2021-01-03T12:38:42.655 INFO:root:teuthology version: 1.0.0-8e49dda4 2021-01-03T12:38:42.657 DEBUG:teuthology.run:Teuthology command: teuthology --lock --archive /home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047 --block --verbose --description fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} --name teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi --owner scheduled_teuthology@teuthology -- /tmp/teuthology-worker.t8wuxor9.tmp 2021-01-03T12:38:42.699 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-03T12:38:42.774 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047 branch: octopus description: fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} email: ceph-qa@ceph.io first_in_suite: false job_id: '5752047' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: octopus ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - POOL_APP_NOT_ENABLED - has not responded to cap revoke by MDS for over - MDS_CLIENT_LATE_RELEASE - responding to mclientcaps sha1: 2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: octopus sha1: 2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e owner: scheduled_teuthology@teuthology priority: 1000 repo: git://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 sha1: 2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e sleep_before_teardown: 0 suite: fs suite_branch: octopus suite_path: /home/teuthworker/src/git.ceph.com_ceph_octopus/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph.git suite_sha1: 2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_misc teuthology_branch: master timestamp: 2021-01-03_04:10:03 tube: smithi user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.4370 2021-01-03T12:38:42.775 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_octopus/qa; will attempt to use it 2021-01-03T12:38:42.776 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks 2021-01-03T12:38:42.776 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-01-03T12:38:42.778 INFO:teuthology.task.internal:Checking packages... 2021-01-03T12:38:42.804 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e' 2021-01-03T12:38:42.804 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-01-03T12:38:42.805 INFO:teuthology.packaging:ref: None 2021-01-03T12:38:42.805 INFO:teuthology.packaging:tag: None 2021-01-03T12:38:42.805 INFO:teuthology.packaging:branch: octopus 2021-01-03T12:38:42.806 INFO:teuthology.packaging:sha1: 2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e 2021-01-03T12:38:42.806 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=octopus 2021-01-03T12:38:43.030 INFO:teuthology.task.internal:Found packages for ceph version 15.2.8-57-g2eacca1e-1bionic 2021-01-03T12:38:43.031 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-01-03T12:38:43.039 INFO:teuthology.task.internal:no buildpackages task found 2021-01-03T12:38:43.039 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2021-01-03T12:38:43.069 INFO:teuthology.task.internal.lock_machines:Locking machines... 2021-01-03T12:38:43.070 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-03T12:38:43.128 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:38:53.143 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 1)... 2021-01-03T12:39:03.159 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 1)... 2021-01-03T12:39:13.175 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 1)... 2021-01-03T12:39:23.190 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 1)... 2021-01-03T12:39:33.208 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 1)... 2021-01-03T12:39:43.225 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:39:53.242 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:40:03.258 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:40:13.274 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:40:23.292 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:40:33.312 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:40:43.323 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:40:53.339 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:41:03.355 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:41:13.368 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:41:23.385 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:41:33.403 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:41:43.421 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:41:53.441 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:42:03.459 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 1)... 2021-01-03T12:42:13.475 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 1)... 2021-01-03T12:42:23.493 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 1)... 2021-01-03T12:42:33.513 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 1)... 2021-01-03T12:42:43.529 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 1)... 2021-01-03T12:42:53.546 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 1)... 2021-01-03T12:43:03.562 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 1)... 2021-01-03T12:43:13.578 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 1)... 2021-01-03T12:43:23.595 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 1)... 2021-01-03T12:43:33.611 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 1)... 2021-01-03T12:43:43.625 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:43:53.648 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:44:03.667 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:44:13.683 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:44:23.698 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:44:33.716 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:44:43.731 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:44:53.745 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:45:03.765 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:45:13.782 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:45:23.799 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2021-01-03T12:45:33.815 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:45:43.832 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2021-01-03T12:45:53.851 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 2)... 2021-01-03T12:46:03.870 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:46:13.887 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 3)... 2021-01-03T12:46:23.904 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:46:33.921 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:46:43.939 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 0)... 2021-01-03T12:46:53.955 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 4, have 3)... 2021-01-03T12:47:03.971 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_teuthology@teuthology', 'count': 4, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047'} 2021-01-03T12:47:03.995 DEBUG:teuthology.lock.ops:locked ubuntu@smithi133.front.sepia.ceph.com, ubuntu@smithi016.front.sepia.ceph.com, ubuntu@smithi007.front.sepia.ceph.com, ubuntu@smithi036.front.sepia.ceph.com 2021-01-03T12:47:04.092 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1dc3792ea0>, signals=[15]) 2021-01-03T12:47:04.319 INFO:teuthology.provision.fog.smithi036:Scheduling deploy of ubuntu 18.04 2021-01-03T12:47:04.325 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of ubuntu 18.04 2021-01-03T12:47:04.329 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of ubuntu 18.04 2021-01-03T12:47:04.332 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of ubuntu 18.04 2021-01-03T12:47:04.752 INFO:teuthology.orchestra.console:Power off smithi007 2021-01-03T12:47:04.753 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-01-03T12:47:04.782 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:04.798 INFO:teuthology.orchestra.console:Power off smithi133 2021-01-03T12:47:04.799 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-01-03T12:47:04.822 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:04.838 INFO:teuthology.orchestra.console:Power off smithi036 2021-01-03T12:47:04.839 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-01-03T12:47:04.861 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:04.875 INFO:teuthology.orchestra.console:Power off smithi016 2021-01-03T12:47:04.876 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-01-03T12:47:04.898 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:08.810 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:08.849 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:08.885 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:08.924 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:12.924 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:12.961 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:12.996 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:13.035 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:13.170 INFO:teuthology.orchestra.console:Power off for smithi133 completed 2021-01-03T12:47:13.206 INFO:teuthology.orchestra.console:Power off for smithi036 completed 2021-01-03T12:47:13.272 INFO:teuthology.orchestra.console:Power on smithi133 2021-01-03T12:47:13.273 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-01-03T12:47:13.292 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:13.308 INFO:teuthology.orchestra.console:Power on smithi036 2021-01-03T12:47:13.308 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-01-03T12:47:13.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:17.037 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:17.145 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:17.254 INFO:teuthology.orchestra.console:Power off for smithi007 completed 2021-01-03T12:47:17.316 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:17.349 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:17.360 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2021-01-03T12:47:17.361 INFO:teuthology.orchestra.console:Power on smithi007 2021-01-03T12:47:17.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-01-03T12:47:17.381 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:17.461 INFO:teuthology.orchestra.console:Power on smithi016 2021-01-03T12:47:17.462 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-01-03T12:47:17.481 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:21.406 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:21.427 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:21.469 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi036.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:21.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:21.667 INFO:teuthology.orchestra.console:Power on for smithi133 completed 2021-01-03T12:47:21.679 INFO:teuthology.orchestra.console:Power on for smithi036 completed 2021-01-03T12:47:21.712 INFO:teuthology.orchestra.console:Power on for smithi016 completed 2021-01-03T12:47:21.768 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2021-01-03T12:47:21.780 INFO:teuthology.provision.fog.smithi036:Waiting for deploy to finish 2021-01-03T12:47:21.813 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2021-01-03T12:47:25.519 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-03T12:47:25.730 INFO:teuthology.orchestra.console:Power on for smithi007 completed 2021-01-03T12:47:25.831 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish 2021-01-03T12:49:53.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:02.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:08.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:08.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:08.648 ERROR:teuthology.orchestra.connection:Error connecting to smithi133.front.sepia.ceph.com Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/connection.py", line 105, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 446, in connect passphrase, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 764, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 740, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 1580, in auth_publickey return self.auth_handler.wait_for_response(my_event) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/auth_handler.py", line 250, in wait_for_response raise e paramiko.ssh_exception.AuthenticationException: Authentication failed. 2021-01-03T12:50:11.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:12.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:17.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:20.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:21.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:26.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:29.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:30.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:35.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:38.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:39.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:44.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:47.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:48.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:50:53.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:15.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:18.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:25.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:25.384 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-01-03T12:51:25.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:25.888 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-01-03T12:51:26.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:26.234 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-01-03T12:51:31.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:31.397 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-01-03T12:51:31.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:31.901 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-01-03T12:51:32.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:32.247 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-01-03T12:51:37.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:37.410 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-01-03T12:51:37.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:37.913 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-01-03T12:51:38.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:38.258 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-01-03T12:51:38.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:43.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:43.495 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-01-03T12:51:43.497 DEBUG:teuthology.orchestra.run.smithi036:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-01-03T12:51:43.835 INFO:teuthology.provision.fog.smithi036:Node is ready 2021-01-03T12:51:43.836 DEBUG:teuthology.orchestra.run.smithi036:> hostname 2021-01-03T12:51:43.884 INFO:teuthology.orchestra.run.smithi036.stdout:smithi036.front.sepia.ceph.com 2021-01-03T12:51:43.885 DEBUG:teuthology.orchestra.run.smithi036:> grep smithi036.front.sepia.ceph.com /etc/hosts 2021-01-03T12:51:43.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:43.925 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-01-03T12:51:43.933 INFO:teuthology.orchestra.run.smithi036.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2021-01-03T12:51:43.933 DEBUG:teuthology.orchestra.run.smithi036:> sudo hostname smithi036 2021-01-03T12:51:44.025 DEBUG:teuthology.orchestra.run.smithi036:> sudo sed -i -e 's/smithi036.front.sepia.ceph.com/smithi036/g' /etc/hosts 2021-01-03T12:51:44.041 DEBUG:teuthology.orchestra.run.smithi036:> sudo sed -i -e 's/172.21.15.36/172.21.15.36/g' /etc/hosts 2021-01-03T12:51:44.098 DEBUG:teuthology.orchestra.run.smithi036:> sudo sed -i -e 's/smithi036.front.sepia.ceph.com/smithi036/g' /etc/hostname 2021-01-03T12:51:44.152 DEBUG:teuthology.orchestra.run.smithi036:> sudo hostname smithi036 2021-01-03T12:51:44.208 INFO:teuthology.provision.fog.smithi036:Deploy complete! 2021-01-03T12:51:44.209 DEBUG:teuthology.parallel:result is None 2021-01-03T12:51:44.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:44.272 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-01-03T12:51:47.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:49.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:50.006 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-01-03T12:51:50.007 DEBUG:teuthology.orchestra.run.smithi007:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-01-03T12:51:50.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:51:50.357 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-01-03T12:51:50.357 DEBUG:teuthology.orchestra.run.smithi016:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-01-03T12:51:50.379 INFO:teuthology.provision.fog.smithi007:Node is ready 2021-01-03T12:51:50.380 DEBUG:teuthology.orchestra.run.smithi007:> hostname 2021-01-03T12:51:50.425 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com 2021-01-03T12:51:50.425 DEBUG:teuthology.orchestra.run.smithi007:> grep smithi007.front.sepia.ceph.com /etc/hosts 2021-01-03T12:51:50.474 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007 2021-01-03T12:51:50.475 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2021-01-03T12:51:50.543 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hosts 2021-01-03T12:51:50.599 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/172.21.15.7/172.21.15.7/g' /etc/hosts 2021-01-03T12:51:50.656 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hostname 2021-01-03T12:51:50.711 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2021-01-03T12:51:50.739 INFO:teuthology.provision.fog.smithi016:Node is ready 2021-01-03T12:51:50.740 DEBUG:teuthology.orchestra.run.smithi016:> hostname 2021-01-03T12:51:50.764 INFO:teuthology.provision.fog.smithi007:Deploy complete! 2021-01-03T12:51:50.764 DEBUG:teuthology.parallel:result is None 2021-01-03T12:51:50.788 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com 2021-01-03T12:51:50.789 DEBUG:teuthology.orchestra.run.smithi016:> grep smithi016.front.sepia.ceph.com /etc/hosts 2021-01-03T12:51:50.837 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016 2021-01-03T12:51:50.838 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2021-01-03T12:51:51.009 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hosts 2021-01-03T12:51:51.024 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/172.21.15.16/172.21.15.16/g' /etc/hosts 2021-01-03T12:51:51.079 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hostname 2021-01-03T12:51:51.138 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2021-01-03T12:51:51.190 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2021-01-03T12:51:51.190 DEBUG:teuthology.parallel:result is None 2021-01-03T12:51:56.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:52:05.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:52:05.117 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-01-03T12:52:05.117 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-01-03T12:52:05.490 INFO:teuthology.provision.fog.smithi133:Node is ready 2021-01-03T12:52:05.490 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2021-01-03T12:52:05.541 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2021-01-03T12:52:05.542 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2021-01-03T12:52:05.592 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2021-01-03T12:52:05.592 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2021-01-03T12:52:05.696 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2021-01-03T12:52:05.709 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2021-01-03T12:52:05.790 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2021-01-03T12:52:05.840 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2021-01-03T12:52:05.892 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2021-01-03T12:52:05.892 DEBUG:teuthology.parallel:result is None 2021-01-03T12:52:06.085 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2021-01-03T12:52:06.086 INFO:teuthology.lock.ops:New key found. Updating... 2021-01-03T12:52:06.109 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com 2021-01-03T12:52:06.110 INFO:teuthology.lock.ops:New key found. Updating... 2021-01-03T12:52:06.123 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com 2021-01-03T12:52:06.123 INFO:teuthology.lock.ops:New key found. Updating... 2021-01-03T12:52:06.136 INFO:teuthology.lock.ops:Checking smithi036.front.sepia.ceph.com 2021-01-03T12:52:06.136 INFO:teuthology.lock.ops:New key found. Updating... 2021-01-03T12:52:06.150 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2021-01-03T12:52:06.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-03T12:52:06.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:52:06.217 DEBUG:teuthology.orchestra.run.smithi133:> true 2021-01-03T12:52:06.407 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2021-01-03T12:52:06.454 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2021-01-03T12:52:06.455 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2021-01-03T12:52:06.502 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2021-01-03T12:52:06.503 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-01-03T12:52:06.503 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2021-01-03T12:52:06.503 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2021-01-03T12:52:06.503 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-01-03T12:52:06.503 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="18.04" 2021-01-03T12:52:06.504 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-03T12:52:06.504 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-03T12:52:06.505 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-03T12:52:06.506 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-03T12:52:06.506 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=bionic 2021-01-03T12:52:06.506 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=bionic 2021-01-03T12:52:06.507 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2021-01-03T12:52:06.523 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server 2021-01-03T12:52:06.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-03T12:52:06.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:52:06.598 DEBUG:teuthology.orchestra.run.smithi016:> true 2021-01-03T12:52:06.799 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2021-01-03T12:52:06.850 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2021-01-03T12:52:06.850 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2021-01-03T12:52:06.900 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Ubuntu" 2021-01-03T12:52:06.900 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-01-03T12:52:06.901 INFO:teuthology.orchestra.run.smithi016.stdout:ID=ubuntu 2021-01-03T12:52:06.901 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE=debian 2021-01-03T12:52:06.901 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-01-03T12:52:06.901 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="18.04" 2021-01-03T12:52:06.902 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-03T12:52:06.902 INFO:teuthology.orchestra.run.smithi016.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-03T12:52:06.902 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-03T12:52:06.902 INFO:teuthology.orchestra.run.smithi016.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-03T12:52:06.902 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_CODENAME=bionic 2021-01-03T12:52:06.903 INFO:teuthology.orchestra.run.smithi016.stdout:UBUNTU_CODENAME=bionic 2021-01-03T12:52:06.903 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2021-01-03T12:52:06.919 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server 2021-01-03T12:52:06.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-03T12:52:06.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:52:06.996 DEBUG:teuthology.orchestra.run.smithi007:> true 2021-01-03T12:52:07.203 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2021-01-03T12:52:07.249 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2021-01-03T12:52:07.250 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2021-01-03T12:52:07.297 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Ubuntu" 2021-01-03T12:52:07.298 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-01-03T12:52:07.298 INFO:teuthology.orchestra.run.smithi007.stdout:ID=ubuntu 2021-01-03T12:52:07.298 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE=debian 2021-01-03T12:52:07.298 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-01-03T12:52:07.298 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="18.04" 2021-01-03T12:52:07.299 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-03T12:52:07.299 INFO:teuthology.orchestra.run.smithi007.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-03T12:52:07.299 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-03T12:52:07.299 INFO:teuthology.orchestra.run.smithi007.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-03T12:52:07.299 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_CODENAME=bionic 2021-01-03T12:52:07.300 INFO:teuthology.orchestra.run.smithi007.stdout:UBUNTU_CODENAME=bionic 2021-01-03T12:52:07.300 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2021-01-03T12:52:07.317 INFO:teuthology.lock.ops:Updating [smithi036.front.sepia.ceph.com]: set os type and version on server 2021-01-03T12:52:07.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-03T12:52:07.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:52:07.390 DEBUG:teuthology.orchestra.run.smithi036:> true 2021-01-03T12:52:07.643 DEBUG:teuthology.orchestra.run.smithi036:> uname -m 2021-01-03T12:52:07.692 INFO:teuthology.orchestra.run.smithi036.stdout:x86_64 2021-01-03T12:52:07.692 DEBUG:teuthology.orchestra.run.smithi036:> cat /etc/os-release 2021-01-03T12:52:07.740 INFO:teuthology.orchestra.run.smithi036.stdout:NAME="Ubuntu" 2021-01-03T12:52:07.740 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-01-03T12:52:07.740 INFO:teuthology.orchestra.run.smithi036.stdout:ID=ubuntu 2021-01-03T12:52:07.740 INFO:teuthology.orchestra.run.smithi036.stdout:ID_LIKE=debian 2021-01-03T12:52:07.741 INFO:teuthology.orchestra.run.smithi036.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-01-03T12:52:07.741 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_ID="18.04" 2021-01-03T12:52:07.741 INFO:teuthology.orchestra.run.smithi036.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-03T12:52:07.741 INFO:teuthology.orchestra.run.smithi036.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-03T12:52:07.741 INFO:teuthology.orchestra.run.smithi036.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-03T12:52:07.742 INFO:teuthology.orchestra.run.smithi036.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-03T12:52:07.742 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_CODENAME=bionic 2021-01-03T12:52:07.742 INFO:teuthology.orchestra.run.smithi036.stdout:UBUNTU_CODENAME=bionic 2021-01-03T12:52:07.743 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2021-01-03T12:52:07.758 INFO:teuthology.task.internal.lock_machines:4 smithi machines locked this try, 4/4 locked so far 2021-01-03T12:52:07.827 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi007.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5RxZrY6MNoO0UDjdwecJbjMPi6VpX1Pk94MWGlqqIouxkCjybzA1ZwkKklC427cwogL791Cz+w40LCFtsXJ9NNbVdUsJtdXkzg9F9VJLpgMNZcgAQbEh8/aglcYREZyCkiNoKsE1GfzJDY1rIO7mxF0/6MFCeTmJja0/HselyQtwwJfUFwl5CFUjH+2WLQvwaLMyu5gA/KckuBdjsrXDEmKQIV90cRI29Jysa5WtLo9h1XCcEIbentvkdqkipaDOT3jDUyQJBjJBXeOPqVOPrcb1WcPVjDyjJ5wZTPBD2KaK6VhfUdkSsTfPP60AEMytcWbTGP0ziT0DfUm3bPIG3 smithi016.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDGNSVgMClNsMwhmFY1moYuCANCN1aU8Ooiqyd9TN8LG7vWF+K5MXANaQTgL+S2hMxwSyzyQSQIBSopWZWiKbtY4dn6DgvxDNyUnvySC01GHu9O7uZTG27cNBOwudq0Np1uB2pZwomuFiYSJC7ZA0t7TKR72N5t5+oxMvD476UuSCG5+2ZjG5ws99G4ZeRMq4/XRDlO1RqMfxTV2esl3WfwFcCUG4jLI8rej9JWS/aJkKUcfhWTVj5N1AN4KpMaBE8tyIe6O+PCaW6aZSIIXCPu+zB7vwzi8so9bommSjRDpXXoc1gpLrUz4WBWgBDRii1FWfqj7cYveGD9tFEuCHPt smithi036.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6SuaDIwK1lIQhGUQZYAsmWzFCJLb8rHAPtJmdHrlbXPuCclTebusChAjInrnDDpJmaUfBQXAsWA+8t5Ff16CbuIxEv7BKK0h9rHxaYn1+LQaSw9EaGp2BZ65Yevtx3A2Yb8Nhww0hX0RJQ125GAdRMmc7YtbaUcUydcSDeSBdE1nlAzGNbCH5Tnc0Lj7cOa4PoYbwFDfLhJ6IpKH0jGMUWNwvAN5mgkQIsgwJAko/oclhezZJxYtrCeDF/jt5c8ZwN8oB/9AnGYqCfovDos56oSXFoTrzXUgdhdxHzoTvEHYczJfsUQ0te7XsCYeODOta3AcQjg9maykWZvXDtkw/ smithi133.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDciI2lV3NHsKiA4JA9afsnMRR1tlBP0uZP2SK36TVPUKwtfBGfBB57OIcIzSFQmcNsQN4WIGlWe9VgZdVfwaH+ucXgwjZV7GXz3AUYYNKagKV+lNdbgvLXDAxKdwUxFcEVCcjFXA5fEWfuED2ZbosjdoJPSYOElC0Erc/oGaGgXbMdDsTjtCfTShcsDVvy0r8ntRzKy5osPbvOBtnqW8ho5Qznp14XuunUj1EVMUOg6p6aMfuf+m6frrwbx7pxEEBbUoH1Z2sykMUADgB43A+T/C30fgNEJuVG3lX3Yr4Qt1cO2Y4G5/XAlWYIypFnElcrloGFXAqGbrh7tVFlRhiv 2021-01-03T12:52:07.828 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-03T12:52:07.889 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-01-03T12:52:07.898 INFO:teuthology.task.internal:Saving configuration 2021-01-03T12:52:07.915 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-01-03T12:52:07.924 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-01-03T12:52:07.942 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-01-03 12:47:03.978675', 'description': '/home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047', 'locked_by': 'scheduled_teuthology@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOzUuinmgU/+KWoX0X5721Yzr3yTNZrvzT7AN5oFvQx8', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi133.front.sepia.ceph.com'} 2021-01-03T12:52:07.957 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-01-03 12:47:03.978695', 'description': '/home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047', 'locked_by': 'scheduled_teuthology@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOG7B/kXnxBDzX7pFx4av9FVNxTyToK1JviXeS/hQEAs', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi016.front.sepia.ceph.com'} 2021-01-03T12:52:07.973 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-01-03 12:47:03.978709', 'description': '/home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047', 'locked_by': 'scheduled_teuthology@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIN8Gk+4wW0LPUmPMu01u9vYT/TjDmDmePXHgxKB7brvp', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi007.front.sepia.ceph.com'} 2021-01-03T12:52:07.989 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-01-03 12:47:03.978748', 'description': '/home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047', 'locked_by': 'scheduled_teuthology@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBNhybT76l16IbGh307/vbXZa7TwnBDCVG7QmiaEBHqs', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi036.front.sepia.ceph.com'} 2021-01-03T12:52:07.989 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-01-03T12:52:07.997 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2021-01-03T12:52:07.998 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2021-01-03T12:52:07.998 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['client.0'] 2021-01-03T12:52:07.998 INFO:teuthology.task.internal:roles: ubuntu@smithi036.front.sepia.ceph.com - ['client.1'] 2021-01-03T12:52:07.999 INFO:teuthology.run_tasks:Running task console_log... 2021-01-03T12:52:08.135 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1dc3792598>, signals=[15]) 2021-01-03T12:52:08.136 INFO:teuthology.run_tasks:Running task internal.connect... 2021-01-03T12:52:08.143 INFO:teuthology.task.internal:Opening connections... 2021-01-03T12:52:08.143 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2021-01-03T12:52:08.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:52:08.223 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2021-01-03T12:52:08.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:52:08.295 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2021-01-03T12:52:08.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:52:08.370 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi036.front.sepia.ceph.com 2021-01-03T12:52:08.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:52:08.446 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-01-03T12:52:08.453 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2021-01-03T12:52:08.460 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2021-01-03T12:52:08.460 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2021-01-03T12:52:08.506 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2021-01-03T12:52:08.507 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-01-03T12:52:08.507 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2021-01-03T12:52:08.507 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2021-01-03T12:52:08.507 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-01-03T12:52:08.507 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="18.04" 2021-01-03T12:52:08.508 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-03T12:52:08.508 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-03T12:52:08.508 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-03T12:52:08.508 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-03T12:52:08.508 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=bionic 2021-01-03T12:52:08.509 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=bionic 2021-01-03T12:52:08.509 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2021-01-03T12:52:08.524 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2021-01-03T12:52:08.531 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2021-01-03T12:52:08.531 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2021-01-03T12:52:08.579 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Ubuntu" 2021-01-03T12:52:08.579 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-01-03T12:52:08.580 INFO:teuthology.orchestra.run.smithi016.stdout:ID=ubuntu 2021-01-03T12:52:08.580 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE=debian 2021-01-03T12:52:08.580 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-01-03T12:52:08.580 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="18.04" 2021-01-03T12:52:08.580 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-03T12:52:08.581 INFO:teuthology.orchestra.run.smithi016.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-03T12:52:08.581 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-03T12:52:08.581 INFO:teuthology.orchestra.run.smithi016.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-03T12:52:08.581 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_CODENAME=bionic 2021-01-03T12:52:08.582 INFO:teuthology.orchestra.run.smithi016.stdout:UBUNTU_CODENAME=bionic 2021-01-03T12:52:08.582 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2021-01-03T12:52:08.597 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2021-01-03T12:52:08.603 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2021-01-03T12:52:08.603 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2021-01-03T12:52:08.650 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Ubuntu" 2021-01-03T12:52:08.650 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-01-03T12:52:08.650 INFO:teuthology.orchestra.run.smithi007.stdout:ID=ubuntu 2021-01-03T12:52:08.651 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE=debian 2021-01-03T12:52:08.651 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-01-03T12:52:08.651 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="18.04" 2021-01-03T12:52:08.651 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-03T12:52:08.651 INFO:teuthology.orchestra.run.smithi007.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-03T12:52:08.652 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-03T12:52:08.652 INFO:teuthology.orchestra.run.smithi007.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-03T12:52:08.652 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_CODENAME=bionic 2021-01-03T12:52:08.652 INFO:teuthology.orchestra.run.smithi007.stdout:UBUNTU_CODENAME=bionic 2021-01-03T12:52:08.653 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2021-01-03T12:52:08.667 DEBUG:teuthology.orchestra.run.smithi036:> uname -m 2021-01-03T12:52:08.673 INFO:teuthology.orchestra.run.smithi036.stdout:x86_64 2021-01-03T12:52:08.673 DEBUG:teuthology.orchestra.run.smithi036:> cat /etc/os-release 2021-01-03T12:52:08.719 INFO:teuthology.orchestra.run.smithi036.stdout:NAME="Ubuntu" 2021-01-03T12:52:08.720 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-01-03T12:52:08.720 INFO:teuthology.orchestra.run.smithi036.stdout:ID=ubuntu 2021-01-03T12:52:08.720 INFO:teuthology.orchestra.run.smithi036.stdout:ID_LIKE=debian 2021-01-03T12:52:08.720 INFO:teuthology.orchestra.run.smithi036.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-01-03T12:52:08.720 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_ID="18.04" 2021-01-03T12:52:08.721 INFO:teuthology.orchestra.run.smithi036.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-03T12:52:08.721 INFO:teuthology.orchestra.run.smithi036.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-03T12:52:08.721 INFO:teuthology.orchestra.run.smithi036.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-03T12:52:08.721 INFO:teuthology.orchestra.run.smithi036.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-03T12:52:08.721 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_CODENAME=bionic 2021-01-03T12:52:08.722 INFO:teuthology.orchestra.run.smithi036.stdout:UBUNTU_CODENAME=bionic 2021-01-03T12:52:08.722 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2021-01-03T12:52:08.739 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-01-03T12:52:08.776 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-01-03T12:52:08.850 INFO:teuthology.task.internal:Checking for old test directory... 2021-01-03T12:52:08.850 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2021-01-03T12:52:08.853 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2021-01-03T12:52:08.855 DEBUG:teuthology.orchestra.run.smithi036:> test '!' -e /home/ubuntu/cephtest 2021-01-03T12:52:08.858 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2021-01-03T12:52:08.864 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-01-03T12:52:08.914 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-01-03T12:52:08.915 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2021-01-03T12:52:08.917 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2021-01-03T12:52:08.919 DEBUG:teuthology.orchestra.run.smithi036:> test -z $(ls -A /var/lib/ceph) 2021-01-03T12:52:08.921 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2021-01-03T12:52:08.932 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-01-03T12:52:09.022 INFO:teuthology.run_tasks:Running task kernel... 2021-01-03T12:52:09.039 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'mds.c': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}} 2021-01-03T12:52:09.040 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-01-03T12:52:09.040 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2021-01-03T12:52:09.046 INFO:teuthology.orchestra.run.smithi133.stdout:4.15.0-128-generic 2021-01-03T12:52:09.047 INFO:teuthology.task.kernel:Running kernel on smithi133: 4.15.0-128-generic 2021-01-03T12:52:09.047 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get clean 2021-01-03T12:52:09.187 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get update 2021-01-03T12:52:09.451 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-01-03T12:52:09.452 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-01-03T12:52:09.509 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-01-03T12:52:09.804 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-01-03T12:52:10.156 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 252 kB in 1s (326 kB/s) 2021-01-03T12:52:11.795 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2021-01-03T12:52:11.842 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-03T12:52:11.924 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2021-01-03T12:52:12.186 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2021-01-03T12:52:12.187 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2021-01-03T12:52:12.269 INFO:teuthology.orchestra.run.smithi133.stderr:E: Unable to locate package linux-image-current-generic 2021-01-03T12:52:12.270 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-03T12:52:12.271 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-03T12:52:12.349 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2021-01-03T12:52:12.608 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2021-01-03T12:52:12.609 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2021-01-03T12:52:12.815 INFO:teuthology.orchestra.run.smithi133.stdout:linux-image-generic is already the newest version (4.15.0.128.115). 2021-01-03T12:52:12.815 INFO:teuthology.orchestra.run.smithi133.stdout:linux-image-generic set to manually installed. 2021-01-03T12:52:12.815 INFO:teuthology.orchestra.run.smithi133.stdout:0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 2021-01-03T12:52:12.818 DEBUG:teuthology.orchestra.run.smithi133:> dpkg -s linux-image-generic 2021-01-03T12:52:12.841 INFO:teuthology.orchestra.run.smithi133.stdout:Package: linux-image-generic 2021-01-03T12:52:12.841 INFO:teuthology.orchestra.run.smithi133.stdout:Status: install ok installed 2021-01-03T12:52:12.841 INFO:teuthology.orchestra.run.smithi133.stdout:Priority: optional 2021-01-03T12:52:12.841 INFO:teuthology.orchestra.run.smithi133.stdout:Section: kernel 2021-01-03T12:52:12.842 INFO:teuthology.orchestra.run.smithi133.stdout:Installed-Size: 16 2021-01-03T12:52:12.842 INFO:teuthology.orchestra.run.smithi133.stdout:Maintainer: Ubuntu Kernel Team 2021-01-03T12:52:12.842 INFO:teuthology.orchestra.run.smithi133.stdout:Architecture: amd64 2021-01-03T12:52:12.842 INFO:teuthology.orchestra.run.smithi133.stdout:Source: linux-meta 2021-01-03T12:52:12.842 INFO:teuthology.orchestra.run.smithi133.stdout:Version: 4.15.0.128.115 2021-01-03T12:52:12.843 INFO:teuthology.orchestra.run.smithi133.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-01-03T12:52:12.843 INFO:teuthology.orchestra.run.smithi133.stdout:Depends: linux-image-4.15.0-128-generic, linux-modules-extra-4.15.0-128-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-03T12:52:12.843 INFO:teuthology.orchestra.run.smithi133.stdout:Recommends: thermald 2021-01-03T12:52:12.843 INFO:teuthology.orchestra.run.smithi133.stdout:Description: Generic Linux kernel image 2021-01-03T12:52:12.844 INFO:teuthology.orchestra.run.smithi133.stdout: This package will always depend on the latest generic kernel image 2021-01-03T12:52:12.844 INFO:teuthology.orchestra.run.smithi133.stdout: available. 2021-01-03T12:52:12.844 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-01-03T12:52:12.844 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2021-01-03T12:52:12.851 INFO:teuthology.orchestra.run.smithi016.stdout:4.15.0-128-generic 2021-01-03T12:52:12.851 INFO:teuthology.task.kernel:Running kernel on smithi016: 4.15.0-128-generic 2021-01-03T12:52:12.851 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get clean 2021-01-03T12:52:12.976 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get update 2021-01-03T12:52:13.300 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-01-03T12:52:13.300 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-01-03T12:52:13.337 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-01-03T12:52:13.603 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-01-03T12:52:14.009 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 252 kB in 1s (310 kB/s) 2021-01-03T12:52:15.696 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2021-01-03T12:52:15.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-03T12:52:15.827 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2021-01-03T12:52:16.090 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2021-01-03T12:52:16.091 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2021-01-03T12:52:16.183 INFO:teuthology.orchestra.run.smithi016.stderr:E: Unable to locate package linux-image-current-generic 2021-01-03T12:52:16.184 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-03T12:52:16.185 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-03T12:52:16.266 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2021-01-03T12:52:16.537 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2021-01-03T12:52:16.538 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2021-01-03T12:52:16.753 INFO:teuthology.orchestra.run.smithi016.stdout:linux-image-generic is already the newest version (4.15.0.128.115). 2021-01-03T12:52:16.754 INFO:teuthology.orchestra.run.smithi016.stdout:linux-image-generic set to manually installed. 2021-01-03T12:52:16.754 INFO:teuthology.orchestra.run.smithi016.stdout:0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 2021-01-03T12:52:16.755 DEBUG:teuthology.orchestra.run.smithi016:> dpkg -s linux-image-generic 2021-01-03T12:52:16.778 INFO:teuthology.orchestra.run.smithi016.stdout:Package: linux-image-generic 2021-01-03T12:52:16.778 INFO:teuthology.orchestra.run.smithi016.stdout:Status: install ok installed 2021-01-03T12:52:16.779 INFO:teuthology.orchestra.run.smithi016.stdout:Priority: optional 2021-01-03T12:52:16.779 INFO:teuthology.orchestra.run.smithi016.stdout:Section: kernel 2021-01-03T12:52:16.779 INFO:teuthology.orchestra.run.smithi016.stdout:Installed-Size: 16 2021-01-03T12:52:16.779 INFO:teuthology.orchestra.run.smithi016.stdout:Maintainer: Ubuntu Kernel Team 2021-01-03T12:52:16.779 INFO:teuthology.orchestra.run.smithi016.stdout:Architecture: amd64 2021-01-03T12:52:16.780 INFO:teuthology.orchestra.run.smithi016.stdout:Source: linux-meta 2021-01-03T12:52:16.780 INFO:teuthology.orchestra.run.smithi016.stdout:Version: 4.15.0.128.115 2021-01-03T12:52:16.780 INFO:teuthology.orchestra.run.smithi016.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-01-03T12:52:16.780 INFO:teuthology.orchestra.run.smithi016.stdout:Depends: linux-image-4.15.0-128-generic, linux-modules-extra-4.15.0-128-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-03T12:52:16.780 INFO:teuthology.orchestra.run.smithi016.stdout:Recommends: thermald 2021-01-03T12:52:16.781 INFO:teuthology.orchestra.run.smithi016.stdout:Description: Generic Linux kernel image 2021-01-03T12:52:16.781 INFO:teuthology.orchestra.run.smithi016.stdout: This package will always depend on the latest generic kernel image 2021-01-03T12:52:16.781 INFO:teuthology.orchestra.run.smithi016.stdout: available. 2021-01-03T12:52:16.781 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-01-03T12:52:16.782 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2021-01-03T12:52:16.789 INFO:teuthology.orchestra.run.smithi007.stdout:4.15.0-128-generic 2021-01-03T12:52:16.790 INFO:teuthology.task.kernel:Running kernel on smithi007: 4.15.0-128-generic 2021-01-03T12:52:16.790 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get clean 2021-01-03T12:52:16.921 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get update 2021-01-03T12:52:17.083 INFO:teuthology.orchestra.run.smithi007.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-01-03T12:52:17.200 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-01-03T12:52:17.280 INFO:teuthology.orchestra.run.smithi007.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-01-03T12:52:17.554 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-01-03T12:52:17.871 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 252 kB in 1s (348 kB/s) 2021-01-03T12:52:19.731 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2021-01-03T12:52:19.779 DEBUG:teuthology.orchestra.run.smithi007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-03T12:52:19.870 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2021-01-03T12:52:20.134 INFO:teuthology.orchestra.run.smithi007.stdout:Building dependency tree... 2021-01-03T12:52:20.134 INFO:teuthology.orchestra.run.smithi007.stdout:Reading state information... 2021-01-03T12:52:20.220 INFO:teuthology.orchestra.run.smithi007.stderr:E: Unable to locate package linux-image-current-generic 2021-01-03T12:52:20.221 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-03T12:52:20.222 DEBUG:teuthology.orchestra.run.smithi007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-03T12:52:20.306 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2021-01-03T12:52:20.563 INFO:teuthology.orchestra.run.smithi007.stdout:Building dependency tree... 2021-01-03T12:52:20.564 INFO:teuthology.orchestra.run.smithi007.stdout:Reading state information... 2021-01-03T12:52:20.778 INFO:teuthology.orchestra.run.smithi007.stdout:linux-image-generic is already the newest version (4.15.0.128.115). 2021-01-03T12:52:20.778 INFO:teuthology.orchestra.run.smithi007.stdout:linux-image-generic set to manually installed. 2021-01-03T12:52:20.779 INFO:teuthology.orchestra.run.smithi007.stdout:0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 2021-01-03T12:52:20.780 DEBUG:teuthology.orchestra.run.smithi007:> dpkg -s linux-image-generic 2021-01-03T12:52:20.805 INFO:teuthology.orchestra.run.smithi007.stdout:Package: linux-image-generic 2021-01-03T12:52:20.805 INFO:teuthology.orchestra.run.smithi007.stdout:Status: install ok installed 2021-01-03T12:52:20.805 INFO:teuthology.orchestra.run.smithi007.stdout:Priority: optional 2021-01-03T12:52:20.805 INFO:teuthology.orchestra.run.smithi007.stdout:Section: kernel 2021-01-03T12:52:20.806 INFO:teuthology.orchestra.run.smithi007.stdout:Installed-Size: 16 2021-01-03T12:52:20.806 INFO:teuthology.orchestra.run.smithi007.stdout:Maintainer: Ubuntu Kernel Team 2021-01-03T12:52:20.806 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: amd64 2021-01-03T12:52:20.807 INFO:teuthology.orchestra.run.smithi007.stdout:Source: linux-meta 2021-01-03T12:52:20.807 INFO:teuthology.orchestra.run.smithi007.stdout:Version: 4.15.0.128.115 2021-01-03T12:52:20.807 INFO:teuthology.orchestra.run.smithi007.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-01-03T12:52:20.808 INFO:teuthology.orchestra.run.smithi007.stdout:Depends: linux-image-4.15.0-128-generic, linux-modules-extra-4.15.0-128-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-03T12:52:20.808 INFO:teuthology.orchestra.run.smithi007.stdout:Recommends: thermald 2021-01-03T12:52:20.809 INFO:teuthology.orchestra.run.smithi007.stdout:Description: Generic Linux kernel image 2021-01-03T12:52:20.809 INFO:teuthology.orchestra.run.smithi007.stdout: This package will always depend on the latest generic kernel image 2021-01-03T12:52:20.810 INFO:teuthology.orchestra.run.smithi007.stdout: available. 2021-01-03T12:52:20.810 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-01-03T12:52:20.811 DEBUG:teuthology.orchestra.run.smithi036:> uname -r 2021-01-03T12:52:20.818 INFO:teuthology.orchestra.run.smithi036.stdout:4.15.0-128-generic 2021-01-03T12:52:20.818 INFO:teuthology.task.kernel:Running kernel on smithi036: 4.15.0-128-generic 2021-01-03T12:52:20.819 DEBUG:teuthology.orchestra.run.smithi036:> sudo apt-get clean 2021-01-03T12:52:20.946 DEBUG:teuthology.orchestra.run.smithi036:> sudo apt-get update 2021-01-03T12:52:21.217 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-01-03T12:52:21.223 INFO:teuthology.orchestra.run.smithi036.stdout:Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-01-03T12:52:21.283 INFO:teuthology.orchestra.run.smithi036.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-01-03T12:52:21.536 INFO:teuthology.orchestra.run.smithi036.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-01-03T12:52:21.952 INFO:teuthology.orchestra.run.smithi036.stdout:Fetched 252 kB in 1s (316 kB/s) 2021-01-03T12:52:22.594 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-01-03T12:52:23.604 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2021-01-03T12:52:23.650 DEBUG:teuthology.orchestra.run.smithi036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-03T12:52:23.734 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2021-01-03T12:52:24.004 INFO:teuthology.orchestra.run.smithi036.stdout:Building dependency tree... 2021-01-03T12:52:24.005 INFO:teuthology.orchestra.run.smithi036.stdout:Reading state information... 2021-01-03T12:52:24.088 INFO:teuthology.orchestra.run.smithi036.stderr:E: Unable to locate package linux-image-current-generic 2021-01-03T12:52:24.090 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-03T12:52:24.090 DEBUG:teuthology.orchestra.run.smithi036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-03T12:52:24.173 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2021-01-03T12:52:24.411 INFO:teuthology.orchestra.run.smithi036.stdout:Building dependency tree... 2021-01-03T12:52:24.412 INFO:teuthology.orchestra.run.smithi036.stdout:Reading state information... 2021-01-03T12:52:24.628 INFO:teuthology.orchestra.run.smithi036.stdout:linux-image-generic is already the newest version (4.15.0.128.115). 2021-01-03T12:52:24.629 INFO:teuthology.orchestra.run.smithi036.stdout:linux-image-generic set to manually installed. 2021-01-03T12:52:24.629 INFO:teuthology.orchestra.run.smithi036.stdout:0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 2021-01-03T12:52:24.630 DEBUG:teuthology.orchestra.run.smithi036:> dpkg -s linux-image-generic 2021-01-03T12:52:24.651 INFO:teuthology.orchestra.run.smithi036.stdout:Package: linux-image-generic 2021-01-03T12:52:24.651 INFO:teuthology.orchestra.run.smithi036.stdout:Status: install ok installed 2021-01-03T12:52:24.652 INFO:teuthology.orchestra.run.smithi036.stdout:Priority: optional 2021-01-03T12:52:24.652 INFO:teuthology.orchestra.run.smithi036.stdout:Section: kernel 2021-01-03T12:52:24.652 INFO:teuthology.orchestra.run.smithi036.stdout:Installed-Size: 16 2021-01-03T12:52:24.652 INFO:teuthology.orchestra.run.smithi036.stdout:Maintainer: Ubuntu Kernel Team 2021-01-03T12:52:24.653 INFO:teuthology.orchestra.run.smithi036.stdout:Architecture: amd64 2021-01-03T12:52:24.653 INFO:teuthology.orchestra.run.smithi036.stdout:Source: linux-meta 2021-01-03T12:52:24.653 INFO:teuthology.orchestra.run.smithi036.stdout:Version: 4.15.0.128.115 2021-01-03T12:52:24.653 INFO:teuthology.orchestra.run.smithi036.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-01-03T12:52:24.653 INFO:teuthology.orchestra.run.smithi036.stdout:Depends: linux-image-4.15.0-128-generic, linux-modules-extra-4.15.0-128-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-03T12:52:24.654 INFO:teuthology.orchestra.run.smithi036.stdout:Recommends: thermald 2021-01-03T12:52:24.654 INFO:teuthology.orchestra.run.smithi036.stdout:Description: Generic Linux kernel image 2021-01-03T12:52:24.654 INFO:teuthology.orchestra.run.smithi036.stdout: This package will always depend on the latest generic kernel image 2021-01-03T12:52:24.654 INFO:teuthology.orchestra.run.smithi036.stdout: available. 2021-01-03T12:52:24.655 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-01-03T12:52:24.655 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-01-03T12:52:24.655 DEBUG:teuthology.orchestra.run.smithi133:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-01-03T12:52:24.768 INFO:teuthology.orchestra.run.smithi133.stdout:ttyS1 2021-01-03T12:52:24.791 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-01-03T12:52:24.791 DEBUG:teuthology.orchestra.run.smithi016:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-01-03T12:52:24.832 INFO:teuthology.orchestra.run.smithi016.stdout:ttyS1 2021-01-03T12:52:24.851 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2021-01-03T12:52:24.851 DEBUG:teuthology.orchestra.run.smithi007:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-01-03T12:52:24.873 INFO:teuthology.orchestra.run.smithi007.stdout:ttyS1 2021-01-03T12:52:24.894 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2021-01-03T12:52:24.895 DEBUG:teuthology.orchestra.run.smithi036:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-01-03T12:52:24.913 INFO:teuthology.orchestra.run.smithi036.stdout:ttyS1 2021-01-03T12:52:24.931 INFO:teuthology.run_tasks:Running task internal.base... 2021-01-03T12:52:24.943 INFO:teuthology.task.internal:Creating test directory... 2021-01-03T12:52:24.943 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-01-03T12:52:24.945 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-01-03T12:52:24.948 DEBUG:teuthology.orchestra.run.smithi036:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-01-03T12:52:24.975 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-01-03T12:52:24.982 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-01-03T12:52:24.993 INFO:teuthology.run_tasks:Running task internal.archive... 2021-01-03T12:52:25.012 INFO:teuthology.task.internal:Creating archive directory... 2021-01-03T12:52:25.013 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-01-03T12:52:25.016 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-01-03T12:52:25.018 DEBUG:teuthology.orchestra.run.smithi036:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-01-03T12:52:25.023 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-01-03T12:52:25.044 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-01-03T12:52:25.067 INFO:teuthology.task.internal:Enabling coredump saving... 2021-01-03T12:52:25.067 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-01-03T12:52:25.074 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-01-03T12:52:25.077 DEBUG:teuthology.orchestra.run.smithi036:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-01-03T12:52:25.079 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-01-03T12:52:25.096 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-03T12:52:25.096 INFO:teuthology.orchestra.run.smithi036.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-03T12:52:25.097 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-03T12:52:25.103 INFO:teuthology.orchestra.run.smithi036.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-03T12:52:25.105 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-03T12:52:25.105 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-03T12:52:25.106 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-03T12:52:25.111 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-03T12:52:25.112 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-01-03T12:52:25.123 INFO:teuthology.task.internal:Configuring sudo... 2021-01-03T12:52:25.123 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-01-03T12:52:25.150 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-01-03T12:52:25.152 DEBUG:teuthology.orchestra.run.smithi036:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-01-03T12:52:25.155 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-01-03T12:52:25.171 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-01-03T12:52:25.188 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-01-03T12:52:25.188 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-01-03T12:52:25.206 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-01-03T12:52:25.211 DEBUG:teuthology.orchestra.run.smithi036:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-01-03T12:52:25.213 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-01-03T12:52:25.220 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-01-03T12:52:25.266 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-01-03T12:52:25.315 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2021-01-03T12:52:25.315 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-01-03T12:52:25.376 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-01-03T12:52:25.383 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-01-03T12:52:25.431 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2021-01-03T12:52:25.431 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-01-03T12:52:25.493 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-01-03T12:52:25.500 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-01-03T12:52:25.547 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2021-01-03T12:52:25.547 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-01-03T12:52:25.609 DEBUG:teuthology.orchestra.run.smithi036:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-01-03T12:52:25.616 DEBUG:teuthology.orchestra.run.smithi036:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-01-03T12:52:25.663 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2021-01-03T12:52:25.663 DEBUG:teuthology.orchestra.run.smithi036:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-01-03T12:52:25.726 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2021-01-03T12:52:25.730 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2021-01-03T12:52:25.732 DEBUG:teuthology.orchestra.run.smithi036:> sudo service rsyslog restart 2021-01-03T12:52:25.771 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2021-01-03T12:52:25.813 INFO:teuthology.run_tasks:Running task internal.timer... 2021-01-03T12:52:25.824 INFO:teuthology.task.internal:Starting timer... 2021-01-03T12:52:25.825 INFO:teuthology.run_tasks:Running task pcp... 2021-01-03T12:52:25.885 INFO:teuthology.run_tasks:Running task selinux... 2021-01-03T12:52:25.964 DEBUG:teuthology.task.selinux:Excluding smithi133: OS 'ubuntu' does not support SELinux 2021-01-03T12:52:25.964 DEBUG:teuthology.task.selinux:Excluding smithi016: OS 'ubuntu' does not support SELinux 2021-01-03T12:52:25.965 DEBUG:teuthology.task.selinux:Excluding smithi007: OS 'ubuntu' does not support SELinux 2021-01-03T12:52:25.965 DEBUG:teuthology.task.selinux:Excluding smithi036: OS 'ubuntu' does not support SELinux 2021-01-03T12:52:25.965 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-01-03T12:52:25.965 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-01-03T12:52:25.966 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-01-03T12:52:25.966 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-01-03T12:52:25.979 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2021-01-03T12:52:25.984 INFO:teuthology.repo_utils:Fetching master from origin 2021-01-03T12:52:26.028 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2021-01-03T12:52:26.040 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-01-03T12:52:26.042 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi133.front.sepia.ceph.com,smithi016.front.sepia.ceph.com,smithi007.front.sepia.ceph.com,smithi036.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-01-03T12:52:26.355 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-01-03T12:52:27.197 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-01-03T12:52:29.653 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-01-03T12:52:29.674 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:29 +0000 (0:00:00.074) 0:00:00.074 ******** 2021-01-03T12:52:29.687 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:29 +0000 (0:00:00.012) 0:00:00.087 ******** 2021-01-03T12:52:29.700 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:29 +0000 (0:00:00.013) 0:00:00.100 ******** 2021-01-03T12:52:29.713 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:29 +0000 (0:00:00.012) 0:00:00.113 ******** 2021-01-03T12:52:31.191 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi007.front.sepia.ceph.com] 2021-01-03T12:52:31.265 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:31 +0000 (0:00:01.551) 0:00:01.664 ******** 2021-01-03T12:52:31.347 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] 2021-01-03T12:52:31.395 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] 2021-01-03T12:52:31.405 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] 2021-01-03T12:52:31.492 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:31 +0000 (0:00:00.226) 0:00:01.891 ******** 2021-01-03T12:52:31.534 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:31 +0000 (0:00:00.042) 0:00:01.933 ******** 2021-01-03T12:52:31.565 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:31 +0000 (0:00:00.031) 0:00:01.965 ******** 2021-01-03T12:52:31.571 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-01-03T12:52:31.572 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-03T12:52:31.608 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:31 +0000 (0:00:00.043) 0:00:02.008 ******** 2021-01-03T12:52:31.615 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-03T12:52:31.650 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:31 +0000 (0:00:00.041) 0:00:02.049 ******** 2021-01-03T12:52:31.668 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-03T12:52:31.703 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:31 +0000 (0:00:00.053) 0:00:02.103 ******** 2021-01-03T12:52:31.709 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-03T12:52:31.745 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:31 +0000 (0:00:00.041) 0:00:02.144 ******** 2021-01-03T12:52:32.062 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-01-03T12:52:32.064 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-01-03T12:52:32.109 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:32 +0000 (0:00:00.364) 0:00:02.508 ******** 2021-01-03T12:52:32.118 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-01-03T12:52:32.120 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-01-03T12:52:32.180 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:32 +0000 (0:00:00.071) 0:00:02.579 ******** 2021-01-03T12:52:32.214 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:32 +0000 (0:00:00.034) 0:00:02.614 ******** 2021-01-03T12:52:32.332 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-01-03T12:52:32.368 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:32 +0000 (0:00:00.154) 0:00:02.768 ******** 2021-01-03T12:52:32.417 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-01-03T12:52:32.419 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.063401", "end": "2021-01-03 12:52:32.222504", "rc": 0, "start": "2021-01-03 12:52:32.159103", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.073626", "end": "2021-01-03 12:52:32.521972", "rc": 0, "start": "2021-01-03 12:52:32.448346", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-01-03T12:52:32.459 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:32 +0000 (0:00:00.090) 0:00:02.858 ******** 2021-01-03T12:52:32.493 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:32 +0000 (0:00:00.033) 0:00:02.892 ******** 2021-01-03T12:52:32.499 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.074533", "end": "2021-01-03 12:52:32.136623", "rc": 0, "start": "2021-01-03 12:52:32.062090", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-01-03T12:52:32.537 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:32 +0000 (0:00:00.044) 0:00:02.937 ******** 2021-01-03T12:52:32.564 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.061641", "end": "2021-01-03 12:52:32.865171", "rc": 0, "start": "2021-01-03 12:52:32.803530", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-01-03T12:52:32.623 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:32 +0000 (0:00:00.085) 0:00:03.023 ******** 2021-01-03T12:52:32.702 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-01-03T12:52:32.704 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi007.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-03T12:52:32.742 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:32 +0000 (0:00:00.119) 0:00:03.142 ******** 2021-01-03T12:52:32.774 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:32 +0000 (0:00:00.030) 0:00:03.173 ******** 2021-01-03T12:52:32.805 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:32 +0000 (0:00:00.031) 0:00:03.205 ******** 2021-01-03T12:52:32.811 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-03T12:52:32.857 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:32 +0000 (0:00:00.051) 0:00:03.256 ******** 2021-01-03T12:52:33.487 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-01-03T12:52:33.489 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1609678352.7915025-238040556397871/source", "state": "file", "uid": 0} changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1609678352.8200512-126709932842001/source", "state": "file", "uid": 0} 2021-01-03T12:52:33.524 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:33 +0000 (0:00:00.667) 0:00:03.924 ******** 2021-01-03T12:52:33.562 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:33 +0000 (0:00:00.037) 0:00:03.961 ******** 2021-01-03T12:52:33.568 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1609678352.7544153-231460849019705/source", "state": "file", "uid": 0} 2021-01-03T12:52:33.569 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1609678352.8741736-82853642171638/source", "state": "file", "uid": 0} 2021-01-03T12:52:33.609 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:33 +0000 (0:00:00.047) 0:00:04.008 ******** 2021-01-03T12:52:33.649 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:33 +0000 (0:00:00.037) 0:00:04.046 ******** 2021-01-03T12:52:33.844 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-01-03T12:52:33.846 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-01-03T12:52:33.848 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2021-01-03T12:52:33.849 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2021-01-03T12:52:33.851 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEz 2021-01-03T12:52:33.852 INFO:teuthology.task.ansible.out:IKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTN 2021-01-03T12:52:33.854 INFO:teuthology.task.ansible.out:xtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6 2021-01-03T12:52:33.856 INFO:teuthology.task.ansible.out:Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-01-03T12:52:34.089 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-01-03T12:52:34.098 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-01-03T12:52:34.255 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:34 +0000 (0:00:00.608) 0:00:04.654 ******** 2021-01-03T12:52:34.292 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:34 +0000 (0:00:00.037) 0:00:04.692 ******** 2021-01-03T12:52:34.338 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:34 +0000 (0:00:00.045) 0:00:04.737 ******** 2021-01-03T12:52:34.370 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:34 +0000 (0:00:00.032) 0:00:04.770 ******** 2021-01-03T12:52:34.925 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi007.front.sepia.ceph.com] 2021-01-03T12:52:35.022 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Sunday 03 January 2021 12:52:35 +0000 (0:00:00.651) 0:00:05.421 ******** 2021-01-03T12:52:35.023 INFO:teuthology.task.ansible.out: 2021-01-03T12:52:35.056 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] 2021-01-03T12:52:35.103 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] 2021-01-03T12:52:35.175 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:35 +0000 (0:00:00.153) 0:00:05.575 ******** 2021-01-03T12:52:35.220 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] 2021-01-03T12:52:35.263 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:35 +0000 (0:00:00.088) 0:00:05.663 ******** 2021-01-03T12:52:35.340 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:35 +0000 (0:00:00.077) 0:00:05.740 ******** 2021-01-03T12:52:35.378 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-01-03T12:52:35.380 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.165866", "end": "2021-01-03 12:52:35.358683", "rc": 0, "start": "2021-01-03 12:52:35.192817", "stderr": "", "stderr_lines": [], "stdout": "00db66c131045494585d1009527441f429a52419", "stdout_lines": ["00db66c131045494585d1009527441f429a52419"]} 2021-01-03T12:52:35.414 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:35 +0000 (0:00:00.073) 0:00:05.814 ******** 2021-01-03T12:52:35.525 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.160068", "end": "2021-01-03 12:52:35.496771", "rc": 0, "start": "2021-01-03 12:52:35.336703", "stderr": "", "stderr_lines": [], "stdout": "00db66c131045494585d1009527441f429a52419", "stdout_lines": ["00db66c131045494585d1009527441f429a52419"]} 2021-01-03T12:52:35.561 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:35 +0000 (0:00:00.146) 0:00:05.960 ******** 2021-01-03T12:52:35.566 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-01-03T12:52:35.568 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.021091", "end": "2021-01-03 12:52:35.665620", "failed_when_result": false, "rc": 0, "start": "2021-01-03 12:52:35.644529", "stderr": "", "stderr_lines": [], "stdout": "00db66c131045494585d1009527441f429a52419", "stdout_lines": ["00db66c131045494585d1009527441f429a52419"]} 2021-01-03T12:52:35.608 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:35 +0000 (0:00:00.047) 0:00:06.008 ******** 2021-01-03T12:52:35.614 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-01-03T12:52:35.616 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.144066", "end": "2021-01-03 12:52:35.583214", "rc": 0, "start": "2021-01-03 12:52:35.439148", "stderr": "", "stderr_lines": [], "stdout": "00db66c131045494585d1009527441f429a52419", "stdout_lines": ["00db66c131045494585d1009527441f429a52419"]} 2021-01-03T12:52:35.653 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:35 +0000 (0:00:00.044) 0:00:06.052 ******** 2021-01-03T12:52:35.659 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-01-03T12:52:35.661 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2021-01-03T12:52:35.700 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:35 +0000 (0:00:00.045) 0:00:06.098 ******** 2021-01-03T12:52:35.706 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi133.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.153565", "end": "2021-01-03 12:52:35.659186", "rc": 0, "start": "2021-01-03 12:52:35.505621", "stderr": "", "stderr_lines": [], "stdout": "00db66c131045494585d1009527441f429a52419", "stdout_lines": ["00db66c131045494585d1009527441f429a52419"]} 2021-01-03T12:52:35.708 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.016010", "end": "2021-01-03 12:52:35.512370", "failed_when_result": false, "rc": 0, "start": "2021-01-03 12:52:35.496360", "stderr": "", "stderr_lines": [], "stdout": "00db66c131045494585d1009527441f429a52419", "stdout_lines": ["00db66c131045494585d1009527441f429a52419"]} 2021-01-03T12:52:35.742 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:35 +0000 (0:00:00.043) 0:00:06.141 ******** 2021-01-03T12:52:35.774 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:35 +0000 (0:00:00.032) 0:00:06.174 ******** 2021-01-03T12:52:35.780 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:35.782 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2021-01-03T12:52:35.817 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:35 +0000 (0:00:00.042) 0:00:06.217 ******** 2021-01-03T12:52:35.849 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:35 +0000 (0:00:00.032) 0:00:06.249 ******** 2021-01-03T12:52:35.856 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-01-03T12:52:35.858 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014917", "end": "2021-01-03 12:52:35.501318", "failed_when_result": false, "rc": 0, "start": "2021-01-03 12:52:35.486401", "stderr": "", "stderr_lines": [], "stdout": "00db66c131045494585d1009527441f429a52419", "stdout_lines": ["00db66c131045494585d1009527441f429a52419"]} TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:35.893 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:35 +0000 (0:00:00.043) 0:00:06.293 ******** 2021-01-03T12:52:35.926 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:35 +0000 (0:00:00.033) 0:00:06.326 ******** 2021-01-03T12:52:35.932 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-01-03T12:52:35.934 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_users list] *********************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:35.934 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.012950", "end": "2021-01-03 12:52:36.223946", "failed_when_result": false, "rc": 0, "start": "2021-01-03 12:52:36.210996", "stderr": "", "stderr_lines": [], "stdout": "00db66c131045494585d1009527441f429a52419", "stdout_lines": ["00db66c131045494585d1009527441f429a52419"]} 2021-01-03T12:52:35.970 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:35 +0000 (0:00:00.043) 0:00:06.369 ******** 2021-01-03T12:52:36.002 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:35 +0000 (0:00:00.032) 0:00:06.402 ******** 2021-01-03T12:52:36.033 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.031) 0:00:06.433 ******** 2021-01-03T12:52:36.038 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-01-03T12:52:36.040 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.077 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.043) 0:00:06.477 ******** 2021-01-03T12:52:36.111 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.033) 0:00:06.511 ******** 2021-01-03T12:52:36.144 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.033) 0:00:06.544 ******** 2021-01-03T12:52:36.150 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-01-03T12:52:36.152 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_users list] *********************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.187 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.042) 0:00:06.587 ******** 2021-01-03T12:52:36.226 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.038) 0:00:06.625 ******** 2021-01-03T12:52:36.260 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.034) 0:00:06.660 ******** 2021-01-03T12:52:36.266 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-01-03T12:52:36.268 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.268 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.268 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-01-03T12:52:36.269 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [sm 2021-01-03T12:52:36.270 INFO:teuthology.task.ansible.out:ithi007.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f79891 2021-01-03T12:52:36.272 INFO:teuthology.task.ansible.out:3da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.307 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.046) 0:00:06.706 ******** 2021-01-03T12:52:36.341 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.034) 0:00:06.741 ******** 2021-01-03T12:52:36.347 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.348 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.349 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.351 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949 2021-01-03T12:52:36.353 INFO:teuthology.task.ansible.out:ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSK 2021-01-03T12:52:36.355 INFO:teuthology.task.ansible.out:lAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.c 2021-01-03T12:52:36.357 INFO:teuthology.task.ansible.out:eph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMa 2021-01-03T12:52:36.358 INFO:teuthology.task.ansible.out:vsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxi 2021-01-03T12:52:36.360 INFO:teuthology.task.ansible.out:Or/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\ 2021-01-03T12:52:36.361 INFO:teuthology.task.ansible.out:n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.394 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.052) 0:00:06.793 ******** 2021-01-03T12:52:36.427 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.033) 0:00:06.827 ******** 2021-01-03T12:52:36.434 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.434 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-01-03T12:52:36.435 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2021-01-03T12:52:36.435 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.436 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.436 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92 2021-01-03T12:52:36.438 INFO:teuthology.task.ansible.out:b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.474 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.046) 0:00:06.874 ******** 2021-01-03T12:52:36.480 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.482 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.482 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.483 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvF 2021-01-03T12:52:36.487 INFO:teuthology.task.ansible.out:A 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb 2021-01-03T12:52:36.489 INFO:teuthology.task.ansible.out:"}, "skip_reason": "Conditional result was False"} TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Condition 2021-01-03T12:52:36.490 INFO:teuthology.task.ansible.out:al result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIV 2021-01-03T12:52:36.492 INFO:teuthology.task.ansible.out:kSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38 2021-01-03T12:52:36.495 INFO:teuthology.task.ansible.out:ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.528 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.053) 0:00:06.927 ******** 2021-01-03T12:52:36.534 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.535 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.536 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.537 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.537 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.538 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] **************************** 2021-01-03T12:52:36.539 INFO:teuthology.task.ansible.out:******* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.540 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13Mu 2021-01-03T12:52:36.542 INFO:teuthology.task.ansible.out:FdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb 2021-01-03T12:52:36.544 INFO:teuthology.task.ansible.out:912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.fron 2021-01-03T12:52:36.546 INFO:teuthology.task.ansible.out:t.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": " 2021-01-03T12:52:36.547 INFO:teuthology.task.ansible.out:item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.581 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.053) 0:00:06.981 ******** 2021-01-03T12:52:36.590 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457eb 2021-01-03T12:52:36.592 INFO:teuthology.task.ansible.out:f54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_users list] *********************************** skipping: [smithi133.front.sepia.ceph.com] => { 2021-01-03T12:52:36.593 INFO:teuthology.task.ansible.out:"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.595 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89b 2021-01-03T12:52:36.596 INFO:teuthology.task.ansible.out:f370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.597 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795f 2021-01-03T12:52:36.598 INFO:teuthology.task.ansible.out:ef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.634 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.052) 0:00:07.033 ******** 2021-01-03T12:52:36.641 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.643 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.643 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", 2021-01-03T12:52:36.650 INFO:teuthology.task.ansible.out: "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686 2021-01-03T12:52:36.655 INFO:teuthology.task.ansible.out:e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c 2021-01-03T12:52:36.661 INFO:teuthology.task.ansible.out:999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.s 2021-01-03T12:52:36.662 INFO:teuthology.task.ansible.out:epia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48d 2021-01-03T12:52:36.665 INFO:teuthology.task.ansible.out:c25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0 2021-01-03T12:52:36.667 INFO:teuthology.task.ansible.out:a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.697 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.063) 0:00:07.096 ******** 2021-01-03T12:52:36.710 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2021-01-03T12:52:36.712 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.713 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'vasu', ' 2021-01-03T12:52:36.715 INFO:teuthology.task.ansible.out:ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932 2021-01-03T12:52:36.716 INFO:teuthology.task.ansible.out:ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459 2021-01-03T12:52:36.722 INFO:teuthology.task.ansible.out:030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1 2021-01-03T12:52:36.723 INFO:teuthology.task.ansible.out:da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d 2021-01-03T12:52:36.725 INFO:teuthology.task.ansible.out:7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f9 2021-01-03T12:52:36.727 INFO:teuthology.task.ansible.out:97d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7a 2021-01-03T12:52:36.728 INFO:teuthology.task.ansible.out:f8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.762 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.064) 0:00:07.161 ******** 2021-01-03T12:52:36.799 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.036) 0:00:07.198 ******** 2021-01-03T12:52:36.806 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.807 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.808 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.809 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.809 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.809 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen" 2021-01-03T12:52:36.811 INFO:teuthology.task.ansible.out:, "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.811 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 2021-01-03T12:52:36.813 INFO:teuthology.task.ansible.out: 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.814 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.815 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.816 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.818 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZ 2021-01-03T12:52:36.819 INFO:teuthology.task.ansible.out:M2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.820 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b 2021-01-03T12:52:36.821 INFO:teuthology.task.ansible.out:9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.822 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "chang 2021-01-03T12:52:36.823 INFO:teuthology.task.ansible.out:ed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.833 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.833 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.835 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.835 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z 2021-01-03T12:52:36.837 INFO:teuthology.task.ansible.out:8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.837 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.838 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90 2021-01-03T12:52:36.839 INFO:teuthology.task.ansible.out:Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f 2021-01-03T12:52:36.841 INFO:teuthology.task.ansible.out:3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.841 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.843 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.843 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.845 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.881 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:36 +0000 (0:00:00.082) 0:00:07.280 ******** 2021-01-03T12:52:36.888 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.889 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.889 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.891 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.893 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.893 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.893 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'a 2021-01-03T12:52:36.895 INFO:teuthology.task.ansible.out:emerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2 2021-01-03T12:52:36.897 INFO:teuthology.task.ansible.out:+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansibl 2021-01-03T12:52:36.898 INFO:teuthology.task.ansible.out:e_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 2021-01-03T12:52:36.900 INFO:teuthology.task.ansible.out: 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d87332 2021-01-03T12:52:36.902 INFO:teuthology.task.ansible.out:5de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Condi 2021-01-03T12:52:36.904 INFO:teuthology.task.ansible.out:tional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was 2021-01-03T12:52:36.906 INFO:teuthology.task.ansible.out: False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika 2021-01-03T12:52:36.908 INFO:teuthology.task.ansible.out:@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.916 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.917 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.918 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.920 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.922 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.932 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.933 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzP 2021-01-03T12:52:36.935 INFO:teuthology.task.ansible.out:spffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was Fals 2021-01-03T12:52:36.937 INFO:teuthology.task.ansible.out:e"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 2021-01-03T12:52:36.939 INFO:teuthology.task.ansible.out:'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.949 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.950 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.952 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@d 2021-01-03T12:52:36.954 INFO:teuthology.task.ansible.out:ell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofrie 2021-01-03T12:52:36.955 INFO:teuthology.task.ansible.out:dma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.957 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.959 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.959 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.959 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'xiaoxichen 2021-01-03T12:52:36.961 INFO:teuthology.task.ansible.out:', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.970 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.972 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.973 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": " 2021-01-03T12:52:36.974 INFO:teuthology.task.ansible.out:rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.975 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.975 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874 2021-01-03T12:52:36.976 INFO:teuthology.task.ansible.out:359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi 2021-01-03T12:52:36.978 INFO:teuthology.task.ansible.out:036.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda 2021-01-03T12:52:36.980 INFO:teuthology.task.ansible.out:7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditio 2021-01-03T12:52:36.981 INFO:teuthology.task.ansible.out:nal result was False"} 2021-01-03T12:52:36.990 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:36.991 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.014 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.015 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79 2021-01-03T12:52:37.017 INFO:teuthology.task.ansible.out:c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.019 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.019 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e819 2021-01-03T12:52:37.021 INFO:teuthology.task.ansible.out:5fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": fa 2021-01-03T12:52:37.023 INFO:teuthology.task.ansible.out:lse, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.057 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:37 +0000 (0:00:00.176) 0:00:07.457 ******** 2021-01-03T12:52:37.064 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.064 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.066 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45c 2021-01-03T12:52:37.067 INFO:teuthology.task.ansible.out:beabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.068 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.068 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'v 2021-01-03T12:52:37.070 INFO:teuthology.task.ansible.out:asu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170 2021-01-03T12:52:37.071 INFO:teuthology.task.ansible.out:204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.073 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.074 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.se 2021-01-03T12:52:37.076 INFO:teuthology.task.ansible.out:pia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn' 2021-01-03T12:52:37.077 INFO:teuthology.task.ansible.out:: 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.087 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.089 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.089 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668 2021-01-03T12:52:37.091 INFO:teuthology.task.ansible.out:079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.091 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'r 2021-01-03T12:52:37.093 INFO:teuthology.task.ansible.out:dias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.093 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-01-03T12:52:37.093 INFO:teuthology.task.ansible.out: TASK 2021-01-03T12:52:37.095 INFO:teuthology.task.ansible.out: [users : Create all admin users with sudo access.] ************************ skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed 2021-01-03T12:52:37.096 INFO:teuthology.task.ansible.out:": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d 2021-01-03T12:52:37.098 INFO:teuthology.task.ansible.out:0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.139 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:37 +0000 (0:00:00.081) 0:00:07.539 ******** 2021-01-03T12:52:37.141 INFO:teuthology.task.ansible.out: 2021-01-03T12:52:37.147 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.149 INFO:teuthology.task.ansible.out: 2021-01-03T12:52:37.150 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.152 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.154 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.155 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.156 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.156 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": " 2021-01-03T12:52:37.158 INFO:teuthology.task.ansible.out:haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.158 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ 2021-01-03T12:52:37.161 INFO:teuthology.task.ansible.out:96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f91943 2021-01-03T12:52:37.163 INFO:teuthology.task.ansible.out:7d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "it 2021-01-03T12:52:37.165 INFO:teuthology.task.ansible.out:em", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (i 2021-01-03T12:52:37.167 INFO:teuthology.task.ansible.out:tem={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.176 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.178 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.178 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.179 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": " 2021-01-03T12:52:37.180 INFO:teuthology.task.ansible.out:amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.186 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-01-03T12:52:37.207 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.208 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.209 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": 2021-01-03T12:52:37.210 INFO:teuthology.task.ansible.out: "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.211 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@th 2021-01-03T12:52:37.212 INFO:teuthology.task.ansible.out:inkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce38 2021-01-03T12:52:37.214 INFO:teuthology.task.ansible.out:5cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.252 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:37 +0000 (0:00:00.113) 0:00:07.652 ******** 2021-01-03T12:52:37.286 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:37 +0000 (0:00:00.034) 0:00:07.686 ******** 2021-01-03T12:52:37.292 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.293 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.294 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.295 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.296 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.296 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.298 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.298 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.299 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.300 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.301 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.cep 2021-01-03T12:52:37.302 INFO:teuthology.task.ansible.out:h.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b 2021-01-03T12:52:37.304 INFO:teuthology.task.ansible.out:908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Cond 2021-01-03T12:52:37.305 INFO:teuthology.task.ansible.out:itional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.306 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.306 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": fal 2021-01-03T12:52:37.308 INFO:teuthology.task.ansible.out:se, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} TASK [users : Clone the keys repo] ********************************************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.308 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.308 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, 2021-01-03T12:52:37.310 INFO:teuthology.task.ansible.out:"item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.346 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:37 +0000 (0:00:00.059) 0:00:07.746 ******** 2021-01-03T12:52:37.353 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.354 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.356 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.356 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.357 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ofriedma', ' 2021-01-03T12:52:37.359 INFO:teuthology.task.ansible.out:ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} TASK [users : Create all users without sudo access.] *************************** TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.359 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => 2021-01-03T12:52:37.361 INFO:teuthology.task.ansible.out: {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.362 INFO:teuthology.task.ansible.out:skipp 2021-01-03T12:52:37.363 INFO:teuthology.task.ansible.out:ing: [smithi036.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.365 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "p 2021-01-03T12:52:37.367 INFO:teuthology.task.ansible.out:rsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38 2021-01-03T12:52:37.369 INFO:teuthology.task.ansible.out:d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.403 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:37 +0000 (0:00:00.057) 0:00:07.803 ******** 2021-01-03T12:52:37.410 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.411 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.412 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.413 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.413 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item" 2021-01-03T12:52:37.415 INFO:teuthology.task.ansible.out:: {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** 2021-01-03T12:52:37.415 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.416 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d 2021-01-03T12:52:37.417 INFO:teuthology.task.ansible.out:88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.418 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZ 2021-01-03T12:52:37.419 INFO:teuthology.task.ansible.out:Gf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.421 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.421 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.421 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@a 2021-01-03T12:52:37.423 INFO:teuthology.task.ansible.out:sus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.458 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:37 +0000 (0:00:00.054) 0:00:07.858 ******** 2021-01-03T12:52:37.598 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': ' 2021-01-03T12:52:37.600 INFO:teuthology.task.ansible.out:ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukr 2021-01-03T12:52:37.602 INFO:teuthology.task.ansible.out:i@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu 2021-01-03T12:52:37.603 INFO:teuthology.task.ansible.out:2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason 2021-01-03T12:52:37.605 INFO:teuthology.task.ansible.out:": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_v 2021-01-03T12:52:37.606 INFO:teuthology.task.ansible.out:ar": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={ 2021-01-03T12:52:37.609 INFO:teuthology.task.ansible.out:'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} Sunday 03 January 2021 12:52:37 +0000 (0:00:00.062) 0:00:07.920 ******** skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11d 2021-01-03T12:52:37.610 INFO:teuthology.task.ansible.out:de1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba66111 2021-01-03T12:52:37.612 INFO:teuthology.task.ansible.out:55ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": 2021-01-03T12:52:37.612 INFO:teuthology.task.ansible.out: "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.614 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.614 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag 2021-01-03T12:52:37.616 INFO:teuthology.task.ansible.out:", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.635 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.637 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} TASK [users : Clone the keys repo] ********************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.637 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.638 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5 2021-01-03T12:52:37.642 INFO:teuthology.task.ansible.out:a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com 2021-01-03T12:52:37.644 INFO:teuthology.task.ansible.out:] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "change 2021-01-03T12:52:37.645 INFO:teuthology.task.ansible.out:d": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sep 2021-01-03T12:52:37.647 INFO:teuthology.task.ansible.out:ia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.680 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:37 +0000 (0:00:00.158) 0:00:08.079 ******** 2021-01-03T12:52:37.714 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:37 +0000 (0:00:00.034) 0:00:08.114 ******** 2021-01-03T12:52:37.747 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:37 +0000 (0:00:00.032) 0:00:08.146 ******** 2021-01-03T12:52:37.753 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.770 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2021-01-03T12:52:37.771 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all users without sudo access.] *************************** 2021-01-03T12:52:37.806 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:37 +0000 (0:00:00.059) 0:00:08.206 ******** 2021-01-03T12:52:37.840 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:37 +0000 (0:00:00.033) 0:00:08.239 ******** 2021-01-03T12:52:37.875 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:37 +0000 (0:00:00.035) 0:00:08.274 ******** 2021-01-03T12:52:37.907 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:37 +0000 (0:00:00.031) 0:00:08.306 ******** 2021-01-03T12:52:37.912 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-01-03T12:52:37.914 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.916 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.916 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.918 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi007.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.918 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.919 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.919 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.919 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-01-03T12:52:37.920 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.920 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi007.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.920 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.921 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.921 INFO:teuthology.task.ansible.out:skipping: [smithi007.fro 2021-01-03T12:52:37.923 INFO:teuthology.task.ansible.out:nt.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:37.958 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:37 +0000 (0:00:00.051) 0:00:08.358 ******** 2021-01-03T12:52:37.995 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:37 +0000 (0:00:00.037) 0:00:08.395 ******** 2021-01-03T12:52:38.007 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-01-03T12:52:38.009 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi007.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.009 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.010 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.010 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.011 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.011 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.011 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.012 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.012 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_r 2021-01-03T12:52:38.014 INFO:teuthology.task.ansible.out:eason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi007.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.016 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.051 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.054) 0:00:08.450 ******** 2021-01-03T12:52:38.083 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.032) 0:00:08.482 ******** 2021-01-03T12:52:38.089 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.091 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.092 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.093 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi007.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.093 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.094 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.094 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj 2021-01-03T12:52:38.097 INFO:teuthology.task.ansible.out:", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.099 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.099 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.137 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.054) 0:00:08.537 ******** 2021-01-03T12:52:38.173 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.035) 0:00:08.572 ******** 2021-01-03T12:52:38.179 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.180 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.181 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.182 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi016.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.182 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.183 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.183 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.183 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.184 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.184 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.187 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.187 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.189 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.231 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.058) 0:00:08.631 ******** 2021-01-03T12:52:38.237 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-01-03T12:52:38.239 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.275 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.043) 0:00:08.675 ******** 2021-01-03T12:52:38.281 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-01-03T12:52:38.283 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.318 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.043) 0:00:08.718 ******** 2021-01-03T12:52:38.324 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-01-03T12:52:38.326 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi016.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.326 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.328 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.328 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.329 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.365 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.046) 0:00:08.764 ******** 2021-01-03T12:52:38.371 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.373 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi016.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.373 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.374 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.375 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.376 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.412 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.047) 0:00:08.811 ******** 2021-01-03T12:52:38.417 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.419 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi016.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.420 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.420 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.421 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.455 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.043) 0:00:08.855 ******** 2021-01-03T12:52:38.465 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-01-03T12:52:38.467 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.503 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.047) 0:00:08.902 ******** 2021-01-03T12:52:38.540 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.037) 0:00:08.940 ******** 2021-01-03T12:52:38.546 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-01-03T12:52:38.548 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.570 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2021-01-03T12:52:38.572 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.605 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.064) 0:00:09.005 ******** 2021-01-03T12:52:38.732 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-01-03T12:52:38.734 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.734 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.734 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.735 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.735 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.735 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.736 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.736 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => ( 2021-01-03T12:52:38.738 INFO:teuthology.task.ansible.out:item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.738 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.739 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-01-03T12:52:38.739 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "003661ddb81b67152d30be2c1bfc586b23ffac5b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2021-01-03T12:52:38.740 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi036.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.741 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.741 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.742 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.742 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.742 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.743 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.743 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.743 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": 2021-01-03T12:52:38.745 INFO:teuthology.task.ansible.out:"Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.781 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.175) 0:00:09.180 ******** 2021-01-03T12:52:38.788 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.789 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.790 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.792 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.792 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.793 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.803 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.805 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.806 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.806 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.807 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.808 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.809 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.809 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi007.front.sepia.ceph.com] => { "msg": "Host smithi007.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-01-03T12:52:38.810 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-01-03T12:52:38.810 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.810 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-01-03T12:52:38.811 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "003661ddb81b67152d30be2c1bfc586b23ffac5b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2021-01-03T12:52:38.811 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-01-03T12:52:38.812 INFO:teuthology.task.ansible.out:skipping: [smithi133. 2021-01-03T12:52:38.814 INFO:teuthology.task.ansible.out:front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.851 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.069) 0:00:09.250 ******** 2021-01-03T12:52:38.887 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.036) 0:00:09.287 ******** 2021-01-03T12:52:38.894 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.894 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.896 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.896 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.897 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.898 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.903 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.905 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.905 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.906 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.906 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.906 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.907 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.908 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi007.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi133.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.909 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.909 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.910 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.946 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.058) 0:00:09.345 ******** 2021-01-03T12:52:38.980 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:38 +0000 (0:00:00.034) 0:00:09.380 ******** 2021-01-03T12:52:38.986 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.988 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} TASK [common : Log the OS name, version and release] *************************** ok: [smithi016.front.sepia.ceph.com] => { "msg": "Host smithi016.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } TASK [users : Remove revoked users] ******************************************** 2021-01-03T12:52:38.988 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.988 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.989 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.989 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.990 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.990 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.991 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.992 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.992 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:38.997 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-01-03T12:52:38.998 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:39.034 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.053) 0:00:09.433 ******** 2021-01-03T12:52:39.067 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.033) 0:00:09.467 ******** 2021-01-03T12:52:39.100 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.032) 0:00:09.500 ******** 2021-01-03T12:52:39.106 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-01-03T12:52:39.107 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Including major version specific variables.] ******************** ok: [smithi016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-01-03T12:52:39.144 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.043) 0:00:09.544 ******** 2021-01-03T12:52:39.178 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.033) 0:00:09.577 ******** 2021-01-03T12:52:39.184 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-01-03T12:52:39.185 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:39.226 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.048) 0:00:09.626 ******** 2021-01-03T12:52:39.232 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-01-03T12:52:39.234 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:39.269 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.043) 0:00:09.669 ******** 2021-01-03T12:52:39.275 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-01-03T12:52:39.276 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:39.278 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "003661ddb81b67152d30be2c1bfc586b23ffac5b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2021-01-03T12:52:39.312 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.043) 0:00:09.712 ******** 2021-01-03T12:52:39.345 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.032) 0:00:09.745 ******** 2021-01-03T12:52:39.352 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-01-03T12:52:39.354 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:39.388 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.042) 0:00:09.787 ******** 2021-01-03T12:52:39.419 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.031) 0:00:09.819 ******** 2021-01-03T12:52:39.425 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-01-03T12:52:39.426 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => { "msg": "Host smithi036.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-01-03T12:52:39.428 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "003661ddb81b67152d30be2c1bfc586b23ffac5b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-01-03T12:52:39.428 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:39.463 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.043) 0:00:09.862 ******** 2021-01-03T12:52:39.494 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.031) 0:00:09.894 ******** 2021-01-03T12:52:39.525 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.031) 0:00:09.925 ******** 2021-01-03T12:52:39.531 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-01-03T12:52:39.532 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Including major version specific variables.] ******************** ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-01-03T12:52:39.567 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.042) 0:00:09.967 ******** 2021-01-03T12:52:39.599 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.031) 0:00:09.998 ******** 2021-01-03T12:52:39.630 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.031) 0:00:10.029 ******** 2021-01-03T12:52:39.636 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-01-03T12:52:39.638 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => { "msg": "Host smithi133.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } TASK [common : Set entitlements_path] ****************************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:39.672 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.042) 0:00:10.072 ******** 2021-01-03T12:52:39.705 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.032) 0:00:10.104 ******** 2021-01-03T12:52:39.748 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.043) 0:00:10.147 ******** 2021-01-03T12:52:39.754 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-01-03T12:52:39.756 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi007.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi007.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-03T12:52:39.756 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:39.793 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.045) 0:00:10.193 ******** 2021-01-03T12:52:39.827 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.033) 0:00:10.226 ******** 2021-01-03T12:52:39.860 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.033) 0:00:10.259 ******** 2021-01-03T12:52:39.866 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-01-03T12:52:39.867 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} TASK [common : Set have_entitlements] ****************************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:39.868 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:39.905 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.044) 0:00:10.304 ******** 2021-01-03T12:52:39.937 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.032) 0:00:10.337 ******** 2021-01-03T12:52:39.970 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:39 +0000 (0:00:00.033) 0:00:10.370 ******** 2021-01-03T12:52:39.977 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-01-03T12:52:39.979 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:40.015 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.044) 0:00:10.414 ******** 2021-01-03T12:52:40.047 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.032) 0:00:10.447 ******** 2021-01-03T12:52:40.080 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.031) 0:00:10.478 ******** 2021-01-03T12:52:40.085 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-01-03T12:52:40.087 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi007.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:40.122 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.042) 0:00:10.521 ******** 2021-01-03T12:52:40.154 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.031) 0:00:10.553 ******** 2021-01-03T12:52:40.186 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.032) 0:00:10.586 ******** 2021-01-03T12:52:40.192 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-01-03T12:52:40.194 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi016.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-03T12:52:40.194 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-03T12:52:40.229 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.042) 0:00:10.628 ******** 2021-01-03T12:52:40.262 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.033) 0:00:10.662 ******** 2021-01-03T12:52:40.301 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.038) 0:00:10.700 ******** 2021-01-03T12:52:40.307 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-01-03T12:52:40.309 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Register with subscription-manager.] **************************** skipping: [smithi007.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set have_entitlements] ****************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:40.345 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.044) 0:00:10.745 ******** 2021-01-03T12:52:40.378 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.032) 0:00:10.777 ******** 2021-01-03T12:52:40.410 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.032) 0:00:10.810 ******** 2021-01-03T12:52:40.416 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-01-03T12:52:40.417 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:40.454 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.043) 0:00:10.853 ******** 2021-01-03T12:52:40.487 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.033) 0:00:10.886 ******** 2021-01-03T12:52:40.521 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.034) 0:00:10.920 ******** 2021-01-03T12:52:40.529 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : List CDN releases available to system] ************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:40.531 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-03T12:52:40.565 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.044) 0:00:10.965 ******** 2021-01-03T12:52:40.599 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.033) 0:00:10.998 ******** 2021-01-03T12:52:40.632 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.032) 0:00:11.031 ******** 2021-01-03T12:52:40.638 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-01-03T12:52:40.639 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:40.675 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.043) 0:00:11.075 ******** 2021-01-03T12:52:40.708 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.032) 0:00:11.108 ******** 2021-01-03T12:52:40.740 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.032) 0:00:11.140 ******** 2021-01-03T12:52:40.746 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-01-03T12:52:40.748 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Register with subscription-manager.] **************************** skipping: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-03T12:52:40.782 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.041) 0:00:11.182 ******** 2021-01-03T12:52:40.815 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.032) 0:00:11.214 ******** 2021-01-03T12:52:40.855 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.040) 0:00:11.255 ******** 2021-01-03T12:52:40.861 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-01-03T12:52:40.863 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi007.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:40.899 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.043) 0:00:11.298 ******** 2021-01-03T12:52:40.931 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.032) 0:00:11.331 ******** 2021-01-03T12:52:40.970 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:40 +0000 (0:00:00.038) 0:00:11.369 ******** 2021-01-03T12:52:40.976 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-01-03T12:52:40.977 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:40.978 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:40.979 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:41.015 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.044) 0:00:11.414 ******** 2021-01-03T12:52:41.046 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.031) 0:00:11.446 ******** 2021-01-03T12:52:41.077 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.031) 0:00:11.477 ******** 2021-01-03T12:52:41.083 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-01-03T12:52:41.085 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:41.120 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.042) 0:00:11.520 ******** 2021-01-03T12:52:41.152 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.032) 0:00:11.552 ******** 2021-01-03T12:52:41.185 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.032) 0:00:11.585 ******** 2021-01-03T12:52:41.191 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-01-03T12:52:41.192 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Store list of enabled repos] ************************************ skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:41.228 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.042) 0:00:11.628 ******** 2021-01-03T12:52:41.262 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.033) 0:00:11.661 ******** 2021-01-03T12:52:41.295 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.032) 0:00:11.694 ******** 2021-01-03T12:52:41.300 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-01-03T12:52:41.302 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-03T12:52:41.338 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.043) 0:00:11.738 ******** 2021-01-03T12:52:41.375 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.036) 0:00:11.774 ******** 2021-01-03T12:52:41.408 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.033) 0:00:11.807 ******** 2021-01-03T12:52:41.413 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-01-03T12:52:41.415 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:41.452 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.044) 0:00:11.852 ******** 2021-01-03T12:52:41.487 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.034) 0:00:11.886 ******** 2021-01-03T12:52:41.518 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.031) 0:00:11.918 ******** 2021-01-03T12:52:41.524 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-01-03T12:52:41.525 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:41.526 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:41.562 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.043) 0:00:11.961 ******** 2021-01-03T12:52:41.595 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.032) 0:00:11.994 ******** 2021-01-03T12:52:41.628 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.032) 0:00:12.027 ******** 2021-01-03T12:52:41.635 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:41.637 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi007.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Store list of enabled repos] ************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:41.671 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.043) 0:00:12.071 ******** 2021-01-03T12:52:41.704 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.032) 0:00:12.104 ******** 2021-01-03T12:52:41.738 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.033) 0:00:12.138 ******** 2021-01-03T12:52:41.744 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-01-03T12:52:41.746 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:41.782 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.043) 0:00:12.182 ******** 2021-01-03T12:52:41.814 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.031) 0:00:12.213 ******** 2021-01-03T12:52:41.846 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.032) 0:00:12.246 ******** 2021-01-03T12:52:41.852 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-01-03T12:52:41.855 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi133.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:41.891 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.044) 0:00:12.290 ******** 2021-01-03T12:52:41.925 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.034) 0:00:12.325 ******** 2021-01-03T12:52:41.958 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.032) 0:00:12.357 ******** 2021-01-03T12:52:41.963 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-01-03T12:52:41.964 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:42.001 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:41 +0000 (0:00:00.043) 0:00:12.400 ******** 2021-01-03T12:52:42.035 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.033) 0:00:12.434 ******** 2021-01-03T12:52:42.067 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.032) 0:00:12.466 ******** 2021-01-03T12:52:42.072 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-01-03T12:52:42.074 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:42.076 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-03T12:52:42.111 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.044) 0:00:12.511 ******** 2021-01-03T12:52:42.145 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.034) 0:00:12.545 ******** 2021-01-03T12:52:42.178 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.032) 0:00:12.577 ******** 2021-01-03T12:52:42.183 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-01-03T12:52:42.185 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi007.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:42.187 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:42.221 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.043) 0:00:12.621 ******** 2021-01-03T12:52:42.254 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.033) 0:00:12.654 ******** 2021-01-03T12:52:42.287 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.032) 0:00:12.686 ******** 2021-01-03T12:52:42.292 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-01-03T12:52:42.294 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:42.331 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.043) 0:00:12.730 ******** 2021-01-03T12:52:42.363 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.032) 0:00:12.763 ******** 2021-01-03T12:52:42.397 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.033) 0:00:12.797 ******** 2021-01-03T12:52:42.403 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-01-03T12:52:42.404 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:42.440 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.042) 0:00:12.839 ******** 2021-01-03T12:52:42.478 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.038) 0:00:12.878 ******** 2021-01-03T12:52:42.484 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-01-03T12:52:42.486 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:42.487 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.021870", "end": "2021-01-03 12:52:42.572667", "rc": 0, "start": "2021-01-03 12:52:42.550797", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-01-03T12:52:42.488 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:42.524 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.045) 0:00:12.923 ******** 2021-01-03T12:52:42.556 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.032) 0:00:12.956 ******** 2021-01-03T12:52:42.589 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.032) 0:00:12.989 ******** 2021-01-03T12:52:42.595 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-01-03T12:52:42.596 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi016.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:42.598 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:42.632 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.043) 0:00:13.032 ******** 2021-01-03T12:52:42.666 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.033) 0:00:13.065 ******** 2021-01-03T12:52:42.698 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.032) 0:00:13.097 ******** 2021-01-03T12:52:42.703 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-01-03T12:52:42.705 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:42.705 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:42.741 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.042) 0:00:13.140 ******** 2021-01-03T12:52:42.773 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.032) 0:00:13.173 ******** 2021-01-03T12:52:42.806 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.032) 0:00:13.205 ******** 2021-01-03T12:52:42.812 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-01-03T12:52:42.814 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:42.850 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.044) 0:00:13.249 ******** 2021-01-03T12:52:42.883 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.032) 0:00:13.282 ******** 2021-01-03T12:52:42.889 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-01-03T12:52:42.890 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set the timezone] *********************************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:42.924 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.041) 0:00:13.324 ******** 2021-01-03T12:52:42.956 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.031) 0:00:13.356 ******** 2021-01-03T12:52:42.969 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-01-03T12:52:42.971 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.011789", "end": "2021-01-03 12:52:42.724961", "rc": 0, "start": "2021-01-03 12:52:42.713172", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:43.006 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:42 +0000 (0:00:00.049) 0:00:13.405 ******** 2021-01-03T12:52:43.039 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.033) 0:00:13.439 ******** 2021-01-03T12:52:43.071 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.032) 0:00:13.471 ******** 2021-01-03T12:52:43.077 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-01-03T12:52:43.079 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:43.113 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.042) 0:00:13.513 ******** 2021-01-03T12:52:43.146 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.032) 0:00:13.545 ******** 2021-01-03T12:52:43.180 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.034) 0:00:13.580 ******** 2021-01-03T12:52:43.186 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-01-03T12:52:43.188 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Refresh repos] ************************************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:43.223 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.042) 0:00:13.622 ******** 2021-01-03T12:52:43.258 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.035) 0:00:13.658 ******** 2021-01-03T12:52:43.292 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.033) 0:00:13.691 ******** 2021-01-03T12:52:43.297 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-01-03T12:52:43.299 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:43.333 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.041) 0:00:13.733 ******** 2021-01-03T12:52:43.366 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.032) 0:00:13.765 ******** 2021-01-03T12:52:43.371 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-01-03T12:52:43.372 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone] *********************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:43.407 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.041) 0:00:13.807 ******** 2021-01-03T12:52:43.439 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.031) 0:00:13.839 ******** 2021-01-03T12:52:43.445 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-01-03T12:52:43.447 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the hardware clock] ***************************************** changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.058561", "end": "2021-01-03 12:52:43.500343", "rc": 0, "start": "2021-01-03 12:52:43.441782", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:43.482 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.042) 0:00:13.882 ******** 2021-01-03T12:52:43.518 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.035) 0:00:13.917 ******** 2021-01-03T12:52:43.550 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.032) 0:00:13.950 ******** 2021-01-03T12:52:43.556 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-01-03T12:52:43.558 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:43.594 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.043) 0:00:13.994 ******** 2021-01-03T12:52:43.629 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.035) 0:00:14.029 ******** 2021-01-03T12:52:43.667 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.037) 0:00:14.066 ******** 2021-01-03T12:52:43.673 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-01-03T12:52:43.675 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Refresh repos] ************************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:43.712 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.045) 0:00:14.111 ******** 2021-01-03T12:52:43.747 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.034) 0:00:14.146 ******** 2021-01-03T12:52:43.758 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-01-03T12:52:43.759 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean apt cache] ************************************************ 2021-01-03T12:52:43.761 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.029078", "end": "2021-01-03 12:52:43.846984", "rc": 0, "start": "2021-01-03 12:52:43.817906", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:52:43.807 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.060) 0:00:14.207 ******** 2021-01-03T12:52:43.843 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.035) 0:00:14.242 ******** 2021-01-03T12:52:43.850 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-01-03T12:52:43.851 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-03T12:52:43.888 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.045) 0:00:14.288 ******** 2021-01-03T12:52:43.895 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-01-03T12:52:43.897 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:43.934 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.045) 0:00:14.333 ******** 2021-01-03T12:52:43.940 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:43.990 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:43 +0000 (0:00:00.056) 0:00:14.390 ******** 2021-01-03T12:52:43.996 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-01-03T12:52:43.999 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.033 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.043) 0:00:14.433 ******** 2021-01-03T12:52:44.039 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-01-03T12:52:44.041 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.080 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.046) 0:00:14.479 ******** 2021-01-03T12:52:44.086 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-01-03T12:52:44.087 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.128 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.048) 0:00:14.528 ******** 2021-01-03T12:52:44.142 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-01-03T12:52:44.143 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.175 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.047) 0:00:14.575 ******** 2021-01-03T12:52:44.181 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-01-03T12:52:44.183 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.217 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.041) 0:00:14.617 ******** 2021-01-03T12:52:44.223 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-01-03T12:52:44.225 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.262 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.045) 0:00:14.662 ******** 2021-01-03T12:52:44.268 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-01-03T12:52:44.270 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.305 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.043) 0:00:14.705 ******** 2021-01-03T12:52:44.312 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-01-03T12:52:44.313 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.349 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.043) 0:00:14.748 ******** 2021-01-03T12:52:44.355 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-01-03T12:52:44.356 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-03T12:52:44.391 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.041) 0:00:14.790 ******** 2021-01-03T12:52:44.397 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-01-03T12:52:44.399 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.432 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.041) 0:00:14.831 ******** 2021-01-03T12:52:44.438 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.474 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.041) 0:00:14.873 ******** 2021-01-03T12:52:44.479 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-01-03T12:52:44.481 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-03T12:52:44.518 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.043) 0:00:14.916 ******** 2021-01-03T12:52:44.522 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-01-03T12:52:44.525 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.561 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.043) 0:00:14.960 ******** 2021-01-03T12:52:44.567 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-01-03T12:52:44.569 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.605 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.043) 0:00:15.004 ******** 2021-01-03T12:52:44.610 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-01-03T12:52:44.612 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.646 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.041) 0:00:15.046 ******** 2021-01-03T12:52:44.652 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-01-03T12:52:44.654 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.690 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.044) 0:00:15.090 ******** 2021-01-03T12:52:44.696 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-01-03T12:52:44.698 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.700 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.856961", "end": "2021-01-03 12:52:44.500404", "rc": 0, "start": "2021-01-03 12:52:43.643443", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:52:44.735 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.044) 0:00:15.135 ******** 2021-01-03T12:52:44.772 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.036) 0:00:15.172 ******** 2021-01-03T12:52:44.778 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-01-03T12:52:44.779 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.815 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.043) 0:00:15.215 ******** 2021-01-03T12:52:44.847 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.032) 0:00:15.247 ******** 2021-01-03T12:52:44.853 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-01-03T12:52:44.854 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.892 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.045) 0:00:15.292 ******** 2021-01-03T12:52:44.898 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-01-03T12:52:44.899 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.936 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.043) 0:00:15.335 ******** 2021-01-03T12:52:44.941 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-01-03T12:52:44.943 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:44.979 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:44 +0000 (0:00:00.043) 0:00:15.379 ******** 2021-01-03T12:52:44.985 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-01-03T12:52:44.986 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.025273", "end": "2021-01-03 12:52:44.775685", "rc": 0, "start": "2021-01-03 12:52:44.750412", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:52:44.987 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi133.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:45.024 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.044) 0:00:15.423 ******** 2021-01-03T12:52:45.057 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.032) 0:00:15.456 ******** 2021-01-03T12:52:45.085 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-01-03T12:52:45.086 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:45.119 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.062) 0:00:15.519 ******** 2021-01-03T12:52:45.126 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-01-03T12:52:45.128 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.015814", "end": "2021-01-03 12:52:44.836687", "rc": 0, "start": "2021-01-03 12:52:44.820873", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-01-03T12:52:45.163 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.043) 0:00:15.562 ******** 2021-01-03T12:52:45.190 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-01-03T12:52:45.191 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:45.227 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.064) 0:00:15.627 ******** 2021-01-03T12:52:45.255 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-01-03T12:52:45.256 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.013013", "end": "2021-01-03 12:52:45.563933", "rc": 0, "start": "2021-01-03 12:52:45.550920", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-01-03T12:52:45.291 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.063) 0:00:15.690 ******** 2021-01-03T12:52:45.324 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.032) 0:00:15.723 ******** 2021-01-03T12:52:45.331 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:45.369 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.044) 0:00:15.768 ******** 2021-01-03T12:52:45.374 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-01-03T12:52:45.376 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:45.416 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.047) 0:00:15.816 ******** 2021-01-03T12:52:45.421 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-01-03T12:52:45.423 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:45.459 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.042) 0:00:15.858 ******** 2021-01-03T12:52:45.465 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-01-03T12:52:45.467 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:45.502 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.043) 0:00:15.901 ******** 2021-01-03T12:52:45.508 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-01-03T12:52:45.510 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:45.545 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.043) 0:00:15.945 ******** 2021-01-03T12:52:45.551 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-01-03T12:52:45.553 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:45.588 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.042) 0:00:15.988 ******** 2021-01-03T12:52:45.594 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-01-03T12:52:45.596 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:45.631 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.042) 0:00:16.031 ******** 2021-01-03T12:52:45.637 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:45.674 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.042) 0:00:16.073 ******** 2021-01-03T12:52:45.680 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-01-03T12:52:45.682 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:45.717 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.043) 0:00:16.116 ******** 2021-01-03T12:52:45.724 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-01-03T12:52:45.726 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:45.768 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.050) 0:00:16.167 ******** 2021-01-03T12:52:45.797 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-01-03T12:52:45.799 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:45.858 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.089) 0:00:16.256 ******** 2021-01-03T12:52:45.897 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-01-03T12:52:45.899 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:45.952 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:45 +0000 (0:00:00.094) 0:00:16.351 ******** 2021-01-03T12:52:46.192 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-01-03T12:52:46.194 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.109992", "end": "2021-01-03 12:52:46.500347", "rc": 0, "start": "2021-01-03 12:52:46.390355", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:52:46.229 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:46 +0000 (0:00:00.277) 0:00:16.628 ******** 2021-01-03T12:52:46.257 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:46.295 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:46 +0000 (0:00:00.065) 0:00:16.694 ******** 2021-01-03T12:52:46.448 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-01-03T12:52:46.449 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.025415", "end": "2021-01-03 12:52:46.755849", "rc": 0, "start": "2021-01-03 12:52:46.730434", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:52:46.488 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:46 +0000 (0:00:00.193) 0:00:16.888 ******** 2021-01-03T12:52:46.788 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-01-03T12:52:46.790 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.943170", "end": "2021-01-03 12:52:46.500341", "rc": 0, "start": "2021-01-03 12:52:45.557171", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:52:46.826 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:46 +0000 (0:00:00.337) 0:00:17.225 ******** 2021-01-03T12:52:46.853 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-01-03T12:52:46.855 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:46.900 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:46 +0000 (0:00:00.073) 0:00:17.299 ******** 2021-01-03T12:52:47.053 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-01-03T12:52:47.055 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.024568", "end": "2021-01-03 12:52:46.764668", "rc": 0, "start": "2021-01-03 12:52:46.740100", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:52:47.092 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:47 +0000 (0:00:00.192) 0:00:17.492 ******** 2021-01-03T12:52:47.340 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-01-03T12:52:47.342 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1609678337, "cache_updated": false, "changed": false} 2021-01-03T12:52:47.405 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:47 +0000 (0:00:00.312) 0:00:17.805 ******** 2021-01-03T12:52:47.897 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1609678333, "cache_updated": false, "changed": false} 2021-01-03T12:52:47.934 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:47 +0000 (0:00:00.528) 0:00:18.333 ******** 2021-01-03T12:52:48.419 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-01-03T12:52:48.421 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"cache_update_time": 1609678337, "cache_updated": false, "changed": false} 2021-01-03T12:52:48.457 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:48 +0000 (0:00:00.523) 0:00:18.857 ******** 2021-01-03T12:52:48.484 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-01-03T12:52:48.485 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:48.521 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:48 +0000 (0:00:00.063) 0:00:18.920 ******** 2021-01-03T12:52:48.819 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-01-03T12:52:48.821 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1609678333, "cache_updated": false, "changed": false} 2021-01-03T12:52:48.859 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:48 +0000 (0:00:00.338) 0:00:19.259 ******** 2021-01-03T12:52:48.866 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-01-03T12:52:48.868 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-01-03T12:52:48.907 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:48 +0000 (0:00:00.047) 0:00:19.307 ******** 2021-01-03T12:52:48.915 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-01-03T12:52:48.917 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:48.969 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:48 +0000 (0:00:00.061) 0:00:19.368 ******** 2021-01-03T12:52:49.281 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-01-03T12:52:49.283 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-01-03T12:52:49.319 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:49 +0000 (0:00:00.350) 0:00:19.718 ******** 2021-01-03T12:52:49.451 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-01-03T12:52:49.454 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1609678330, "cache_updated": false, "changed": false} 2021-01-03T12:52:49.490 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:49 +0000 (0:00:00.171) 0:00:19.890 ******** 2021-01-03T12:52:49.836 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-01-03T12:52:49.838 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"cache_update_time": 1609678337, "cache_updated": false, "changed": false} 2021-01-03T12:52:49.873 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:49 +0000 (0:00:00.383) 0:00:20.273 ******** 2021-01-03T12:52:49.985 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-01-03T12:52:49.987 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1609678341, "cache_updated": false, "changed": false} 2021-01-03T12:52:50.022 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:50 +0000 (0:00:00.148) 0:00:20.421 ******** 2021-01-03T12:52:50.200 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi007.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-01-03T12:52:50.211 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1609678333, "cache_updated": false, "changed": false} 2021-01-03T12:52:50.257 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:50 +0000 (0:00:00.235) 0:00:20.657 ******** 2021-01-03T12:52:50.350 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-01-03T12:52:50.352 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"cache_update_time": 1609678330, "cache_updated": false, "changed": false} 2021-01-03T12:52:50.392 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:50 +0000 (0:00:00.135) 0:00:20.792 ******** 2021-01-03T12:52:50.419 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:50.455 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:50 +0000 (0:00:00.063) 0:00:20.855 ******** 2021-01-03T12:52:50.505 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi007.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-01-03T12:52:50.601 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-01-03T12:52:50.739 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-01-03T12:52:50.741 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-01-03T12:52:50.786 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:50 +0000 (0:00:00.330) 0:00:21.186 ******** 2021-01-03T12:52:50.793 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi007.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-01-03T12:52:50.835 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:50 +0000 (0:00:00.049) 0:00:21.235 ******** 2021-01-03T12:52:50.886 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-01-03T12:52:50.928 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-01-03T12:52:50.930 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1609678341, "cache_updated": false, "changed": false} 2021-01-03T12:52:50.969 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:50 +0000 (0:00:00.133) 0:00:21.369 ******** 2021-01-03T12:52:50.975 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-01-03T12:52:50.977 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-01-03T12:52:51.012 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:51 +0000 (0:00:00.043) 0:00:21.412 ******** 2021-01-03T12:52:51.020 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-01-03T12:52:51.021 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:51.056 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:51 +0000 (0:00:00.043) 0:00:21.456 ******** 2021-01-03T12:52:51.147 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-01-03T12:52:51.149 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-01-03T12:52:51.186 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:51 +0000 (0:00:00.129) 0:00:21.585 ******** 2021-01-03T12:52:51.297 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-03T12:52:51.299 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-01-03T12:52:51.319 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-01-03T12:52:51.320 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-01-03T12:52:51.354 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:51 +0000 (0:00:00.168) 0:00:21.754 ******** 2021-01-03T12:52:51.371 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-01-03T12:52:51.372 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-01-03T12:52:51.408 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:51 +0000 (0:00:00.053) 0:00:21.807 ******** 2021-01-03T12:52:51.562 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-03T12:52:51.564 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-01-03T12:52:51.647 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi133.front.sepia.ceph.com] => {"cache_update_time": 1609678330, "cache_updated": false, "changed": false} 2021-01-03T12:52:51.689 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:51 +0000 (0:00:00.281) 0:00:22.089 ******** 2021-01-03T12:52:51.697 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-03T12:52:51.699 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-01-03T12:52:51.817 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-01-03T12:52:51.858 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:51 +0000 (0:00:00.168) 0:00:22.258 ******** 2021-01-03T12:52:51.886 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-01-03T12:52:51.888 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-01-03T12:52:51.924 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:51 +0000 (0:00:00.065) 0:00:22.324 ******** 2021-01-03T12:52:51.930 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-03T12:52:51.931 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-01-03T12:52:51.954 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-01-03T12:52:51.956 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:51.992 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:51 +0000 (0:00:00.067) 0:00:22.391 ******** 2021-01-03T12:52:52.019 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-01-03T12:52:52.020 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-03T12:52:52.069 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:52 +0000 (0:00:00.077) 0:00:22.469 ******** 2021-01-03T12:52:52.120 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-01-03T12:52:52.122 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:52.132 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:52.132 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-01-03T12:52:52.133 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-01-03T12:52:52.150 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi007.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:52.186 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:52 +0000 (0:00:00.116) 0:00:22.585 ******** 2021-01-03T12:52:52.192 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi016.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-01-03T12:52:52.231 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:52 +0000 (0:00:00.045) 0:00:22.631 ******** 2021-01-03T12:52:52.238 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-01-03T12:52:52.240 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:52.274 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:52 +0000 (0:00:00.043) 0:00:22.674 ******** 2021-01-03T12:52:52.280 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-01-03T12:52:52.282 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-01-03T12:52:52.317 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:52 +0000 (0:00:00.042) 0:00:22.717 ******** 2021-01-03T12:52:52.323 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-01-03T12:52:52.325 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1609678341, "cache_updated": false, "changed": false} 2021-01-03T12:52:52.359 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:52 +0000 (0:00:00.042) 0:00:22.759 ******** 2021-01-03T12:52:52.365 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-01-03T12:52:52.367 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:52.402 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:52 +0000 (0:00:00.042) 0:00:22.802 ******** 2021-01-03T12:52:52.418 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-01-03T12:52:52.420 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-01-03T12:52:52.430 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-01-03T12:52:52.431 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-03T12:52:52.465 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:52 +0000 (0:00:00.062) 0:00:22.864 ******** 2021-01-03T12:52:52.502 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-01-03T12:52:52.504 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:52.514 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:52.525 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:52.561 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:52 +0000 (0:00:00.095) 0:00:22.960 ******** 2021-01-03T12:52:52.587 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-01-03T12:52:52.588 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:52.622 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:52 +0000 (0:00:00.061) 0:00:23.022 ******** 2021-01-03T12:52:52.648 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-01-03T12:52:52.650 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-01-03T12:52:52.687 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:52 +0000 (0:00:00.064) 0:00:23.086 ******** 2021-01-03T12:52:52.694 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-01-03T12:52:52.810 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-01-03T12:52:52.811 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-01-03T12:52:52.845 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:52 +0000 (0:00:00.158) 0:00:23.245 ******** 2021-01-03T12:52:52.935 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi036.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-01-03T12:52:53.123 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-03T12:52:53.125 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-01-03T12:52:53.187 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-01-03T12:52:53.188 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-01-03T12:52:53.232 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:53 +0000 (0:00:00.386) 0:00:23.631 ******** 2021-01-03T12:52:53.239 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-01-03T12:52:53.241 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"cache_update_time": 1609678337, "cache_updated": false, "changed": false} 2021-01-03T12:52:53.277 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:53 +0000 (0:00:00.045) 0:00:23.677 ******** 2021-01-03T12:52:53.357 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-01-03T12:52:53.359 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-01-03T12:52:53.395 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:53 +0000 (0:00:00.117) 0:00:23.794 ******** 2021-01-03T12:52:53.401 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-03T12:52:53.403 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-01-03T12:52:53.552 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-01-03T12:52:53.553 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1609678333, "cache_updated": false, "changed": false} 2021-01-03T12:52:53.588 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:53 +0000 (0:00:00.193) 0:00:23.988 ******** 2021-01-03T12:52:53.595 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-01-03T12:52:53.597 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-01-03T12:52:53.634 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:53 +0000 (0:00:00.045) 0:00:24.033 ******** 2021-01-03T12:52:53.641 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-03T12:52:53.643 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-01-03T12:52:53.682 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:53 +0000 (0:00:00.047) 0:00:24.081 ******** 2021-01-03T12:52:53.698 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-01-03T12:52:53.720 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-01-03T12:52:53.721 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-01-03T12:52:53.756 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:53 +0000 (0:00:00.073) 0:00:24.155 ******** 2021-01-03T12:52:53.781 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-01-03T12:52:53.783 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:53.817 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:53 +0000 (0:00:00.062) 0:00:24.217 ******** 2021-01-03T12:52:53.843 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-01-03T12:52:53.845 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-03T12:52:53.880 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:53 +0000 (0:00:00.061) 0:00:24.278 ******** 2021-01-03T12:52:53.894 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-01-03T12:52:53.896 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-01-03T12:52:53.932 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:53 +0000 (0:00:00.053) 0:00:24.332 ******** 2021-01-03T12:52:53.938 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-01-03T12:52:53.940 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:53.940 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-01-03T12:52:53.941 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-01-03T12:52:53.941 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi133.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:53.978 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:53 +0000 (0:00:00.045) 0:00:24.377 ******** 2021-01-03T12:52:54.011 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.032) 0:00:24.410 ******** 2021-01-03T12:52:54.017 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-03T12:52:54.018 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-01-03T12:52:54.039 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-01-03T12:52:54.041 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:54.073 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.062) 0:00:24.473 ******** 2021-01-03T12:52:54.132 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-01-03T12:52:54.134 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-01-03T12:52:54.218 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-03T12:52:54.220 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-01-03T12:52:54.268 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.194) 0:00:24.667 ******** 2021-01-03T12:52:54.278 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-01-03T12:52:54.279 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-01-03T12:52:54.281 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi007.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-01-03T12:52:54.320 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.051) 0:00:24.719 ******** 2021-01-03T12:52:54.356 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.036) 0:00:24.755 ******** 2021-01-03T12:52:54.363 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-01-03T12:52:54.364 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:54.400 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.044) 0:00:24.800 ******** 2021-01-03T12:52:54.436 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.035) 0:00:24.835 ******** 2021-01-03T12:52:54.442 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-01-03T12:52:54.444 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-03T12:52:54.478 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.042) 0:00:24.878 ******** 2021-01-03T12:52:54.484 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-01-03T12:52:54.485 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:54.486 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi016.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-01-03T12:52:54.522 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.044) 0:00:24.922 ******** 2021-01-03T12:52:54.527 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-01-03T12:52:54.529 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:54.565 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.042) 0:00:24.964 ******** 2021-01-03T12:52:54.570 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-01-03T12:52:54.572 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-03T12:52:54.608 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.042) 0:00:25.007 ******** 2021-01-03T12:52:54.614 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-01-03T12:52:54.616 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-01-03T12:52:54.654 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.045) 0:00:25.053 ******** 2021-01-03T12:52:54.664 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-01-03T12:52:54.665 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:54.667 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:54.667 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-03T12:52:54.679 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-01-03T12:52:54.682 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:54.718 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.064) 0:00:25.117 ******** 2021-01-03T12:52:54.758 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.040) 0:00:25.158 ******** 2021-01-03T12:52:54.767 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-01-03T12:52:54.768 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-03T12:52:54.806 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.047) 0:00:25.205 ******** 2021-01-03T12:52:54.812 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-01-03T12:52:54.814 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:54.848 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.042) 0:00:25.248 ******** 2021-01-03T12:52:54.854 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-01-03T12:52:54.856 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:54.891 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.042) 0:00:25.290 ******** 2021-01-03T12:52:54.897 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-01-03T12:52:54.898 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-01-03T12:52:54.940 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:54 +0000 (0:00:00.048) 0:00:25.339 ******** 2021-01-03T12:52:54.988 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-01-03T12:52:54.990 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"cache_update_time": 1609678330, "cache_updated": false, "changed": false} 2021-01-03T12:52:55.024 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:55 +0000 (0:00:00.083) 0:00:25.423 ******** 2021-01-03T12:52:55.198 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-01-03T12:52:55.199 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-01-03T12:52:55.234 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:55 +0000 (0:00:00.210) 0:00:25.634 ******** 2021-01-03T12:52:55.314 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-01-03T12:52:55.316 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-01-03T12:52:55.350 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:55 +0000 (0:00:00.115) 0:00:25.750 ******** 2021-01-03T12:52:55.544 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-01-03T12:52:55.545 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2021-01-03 12:51:22 UTC", "ActiveEnterTimestampMonotonic": "17979034", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target nss-lookup.target system.slice var-run.mount -.mount systemd-tmpfiles-setup.service sysinit.target local-fs.target network.target time-sync.target basic.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2021-01-03 12:51:22 UTC", "AssertTimestampMonotonic": "17978251", "Before": "multi-user.target shutdown.target plymouth-quit.service xdm.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2021-01-03 12:51:22 UTC", "ConditionTimestampMonotonic": "17978251", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-01-03T12:52:55.547 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1287", "ExecMainStartTimestamp": "Sun 2021-01-03 12:51:22 UTC", "ExecMainStartTimestampMonotonic": "17978993", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2021-01-03 12:51:22 UTC", "InactiveExitTimestampMonotonic": "17979034", "InvocationID": "8986a70c415d47f89056e96f2a725e98", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "i 2021-01-03T12:52:55.548 INFO:teuthology.task.ansible.out:nfinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1287", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no" 2021-01-03T12:52:55.550 INFO:teuthology.task.ansible.out:, "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2021-01-03 12:51:22 UTC", "StateChangeTimestampMonotonic": "17979034", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2021-01-03 12:51:22 UTC", "WatchdogTimestampMonotonic": "17979033", "WatchdogUSec": "0"}} 2021-01-03T12:52:55.582 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:55 +0000 (0:00:00.231) 0:00:25.982 ******** 2021-01-03T12:52:55.590 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2021-01-03 12:51:24 UTC", "ActiveEnterTimestampMonotonic": "16928070", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target time-sync.target sysinit.target system.slice basic.target var-run.mount nss-lookup.target network.target systemd-journald.socket systemd-tmpfiles-setup.service -.mount local-fs.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2021-01-03 12:51:24 UTC", "AssertTimestampMonotonic": "16927373", "Before": "plymouth-quit.service multi-user.target xdm.service shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2021-01-03 12:51:24 UTC", "ConditionTimestampMonotonic": "16927373", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-01-03T12:52:55.592 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1306", "ExecMainStartTimestamp": "Sun 2021-01-03 12:51:24 UTC", "ExecMainStartTimestampMonotonic": "16928045", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2021-01-03 12:51:24 UTC", "InactiveExitTimestampMonotonic": "16928070", "InvocationID": "3b8754fc8b7e447492bbf6d48d21e87d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "i 2021-01-03T12:52:55.594 INFO:teuthology.task.ansible.out:nfinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1306", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no" 2021-01-03T12:52:55.596 INFO:teuthology.task.ansible.out:, "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2021-01-03 12:51:24 UTC", "StateChangeTimestampMonotonic": "16928070", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2021-01-03 12:51:24 UTC", "WatchdogTimestampMonotonic": "16928069", "WatchdogUSec": "0"}} 2021-01-03T12:52:55.627 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:55 +0000 (0:00:00.044) 0:00:26.026 ******** 2021-01-03T12:52:55.633 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-01-03T12:52:55.634 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-01-03T12:52:55.670 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:55 +0000 (0:00:00.042) 0:00:26.069 ******** 2021-01-03T12:52:55.702 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:55 +0000 (0:00:00.032) 0:00:26.101 ******** 2021-01-03T12:52:55.708 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:55.710 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:55.745 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:55 +0000 (0:00:00.043) 0:00:26.145 ******** 2021-01-03T12:52:55.778 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:55 +0000 (0:00:00.032) 0:00:26.177 ******** 2021-01-03T12:52:55.784 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-01-03T12:52:55.786 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1609678341, "cache_updated": false, "changed": false} TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:55.821 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:55 +0000 (0:00:00.043) 0:00:26.221 ******** 2021-01-03T12:52:55.856 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:55 +0000 (0:00:00.034) 0:00:26.256 ******** 2021-01-03T12:52:55.870 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-01-03T12:52:55.871 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi133.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:55.906 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:55 +0000 (0:00:00.049) 0:00:26.305 ******** 2021-01-03T12:52:55.939 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:55 +0000 (0:00:00.033) 0:00:26.338 ******** 2021-01-03T12:52:55.945 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-01-03T12:52:55.947 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi133.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-01-03T12:52:55.983 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:55 +0000 (0:00:00.043) 0:00:26.382 ******** 2021-01-03T12:52:56.014 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.031) 0:00:26.414 ******** 2021-01-03T12:52:56.019 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-01-03T12:52:56.021 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:56.056 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.041) 0:00:26.456 ******** 2021-01-03T12:52:56.087 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.031) 0:00:26.487 ******** 2021-01-03T12:52:56.093 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-01-03T12:52:56.095 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:56.128 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.040) 0:00:26.528 ******** 2021-01-03T12:52:56.161 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.032) 0:00:26.560 ******** 2021-01-03T12:52:56.166 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-01-03T12:52:56.168 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-01-03T12:52:56.168 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-01-03T12:52:56.204 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.042) 0:00:26.603 ******** 2021-01-03T12:52:56.235 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.031) 0:00:26.635 ******** 2021-01-03T12:52:56.267 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.031) 0:00:26.666 ******** 2021-01-03T12:52:56.272 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-01-03T12:52:56.274 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:56.312 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.045) 0:00:26.711 ******** 2021-01-03T12:52:56.346 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.033) 0:00:26.745 ******** 2021-01-03T12:52:56.377 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.031) 0:00:26.777 ******** 2021-01-03T12:52:56.383 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-01-03T12:52:56.384 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:56.421 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.043) 0:00:26.820 ******** 2021-01-03T12:52:56.460 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.039) 0:00:26.860 ******** 2021-01-03T12:52:56.466 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-01-03T12:52:56.467 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include package type specific vars.] ************************** ok: [smithi007.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-01-03T12:52:56.612 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.151) 0:00:27.011 ******** 2021-01-03T12:52:56.644 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.032) 0:00:27.043 ******** 2021-01-03T12:52:56.649 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-01-03T12:52:56.651 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:56.651 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-01-03T12:52:56.652 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-01-03T12:52:56.690 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.045) 0:00:27.089 ******** 2021-01-03T12:52:56.723 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.032) 0:00:27.122 ******** 2021-01-03T12:52:56.754 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.031) 0:00:27.154 ******** 2021-01-03T12:52:56.760 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-01-03T12:52:56.761 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-01-03T12:52:56.761 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:56.798 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.043) 0:00:27.198 ******** 2021-01-03T12:52:56.830 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.031) 0:00:27.230 ******** 2021-01-03T12:52:56.836 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-01-03T12:52:56.838 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-01-03T12:52:56.873 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.042) 0:00:27.272 ******** 2021-01-03T12:52:56.879 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-01-03T12:52:56.881 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:56.916 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.043) 0:00:27.316 ******** 2021-01-03T12:52:56.923 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-01-03T12:52:56.925 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-01-03T12:52:56.946 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-01-03T12:52:56.947 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-01-03T12:52:56.982 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:56 +0000 (0:00:00.065) 0:00:27.382 ******** 2021-01-03T12:52:57.017 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.035) 0:00:27.417 ******** 2021-01-03T12:52:57.023 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-01-03T12:52:57.025 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-01-03T12:52:57.026 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-03T12:52:57.027 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-01-03T12:52:57.027 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-01-03T12:52:57.064 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.046) 0:00:27.463 ******** 2021-01-03T12:52:57.097 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.032) 0:00:27.496 ******** 2021-01-03T12:52:57.131 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.033) 0:00:27.530 ******** 2021-01-03T12:52:57.137 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-01-03T12:52:57.138 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-01-03T12:52:57.175 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.044) 0:00:27.575 ******** 2021-01-03T12:52:57.188 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-01-03T12:52:57.190 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:57.226 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.050) 0:00:27.625 ******** 2021-01-03T12:52:57.232 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-01-03T12:52:57.234 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} TASK [testnode : Including major version specific variables.] ****************** ok: [smithi016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-01-03T12:52:57.236 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-01-03T12:52:57.237 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2021-01-03 12:51:42 UTC", "ActiveEnterTimestampMonotonic": "17508744", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target basic.target -.mount systemd-tmpfiles-setup.service var-run.mount nss-lookup.target time-sync.target remote-fs.target sysinit.target system.slice local-fs.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2021-01-03 12:51:42 UTC", "AssertTimestampMonotonic": "17508026", "Before": "shutdown.target getty@tty1.service xdm.service multi-user.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2021-01-03 12:51:42 UTC", "ConditionTimestampMonotonic": "17508026", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-01-03T12:52:57.238 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1127", "ExecMainStartTimestamp": "Sun 2021-01-03 12:51:42 UTC", "ExecMainStartTimestampMonotonic": "17508720", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2021-01-03 12:51:42 UTC", "InactiveExitTimestampMonotonic": "17508744", "InvocationID": "a2aa94db2c8e4bcb9b21aeb89f30e45b", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "i 2021-01-03T12:52:57.240 INFO:teuthology.task.ansible.out:nfinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1127", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no" 2021-01-03T12:52:57.241 INFO:teuthology.task.ansible.out:, "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2021-01-03 12:51:42 UTC", "StateChangeTimestampMonotonic": "17508744", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2021-01-03 12:51:42 UTC", "WatchdogTimestampMonotonic": "17508743", "WatchdogUSec": "0"}} 2021-01-03T12:52:57.273 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.047) 0:00:27.673 ******** 2021-01-03T12:52:57.306 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.032) 0:00:27.705 ******** 2021-01-03T12:52:57.338 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.032) 0:00:27.738 ******** 2021-01-03T12:52:57.344 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-01-03T12:52:57.345 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:57.380 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.041) 0:00:27.779 ******** 2021-01-03T12:52:57.412 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.031) 0:00:27.811 ******** 2021-01-03T12:52:57.418 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-01-03T12:52:57.419 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} TASK [common : Get SELinux status] ********************************************* 2021-01-03T12:52:57.419 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:57.420 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:57.455 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.043) 0:00:27.855 ******** 2021-01-03T12:52:57.487 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.032) 0:00:27.887 ******** 2021-01-03T12:52:57.519 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.031) 0:00:27.919 ******** 2021-01-03T12:52:57.526 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-01-03T12:52:57.528 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:57.563 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.043) 0:00:27.962 ******** 2021-01-03T12:52:57.570 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-01-03T12:52:57.571 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:57.606 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.043) 0:00:28.005 ******** 2021-01-03T12:52:57.613 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-01-03T12:52:57.614 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-03T12:52:57.649 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.042) 0:00:28.048 ******** 2021-01-03T12:52:57.681 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.032) 0:00:28.080 ******** 2021-01-03T12:52:57.687 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-01-03T12:52:57.688 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:57.723 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.042) 0:00:28.123 ******** 2021-01-03T12:52:57.750 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-01-03T12:52:57.751 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:57.791 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.067) 0:00:28.190 ******** 2021-01-03T12:52:57.806 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-01-03T12:52:57.808 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-01-03T12:52:57.842 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.051) 0:00:28.241 ******** 2021-01-03T12:52:57.848 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-01-03T12:52:57.850 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:57.888 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.045) 0:00:28.287 ******** 2021-01-03T12:52:57.893 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-01-03T12:52:57.895 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-01-03T12:52:57.931 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.043) 0:00:28.331 ******** 2021-01-03T12:52:57.965 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:57 +0000 (0:00:00.032) 0:00:28.364 ******** 2021-01-03T12:52:57.970 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-01-03T12:52:57.971 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:58.007 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.043) 0:00:28.407 ******** 2021-01-03T12:52:58.041 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.033) 0:00:28.440 ******** 2021-01-03T12:52:58.046 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-01-03T12:52:58.048 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-01-03T12:52:58.083 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.042) 0:00:28.483 ******** 2021-01-03T12:52:58.089 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-01-03T12:52:58.090 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:58.125 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.041) 0:00:28.524 ******** 2021-01-03T12:52:58.130 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-01-03T12:52:58.131 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi007"}, "changed": false} 2021-01-03T12:52:58.166 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.041) 0:00:28.566 ******** 2021-01-03T12:52:58.173 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-01-03T12:52:58.174 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi016.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-01-03T12:52:58.176 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-01-03T12:52:58.177 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2021-01-03 12:51:17 UTC", "ActiveEnterTimestampMonotonic": "17379150", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target local-fs.target network.target systemd-tmpfiles-setup.service time-sync.target nss-lookup.target var-run.mount system.slice -.mount basic.target remote-fs.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2021-01-03 12:51:17 UTC", "AssertTimestampMonotonic": "17378439", "Before": "multi-user.target plymouth-quit.service getty@tty1.service xdm.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2021-01-03 12:51:17 UTC", "ConditionTimestampMonotonic": "17378439", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2021-01-03T12:52:58.179 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1300", "ExecMainStartTimestamp": "Sun 2021-01-03 12:51:17 UTC", "ExecMainStartTimestampMonotonic": "17379116", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2021-01-03 12:51:17 UTC", "InactiveExitTimestampMonotonic": "17379150", "InvocationID": "740cde681b9b4cb48e02104be1be0ec2", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "i 2021-01-03T12:52:58.180 INFO:teuthology.task.ansible.out:nfinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1300", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no" 2021-01-03T12:52:58.182 INFO:teuthology.task.ansible.out:, "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2021-01-03 12:51:17 UTC", "StateChangeTimestampMonotonic": "17379150", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2021-01-03 12:51:17 UTC", "WatchdogTimestampMonotonic": "17379149", "WatchdogUSec": "0"}} 2021-01-03T12:52:58.213 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.046) 0:00:28.613 ******** 2021-01-03T12:52:58.245 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.031) 0:00:28.645 ******** 2021-01-03T12:52:58.277 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.031) 0:00:28.676 ******** 2021-01-03T12:52:58.282 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-01-03T12:52:58.284 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:58.319 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.041) 0:00:28.718 ******** 2021-01-03T12:52:58.324 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-01-03T12:52:58.326 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:58.363 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.044) 0:00:28.763 ******** 2021-01-03T12:52:58.368 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-01-03T12:52:58.370 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:58.418 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.054) 0:00:28.817 ******** 2021-01-03T12:52:58.425 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:58.460 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.042) 0:00:28.860 ******** 2021-01-03T12:52:58.466 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-01-03T12:52:58.468 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:58.505 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.044) 0:00:28.904 ******** 2021-01-03T12:52:58.511 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-01-03T12:52:58.512 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-01-03T12:52:58.548 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.043) 0:00:28.948 ******** 2021-01-03T12:52:58.554 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-01-03T12:52:58.556 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:58.597 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.048) 0:00:28.996 ******** 2021-01-03T12:52:58.602 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-01-03T12:52:58.604 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-01-03T12:52:58.606 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-01-03T12:52:58.641 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.044) 0:00:29.041 ******** 2021-01-03T12:52:58.673 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.031) 0:00:29.072 ******** 2021-01-03T12:52:58.677 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-01-03T12:52:58.679 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set hostname var] ********************************************* ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi016"}, "changed": false} 2021-01-03T12:52:58.715 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.042) 0:00:29.114 ******** 2021-01-03T12:52:58.747 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.032) 0:00:29.147 ******** 2021-01-03T12:52:58.753 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-01-03T12:52:58.755 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-01-03T12:52:58.790 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.043) 0:00:29.190 ******** 2021-01-03T12:52:58.796 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-01-03T12:52:58.798 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:58.834 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.043) 0:00:29.234 ******** 2021-01-03T12:52:58.841 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-01-03T12:52:58.843 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-01-03T12:52:58.880 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.045) 0:00:29.279 ******** 2021-01-03T12:52:58.885 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-01-03T12:52:58.887 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:58.924 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.043) 0:00:29.323 ******** 2021-01-03T12:52:58.950 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-01-03T12:52:58.952 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:58.988 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:58 +0000 (0:00:00.064) 0:00:29.387 ******** 2021-01-03T12:52:59.004 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-01-03T12:52:59.006 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-03T12:52:59.047 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.059) 0:00:29.447 ******** 2021-01-03T12:52:59.053 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-01-03T12:52:59.055 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set the system's hostname] ************************************ ok: [smithi007.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi007", "ansible_hostname": "smithi007", "ansible_nodename": "smithi007"}, "changed": false, "name": "smithi007"} 2021-01-03T12:52:59.093 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.045) 0:00:29.492 ******** 2021-01-03T12:52:59.129 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.036) 0:00:29.529 ******** 2021-01-03T12:52:59.146 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi016", "ansible_hostname": "smithi016", "ansible_nodename": "smithi016"}, "changed": false, "name": "smithi016"} 2021-01-03T12:52:59.189 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.059) 0:00:29.589 ******** 2021-01-03T12:52:59.196 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-01-03T12:52:59.198 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-01-03T12:52:59.241 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.051) 0:00:29.640 ******** 2021-01-03T12:52:59.276 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.035) 0:00:29.675 ******** 2021-01-03T12:52:59.281 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-01-03T12:52:59.283 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-01-03T12:52:59.320 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.044) 0:00:29.720 ******** 2021-01-03T12:52:59.326 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-01-03T12:52:59.328 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:59.387 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.066) 0:00:29.786 ******** 2021-01-03T12:52:59.392 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-01-03T12:52:59.394 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-01-03T12:52:59.430 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.043) 0:00:29.830 ******** 2021-01-03T12:52:59.436 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-01-03T12:52:59.438 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:52:59.481 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.050) 0:00:29.880 ******** 2021-01-03T12:52:59.516 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.034) 0:00:29.915 ******** 2021-01-03T12:52:59.521 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-01-03T12:52:59.523 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-01-03T12:52:59.523 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-01-03T12:52:59.524 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-01-03T12:52:59.561 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.045) 0:00:29.961 ******** 2021-01-03T12:52:59.594 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.032) 0:00:29.994 ******** 2021-01-03T12:52:59.631 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-01-03T12:52:59.632 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-01-03T12:52:59.667 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.073) 0:00:30.067 ******** 2021-01-03T12:52:59.674 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-01-03T12:52:59.676 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-01-03T12:52:59.712 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.044) 0:00:30.111 ******** 2021-01-03T12:52:59.797 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-01-03T12:52:59.799 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-03T12:52:59.832 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.120) 0:00:30.232 ******** 2021-01-03T12:52:59.866 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.033) 0:00:30.266 ******** 2021-01-03T12:52:59.873 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-01-03T12:52:59.877 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-01-03T12:52:59.911 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:52:59 +0000 (0:00:00.044) 0:00:30.310 ******** 2021-01-03T12:53:00.012 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-01-03T12:53:00.048 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.137) 0:00:30.448 ******** 2021-01-03T12:53:00.075 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-01-03T12:53:00.077 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:00.110 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.061) 0:00:30.510 ******** 2021-01-03T12:53:00.116 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-01-03T12:53:00.118 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-01-03T12:53:00.153 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.042) 0:00:30.552 ******** 2021-01-03T12:53:00.159 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-01-03T12:53:00.161 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:00.195 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.042) 0:00:30.595 ******** 2021-01-03T12:53:00.201 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-01-03T12:53:00.203 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi133"}, "changed": false} 2021-01-03T12:53:00.241 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.045) 0:00:30.641 ******** 2021-01-03T12:53:00.321 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-01-03T12:53:00.323 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-01-03T12:53:00.360 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.118) 0:00:30.759 ******** 2021-01-03T12:53:00.367 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-01-03T12:53:00.368 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-01-03T12:53:00.406 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.045) 0:00:30.805 ******** 2021-01-03T12:53:00.412 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-01-03T12:53:00.413 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi016.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-01-03T12:53:00.451 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.045) 0:00:30.850 ******** 2021-01-03T12:53:00.485 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.034) 0:00:30.885 ******** 2021-01-03T12:53:00.491 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-03T12:53:00.493 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:00.528 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.043) 0:00:30.928 ******** 2021-01-03T12:53:00.534 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-01-03T12:53:00.536 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:00.576 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.047) 0:00:30.976 ******** 2021-01-03T12:53:00.583 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-03T12:53:00.584 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:00.620 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.044) 0:00:31.020 ******** 2021-01-03T12:53:00.628 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-03T12:53:00.630 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:00.665 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.044) 0:00:31.065 ******** 2021-01-03T12:53:00.672 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-03T12:53:00.673 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:00.709 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.043) 0:00:31.109 ******** 2021-01-03T12:53:00.716 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-03T12:53:00.717 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:00.754 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.044) 0:00:31.154 ******** 2021-01-03T12:53:00.760 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-03T12:53:00.762 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:00.796 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.041) 0:00:31.195 ******** 2021-01-03T12:53:00.802 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-01-03T12:53:00.803 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:00.839 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.043) 0:00:31.238 ******** 2021-01-03T12:53:00.870 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.031) 0:00:31.270 ******** 2021-01-03T12:53:00.876 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-01-03T12:53:00.878 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi133", "ansible_hostname": "smithi133", "ansible_nodename": "smithi133"}, "changed": false, "name": "smithi133"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:00.914 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.043) 0:00:31.313 ******** 2021-01-03T12:53:00.947 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.032) 0:00:31.346 ******** 2021-01-03T12:53:00.980 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:00 +0000 (0:00:00.032) 0:00:31.379 ******** 2021-01-03T12:53:00.985 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-01-03T12:53:00.987 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi036"}, "changed": false} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:01.023 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.043) 0:00:31.423 ******** 2021-01-03T12:53:01.056 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.032) 0:00:31.455 ******** 2021-01-03T12:53:01.087 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.031) 0:00:31.487 ******** 2021-01-03T12:53:01.093 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-01-03T12:53:01.095 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:01.131 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.043) 0:00:31.530 ******** 2021-01-03T12:53:01.170 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.038) 0:00:31.569 ******** 2021-01-03T12:53:01.177 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-01-03T12:53:01.212 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.042) 0:00:31.612 ******** 2021-01-03T12:53:01.218 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-01-03T12:53:01.220 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:01.259 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.046) 0:00:31.658 ******** 2021-01-03T12:53:01.266 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-01-03T12:53:01.302 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.042) 0:00:31.701 ******** 2021-01-03T12:53:01.308 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-01-03T12:53:01.310 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-01-03T12:53:01.345 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.043) 0:00:31.745 ******** 2021-01-03T12:53:01.379 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.033) 0:00:31.778 ******** 2021-01-03T12:53:01.385 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-01-03T12:53:01.386 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-01-03T12:53:01.424 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.045) 0:00:31.824 ******** 2021-01-03T12:53:01.458 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.033) 0:00:31.857 ******** 2021-01-03T12:53:01.463 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-01-03T12:53:01.464 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:01.500 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.041) 0:00:31.899 ******** 2021-01-03T12:53:01.506 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-01-03T12:53:01.508 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-01-03T12:53:01.508 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi036", "ansible_hostname": "smithi036", "ansible_nodename": "smithi036"}, "changed": false, "name": "smithi036"} 2021-01-03T12:53:01.545 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.045) 0:00:31.944 ******** 2021-01-03T12:53:01.577 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.032) 0:00:31.977 ******** 2021-01-03T12:53:01.584 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi007.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:01.586 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG] ************************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:01.622 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.044) 0:00:32.021 ******** 2021-01-03T12:53:01.654 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.032) 0:00:32.054 ******** 2021-01-03T12:53:01.660 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:01.699 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.045) 0:00:32.099 ******** 2021-01-03T12:53:01.714 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-01-03T12:53:01.715 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi016.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:01.755 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.055) 0:00:32.154 ******** 2021-01-03T12:53:01.790 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.034) 0:00:32.189 ******** 2021-01-03T12:53:01.796 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:53:01.797 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:01.833 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.043) 0:00:32.232 ******** 2021-01-03T12:53:01.866 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.032) 0:00:32.265 ******** 2021-01-03T12:53:01.871 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-01-03T12:53:01.873 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:01.909 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.043) 0:00:32.309 ******** 2021-01-03T12:53:01.916 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-01-03T12:53:01.918 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-01-03T12:53:01.918 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:01.953 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.044) 0:00:32.353 ******** 2021-01-03T12:53:01.988 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:01 +0000 (0:00:00.034) 0:00:32.387 ******** 2021-01-03T12:53:01.994 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-01-03T12:53:01.996 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:02.035 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.046) 0:00:32.434 ******** 2021-01-03T12:53:02.069 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.034) 0:00:32.469 ******** 2021-01-03T12:53:02.076 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-01-03T12:53:02.078 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:02.115 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.045) 0:00:32.514 ******** 2021-01-03T12:53:02.123 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-01-03T12:53:02.125 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:02.159 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.044) 0:00:32.558 ******** 2021-01-03T12:53:02.165 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-01-03T12:53:02.167 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:02.205 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.045) 0:00:32.604 ******** 2021-01-03T12:53:02.212 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-01-03T12:53:02.213 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:02.250 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.045) 0:00:32.650 ******** 2021-01-03T12:53:02.257 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-03T12:53:02.259 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:02.294 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.044) 0:00:32.694 ******** 2021-01-03T12:53:02.301 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-01-03T12:53:02.303 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-01-03T12:53:02.304 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi133.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-01-03T12:53:02.344 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.049) 0:00:32.744 ******** 2021-01-03T12:53:02.378 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.033) 0:00:32.778 ******** 2021-01-03T12:53:02.413 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.034) 0:00:32.813 ******** 2021-01-03T12:53:02.420 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-03T12:53:02.421 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:02.460 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.046) 0:00:32.859 ******** 2021-01-03T12:53:02.496 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.035) 0:00:32.895 ******** 2021-01-03T12:53:02.502 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-01-03T12:53:02.504 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:02.541 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.044) 0:00:32.940 ******** 2021-01-03T12:53:02.578 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.037) 0:00:32.978 ******** 2021-01-03T12:53:02.586 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-03T12:53:02.587 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:02.588 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:02.625 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.046) 0:00:33.024 ******** 2021-01-03T12:53:02.662 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.037) 0:00:33.061 ******** 2021-01-03T12:53:02.669 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-03T12:53:02.671 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:02.711 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.048) 0:00:33.110 ******** 2021-01-03T12:53:02.746 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.034) 0:00:33.145 ******** 2021-01-03T12:53:02.751 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-03T12:53:02.753 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:02.788 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.042) 0:00:33.188 ******** 2021-01-03T12:53:02.822 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.033) 0:00:33.221 ******** 2021-01-03T12:53:02.828 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:02.830 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:02.864 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.042) 0:00:33.264 ******** 2021-01-03T12:53:02.896 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.031) 0:00:33.295 ******** 2021-01-03T12:53:02.901 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-01-03T12:53:02.903 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi036.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-01-03T12:53:02.904 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:02.938 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.042) 0:00:33.338 ******** 2021-01-03T12:53:02.975 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:02 +0000 (0:00:00.036) 0:00:33.374 ******** 2021-01-03T12:53:03.007 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.032) 0:00:33.406 ******** 2021-01-03T12:53:03.013 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-03T12:53:03.015 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:03.051 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.044) 0:00:33.451 ******** 2021-01-03T12:53:03.084 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.032) 0:00:33.483 ******** 2021-01-03T12:53:03.117 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.032) 0:00:33.516 ******** 2021-01-03T12:53:03.123 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-01-03T12:53:03.125 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:03.161 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.044) 0:00:33.560 ******** 2021-01-03T12:53:03.193 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.031) 0:00:33.592 ******** 2021-01-03T12:53:03.226 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.032) 0:00:33.625 ******** 2021-01-03T12:53:03.235 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-03T12:53:03.237 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:03.271 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.045) 0:00:33.671 ******** 2021-01-03T12:53:03.303 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.032) 0:00:33.703 ******** 2021-01-03T12:53:03.335 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.031) 0:00:33.735 ******** 2021-01-03T12:53:03.341 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:03.343 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:03.378 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.042) 0:00:33.777 ******** 2021-01-03T12:53:03.409 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.031) 0:00:33.809 ******** 2021-01-03T12:53:03.440 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.031) 0:00:33.840 ******** 2021-01-03T12:53:03.445 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-03T12:53:03.447 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:03.482 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.041) 0:00:33.881 ******** 2021-01-03T12:53:03.514 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.032) 0:00:33.913 ******** 2021-01-03T12:53:03.551 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.037) 0:00:33.951 ******** 2021-01-03T12:53:03.557 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-03T12:53:03.558 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:03.594 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.042) 0:00:33.993 ******** 2021-01-03T12:53:03.627 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.033) 0:00:34.026 ******** 2021-01-03T12:53:03.660 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.033) 0:00:34.059 ******** 2021-01-03T12:53:03.665 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-03T12:53:03.667 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:03.702 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.042) 0:00:34.102 ******** 2021-01-03T12:53:03.734 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.031) 0:00:34.133 ******** 2021-01-03T12:53:03.739 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-03T12:53:03.741 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for custom repos] *************************************** ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.003457", "end": "2021-01-03 12:53:03.810155", "rc": 0, "start": "2021-01-03 12:53:03.806698", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:03.741 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:03.777 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.043) 0:00:34.177 ******** 2021-01-03T12:53:03.809 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.031) 0:00:34.209 ******** 2021-01-03T12:53:03.842 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.031) 0:00:34.241 ******** 2021-01-03T12:53:03.847 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-01-03T12:53:03.848 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove custom repos] ****************************************** TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-01-03T12:53:03.849 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:03.883 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.041) 0:00:34.282 ******** 2021-01-03T12:53:03.917 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.033) 0:00:34.316 ******** 2021-01-03T12:53:03.949 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.031) 0:00:34.348 ******** 2021-01-03T12:53:03.954 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-03T12:53:03.956 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:03.990 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:03 +0000 (0:00:00.041) 0:00:34.390 ******** 2021-01-03T12:53:04.022 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.031) 0:00:34.422 ******** 2021-01-03T12:53:04.029 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-01-03T12:53:04.065 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.042) 0:00:34.464 ******** 2021-01-03T12:53:04.070 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-03T12:53:04.072 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:04.115 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.049) 0:00:34.514 ******** 2021-01-03T12:53:04.122 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-01-03T12:53:04.158 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.042) 0:00:34.557 ******** 2021-01-03T12:53:04.164 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-01-03T12:53:04.165 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005138", "end": "2021-01-03 12:53:03.943075", "rc": 0, "start": "2021-01-03 12:53:03.937937", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:04.204 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.045) 0:00:34.603 ******** 2021-01-03T12:53:04.240 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.036) 0:00:34.640 ******** 2021-01-03T12:53:04.248 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-01-03T12:53:04.249 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-01-03T12:53:04.251 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} TASK [testnode : Remove custom repos] ****************************************** 2021-01-03T12:53:04.288 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.047) 0:00:34.688 ******** 2021-01-03T12:53:04.325 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.036) 0:00:34.725 ******** 2021-01-03T12:53:04.363 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.037) 0:00:34.762 ******** 2021-01-03T12:53:04.371 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-01-03T12:53:04.372 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add sources list] ********************************************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:04.412 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.049) 0:00:34.812 ******** 2021-01-03T12:53:04.450 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.037) 0:00:34.850 ******** 2021-01-03T12:53:04.458 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-01-03T12:53:04.459 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:04.493 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.042) 0:00:34.893 ******** 2021-01-03T12:53:04.500 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-01-03T12:53:04.537 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.043) 0:00:34.936 ******** 2021-01-03T12:53:04.543 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-01-03T12:53:04.545 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:04.580 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.043) 0:00:34.979 ******** 2021-01-03T12:53:04.587 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-01-03T12:53:04.624 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.043) 0:00:35.023 ******** 2021-01-03T12:53:04.630 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-01-03T12:53:04.632 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:04.633 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-01-03T12:53:04.670 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.046) 0:00:35.069 ******** 2021-01-03T12:53:04.706 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.036) 0:00:35.106 ******** 2021-01-03T12:53:04.712 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-01-03T12:53:04.713 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:04.749 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.042) 0:00:35.148 ******** 2021-01-03T12:53:04.783 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.033) 0:00:35.182 ******** 2021-01-03T12:53:04.789 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:53:04.791 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:04.827 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.044) 0:00:35.226 ******** 2021-01-03T12:53:04.833 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-01-03T12:53:04.835 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:04.870 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.042) 0:00:35.269 ******** 2021-01-03T12:53:04.877 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-01-03T12:53:04.878 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:04.918 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.047) 0:00:35.317 ******** 2021-01-03T12:53:04.926 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-01-03T12:53:04.928 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:04.977 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:04 +0000 (0:00:00.059) 0:00:35.377 ******** 2021-01-03T12:53:04.984 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-01-03T12:53:04.986 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.020 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.042) 0:00:35.419 ******** 2021-01-03T12:53:05.025 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-01-03T12:53:05.027 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.062 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.042) 0:00:35.461 ******** 2021-01-03T12:53:05.068 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.103 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.041) 0:00:35.503 ******** 2021-01-03T12:53:05.109 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:53:05.110 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.145 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.041) 0:00:35.544 ******** 2021-01-03T12:53:05.150 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-01-03T12:53:05.152 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.186 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.040) 0:00:35.585 ******** 2021-01-03T12:53:05.191 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-01-03T12:53:05.192 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.226 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.040) 0:00:35.626 ******** 2021-01-03T12:53:05.232 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-03T12:53:05.234 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.271 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.044) 0:00:35.670 ******** 2021-01-03T12:53:05.276 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-01-03T12:53:05.277 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.311 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.040) 0:00:35.711 ******** 2021-01-03T12:53:05.318 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-03T12:53:05.320 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.352 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.040) 0:00:35.752 ******** 2021-01-03T12:53:05.357 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-01-03T12:53:05.359 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.394 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.041) 0:00:35.793 ******** 2021-01-03T12:53:05.398 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-03T12:53:05.400 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.434 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.040) 0:00:35.833 ******** 2021-01-03T12:53:05.439 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-01-03T12:53:05.441 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.475 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.041) 0:00:35.874 ******** 2021-01-03T12:53:05.480 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-01-03T12:53:05.482 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.515 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.040) 0:00:35.915 ******** 2021-01-03T12:53:05.521 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-03T12:53:05.523 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.556 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.040) 0:00:35.956 ******** 2021-01-03T12:53:05.563 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-03T12:53:05.565 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.598 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.041) 0:00:35.997 ******** 2021-01-03T12:53:05.603 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-03T12:53:05.605 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.640 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.041) 0:00:36.039 ******** 2021-01-03T12:53:05.645 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-03T12:53:05.646 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.680 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.040) 0:00:36.080 ******** 2021-01-03T12:53:05.685 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-03T12:53:05.688 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.722 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.041) 0:00:36.121 ******** 2021-01-03T12:53:05.728 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-01-03T12:53:05.729 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.765 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.043) 0:00:36.164 ******** 2021-01-03T12:53:05.770 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-01-03T12:53:05.773 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.807 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.041) 0:00:36.206 ******** 2021-01-03T12:53:05.813 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-01-03T12:53:05.814 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.849 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.042) 0:00:36.249 ******** 2021-01-03T12:53:05.854 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-03T12:53:05.856 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.894 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.044) 0:00:36.293 ******** 2021-01-03T12:53:05.900 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-01-03T12:53:05.901 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.938 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.044) 0:00:36.338 ******** 2021-01-03T12:53:05.944 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-03T12:53:05.945 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:05.981 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:05 +0000 (0:00:00.042) 0:00:36.380 ******** 2021-01-03T12:53:05.987 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-01-03T12:53:05.988 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:06.023 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.042) 0:00:36.423 ******** 2021-01-03T12:53:06.029 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-01-03T12:53:06.030 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:06.066 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.042) 0:00:36.465 ******** 2021-01-03T12:53:06.073 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-01-03T12:53:06.075 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:06.109 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.043) 0:00:36.508 ******** 2021-01-03T12:53:06.114 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-01-03T12:53:06.115 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:06.150 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.041) 0:00:36.549 ******** 2021-01-03T12:53:06.155 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-01-03T12:53:06.157 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:06.191 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.041) 0:00:36.591 ******** 2021-01-03T12:53:06.197 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-01-03T12:53:06.199 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:06.234 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.042) 0:00:36.633 ******** 2021-01-03T12:53:06.240 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-01-03T12:53:06.241 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:06.275 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.041) 0:00:36.675 ******** 2021-01-03T12:53:06.281 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-01-03T12:53:06.282 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:06.317 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.041) 0:00:36.716 ******** 2021-01-03T12:53:06.323 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-01-03T12:53:06.324 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:06.358 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.040) 0:00:36.757 ******** 2021-01-03T12:53:06.364 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-01-03T12:53:06.366 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:06.400 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.042) 0:00:36.800 ******** 2021-01-03T12:53:06.427 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-01-03T12:53:06.429 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:06.463 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.062) 0:00:36.862 ******** 2021-01-03T12:53:06.480 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-01-03T12:53:06.481 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005126", "end": "2021-01-03 12:53:06.790666", "rc": 0, "start": "2021-01-03 12:53:06.785540", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:06.519 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.055) 0:00:36.918 ******** 2021-01-03T12:53:06.524 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-01-03T12:53:06.526 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:06.560 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.040) 0:00:36.959 ******** 2021-01-03T12:53:06.566 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-01-03T12:53:06.601 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.041) 0:00:37.001 ******** 2021-01-03T12:53:06.607 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-01-03T12:53:06.608 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:06.644 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.042) 0:00:37.044 ******** 2021-01-03T12:53:06.650 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-01-03T12:53:06.652 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-01-03T12:53:06.688 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.043) 0:00:37.087 ******** 2021-01-03T12:53:06.737 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-01-03T12:53:06.775 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.086) 0:00:37.174 ******** 2021-01-03T12:53:06.782 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-01-03T12:53:06.783 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005255", "end": "2021-01-03 12:53:06.501682", "rc": 0, "start": "2021-01-03 12:53:06.496427", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:06.819 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.044) 0:00:37.218 ******** 2021-01-03T12:53:06.846 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-01-03T12:53:06.880 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.061) 0:00:37.280 ******** 2021-01-03T12:53:06.907 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-01-03T12:53:06.909 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-01-03T12:53:06.944 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.063) 0:00:37.343 ******** 2021-01-03T12:53:06.971 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-01-03T12:53:06.973 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:07.006 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:06 +0000 (0:00:00.061) 0:00:37.405 ******** 2021-01-03T12:53:07.180 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-01-03T12:53:07.181 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-01-03T12:53:07.218 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:07 +0000 (0:00:00.212) 0:00:37.617 ******** 2021-01-03T12:53:07.244 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:07.280 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:07 +0000 (0:00:00.062) 0:00:37.680 ******** 2021-01-03T12:53:07.631 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-01-03T12:53:07.632 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"cache_update_time": 1609678337, "cache_updated": false, "changed": false} 2021-01-03T12:53:07.673 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:07 +0000 (0:00:00.392) 0:00:38.072 ******** 2021-01-03T12:53:07.691 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1609678333, "cache_updated": false, "changed": false} 2021-01-03T12:53:07.726 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:07 +0000 (0:00:00.053) 0:00:38.126 ******** 2021-01-03T12:53:07.733 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-01-03T12:53:07.768 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:07 +0000 (0:00:00.041) 0:00:38.167 ******** 2021-01-03T12:53:07.811 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:07 +0000 (0:00:00.042) 0:00:38.210 ******** 2021-01-03T12:53:07.943 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-01-03T12:53:07.945 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.033309", "end": "2021-01-03 12:53:08.025831", "rc": 0, "start": "2021-01-03 12:53:07.992522", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:07.980 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:07 +0000 (0:00:00.169) 0:00:38.379 ******** 2021-01-03T12:53:07.987 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.037757", "end": "2021-01-03 12:53:07.808448", "rc": 0, "start": "2021-01-03 12:53:07.770691", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:08.024 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:08 +0000 (0:00:00.043) 0:00:38.423 ******** 2021-01-03T12:53:08.029 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-01-03T12:53:08.031 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-01-03T12:53:08.303 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-01-03T12:53:08.908 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-01-03T12:53:08.944 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:08 +0000 (0:00:00.919) 0:00:39.343 ******** 2021-01-03T12:53:09.264 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-01-03T12:53:09.311 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:09 +0000 (0:00:00.366) 0:00:39.710 ******** 2021-01-03T12:53:09.831 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [smithi133.front.sepia.ceph.com] => {"cache_update_time": 1609678330, "cache_updated": false, "changed": false} 2021-01-03T12:53:09.871 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:09 +0000 (0:00:00.560) 0:00:40.271 ******** 2021-01-03T12:53:09.898 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-01-03T12:53:09.933 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:09 +0000 (0:00:00.061) 0:00:40.333 ******** 2021-01-03T12:53:10.095 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-01-03T12:53:10.097 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.037438", "end": "2021-01-03 12:53:10.402257", "rc": 0, "start": "2021-01-03 12:53:10.364819", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:10.131 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:10 +0000 (0:00:00.197) 0:00:40.530 ******** 2021-01-03T12:53:10.221 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-01-03T12:53:10.223 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1609678341, "cache_updated": false, "changed": false} 2021-01-03T12:53:10.260 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:10 +0000 (0:00:00.128) 0:00:40.659 ******** 2021-01-03T12:53:10.288 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-01-03T12:53:10.329 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:10 +0000 (0:00:00.069) 0:00:40.729 ******** 2021-01-03T12:53:10.504 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-01-03T12:53:10.506 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.035910", "end": "2021-01-03 12:53:10.220551", "rc": 0, "start": "2021-01-03 12:53:10.184641", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:10.548 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:10 +0000 (0:00:00.218) 0:00:40.947 ******** 2021-01-03T12:53:11.035 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-01-03T12:53:11.036 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1609678333, "cache_updated": false, "changed": false} 2021-01-03T12:53:11.073 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:11 +0000 (0:00:00.524) 0:00:41.472 ******** 2021-01-03T12:53:11.092 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"cache_update_time": 1609678337, "cache_updated": false, "changed": false} 2021-01-03T12:53:11.136 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:11 +0000 (0:00:00.062) 0:00:41.535 ******** 2021-01-03T12:53:13.016 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"cache_update_time": 1609678330, "cache_updated": false, "changed": false} 2021-01-03T12:53:13.051 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:13 +0000 (0:00:01.915) 0:00:43.451 ******** 2021-01-03T12:53:13.622 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1609678341, "cache_updated": false, "changed": false} 2021-01-03T12:53:13.658 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:13 +0000 (0:00:00.607) 0:00:44.058 ******** 2021-01-03T12:53:21.556 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-01-03T12:53:21.561 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 0 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 102078 files and directories 2021-01-03T12:53:21.563 INFO:teuthology.task.ansible.out: currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.5) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.5) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 0 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2021-01-03T12:53:21.564 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 102078 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.5) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.5) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-01-03T12:53:21.594 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:21 +0000 (0:00:07.935) 0:00:51.993 ******** 2021-01-03T12:53:21.717 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 0 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 102078 files and directories 2021-01-03T12:53:21.718 INFO:teuthology.task.ansible.out: currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.5) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.5) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 0 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2021-01-03T12:53:21.720 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 102078 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.5) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.5) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-01-03T12:53:21.755 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:21 +0000 (0:00:00.160) 0:00:52.154 ******** 2021-01-03T12:53:22.505 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-03T12:53:22.507 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1609678333, "cache_updated": false, "changed": false} 2021-01-03T12:53:22.544 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:22 +0000 (0:00:00.788) 0:00:52.943 ******** 2021-01-03T12:53:22.573 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-01-03T12:53:22.575 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:22.609 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:22 +0000 (0:00:00.065) 0:00:53.008 ******** 2021-01-03T12:53:22.689 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* ok: [smithi007.front.sepia.ceph.com] => {"cache_update_time": 1609678337, "cache_updated": false, "changed": false} 2021-01-03T12:53:22.726 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:22 +0000 (0:00:00.116) 0:00:53.125 ******** 2021-01-03T12:53:22.752 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:22.787 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:22 +0000 (0:00:00.061) 0:00:53.187 ******** 2021-01-03T12:53:23.191 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 0 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 2021-01-03T12:53:23.194 INFO:teuthology.task.ansible.out: 95%\r(Reading database ... 100%\r(Reading database ... 102078 files and directories currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.5) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.5) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 0 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading d 2021-01-03T12:53:23.195 INFO:teuthology.task.ansible.out:atabase ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 102078 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.5) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.5) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-01-03T12:53:23.231 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:23 +0000 (0:00:00.443) 0:00:53.630 ******** 2021-01-03T12:53:24.107 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-03T12:53:24.108 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"cache_update_time": 1609678330, "cache_updated": false, "changed": false} 2021-01-03T12:53:24.142 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:24 +0000 (0:00:00.911) 0:00:54.542 ******** 2021-01-03T12:53:24.158 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-01-03T12:53:24.160 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 0 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 102078 files and directories 2021-01-03T12:53:24.162 INFO:teuthology.task.ansible.out: currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.5) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.5) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 0 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2021-01-03T12:53:24.164 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 102078 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.5) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.5) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-01-03T12:53:24.195 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:24 +0000 (0:00:00.053) 0:00:54.595 ******** 2021-01-03T12:53:24.201 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-01-03T12:53:24.203 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:24.240 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:24 +0000 (0:00:00.044) 0:00:54.639 ******** 2021-01-03T12:53:25.114 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1609678341, "cache_updated": false, "changed": false} 2021-01-03T12:53:25.150 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:25 +0000 (0:00:00.910) 0:00:55.550 ******** 2021-01-03T12:53:25.177 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:25.212 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:25 +0000 (0:00:00.061) 0:00:55.611 ******** 2021-01-03T12:53:31.136 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-03T12:53:31.138 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1609678333, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.5 [2723 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.5 [923 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.34 [40.2 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.34 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.34 [5188 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.34 [871 kB]\nFetched 10.4 MB in 1s (9483 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 2021-01-03T12:53:31.139 INFO:teuthology.task.ansible.out: 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101936 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.5_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.5) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.5_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.5) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.5) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.5) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu 2021-01-03T12:53:31.141 INFO:teuthology.task.ansible.out:1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.5 [2723 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.5 [923 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.34 [40.2 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.34 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.34 [5188 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.34 [871 kB]", "Fetched 10.4 MB in 1s (9483 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Rea 2021-01-03T12:53:31.142 INFO:teuthology.task.ansible.out:ding database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101936 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.5_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.5) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.5_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.5) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.5) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.5) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-01-03T12:53:31.173 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:31 +0000 (0:00:05.961) 0:01:01.573 ******** 2021-01-03T12:53:31.464 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"cache_update_time": 1609678337, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.5 [2723 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.5 [923 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.34 [40.2 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.34 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.34 [5188 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.34 [871 kB]\nFetched 10.4 MB in 1s (9626 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 2021-01-03T12:53:31.466 INFO:teuthology.task.ansible.out: 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101936 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.5_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.5) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.5_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.5) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.5) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.5) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu 2021-01-03T12:53:31.468 INFO:teuthology.task.ansible.out:1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.5 [2723 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.5 [923 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.34 [40.2 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.34 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.34 [5188 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.34 [871 kB]", "Fetched 10.4 MB in 1s (9626 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Rea 2021-01-03T12:53:31.469 INFO:teuthology.task.ansible.out:ding database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101936 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.5_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.5) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.5_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.5) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.5) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.5) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-01-03T12:53:31.502 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:31 +0000 (0:00:00.328) 0:01:01.901 ******** 2021-01-03T12:53:32.076 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-01-03T12:53:32.077 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1609678333, "cache_updated": false, "changed": false} 2021-01-03T12:53:32.114 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:32 +0000 (0:00:00.612) 0:01:02.514 ******** 2021-01-03T12:53:32.247 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-01-03T12:53:32.249 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-01-03T12:53:32.283 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:32 +0000 (0:00:00.169) 0:01:02.683 ******** 2021-01-03T12:53:32.310 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-01-03T12:53:32.312 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:32.346 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:32 +0000 (0:00:00.062) 0:01:02.746 ******** 2021-01-03T12:53:32.415 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-01-03T12:53:32.417 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"cache_update_time": 1609678337, "cache_updated": false, "changed": false} 2021-01-03T12:53:32.453 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:32 +0000 (0:00:00.106) 0:01:02.853 ******** 2021-01-03T12:53:32.471 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-01-03T12:53:32.473 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-01-03T12:53:32.507 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:32 +0000 (0:00:00.054) 0:01:02.907 ******** 2021-01-03T12:53:32.586 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-01-03T12:53:32.588 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-01-03T12:53:32.627 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:32 +0000 (0:00:00.119) 0:01:03.026 ******** 2021-01-03T12:53:32.655 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-01-03T12:53:32.657 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:32.803 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:32 +0000 (0:00:00.176) 0:01:03.202 ******** 2021-01-03T12:53:32.836 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-03T12:53:32.837 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"cache_update_time": 1609678330, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.5 [2723 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.5 [923 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.34 [40.2 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.34 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.34 [5188 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.34 [871 kB]\nFetched 10.4 MB in 1s (9915 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 2021-01-03T12:53:32.838 INFO:teuthology.task.ansible.out: 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101936 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.5_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.5) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.5_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.5) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.5) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.5) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu 2021-01-03T12:53:32.840 INFO:teuthology.task.ansible.out:1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.5 [2723 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.5 [923 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.34 [40.2 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.34 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.34 [5188 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.34 [871 kB]", "Fetched 10.4 MB in 1s (9915 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Rea 2021-01-03T12:53:32.841 INFO:teuthology.task.ansible.out:ding database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101936 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.5_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.5) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.5_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.5) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.5) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.5) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-01-03T12:53:32.874 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:32 +0000 (0:00:00.071) 0:01:03.274 ******** 2021-01-03T12:53:32.944 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-01-03T12:53:32.946 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-01-03T12:53:32.981 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:32 +0000 (0:00:00.107) 0:01:03.381 ******** 2021-01-03T12:53:33.016 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:33 +0000 (0:00:00.034) 0:01:03.416 ******** 2021-01-03T12:53:33.169 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-01-03T12:53:33.171 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-01-03T12:53:33.204 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:33 +0000 (0:00:00.188) 0:01:03.604 ******** 2021-01-03T12:53:33.287 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-01-03T12:53:33.289 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-01-03T12:53:33.323 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:33 +0000 (0:00:00.118) 0:01:03.722 ******** 2021-01-03T12:53:33.340 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-01-03T12:53:33.342 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-03T12:53:33.379 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:33 +0000 (0:00:00.055) 0:01:03.778 ******** 2021-01-03T12:53:33.479 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-01-03T12:53:33.481 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-01-03T12:53:33.517 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:33 +0000 (0:00:00.138) 0:01:03.917 ******** 2021-01-03T12:53:33.661 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-01-03T12:53:33.663 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-03T12:53:33.710 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:33 +0000 (0:00:00.192) 0:01:04.110 ******** 2021-01-03T12:53:33.717 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-01-03T12:53:33.719 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sun 2021-01-03 12:51:25 UTC", "ActiveEnterTimestampMonotonic": "17377542", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target basic.target systemd-tmpfiles-setup.service nss-lookup.target network.target sysinit.target -.mount system.slice systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2021-01-03 12:51:24 UTC", "AssertTimestampMonotonic": "16928755", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2021-01-03 12:51:24 UTC", "ConditionTimestampMonotonic": "16928754", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2021-01-03T12:53:33.720 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1391", "ExecMainStartTimestamp": "Sun 2021-01-03 12:51:25 UTC", "ExecMainStartTimestampMonotonic": "17377530", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2021-01-03 12:51:24 UTC", "InactiveExitTimestampMonotonic": "16929357", "InvocationID": "fe3529439c8749189a9fded2ed1f887f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2021-01-03T12:53:33.722 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1391", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2021-01-03T12:53:33.723 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2021-01-03 12:51:25 UTC", "StateChangeTimestampMonotonic": "17377542", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2021-01-03 12:51:25 UTC", "WatchdogTimestampMonotonic": "17377540", "WatchdogUSec": "0"}} 2021-01-03T12:53:33.759 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:33 +0000 (0:00:00.048) 0:01:04.158 ******** 2021-01-03T12:53:33.766 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-01-03T12:53:33.768 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"cache_update_time": 1609678330, "cache_updated": false, "changed": false} 2021-01-03T12:53:33.821 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:33 +0000 (0:00:00.062) 0:01:04.221 ******** 2021-01-03T12:53:33.827 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-03T12:53:33.829 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:33.887 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:33 +0000 (0:00:00.066) 0:01:04.287 ******** 2021-01-03T12:53:33.895 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-03T12:53:33.896 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1609678341, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.5 [2723 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.5 [923 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.34 [40.2 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.34 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.34 [5188 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.34 [871 kB]\nFetched 10.4 MB in 1s (9467 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 2021-01-03T12:53:33.897 INFO:teuthology.task.ansible.out: 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101936 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.5_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.5) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.5_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.5) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.5) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.5) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu 2021-01-03T12:53:33.899 INFO:teuthology.task.ansible.out:1.4) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.5 [2723 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.5 [923 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.34 [40.2 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.34 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.34 [5188 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.34 [871 kB]", "Fetched 10.4 MB in 1s (9467 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Rea 2021-01-03T12:53:33.900 INFO:teuthology.task.ansible.out:ding database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101936 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.5_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.5) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.5_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.5) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.34_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.5) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.5) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.34) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.34) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.34) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.34) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.4) ..."]} 2021-01-03T12:53:33.934 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:33 +0000 (0:00:00.046) 0:01:04.334 ******** 2021-01-03T12:53:33.942 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-03T12:53:33.943 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:33.979 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:33 +0000 (0:00:00.044) 0:01:04.379 ******** 2021-01-03T12:53:33.987 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-01-03T12:53:33.989 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-01-03T12:53:34.023 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.043) 0:01:04.422 ******** 2021-01-03T12:53:34.029 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-01-03T12:53:34.031 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sun 2021-01-03 12:51:23 UTC", "ActiveEnterTimestampMonotonic": "18514454", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target basic.target system.slice sysinit.target remote-fs.target network.target -.mount systemd-tmpfiles-setup.service systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2021-01-03 12:51:22 UTC", "AssertTimestampMonotonic": "17979177", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2021-01-03 12:51:22 UTC", "ConditionTimestampMonotonic": "17979177", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2021-01-03T12:53:34.032 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1383", "ExecMainStartTimestamp": "Sun 2021-01-03 12:51:23 UTC", "ExecMainStartTimestampMonotonic": "18514444", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2021-01-03 12:51:22 UTC", "InactiveExitTimestampMonotonic": "17980441", "InvocationID": "87f556389a9442e297f1cbfc235f885b", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2021-01-03T12:53:34.034 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1383", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2021-01-03T12:53:34.036 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2021-01-03 12:51:23 UTC", "StateChangeTimestampMonotonic": "18514454", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2021-01-03 12:51:23 UTC", "WatchdogTimestampMonotonic": "18514453", "WatchdogUSec": "0"}} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.068 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.045) 0:01:04.468 ******** 2021-01-03T12:53:34.100 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.032) 0:01:04.500 ******** 2021-01-03T12:53:34.106 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-01-03T12:53:34.108 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.143 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.042) 0:01:04.542 ******** 2021-01-03T12:53:34.177 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.034) 0:01:04.576 ******** 2021-01-03T12:53:34.184 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-03T12:53:34.185 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-03T12:53:34.186 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.221 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.043) 0:01:04.620 ******** 2021-01-03T12:53:34.253 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.032) 0:01:04.653 ******** 2021-01-03T12:53:34.259 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-03T12:53:34.261 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.297 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.043) 0:01:04.697 ******** 2021-01-03T12:53:34.303 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-03T12:53:34.305 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.339 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.041) 0:01:04.738 ******** 2021-01-03T12:53:34.345 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-01-03T12:53:34.347 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.381 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.042) 0:01:04.780 ******** 2021-01-03T12:53:34.416 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.034) 0:01:04.815 ******** 2021-01-03T12:53:34.422 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.423 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.458 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.042) 0:01:04.858 ******** 2021-01-03T12:53:34.492 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.033) 0:01:04.891 ******** 2021-01-03T12:53:34.497 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-03T12:53:34.500 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.534 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.042) 0:01:04.933 ******** 2021-01-03T12:53:34.539 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-03T12:53:34.541 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.575 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.041) 0:01:04.975 ******** 2021-01-03T12:53:34.581 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.616 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.041) 0:01:05.016 ******** 2021-01-03T12:53:34.622 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-03T12:53:34.624 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.658 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.041) 0:01:05.057 ******** 2021-01-03T12:53:34.665 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.700 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.042) 0:01:05.099 ******** 2021-01-03T12:53:34.706 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:53:34.708 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.743 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.043) 0:01:05.143 ******** 2021-01-03T12:53:34.749 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-01-03T12:53:34.751 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} TASK [testnode : set_fact] ***************************************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.786 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.043) 0:01:05.186 ******** 2021-01-03T12:53:34.818 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.032) 0:01:05.218 ******** 2021-01-03T12:53:34.825 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-03T12:53:34.827 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.862 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.043) 0:01:05.261 ******** 2021-01-03T12:53:34.895 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.033) 0:01:05.294 ******** 2021-01-03T12:53:34.900 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-01-03T12:53:34.902 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1609678341, "cache_updated": false, "changed": false} TASK [testnode : Install packages] ********************************************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.937 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.042) 0:01:05.337 ******** 2021-01-03T12:53:34.970 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:34 +0000 (0:00:00.032) 0:01:05.369 ******** 2021-01-03T12:53:34.975 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:34.977 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi133.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-01-03T12:53:35.016 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.046) 0:01:05.416 ******** 2021-01-03T12:53:35.050 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.033) 0:01:05.449 ******** 2021-01-03T12:53:35.082 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.032) 0:01:05.482 ******** 2021-01-03T12:53:35.088 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-03T12:53:35.089 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:35.125 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.043) 0:01:05.525 ******** 2021-01-03T12:53:35.158 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.033) 0:01:05.558 ******** 2021-01-03T12:53:35.165 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-01-03T12:53:35.166 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:35.202 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.043) 0:01:05.602 ******** 2021-01-03T12:53:35.235 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.032) 0:01:05.634 ******** 2021-01-03T12:53:35.241 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-03T12:53:35.242 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi133.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-03T12:53:35.243 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:35.279 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.044) 0:01:05.679 ******** 2021-01-03T12:53:35.312 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.032) 0:01:05.711 ******** 2021-01-03T12:53:35.343 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.031) 0:01:05.742 ******** 2021-01-03T12:53:35.347 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-01-03T12:53:35.349 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:35.385 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.041) 0:01:05.784 ******** 2021-01-03T12:53:35.417 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.032) 0:01:05.817 ******** 2021-01-03T12:53:35.448 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.030) 0:01:05.847 ******** 2021-01-03T12:53:35.453 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-03T12:53:35.455 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:35.491 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.042) 0:01:05.890 ******** 2021-01-03T12:53:35.524 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.033) 0:01:05.924 ******** 2021-01-03T12:53:35.531 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-03T12:53:35.532 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:35.566 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.041) 0:01:05.965 ******** 2021-01-03T12:53:35.572 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-03T12:53:35.573 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:35.614 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.048) 0:01:06.014 ******** 2021-01-03T12:53:35.621 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-01-03T12:53:35.623 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:35.659 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.045) 0:01:06.059 ******** 2021-01-03T12:53:35.693 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.033) 0:01:06.093 ******** 2021-01-03T12:53:35.700 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-03T12:53:35.702 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop apache2] ************************************************* 2021-01-03T12:53:35.704 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sun 2021-01-03 12:51:42 UTC", "ActiveEnterTimestampMonotonic": "17939299", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service nss-lookup.target system.slice remote-fs.target -.mount network.target systemd-journald.socket sysinit.target basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2021-01-03 12:51:42 UTC", "AssertTimestampMonotonic": "17508893", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2021-01-03 12:51:42 UTC", "ConditionTimestampMonotonic": "17508893", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2021-01-03T12:53:35.705 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1215", "ExecMainStartTimestamp": "Sun 2021-01-03 12:51:42 UTC", "ExecMainStartTimestampMonotonic": "17939287", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2021-01-03 12:51:42 UTC", "InactiveExitTimestampMonotonic": "17509707", "InvocationID": "24bf1e62f7be4799abaea5fe205f0571", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2021-01-03T12:53:35.707 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1215", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2021-01-03T12:53:35.708 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2021-01-03 12:51:42 UTC", "StateChangeTimestampMonotonic": "17939299", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2021-01-03 12:51:42 UTC", "WatchdogTimestampMonotonic": "17939297", "WatchdogUSec": "0"}} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:35.761 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.068) 0:01:06.161 ******** 2021-01-03T12:53:35.798 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.036) 0:01:06.197 ******** 2021-01-03T12:53:35.832 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.033) 0:01:06.231 ******** 2021-01-03T12:53:35.839 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-03T12:53:35.841 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:35.877 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.044) 0:01:06.276 ******** 2021-01-03T12:53:35.910 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.033) 0:01:06.310 ******** 2021-01-03T12:53:35.916 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-03T12:53:35.918 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:35.955 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.044) 0:01:06.354 ******** 2021-01-03T12:53:35.987 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:35 +0000 (0:00:00.032) 0:01:06.387 ******** 2021-01-03T12:53:35.992 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-03T12:53:35.994 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:35.995 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-01-03T12:53:36.030 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.042) 0:01:06.430 ******** 2021-01-03T12:53:36.063 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.032) 0:01:06.463 ******** 2021-01-03T12:53:36.096 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.032) 0:01:06.495 ******** 2021-01-03T12:53:36.102 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-03T12:53:36.104 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:36.139 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.043) 0:01:06.539 ******** 2021-01-03T12:53:36.172 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.032) 0:01:06.572 ******** 2021-01-03T12:53:36.213 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.040) 0:01:06.612 ******** 2021-01-03T12:53:36.218 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-03T12:53:36.220 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:36.255 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.042) 0:01:06.655 ******** 2021-01-03T12:53:36.287 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.031) 0:01:06.686 ******** 2021-01-03T12:53:36.293 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-03T12:53:36.295 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi036.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-01-03T12:53:36.296 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:36.331 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.044) 0:01:06.731 ******** 2021-01-03T12:53:36.365 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.033) 0:01:06.764 ******** 2021-01-03T12:53:36.398 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.032) 0:01:06.797 ******** 2021-01-03T12:53:36.403 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-03T12:53:36.405 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:36.441 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.043) 0:01:06.840 ******** 2021-01-03T12:53:36.446 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-03T12:53:36.448 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:36.483 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.042) 0:01:06.883 ******** 2021-01-03T12:53:36.489 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-03T12:53:36.490 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-01-03T12:53:36.526 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.042) 0:01:06.926 ******** 2021-01-03T12:53:36.559 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.032) 0:01:06.958 ******** 2021-01-03T12:53:36.565 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-01-03T12:53:36.567 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:36.602 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.043) 0:01:07.002 ******** 2021-01-03T12:53:36.635 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.032) 0:01:07.034 ******** 2021-01-03T12:53:36.641 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-03T12:53:36.642 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:36.677 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.042) 0:01:07.077 ******** 2021-01-03T12:53:36.684 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-03T12:53:36.686 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:36.720 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.042) 0:01:07.119 ******** 2021-01-03T12:53:36.726 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-03T12:53:36.727 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:36.768 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.048) 0:01:07.168 ******** 2021-01-03T12:53:36.774 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-03T12:53:36.776 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:36.810 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.041) 0:01:07.210 ******** 2021-01-03T12:53:36.817 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-01-03T12:53:36.818 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:36.853 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.042) 0:01:07.252 ******** 2021-01-03T12:53:36.858 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-03T12:53:36.860 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:36.899 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.045) 0:01:07.298 ******** 2021-01-03T12:53:36.933 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.033) 0:01:07.332 ******** 2021-01-03T12:53:36.940 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-01-03T12:53:36.942 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sun 2021-01-03 12:51:17 UTC", "ActiveEnterTimestampMonotonic": "17928927", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount sysinit.target nss-lookup.target basic.target network.target remote-fs.target systemd-journald.socket system.slice systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2021-01-03 12:51:17 UTC", "AssertTimestampMonotonic": "17379305", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2021-01-03 12:51:17 UTC", "ConditionTimestampMonotonic": "17379305", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2021-01-03T12:53:36.944 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1392", "ExecMainStartTimestamp": "Sun 2021-01-03 12:51:17 UTC", "ExecMainStartTimestampMonotonic": "17928915", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2021-01-03 12:51:17 UTC", "InactiveExitTimestampMonotonic": "17380257", "InvocationID": "7132d8077de8418fb1a74e1d3eb78da9", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2021-01-03T12:53:36.945 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1392", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2021-01-03T12:53:36.947 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2021-01-03 12:51:17 UTC", "StateChangeTimestampMonotonic": "17928927", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2021-01-03 12:51:17 UTC", "WatchdogTimestampMonotonic": "17928926", "WatchdogUSec": "0"}} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:36.979 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:36 +0000 (0:00:00.046) 0:01:07.378 ******** 2021-01-03T12:53:37.012 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.032) 0:01:07.411 ******** 2021-01-03T12:53:37.018 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:53:37.020 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-01-03T12:53:37.056 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.044) 0:01:07.455 ******** 2021-01-03T12:53:37.088 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.032) 0:01:07.488 ******** 2021-01-03T12:53:37.094 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-03T12:53:37.096 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:37.132 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.043) 0:01:07.531 ******** 2021-01-03T12:53:37.137 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-03T12:53:37.139 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:37.173 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.041) 0:01:07.573 ******** 2021-01-03T12:53:37.178 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-03T12:53:37.180 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:37.215 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.041) 0:01:07.614 ******** 2021-01-03T12:53:37.221 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-03T12:53:37.223 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:37.257 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.042) 0:01:07.657 ******** 2021-01-03T12:53:37.263 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-03T12:53:37.264 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:37.299 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.041) 0:01:07.699 ******** 2021-01-03T12:53:37.305 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-03T12:53:37.307 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-01-03T12:53:37.346 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.046) 0:01:07.746 ******** 2021-01-03T12:53:37.379 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.032) 0:01:07.779 ******** 2021-01-03T12:53:37.385 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-03T12:53:37.386 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-01-03T12:53:37.426 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.046) 0:01:07.826 ******** 2021-01-03T12:53:37.463 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.036) 0:01:07.862 ******** 2021-01-03T12:53:37.469 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-03T12:53:37.471 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:37.507 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.044) 0:01:07.907 ******** 2021-01-03T12:53:37.543 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.035) 0:01:07.942 ******** 2021-01-03T12:53:37.549 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-03T12:53:37.551 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:37.588 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.044) 0:01:07.987 ******** 2021-01-03T12:53:37.593 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-03T12:53:37.595 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:37.631 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.043) 0:01:08.031 ******** 2021-01-03T12:53:37.636 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-03T12:53:37.638 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:37.674 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.043) 0:01:08.074 ******** 2021-01-03T12:53:37.680 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-03T12:53:37.682 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:37.717 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.042) 0:01:08.116 ******** 2021-01-03T12:53:37.722 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-01-03T12:53:37.724 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:37.760 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.042) 0:01:08.159 ******** 2021-01-03T12:53:37.792 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.032) 0:01:08.192 ******** 2021-01-03T12:53:37.798 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-03T12:53:37.800 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:37.835 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.042) 0:01:08.234 ******** 2021-01-03T12:53:37.841 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-01-03T12:53:37.842 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-01-03T12:53:37.844 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:37.884 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.048) 0:01:08.283 ******** 2021-01-03T12:53:37.916 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.032) 0:01:08.316 ******** 2021-01-03T12:53:37.923 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:37.960 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.043) 0:01:08.360 ******** 2021-01-03T12:53:37.965 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:53:37.967 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:38.002 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:37 +0000 (0:00:00.042) 0:01:08.402 ******** 2021-01-03T12:53:38.008 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-03T12:53:38.010 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:38.045 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.042) 0:01:08.444 ******** 2021-01-03T12:53:38.050 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-03T12:53:38.052 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:38.086 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.041) 0:01:08.486 ******** 2021-01-03T12:53:38.092 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-01-03T12:53:38.094 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:38.129 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.042) 0:01:08.528 ******** 2021-01-03T12:53:38.161 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.032) 0:01:08.560 ******** 2021-01-03T12:53:38.167 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-03T12:53:38.168 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:38.209 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.048) 0:01:08.609 ******** 2021-01-03T12:53:38.215 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-03T12:53:38.216 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-01-03T12:53:38.252 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.043) 0:01:08.652 ******** 2021-01-03T12:53:38.285 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.032) 0:01:08.685 ******** 2021-01-03T12:53:38.290 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-03T12:53:38.292 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi007.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-03T12:53:38.327 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.041) 0:01:08.727 ******** 2021-01-03T12:53:38.359 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.031) 0:01:08.759 ******** 2021-01-03T12:53:38.365 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-03T12:53:38.366 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:38.401 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.041) 0:01:08.800 ******** 2021-01-03T12:53:38.433 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.032) 0:01:08.833 ******** 2021-01-03T12:53:38.439 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-03T12:53:38.440 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop collectl] ************************************************ skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:38.480 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.046) 0:01:08.879 ******** 2021-01-03T12:53:38.512 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.032) 0:01:08.912 ******** 2021-01-03T12:53:38.518 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-03T12:53:38.520 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:38.555 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.042) 0:01:08.954 ******** 2021-01-03T12:53:38.586 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.031) 0:01:08.986 ******** 2021-01-03T12:53:38.592 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-03T12:53:38.593 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-01-03T12:53:38.595 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:38.629 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.042) 0:01:09.029 ******** 2021-01-03T12:53:38.662 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.032) 0:01:09.061 ******** 2021-01-03T12:53:38.694 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.032) 0:01:09.094 ******** 2021-01-03T12:53:38.700 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-03T12:53:38.702 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:38.736 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.042) 0:01:09.136 ******** 2021-01-03T12:53:38.769 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.032) 0:01:09.169 ******** 2021-01-03T12:53:38.775 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-03T12:53:38.777 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:38.777 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi007.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-01-03T12:53:38.813 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.043) 0:01:09.213 ******** 2021-01-03T12:53:38.848 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.035) 0:01:09.248 ******** 2021-01-03T12:53:38.857 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-01-03T12:53:38.859 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi007.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:38.895 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.046) 0:01:09.294 ******** 2021-01-03T12:53:38.938 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:38 +0000 (0:00:00.042) 0:01:09.337 ******** 2021-01-03T12:53:39.423 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi007.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [smithi007.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi007.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi007.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (ite 2021-01-03T12:53:39.425 INFO:teuthology.task.ansible.out:m=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} Sunday 03 January 2021 12:53:38 +0000 (0:00:00.052) 0:01:09.390 ******** Sunday 03 January 2021 12:53:39 +0000 (0:00:00.039) 0:01:09.429 ******** skipping: [smithi007.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop collectl] ************************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Sunday 03 January 2021 12:53:39 +0000 (0:00:00.050) 0:01:09.480 ******** Sunday 03 January 2021 12:53:39 +0000 (0:00:00.032) 0:01:09.513 ******** Sunday 03 January 2021 12:53:39 +0000 (0:00:00.035) 0:01:09.548 ******** TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:39.427 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Sunday 03 January 2021 12:53:39 +0000 (0:00:00.043) 0:01:09.591 ******** Sunday 03 January 2021 12:53:39 +0000 (0:00:00.035) 0:01:09.627 ******** TASK [testnode : Set grub config.] ********************************************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Sunday 03 January 2021 12:53:39 +0000 (0:00:00.043) 0:01:09.671 ******** Sunday 03 January 2021 12:53:39 +0000 (0:00:00.031) 0:01:09.702 ******** TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi007.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003114", "end": "2021-01-03 12:53:39.237056", "rc": 0, "start": "2021-01-03 12:53:39.233942", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Sunday 03 January 2021 12:53:39 +0000 (0:00:00.048) 0:01:09.751 ******** Sunday 03 January 2021 12:53:39 +0000 (0:00:00.033) 2021-01-03T12:53:39.428 INFO:teuthology.task.ansible.out: 0:01:09.784 ******** Sunday 03 January 2021 12:53:39 +0000 (0:00:00.032) 0:01:09.816 ******** TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-01-03T12:53:39.463 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:39 +0000 (0:00:00.045) 0:01:09.862 ******** 2021-01-03T12:53:39.494 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:39 +0000 (0:00:00.031) 0:01:09.894 ******** 2021-01-03T12:53:39.500 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-01-03T12:53:39.501 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:39.542 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:39 +0000 (0:00:00.047) 0:01:09.941 ******** 2021-01-03T12:53:39.577 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:39 +0000 (0:00:00.034) 0:01:09.976 ******** 2021-01-03T12:53:39.609 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:39 +0000 (0:00:00.032) 0:01:10.009 ******** 2021-01-03T12:53:39.615 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-01-03T12:53:39.616 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:39.617 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:39.617 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:39.619 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi016.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:39.619 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-01-03T12:53:39.620 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:39.621 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:39.621 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi016.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:39.621 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:39.622 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:39.622 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:39.659 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:39 +0000 (0:00:00.049) 0:01:10.058 ******** 2021-01-03T12:53:39.692 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:39 +0000 (0:00:00.032) 0:01:10.091 ******** 2021-01-03T12:53:39.699 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:39.700 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:39.743 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:39 +0000 (0:00:00.051) 0:01:10.142 ******** 2021-01-03T12:53:39.749 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-03T12:53:39.751 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:39.790 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:39 +0000 (0:00:00.047) 0:01:10.190 ******** 2021-01-03T12:53:39.817 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-03T12:53:39.819 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:39.856 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:39 +0000 (0:00:00.065) 0:01:10.255 ******** 2021-01-03T12:53:39.884 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-03T12:53:39.886 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:39.937 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:39 +0000 (0:00:00.081) 0:01:10.337 ******** 2021-01-03T12:53:39.945 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-03T12:53:39.946 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-01-03T12:53:39.948 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi016.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.002981", "end": "2021-01-03 12:53:39.901929", "rc": 0, "start": "2021-01-03 12:53:39.898948", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2021-01-03T12:53:39.998 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:39 +0000 (0:00:00.060) 0:01:10.397 ******** 2021-01-03T12:53:40.035 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:40 +0000 (0:00:00.036) 0:01:10.434 ******** 2021-01-03T12:53:40.039 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-03T12:53:40.041 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:40.084 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:40 +0000 (0:00:00.049) 0:01:10.483 ******** 2021-01-03T12:53:40.122 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:40 +0000 (0:00:00.037) 0:01:10.521 ******** 2021-01-03T12:53:40.127 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-03T12:53:40.130 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:40.164 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:40 +0000 (0:00:00.042) 0:01:10.563 ******** 2021-01-03T12:53:40.198 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:40 +0000 (0:00:00.033) 0:01:10.597 ******** 2021-01-03T12:53:40.205 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-03T12:53:40.207 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:40.245 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:40 +0000 (0:00:00.046) 0:01:10.644 ******** 2021-01-03T12:53:40.279 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:40 +0000 (0:00:00.034) 0:01:10.678 ******** 2021-01-03T12:53:40.306 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-01-03T12:53:40.307 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:40.342 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:40 +0000 (0:00:00.063) 0:01:10.741 ******** 2021-01-03T12:53:40.473 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-01-03T12:53:40.475 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-01-03T12:53:40.509 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:40 +0000 (0:00:00.166) 0:01:10.908 ******** 2021-01-03T12:53:40.514 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-01-03T12:53:40.516 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-01-03T12:53:40.551 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:40 +0000 (0:00:00.042) 0:01:10.951 ******** 2021-01-03T12:53:40.577 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-01-03T12:53:40.579 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"cache_update_time": 1609678337, "cache_updated": false, "changed": false} 2021-01-03T12:53:40.614 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:40 +0000 (0:00:00.062) 0:01:11.014 ******** 2021-01-03T12:53:40.641 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-01-03T12:53:40.643 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:40.676 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:40 +0000 (0:00:00.061) 0:01:11.076 ******** 2021-01-03T12:53:40.713 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-03T12:53:40.715 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => (item={'block_used': 13644207, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226450901, 'size_available': 927542890496, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113977, 'block_size': 4096, 'inode_available': 60940999}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226450901, "block_size": 4096, "block_total": 240095108, "block_used": 13644207, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60940999, "inode_total": 61054976, "inode_used": 113977, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927542890496, "size_total": 983429562368, "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}} 2021-01-03T12:53:40.749 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:40 +0000 (0:00:00.072) 0:01:11.148 ******** 2021-01-03T12:53:40.828 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-03T12:53:40.829 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-01-03T12:53:40.865 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:40 +0000 (0:00:00.115) 0:01:11.264 ******** 2021-01-03T12:53:40.871 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-01-03T12:53:40.873 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-01-03T12:53:40.908 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:40 +0000 (0:00:00.043) 0:01:11.307 ******** 2021-01-03T12:53:40.913 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-01-03T12:53:40.915 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.008780", "end": "2021-01-03 12:53:40.948327", "rc": 0, "start": "2021-01-03 12:53:40.939547", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-03T12:53:40.915 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:40.957 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:40 +0000 (0:00:00.049) 0:01:11.356 ******** 2021-01-03T12:53:40.990 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:40 +0000 (0:00:00.033) 0:01:11.390 ******** 2021-01-03T12:53:40.997 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-01-03T12:53:40.999 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'block_used': 13644207, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226450901, 'size_available': 927542890496, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113977, 'block_size': 4096, 'inode_available': 60940999}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226450901, "block_size": 4096, "block_total": 240095108, "block_used": 13644207, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60940999, "inode_total": 61054976, "inode_used": 113977, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927542890496, "size_total": 983429562368, "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:41.035 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.044) 0:01:11.435 ******** 2021-01-03T12:53:41.062 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-01-03T12:53:41.096 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.061) 0:01:11.496 ******** 2021-01-03T12:53:41.136 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-03T12:53:41.137 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:41.157 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-01-03T12:53:41.159 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1609678333, "cache_updated": false, "changed": false} 2021-01-03T12:53:41.193 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.096) 0:01:11.593 ******** 2021-01-03T12:53:41.210 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-01-03T12:53:41.212 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-01-03T12:53:41.246 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.052) 0:01:11.645 ******** 2021-01-03T12:53:41.252 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-01-03T12:53:41.253 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:41.289 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.042) 0:01:11.688 ******** 2021-01-03T12:53:41.305 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-01-03T12:53:41.307 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-01-03T12:53:41.342 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.053) 0:01:11.742 ******** 2021-01-03T12:53:41.348 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-03T12:53:41.350 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item={'block_used': 13644207, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226450901, 'size_available': 927542890496, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113977, 'block_size': 4096, 'inode_available': 60940999}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226450901, "block_size": 4096, "block_total": 240095108, "block_used": 13644207, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60940999, "inode_total": 61054976, "inode_used": 113977, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927542890496, "size_total": 983429562368, "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}} 2021-01-03T12:53:41.388 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.045) 0:01:11.787 ******** 2021-01-03T12:53:41.396 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-01-03T12:53:41.398 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-03T12:53:41.433 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.045) 0:01:11.832 ******** 2021-01-03T12:53:41.459 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-01-03T12:53:41.461 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:41.494 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.061) 0:01:11.894 ******** 2021-01-03T12:53:41.510 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-01-03T12:53:41.512 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.008009", "end": "2021-01-03 12:53:41.358334", "rc": 0, "start": "2021-01-03 12:53:41.350325", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Stop collectl] ************************************************ skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:41.548 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.053) 0:01:11.947 ******** 2021-01-03T12:53:41.581 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.032) 0:01:11.980 ******** 2021-01-03T12:53:41.587 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-01-03T12:53:41.589 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'block_used': 13644207, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226450901, 'size_available': 927542890496, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113977, 'block_size': 4096, 'inode_available': 60940999}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226450901, "block_size": 4096, "block_total": 240095108, "block_used": 13644207, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60940999, "inode_total": 61054976, "inode_used": 113977, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927542890496, "size_total": 983429562368, "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:41.625 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.044) 0:01:12.025 ******** 2021-01-03T12:53:41.631 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-01-03T12:53:41.633 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:41.670 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.044) 0:01:12.070 ******** 2021-01-03T12:53:41.676 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-01-03T12:53:41.677 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-01-03T12:53:41.677 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-01-03T12:53:41.713 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.042) 0:01:12.113 ******** 2021-01-03T12:53:41.747 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.033) 0:01:12.146 ******** 2021-01-03T12:53:41.753 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-01-03T12:53:41.755 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:41.791 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.043) 0:01:12.190 ******** 2021-01-03T12:53:41.796 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-03T12:53:41.798 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:41.809 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-01-03T12:53:41.810 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:41.844 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.053) 0:01:12.244 ******** 2021-01-03T12:53:41.872 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:53:41.873 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-01-03T12:53:41.907 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:41 +0000 (0:00:00.062) 0:01:12.306 ******** 2021-01-03T12:53:41.944 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-01-03T12:53:41.946 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:41.956 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:41.966 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:41.968 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:41.978 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:41.988 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:41.999 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-01-03T12:53:42.001 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.011 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.021 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.032 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.034 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.044 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-01-03T12:53:42.046 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi133.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.081 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:42 +0000 (0:00:00.174) 0:01:12.481 ******** 2021-01-03T12:53:42.087 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.132 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:42 +0000 (0:00:00.051) 0:01:12.532 ******** 2021-01-03T12:53:42.211 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-01-03T12:53:42.213 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-03T12:53:42.250 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:42 +0000 (0:00:00.117) 0:01:12.650 ******** 2021-01-03T12:53:42.277 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-01-03T12:53:42.278 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.313 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:42 +0000 (0:00:00.062) 0:01:12.712 ******** 2021-01-03T12:53:42.319 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-01-03T12:53:42.321 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.002676", "end": "2021-01-03 12:53:42.290851", "rc": 0, "start": "2021-01-03 12:53:42.288175", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2021-01-03T12:53:42.359 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:42 +0000 (0:00:00.046) 0:01:12.758 ******** 2021-01-03T12:53:42.364 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-01-03T12:53:42.365 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.401 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:42 +0000 (0:00:00.042) 0:01:12.801 ******** 2021-01-03T12:53:42.407 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-01-03T12:53:42.408 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.450 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:42 +0000 (0:00:00.048) 0:01:12.849 ******** 2021-01-03T12:53:42.456 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-01-03T12:53:42.457 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.493 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:42 +0000 (0:00:00.043) 0:01:12.893 ******** 2021-01-03T12:53:42.501 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-01-03T12:53:42.503 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.536 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:42 +0000 (0:00:00.043) 0:01:12.936 ******** 2021-01-03T12:53:42.543 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-01-03T12:53:42.544 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.580 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:42 +0000 (0:00:00.043) 0:01:12.980 ******** 2021-01-03T12:53:42.586 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-01-03T12:53:42.588 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.623 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:42 +0000 (0:00:00.043) 0:01:13.023 ******** 2021-01-03T12:53:42.629 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-01-03T12:53:42.631 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.668 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:42 +0000 (0:00:00.044) 0:01:13.067 ******** 2021-01-03T12:53:42.694 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:53:42.696 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-01-03T12:53:42.731 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:42 +0000 (0:00:00.063) 0:01:13.131 ******** 2021-01-03T12:53:42.768 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-01-03T12:53:42.770 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.779 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.790 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.792 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.801 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.812 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.813 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-01-03T12:53:42.824 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.834 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.845 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.847 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.856 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.869 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.880 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-01-03T12:53:42.920 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:42 +0000 (0:00:00.189) 0:01:13.320 ******** 2021-01-03T12:53:42.926 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-03T12:53:42.928 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQE4ZtH1jt2Oi4xgFattDktlSYYl5R0Bcv0'], 'uuids': ['8fc69caf-e26a-4353-8fa5-394747cd134f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.638214", "end": "2021-01-03 12:53:42.961251", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQE4ZtH1jt2Oi4xgFattDktlSYYl5R0Bcv0"], "labels": [], "masters": [], "uuids": ["8fc69caf-e26a-4353-8fa5-394747cd134f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:41.323037", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:42.929 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => 2021-01-03T12:53:42.931 INFO:teuthology.task.ansible.out:(item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:43.102 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-01-03T12:53:43.104 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003142", "end": "2021-01-03 12:53:43.079347", "rc": 0, "start": "2021-01-03 12:53:43.076205", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2021-01-03T12:53:43.141 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:43 +0000 (0:00:00.221) 0:01:13.541 ******** 2021-01-03T12:53:43.167 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-01-03T12:53:43.168 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:43.205 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:43 +0000 (0:00:00.063) 0:01:13.605 ******** 2021-01-03T12:53:43.207 INFO:teuthology.task.ansible.out: 2021-01-03T12:53:43.232 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-01-03T12:53:43.233 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:43.269 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:43 +0000 (0:00:00.063) 0:01:13.669 ******** 2021-01-03T12:53:43.296 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-01-03T12:53:43.298 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:43.335 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:43 +0000 (0:00:00.065) 0:01:13.735 ******** 2021-01-03T12:53:43.528 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-01-03T12:53:43.529 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"cache_update_time": 1609678330, "cache_updated": false, "changed": false} 2021-01-03T12:53:43.564 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:43 +0000 (0:00:00.229) 0:01:13.964 ******** 2021-01-03T12:53:43.591 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-01-03T12:53:43.592 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:43.625 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:43 +0000 (0:00:00.060) 0:01:14.024 ******** 2021-01-03T12:53:43.664 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-03T12:53:43.666 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item={'block_used': 13644198, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226450910, 'size_available': 927542927360, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113978, 'block_size': 4096, 'inode_available': 60940998}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226450910, "block_size": 4096, "block_total": 240095108, "block_used": 13644198, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60940998, "inode_total": 61054976, "inode_used": 113978, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927542927360, "size_total": 983429562368, "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}} 2021-01-03T12:53:43.698 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:43 +0000 (0:00:00.073) 0:01:14.098 ******** 2021-01-03T12:53:43.778 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye32ssVOu987Ut01mlKUyUCwzLQSz9ySVwz'], 'uuids': ['5ac7f084-f665-44c0-bd47-aef9d9aca125']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.894988", "end": "2021-01-03 12:53:43.607322", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye32ssVOu987Ut01mlKUyUCwzLQSz9ySVwz"], "labels": [], "masters": [], "uuids": ["5ac7f084-f665-44c0-bd47-aef9d9aca125"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:41.712334", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk u 2021-01-03T12:53:43.780 INFO:teuthology.task.ansible.out:sing fdisk or", "other utilities."]} skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:43.790 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:43.833 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-01-03T12:53:43.834 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.010043", "end": "2021-01-03 12:53:44.144332", "rc": 0, "start": "2021-01-03 12:53:44.134289", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:43.869 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:43 +0000 (0:00:00.170) 0:01:14.268 ******** 2021-01-03T12:53:43.905 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-01-03T12:53:43.907 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'block_used': 13644198, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226450910, 'size_available': 927542927360, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113978, 'block_size': 4096, 'inode_available': 60940998}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226450910, "block_size": 4096, "block_total": 240095108, "block_used": 13644198, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60940998, "inode_total": 61054976, "inode_used": 113978, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927542927360, "size_total": 983429562368, "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:43.942 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:43 +0000 (0:00:00.072) 0:01:14.341 ******** 2021-01-03T12:53:43.968 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-01-03T12:53:44.003 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:43 +0000 (0:00:00.061) 0:01:14.403 ******** 2021-01-03T12:53:44.051 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-03T12:53:44.053 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:44.147 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQEEcx0rpdxf73pRKEEyecXOxQMNVo1Vbpw'], 'uuids': ['d8c0c0c5-4eb2-449f-9e28-0a5dd61be983']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.120587", "end": "2021-01-03 12:53:44.217256", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQEEcx0rpdxf73pRKEEyecXOxQMNVo1Vbpw"], "labels": [], "masters": [], "uuids": ["d8c0c0c5-4eb2-449f-9e28-0a5dd61be983"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:43.096669", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:44.159 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HPND', 'wwn-0x5000c500871a9ba6'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HPND-part1', 'wwn-0x5000c500871a9ba6-part1'], 'uuids': ['397198c1-ee90-4109-8119-26133eb0d3c7']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a9ba6', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HPND', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HPND", "wwn-0x5000c500871a9ba6"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HPND-part1", "wwn-0x5000c500871a9ba6-part1"], "labels": [], "masters": [], "uuids": ["397198c1-ee90-4109-8119-26133eb0d3c7"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HPND", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a9ba6"}}, "skip_reason": 2021-01-03T12:53:44.161 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-01-03T12:53:44.244 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-01-03T12:53:44.246 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1609678341, "cache_updated": false, "changed": false} 2021-01-03T12:53:44.281 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:44 +0000 (0:00:00.277) 0:01:14.681 ******** 2021-01-03T12:53:44.309 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-01-03T12:53:44.312 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:44.345 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:44 +0000 (0:00:00.064) 0:01:14.745 ******** 2021-01-03T12:53:44.393 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-03T12:53:44.395 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'block_used': 13644209, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226450899, 'size_available': 927542882304, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113977, 'block_size': 4096, 'inode_available': 60940999}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226450899, "block_size": 4096, "block_total": 240095108, "block_used": 13644209, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60940999, "inode_total": 61054976, "inode_used": 113977, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927542882304, "size_total": 983429562368, "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}} 2021-01-03T12:53:44.428 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:44 +0000 (0:00:00.082) 0:01:14.828 ******** 2021-01-03T12:53:44.559 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-01-03T12:53:44.562 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009904", "end": "2021-01-03 12:53:44.306281", "rc": 0, "start": "2021-01-03 12:53:44.296377", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:44.594 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:44 +0000 (0:00:00.166) 0:01:14.994 ******** 2021-01-03T12:53:44.642 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi036.front.sepia.ceph.com] => (item={'block_used': 13644209, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226450899, 'size_available': 927542882304, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113977, 'block_size': 4096, 'inode_available': 60940999}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226450899, "block_size": 4096, "block_total": 240095108, "block_used": 13644209, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60940999, "inode_total": 61054976, "inode_used": 113977, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927542882304, "size_total": 983429562368, "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:44.686 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:44 +0000 (0:00:00.091) 0:01:15.086 ******** 2021-01-03T12:53:44.713 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-01-03T12:53:44.751 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:44 +0000 (0:00:00.064) 0:01:15.150 ******** 2021-01-03T12:53:44.788 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-03T12:53:44.790 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:45.010 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye3MkVRV5nyP8QymVSWc19kuHExFex01h27'], 'uuids': ['8e0c9d37-003e-4db5-9322-29c9c2cfa430']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.104324", "end": "2021-01-03 12:53:44.853294", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye3MkVRV5nyP8QymVSWc19kuHExFex01h27"], "labels": [], "masters": [], "uuids": ["8e0c9d37-003e-4db5-9322-29c9c2cfa430"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:43.748970", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:45.022 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HKZ5', 'wwn-0x5000c50087198ecb'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HKZ5-part1', 'wwn-0x5000c50087198ecb-part1'], 'uuids': ['397198c1-ee90-4109-8119-26133eb0d3c7']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50087198ecb', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HKZ5', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HKZ5", "wwn-0x5000c50087198ecb"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HKZ5-part1", "wwn-0x5000c50087198ecb-part1"], "labels": [], "masters": [], "uuids": ["397198c1-ee90-4109-8119-26133eb0d3c7"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HKZ5", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087198ecb"}}, "skip_reason": 2021-01-03T12:53:45.023 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-01-03T12:53:45.420 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-btTHQB-6UfY-5Vxk-8kpS-Dnzp-vU2K-hbHgiP', 'nvme-INTEL_SSDPED1D480GA_PHMB751300GE480DGN', 'nvme-nvme.8086-50484d42373531333030474534383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.154541", "end": "2021-01-03 12:53:45.488303", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-btTHQB-6UfY-5Vxk-8kpS-Dnzp-vU2K-hbHgiP", "nvme-INTEL_SSDPED1D480GA_PHMB751300GE480DGN", "nvme-nvme.8086-50484d42373531333030474534383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:44.333762", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now pa 2021-01-03T12:53:45.422 INFO:teuthology.task.ansible.out:rtition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:45.433 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:45.445 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:46.134 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5OoHYaZhRbr3QzyM4LbRgAQkfjryZ0NndS'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.933811", "end": "2021-01-03 12:53:46.437032", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5OoHYaZhRbr3QzyM4LbRgAQkfjryZ0NndS"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:44.503221", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:46.145 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:46.146 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:46.293 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-T3P84b-Bk54-Hm7b-8nNS-WqFY-W1oB-nvoyBx', 'nvme-INTEL_SSDPED1D480GA_PHMB7513002C480DGN', 'nvme-nvme.8086-50484d42373531333030324334383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.151268", "end": "2021-01-03 12:53:46.124962", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-T3P84b-Bk54-Hm7b-8nNS-WqFY-W1oB-nvoyBx", "nvme-INTEL_SSDPED1D480GA_PHMB7513002C480DGN", "nvme-nvme.8086-50484d42373531333030324334383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:44.973694", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now pa 2021-01-03T12:53:46.295 INFO:teuthology.task.ansible.out:rtition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:46.305 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:46.316 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:46.671 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQEXrXN4r3E4FjdgriW2vXd9RdVdfQW3R8v'], 'uuids': ['49b82373-6328-413e-8b0b-1e10cde5ae0e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.120698", "end": "2021-01-03 12:53:46.734077", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQEXrXN4r3E4FjdgriW2vXd9RdVdfQW3R8v"], "labels": [], "masters": [], "uuids": ["49b82373-6328-413e-8b0b-1e10cde5ae0e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:45.613379", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:46.683 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:46.684 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:46.841 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24Oke0e1mqpaD1RDYr1o8vuHTC6CuNDXdtH9'], 'uuids': ['b00dfcd6-1751-4df1-b303-840186460b41']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.932945", "end": "2021-01-03 12:53:46.584467", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24Oke0e1mqpaD1RDYr1o8vuHTC6CuNDXdtH9"], "labels": [], "masters": [], "uuids": ["b00dfcd6-1751-4df1-b303-840186460b41"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:44.651522", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:46.852 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:46.864 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:47.395 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5OrQy2hYHr8lWYACuof82kOrDiiy2lxERL'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.115400", "end": "2021-01-03 12:53:47.687508", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5OrQy2hYHr8lWYACuof82kOrDiiy2lxERL"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:46.572108", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:47.407 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XPD9', 'wwn-0x5000c50092928ee8'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XPD9-part1', 'wwn-0x5000c50092928ee8-part1'], 'uuids': ['397198c1-ee90-4109-8119-26133eb0d3c7']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092928ee8', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XPD9', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XPD9", "wwn-0x5000c50092928ee8"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XPD9-part1", "wwn-0x5000c50092928ee8-part1"], "labels": [], "masters": [], "uuids": ["397198c1-ee90-4109-8119-26133eb0d3c7"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XPD9", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092928ee8"}}, "skip_reason": 2021-01-03T12:53:47.408 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-01-03T12:53:47.543 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye34YMOaJwfzbbPL9mHfbnsyBLKgmS9K860'], 'uuids': ['61544abc-ce3f-40e4-9b8d-2ab5e8bccdd8']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.114345", "end": "2021-01-03 12:53:47.380297", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye34YMOaJwfzbbPL9mHfbnsyBLKgmS9K860"], "labels": [], "masters": [], "uuids": ["61544abc-ce3f-40e4-9b8d-2ab5e8bccdd8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:46.265952", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:47.554 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:47.565 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:47.911 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQEGrOSqqvYBBugCfwtvmhCCKmN8olHVxeq'], 'uuids': ['b21bfbc7-0c52-42b0-975a-39f9fafc4de6']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.092750", "end": "2021-01-03 12:53:47.965938", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQEGrOSqqvYBBugCfwtvmhCCKmN8olHVxeq"], "labels": [], "masters": [], "uuids": ["b21bfbc7-0c52-42b0-975a-39f9fafc4de6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:46.873188", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:47.924 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:48.082 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24OkokX6WqH46nf11Af8hM2ttO4czTzYpCBh'], 'uuids': ['4428d472-32d9-4f6f-998e-4819be8d7a1d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.102366", "end": "2021-01-03 12:53:47.822707", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24OkokX6WqH46nf11Af8hM2ttO4czTzYpCBh"], "labels": [], "masters": [], "uuids": ["4428d472-32d9-4f6f-998e-4819be8d7a1d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:46.720341", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:48.094 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2QS', 'wwn-0x5000c500871b68bf'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2QS-part1', 'wwn-0x5000c500871b68bf-part1'], 'uuids': ['397198c1-ee90-4109-8119-26133eb0d3c7']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871b68bf', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4J2QS', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2QS", "wwn-0x5000c500871b68bf"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2QS-part1", "wwn-0x5000c500871b68bf-part1"], "labels": [], "masters": [], "uuids": ["397198c1-ee90-4109-8119-26133eb0d3c7"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2QS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b68bf"}}, "skip_reason": 2021-01-03T12:53:48.095 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-01-03T12:53:48.678 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-X3SR5l-bgKV-OaAL-bjGs-UBSY-HxWX-X7KWF6', 'nvme-INTEL_SSDPEDMD400G4_PHFT620401AQ400BGN', 'nvme-nvme.8086-50484654363230343031415134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.140741", "end": "2021-01-03 12:53:48.976069", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-X3SR5l-bgKV-OaAL-bjGs-UBSY-HxWX-X7KWF6", "nvme-INTEL_SSDPEDMD400G4_PHFT620401AQ400BGN", "nvme-nvme.8086-50484654363230343031415134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:47.835328", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-01-03T12:53:48.680 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:48.690 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:48.692 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:48.797 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye3riPpabtkeVeQxXMQ7LFDqfCEChj1gTIl'], 'uuids': ['8405f833-5035-4398-8557-8e9635d7016b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.109809", "end": "2021-01-03 12:53:48.631494", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye3riPpabtkeVeQxXMQ7LFDqfCEChj1gTIl"], "labels": [], "masters": [], "uuids": ["8405f833-5035-4398-8557-8e9635d7016b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:47.521685", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:48.809 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:49.153 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQEd3ENBO6l7QUG2cc3V2IgAHRUMwVaGEIr'], 'uuids': ['e0b5fecd-fc00-4e3c-837c-c457682b6d57']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.096688", "end": "2021-01-03 12:53:49.207321", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQEd3ENBO6l7QUG2cc3V2IgAHRUMwVaGEIr"], "labels": [], "masters": [], "uuids": ["e0b5fecd-fc00-4e3c-837c-c457682b6d57"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:48.110633", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:49.201 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:49 +0000 (0:00:04.447) 0:01:19.598 ******** 2021-01-03T12:53:49.247 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-03T12:53:49.249 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:49.352 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-03T12:53:49.354 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-aMMlNr-tZ3k-a3Cu-5jGS-egGj-ye0U-S6AeQM', 'nvme-INTEL_SSDPEDMD400G4_CVFT53300040400BGN', 'nvme-nvme.8086-43564654353333303030343034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.136824", "end": "2021-01-03 12:53:49.088757", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-aMMlNr-tZ3k-a3Cu-5jGS-egGj-ye0U-S6AeQM", "nvme-INTEL_SSDPEDMD400G4_CVFT53300040400BGN", "nvme-nvme.8086-43564654353333303030343034303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:47.951933", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-01-03T12:53:49.356 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:49.365 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:49.366 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:49.491 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-03T12:53:49.493 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQE4ZtH1jt2Oi4xgFattDktlSYYl5R0Bcv0'], 'uuids': ['8fc69caf-e26a-4353-8fa5-394747cd134f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.114830", "end": "2021-01-03 12:53:49.550756", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQE4ZtH1jt2Oi4xgFattDktlSYYl5R0Bcv0"], "labels": [], "masters": [], "uuids": ["8fc69caf-e26a-4353-8fa5-394747cd134f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:49.435926", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.110031 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.110031 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:49.505 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:49.724 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQEEcx0rpdxf73pRKEEyecXOxQMNVo1Vbpw'], 'uuids': ['d8c0c0c5-4eb2-449f-9e28-0a5dd61be983']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.105634", "end": "2021-01-03 12:53:49.785166", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQEEcx0rpdxf73pRKEEyecXOxQMNVo1Vbpw"], "labels": [], "masters": [], "uuids": ["d8c0c0c5-4eb2-449f-9e28-0a5dd61be983"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:49.679532", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.101562 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.101562 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:49.736 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HPND', 'wwn-0x5000c500871a9ba6'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HPND-part1', 'wwn-0x5000c500871a9ba6-part1'], 'uuids': ['397198c1-ee90-4109-8119-26133eb0d3c7']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a9ba6', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HPND', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HPND", "wwn-0x5000c500871a9ba6"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HPND-part1", "wwn-0x5000c500871a9ba6-part1"], "labels": [], "masters": [], "uuids": ["397198c1-ee90-4109-8119-26133eb0d3c7"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HPND", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a9ba6"}}, "skip_reason": 2021-01-03T12:53:49.738 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-01-03T12:53:49.916 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-btTHQB-6UfY-5Vxk-8kpS-Dnzp-vU2K-hbHgiP', 'nvme-INTEL_SSDPED1D480GA_PHMB751300GE480DGN', 'nvme-nvme.8086-50484d42373531333030474534383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.049000", "end": "2021-01-03 12:53:49.978507", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-btTHQB-6UfY-5Vxk-8kpS-Dnzp-vU2K-hbHgiP", "nvme-INTEL_SSDPED1D480GA_PHMB751300GE480DGN", "nvme-nvme.8086-50484d42373531333030474534383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:49.929507", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0443451 s, 2.6 GB/s", "stderr_lines": [" 2021-01-03T12:53:49.918 INFO:teuthology.task.ansible.out:110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0443451 s, 2.6 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:49.927 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:49.939 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:49.940 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-03T12:53:49.940 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5OHczs3eWMtPnKjrDjnNL51fhJ4iXHrVqd'], 'uuids': ['cde805f9-6e28-4ce1-9cb2-ad75eea2d4f7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.133808", "end": "2021-01-03 12:53:50.247243", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5OHczs3eWMtPnKjrDjnNL51fhJ4iXHrVqd"], "labels": [], "masters": [], "uuids": ["cde805f9-6e28-4ce1-9cb2-ad75eea2d4f7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:49.113435", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk usi 2021-01-03T12:53:49.942 INFO:teuthology.task.ansible.out:ng fdisk or", "other utilities."]} 2021-01-03T12:53:49.952 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:49.964 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:50.039 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye3HsNpxQTc8A830XGAw2JIquP4DRkpD0Jk'], 'uuids': ['4655c234-11cb-4457-9c82-e4981cd56232']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.102833", "end": "2021-01-03 12:53:49.879849", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye3HsNpxQTc8A830XGAw2JIquP4DRkpD0Jk"], "labels": [], "masters": [], "uuids": ["4655c234-11cb-4457-9c82-e4981cd56232"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:48.777016", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:50.095 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:50 +0000 (0:00:00.896) 0:01:20.495 ******** 2021-01-03T12:53:50.134 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-03T12:53:50.136 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:50.146 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQEXrXN4r3E4FjdgriW2vXd9RdVdfQW3R8v'], 'uuids': ['49b82373-6328-413e-8b0b-1e10cde5ae0e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.099460", "end": "2021-01-03 12:53:50.212796", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQEXrXN4r3E4FjdgriW2vXd9RdVdfQW3R8v"], "labels": [], "masters": [], "uuids": ["49b82373-6328-413e-8b0b-1e10cde5ae0e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:50.113336", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0970412 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0970412 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:50.158 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:50.170 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:50.379 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye32ssVOu987Ut01mlKUyUCwzLQSz9ySVwz'], 'uuids': ['5ac7f084-f665-44c0-bd47-aef9d9aca125']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.113961", "end": "2021-01-03 12:53:50.219943", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye32ssVOu987Ut01mlKUyUCwzLQSz9ySVwz"], "labels": [], "masters": [], "uuids": ["5ac7f084-f665-44c0-bd47-aef9d9aca125"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:50.105982", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.110846 s, 1.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.110846 s, 1.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:50.391 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQEGrOSqqvYBBugCfwtvmhCCKmN8olHVxeq'], 'uuids': ['b21bfbc7-0c52-42b0-975a-39f9fafc4de6']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.110576", "end": "2021-01-03 12:53:50.448247", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQEGrOSqqvYBBugCfwtvmhCCKmN8olHVxeq"], "labels": [], "masters": [], "uuids": ["b21bfbc7-0c52-42b0-975a-39f9fafc4de6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:50.337671", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.10592 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.10592 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:50.392 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:50.403 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:50.404 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:50.614 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-03T12:53:50.616 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24OkNg051CfkDlFCk2iaRn3PKN2IxOJ7AsoW'], 'uuids': ['c9255051-2d3d-47ab-9728-e31d28f904d4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.133431", "end": "2021-01-03 12:53:50.356916", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24OkNg051CfkDlFCk2iaRn3PKN2IxOJ7AsoW"], "labels": [], "masters": [], "uuids": ["c9255051-2d3d-47ab-9728-e31d28f904d4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:49.223485", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:50.626 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:50.638 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:50.639 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-03T12:53:50.639 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQEd3ENBO6l7QUG2cc3V2IgAHRUMwVaGEIr'], 'uuids': ['e0b5fecd-fc00-4e3c-837c-c457682b6d57']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.109434", "end": "2021-01-03 12:53:50.691643", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-aMfR9polAJ1LAjEMDHKTHlZzQcOfswQEd3ENBO6l7QUG2cc3V2IgAHRUMwVaGEIr"], "labels": [], "masters": [], "uuids": ["e0b5fecd-fc00-4e3c-837c-c457682b6d57"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:50.582209", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.104716 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.104716 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:50.641 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye3MkVRV5nyP8QymVSWc19kuHExFex01h27'], 'uuids': ['8e0c9d37-003e-4db5-9322-29c9c2cfa430']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.114321", "end": "2021-01-03 12:53:50.479624", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye3MkVRV5nyP8QymVSWc19kuHExFex01h27"], "labels": [], "masters": [], "uuids": ["8e0c9d37-003e-4db5-9322-29c9c2cfa430"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:50.365303", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.109589 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.109589 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:50.651 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HKZ5', 'wwn-0x5000c50087198ecb'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HKZ5-part1', 'wwn-0x5000c50087198ecb-part1'], 'uuids': ['397198c1-ee90-4109-8119-26133eb0d3c7']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50087198ecb', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HKZ5', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HKZ5", "wwn-0x5000c50087198ecb"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HKZ5-part1", "wwn-0x5000c50087198ecb-part1"], "labels": [], "masters": [], "uuids": ["397198c1-ee90-4109-8119-26133eb0d3c7"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HKZ5", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087198ecb"}}, "skip_reason": 2021-01-03T12:53:50.653 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-01-03T12:53:50.687 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:50 +0000 (0:00:00.592) 0:01:21.087 ******** 2021-01-03T12:53:50.809 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-T3P84b-Bk54-Hm7b-8nNS-WqFY-W1oB-nvoyBx', 'nvme-INTEL_SSDPED1D480GA_PHMB7513002C480DGN', 'nvme-nvme.8086-50484d42373531333030324334383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.048548", "end": "2021-01-03 12:53:50.647329", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-T3P84b-Bk54-Hm7b-8nNS-WqFY-W1oB-nvoyBx", "nvme-INTEL_SSDPED1D480GA_PHMB7513002C480DGN", "nvme-nvme.8086-50484d42373531333030324334383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:50.598781", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0439081 s, 2.6 GB/s", "stderr_lines": [" 2021-01-03T12:53:50.811 INFO:teuthology.task.ansible.out:110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0439081 s, 2.6 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:50.821 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:50.822 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:50.928 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-01-03T12:53:50.929 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.113561", "end": "2021-01-03 12:53:50.988112", "rc": 0, "start": "2021-01-03 12:53:50.874551", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:50.965 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:50 +0000 (0:00:00.277) 0:01:21.365 ******** 2021-01-03T12:53:51.045 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-03T12:53:51.047 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye34YMOaJwfzbbPL9mHfbnsyBLKgmS9K860'], 'uuids': ['61544abc-ce3f-40e4-9b8d-2ab5e8bccdd8']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.108085", "end": "2021-01-03 12:53:50.889293", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye34YMOaJwfzbbPL9mHfbnsyBLKgmS9K860"], "labels": [], "masters": [], "uuids": ["61544abc-ce3f-40e4-9b8d-2ab5e8bccdd8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:50.781208", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.103791 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.103791 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:51.059 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:51.071 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:51.135 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-01-03T12:53:51.137 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.057319", "end": "2021-01-03 12:53:51.201131", "rc": 0, "start": "2021-01-03 12:53:51.143812", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:51.171 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:51 +0000 (0:00:00.205) 0:01:21.570 ******** 2021-01-03T12:53:51.198 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-01-03T12:53:51.235 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:51 +0000 (0:00:00.064) 0:01:21.635 ******** 2021-01-03T12:53:51.241 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-03T12:53:51.242 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5OAX1jkmEJrLlWlPYpt38DiE7n1AIsEmiX'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.132778", "end": "2021-01-03 12:53:51.513698", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5OAX1jkmEJrLlWlPYpt38DiE7n1AIsEmiX"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:50.380920", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:51.244 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:51.256 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-01-03T12:53:51.257 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:51.317 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:51 +0000 (0:00:00.082) 0:01:21.717 ******** 2021-01-03T12:53:51.326 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-03T12:53:51.327 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye3riPpabtkeVeQxXMQ7LFDqfCEChj1gTIl'], 'uuids': ['8405f833-5035-4398-8557-8e9635d7016b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.107873", "end": "2021-01-03 12:53:51.132055", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye3riPpabtkeVeQxXMQ7LFDqfCEChj1gTIl"], "labels": [], "masters": [], "uuids": ["8405f833-5035-4398-8557-8e9635d7016b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:51.024182", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.103211 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.103211 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:51.329 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:51.341 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-01-03T12:53:51.343 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:51.379 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:51 +0000 (0:00:00.061) 0:01:21.778 ******** 2021-01-03T12:53:51.405 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:51.445 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:51 +0000 (0:00:00.066) 0:01:21.844 ******** 2021-01-03T12:53:51.472 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-01-03T12:53:51.473 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:51.506 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:51 +0000 (0:00:00.060) 0:01:21.905 ******** 2021-01-03T12:53:51.533 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-03T12:53:51.534 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye3HsNpxQTc8A830XGAw2JIquP4DRkpD0Jk'], 'uuids': ['4655c234-11cb-4457-9c82-e4981cd56232']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.111431", "end": "2021-01-03 12:53:51.373884", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-efhJ26LMWVlk42Wdqy8EJFxmAlUdzye3HsNpxQTc8A830XGAw2JIquP4DRkpD0Jk"], "labels": [], "masters": [], "uuids": ["4655c234-11cb-4457-9c82-e4981cd56232"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:51.262453", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.106844 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.106844 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:51.580 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:51 +0000 (0:00:00.074) 0:01:21.980 ******** 2021-01-03T12:53:51.622 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-01-03T12:53:51.624 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-03T12:53:51.660 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:51 +0000 (0:00:00.080) 0:01:22.060 ******** 2021-01-03T12:53:51.699 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-03T12:53:51.701 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'block_used': 13644207, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226450901, 'size_available': 927542890496, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113977, 'block_size': 4096, 'inode_available': 60940999}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226450901, "block_size": 4096, "block_total": 240095108, "block_used": 13644207, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60940999, "inode_total": 61054976, "inode_used": 113977, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927542890496, "size_total": 983429562368, "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:51.734 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:51 +0000 (0:00:00.073) 0:01:22.134 ******** 2021-01-03T12:53:51.761 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-01-03T12:53:51.763 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:51.794 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:51 +0000 (0:00:00.059) 0:01:22.194 ******** 2021-01-03T12:53:51.827 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:53:51.829 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:51.860 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:51 +0000 (0:00:00.066) 0:01:22.260 ******** 2021-01-03T12:53:51.867 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-03T12:53:51.869 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24OkOzRlphmrU8h35mjPJwHusZGCbzWPN4Th'], 'uuids': ['e165d62f-65d0-423a-9876-94b71f64a86e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.097625", "end": "2021-01-03 12:53:51.591029", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24OkOzRlphmrU8h35mjPJwHusZGCbzWPN4Th"], "labels": [], "masters": [], "uuids": ["e165d62f-65d0-423a-9876-94b71f64a86e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:50.493404", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:51.879 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-01-03T12:53:51.881 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.156795", "end": "2021-01-03 12:53:51.704819", "rc": 0, "start": "2021-01-03 12:53:51.548024", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:51.915 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:51 +0000 (0:00:00.055) 0:01:22.315 ******** 2021-01-03T12:53:51.921 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:53:51.923 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:51.962 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:51 +0000 (0:00:00.046) 0:01:22.362 ******** 2021-01-03T12:53:51.989 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-01-03T12:53:51.991 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:52.026 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:52 +0000 (0:00:00.064) 0:01:22.426 ******** 2021-01-03T12:53:52.052 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:52.087 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:52 +0000 (0:00:00.060) 0:01:22.487 ******** 2021-01-03T12:53:52.104 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-01-03T12:53:52.105 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.052756", "end": "2021-01-03 12:53:51.938987", "rc": 0, "start": "2021-01-03 12:53:51.886231", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:52.140 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:52 +0000 (0:00:00.052) 0:01:22.539 ******** 2021-01-03T12:53:52.145 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-01-03T12:53:52.147 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:52.180 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:52 +0000 (0:00:00.040) 0:01:22.580 ******** 2021-01-03T12:53:52.188 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-01-03T12:53:52.227 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:52 +0000 (0:00:00.046) 0:01:22.626 ******** 2021-01-03T12:53:52.254 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-01-03T12:53:52.255 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:52.293 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:52 +0000 (0:00:00.064) 0:01:22.690 ******** 2021-01-03T12:53:52.321 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-01-03T12:53:52.322 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:52.356 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:52 +0000 (0:00:00.065) 0:01:22.756 ******** 2021-01-03T12:53:52.383 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-03T12:53:52.384 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:52.420 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:52 +0000 (0:00:00.063) 0:01:22.819 ******** 2021-01-03T12:53:52.446 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-01-03T12:53:52.448 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:52.486 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:52 +0000 (0:00:00.065) 0:01:22.885 ******** 2021-01-03T12:53:52.491 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-03T12:53:52.492 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5Oh62yBBuTA6D4YB1YJ9w79vMIy77AYhp6'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.126265", "end": "2021-01-03 12:53:52.763920", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5Oh62yBBuTA6D4YB1YJ9w79vMIy77AYhp6"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:51.637655", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:52.541 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:52 +0000 (0:00:00.055) 0:01:22.940 ******** 2021-01-03T12:53:52.588 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-03T12:53:52.590 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:52.611 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-01-03T12:53:52.612 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-03T12:53:52.647 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:52 +0000 (0:00:00.106) 0:01:23.046 ******** 2021-01-03T12:53:52.684 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-03T12:53:52.685 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'block_used': 13644207, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226450901, 'size_available': 927542890496, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113977, 'block_size': 4096, 'inode_available': 60940999}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226450901, "block_size": 4096, "block_total": 240095108, "block_used": 13644207, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60940999, "inode_total": 61054976, "inode_used": 113977, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927542890496, "size_total": 983429562368, "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:52.720 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:52 +0000 (0:00:00.072) 0:01:23.119 ******** 2021-01-03T12:53:52.726 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-01-03T12:53:52.728 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-01-03T12:53:52.764 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:52 +0000 (0:00:00.044) 0:01:23.163 ******** 2021-01-03T12:53:52.772 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-01-03T12:53:52.773 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:52.808 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:52 +0000 (0:00:00.044) 0:01:23.208 ******** 2021-01-03T12:53:52.837 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:53:52.838 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:52.872 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:52 +0000 (0:00:00.063) 0:01:23.272 ******** 2021-01-03T12:53:52.879 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-03T12:53:52.880 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5OoHYaZhRbr3QzyM4LbRgAQkfjryZ0NndS'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.155288", "end": "2021-01-03 12:53:53.160860", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5OoHYaZhRbr3QzyM4LbRgAQkfjryZ0NndS"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:53.005572", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.150464 s, 767 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.150464 s, 767 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:52.882 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:52.894 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:52.895 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:52.929 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:52 +0000 (0:00:00.056) 0:01:23.329 ******** 2021-01-03T12:53:52.956 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:52.991 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:52 +0000 (0:00:00.061) 0:01:23.390 ******** 2021-01-03T12:53:53.016 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-01-03T12:53:53.018 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:53.051 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:53 +0000 (0:00:00.060) 0:01:23.451 ******** 2021-01-03T12:53:53.078 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-03T12:53:53.080 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24Ok7P6A9WvZXTSF9ksTrEHoFfUGpjQ1LeJD'], 'uuids': ['43544831-d868-464f-974f-13472a5d399d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.100345", "end": "2021-01-03 12:53:52.817234", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24Ok7P6A9WvZXTSF9ksTrEHoFfUGpjQ1LeJD"], "labels": [], "masters": [], "uuids": ["43544831-d868-464f-974f-13472a5d399d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:51.716889", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-03T12:53:53.089 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:53.124 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:53 +0000 (0:00:00.072) 0:01:23.523 ******** 2021-01-03T12:53:53.160 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:53 +0000 (0:00:00.036) 0:01:23.560 ******** 2021-01-03T12:53:53.168 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-03T12:53:53.169 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5OrQy2hYHr8lWYACuof82kOrDiiy2lxERL'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.159979", "end": "2021-01-03 12:53:53.459747", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5OrQy2hYHr8lWYACuof82kOrDiiy2lxERL"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:53.299768", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15531 s, 743 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15531 s, 743 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:53.170 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XPD9', 'wwn-0x5000c50092928ee8'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XPD9-part1', 'wwn-0x5000c50092928ee8-part1'], 'uuids': ['397198c1-ee90-4109-8119-26133eb0d3c7']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092928ee8', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XPD9', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XPD9", "wwn-0x5000c50092928ee8"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XPD9-part1", "wwn-0x5000c50092928ee8-part1"], "labels": [], "masters": [], "uuids": ["397198c1-ee90-4109-8119-26133eb0d3c7"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XPD9", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092928ee8"}}, "skip_reason": 2021-01-03T12:53:53.172 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-01-03T12:53:53.288 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-03T12:53:53.290 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-03T12:53:53.331 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-03T12:53:53.333 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:53.343 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-X3SR5l-bgKV-OaAL-bjGs-UBSY-HxWX-X7KWF6', 'nvme-INTEL_SSDPEDMD400G4_PHFT620401AQ400BGN', 'nvme-nvme.8086-50484654363230343031415134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.054912", "end": "2021-01-03 12:53:53.642283", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-X3SR5l-bgKV-OaAL-bjGs-UBSY-HxWX-X7KWF6", "nvme-INTEL_SSDPEDMD400G4_PHFT620401AQ400BGN", "nvme-nvme.8086-50484654363230343031415134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:53.587371", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0501622 s, 2.3 GB/s", "std 2021-01-03T12:53:53.345 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0501622 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:53.356 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:53.409 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-01-03T12:53:53.411 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-01-03T12:53:53.555 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:53 +0000 (0:00:00.394) 0:01:23.954 ******** 2021-01-03T12:53:53.605 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24Oke0e1mqpaD1RDYr1o8vuHTC6CuNDXdtH9'], 'uuids': ['b00dfcd6-1751-4df1-b303-840186460b41']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.155672", "end": "2021-01-03 12:53:53.344744", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24Oke0e1mqpaD1RDYr1o8vuHTC6CuNDXdtH9"], "labels": [], "masters": [], "uuids": ["b00dfcd6-1751-4df1-b303-840186460b41"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:53.189072", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.150841 s, 765 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.150841 s, 765 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:53.616 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:53.617 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:53.629 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5OHczs3eWMtPnKjrDjnNL51fhJ4iXHrVqd'], 'uuids': ['cde805f9-6e28-4ce1-9cb2-ad75eea2d4f7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.158913", "end": "2021-01-03 12:53:53.935838", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5OHczs3eWMtPnKjrDjnNL51fhJ4iXHrVqd"], "labels": [], "masters": [], "uuids": ["cde805f9-6e28-4ce1-9cb2-ad75eea2d4f7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:53.776925", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154399 s, 747 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154399 s, 747 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:53.640 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-03T12:53:53.642 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:53.652 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:53.842 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-03T12:53:53.873 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-03T12:53:53.906 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-03T12:53:53.907 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24OkokX6WqH46nf11Af8hM2ttO4czTzYpCBh'], 'uuids': ['4428d472-32d9-4f6f-998e-4819be8d7a1d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.168501", "end": "2021-01-03 12:53:53.649488", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24OkokX6WqH46nf11Af8hM2ttO4czTzYpCBh"], "labels": [], "masters": [], "uuids": ["4428d472-32d9-4f6f-998e-4819be8d7a1d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:53.480987", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.163732 s, 704 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.163732 s, 704 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:53.918 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2QS', 'wwn-0x5000c500871b68bf'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2QS-part1', 'wwn-0x5000c500871b68bf-part1'], 'uuids': ['397198c1-ee90-4109-8119-26133eb0d3c7']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871b68bf', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4J2QS', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2QS", "wwn-0x5000c500871b68bf"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2QS-part1", "wwn-0x5000c500871b68bf-part1"], "labels": [], "masters": [], "uuids": ["397198c1-ee90-4109-8119-26133eb0d3c7"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2QS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b68bf"}}, "skip_reason": 2021-01-03T12:53:53.919 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2021-01-03T12:53:53.930 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5OAX1jkmEJrLlWlPYpt38DiE7n1AIsEmiX'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.159802", "end": "2021-01-03 12:53:54.231834", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5OAX1jkmEJrLlWlPYpt38DiE7n1AIsEmiX"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:54.072032", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15511 s, 744 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15511 s, 744 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:53.941 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:54.048 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-03T12:53:54.050 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-03T12:53:54.091 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-03T12:53:54.093 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-aMMlNr-tZ3k-a3Cu-5jGS-egGj-ye0U-S6AeQM', 'nvme-INTEL_SSDPEDMD400G4_CVFT53300040400BGN', 'nvme-nvme.8086-43564654353333303030343034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.053166", "end": "2021-01-03 12:53:53.833318", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-aMMlNr-tZ3k-a3Cu-5jGS-egGj-ye0U-S6AeQM", "nvme-INTEL_SSDPEDMD400G4_CVFT53300040400BGN", "nvme-nvme.8086-43564654353333303030343034303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:53.780152", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0483907 s, 2.4 GB/s", "std 2021-01-03T12:53:54.094 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0483907 s, 2.4 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:54.103 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-03T12:53:54.104 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:54.115 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:54.272 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-03T12:53:54.274 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-03T12:53:54.317 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:54 +0000 (0:00:00.762) 0:01:24.716 ******** 2021-01-03T12:53:54.324 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-03T12:53:54.325 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5Oh62yBBuTA6D4YB1YJ9w79vMIy77AYhp6'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.159285", "end": "2021-01-03 12:53:54.609767", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-808uLqmlEUjjHgqJzSTGF23EmIG3uc5Oh62yBBuTA6D4YB1YJ9w79vMIy77AYhp6"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:54.450482", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154378 s, 747 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154378 s, 747 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:54.336 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-03T12:53:54.339 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-03T12:53:54.372 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:54 +0000 (0:00:00.055) 0:01:24.772 ******** 2021-01-03T12:53:54.392 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-03T12:53:54.394 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24OkNg051CfkDlFCk2iaRn3PKN2IxOJ7AsoW'], 'uuids': ['c9255051-2d3d-47ab-9728-e31d28f904d4']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.143888", "end": "2021-01-03 12:53:54.119486", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24OkNg051CfkDlFCk2iaRn3PKN2IxOJ7AsoW"], "labels": [], "masters": [], "uuids": ["c9255051-2d3d-47ab-9728-e31d28f904d4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:53.975598", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.140647 s, 820 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.140647 s, 820 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:54.394 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': ' 2021-01-03T12:53:54.396 INFO:teuthology.task.ansible.out:0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:54.405 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:54.458 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-03T12:53:54.460 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-01-03T12:53:54.498 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:54 +0000 (0:00:00.125) 0:01:24.897 ******** 2021-01-03T12:53:54.568 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-03T12:53:54.569 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-03T12:53:54.643 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-03T12:53:54.644 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi133.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.138699", "end": "2021-01-03 12:53:54.948065", "rc": 0, "start": "2021-01-03 12:53:54.809366", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:54.681 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:54 +0000 (0:00:00.183) 0:01:25.081 ******** 2021-01-03T12:53:54.688 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-03T12:53:54.689 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24OkOzRlphmrU8h35mjPJwHusZGCbzWPN4Th'], 'uuids': ['e165d62f-65d0-423a-9876-94b71f64a86e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.156778", "end": "2021-01-03 12:53:54.417749", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24OkOzRlphmrU8h35mjPJwHusZGCbzWPN4Th"], "labels": [], "masters": [], "uuids": ["e165d62f-65d0-423a-9876-94b71f64a86e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:54.260971", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.151828 s, 760 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.151828 s, 760 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:54.691 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:54.766 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-03T12:53:54.768 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-03T12:53:54.820 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-03T12:53:54.822 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-03T12:53:54.858 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:54 +0000 (0:00:00.176) 0:01:25.258 ******** 2021-01-03T12:53:54.875 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-01-03T12:53:54.877 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.059954", "end": "2021-01-03 12:53:55.175592", "rc": 0, "start": "2021-01-03 12:53:55.115638", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:54.914 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:54 +0000 (0:00:00.055) 0:01:25.314 ******** 2021-01-03T12:53:54.921 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-03T12:53:54.922 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-03T12:53:54.945 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-01-03T12:53:54.995 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:54 +0000 (0:00:00.081) 0:01:25.395 ******** 2021-01-03T12:53:55.001 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-03T12:53:55.002 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24Ok7P6A9WvZXTSF9ksTrEHoFfUGpjQ1LeJD'], 'uuids': ['43544831-d868-464f-974f-13472a5d399d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.165460", "end": "2021-01-03 12:53:54.718602", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-hNFaO5c0FYyAXM39zoo7FT2buhOE24Ok7P6A9WvZXTSF9ksTrEHoFfUGpjQ1LeJD"], "labels": [], "masters": [], "uuids": ["43544831-d868-464f-974f-13472a5d399d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-03 12:53:54.553142", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.160647 s, 718 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.160647 s, 718 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:55.014 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-03T12:53:55.016 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi007.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-03T12:53:55.050 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.055) 0:01:25.450 ******** 2021-01-03T12:53:55.084 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.033) 0:01:25.483 ******** 2021-01-03T12:53:55.090 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:55.094 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:55.132 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.048) 0:01:25.531 ******** 2021-01-03T12:53:55.169 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.037) 0:01:25.569 ******** 2021-01-03T12:53:55.174 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-01-03T12:53:55.176 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:55.210 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.041) 0:01:25.610 ******** 2021-01-03T12:53:55.217 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-03T12:53:55.219 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:55.254 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.043) 0:01:25.653 ******** 2021-01-03T12:53:55.260 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-01-03T12:53:55.261 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:55.296 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.042) 0:01:25.696 ******** 2021-01-03T12:53:55.303 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-03T12:53:55.305 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-03T12:53:55.344 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.048) 0:01:25.744 ******** 2021-01-03T12:53:55.371 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-01-03T12:53:55.373 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:55.407 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.062) 0:01:25.806 ******** 2021-01-03T12:53:55.414 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-01-03T12:53:55.415 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.155728", "end": "2021-01-03 12:53:55.116617", "rc": 0, "start": "2021-01-03 12:53:54.960889", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:53:55.417 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-03T12:53:55.418 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-03T12:53:55.456 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.049) 0:01:25.856 ******** 2021-01-03T12:53:55.463 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-01-03T12:53:55.465 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-01-03T12:53:55.503 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.046) 0:01:25.903 ******** 2021-01-03T12:53:55.520 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-03T12:53:55.522 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-03T12:53:55.532 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-01-03T12:53:55.534 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi007.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} TASK [testnode : Write /scratch_devs] ****************************************** skipping: [smithi016.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:55.577 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.073) 0:01:25.977 ******** 2021-01-03T12:53:55.612 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.034) 0:01:26.011 ******** 2021-01-03T12:53:55.648 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.036) 0:01:26.048 ******** 2021-01-03T12:53:55.655 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-01-03T12:53:55.657 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.041674", "end": "2021-01-03 12:53:55.374860", "rc": 0, "start": "2021-01-03 12:53:55.333186", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Create filesystems] ******************************************* skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:55.694 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.045) 0:01:26.093 ******** 2021-01-03T12:53:55.726 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.032) 0:01:26.125 ******** 2021-01-03T12:53:55.733 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-03T12:53:55.735 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'block_used': 13644198, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226450910, 'size_available': 927542927360, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113978, 'block_size': 4096, 'inode_available': 60940998}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226450910, "block_size": 4096, "block_total": 240095108, "block_used": 13644198, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60940998, "inode_total": 61054976, "inode_used": 113978, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927542927360, "size_total": 983429562368, "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:55.735 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:55.770 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.043) 0:01:26.169 ******** 2021-01-03T12:53:55.803 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.032) 0:01:26.202 ******** 2021-01-03T12:53:55.809 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-01-03T12:53:55.848 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.045) 0:01:26.247 ******** 2021-01-03T12:53:55.854 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-01-03T12:53:55.856 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:55.890 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.042) 0:01:26.290 ******** 2021-01-03T12:53:55.897 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-01-03T12:53:55.899 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-01-03T12:53:55.934 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.043) 0:01:26.334 ******** 2021-01-03T12:53:55.969 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:55 +0000 (0:00:00.035) 0:01:26.369 ******** 2021-01-03T12:53:55.975 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:53:55.977 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-01-03T12:53:56.011 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.042) 0:01:26.411 ******** 2021-01-03T12:53:56.044 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.032) 0:01:26.444 ******** 2021-01-03T12:53:56.049 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-01-03T12:53:56.051 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:56.086 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.042) 0:01:26.486 ******** 2021-01-03T12:53:56.100 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:53:56.102 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:56.134 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.047) 0:01:26.534 ******** 2021-01-03T12:53:56.140 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-03T12:53:56.142 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:56.179 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.045) 0:01:26.579 ******** 2021-01-03T12:53:56.185 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-01-03T12:53:56.187 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi016.front.sepia.ceph.com] => {"changed": true} 2021-01-03T12:53:56.224 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.044) 0:01:26.624 ******** 2021-01-03T12:53:56.257 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.032) 0:01:26.657 ******** 2021-01-03T12:53:56.263 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-01-03T12:53:56.265 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:56.300 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.043) 0:01:26.700 ******** 2021-01-03T12:53:56.306 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-01-03T12:53:56.308 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:56.346 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.045) 0:01:26.746 ******** 2021-01-03T12:53:56.374 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-01-03T12:53:56.375 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:56.409 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.062) 0:01:26.808 ******** 2021-01-03T12:53:56.425 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-01-03T12:53:56.427 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-03T12:53:56.465 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.055) 0:01:26.864 ******** 2021-01-03T12:53:56.504 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi036.front.sepia.ceph.com] => (item={'block_used': 13644209, 'uuid': '397198c1-ee90-4109-8119-26133eb0d3c7', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226450899, 'size_available': 927542882304, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113977, 'block_size': 4096, 'inode_available': 60940999}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226450899, "block_size": 4096, "block_total": 240095108, "block_used": 13644209, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60940999, "inode_total": 61054976, "inode_used": 113977, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927542882304, "size_total": 983429562368, "uuid": "397198c1-ee90-4109-8119-26133eb0d3c7"}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:56.542 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.077) 0:01:26.942 ******** 2021-01-03T12:53:56.548 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-01-03T12:53:56.550 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-01-03T12:53:56.586 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.043) 0:01:26.986 ******** 2021-01-03T12:53:56.592 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-01-03T12:53:56.594 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:56.628 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.042) 0:01:27.028 ******** 2021-01-03T12:53:56.635 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-01-03T12:53:56.636 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:56.672 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.043) 0:01:27.071 ******** 2021-01-03T12:53:56.678 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:53:56.680 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:56.714 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.042) 0:01:27.114 ******** 2021-01-03T12:53:56.721 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-01-03T12:53:56.722 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:56.757 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.042) 0:01:27.156 ******** 2021-01-03T12:53:56.768 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:53:56.769 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create volume group(s)] *************************************** changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-01-03T12:53:56.805 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.047) 0:01:27.204 ******** 2021-01-03T12:53:56.841 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.036) 0:01:27.241 ******** 2021-01-03T12:53:56.847 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-03T12:53:56.849 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-01-03T12:53:56.849 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"changed": true} 2021-01-03T12:53:56.893 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.051) 0:01:27.292 ******** 2021-01-03T12:53:56.941 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.048) 0:01:27.341 ******** 2021-01-03T12:53:56.978 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:56 +0000 (0:00:00.036) 0:01:27.378 ******** 2021-01-03T12:53:56.984 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-03T12:53:56.986 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:57.023 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:57 +0000 (0:00:00.044) 0:01:27.422 ******** 2021-01-03T12:53:57.030 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-01-03T12:53:57.031 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:57.071 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:57 +0000 (0:00:00.048) 0:01:27.470 ******** 2021-01-03T12:53:57.079 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-01-03T12:53:57.082 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-01-03T12:53:57.120 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:57 +0000 (0:00:00.049) 0:01:27.520 ******** 2021-01-03T12:53:57.128 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-01-03T12:53:57.129 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:57.168 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:57 +0000 (0:00:00.046) 0:01:27.566 ******** 2021-01-03T12:53:57.176 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-03T12:53:57.178 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:57.180 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-01-03T12:53:57.230 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:57 +0000 (0:00:00.063) 0:01:27.629 ******** 2021-01-03T12:53:57.275 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:57 +0000 (0:00:00.044) 0:01:27.674 ******** 2021-01-03T12:53:57.281 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-01-03T12:53:57.283 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:57.325 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:57 +0000 (0:00:00.050) 0:01:27.725 ******** 2021-01-03T12:53:57.353 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-03T12:53:57.355 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:57.408 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:57 +0000 (0:00:00.082) 0:01:27.808 ******** 2021-01-03T12:53:57.415 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-03T12:53:57.416 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-01-03T12:53:57.454 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:57 +0000 (0:00:00.045) 0:01:27.853 ******** 2021-01-03T12:53:57.460 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-03T12:53:57.461 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:57.499 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:57 +0000 (0:00:00.045) 0:01:27.899 ******** 2021-01-03T12:53:57.506 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-01-03T12:53:57.508 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-01-03T12:53:57.556 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:57 +0000 (0:00:00.056) 0:01:27.956 ******** 2021-01-03T12:53:57.605 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-03T12:53:57.607 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-03T12:53:57.649 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-01-03T12:53:57.697 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:57 +0000 (0:00:00.140) 0:01:28.096 ******** 2021-01-03T12:53:57.766 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-01-03T12:53:57.768 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-01-03T12:53:57.804 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:57 +0000 (0:00:00.106) 0:01:28.203 ******** 2021-01-03T12:53:57.853 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-01-03T12:53:57.855 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-03T12:53:57.903 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:57 +0000 (0:00:00.099) 0:01:28.303 ******** 2021-01-03T12:53:57.910 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-03T12:53:58.102 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-03T12:53:58.150 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:58 +0000 (0:00:00.247) 0:01:28.550 ******** 2021-01-03T12:53:58.160 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-03T12:53:58.162 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-01-03T12:53:58.162 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-01-03T12:53:58.215 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:58 +0000 (0:00:00.062) 0:01:28.613 ******** 2021-01-03T12:53:58.260 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-01-03T12:53:58.266 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-01-03T12:53:58.316 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:58 +0000 (0:00:00.103) 0:01:28.716 ******** 2021-01-03T12:53:58.327 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-03T12:53:58.330 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-01-03T12:53:58.375 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:58 +0000 (0:00:00.058) 0:01:28.774 ******** 2021-01-03T12:53:58.384 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-03T12:53:58.546 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-03T12:53:58.548 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-03T12:53:58.622 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-03T12:53:58.624 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-03T12:53:58.667 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-03T12:53:58.669 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-03T12:53:58.680 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-01-03T12:53:58.682 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-01-03T12:53:58.730 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:58 +0000 (0:00:00.347) 0:01:29.121 ******** 2021-01-03T12:53:58.785 INFO:teuthology.task.ansible.out: 2021-01-03T12:53:58.788 INFO:teuthology.task.ansible.out:TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-03T12:53:58.865 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-03T12:53:58.922 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:58 +0000 (0:00:00.199) 0:01:29.321 ******** 2021-01-03T12:53:58.929 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-03T12:53:58.931 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [smithi133.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:58.996 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:58 +0000 (0:00:00.074) 0:01:29.396 ******** 2021-01-03T12:53:59.037 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:59.097 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:59 +0000 (0:00:00.100) 0:01:29.496 ******** 2021-01-03T12:53:59.107 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-03T12:53:59.110 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-01-03T12:53:59.162 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:59 +0000 (0:00:00.065) 0:01:29.562 ******** 2021-01-03T12:53:59.169 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-01-03T12:53:59.171 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1609678333, "cache_updated": false, "changed": false} TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:59.207 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:59 +0000 (0:00:00.044) 0:01:29.607 ******** 2021-01-03T12:53:59.243 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:59 +0000 (0:00:00.034) 0:01:29.641 ******** 2021-01-03T12:53:59.334 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-03T12:53:59.336 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-03T12:53:59.391 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.047566", "end": "2021-01-03 12:53:59.241299", "rc": 0, "start": "2021-01-03 12:53:59.193733", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-01-03T12:53:59.439 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:59 +0000 (0:00:00.198) 0:01:29.839 ******** 2021-01-03T12:53:59.504 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:59 +0000 (0:00:00.064) 0:01:29.903 ******** 2021-01-03T12:53:59.513 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-03T12:53:59.515 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:59.549 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:59 +0000 (0:00:00.045) 0:01:29.948 ******** 2021-01-03T12:53:59.555 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-01-03T12:53:59.557 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-01-03T12:53:59.589 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:59 +0000 (0:00:00.039) 0:01:29.988 ******** 2021-01-03T12:53:59.595 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:59.638 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:59 +0000 (0:00:00.049) 0:01:30.038 ******** 2021-01-03T12:53:59.647 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-03T12:53:59.649 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-03T12:53:59.671 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi007.front.sepia.ceph.com] => {"cache_update_time": 1609678337, "cache_updated": false, "changed": false} 2021-01-03T12:53:59.714 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:59 +0000 (0:00:00.075) 0:01:30.114 ******** 2021-01-03T12:53:59.734 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-03T12:53:59.735 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-03T12:53:59.748 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:59.792 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:59 +0000 (0:00:00.078) 0:01:30.192 ******** 2021-01-03T12:53:59.821 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-01-03T12:53:59.823 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true} 2021-01-03T12:53:59.860 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:59 +0000 (0:00:00.067) 0:01:30.259 ******** 2021-01-03T12:53:59.868 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:53:59.905 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:59 +0000 (0:00:00.044) 0:01:30.304 ******** 2021-01-03T12:53:59.911 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-01-03T12:53:59.913 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.036575", "end": "2021-01-03 12:53:59.956434", "rc": 0, "start": "2021-01-03 12:53:59.919859", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-01-03T12:53:59.962 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:53:59 +0000 (0:00:00.053) 0:01:30.357 ******** 2021-01-03T12:53:59.968 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-01-03T12:53:59.970 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:00.030 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.072) 0:01:30.430 ******** 2021-01-03T12:54:00.038 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-01-03T12:54:00.040 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-01-03T12:54:00.081 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.050) 0:01:30.480 ******** 2021-01-03T12:54:00.115 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.033) 0:01:30.514 ******** 2021-01-03T12:54:00.121 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:00.172 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.056) 0:01:30.570 ******** 2021-01-03T12:54:00.178 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-01-03T12:54:00.180 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-01-03T12:54:00.218 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.047) 0:01:30.618 ******** 2021-01-03T12:54:00.254 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.035) 0:01:30.653 ******** 2021-01-03T12:54:00.260 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-01-03T12:54:00.261 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-01-03T12:54:00.296 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.042) 0:01:30.695 ******** 2021-01-03T12:54:00.301 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-01-03T12:54:00.303 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:00.338 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.042) 0:01:30.738 ******** 2021-01-03T12:54:00.364 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-03T12:54:00.365 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:00.399 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.060) 0:01:30.799 ******** 2021-01-03T12:54:00.425 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:00.460 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.060) 0:01:30.859 ******** 2021-01-03T12:54:00.506 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-01-03T12:54:00.507 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true} 2021-01-03T12:54:00.542 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.082) 0:01:30.941 ******** 2021-01-03T12:54:00.548 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-01-03T12:54:00.550 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1609678333, "cache_updated": false, "changed": false} 2021-01-03T12:54:00.585 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.043) 0:01:30.985 ******** 2021-01-03T12:54:00.613 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:00.649 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.063) 0:01:31.048 ******** 2021-01-03T12:54:00.683 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.034) 0:01:31.083 ******** 2021-01-03T12:54:00.721 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-01-03T12:54:00.723 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-01-03T12:54:00.781 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.096) 0:01:31.180 ******** 2021-01-03T12:54:00.810 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-01-03T12:54:00.812 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:00.852 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.071) 0:01:31.251 ******** 2021-01-03T12:54:00.858 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-01-03T12:54:00.860 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-01-03T12:54:00.895 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.042) 0:01:31.294 ******** 2021-01-03T12:54:00.899 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-01-03T12:54:00.901 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:00.937 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.042) 0:01:31.336 ******** 2021-01-03T12:54:00.963 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-03T12:54:00.965 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:00.999 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:00 +0000 (0:00:00.062) 0:01:31.399 ******** 2021-01-03T12:54:01.005 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-01-03T12:54:01.007 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-01-03T12:54:01.043 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.043) 0:01:31.442 ******** 2021-01-03T12:54:01.049 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-03T12:54:01.051 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:01.052 INFO:teuthology.task.ansible.out: 2021-01-03T12:54:01.054 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [smithi007.front.sepia.ceph.com] => {"cache_update_time": 1609678337, "cache_updated": false, "changed": false} 2021-01-03T12:54:01.088 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.045) 0:01:31.487 ******** 2021-01-03T12:54:01.122 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.033) 0:01:31.521 ******** 2021-01-03T12:54:01.129 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:01.165 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.043) 0:01:31.564 ******** 2021-01-03T12:54:01.198 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.033) 0:01:31.597 ******** 2021-01-03T12:54:01.236 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-01-03T12:54:01.238 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-01-03T12:54:01.275 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.077) 0:01:31.675 ******** 2021-01-03T12:54:01.282 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-01-03T12:54:01.284 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-01-03T12:54:01.321 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.045) 0:01:31.720 ******** 2021-01-03T12:54:01.404 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-01-03T12:54:01.406 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2021-01-03 12:51:30 UTC", "ActiveEnterTimestampMonotonic": "23036573", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target systemd-tmpfiles-setup.service system.slice systemd-journald.socket network.target basic.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2021-01-03 12:51:24 UTC", "AssertTimestampMonotonic": "16580238", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2021-01-03 12:51:24 UTC", "ConditionTimestampMonotonic": "16580237", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2021-01-03T12:54:01.407 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1971", "ExecMainStartTimestamp": "Sun 2021-01-03 12:51:30 UTC", "ExecMainStartTimestampMonotonic": "23036521", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2021-01-03 12:51:24 UTC", "InactiveExitTimestampMonotonic": "16581030", "InvocationID": "1c87b55a6d4c4c7783e760d7c624b23e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2021-01-03T12:54:01.409 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1971", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2021-01-03 12:51:30 UTC", "S 2021-01-03T12:54:01.411 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "23036573", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2021-01-03 12:51:30 UTC", "WatchdogTimestampMonotonic": "23036569", "WatchdogUSec": "0"}} 2021-01-03T12:54:01.468 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.147) 0:01:31.868 ******** 2021-01-03T12:54:01.475 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-01-03T12:54:01.512 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.044) 0:01:31.912 ******** 2021-01-03T12:54:01.518 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:54:01.520 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-01-03T12:54:01.556 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.043) 0:01:31.955 ******** 2021-01-03T12:54:01.592 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.036) 0:01:31.992 ******** 2021-01-03T12:54:01.598 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-01-03T12:54:01.601 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload CPAN config for root.] ********************************* ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-01-03T12:54:01.641 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.048) 0:01:32.041 ******** 2021-01-03T12:54:01.674 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.032) 0:01:32.073 ******** 2021-01-03T12:54:01.680 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:01.717 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.043) 0:01:32.117 ******** 2021-01-03T12:54:01.744 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-01-03T12:54:01.746 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:01.779 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.061) 0:01:32.178 ******** 2021-01-03T12:54:01.817 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-01-03T12:54:01.818 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-01-03T12:54:01.853 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.074) 0:01:32.253 ******** 2021-01-03T12:54:01.871 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-01-03T12:54:01.872 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2021-01-03 12:51:28 UTC", "ActiveEnterTimestampMonotonic": "23863257", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target basic.target systemd-journald.socket systemd-tmpfiles-setup.service system.slice sysinit.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2021-01-03 12:51:22 UTC", "AssertTimestampMonotonic": "17568069", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2021-01-03 12:51:22 UTC", "ConditionTimestampMonotonic": "17568068", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2021-01-03T12:54:01.874 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1977", "ExecMainStartTimestamp": "Sun 2021-01-03 12:51:28 UTC", "ExecMainStartTimestampMonotonic": "23863213", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2021-01-03 12:51:22 UTC", "InactiveExitTimestampMonotonic": "17568863", "InvocationID": "735ab0b6e9794e408758157f531b1dd2", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2021-01-03T12:54:01.875 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1977", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2021-01-03 12:51:28 UTC", "S 2021-01-03T12:54:01.877 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "23863257", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2021-01-03 12:51:28 UTC", "WatchdogTimestampMonotonic": "23863254", "WatchdogUSec": "0"}} 2021-01-03T12:54:01.910 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.056) 0:01:32.309 ******** 2021-01-03T12:54:01.937 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:54:01.939 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-01-03T12:54:01.973 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:01 +0000 (0:00:00.062) 0:01:32.372 ******** 2021-01-03T12:54:02.002 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:54:02.004 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:02.036 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:02 +0000 (0:00:00.063) 0:01:32.436 ******** 2021-01-03T12:54:02.065 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:02.099 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:02 +0000 (0:00:00.062) 0:01:32.499 ******** 2021-01-03T12:54:02.160 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-01-03T12:54:02.162 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-01-03T12:54:02.198 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:02 +0000 (0:00:00.097) 0:01:32.596 ******** 2021-01-03T12:54:02.559 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-01-03T12:54:02.561 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"cache_update_time": 1609678330, "cache_updated": false, "changed": false} 2021-01-03T12:54:02.595 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:02 +0000 (0:00:00.398) 0:01:32.995 ******** 2021-01-03T12:54:02.653 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-01-03T12:54:02.655 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1609678333, "cache_updated": false, "changed": false} 2021-01-03T12:54:02.690 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:02 +0000 (0:00:00.094) 0:01:33.090 ******** 2021-01-03T12:54:02.717 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-01-03T12:54:02.719 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:02.759 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:02 +0000 (0:00:00.068) 0:01:33.158 ******** 2021-01-03T12:54:02.776 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-01-03T12:54:02.777 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.046185", "end": "2021-01-03 12:54:03.076320", "rc": 0, "start": "2021-01-03 12:54:03.030135", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-01-03T12:54:02.813 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:02 +0000 (0:00:00.054) 0:01:33.213 ******** 2021-01-03T12:54:02.841 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-01-03T12:54:02.843 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:02.878 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:02 +0000 (0:00:00.064) 0:01:33.278 ******** 2021-01-03T12:54:02.885 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-01-03T12:54:02.886 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-01-03T12:54:02.922 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:02 +0000 (0:00:00.043) 0:01:33.321 ******** 2021-01-03T12:54:02.927 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-01-03T12:54:02.929 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:02.963 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:02 +0000 (0:00:00.041) 0:01:33.363 ******** 2021-01-03T12:54:03.055 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi007.front.sepia.ceph.com] => {"cache_update_time": 1609678337, "cache_updated": false, "changed": false} 2021-01-03T12:54:03.091 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:03 +0000 (0:00:00.128) 0:01:33.491 ******** 2021-01-03T12:54:03.119 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-01-03T12:54:03.121 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:03.157 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:03 +0000 (0:00:00.064) 0:01:33.556 ******** 2021-01-03T12:54:03.164 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1609678341, "cache_updated": false, "changed": false} 2021-01-03T12:54:03.202 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:03 +0000 (0:00:00.045) 0:01:33.602 ******** 2021-01-03T12:54:03.230 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-01-03T12:54:03.269 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:03 +0000 (0:00:00.066) 0:01:33.668 ******** 2021-01-03T12:54:03.287 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-01-03T12:54:03.288 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-01-03T12:54:03.323 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:03 +0000 (0:00:00.054) 0:01:33.723 ******** 2021-01-03T12:54:03.393 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-01-03T12:54:03.395 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.045206", "end": "2021-01-03 12:54:03.143894", "rc": 0, "start": "2021-01-03 12:54:03.098688", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-01-03T12:54:03.430 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:03 +0000 (0:00:00.106) 0:01:33.830 ******** 2021-01-03T12:54:03.458 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:03.493 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:03 +0000 (0:00:00.062) 0:01:33.892 ******** 2021-01-03T12:54:03.520 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-01-03T12:54:03.522 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:03.556 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:03 +0000 (0:00:00.063) 0:01:33.955 ******** 2021-01-03T12:54:03.658 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-01-03T12:54:03.701 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:03 +0000 (0:00:00.144) 0:01:34.100 ******** 2021-01-03T12:54:03.803 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [smithi133.front.sepia.ceph.com] => {"cache_update_time": 1609678330, "cache_updated": false, "changed": false} 2021-01-03T12:54:03.839 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:03 +0000 (0:00:00.138) 0:01:34.238 ******** 2021-01-03T12:54:03.866 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-01-03T12:54:03.867 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:03.902 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:03 +0000 (0:00:00.063) 0:01:34.302 ******** 2021-01-03T12:54:04.194 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-01-03T12:54:04.196 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-01-03T12:54:04.229 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:04 +0000 (0:00:00.327) 0:01:34.629 ******** 2021-01-03T12:54:04.256 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:04.291 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:04 +0000 (0:00:00.061) 0:01:34.690 ******** 2021-01-03T12:54:04.317 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-01-03T12:54:04.319 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-01-03T12:54:04.355 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:04 +0000 (0:00:00.063) 0:01:34.754 ******** 2021-01-03T12:54:04.417 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-01-03T12:54:04.419 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1609678341, "cache_updated": false, "changed": false} 2021-01-03T12:54:04.457 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:04 +0000 (0:00:00.101) 0:01:34.856 ******** 2021-01-03T12:54:04.473 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-01-03T12:54:04.476 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-01-03T12:54:04.512 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:04 +0000 (0:00:00.055) 0:01:34.911 ******** 2021-01-03T12:54:04.519 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-01-03T12:54:04.521 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make sure ntpd is running.] *********************************** ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2021-01-03 12:51:41 UTC", "ActiveEnterTimestampMonotonic": "17331254", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target system.slice systemd-tmpfiles-setup.service network.target systemd-journald.socket -.mount sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2021-01-03 12:51:41 UTC", "AssertTimestampMonotonic": "17240133", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2021-01-03 12:51:41 UTC", "ConditionTimestampMonotonic": "17240132", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesy 2021-01-03T12:54:04.525 INFO:teuthology.task.ansible.out:ncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1099", "ExecMainStartTimestamp": "Sun 2021-01-03 12:51:41 UTC", "ExecMainStartTimestampMonotonic": "17331243", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2021-01-03 12:51:41 UTC", "InactiveExitTimestampMonotonic": "17241165", "InvocationID": "c746cd29d2e74d84b3b04e464684035a", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "Limit 2021-01-03T12:54:04.527 INFO:teuthology.task.ansible.out:NOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128029", "LimitNPROCSoft": "128029", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1099", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "1 2021-01-03T12:54:04.530 INFO:teuthology.task.ansible.out:0s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2021-01-03 12:51:41 UTC", "StateChangeTimestampMonotonic": "17331254", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2021-01-03 12:51:41 UTC", "WatchdogTimestampMonotonic": "17331253", "WatchdogUSec": "0"}} 2021-01-03T12:54:04.560 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:04 +0000 (0:00:00.048) 0:01:34.959 ******** 2021-01-03T12:54:04.596 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:04 +0000 (0:00:00.036) 0:01:34.996 ******** 2021-01-03T12:54:04.625 INFO:teuthology.task.ansible.out: 2021-01-03T12:54:04.626 INFO:teuthology.task.ansible.out:TASK [testnode : set_fact] ***************************************************** ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-01-03T12:54:04.661 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:04 +0000 (0:00:00.064) 0:01:35.061 ******** 2021-01-03T12:54:04.663 INFO:teuthology.task.ansible.out: 2021-01-03T12:54:04.690 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:54:04.692 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:04.726 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:04 +0000 (0:00:00.064) 0:01:35.125 ******** 2021-01-03T12:54:04.753 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:04.795 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:04 +0000 (0:00:00.069) 0:01:35.194 ******** 2021-01-03T12:54:04.866 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-01-03T12:54:04.868 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false} 2021-01-03T12:54:04.905 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:04 +0000 (0:00:00.110) 0:01:35.305 ******** 2021-01-03T12:54:04.912 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-01-03T12:54:04.914 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-01-03T12:54:04.952 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:04 +0000 (0:00:00.046) 0:01:35.352 ******** 2021-01-03T12:54:04.960 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-01-03T12:54:04.962 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2021-01-03T12:54:05.001 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:04 +0000 (0:00:00.046) 0:01:35.398 ******** 2021-01-03T12:54:05.006 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-01-03T12:54:05.008 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:05.047 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.047) 0:01:35.446 ******** 2021-01-03T12:54:05.064 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-01-03T12:54:05.066 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false} 2021-01-03T12:54:05.107 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.059) 0:01:35.506 ******** 2021-01-03T12:54:05.136 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-01-03T12:54:05.138 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-01-03T12:54:05.138 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1609678299.8644562, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1609678299.8604543, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 96882, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1609678299.8604543, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "3394389858", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-01-03T12:54:05.174 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.067) 0:01:35.573 ******** 2021-01-03T12:54:05.208 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.034) 0:01:35.608 ******** 2021-01-03T12:54:05.249 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-01-03T12:54:05.250 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2021-01-03 12:51:22 UTC", "ActiveEnterTimestampMonotonic": "23282133", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target systemd-tmpfiles-setup.service systemd-journald.socket sysinit.target network.target system.slice -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sun 2021-01-03 12:51:16 UTC", "AssertTimestampMonotonic": "17188175", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2021-01-03 12:51:16 UTC", "ConditionTimestampMonotonic": "17188175", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2021-01-03T12:54:05.252 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1976", "ExecMainStartTimestamp": "Sun 2021-01-03 12:51:22 UTC", "ExecMainStartTimestampMonotonic": "23282086", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2021-01-03 12:51:16 UTC", "InactiveExitTimestampMonotonic": "17189159", "InvocationID": "25d6e7d89c9a485f92f2051d670a354d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128053", "LimitNPROCSoft": "128053", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2021-01-03T12:54:05.254 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128053", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1976", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2021-01-03 12:51:22 UTC", "S 2021-01-03T12:54:05.256 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "23282133", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sun 2021-01-03 12:51:22 UTC", "WatchdogTimestampMonotonic": "23282131", "WatchdogUSec": "0"}} 2021-01-03T12:54:05.288 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.080) 0:01:35.688 ******** 2021-01-03T12:54:05.316 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-01-03T12:54:05.319 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1609678297.9352796, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1609678297.9312818, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 96882, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1609678297.9312818, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "3394389858", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} TASK [testnode : set_fact] ***************************************************** ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-01-03T12:54:05.352 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.064) 0:01:35.752 ******** 2021-01-03T12:54:05.386 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.033) 0:01:35.786 ******** 2021-01-03T12:54:05.413 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:54:05.415 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:05.449 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.062) 0:01:35.848 ******** 2021-01-03T12:54:05.475 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-01-03T12:54:05.477 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:05.512 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.062) 0:01:35.911 ******** 2021-01-03T12:54:05.582 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-01-03T12:54:05.584 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "msg": ""} ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-01-03T12:54:05.619 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.107) 0:01:36.019 ******** 2021-01-03T12:54:05.662 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.040) 0:01:36.059 ******** 2021-01-03T12:54:05.666 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-01-03T12:54:05.668 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi133.front.sepia.ceph.com] => {"cache_update_time": 1609678330, "cache_updated": false, "changed": false} 2021-01-03T12:54:05.705 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.046) 0:01:36.105 ******** 2021-01-03T12:54:05.741 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.035) 0:01:36.141 ******** 2021-01-03T12:54:05.748 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-01-03T12:54:05.750 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:05.784 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.042) 0:01:36.184 ******** 2021-01-03T12:54:05.817 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.032) 0:01:36.217 ******** 2021-01-03T12:54:05.824 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:05.865 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.047) 0:01:36.265 ******** 2021-01-03T12:54:05.872 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-01-03T12:54:05.873 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:05.913 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.047) 0:01:36.312 ******** 2021-01-03T12:54:05.920 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-01-03T12:54:05.921 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-01-03T12:54:05.962 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:05 +0000 (0:00:00.048) 0:01:36.361 ******** 2021-01-03T12:54:05.990 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-01-03T12:54:06.027 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.065) 0:01:36.427 ******** 2021-01-03T12:54:06.034 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-01-03T12:54:06.036 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-01-03T12:54:06.072 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.044) 0:01:36.472 ******** 2021-01-03T12:54:06.089 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi007.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-01-03T12:54:06.132 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.059) 0:01:36.532 ******** 2021-01-03T12:54:06.159 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-01-03T12:54:06.161 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.195 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.063) 0:01:36.595 ******** 2021-01-03T12:54:06.212 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-01-03T12:54:06.213 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-01-03T12:54:06.251 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.054) 0:01:36.649 ******** 2021-01-03T12:54:06.258 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi007.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.260 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.295 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.045) 0:01:36.694 ******** 2021-01-03T12:54:06.302 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-01-03T12:54:06.304 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.339 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.043) 0:01:36.738 ******** 2021-01-03T12:54:06.345 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-01-03T12:54:06.347 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.347 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-01-03T12:54:06.349 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi007.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi007.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.388 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.049) 0:01:36.788 ******** 2021-01-03T12:54:06.395 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.397 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-01-03T12:54:06.398 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.399 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.400 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.437 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.048) 0:01:36.836 ******** 2021-01-03T12:54:06.471 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.034) 0:01:36.871 ******** 2021-01-03T12:54:06.477 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-01-03T12:54:06.479 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1609678341, "cache_updated": false, "changed": false} TASK [testnode : set_fact] ***************************************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.523 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.052) 0:01:36.923 ******** 2021-01-03T12:54:06.556 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.032) 0:01:36.955 ******** 2021-01-03T12:54:06.562 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-01-03T12:54:06.563 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.565 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi016.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.567 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.601 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.045) 0:01:37.001 ******** 2021-01-03T12:54:06.633 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.031) 0:01:37.033 ******** 2021-01-03T12:54:06.639 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-01-03T12:54:06.641 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.677 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.043) 0:01:37.077 ******** 2021-01-03T12:54:06.710 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.032) 0:01:37.109 ******** 2021-01-03T12:54:06.715 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:54:06.717 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.752 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.042) 0:01:37.152 ******** 2021-01-03T12:54:06.790 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.036) 0:01:37.188 ******** 2021-01-03T12:54:06.795 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.833 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.044) 0:01:37.233 ******** 2021-01-03T12:54:06.839 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-01-03T12:54:06.842 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-01-03T12:54:06.879 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.044) 0:01:37.278 ******** 2021-01-03T12:54:06.912 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.032) 0:01:37.311 ******** 2021-01-03T12:54:06.918 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-03T12:54:06.919 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:06.963 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.051) 0:01:37.362 ******** 2021-01-03T12:54:06.999 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:06 +0000 (0:00:00.036) 0:01:37.399 ******** 2021-01-03T12:54:07.006 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-01-03T12:54:07.008 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:07.044 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:07 +0000 (0:00:00.044) 0:01:37.443 ******** 2021-01-03T12:54:07.050 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-01-03T12:54:07.052 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:07.087 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:07 +0000 (0:00:00.043) 0:01:37.487 ******** 2021-01-03T12:54:07.093 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-03T12:54:07.095 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:07.129 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:07 +0000 (0:00:00.041) 0:01:37.528 ******** 2021-01-03T12:54:07.135 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-01-03T12:54:07.136 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:07.176 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:07 +0000 (0:00:00.047) 0:01:37.575 ******** 2021-01-03T12:54:07.183 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-01-03T12:54:07.184 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-01-03T12:54:07.219 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:07 +0000 (0:00:00.043) 0:01:37.619 ******** 2021-01-03T12:54:07.225 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-03T12:54:07.227 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:07.264 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:07 +0000 (0:00:00.044) 0:01:37.664 ******** 2021-01-03T12:54:07.271 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-01-03T12:54:07.272 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-01-03T12:54:07.308 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:07 +0000 (0:00:00.043) 0:01:37.708 ******** 2021-01-03T12:54:07.314 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-01-03T12:54:07.316 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011142", "end": "2021-01-03 12:54:07.321121", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-01-03 12:54:07.309979", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:07.354 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:07 +0000 (0:00:00.045) 0:01:37.754 ******** 2021-01-03T12:54:07.381 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-03T12:54:07.384 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi007.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005891", "end": "2021-01-03 12:54:07.429708", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-01-03 12:54:07.423817", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:07.417 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:07 +0000 (0:00:00.062) 0:01:37.816 ******** 2021-01-03T12:54:07.496 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005255", "end": "2021-01-03 12:54:07.547956", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-01-03 12:54:07.542701", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:07.560 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.007050", "end": "2021-01-03 12:54:07.409006", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-01-03 12:54:07.401956", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:07.623 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.007313", "end": "2021-01-03 12:54:07.668297", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-01-03 12:54:07.660984", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:07.625 INFO:teuthology.task.ansible.out: 2021-01-03T12:54:07.666 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:07 +0000 (0:00:00.248) 0:01:38.065 ******** 2021-01-03T12:54:07.683 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006051", "end": "2021-01-03 12:54:07.523913", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-01-03 12:54:07.517862", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:07.694 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-01-03T12:54:07.732 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:07 +0000 (0:00:00.066) 0:01:38.131 ******** 2021-01-03T12:54:07.749 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-01-03T12:54:07.752 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false} 2021-01-03T12:54:07.790 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:07 +0000 (0:00:00.058) 0:01:38.190 ******** 2021-01-03T12:54:07.797 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-01-03T12:54:07.799 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005504", "end": "2021-01-03 12:54:07.640522", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-01-03 12:54:07.635018", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:07.821 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-01-03T12:54:07.822 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-01-03T12:54:07.856 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:07 +0000 (0:00:00.065) 0:01:38.256 ******** 2021-01-03T12:54:07.873 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-01-03T12:54:07.874 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-01-03T12:54:07.911 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-01-03T12:54:07.912 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.007900", "end": "2021-01-03 12:54:07.758213", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-01-03 12:54:07.750313", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:07.971 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:07 +0000 (0:00:00.114) 0:01:38.370 ******** 2021-01-03T12:54:07.989 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-01-03T12:54:07.990 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1609678323.023321, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1609678323.019321, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 96882, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1609678323.019321, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3394389858", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-01-03T12:54:08.025 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:08 +0000 (0:00:00.054) 0:01:38.425 ******** 2021-01-03T12:54:08.031 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-01-03T12:54:08.069 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:08 +0000 (0:00:00.043) 0:01:38.469 ******** 2021-01-03T12:54:08.075 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-01-03T12:54:08.076 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-01-03T12:54:08.115 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:08 +0000 (0:00:00.046) 0:01:38.515 ******** 2021-01-03T12:54:08.156 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-01-03T12:54:08.157 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-01-03T12:54:08.193 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:08 +0000 (0:00:00.077) 0:01:38.592 ******** 2021-01-03T12:54:08.199 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-01-03T12:54:08.200 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-01-03T12:54:08.236 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-01-03T12:54:08.237 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-01-03T12:54:08.295 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:08 +0000 (0:00:00.102) 0:01:38.695 ******** 2021-01-03T12:54:08.321 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-01-03T12:54:08.323 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:08.356 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:08 +0000 (0:00:00.060) 0:01:38.756 ******** 2021-01-03T12:54:08.479 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-01-03T12:54:08.481 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-01-03T12:54:08.515 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:08 +0000 (0:00:00.158) 0:01:38.914 ******** 2021-01-03T12:54:08.637 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-01-03T12:54:08.638 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-01-03T12:54:08.679 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:08 +0000 (0:00:00.162) 0:01:39.077 ******** 2021-01-03T12:54:08.684 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-01-03T12:54:08.685 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false} 2021-01-03T12:54:08.721 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:08 +0000 (0:00:00.043) 0:01:39.120 ******** 2021-01-03T12:54:08.730 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:08.766 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:08 +0000 (0:00:00.045) 0:01:39.166 ******** 2021-01-03T12:54:08.773 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-01-03T12:54:08.774 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2021-01-03T12:54:08.813 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:08 +0000 (0:00:00.046) 0:01:39.212 ******** 2021-01-03T12:54:08.820 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-01-03T12:54:08.822 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-01-03T12:54:08.834 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi133.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-01-03T12:54:08.870 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:08 +0000 (0:00:00.057) 0:01:39.270 ******** 2021-01-03T12:54:08.908 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi133.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:08.919 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:08.921 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:08.931 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:08.933 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:08.968 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:08 +0000 (0:00:00.097) 0:01:39.368 ******** 2021-01-03T12:54:08.974 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-01-03T12:54:08.975 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1609678292.2604544, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1609678292.2564523, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 96882, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1609678292.2564523, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "3394389858", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-01-03T12:54:09.012 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:09 +0000 (0:00:00.043) 0:01:39.411 ******** 2021-01-03T12:54:09.018 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-03T12:54:09.020 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:09.057 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:09 +0000 (0:00:00.045) 0:01:39.457 ******** 2021-01-03T12:54:09.084 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-01-03T12:54:09.085 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:09.121 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:09 +0000 (0:00:00.063) 0:01:39.520 ******** 2021-01-03T12:54:09.137 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-01-03T12:54:09.138 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-01-03T12:54:09.173 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:09 +0000 (0:00:00.052) 0:01:39.572 ******** 2021-01-03T12:54:09.179 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-01-03T12:54:09.181 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:09.217 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:09 +0000 (0:00:00.043) 0:01:39.616 ******** 2021-01-03T12:54:09.223 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-01-03T12:54:09.224 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-01-03T12:54:09.259 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:09 +0000 (0:00:00.042) 0:01:39.659 ******** 2021-01-03T12:54:09.266 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-01-03T12:54:09.268 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:09.302 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:09 +0000 (0:00:00.042) 0:01:39.702 ******** 2021-01-03T12:54:09.307 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-01-03T12:54:09.309 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:09.343 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:09 +0000 (0:00:00.040) 0:01:39.743 ******** 2021-01-03T12:54:09.348 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-01-03T12:54:09.350 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:09.392 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:09 +0000 (0:00:00.049) 0:01:39.792 ******** 2021-01-03T12:54:09.419 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-03T12:54:09.420 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:09.456 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:09 +0000 (0:00:00.063) 0:01:39.856 ******** 2021-01-03T12:54:09.473 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-01-03T12:54:09.474 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-01-03T12:54:09.508 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:09 +0000 (0:00:00.052) 0:01:39.908 ******** 2021-01-03T12:54:09.515 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-01-03T12:54:09.516 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:09.554 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:09 +0000 (0:00:00.045) 0:01:39.954 ******** 2021-01-03T12:54:09.581 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-03T12:54:09.583 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:09.618 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:09 +0000 (0:00:00.062) 0:01:40.017 ******** 2021-01-03T12:54:09.768 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} Sunday 03 January 2021 12:54:09 +0000 (0:00:00.052) 0:01:40.069 ******** TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Sunday 03 January 2021 12:54:09 +0000 (0:00:00.061) 0:01:40.131 ******** 2021-01-03T12:54:09.770 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi036.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2021-01-03T12:54:09.772 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi133.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010950", "end": "2021-01-03 12:54:10.066669", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-01-03 12:54:10.055719", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:09.773 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi036.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-01-03T12:54:09.783 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2021-01-03T12:54:09.784 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-01-03T12:54:09.819 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:09 +0000 (0:00:00.087) 0:01:40.219 ******** 2021-01-03T12:54:09.856 INFO:teuthology.task.ansible.out: 2021-01-03T12:54:09.858 INFO:teuthology.task.ansible.out:TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:09.869 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:09.871 INFO:teuthology.task.ansible.out: skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:09.907 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:09 +0000 (0:00:00.087) 0:01:40.306 ******** 2021-01-03T12:54:09.913 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-01-03T12:54:09.915 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005625", "end": "2021-01-03 12:54:10.188207", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-01-03 12:54:10.182582", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:09.935 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:09.975 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:09 +0000 (0:00:00.068) 0:01:40.375 ******** 2021-01-03T12:54:10.002 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-01-03T12:54:10.005 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005453", "end": "2021-01-03 12:54:10.300649", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-01-03 12:54:10.295196", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:10.038 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:10 +0000 (0:00:00.062) 0:01:40.438 ******** 2021-01-03T12:54:10.065 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-01-03T12:54:10.066 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:10.103 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:10 +0000 (0:00:00.064) 0:01:40.502 ******** 2021-01-03T12:54:10.120 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-01-03T12:54:10.123 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.008217", "end": "2021-01-03 12:54:10.415571", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-01-03 12:54:10.407354", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:10.162 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:10 +0000 (0:00:00.058) 0:01:40.561 ******** 2021-01-03T12:54:10.167 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-01-03T12:54:10.169 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:10.204 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:10 +0000 (0:00:00.043) 0:01:40.604 ******** 2021-01-03T12:54:10.211 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-01-03T12:54:10.248 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:10 +0000 (0:00:00.044) 0:01:40.648 ******** 2021-01-03T12:54:10.254 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:10.297 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:10 +0000 (0:00:00.048) 0:01:40.697 ******** 2021-01-03T12:54:10.326 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:10.363 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:10 +0000 (0:00:00.064) 0:01:40.762 ******** 2021-01-03T12:54:10.380 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-01-03T12:54:10.382 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-01-03T12:54:10.416 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-01-03T12:54:10.417 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:10.452 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:10 +0000 (0:00:00.090) 0:01:40.852 ******** 2021-01-03T12:54:10.485 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:10.519 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:10 +0000 (0:00:00.066) 0:01:40.918 ******** 2021-01-03T12:54:10.671 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-01-03T12:54:10.672 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011102", "end": "2021-01-03 12:54:10.418750", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-01-03 12:54:10.407648", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:10.789 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006220", "end": "2021-01-03 12:54:10.537460", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-01-03 12:54:10.531240", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:10.903 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005553", "end": "2021-01-03 12:54:10.652575", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-01-03 12:54:10.647022", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:11.029 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.008289", "end": "2021-01-03 12:54:10.774322", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-01-03 12:54:10.766033", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:11.066 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:11 +0000 (0:00:00.547) 0:01:41.466 ******** 2021-01-03T12:54:11.094 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-01-03T12:54:11.131 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:11 +0000 (0:00:00.064) 0:01:41.531 ******** 2021-01-03T12:54:11.252 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-01-03T12:54:11.254 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-01-03T12:54:11.443 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-01-03T12:54:11.476 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:11 +0000 (0:00:00.344) 0:01:41.876 ******** 2021-01-03T12:54:11.510 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:11 +0000 (0:00:00.034) 0:01:41.910 ******** 2021-01-03T12:54:11.546 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:11 +0000 (0:00:00.035) 0:01:41.945 ******** 2021-01-03T12:54:11.580 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:11 +0000 (0:00:00.034) 0:01:41.979 ******** 2021-01-03T12:54:12.194 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-01-03T12:54:12.196 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] 2021-01-03T12:54:12.277 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:12 +0000 (0:00:00.697) 0:01:42.676 ******** 2021-01-03T12:54:12.308 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-03T12:54:12.310 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-01-03T12:54:12.312 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi036.front.sepia.ceph.com] 2021-01-03T12:54:12.355 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:12 +0000 (0:00:00.078) 0:01:42.754 ******** 2021-01-03T12:54:12.393 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] 2021-01-03T12:54:12.399 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-03T12:54:12.401 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:12.435 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:12 +0000 (0:00:00.080) 0:01:42.834 ******** 2021-01-03T12:54:12.470 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:12 +0000 (0:00:00.035) 0:01:42.870 ******** 2021-01-03T12:54:12.504 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-01-03T12:54:12.506 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} TASK [container-host : set_fact] *********************************************** ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-01-03T12:54:12.540 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:12 +0000 (0:00:00.069) 0:01:42.939 ******** 2021-01-03T12:54:12.574 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:12 +0000 (0:00:00.034) 0:01:42.974 ******** 2021-01-03T12:54:12.608 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:12 +0000 (0:00:00.033) 0:01:43.007 ******** 2021-01-03T12:54:12.613 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-03T12:54:12.615 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:12.651 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:12 +0000 (0:00:00.043) 0:01:43.051 ******** 2021-01-03T12:54:12.656 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-03T12:54:12.658 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-01-03T12:54:12.695 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:12 +0000 (0:00:00.043) 0:01:43.094 ******** 2021-01-03T12:54:12.701 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-01-03T12:54:12.702 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-01-03T12:54:12.741 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:12 +0000 (0:00:00.045) 0:01:43.140 ******** 2021-01-03T12:54:12.747 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:12.788 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:12 +0000 (0:00:00.047) 0:01:43.187 ******** 2021-01-03T12:54:12.825 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** ok: [smithi133.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-01-03T12:54:12.866 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:12 +0000 (0:00:00.078) 0:01:43.265 ******** 2021-01-03T12:54:13.262 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-01-03T12:54:13.264 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] 2021-01-03T12:54:13.341 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:13 +0000 (0:00:00.474) 0:01:43.740 ******** 2021-01-03T12:54:13.368 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-03T12:54:13.369 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-01-03T12:54:13.405 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:13 +0000 (0:00:00.064) 0:01:43.805 ******** 2021-01-03T12:54:13.411 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-01-03T12:54:13.413 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"cache_update_time": 1609678337, "cache_updated": false, "changed": false} 2021-01-03T12:54:13.450 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:13 +0000 (0:00:00.044) 0:01:43.850 ******** 2021-01-03T12:54:13.457 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-03T12:54:13.459 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:13.495 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:13 +0000 (0:00:00.045) 0:01:43.895 ******** 2021-01-03T12:54:13.502 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-03T12:54:13.503 INFO:teuthology.task.ansible.out:skipping: [smithi007.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:13.541 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:13 +0000 (0:00:00.045) 0:01:43.941 ******** 2021-01-03T12:54:13.547 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-01-03T12:54:13.548 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-01-03T12:54:13.586 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:13 +0000 (0:00:00.044) 0:01:43.985 ******** 2021-01-03T12:54:13.591 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-03T12:54:13.593 INFO:teuthology.task.ansible.out:ok: [smithi007.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-01-03T12:54:13.631 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:13 +0000 (0:00:00.045) 0:01:44.031 ******** 2021-01-03T12:54:13.668 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-01-03T12:54:13.670 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1609678341, "cache_updated": false, "changed": false} 2021-01-03T12:54:13.706 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:13 +0000 (0:00:00.074) 0:01:44.106 ******** 2021-01-03T12:54:13.733 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-03T12:54:13.735 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:13.770 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:13 +0000 (0:00:00.064) 0:01:44.170 ******** 2021-01-03T12:54:13.776 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2021-01-03T12:54:13.778 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} TASK [container-host : Install container packages] ***************************** ok: [smithi133.front.sepia.ceph.com] => {"cache_update_time": 1609678330, "cache_updated": false, "changed": false} 2021-01-03T12:54:13.822 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:13 +0000 (0:00:00.051) 0:01:44.221 ******** 2021-01-03T12:54:13.856 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:13 +0000 (0:00:00.034) 0:01:44.256 ******** 2021-01-03T12:54:13.862 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-03T12:54:13.864 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-01-03T12:54:13.901 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:13 +0000 (0:00:00.045) 0:01:44.301 ******** 2021-01-03T12:54:13.907 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-03T12:54:13.910 INFO:teuthology.task.ansible.out:skipping: [smithi133.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:13.946 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:13 +0000 (0:00:00.044) 0:01:44.346 ******** 2021-01-03T12:54:13.972 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-03T12:54:13.974 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-01-03T12:54:14.009 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:14 +0000 (0:00:00.062) 0:01:44.408 ******** 2021-01-03T12:54:14.034 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2021-01-03T12:54:14.036 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-03T12:54:14.073 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:14 +0000 (0:00:00.064) 0:01:44.473 ******** 2021-01-03T12:54:14.142 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-03T12:54:14.180 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:14 +0000 (0:00:00.107) 0:01:44.580 ******** 2021-01-03T12:54:14.186 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-01-03T12:54:14.188 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "checksum": "ad23d23287af05eb6dfc6847a1957988954f5ccf", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "97bf7a9f95b52e04e40f96163cd1717c", "mode": "0644", "owner": "root", "size": 2134, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1609678453.8486526-100611469660921/source", "state": "file", "uid": 0} 2021-01-03T12:54:14.227 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:14 +0000 (0:00:00.046) 0:01:44.626 ******** 2021-01-03T12:54:14.390 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "checksum": "ad23d23287af05eb6dfc6847a1957988954f5ccf", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "97bf7a9f95b52e04e40f96163cd1717c", "mode": "0644", "owner": "root", "size": 2134, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1609678454.1001356-44643344332463/source", "state": "file", "uid": 0} 2021-01-03T12:54:14.428 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:14 +0000 (0:00:00.201) 0:01:44.828 ******** 2021-01-03T12:54:14.497 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "checksum": "ad23d23287af05eb6dfc6847a1957988954f5ccf", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "97bf7a9f95b52e04e40f96163cd1717c", "mode": "0644", "owner": "root", "size": 2134, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1609678454.2060442-237247199425676/source", "state": "file", "uid": 0} 2021-01-03T12:54:14.537 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:14 +0000 (0:00:00.108) 0:01:44.936 ******** 2021-01-03T12:54:14.543 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-01-03T12:54:14.545 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"cache_update_time": 1609678333, "cache_updated": false, "changed": false} 2021-01-03T12:54:14.583 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:14 +0000 (0:00:00.045) 0:01:44.982 ******** 2021-01-03T12:54:14.610 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-03T12:54:14.612 INFO:teuthology.task.ansible.out:skipping: [smithi016.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-03T12:54:14.647 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:14 +0000 (0:00:00.064) 0:01:45.047 ******** 2021-01-03T12:54:14.674 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-03T12:54:14.676 INFO:teuthology.task.ansible.out:ok: [smithi016.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-01-03T12:54:14.711 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:14 +0000 (0:00:00.064) 0:01:45.111 ******** 2021-01-03T12:54:14.843 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2021-01-03T12:54:14.845 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-03T12:54:14.880 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:14 +0000 (0:00:00.169) 0:01:45.280 ******** 2021-01-03T12:54:15.204 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-01-03T12:54:15.206 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "checksum": "ad23d23287af05eb6dfc6847a1957988954f5ccf", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "97bf7a9f95b52e04e40f96163cd1717c", "mode": "0644", "owner": "root", "size": 2134, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1609678454.9123719-192987826097322/source", "state": "file", "uid": 0} 2021-01-03T12:54:15.242 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:15 +0000 (0:00:00.361) 0:01:45.641 ******** 2021-01-03T12:54:17.749 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-01-03T12:54:17.751 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-7cAWGE-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-7cAWGE-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packag 2021-01-03T12:54:17.752 INFO:teuthology.task.ansible.out:es/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-01-03T12:54:17.787 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:17 +0000 (0:00:02.545) 0:01:48.187 ******** 2021-01-03T12:54:17.857 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-C9LzI1-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-C9LzI1-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packag 2021-01-03T12:54:17.859 INFO:teuthology.task.ansible.out:es/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-01-03T12:54:17.895 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:17 +0000 (0:00:00.107) 0:01:48.294 ******** 2021-01-03T12:54:17.913 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-uo9giH-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-uo9giH-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packag 2021-01-03T12:54:17.914 INFO:teuthology.task.ansible.out:es/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-01-03T12:54:17.952 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:17 +0000 (0:00:00.055) 0:01:48.350 ******** 2021-01-03T12:54:17.961 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* ok: [smithi007.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-01-03T12:54:18.002 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:17 +0000 (0:00:00.050) 0:01:48.401 ******** 2021-01-03T12:54:18.031 INFO:teuthology.task.ansible.out:ok: [smithi133.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-01-03T12:54:18.070 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:18 +0000 (0:00:00.068) 0:01:48.469 ******** 2021-01-03T12:54:18.088 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-01-03T12:54:18.128 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:18 +0000 (0:00:00.057) 0:01:48.527 ******** 2021-01-03T12:54:18.360 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1609678458.0380654-204736127859244/source", "state": "file", "uid": 0} 2021-01-03T12:54:18.404 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:18 +0000 (0:00:00.276) 0:01:48.803 ******** 2021-01-03T12:54:18.434 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1609678458.1086276-116708021189897/source", "state": "file", "uid": 0} 2021-01-03T12:54:18.472 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:18 +0000 (0:00:00.067) 0:01:48.871 ******** 2021-01-03T12:54:18.479 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1609678458.164371-12370042629969/source", "state": "file", "uid": 0} 2021-01-03T12:54:18.518 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:18 +0000 (0:00:00.045) 0:01:48.917 ******** 2021-01-03T12:54:18.662 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-01-03T12:54:18.663 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.113806", "end": "2021-01-03 12:54:18.710505", "rc": 0, "start": "2021-01-03 12:54:18.596699", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:18.700 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:18 +0000 (0:00:00.182) 0:01:49.100 ******** 2021-01-03T12:54:18.706 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-01-03T12:54:18.707 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-vyZI4X-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-vyZI4X-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packag 2021-01-03T12:54:18.709 INFO:teuthology.task.ansible.out:es/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-01-03T12:54:18.746 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:18 +0000 (0:00:00.045) 0:01:49.145 ******** 2021-01-03T12:54:18.753 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-01-03T12:54:18.754 INFO:teuthology.task.ansible.out:changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.120377", "end": "2021-01-03 12:54:19.035100", "rc": 0, "start": "2021-01-03 12:54:18.914723", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:18.794 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:18 +0000 (0:00:00.047) 0:01:49.193 ******** 2021-01-03T12:54:18.805 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.121781", "end": "2021-01-03 12:54:18.534692", "rc": 0, "start": "2021-01-03 12:54:18.412911", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:18.868 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:18 +0000 (0:00:00.074) 0:01:49.268 ******** 2021-01-03T12:54:18.886 INFO:teuthology.task.ansible.out: 2021-01-03T12:54:18.887 INFO:teuthology.task.ansible.out:TASK [container-host : Check for docker's daemon.json] ************************* 2021-01-03T12:54:18.889 INFO:teuthology.task.ansible.out: ok: [smithi016.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-01-03T12:54:18.925 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:18 +0000 (0:00:00.056) 0:01:49.325 ******** 2021-01-03T12:54:19.254 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-01-03T12:54:19.256 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1609678458.960094-175733898877460/source", "state": "file", "uid": 0} 2021-01-03T12:54:19.292 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:19 +0000 (0:00:00.366) 0:01:49.692 ******** 2021-01-03T12:54:19.563 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-01-03T12:54:19.564 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.132485", "end": "2021-01-03 12:54:19.420495", "rc": 0, "start": "2021-01-03 12:54:19.288010", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-03T12:54:19.601 INFO:teuthology.task.ansible.out:Sunday 03 January 2021 12:54:19 +0000 (0:00:00.309) 0:01:50.001 ******** 2021-01-03T12:54:21.882 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* changed: [smithi133.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "firewalld.service network-online.target basic.target sysinit.target containerd.service systemd-journald.socket docker.socket system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BindsTo": "containerd.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.dock 2021-01-03T12:54:21.884 INFO:teuthology.task.ansible.out:er.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", 2021-01-03T12:54:21.885 INFO:teuthology.task.ansible.out: "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128029", "LimitSIGPENDINGSoft": "128029", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2021-01-03 12:52:05 UTC", "StateChangeTimestampMonoto 2021-01-03T12:54:21.887 INFO:teuthology.task.ansible.out:nic": "41158379", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-03T12:54:21.979 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "docker.socket network-online.target firewalld.service sysinit.target basic.target systemd-journald.socket system.slice containerd.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BindsTo": "containerd.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": 2021-01-03T12:54:21.981 INFO:teuthology.task.ansible.out: "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "12805 2021-01-03T12:54:21.983 INFO:teuthology.task.ansible.out:3", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target docker.socket system.slice", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2021-01-03 12:51:38 UTC", "StateChangeTimestampMonotonic": "39150474", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneede 2021-01-03T12:54:21.984 INFO:teuthology.task.ansible.out:d": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-03T12:54:22.142 INFO:teuthology.task.ansible.out:changed: [smithi007.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "containerd.service systemd-journald.socket sysinit.target basic.target firewalld.service system.slice docker.socket network-online.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BindsTo": "containerd.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": 2021-01-03T12:54:22.144 INFO:teuthology.task.ansible.out: "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "12805 2021-01-03T12:54:22.145 INFO:teuthology.task.ansible.out:3", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target docker.socket system.slice", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2021-01-03 12:51:45 UTC", "StateChangeTimestampMonotonic": "40698286", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneede 2021-01-03T12:54:22.147 INFO:teuthology.task.ansible.out:d": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-03T12:54:22.951 INFO:teuthology.task.ansible.out:changed: [smithi016.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "firewalld.service docker.socket containerd.service basic.target system.slice sysinit.target network-online.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BindsTo": "containerd.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": 2021-01-03T12:54:22.953 INFO:teuthology.task.ansible.out: "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "67108864", "LimitMEMLOCKSoft": "67108864", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "12805 2021-01-03T12:54:22.955 INFO:teuthology.task.ansible.out:3", "LimitSIGPENDINGSoft": "128053", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sun 2021-01-03 12:51:47 UTC", "StateChangeTimestampMonotonic": "39715342", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneede 2021-01-03T12:54:22.956 INFO:teuthology.task.ansible.out:d": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-03T12:54:23.054 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** 2021-01-03T12:54:23.055 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2021-01-03T12:54:23.059 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-01-03T12:54:23.061 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-01-03T12:54:23.062 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi007.front.sepia.ceph.com : ok=120 changed=32 unreachable=0 failed=0 skipped=189 rescued=0 ignored=0 smithi016.front.sepia.ceph.com : ok=120 changed=32 unreachable=0 failed=0 skipped=189 rescued=0 ignored=0 smithi036.front.sepia.ceph.com : ok=120 changed=32 unreachable=0 failed=0 skipped=189 rescued=0 ignored=0 smithi133.front.sepia.ceph.com : ok=120 changed=32 unreachable=0 failed=0 skipped=189 rescued=0 ignored=0 Sunday 03 January 2021 12:54:23 +0000 (0:00:03.460) 0:01:53.461 ******** =============================================================================== testnode : Ensure packages are not present. ----------------------------- 7.94s testnode : Install packages --------------------------------------------- 5.96s testnode : Zap all non-root disks --------------------------------------- 4.45s container-host : Restart docker service --------------------------------- 3.46s container-host : Install registries-conf-ctl ---------------------------- 2.55s Gathering Facts --------------------------------------------------------- 1.55s Gathering Facts --------------------------------------------------------- 0.70s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.67s Gathering Facts --------------------------------------------------------- 0.65s ansible-managed : Add authorized keys for the ansible user. ------------- 0.61s testnode : Install python-apt ------------------------------------------- 0.56s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.55s testnode : Update apt cache. -------------------------------------------- 0.52s testnode : Ensure perl-doc is installed on apt systems. ----------------- 0.40s testnode : Blow away lingering OSD data and FSIDs ----------------------- 0.39s testnode : Install apt keys --------------- 2021-01-03T12:54:23.064 INFO:teuthology.task.ansible.out:------------------------------ 0.39s container-host : Create /etc/docker/daemon.json if necessary ------------ 0.37s ansible-managed : Create the ansible user. ------------------------------ 0.36s container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert --- 0.36s testnode : Touch /ceph-qa-ready ----------------------------------------- 0.34s 2021-01-03T12:54:23.389 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi133.front.sepia.ceph.com'), Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi036.front.sepia.ceph.com')] 2021-01-03T12:54:23.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-03T12:54:23.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:54:23.468 DEBUG:teuthology.orchestra.run.smithi133:> true 2021-01-03T12:54:23.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-03T12:54:23.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:54:23.745 DEBUG:teuthology.orchestra.run.smithi016:> true 2021-01-03T12:54:23.951 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-03T12:54:23.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:54:24.028 DEBUG:teuthology.orchestra.run.smithi007:> true 2021-01-03T12:54:24.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-03T12:54:24.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-03T12:54:24.310 DEBUG:teuthology.orchestra.run.smithi036:> true 2021-01-03T12:54:24.519 INFO:teuthology.run_tasks:Running task clock... 2021-01-03T12:54:24.536 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-01-03T12:54:24.537 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-01-03T12:54:24.538 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-03T12:54:24.589 INFO:teuthology.orchestra.run.smithi133.stdout: 3 Jan 12:54:24 ntpd[6918]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-01-03T12:54:24.590 INFO:teuthology.orchestra.run.smithi133.stdout: 3 Jan 12:54:24 ntpd[6918]: Command line: ntpd -gq 2021-01-03T12:54:24.590 INFO:teuthology.orchestra.run.smithi133.stdout: 3 Jan 12:54:24 ntpd[6918]: proto: precision = 0.123 usec (-23) 2021-01-03T12:54:24.592 INFO:teuthology.orchestra.run.smithi133.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-03T12:54:24.592 INFO:teuthology.orchestra.run.smithi133.stderr:restrict ::: KOD does nothing without LIMITED. 2021-01-03T12:54:24.592 INFO:teuthology.orchestra.run.smithi133.stdout: 3 Jan 12:54:24 ntpd[6918]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-03T12:54:24.593 INFO:teuthology.orchestra.run.smithi133.stdout: 3 Jan 12:54:24 ntpd[6918]: restrict ::: KOD does nothing without LIMITED. 2021-01-03T12:54:24.593 INFO:teuthology.orchestra.run.smithi133.stdout: 3 Jan 12:54:24 ntpd[6918]: Listen and drop on 0 v6wildcard [::]:123 2021-01-03T12:54:24.593 INFO:teuthology.orchestra.run.smithi133.stdout: 3 Jan 12:54:24 ntpd[6918]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-01-03T12:54:24.593 INFO:teuthology.orchestra.run.smithi133.stdout: 3 Jan 12:54:24 ntpd[6918]: Listen normally on 2 lo 127.0.0.1:123 2021-01-03T12:54:24.593 INFO:teuthology.orchestra.run.smithi133.stdout: 3 Jan 12:54:24 ntpd[6918]: Listen normally on 3 enp3s0f1 172.21.15.133:123 2021-01-03T12:54:24.594 INFO:teuthology.orchestra.run.smithi133.stdout: 3 Jan 12:54:24 ntpd[6918]: Listen normally on 4 lo [::1]:123 2021-01-03T12:54:24.594 INFO:teuthology.orchestra.run.smithi133.stdout: 3 Jan 12:54:24 ntpd[6918]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8087%5]:123 2021-01-03T12:54:24.594 INFO:teuthology.orchestra.run.smithi133.stdout: 3 Jan 12:54:24 ntpd[6918]: Listening on routing socket on fd #22 for interface updates 2021-01-03T12:54:25.590 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:25 ntpd[6918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:25.591 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:25 ntpd[6918]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:25.591 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:25 ntpd[6918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:25.591 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:25 ntpd[6918]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:27.591 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:27 ntpd[6918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:27.591 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:27 ntpd[6918]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:27.591 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:27 ntpd[6918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:27.591 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:27 ntpd[6918]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:27.592 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:27 ntpd[6918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:27.592 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:27 ntpd[6918]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:27.592 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:27 ntpd[6918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:27.592 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:27 ntpd[6918]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:28.591 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:28 ntpd[6918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:28.591 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:28 ntpd[6918]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:28.591 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:28 ntpd[6918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:28.592 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:28 ntpd[6918]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:29.591 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:29 ntpd[6918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:29.591 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:29 ntpd[6918]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:29.593 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:29 ntpd[6918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:29.593 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:29 ntpd[6918]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:29.594 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:29 ntpd[6918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:29.594 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:29 ntpd[6918]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:29.594 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:29 ntpd[6918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:29.594 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:29 ntpd[6918]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:29.594 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:29 ntpd[6918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:29.595 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:29 ntpd[6918]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:29.595 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:29 ntpd[6918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:29.595 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:29 ntpd[6918]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:30.591 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:30 ntpd[6918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:30.592 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:30 ntpd[6918]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:30.592 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:30 ntpd[6918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:30.592 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:30 ntpd[6918]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:31.590 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:31 ntpd[6918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:31.591 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:31 ntpd[6918]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:31.591 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:31 ntpd[6918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:31.591 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:31 ntpd[6918]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:31.591 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:31 ntpd[6918]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-01-03T12:54:31.592 INFO:teuthology.orchestra.run.smithi133.stderr: 3 Jan 12:54:31 ntpd[6918]: can't open /var/log/ntpstats/loopstats.20210103: Permission denied 2021-01-03T12:54:31.592 INFO:teuthology.orchestra.run.smithi133.stdout: 3 Jan 12:54:31 ntpd[6918]: ntpd: time set -0.327579 s 2021-01-03T12:54:31.592 INFO:teuthology.orchestra.run.smithi133.stdout:ntpd: time set -0.327579s 2021-01-03T12:54:31.660 INFO:teuthology.orchestra.run.smithi133.stdout: remote refid st t when poll reach delay offset jitter 2021-01-03T12:54:31.660 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================== 2021-01-03T12:54:31.661 INFO:teuthology.orchestra.run.smithi133.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-03T12:54:31.661 INFO:teuthology.orchestra.run.smithi133.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-03T12:54:31.661 INFO:teuthology.orchestra.run.smithi133.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-03T12:54:31.661 INFO:teuthology.orchestra.run.smithi133.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-03T12:54:31.662 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-01-03T12:54:31.663 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-03T12:54:31.715 INFO:teuthology.orchestra.run.smithi016.stdout: 3 Jan 12:54:31 ntpd[7242]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-01-03T12:54:31.715 INFO:teuthology.orchestra.run.smithi016.stdout: 3 Jan 12:54:31 ntpd[7242]: Command line: ntpd -gq 2021-01-03T12:54:31.717 INFO:teuthology.orchestra.run.smithi016.stdout: 3 Jan 12:54:31 ntpd[7242]: proto: precision = 0.117 usec (-23) 2021-01-03T12:54:31.717 INFO:teuthology.orchestra.run.smithi016.stdout: 3 Jan 12:54:31 ntpd[7242]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-03T12:54:31.717 INFO:teuthology.orchestra.run.smithi016.stdout: 3 Jan 12:54:31 ntpd[7242]: restrict ::: KOD does nothing without LIMITED. 2021-01-03T12:54:31.717 INFO:teuthology.orchestra.run.smithi016.stdout: 3 Jan 12:54:31 ntpd[7242]: Listen and drop on 0 v6wildcard [::]:123 2021-01-03T12:54:31.717 INFO:teuthology.orchestra.run.smithi016.stdout: 3 Jan 12:54:31 ntpd[7242]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-01-03T12:54:31.718 INFO:teuthology.orchestra.run.smithi016.stdout: 3 Jan 12:54:31 ntpd[7242]: Listen normally on 2 lo 127.0.0.1:123 2021-01-03T12:54:31.718 INFO:teuthology.orchestra.run.smithi016.stdout: 3 Jan 12:54:31 ntpd[7242]: Listen normally on 3 ens1f0 172.21.15.16:123 2021-01-03T12:54:31.718 INFO:teuthology.orchestra.run.smithi016.stdout: 3 Jan 12:54:31 ntpd[7242]: Listen normally on 4 lo [::1]:123 2021-01-03T12:54:31.718 INFO:teuthology.orchestra.run.smithi016.stdout: 3 Jan 12:54:31 ntpd[7242]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1564%3]:123 2021-01-03T12:54:31.718 INFO:teuthology.orchestra.run.smithi016.stdout: 3 Jan 12:54:31 ntpd[7242]: Listening on routing socket on fd #22 for interface updates 2021-01-03T12:54:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-03T12:54:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:restrict ::: KOD does nothing without LIMITED. 2021-01-03T12:54:33.715 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:33 ntpd[7242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:33.715 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:33 ntpd[7242]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:33.715 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:33 ntpd[7242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:33.715 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:33 ntpd[7242]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:35.714 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:35 ntpd[7242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:35.714 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:35 ntpd[7242]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:35.715 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:35 ntpd[7242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:35.715 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:35 ntpd[7242]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:35.715 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:35 ntpd[7242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:35.715 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:35 ntpd[7242]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:35.715 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:35 ntpd[7242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:35.716 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:35 ntpd[7242]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:35.716 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:35 ntpd[7242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:35.716 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:35 ntpd[7242]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:35.716 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:35 ntpd[7242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:35.716 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:35 ntpd[7242]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:36.714 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:36 ntpd[7242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:36.714 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:36 ntpd[7242]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:36.715 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:36 ntpd[7242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:36.715 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:36 ntpd[7242]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:37.714 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:37 ntpd[7242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:37.715 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:37 ntpd[7242]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:37.715 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:37 ntpd[7242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:37.715 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:37 ntpd[7242]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:37.716 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:37 ntpd[7242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:37.716 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:37 ntpd[7242]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:37.716 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:37 ntpd[7242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:37.717 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:37 ntpd[7242]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:37.717 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:37 ntpd[7242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:37.717 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:37 ntpd[7242]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:37.718 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:37 ntpd[7242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:37.718 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:37 ntpd[7242]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:38.712 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:38 ntpd[7242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:38.712 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:38 ntpd[7242]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:38.712 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:38 ntpd[7242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:38.713 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:38 ntpd[7242]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:39.712 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:39 ntpd[7242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:39.712 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:39 ntpd[7242]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:39.713 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:39 ntpd[7242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:39.713 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:39 ntpd[7242]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:39.713 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:39 ntpd[7242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:39.713 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:39 ntpd[7242]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:39.713 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:39 ntpd[7242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:39.714 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:39 ntpd[7242]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:39.714 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:39 ntpd[7242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:39.714 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:39 ntpd[7242]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:39.714 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:39 ntpd[7242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:39.714 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:39 ntpd[7242]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:39.715 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:39 ntpd[7242]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-01-03T12:54:39.715 INFO:teuthology.orchestra.run.smithi016.stderr: 3 Jan 12:54:39 ntpd[7242]: can't open /var/log/ntpstats/loopstats.20210103: Permission denied 2021-01-03T12:54:39.715 INFO:teuthology.orchestra.run.smithi016.stdout: 3 Jan 12:54:39 ntpd[7242]: ntpd: time set +0.108311 s 2021-01-03T12:54:39.715 INFO:teuthology.orchestra.run.smithi016.stdout:ntpd: time set +0.108311s 2021-01-03T12:54:39.767 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2021-01-03T12:54:39.768 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2021-01-03T12:54:39.768 INFO:teuthology.orchestra.run.smithi016.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-03T12:54:39.768 INFO:teuthology.orchestra.run.smithi016.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-03T12:54:39.768 INFO:teuthology.orchestra.run.smithi016.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-03T12:54:39.769 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-03T12:54:39.770 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-01-03T12:54:39.770 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-03T12:54:39.829 INFO:teuthology.orchestra.run.smithi007.stdout: 3 Jan 12:54:39 ntpd[7327]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-01-03T12:54:39.830 INFO:teuthology.orchestra.run.smithi007.stdout: 3 Jan 12:54:39 ntpd[7327]: Command line: ntpd -gq 2021-01-03T12:54:39.830 INFO:teuthology.orchestra.run.smithi007.stdout: 3 Jan 12:54:39 ntpd[7327]: proto: precision = 0.127 usec (-23) 2021-01-03T12:54:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-03T12:54:39.832 INFO:teuthology.orchestra.run.smithi007.stderr:restrict ::: KOD does nothing without LIMITED. 2021-01-03T12:54:39.832 INFO:teuthology.orchestra.run.smithi007.stdout: 3 Jan 12:54:39 ntpd[7327]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-03T12:54:39.832 INFO:teuthology.orchestra.run.smithi007.stdout: 3 Jan 12:54:39 ntpd[7327]: restrict ::: KOD does nothing without LIMITED. 2021-01-03T12:54:39.833 INFO:teuthology.orchestra.run.smithi007.stdout: 3 Jan 12:54:39 ntpd[7327]: Listen and drop on 0 v6wildcard [::]:123 2021-01-03T12:54:39.833 INFO:teuthology.orchestra.run.smithi007.stdout: 3 Jan 12:54:39 ntpd[7327]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-01-03T12:54:39.833 INFO:teuthology.orchestra.run.smithi007.stdout: 3 Jan 12:54:39 ntpd[7327]: Listen normally on 2 lo 127.0.0.1:123 2021-01-03T12:54:39.833 INFO:teuthology.orchestra.run.smithi007.stdout: 3 Jan 12:54:39 ntpd[7327]: Listen normally on 3 ens1f0 172.21.15.7:123 2021-01-03T12:54:39.834 INFO:teuthology.orchestra.run.smithi007.stdout: 3 Jan 12:54:39 ntpd[7327]: Listen normally on 4 lo [::1]:123 2021-01-03T12:54:39.834 INFO:teuthology.orchestra.run.smithi007.stdout: 3 Jan 12:54:39 ntpd[7327]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15ea%4]:123 2021-01-03T12:54:39.834 INFO:teuthology.orchestra.run.smithi007.stdout: 3 Jan 12:54:39 ntpd[7327]: Listening on routing socket on fd #22 for interface updates 2021-01-03T12:54:40.830 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:40 ntpd[7327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:40.831 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:40 ntpd[7327]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:40.831 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:40 ntpd[7327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:40.831 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:40 ntpd[7327]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:42.831 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:42 ntpd[7327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:42.832 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:42 ntpd[7327]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:42.832 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:42 ntpd[7327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:42.832 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:42 ntpd[7327]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:43.833 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:43 ntpd[7327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:43.834 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:43 ntpd[7327]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:43.834 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:43 ntpd[7327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:43.834 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:43 ntpd[7327]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:43.834 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:43 ntpd[7327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:43.834 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:43 ntpd[7327]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:43.835 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:43 ntpd[7327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:43.835 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:43 ntpd[7327]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:43.835 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:43 ntpd[7327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:43.835 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:43 ntpd[7327]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:43.836 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:43 ntpd[7327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:43.836 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:43 ntpd[7327]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:44.832 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:44 ntpd[7327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:44.833 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:44 ntpd[7327]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:44.833 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:44 ntpd[7327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:44.833 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:44 ntpd[7327]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:45.833 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:45 ntpd[7327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:45.834 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:45 ntpd[7327]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:45.834 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:45 ntpd[7327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:45.834 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:45 ntpd[7327]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:45.834 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:45 ntpd[7327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:45.835 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:45 ntpd[7327]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:45.835 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:45 ntpd[7327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:45.835 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:45 ntpd[7327]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:45.835 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:45 ntpd[7327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:45.835 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:45 ntpd[7327]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:45.836 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:45 ntpd[7327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:45.836 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:45 ntpd[7327]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:46.834 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:46 ntpd[7327]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:46.835 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:46 ntpd[7327]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:46.835 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:46 ntpd[7327]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:46.835 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:46 ntpd[7327]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:46.836 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:46 ntpd[7327]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-01-03T12:54:46.836 INFO:teuthology.orchestra.run.smithi007.stderr: 3 Jan 12:54:46 ntpd[7327]: can't open /var/log/ntpstats/loopstats.20210103: Permission denied 2021-01-03T12:54:46.837 INFO:teuthology.orchestra.run.smithi007.stdout: 3 Jan 12:54:46 ntpd[7327]: ntpd: time set -0.056887 s 2021-01-03T12:54:46.837 INFO:teuthology.orchestra.run.smithi007.stdout:ntpd: time set -0.056887s 2021-01-03T12:54:46.899 INFO:teuthology.orchestra.run.smithi007.stdout: remote refid st t when poll reach delay offset jitter 2021-01-03T12:54:46.899 INFO:teuthology.orchestra.run.smithi007.stdout:============================================================================== 2021-01-03T12:54:46.899 INFO:teuthology.orchestra.run.smithi007.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-03T12:54:46.900 INFO:teuthology.orchestra.run.smithi007.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-03T12:54:46.900 INFO:teuthology.orchestra.run.smithi007.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-03T12:54:46.900 INFO:teuthology.orchestra.run.smithi007.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-03T12:54:46.901 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-01-03T12:54:46.902 DEBUG:teuthology.orchestra.run.smithi036:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-03T12:54:46.955 INFO:teuthology.orchestra.run.smithi036.stdout: 3 Jan 12:54:46 ntpd[7280]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-01-03T12:54:46.956 INFO:teuthology.orchestra.run.smithi036.stdout: 3 Jan 12:54:46 ntpd[7280]: Command line: ntpd -gq 2021-01-03T12:54:46.957 INFO:teuthology.orchestra.run.smithi036.stdout: 3 Jan 12:54:46 ntpd[7280]: proto: precision = 0.093 usec (-23) 2021-01-03T12:54:46.957 INFO:teuthology.orchestra.run.smithi036.stdout: 3 Jan 12:54:46 ntpd[7280]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-03T12:54:46.957 INFO:teuthology.orchestra.run.smithi036.stdout: 3 Jan 12:54:46 ntpd[7280]: restrict ::: KOD does nothing without LIMITED. 2021-01-03T12:54:46.958 INFO:teuthology.orchestra.run.smithi036.stdout: 3 Jan 12:54:46 ntpd[7280]: Listen and drop on 0 v6wildcard [::]:123 2021-01-03T12:54:46.958 INFO:teuthology.orchestra.run.smithi036.stdout: 3 Jan 12:54:46 ntpd[7280]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-01-03T12:54:46.958 INFO:teuthology.orchestra.run.smithi036.stdout: 3 Jan 12:54:46 ntpd[7280]: Listen normally on 2 lo 127.0.0.1:123 2021-01-03T12:54:46.958 INFO:teuthology.orchestra.run.smithi036.stdout: 3 Jan 12:54:46 ntpd[7280]: Listen normally on 3 ens1f0 172.21.15.36:123 2021-01-03T12:54:46.960 INFO:teuthology.orchestra.run.smithi036.stdout: 3 Jan 12:54:46 ntpd[7280]: Listen normally on 4 lo [::1]:123 2021-01-03T12:54:46.960 INFO:teuthology.orchestra.run.smithi036.stdout: 3 Jan 12:54:46 ntpd[7280]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:2542%3]:123 2021-01-03T12:54:46.960 INFO:teuthology.orchestra.run.smithi036.stdout: 3 Jan 12:54:46 ntpd[7280]: Listening on routing socket on fd #22 for interface updates 2021-01-03T12:54:46.961 INFO:teuthology.orchestra.run.smithi036.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-03T12:54:46.961 INFO:teuthology.orchestra.run.smithi036.stderr:restrict ::: KOD does nothing without LIMITED. 2021-01-03T12:54:48.956 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:48 ntpd[7280]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:48.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:48 ntpd[7280]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:48.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:48 ntpd[7280]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:48.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:48 ntpd[7280]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:48.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:48 ntpd[7280]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:48.958 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:48 ntpd[7280]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:48.958 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:48 ntpd[7280]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:48.958 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:48 ntpd[7280]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:49.956 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:49 ntpd[7280]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:49.956 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:49 ntpd[7280]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:49.956 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:49 ntpd[7280]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:49.956 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:49 ntpd[7280]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:50.956 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:50 ntpd[7280]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:50.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:50 ntpd[7280]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:50.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:50 ntpd[7280]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:50.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:50 ntpd[7280]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:50.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:50 ntpd[7280]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:50.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:50 ntpd[7280]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:50.958 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:50 ntpd[7280]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:50.958 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:50 ntpd[7280]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:51.956 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:51 ntpd[7280]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:51.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:51 ntpd[7280]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:51.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:51 ntpd[7280]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:51.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:51 ntpd[7280]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:51.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:51 ntpd[7280]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:51.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:51 ntpd[7280]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:51.958 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:51 ntpd[7280]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:51.958 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:51 ntpd[7280]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:52.956 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:52 ntpd[7280]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:52.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:52 ntpd[7280]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:52.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:52 ntpd[7280]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:52.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:52 ntpd[7280]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:52.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:52 ntpd[7280]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:52.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:52 ntpd[7280]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:52.958 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:52 ntpd[7280]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:52.958 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:52 ntpd[7280]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:53.956 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:53 ntpd[7280]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:53.956 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:53 ntpd[7280]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:53.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:53 ntpd[7280]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:53.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:53 ntpd[7280]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:53.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:53 ntpd[7280]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:53.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:53 ntpd[7280]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:53.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:53 ntpd[7280]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:53.958 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:53 ntpd[7280]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:54.956 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:54 ntpd[7280]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-03T12:54:54.956 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:54 ntpd[7280]: can't open /var/log/ntpstats/rawstats.20210103: Permission denied 2021-01-03T12:54:54.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:54 ntpd[7280]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-03T12:54:54.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:54 ntpd[7280]: can't open /var/log/ntpstats/peerstats.20210103: Permission denied 2021-01-03T12:54:54.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:54 ntpd[7280]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-01-03T12:54:54.957 INFO:teuthology.orchestra.run.smithi036.stderr: 3 Jan 12:54:54 ntpd[7280]: can't open /var/log/ntpstats/loopstats.20210103: Permission denied 2021-01-03T12:54:54.958 INFO:teuthology.orchestra.run.smithi036.stdout: 3 Jan 12:54:54 ntpd[7280]: ntpd: time slew +0.000034 s 2021-01-03T12:54:54.958 INFO:teuthology.orchestra.run.smithi036.stdout:ntpd: time slew +0.000034s 2021-01-03T12:54:55.017 INFO:teuthology.orchestra.run.smithi036.stdout: remote refid st t when poll reach delay offset jitter 2021-01-03T12:54:55.017 INFO:teuthology.orchestra.run.smithi036.stdout:============================================================================== 2021-01-03T12:54:55.017 INFO:teuthology.orchestra.run.smithi036.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-03T12:54:55.017 INFO:teuthology.orchestra.run.smithi036.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-03T12:54:55.018 INFO:teuthology.orchestra.run.smithi036.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-03T12:54:55.018 INFO:teuthology.orchestra.run.smithi036.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-03T12:54:55.019 INFO:teuthology.run_tasks:Running task install... 2021-01-03T12:54:55.030 DEBUG:teuthology.task.install:project ceph 2021-01-03T12:54:55.031 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e'}} 2021-01-03T12:54:55.031 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e'} 2021-01-03T12:54:55.031 INFO:teuthology.task.install:Using flavor: basic 2021-01-03T12:54:55.038 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-01-03T12:54:55.038 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2021-01-03T12:54:55.039 DEBUG:teuthology.orchestra.run.smithi133:> sudo lsb_release -is 2021-01-03T12:54:55.092 INFO:teuthology.orchestra.run.smithi133.stdout:Ubuntu 2021-01-03T12:54:55.097 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-03T12:54:55.097 DEBUG:teuthology.orchestra.run.smithi016:> sudo lsb_release -is 2021-01-03T12:54:55.098 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-key list | grep Ceph 2021-01-03T12:54:55.151 INFO:teuthology.orchestra.run.smithi016.stdout:Ubuntu 2021-01-03T12:54:55.156 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-03T12:54:55.157 DEBUG:teuthology.orchestra.run.smithi007:> sudo lsb_release -is 2021-01-03T12:54:55.157 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-key list | grep Ceph 2021-01-03T12:54:55.194 INFO:teuthology.orchestra.run.smithi133.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-01-03T12:54:55.212 INFO:teuthology.orchestra.run.smithi007.stdout:Ubuntu 2021-01-03T12:54:55.217 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-03T12:54:55.218 DEBUG:teuthology.orchestra.run.smithi036:> sudo lsb_release -is 2021-01-03T12:54:55.218 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-key list | grep Ceph 2021-01-03T12:54:55.248 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-01-03T12:54:55.262 INFO:teuthology.orchestra.run.smithi133.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-01-03T12:54:55.262 INFO:teuthology.orchestra.run.smithi133.stdout:uid [ unknown] Ceph.com (release key) 2021-01-03T12:54:55.263 DEBUG:teuthology.orchestra.run.smithi133:> sudo lsb_release -is 2021-01-03T12:54:55.272 INFO:teuthology.orchestra.run.smithi036.stdout:Ubuntu 2021-01-03T12:54:55.278 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-03T12:54:55.279 DEBUG:teuthology.orchestra.run.smithi036:> sudo apt-key list | grep Ceph 2021-01-03T12:54:55.307 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-01-03T12:54:55.307 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph.com (release key) 2021-01-03T12:54:55.308 DEBUG:teuthology.orchestra.run.smithi016:> sudo lsb_release -is 2021-01-03T12:54:55.315 INFO:teuthology.orchestra.run.smithi133.stdout:Ubuntu 2021-01-03T12:54:55.316 INFO:teuthology.orchestra.run.smithi007.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-01-03T12:54:55.320 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-03T12:54:55.320 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-01-03T12:54:55.321 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-01-03T12:54:55.321 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e 2021-01-03T12:54:55.361 INFO:teuthology.orchestra.run.smithi016.stdout:Ubuntu 2021-01-03T12:54:55.367 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-03T12:54:55.367 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-01-03T12:54:55.367 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-01-03T12:54:55.368 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e 2021-01-03T12:54:55.372 INFO:teuthology.orchestra.run.smithi036.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-01-03T12:54:55.372 INFO:teuthology.orchestra.run.smithi007.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-01-03T12:54:55.372 INFO:teuthology.orchestra.run.smithi007.stdout:uid [ unknown] Ceph.com (release key) 2021-01-03T12:54:55.373 DEBUG:teuthology.orchestra.run.smithi007:> sudo lsb_release -is 2021-01-03T12:54:55.422 INFO:teuthology.orchestra.run.smithi007.stdout:Ubuntu 2021-01-03T12:54:55.427 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-03T12:54:55.427 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-01-03T12:54:55.427 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-01-03T12:54:55.428 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e 2021-01-03T12:54:55.435 INFO:teuthology.orchestra.run.smithi036.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-01-03T12:54:55.435 INFO:teuthology.orchestra.run.smithi036.stdout:uid [ unknown] Ceph.com (release key) 2021-01-03T12:54:55.436 DEBUG:teuthology.orchestra.run.smithi036:> sudo lsb_release -is 2021-01-03T12:54:55.484 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default/ 2021-01-03T12:54:55.484 INFO:teuthology.task.install.deb:Package version is 15.2.8-57-g2eacca1e-1bionic 2021-01-03T12:54:55.489 INFO:teuthology.orchestra.run.smithi036.stdout:Ubuntu 2021-01-03T12:54:55.495 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-03T12:54:55.495 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2021-01-03T12:54:55.496 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2021-01-03T12:54:55.496 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e 2021-01-03T12:54:55.522 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default/ 2021-01-03T12:54:55.522 INFO:teuthology.task.install.deb:Package version is 15.2.8-57-g2eacca1e-1bionic 2021-01-03T12:54:55.601 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default/ 2021-01-03T12:54:55.602 INFO:teuthology.task.install.deb:Package version is 15.2.8-57-g2eacca1e-1bionic 2021-01-03T12:54:55.611 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2021-01-03T12:54:55.611 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-01-03T12:54:55.626 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get update 2021-01-03T12:54:55.646 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2021-01-03T12:54:55.647 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-01-03T12:54:55.653 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default/ 2021-01-03T12:54:55.653 INFO:teuthology.task.install.deb:Package version is 15.2.8-57-g2eacca1e-1bionic 2021-01-03T12:54:55.663 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get update 2021-01-03T12:54:55.730 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2021-01-03T12:54:55.731 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-01-03T12:54:55.747 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get update 2021-01-03T12:54:55.776 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2021-01-03T12:54:55.777 DEBUG:teuthology.orchestra.run.smithi036:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-01-03T12:54:55.792 DEBUG:teuthology.orchestra.run.smithi036:> sudo apt-get update 2021-01-03T12:54:55.895 INFO:teuthology.orchestra.run.smithi133.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic InRelease 2021-01-03T12:54:55.913 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic InRelease 2021-01-03T12:54:55.918 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic Release [7,681 B] 2021-01-03T12:54:55.937 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic Release [7,681 B] 2021-01-03T12:54:55.937 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-01-03T12:54:55.938 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-01-03T12:54:55.938 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:4 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-01-03T12:54:55.943 INFO:teuthology.orchestra.run.smithi133.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic Release.gpg 2021-01-03T12:54:55.967 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,087 B] 2021-01-03T12:54:55.973 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:3 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-01-03T12:54:55.973 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-01-03T12:54:55.974 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic Release.gpg 2021-01-03T12:54:55.983 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-01-03T12:54:55.997 INFO:teuthology.orchestra.run.smithi007.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic InRelease 2021-01-03T12:54:55.998 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2021-01-03T12:54:56.004 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2021-01-03T12:54:56.006 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-01-03T12:54:56.020 INFO:teuthology.orchestra.run.smithi007.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic Release [7,681 B] 2021-01-03T12:54:56.041 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:7 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-01-03T12:54:56.042 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,087 B] 2021-01-03T12:54:56.042 INFO:teuthology.orchestra.run.smithi036.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic InRelease 2021-01-03T12:54:56.043 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-01-03T12:54:56.045 INFO:teuthology.orchestra.run.smithi007.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic Release.gpg 2021-01-03T12:54:56.065 INFO:teuthology.orchestra.run.smithi036.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic Release [7,681 B] 2021-01-03T12:54:56.069 INFO:teuthology.orchestra.run.smithi007.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2021-01-03T12:54:56.085 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-01-03T12:54:56.091 INFO:teuthology.orchestra.run.smithi036.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic Release.gpg 2021-01-03T12:54:56.091 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:5 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-01-03T12:54:56.108 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,087 B] 2021-01-03T12:54:56.114 INFO:teuthology.orchestra.run.smithi036.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,087 B] 2021-01-03T12:54:56.121 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-01-03T12:54:56.121 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-01-03T12:54:56.156 INFO:teuthology.orchestra.run.smithi036.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2021-01-03T12:54:56.172 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-01-03T12:54:56.200 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-01-03T12:54:56.253 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-01-03T12:54:56.533 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 26.6 kB in 1s (37.8 kB/s) 2021-01-03T12:54:56.534 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 26.6 kB in 1s (45.3 kB/s) 2021-01-03T12:54:56.595 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 26.6 kB in 1s (36.8 kB/s) 2021-01-03T12:54:56.625 INFO:teuthology.orchestra.run.smithi036.stdout:Fetched 26.6 kB in 1s (42.3 kB/s) 2021-01-03T12:54:57.762 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2021-01-03T12:54:57.806 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2021-01-03T12:54:57.809 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.8-57-g2eacca1e-1bionic cephadm=15.2.8-57-g2eacca1e-1bionic ceph-mds=15.2.8-57-g2eacca1e-1bionic ceph-mgr=15.2.8-57-g2eacca1e-1bionic ceph-common=15.2.8-57-g2eacca1e-1bionic ceph-fuse=15.2.8-57-g2eacca1e-1bionic ceph-test=15.2.8-57-g2eacca1e-1bionic radosgw=15.2.8-57-g2eacca1e-1bionic python3-rados=15.2.8-57-g2eacca1e-1bionic python3-rgw=15.2.8-57-g2eacca1e-1bionic python3-cephfs=15.2.8-57-g2eacca1e-1bionic python3-rbd=15.2.8-57-g2eacca1e-1bionic libcephfs2=15.2.8-57-g2eacca1e-1bionic libcephfs-dev=15.2.8-57-g2eacca1e-1bionic librados2=15.2.8-57-g2eacca1e-1bionic librbd1=15.2.8-57-g2eacca1e-1bionic rbd-fuse=15.2.8-57-g2eacca1e-1bionic python3-cephfs=15.2.8-57-g2eacca1e-1bionic cephfs-shell=15.2.8-57-g2eacca1e-1bionic 2021-01-03T12:54:57.854 DEBUG:teuthology.orchestra.run.smithi007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.8-57-g2eacca1e-1bionic cephadm=15.2.8-57-g2eacca1e-1bionic ceph-mds=15.2.8-57-g2eacca1e-1bionic ceph-mgr=15.2.8-57-g2eacca1e-1bionic ceph-common=15.2.8-57-g2eacca1e-1bionic ceph-fuse=15.2.8-57-g2eacca1e-1bionic ceph-test=15.2.8-57-g2eacca1e-1bionic radosgw=15.2.8-57-g2eacca1e-1bionic python3-rados=15.2.8-57-g2eacca1e-1bionic python3-rgw=15.2.8-57-g2eacca1e-1bionic python3-cephfs=15.2.8-57-g2eacca1e-1bionic python3-rbd=15.2.8-57-g2eacca1e-1bionic libcephfs2=15.2.8-57-g2eacca1e-1bionic libcephfs-dev=15.2.8-57-g2eacca1e-1bionic librados2=15.2.8-57-g2eacca1e-1bionic librbd1=15.2.8-57-g2eacca1e-1bionic rbd-fuse=15.2.8-57-g2eacca1e-1bionic python3-cephfs=15.2.8-57-g2eacca1e-1bionic cephfs-shell=15.2.8-57-g2eacca1e-1bionic 2021-01-03T12:54:57.873 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2021-01-03T12:54:57.887 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2021-01-03T12:54:57.905 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2021-01-03T12:54:57.919 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.8-57-g2eacca1e-1bionic cephadm=15.2.8-57-g2eacca1e-1bionic ceph-mds=15.2.8-57-g2eacca1e-1bionic ceph-mgr=15.2.8-57-g2eacca1e-1bionic ceph-common=15.2.8-57-g2eacca1e-1bionic ceph-fuse=15.2.8-57-g2eacca1e-1bionic ceph-test=15.2.8-57-g2eacca1e-1bionic radosgw=15.2.8-57-g2eacca1e-1bionic python3-rados=15.2.8-57-g2eacca1e-1bionic python3-rgw=15.2.8-57-g2eacca1e-1bionic python3-cephfs=15.2.8-57-g2eacca1e-1bionic python3-rbd=15.2.8-57-g2eacca1e-1bionic libcephfs2=15.2.8-57-g2eacca1e-1bionic libcephfs-dev=15.2.8-57-g2eacca1e-1bionic librados2=15.2.8-57-g2eacca1e-1bionic librbd1=15.2.8-57-g2eacca1e-1bionic rbd-fuse=15.2.8-57-g2eacca1e-1bionic python3-cephfs=15.2.8-57-g2eacca1e-1bionic cephfs-shell=15.2.8-57-g2eacca1e-1bionic 2021-01-03T12:54:57.935 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2021-01-03T12:54:57.954 DEBUG:teuthology.orchestra.run.smithi036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.8-57-g2eacca1e-1bionic cephadm=15.2.8-57-g2eacca1e-1bionic ceph-mds=15.2.8-57-g2eacca1e-1bionic ceph-mgr=15.2.8-57-g2eacca1e-1bionic ceph-common=15.2.8-57-g2eacca1e-1bionic ceph-fuse=15.2.8-57-g2eacca1e-1bionic ceph-test=15.2.8-57-g2eacca1e-1bionic radosgw=15.2.8-57-g2eacca1e-1bionic python3-rados=15.2.8-57-g2eacca1e-1bionic python3-rgw=15.2.8-57-g2eacca1e-1bionic python3-cephfs=15.2.8-57-g2eacca1e-1bionic python3-rbd=15.2.8-57-g2eacca1e-1bionic libcephfs2=15.2.8-57-g2eacca1e-1bionic libcephfs-dev=15.2.8-57-g2eacca1e-1bionic librados2=15.2.8-57-g2eacca1e-1bionic librbd1=15.2.8-57-g2eacca1e-1bionic rbd-fuse=15.2.8-57-g2eacca1e-1bionic python3-cephfs=15.2.8-57-g2eacca1e-1bionic cephfs-shell=15.2.8-57-g2eacca1e-1bionic 2021-01-03T12:54:58.001 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2021-01-03T12:54:58.038 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2021-01-03T12:54:58.115 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2021-01-03T12:54:58.115 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2021-01-03T12:54:58.194 INFO:teuthology.orchestra.run.smithi007.stdout:Building dependency tree... 2021-01-03T12:54:58.195 INFO:teuthology.orchestra.run.smithi007.stdout:Reading state information... 2021-01-03T12:54:58.268 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2021-01-03T12:54:58.268 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2021-01-03T12:54:58.277 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2021-01-03T12:54:58.277 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-01-03T12:54:58.277 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-01-03T12:54:58.278 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2021-01-03T12:54:58.279 INFO:teuthology.orchestra.run.smithi133.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-01-03T12:54:58.279 INFO:teuthology.orchestra.run.smithi133.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2021-01-03T12:54:58.279 INFO:teuthology.orchestra.run.smithi133.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2021-01-03T12:54:58.279 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2021-01-03T12:54:58.279 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2021-01-03T12:54:58.280 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-01-03T12:54:58.280 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2021-01-03T12:54:58.280 INFO:teuthology.orchestra.run.smithi133.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib 2021-01-03T12:54:58.280 INFO:teuthology.orchestra.run.smithi133.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes 2021-01-03T12:54:58.281 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2021-01-03T12:54:58.281 INFO:teuthology.orchestra.run.smithi133.stdout: python3-matplotlib python3-monotonic python3-numpy python3-oauth2client 2021-01-03T12:54:58.281 INFO:teuthology.orchestra.run.smithi133.stdout: python3-olefile python3-openssl python3-paste python3-pastedeploy 2021-01-03T12:54:58.281 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pastescript python3-pecan python3-pil python3-pluggy 2021-01-03T12:54:58.281 INFO:teuthology.orchestra.run.smithi133.stdout: python3-prettytable python3-py python3-pyasn1 python3-pyasn1-modules 2021-01-03T12:54:58.282 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyinotify python3-pyparsing python3-pyperclip python3-pytest 2021-01-03T12:54:58.282 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2021-01-03T12:54:58.282 INFO:teuthology.orchestra.run.smithi133.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2021-01-03T12:54:58.282 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2021-01-03T12:54:58.283 INFO:teuthology.orchestra.run.smithi133.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2021-01-03T12:54:58.283 INFO:teuthology.orchestra.run.smithi133.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2021-01-03T12:54:58.283 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-01-03T12:54:58.283 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2021-01-03T12:54:58.284 INFO:teuthology.orchestra.run.smithi133.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2021-01-03T12:54:58.284 INFO:teuthology.orchestra.run.smithi133.stdout: python-pytest-xdist python-mock python-cryptography-doc 2021-01-03T12:54:58.284 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2021-01-03T12:54:58.284 INFO:teuthology.orchestra.run.smithi133.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2021-01-03T12:54:58.285 INFO:teuthology.orchestra.run.smithi133.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2021-01-03T12:54:58.285 INFO:teuthology.orchestra.run.smithi133.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2021-01-03T12:54:58.285 INFO:teuthology.orchestra.run.smithi133.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2021-01-03T12:54:58.285 INFO:teuthology.orchestra.run.smithi133.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2021-01-03T12:54:58.285 INFO:teuthology.orchestra.run.smithi133.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2021-01-03T12:54:58.286 INFO:teuthology.orchestra.run.smithi133.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2021-01-03T12:54:58.286 INFO:teuthology.orchestra.run.smithi133.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2021-01-03T12:54:58.286 INFO:teuthology.orchestra.run.smithi133.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2021-01-03T12:54:58.286 INFO:teuthology.orchestra.run.smithi133.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2021-01-03T12:54:58.287 INFO:teuthology.orchestra.run.smithi133.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2021-01-03T12:54:58.287 INFO:teuthology.orchestra.run.smithi133.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2021-01-03T12:54:58.296 INFO:teuthology.orchestra.run.smithi036.stdout:Building dependency tree... 2021-01-03T12:54:58.297 INFO:teuthology.orchestra.run.smithi036.stdout:Reading state information... 2021-01-03T12:54:58.372 INFO:teuthology.orchestra.run.smithi007.stdout:The following additional packages will be installed: 2021-01-03T12:54:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-01-03T12:54:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-01-03T12:54:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2021-01-03T12:54:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-01-03T12:54:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2021-01-03T12:54:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2021-01-03T12:54:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2021-01-03T12:54:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2021-01-03T12:54:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-01-03T12:54:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2021-01-03T12:54:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib 2021-01-03T12:54:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes 2021-01-03T12:54:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2021-01-03T12:54:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: python3-matplotlib python3-monotonic python3-numpy python3-oauth2client 2021-01-03T12:54:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: python3-olefile python3-openssl python3-paste python3-pastedeploy 2021-01-03T12:54:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pastescript python3-pecan python3-pil python3-pluggy 2021-01-03T12:54:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable python3-py python3-pyasn1 python3-pyasn1-modules 2021-01-03T12:54:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyinotify python3-pyparsing python3-pyperclip python3-pytest 2021-01-03T12:54:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2021-01-03T12:54:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2021-01-03T12:54:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2021-01-03T12:54:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2021-01-03T12:54:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2021-01-03T12:54:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-01-03T12:54:58.379 INFO:teuthology.orchestra.run.smithi007.stdout:Suggested packages: 2021-01-03T12:54:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2021-01-03T12:54:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: python-pytest-xdist python-mock python-cryptography-doc 2021-01-03T12:54:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2021-01-03T12:54:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2021-01-03T12:54:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2021-01-03T12:54:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2021-01-03T12:54:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2021-01-03T12:54:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2021-01-03T12:54:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2021-01-03T12:54:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2021-01-03T12:54:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2021-01-03T12:54:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2021-01-03T12:54:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2021-01-03T12:54:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2021-01-03T12:54:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2021-01-03T12:54:58.387 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2021-01-03T12:54:58.387 INFO:teuthology.orchestra.run.smithi133.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-01-03T12:54:58.387 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-01-03T12:54:58.388 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-01-03T12:54:58.389 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2021-01-03T12:54:58.389 INFO:teuthology.orchestra.run.smithi133.stdout: libcephfs-dev libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 2021-01-03T12:54:58.389 INFO:teuthology.orchestra.run.smithi133.stdout: libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 2021-01-03T12:54:58.389 INFO:teuthology.orchestra.run.smithi133.stdout: libxslt1.1 nvme-cli python-attr python-funcsigs python-pastedeploy-tpl 2021-01-03T12:54:58.390 INFO:teuthology.orchestra.run.smithi133.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2021-01-03T12:54:58.390 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt python3-bs4 python3-ceph-argparse python3-ceph-common 2021-01-03T12:54:58.390 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cephfs python3-cffi-backend python3-cherrypy3 python3-cmd2 2021-01-03T12:54:58.390 INFO:teuthology.orchestra.run.smithi133.stdout: python3-colorama python3-cryptography python3-cycler python3-dateutil 2021-01-03T12:54:58.390 INFO:teuthology.orchestra.run.smithi133.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2021-01-03T12:54:58.391 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-01-03T12:54:58.391 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-01-03T12:54:58.391 INFO:teuthology.orchestra.run.smithi133.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2021-01-03T12:54:58.392 INFO:teuthology.orchestra.run.smithi133.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2021-01-03T12:54:58.392 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2021-01-03T12:54:58.392 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2021-01-03T12:54:58.392 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2021-01-03T12:54:58.392 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2021-01-03T12:54:58.393 INFO:teuthology.orchestra.run.smithi133.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2021-01-03T12:54:58.393 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-01-03T12:54:58.393 INFO:teuthology.orchestra.run.smithi133.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2021-01-03T12:54:58.393 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2021-01-03T12:54:58.393 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2021-01-03T12:54:58.394 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-01-03T12:54:58.394 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages will be upgraded: 2021-01-03T12:54:58.395 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 librbd1 2021-01-03T12:54:58.443 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2021-01-03T12:54:58.444 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-01-03T12:54:58.444 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-01-03T12:54:58.445 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2021-01-03T12:54:58.446 INFO:teuthology.orchestra.run.smithi016.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-01-03T12:54:58.446 INFO:teuthology.orchestra.run.smithi016.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2021-01-03T12:54:58.446 INFO:teuthology.orchestra.run.smithi016.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2021-01-03T12:54:58.446 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2021-01-03T12:54:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2021-01-03T12:54:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-01-03T12:54:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2021-01-03T12:54:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib 2021-01-03T12:54:58.447 INFO:teuthology.orchestra.run.smithi016.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes 2021-01-03T12:54:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2021-01-03T12:54:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: python3-matplotlib python3-monotonic python3-numpy python3-oauth2client 2021-01-03T12:54:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: python3-olefile python3-openssl python3-paste python3-pastedeploy 2021-01-03T12:54:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pastescript python3-pecan python3-pil python3-pluggy 2021-01-03T12:54:58.448 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable python3-py python3-pyasn1 python3-pyasn1-modules 2021-01-03T12:54:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyinotify python3-pyparsing python3-pyperclip python3-pytest 2021-01-03T12:54:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2021-01-03T12:54:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2021-01-03T12:54:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2021-01-03T12:54:58.449 INFO:teuthology.orchestra.run.smithi016.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2021-01-03T12:54:58.450 INFO:teuthology.orchestra.run.smithi016.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2021-01-03T12:54:58.450 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-01-03T12:54:58.451 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2021-01-03T12:54:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2021-01-03T12:54:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: python-pytest-xdist python-mock python-cryptography-doc 2021-01-03T12:54:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2021-01-03T12:54:58.451 INFO:teuthology.orchestra.run.smithi016.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2021-01-03T12:54:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2021-01-03T12:54:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2021-01-03T12:54:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2021-01-03T12:54:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2021-01-03T12:54:58.452 INFO:teuthology.orchestra.run.smithi016.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2021-01-03T12:54:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2021-01-03T12:54:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2021-01-03T12:54:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2021-01-03T12:54:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2021-01-03T12:54:58.453 INFO:teuthology.orchestra.run.smithi016.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2021-01-03T12:54:58.454 INFO:teuthology.orchestra.run.smithi016.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2021-01-03T12:54:58.468 INFO:teuthology.orchestra.run.smithi036.stdout:The following additional packages will be installed: 2021-01-03T12:54:58.468 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-01-03T12:54:58.469 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-01-03T12:54:58.469 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2021-01-03T12:54:58.470 INFO:teuthology.orchestra.run.smithi036.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-01-03T12:54:58.470 INFO:teuthology.orchestra.run.smithi036.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2021-01-03T12:54:58.470 INFO:teuthology.orchestra.run.smithi036.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2021-01-03T12:54:58.470 INFO:teuthology.orchestra.run.smithi036.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2021-01-03T12:54:58.471 INFO:teuthology.orchestra.run.smithi036.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2021-01-03T12:54:58.471 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2021-01-03T12:54:58.471 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2021-01-03T12:54:58.471 INFO:teuthology.orchestra.run.smithi036.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib 2021-01-03T12:54:58.471 INFO:teuthology.orchestra.run.smithi036.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes 2021-01-03T12:54:58.472 INFO:teuthology.orchestra.run.smithi036.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2021-01-03T12:54:58.472 INFO:teuthology.orchestra.run.smithi036.stdout: python3-matplotlib python3-monotonic python3-numpy python3-oauth2client 2021-01-03T12:54:58.472 INFO:teuthology.orchestra.run.smithi036.stdout: python3-olefile python3-openssl python3-paste python3-pastedeploy 2021-01-03T12:54:58.472 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pastescript python3-pecan python3-pil python3-pluggy 2021-01-03T12:54:58.472 INFO:teuthology.orchestra.run.smithi036.stdout: python3-prettytable python3-py python3-pyasn1 python3-pyasn1-modules 2021-01-03T12:54:58.473 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pyinotify python3-pyparsing python3-pyperclip python3-pytest 2021-01-03T12:54:58.473 INFO:teuthology.orchestra.run.smithi036.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2021-01-03T12:54:58.473 INFO:teuthology.orchestra.run.smithi036.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2021-01-03T12:54:58.473 INFO:teuthology.orchestra.run.smithi036.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2021-01-03T12:54:58.473 INFO:teuthology.orchestra.run.smithi036.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2021-01-03T12:54:58.474 INFO:teuthology.orchestra.run.smithi036.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2021-01-03T12:54:58.474 INFO:teuthology.orchestra.run.smithi036.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-01-03T12:54:58.474 INFO:teuthology.orchestra.run.smithi036.stdout:Suggested packages: 2021-01-03T12:54:58.474 INFO:teuthology.orchestra.run.smithi036.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2021-01-03T12:54:58.475 INFO:teuthology.orchestra.run.smithi036.stdout: python-pytest-xdist python-mock python-cryptography-doc 2021-01-03T12:54:58.475 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2021-01-03T12:54:58.475 INFO:teuthology.orchestra.run.smithi036.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2021-01-03T12:54:58.475 INFO:teuthology.orchestra.run.smithi036.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2021-01-03T12:54:58.475 INFO:teuthology.orchestra.run.smithi036.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2021-01-03T12:54:58.476 INFO:teuthology.orchestra.run.smithi036.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2021-01-03T12:54:58.476 INFO:teuthology.orchestra.run.smithi036.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2021-01-03T12:54:58.476 INFO:teuthology.orchestra.run.smithi036.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2021-01-03T12:54:58.476 INFO:teuthology.orchestra.run.smithi036.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2021-01-03T12:54:58.476 INFO:teuthology.orchestra.run.smithi036.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2021-01-03T12:54:58.477 INFO:teuthology.orchestra.run.smithi036.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2021-01-03T12:54:58.477 INFO:teuthology.orchestra.run.smithi036.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2021-01-03T12:54:58.477 INFO:teuthology.orchestra.run.smithi036.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2021-01-03T12:54:58.477 INFO:teuthology.orchestra.run.smithi036.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2021-01-03T12:54:58.487 INFO:teuthology.orchestra.run.smithi007.stdout:The following NEW packages will be installed: 2021-01-03T12:54:58.487 INFO:teuthology.orchestra.run.smithi007.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-01-03T12:54:58.487 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-01-03T12:54:58.487 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-01-03T12:54:58.488 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2021-01-03T12:54:58.489 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-dev libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 2021-01-03T12:54:58.489 INFO:teuthology.orchestra.run.smithi007.stdout: libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 2021-01-03T12:54:58.489 INFO:teuthology.orchestra.run.smithi007.stdout: libxslt1.1 nvme-cli python-attr python-funcsigs python-pastedeploy-tpl 2021-01-03T12:54:58.489 INFO:teuthology.orchestra.run.smithi007.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2021-01-03T12:54:58.490 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt python3-bs4 python3-ceph-argparse python3-ceph-common 2021-01-03T12:54:58.490 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs python3-cffi-backend python3-cherrypy3 python3-cmd2 2021-01-03T12:54:58.490 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama python3-cryptography python3-cycler python3-dateutil 2021-01-03T12:54:58.490 INFO:teuthology.orchestra.run.smithi007.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2021-01-03T12:54:58.491 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-01-03T12:54:58.491 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-01-03T12:54:58.491 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2021-01-03T12:54:58.491 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2021-01-03T12:54:58.491 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2021-01-03T12:54:58.491 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2021-01-03T12:54:58.492 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2021-01-03T12:54:58.492 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2021-01-03T12:54:58.492 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2021-01-03T12:54:58.492 INFO:teuthology.orchestra.run.smithi007.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-01-03T12:54:58.492 INFO:teuthology.orchestra.run.smithi007.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2021-01-03T12:54:58.493 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2021-01-03T12:54:58.493 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2021-01-03T12:54:58.493 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-01-03T12:54:58.494 INFO:teuthology.orchestra.run.smithi007.stdout:The following packages will be upgraded: 2021-01-03T12:54:58.494 INFO:teuthology.orchestra.run.smithi007.stdout: librados2 librbd1 2021-01-03T12:54:58.551 INFO:teuthology.orchestra.run.smithi133.stdout:2 upgraded, 115 newly installed, 0 to remove and 0 not upgraded. 2021-01-03T12:54:58.551 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 156 MB of archives. 2021-01-03T12:54:58.552 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 724 MB of additional disk space will be used. 2021-01-03T12:54:58.552 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.8-57-g2eacca1e-1bionic [1,637 kB] 2021-01-03T12:54:58.559 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2021-01-03T12:54:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-01-03T12:54:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-01-03T12:54:58.560 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-01-03T12:54:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2021-01-03T12:54:58.562 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-dev libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 2021-01-03T12:54:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 2021-01-03T12:54:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: libxslt1.1 nvme-cli python-attr python-funcsigs python-pastedeploy-tpl 2021-01-03T12:54:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2021-01-03T12:54:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt python3-bs4 python3-ceph-argparse python3-ceph-common 2021-01-03T12:54:58.563 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs python3-cffi-backend python3-cherrypy3 python3-cmd2 2021-01-03T12:54:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: python3-colorama python3-cryptography python3-cycler python3-dateutil 2021-01-03T12:54:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2021-01-03T12:54:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-01-03T12:54:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-01-03T12:54:58.564 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2021-01-03T12:54:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2021-01-03T12:54:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2021-01-03T12:54:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2021-01-03T12:54:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2021-01-03T12:54:58.565 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2021-01-03T12:54:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2021-01-03T12:54:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-01-03T12:54:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2021-01-03T12:54:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2021-01-03T12:54:58.566 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2021-01-03T12:54:58.567 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-01-03T12:54:58.567 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages will be upgraded: 2021-01-03T12:54:58.568 INFO:teuthology.orchestra.run.smithi016.stdout: librados2 librbd1 2021-01-03T12:54:58.576 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-01-03T12:54:58.585 INFO:teuthology.orchestra.run.smithi036.stdout:The following NEW packages will be installed: 2021-01-03T12:54:58.585 INFO:teuthology.orchestra.run.smithi036.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-01-03T12:54:58.585 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-01-03T12:54:58.585 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-01-03T12:54:58.586 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2021-01-03T12:54:58.587 INFO:teuthology.orchestra.run.smithi036.stdout: libcephfs-dev libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 2021-01-03T12:54:58.587 INFO:teuthology.orchestra.run.smithi036.stdout: libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 2021-01-03T12:54:58.587 INFO:teuthology.orchestra.run.smithi036.stdout: libxslt1.1 nvme-cli python-attr python-funcsigs python-pastedeploy-tpl 2021-01-03T12:54:58.587 INFO:teuthology.orchestra.run.smithi036.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2021-01-03T12:54:58.588 INFO:teuthology.orchestra.run.smithi036.stdout: python3-bcrypt python3-bs4 python3-ceph-argparse python3-ceph-common 2021-01-03T12:54:58.588 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cephfs python3-cffi-backend python3-cherrypy3 python3-cmd2 2021-01-03T12:54:58.588 INFO:teuthology.orchestra.run.smithi036.stdout: python3-colorama python3-cryptography python3-cycler python3-dateutil 2021-01-03T12:54:58.588 INFO:teuthology.orchestra.run.smithi036.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2021-01-03T12:54:58.588 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-01-03T12:54:58.588 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-01-03T12:54:58.589 INFO:teuthology.orchestra.run.smithi036.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2021-01-03T12:54:58.589 INFO:teuthology.orchestra.run.smithi036.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2021-01-03T12:54:58.589 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2021-01-03T12:54:58.589 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2021-01-03T12:54:58.589 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2021-01-03T12:54:58.590 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2021-01-03T12:54:58.590 INFO:teuthology.orchestra.run.smithi036.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2021-01-03T12:54:58.590 INFO:teuthology.orchestra.run.smithi036.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-01-03T12:54:58.590 INFO:teuthology.orchestra.run.smithi036.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2021-01-03T12:54:58.591 INFO:teuthology.orchestra.run.smithi036.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2021-01-03T12:54:58.591 INFO:teuthology.orchestra.run.smithi036.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2021-01-03T12:54:58.591 INFO:teuthology.orchestra.run.smithi036.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-01-03T12:54:58.591 INFO:teuthology.orchestra.run.smithi036.stdout:The following packages will be upgraded: 2021-01-03T12:54:58.592 INFO:teuthology.orchestra.run.smithi036.stdout: librados2 librbd1 2021-01-03T12:54:58.653 INFO:teuthology.orchestra.run.smithi007.stdout:2 upgraded, 115 newly installed, 0 to remove and 0 not upgraded. 2021-01-03T12:54:58.653 INFO:teuthology.orchestra.run.smithi007.stdout:Need to get 156 MB of archives. 2021-01-03T12:54:58.653 INFO:teuthology.orchestra.run.smithi007.stdout:After this operation, 724 MB of additional disk space will be used. 2021-01-03T12:54:58.653 INFO:teuthology.orchestra.run.smithi007.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.8-57-g2eacca1e-1bionic [1,637 kB] 2021-01-03T12:54:58.679 INFO:teuthology.orchestra.run.smithi007.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-01-03T12:54:58.728 INFO:teuthology.orchestra.run.smithi016.stdout:2 upgraded, 115 newly installed, 0 to remove and 0 not upgraded. 2021-01-03T12:54:58.729 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 156 MB of archives. 2021-01-03T12:54:58.729 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 724 MB of additional disk space will be used. 2021-01-03T12:54:58.729 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.8-57-g2eacca1e-1bionic [1,637 kB] 2021-01-03T12:54:58.738 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.8-57-g2eacca1e-1bionic [3,062 kB] 2021-01-03T12:54:58.752 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-01-03T12:54:58.754 INFO:teuthology.orchestra.run.smithi036.stdout:2 upgraded, 115 newly installed, 0 to remove and 0 not upgraded. 2021-01-03T12:54:58.754 INFO:teuthology.orchestra.run.smithi036.stdout:Need to get 156 MB of archives. 2021-01-03T12:54:58.755 INFO:teuthology.orchestra.run.smithi036.stdout:After this operation, 724 MB of additional disk space will be used. 2021-01-03T12:54:58.755 INFO:teuthology.orchestra.run.smithi036.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.8-57-g2eacca1e-1bionic [1,637 kB] 2021-01-03T12:54:58.776 INFO:teuthology.orchestra.run.smithi036.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2021-01-03T12:54:58.836 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2021-01-03T12:54:58.836 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2021-01-03T12:54:58.848 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2021-01-03T12:54:58.848 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-01-03T12:54:58.886 INFO:teuthology.orchestra.run.smithi007.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.8-57-g2eacca1e-1bionic [3,062 kB] 2021-01-03T12:54:58.921 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.8-57-g2eacca1e-1bionic [435 kB] 2021-01-03T12:54:58.943 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2021-01-03T12:54:58.950 INFO:teuthology.orchestra.run.smithi007.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2021-01-03T12:54:58.960 INFO:teuthology.orchestra.run.smithi007.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2021-01-03T12:54:58.961 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-01-03T12:54:58.962 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.8-57-g2eacca1e-1bionic [332 kB] 2021-01-03T12:54:58.972 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.8-57-g2eacca1e-1bionic [20.7 kB] 2021-01-03T12:54:58.973 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.8-57-g2eacca1e-1bionic [133 kB] 2021-01-03T12:54:58.997 INFO:teuthology.orchestra.run.smithi133.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2021-01-03T12:54:59.001 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2021-01-03T12:54:59.002 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2021-01-03T12:54:59.004 INFO:teuthology.orchestra.run.smithi133.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-01-03T12:54:59.004 INFO:teuthology.orchestra.run.smithi133.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.8-57-g2eacca1e-1bionic [27.9 kB] 2021-01-03T12:54:59.005 INFO:teuthology.orchestra.run.smithi133.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.8-57-g2eacca1e-1bionic [312 kB] 2021-01-03T12:54:59.013 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2021-01-03T12:54:59.015 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-01-03T12:54:59.016 INFO:teuthology.orchestra.run.smithi133.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2021-01-03T12:54:59.016 INFO:teuthology.orchestra.run.smithi133.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.8-57-g2eacca1e-1bionic [2,891 kB] 2021-01-03T12:54:59.024 INFO:teuthology.orchestra.run.smithi036.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2021-01-03T12:54:59.027 INFO:teuthology.orchestra.run.smithi036.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2021-01-03T12:54:59.037 INFO:teuthology.orchestra.run.smithi036.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2021-01-03T12:54:59.037 INFO:teuthology.orchestra.run.smithi036.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-01-03T12:54:59.107 INFO:teuthology.orchestra.run.smithi007.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2021-01-03T12:54:59.108 INFO:teuthology.orchestra.run.smithi133.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-01-03T12:54:59.110 INFO:teuthology.orchestra.run.smithi133.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-01-03T12:54:59.117 INFO:teuthology.orchestra.run.smithi007.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-01-03T12:54:59.131 INFO:teuthology.orchestra.run.smithi007.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2021-01-03T12:54:59.132 INFO:teuthology.orchestra.run.smithi133.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-01-03T12:54:59.143 INFO:teuthology.orchestra.run.smithi133.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2021-01-03T12:54:59.146 INFO:teuthology.orchestra.run.smithi007.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.8-57-g2eacca1e-1bionic [435 kB] 2021-01-03T12:54:59.151 INFO:teuthology.orchestra.run.smithi133.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2021-01-03T12:54:59.160 INFO:teuthology.orchestra.run.smithi007.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.8-57-g2eacca1e-1bionic [332 kB] 2021-01-03T12:54:59.161 INFO:teuthology.orchestra.run.smithi133.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2021-01-03T12:54:59.162 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2021-01-03T12:54:59.169 INFO:teuthology.orchestra.run.smithi133.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.4 [220 kB] 2021-01-03T12:54:59.182 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-01-03T12:54:59.183 INFO:teuthology.orchestra.run.smithi036.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2021-01-03T12:54:59.191 INFO:teuthology.orchestra.run.smithi036.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-01-03T12:54:59.194 INFO:teuthology.orchestra.run.smithi133.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2021-01-03T12:54:59.196 INFO:teuthology.orchestra.run.smithi133.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2021-01-03T12:54:59.203 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2021-01-03T12:54:59.205 INFO:teuthology.orchestra.run.smithi036.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2021-01-03T12:54:59.207 INFO:teuthology.orchestra.run.smithi007.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-01-03T12:54:59.207 INFO:teuthology.orchestra.run.smithi007.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.8-57-g2eacca1e-1bionic [20.7 kB] 2021-01-03T12:54:59.208 INFO:teuthology.orchestra.run.smithi007.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.8-57-g2eacca1e-1bionic [133 kB] 2021-01-03T12:54:59.209 INFO:teuthology.orchestra.run.smithi007.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-01-03T12:54:59.211 INFO:teuthology.orchestra.run.smithi007.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.8-57-g2eacca1e-1bionic [27.9 kB] 2021-01-03T12:54:59.212 INFO:teuthology.orchestra.run.smithi007.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.8-57-g2eacca1e-1bionic [312 kB] 2021-01-03T12:54:59.234 INFO:teuthology.orchestra.run.smithi007.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-01-03T12:54:59.235 INFO:teuthology.orchestra.run.smithi133.stdout:Get:27 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.8-57-g2eacca1e-1bionic [99.3 kB] 2021-01-03T12:54:59.235 INFO:teuthology.orchestra.run.smithi133.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2021-01-03T12:54:59.238 INFO:teuthology.orchestra.run.smithi133.stdout:Get:29 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.8-57-g2eacca1e-1bionic [337 kB] 2021-01-03T12:54:59.242 INFO:teuthology.orchestra.run.smithi007.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2021-01-03T12:54:59.244 INFO:teuthology.orchestra.run.smithi133.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2021-01-03T12:54:59.245 INFO:teuthology.orchestra.run.smithi133.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2021-01-03T12:54:59.246 INFO:teuthology.orchestra.run.smithi133.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2021-01-03T12:54:59.247 INFO:teuthology.orchestra.run.smithi133.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2021-01-03T12:54:59.248 INFO:teuthology.orchestra.run.smithi133.stdout:Get:34 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.8-57-g2eacca1e-1bionic [18.8 MB] 2021-01-03T12:54:59.250 INFO:teuthology.orchestra.run.smithi007.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2021-01-03T12:54:59.255 INFO:teuthology.orchestra.run.smithi007.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.8-57-g2eacca1e-1bionic [2,891 kB] 2021-01-03T12:54:59.261 INFO:teuthology.orchestra.run.smithi007.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2021-01-03T12:54:59.268 INFO:teuthology.orchestra.run.smithi007.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.4 [220 kB] 2021-01-03T12:54:59.275 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.8-57-g2eacca1e-1bionic [3,062 kB] 2021-01-03T12:54:59.277 INFO:teuthology.orchestra.run.smithi036.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-01-03T12:54:59.280 INFO:teuthology.orchestra.run.smithi036.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-01-03T12:54:59.284 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-01-03T12:54:59.287 INFO:teuthology.orchestra.run.smithi007.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2021-01-03T12:54:59.288 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-01-03T12:54:59.290 INFO:teuthology.orchestra.run.smithi007.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2021-01-03T12:54:59.305 INFO:teuthology.orchestra.run.smithi036.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-01-03T12:54:59.311 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-01-03T12:54:59.313 INFO:teuthology.orchestra.run.smithi036.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2021-01-03T12:54:59.313 INFO:teuthology.orchestra.run.smithi133.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2021-01-03T12:54:59.314 INFO:teuthology.orchestra.run.smithi133.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2021-01-03T12:54:59.314 INFO:teuthology.orchestra.run.smithi133.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-01-03T12:54:59.316 INFO:teuthology.orchestra.run.smithi133.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2021-01-03T12:54:59.318 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2021-01-03T12:54:59.320 INFO:teuthology.orchestra.run.smithi133.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2021-01-03T12:54:59.322 INFO:teuthology.orchestra.run.smithi036.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2021-01-03T12:54:59.326 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2021-01-03T12:54:59.331 INFO:teuthology.orchestra.run.smithi036.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2021-01-03T12:54:59.336 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2021-01-03T12:54:59.340 INFO:teuthology.orchestra.run.smithi036.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.4 [220 kB] 2021-01-03T12:54:59.342 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.4 [220 kB] 2021-01-03T12:54:59.349 INFO:teuthology.orchestra.run.smithi007.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2021-01-03T12:54:59.357 INFO:teuthology.orchestra.run.smithi036.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2021-01-03T12:54:59.358 INFO:teuthology.orchestra.run.smithi007.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2021-01-03T12:54:59.359 INFO:teuthology.orchestra.run.smithi007.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2021-01-03T12:54:59.360 INFO:teuthology.orchestra.run.smithi036.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2021-01-03T12:54:59.361 INFO:teuthology.orchestra.run.smithi007.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2021-01-03T12:54:59.362 INFO:teuthology.orchestra.run.smithi007.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2021-01-03T12:54:59.362 INFO:teuthology.orchestra.run.smithi007.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2021-01-03T12:54:59.363 INFO:teuthology.orchestra.run.smithi007.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2021-01-03T12:54:59.367 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2021-01-03T12:54:59.370 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2021-01-03T12:54:59.391 INFO:teuthology.orchestra.run.smithi133.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2021-01-03T12:54:59.392 INFO:teuthology.orchestra.run.smithi133.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-01-03T12:54:59.400 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2021-01-03T12:54:59.411 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2021-01-03T12:54:59.412 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2021-01-03T12:54:59.413 INFO:teuthology.orchestra.run.smithi133.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-01-03T12:54:59.414 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2021-01-03T12:54:59.414 INFO:teuthology.orchestra.run.smithi133.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2021-01-03T12:54:59.415 INFO:teuthology.orchestra.run.smithi133.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2021-01-03T12:54:59.420 INFO:teuthology.orchestra.run.smithi036.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2021-01-03T12:54:59.429 INFO:teuthology.orchestra.run.smithi036.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2021-01-03T12:54:59.429 INFO:teuthology.orchestra.run.smithi007.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-01-03T12:54:59.430 INFO:teuthology.orchestra.run.smithi036.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2021-01-03T12:54:59.431 INFO:teuthology.orchestra.run.smithi036.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2021-01-03T12:54:59.432 INFO:teuthology.orchestra.run.smithi036.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2021-01-03T12:54:59.432 INFO:teuthology.orchestra.run.smithi007.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2021-01-03T12:54:59.434 INFO:teuthology.orchestra.run.smithi036.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2021-01-03T12:54:59.435 INFO:teuthology.orchestra.run.smithi007.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2021-01-03T12:54:59.435 INFO:teuthology.orchestra.run.smithi036.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2021-01-03T12:54:59.470 INFO:teuthology.orchestra.run.smithi133.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2021-01-03T12:54:59.473 INFO:teuthology.orchestra.run.smithi133.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-01-03T12:54:59.476 INFO:teuthology.orchestra.run.smithi007.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.8-57-g2eacca1e-1bionic [99.3 kB] 2021-01-03T12:54:59.478 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2021-01-03T12:54:59.479 INFO:teuthology.orchestra.run.smithi007.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.8-57-g2eacca1e-1bionic [337 kB] 2021-01-03T12:54:59.481 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2021-01-03T12:54:59.481 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2021-01-03T12:54:59.482 INFO:teuthology.orchestra.run.smithi133.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2021-01-03T12:54:59.482 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-01-03T12:54:59.485 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2021-01-03T12:54:59.486 INFO:teuthology.orchestra.run.smithi133.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2021-01-03T12:54:59.487 INFO:teuthology.orchestra.run.smithi133.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2021-01-03T12:54:59.487 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2021-01-03T12:54:59.498 INFO:teuthology.orchestra.run.smithi036.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-01-03T12:54:59.501 INFO:teuthology.orchestra.run.smithi036.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2021-01-03T12:54:59.503 INFO:teuthology.orchestra.run.smithi036.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2021-01-03T12:54:59.509 INFO:teuthology.orchestra.run.smithi007.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2021-01-03T12:54:59.510 INFO:teuthology.orchestra.run.smithi007.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-01-03T12:54:59.529 INFO:teuthology.orchestra.run.smithi007.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-01-03T12:54:59.529 INFO:teuthology.orchestra.run.smithi007.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2021-01-03T12:54:59.530 INFO:teuthology.orchestra.run.smithi007.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2021-01-03T12:54:59.531 INFO:teuthology.orchestra.run.smithi007.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2021-01-03T12:54:59.535 INFO:teuthology.orchestra.run.smithi007.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-01-03T12:54:59.537 INFO:teuthology.orchestra.run.smithi007.stdout:Get:46 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.8-57-g2eacca1e-1bionic [18.8 MB] 2021-01-03T12:54:59.548 INFO:teuthology.orchestra.run.smithi133.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2021-01-03T12:54:59.556 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2021-01-03T12:54:59.557 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-01-03T12:54:59.576 INFO:teuthology.orchestra.run.smithi036.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2021-01-03T12:54:59.578 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-01-03T12:54:59.578 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2021-01-03T12:54:59.579 INFO:teuthology.orchestra.run.smithi036.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-01-03T12:54:59.588 INFO:teuthology.orchestra.run.smithi007.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2021-01-03T12:54:59.592 INFO:teuthology.orchestra.run.smithi007.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2021-01-03T12:54:59.593 INFO:teuthology.orchestra.run.smithi007.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2021-01-03T12:54:59.597 INFO:teuthology.orchestra.run.smithi036.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-01-03T12:54:59.599 INFO:teuthology.orchestra.run.smithi036.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2021-01-03T12:54:59.599 INFO:teuthology.orchestra.run.smithi036.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2021-01-03T12:54:59.600 INFO:teuthology.orchestra.run.smithi036.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2021-01-03T12:54:59.602 INFO:teuthology.orchestra.run.smithi036.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-01-03T12:54:59.634 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2021-01-03T12:54:59.636 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2021-01-03T12:54:59.639 INFO:teuthology.orchestra.run.smithi133.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2021-01-03T12:54:59.639 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-01-03T12:54:59.640 INFO:teuthology.orchestra.run.smithi133.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2021-01-03T12:54:59.643 INFO:teuthology.orchestra.run.smithi036.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.8-57-g2eacca1e-1bionic [3,062 kB] 2021-01-03T12:54:59.647 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2021-01-03T12:54:59.651 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2021-01-03T12:54:59.651 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2021-01-03T12:54:59.655 INFO:teuthology.orchestra.run.smithi036.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2021-01-03T12:54:59.659 INFO:teuthology.orchestra.run.smithi036.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2021-01-03T12:54:59.659 INFO:teuthology.orchestra.run.smithi036.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2021-01-03T12:54:59.668 INFO:teuthology.orchestra.run.smithi007.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2021-01-03T12:54:59.705 INFO:teuthology.orchestra.run.smithi007.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2021-01-03T12:54:59.705 INFO:teuthology.orchestra.run.smithi007.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2021-01-03T12:54:59.712 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2021-01-03T12:54:59.732 INFO:teuthology.orchestra.run.smithi036.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2021-01-03T12:54:59.766 INFO:teuthology.orchestra.run.smithi036.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2021-01-03T12:54:59.766 INFO:teuthology.orchestra.run.smithi036.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2021-01-03T12:54:59.798 INFO:teuthology.orchestra.run.smithi016.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2021-01-03T12:54:59.799 INFO:teuthology.orchestra.run.smithi016.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2021-01-03T12:54:59.910 INFO:teuthology.orchestra.run.smithi133.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2021-01-03T12:54:59.957 INFO:teuthology.orchestra.run.smithi133.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2021-01-03T12:54:59.958 INFO:teuthology.orchestra.run.smithi133.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2021-01-03T12:54:59.990 INFO:teuthology.orchestra.run.smithi133.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2021-01-03T12:54:59.990 INFO:teuthology.orchestra.run.smithi133.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2021-01-03T12:54:59.991 INFO:teuthology.orchestra.run.smithi133.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2021-01-03T12:54:59.991 INFO:teuthology.orchestra.run.smithi133.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2021-01-03T12:54:59.992 INFO:teuthology.orchestra.run.smithi133.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2021-01-03T12:54:59.993 INFO:teuthology.orchestra.run.smithi133.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2021-01-03T12:54:59.994 INFO:teuthology.orchestra.run.smithi133.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2021-01-03T12:55:00.024 INFO:teuthology.orchestra.run.smithi007.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2021-01-03T12:55:00.037 INFO:teuthology.orchestra.run.smithi007.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2021-01-03T12:55:00.038 INFO:teuthology.orchestra.run.smithi007.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2021-01-03T12:55:00.067 INFO:teuthology.orchestra.run.smithi133.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2021-01-03T12:55:00.069 INFO:teuthology.orchestra.run.smithi133.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2021-01-03T12:55:00.087 INFO:teuthology.orchestra.run.smithi016.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2021-01-03T12:55:00.095 INFO:teuthology.orchestra.run.smithi007.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2021-01-03T12:55:00.096 INFO:teuthology.orchestra.run.smithi007.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2021-01-03T12:55:00.096 INFO:teuthology.orchestra.run.smithi007.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2021-01-03T12:55:00.097 INFO:teuthology.orchestra.run.smithi007.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2021-01-03T12:55:00.098 INFO:teuthology.orchestra.run.smithi007.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2021-01-03T12:55:00.099 INFO:teuthology.orchestra.run.smithi007.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2021-01-03T12:55:00.105 INFO:teuthology.orchestra.run.smithi007.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2021-01-03T12:55:00.121 INFO:teuthology.orchestra.run.smithi016.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2021-01-03T12:55:00.122 INFO:teuthology.orchestra.run.smithi016.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2021-01-03T12:55:00.146 INFO:teuthology.orchestra.run.smithi133.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-01-03T12:55:00.147 INFO:teuthology.orchestra.run.smithi133.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-01-03T12:55:00.153 INFO:teuthology.orchestra.run.smithi133.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2021-01-03T12:55:00.153 INFO:teuthology.orchestra.run.smithi036.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2021-01-03T12:55:00.154 INFO:teuthology.orchestra.run.smithi133.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2021-01-03T12:55:00.154 INFO:teuthology.orchestra.run.smithi133.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-01-03T12:55:00.157 INFO:teuthology.orchestra.run.smithi133.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-01-03T12:55:00.159 INFO:teuthology.orchestra.run.smithi133.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-01-03T12:55:00.160 INFO:teuthology.orchestra.run.smithi133.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-01-03T12:55:00.163 INFO:teuthology.orchestra.run.smithi016.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2021-01-03T12:55:00.163 INFO:teuthology.orchestra.run.smithi016.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2021-01-03T12:55:00.164 INFO:teuthology.orchestra.run.smithi016.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2021-01-03T12:55:00.164 INFO:teuthology.orchestra.run.smithi016.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2021-01-03T12:55:00.165 INFO:teuthology.orchestra.run.smithi016.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2021-01-03T12:55:00.166 INFO:teuthology.orchestra.run.smithi016.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2021-01-03T12:55:00.166 INFO:teuthology.orchestra.run.smithi016.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2021-01-03T12:55:00.171 INFO:teuthology.orchestra.run.smithi016.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.8-57-g2eacca1e-1bionic [435 kB] 2021-01-03T12:55:00.180 INFO:teuthology.orchestra.run.smithi007.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2021-01-03T12:55:00.182 INFO:teuthology.orchestra.run.smithi007.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2021-01-03T12:55:00.190 INFO:teuthology.orchestra.run.smithi007.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-01-03T12:55:00.191 INFO:teuthology.orchestra.run.smithi007.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-01-03T12:55:00.195 INFO:teuthology.orchestra.run.smithi007.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2021-01-03T12:55:00.196 INFO:teuthology.orchestra.run.smithi007.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2021-01-03T12:55:00.196 INFO:teuthology.orchestra.run.smithi007.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-01-03T12:55:00.198 INFO:teuthology.orchestra.run.smithi007.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-01-03T12:55:00.198 INFO:teuthology.orchestra.run.smithi007.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-01-03T12:55:00.212 INFO:teuthology.orchestra.run.smithi036.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2021-01-03T12:55:00.214 INFO:teuthology.orchestra.run.smithi036.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2021-01-03T12:55:00.224 INFO:teuthology.orchestra.run.smithi133.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-01-03T12:55:00.229 INFO:teuthology.orchestra.run.smithi133.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-01-03T12:55:00.231 INFO:teuthology.orchestra.run.smithi036.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2021-01-03T12:55:00.232 INFO:teuthology.orchestra.run.smithi036.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2021-01-03T12:55:00.232 INFO:teuthology.orchestra.run.smithi036.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2021-01-03T12:55:00.233 INFO:teuthology.orchestra.run.smithi036.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2021-01-03T12:55:00.233 INFO:teuthology.orchestra.run.smithi036.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2021-01-03T12:55:00.233 INFO:teuthology.orchestra.run.smithi036.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2021-01-03T12:55:00.234 INFO:teuthology.orchestra.run.smithi036.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2021-01-03T12:55:00.244 INFO:teuthology.orchestra.run.smithi016.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2021-01-03T12:55:00.247 INFO:teuthology.orchestra.run.smithi016.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2021-01-03T12:55:00.254 INFO:teuthology.orchestra.run.smithi016.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-01-03T12:55:00.255 INFO:teuthology.orchestra.run.smithi016.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-01-03T12:55:00.257 INFO:teuthology.orchestra.run.smithi016.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2021-01-03T12:55:00.258 INFO:teuthology.orchestra.run.smithi016.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2021-01-03T12:55:00.258 INFO:teuthology.orchestra.run.smithi016.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-01-03T12:55:00.264 INFO:teuthology.orchestra.run.smithi007.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-01-03T12:55:00.278 INFO:teuthology.orchestra.run.smithi007.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-01-03T12:55:00.281 INFO:teuthology.orchestra.run.smithi007.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-01-03T12:55:00.286 INFO:teuthology.orchestra.run.smithi007.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2021-01-03T12:55:00.286 INFO:teuthology.orchestra.run.smithi007.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-01-03T12:55:00.289 INFO:teuthology.orchestra.run.smithi007.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-01-03T12:55:00.289 INFO:teuthology.orchestra.run.smithi007.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-01-03T12:55:00.290 INFO:teuthology.orchestra.run.smithi007.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-01-03T12:55:00.290 INFO:teuthology.orchestra.run.smithi007.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-01-03T12:55:00.302 INFO:teuthology.orchestra.run.smithi133.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2021-01-03T12:55:00.303 INFO:teuthology.orchestra.run.smithi133.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-01-03T12:55:00.304 INFO:teuthology.orchestra.run.smithi016.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.8-57-g2eacca1e-1bionic [332 kB] 2021-01-03T12:55:00.310 INFO:teuthology.orchestra.run.smithi133.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-01-03T12:55:00.310 INFO:teuthology.orchestra.run.smithi036.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2021-01-03T12:55:00.311 INFO:teuthology.orchestra.run.smithi133.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-01-03T12:55:00.311 INFO:teuthology.orchestra.run.smithi133.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-01-03T12:55:00.312 INFO:teuthology.orchestra.run.smithi133.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-01-03T12:55:00.312 INFO:teuthology.orchestra.run.smithi036.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2021-01-03T12:55:00.314 INFO:teuthology.orchestra.run.smithi133.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-01-03T12:55:00.316 INFO:teuthology.orchestra.run.smithi133.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2021-01-03T12:55:00.322 INFO:teuthology.orchestra.run.smithi016.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-01-03T12:55:00.326 INFO:teuthology.orchestra.run.smithi016.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-01-03T12:55:00.328 INFO:teuthology.orchestra.run.smithi016.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-01-03T12:55:00.344 INFO:teuthology.orchestra.run.smithi007.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-01-03T12:55:00.371 INFO:teuthology.orchestra.run.smithi007.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2021-01-03T12:55:00.372 INFO:teuthology.orchestra.run.smithi007.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2021-01-03T12:55:00.373 INFO:teuthology.orchestra.run.smithi007.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2021-01-03T12:55:00.374 INFO:teuthology.orchestra.run.smithi007.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2021-01-03T12:55:00.377 INFO:teuthology.orchestra.run.smithi007.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.3 [1,097 kB] 2021-01-03T12:55:00.380 INFO:teuthology.orchestra.run.smithi133.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2021-01-03T12:55:00.381 INFO:teuthology.orchestra.run.smithi133.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2021-01-03T12:55:00.388 INFO:teuthology.orchestra.run.smithi036.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-01-03T12:55:00.390 INFO:teuthology.orchestra.run.smithi036.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-01-03T12:55:00.395 INFO:teuthology.orchestra.run.smithi007.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2021-01-03T12:55:00.395 INFO:teuthology.orchestra.run.smithi007.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2021-01-03T12:55:00.401 INFO:teuthology.orchestra.run.smithi016.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-01-03T12:55:00.401 INFO:teuthology.orchestra.run.smithi036.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2021-01-03T12:55:00.402 INFO:teuthology.orchestra.run.smithi036.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2021-01-03T12:55:00.403 INFO:teuthology.orchestra.run.smithi036.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-01-03T12:55:00.405 INFO:teuthology.orchestra.run.smithi036.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-01-03T12:55:00.406 INFO:teuthology.orchestra.run.smithi036.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-01-03T12:55:00.406 INFO:teuthology.orchestra.run.smithi036.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-01-03T12:55:00.407 INFO:teuthology.orchestra.run.smithi016.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-01-03T12:55:00.416 INFO:teuthology.orchestra.run.smithi016.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2021-01-03T12:55:00.417 INFO:teuthology.orchestra.run.smithi016.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-01-03T12:55:00.419 INFO:teuthology.orchestra.run.smithi016.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-01-03T12:55:00.419 INFO:teuthology.orchestra.run.smithi016.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-01-03T12:55:00.420 INFO:teuthology.orchestra.run.smithi016.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-01-03T12:55:00.437 INFO:teuthology.orchestra.run.smithi016.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.8-57-g2eacca1e-1bionic [20.7 kB] 2021-01-03T12:55:00.439 INFO:teuthology.orchestra.run.smithi016.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.8-57-g2eacca1e-1bionic [133 kB] 2021-01-03T12:55:00.444 INFO:teuthology.orchestra.run.smithi016.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.8-57-g2eacca1e-1bionic [27.9 kB] 2021-01-03T12:55:00.445 INFO:teuthology.orchestra.run.smithi016.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.8-57-g2eacca1e-1bionic [312 kB] 2021-01-03T12:55:00.459 INFO:teuthology.orchestra.run.smithi133.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2021-01-03T12:55:00.461 INFO:teuthology.orchestra.run.smithi133.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.3 [1,097 kB] 2021-01-03T12:55:00.467 INFO:teuthology.orchestra.run.smithi036.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-01-03T12:55:00.472 INFO:teuthology.orchestra.run.smithi036.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-01-03T12:55:00.479 INFO:teuthology.orchestra.run.smithi016.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-01-03T12:55:00.480 INFO:teuthology.orchestra.run.smithi133.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2021-01-03T12:55:00.481 INFO:teuthology.orchestra.run.smithi133.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2021-01-03T12:55:00.485 INFO:teuthology.orchestra.run.smithi016.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-01-03T12:55:00.489 INFO:teuthology.orchestra.run.smithi016.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2021-01-03T12:55:00.508 INFO:teuthology.orchestra.run.smithi007.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2021-01-03T12:55:00.509 INFO:teuthology.orchestra.run.smithi007.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2021-01-03T12:55:00.510 INFO:teuthology.orchestra.run.smithi007.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.3 [330 kB] 2021-01-03T12:55:00.516 INFO:teuthology.orchestra.run.smithi007.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2021-01-03T12:55:00.516 INFO:teuthology.orchestra.run.smithi007.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2021-01-03T12:55:00.517 INFO:teuthology.orchestra.run.smithi007.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2021-01-03T12:55:00.517 INFO:teuthology.orchestra.run.smithi007.stdout:Get:95 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2021-01-03T12:55:00.519 INFO:teuthology.orchestra.run.smithi007.stdout:Get:96 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2021-01-03T12:55:00.519 INFO:teuthology.orchestra.run.smithi007.stdout:Get:97 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2021-01-03T12:55:00.540 INFO:teuthology.orchestra.run.smithi036.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.8-57-g2eacca1e-1bionic [435 kB] 2021-01-03T12:55:00.544 INFO:teuthology.orchestra.run.smithi036.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2021-01-03T12:55:00.545 INFO:teuthology.orchestra.run.smithi036.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-01-03T12:55:00.549 INFO:teuthology.orchestra.run.smithi036.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-01-03T12:55:00.550 INFO:teuthology.orchestra.run.smithi036.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-01-03T12:55:00.550 INFO:teuthology.orchestra.run.smithi036.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-01-03T12:55:00.551 INFO:teuthology.orchestra.run.smithi036.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-01-03T12:55:00.552 INFO:teuthology.orchestra.run.smithi036.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-01-03T12:55:00.556 INFO:teuthology.orchestra.run.smithi036.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2021-01-03T12:55:00.557 INFO:teuthology.orchestra.run.smithi016.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2021-01-03T12:55:00.557 INFO:teuthology.orchestra.run.smithi016.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2021-01-03T12:55:00.558 INFO:teuthology.orchestra.run.smithi016.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2021-01-03T12:55:00.561 INFO:teuthology.orchestra.run.smithi016.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.3 [1,097 kB] 2021-01-03T12:55:00.565 INFO:teuthology.orchestra.run.smithi133.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2021-01-03T12:55:00.581 INFO:teuthology.orchestra.run.smithi016.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2021-01-03T12:55:00.582 INFO:teuthology.orchestra.run.smithi016.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2021-01-03T12:55:00.582 INFO:teuthology.orchestra.run.smithi016.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.8-57-g2eacca1e-1bionic [2,891 kB] 2021-01-03T12:55:00.616 INFO:teuthology.orchestra.run.smithi133.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2021-01-03T12:55:00.618 INFO:teuthology.orchestra.run.smithi133.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.3 [330 kB] 2021-01-03T12:55:00.622 INFO:teuthology.orchestra.run.smithi036.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2021-01-03T12:55:00.623 INFO:teuthology.orchestra.run.smithi036.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2021-01-03T12:55:00.628 INFO:teuthology.orchestra.run.smithi133.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2021-01-03T12:55:00.628 INFO:teuthology.orchestra.run.smithi133.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2021-01-03T12:55:00.629 INFO:teuthology.orchestra.run.smithi133.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2021-01-03T12:55:00.629 INFO:teuthology.orchestra.run.smithi133.stdout:Get:95 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2021-01-03T12:55:00.631 INFO:teuthology.orchestra.run.smithi133.stdout:Get:96 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2021-01-03T12:55:00.631 INFO:teuthology.orchestra.run.smithi133.stdout:Get:97 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2021-01-03T12:55:00.678 INFO:teuthology.orchestra.run.smithi036.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.8-57-g2eacca1e-1bionic [332 kB] 2021-01-03T12:55:00.688 INFO:teuthology.orchestra.run.smithi016.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2021-01-03T12:55:00.689 INFO:teuthology.orchestra.run.smithi016.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2021-01-03T12:55:00.690 INFO:teuthology.orchestra.run.smithi016.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.3 [330 kB] 2021-01-03T12:55:00.696 INFO:teuthology.orchestra.run.smithi016.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2021-01-03T12:55:00.701 INFO:teuthology.orchestra.run.smithi036.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2021-01-03T12:55:00.701 INFO:teuthology.orchestra.run.smithi133.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.8-57-g2eacca1e-1bionic [5,170 kB] 2021-01-03T12:55:00.703 INFO:teuthology.orchestra.run.smithi036.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.3 [1,097 kB] 2021-01-03T12:55:00.713 INFO:teuthology.orchestra.run.smithi016.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2021-01-03T12:55:00.714 INFO:teuthology.orchestra.run.smithi016.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2021-01-03T12:55:00.715 INFO:teuthology.orchestra.run.smithi016.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2021-01-03T12:55:00.717 INFO:teuthology.orchestra.run.smithi016.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2021-01-03T12:55:00.718 INFO:teuthology.orchestra.run.smithi016.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2021-01-03T12:55:00.725 INFO:teuthology.orchestra.run.smithi036.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2021-01-03T12:55:00.725 INFO:teuthology.orchestra.run.smithi036.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2021-01-03T12:55:00.751 INFO:teuthology.orchestra.run.smithi036.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.8-57-g2eacca1e-1bionic [20.7 kB] 2021-01-03T12:55:00.752 INFO:teuthology.orchestra.run.smithi036.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.8-57-g2eacca1e-1bionic [133 kB] 2021-01-03T12:55:00.756 INFO:teuthology.orchestra.run.smithi036.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.8-57-g2eacca1e-1bionic [27.9 kB] 2021-01-03T12:55:00.757 INFO:teuthology.orchestra.run.smithi036.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.8-57-g2eacca1e-1bionic [312 kB] 2021-01-03T12:55:00.831 INFO:teuthology.orchestra.run.smithi036.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.8-57-g2eacca1e-1bionic [2,891 kB] 2021-01-03T12:55:00.862 INFO:teuthology.orchestra.run.smithi036.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2021-01-03T12:55:00.862 INFO:teuthology.orchestra.run.smithi036.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2021-01-03T12:55:00.864 INFO:teuthology.orchestra.run.smithi036.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.3 [330 kB] 2021-01-03T12:55:00.872 INFO:teuthology.orchestra.run.smithi036.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2021-01-03T12:55:00.872 INFO:teuthology.orchestra.run.smithi036.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2021-01-03T12:55:00.873 INFO:teuthology.orchestra.run.smithi036.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2021-01-03T12:55:00.873 INFO:teuthology.orchestra.run.smithi036.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2021-01-03T12:55:00.874 INFO:teuthology.orchestra.run.smithi036.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2021-01-03T12:55:00.875 INFO:teuthology.orchestra.run.smithi036.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2021-01-03T12:55:01.151 INFO:teuthology.orchestra.run.smithi133.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.8-57-g2eacca1e-1bionic [148 kB] 2021-01-03T12:55:01.158 INFO:teuthology.orchestra.run.smithi133.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.8-57-g2eacca1e-1bionic [1,284 kB] 2021-01-03T12:55:01.262 INFO:teuthology.orchestra.run.smithi007.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.8-57-g2eacca1e-1bionic [5,170 kB] 2021-01-03T12:55:01.285 INFO:teuthology.orchestra.run.smithi133.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.8-57-g2eacca1e-1bionic [5,942 kB] 2021-01-03T12:55:01.476 INFO:teuthology.orchestra.run.smithi036.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.8-57-g2eacca1e-1bionic [99.3 kB] 2021-01-03T12:55:01.477 INFO:teuthology.orchestra.run.smithi036.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.8-57-g2eacca1e-1bionic [337 kB] 2021-01-03T12:55:01.480 INFO:teuthology.orchestra.run.smithi036.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.8-57-g2eacca1e-1bionic [18.8 MB] 2021-01-03T12:55:01.506 INFO:teuthology.orchestra.run.smithi016.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.8-57-g2eacca1e-1bionic [99.3 kB] 2021-01-03T12:55:01.509 INFO:teuthology.orchestra.run.smithi016.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.8-57-g2eacca1e-1bionic [337 kB] 2021-01-03T12:55:01.582 INFO:teuthology.orchestra.run.smithi016.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.8-57-g2eacca1e-1bionic [18.8 MB] 2021-01-03T12:55:01.703 INFO:teuthology.orchestra.run.smithi007.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.8-57-g2eacca1e-1bionic [148 kB] 2021-01-03T12:55:01.706 INFO:teuthology.orchestra.run.smithi007.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.8-57-g2eacca1e-1bionic [1,284 kB] 2021-01-03T12:55:01.830 INFO:teuthology.orchestra.run.smithi133.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.8-57-g2eacca1e-1bionic [22.8 MB] 2021-01-03T12:55:01.836 INFO:teuthology.orchestra.run.smithi007.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.8-57-g2eacca1e-1bionic [5,942 kB] 2021-01-03T12:55:02.299 INFO:teuthology.orchestra.run.smithi007.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.8-57-g2eacca1e-1bionic [22.8 MB] 2021-01-03T12:55:04.208 INFO:teuthology.orchestra.run.smithi133.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.8-57-g2eacca1e-1bionic [3,912 B] 2021-01-03T12:55:04.209 INFO:teuthology.orchestra.run.smithi133.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.8-57-g2eacca1e-1bionic [515 kB] 2021-01-03T12:55:04.235 INFO:teuthology.orchestra.run.smithi133.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.8-57-g2eacca1e-1bionic [1,854 kB] 2021-01-03T12:55:04.262 INFO:teuthology.orchestra.run.smithi007.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.8-57-g2eacca1e-1bionic [3,912 B] 2021-01-03T12:55:04.263 INFO:teuthology.orchestra.run.smithi007.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.8-57-g2eacca1e-1bionic [515 kB] 2021-01-03T12:55:04.326 INFO:teuthology.orchestra.run.smithi007.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.8-57-g2eacca1e-1bionic [1,854 kB] 2021-01-03T12:55:04.425 INFO:teuthology.orchestra.run.smithi133.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.8-57-g2eacca1e-1bionic [51.8 kB] 2021-01-03T12:55:04.427 INFO:teuthology.orchestra.run.smithi133.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.8-57-g2eacca1e-1bionic [56.6 kB] 2021-01-03T12:55:04.429 INFO:teuthology.orchestra.run.smithi133.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.8-57-g2eacca1e-1bionic [3,177 kB] 2021-01-03T12:55:04.542 INFO:teuthology.orchestra.run.smithi007.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.8-57-g2eacca1e-1bionic [51.8 kB] 2021-01-03T12:55:04.544 INFO:teuthology.orchestra.run.smithi007.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.8-57-g2eacca1e-1bionic [56.6 kB] 2021-01-03T12:55:04.546 INFO:teuthology.orchestra.run.smithi007.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.8-57-g2eacca1e-1bionic [3,177 kB] 2021-01-03T12:55:04.724 INFO:teuthology.orchestra.run.smithi133.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.8-57-g2eacca1e-1bionic [34.2 kB] 2021-01-03T12:55:04.726 INFO:teuthology.orchestra.run.smithi133.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.8-57-g2eacca1e-1bionic [7,883 kB] 2021-01-03T12:55:04.826 INFO:teuthology.orchestra.run.smithi036.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.8-57-g2eacca1e-1bionic [5,170 kB] 2021-01-03T12:55:04.906 INFO:teuthology.orchestra.run.smithi007.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.8-57-g2eacca1e-1bionic [34.2 kB] 2021-01-03T12:55:04.907 INFO:teuthology.orchestra.run.smithi007.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.8-57-g2eacca1e-1bionic [7,883 kB] 2021-01-03T12:55:05.477 INFO:teuthology.orchestra.run.smithi133.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.8-57-g2eacca1e-1bionic [4,028 B] 2021-01-03T12:55:05.477 INFO:teuthology.orchestra.run.smithi133.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.8-57-g2eacca1e-1bionic [22.4 kB] 2021-01-03T12:55:05.478 INFO:teuthology.orchestra.run.smithi133.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.8-57-g2eacca1e-1bionic [44.0 MB] 2021-01-03T12:55:05.646 INFO:teuthology.orchestra.run.smithi036.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.8-57-g2eacca1e-1bionic [148 kB] 2021-01-03T12:55:05.651 INFO:teuthology.orchestra.run.smithi036.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.8-57-g2eacca1e-1bionic [1,284 kB] 2021-01-03T12:55:05.686 INFO:teuthology.orchestra.run.smithi007.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.8-57-g2eacca1e-1bionic [4,028 B] 2021-01-03T12:55:05.686 INFO:teuthology.orchestra.run.smithi007.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.8-57-g2eacca1e-1bionic [22.4 kB] 2021-01-03T12:55:05.686 INFO:teuthology.orchestra.run.smithi007.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.8-57-g2eacca1e-1bionic [44.0 MB] 2021-01-03T12:55:05.874 INFO:teuthology.orchestra.run.smithi036.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.8-57-g2eacca1e-1bionic [5,942 kB] 2021-01-03T12:55:06.697 INFO:teuthology.orchestra.run.smithi016.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.8-57-g2eacca1e-1bionic [5,170 kB] 2021-01-03T12:55:06.812 INFO:teuthology.orchestra.run.smithi036.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.8-57-g2eacca1e-1bionic [22.8 MB] 2021-01-03T12:55:08.053 INFO:teuthology.orchestra.run.smithi016.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.8-57-g2eacca1e-1bionic [148 kB] 2021-01-03T12:55:08.120 INFO:teuthology.orchestra.run.smithi016.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.8-57-g2eacca1e-1bionic [1,284 kB] 2021-01-03T12:55:08.448 INFO:teuthology.orchestra.run.smithi016.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.8-57-g2eacca1e-1bionic [5,942 kB] 2021-01-03T12:55:09.708 INFO:teuthology.orchestra.run.smithi133.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 15.2.8-57-g2eacca1e-1bionic [15.8 kB] 2021-01-03T12:55:09.709 INFO:teuthology.orchestra.run.smithi133.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.8-57-g2eacca1e-1bionic [18.0 kB] 2021-01-03T12:55:09.709 INFO:teuthology.orchestra.run.smithi133.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.8-57-g2eacca1e-1bionic [8,844 kB] 2021-01-03T12:55:09.938 INFO:teuthology.orchestra.run.smithi016.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.8-57-g2eacca1e-1bionic [22.8 MB] 2021-01-03T12:55:10.051 INFO:teuthology.orchestra.run.smithi007.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 15.2.8-57-g2eacca1e-1bionic [15.8 kB] 2021-01-03T12:55:10.051 INFO:teuthology.orchestra.run.smithi007.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.8-57-g2eacca1e-1bionic [18.0 kB] 2021-01-03T12:55:10.052 INFO:teuthology.orchestra.run.smithi007.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.8-57-g2eacca1e-1bionic [8,844 kB] 2021-01-03T12:55:10.591 INFO:teuthology.orchestra.run.smithi133.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.8-57-g2eacca1e-1bionic [63.1 kB] 2021-01-03T12:55:10.592 INFO:teuthology.orchestra.run.smithi036.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.8-57-g2eacca1e-1bionic [3,912 B] 2021-01-03T12:55:10.593 INFO:teuthology.orchestra.run.smithi036.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.8-57-g2eacca1e-1bionic [515 kB] 2021-01-03T12:55:10.599 INFO:teuthology.orchestra.run.smithi036.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.8-57-g2eacca1e-1bionic [1,854 kB] 2021-01-03T12:55:10.813 INFO:teuthology.orchestra.run.smithi007.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.8-57-g2eacca1e-1bionic [63.1 kB] 2021-01-03T12:55:10.827 INFO:teuthology.orchestra.run.smithi036.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.8-57-g2eacca1e-1bionic [51.8 kB] 2021-01-03T12:55:10.829 INFO:teuthology.orchestra.run.smithi036.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.8-57-g2eacca1e-1bionic [56.6 kB] 2021-01-03T12:55:10.831 INFO:teuthology.orchestra.run.smithi036.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.8-57-g2eacca1e-1bionic [3,177 kB] 2021-01-03T12:55:11.049 INFO:teuthology.orchestra.run.smithi036.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.8-57-g2eacca1e-1bionic [34.2 kB] 2021-01-03T12:55:11.050 INFO:teuthology.orchestra.run.smithi036.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.8-57-g2eacca1e-1bionic [7,883 kB] 2021-01-03T12:55:11.307 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 156 MB in 12s (12.8 MB/s) 2021-01-03T12:55:11.453 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyparsing. 2021-01-03T12:55:11.491 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102079 files and directories currently installed.) 2021-01-03T12:55:11.494 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../000-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-01-03T12:55:11.532 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 156 MB in 12s (12.7 MB/s) 2021-01-03T12:55:11.535 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-01-03T12:55:11.570 INFO:teuthology.orchestra.run.smithi036.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.8-57-g2eacca1e-1bionic [4,028 B] 2021-01-03T12:55:11.571 INFO:teuthology.orchestra.run.smithi036.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.8-57-g2eacca1e-1bionic [22.4 kB] 2021-01-03T12:55:11.571 INFO:teuthology.orchestra.run.smithi036.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.8-57-g2eacca1e-1bionic [44.0 MB] 2021-01-03T12:55:11.651 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyparsing. 2021-01-03T12:55:11.692 INFO:teuthology.orchestra.run.smithi007.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102079 files and directories currently installed.) 2021-01-03T12:55:11.695 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../000-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-01-03T12:55:11.725 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-01-03T12:55:11.788 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyperclip. 2021-01-03T12:55:11.799 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../001-python3-pyperclip_1.6.0-1_all.deb ... 2021-01-03T12:55:11.829 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2021-01-03T12:55:12.001 INFO:teuthology.orchestra.run.smithi016.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.8-57-g2eacca1e-1bionic [3,912 B] 2021-01-03T12:55:12.002 INFO:teuthology.orchestra.run.smithi016.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.8-57-g2eacca1e-1bionic [515 kB] 2021-01-03T12:55:12.030 INFO:teuthology.orchestra.run.smithi016.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.8-57-g2eacca1e-1bionic [1,854 kB] 2021-01-03T12:55:12.052 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyperclip. 2021-01-03T12:55:12.065 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../001-python3-pyperclip_1.6.0-1_all.deb ... 2021-01-03T12:55:12.103 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2021-01-03T12:55:12.115 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cmd2. 2021-01-03T12:55:12.127 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../002-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2021-01-03T12:55:12.146 INFO:teuthology.orchestra.run.smithi016.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.8-57-g2eacca1e-1bionic [51.8 kB] 2021-01-03T12:55:12.148 INFO:teuthology.orchestra.run.smithi016.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.8-57-g2eacca1e-1bionic [56.6 kB] 2021-01-03T12:55:12.161 INFO:teuthology.orchestra.run.smithi016.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.8-57-g2eacca1e-1bionic [3,177 kB] 2021-01-03T12:55:12.165 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2021-01-03T12:55:12.354 INFO:teuthology.orchestra.run.smithi016.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.8-57-g2eacca1e-1bionic [34.2 kB] 2021-01-03T12:55:12.366 INFO:teuthology.orchestra.run.smithi016.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.8-57-g2eacca1e-1bionic [7,883 kB] 2021-01-03T12:55:12.405 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cmd2. 2021-01-03T12:55:12.418 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../002-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2021-01-03T12:55:12.455 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2021-01-03T12:55:12.467 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-uritemplate. 2021-01-03T12:55:12.479 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../003-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2021-01-03T12:55:12.526 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2021-01-03T12:55:12.741 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-uritemplate. 2021-01-03T12:55:12.752 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../003-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2021-01-03T12:55:12.783 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2021-01-03T12:55:12.820 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-01-03T12:55:12.831 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-01-03T12:55:12.850 INFO:teuthology.orchestra.run.smithi016.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.8-57-g2eacca1e-1bionic [4,028 B] 2021-01-03T12:55:12.851 INFO:teuthology.orchestra.run.smithi016.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.8-57-g2eacca1e-1bionic [22.4 kB] 2021-01-03T12:55:12.862 INFO:teuthology.orchestra.run.smithi016.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.8-57-g2eacca1e-1bionic [44.0 MB] 2021-01-03T12:55:12.896 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-01-03T12:55:13.111 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-01-03T12:55:13.123 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-01-03T12:55:13.176 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../005-librbd1_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:13.211 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-01-03T12:55:13.299 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librbd1 (15.2.8-57-g2eacca1e-1bionic) over (12.2.13-0ubuntu0.18.04.5) ... 2021-01-03T12:55:13.561 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../005-librbd1_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:13.682 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librbd1 (15.2.8-57-g2eacca1e-1bionic) over (12.2.13-0ubuntu0.18.04.5) ... 2021-01-03T12:55:13.840 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../006-librados2_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:13.962 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librados2 (15.2.8-57-g2eacca1e-1bionic) over (12.2.13-0ubuntu0.18.04.5) ... 2021-01-03T12:55:14.189 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../006-librados2_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:14.286 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librados2 (15.2.8-57-g2eacca1e-1bionic) over (12.2.13-0ubuntu0.18.04.5) ... 2021-01-03T12:55:14.540 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libcephfs2. 2021-01-03T12:55:14.553 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../007-libcephfs2_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:14.582 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libcephfs2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:14.730 INFO:teuthology.orchestra.run.smithi036.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 15.2.8-57-g2eacca1e-1bionic [15.8 kB] 2021-01-03T12:55:14.731 INFO:teuthology.orchestra.run.smithi036.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.8-57-g2eacca1e-1bionic [18.0 kB] 2021-01-03T12:55:14.731 INFO:teuthology.orchestra.run.smithi036.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.8-57-g2eacca1e-1bionic [8,844 kB] 2021-01-03T12:55:14.918 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rados. 2021-01-03T12:55:14.929 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../008-python3-rados_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:14.932 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libcephfs2. 2021-01-03T12:55:14.943 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../007-libcephfs2_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:14.976 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rados (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:14.982 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libcephfs2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:15.284 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rados. 2021-01-03T12:55:15.295 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../008-python3-rados_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:15.320 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-01-03T12:55:15.332 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../009-python3-ceph-argparse_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:15.334 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rados (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:15.370 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-ceph-argparse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:15.371 INFO:teuthology.orchestra.run.smithi016.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 15.2.8-57-g2eacca1e-1bionic [15.8 kB] 2021-01-03T12:55:15.372 INFO:teuthology.orchestra.run.smithi016.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.8-57-g2eacca1e-1bionic [18.0 kB] 2021-01-03T12:55:15.372 INFO:teuthology.orchestra.run.smithi016.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.8-57-g2eacca1e-1bionic [8,844 kB] 2021-01-03T12:55:15.487 INFO:teuthology.orchestra.run.smithi036.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.8-57-g2eacca1e-1bionic [63.1 kB] 2021-01-03T12:55:15.631 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cephfs. 2021-01-03T12:55:15.640 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../010-python3-cephfs_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:15.654 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-01-03T12:55:15.666 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../009-python3-ceph-argparse_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:15.673 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cephfs (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:15.696 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-ceph-argparse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:15.705 INFO:teuthology.orchestra.run.smithi016.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/octopus/2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.8-57-g2eacca1e-1bionic [63.1 kB] 2021-01-03T12:55:15.959 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-ceph-common. 2021-01-03T12:55:15.971 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../011-python3-ceph-common_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:16.009 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-ceph-common (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:16.015 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cephfs. 2021-01-03T12:55:16.027 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../010-python3-cephfs_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:16.065 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cephfs (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:16.220 INFO:teuthology.orchestra.run.smithi036.stdout:Fetched 156 MB in 17s (9,245 kB/s) 2021-01-03T12:55:16.320 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-prettytable. 2021-01-03T12:55:16.332 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-3_all.deb ... 2021-01-03T12:55:16.340 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pyparsing. 2021-01-03T12:55:16.370 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2021-01-03T12:55:16.376 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-ceph-common. 2021-01-03T12:55:16.379 INFO:teuthology.orchestra.run.smithi036.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102079 files and directories currently installed.) 2021-01-03T12:55:16.382 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../000-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-01-03T12:55:16.389 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../011-python3-ceph-common_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:16.414 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-01-03T12:55:16.434 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 156 MB in 17s (9,115 kB/s) 2021-01-03T12:55:16.443 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-ceph-common (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:16.557 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyparsing. 2021-01-03T12:55:16.597 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102079 files and directories currently installed.) 2021-01-03T12:55:16.600 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../000-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2021-01-03T12:55:16.614 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rbd. 2021-01-03T12:55:16.625 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../013-python3-rbd_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:16.630 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2021-01-03T12:55:16.664 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rbd (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:16.721 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-prettytable. 2021-01-03T12:55:16.725 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pyperclip. 2021-01-03T12:55:16.732 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-3_all.deb ... 2021-01-03T12:55:16.736 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../001-python3-pyperclip_1.6.0-1_all.deb ... 2021-01-03T12:55:16.763 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2021-01-03T12:55:16.775 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2021-01-03T12:55:16.941 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyperclip. 2021-01-03T12:55:16.954 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../001-python3-pyperclip_1.6.0-1_all.deb ... 2021-01-03T12:55:16.991 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2021-01-03T12:55:16.992 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-01-03T12:55:17.004 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-01-03T12:55:17.033 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-01-03T12:55:17.052 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-cmd2. 2021-01-03T12:55:17.065 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../002-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2021-01-03T12:55:17.102 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2021-01-03T12:55:17.115 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rbd. 2021-01-03T12:55:17.127 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../013-python3-rbd_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:17.165 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rbd (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:17.285 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cmd2. 2021-01-03T12:55:17.298 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../002-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2021-01-03T12:55:17.335 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2021-01-03T12:55:17.353 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-01-03T12:55:17.365 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2021-01-03T12:55:17.388 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-uritemplate. 2021-01-03T12:55:17.400 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../003-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2021-01-03T12:55:17.403 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2021-01-03T12:55:17.438 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2021-01-03T12:55:17.560 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-01-03T12:55:17.571 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-01-03T12:55:17.610 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-01-03T12:55:17.638 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-uritemplate. 2021-01-03T12:55:17.652 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../003-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2021-01-03T12:55:17.688 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2021-01-03T12:55:17.739 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librgw2. 2021-01-03T12:55:17.750 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-01-03T12:55:17.751 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../016-librgw2_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:17.760 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-01-03T12:55:17.841 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-01-03T12:55:17.888 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-01-03T12:55:17.897 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librgw2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:17.900 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2021-01-03T12:55:17.938 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2021-01-03T12:55:17.949 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-01-03T12:55:17.961 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-01-03T12:55:18.025 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-01-03T12:55:18.148 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../005-librbd1_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:18.270 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking librbd1 (15.2.8-57-g2eacca1e-1bionic) over (12.2.13-0ubuntu0.18.04.5) ... 2021-01-03T12:55:18.282 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librgw2. 2021-01-03T12:55:18.295 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../016-librgw2_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:18.324 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librgw2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:18.356 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../005-librbd1_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:18.433 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rgw. 2021-01-03T12:55:18.443 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../017-python3-rgw_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:18.478 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librbd1 (15.2.8-57-g2eacca1e-1bionic) over (12.2.13-0ubuntu0.18.04.5) ... 2021-01-03T12:55:18.483 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rgw (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:18.744 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-01-03T12:55:18.756 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-01-03T12:55:18.785 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-01-03T12:55:18.801 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../006-librados2_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:18.860 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rgw. 2021-01-03T12:55:18.871 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../017-python3-rgw_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:18.910 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rgw (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:18.932 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking librados2 (15.2.8-57-g2eacca1e-1bionic) over (12.2.13-0ubuntu0.18.04.5) ... 2021-01-03T12:55:19.019 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../006-librados2_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:19.080 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-01-03T12:55:19.091 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2021-01-03T12:55:19.124 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librados2 (15.2.8-57-g2eacca1e-1bionic) over (12.2.13-0ubuntu0.18.04.5) ... 2021-01-03T12:55:19.129 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-01-03T12:55:19.238 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-01-03T12:55:19.249 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-01-03T12:55:19.288 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-01-03T12:55:19.507 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liboath0. 2021-01-03T12:55:19.520 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2021-01-03T12:55:19.528 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libcephfs2. 2021-01-03T12:55:19.540 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../007-libcephfs2_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:19.557 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-01-03T12:55:19.574 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-01-03T12:55:19.577 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libcephfs2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:19.586 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2021-01-03T12:55:19.632 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-01-03T12:55:19.745 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs2. 2021-01-03T12:55:19.757 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../007-libcephfs2_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:19.795 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:19.835 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libradosstriper1. 2021-01-03T12:55:19.847 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../021-libradosstriper1_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:19.855 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-rados. 2021-01-03T12:55:19.867 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../008-python3-rados_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:19.877 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libradosstriper1 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:19.905 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-rados (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:20.036 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package liboath0. 2021-01-03T12:55:20.046 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2021-01-03T12:55:20.085 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-01-03T12:55:20.097 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rados. 2021-01-03T12:55:20.110 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../008-python3-rados_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:20.147 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rados (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:20.232 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-01-03T12:55:20.245 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../009-python3-ceph-argparse_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:20.282 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-ceph-argparse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:20.297 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-common. 2021-01-03T12:55:20.308 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../022-ceph-common_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:20.346 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-common (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:20.388 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libradosstriper1. 2021-01-03T12:55:20.400 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../021-libradosstriper1_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:20.438 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libradosstriper1 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:20.450 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-01-03T12:55:20.461 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../009-python3-ceph-argparse_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:20.500 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-argparse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:20.535 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-cephfs. 2021-01-03T12:55:20.548 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../010-python3-cephfs_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:20.577 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-cephfs (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:20.744 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cephfs. 2021-01-03T12:55:20.757 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../010-python3-cephfs_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:20.794 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cephfs (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:20.825 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-common. 2021-01-03T12:55:20.836 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../022-ceph-common_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:20.866 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-common (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:21.013 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-ceph-common. 2021-01-03T12:55:21.024 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../011-python3-ceph-common_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:21.062 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-ceph-common (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:21.114 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-common. 2021-01-03T12:55:21.125 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../011-python3-ceph-common_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:21.164 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-common (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:21.382 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-prettytable. 2021-01-03T12:55:21.393 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-3_all.deb ... 2021-01-03T12:55:21.432 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2021-01-03T12:55:21.475 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-prettytable. 2021-01-03T12:55:21.486 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-3_all.deb ... 2021-01-03T12:55:21.525 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2021-01-03T12:55:21.701 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-rbd. 2021-01-03T12:55:21.714 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../013-python3-rbd_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:21.751 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-rbd (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:21.794 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rbd. 2021-01-03T12:55:21.807 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../013-python3-rbd_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:21.844 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rbd (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:22.071 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-base. 2021-01-03T12:55:22.079 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-01-03T12:55:22.083 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../023-ceph-base_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:22.091 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-01-03T12:55:22.121 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-01-03T12:55:22.129 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-base (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:22.189 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-01-03T12:55:22.201 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-01-03T12:55:22.239 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-01-03T12:55:22.448 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-01-03T12:55:22.460 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2021-01-03T12:55:22.499 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2021-01-03T12:55:22.575 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-01-03T12:55:22.586 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2021-01-03T12:55:22.625 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2021-01-03T12:55:22.656 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-base. 2021-01-03T12:55:22.668 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../023-ceph-base_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:22.732 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-base (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:22.826 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package librgw2. 2021-01-03T12:55:22.839 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../016-librgw2_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:22.876 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking librgw2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:22.953 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librgw2. 2021-01-03T12:55:22.965 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../016-librgw2_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:23.003 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librgw2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:23.008 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-dateutil. 2021-01-03T12:55:23.020 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../024-python3-dateutil_2.6.1-1_all.deb ... 2021-01-03T12:55:23.059 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2021-01-03T12:55:23.328 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-asn1crypto. 2021-01-03T12:55:23.340 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../025-python3-asn1crypto_0.24.0-1_all.deb ... 2021-01-03T12:55:23.378 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-rgw. 2021-01-03T12:55:23.386 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2021-01-03T12:55:23.389 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../017-python3-rgw_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:23.428 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-rgw (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:23.530 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rgw. 2021-01-03T12:55:23.543 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../017-python3-rgw_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:23.580 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rgw (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:23.614 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cffi-backend. 2021-01-03T12:55:23.626 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../026-python3-cffi-backend_1.11.5-1_amd64.deb ... 2021-01-03T12:55:23.672 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2021-01-03T12:55:23.739 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-01-03T12:55:23.752 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-01-03T12:55:23.789 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-01-03T12:55:23.928 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-dateutil. 2021-01-03T12:55:23.940 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../024-python3-dateutil_2.6.1-1_all.deb ... 2021-01-03T12:55:23.968 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cryptography. 2021-01-03T12:55:23.977 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../027-python3-cryptography_2.1.4-1ubuntu1.4_amd64.deb ... 2021-01-03T12:55:23.978 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2021-01-03T12:55:24.008 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-01-03T12:55:24.016 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-01-03T12:55:24.020 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-01-03T12:55:24.058 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-01-03T12:55:24.092 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-01-03T12:55:24.103 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2021-01-03T12:55:24.142 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-01-03T12:55:24.280 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-asn1crypto. 2021-01-03T12:55:24.294 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../025-python3-asn1crypto_0.24.0-1_all.deb ... 2021-01-03T12:55:24.331 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2021-01-03T12:55:24.352 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-01-03T12:55:24.365 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2021-01-03T12:55:24.395 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-openssl. 2021-01-03T12:55:24.402 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-01-03T12:55:24.407 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../028-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2021-01-03T12:55:24.445 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2021-01-03T12:55:24.470 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package liboath0. 2021-01-03T12:55:24.481 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2021-01-03T12:55:24.520 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-01-03T12:55:24.608 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cffi-backend. 2021-01-03T12:55:24.621 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../026-python3-cffi-backend_1.11.5-1_amd64.deb ... 2021-01-03T12:55:24.650 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2021-01-03T12:55:24.706 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-01-03T12:55:24.714 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liboath0. 2021-01-03T12:55:24.718 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../029-ceph-mgr-modules-core_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:24.725 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2021-01-03T12:55:24.756 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-01-03T12:55:24.756 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-modules-core (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:24.772 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libradosstriper1. 2021-01-03T12:55:24.785 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../021-libradosstriper1_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:24.814 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libradosstriper1 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:24.988 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cryptography. 2021-01-03T12:55:25.000 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../027-python3-cryptography_2.1.4-1ubuntu1.4_amd64.deb ... 2021-01-03T12:55:25.038 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-01-03T12:55:25.075 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libradosstriper1. 2021-01-03T12:55:25.085 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-bcrypt. 2021-01-03T12:55:25.088 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../021-libradosstriper1_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:25.097 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../030-python3-bcrypt_3.1.4-2_amd64.deb ... 2021-01-03T12:55:25.125 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libradosstriper1 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:25.134 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2021-01-03T12:55:25.284 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-common. 2021-01-03T12:55:25.296 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../022-ceph-common_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:25.334 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-common (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:25.421 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cherrypy3. 2021-01-03T12:55:25.431 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../031-python3-cherrypy3_8.9.1-2_all.deb ... 2021-01-03T12:55:25.433 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-openssl. 2021-01-03T12:55:25.444 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../028-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2021-01-03T12:55:25.471 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2021-01-03T12:55:25.483 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2021-01-03T12:55:25.570 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-common. 2021-01-03T12:55:25.582 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../022-ceph-common_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:25.619 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-common (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:25.752 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-01-03T12:55:25.764 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../029-ceph-mgr-modules-core_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:25.802 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-modules-core (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:25.815 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jwt. 2021-01-03T12:55:25.827 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../032-python3-jwt_1.5.3+ds1-1_all.deb ... 2021-01-03T12:55:25.865 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2021-01-03T12:55:26.165 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-bcrypt. 2021-01-03T12:55:26.176 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../030-python3-bcrypt_3.1.4-2_amd64.deb ... 2021-01-03T12:55:26.177 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-logutils. 2021-01-03T12:55:26.188 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-5_all.deb ... 2021-01-03T12:55:26.215 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2021-01-03T12:55:26.227 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-logutils (0.3.3-5) ... 2021-01-03T12:55:26.488 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-markupsafe. 2021-01-03T12:55:26.499 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../034-python3-markupsafe_1.0-1build1_amd64.deb ... 2021-01-03T12:55:26.526 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cherrypy3. 2021-01-03T12:55:26.529 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2021-01-03T12:55:26.539 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../031-python3-cherrypy3_8.9.1-2_all.deb ... 2021-01-03T12:55:26.575 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2021-01-03T12:55:26.832 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-mako. 2021-01-03T12:55:26.845 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../035-python3-mako_1.0.7+ds1-1_all.deb ... 2021-01-03T12:55:26.870 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jwt. 2021-01-03T12:55:26.882 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2021-01-03T12:55:26.884 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../032-python3-jwt_1.5.3+ds1-1_all.deb ... 2021-01-03T12:55:26.933 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2021-01-03T12:55:27.056 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-base. 2021-01-03T12:55:27.067 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../023-ceph-base_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:27.106 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-base (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:27.194 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-simplegeneric. 2021-01-03T12:55:27.205 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-1_all.deb ... 2021-01-03T12:55:27.224 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-logutils. 2021-01-03T12:55:27.237 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-5_all.deb ... 2021-01-03T12:55:27.243 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2021-01-03T12:55:27.274 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-logutils (0.3.3-5) ... 2021-01-03T12:55:27.392 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-base. 2021-01-03T12:55:27.405 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../023-ceph-base_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:27.452 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-base (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:27.538 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-singledispatch. 2021-01-03T12:55:27.549 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2_all.deb ... 2021-01-03T12:55:27.589 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2021-01-03T12:55:27.601 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-markupsafe. 2021-01-03T12:55:27.612 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../034-python3-markupsafe_1.0-1build1_amd64.deb ... 2021-01-03T12:55:27.651 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2021-01-03T12:55:27.841 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webob. 2021-01-03T12:55:27.852 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../038-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-01-03T12:55:27.883 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2021-01-03T12:55:27.912 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-mako. 2021-01-03T12:55:27.923 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../035-python3-mako_1.0.7+ds1-1_all.deb ... 2021-01-03T12:55:27.969 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-dateutil. 2021-01-03T12:55:27.979 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2021-01-03T12:55:27.980 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../024-python3-dateutil_2.6.1-1_all.deb ... 2021-01-03T12:55:28.019 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2021-01-03T12:55:28.257 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-simplegeneric. 2021-01-03T12:55:28.267 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-1_all.deb ... 2021-01-03T12:55:28.297 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-dateutil. 2021-01-03T12:55:28.310 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../024-python3-dateutil_2.6.1-1_all.deb ... 2021-01-03T12:55:28.338 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-asn1crypto. 2021-01-03T12:55:28.347 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2021-01-03T12:55:28.349 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../025-python3-asn1crypto_0.24.0-1_all.deb ... 2021-01-03T12:55:28.388 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2021-01-03T12:55:28.633 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-asn1crypto. 2021-01-03T12:55:28.645 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../025-python3-asn1crypto_0.24.0-1_all.deb ... 2021-01-03T12:55:28.685 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2021-01-03T12:55:28.910 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-bs4. 2021-01-03T12:55:28.923 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../039-python3-bs4_4.6.0-1_all.deb ... 2021-01-03T12:55:28.960 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2021-01-03T12:55:29.007 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2021-01-03T12:55:29.271 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-waitress. 2021-01-03T12:55:29.283 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../040-python3-waitress_1.0.1-1_all.deb ... 2021-01-03T12:55:29.309 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-singledispatch. 2021-01-03T12:55:29.321 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2_all.deb ... 2021-01-03T12:55:29.321 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-waitress (1.0.1-1) ... 2021-01-03T12:55:29.359 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2021-01-03T12:55:29.508 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-cffi-backend. 2021-01-03T12:55:29.520 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../026-python3-cffi-backend_1.11.5-1_amd64.deb ... 2021-01-03T12:55:29.557 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2021-01-03T12:55:29.641 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-tempita. 2021-01-03T12:55:29.653 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-2_all.deb ... 2021-01-03T12:55:29.671 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-webob. 2021-01-03T12:55:29.683 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../038-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-01-03T12:55:29.691 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-tempita (0.5.2-2) ... 2021-01-03T12:55:29.721 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2021-01-03T12:55:29.786 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cffi-backend. 2021-01-03T12:55:29.797 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../026-python3-cffi-backend_1.11.5-1_amd64.deb ... 2021-01-03T12:55:29.820 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-cryptography. 2021-01-03T12:55:29.827 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2021-01-03T12:55:29.831 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../027-python3-cryptography_2.1.4-1ubuntu1.4_amd64.deb ... 2021-01-03T12:55:29.860 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-01-03T12:55:29.994 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-paste. 2021-01-03T12:55:30.005 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../042-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-01-03T12:55:30.031 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-bs4. 2021-01-03T12:55:30.043 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-01-03T12:55:30.045 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../039-python3-bs4_4.6.0-1_all.deb ... 2021-01-03T12:55:30.130 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cryptography. 2021-01-03T12:55:30.131 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2021-01-03T12:55:30.142 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../027-python3-cryptography_2.1.4-1ubuntu1.4_amd64.deb ... 2021-01-03T12:55:30.163 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-openssl. 2021-01-03T12:55:30.176 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../028-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2021-01-03T12:55:30.180 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-01-03T12:55:30.205 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2021-01-03T12:55:30.355 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-01-03T12:55:30.368 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-01-03T12:55:30.413 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-01-03T12:55:30.459 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-waitress. 2021-01-03T12:55:30.473 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../040-python3-waitress_1.0.1-1_all.deb ... 2021-01-03T12:55:30.474 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-01-03T12:55:30.487 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../029-ceph-mgr-modules-core_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:30.509 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-waitress (1.0.1-1) ... 2021-01-03T12:55:30.533 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-modules-core (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:30.533 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-openssl. 2021-01-03T12:55:30.547 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../028-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2021-01-03T12:55:30.584 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2021-01-03T12:55:30.691 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pastedeploy. 2021-01-03T12:55:30.702 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../044-python3-pastedeploy_1.5.2-4_all.deb ... 2021-01-03T12:55:30.733 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2021-01-03T12:55:30.811 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-bcrypt. 2021-01-03T12:55:30.824 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../030-python3-bcrypt_3.1.4-2_amd64.deb ... 2021-01-03T12:55:30.829 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-tempita. 2021-01-03T12:55:30.841 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-2_all.deb ... 2021-01-03T12:55:30.844 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-01-03T12:55:30.857 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../029-ceph-mgr-modules-core_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:30.861 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2021-01-03T12:55:30.871 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-tempita (0.5.2-2) ... 2021-01-03T12:55:30.894 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-modules-core (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:30.977 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webtest. 2021-01-03T12:55:30.988 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../045-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2021-01-03T12:55:31.027 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2021-01-03T12:55:31.157 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-paste. 2021-01-03T12:55:31.164 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-cherrypy3. 2021-01-03T12:55:31.168 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../042-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-01-03T12:55:31.176 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../031-python3-cherrypy3_8.9.1-2_all.deb ... 2021-01-03T12:55:31.206 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-01-03T12:55:31.214 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2021-01-03T12:55:31.249 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-bcrypt. 2021-01-03T12:55:31.261 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../030-python3-bcrypt_3.1.4-2_amd64.deb ... 2021-01-03T12:55:31.307 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2021-01-03T12:55:31.363 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pecan. 2021-01-03T12:55:31.375 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../046-python3-pecan_1.2.1-2_all.deb ... 2021-01-03T12:55:31.413 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pecan (1.2.1-2) ... 2021-01-03T12:55:31.501 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-01-03T12:55:31.513 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-01-03T12:55:31.534 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-jwt. 2021-01-03T12:55:31.546 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../032-python3-jwt_1.5.3+ds1-1_all.deb ... 2021-01-03T12:55:31.551 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-01-03T12:55:31.584 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2021-01-03T12:55:31.735 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cherrypy3. 2021-01-03T12:55:31.747 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../031-python3-cherrypy3_8.9.1-2_all.deb ... 2021-01-03T12:55:31.776 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-werkzeug. 2021-01-03T12:55:31.785 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2021-01-03T12:55:31.787 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../047-python3-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-01-03T12:55:31.826 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-01-03T12:55:31.846 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pastedeploy. 2021-01-03T12:55:31.857 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../044-python3-pastedeploy_1.5.2-4_all.deb ... 2021-01-03T12:55:31.886 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-logutils. 2021-01-03T12:55:31.895 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2021-01-03T12:55:31.898 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-5_all.deb ... 2021-01-03T12:55:31.936 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-logutils (0.3.3-5) ... 2021-01-03T12:55:32.113 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jwt. 2021-01-03T12:55:32.125 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../032-python3-jwt_1.5.3+ds1-1_all.deb ... 2021-01-03T12:55:32.163 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2021-01-03T12:55:32.196 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr. 2021-01-03T12:55:32.208 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../048-ceph-mgr_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:32.223 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-webtest. 2021-01-03T12:55:32.236 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../045-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2021-01-03T12:55:32.239 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-markupsafe. 2021-01-03T12:55:32.246 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:32.252 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../034-python3-markupsafe_1.0-1build1_amd64.deb ... 2021-01-03T12:55:32.273 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2021-01-03T12:55:32.289 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2021-01-03T12:55:32.466 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-logutils. 2021-01-03T12:55:32.477 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-5_all.deb ... 2021-01-03T12:55:32.532 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-logutils (0.3.3-5) ... 2021-01-03T12:55:32.542 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-mako. 2021-01-03T12:55:32.554 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../035-python3-mako_1.0.7+ds1-1_all.deb ... 2021-01-03T12:55:32.584 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2021-01-03T12:55:32.593 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pecan. 2021-01-03T12:55:32.606 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../046-python3-pecan_1.2.1-2_all.deb ... 2021-01-03T12:55:32.668 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pecan (1.2.1-2) ... 2021-01-03T12:55:32.699 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mon. 2021-01-03T12:55:32.710 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../049-ceph-mon_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:32.749 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mon (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:32.777 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-markupsafe. 2021-01-03T12:55:32.788 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../034-python3-markupsafe_1.0-1build1_amd64.deb ... 2021-01-03T12:55:32.819 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2021-01-03T12:55:32.878 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-simplegeneric. 2021-01-03T12:55:32.890 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-1_all.deb ... 2021-01-03T12:55:32.928 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2021-01-03T12:55:33.014 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-werkzeug. 2021-01-03T12:55:33.025 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../047-python3-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-01-03T12:55:33.064 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-01-03T12:55:33.138 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-mako. 2021-01-03T12:55:33.150 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../035-python3-mako_1.0.7+ds1-1_all.deb ... 2021-01-03T12:55:33.196 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2021-01-03T12:55:33.247 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-singledispatch. 2021-01-03T12:55:33.259 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2_all.deb ... 2021-01-03T12:55:33.297 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2021-01-03T12:55:33.450 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr. 2021-01-03T12:55:33.463 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../048-ceph-mgr_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:33.500 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:33.508 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplegeneric. 2021-01-03T12:55:33.520 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-1_all.deb ... 2021-01-03T12:55:33.558 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2021-01-03T12:55:33.594 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-osd. 2021-01-03T12:55:33.600 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-webob. 2021-01-03T12:55:33.605 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../050-ceph-osd_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:33.610 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../038-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-01-03T12:55:33.635 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-osd (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:33.650 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2021-01-03T12:55:33.860 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-singledispatch. 2021-01-03T12:55:33.873 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2_all.deb ... 2021-01-03T12:55:33.910 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2021-01-03T12:55:33.920 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mon. 2021-01-03T12:55:33.932 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../049-ceph-mon_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:33.970 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mon (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:34.155 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webob. 2021-01-03T12:55:34.161 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-bs4. 2021-01-03T12:55:34.165 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../038-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-01-03T12:55:34.173 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../039-python3-bs4_4.6.0-1_all.deb ... 2021-01-03T12:55:34.205 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2021-01-03T12:55:34.211 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2021-01-03T12:55:34.466 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-bs4. 2021-01-03T12:55:34.479 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../039-python3-bs4_4.6.0-1_all.deb ... 2021-01-03T12:55:34.488 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-waitress. 2021-01-03T12:55:34.499 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../040-python3-waitress_1.0.1-1_all.deb ... 2021-01-03T12:55:34.530 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-waitress (1.0.1-1) ... 2021-01-03T12:55:34.541 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2021-01-03T12:55:34.816 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-tempita. 2021-01-03T12:55:34.827 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-2_all.deb ... 2021-01-03T12:55:34.858 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-tempita (0.5.2-2) ... 2021-01-03T12:55:34.860 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-waitress. 2021-01-03T12:55:34.873 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../040-python3-waitress_1.0.1-1_all.deb ... 2021-01-03T12:55:34.882 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-osd. 2021-01-03T12:55:34.894 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../050-ceph-osd_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:34.910 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-waitress (1.0.1-1) ... 2021-01-03T12:55:34.931 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-osd (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:35.152 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-paste. 2021-01-03T12:55:35.164 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../042-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-01-03T12:55:35.202 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-01-03T12:55:35.238 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tempita. 2021-01-03T12:55:35.250 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-2_all.deb ... 2021-01-03T12:55:35.297 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tempita (0.5.2-2) ... 2021-01-03T12:55:35.449 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph. 2021-01-03T12:55:35.459 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../051-ceph_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:35.472 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-01-03T12:55:35.482 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-01-03T12:55:35.499 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:35.513 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-01-03T12:55:35.575 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-paste. 2021-01-03T12:55:35.586 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../042-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-01-03T12:55:35.625 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-01-03T12:55:35.760 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-fuse. 2021-01-03T12:55:35.772 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../052-ceph-fuse_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:35.801 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-fuse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:35.816 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pastedeploy. 2021-01-03T12:55:35.828 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../044-python3-pastedeploy_1.5.2-4_all.deb ... 2021-01-03T12:55:35.866 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2021-01-03T12:55:35.919 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-01-03T12:55:35.931 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-01-03T12:55:35.969 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-01-03T12:55:36.144 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-webtest. 2021-01-03T12:55:36.154 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mds. 2021-01-03T12:55:36.155 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../045-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2021-01-03T12:55:36.167 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../053-ceph-mds_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:36.195 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2021-01-03T12:55:36.205 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mds (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:36.272 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastedeploy. 2021-01-03T12:55:36.283 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../044-python3-pastedeploy_1.5.2-4_all.deb ... 2021-01-03T12:55:36.322 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2021-01-03T12:55:36.513 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pecan. 2021-01-03T12:55:36.526 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../046-python3-pecan_1.2.1-2_all.deb ... 2021-01-03T12:55:36.563 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pecan (1.2.1-2) ... 2021-01-03T12:55:36.575 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webtest. 2021-01-03T12:55:36.586 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../045-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2021-01-03T12:55:36.617 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2021-01-03T12:55:36.657 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephadm. 2021-01-03T12:55:36.670 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../054-cephadm_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:36.707 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephadm (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:36.870 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph. 2021-01-03T12:55:36.883 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../051-ceph_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:36.912 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:36.926 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-werkzeug. 2021-01-03T12:55:36.938 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../047-python3-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-01-03T12:55:36.953 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pecan. 2021-01-03T12:55:36.965 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../046-python3-pecan_1.2.1-2_all.deb ... 2021-01-03T12:55:36.976 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-01-03T12:55:36.976 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jinja2. 2021-01-03T12:55:36.989 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../055-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2021-01-03T12:55:37.003 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pecan (1.2.1-2) ... 2021-01-03T12:55:37.018 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-01-03T12:55:37.189 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-fuse. 2021-01-03T12:55:37.201 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../052-ceph-fuse_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:37.239 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-fuse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:37.271 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-01-03T12:55:37.279 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr. 2021-01-03T12:55:37.282 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:37.291 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../048-ceph-mgr_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:37.307 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-werkzeug. 2021-01-03T12:55:37.313 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-cephadm (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:37.320 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:37.321 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../047-python3-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-01-03T12:55:37.358 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-01-03T12:55:37.607 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-repoze.lru. 2021-01-03T12:55:37.620 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../057-python3-repoze.lru_0.7-1_all.deb ... 2021-01-03T12:55:37.642 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mds. 2021-01-03T12:55:37.652 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr. 2021-01-03T12:55:37.655 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../053-ceph-mds_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:37.657 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2021-01-03T12:55:37.665 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../048-ceph-mgr_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:37.692 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mds (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:37.702 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:37.882 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mon. 2021-01-03T12:55:37.895 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../049-ceph-mon_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:37.932 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mon (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:37.960 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-routes. 2021-01-03T12:55:37.973 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../058-python3-routes_2.4.1-1_all.deb ... 2021-01-03T12:55:38.010 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-routes (2.4.1-1) ... 2021-01-03T12:55:38.104 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package cephadm. 2021-01-03T12:55:38.117 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../054-cephadm_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:38.130 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mon. 2021-01-03T12:55:38.144 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../049-ceph-mon_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:38.145 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking cephadm (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:38.180 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mon (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:38.321 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-01-03T12:55:38.333 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:38.371 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-dashboard (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:38.464 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jinja2. 2021-01-03T12:55:38.476 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../055-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2021-01-03T12:55:38.514 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-01-03T12:55:38.792 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-01-03T12:55:38.793 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-osd. 2021-01-03T12:55:38.804 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:38.806 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../050-ceph-osd_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:38.834 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-cephadm (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:38.843 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-osd (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:39.100 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-osd. 2021-01-03T12:55:39.113 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../050-ceph-osd_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:39.129 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-repoze.lru. 2021-01-03T12:55:39.141 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../057-python3-repoze.lru_0.7-1_all.deb ... 2021-01-03T12:55:39.150 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-osd (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:39.179 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2021-01-03T12:55:39.236 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-01-03T12:55:39.250 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:39.295 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:39.498 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-routes. 2021-01-03T12:55:39.509 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../058-python3-routes_2.4.1-1_all.deb ... 2021-01-03T12:55:39.549 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-routes (2.4.1-1) ... 2021-01-03T12:55:39.598 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-numpy. 2021-01-03T12:55:39.609 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../061-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2021-01-03T12:55:39.648 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2021-01-03T12:55:39.859 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-01-03T12:55:39.871 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:39.934 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-dashboard (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:40.203 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-decorator. 2021-01-03T12:55:40.216 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../062-python3-decorator_4.1.2-1_all.deb ... 2021-01-03T12:55:40.245 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-decorator (4.1.2-1) ... 2021-01-03T12:55:40.523 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-scipy. 2021-01-03T12:55:40.536 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../063-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-01-03T12:55:40.573 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2021-01-03T12:55:40.783 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph. 2021-01-03T12:55:40.794 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../051-ceph_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:40.831 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:40.833 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-01-03T12:55:40.845 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:40.912 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:41.089 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph. 2021-01-03T12:55:41.102 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../051-ceph_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:41.147 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:41.151 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-fuse. 2021-01-03T12:55:41.162 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../052-ceph-fuse_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:41.201 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-fuse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:41.219 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-numpy. 2021-01-03T12:55:41.230 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../061-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2021-01-03T12:55:41.269 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2021-01-03T12:55:41.442 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-fuse. 2021-01-03T12:55:41.454 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../052-ceph-fuse_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:41.483 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-fuse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:41.646 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mds. 2021-01-03T12:55:41.657 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../053-ceph-mds_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:41.695 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mds (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:41.747 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-01-03T12:55:41.761 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2021-01-03T12:55:41.805 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2021-01-03T12:55:41.819 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mds. 2021-01-03T12:55:41.833 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../053-ceph-mds_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:41.841 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-decorator. 2021-01-03T12:55:41.853 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../062-python3-decorator_4.1.2-1_all.deb ... 2021-01-03T12:55:41.869 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mds (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:41.883 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-decorator (4.1.2-1) ... 2021-01-03T12:55:42.148 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package cephadm. 2021-01-03T12:55:42.161 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../054-cephadm_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:42.185 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-scipy. 2021-01-03T12:55:42.198 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking cephadm (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:42.199 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../063-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-01-03T12:55:42.225 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-joblib. 2021-01-03T12:55:42.235 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2021-01-03T12:55:42.237 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../065-python3-joblib_0.11-1_all.deb ... 2021-01-03T12:55:42.275 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-joblib (0.11-1) ... 2021-01-03T12:55:42.364 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephadm. 2021-01-03T12:55:42.377 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../054-cephadm_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:42.414 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephadm (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:42.526 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-jinja2. 2021-01-03T12:55:42.538 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../055-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2021-01-03T12:55:42.579 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-01-03T12:55:42.637 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-sklearn. 2021-01-03T12:55:42.648 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../066-python3-sklearn_0.19.1-3_all.deb ... 2021-01-03T12:55:42.687 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2021-01-03T12:55:42.717 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jinja2. 2021-01-03T12:55:42.729 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../055-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2021-01-03T12:55:42.759 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-01-03T12:55:42.895 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-01-03T12:55:42.906 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:42.945 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-cephadm (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:43.036 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-01-03T12:55:43.050 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:43.078 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-cephadm (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:43.186 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-01-03T12:55:43.196 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:43.235 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:43.250 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-repoze.lru. 2021-01-03T12:55:43.261 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../057-python3-repoze.lru_0.7-1_all.deb ... 2021-01-03T12:55:43.298 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2021-01-03T12:55:43.340 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-repoze.lru. 2021-01-03T12:55:43.352 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../057-python3-repoze.lru_0.7-1_all.deb ... 2021-01-03T12:55:43.389 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2021-01-03T12:55:43.485 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-01-03T12:55:43.499 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2021-01-03T12:55:43.535 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2021-01-03T12:55:43.601 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-routes. 2021-01-03T12:55:43.613 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../058-python3-routes_2.4.1-1_all.deb ... 2021-01-03T12:55:43.651 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-routes (2.4.1-1) ... 2021-01-03T12:55:43.692 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-routes. 2021-01-03T12:55:43.705 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../058-python3-routes_2.4.1-1_all.deb ... 2021-01-03T12:55:43.742 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-routes (2.4.1-1) ... 2021-01-03T12:55:43.929 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-01-03T12:55:43.941 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:43.970 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-dashboard (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:43.980 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-joblib. 2021-01-03T12:55:43.992 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../065-python3-joblib_0.11-1_all.deb ... 2021-01-03T12:55:44.022 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-joblib (0.11-1) ... 2021-01-03T12:55:44.187 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-01-03T12:55:44.198 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:44.237 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-dashboard (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:44.346 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-monotonic. 2021-01-03T12:55:44.359 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../068-python3-monotonic_1.1-2_all.deb ... 2021-01-03T12:55:44.397 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-monotonic (1.1-2) ... 2021-01-03T12:55:44.417 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-sklearn. 2021-01-03T12:55:44.428 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../066-python3-sklearn_0.19.1-3_all.deb ... 2021-01-03T12:55:44.467 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2021-01-03T12:55:44.699 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-fasteners. 2021-01-03T12:55:44.712 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../069-python3-fasteners_0.12.0-3_all.deb ... 2021-01-03T12:55:44.749 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2021-01-03T12:55:44.860 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-01-03T12:55:44.875 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:44.943 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:44.998 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-01-03T12:55:45.011 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:45.018 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-httplib2. 2021-01-03T12:55:45.031 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../070-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2021-01-03T12:55:45.048 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:45.060 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-01-03T12:55:45.144 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-01-03T12:55:45.159 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:45.194 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:45.247 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-numpy. 2021-01-03T12:55:45.259 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../061-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2021-01-03T12:55:45.296 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2021-01-03T12:55:45.372 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyasn1. 2021-01-03T12:55:45.384 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3_all.deb ... 2021-01-03T12:55:45.421 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2021-01-03T12:55:45.455 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-numpy. 2021-01-03T12:55:45.467 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../061-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2021-01-03T12:55:45.497 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2021-01-03T12:55:45.724 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-01-03T12:55:45.738 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-01-03T12:55:45.774 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2021-01-03T12:55:45.869 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-decorator. 2021-01-03T12:55:45.882 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../062-python3-decorator_4.1.2-1_all.deb ... 2021-01-03T12:55:45.910 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-decorator (4.1.2-1) ... 2021-01-03T12:55:46.085 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rsa. 2021-01-03T12:55:46.098 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../073-python3-rsa_3.4.2-1_all.deb ... 2021-01-03T12:55:46.120 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-decorator. 2021-01-03T12:55:46.133 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../062-python3-decorator_4.1.2-1_all.deb ... 2021-01-03T12:55:46.135 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rsa (3.4.2-1) ... 2021-01-03T12:55:46.169 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-decorator (4.1.2-1) ... 2021-01-03T12:55:46.179 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-scipy. 2021-01-03T12:55:46.191 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../063-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-01-03T12:55:46.221 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2021-01-03T12:55:46.226 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-monotonic. 2021-01-03T12:55:46.237 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../068-python3-monotonic_1.1-2_all.deb ... 2021-01-03T12:55:46.309 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-monotonic (1.1-2) ... 2021-01-03T12:55:46.422 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-scipy. 2021-01-03T12:55:46.436 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../063-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-01-03T12:55:46.447 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-sqlalchemy. 2021-01-03T12:55:46.460 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../074-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-01-03T12:55:46.463 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2021-01-03T12:55:46.489 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-01-03T12:55:46.595 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-fasteners. 2021-01-03T12:55:46.609 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../069-python3-fasteners_0.12.0-3_all.deb ... 2021-01-03T12:55:46.653 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2021-01-03T12:55:46.918 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-oauth2client. 2021-01-03T12:55:46.929 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../075-python3-oauth2client_4.1.2-3_all.deb ... 2021-01-03T12:55:46.968 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2021-01-03T12:55:46.990 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-httplib2. 2021-01-03T12:55:47.003 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../070-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2021-01-03T12:55:47.040 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-01-03T12:55:47.271 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-setuptools. 2021-01-03T12:55:47.281 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../076-python3-setuptools_39.0.1-2_all.deb ... 2021-01-03T12:55:47.321 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2021-01-03T12:55:47.329 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-01-03T12:55:47.334 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyasn1. 2021-01-03T12:55:47.342 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2021-01-03T12:55:47.347 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3_all.deb ... 2021-01-03T12:55:47.376 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2021-01-03T12:55:47.379 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2021-01-03T12:55:47.622 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-01-03T12:55:47.634 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2021-01-03T12:55:47.654 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-01-03T12:55:47.667 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-01-03T12:55:47.672 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2021-01-03T12:55:47.699 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-websocket. 2021-01-03T12:55:47.712 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../077-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2021-01-03T12:55:47.712 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2021-01-03T12:55:47.766 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2021-01-03T12:55:47.832 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-joblib. 2021-01-03T12:55:47.843 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../065-python3-joblib_0.11-1_all.deb ... 2021-01-03T12:55:47.882 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-joblib (0.11-1) ... 2021-01-03T12:55:48.032 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rsa. 2021-01-03T12:55:48.043 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../073-python3-rsa_3.4.2-1_all.deb ... 2021-01-03T12:55:48.060 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-kubernetes. 2021-01-03T12:55:48.073 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rsa (3.4.2-1) ... 2021-01-03T12:55:48.074 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../078-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-01-03T12:55:48.117 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-joblib. 2021-01-03T12:55:48.119 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2021-01-03T12:55:48.128 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../065-python3-joblib_0.11-1_all.deb ... 2021-01-03T12:55:48.167 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-joblib (0.11-1) ... 2021-01-03T12:55:48.252 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-sklearn. 2021-01-03T12:55:48.264 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../066-python3-sklearn_0.19.1-3_all.deb ... 2021-01-03T12:55:48.302 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2021-01-03T12:55:48.427 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-sqlalchemy. 2021-01-03T12:55:48.439 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../074-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-01-03T12:55:48.477 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-01-03T12:55:48.520 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn. 2021-01-03T12:55:48.531 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../066-python3-sklearn_0.19.1-3_all.deb ... 2021-01-03T12:55:48.570 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2021-01-03T12:55:48.722 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-01-03T12:55:48.736 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../079-ceph-mgr-k8sevents_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:48.781 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-k8sevents (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:48.858 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-01-03T12:55:48.870 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:48.908 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:48.931 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-oauth2client. 2021-01-03T12:55:48.944 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../075-python3-oauth2client_4.1.2-3_all.deb ... 2021-01-03T12:55:48.981 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2021-01-03T12:55:49.100 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-json-pointer. 2021-01-03T12:55:49.113 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../080-python3-json-pointer_1.10-1_all.deb ... 2021-01-03T12:55:49.168 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-01-03T12:55:49.181 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:49.218 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:49.227 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-json-pointer (1.10-1) ... 2021-01-03T12:55:49.300 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-setuptools. 2021-01-03T12:55:49.312 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../076-python3-setuptools_39.0.1-2_all.deb ... 2021-01-03T12:55:49.375 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2021-01-03T12:55:49.556 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jsonpatch. 2021-01-03T12:55:49.568 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../081-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2021-01-03T12:55:49.608 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-01-03T12:55:49.770 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-websocket. 2021-01-03T12:55:49.783 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../077-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2021-01-03T12:55:49.820 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2021-01-03T12:55:49.909 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-01-03T12:55:49.921 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../082-ceph-mgr-rook_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:49.958 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-rook (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:49.994 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-monotonic. 2021-01-03T12:55:50.007 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../068-python3-monotonic_1.1-2_all.deb ... 2021-01-03T12:55:50.037 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-monotonic (1.1-2) ... 2021-01-03T12:55:50.165 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-kubernetes. 2021-01-03T12:55:50.178 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../078-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-01-03T12:55:50.215 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2021-01-03T12:55:50.297 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-monotonic. 2021-01-03T12:55:50.303 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libonig4:amd64. 2021-01-03T12:55:50.308 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../068-python3-monotonic_1.1-2_all.deb ... 2021-01-03T12:55:50.313 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-fasteners. 2021-01-03T12:55:50.315 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../083-libonig4_6.7.0-1_amd64.deb ... 2021-01-03T12:55:50.325 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../069-python3-fasteners_0.12.0-3_all.deb ... 2021-01-03T12:55:50.346 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-monotonic (1.1-2) ... 2021-01-03T12:55:50.353 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-01-03T12:55:50.363 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2021-01-03T12:55:50.639 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjq1:amd64. 2021-01-03T12:55:50.653 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../084-libjq1_1.5+dfsg-2_amd64.deb ... 2021-01-03T12:55:50.658 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-fasteners. 2021-01-03T12:55:50.660 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-01-03T12:55:50.666 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-httplib2. 2021-01-03T12:55:50.671 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../069-python3-fasteners_0.12.0-3_all.deb ... 2021-01-03T12:55:50.673 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../079-ceph-mgr-k8sevents_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:50.679 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../070-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2021-01-03T12:55:50.698 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-01-03T12:55:50.710 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-k8sevents (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:50.716 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2021-01-03T12:55:50.716 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-01-03T12:55:50.942 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package jq. 2021-01-03T12:55:50.955 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../085-jq_1.5+dfsg-2_amd64.deb ... 2021-01-03T12:55:50.988 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-json-pointer. 2021-01-03T12:55:50.992 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-01-03T12:55:51.002 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../080-python3-json-pointer_1.10-1_all.deb ... 2021-01-03T12:55:51.019 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-httplib2. 2021-01-03T12:55:51.019 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pyasn1. 2021-01-03T12:55:51.031 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../070-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2021-01-03T12:55:51.031 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3_all.deb ... 2021-01-03T12:55:51.069 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-01-03T12:55:51.069 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2021-01-03T12:55:51.107 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-json-pointer (1.10-1) ... 2021-01-03T12:55:51.244 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package socat. 2021-01-03T12:55:51.256 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../086-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-01-03T12:55:51.294 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-01-03T12:55:51.355 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1. 2021-01-03T12:55:51.368 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3_all.deb ... 2021-01-03T12:55:51.380 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-01-03T12:55:51.394 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-01-03T12:55:51.405 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2021-01-03T12:55:51.430 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2021-01-03T12:55:51.477 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jsonpatch. 2021-01-03T12:55:51.489 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../081-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2021-01-03T12:55:51.530 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-01-03T12:55:51.648 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-01-03T12:55:51.660 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../087-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-01-03T12:55:51.698 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-01-03T12:55:51.700 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-01-03T12:55:51.713 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-01-03T12:55:51.741 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-rsa. 2021-01-03T12:55:51.742 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2021-01-03T12:55:51.753 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../073-python3-rsa_3.4.2-1_all.deb ... 2021-01-03T12:55:51.791 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-rsa (3.4.2-1) ... 2021-01-03T12:55:51.813 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-01-03T12:55:51.827 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../082-ceph-mgr-rook_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:51.871 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-rook (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:51.959 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package xmlstarlet. 2021-01-03T12:55:51.972 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2_amd64.deb ... 2021-01-03T12:55:52.009 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-01-03T12:55:52.053 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rsa. 2021-01-03T12:55:52.055 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-sqlalchemy. 2021-01-03T12:55:52.066 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../073-python3-rsa_3.4.2-1_all.deb ... 2021-01-03T12:55:52.068 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../074-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-01-03T12:55:52.094 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rsa (3.4.2-1) ... 2021-01-03T12:55:52.104 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-01-03T12:55:52.208 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libonig4:amd64. 2021-01-03T12:55:52.220 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../083-libonig4_6.7.0-1_amd64.deb ... 2021-01-03T12:55:52.257 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-01-03T12:55:52.305 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-test. 2021-01-03T12:55:52.318 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../089-ceph-test_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:52.354 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-test (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:52.357 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sqlalchemy. 2021-01-03T12:55:52.369 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../074-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-01-03T12:55:52.397 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-01-03T12:55:52.576 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-oauth2client. 2021-01-03T12:55:52.588 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../075-python3-oauth2client_4.1.2-3_all.deb ... 2021-01-03T12:55:52.625 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2021-01-03T12:55:52.635 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libjq1:amd64. 2021-01-03T12:55:52.648 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../084-libjq1_1.5+dfsg-2_amd64.deb ... 2021-01-03T12:55:52.685 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-01-03T12:55:52.788 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-oauth2client. 2021-01-03T12:55:52.801 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../075-python3-oauth2client_4.1.2-3_all.deb ... 2021-01-03T12:55:52.829 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2021-01-03T12:55:52.955 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-setuptools. 2021-01-03T12:55:52.967 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../076-python3-setuptools_39.0.1-2_all.deb ... 2021-01-03T12:55:52.989 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package jq. 2021-01-03T12:55:53.002 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../085-jq_1.5+dfsg-2_amd64.deb ... 2021-01-03T12:55:53.003 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2021-01-03T12:55:53.038 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-01-03T12:55:53.149 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-setuptools. 2021-01-03T12:55:53.162 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../076-python3-setuptools_39.0.1-2_all.deb ... 2021-01-03T12:55:53.199 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2021-01-03T12:55:53.274 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package socat. 2021-01-03T12:55:53.288 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../086-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-01-03T12:55:53.324 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-01-03T12:55:53.381 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-websocket. 2021-01-03T12:55:53.395 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../077-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2021-01-03T12:55:53.440 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2021-01-03T12:55:53.594 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-websocket. 2021-01-03T12:55:53.608 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../077-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2021-01-03T12:55:53.653 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2021-01-03T12:55:53.711 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-01-03T12:55:53.723 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../087-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-01-03T12:55:53.751 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-kubernetes. 2021-01-03T12:55:53.760 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-01-03T12:55:53.764 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../078-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-01-03T12:55:53.801 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2021-01-03T12:55:53.964 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-kubernetes. 2021-01-03T12:55:53.977 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../078-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-01-03T12:55:54.022 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2021-01-03T12:55:54.197 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-01-03T12:55:54.210 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../079-ceph-mgr-k8sevents_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:54.255 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-k8sevents (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:54.372 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package xmlstarlet. 2021-01-03T12:55:54.386 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2_amd64.deb ... 2021-01-03T12:55:54.430 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-01-03T12:55:54.452 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-01-03T12:55:54.464 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../079-ceph-mgr-k8sevents_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:54.591 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-json-pointer. 2021-01-03T12:55:54.604 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../080-python3-json-pointer_1.10-1_all.deb ... 2021-01-03T12:55:54.702 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-k8sevents (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:54.718 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-json-pointer (1.10-1) ... 2021-01-03T12:55:54.809 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-test. 2021-01-03T12:55:54.821 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../089-ceph-test_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:54.859 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-test (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:55.021 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-json-pointer. 2021-01-03T12:55:55.034 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../080-python3-json-pointer_1.10-1_all.deb ... 2021-01-03T12:55:55.088 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-jsonpatch. 2021-01-03T12:55:55.099 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../081-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2021-01-03T12:55:55.141 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-01-03T12:55:55.173 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-json-pointer (1.10-1) ... 2021-01-03T12:55:55.382 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-01-03T12:55:55.395 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../082-ceph-mgr-rook_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:55.424 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-rook (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:55.527 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jsonpatch. 2021-01-03T12:55:55.539 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../081-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2021-01-03T12:55:55.580 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-01-03T12:55:55.617 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-colorama. 2021-01-03T12:55:55.628 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../090-python3-colorama_0.3.7-1_all.deb ... 2021-01-03T12:55:55.667 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-colorama (0.3.7-1) ... 2021-01-03T12:55:55.752 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libonig4:amd64. 2021-01-03T12:55:55.764 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../083-libonig4_6.7.0-1_amd64.deb ... 2021-01-03T12:55:55.801 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-01-03T12:55:55.880 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-01-03T12:55:55.893 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../082-ceph-mgr-rook_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:55.919 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephfs-shell. 2021-01-03T12:55:55.930 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-rook (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:55.933 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../091-cephfs-shell_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:55.977 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephfs-shell (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:56.199 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libonig4:amd64. 2021-01-03T12:55:56.205 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libcephfs-dev. 2021-01-03T12:55:56.212 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../083-libonig4_6.7.0-1_amd64.deb ... 2021-01-03T12:55:56.213 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libjq1:amd64. 2021-01-03T12:55:56.218 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../092-libcephfs-dev_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:56.227 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../084-libjq1_1.5+dfsg-2_amd64.deb ... 2021-01-03T12:55:56.241 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-01-03T12:55:56.255 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libcephfs-dev (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:56.271 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-01-03T12:55:56.524 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package nvme-cli. 2021-01-03T12:55:56.532 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package jq. 2021-01-03T12:55:56.536 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../093-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-01-03T12:55:56.545 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../085-jq_1.5+dfsg-2_amd64.deb ... 2021-01-03T12:55:56.574 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-01-03T12:55:56.590 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-01-03T12:55:56.594 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjq1:amd64. 2021-01-03T12:55:56.607 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../084-libjq1_1.5+dfsg-2_amd64.deb ... 2021-01-03T12:55:56.644 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-01-03T12:55:56.809 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package socat. 2021-01-03T12:55:56.821 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../086-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-01-03T12:55:56.859 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-01-03T12:55:56.895 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-attr. 2021-01-03T12:55:56.909 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../094-python-attr_17.4.0-2_all.deb ... 2021-01-03T12:55:56.947 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package jq. 2021-01-03T12:55:56.953 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-attr (17.4.0-2) ... 2021-01-03T12:55:56.961 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../085-jq_1.5+dfsg-2_amd64.deb ... 2021-01-03T12:55:57.005 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-01-03T12:55:57.225 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package socat. 2021-01-03T12:55:57.236 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../086-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-01-03T12:55:57.238 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-01-03T12:55:57.248 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-funcsigs. 2021-01-03T12:55:57.250 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../087-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-01-03T12:55:57.260 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../095-python-funcsigs_1.0.2-4_all.deb ... 2021-01-03T12:55:57.266 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-01-03T12:55:57.289 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-01-03T12:55:57.298 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-01-03T12:55:57.574 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package xmlstarlet. 2021-01-03T12:55:57.576 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-pluggy. 2021-01-03T12:55:57.588 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2_amd64.deb ... 2021-01-03T12:55:57.588 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../096-python-pluggy_0.6.0-1_all.deb ... 2021-01-03T12:55:57.617 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-01-03T12:55:57.632 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-01-03T12:55:57.637 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-01-03T12:55:57.650 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../087-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-01-03T12:55:57.687 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-01-03T12:55:57.920 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-py. 2021-01-03T12:55:57.932 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../097-python-py_1.5.2-1_all.deb ... 2021-01-03T12:55:57.948 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package xmlstarlet. 2021-01-03T12:55:57.959 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2_amd64.deb ... 2021-01-03T12:55:57.969 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-test. 2021-01-03T12:55:57.970 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-py (1.5.2-1) ... 2021-01-03T12:55:57.983 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../089-ceph-test_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:57.998 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-01-03T12:55:58.019 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-test (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:58.197 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-colorama. 2021-01-03T12:55:58.208 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../090-python3-colorama_0.3.7-1_all.deb ... 2021-01-03T12:55:58.271 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-colorama (0.3.7-1) ... 2021-01-03T12:55:58.282 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-pytest. 2021-01-03T12:55:58.293 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../098-python-pytest_3.3.2-2_all.deb ... 2021-01-03T12:55:58.334 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-01-03T12:55:58.361 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-test. 2021-01-03T12:55:58.374 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../089-ceph-test_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:58.411 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-test (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:58.507 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package cephfs-shell. 2021-01-03T12:55:58.518 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../091-cephfs-shell_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:55:58.548 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking cephfs-shell (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:58.677 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-attr. 2021-01-03T12:55:58.689 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../099-python3-attr_17.4.0-2_all.deb ... 2021-01-03T12:55:58.727 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-attr (17.4.0-2) ... 2021-01-03T12:55:58.793 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libcephfs-dev. 2021-01-03T12:55:58.805 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../092-libcephfs-dev_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:55:58.843 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libcephfs-dev (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:55:59.029 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cycler. 2021-01-03T12:55:59.041 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../100-python3-cycler_0.10.0-1_all.deb ... 2021-01-03T12:55:59.079 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cycler (0.10.0-1) ... 2021-01-03T12:55:59.112 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package nvme-cli. 2021-01-03T12:55:59.124 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../093-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-01-03T12:55:59.162 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-01-03T12:55:59.367 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webencodings. 2021-01-03T12:55:59.381 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../101-python3-webencodings_0.5-2_all.deb ... 2021-01-03T12:55:59.425 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webencodings (0.5-2) ... 2021-01-03T12:55:59.533 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-attr. 2021-01-03T12:55:59.546 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../094-python-attr_17.4.0-2_all.deb ... 2021-01-03T12:55:59.583 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-attr (17.4.0-2) ... 2021-01-03T12:55:59.745 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-html5lib. 2021-01-03T12:55:59.758 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../102-python3-html5lib_0.999999999-1_all.deb ... 2021-01-03T12:55:59.795 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2021-01-03T12:55:59.869 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-funcsigs. 2021-01-03T12:55:59.881 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../095-python-funcsigs_1.0.2-4_all.deb ... 2021-01-03T12:55:59.910 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-01-03T12:56:00.115 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-01-03T12:56:00.125 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../103-python3-lxml_4.2.1-1ubuntu0.3_amd64.deb ... 2021-01-03T12:56:00.164 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-01-03T12:56:00.222 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-pluggy. 2021-01-03T12:56:00.235 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../096-python-pluggy_0.6.0-1_all.deb ... 2021-01-03T12:56:00.297 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-01-03T12:56:00.576 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-tz. 2021-01-03T12:56:00.589 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../104-python3-tz_2018.3-2_all.deb ... 2021-01-03T12:56:00.599 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-py. 2021-01-03T12:56:00.612 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../097-python-py_1.5.2-1_all.deb ... 2021-01-03T12:56:00.634 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-tz (2018.3-2) ... 2021-01-03T12:56:00.649 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-py (1.5.2-1) ... 2021-01-03T12:56:00.946 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-matplotlib. 2021-01-03T12:56:00.957 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../105-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2021-01-03T12:56:00.995 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2021-01-03T12:56:01.011 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-pytest. 2021-01-03T12:56:01.023 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../098-python-pytest_3.3.2-2_all.deb ... 2021-01-03T12:56:01.061 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-01-03T12:56:01.398 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-attr. 2021-01-03T12:56:01.399 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-colorama. 2021-01-03T12:56:01.411 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../099-python3-attr_17.4.0-2_all.deb ... 2021-01-03T12:56:01.411 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../090-python3-colorama_0.3.7-1_all.deb ... 2021-01-03T12:56:01.439 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-attr (17.4.0-2) ... 2021-01-03T12:56:01.440 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-colorama (0.3.7-1) ... 2021-01-03T12:56:01.642 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-olefile. 2021-01-03T12:56:01.651 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package cephfs-shell. 2021-01-03T12:56:01.654 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../106-python3-olefile_0.45.1-1_all.deb ... 2021-01-03T12:56:01.664 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../091-cephfs-shell_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:56:01.692 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-olefile (0.45.1-1) ... 2021-01-03T12:56:01.700 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking cephfs-shell (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:01.725 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cycler. 2021-01-03T12:56:01.737 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../100-python3-cycler_0.10.0-1_all.deb ... 2021-01-03T12:56:01.776 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cycler (0.10.0-1) ... 2021-01-03T12:56:01.799 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-colorama. 2021-01-03T12:56:01.811 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../090-python3-colorama_0.3.7-1_all.deb ... 2021-01-03T12:56:01.840 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-colorama (0.3.7-1) ... 2021-01-03T12:56:01.953 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libcephfs-dev. 2021-01-03T12:56:01.967 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../092-libcephfs-dev_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:56:01.995 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pastescript. 2021-01-03T12:56:02.006 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-2_all.deb ... 2021-01-03T12:56:02.020 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libcephfs-dev (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:02.045 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2021-01-03T12:56:02.092 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephfs-shell. 2021-01-03T12:56:02.102 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-webencodings. 2021-01-03T12:56:02.106 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../091-cephfs-shell_15.2.8-57-g2eacca1e-1bionic_all.deb ... 2021-01-03T12:56:02.116 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../101-python3-webencodings_0.5-2_all.deb ... 2021-01-03T12:56:02.152 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-webencodings (0.5-2) ... 2021-01-03T12:56:02.159 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephfs-shell (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:02.297 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package nvme-cli. 2021-01-03T12:56:02.310 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../093-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-01-03T12:56:02.347 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-01-03T12:56:02.395 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs-dev. 2021-01-03T12:56:02.406 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pil:amd64. 2021-01-03T12:56:02.407 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../092-libcephfs-dev_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:56:02.419 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../108-python3-pil_5.1.0-1ubuntu0.3_amd64.deb ... 2021-01-03T12:56:02.445 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs-dev (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:02.456 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2021-01-03T12:56:02.466 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-html5lib. 2021-01-03T12:56:02.480 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../102-python3-html5lib_0.999999999-1_all.deb ... 2021-01-03T12:56:02.516 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2021-01-03T12:56:02.652 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python-attr. 2021-01-03T12:56:02.666 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../094-python-attr_17.4.0-2_all.deb ... 2021-01-03T12:56:02.702 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python-attr (17.4.0-2) ... 2021-01-03T12:56:02.706 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package nvme-cli. 2021-01-03T12:56:02.719 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../093-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-01-03T12:56:02.756 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-01-03T12:56:02.809 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pluggy. 2021-01-03T12:56:02.822 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../109-python3-pluggy_0.6.0-1_all.deb ... 2021-01-03T12:56:02.851 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2021-01-03T12:56:02.860 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-01-03T12:56:02.873 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../103-python3-lxml_4.2.1-1ubuntu0.3_amd64.deb ... 2021-01-03T12:56:02.910 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-01-03T12:56:02.988 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python-funcsigs. 2021-01-03T12:56:03.002 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../095-python-funcsigs_1.0.2-4_all.deb ... 2021-01-03T12:56:03.046 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-01-03T12:56:03.119 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-attr. 2021-01-03T12:56:03.132 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../094-python-attr_17.4.0-2_all.deb ... 2021-01-03T12:56:03.145 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-py. 2021-01-03T12:56:03.157 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../110-python3-py_1.5.2-1_all.deb ... 2021-01-03T12:56:03.178 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-attr (17.4.0-2) ... 2021-01-03T12:56:03.195 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-py (1.5.2-1) ... 2021-01-03T12:56:03.342 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-tz. 2021-01-03T12:56:03.355 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../104-python3-tz_2018.3-2_all.deb ... 2021-01-03T12:56:03.358 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python-pluggy. 2021-01-03T12:56:03.369 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../096-python-pluggy_0.6.0-1_all.deb ... 2021-01-03T12:56:03.399 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-tz (2018.3-2) ... 2021-01-03T12:56:03.407 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-01-03T12:56:03.481 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-funcsigs. 2021-01-03T12:56:03.495 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../095-python-funcsigs_1.0.2-4_all.deb ... 2021-01-03T12:56:03.515 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyinotify. 2021-01-03T12:56:03.528 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1_all.deb ... 2021-01-03T12:56:03.539 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-01-03T12:56:03.565 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2021-01-03T12:56:03.701 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-matplotlib. 2021-01-03T12:56:03.701 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python-py. 2021-01-03T12:56:03.713 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../105-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2021-01-03T12:56:03.715 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../097-python-py_1.5.2-1_all.deb ... 2021-01-03T12:56:03.750 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2021-01-03T12:56:03.776 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python-py (1.5.2-1) ... 2021-01-03T12:56:03.867 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pluggy. 2021-01-03T12:56:03.879 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../096-python-pluggy_0.6.0-1_all.deb ... 2021-01-03T12:56:03.884 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pytest. 2021-01-03T12:56:03.897 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../112-python3-pytest_3.3.2-2_all.deb ... 2021-01-03T12:56:03.917 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-01-03T12:56:03.934 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pytest (3.3.2-2) ... 2021-01-03T12:56:04.055 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python-pytest. 2021-01-03T12:56:04.066 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../098-python-pytest_3.3.2-2_all.deb ... 2021-01-03T12:56:04.113 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-01-03T12:56:04.170 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-py. 2021-01-03T12:56:04.183 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../097-python-py_1.5.2-1_all.deb ... 2021-01-03T12:56:04.220 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-py (1.5.2-1) ... 2021-01-03T12:56:04.263 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-simplejson. 2021-01-03T12:56:04.275 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../113-python3-simplejson_3.13.2-1_amd64.deb ... 2021-01-03T12:56:04.313 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2021-01-03T12:56:04.439 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-olefile. 2021-01-03T12:56:04.452 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../106-python3-olefile_0.45.1-1_all.deb ... 2021-01-03T12:56:04.457 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-attr. 2021-01-03T12:56:04.469 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../099-python3-attr_17.4.0-2_all.deb ... 2021-01-03T12:56:04.490 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-olefile (0.45.1-1) ... 2021-01-03T12:56:04.533 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pytest. 2021-01-03T12:56:04.543 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../098-python-pytest_3.3.2-2_all.deb ... 2021-01-03T12:56:04.547 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-attr (17.4.0-2) ... 2021-01-03T12:56:04.582 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-01-03T12:56:04.615 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-tk:amd64. 2021-01-03T12:56:04.630 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../114-python3-tk_3.6.9-1~18.04_amd64.deb ... 2021-01-03T12:56:04.674 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2021-01-03T12:56:04.801 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pastescript. 2021-01-03T12:56:04.813 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-2_all.deb ... 2021-01-03T12:56:04.851 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2021-01-03T12:56:04.960 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-attr. 2021-01-03T12:56:04.972 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../099-python3-attr_17.4.0-2_all.deb ... 2021-01-03T12:56:04.977 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-cycler. 2021-01-03T12:56:04.989 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../100-python3-cycler_0.10.0-1_all.deb ... 2021-01-03T12:56:05.010 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-attr (17.4.0-2) ... 2021-01-03T12:56:05.020 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-cycler (0.10.0-1) ... 2021-01-03T12:56:05.119 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package radosgw. 2021-01-03T12:56:05.132 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../115-radosgw_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:56:05.169 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking radosgw (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:05.229 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pil:amd64. 2021-01-03T12:56:05.241 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../108-python3-pil_5.1.0-1ubuntu0.3_amd64.deb ... 2021-01-03T12:56:05.279 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2021-01-03T12:56:05.288 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cycler. 2021-01-03T12:56:05.299 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../100-python3-cycler_0.10.0-1_all.deb ... 2021-01-03T12:56:05.305 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-webencodings. 2021-01-03T12:56:05.316 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../101-python3-webencodings_0.5-2_all.deb ... 2021-01-03T12:56:05.330 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cycler (0.10.0-1) ... 2021-01-03T12:56:05.346 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-webencodings (0.5-2) ... 2021-01-03T12:56:05.616 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webencodings. 2021-01-03T12:56:05.624 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-html5lib. 2021-01-03T12:56:05.629 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../101-python3-webencodings_0.5-2_all.deb ... 2021-01-03T12:56:05.637 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../102-python3-html5lib_0.999999999-1_all.deb ... 2021-01-03T12:56:05.666 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webencodings (0.5-2) ... 2021-01-03T12:56:05.674 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pluggy. 2021-01-03T12:56:05.682 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2021-01-03T12:56:05.686 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../109-python3-pluggy_0.6.0-1_all.deb ... 2021-01-03T12:56:05.724 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2021-01-03T12:56:05.969 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-html5lib. 2021-01-03T12:56:05.982 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../102-python3-html5lib_0.999999999-1_all.deb ... 2021-01-03T12:56:06.010 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-py. 2021-01-03T12:56:06.018 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-01-03T12:56:06.019 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2021-01-03T12:56:06.022 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../110-python3-py_1.5.2-1_all.deb ... 2021-01-03T12:56:06.032 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../103-python3-lxml_4.2.1-1ubuntu0.3_amd64.deb ... 2021-01-03T12:56:06.052 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-py (1.5.2-1) ... 2021-01-03T12:56:06.068 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-01-03T12:56:06.080 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package rbd-fuse. 2021-01-03T12:56:06.092 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../116-rbd-fuse_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:56:06.130 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking rbd-fuse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:06.347 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyinotify. 2021-01-03T12:56:06.361 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1_all.deb ... 2021-01-03T12:56:06.381 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-01-03T12:56:06.394 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../103-python3-lxml_4.2.1-1ubuntu0.3_amd64.deb ... 2021-01-03T12:56:06.426 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-logutils (0.3.3-5) ... 2021-01-03T12:56:06.431 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-01-03T12:56:06.438 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2021-01-03T12:56:06.471 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-tz. 2021-01-03T12:56:06.483 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../104-python3-tz_2018.3-2_all.deb ... 2021-01-03T12:56:06.530 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-tz (2018.3-2) ... 2021-01-03T12:56:06.735 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-01-03T12:56:06.750 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pytest. 2021-01-03T12:56:06.763 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../112-python3-pytest_3.3.2-2_all.deb ... 2021-01-03T12:56:06.800 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pytest (3.3.2-2) ... 2021-01-03T12:56:06.833 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-matplotlib. 2021-01-03T12:56:06.834 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tz. 2021-01-03T12:56:06.845 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../104-python3-tz_2018.3-2_all.deb ... 2021-01-03T12:56:06.846 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../105-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2021-01-03T12:56:06.882 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2021-01-03T12:56:06.884 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tz (2018.3-2) ... 2021-01-03T12:56:07.095 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2021-01-03T12:56:07.162 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-simplejson. 2021-01-03T12:56:07.176 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../113-python3-simplejson_3.13.2-1_amd64.deb ... 2021-01-03T12:56:07.180 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-matplotlib. 2021-01-03T12:56:07.192 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../105-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2021-01-03T12:56:07.220 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2021-01-03T12:56:07.229 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-01-03T12:56:07.237 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2021-01-03T12:56:07.555 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-olefile. 2021-01-03T12:56:07.568 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../106-python3-olefile_0.45.1-1_all.deb ... 2021-01-03T12:56:07.598 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-tk:amd64. 2021-01-03T12:56:07.613 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../114-python3-tk_3.6.9-1~18.04_amd64.deb ... 2021-01-03T12:56:07.621 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-olefile (0.45.1-1) ... 2021-01-03T12:56:07.648 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2021-01-03T12:56:07.823 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2021-01-03T12:56:07.851 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-olefile. 2021-01-03T12:56:07.863 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../106-python3-olefile_0.45.1-1_all.deb ... 2021-01-03T12:56:07.882 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pastescript. 2021-01-03T12:56:07.894 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-2_all.deb ... 2021-01-03T12:56:07.924 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2021-01-03T12:56:07.926 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-olefile (0.45.1-1) ... 2021-01-03T12:56:08.118 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package radosgw. 2021-01-03T12:56:08.133 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../115-radosgw_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:56:08.168 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking radosgw (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:08.200 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2021-01-03T12:56:08.210 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pil:amd64. 2021-01-03T12:56:08.224 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../108-python3-pil_5.1.0-1ubuntu0.3_amd64.deb ... 2021-01-03T12:56:08.237 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastescript. 2021-01-03T12:56:08.250 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-2_all.deb ... 2021-01-03T12:56:08.260 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2021-01-03T12:56:08.287 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2021-01-03T12:56:08.476 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webencodings (0.5-2) ... 2021-01-03T12:56:08.622 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pluggy. 2021-01-03T12:56:08.635 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../109-python3-pluggy_0.6.0-1_all.deb ... 2021-01-03T12:56:08.649 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pil:amd64. 2021-01-03T12:56:08.662 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../108-python3-pil_5.1.0-1ubuntu0.3_amd64.deb ... 2021-01-03T12:56:08.672 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2021-01-03T12:56:08.699 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2021-01-03T12:56:08.770 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-attr (17.4.0-2) ... 2021-01-03T12:56:08.916 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-py. 2021-01-03T12:56:08.928 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../110-python3-py_1.5.2-1_all.deb ... 2021-01-03T12:56:08.966 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-py (1.5.2-1) ... 2021-01-03T12:56:08.970 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2021-01-03T12:56:09.062 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pluggy. 2021-01-03T12:56:09.075 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../109-python3-pluggy_0.6.0-1_all.deb ... 2021-01-03T12:56:09.088 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-py (1.5.2-1) ... 2021-01-03T12:56:09.119 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2021-01-03T12:56:09.130 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package rbd-fuse. 2021-01-03T12:56:09.143 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../116-rbd-fuse_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:56:09.180 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking rbd-fuse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:09.261 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pyinotify. 2021-01-03T12:56:09.275 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1_all.deb ... 2021-01-03T12:56:09.319 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2021-01-03T12:56:09.414 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-waitress (1.0.1-1) ... 2021-01-03T12:56:09.422 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-py. 2021-01-03T12:56:09.434 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../110-python3-py_1.5.2-1_all.deb ... 2021-01-03T12:56:09.482 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-logutils (0.3.3-5) ... 2021-01-03T12:56:09.497 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-py (1.5.2-1) ... 2021-01-03T12:56:09.622 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pytest. 2021-01-03T12:56:09.634 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../112-python3-pytest_3.3.2-2_all.deb ... 2021-01-03T12:56:09.672 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pytest (3.3.2-2) ... 2021-01-03T12:56:09.782 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-01-03T12:56:09.802 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-01-03T12:56:09.817 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyinotify. 2021-01-03T12:56:09.830 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1_all.deb ... 2021-01-03T12:56:09.867 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2021-01-03T12:56:10.034 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-simplejson. 2021-01-03T12:56:10.046 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../113-python3-simplejson_3.13.2-1_amd64.deb ... 2021-01-03T12:56:10.083 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2021-01-03T12:56:10.084 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-olefile (0.45.1-1) ... 2021-01-03T12:56:10.154 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2021-01-03T12:56:10.178 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pytest. 2021-01-03T12:56:10.190 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../112-python3-pytest_3.3.2-2_all.deb ... 2021-01-03T12:56:10.228 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pytest (3.3.2-2) ... 2021-01-03T12:56:10.280 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-01-03T12:56:10.377 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-ceph-argparse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:10.428 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-tk:amd64. 2021-01-03T12:56:10.442 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../114-python3-tk_3.6.9-1~18.04_amd64.deb ... 2021-01-03T12:56:10.486 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2021-01-03T12:56:10.574 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplejson. 2021-01-03T12:56:10.586 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../113-python3-simplejson_3.13.2-1_amd64.deb ... 2021-01-03T12:56:10.623 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2021-01-03T12:56:10.678 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-tempita (0.5.2-2) ... 2021-01-03T12:56:10.890 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package radosgw. 2021-01-03T12:56:10.899 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2021-01-03T12:56:10.901 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../115-radosgw_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:56:10.927 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tk:amd64. 2021-01-03T12:56:10.938 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../114-python3-tk_3.6.9-1~18.04_amd64.deb ... 2021-01-03T12:56:10.939 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking radosgw (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:10.962 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-01-03T12:56:10.977 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2021-01-03T12:56:11.063 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2021-01-03T12:56:11.276 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2021-01-03T12:56:11.431 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package radosgw. 2021-01-03T12:56:11.444 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../115-radosgw_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:56:11.489 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking radosgw (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:11.569 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-webencodings (0.5-2) ... 2021-01-03T12:56:11.853 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-attr (17.4.0-2) ... 2021-01-03T12:56:11.884 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package rbd-fuse. 2021-01-03T12:56:11.896 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../116-rbd-fuse_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:56:11.934 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking rbd-fuse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:11.966 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2021-01-03T12:56:12.071 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2021-01-03T12:56:12.214 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-py (1.5.2-1) ... 2021-01-03T12:56:12.230 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-logutils (0.3.3-5) ... 2021-01-03T12:56:12.284 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2021-01-03T12:56:12.467 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package rbd-fuse. 2021-01-03T12:56:12.480 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../116-rbd-fuse_15.2.8-57-g2eacca1e-1bionic_amd64.deb ... 2021-01-03T12:56:12.517 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking rbd-fuse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:12.548 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-01-03T12:56:12.568 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-py (1.5.2-1) ... 2021-01-03T12:56:12.582 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-waitress (1.0.1-1) ... 2021-01-03T12:56:12.811 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-simplejson (3.13.2-1) ... 2021-01-03T12:56:12.828 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-logutils (0.3.3-5) ... 2021-01-03T12:56:12.891 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2021-01-03T12:56:12.896 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-01-03T12:56:12.992 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-01-03T12:56:13.121 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-json-pointer (1.10-1) ... 2021-01-03T12:56:13.139 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-01-03T12:56:13.193 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2021-01-03T12:56:13.202 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-olefile (0.45.1-1) ... 2021-01-03T12:56:13.439 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-01-03T12:56:13.487 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-ceph-argparse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:13.565 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-01-03T12:56:13.695 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2021-01-03T12:56:13.696 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2021-01-03T12:56:13.767 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-01-03T12:56:13.775 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-colorama (0.3.7-1) ... 2021-01-03T12:56:13.830 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-tempita (0.5.2-2) ... 2021-01-03T12:56:13.987 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2021-01-03T12:56:14.076 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2021-01-03T12:56:14.140 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-01-03T12:56:14.265 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2021-01-03T12:56:14.280 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-webencodings (0.5-2) ... 2021-01-03T12:56:14.370 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2021-01-03T12:56:14.377 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-01-03T12:56:14.581 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python-attr (17.4.0-2) ... 2021-01-03T12:56:14.686 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cycler (0.10.0-1) ... 2021-01-03T12:56:14.729 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2021-01-03T12:56:14.757 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2021-01-03T12:56:14.858 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-py (1.5.2-1) ... 2021-01-03T12:56:14.962 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2021-01-03T12:56:15.014 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webencodings (0.5-2) ... 2021-01-03T12:56:15.196 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-waitress (1.0.1-1) ... 2021-01-03T12:56:15.210 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2021-01-03T12:56:15.315 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-attr (17.4.0-2) ... 2021-01-03T12:56:15.321 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-bs4 (4.6.0-1) ... 2021-01-03T12:56:15.512 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2021-01-03T12:56:15.516 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2021-01-03T12:56:15.535 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-01-03T12:56:15.643 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-py (1.5.2-1) ... 2021-01-03T12:56:15.664 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pluggy (0.6.0-1) ... 2021-01-03T12:56:15.788 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-py (1.5.2-1) ... 2021-01-03T12:56:15.838 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-olefile (0.45.1-1) ... 2021-01-03T12:56:15.958 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephadm (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:16.011 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-waitress (1.0.1-1) ... 2021-01-03T12:56:16.014 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-simplejson (3.13.2-1) ... 2021-01-03T12:56:16.147 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-ceph-argparse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:16.351 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-01-03T12:56:16.366 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-json-pointer (1.10-1) ... 2021-01-03T12:56:16.432 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-tempita (0.5.2-2) ... 2021-01-03T12:56:16.456 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2021-01-03T12:56:16.583 INFO:teuthology.orchestra.run.smithi133.stdout:Adding system user cephadm....done 2021-01-03T12:56:16.639 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-olefile (0.45.1-1) ... 2021-01-03T12:56:16.700 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-01-03T12:56:16.701 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-01-03T12:56:16.747 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2021-01-03T12:56:16.801 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2021-01-03T12:56:16.827 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-01-03T12:56:16.932 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-argparse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:17.011 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-colorama (0.3.7-1) ... 2021-01-03T12:56:17.048 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-01-03T12:56:17.167 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-01-03T12:56:17.242 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tempita (0.5.2-2) ... 2021-01-03T12:56:17.275 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2021-01-03T12:56:17.287 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2021-01-03T12:56:17.560 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-01-03T12:56:17.597 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-01-03T12:56:17.602 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-prettytable (0.7.2-3) ... 2021-01-03T12:56:17.686 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2021-01-03T12:56:17.745 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2021-01-03T12:56:17.902 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-01-03T12:56:17.940 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cycler (0.10.0-1) ... 2021-01-03T12:56:18.029 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2021-01-03T12:56:18.071 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2021-01-03T12:56:18.233 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2021-01-03T12:56:18.355 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-ceph-common (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:18.364 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python-py (1.5.2-1) ... 2021-01-03T12:56:18.590 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-simplejson (3.13.2-1) ... 2021-01-03T12:56:18.592 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-bs4 (4.6.0-1) ... 2021-01-03T12:56:18.622 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2021-01-03T12:56:18.656 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-monotonic (1.1-2) ... 2021-01-03T12:56:18.900 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-json-pointer (1.10-1) ... 2021-01-03T12:56:18.936 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pluggy (0.6.0-1) ... 2021-01-03T12:56:18.957 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2021-01-03T12:56:18.957 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-01-03T12:56:18.973 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2021-01-03T12:56:19.066 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-01-03T12:56:19.185 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-01-03T12:56:19.245 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up cephadm (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:19.258 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-py (1.5.2-1) ... 2021-01-03T12:56:19.311 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-01-03T12:56:19.485 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplejson (3.13.2-1) ... 2021-01-03T12:56:19.493 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-html5lib (0.999999999-1) ... 2021-01-03T12:56:19.503 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-colorama (0.3.7-1) ... 2021-01-03T12:56:19.819 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-json-pointer (1.10-1) ... 2021-01-03T12:56:19.821 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2021-01-03T12:56:19.836 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-01-03T12:56:19.896 INFO:teuthology.orchestra.run.smithi007.stdout:Adding system user cephadm....done 2021-01-03T12:56:19.909 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2021-01-03T12:56:19.925 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-01-03T12:56:19.957 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2021-01-03T12:56:20.044 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2021-01-03T12:56:20.131 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-01-03T12:56:20.154 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-01-03T12:56:20.204 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-repoze.lru (0.7-1) ... 2021-01-03T12:56:20.280 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-01-03T12:56:20.337 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-01-03T12:56:20.440 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-cycler (0.10.0-1) ... 2021-01-03T12:56:20.446 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-01-03T12:56:20.507 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-colorama (0.3.7-1) ... 2021-01-03T12:56:20.513 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-01-03T12:56:20.581 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2021-01-03T12:56:20.716 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2021-01-03T12:56:20.808 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2021-01-03T12:56:20.814 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2021-01-03T12:56:20.924 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-prettytable (0.7.2-3) ... 2021-01-03T12:56:21.068 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-bs4 (4.6.0-1) ... 2021-01-03T12:56:21.092 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2021-01-03T12:56:21.149 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-attr (17.4.0-2) ... 2021-01-03T12:56:21.234 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-01-03T12:56:21.376 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2021-01-03T12:56:21.393 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cycler (0.10.0-1) ... 2021-01-03T12:56:21.402 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pluggy (0.6.0-1) ... 2021-01-03T12:56:21.417 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-01-03T12:56:21.585 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-01-03T12:56:21.686 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2021-01-03T12:56:21.711 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up cephadm (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:21.719 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-ceph-common (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:21.986 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2021-01-03T12:56:22.029 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-monotonic (1.1-2) ... 2021-01-03T12:56:22.076 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-01-03T12:56:22.079 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-bs4 (4.6.0-1) ... 2021-01-03T12:56:22.321 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liboath0 (2.6.1-1) ... 2021-01-03T12:56:22.322 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-01-03T12:56:22.354 INFO:teuthology.orchestra.run.smithi036.stdout:Adding system user cephadm....done 2021-01-03T12:56:22.431 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pluggy (0.6.0-1) ... 2021-01-03T12:56:22.448 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-01-03T12:56:22.493 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2021-01-03T12:56:22.497 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-01-03T12:56:22.632 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2021-01-03T12:56:22.740 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephadm (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:22.769 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-01-03T12:56:22.808 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-html5lib (0.999999999-1) ... 2021-01-03T12:56:22.874 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-01-03T12:56:22.895 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-01-03T12:56:22.975 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-setuptools (39.0.1-2) ... 2021-01-03T12:56:23.055 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2021-01-03T12:56:23.168 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-01-03T12:56:23.258 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-01-03T12:56:23.290 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2021-01-03T12:56:23.324 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user cephadm....done 2021-01-03T12:56:23.352 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-01-03T12:56:23.406 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-prettytable (0.7.2-3) ... 2021-01-03T12:56:23.478 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-decorator (4.1.2-1) ... 2021-01-03T12:56:23.480 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2021-01-03T12:56:23.545 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-repoze.lru (0.7-1) ... 2021-01-03T12:56:23.708 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-01-03T12:56:23.770 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-tz (2018.3-2) ... 2021-01-03T12:56:23.790 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-01-03T12:56:23.808 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2021-01-03T12:56:23.854 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-01-03T12:56:23.916 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-01-03T12:56:24.059 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2021-01-03T12:56:24.080 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2021-01-03T12:56:24.126 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-ceph-common (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:24.139 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2021-01-03T12:56:24.381 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2021-01-03T12:56:24.385 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-prettytable (0.7.2-3) ... 2021-01-03T12:56:24.444 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-monotonic (1.1-2) ... 2021-01-03T12:56:24.482 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-attr (17.4.0-2) ... 2021-01-03T12:56:24.678 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-01-03T12:56:24.699 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-joblib (0.11-1) ... 2021-01-03T12:56:24.745 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-01-03T12:56:24.804 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2021-01-03T12:56:24.863 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-01-03T12:56:24.917 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-01-03T12:56:25.050 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-routes (2.4.1-1) ... 2021-01-03T12:56:25.109 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-01-03T12:56:25.164 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-common (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:25.214 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-html5lib (0.999999999-1) ... 2021-01-03T12:56:25.351 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2021-01-03T12:56:25.520 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2021-01-03T12:56:25.574 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-01-03T12:56:25.601 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-01-03T12:56:25.644 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-dateutil (2.6.1-1) ... 2021-01-03T12:56:25.664 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-01-03T12:56:25.696 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2021-01-03T12:56:25.757 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-monotonic (1.1-2) ... 2021-01-03T12:56:25.863 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up liboath0 (2.6.1-1) ... 2021-01-03T12:56:25.942 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-repoze.lru (0.7-1) ... 2021-01-03T12:56:25.978 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2021-01-03T12:56:26.041 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-01-03T12:56:26.065 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-01-03T12:56:26.159 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2021-01-03T12:56:26.191 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2021-01-03T12:56:26.244 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-01-03T12:56:26.271 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-01-03T12:56:26.459 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-01-03T12:56:26.460 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-html5lib (0.999999999-1) ... 2021-01-03T12:56:26.545 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2021-01-03T12:56:26.585 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-setuptools (39.0.1-2) ... 2021-01-03T12:56:26.648 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-fasteners (0.12.0-3) ... 2021-01-03T12:56:26.804 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2021-01-03T12:56:26.863 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-attr (17.4.0-2) ... 2021-01-03T12:56:26.910 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-01-03T12:56:26.942 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2021-01-03T12:56:26.966 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up jq (1.5+dfsg-2) ... 2021-01-03T12:56:26.978 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-01-03T12:56:27.067 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2021-01-03T12:56:27.087 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-decorator (4.1.2-1) ... 2021-01-03T12:56:27.130 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-01-03T12:56:27.172 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-repoze.lru (0.7-1) ... 2021-01-03T12:56:27.323 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-01-03T12:56:27.372 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-tz (2018.3-2) ... 2021-01-03T12:56:27.473 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-01-03T12:56:27.707 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2021-01-03T12:56:27.725 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2021-01-03T12:56:27.783 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2021-01-03T12:56:27.814 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-01-03T12:56:28.008 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2021-01-03T12:56:28.068 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up liboath0 (2.6.1-1) ... 2021-01-03T12:56:28.126 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-attr (17.4.0-2) ... 2021-01-03T12:56:28.230 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-01-03T12:56:28.235 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-01-03T12:56:28.317 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-joblib (0.11-1) ... 2021-01-03T12:56:28.353 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2021-01-03T12:56:28.427 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-01-03T12:56:28.548 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2021-01-03T12:56:28.621 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-01-03T12:56:28.637 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2021-01-03T12:56:28.702 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-routes (2.4.1-1) ... 2021-01-03T12:56:28.739 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-setuptools (39.0.1-2) ... 2021-01-03T12:56:28.891 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2021-01-03T12:56:28.991 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pytest (3.3.2-2) ... 2021-01-03T12:56:29.013 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2021-01-03T12:56:29.030 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2021-01-03T12:56:29.120 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-01-03T12:56:29.124 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-01-03T12:56:29.250 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-decorator (4.1.2-1) ... 2021-01-03T12:56:29.296 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-dateutil (2.6.1-1) ... 2021-01-03T12:56:29.343 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2021-01-03T12:56:29.373 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liboath0 (2.6.1-1) ... 2021-01-03T12:56:29.550 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-01-03T12:56:29.550 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-tz (2018.3-2) ... 2021-01-03T12:56:29.606 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2021-01-03T12:56:29.627 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-pytest (3.3.2-2) ... 2021-01-03T12:56:29.676 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2021-01-03T12:56:29.860 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2021-01-03T12:56:29.887 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-01-03T12:56:29.908 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-01-03T12:56:29.919 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-01-03T12:56:30.012 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-01-03T12:56:30.020 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-setuptools (39.0.1-2) ... 2021-01-03T12:56:30.138 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librados2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:30.153 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2021-01-03T12:56:30.265 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rsa (3.4.2-1) ... 2021-01-03T12:56:30.293 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-fasteners (0.12.0-3) ... 2021-01-03T12:56:30.430 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-01-03T12:56:30.454 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-joblib (0.11-1) ... 2021-01-03T12:56:30.556 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-decorator (4.1.2-1) ... 2021-01-03T12:56:30.582 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libcephfs2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:30.602 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up jq (1.5+dfsg-2) ... 2021-01-03T12:56:30.692 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libcephfs-dev (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:30.737 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2021-01-03T12:56:30.805 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-routes (2.4.1-1) ... 2021-01-03T12:56:30.817 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rados (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:30.857 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tz (2018.3-2) ... 2021-01-03T12:56:30.918 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2021-01-03T12:56:31.098 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2021-01-03T12:56:31.158 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2021-01-03T12:56:31.313 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2021-01-03T12:56:31.407 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-dateutil (2.6.1-1) ... 2021-01-03T12:56:31.451 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2021-01-03T12:56:31.606 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2021-01-03T12:56:31.742 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2021-01-03T12:56:31.752 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-joblib (0.11-1) ... 2021-01-03T12:56:31.917 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-01-03T12:56:31.940 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2021-01-03T12:56:32.051 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-01-03T12:56:32.104 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-routes (2.4.1-1) ... 2021-01-03T12:56:32.227 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2021-01-03T12:56:32.413 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2021-01-03T12:56:32.428 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-fasteners (0.12.0-3) ... 2021-01-03T12:56:32.587 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2021-01-03T12:56:32.688 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pytest (3.3.2-2) ... 2021-01-03T12:56:32.723 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-dateutil (2.6.1-1) ... 2021-01-03T12:56:32.737 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up jq (1.5+dfsg-2) ... 2021-01-03T12:56:32.776 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-sklearn (0.19.1-3) ... 2021-01-03T12:56:32.839 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2021-01-03T12:56:33.022 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2021-01-03T12:56:33.058 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2021-01-03T12:56:33.350 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-pytest (3.3.2-2) ... 2021-01-03T12:56:33.351 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.4) ... 2021-01-03T12:56:33.599 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2021-01-03T12:56:33.625 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-01-03T12:56:33.727 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-fasteners (0.12.0-3) ... 2021-01-03T12:56:33.751 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-01-03T12:56:33.877 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librados2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:33.900 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libradosstriper1 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:34.000 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cephfs (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:34.003 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rsa (3.4.2-1) ... 2021-01-03T12:56:34.004 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up jq (1.5+dfsg-2) ... 2021-01-03T12:56:34.026 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-01-03T12:56:34.121 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2021-01-03T12:56:34.277 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librgw2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:34.296 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libcephfs2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:34.344 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2021-01-03T12:56:34.403 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-fuse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:34.405 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libcephfs-dev (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:34.540 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rados (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:34.625 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-03T12:56:34.626 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-03T12:56:34.688 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2021-01-03T12:56:34.691 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2021-01-03T12:56:34.789 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pytest (3.3.2-2) ... 2021-01-03T12:56:34.904 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librbd1 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:35.030 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephfs-shell (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:35.136 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2021-01-03T12:56:35.156 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pecan (1.2.1-2) ... 2021-01-03T12:56:35.157 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2021-01-03T12:56:35.245 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-01-03T12:56:35.287 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-01-03T12:56:35.343 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-01-03T12:56:35.454 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2021-01-03T12:56:35.601 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2021-01-03T12:56:35.644 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2021-01-03T12:56:35.763 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2021-01-03T12:56:35.799 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python-pytest (3.3.2-2) ... 2021-01-03T12:56:35.954 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2021-01-03T12:56:36.058 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-01-03T12:56:36.080 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pytest (3.3.2-2) ... 2021-01-03T12:56:36.185 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-01-03T12:56:36.245 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-modules-core (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:36.310 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up librados2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:36.371 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pastescript (2.0.2-2) ... 2021-01-03T12:56:36.436 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-rsa (3.4.2-1) ... 2021-01-03T12:56:36.465 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2021-01-03T12:56:36.608 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-sklearn (0.19.1-3) ... 2021-01-03T12:56:36.697 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rgw (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:36.754 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libcephfs2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:36.766 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pytest (3.3.2-2) ... 2021-01-03T12:56:36.823 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up rbd-fuse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:36.855 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libcephfs-dev (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:36.958 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rbd (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:36.964 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-rados (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:37.026 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-01-03T12:56:37.075 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-common (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:37.090 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2021-01-03T12:56:37.143 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-01-03T12:56:37.245 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librados2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:37.346 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rsa (3.4.2-1) ... 2021-01-03T12:56:37.480 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2021-01-03T12:56:37.501 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2021-01-03T12:56:37.551 INFO:teuthology.orchestra.run.smithi133.stdout:Adding group ceph....done 2021-01-03T12:56:37.655 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:37.740 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libradosstriper1 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:37.781 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs-dev (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:37.802 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2021-01-03T12:56:37.866 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cephfs (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:37.907 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rados (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:37.953 INFO:teuthology.orchestra.run.smithi133.stdout:Adding system user ceph....done 2021-01-03T12:56:38.058 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2021-01-03T12:56:38.121 INFO:teuthology.orchestra.run.smithi133.stdout:Setting system user ceph properties....done 2021-01-03T12:56:38.137 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2021-01-03T12:56:38.192 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librgw2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:38.273 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-01-03T12:56:38.318 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-fuse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:38.455 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2021-01-03T12:56:38.488 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-01-03T12:56:38.537 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-03T12:56:38.537 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-03T12:56:38.764 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2021-01-03T12:56:38.785 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up radosgw (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:38.844 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librbd1 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:38.970 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up cephfs-shell (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:38.983 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-sklearn (0.19.1-3) ... 2021-01-03T12:56:39.025 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-03T12:56:39.025 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-03T12:56:39.091 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2021-01-03T12:56:39.096 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pecan (1.2.1-2) ... 2021-01-03T12:56:39.178 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-01-03T12:56:39.227 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-01-03T12:56:39.387 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-test (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:39.512 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-base (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:39.542 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2021-01-03T12:56:39.838 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2021-01-03T12:56:39.861 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-01-03T12:56:39.973 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn (0.19.1-3) ... 2021-01-03T12:56:40.114 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libradosstriper1 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:40.148 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:40.238 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-modules-core (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:40.240 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-cephfs (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:40.362 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-03T12:56:40.362 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-03T12:56:40.370 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pastescript (2.0.2-2) ... 2021-01-03T12:56:40.541 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up librgw2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:40.633 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-diskprediction-local (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:40.667 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-fuse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:40.680 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rgw (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:40.767 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-osd (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:40.807 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2021-01-03T12:56:40.822 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up rbd-fuse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:40.886 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-03T12:56:40.887 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-03T12:56:40.924 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rbd (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:41.050 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-common (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:41.108 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libradosstriper1 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:41.168 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up librbd1 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:41.188 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-03T12:56:41.188 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-03T12:56:41.259 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cephfs (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:41.294 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up cephfs-shell (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:41.420 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pecan (1.2.1-2) ... 2021-01-03T12:56:41.444 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-cephadm (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:41.501 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-01-03T12:56:41.534 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-01-03T12:56:41.568 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librgw2 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:41.587 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:41.593 INFO:teuthology.orchestra.run.smithi007.stdout:Adding group ceph....done 2021-01-03T12:56:41.670 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-fuse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:41.730 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-rook (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:41.849 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2021-01-03T12:56:41.872 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mds (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:41.875 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-03T12:56:41.876 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-03T12:56:41.988 INFO:teuthology.orchestra.run.smithi007.stdout:Adding system user ceph....done 2021-01-03T12:56:42.088 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-03T12:56:42.088 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-03T12:56:42.180 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librbd1 (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:42.188 INFO:teuthology.orchestra.run.smithi007.stdout:Setting system user ceph properties....done 2021-01-03T12:56:42.306 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephfs-shell (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:42.348 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-01-03T12:56:42.365 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mon (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:42.431 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pecan (1.2.1-2) ... 2021-01-03T12:56:42.521 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-01-03T12:56:42.534 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-modules-core (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:42.553 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-01-03T12:56:42.582 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-01-03T12:56:42.583 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-03T12:56:42.583 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-03T12:56:42.660 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pastescript (2.0.2-2) ... 2021-01-03T12:56:42.868 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2021-01-03T12:56:42.875 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-k8sevents (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:42.894 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up radosgw (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:42.984 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-dashboard (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:42.995 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-rgw (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:43.102 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:43.120 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up rbd-fuse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:43.156 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-03T12:56:43.157 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-03T12:56:43.203 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for systemd (237-3ubuntu10.43) ... 2021-01-03T12:56:43.230 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-rbd (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:43.331 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-common (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:43.396 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-01-03T12:56:43.529 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-modules-core (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:43.554 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-test (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:43.664 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastescript (2.0.2-2) ... 2021-01-03T12:56:43.680 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-base (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:43.864 INFO:teuthology.orchestra.run.smithi036.stdout:Adding group ceph....done 2021-01-03T12:56:43.982 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rgw (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:44.012 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-01-03T12:56:44.108 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up rbd-fuse (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:44.234 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rbd (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:44.243 INFO:teuthology.orchestra.run.smithi036.stdout:Adding system user ceph....done 2021-01-03T12:56:44.299 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:44.377 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-common (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:44.418 INFO:teuthology.orchestra.run.smithi036.stdout:Setting system user ceph properties....done 2021-01-03T12:56:44.538 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-03T12:56:44.539 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-03T12:56:44.576 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-01-03T12:56:44.797 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-01-03T12:56:44.836 INFO:teuthology.orchestra.run.smithi016.stdout:Adding group ceph....done 2021-01-03T12:56:44.857 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-diskprediction-local (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:45.001 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-osd (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:45.107 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up radosgw (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:45.239 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user ceph....done 2021-01-03T12:56:45.347 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-03T12:56:45.347 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-03T12:56:45.440 INFO:teuthology.orchestra.run.smithi016.stdout:Setting system user ceph properties....done 2021-01-03T12:56:45.482 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-01-03T12:56:45.530 INFO:teuthology.orchestra.run.smithi133.stdout:ureadahead will be reprofiled on next reboot 2021-01-03T12:56:45.591 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-01-03T12:56:45.601 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-01-03T12:56:45.710 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-test (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:45.738 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-03T12:56:45.739 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-03T12:56:45.828 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-01-03T12:56:45.836 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-base (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:46.030 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-cephadm (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:46.032 INFO:teuthology.orchestra.run.smithi133.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-03T12:56:46.034 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-01-03T12:56:46.117 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2021-01-03T12:56:46.130 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up radosgw (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:46.172 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:46.176 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-01-03T12:56:46.299 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-rook (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:46.376 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2021-01-03T12:56:46.377 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2021-01-03T12:56:46.391 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-03T12:56:46.392 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-03T12:56:46.446 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:46.450 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mds (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:46.540 INFO:teuthology.orchestra.run.smithi133.stdout:libtool-bin is already the newest version (2.4.6-2). 2021-01-03T12:56:46.540 INFO:teuthology.orchestra.run.smithi133.stdout:xfslibs-dev is already the newest version (4.9.0+nmu1ubuntu2). 2021-01-03T12:56:46.540 INFO:teuthology.orchestra.run.smithi133.stdout:uuid-dev is already the newest version (2.31.1-0.4ubuntu3.7). 2021-01-03T12:56:46.540 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2021-01-03T12:56:46.541 INFO:teuthology.orchestra.run.smithi133.stdout: libbison-dev libfl-dev libfl2 zlib1g-dev 2021-01-03T12:56:46.542 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2021-01-03T12:56:46.543 INFO:teuthology.orchestra.run.smithi133.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-01-03T12:56:46.568 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2021-01-03T12:56:46.569 INFO:teuthology.orchestra.run.smithi133.stdout: bison dump flex indent libaio-dev libbison-dev libelf-dev libfl-dev libfl2 2021-01-03T12:56:46.570 INFO:teuthology.orchestra.run.smithi133.stdout: libssl-dev zlib1g-dev 2021-01-03T12:56:46.670 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-03T12:56:46.670 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-03T12:56:46.673 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-03T12:56:46.673 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-03T12:56:46.748 INFO:teuthology.orchestra.run.smithi133.stdout:0 upgraded, 11 newly installed, 0 to remove and 0 not upgraded. 2021-01-03T12:56:46.749 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 2,960 kB of archives. 2021-01-03T12:56:46.749 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 12.2 MB of additional disk space will be used. 2021-01-03T12:56:46.749 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2021-01-03T12:56:46.782 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-test (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:46.908 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-base (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:46.939 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-diskprediction-local (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:46.993 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mon (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:47.057 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-osd (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:47.185 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2021-01-03T12:56:47.209 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-03T12:56:47.209 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-03T12:56:47.245 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-01-03T12:56:47.265 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2021-01-03T12:56:47.312 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 dump amd64 0.4b46-3 [129 kB] 2021-01-03T12:56:47.330 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 indent amd64 2.2.11-5 [80.7 kB] 2021-01-03T12:56:47.342 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libaio-dev amd64 0.3.110-5ubuntu0.1 [12.8 kB] 2021-01-03T12:56:47.343 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2021-01-03T12:56:47.358 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2021-01-03T12:56:47.363 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2021-01-03T12:56:47.364 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2021-01-03T12:56:47.364 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.7 [1,566 kB] 2021-01-03T12:56:47.490 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-03T12:56:47.491 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-03T12:56:47.519 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-k8sevents (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:47.534 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:47.645 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-dashboard (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:47.742 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-cephadm (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:47.757 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-03T12:56:47.757 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-03T12:56:47.788 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:47.840 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 2,960 kB in 1s (3,393 kB/s) 2021-01-03T12:56:47.885 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:47.914 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for systemd (237-3ubuntu10.43) ... 2021-01-03T12:56:47.980 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package flex. 2021-01-03T12:56:48.020 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109924 files and directories currently installed.) 2021-01-03T12:56:48.023 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../00-flex_2.6.4-6_amd64.deb ... 2021-01-03T12:56:48.027 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-rook (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:48.044 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-diskprediction-local (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:48.062 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking flex (2.6.4-6) ... 2021-01-03T12:56:48.141 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-01-03T12:56:48.170 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mds (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:48.170 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-osd (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:48.390 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-03T12:56:48.390 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-03T12:56:48.441 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libbison-dev:amd64. 2021-01-03T12:56:48.454 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../01-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-01-03T12:56:48.491 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-01-03T12:56:48.609 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-03T12:56:48.610 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-03T12:56:48.663 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mon (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:48.827 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package bison. 2021-01-03T12:56:48.840 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../02-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-01-03T12:56:48.876 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-03T12:56:48.877 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-03T12:56:48.881 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2021-01-03T12:56:48.906 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-cephadm (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:49.090 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:49.139 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-k8sevents (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:49.233 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-rook (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:49.257 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-dashboard (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:49.280 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package dump. 2021-01-03T12:56:49.292 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../03-dump_0.4b46-3_amd64.deb ... 2021-01-03T12:56:49.339 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking dump (0.4b46-3) ... 2021-01-03T12:56:49.376 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mds (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:49.399 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:49.526 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for systemd (237-3ubuntu10.43) ... 2021-01-03T12:56:49.600 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-03T12:56:49.600 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-03T12:56:49.609 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package indent. 2021-01-03T12:56:49.622 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../04-indent_2.2.11-5_amd64.deb ... 2021-01-03T12:56:49.659 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking indent (2.2.11-5) ... 2021-01-03T12:56:49.718 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-01-03T12:56:49.894 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mon (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:49.919 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-01-03T12:56:49.931 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../05-libaio-dev_0.3.110-5ubuntu0.1_amd64.deb ... 2021-01-03T12:56:50.105 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-03T12:56:50.106 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-03T12:56:50.185 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-01-03T12:56:50.317 INFO:teuthology.orchestra.run.smithi007.stdout:ureadahead will be reprofiled on next reboot 2021-01-03T12:56:50.337 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-01-03T12:56:50.378 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-01-03T12:56:50.388 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-k8sevents (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:50.497 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-dashboard (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:50.575 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2021-01-03T12:56:50.588 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../06-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2021-01-03T12:56:50.625 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-01-03T12:56:50.631 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph (15.2.8-57-g2eacca1e-1bionic) ... 2021-01-03T12:56:50.791 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for systemd (237-3ubuntu10.43) ... 2021-01-03T12:56:50.850 INFO:teuthology.orchestra.run.smithi007.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-03T12:56:50.852 DEBUG:teuthology.orchestra.run.smithi007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-01-03T12:56:50.895 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-01-03T12:56:50.908 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../07-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2021-01-03T12:56:50.939 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2021-01-03T12:56:50.953 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-01-03T12:56:51.185 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-01-03T12:56:51.217 INFO:teuthology.orchestra.run.smithi007.stdout:Building dependency tree... 2021-01-03T12:56:51.218 INFO:teuthology.orchestra.run.smithi007.stdout:Reading state information... 2021-01-03T12:56:51.297 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libfl2:amd64. 2021-01-03T12:56:51.310 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../08-libfl2_2.6.4-6_amd64.deb ... 2021-01-03T12:56:51.389 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2021-01-03T12:56:51.406 INFO:teuthology.orchestra.run.smithi007.stdout:libtool-bin is already the newest version (2.4.6-2). 2021-01-03T12:56:51.407 INFO:teuthology.orchestra.run.smithi007.stdout:xfslibs-dev is already the newest version (4.9.0+nmu1ubuntu2). 2021-01-03T12:56:51.407 INFO:teuthology.orchestra.run.smithi007.stdout:uuid-dev is already the newest version (2.31.1-0.4ubuntu3.7). 2021-01-03T12:56:51.407 INFO:teuthology.orchestra.run.smithi007.stdout:The following additional packages will be installed: 2021-01-03T12:56:51.408 INFO:teuthology.orchestra.run.smithi007.stdout: libbison-dev libfl-dev libfl2 zlib1g-dev 2021-01-03T12:56:51.409 INFO:teuthology.orchestra.run.smithi007.stdout:Suggested packages: 2021-01-03T12:56:51.409 INFO:teuthology.orchestra.run.smithi007.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-01-03T12:56:51.437 INFO:teuthology.orchestra.run.smithi007.stdout:The following NEW packages will be installed: 2021-01-03T12:56:51.438 INFO:teuthology.orchestra.run.smithi007.stdout: bison dump flex indent libaio-dev libbison-dev libelf-dev libfl-dev libfl2 2021-01-03T12:56:51.439 INFO:teuthology.orchestra.run.smithi007.stdout: libssl-dev zlib1g-dev 2021-01-03T12:56:51.622 INFO:teuthology.orchestra.run.smithi007.stdout:0 upgraded, 11 newly installed, 0 to remove and 0 not upgraded. 2021-01-03T12:56:51.622 INFO:teuthology.orchestra.run.smithi007.stdout:Need to get 2,960 kB of archives. 2021-01-03T12:56:51.622 INFO:teuthology.orchestra.run.smithi007.stdout:After this operation, 12.2 MB of additional disk space will be used. 2021-01-03T12:56:51.623 INFO:teuthology.orchestra.run.smithi007.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2021-01-03T12:56:51.633 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-01-03T12:56:51.646 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6_amd64.deb ... 2021-01-03T12:56:51.675 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2021-01-03T12:56:51.814 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-01-03T12:56:51.852 INFO:teuthology.orchestra.run.smithi036.stdout:ureadahead will be reprofiled on next reboot 2021-01-03T12:56:51.906 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-01-03T12:56:51.911 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-01-03T12:56:51.924 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../10-libssl-dev_1.1.1-1ubuntu2.1~18.04.7_amd64.deb ... 2021-01-03T12:56:51.961 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-01-03T12:56:52.113 INFO:teuthology.orchestra.run.smithi007.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2021-01-03T12:56:52.201 INFO:teuthology.orchestra.run.smithi007.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2021-01-03T12:56:52.251 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 dump amd64 0.4b46-3 [129 kB] 2021-01-03T12:56:52.270 INFO:teuthology.orchestra.run.smithi007.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 indent amd64 2.2.11-5 [80.7 kB] 2021-01-03T12:56:52.278 INFO:teuthology.orchestra.run.smithi007.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libaio-dev amd64 0.3.110-5ubuntu0.1 [12.8 kB] 2021-01-03T12:56:52.279 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2021-01-03T12:56:52.292 INFO:teuthology.orchestra.run.smithi007.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2021-01-03T12:56:52.297 INFO:teuthology.orchestra.run.smithi007.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2021-01-03T12:56:52.298 INFO:teuthology.orchestra.run.smithi007.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2021-01-03T12:56:52.298 INFO:teuthology.orchestra.run.smithi007.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.7 [1,566 kB] 2021-01-03T12:56:52.356 INFO:teuthology.orchestra.run.smithi036.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-03T12:56:52.358 DEBUG:teuthology.orchestra.run.smithi036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-01-03T12:56:52.421 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up flex (2.6.4-6) ... 2021-01-03T12:56:52.442 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2021-01-03T12:56:52.558 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up dump (0.4b46-3) ... 2021-01-03T12:56:52.664 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-01-03T12:56:52.721 INFO:teuthology.orchestra.run.smithi036.stdout:Building dependency tree... 2021-01-03T12:56:52.722 INFO:teuthology.orchestra.run.smithi036.stdout:Reading state information... 2021-01-03T12:56:52.734 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-01-03T12:56:52.791 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 2,960 kB in 1s (3,144 kB/s) 2021-01-03T12:56:52.860 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up indent (2.2.11-5) ... 2021-01-03T12:56:52.908 INFO:teuthology.orchestra.run.smithi036.stdout:libtool-bin is already the newest version (2.4.6-2). 2021-01-03T12:56:52.909 INFO:teuthology.orchestra.run.smithi036.stdout:xfslibs-dev is already the newest version (4.9.0+nmu1ubuntu2). 2021-01-03T12:56:52.909 INFO:teuthology.orchestra.run.smithi036.stdout:uuid-dev is already the newest version (2.31.1-0.4ubuntu3.7). 2021-01-03T12:56:52.909 INFO:teuthology.orchestra.run.smithi036.stdout:The following additional packages will be installed: 2021-01-03T12:56:52.910 INFO:teuthology.orchestra.run.smithi036.stdout: libbison-dev libfl-dev libfl2 zlib1g-dev 2021-01-03T12:56:52.911 INFO:teuthology.orchestra.run.smithi036.stdout:Suggested packages: 2021-01-03T12:56:52.911 INFO:teuthology.orchestra.run.smithi036.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-01-03T12:56:52.937 INFO:teuthology.orchestra.run.smithi036.stdout:The following NEW packages will be installed: 2021-01-03T12:56:52.938 INFO:teuthology.orchestra.run.smithi036.stdout: bison dump flex indent libaio-dev libbison-dev libelf-dev libfl-dev libfl2 2021-01-03T12:56:52.939 INFO:teuthology.orchestra.run.smithi036.stdout: libssl-dev zlib1g-dev 2021-01-03T12:56:52.951 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package flex. 2021-01-03T12:56:52.986 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-01-03T12:56:52.993 INFO:teuthology.orchestra.run.smithi007.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109924 files and directories currently installed.) 2021-01-03T12:56:52.996 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../00-flex_2.6.4-6_amd64.deb ... 2021-01-03T12:56:53.041 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking flex (2.6.4-6) ... 2021-01-03T12:56:53.118 INFO:teuthology.orchestra.run.smithi036.stdout:0 upgraded, 11 newly installed, 0 to remove and 0 not upgraded. 2021-01-03T12:56:53.118 INFO:teuthology.orchestra.run.smithi036.stdout:Need to get 2,960 kB of archives. 2021-01-03T12:56:53.119 INFO:teuthology.orchestra.run.smithi036.stdout:After this operation, 12.2 MB of additional disk space will be used. 2021-01-03T12:56:53.119 INFO:teuthology.orchestra.run.smithi036.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2021-01-03T12:56:53.128 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2021-01-03T12:56:53.255 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2021-01-03T12:56:53.304 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-01-03T12:56:53.345 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-01-03T12:56:53.345 INFO:teuthology.orchestra.run.smithi016.stdout:ureadahead will be reprofiled on next reboot 2021-01-03T12:56:53.396 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-01-03T12:56:53.406 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-01-03T12:56:53.412 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libbison-dev:amd64. 2021-01-03T12:56:53.424 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../01-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-01-03T12:56:53.462 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-01-03T12:56:53.524 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-01-03T12:56:53.551 INFO:teuthology.orchestra.run.smithi036.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2021-01-03T12:56:53.632 INFO:teuthology.orchestra.run.smithi036.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2021-01-03T12:56:53.650 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-01-03T12:56:53.687 INFO:teuthology.orchestra.run.smithi036.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 dump amd64 0.4b46-3 [129 kB] 2021-01-03T12:56:53.706 INFO:teuthology.orchestra.run.smithi036.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 indent amd64 2.2.11-5 [80.7 kB] 2021-01-03T12:56:53.712 INFO:teuthology.orchestra.run.smithi036.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libaio-dev amd64 0.3.110-5ubuntu0.1 [12.8 kB] 2021-01-03T12:56:53.713 INFO:teuthology.orchestra.run.smithi036.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2021-01-03T12:56:53.727 INFO:teuthology.orchestra.run.smithi036.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2021-01-03T12:56:53.731 INFO:teuthology.orchestra.run.smithi036.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2021-01-03T12:56:53.732 INFO:teuthology.orchestra.run.smithi036.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2021-01-03T12:56:53.734 INFO:teuthology.orchestra.run.smithi036.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.7 [1,566 kB] 2021-01-03T12:56:53.796 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2021-01-03T12:56:53.837 INFO:teuthology.orchestra.run.smithi016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-03T12:56:53.839 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2021-01-03T12:56:53.840 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package bison. 2021-01-03T12:56:53.853 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../02-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-01-03T12:56:53.894 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2021-01-03T12:56:53.919 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-01-03T12:56:53.924 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2021-01-03T12:56:54.188 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2021-01-03T12:56:54.188 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2021-01-03T12:56:54.235 INFO:teuthology.orchestra.run.smithi036.stdout:Fetched 2,960 kB in 1s (3,356 kB/s) 2021-01-03T12:56:54.252 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package dump. 2021-01-03T12:56:54.264 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../03-dump_0.4b46-3_amd64.deb ... 2021-01-03T12:56:54.302 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking dump (0.4b46-3) ... 2021-01-03T12:56:54.378 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package flex. 2021-01-03T12:56:54.382 INFO:teuthology.orchestra.run.smithi016.stdout:libtool-bin is already the newest version (2.4.6-2). 2021-01-03T12:56:54.382 INFO:teuthology.orchestra.run.smithi016.stdout:xfslibs-dev is already the newest version (4.9.0+nmu1ubuntu2). 2021-01-03T12:56:54.382 INFO:teuthology.orchestra.run.smithi016.stdout:uuid-dev is already the newest version (2.31.1-0.4ubuntu3.7). 2021-01-03T12:56:54.382 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2021-01-03T12:56:54.383 INFO:teuthology.orchestra.run.smithi016.stdout: libbison-dev libfl-dev libfl2 zlib1g-dev 2021-01-03T12:56:54.385 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2021-01-03T12:56:54.385 INFO:teuthology.orchestra.run.smithi016.stdout: bison-doc flex-doc indent-doc libssl-doc 2021-01-03T12:56:54.412 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2021-01-03T12:56:54.413 INFO:teuthology.orchestra.run.smithi016.stdout: bison dump flex indent libaio-dev libbison-dev libelf-dev libfl-dev libfl2 2021-01-03T12:56:54.413 INFO:teuthology.orchestra.run.smithi016.stdout: libssl-dev zlib1g-dev 2021-01-03T12:56:54.418 INFO:teuthology.orchestra.run.smithi036.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109924 files and directories currently installed.) 2021-01-03T12:56:54.421 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../00-flex_2.6.4-6_amd64.deb ... 2021-01-03T12:56:54.460 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking flex (2.6.4-6) ... 2021-01-03T12:56:54.572 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package indent. 2021-01-03T12:56:54.585 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../04-indent_2.2.11-5_amd64.deb ... 2021-01-03T12:56:54.594 INFO:teuthology.orchestra.run.smithi016.stdout:0 upgraded, 11 newly installed, 0 to remove and 0 not upgraded. 2021-01-03T12:56:54.594 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 2,960 kB of archives. 2021-01-03T12:56:54.594 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 12.2 MB of additional disk space will be used. 2021-01-03T12:56:54.595 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2021-01-03T12:56:54.647 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking indent (2.2.11-5) ... 2021-01-03T12:56:54.864 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libbison-dev:amd64. 2021-01-03T12:56:54.876 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../01-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-01-03T12:56:54.910 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-01-03T12:56:54.914 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-01-03T12:56:54.924 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../05-libaio-dev_0.3.110-5ubuntu0.1_amd64.deb ... 2021-01-03T12:56:54.968 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-01-03T12:56:55.036 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2021-01-03T12:56:55.114 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2021-01-03T12:56:55.158 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 dump amd64 0.4b46-3 [129 kB] 2021-01-03T12:56:55.173 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 indent amd64 2.2.11-5 [80.7 kB] 2021-01-03T12:56:55.182 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libaio-dev amd64 0.3.110-5ubuntu0.1 [12.8 kB] 2021-01-03T12:56:55.184 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2021-01-03T12:56:55.204 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2021-01-03T12:56:55.209 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2021-01-03T12:56:55.210 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2021-01-03T12:56:55.210 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.7 [1,566 kB] 2021-01-03T12:56:55.216 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package bison. 2021-01-03T12:56:55.228 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../02-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-01-03T12:56:55.238 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2021-01-03T12:56:55.250 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../06-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2021-01-03T12:56:55.262 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2021-01-03T12:56:55.288 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-01-03T12:56:55.654 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package dump. 2021-01-03T12:56:55.655 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2021-01-03T12:56:55.665 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../03-dump_0.4b46-3_amd64.deb ... 2021-01-03T12:56:55.702 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 2,960 kB in 1s (3,400 kB/s) 2021-01-03T12:56:55.703 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking dump (0.4b46-3) ... 2021-01-03T12:56:55.836 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package flex. 2021-01-03T12:56:55.878 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109924 files and directories currently installed.) 2021-01-03T12:56:55.881 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../00-flex_2.6.4-6_amd64.deb ... 2021-01-03T12:56:55.900 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-01-03T12:56:55.912 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../07-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2021-01-03T12:56:55.950 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-01-03T12:56:55.964 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-01-03T12:56:55.981 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking flex (2.6.4-6) ... 2021-01-03T12:56:56.024 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package indent. 2021-01-03T12:56:56.037 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../04-indent_2.2.11-5_amd64.deb ... 2021-01-03T12:56:56.074 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking indent (2.2.11-5) ... 2021-01-03T12:56:56.278 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libfl2:amd64. 2021-01-03T12:56:56.292 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../08-libfl2_2.6.4-6_amd64.deb ... 2021-01-03T12:56:56.354 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2021-01-03T12:56:56.368 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-01-03T12:56:56.381 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../05-libaio-dev_0.3.110-5ubuntu0.1_amd64.deb ... 2021-01-03T12:56:56.408 INFO:teuthology.orchestra.run.smithi133.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-03T12:56:56.410 DEBUG:teuthology.parallel:result is None 2021-01-03T12:56:56.418 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-01-03T12:56:56.506 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libbison-dev:amd64. 2021-01-03T12:56:56.518 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../01-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-01-03T12:56:56.556 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-01-03T12:56:56.598 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-01-03T12:56:56.611 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6_amd64.deb ... 2021-01-03T12:56:56.648 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2021-01-03T12:56:56.679 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2021-01-03T12:56:56.690 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../06-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2021-01-03T12:56:56.729 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-01-03T12:56:56.900 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package bison. 2021-01-03T12:56:56.913 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../02-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2021-01-03T12:56:56.934 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-01-03T12:56:56.946 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../10-libssl-dev_1.1.1-1ubuntu2.1~18.04.7_amd64.deb ... 2021-01-03T12:56:56.954 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2021-01-03T12:56:56.984 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-01-03T12:56:57.024 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-01-03T12:56:57.036 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../07-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2021-01-03T12:56:57.074 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-01-03T12:56:57.337 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package dump. 2021-01-03T12:56:57.351 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../03-dump_0.4b46-3_amd64.deb ... 2021-01-03T12:56:57.377 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libfl2:amd64. 2021-01-03T12:56:57.389 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../08-libfl2_2.6.4-6_amd64.deb ... 2021-01-03T12:56:57.395 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking dump (0.4b46-3) ... 2021-01-03T12:56:57.460 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2021-01-03T12:56:57.461 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up flex (2.6.4-6) ... 2021-01-03T12:56:57.572 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up dump (0.4b46-3) ... 2021-01-03T12:56:57.660 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-01-03T12:56:57.666 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package indent. 2021-01-03T12:56:57.679 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../04-indent_2.2.11-5_amd64.deb ... 2021-01-03T12:56:57.716 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking indent (2.2.11-5) ... 2021-01-03T12:56:57.721 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-01-03T12:56:57.733 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6_amd64.deb ... 2021-01-03T12:56:57.757 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-01-03T12:56:57.771 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2021-01-03T12:56:57.884 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up indent (2.2.11-5) ... 2021-01-03T12:56:57.985 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libaio-dev:amd64. 2021-01-03T12:56:57.997 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../05-libaio-dev_0.3.110-5ubuntu0.1_amd64.deb ... 2021-01-03T12:56:58.010 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-01-03T12:56:58.024 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-01-03T12:56:58.035 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../10-libssl-dev_1.1.1-1ubuntu2.1~18.04.7_amd64.deb ... 2021-01-03T12:56:58.035 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-01-03T12:56:58.074 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-01-03T12:56:58.136 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2021-01-03T12:56:58.287 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2021-01-03T12:56:58.297 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2021-01-03T12:56:58.309 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../06-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2021-01-03T12:56:58.347 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-01-03T12:56:58.377 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-01-03T12:56:58.447 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-01-03T12:56:58.531 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up flex (2.6.4-6) ... 2021-01-03T12:56:58.565 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-01-03T12:56:58.642 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libelf-dev:amd64. 2021-01-03T12:56:58.653 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up dump (0.4b46-3) ... 2021-01-03T12:56:58.655 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../07-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2021-01-03T12:56:58.665 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-01-03T12:56:58.700 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-01-03T12:56:58.752 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-01-03T12:56:58.817 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2021-01-03T12:56:58.821 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-01-03T12:56:58.944 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-01-03T12:56:58.947 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up indent (2.2.11-5) ... 2021-01-03T12:56:59.045 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libfl2:amd64. 2021-01-03T12:56:59.057 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../08-libfl2_2.6.4-6_amd64.deb ... 2021-01-03T12:56:59.073 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-01-03T12:56:59.137 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2021-01-03T12:56:59.174 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2021-01-03T12:56:59.284 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2021-01-03T12:56:59.374 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-01-03T12:56:59.390 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libfl-dev:amd64. 2021-01-03T12:56:59.402 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6_amd64.deb ... 2021-01-03T12:56:59.440 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2021-01-03T12:56:59.443 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-01-03T12:56:59.569 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-01-03T12:56:59.659 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libssl-dev:amd64. 2021-01-03T12:56:59.673 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../10-libssl-dev_1.1.1-1ubuntu2.1~18.04.7_amd64.deb ... 2021-01-03T12:56:59.695 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-01-03T12:56:59.709 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-01-03T12:56:59.821 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2021-01-03T12:56:59.948 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-01-03T12:57:00.159 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up flex (2.6.4-6) ... 2021-01-03T12:57:00.272 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up dump (0.4b46-3) ... 2021-01-03T12:57:00.368 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2021-01-03T12:57:00.441 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.7) ... 2021-01-03T12:57:00.567 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up indent (2.2.11-5) ... 2021-01-03T12:57:00.671 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2021-01-03T12:57:00.693 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2021-01-03T12:57:00.819 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2021-01-03T12:57:00.945 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2021-01-03T12:57:01.035 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2021-01-03T12:57:01.057 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-01-03T12:57:01.164 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2021-01-03T12:57:01.265 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2021-01-03T12:57:01.383 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2021-01-03T12:57:01.509 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2021-01-03T12:57:01.510 INFO:teuthology.orchestra.run.smithi007.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-03T12:57:01.513 DEBUG:teuthology.parallel:result is None 2021-01-03T12:57:01.635 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-01-03T12:57:01.684 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2021-01-03T12:57:02.018 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-01-03T12:57:02.466 INFO:teuthology.orchestra.run.smithi036.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-03T12:57:02.468 DEBUG:teuthology.parallel:result is None 2021-01-03T12:57:03.488 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2021-01-03T12:57:03.823 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.4) ... 2021-01-03T12:57:04.266 INFO:teuthology.orchestra.run.smithi016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-03T12:57:04.269 DEBUG:teuthology.parallel:result is None 2021-01-03T12:57:04.269 DEBUG:teuthology.orchestra.run.smithi133:> sudo lsb_release -is 2021-01-03T12:57:04.325 INFO:teuthology.orchestra.run.smithi133.stdout:Ubuntu 2021-01-03T12:57:04.331 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-03T12:57:04.331 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e 2021-01-03T12:57:04.502 DEBUG:teuthology.orchestra.run.smithi133:> dpkg-query -W -f '${Version}' ceph 2021-01-03T12:57:04.526 INFO:teuthology.orchestra.run.smithi133.stdout:15.2.8-57-g2eacca1e-1bionic 2021-01-03T12:57:04.527 INFO:teuthology.packaging:The installed version of ceph is 15.2.8-57-g2eacca1e-1bionic 2021-01-03T12:57:04.527 INFO:teuthology.task.install:The correct ceph version 15.2.8-57-g2eacca1e-1bionic is installed. 2021-01-03T12:57:04.527 DEBUG:teuthology.orchestra.run.smithi016:> sudo lsb_release -is 2021-01-03T12:57:04.583 INFO:teuthology.orchestra.run.smithi016.stdout:Ubuntu 2021-01-03T12:57:04.589 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-03T12:57:04.589 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e 2021-01-03T12:57:04.753 DEBUG:teuthology.orchestra.run.smithi016:> dpkg-query -W -f '${Version}' ceph 2021-01-03T12:57:04.779 INFO:teuthology.orchestra.run.smithi016.stdout:15.2.8-57-g2eacca1e-1bionic 2021-01-03T12:57:04.779 INFO:teuthology.packaging:The installed version of ceph is 15.2.8-57-g2eacca1e-1bionic 2021-01-03T12:57:04.780 INFO:teuthology.task.install:The correct ceph version 15.2.8-57-g2eacca1e-1bionic is installed. 2021-01-03T12:57:04.780 DEBUG:teuthology.orchestra.run.smithi007:> sudo lsb_release -is 2021-01-03T12:57:04.838 INFO:teuthology.orchestra.run.smithi007.stdout:Ubuntu 2021-01-03T12:57:04.843 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-03T12:57:04.844 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e 2021-01-03T12:57:05.001 DEBUG:teuthology.orchestra.run.smithi007:> dpkg-query -W -f '${Version}' ceph 2021-01-03T12:57:05.025 INFO:teuthology.orchestra.run.smithi007.stdout:15.2.8-57-g2eacca1e-1bionic 2021-01-03T12:57:05.026 INFO:teuthology.packaging:The installed version of ceph is 15.2.8-57-g2eacca1e-1bionic 2021-01-03T12:57:05.026 INFO:teuthology.task.install:The correct ceph version 15.2.8-57-g2eacca1e-1bionic is installed. 2021-01-03T12:57:05.027 DEBUG:teuthology.orchestra.run.smithi036:> sudo lsb_release -is 2021-01-03T12:57:05.084 INFO:teuthology.orchestra.run.smithi036.stdout:Ubuntu 2021-01-03T12:57:05.089 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-03T12:57:05.090 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e 2021-01-03T12:57:05.246 DEBUG:teuthology.orchestra.run.smithi036:> dpkg-query -W -f '${Version}' ceph 2021-01-03T12:57:05.271 INFO:teuthology.orchestra.run.smithi036.stdout:15.2.8-57-g2eacca1e-1bionic 2021-01-03T12:57:05.271 INFO:teuthology.packaging:The installed version of ceph is 15.2.8-57-g2eacca1e-1bionic 2021-01-03T12:57:05.272 INFO:teuthology.task.install:The correct ceph version 15.2.8-57-g2eacca1e-1bionic is installed. 2021-01-03T12:57:05.272 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-01-03T12:57:05.272 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2021-01-03T12:57:05.273 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-01-03T12:57:05.288 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2021-01-03T12:57:05.288 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-01-03T12:57:05.304 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2021-01-03T12:57:05.304 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-01-03T12:57:05.319 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2021-01-03T12:57:05.320 DEBUG:teuthology.orchestra.run.smithi036:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-01-03T12:57:05.335 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-01-03T12:57:05.336 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2021-01-03T12:57:05.336 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2021-01-03T12:57:05.349 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-01-03T12:57:05.405 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2021-01-03T12:57:05.405 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2021-01-03T12:57:05.420 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-01-03T12:57:05.475 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2021-01-03T12:57:05.476 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2021-01-03T12:57:05.491 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-01-03T12:57:05.549 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2021-01-03T12:57:05.550 DEBUG:teuthology.orchestra.run.smithi036:> sudo dd of=/usr/bin/daemon-helper 2021-01-03T12:57:05.564 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-01-03T12:57:05.618 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-01-03T12:57:05.619 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2021-01-03T12:57:05.619 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2021-01-03T12:57:05.634 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-01-03T12:57:05.689 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2021-01-03T12:57:05.689 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2021-01-03T12:57:05.704 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-01-03T12:57:05.761 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2021-01-03T12:57:05.761 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2021-01-03T12:57:05.778 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-01-03T12:57:05.838 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2021-01-03T12:57:05.839 DEBUG:teuthology.orchestra.run.smithi036:> sudo dd of=/usr/bin/adjust-ulimits 2021-01-03T12:57:05.856 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-01-03T12:57:05.911 INFO:teuthology.run_tasks:Running task ceph... 2021-01-03T12:57:05.991 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-01-03T12:57:05.992 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /var/log/ceph 2021-01-03T12:57:05.995 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /var/log/ceph 2021-01-03T12:57:05.997 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 777 /var/log/ceph 2021-01-03T12:57:06.000 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /var/log/ceph 2021-01-03T12:57:06.051 INFO:tasks.ceph:Disabling ceph logrotate... 2021-01-03T12:57:06.052 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/logrotate.d/ceph 2021-01-03T12:57:06.054 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/logrotate.d/ceph 2021-01-03T12:57:06.056 DEBUG:teuthology.orchestra.run.smithi036:> sudo rm -f -- /etc/logrotate.d/ceph 2021-01-03T12:57:06.059 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/logrotate.d/ceph 2021-01-03T12:57:06.073 INFO:tasks.ceph:Creating extra log directories... 2021-01-03T12:57:06.073 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-01-03T12:57:06.109 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-01-03T12:57:06.112 DEBUG:teuthology.orchestra.run.smithi036:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-01-03T12:57:06.114 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-01-03T12:57:06.130 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2021-01-03T12:57:06.131 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2021-01-03T12:57:06.131 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2021-01-03T12:57:06.131 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2021-01-03T12:57:06.132 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-01-03T12:57:06.177 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-01-03T12:57:06.256 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2021-01-03T12:57:06.256 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-01-03T12:57:06.263 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-01-03T12:57:06.343 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2021-01-03T12:57:06.343 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-01-03T12:57:06.350 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-01-03T12:57:06.428 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2021-01-03T12:57:06.428 DEBUG:teuthology.orchestra.run.smithi036:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2021-01-03T12:57:06.435 DEBUG:teuthology.orchestra.run.smithi036:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2021-01-03T12:57:06.513 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-01-03T12:57:06.513 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-01-03T12:57:06.514 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047', 'branch': 'octopus', 'description': 'fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '5752047', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '18.04', 'overrides': {'admin_socket': {'branch': 'octopus'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'sha1': '2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': '2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'octopus', 'sha1': '2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 1000, 'repo': 'git://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1']], 'sha1': '2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'octopus', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_octopus/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph.git', 'suite_sha1': '2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (4, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_misc']}}], 'teuthology_branch': 'master', 'timestamp': '2021-01-03_04:10:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.4370', 'targets': {'smithi133.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDciI2lV3NHsKiA4JA9afsnMRR1tlBP0uZP2SK36TVPUKwtfBGfBB57OIcIzSFQmcNsQN4WIGlWe9VgZdVfwaH+ucXgwjZV7GXz3AUYYNKagKV+lNdbgvLXDAxKdwUxFcEVCcjFXA5fEWfuED2ZbosjdoJPSYOElC0Erc/oGaGgXbMdDsTjtCfTShcsDVvy0r8ntRzKy5osPbvOBtnqW8ho5Qznp14XuunUj1EVMUOg6p6aMfuf+m6frrwbx7pxEEBbUoH1Z2sykMUADgB43A+T/C30fgNEJuVG3lX3Yr4Qt1cO2Y4G5/XAlWYIypFnElcrloGFXAqGbrh7tVFlRhiv', 'smithi016.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDGNSVgMClNsMwhmFY1moYuCANCN1aU8Ooiqyd9TN8LG7vWF+K5MXANaQTgL+S2hMxwSyzyQSQIBSopWZWiKbtY4dn6DgvxDNyUnvySC01GHu9O7uZTG27cNBOwudq0Np1uB2pZwomuFiYSJC7ZA0t7TKR72N5t5+oxMvD476UuSCG5+2ZjG5ws99G4ZeRMq4/XRDlO1RqMfxTV2esl3WfwFcCUG4jLI8rej9JWS/aJkKUcfhWTVj5N1AN4KpMaBE8tyIe6O+PCaW6aZSIIXCPu+zB7vwzi8so9bommSjRDpXXoc1gpLrUz4WBWgBDRii1FWfqj7cYveGD9tFEuCHPt', 'smithi007.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5RxZrY6MNoO0UDjdwecJbjMPi6VpX1Pk94MWGlqqIouxkCjybzA1ZwkKklC427cwogL791Cz+w40LCFtsXJ9NNbVdUsJtdXkzg9F9VJLpgMNZcgAQbEh8/aglcYREZyCkiNoKsE1GfzJDY1rIO7mxF0/6MFCeTmJja0/HselyQtwwJfUFwl5CFUjH+2WLQvwaLMyu5gA/KckuBdjsrXDEmKQIV90cRI29Jysa5WtLo9h1XCcEIbentvkdqkipaDOT3jDUyQJBjJBXeOPqVOPrcb1WcPVjDyjJ5wZTPBD2KaK6VhfUdkSsTfPP60AEMytcWbTGP0ziT0DfUm3bPIG3', 'smithi036.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6SuaDIwK1lIQhGUQZYAsmWzFCJLb8rHAPtJmdHrlbXPuCclTebusChAjInrnDDpJmaUfBQXAsWA+8t5Ff16CbuIxEv7BKK0h9rHxaYn1+LQaSw9EaGp2BZ65Yevtx3A2Yb8Nhww0hX0RJQ125GAdRMmc7YtbaUcUydcSDeSBdE1nlAzGNbCH5Tnc0Lj7cOa4PoYbwFDfLhJ6IpKH0jGMUWNwvAN5mgkQIsgwJAko/oclhezZJxYtrCeDF/jt5c8ZwN8oB/9AnGYqCfovDos56oSXFoTrzXUgdhdxHzoTvEHYczJfsUQ0te7XsCYeODOta3AcQjg9maykWZvXDtkw/'}} 2021-01-03T12:57:06.515 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-01-03T12:57:06.517 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-01-03T12:57:06.519 DEBUG:teuthology.orchestra.run.smithi036:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-01-03T12:57:06.558 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-01-03T12:57:06.566 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/run/ceph 2021-01-03T12:57:06.568 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/run/ceph 2021-01-03T12:57:06.570 DEBUG:teuthology.orchestra.run.smithi036:> sudo install -d -m0777 -- /var/run/ceph 2021-01-03T12:57:06.606 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/run/ceph 2021-01-03T12:57:06.622 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2021-01-03T12:57:06.623 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2021-01-03T12:57:06.670 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-01-03T12:57:06.671 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-01-03T12:57:06.718 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-01-03T12:57:06.718 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-03T12:57:06.719 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 342 Links: 1 2021-01-03T12:57:06.719 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-03T12:57:06.719 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2021-01-03 12:53:57.567318430 +0000 2021-01-03T12:57:06.719 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2021-01-03 12:53:57.475318432 +0000 2021-01-03T12:57:06.719 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2021-01-03 12:53:57.475318432 +0000 2021-01-03T12:57:06.720 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2021-01-03T12:57:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2021-01-03T12:57:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2021-01-03T12:57:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000341434 s, 1.5 MB/s 2021-01-03T12:57:06.730 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-01-03T12:57:06.778 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-01-03T12:57:06.778 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-03T12:57:06.778 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 348 Links: 1 2021-01-03T12:57:06.779 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-03T12:57:06.779 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2021-01-03 12:53:57.691318427 +0000 2021-01-03T12:57:06.779 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2021-01-03 12:53:57.687318427 +0000 2021-01-03T12:57:06.779 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2021-01-03 12:53:57.687318427 +0000 2021-01-03T12:57:06.780 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2021-01-03T12:57:06.787 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2021-01-03T12:57:06.788 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2021-01-03T12:57:06.788 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000357757 s, 1.4 MB/s 2021-01-03T12:57:06.791 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-01-03T12:57:06.842 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-01-03T12:57:06.842 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-03T12:57:06.843 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 354 Links: 1 2021-01-03T12:57:06.843 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-03T12:57:06.844 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2021-01-03 12:53:57.927318422 +0000 2021-01-03T12:57:06.844 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2021-01-03 12:53:57.923318422 +0000 2021-01-03T12:57:06.844 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2021-01-03 12:53:57.923318422 +0000 2021-01-03T12:57:06.845 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2021-01-03T12:57:06.851 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2021-01-03T12:57:06.852 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2021-01-03T12:57:06.852 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000386197 s, 1.3 MB/s 2021-01-03T12:57:06.856 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-01-03T12:57:06.906 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-01-03T12:57:06.906 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-03T12:57:06.906 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-01-03T12:57:06.907 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-03T12:57:06.907 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2021-01-03 12:53:58.287318414 +0000 2021-01-03T12:57:06.907 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2021-01-03 12:53:58.171318417 +0000 2021-01-03T12:57:06.907 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2021-01-03 12:53:58.171318417 +0000 2021-01-03T12:57:06.908 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2021-01-03T12:57:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2021-01-03T12:57:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2021-01-03T12:57:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000429931 s, 1.2 MB/s 2021-01-03T12:57:06.918 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-01-03T12:57:06.918 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2021-01-03T12:57:06.919 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2021-01-03T12:57:06.926 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-01-03T12:57:06.926 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-01-03T12:57:06.976 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-01-03T12:57:06.976 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-03T12:57:06.977 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 340 Links: 1 2021-01-03T12:57:06.977 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-03T12:57:06.977 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2021-01-03 12:53:53.843396310 +0000 2021-01-03T12:57:06.977 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2021-01-03 12:53:53.735342310 +0000 2021-01-03T12:57:06.977 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2021-01-03 12:53:53.735342310 +0000 2021-01-03T12:57:06.978 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2021-01-03T12:57:06.986 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2021-01-03T12:57:06.986 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2021-01-03T12:57:06.986 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000292967 s, 1.7 MB/s 2021-01-03T12:57:06.991 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-01-03T12:57:07.040 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-01-03T12:57:07.040 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-03T12:57:07.041 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 347 Links: 1 2021-01-03T12:57:07.041 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-03T12:57:07.041 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2021-01-03 12:53:54.067508306 +0000 2021-01-03T12:57:07.041 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2021-01-03 12:53:53.967458308 +0000 2021-01-03T12:57:07.041 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2021-01-03 12:53:53.967458308 +0000 2021-01-03T12:57:07.042 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2021-01-03T12:57:07.050 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2021-01-03T12:57:07.050 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2021-01-03T12:57:07.050 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000305694 s, 1.7 MB/s 2021-01-03T12:57:07.054 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-01-03T12:57:07.108 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-01-03T12:57:07.108 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-03T12:57:07.109 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 353 Links: 1 2021-01-03T12:57:07.109 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-03T12:57:07.109 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2021-01-03 12:53:54.303626304 +0000 2021-01-03T12:57:07.109 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2021-01-03 12:53:54.207578305 +0000 2021-01-03T12:57:07.109 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2021-01-03 12:53:54.207578305 +0000 2021-01-03T12:57:07.109 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2021-01-03T12:57:07.117 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2021-01-03T12:57:07.118 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2021-01-03T12:57:07.118 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000259182 s, 2.0 MB/s 2021-01-03T12:57:07.121 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-01-03T12:57:07.172 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-01-03T12:57:07.172 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-03T12:57:07.172 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 6h/6d Inode: 359 Links: 1 2021-01-03T12:57:07.172 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-03T12:57:07.173 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2021-01-03 12:53:54.551750302 +0000 2021-01-03T12:57:07.173 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2021-01-03 12:53:54.419684303 +0000 2021-01-03T12:57:07.173 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2021-01-03 12:53:54.419684303 +0000 2021-01-03T12:57:07.173 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: - 2021-01-03T12:57:07.181 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2021-01-03T12:57:07.182 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2021-01-03T12:57:07.182 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000308347 s, 1.7 MB/s 2021-01-03T12:57:07.186 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-01-03T12:57:07.187 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-01-03T12:57:07.187 INFO:tasks.ceph:Generating config... 2021-01-03T12:57:07.188 INFO:tasks.ceph:[client] client mount timeout = 600 2021-01-03T12:57:07.189 INFO:tasks.ceph:[client] debug client = 20 2021-01-03T12:57:07.189 INFO:tasks.ceph:[client] debug ms = 1 2021-01-03T12:57:07.189 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2021-01-03T12:57:07.189 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2021-01-03T12:57:07.190 INFO:tasks.ceph:[mds] debug mds = 20 2021-01-03T12:57:07.190 INFO:tasks.ceph:[mds] debug ms = 1 2021-01-03T12:57:07.190 INFO:tasks.ceph:[mds] mds bal frag = True 2021-01-03T12:57:07.190 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2021-01-03T12:57:07.191 INFO:tasks.ceph:[mds] mds bal merge size = 5 2021-01-03T12:57:07.191 INFO:tasks.ceph:[mds] mds bal split bits = 3 2021-01-03T12:57:07.191 INFO:tasks.ceph:[mds] mds bal split size = 100 2021-01-03T12:57:07.191 INFO:tasks.ceph:[mds] mds debug frag = True 2021-01-03T12:57:07.192 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2021-01-03T12:57:07.192 INFO:tasks.ceph:[mds] mds op complaint time = 180 2021-01-03T12:57:07.192 INFO:tasks.ceph:[mds] mds verify scatter = True 2021-01-03T12:57:07.193 INFO:tasks.ceph:[mds] osd op complaint time = 180 2021-01-03T12:57:07.193 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2021-01-03T12:57:07.193 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2021-01-03T12:57:07.193 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-01-03T12:57:07.194 INFO:tasks.ceph:[mgr] debug ms = 1 2021-01-03T12:57:07.194 INFO:tasks.ceph:[mon] debug mon = 20 2021-01-03T12:57:07.194 INFO:tasks.ceph:[mon] debug ms = 1 2021-01-03T12:57:07.194 INFO:tasks.ceph:[mon] debug paxos = 20 2021-01-03T12:57:07.195 INFO:tasks.ceph:[mon] mon op complaint time = 120 2021-01-03T12:57:07.195 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-01-03T12:57:07.195 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2021-01-03T12:57:07.195 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-01-03T12:57:07.196 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-01-03T12:57:07.196 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-01-03T12:57:07.196 INFO:tasks.ceph:[osd] debug filestore = 20 2021-01-03T12:57:07.197 INFO:tasks.ceph:[osd] debug journal = 20 2021-01-03T12:57:07.197 INFO:tasks.ceph:[osd] debug ms = 20 2021-01-03T12:57:07.197 INFO:tasks.ceph:[osd] debug osd = 25 2021-01-03T12:57:07.197 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-01-03T12:57:07.198 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-01-03T12:57:07.198 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-01-03T12:57:07.198 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-01-03T12:57:07.198 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-01-03T12:57:07.199 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-01-03T12:57:07.199 INFO:tasks.ceph:[osd] osd op complaint time = 180 2021-01-03T12:57:07.199 INFO:tasks.ceph:Setting up mon.a... 2021-01-03T12:57:07.200 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-01-03T12:57:07.231 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.keyring 2021-01-03T12:57:07.234 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-01-03T12:57:07.309 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-01-03T12:57:07.364 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.133'), ('mon.b', '172.21.15.16'), ('mon.c', '[v2:172.21.15.16:3301,v1:172.21.15.16:6790]')] 2021-01-03T12:57:07.364 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.133 --add b 172.21.15.16 --addv c '[v2:172.21.15.16:3301,v1:172.21.15.16:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2021-01-03T12:57:07.445 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-01-03T12:57:07.445 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: generated fsid 80bc9ef3-5820-4b9f-9c57-8f734e4c440e 2021-01-03T12:57:07.445 INFO:teuthology.orchestra.run.smithi133.stdout:epoch 0 2021-01-03T12:57:07.445 INFO:teuthology.orchestra.run.smithi133.stdout:fsid 80bc9ef3-5820-4b9f-9c57-8f734e4c440e 2021-01-03T12:57:07.446 INFO:teuthology.orchestra.run.smithi133.stdout:last_changed 2021-01-03T12:57:07.448696+0000 2021-01-03T12:57:07.446 INFO:teuthology.orchestra.run.smithi133.stdout:created 2021-01-03T12:57:07.448696+0000 2021-01-03T12:57:07.446 INFO:teuthology.orchestra.run.smithi133.stdout:min_mon_release 0 (unknown) 2021-01-03T12:57:07.446 INFO:teuthology.orchestra.run.smithi133.stdout:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2021-01-03T12:57:07.446 INFO:teuthology.orchestra.run.smithi133.stdout:1: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.b 2021-01-03T12:57:07.447 INFO:teuthology.orchestra.run.smithi133.stdout:2: [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] mon.c 2021-01-03T12:57:07.447 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-01-03T12:57:07.448 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 80bc9ef3-5820-4b9f-9c57-8f734e4c440e... 2021-01-03T12:57:07.449 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-01-03T12:57:07.452 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-01-03T12:57:07.454 DEBUG:teuthology.orchestra.run.smithi036:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-01-03T12:57:07.456 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-01-03T12:57:07.494 INFO:teuthology.orchestra.run.smithi036.stdout:[global] 2021-01-03T12:57:07.495 INFO:teuthology.orchestra.run.smithi036.stdout: chdir = "" 2021-01-03T12:57:07.495 INFO:teuthology.orchestra.run.smithi036.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-01-03T12:57:07.495 INFO:teuthology.orchestra.run.smithi036.stdout: auth supported = cephx 2021-01-03T12:57:07.495 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.495 INFO:teuthology.orchestra.run.smithi036.stdout: filestore xattr use omap = true 2021-01-03T12:57:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: mon clock drift allowed = 1.000 2021-01-03T12:57:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: osd crush chooseleaf type = 0 2021-01-03T12:57:07.496 INFO:teuthology.orchestra.run.smithi036.stdout: auth debug = true 2021-01-03T12:57:07.497 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.497 INFO:teuthology.orchestra.run.smithi036.stdout: ms die on old message = true 2021-01-03T12:57:07.497 INFO:teuthology.orchestra.run.smithi036.stdout: ms die on bug = true 2021-01-03T12:57:07.497 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.497 INFO:teuthology.orchestra.run.smithi036.stdout: mon max pg per osd = 10000 # >= luminous 2021-01-03T12:57:07.497 INFO:teuthology.orchestra.run.smithi036.stdout: mon pg warn max object skew = 0 2021-01-03T12:57:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: # disable pg_autoscaler by default for new pools 2021-01-03T12:57:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: osd_pool_default_pg_autoscale_mode = off 2021-01-03T12:57:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.498 INFO:teuthology.orchestra.run.smithi036.stdout: osd pool default size = 2 2021-01-03T12:57:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd allow primary affinity = true 2021-01-03T12:57:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd allow pg remap = true 2021-01-03T12:57:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on legacy crush tunables = false 2021-01-03T12:57:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on crush straw calc version zero = false 2021-01-03T12:57:07.499 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on no sortbitwise = false 2021-01-03T12:57:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on osd down out interval zero = false 2021-01-03T12:57:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on too few osds = false 2021-01-03T12:57:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-01-03T12:57:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_pool_no_redundancy = false 2021-01-03T12:57:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.500 INFO:teuthology.orchestra.run.smithi036.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-01-03T12:57:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: osd default data pool replay window = 5 2021-01-03T12:57:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: mon allow pool delete = true 2021-01-03T12:57:07.501 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: mon cluster log file level = debug 2021-01-03T12:57:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: debug asserts on shutdown = true 2021-01-03T12:57:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: mon health detail to clog = false 2021-01-03T12:57:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: mon host = "172.21.15.133,172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790]" 2021-01-03T12:57:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: fsid = 80bc9ef3-5820-4b9f-9c57-8f734e4c440e 2021-01-03T12:57:07.502 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.503 INFO:teuthology.orchestra.run.smithi036.stdout:[osd] 2021-01-03T12:57:07.503 INFO:teuthology.orchestra.run.smithi036.stdout: osd journal size = 100 2021-01-03T12:57:07.503 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.503 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub load threshold = 5.0 2021-01-03T12:57:07.503 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub max interval = 600 2021-01-03T12:57:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: osd recover clone overlap = true 2021-01-03T12:57:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: osd recovery max chunk = 1048576 2021-01-03T12:57:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug shutdown = true 2021-01-03T12:57:07.504 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug op order = true 2021-01-03T12:57:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug verify stray on activate = true 2021-01-03T12:57:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: osd open classes on start = true 2021-01-03T12:57:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug pg log writeout = true 2021-01-03T12:57:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.505 INFO:teuthology.orchestra.run.smithi036.stdout: osd deep scrub update digest min age = 30 2021-01-03T12:57:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: osd map max advance = 10 2021-01-03T12:57:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: journal zero on create = true 2021-01-03T12:57:07.506 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: filestore ondisk finisher threads = 3 2021-01-03T12:57:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: filestore apply finisher threads = 3 2021-01-03T12:57:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: bdev debug aio = true 2021-01-03T12:57:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug misdirected ops = true 2021-01-03T12:57:07.507 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore block size = 96636764160 2021-01-03T12:57:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore compression mode = aggressive 2021-01-03T12:57:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore fsck on mount = True 2021-01-03T12:57:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: debug bluefs = 20 2021-01-03T12:57:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: debug bluestore = 20 2021-01-03T12:57:07.508 INFO:teuthology.orchestra.run.smithi036.stdout: debug filestore = 20 2021-01-03T12:57:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: debug journal = 20 2021-01-03T12:57:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 20 2021-01-03T12:57:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: debug osd = 25 2021-01-03T12:57:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: debug rocksdb = 10 2021-01-03T12:57:07.509 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd backfillfull_ratio = 0.85 2021-01-03T12:57:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd full ratio = 0.9 2021-01-03T12:57:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd nearfull ratio = 0.8 2021-01-03T12:57:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: osd failsafe full ratio = 0.95 2021-01-03T12:57:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: osd objectstore = bluestore 2021-01-03T12:57:07.510 INFO:teuthology.orchestra.run.smithi036.stdout: osd op complaint time = 180 2021-01-03T12:57:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.511 INFO:teuthology.orchestra.run.smithi036.stdout:[mgr] 2021-01-03T12:57:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2021-01-03T12:57:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: debug mgr = 20 2021-01-03T12:57:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: debug mon = 20 2021-01-03T12:57:07.511 INFO:teuthology.orchestra.run.smithi036.stdout: debug auth = 20 2021-01-03T12:57:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min pgs per osd = 4 2021-01-03T12:57:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min bytes per osd = 10 2021-01-03T12:57:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: mgr/telemetry/nag = false 2021-01-03T12:57:07.512 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.512 INFO:teuthology.orchestra.run.smithi036.stdout:[mon] 2021-01-03T12:57:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2021-01-03T12:57:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: debug mon = 20 2021-01-03T12:57:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: debug paxos = 20 2021-01-03T12:57:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: debug auth = 20 2021-01-03T12:57:07.513 INFO:teuthology.orchestra.run.smithi036.stdout: mon data avail warn = 5 2021-01-03T12:57:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: mon mgr mkfs grace = 240 2021-01-03T12:57:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min pgs per osd = 4 2021-01-03T12:57:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd reporter subtree level = osd 2021-01-03T12:57:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd prime pg temp = true 2021-01-03T12:57:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min bytes per osd = 10 2021-01-03T12:57:07.514 INFO:teuthology.orchestra.run.smithi036.stdout: mon op complaint time = 120 2021-01-03T12:57:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T12:57:07.515 INFO:teuthology.orchestra.run.smithi036.stdout:[client] 2021-01-03T12:57:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: rgw cache enabled = true 2021-01-03T12:57:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: rgw enable ops log = true 2021-01-03T12:57:07.515 INFO:teuthology.orchestra.run.smithi036.stdout: rgw enable usage log = true 2021-01-03T12:57:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-01-03T12:57:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-01-03T12:57:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: client mount timeout = 600 2021-01-03T12:57:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: debug client = 20 2021-01-03T12:57:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2021-01-03T12:57:07.516 INFO:teuthology.orchestra.run.smithi036.stdout: rados mon op timeout = 15m 2021-01-03T12:57:07.517 INFO:teuthology.orchestra.run.smithi036.stdout: rados osd op timeout = 15m 2021-01-03T12:57:07.517 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.a] 2021-01-03T12:57:07.517 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.b] 2021-01-03T12:57:07.517 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.c] 2021-01-03T12:57:07.517 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.a] 2021-01-03T12:57:07.517 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.c] 2021-01-03T12:57:07.518 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.b] 2021-01-03T12:57:07.518 INFO:teuthology.orchestra.run.smithi036.stdout:[mds] 2021-01-03T12:57:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: debug mds = 20 2021-01-03T12:57:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2021-01-03T12:57:07.518 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal frag = True 2021-01-03T12:57:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal fragment size max = 10000 2021-01-03T12:57:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal merge size = 5 2021-01-03T12:57:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal split bits = 3 2021-01-03T12:57:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal split size = 100 2021-01-03T12:57:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: mds debug frag = True 2021-01-03T12:57:07.519 INFO:teuthology.orchestra.run.smithi036.stdout: mds debug scatterstat = True 2021-01-03T12:57:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: mds op complaint time = 180 2021-01-03T12:57:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: mds verify scatter = True 2021-01-03T12:57:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: osd op complaint time = 180 2021-01-03T12:57:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: rados mon op timeout = 15m 2021-01-03T12:57:07.520 INFO:teuthology.orchestra.run.smithi036.stdout: rados osd op timeout = 15m 2021-01-03T12:57:07.520 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2021-01-03T12:57:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: chdir = "" 2021-01-03T12:57:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-01-03T12:57:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: auth supported = cephx 2021-01-03T12:57:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: filestore xattr use omap = true 2021-01-03T12:57:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: mon clock drift allowed = 1.000 2021-01-03T12:57:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: osd crush chooseleaf type = 0 2021-01-03T12:57:07.522 INFO:teuthology.orchestra.run.smithi016.stdout: auth debug = true 2021-01-03T12:57:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on old message = true 2021-01-03T12:57:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on bug = true 2021-01-03T12:57:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: mon max pg per osd = 10000 # >= luminous 2021-01-03T12:57:07.523 INFO:teuthology.orchestra.run.smithi016.stdout: mon pg warn max object skew = 0 2021-01-03T12:57:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: # disable pg_autoscaler by default for new pools 2021-01-03T12:57:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: osd_pool_default_pg_autoscale_mode = off 2021-01-03T12:57:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.524 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default size = 2 2021-01-03T12:57:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow primary affinity = true 2021-01-03T12:57:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow pg remap = true 2021-01-03T12:57:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on legacy crush tunables = false 2021-01-03T12:57:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on crush straw calc version zero = false 2021-01-03T12:57:07.525 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on no sortbitwise = false 2021-01-03T12:57:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on osd down out interval zero = false 2021-01-03T12:57:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on too few osds = false 2021-01-03T12:57:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-01-03T12:57:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_no_redundancy = false 2021-01-03T12:57:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.526 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-01-03T12:57:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: osd default data pool replay window = 5 2021-01-03T12:57:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: mon allow pool delete = true 2021-01-03T12:57:07.527 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: mon cluster log file level = debug 2021-01-03T12:57:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: debug asserts on shutdown = true 2021-01-03T12:57:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: mon health detail to clog = false 2021-01-03T12:57:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: mon host = "172.21.15.133,172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790]" 2021-01-03T12:57:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = 80bc9ef3-5820-4b9f-9c57-8f734e4c440e 2021-01-03T12:57:07.528 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.529 INFO:teuthology.orchestra.run.smithi016.stdout:[osd] 2021-01-03T12:57:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: osd journal size = 100 2021-01-03T12:57:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub load threshold = 5.0 2021-01-03T12:57:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub max interval = 600 2021-01-03T12:57:07.529 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: osd recover clone overlap = true 2021-01-03T12:57:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: osd recovery max chunk = 1048576 2021-01-03T12:57:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug shutdown = true 2021-01-03T12:57:07.530 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug op order = true 2021-01-03T12:57:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug verify stray on activate = true 2021-01-03T12:57:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: osd open classes on start = true 2021-01-03T12:57:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug pg log writeout = true 2021-01-03T12:57:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.531 INFO:teuthology.orchestra.run.smithi016.stdout: osd deep scrub update digest min age = 30 2021-01-03T12:57:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: osd map max advance = 10 2021-01-03T12:57:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: journal zero on create = true 2021-01-03T12:57:07.532 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: filestore ondisk finisher threads = 3 2021-01-03T12:57:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: filestore apply finisher threads = 3 2021-01-03T12:57:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: bdev debug aio = true 2021-01-03T12:57:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug misdirected ops = true 2021-01-03T12:57:07.533 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore block size = 96636764160 2021-01-03T12:57:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore compression mode = aggressive 2021-01-03T12:57:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore fsck on mount = True 2021-01-03T12:57:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluefs = 20 2021-01-03T12:57:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluestore = 20 2021-01-03T12:57:07.534 INFO:teuthology.orchestra.run.smithi016.stdout: debug filestore = 20 2021-01-03T12:57:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: debug journal = 20 2021-01-03T12:57:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 20 2021-01-03T12:57:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: debug osd = 25 2021-01-03T12:57:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: debug rocksdb = 10 2021-01-03T12:57:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd backfillfull_ratio = 0.85 2021-01-03T12:57:07.535 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd full ratio = 0.9 2021-01-03T12:57:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd nearfull ratio = 0.8 2021-01-03T12:57:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: osd failsafe full ratio = 0.95 2021-01-03T12:57:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: osd objectstore = bluestore 2021-01-03T12:57:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2021-01-03T12:57:07.536 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.537 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr] 2021-01-03T12:57:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2021-01-03T12:57:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: debug mgr = 20 2021-01-03T12:57:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2021-01-03T12:57:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2021-01-03T12:57:07.537 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2021-01-03T12:57:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2021-01-03T12:57:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: mgr/telemetry/nag = false 2021-01-03T12:57:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.538 INFO:teuthology.orchestra.run.smithi016.stdout:[mon] 2021-01-03T12:57:07.538 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2021-01-03T12:57:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2021-01-03T12:57:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: debug paxos = 20 2021-01-03T12:57:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2021-01-03T12:57:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: mon data avail warn = 5 2021-01-03T12:57:07.539 INFO:teuthology.orchestra.run.smithi016.stdout: mon mgr mkfs grace = 240 2021-01-03T12:57:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2021-01-03T12:57:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd reporter subtree level = osd 2021-01-03T12:57:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd prime pg temp = true 2021-01-03T12:57:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2021-01-03T12:57:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: mon op complaint time = 120 2021-01-03T12:57:07.540 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T12:57:07.541 INFO:teuthology.orchestra.run.smithi016.stdout:[client] 2021-01-03T12:57:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: rgw cache enabled = true 2021-01-03T12:57:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable ops log = true 2021-01-03T12:57:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable usage log = true 2021-01-03T12:57:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-01-03T12:57:07.541 INFO:teuthology.orchestra.run.smithi016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-01-03T12:57:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: client mount timeout = 600 2021-01-03T12:57:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2021-01-03T12:57:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2021-01-03T12:57:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 15m 2021-01-03T12:57:07.542 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 15m 2021-01-03T12:57:07.543 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.a] 2021-01-03T12:57:07.543 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.b] 2021-01-03T12:57:07.543 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.c] 2021-01-03T12:57:07.543 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2021-01-03T12:57:07.543 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2021-01-03T12:57:07.543 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2021-01-03T12:57:07.544 INFO:teuthology.orchestra.run.smithi016.stdout:[mds] 2021-01-03T12:57:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds = 20 2021-01-03T12:57:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2021-01-03T12:57:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal frag = True 2021-01-03T12:57:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal fragment size max = 10000 2021-01-03T12:57:07.544 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal merge size = 5 2021-01-03T12:57:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal split bits = 3 2021-01-03T12:57:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal split size = 100 2021-01-03T12:57:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug frag = True 2021-01-03T12:57:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug scatterstat = True 2021-01-03T12:57:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: mds op complaint time = 180 2021-01-03T12:57:07.545 INFO:teuthology.orchestra.run.smithi016.stdout: mds verify scatter = True 2021-01-03T12:57:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2021-01-03T12:57:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 15m 2021-01-03T12:57:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 15m 2021-01-03T12:57:07.546 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2021-01-03T12:57:07.547 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2021-01-03T12:57:07.547 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-01-03T12:57:07.547 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2021-01-03T12:57:07.547 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.547 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2021-01-03T12:57:07.547 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.548 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2021-01-03T12:57:07.548 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.548 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2021-01-03T12:57:07.548 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2021-01-03T12:57:07.548 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.548 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2021-01-03T12:57:07.549 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2021-01-03T12:57:07.549 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.549 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2021-01-03T12:57:07.549 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2021-01-03T12:57:07.549 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.550 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2021-01-03T12:57:07.550 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2021-01-03T12:57:07.550 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.550 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2021-01-03T12:57:07.550 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.550 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2021-01-03T12:57:07.551 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2021-01-03T12:57:07.551 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2021-01-03T12:57:07.551 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2021-01-03T12:57:07.551 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2021-01-03T12:57:07.551 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2021-01-03T12:57:07.551 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2021-01-03T12:57:07.552 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-01-03T12:57:07.552 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2021-01-03T12:57:07.552 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.552 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-01-03T12:57:07.552 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.553 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2021-01-03T12:57:07.553 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.553 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2021-01-03T12:57:07.553 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.553 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2021-01-03T12:57:07.554 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2021-01-03T12:57:07.554 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2021-01-03T12:57:07.554 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "172.21.15.133,172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790]" 2021-01-03T12:57:07.554 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = 80bc9ef3-5820-4b9f-9c57-8f734e4c440e 2021-01-03T12:57:07.554 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.554 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2021-01-03T12:57:07.555 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2021-01-03T12:57:07.555 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.555 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2021-01-03T12:57:07.555 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2021-01-03T12:57:07.555 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.556 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2021-01-03T12:57:07.556 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2021-01-03T12:57:07.556 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.556 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2021-01-03T12:57:07.556 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2021-01-03T12:57:07.556 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2021-01-03T12:57:07.557 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.557 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2021-01-03T12:57:07.557 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2021-01-03T12:57:07.557 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.557 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2021-01-03T12:57:07.557 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.558 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2021-01-03T12:57:07.558 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.558 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2021-01-03T12:57:07.558 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.558 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2021-01-03T12:57:07.559 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2021-01-03T12:57:07.559 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.559 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2021-01-03T12:57:07.559 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2021-01-03T12:57:07.559 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2021-01-03T12:57:07.560 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore compression mode = aggressive 2021-01-03T12:57:07.560 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2021-01-03T12:57:07.560 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 20 2021-01-03T12:57:07.560 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 20 2021-01-03T12:57:07.560 INFO:teuthology.orchestra.run.smithi007.stdout: debug filestore = 20 2021-01-03T12:57:07.560 INFO:teuthology.orchestra.run.smithi007.stdout: debug journal = 20 2021-01-03T12:57:07.561 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 20 2021-01-03T12:57:07.561 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 25 2021-01-03T12:57:07.561 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 10 2021-01-03T12:57:07.561 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2021-01-03T12:57:07.561 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2021-01-03T12:57:07.561 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2021-01-03T12:57:07.562 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2021-01-03T12:57:07.562 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2021-01-03T12:57:07.562 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2021-01-03T12:57:07.562 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.562 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2021-01-03T12:57:07.563 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2021-01-03T12:57:07.563 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2021-01-03T12:57:07.563 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2021-01-03T12:57:07.563 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2021-01-03T12:57:07.563 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2021-01-03T12:57:07.563 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2021-01-03T12:57:07.564 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2021-01-03T12:57:07.564 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.564 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2021-01-03T12:57:07.564 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2021-01-03T12:57:07.564 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2021-01-03T12:57:07.564 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2021-01-03T12:57:07.565 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2021-01-03T12:57:07.565 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2021-01-03T12:57:07.565 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2021-01-03T12:57:07.565 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2021-01-03T12:57:07.565 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2021-01-03T12:57:07.566 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2021-01-03T12:57:07.566 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2021-01-03T12:57:07.566 INFO:teuthology.orchestra.run.smithi007.stdout: mon op complaint time = 120 2021-01-03T12:57:07.566 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T12:57:07.566 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2021-01-03T12:57:07.566 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2021-01-03T12:57:07.567 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = true 2021-01-03T12:57:07.567 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2021-01-03T12:57:07.567 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-01-03T12:57:07.567 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-01-03T12:57:07.567 INFO:teuthology.orchestra.run.smithi007.stdout: client mount timeout = 600 2021-01-03T12:57:07.568 INFO:teuthology.orchestra.run.smithi007.stdout: debug client = 20 2021-01-03T12:57:07.568 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2021-01-03T12:57:07.568 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 15m 2021-01-03T12:57:07.568 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 15m 2021-01-03T12:57:07.568 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2021-01-03T12:57:07.568 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2021-01-03T12:57:07.569 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2021-01-03T12:57:07.569 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2021-01-03T12:57:07.569 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c] 2021-01-03T12:57:07.569 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b] 2021-01-03T12:57:07.569 INFO:teuthology.orchestra.run.smithi007.stdout:[mds] 2021-01-03T12:57:07.569 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds = 20 2021-01-03T12:57:07.570 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2021-01-03T12:57:07.570 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal frag = True 2021-01-03T12:57:07.570 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal fragment size max = 10000 2021-01-03T12:57:07.570 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal merge size = 5 2021-01-03T12:57:07.570 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal split bits = 3 2021-01-03T12:57:07.570 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal split size = 100 2021-01-03T12:57:07.571 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug frag = True 2021-01-03T12:57:07.571 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug scatterstat = True 2021-01-03T12:57:07.571 INFO:teuthology.orchestra.run.smithi007.stdout: mds op complaint time = 180 2021-01-03T12:57:07.571 INFO:teuthology.orchestra.run.smithi007.stdout: mds verify scatter = True 2021-01-03T12:57:07.571 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2021-01-03T12:57:07.571 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 15m 2021-01-03T12:57:07.572 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 15m 2021-01-03T12:57:07.574 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2021-01-03T12:57:07.574 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2021-01-03T12:57:07.574 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-01-03T12:57:07.574 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2021-01-03T12:57:07.574 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.575 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2021-01-03T12:57:07.575 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.575 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2021-01-03T12:57:07.575 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.575 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2021-01-03T12:57:07.576 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2021-01-03T12:57:07.576 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.576 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2021-01-03T12:57:07.576 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2021-01-03T12:57:07.576 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.576 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2021-01-03T12:57:07.577 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2021-01-03T12:57:07.577 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.577 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2021-01-03T12:57:07.577 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2021-01-03T12:57:07.577 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.577 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2021-01-03T12:57:07.578 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.578 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2021-01-03T12:57:07.578 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2021-01-03T12:57:07.578 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2021-01-03T12:57:07.578 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2021-01-03T12:57:07.579 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2021-01-03T12:57:07.579 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2021-01-03T12:57:07.579 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2021-01-03T12:57:07.579 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-01-03T12:57:07.579 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2021-01-03T12:57:07.580 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.580 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-01-03T12:57:07.580 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.580 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2021-01-03T12:57:07.580 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.580 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2021-01-03T12:57:07.581 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.581 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2021-01-03T12:57:07.581 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2021-01-03T12:57:07.581 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2021-01-03T12:57:07.581 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = "172.21.15.133,172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790]" 2021-01-03T12:57:07.581 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = 80bc9ef3-5820-4b9f-9c57-8f734e4c440e 2021-01-03T12:57:07.582 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.582 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2021-01-03T12:57:07.582 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2021-01-03T12:57:07.582 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.582 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2021-01-03T12:57:07.583 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2021-01-03T12:57:07.583 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.583 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2021-01-03T12:57:07.583 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2021-01-03T12:57:07.583 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.584 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2021-01-03T12:57:07.584 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2021-01-03T12:57:07.584 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2021-01-03T12:57:07.584 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.584 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2021-01-03T12:57:07.584 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2021-01-03T12:57:07.585 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.585 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2021-01-03T12:57:07.585 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.585 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2021-01-03T12:57:07.585 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.586 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2021-01-03T12:57:07.586 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.586 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2021-01-03T12:57:07.586 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2021-01-03T12:57:07.586 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.587 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2021-01-03T12:57:07.587 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2021-01-03T12:57:07.587 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2021-01-03T12:57:07.587 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore compression mode = aggressive 2021-01-03T12:57:07.587 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2021-01-03T12:57:07.587 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 20 2021-01-03T12:57:07.588 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 20 2021-01-03T12:57:07.588 INFO:teuthology.orchestra.run.smithi133.stdout: debug filestore = 20 2021-01-03T12:57:07.588 INFO:teuthology.orchestra.run.smithi133.stdout: debug journal = 20 2021-01-03T12:57:07.588 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 20 2021-01-03T12:57:07.588 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 25 2021-01-03T12:57:07.589 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 10 2021-01-03T12:57:07.589 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2021-01-03T12:57:07.589 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2021-01-03T12:57:07.589 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2021-01-03T12:57:07.589 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 0.95 2021-01-03T12:57:07.589 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = bluestore 2021-01-03T12:57:07.590 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2021-01-03T12:57:07.590 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.590 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2021-01-03T12:57:07.590 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2021-01-03T12:57:07.590 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2021-01-03T12:57:07.591 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2021-01-03T12:57:07.591 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2021-01-03T12:57:07.591 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2021-01-03T12:57:07.591 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2021-01-03T12:57:07.591 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2021-01-03T12:57:07.591 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.592 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2021-01-03T12:57:07.592 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2021-01-03T12:57:07.592 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2021-01-03T12:57:07.592 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2021-01-03T12:57:07.592 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2021-01-03T12:57:07.592 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2021-01-03T12:57:07.593 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2021-01-03T12:57:07.593 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2021-01-03T12:57:07.593 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2021-01-03T12:57:07.593 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2021-01-03T12:57:07.593 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2021-01-03T12:57:07.593 INFO:teuthology.orchestra.run.smithi133.stdout: mon op complaint time = 120 2021-01-03T12:57:07.594 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:07.594 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2021-01-03T12:57:07.594 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2021-01-03T12:57:07.594 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = true 2021-01-03T12:57:07.594 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2021-01-03T12:57:07.595 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-01-03T12:57:07.595 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-01-03T12:57:07.595 INFO:teuthology.orchestra.run.smithi133.stdout: client mount timeout = 600 2021-01-03T12:57:07.595 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2021-01-03T12:57:07.595 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2021-01-03T12:57:07.596 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 15m 2021-01-03T12:57:07.596 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 15m 2021-01-03T12:57:07.596 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2021-01-03T12:57:07.596 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.b] 2021-01-03T12:57:07.596 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.c] 2021-01-03T12:57:07.596 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2021-01-03T12:57:07.597 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2021-01-03T12:57:07.597 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2021-01-03T12:57:07.597 INFO:teuthology.orchestra.run.smithi133.stdout:[mds] 2021-01-03T12:57:07.597 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds = 20 2021-01-03T12:57:07.597 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2021-01-03T12:57:07.598 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal frag = True 2021-01-03T12:57:07.598 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal fragment size max = 10000 2021-01-03T12:57:07.598 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal merge size = 5 2021-01-03T12:57:07.598 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal split bits = 3 2021-01-03T12:57:07.598 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal split size = 100 2021-01-03T12:57:07.598 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug frag = True 2021-01-03T12:57:07.599 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug scatterstat = True 2021-01-03T12:57:07.599 INFO:teuthology.orchestra.run.smithi133.stdout: mds op complaint time = 180 2021-01-03T12:57:07.599 INFO:teuthology.orchestra.run.smithi133.stdout: mds verify scatter = True 2021-01-03T12:57:07.599 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2021-01-03T12:57:07.599 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 15m 2021-01-03T12:57:07.600 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 15m 2021-01-03T12:57:07.600 INFO:tasks.ceph:Creating admin key on mon.a... 2021-01-03T12:57:07.600 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-01-03T12:57:07.660 INFO:tasks.ceph:Copying monmap to all nodes... 2021-01-03T12:57:07.667 DEBUG:teuthology.orchestra.remote:smithi133:/etc/ceph/ceph.keyring is 206B 2021-01-03T12:57:07.684 DEBUG:teuthology.orchestra.remote:smithi133:/home/ubuntu/cephtest/ceph.monmap is 379B 2021-01-03T12:57:07.695 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi133.front.sepia.ceph.com 2021-01-03T12:57:07.695 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2021-01-03T12:57:07.696 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.keyring 2021-01-03T12:57:07.696 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-01-03T12:57:07.719 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2021-01-03T12:57:07.719 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-01-03T12:57:07.765 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi016.front.sepia.ceph.com 2021-01-03T12:57:07.765 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2021-01-03T12:57:07.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.keyring 2021-01-03T12:57:07.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-01-03T12:57:07.791 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2021-01-03T12:57:07.792 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-01-03T12:57:07.839 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi007.front.sepia.ceph.com 2021-01-03T12:57:07.840 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2021-01-03T12:57:07.840 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.keyring 2021-01-03T12:57:07.840 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-01-03T12:57:07.866 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2021-01-03T12:57:07.866 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-01-03T12:57:07.913 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi036.front.sepia.ceph.com 2021-01-03T12:57:07.913 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2021-01-03T12:57:07.914 DEBUG:teuthology.orchestra.run.smithi036:> sudo dd of=/etc/ceph/ceph.keyring 2021-01-03T12:57:07.914 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-01-03T12:57:07.939 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2021-01-03T12:57:07.939 DEBUG:teuthology.orchestra.run.smithi036:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-01-03T12:57:07.990 INFO:tasks.ceph:Setting up mon nodes... 2021-01-03T12:57:07.991 INFO:tasks.ceph:Setting up mgr nodes... 2021-01-03T12:57:07.991 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2021-01-03T12:57:08.034 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2021-01-03T12:57:08.036 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-01-03T12:57:08.077 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-01-03T12:57:08.080 INFO:tasks.ceph:Setting up mds nodes... 2021-01-03T12:57:08.080 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2021-01-03T12:57:08.122 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2021-01-03T12:57:08.124 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2021-01-03T12:57:08.186 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2021-01-03T12:57:08.261 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2021-01-03T12:57:08.263 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2021-01-03T12:57:08.319 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2021-01-03T12:57:08.360 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2021-01-03T12:57:08.362 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2021-01-03T12:57:08.420 INFO:tasks.ceph_client:Setting up client nodes... 2021-01-03T12:57:08.421 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-01-03T12:57:08.456 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-01-03T12:57:08.467 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-01-03T12:57:08.501 INFO:teuthology.orchestra.run.smithi036.stdout:creating /etc/ceph/ceph.client.1.keyring 2021-01-03T12:57:08.514 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-01-03T12:57:08.515 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2021-01-03T12:57:08.515 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-01-03T12:57:08.529 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-01-03T12:57:08.530 INFO:tasks.ceph:role: osd.0 2021-01-03T12:57:08.530 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com 2021-01-03T12:57:08.531 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-01-03T12:57:09.049 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-01-03T12:57:09.049 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2021-01-03T12:57:09.049 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-01-03T12:57:09.050 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-01-03T12:57:09.050 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2021-01-03T12:57:09.050 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-01-03T12:57:09.050 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-01-03T12:57:09.051 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-01-03T12:57:09.051 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-01-03T12:57:09.052 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2021-01-03T12:57:09.052 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-01-03T12:57:09.139 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-01-03T12:57:09.150 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2021-01-03T12:57:09.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T12:57:09.151 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-01-03T12:57:09.205 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-01-03T12:57:09.205 INFO:tasks.ceph:role: osd.1 2021-01-03T12:57:09.205 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com 2021-01-03T12:57:09.206 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-01-03T12:57:09.715 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-01-03T12:57:09.715 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2021-01-03T12:57:09.716 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-01-03T12:57:09.716 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-01-03T12:57:09.716 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2021-01-03T12:57:09.716 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-01-03T12:57:09.717 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-01-03T12:57:09.717 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-01-03T12:57:09.717 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-01-03T12:57:09.718 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2021-01-03T12:57:09.719 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-01-03T12:57:09.784 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-01-03T12:57:09.794 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2021-01-03T12:57:09.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T12:57:09.795 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-01-03T12:57:09.849 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-01-03T12:57:09.849 INFO:tasks.ceph:role: osd.2 2021-01-03T12:57:09.849 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com 2021-01-03T12:57:09.850 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-01-03T12:57:10.349 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-01-03T12:57:10.350 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2021-01-03T12:57:10.350 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-01-03T12:57:10.350 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-01-03T12:57:10.350 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2021-01-03T12:57:10.351 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-01-03T12:57:10.351 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-01-03T12:57:10.351 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-01-03T12:57:10.351 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-01-03T12:57:10.352 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2021-01-03T12:57:10.352 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-01-03T12:57:10.398 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-01-03T12:57:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2021-01-03T12:57:10.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T12:57:10.450 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-01-03T12:57:10.505 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2021-01-03T12:57:10.505 INFO:tasks.ceph:role: osd.3 2021-01-03T12:57:10.505 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com 2021-01-03T12:57:10.506 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-01-03T12:57:11.042 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-01-03T12:57:11.043 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2021-01-03T12:57:11.043 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-01-03T12:57:11.043 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-01-03T12:57:11.044 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2021-01-03T12:57:11.044 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-01-03T12:57:11.045 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-01-03T12:57:11.045 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-01-03T12:57:11.045 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-01-03T12:57:11.047 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2021-01-03T12:57:11.048 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2021-01-03T12:57:11.083 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-01-03T12:57:11.135 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2021-01-03T12:57:11.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T12:57:11.136 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-01-03T12:57:11.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:11.227+0000 7f6377e9ed80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-01-03T12:57:11.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:11.231+0000 7f6377e9ed80 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-01-03T12:57:11.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:11.231+0000 7f6377e9ed80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-01-03T12:57:11.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:11.231+0000 7f6377e9ed80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-01-03T12:57:11.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:11.231+0000 7f6377e9ed80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-01-03T12:57:11.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:11.235+0000 7f6377e9ed80 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2021-01-03T12:57:11.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:11.271+0000 7f6377e9ed80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-01-03T12:57:13.682 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-01-03T12:57:13.698 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-01-03T12:57:13.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:13.779+0000 7ff8843dcd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-01-03T12:57:13.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:13.779+0000 7ff8843dcd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-01-03T12:57:13.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:13.779+0000 7ff8843dcd80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-01-03T12:57:13.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:13.779+0000 7ff8843dcd80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-01-03T12:57:13.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:13.779+0000 7ff8843dcd80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-01-03T12:57:13.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:13.783+0000 7ff8843dcd80 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2021-01-03T12:57:13.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:13.799+0000 7ff8843dcd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-01-03T12:57:16.242 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-01-03T12:57:16.298 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-01-03T12:57:16.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:16.379+0000 7f6f72c2cd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-01-03T12:57:16.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:16.379+0000 7f6f72c2cd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-01-03T12:57:16.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:16.379+0000 7f6f72c2cd80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-01-03T12:57:16.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:16.379+0000 7f6f72c2cd80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-01-03T12:57:16.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:16.379+0000 7f6f72c2cd80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-01-03T12:57:16.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:16.379+0000 7f6f72c2cd80 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2021-01-03T12:57:16.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:16.403+0000 7f6f72c2cd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-01-03T12:57:18.830 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-01-03T12:57:18.885 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-01-03T12:57:18.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:18.967+0000 7f1347f83d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-01-03T12:57:18.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:18.967+0000 7f1347f83d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-01-03T12:57:18.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:18.967+0000 7f1347f83d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-01-03T12:57:18.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:18.967+0000 7f1347f83d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-01-03T12:57:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:18.967+0000 7f1347f83d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-01-03T12:57:18.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:18.971+0000 7f1347f83d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2021-01-03T12:57:18.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:18.987+0000 7f1347f83d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-01-03T12:57:21.457 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-01-03T12:57:21.513 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-01-03T12:57:21.529 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-01-03T12:57:21.530 INFO:tasks.ceph:role: osd.4 2021-01-03T12:57:21.530 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com 2021-01-03T12:57:21.530 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-01-03T12:57:21.613 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-01-03T12:57:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2021-01-03T12:57:21.613 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-01-03T12:57:21.614 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-01-03T12:57:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2021-01-03T12:57:21.614 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-01-03T12:57:21.614 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-01-03T12:57:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-01-03T12:57:21.615 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-01-03T12:57:21.661 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2021-01-03T12:57:21.661 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2021-01-03T12:57:21.726 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-01-03T12:57:21.781 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2021-01-03T12:57:21.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T12:57:21.782 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-01-03T12:57:21.839 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-01-03T12:57:21.839 INFO:tasks.ceph:role: osd.5 2021-01-03T12:57:21.840 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com 2021-01-03T12:57:21.840 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-01-03T12:57:21.921 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-01-03T12:57:21.922 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2021-01-03T12:57:21.922 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-01-03T12:57:21.922 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-01-03T12:57:21.923 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2021-01-03T12:57:21.923 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-01-03T12:57:21.923 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-01-03T12:57:21.923 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-01-03T12:57:21.923 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-01-03T12:57:21.924 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2021-01-03T12:57:21.925 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2021-01-03T12:57:21.987 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-01-03T12:57:22.040 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2021-01-03T12:57:22.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T12:57:22.041 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2021-01-03T12:57:22.100 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-01-03T12:57:22.100 INFO:tasks.ceph:role: osd.6 2021-01-03T12:57:22.100 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com 2021-01-03T12:57:22.100 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-01-03T12:57:22.181 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-01-03T12:57:22.181 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2021-01-03T12:57:22.181 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-01-03T12:57:22.182 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-01-03T12:57:22.182 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2021-01-03T12:57:22.182 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-01-03T12:57:22.182 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-01-03T12:57:22.182 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-01-03T12:57:22.183 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-01-03T12:57:22.184 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2021-01-03T12:57:22.184 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2021-01-03T12:57:22.244 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2021-01-03T12:57:22.295 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2021-01-03T12:57:22.296 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T12:57:22.296 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2021-01-03T12:57:22.351 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2021-01-03T12:57:22.352 INFO:tasks.ceph:role: osd.7 2021-01-03T12:57:22.352 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com 2021-01-03T12:57:22.352 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2021-01-03T12:57:22.433 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2021-01-03T12:57:22.433 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2021-01-03T12:57:22.434 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-01-03T12:57:22.434 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-01-03T12:57:22.434 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2021-01-03T12:57:22.434 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-01-03T12:57:22.435 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-01-03T12:57:22.435 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-01-03T12:57:22.435 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-01-03T12:57:22.436 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2021-01-03T12:57:22.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2021-01-03T12:57:22.495 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2021-01-03T12:57:22.548 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2021-01-03T12:57:22.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T12:57:22.550 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-01-03T12:57:22.636 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:22.635+0000 7fdbc3587d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-01-03T12:57:22.636 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:22.635+0000 7fdbc3587d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-01-03T12:57:22.637 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:22.635+0000 7fdbc3587d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-01-03T12:57:22.637 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:22.635+0000 7fdbc3587d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-01-03T12:57:22.637 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:22.635+0000 7fdbc3587d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-01-03T12:57:22.638 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:22.635+0000 7fdbc3587d80 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2021-01-03T12:57:22.648 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:22.647+0000 7fdbc3587d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-01-03T12:57:25.077 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-01-03T12:57:25.133 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-01-03T12:57:25.210 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:25.207+0000 7f390c2b8d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-01-03T12:57:25.210 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:25.211+0000 7f390c2b8d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-01-03T12:57:25.210 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:25.211+0000 7f390c2b8d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-01-03T12:57:25.210 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:25.211+0000 7f390c2b8d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-01-03T12:57:25.211 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:25.211+0000 7f390c2b8d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-01-03T12:57:25.211 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:25.211+0000 7f390c2b8d80 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2021-01-03T12:57:25.222 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:25.223+0000 7f390c2b8d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-01-03T12:57:27.680 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-01-03T12:57:27.736 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-01-03T12:57:27.815 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:27.815+0000 7f2d2d14dd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2021-01-03T12:57:27.816 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:27.815+0000 7f2d2d14dd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2021-01-03T12:57:27.816 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:27.815+0000 7f2d2d14dd80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-01-03T12:57:27.816 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:27.815+0000 7f2d2d14dd80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-01-03T12:57:27.816 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:27.815+0000 7f2d2d14dd80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2021-01-03T12:57:27.817 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:27.815+0000 7f2d2d14dd80 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2021-01-03T12:57:27.830 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:27.831+0000 7f2d2d14dd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-01-03T12:57:30.255 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-01-03T12:57:30.313 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-01-03T12:57:30.391 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:30.391+0000 7fa1b9e69d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2021-01-03T12:57:30.391 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:30.391+0000 7fa1b9e69d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2021-01-03T12:57:30.391 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:30.391+0000 7fa1b9e69d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-01-03T12:57:30.392 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:30.391+0000 7fa1b9e69d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-01-03T12:57:30.392 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:30.391+0000 7fa1b9e69d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2021-01-03T12:57:30.392 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:30.391+0000 7fa1b9e69d80 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2021-01-03T12:57:30.402 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:30.403+0000 7fa1b9e69d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-01-03T12:57:32.859 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-01-03T12:57:32.920 INFO:tasks.ceph:Reading keys from all nodes... 2021-01-03T12:57:32.921 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2021-01-03T12:57:32.927 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.3U9qR54P2h 2021-01-03T12:57:32.928 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.3U9qR54P2h 2021-01-03T12:57:32.986 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.3U9qR54P2h 2021-01-03T12:57:33.091 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.3U9qR54P2h is 56B 2021-01-03T12:57:33.102 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.3U9qR54P2h 2021-01-03T12:57:33.107 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2021-01-03T12:57:33.156 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.VYtfXiASIB 2021-01-03T12:57:33.157 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.VYtfXiASIB 2021-01-03T12:57:33.214 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.VYtfXiASIB 2021-01-03T12:57:33.318 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.VYtfXiASIB is 56B 2021-01-03T12:57:33.329 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.VYtfXiASIB 2021-01-03T12:57:33.336 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2021-01-03T12:57:33.385 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.Q8K7yE49ES 2021-01-03T12:57:33.385 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /var/lib/ceph/mds/ceph-c/keyring /tmp/tmp.Q8K7yE49ES 2021-01-03T12:57:33.442 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.Q8K7yE49ES 2021-01-03T12:57:33.547 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.Q8K7yE49ES is 56B 2021-01-03T12:57:33.558 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.Q8K7yE49ES 2021-01-03T12:57:33.564 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2021-01-03T12:57:33.613 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.ZriUv5L9Vy 2021-01-03T12:57:33.613 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.ZriUv5L9Vy 2021-01-03T12:57:33.669 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.ZriUv5L9Vy 2021-01-03T12:57:33.775 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.ZriUv5L9Vy is 56B 2021-01-03T12:57:33.787 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.ZriUv5L9Vy 2021-01-03T12:57:33.795 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2021-01-03T12:57:33.840 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.BcoYR10MA2 2021-01-03T12:57:33.841 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.BcoYR10MA2 2021-01-03T12:57:33.899 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.BcoYR10MA2 2021-01-03T12:57:34.003 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.BcoYR10MA2 is 56B 2021-01-03T12:57:34.014 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.BcoYR10MA2 2021-01-03T12:57:34.020 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2021-01-03T12:57:34.068 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.vE1hrPBoHU 2021-01-03T12:57:34.069 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.vE1hrPBoHU 2021-01-03T12:57:34.125 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.vE1hrPBoHU 2021-01-03T12:57:34.231 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.vE1hrPBoHU is 56B 2021-01-03T12:57:34.242 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.vE1hrPBoHU 2021-01-03T12:57:34.248 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2021-01-03T12:57:34.296 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.HZ7et89ccV 2021-01-03T12:57:34.298 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.HZ7et89ccV 2021-01-03T12:57:34.354 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.HZ7et89ccV 2021-01-03T12:57:34.459 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.HZ7et89ccV is 56B 2021-01-03T12:57:34.471 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.HZ7et89ccV 2021-01-03T12:57:34.477 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2021-01-03T12:57:34.484 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.XawsDHBCKh 2021-01-03T12:57:34.484 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.XawsDHBCKh 2021-01-03T12:57:34.540 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.XawsDHBCKh 2021-01-03T12:57:34.649 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.XawsDHBCKh is 56B 2021-01-03T12:57:34.659 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.XawsDHBCKh 2021-01-03T12:57:34.665 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2021-01-03T12:57:34.710 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.MP4IwD06kz 2021-01-03T12:57:34.711 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.MP4IwD06kz 2021-01-03T12:57:34.767 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.MP4IwD06kz 2021-01-03T12:57:34.873 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.MP4IwD06kz is 56B 2021-01-03T12:57:34.883 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.MP4IwD06kz 2021-01-03T12:57:34.890 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2021-01-03T12:57:34.938 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.nS0VK7OMTm 2021-01-03T12:57:34.939 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.nS0VK7OMTm 2021-01-03T12:57:34.996 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.nS0VK7OMTm 2021-01-03T12:57:35.109 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.nS0VK7OMTm is 56B 2021-01-03T12:57:35.119 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.nS0VK7OMTm 2021-01-03T12:57:35.125 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2021-01-03T12:57:35.170 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.lsSYfI3zXi 2021-01-03T12:57:35.171 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.lsSYfI3zXi 2021-01-03T12:57:35.228 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.lsSYfI3zXi 2021-01-03T12:57:35.337 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.lsSYfI3zXi is 56B 2021-01-03T12:57:35.348 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.lsSYfI3zXi 2021-01-03T12:57:35.353 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2021-01-03T12:57:35.402 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.3TwaSjuon0 2021-01-03T12:57:35.403 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.3TwaSjuon0 2021-01-03T12:57:35.460 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.3TwaSjuon0 2021-01-03T12:57:35.569 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.3TwaSjuon0 is 56B 2021-01-03T12:57:35.580 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.3TwaSjuon0 2021-01-03T12:57:35.586 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2021-01-03T12:57:35.630 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.i254NGo2TL 2021-01-03T12:57:35.631 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.i254NGo2TL 2021-01-03T12:57:35.688 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.i254NGo2TL 2021-01-03T12:57:35.793 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.i254NGo2TL is 56B 2021-01-03T12:57:35.803 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.i254NGo2TL 2021-01-03T12:57:35.818 DEBUG:teuthology.orchestra.remote:smithi007:/etc/ceph/ceph.client.0.keyring is 59B 2021-01-03T12:57:35.840 DEBUG:teuthology.orchestra.remote:smithi036:/etc/ceph/ceph.client.1.keyring is 59B 2021-01-03T12:57:35.850 INFO:tasks.ceph:Adding keys to all mons... 2021-01-03T12:57:35.851 DEBUG:teuthology.orchestra.run.smithi016:> sudo tee -a /etc/ceph/ceph.keyring 2021-01-03T12:57:35.854 DEBUG:teuthology.orchestra.run.smithi133:> sudo tee -a /etc/ceph/ceph.keyring 2021-01-03T12:57:35.866 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.y] 2021-01-03T12:57:35.867 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAkv/FfAOFAAhAAPQOSkofyJoEYvcAqKK2+Mg== 2021-01-03T12:57:35.867 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2021-01-03T12:57:35.867 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAkv/Fflox9BxAA6coLDFV/FaQ/G/cvtonWgg== 2021-01-03T12:57:35.867 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2021-01-03T12:57:35.867 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAkv/FfpPPLDxAAVvg80vLejYKDH485/L1gSQ== 2021-01-03T12:57:35.868 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.0] 2021-01-03T12:57:35.868 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAnv/FfQ+CcDRAAUkTDLby5scMkNzxa0lVdAQ== 2021-01-03T12:57:35.868 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.1] 2021-01-03T12:57:35.868 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQApv/Ff1iilLhAAbK9hZmL772nNKAEJ4i+pkw== 2021-01-03T12:57:35.869 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.2] 2021-01-03T12:57:35.869 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAsv/Ffmoe2FhAA1EbxU5yHncN+pbC/EX6d9A== 2021-01-03T12:57:35.869 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.3] 2021-01-03T12:57:35.869 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAuv/FfJh/VORAAG9aCOh5s/2Lw+yN9hBFWLw== 2021-01-03T12:57:35.870 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.x] 2021-01-03T12:57:35.870 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAkv/FfAU/DBBAASi+hx05pZEsP+dV9iwbz4g== 2021-01-03T12:57:35.870 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2021-01-03T12:57:35.870 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAkv/FfrnWWFRAA3PHH/FJOvDozCChrb1T8Dg== 2021-01-03T12:57:35.870 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.4] 2021-01-03T12:57:35.871 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAyv/Ffus0NJhAALX1TIqQ9EIupaX8KtRu7rQ== 2021-01-03T12:57:35.871 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.5] 2021-01-03T12:57:35.871 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQA1v/FfoL6kDBAAggoRy/o0qas/41yLYqDVgA== 2021-01-03T12:57:35.871 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.6] 2021-01-03T12:57:35.871 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQA3v/FfwOPCMBAAGOt8ShPQ/szNbCfaP/uZEQ== 2021-01-03T12:57:35.872 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.7] 2021-01-03T12:57:35.872 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQA6v/Ffoz5xFxAAn3xvUDSeNSWrBJTa1Nsb6w== 2021-01-03T12:57:35.872 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2021-01-03T12:57:35.872 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAkv/FfyGlbGxAALm0NezvPiTAnlwu8iPEuCw== 2021-01-03T12:57:35.872 INFO:teuthology.orchestra.run.smithi016.stdout:[client.1] 2021-01-03T12:57:35.873 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQAkv/Ffa2AFHhAAD4Pq5zMJ28SqqEosBA9vnQ== 2021-01-03T12:57:35.874 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.y] 2021-01-03T12:57:35.874 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAkv/FfAOFAAhAAPQOSkofyJoEYvcAqKK2+Mg== 2021-01-03T12:57:35.874 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2021-01-03T12:57:35.875 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAkv/Fflox9BxAA6coLDFV/FaQ/G/cvtonWgg== 2021-01-03T12:57:35.875 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2021-01-03T12:57:35.875 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAkv/FfpPPLDxAAVvg80vLejYKDH485/L1gSQ== 2021-01-03T12:57:35.875 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.0] 2021-01-03T12:57:35.875 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAnv/FfQ+CcDRAAUkTDLby5scMkNzxa0lVdAQ== 2021-01-03T12:57:35.876 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.1] 2021-01-03T12:57:35.876 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQApv/Ff1iilLhAAbK9hZmL772nNKAEJ4i+pkw== 2021-01-03T12:57:35.876 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.2] 2021-01-03T12:57:35.876 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAsv/Ffmoe2FhAA1EbxU5yHncN+pbC/EX6d9A== 2021-01-03T12:57:35.876 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.3] 2021-01-03T12:57:35.877 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAuv/FfJh/VORAAG9aCOh5s/2Lw+yN9hBFWLw== 2021-01-03T12:57:35.877 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.x] 2021-01-03T12:57:35.877 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAkv/FfAU/DBBAASi+hx05pZEsP+dV9iwbz4g== 2021-01-03T12:57:35.877 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2021-01-03T12:57:35.877 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAkv/FfrnWWFRAA3PHH/FJOvDozCChrb1T8Dg== 2021-01-03T12:57:35.878 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.4] 2021-01-03T12:57:35.878 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAyv/Ffus0NJhAALX1TIqQ9EIupaX8KtRu7rQ== 2021-01-03T12:57:35.878 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.5] 2021-01-03T12:57:35.878 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQA1v/FfoL6kDBAAggoRy/o0qas/41yLYqDVgA== 2021-01-03T12:57:35.878 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.6] 2021-01-03T12:57:35.879 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQA3v/FfwOPCMBAAGOt8ShPQ/szNbCfaP/uZEQ== 2021-01-03T12:57:35.879 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.7] 2021-01-03T12:57:35.879 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQA6v/Ffoz5xFxAAn3xvUDSeNSWrBJTa1Nsb6w== 2021-01-03T12:57:35.879 INFO:teuthology.orchestra.run.smithi133.stdout:[client.0] 2021-01-03T12:57:35.879 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAkv/FfyGlbGxAALm0NezvPiTAnlwu8iPEuCw== 2021-01-03T12:57:35.880 INFO:teuthology.orchestra.run.smithi133.stdout:[client.1] 2021-01-03T12:57:35.880 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAkv/Ffa2AFHhAAD4Pq5zMJ28SqqEosBA9vnQ== 2021-01-03T12:57:35.880 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-01-03T12:57:35.919 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-01-03T12:57:35.960 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-03T12:57:36.007 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-03T12:57:36.051 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-03T12:57:36.095 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-03T12:57:36.139 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-03T12:57:36.183 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-03T12:57:36.224 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-03T12:57:36.271 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-03T12:57:36.312 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-03T12:57:36.355 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-03T12:57:36.398 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-03T12:57:36.439 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-03T12:57:36.480 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-01-03T12:57:36.516 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:57:36.519 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:57:36.523 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-01-03T12:57:36.524 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:57:36.527 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:57:36.565 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-03T12:57:36.630 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2021-01-03T12:57:36.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-03T12:57:36.718 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-03T12:57:36.778 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-03T12:57:36.803 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-03T12:57:36.860 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-03T12:57:36.887 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-03T12:57:36.944 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-03T12:57:36.974 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-01-03T12:57:37.191 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-01-03T12:57:37.193 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-01-03T12:57:37.246 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-01-03T12:57:37.249 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-01-03T12:57:37.327 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-01-03T12:57:37.327 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-01-03T12:57:37.384 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-01-03T12:57:37.497 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-01-03T12:57:37.513 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-01-03T12:57:37.528 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-01-03T12:57:37.645 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-01-03T12:57:37.659 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-01-03T12:57:37.718 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-01-03T12:57:37.841 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-01-03T12:57:37.857 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-01-03T12:57:37.898 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-01-03T12:57:37.905 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-01-03T12:57:37.905 INFO:tasks.ceph.mon.a:Restarting daemon 2021-01-03T12:57:37.906 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-01-03T12:57:37.948 INFO:tasks.ceph.mon.a:Started 2021-01-03T12:57:37.949 INFO:tasks.ceph.mon.b:Restarting daemon 2021-01-03T12:57:37.950 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-01-03T12:57:37.952 INFO:tasks.ceph.mon.b:Started 2021-01-03T12:57:37.953 INFO:tasks.ceph.mon.c:Restarting daemon 2021-01-03T12:57:37.953 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-01-03T12:57:37.955 INFO:tasks.ceph.mon.c:Started 2021-01-03T12:57:37.956 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-01-03T12:57:37.956 INFO:tasks.ceph.mgr.y:Restarting daemon 2021-01-03T12:57:37.957 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2021-01-03T12:57:37.959 INFO:tasks.ceph.mgr.y:Started 2021-01-03T12:57:37.959 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-01-03T12:57:37.960 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-01-03T12:57:37.962 INFO:tasks.ceph.mgr.x:Started 2021-01-03T12:57:37.962 INFO:tasks.ceph:Setting crush tunables to default 2021-01-03T12:57:37.963 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd crush tunables default 2021-01-03T12:57:43.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad21498700 1 Processor -- start 2021-01-03T12:57:43.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad21498700 1 -- start start 2021-01-03T12:57:43.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad21498700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 0x7fad1c0ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:43.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad21498700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 0x7fad1c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:43.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad21498700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 0x7fad1c0afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:43.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad21498700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1c062340 con 0x7fad1c0b5120 2021-01-03T12:57:43.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad21498700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1c0ac2c0 con 0x7fad1c0af9f0 2021-01-03T12:57:43.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad21498700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c09a380 con 0x7fad1c060b00 2021-01-03T12:57:43.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad1bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 0x7fad1c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad1bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 0x7fad1c0afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59208/0 (socket says 172.21.15.133:59208) 2021-01-03T12:57:43.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad1bfff700 1 -- 172.21.15.133:0/3079174067 learned_addr learned my addr 172.21.15.133:0/3079174067 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:57:43.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad1b7fe700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 0x7fad1c0ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad1affd700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 0x7fad1c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad1bfff700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 msgr2=0x7fad1c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-01-03T12:57:43.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad1bfff700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 msgr2=0x7fad1c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-01-03T12:57:43.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad1bfff700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 0x7fad1c0afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-03T12:57:43.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad1bfff700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 0x7fad1c0afe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-01-03T12:57:43.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad1affd700 1 -- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 msgr2=0x7fad1c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-01-03T12:57:43.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad1affd700 1 -- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 msgr2=0x7fad1c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-01-03T12:57:43.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad1b7fe700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 msgr2=0x7fad1c0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2021-01-03T12:57:43.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad1b7fe700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 msgr2=0x7fad1c0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-01-03T12:57:43.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad1affd700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 0x7fad1c0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-03T12:57:43.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad1b7fe700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 0x7fad1c0ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-03T12:57:43.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad1affd700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 0x7fad1c0abdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-01-03T12:57:43.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.151+0000 7fad1b7fe700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 0x7fad1c0ab8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-01-03T12:57:43.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.355+0000 7fad1bfff700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 0x7fad1c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.355+0000 7fad1b7fe700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 0x7fad1c0ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.355+0000 7fad1bfff700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 msgr2=0x7fad1c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2021-01-03T12:57:43.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.355+0000 7fad1bfff700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 msgr2=0x7fad1c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-01-03T12:57:43.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.355+0000 7fad1bfff700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 0x7fad1c0afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-03T12:57:43.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.355+0000 7fad1affd700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 0x7fad1c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.355+0000 7fad1bfff700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 0x7fad1c0afe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-01-03T12:57:43.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.355+0000 7fad1affd700 1 -- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 msgr2=0x7fad1c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-01-03T12:57:43.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.355+0000 7fad1affd700 1 -- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 msgr2=0x7fad1c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-01-03T12:57:43.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.355+0000 7fad1affd700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 0x7fad1c0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-03T12:57:43.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.355+0000 7fad1b7fe700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 msgr2=0x7fad1c0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-01-03T12:57:43.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.355+0000 7fad1b7fe700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 msgr2=0x7fad1c0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-01-03T12:57:43.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.355+0000 7fad1affd700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 0x7fad1c0abdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-01-03T12:57:43.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.355+0000 7fad1b7fe700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 0x7fad1c0ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-03T12:57:43.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.355+0000 7fad1b7fe700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 0x7fad1c0ab8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2021-01-03T12:57:43.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.759+0000 7fad1bfff700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 0x7fad1c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.759+0000 7fad1affd700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 0x7fad1c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.759+0000 7fad1b7fe700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 0x7fad1c0ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.759+0000 7fad1bfff700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 msgr2=0x7fad1c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-01-03T12:57:43.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.759+0000 7fad1bfff700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 msgr2=0x7fad1c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-01-03T12:57:43.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.759+0000 7fad1bfff700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 0x7fad1c0afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-03T12:57:43.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.759+0000 7fad1bfff700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 0x7fad1c0afe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-01-03T12:57:43.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.759+0000 7fad1b7fe700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 msgr2=0x7fad1c0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2021-01-03T12:57:43.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.759+0000 7fad1b7fe700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 msgr2=0x7fad1c0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-01-03T12:57:43.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.759+0000 7fad1b7fe700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 0x7fad1c0ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-03T12:57:43.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.759+0000 7fad1affd700 1 -- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 msgr2=0x7fad1c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-01-03T12:57:43.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.759+0000 7fad1affd700 1 -- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 msgr2=0x7fad1c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-01-03T12:57:43.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.759+0000 7fad1affd700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 0x7fad1c0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-03T12:57:43.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.759+0000 7fad1b7fe700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 0x7fad1c0ab8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-01-03T12:57:43.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:38.759+0000 7fad1affd700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 0x7fad1c0abdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2021-01-03T12:57:43.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:39.563+0000 7fad1bfff700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 0x7fad1c0afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:39.563+0000 7fad1affd700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 0x7fad1c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:39.563+0000 7fad1b7fe700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 0x7fad1c0ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:39.563+0000 7fad1bfff700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 msgr2=0x7fad1c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2021-01-03T12:57:43.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:39.563+0000 7fad1bfff700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 msgr2=0x7fad1c0afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-01-03T12:57:43.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:39.563+0000 7fad1bfff700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 0x7fad1c0afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-03T12:57:43.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:39.563+0000 7fad1bfff700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 0x7fad1c0afe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-01-03T12:57:43.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:39.563+0000 7fad1affd700 1 -- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 msgr2=0x7fad1c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-01-03T12:57:43.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:39.563+0000 7fad1affd700 1 -- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 msgr2=0x7fad1c0abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-01-03T12:57:43.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:39.563+0000 7fad1affd700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 0x7fad1c0abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-03T12:57:43.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:39.563+0000 7fad1b7fe700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 msgr2=0x7fad1c0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2021-01-03T12:57:43.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:39.563+0000 7fad1affd700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 0x7fad1c0abdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-01-03T12:57:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:39.563+0000 7fad1b7fe700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 msgr2=0x7fad1c0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-01-03T12:57:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:39.563+0000 7fad1b7fe700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 0x7fad1c0ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-03T12:57:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:39.563+0000 7fad1b7fe700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 0x7fad1c0ab8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2021-01-03T12:57:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:41.151+0000 7fad197fa700 1 -- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 msgr2=0x7fad1c0abdd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-03T12:57:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:41.151+0000 7fad197fa700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad1c060b00 0x7fad1c0abdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:41.151+0000 7fad197fa700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 msgr2=0x7fad1c0afe80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-03T12:57:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:41.151+0000 7fad197fa700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.133:3300/0 conn(0x7fad1c0af9f0 0x7fad1c0afe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:41.151+0000 7fad197fa700 1 -- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 msgr2=0x7fad1c0ab8e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-03T12:57:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:41.151+0000 7fad197fa700 1 --2- 172.21.15.133:0/3079174067 >> v2:172.21.15.16:3300/0 conn(0x7fad1c0b5120 0x7fad1c0ab8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:43.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:41.151+0000 7fad197fa700 1 -- 172.21.15.133:0/3079174067 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1c060090 con 0x7fad08007010 2021-01-03T12:57:43.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:41.151+0000 7fad197fa700 1 -- 172.21.15.133:0/3079174067 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0800bd40 con 0x7fad080033c0 2021-01-03T12:57:43.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.323+0000 7fad1a7fc700 1 -- 172.21.15.133:0/3079174067 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277948753 0 0) 0x7fad1c060090 con 0x7fad08007010 2021-01-03T12:57:43.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.323+0000 7fad1a7fc700 1 -- 172.21.15.133:0/3079174067 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facfc003230 con 0x7fad08007010 2021-01-03T12:57:43.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.323+0000 7fad1a7fc700 1 -- 172.21.15.133:0/3079174067 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015410205 0 0) 0x7fad0800bd40 con 0x7fad080033c0 2021-01-03T12:57:43.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.323+0000 7fad1a7fc700 1 -- 172.21.15.133:0/3079174067 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad1c060090 con 0x7fad080033c0 2021-01-03T12:57:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.323+0000 7fad1a7fc700 1 -- 172.21.15.133:0/3079174067 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1414979124 0 0) 0x7facfc003230 con 0x7fad08007010 2021-01-03T12:57:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.323+0000 7fad1a7fc700 1 -- 172.21.15.133:0/3079174067 >> v1:172.21.15.133:6789/0 conn(0x7fad080033c0 legacy=0x7fad080057e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.323+0000 7fad1a7fc700 1 -- 172.21.15.133:0/3079174067 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0800d000 con 0x7fad08007010 2021-01-03T12:57:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.323+0000 7fad1a7fc700 1 -- 172.21.15.133:0/3079174067 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fad0400d3b0 con 0x7fad08007010 2021-01-03T12:57:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.323+0000 7fad1a7fc700 1 -- 172.21.15.133:0/3079174067 >> v1:172.21.15.16:6789/0 conn(0x7fad08007010 legacy=0x7fad080094d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:43.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.323+0000 7fad1bfff700 1 -- 172.21.15.133:0/3079174067 reap_dead start 2021-01-03T12:57:43.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.323+0000 7fad1a7fc700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc003930 0x7facfc003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:43.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1a7fc700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facfc0044d0 0x7facfc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:43.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1a7fc700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc004e90 0x7facfc00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:43.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1a7fc700 1 -- 172.21.15.133:0/3079174067 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc00bc10 con 0x7facfc0044d0 2021-01-03T12:57:43.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1a7fc700 1 -- 172.21.15.133:0/3079174067 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc00bd80 con 0x7facfc004e90 2021-01-03T12:57:43.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1a7fc700 1 -- 172.21.15.133:0/3079174067 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facfc00bf40 con 0x7facfc003930 2021-01-03T12:57:43.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1bfff700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc004e90 0x7facfc00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1b7fe700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc003930 0x7facfc003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1affd700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facfc0044d0 0x7facfc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1b7fe700 1 -- 172.21.15.133:0/3079174067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc004e90 msgr2=0x7facfc00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:43.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1b7fe700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc004e90 0x7facfc00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:43.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1b7fe700 1 -- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facfc0044d0 msgr2=0x7facfc004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:43.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1b7fe700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facfc0044d0 0x7facfc004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:43.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1b7fe700 1 -- 172.21.15.133:0/3079174067 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc003230 con 0x7facfc003930 2021-01-03T12:57:43.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1bfff700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc004e90 0x7facfc00b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:57:43.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1b7fe700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc003930 0x7facfc003d10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fad14007000 tx=0x7fad14008040).ready entity=mon.2 client_cookie=7241aa74a136a09e server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:43.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1a7fc700 1 -- 172.21.15.133:0/3079174067 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad14012e80 con 0x7facfc003930 2021-01-03T12:57:43.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1a7fc700 1 -- 172.21.15.133:0/3079174067 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1400c040 con 0x7facfc003930 2021-01-03T12:57:43.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad1a7fc700 1 -- 172.21.15.133:0/3079174067 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad14017660 con 0x7facfc003930 2021-01-03T12:57:43.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad21498700 1 -- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc003930 msgr2=0x7facfc003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:43.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.327+0000 7fad21498700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc003930 0x7facfc003d10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fad14007000 tx=0x7fad14008040).stop 2021-01-03T12:57:43.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.331+0000 7fad21498700 1 -- 172.21.15.133:0/3079174067 shutdown_connections 2021-01-03T12:57:43.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.331+0000 7fad21498700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facfc0044d0 0x7facfc004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:43.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.331+0000 7fad21498700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc004e90 0x7facfc00b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:43.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.331+0000 7fad21498700 1 --2- 172.21.15.133:0/3079174067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc003930 0x7facfc003d10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:43.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.331+0000 7fad21498700 1 -- 172.21.15.133:0/3079174067 >> 172.21.15.133:0/3079174067 conn(0x7fad1c05bdf0 msgr2=0x7fad1c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:43.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.331+0000 7fad21498700 1 -- 172.21.15.133:0/3079174067 shutdown_connections 2021-01-03T12:57:43.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.331+0000 7fad21498700 1 -- 172.21.15.133:0/3079174067 wait complete. 2021-01-03T12:57:43.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad21498700 1 Processor -- start 2021-01-03T12:57:43.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad21498700 1 -- start start 2021-01-03T12:57:43.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad21498700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facfc003930 0x7fad1c0b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:43.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad21498700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0044d0 0x7fad1c065350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:43.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad21498700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc004e90 0x7fad1c065840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:43.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad21498700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0965d0 con 0x7facfc003930 2021-01-03T12:57:43.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad21498700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c0941f0 con 0x7facfc0044d0 2021-01-03T12:57:43.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad21498700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c065d30 con 0x7facfc004e90 2021-01-03T12:57:43.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad1affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0044d0 0x7fad1c065350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad1b7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facfc003930 0x7fad1c0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad1affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0044d0 0x7fad1c065350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59276/0 (socket says 172.21.15.133:59276) 2021-01-03T12:57:43.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad1affd700 1 -- 172.21.15.133:0/1505146761 learned_addr learned my addr 172.21.15.133:0/1505146761 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:57:43.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad1b7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facfc003930 0x7fad1c0b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:57814/0 (socket says 172.21.15.133:57814) 2021-01-03T12:57:43.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad1bfff700 1 --2- 172.21.15.133:0/1505146761 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc004e90 0x7fad1c065840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:43.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad1affd700 1 -- 172.21.15.133:0/1505146761 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc004e90 msgr2=0x7fad1c065840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:43.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad1affd700 1 --2- 172.21.15.133:0/1505146761 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc004e90 0x7fad1c065840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:43.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad1affd700 1 -- 172.21.15.133:0/1505146761 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facfc003930 msgr2=0x7fad1c0b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:43.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad1affd700 1 --2- 172.21.15.133:0/1505146761 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facfc003930 0x7fad1c0b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:43.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad1affd700 1 -- 172.21.15.133:0/1505146761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c066b80 con 0x7facfc0044d0 2021-01-03T12:57:43.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad1affd700 1 --2- 172.21.15.133:0/1505146761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0044d0 0x7fad1c065350 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fad1c0649f0 tx=0x7fad04008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:43.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad13fff700 1 -- 172.21.15.133:0/1505146761 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad04013e80 con 0x7facfc0044d0 2021-01-03T12:57:43.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad13fff700 1 -- 172.21.15.133:0/1505146761 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0401a070 con 0x7facfc0044d0 2021-01-03T12:57:43.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad21498700 1 -- 172.21.15.133:0/1505146761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1c094420 con 0x7facfc0044d0 2021-01-03T12:57:43.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.335+0000 7fad13fff700 1 -- 172.21.15.133:0/1505146761 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad04016620 con 0x7facfc0044d0 2021-01-03T12:57:43.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.339+0000 7fad21498700 1 -- 172.21.15.133:0/1505146761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1c066e20 con 0x7facfc0044d0 2021-01-03T12:57:43.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.339+0000 7fad13fff700 1 -- 172.21.15.133:0/1505146761 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fad04026070 con 0x7facfc0044d0 2021-01-03T12:57:43.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.339+0000 7fad13fff700 1 -- 172.21.15.133:0/1505146761 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fad04016b70 con 0x7facfc0044d0 2021-01-03T12:57:43.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.339+0000 7fad21498700 1 -- 172.21.15.133:0/1505146761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1c057300 con 0x7facfc0044d0 2021-01-03T12:57:43.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.343+0000 7fad13fff700 1 -- 172.21.15.133:0/1505146761 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fad04024060 con 0x7facfc0044d0 2021-01-03T12:57:43.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.411+0000 7fad21498700 1 -- 172.21.15.133:0/1505146761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fad1c05ce00 con 0x7facfc0044d0 2021-01-03T12:57:43.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.419+0000 7fad13fff700 1 -- 172.21.15.133:0/1505146761 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fad04016e20 con 0x7facfc0044d0 2021-01-03T12:57:43.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.419+0000 7fad21498700 1 -- 172.21.15.133:0/1505146761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0044d0 msgr2=0x7fad1c065350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:43.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.419+0000 7fad21498700 1 --2- 172.21.15.133:0/1505146761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0044d0 0x7fad1c065350 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fad1c0649f0 tx=0x7fad04008040).stop 2021-01-03T12:57:43.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.419+0000 7fad21498700 1 -- 172.21.15.133:0/1505146761 shutdown_connections 2021-01-03T12:57:43.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.419+0000 7fad21498700 1 --2- 172.21.15.133:0/1505146761 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facfc003930 0x7fad1c0b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:43.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.419+0000 7fad21498700 1 --2- 172.21.15.133:0/1505146761 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc004e90 0x7fad1c065840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.419+0000 7fad21498700 1 --2- 172.21.15.133:0/1505146761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0044d0 0x7fad1c065350 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.419+0000 7fad21498700 1 -- 172.21.15.133:0/1505146761 >> 172.21.15.133:0/1505146761 conn(0x7fad1c05bdf0 msgr2=0x7fad1c0b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.419+0000 7fad21498700 1 -- 172.21.15.133:0/1505146761 shutdown_connections 2021-01-03T12:57:43.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:43.419+0000 7fad21498700 1 -- 172.21.15.133:0/1505146761 wait complete. 2021-01-03T12:57:43.421 INFO:teuthology.orchestra.run.smithi133.stderr:adjusted tunables profile to default 2021-01-03T12:57:43.432 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-01-03T12:57:43.432 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2021-01-03T12:57:43.438 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.CGoggsajlm 2021-01-03T12:57:43.439 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.CGoggsajlm 2021-01-03T12:57:43.494 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.CGoggsajlm 2021-01-03T12:57:43.598 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.CGoggsajlm is 37B 2021-01-03T12:57:43.609 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.CGoggsajlm 2021-01-03T12:57:43.614 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2021-01-03T12:57:43.661 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.SoedrXoIJ1 2021-01-03T12:57:43.661 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.SoedrXoIJ1 2021-01-03T12:57:43.716 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.SoedrXoIJ1 2021-01-03T12:57:43.822 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.SoedrXoIJ1 is 37B 2021-01-03T12:57:43.873 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.SoedrXoIJ1 2021-01-03T12:57:43.879 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2021-01-03T12:57:43.928 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.hWNy69RZo3 2021-01-03T12:57:43.929 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.hWNy69RZo3 2021-01-03T12:57:43.985 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.hWNy69RZo3 2021-01-03T12:57:44.091 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.hWNy69RZo3 is 37B 2021-01-03T12:57:44.100 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.hWNy69RZo3 2021-01-03T12:57:44.105 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2021-01-03T12:57:44.152 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.I5Gs06hPF0 2021-01-03T12:57:44.152 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.I5Gs06hPF0 2021-01-03T12:57:44.209 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.I5Gs06hPF0 2021-01-03T12:57:44.314 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.I5Gs06hPF0 is 37B 2021-01-03T12:57:44.326 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.I5Gs06hPF0 2021-01-03T12:57:44.331 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2021-01-03T12:57:44.337 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.NBhhBCS7Ro 2021-01-03T12:57:44.338 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.NBhhBCS7Ro 2021-01-03T12:57:44.395 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.NBhhBCS7Ro 2021-01-03T12:57:44.500 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.NBhhBCS7Ro is 37B 2021-01-03T12:57:44.510 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.NBhhBCS7Ro 2021-01-03T12:57:44.516 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2021-01-03T12:57:44.562 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.NrIUgjDdQF 2021-01-03T12:57:44.563 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.NrIUgjDdQF 2021-01-03T12:57:44.619 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.NrIUgjDdQF 2021-01-03T12:57:44.724 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.NrIUgjDdQF is 37B 2021-01-03T12:57:44.734 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.NrIUgjDdQF 2021-01-03T12:57:44.740 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2021-01-03T12:57:44.786 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.55tO64Meje 2021-01-03T12:57:44.787 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.55tO64Meje 2021-01-03T12:57:44.843 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.55tO64Meje 2021-01-03T12:57:44.948 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.55tO64Meje is 37B 2021-01-03T12:57:44.959 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.55tO64Meje 2021-01-03T12:57:44.964 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2021-01-03T12:57:45.010 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.zKzkfeMzed 2021-01-03T12:57:45.011 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.zKzkfeMzed 2021-01-03T12:57:45.067 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.zKzkfeMzed 2021-01-03T12:57:45.172 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.zKzkfeMzed is 37B 2021-01-03T12:57:45.182 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.zKzkfeMzed 2021-01-03T12:57:45.188 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd new 11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a 0 2021-01-03T12:57:45.342 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a2db3700 1 Processor -- start 2021-01-03T12:57:45.343 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a2db3700 1 -- start start 2021-01-03T12:57:45.343 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a2db3700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe79c0adc10 0x7fe79c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:45.343 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a2db3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe79c062450 0x7fe79c0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:45.343 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a2db3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79c0adff0 con 0x7fe79c0b3190 2021-01-03T12:57:45.344 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a2db3700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79c0b1930 con 0x7fe79c0adc10 2021-01-03T12:57:45.344 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a2db3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79c05fb80 con 0x7fe79c062450 2021-01-03T12:57:45.344 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a25b2700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe79c0adc10 0x7fe79c067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:45.344 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a25b2700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe79c0adc10 0x7fe79c067cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50928/0 (socket says 172.21.15.16:50928) 2021-01-03T12:57:45.344 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a25b2700 1 -- 172.21.15.16:0/1128637515 learned_addr learned my addr 172.21.15.16:0/1128637515 (peer_addr_for_me v2:172.21.15.16:0/0) 2021-01-03T12:57:45.345 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a1db1700 1 --2- 172.21.15.16:0/1128637515 >> v2:172.21.15.133:3300/0 conn(0x7fe79c062450 0x7fe79c0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:45.345 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a25b2700 1 -- 172.21.15.16:0/1128637515 >> v2:172.21.15.133:3300/0 conn(0x7fe79c062450 msgr2=0x7fe79c0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:45.345 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a25b2700 1 --2- 172.21.15.16:0/1128637515 >> v2:172.21.15.133:3300/0 conn(0x7fe79c062450 0x7fe79c0b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.345 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a25b2700 1 -- 172.21.15.16:0/1128637515 >> v1:172.21.15.133:6789/0 conn(0x7fe79c0b3190 legacy=0x7fe79c025140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:45.345 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a25b2700 1 -- 172.21.15.16:0/1128637515 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c05fed0 con 0x7fe79c0adc10 2021-01-03T12:57:45.346 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a25b2700 1 --2- 172.21.15.16:0/1128637515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe79c0adc10 0x7fe79c067cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fe798002f30 tx=0x7fe798006e80).ready entity=mon.0 client_cookie=febc804318237572 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:45.346 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a15b0700 1 -- 172.21.15.16:0/1128637515 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7980097f0 con 0x7fe79c0adc10 2021-01-03T12:57:45.346 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a15b0700 1 -- 172.21.15.16:0/1128637515 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe798009950 con 0x7fe79c0adc10 2021-01-03T12:57:45.346 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a15b0700 1 -- 172.21.15.16:0/1128637515 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe798009cb0 con 0x7fe79c0adc10 2021-01-03T12:57:45.346 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a2db3700 1 -- 172.21.15.16:0/1128637515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe79c0adc10 msgr2=0x7fe79c067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:45.347 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.339+0000 7fe7a2db3700 1 --2- 172.21.15.16:0/1128637515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe79c0adc10 0x7fe79c067cb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fe798002f30 tx=0x7fe798006e80).stop 2021-01-03T12:57:45.347 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.343+0000 7fe7a2db3700 1 -- 172.21.15.16:0/1128637515 shutdown_connections 2021-01-03T12:57:45.347 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.343+0000 7fe7a2db3700 1 --2- 172.21.15.16:0/1128637515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe79c0adc10 0x7fe79c067cb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.347 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.343+0000 7fe7a2db3700 1 --2- 172.21.15.16:0/1128637515 >> v2:172.21.15.133:3300/0 conn(0x7fe79c062450 0x7fe79c0b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.347 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.343+0000 7fe7a2db3700 1 -- 172.21.15.16:0/1128637515 >> 172.21.15.16:0/1128637515 conn(0x7fe79c060d10 msgr2=0x7fe79c061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:45.348 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.343+0000 7fe7a2db3700 1 -- 172.21.15.16:0/1128637515 shutdown_connections 2021-01-03T12:57:45.348 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.343+0000 7fe7a2db3700 1 -- 172.21.15.16:0/1128637515 wait complete. 2021-01-03T12:57:45.350 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.343+0000 7fe7a2db3700 1 Processor -- start 2021-01-03T12:57:45.350 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.343+0000 7fe7a2db3700 1 -- start start 2021-01-03T12:57:45.350 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a2db3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe79c062450 0x7fe79c1200d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:45.351 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a2db3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe79c0adc10 0x7fe79c14f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:45.351 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a2db3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe79c0b3190 0x7fe79c14fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:45.351 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a2db3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c131720 con 0x7fe79c0b3190 2021-01-03T12:57:45.351 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a2db3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c11f9d0 con 0x7fe79c062450 2021-01-03T12:57:45.351 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a2db3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c1510d0 con 0x7fe79c0adc10 2021-01-03T12:57:45.352 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a1db1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe79c0adc10 0x7fe79c14f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:45.352 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a1db1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe79c0adc10 0x7fe79c14f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.16:45762/0 (socket says 172.21.15.16:45762) 2021-01-03T12:57:45.352 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a1db1700 1 -- 172.21.15.16:0/874823267 learned_addr learned my addr 172.21.15.16:0/874823267 (peer_addr_for_me v2:172.21.15.16:0/0) 2021-01-03T12:57:45.352 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a4015700 1 --2- 172.21.15.16:0/874823267 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe79c0b3190 0x7fe79c14fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:45.353 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a25b2700 1 --2- 172.21.15.16:0/874823267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe79c062450 0x7fe79c1200d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:45.353 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a1db1700 1 -- 172.21.15.16:0/874823267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe79c062450 msgr2=0x7fe79c1200d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:45.353 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a1db1700 1 --2- 172.21.15.16:0/874823267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe79c062450 0x7fe79c1200d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.353 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a1db1700 1 -- 172.21.15.16:0/874823267 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe79c0b3190 msgr2=0x7fe79c14fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:45.353 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a1db1700 1 --2- 172.21.15.16:0/874823267 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe79c0b3190 0x7fe79c14fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.354 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a1db1700 1 -- 172.21.15.16:0/874823267 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c150e30 con 0x7fe79c0adc10 2021-01-03T12:57:45.354 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a1db1700 1 --2- 172.21.15.16:0/874823267 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe79c0adc10 0x7fe79c14f9f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fe79c112cc0 tx=0x7fe78c008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:45.354 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe792ffd700 1 -- 172.21.15.16:0/874823267 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe78c009790 con 0x7fe79c0adc10 2021-01-03T12:57:45.354 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe792ffd700 1 -- 172.21.15.16:0/874823267 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c0098f0 con 0x7fe79c0adc10 2021-01-03T12:57:45.354 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a2db3700 1 -- 172.21.15.16:0/874823267 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c11fc30 con 0x7fe79c0adc10 2021-01-03T12:57:45.355 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe792ffd700 1 -- 172.21.15.16:0/874823267 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe78c009c50 con 0x7fe79c0adc10 2021-01-03T12:57:45.355 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a2db3700 1 -- 172.21.15.16:0/874823267 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79c070c80 con 0x7fe79c0adc10 2021-01-03T12:57:45.355 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe792ffd700 1 -- 172.21.15.16:0/874823267 <== mon.2 v2:172.21.15.16:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fe78c013480 con 0x7fe79c0adc10 2021-01-03T12:57:45.355 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe792ffd700 1 -- 172.21.15.16:0/874823267 <== mon.2 v2:172.21.15.16:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fe78c013bc0 con 0x7fe79c0adc10 2021-01-03T12:57:45.355 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.347+0000 7fe7a2db3700 1 -- 172.21.15.16:0/874823267 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79c11fdc0 con 0x7fe79c0adc10 2021-01-03T12:57:45.356 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.351+0000 7fe792ffd700 1 -- 172.21.15.16:0/874823267 <== mon.2 v2:172.21.15.16:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fe78c013d80 con 0x7fe79c0adc10 2021-01-03T12:57:45.429 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.431+0000 7fe7a2db3700 1 -- 172.21.15.16:0/874823267 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_command({"prefix": "osd new", "uuid": "11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a", "id": 0} v 0) v1 -- 0x7fe79c057300 con 0x7fe79c0adc10 2021-01-03T12:57:45.436 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.435+0000 7fe792ffd700 1 -- 172.21.15.16:0/874823267 <== mon.2 v2:172.21.15.16:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe78c02c0b0 con 0x7fe79c0adc10 2021-01-03T12:57:45.436 INFO:teuthology.orchestra.run.smithi016.stdout:0 2021-01-03T12:57:45.437 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.435+0000 7fe7a2db3700 1 -- 172.21.15.16:0/874823267 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe79c0adc10 msgr2=0x7fe79c14f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:45.437 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.435+0000 7fe7a2db3700 1 --2- 172.21.15.16:0/874823267 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe79c0adc10 0x7fe79c14f9f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fe79c112cc0 tx=0x7fe78c008040).stop 2021-01-03T12:57:45.437 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.435+0000 7fe7a2db3700 1 -- 172.21.15.16:0/874823267 shutdown_connections 2021-01-03T12:57:45.438 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.435+0000 7fe7a2db3700 1 --2- 172.21.15.16:0/874823267 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe79c0b3190 0x7fe79c14fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.438 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.435+0000 7fe7a2db3700 1 --2- 172.21.15.16:0/874823267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe79c062450 0x7fe79c1200d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.438 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.435+0000 7fe7a2db3700 1 --2- 172.21.15.16:0/874823267 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe79c0adc10 0x7fe79c14f9f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.438 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.435+0000 7fe7a2db3700 1 -- 172.21.15.16:0/874823267 >> 172.21.15.16:0/874823267 conn(0x7fe79c060d10 msgr2=0x7fe79c0b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:45.438 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.435+0000 7fe7a2db3700 1 -- 172.21.15.16:0/874823267 shutdown_connections 2021-01-03T12:57:45.439 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.435+0000 7fe7a2db3700 1 -- 172.21.15.16:0/874823267 wait complete. 2021-01-03T12:57:45.448 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd new 9170d1de-58d4-4dfd-b9de-80dc15ca9e60 1 2021-01-03T12:57:45.562 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dec55700 1 Processor -- start 2021-01-03T12:57:45.562 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dec55700 1 -- start start 2021-01-03T12:57:45.562 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dec55700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1d8062450 0x7fc1d8067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:45.562 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dec55700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1d80b33b0 0x7fc1d814f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:45.563 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dec55700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d80adff0 con 0x7fc1d80adc10 2021-01-03T12:57:45.563 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dec55700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d80b1930 con 0x7fc1d80b33b0 2021-01-03T12:57:45.563 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dec55700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d805fb80 con 0x7fc1d8062450 2021-01-03T12:57:45.563 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1ddc53700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1d8062450 0x7fc1d8067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:45.564 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1de454700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc1d80adc10 0x7fc1d80b2ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59462/0 (socket says 172.21.15.16:59462) 2021-01-03T12:57:45.564 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1de454700 1 -- 172.21.15.16:0/2075788982 learned_addr learned my addr 172.21.15.16:0/2075788982 (peer_addr_for_me v1:172.21.15.16:0/0) 2021-01-03T12:57:45.564 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dfeb7700 1 --2- 172.21.15.16:0/2075788982 >> v2:172.21.15.133:3300/0 conn(0x7fc1d80b33b0 0x7fc1d814f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:45.564 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dd452700 1 -- 172.21.15.16:0/2075788982 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245412393 0 0) 0x7fc1d80adff0 con 0x7fc1d80adc10 2021-01-03T12:57:45.564 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dd452700 1 -- 172.21.15.16:0/2075788982 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1c4003230 con 0x7fc1d80adc10 2021-01-03T12:57:45.565 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1ddc53700 1 -- 172.21.15.16:0/2075788982 >> v2:172.21.15.133:3300/0 conn(0x7fc1d80b33b0 msgr2=0x7fc1d814f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:45.565 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1ddc53700 1 --2- 172.21.15.16:0/2075788982 >> v2:172.21.15.133:3300/0 conn(0x7fc1d80b33b0 0x7fc1d814f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.565 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1ddc53700 1 -- 172.21.15.16:0/2075788982 >> v1:172.21.15.16:6789/0 conn(0x7fc1d80adc10 legacy=0x7fc1d80b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:45.565 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1ddc53700 1 -- 172.21.15.16:0/2075788982 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d805fed0 con 0x7fc1d8062450 2021-01-03T12:57:45.565 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1ddc53700 1 --2- 172.21.15.16:0/2075788982 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1d8062450 0x7fc1d8067cb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fc1d4002f30 tx=0x7fc1d4006dc0).ready entity=mon.2 client_cookie=44d01f8a6450165 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:45.566 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dd452700 1 -- 172.21.15.16:0/2075788982 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1d4009760 con 0x7fc1d8062450 2021-01-03T12:57:45.566 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dd452700 1 -- 172.21.15.16:0/2075788982 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d40098c0 con 0x7fc1d8062450 2021-01-03T12:57:45.566 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dd452700 1 -- 172.21.15.16:0/2075788982 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1d4009c20 con 0x7fc1d8062450 2021-01-03T12:57:45.566 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dec55700 1 -- 172.21.15.16:0/2075788982 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1d8062450 msgr2=0x7fc1d8067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:45.566 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dec55700 1 --2- 172.21.15.16:0/2075788982 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1d8062450 0x7fc1d8067cb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fc1d4002f30 tx=0x7fc1d4006dc0).stop 2021-01-03T12:57:45.567 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dec55700 1 -- 172.21.15.16:0/2075788982 shutdown_connections 2021-01-03T12:57:45.567 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dec55700 1 --2- 172.21.15.16:0/2075788982 >> v2:172.21.15.133:3300/0 conn(0x7fc1d80b33b0 0x7fc1d814f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.567 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dec55700 1 --2- 172.21.15.16:0/2075788982 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1d8062450 0x7fc1d8067cb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.567 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.559+0000 7fc1dec55700 1 -- 172.21.15.16:0/2075788982 >> 172.21.15.16:0/2075788982 conn(0x7fc1d8060d10 msgr2=0x7fc1d8061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:45.567 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1dec55700 1 -- 172.21.15.16:0/2075788982 shutdown_connections 2021-01-03T12:57:45.568 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1dec55700 1 -- 172.21.15.16:0/2075788982 wait complete. 2021-01-03T12:57:45.570 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1dec55700 1 Processor -- start 2021-01-03T12:57:45.570 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1dec55700 1 -- start start 2021-01-03T12:57:45.570 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1dec55700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1d8062450 0x7fc1d80b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:45.571 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1dec55700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1d80adc10 0x7fc1d8153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:45.571 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1dec55700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1d80b33b0 0x7fc1d8153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:45.571 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1dec55700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8155220 con 0x7fc1d80b33b0 2021-01-03T12:57:45.571 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1dec55700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8128f00 con 0x7fc1d8062450 2021-01-03T12:57:45.571 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1dec55700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d8153b00 con 0x7fc1d80adc10 2021-01-03T12:57:45.572 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1ddc53700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1d80adc10 0x7fc1d8153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:45.572 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1ddc53700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1d80adc10 0x7fc1d8153120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.16:45776/0 (socket says 172.21.15.16:45776) 2021-01-03T12:57:45.572 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1ddc53700 1 -- 172.21.15.16:0/2665782019 learned_addr learned my addr 172.21.15.16:0/2665782019 (peer_addr_for_me v2:172.21.15.16:0/0) 2021-01-03T12:57:45.572 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1dfeb7700 1 --2- 172.21.15.16:0/2665782019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1d80b33b0 0x7fc1d8153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:45.573 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1de454700 1 --2- 172.21.15.16:0/2665782019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1d8062450 0x7fc1d80b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:45.573 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1ddc53700 1 -- 172.21.15.16:0/2665782019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1d8062450 msgr2=0x7fc1d80b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:45.573 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1ddc53700 1 --2- 172.21.15.16:0/2665782019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1d8062450 0x7fc1d80b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.573 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1ddc53700 1 -- 172.21.15.16:0/2665782019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1d80b33b0 msgr2=0x7fc1d8153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:45.573 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1ddc53700 1 --2- 172.21.15.16:0/2665782019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1d80b33b0 0x7fc1d8153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.574 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1ddc53700 1 -- 172.21.15.16:0/2665782019 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d8129130 con 0x7fc1d80adc10 2021-01-03T12:57:45.574 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1ddc53700 1 --2- 172.21.15.16:0/2665782019 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1d80adc10 0x7fc1d8153120 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fc1d80b4df0 tx=0x7fc1d4015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:45.574 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1caffd700 1 -- 172.21.15.16:0/2665782019 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1d40119e0 con 0x7fc1d80adc10 2021-01-03T12:57:45.574 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1caffd700 1 -- 172.21.15.16:0/2665782019 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d4011b40 con 0x7fc1d80adc10 2021-01-03T12:57:45.574 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1dec55700 1 -- 172.21.15.16:0/2665782019 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d81293d0 con 0x7fc1d80adc10 2021-01-03T12:57:45.575 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1caffd700 1 -- 172.21.15.16:0/2665782019 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1d4011ea0 con 0x7fc1d80adc10 2021-01-03T12:57:45.575 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1dec55700 1 -- 172.21.15.16:0/2665782019 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d8127070 con 0x7fc1d80adc10 2021-01-03T12:57:45.575 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1caffd700 1 -- 172.21.15.16:0/2665782019 <== mon.2 v2:172.21.15.16:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fc1d4024030 con 0x7fc1d80adc10 2021-01-03T12:57:45.575 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.563+0000 7fc1caffd700 1 -- 172.21.15.16:0/2665782019 <== mon.2 v2:172.21.15.16:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fc1d4027ac0 con 0x7fc1d80adc10 2021-01-03T12:57:45.575 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.567+0000 7fc1dec55700 1 -- 172.21.15.16:0/2665782019 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d8057300 con 0x7fc1d80adc10 2021-01-03T12:57:45.576 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.571+0000 7fc1caffd700 1 -- 172.21.15.16:0/2665782019 <== mon.2 v2:172.21.15.16:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fc1d4022070 con 0x7fc1d80adc10 2021-01-03T12:57:45.649 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.647+0000 7fc1dec55700 1 -- 172.21.15.16:0/2665782019 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9170d1de-58d4-4dfd-b9de-80dc15ca9e60", "id": 1} v 0) v1 -- 0x7fc1d8068660 con 0x7fc1d80adc10 2021-01-03T12:57:45.655 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.655+0000 7fc1caffd700 1 -- 172.21.15.16:0/2665782019 <== mon.2 v2:172.21.15.16:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9170d1de-58d4-4dfd-b9de-80dc15ca9e60", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc1d401d440 con 0x7fc1d80adc10 2021-01-03T12:57:45.655 INFO:teuthology.orchestra.run.smithi016.stdout:1 2021-01-03T12:57:45.656 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.655+0000 7fc1dec55700 1 -- 172.21.15.16:0/2665782019 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1d80adc10 msgr2=0x7fc1d8153120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:45.656 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.655+0000 7fc1dec55700 1 --2- 172.21.15.16:0/2665782019 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1d80adc10 0x7fc1d8153120 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fc1d80b4df0 tx=0x7fc1d4015000).stop 2021-01-03T12:57:45.657 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.655+0000 7fc1dec55700 1 -- 172.21.15.16:0/2665782019 shutdown_connections 2021-01-03T12:57:45.657 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.655+0000 7fc1dec55700 1 --2- 172.21.15.16:0/2665782019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1d80b33b0 0x7fc1d8153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.657 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.655+0000 7fc1dec55700 1 --2- 172.21.15.16:0/2665782019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1d8062450 0x7fc1d80b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.657 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.655+0000 7fc1dec55700 1 --2- 172.21.15.16:0/2665782019 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1d80adc10 0x7fc1d8153120 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.658 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.655+0000 7fc1dec55700 1 -- 172.21.15.16:0/2665782019 >> 172.21.15.16:0/2665782019 conn(0x7fc1d8060d10 msgr2=0x7fc1d80b6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:45.658 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.655+0000 7fc1dec55700 1 -- 172.21.15.16:0/2665782019 shutdown_connections 2021-01-03T12:57:45.658 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.655+0000 7fc1dec55700 1 -- 172.21.15.16:0/2665782019 wait complete. 2021-01-03T12:57:45.670 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd new 9fc5adf9-3537-4953-9c65-0c67ecb53776 2 2021-01-03T12:57:45.778 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb29971700 1 Processor -- start 2021-01-03T12:57:45.778 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb29971700 1 -- start start 2021-01-03T12:57:45.778 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb29971700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feb24060b00 0x7feb240af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:45.778 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb29971700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb240abff0 0x7feb240afee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:45.779 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb29971700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2409a380 con 0x7feb240b5120 2021-01-03T12:57:45.779 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb29971700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb24062340 con 0x7feb24060b00 2021-01-03T12:57:45.779 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb29971700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb24060090 con 0x7feb240abff0 2021-01-03T12:57:45.779 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb22ffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feb24060b00 0x7feb240af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:45.779 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb23fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb240abff0 0x7feb240afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:45.780 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb237fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7feb240b5120 0x7feb240ab8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59474/0 (socket says 172.21.15.16:59474) 2021-01-03T12:57:45.780 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb237fe700 1 -- 172.21.15.16:0/904826073 learned_addr learned my addr 172.21.15.16:0/904826073 (peer_addr_for_me v1:172.21.15.16:0/0) 2021-01-03T12:57:45.780 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb22ffd700 1 -- 172.21.15.16:0/904826073 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb240abff0 msgr2=0x7feb240afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:45.780 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb22ffd700 1 --2- 172.21.15.16:0/904826073 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb240abff0 0x7feb240afee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.780 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb22ffd700 1 -- 172.21.15.16:0/904826073 >> v1:172.21.15.16:6789/0 conn(0x7feb240b5120 legacy=0x7feb240ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:45.781 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb22ffd700 1 -- 172.21.15.16:0/904826073 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb24060330 con 0x7feb24060b00 2021-01-03T12:57:45.781 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb23fff700 1 --2- 172.21.15.16:0/904826073 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb240abff0 0x7feb240afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:57:45.781 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb22ffd700 1 --2- 172.21.15.16:0/904826073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb24060b00 0x7feb240af9f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7feb18002f30 tx=0x7feb18006dc0).ready entity=mon.0 client_cookie=a30be573b7dd2252 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:45.781 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb227fc700 1 -- 172.21.15.16:0/904826073 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb18009760 con 0x7feb24060b00 2021-01-03T12:57:45.781 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb227fc700 1 -- 172.21.15.16:0/904826073 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb180098c0 con 0x7feb24060b00 2021-01-03T12:57:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb227fc700 1 -- 172.21.15.16:0/904826073 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb18009c20 con 0x7feb24060b00 2021-01-03T12:57:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb29971700 1 -- 172.21.15.16:0/904826073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb24060b00 msgr2=0x7feb240af9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb29971700 1 --2- 172.21.15.16:0/904826073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb24060b00 0x7feb240af9f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7feb18002f30 tx=0x7feb18006dc0).stop 2021-01-03T12:57:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb29971700 1 -- 172.21.15.16:0/904826073 shutdown_connections 2021-01-03T12:57:45.782 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb29971700 1 --2- 172.21.15.16:0/904826073 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb240abff0 0x7feb240afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.783 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb29971700 1 --2- 172.21.15.16:0/904826073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb24060b00 0x7feb240af9f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.783 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb29971700 1 -- 172.21.15.16:0/904826073 >> 172.21.15.16:0/904826073 conn(0x7feb2405bdf0 msgr2=0x7feb2405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:45.783 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb29971700 1 -- 172.21.15.16:0/904826073 shutdown_connections 2021-01-03T12:57:45.783 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.775+0000 7feb29971700 1 -- 172.21.15.16:0/904826073 wait complete. 2021-01-03T12:57:45.786 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.779+0000 7feb29971700 1 Processor -- start 2021-01-03T12:57:45.786 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.779+0000 7feb29971700 1 -- start start 2021-01-03T12:57:45.786 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.779+0000 7feb29971700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb24060b00 0x7feb240aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:45.786 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.779+0000 7feb29971700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb240abff0 0x7feb240afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:45.787 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.779+0000 7feb29971700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb240b5120 0x7feb240ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:45.787 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.779+0000 7feb29971700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb240af1e0 con 0x7feb24060b00 2021-01-03T12:57:45.787 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.779+0000 7feb29971700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb240ad080 con 0x7feb240abff0 2021-01-03T12:57:45.787 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.779+0000 7feb29971700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb24066670 con 0x7feb240b5120 2021-01-03T12:57:45.787 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.779+0000 7feb237fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb24060b00 0x7feb240aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:45.788 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.779+0000 7feb23fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb240b5120 0x7feb240ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:45.788 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.779+0000 7feb237fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb24060b00 0x7feb240aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50958/0 (socket says 172.21.15.16:50958) 2021-01-03T12:57:45.788 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.779+0000 7feb23fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb240b5120 0x7feb240ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.16:45790/0 (socket says 172.21.15.16:45790) 2021-01-03T12:57:45.788 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.779+0000 7feb237fe700 1 -- 172.21.15.16:0/4002004222 learned_addr learned my addr 172.21.15.16:0/4002004222 (peer_addr_for_me v2:172.21.15.16:0/0) 2021-01-03T12:57:45.789 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.779+0000 7feb22ffd700 1 --2- 172.21.15.16:0/4002004222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb240abff0 0x7feb240afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:45.789 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.779+0000 7feb237fe700 1 -- 172.21.15.16:0/4002004222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb240b5120 msgr2=0x7feb240ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:45.789 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.783+0000 7feb237fe700 1 --2- 172.21.15.16:0/4002004222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb240b5120 0x7feb240ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.789 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.783+0000 7feb237fe700 1 -- 172.21.15.16:0/4002004222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb240abff0 msgr2=0x7feb240afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:45.789 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.783+0000 7feb237fe700 1 --2- 172.21.15.16:0/4002004222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb240abff0 0x7feb240afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.790 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.783+0000 7feb237fe700 1 -- 172.21.15.16:0/4002004222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb240ae4e0 con 0x7feb24060b00 2021-01-03T12:57:45.790 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.783+0000 7feb23fff700 1 --2- 172.21.15.16:0/4002004222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb240b5120 0x7feb240ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:57:45.790 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.783+0000 7feb237fe700 1 --2- 172.21.15.16:0/4002004222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb24060b00 0x7feb240aaa80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7feb24068140 tx=0x7feb14007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:45.790 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.783+0000 7feb0bfff700 1 -- 172.21.15.16:0/4002004222 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb14007380 con 0x7feb24060b00 2021-01-03T12:57:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.783+0000 7feb29971700 1 -- 172.21.15.16:0/4002004222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb240ad2b0 con 0x7feb24060b00 2021-01-03T12:57:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.783+0000 7feb0bfff700 1 -- 172.21.15.16:0/4002004222 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb14005030 con 0x7feb24060b00 2021-01-03T12:57:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.783+0000 7feb0bfff700 1 -- 172.21.15.16:0/4002004222 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb14005390 con 0x7feb24060b00 2021-01-03T12:57:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.783+0000 7feb29971700 1 -- 172.21.15.16:0/4002004222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb240adc60 con 0x7feb24060b00 2021-01-03T12:57:45.791 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.783+0000 7feb0bfff700 1 -- 172.21.15.16:0/4002004222 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7feb1401b070 con 0x7feb24060b00 2021-01-03T12:57:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.783+0000 7feb0bfff700 1 -- 172.21.15.16:0/4002004222 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7feb140057b0 con 0x7feb24060b00 2021-01-03T12:57:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.783+0000 7feb29971700 1 -- 172.21.15.16:0/4002004222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb240ae670 con 0x7feb24060b00 2021-01-03T12:57:45.792 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.787+0000 7feb0bfff700 1 -- 172.21.15.16:0/4002004222 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7feb14019060 con 0x7feb24060b00 2021-01-03T12:57:45.866 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.867+0000 7feb29971700 1 -- 172.21.15.16:0/4002004222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9fc5adf9-3537-4953-9c65-0c67ecb53776", "id": 2} v 0) v1 -- 0x7feb240ad570 con 0x7feb24060b00 2021-01-03T12:57:45.871 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.871+0000 7feb0bfff700 1 -- 172.21.15.16:0/4002004222 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9fc5adf9-3537-4953-9c65-0c67ecb53776", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7feb14022020 con 0x7feb24060b00 2021-01-03T12:57:45.872 INFO:teuthology.orchestra.run.smithi016.stdout:2 2021-01-03T12:57:45.873 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.871+0000 7feb29971700 1 -- 172.21.15.16:0/4002004222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb24060b00 msgr2=0x7feb240aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:45.873 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.871+0000 7feb29971700 1 --2- 172.21.15.16:0/4002004222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb24060b00 0x7feb240aaa80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7feb24068140 tx=0x7feb14007c30).stop 2021-01-03T12:57:45.873 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.871+0000 7feb29971700 1 -- 172.21.15.16:0/4002004222 shutdown_connections 2021-01-03T12:57:45.873 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.871+0000 7feb29971700 1 --2- 172.21.15.16:0/4002004222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb24060b00 0x7feb240aaa80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.874 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.871+0000 7feb29971700 1 --2- 172.21.15.16:0/4002004222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb240b5120 0x7feb240ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.874 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.871+0000 7feb29971700 1 --2- 172.21.15.16:0/4002004222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb240abff0 0x7feb240afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.874 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.871+0000 7feb29971700 1 -- 172.21.15.16:0/4002004222 >> 172.21.15.16:0/4002004222 conn(0x7feb2405bdf0 msgr2=0x7feb24064480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:45.874 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.871+0000 7feb29971700 1 -- 172.21.15.16:0/4002004222 shutdown_connections 2021-01-03T12:57:45.874 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.871+0000 7feb29971700 1 -- 172.21.15.16:0/4002004222 wait complete. 2021-01-03T12:57:45.884 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd new 0ad45ce5-6635-4089-bbf8-c966d0fe5338 3 2021-01-03T12:57:45.993 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.987+0000 7fed19774700 1 Processor -- start 2021-01-03T12:57:45.993 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.987+0000 7fed19774700 1 -- start start 2021-01-03T12:57:45.993 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed19774700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fed140b5120 0x7fed140ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:45.993 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed19774700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed14060b00 0x7fed140abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:45.994 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed19774700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed1409a380 con 0x7fed140af9f0 2021-01-03T12:57:45.994 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed19774700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed14062340 con 0x7fed140b5120 2021-01-03T12:57:45.994 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed19774700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed140ac2c0 con 0x7fed14060b00 2021-01-03T12:57:45.994 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed12ffd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed14060b00 0x7fed140abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:45.994 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed12ffd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed14060b00 0x7fed140abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.16:45794/0 (socket says 172.21.15.16:45794) 2021-01-03T12:57:45.995 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed12ffd700 1 -- 172.21.15.16:0/3899824524 learned_addr learned my addr 172.21.15.16:0/3899824524 (peer_addr_for_me v2:172.21.15.16:0/0) 2021-01-03T12:57:45.995 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed137fe700 1 --2- 172.21.15.16:0/3899824524 >> v2:172.21.15.133:3300/0 conn(0x7fed140b5120 0x7fed140ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:45.995 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed12ffd700 1 -- 172.21.15.16:0/3899824524 >> v2:172.21.15.133:3300/0 conn(0x7fed140b5120 msgr2=0x7fed140ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:45.995 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed12ffd700 1 --2- 172.21.15.16:0/3899824524 >> v2:172.21.15.133:3300/0 conn(0x7fed140b5120 0x7fed140ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.995 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed12ffd700 1 -- 172.21.15.16:0/3899824524 >> v1:172.21.15.133:6789/0 conn(0x7fed140af9f0 legacy=0x7fed140afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:45.996 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed12ffd700 1 -- 172.21.15.16:0/3899824524 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed14060090 con 0x7fed14060b00 2021-01-03T12:57:45.996 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed137fe700 1 --2- 172.21.15.16:0/3899824524 >> v2:172.21.15.133:3300/0 conn(0x7fed140b5120 0x7fed140ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:57:45.996 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed12ffd700 1 --2- 172.21.15.16:0/3899824524 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed14060b00 0x7fed140abdd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fecfc002f30 tx=0x7fecfc006e80).ready entity=mon.2 client_cookie=ceead0b378af931f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:45.996 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed127fc700 1 -- 172.21.15.16:0/3899824524 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecfc0097f0 con 0x7fed14060b00 2021-01-03T12:57:45.996 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed127fc700 1 -- 172.21.15.16:0/3899824524 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc009950 con 0x7fed14060b00 2021-01-03T12:57:45.997 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed127fc700 1 -- 172.21.15.16:0/3899824524 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecfc009cb0 con 0x7fed14060b00 2021-01-03T12:57:45.997 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed19774700 1 -- 172.21.15.16:0/3899824524 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed14060b00 msgr2=0x7fed140abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:45.997 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed19774700 1 --2- 172.21.15.16:0/3899824524 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed14060b00 0x7fed140abdd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fecfc002f30 tx=0x7fecfc006e80).stop 2021-01-03T12:57:45.997 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed19774700 1 -- 172.21.15.16:0/3899824524 shutdown_connections 2021-01-03T12:57:45.997 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed19774700 1 --2- 172.21.15.16:0/3899824524 >> v2:172.21.15.133:3300/0 conn(0x7fed140b5120 0x7fed140ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.998 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed19774700 1 --2- 172.21.15.16:0/3899824524 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed14060b00 0x7fed140abdd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:45.998 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed19774700 1 -- 172.21.15.16:0/3899824524 >> 172.21.15.16:0/3899824524 conn(0x7fed1405bdf0 msgr2=0x7fed1405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:45.998 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed19774700 1 -- 172.21.15.16:0/3899824524 shutdown_connections 2021-01-03T12:57:45.998 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.991+0000 7fed19774700 1 -- 172.21.15.16:0/3899824524 wait complete. 2021-01-03T12:57:46.000 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed19774700 1 Processor -- start 2021-01-03T12:57:46.001 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed19774700 1 -- start start 2021-01-03T12:57:46.001 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed19774700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed14060b00 0x7fed1412db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.001 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed19774700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed140af9f0 0x7fed14066990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.001 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed19774700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed140b5120 0x7fed14066e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.002 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed19774700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed14142190 con 0x7fed140af9f0 2021-01-03T12:57:46.002 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed19774700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed14142430 con 0x7fed14060b00 2021-01-03T12:57:46.002 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed19774700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed141426d0 con 0x7fed140b5120 2021-01-03T12:57:46.002 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed12ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed140af9f0 0x7fed14066990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.002 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed12ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed140af9f0 0x7fed14066990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50972/0 (socket says 172.21.15.16:50972) 2021-01-03T12:57:46.003 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed12ffd700 1 -- 172.21.15.16:0/1919524459 learned_addr learned my addr 172.21.15.16:0/1919524459 (peer_addr_for_me v2:172.21.15.16:0/0) 2021-01-03T12:57:46.003 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed13fff700 1 --2- 172.21.15.16:0/1919524459 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed140b5120 0x7fed14066e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.003 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed137fe700 1 --2- 172.21.15.16:0/1919524459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed14060b00 0x7fed1412db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.003 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed12ffd700 1 -- 172.21.15.16:0/1919524459 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed140b5120 msgr2=0x7fed14066e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.003 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed12ffd700 1 --2- 172.21.15.16:0/1919524459 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed140b5120 0x7fed14066e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.004 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed12ffd700 1 -- 172.21.15.16:0/1919524459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed14060b00 msgr2=0x7fed1412db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.004 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed12ffd700 1 --2- 172.21.15.16:0/1919524459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed14060b00 0x7fed1412db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.004 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed12ffd700 1 -- 172.21.15.16:0/1919524459 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed14142970 con 0x7fed140af9f0 2021-01-03T12:57:46.004 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed137fe700 1 --2- 172.21.15.16:0/1919524459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed14060b00 0x7fed1412db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:57:46.005 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed12ffd700 1 --2- 172.21.15.16:0/1919524459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed140af9f0 0x7fed14066990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fecfc002f30 tx=0x7fecfc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:46.005 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed0bfff700 1 -- 172.21.15.16:0/1919524459 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecfc011c30 con 0x7fed140af9f0 2021-01-03T12:57:46.005 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed0bfff700 1 -- 172.21.15.16:0/1919524459 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc011d90 con 0x7fed140af9f0 2021-01-03T12:57:46.005 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed19774700 1 -- 172.21.15.16:0/1919524459 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed14142e10 con 0x7fed140af9f0 2021-01-03T12:57:46.005 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed0bfff700 1 -- 172.21.15.16:0/1919524459 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fecfc01e650 con 0x7fed140af9f0 2021-01-03T12:57:46.006 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed19774700 1 -- 172.21.15.16:0/1919524459 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1412fe50 con 0x7fed140af9f0 2021-01-03T12:57:46.006 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed0bfff700 1 -- 172.21.15.16:0/1919524459 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fecfc025030 con 0x7fed140af9f0 2021-01-03T12:57:46.006 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.995+0000 7fed0bfff700 1 -- 172.21.15.16:0/1919524459 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7fecfc01d880 con 0x7fed140af9f0 2021-01-03T12:57:46.006 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.999+0000 7fed19774700 1 -- 172.21.15.16:0/1919524459 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed140b06b0 con 0x7fed140af9f0 2021-01-03T12:57:46.006 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:45.999+0000 7fed0bfff700 1 -- 172.21.15.16:0/1919524459 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fed140b06b0 con 0x7fed140af9f0 2021-01-03T12:57:46.080 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.079+0000 7fed19774700 1 -- 172.21.15.16:0/1919524459 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0ad45ce5-6635-4089-bbf8-c966d0fe5338", "id": 3} v 0) v1 -- 0x7fed14057300 con 0x7fed140af9f0 2021-01-03T12:57:46.084 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.083+0000 7fed0bfff700 1 -- 172.21.15.16:0/1919524459 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0ad45ce5-6635-4089-bbf8-c966d0fe5338", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fecfc023070 con 0x7fed140af9f0 2021-01-03T12:57:46.085 INFO:teuthology.orchestra.run.smithi016.stdout:3 2021-01-03T12:57:46.086 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.087+0000 7fed19774700 1 -- 172.21.15.16:0/1919524459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed140af9f0 msgr2=0x7fed14066990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.086 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.087+0000 7fed19774700 1 --2- 172.21.15.16:0/1919524459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed140af9f0 0x7fed14066990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fecfc002f30 tx=0x7fecfc015000).stop 2021-01-03T12:57:46.086 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.087+0000 7fed19774700 1 -- 172.21.15.16:0/1919524459 shutdown_connections 2021-01-03T12:57:46.087 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.087+0000 7fed19774700 1 --2- 172.21.15.16:0/1919524459 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed140b5120 0x7fed14066e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.087 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.087+0000 7fed19774700 1 --2- 172.21.15.16:0/1919524459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed14060b00 0x7fed1412db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.087 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.087+0000 7fed19774700 1 --2- 172.21.15.16:0/1919524459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed140af9f0 0x7fed14066990 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.087 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.087+0000 7fed19774700 1 -- 172.21.15.16:0/1919524459 >> 172.21.15.16:0/1919524459 conn(0x7fed1405bdf0 msgr2=0x7fed14130c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:46.087 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.087+0000 7fed19774700 1 -- 172.21.15.16:0/1919524459 shutdown_connections 2021-01-03T12:57:46.088 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.087+0000 7fed19774700 1 -- 172.21.15.16:0/1919524459 wait complete. 2021-01-03T12:57:46.098 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd new 86b8d6d5-271b-4a70-ae7b-a227afb38d7c 4 2021-01-03T12:57:46.210 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c0e1e700 1 Processor -- start 2021-01-03T12:57:46.210 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c0e1e700 1 -- start start 2021-01-03T12:57:46.210 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c0e1e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f87bc062450 0x7f87bc067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.211 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c0e1e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87bc0b33b0 0x7f87bc14f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.211 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c0e1e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87bc0adff0 con 0x7f87bc0adc10 2021-01-03T12:57:46.211 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c0e1e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87bc0b1930 con 0x7f87bc062450 2021-01-03T12:57:46.211 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c0e1e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc05fb80 con 0x7f87bc0b33b0 2021-01-03T12:57:46.212 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87bbfff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f87bc0adc10 0x7f87bc0b2ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59498/0 (socket says 172.21.15.16:59498) 2021-01-03T12:57:46.212 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87bbfff700 1 -- 172.21.15.16:0/1711942338 learned_addr learned my addr 172.21.15.16:0/1711942338 (peer_addr_for_me v1:172.21.15.16:0/0) 2021-01-03T12:57:46.212 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c2080700 1 --2- 172.21.15.16:0/1711942338 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87bc0b33b0 0x7f87bc14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.212 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87bb7fe700 1 --2- 172.21.15.16:0/1711942338 >> v2:172.21.15.133:3300/0 conn(0x7f87bc062450 0x7f87bc067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.212 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87baffd700 1 -- 172.21.15.16:0/1711942338 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466060107 0 0) 0x7f87bc0adff0 con 0x7f87bc0adc10 2021-01-03T12:57:46.213 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87baffd700 1 -- 172.21.15.16:0/1711942338 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f879c003230 con 0x7f87bc0adc10 2021-01-03T12:57:46.213 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c2080700 1 -- 172.21.15.16:0/1711942338 >> v2:172.21.15.133:3300/0 conn(0x7f87bc062450 msgr2=0x7f87bc067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:46.213 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c2080700 1 --2- 172.21.15.16:0/1711942338 >> v2:172.21.15.133:3300/0 conn(0x7f87bc062450 0x7f87bc067cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.213 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c2080700 1 -- 172.21.15.16:0/1711942338 >> v1:172.21.15.16:6789/0 conn(0x7f87bc0adc10 legacy=0x7f87bc0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.213 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c2080700 1 -- 172.21.15.16:0/1711942338 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87bc05fed0 con 0x7f87bc0b33b0 2021-01-03T12:57:46.214 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c2080700 1 --2- 172.21.15.16:0/1711942338 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87bc0b33b0 0x7f87bc14f870 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f87ac0032b0 tx=0x7f87ac0091a0).ready entity=mon.2 client_cookie=7898cdf28d90638b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:46.214 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87baffd700 1 -- 172.21.15.16:0/1711942338 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87ac00b9a0 con 0x7f87bc0b33b0 2021-01-03T12:57:46.214 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87baffd700 1 -- 172.21.15.16:0/1711942338 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ac00bb00 con 0x7f87bc0b33b0 2021-01-03T12:57:46.214 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87baffd700 1 -- 172.21.15.16:0/1711942338 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87ac00bc70 con 0x7f87bc0b33b0 2021-01-03T12:57:46.215 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c0e1e700 1 -- 172.21.15.16:0/1711942338 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87bc0b33b0 msgr2=0x7f87bc14f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.215 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c0e1e700 1 --2- 172.21.15.16:0/1711942338 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87bc0b33b0 0x7f87bc14f870 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f87ac0032b0 tx=0x7f87ac0091a0).stop 2021-01-03T12:57:46.215 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c0e1e700 1 -- 172.21.15.16:0/1711942338 shutdown_connections 2021-01-03T12:57:46.215 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c0e1e700 1 --2- 172.21.15.16:0/1711942338 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87bc0b33b0 0x7f87bc14f870 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.215 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c0e1e700 1 --2- 172.21.15.16:0/1711942338 >> v2:172.21.15.133:3300/0 conn(0x7f87bc062450 0x7f87bc067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.216 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c0e1e700 1 -- 172.21.15.16:0/1711942338 >> 172.21.15.16:0/1711942338 conn(0x7f87bc060d10 msgr2=0x7f87bc061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:46.216 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c0e1e700 1 -- 172.21.15.16:0/1711942338 shutdown_connections 2021-01-03T12:57:46.217 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.207+0000 7f87c0e1e700 1 -- 172.21.15.16:0/1711942338 wait complete. 2021-01-03T12:57:46.220 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87c0e1e700 1 Processor -- start 2021-01-03T12:57:46.220 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87c0e1e700 1 -- start start 2021-01-03T12:57:46.220 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87c0e1e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87bc062450 0x7f87bc12c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.220 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87c0e1e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87bc0adc10 0x7f87bc142040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.221 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87c0e1e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87bc0b33b0 0x7f87bc142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.221 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87c0e1e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc141bb0 con 0x7f87bc062450 2021-01-03T12:57:46.221 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87c0e1e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc0b4090 con 0x7f87bc0adc10 2021-01-03T12:57:46.221 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87c0e1e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc0b4810 con 0x7f87bc0b33b0 2021-01-03T12:57:46.222 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87bbfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87bc062450 0x7f87bc12c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.222 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87bbfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87bc062450 0x7f87bc12c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50982/0 (socket says 172.21.15.16:50982) 2021-01-03T12:57:46.222 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87bbfff700 1 -- 172.21.15.16:0/3472464985 learned_addr learned my addr 172.21.15.16:0/3472464985 (peer_addr_for_me v2:172.21.15.16:0/0) 2021-01-03T12:57:46.222 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87c2080700 1 --2- 172.21.15.16:0/3472464985 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87bc0b33b0 0x7f87bc142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.222 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87bb7fe700 1 --2- 172.21.15.16:0/3472464985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87bc0adc10 0x7f87bc142040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87bbfff700 1 -- 172.21.15.16:0/3472464985 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87bc0b33b0 msgr2=0x7f87bc142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87bbfff700 1 --2- 172.21.15.16:0/3472464985 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87bc0b33b0 0x7f87bc142530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87bbfff700 1 -- 172.21.15.16:0/3472464985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87bc0adc10 msgr2=0x7f87bc142040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87bbfff700 1 --2- 172.21.15.16:0/3472464985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87bc0adc10 0x7f87bc142040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.224 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87bbfff700 1 -- 172.21.15.16:0/3472464985 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87bc0b42c0 con 0x7f87bc062450 2021-01-03T12:57:46.224 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87bbfff700 1 --2- 172.21.15.16:0/3472464985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87bc062450 0x7f87bc12c130 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f87a40010d0 tx=0x7f87a4007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:46.224 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87b8ff9700 1 -- 172.21.15.16:0/3472464985 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87a40072e0 con 0x7f87bc062450 2021-01-03T12:57:46.224 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87b8ff9700 1 -- 172.21.15.16:0/3472464985 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a4007440 con 0x7f87bc062450 2021-01-03T12:57:46.224 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87c0e1e700 1 -- 172.21.15.16:0/3472464985 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87bc0b4a40 con 0x7f87bc062450 2021-01-03T12:57:46.225 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87b8ff9700 1 -- 172.21.15.16:0/3472464985 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87a40057d0 con 0x7f87bc062450 2021-01-03T12:57:46.225 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87c0e1e700 1 -- 172.21.15.16:0/3472464985 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87bc142a20 con 0x7f87bc062450 2021-01-03T12:57:46.225 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87b8ff9700 1 -- 172.21.15.16:0/3472464985 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f87a4010070 con 0x7f87bc062450 2021-01-03T12:57:46.226 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.211+0000 7f87b8ff9700 1 -- 172.21.15.16:0/3472464985 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f87a401c920 con 0x7f87bc062450 2021-01-03T12:57:46.226 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.215+0000 7f87c0e1e700 1 -- 172.21.15.16:0/3472464985 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87bc0b4bd0 con 0x7f87bc062450 2021-01-03T12:57:46.226 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.215+0000 7f87b8ff9700 1 -- 172.21.15.16:0/3472464985 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f87a401cc00 con 0x7f87bc062450 2021-01-03T12:57:46.295 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.295+0000 7f87c0e1e700 1 -- 172.21.15.16:0/3472464985 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd new", "uuid": "86b8d6d5-271b-4a70-ae7b-a227afb38d7c", "id": 4} v 0) v1 -- 0x7f87bc057300 con 0x7f87bc062450 2021-01-03T12:57:46.301 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.299+0000 7f87b8ff9700 1 -- 172.21.15.16:0/3472464985 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86b8d6d5-271b-4a70-ae7b-a227afb38d7c", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f87a401cda0 con 0x7f87bc062450 2021-01-03T12:57:46.301 INFO:teuthology.orchestra.run.smithi016.stdout:4 2021-01-03T12:57:46.302 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.303+0000 7f87c0e1e700 1 -- 172.21.15.16:0/3472464985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87bc062450 msgr2=0x7f87bc12c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.302 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.303+0000 7f87c0e1e700 1 --2- 172.21.15.16:0/3472464985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87bc062450 0x7f87bc12c130 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f87a40010d0 tx=0x7f87a4007a70).stop 2021-01-03T12:57:46.303 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.303+0000 7f87c0e1e700 1 -- 172.21.15.16:0/3472464985 shutdown_connections 2021-01-03T12:57:46.303 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.303+0000 7f87c0e1e700 1 --2- 172.21.15.16:0/3472464985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87bc062450 0x7f87bc12c130 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.303 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.303+0000 7f87c0e1e700 1 --2- 172.21.15.16:0/3472464985 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87bc0b33b0 0x7f87bc142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.303 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.303+0000 7f87c0e1e700 1 --2- 172.21.15.16:0/3472464985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87bc0adc10 0x7f87bc142040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.303 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.303+0000 7f87c0e1e700 1 -- 172.21.15.16:0/3472464985 >> 172.21.15.16:0/3472464985 conn(0x7f87bc060d10 msgr2=0x7f87bc12a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:46.304 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.303+0000 7f87c0e1e700 1 -- 172.21.15.16:0/3472464985 shutdown_connections 2021-01-03T12:57:46.304 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.303+0000 7f87c0e1e700 1 -- 172.21.15.16:0/3472464985 wait complete. 2021-01-03T12:57:46.314 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd new 173feb9d-f596-4030-85d8-1f4b46a9ffe5 5 2021-01-03T12:57:46.421 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1cacad700 1 Processor -- start 2021-01-03T12:57:46.421 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1cacad700 1 -- start start 2021-01-03T12:57:46.421 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1cacad700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe1c40adc10 0x7fe1c4067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.422 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1cacad700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe1c4062450 0x7fe1c40b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.422 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1cacad700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c40adff0 con 0x7fe1c40b3190 2021-01-03T12:57:46.422 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1cacad700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c40b1930 con 0x7fe1c40adc10 2021-01-03T12:57:46.422 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1cacad700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c405fb80 con 0x7fe1c4062450 2021-01-03T12:57:46.422 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1ca4ac700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe1c40adc10 0x7fe1c4067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.423 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1ca4ac700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe1c40adc10 0x7fe1c4067cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50988/0 (socket says 172.21.15.16:50988) 2021-01-03T12:57:46.423 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1ca4ac700 1 -- 172.21.15.16:0/1805593178 learned_addr learned my addr 172.21.15.16:0/1805593178 (peer_addr_for_me v2:172.21.15.16:0/0) 2021-01-03T12:57:46.423 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1c9cab700 1 --2- 172.21.15.16:0/1805593178 >> v2:172.21.15.133:3300/0 conn(0x7fe1c4062450 0x7fe1c40b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.423 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1ca4ac700 1 -- 172.21.15.16:0/1805593178 >> v2:172.21.15.133:3300/0 conn(0x7fe1c4062450 msgr2=0x7fe1c40b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:46.423 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1ca4ac700 1 --2- 172.21.15.16:0/1805593178 >> v2:172.21.15.133:3300/0 conn(0x7fe1c4062450 0x7fe1c40b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.424 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1ca4ac700 1 -- 172.21.15.16:0/1805593178 >> v1:172.21.15.133:6789/0 conn(0x7fe1c40b3190 legacy=0x7fe1c4025140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:46.424 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1ca4ac700 1 -- 172.21.15.16:0/1805593178 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c405fed0 con 0x7fe1c40adc10 2021-01-03T12:57:46.424 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1ca4ac700 1 --2- 172.21.15.16:0/1805593178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1c40adc10 0x7fe1c4067cb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fe1c4026230 tx=0x7fe1c0006e80).ready entity=mon.0 client_cookie=7f54b86628db8bfc server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:46.424 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1c94aa700 1 -- 172.21.15.16:0/1805593178 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1c00097b0 con 0x7fe1c40adc10 2021-01-03T12:57:46.424 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1c94aa700 1 -- 172.21.15.16:0/1805593178 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c0009910 con 0x7fe1c40adc10 2021-01-03T12:57:46.425 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1c94aa700 1 -- 172.21.15.16:0/1805593178 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1c0009a80 con 0x7fe1c40adc10 2021-01-03T12:57:46.425 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1cacad700 1 -- 172.21.15.16:0/1805593178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1c40adc10 msgr2=0x7fe1c4067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.425 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1cacad700 1 --2- 172.21.15.16:0/1805593178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1c40adc10 0x7fe1c4067cb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fe1c4026230 tx=0x7fe1c0006e80).stop 2021-01-03T12:57:46.426 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1cacad700 1 -- 172.21.15.16:0/1805593178 shutdown_connections 2021-01-03T12:57:46.426 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1cacad700 1 --2- 172.21.15.16:0/1805593178 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1c40adc10 0x7fe1c4067cb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.426 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1cacad700 1 --2- 172.21.15.16:0/1805593178 >> v2:172.21.15.133:3300/0 conn(0x7fe1c4062450 0x7fe1c40b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.426 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1cacad700 1 -- 172.21.15.16:0/1805593178 >> 172.21.15.16:0/1805593178 conn(0x7fe1c4060d10 msgr2=0x7fe1c4061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:46.426 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1cacad700 1 -- 172.21.15.16:0/1805593178 shutdown_connections 2021-01-03T12:57:46.427 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.419+0000 7fe1cacad700 1 -- 172.21.15.16:0/1805593178 wait complete. 2021-01-03T12:57:46.429 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cacad700 1 Processor -- start 2021-01-03T12:57:46.429 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cacad700 1 -- start start 2021-01-03T12:57:46.430 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cacad700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe1c4062450 0x7fe1c40b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.430 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cacad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1c40adc10 0x7fe1c4065aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.430 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cacad700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1c40b3190 0x7fe1c4065f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.430 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cacad700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c412c460 con 0x7fe1c40b3190 2021-01-03T12:57:46.430 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cacad700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c4067180 con 0x7fe1c40adc10 2021-01-03T12:57:46.431 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cacad700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c40654f0 con 0x7fe1c4062450 2021-01-03T12:57:46.431 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1ca4ac700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe1c4062450 0x7fe1c40b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.431 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cbf0f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1c40b3190 0x7fe1c4065f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.431 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1ca4ac700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe1c4062450 0x7fe1c40b4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.16:45822/0 (socket says 172.21.15.16:45822) 2021-01-03T12:57:46.431 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cbf0f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1c40b3190 0x7fe1c4065f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50998/0 (socket says 172.21.15.16:50998) 2021-01-03T12:57:46.432 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1ca4ac700 1 -- 172.21.15.16:0/3756009074 learned_addr learned my addr 172.21.15.16:0/3756009074 (peer_addr_for_me v2:172.21.15.16:0/0) 2021-01-03T12:57:46.432 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1c9cab700 1 --2- 172.21.15.16:0/3756009074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1c40adc10 0x7fe1c4065aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.432 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cbf0f700 1 -- 172.21.15.16:0/3756009074 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe1c4062450 msgr2=0x7fe1c40b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.432 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cbf0f700 1 --2- 172.21.15.16:0/3756009074 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe1c4062450 0x7fe1c40b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.433 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cbf0f700 1 -- 172.21.15.16:0/3756009074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1c40adc10 msgr2=0x7fe1c4065aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.433 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cbf0f700 1 --2- 172.21.15.16:0/3756009074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1c40adc10 0x7fe1c4065aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.433 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cbf0f700 1 -- 172.21.15.16:0/3756009074 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c4065790 con 0x7fe1c40b3190 2021-01-03T12:57:46.433 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cbf0f700 1 --2- 172.21.15.16:0/3756009074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1c40b3190 0x7fe1c4065f90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fe1bc003270 tx=0x7fe1bc00ba40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:46.434 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1b6ffd700 1 -- 172.21.15.16:0/3756009074 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1bc00e800 con 0x7fe1c40b3190 2021-01-03T12:57:46.434 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1b6ffd700 1 -- 172.21.15.16:0/3756009074 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc00e960 con 0x7fe1c40b3190 2021-01-03T12:57:46.434 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cacad700 1 -- 172.21.15.16:0/3756009074 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c412bd20 con 0x7fe1c40b3190 2021-01-03T12:57:46.434 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1b6ffd700 1 -- 172.21.15.16:0/3756009074 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1bc00ecc0 con 0x7fe1c40b3190 2021-01-03T12:57:46.435 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1cacad700 1 -- 172.21.15.16:0/3756009074 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c4070e70 con 0x7fe1c40b3190 2021-01-03T12:57:46.435 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1b6ffd700 1 -- 172.21.15.16:0/3756009074 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fe1bc010470 con 0x7fe1c40b3190 2021-01-03T12:57:46.435 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.423+0000 7fe1b6ffd700 1 -- 172.21.15.16:0/3756009074 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fe1bc010700 con 0x7fe1c40b3190 2021-01-03T12:57:46.435 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.427+0000 7fe1cacad700 1 -- 172.21.15.16:0/3756009074 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c4066620 con 0x7fe1c40b3190 2021-01-03T12:57:46.435 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.427+0000 7fe1b6ffd700 1 -- 172.21.15.16:0/3756009074 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fe1c4066620 con 0x7fe1c40b3190 2021-01-03T12:57:46.507 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.507+0000 7fe1cacad700 1 -- 172.21.15.16:0/3756009074 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd new", "uuid": "173feb9d-f596-4030-85d8-1f4b46a9ffe5", "id": 5} v 0) v1 -- 0x7fe1c4057300 con 0x7fe1c40b3190 2021-01-03T12:57:46.512 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.511+0000 7fe1b6ffd700 1 -- 172.21.15.16:0/3756009074 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "173feb9d-f596-4030-85d8-1f4b46a9ffe5", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe1bc010bb0 con 0x7fe1c40b3190 2021-01-03T12:57:46.512 INFO:teuthology.orchestra.run.smithi016.stdout:5 2021-01-03T12:57:46.513 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.511+0000 7fe1cacad700 1 -- 172.21.15.16:0/3756009074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1c40b3190 msgr2=0x7fe1c4065f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.513 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.511+0000 7fe1cacad700 1 --2- 172.21.15.16:0/3756009074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1c40b3190 0x7fe1c4065f90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fe1bc003270 tx=0x7fe1bc00ba40).stop 2021-01-03T12:57:46.514 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.511+0000 7fe1cacad700 1 -- 172.21.15.16:0/3756009074 shutdown_connections 2021-01-03T12:57:46.514 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.511+0000 7fe1cacad700 1 --2- 172.21.15.16:0/3756009074 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1c40b3190 0x7fe1c4065f90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.514 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.511+0000 7fe1cacad700 1 --2- 172.21.15.16:0/3756009074 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe1c4062450 0x7fe1c40b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.514 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.511+0000 7fe1cacad700 1 --2- 172.21.15.16:0/3756009074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe1c40adc10 0x7fe1c4065aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.515 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.511+0000 7fe1cacad700 1 -- 172.21.15.16:0/3756009074 >> 172.21.15.16:0/3756009074 conn(0x7fe1c4060d10 msgr2=0x7fe1c40b6470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:46.515 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.515+0000 7fe1cacad700 1 -- 172.21.15.16:0/3756009074 shutdown_connections 2021-01-03T12:57:46.515 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.515+0000 7fe1cacad700 1 -- 172.21.15.16:0/3756009074 wait complete. 2021-01-03T12:57:46.524 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd new b487980e-ad4d-43c1-91fa-4845f7af3d4d 6 2021-01-03T12:57:46.638 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0ccafc8700 1 Processor -- start 2021-01-03T12:57:46.638 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0ccafc8700 1 -- start start 2021-01-03T12:57:46.639 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0ccafc8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0cc40adc10 0x7f0cc4067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.639 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0ccafc8700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0cc40b33b0 0x7f0cc414f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.639 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0ccafc8700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc40adff0 con 0x7f0cc4062450 2021-01-03T12:57:46.639 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0ccafc8700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc40b1930 con 0x7f0cc40b33b0 2021-01-03T12:57:46.639 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0ccafc8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc405fb80 con 0x7f0cc40adc10 2021-01-03T12:57:46.640 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0ccc22a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0cc40b33b0 0x7f0cc414f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.640 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0ccc22a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0cc40b33b0 0x7f0cc414f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:51002/0 (socket says 172.21.15.16:51002) 2021-01-03T12:57:46.640 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0ccc22a700 1 -- 172.21.15.16:0/3297406425 learned_addr learned my addr 172.21.15.16:0/3297406425 (peer_addr_for_me v2:172.21.15.16:0/0) 2021-01-03T12:57:46.640 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0cc9fc6700 1 --1- 172.21.15.16:0/3297406425 >> v1:172.21.15.16:6789/0 conn(0x7f0cc4062450 0x7f0cc40b2ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:59524/0 (socket says 172.21.15.16:59524) 2021-01-03T12:57:46.640 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0cca7c7700 1 --2- 172.21.15.16:0/3297406425 >> v2:172.21.15.133:3300/0 conn(0x7f0cc40adc10 0x7f0cc4067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.641 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0ccc22a700 1 -- 172.21.15.16:0/3297406425 >> v2:172.21.15.133:3300/0 conn(0x7f0cc40adc10 msgr2=0x7f0cc4067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:46.641 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0ccc22a700 1 --2- 172.21.15.16:0/3297406425 >> v2:172.21.15.133:3300/0 conn(0x7f0cc40adc10 0x7f0cc4067cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.641 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0ccc22a700 1 -- 172.21.15.16:0/3297406425 >> v1:172.21.15.16:6789/0 conn(0x7f0cc4062450 legacy=0x7f0cc40b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.641 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0cc97c5700 1 -- 172.21.15.16:0/3297406425 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306732275 0 0) 0x7f0cc40adff0 con 0x7f0cc4062450 2021-01-03T12:57:46.641 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0ccc22a700 1 -- 172.21.15.16:0/3297406425 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc40b3840 con 0x7f0cc40b33b0 2021-01-03T12:57:46.642 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0ccc22a700 1 --2- 172.21.15.16:0/3297406425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc40b33b0 0x7f0cc414f870 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0cbc0032b0 tx=0x7f0cbc009270).ready entity=mon.0 client_cookie=7a03b1fc29276de4 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:46.642 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0cc97c5700 1 -- 172.21.15.16:0/3297406425 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cbc00bc00 con 0x7f0cc40b33b0 2021-01-03T12:57:46.642 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0cc97c5700 1 -- 172.21.15.16:0/3297406425 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc00bd60 con 0x7f0cc40b33b0 2021-01-03T12:57:46.642 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0cc97c5700 1 -- 172.21.15.16:0/3297406425 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cbc011400 con 0x7f0cc40b33b0 2021-01-03T12:57:46.642 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0ccafc8700 1 -- 172.21.15.16:0/3297406425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc40b33b0 msgr2=0x7f0cc414f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.635+0000 7f0ccafc8700 1 --2- 172.21.15.16:0/3297406425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc40b33b0 0x7f0cc414f870 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0cbc0032b0 tx=0x7f0cbc009270).stop 2021-01-03T12:57:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.639+0000 7f0ccafc8700 1 -- 172.21.15.16:0/3297406425 shutdown_connections 2021-01-03T12:57:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.639+0000 7f0ccafc8700 1 --2- 172.21.15.16:0/3297406425 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc40b33b0 0x7f0cc414f870 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.639+0000 7f0ccafc8700 1 --2- 172.21.15.16:0/3297406425 >> v2:172.21.15.133:3300/0 conn(0x7f0cc40adc10 0x7f0cc4067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.643 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.639+0000 7f0ccafc8700 1 -- 172.21.15.16:0/3297406425 >> 172.21.15.16:0/3297406425 conn(0x7f0cc4060d10 msgr2=0x7f0cc4061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:46.644 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.639+0000 7f0ccafc8700 1 -- 172.21.15.16:0/3297406425 shutdown_connections 2021-01-03T12:57:46.644 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.639+0000 7f0ccafc8700 1 -- 172.21.15.16:0/3297406425 wait complete. 2021-01-03T12:57:46.646 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.639+0000 7f0ccafc8700 1 Processor -- start 2021-01-03T12:57:46.646 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.639+0000 7f0ccafc8700 1 -- start start 2021-01-03T12:57:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.639+0000 7f0ccafc8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc4062450 0x7f0cc41243d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0ccafc8700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc40adc10 0x7f0cc41554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0ccafc8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc40b33b0 0x7f0cc41559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0ccafc8700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc4153ce0 con 0x7f0cc40adc10 2021-01-03T12:57:46.647 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0ccafc8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc4153f10 con 0x7f0cc4062450 2021-01-03T12:57:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0ccafc8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc4066490 con 0x7f0cc40b33b0 2021-01-03T12:57:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0ccc22a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc40b33b0 0x7f0cc41559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0cc9fc6700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc40adc10 0x7f0cc41554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0ccc22a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc40b33b0 0x7f0cc41559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.16:45838/0 (socket says 172.21.15.16:45838) 2021-01-03T12:57:46.648 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0ccc22a700 1 -- 172.21.15.16:0/2380874545 learned_addr learned my addr 172.21.15.16:0/2380874545 (peer_addr_for_me v2:172.21.15.16:0/0) 2021-01-03T12:57:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0cca7c7700 1 --2- 172.21.15.16:0/2380874545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc4062450 0x7f0cc41243d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0ccc22a700 1 -- 172.21.15.16:0/2380874545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc4062450 msgr2=0x7f0cc41243d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0ccc22a700 1 --2- 172.21.15.16:0/2380874545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc4062450 0x7f0cc41243d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0ccc22a700 1 -- 172.21.15.16:0/2380874545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc40adc10 msgr2=0x7f0cc41554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.649 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0ccc22a700 1 --2- 172.21.15.16:0/2380874545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc40adc10 0x7f0cc41554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.650 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0ccc22a700 1 -- 172.21.15.16:0/2380874545 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc4066730 con 0x7f0cc40b33b0 2021-01-03T12:57:46.650 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0ccc22a700 1 --2- 172.21.15.16:0/2380874545 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc40b33b0 0x7f0cc41559e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f0cbc0032b0 tx=0x7f0cbc016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:46.650 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0cbaffd700 1 -- 172.21.15.16:0/2380874545 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cbc026610 con 0x7f0cc40b33b0 2021-01-03T12:57:46.650 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0cbaffd700 1 -- 172.21.15.16:0/2380874545 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc026770 con 0x7f0cc40b33b0 2021-01-03T12:57:46.650 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0ccafc8700 1 -- 172.21.15.16:0/2380874545 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc40669d0 con 0x7f0cc40b33b0 2021-01-03T12:57:46.651 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0cbaffd700 1 -- 172.21.15.16:0/2380874545 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cbc026ad0 con 0x7f0cc40b33b0 2021-01-03T12:57:46.651 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0ccafc8700 1 -- 172.21.15.16:0/2380874545 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc40805d0 con 0x7f0cc40b33b0 2021-01-03T12:57:46.651 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0cbaffd700 1 -- 172.21.15.16:0/2380874545 <== mon.2 v2:172.21.15.16:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f0cbc00f070 con 0x7f0cc40b33b0 2021-01-03T12:57:46.651 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0cbaffd700 1 -- 172.21.15.16:0/2380874545 <== mon.2 v2:172.21.15.16:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f0cbc0253d0 con 0x7f0cc40b33b0 2021-01-03T12:57:46.651 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.643+0000 7f0ccafc8700 1 -- 172.21.15.16:0/2380874545 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc41540d0 con 0x7f0cc40b33b0 2021-01-03T12:57:46.652 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.647+0000 7f0cbaffd700 1 -- 172.21.15.16:0/2380874545 <== mon.2 v2:172.21.15.16:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f0cbc02b060 con 0x7f0cc40b33b0 2021-01-03T12:57:46.729 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.727+0000 7f0ccafc8700 1 -- 172.21.15.16:0/2380874545 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b487980e-ad4d-43c1-91fa-4845f7af3d4d", "id": 6} v 0) v1 -- 0x7f0cc4057300 con 0x7f0cc40b33b0 2021-01-03T12:57:46.735 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.735+0000 7f0cbaffd700 1 -- 172.21.15.16:0/2380874545 <== mon.2 v2:172.21.15.16:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b487980e-ad4d-43c1-91fa-4845f7af3d4d", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0cbc01b040 con 0x7f0cc40b33b0 2021-01-03T12:57:46.735 INFO:teuthology.orchestra.run.smithi016.stdout:6 2021-01-03T12:57:46.736 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.735+0000 7f0ccafc8700 1 -- 172.21.15.16:0/2380874545 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc40b33b0 msgr2=0x7f0cc41559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.737 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.735+0000 7f0ccafc8700 1 --2- 172.21.15.16:0/2380874545 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc40b33b0 0x7f0cc41559e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f0cbc0032b0 tx=0x7f0cbc016000).stop 2021-01-03T12:57:46.737 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.735+0000 7f0ccafc8700 1 -- 172.21.15.16:0/2380874545 shutdown_connections 2021-01-03T12:57:46.737 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.735+0000 7f0ccafc8700 1 --2- 172.21.15.16:0/2380874545 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc40b33b0 0x7f0cc41559e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.737 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.735+0000 7f0ccafc8700 1 --2- 172.21.15.16:0/2380874545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc4062450 0x7f0cc41243d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.738 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.735+0000 7f0ccafc8700 1 --2- 172.21.15.16:0/2380874545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc40adc10 0x7f0cc41554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.738 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.735+0000 7f0ccafc8700 1 -- 172.21.15.16:0/2380874545 >> 172.21.15.16:0/2380874545 conn(0x7f0cc4060d10 msgr2=0x7f0cc40b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:46.738 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.735+0000 7f0ccafc8700 1 -- 172.21.15.16:0/2380874545 shutdown_connections 2021-01-03T12:57:46.738 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.735+0000 7f0ccafc8700 1 -- 172.21.15.16:0/2380874545 wait complete. 2021-01-03T12:57:46.748 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd new 38ea839a-451f-4c09-a545-4514e049b178 7 2021-01-03T12:57:46.856 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.851+0000 7fefebfff700 1 Processor -- start 2021-01-03T12:57:46.856 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.851+0000 7fefebfff700 1 -- start start 2021-01-03T12:57:46.856 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fefec0adc10 0x7fefec067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.856 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefec0b33b0 0x7fefec14f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.857 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefec0adff0 con 0x7fefec062450 2021-01-03T12:57:46.857 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefec0b1930 con 0x7fefec0adc10 2021-01-03T12:57:46.857 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefec05fb80 con 0x7fefec0b33b0 2021-01-03T12:57:46.858 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7feff15b7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefec0b33b0 0x7fefec14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.858 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7feff15b7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefec0b33b0 0x7fefec14f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.16:45844/0 (socket says 172.21.15.16:45844) 2021-01-03T12:57:46.858 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7feff15b7700 1 -- 172.21.15.16:0/3579499162 learned_addr learned my addr 172.21.15.16:0/3579499162 (peer_addr_for_me v2:172.21.15.16:0/0) 2021-01-03T12:57:46.858 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefeb7fe700 1 --2- 172.21.15.16:0/3579499162 >> v2:172.21.15.133:3300/0 conn(0x7fefec0adc10 0x7fefec067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.858 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7feff15b7700 1 -- 172.21.15.16:0/3579499162 >> v2:172.21.15.133:3300/0 conn(0x7fefec0adc10 msgr2=0x7fefec067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:46.859 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7feff15b7700 1 --2- 172.21.15.16:0/3579499162 >> v2:172.21.15.133:3300/0 conn(0x7fefec0adc10 0x7fefec067cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.859 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7feff15b7700 1 -- 172.21.15.16:0/3579499162 >> v1:172.21.15.16:6789/0 conn(0x7fefec062450 legacy=0x7fefec0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.859 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7feff15b7700 1 -- 172.21.15.16:0/3579499162 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefec0b3840 con 0x7fefec0b33b0 2021-01-03T12:57:46.859 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefeb7fe700 1 --2- 172.21.15.16:0/3579499162 >> v2:172.21.15.133:3300/0 conn(0x7fefec0adc10 0x7fefec067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:57:46.860 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7feff15b7700 1 --2- 172.21.15.16:0/3579499162 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefec0b33b0 0x7fefec14f870 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fefdc002f30 tx=0x7fefdc006e80).ready entity=mon.2 client_cookie=561f010cc28153b2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:46.860 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefea7fc700 1 -- 172.21.15.16:0/3579499162 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefdc0097f0 con 0x7fefec0b33b0 2021-01-03T12:57:46.860 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefea7fc700 1 -- 172.21.15.16:0/3579499162 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefdc009950 con 0x7fefec0b33b0 2021-01-03T12:57:46.860 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefea7fc700 1 -- 172.21.15.16:0/3579499162 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefdc009cb0 con 0x7fefec0b33b0 2021-01-03T12:57:46.860 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 -- 172.21.15.16:0/3579499162 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefec0b33b0 msgr2=0x7fefec14f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.861 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 --2- 172.21.15.16:0/3579499162 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefec0b33b0 0x7fefec14f870 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fefdc002f30 tx=0x7fefdc006e80).stop 2021-01-03T12:57:46.861 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 -- 172.21.15.16:0/3579499162 shutdown_connections 2021-01-03T12:57:46.861 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 --2- 172.21.15.16:0/3579499162 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefec0b33b0 0x7fefec14f870 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.862 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 --2- 172.21.15.16:0/3579499162 >> v2:172.21.15.133:3300/0 conn(0x7fefec0adc10 0x7fefec067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.862 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 -- 172.21.15.16:0/3579499162 >> 172.21.15.16:0/3579499162 conn(0x7fefec060d10 msgr2=0x7fefec061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:46.862 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 -- 172.21.15.16:0/3579499162 shutdown_connections 2021-01-03T12:57:46.862 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 -- 172.21.15.16:0/3579499162 wait complete. 2021-01-03T12:57:46.865 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 Processor -- start 2021-01-03T12:57:46.865 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 -- start start 2021-01-03T12:57:46.865 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefec062450 0x7fefec070460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.866 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefec0adc10 0x7fefec112000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.866 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefec0b33b0 0x7fefec1124f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:46.866 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefec13bbe0 con 0x7fefec0b33b0 2021-01-03T12:57:46.866 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefec110c40 con 0x7fefec062450 2021-01-03T12:57:46.867 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefebfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefec110ee0 con 0x7fefec0adc10 2021-01-03T12:57:46.867 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefeaffd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefec0adc10 0x7fefec112000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.867 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7feff15b7700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefec0b33b0 0x7fefec1124f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.867 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefeaffd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefec0adc10 0x7fefec112000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.16:45848/0 (socket says 172.21.15.16:45848) 2021-01-03T12:57:46.867 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.855+0000 7fefeaffd700 1 -- 172.21.15.16:0/3243078881 learned_addr learned my addr 172.21.15.16:0/3243078881 (peer_addr_for_me v2:172.21.15.16:0/0) 2021-01-03T12:57:46.868 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.859+0000 7fefeb7fe700 1 --2- 172.21.15.16:0/3243078881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefec062450 0x7fefec070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:46.868 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.859+0000 7fefeaffd700 1 -- 172.21.15.16:0/3243078881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefec062450 msgr2=0x7fefec070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.868 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.859+0000 7fefeaffd700 1 --2- 172.21.15.16:0/3243078881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefec062450 0x7fefec070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.868 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.859+0000 7fefeaffd700 1 -- 172.21.15.16:0/3243078881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefec0b33b0 msgr2=0x7fefec1124f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.869 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.859+0000 7fefeaffd700 1 --2- 172.21.15.16:0/3243078881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefec0b33b0 0x7fefec1124f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.869 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.859+0000 7fefeaffd700 1 -- 172.21.15.16:0/3243078881 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefec070950 con 0x7fefec0adc10 2021-01-03T12:57:46.869 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.859+0000 7fefeb7fe700 1 --2- 172.21.15.16:0/3243078881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefec062450 0x7fefec070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:57:46.869 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.859+0000 7fefeaffd700 1 --2- 172.21.15.16:0/3243078881 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefec0adc10 0x7fefec112000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fefec026230 tx=0x7fefd4007be0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:46.870 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.859+0000 7fefe3fff700 1 -- 172.21.15.16:0/3243078881 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefd4007240 con 0x7fefec0adc10 2021-01-03T12:57:46.870 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.859+0000 7fefe3fff700 1 -- 172.21.15.16:0/3243078881 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd40073a0 con 0x7fefec0adc10 2021-01-03T12:57:46.870 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.859+0000 7fefe3fff700 1 -- 172.21.15.16:0/3243078881 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefd40064e0 con 0x7fefec0adc10 2021-01-03T12:57:46.870 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.859+0000 7fefebfff700 1 -- 172.21.15.16:0/3243078881 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefec111d10 con 0x7fefec0adc10 2021-01-03T12:57:46.871 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.859+0000 7fefebfff700 1 -- 172.21.15.16:0/3243078881 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefec1106f0 con 0x7fefec0adc10 2021-01-03T12:57:46.871 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.859+0000 7fefe3fff700 1 -- 172.21.15.16:0/3243078881 <== mon.2 v2:172.21.15.16:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fefd4010070 con 0x7fefec0adc10 2021-01-03T12:57:46.871 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.859+0000 7fefe3fff700 1 -- 172.21.15.16:0/3243078881 <== mon.2 v2:172.21.15.16:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7fefd4006810 con 0x7fefec0adc10 2021-01-03T12:57:46.871 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.859+0000 7fefebfff700 1 -- 172.21.15.16:0/3243078881 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefec110aa0 con 0x7fefec0adc10 2021-01-03T12:57:46.871 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.863+0000 7fefe3fff700 1 -- 172.21.15.16:0/3243078881 <== mon.2 v2:172.21.15.16:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fefd4032870 con 0x7fefec0adc10 2021-01-03T12:57:46.937 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.939+0000 7fefebfff700 1 -- 172.21.15.16:0/3243078881 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_command({"prefix": "osd new", "uuid": "38ea839a-451f-4c09-a545-4514e049b178", "id": 7} v 0) v1 -- 0x7fefec1110a0 con 0x7fefec0adc10 2021-01-03T12:57:46.943 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.943+0000 7fefe3fff700 1 -- 172.21.15.16:0/3243078881 <== mon.2 v2:172.21.15.16:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "38ea839a-451f-4c09-a545-4514e049b178", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fefd4022070 con 0x7fefec0adc10 2021-01-03T12:57:46.943 INFO:teuthology.orchestra.run.smithi016.stdout:7 2021-01-03T12:57:46.944 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.943+0000 7fefebfff700 1 -- 172.21.15.16:0/3243078881 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefec0adc10 msgr2=0x7fefec112000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:46.945 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.943+0000 7fefebfff700 1 --2- 172.21.15.16:0/3243078881 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefec0adc10 0x7fefec112000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fefec026230 tx=0x7fefd4007be0).stop 2021-01-03T12:57:46.945 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.943+0000 7fefebfff700 1 -- 172.21.15.16:0/3243078881 shutdown_connections 2021-01-03T12:57:46.945 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.943+0000 7fefebfff700 1 --2- 172.21.15.16:0/3243078881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefec0b33b0 0x7fefec1124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.945 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.943+0000 7fefebfff700 1 --2- 172.21.15.16:0/3243078881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefec062450 0x7fefec070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.945 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.943+0000 7fefebfff700 1 --2- 172.21.15.16:0/3243078881 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefec0adc10 0x7fefec112000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:46.946 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.943+0000 7fefebfff700 1 -- 172.21.15.16:0/3243078881 >> 172.21.15.16:0/3243078881 conn(0x7fefec060d10 msgr2=0x7fefec0b57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:46.946 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.943+0000 7fefebfff700 1 -- 172.21.15.16:0/3243078881 shutdown_connections 2021-01-03T12:57:46.946 INFO:teuthology.orchestra.run.smithi016.stderr:2021-01-03T12:57:46.943+0000 7fefebfff700 1 -- 172.21.15.16:0/3243078881 wait complete. 2021-01-03T12:57:46.956 INFO:tasks.ceph.osd.0:Restarting daemon 2021-01-03T12:57:47.027 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-01-03T12:57:47.030 INFO:tasks.ceph.osd.0:Started 2021-01-03T12:57:47.030 INFO:tasks.ceph.osd.1:Restarting daemon 2021-01-03T12:57:47.031 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-01-03T12:57:47.033 INFO:tasks.ceph.osd.1:Started 2021-01-03T12:57:47.033 INFO:tasks.ceph.osd.2:Restarting daemon 2021-01-03T12:57:47.033 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-01-03T12:57:47.035 INFO:tasks.ceph.osd.2:Started 2021-01-03T12:57:47.036 INFO:tasks.ceph.osd.3:Restarting daemon 2021-01-03T12:57:47.036 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-01-03T12:57:47.038 INFO:tasks.ceph.osd.3:Started 2021-01-03T12:57:47.039 INFO:tasks.ceph.osd.4:Restarting daemon 2021-01-03T12:57:47.039 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-01-03T12:57:47.041 INFO:tasks.ceph.osd.4:Started 2021-01-03T12:57:47.041 INFO:tasks.ceph.osd.5:Restarting daemon 2021-01-03T12:57:47.042 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-01-03T12:57:47.044 INFO:tasks.ceph.osd.5:Started 2021-01-03T12:57:47.044 INFO:tasks.ceph.osd.6:Restarting daemon 2021-01-03T12:57:47.045 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2021-01-03T12:57:47.046 INFO:tasks.ceph.osd.6:Started 2021-01-03T12:57:47.047 INFO:tasks.ceph.osd.7:Restarting daemon 2021-01-03T12:57:47.047 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2021-01-03T12:57:47.049 INFO:tasks.ceph.osd.7:Started 2021-01-03T12:57:47.050 INFO:tasks.ceph:Waiting for OSDs to come up 2021-01-03T12:57:47.389 INFO:tasks.ceph.osd.2.smithi133.stderr:2021-01-03T12:57:47.391+0000 7fa84ed06d80 -1 Falling back to public interface 2021-01-03T12:57:47.407 INFO:tasks.ceph.osd.6.smithi016.stderr:2021-01-03T12:57:47.407+0000 7f57aea94d80 -1 Falling back to public interface 2021-01-03T12:57:47.409 INFO:tasks.ceph.osd.0.smithi133.stderr:2021-01-03T12:57:47.411+0000 7f31c19cbd80 -1 Falling back to public interface 2021-01-03T12:57:47.423 INFO:tasks.ceph.osd.4.smithi016.stderr:2021-01-03T12:57:47.423+0000 7f2af5e54d80 -1 Falling back to public interface 2021-01-03T12:57:47.637 INFO:tasks.ceph.osd.1.smithi133.stderr:2021-01-03T12:57:47.639+0000 7fb37a850d80 -1 Falling back to public interface 2021-01-03T12:57:47.660 INFO:tasks.ceph.osd.3.smithi133.stderr:2021-01-03T12:57:47.663+0000 7f7f4f312d80 -1 Falling back to public interface 2021-01-03T12:57:47.663 INFO:tasks.ceph.osd.5.smithi016.stderr:2021-01-03T12:57:47.663+0000 7f1c4f8f6d80 -1 Falling back to public interface 2021-01-03T12:57:47.664 INFO:tasks.ceph.osd.7.smithi016.stderr:2021-01-03T12:57:47.663+0000 7fa01fa97d80 -1 Falling back to public interface 2021-01-03T12:57:47.854 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-01-03T12:57:47.953 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.951+0000 7fdf99905700 1 Processor -- start 2021-01-03T12:57:47.954 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.951+0000 7fdf99905700 1 -- start start 2021-01-03T12:57:47.954 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.951+0000 7fdf99905700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdf940b5120 0x7fdf940ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:47.954 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.951+0000 7fdf99905700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf940abdd0 0x7fdf940b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:47.954 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.951+0000 7fdf99905700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf940ac280 con 0x7fdf94060b00 2021-01-03T12:57:47.955 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.951+0000 7fdf99905700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf94062340 con 0x7fdf940b5120 2021-01-03T12:57:47.955 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.951+0000 7fdf99905700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf9409a380 con 0x7fdf940abdd0 2021-01-03T12:57:47.955 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.951+0000 7fdf92ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdf94060b00 0x7fdf940af9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52134/0 (socket says 172.21.15.133:52134) 2021-01-03T12:57:47.955 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.951+0000 7fdf92ffd700 1 -- 172.21.15.133:0/2641194502 learned_addr learned my addr 172.21.15.133:0/2641194502 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:57:47.955 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.951+0000 7fdf93fff700 1 --2- 172.21.15.133:0/2641194502 >> v2:172.21.15.133:3300/0 conn(0x7fdf940abdd0 0x7fdf940b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:47.956 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf927fc700 1 -- 172.21.15.133:0/2641194502 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 809158244 0 0) 0x7fdf940ac280 con 0x7fdf94060b00 2021-01-03T12:57:47.956 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.951+0000 7fdf937fe700 1 --2- 172.21.15.133:0/2641194502 >> v2:172.21.15.16:3300/0 conn(0x7fdf940b5120 0x7fdf940ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:47.956 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf927fc700 1 -- 172.21.15.133:0/2641194502 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf7c003230 con 0x7fdf94060b00 2021-01-03T12:57:47.956 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf93fff700 1 -- 172.21.15.133:0/2641194502 >> v2:172.21.15.16:3300/0 conn(0x7fdf940b5120 msgr2=0x7fdf940ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:47.956 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf93fff700 1 --2- 172.21.15.133:0/2641194502 >> v2:172.21.15.16:3300/0 conn(0x7fdf940b5120 0x7fdf940ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:47.957 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf93fff700 1 -- 172.21.15.133:0/2641194502 >> v1:172.21.15.133:6789/0 conn(0x7fdf94060b00 legacy=0x7fdf940af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:47.957 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf93fff700 1 -- 172.21.15.133:0/2641194502 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf94060090 con 0x7fdf940abdd0 2021-01-03T12:57:47.957 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf93fff700 1 --2- 172.21.15.133:0/2641194502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf940abdd0 0x7fdf940b0100 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fdf8c0032b0 tx=0x7fdf8c0091a0).ready entity=mon.1 client_cookie=32bb06f75ea16161 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:47.957 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf927fc700 1 -- 172.21.15.133:0/2641194502 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf8c00b940 con 0x7fdf940abdd0 2021-01-03T12:57:47.957 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf927fc700 1 -- 172.21.15.133:0/2641194502 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c00baa0 con 0x7fdf940abdd0 2021-01-03T12:57:47.957 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf927fc700 1 -- 172.21.15.133:0/2641194502 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf8c00bc10 con 0x7fdf940abdd0 2021-01-03T12:57:47.958 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf99905700 1 -- 172.21.15.133:0/2641194502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf940abdd0 msgr2=0x7fdf940b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:47.958 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf99905700 1 --2- 172.21.15.133:0/2641194502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf940abdd0 0x7fdf940b0100 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fdf8c0032b0 tx=0x7fdf8c0091a0).stop 2021-01-03T12:57:47.958 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf99905700 1 -- 172.21.15.133:0/2641194502 shutdown_connections 2021-01-03T12:57:47.958 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf99905700 1 --2- 172.21.15.133:0/2641194502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf940abdd0 0x7fdf940b0100 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:47.958 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf99905700 1 --2- 172.21.15.133:0/2641194502 >> v2:172.21.15.16:3300/0 conn(0x7fdf940b5120 0x7fdf940ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:47.959 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf99905700 1 -- 172.21.15.133:0/2641194502 >> 172.21.15.133:0/2641194502 conn(0x7fdf9405bdf0 msgr2=0x7fdf9405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:47.959 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf99905700 1 -- 172.21.15.133:0/2641194502 shutdown_connections 2021-01-03T12:57:47.959 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.955+0000 7fdf99905700 1 -- 172.21.15.133:0/2641194502 wait complete. 2021-01-03T12:57:47.961 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf99905700 1 Processor -- start 2021-01-03T12:57:47.961 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf99905700 1 -- start start 2021-01-03T12:57:47.961 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf99905700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf94060b00 0x7fdf940afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:47.962 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf99905700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf940abdd0 0x7fdf9413dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:47.962 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf99905700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf940b5120 0x7fdf9413e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:47.962 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf99905700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf94080950 con 0x7fdf94060b00 2021-01-03T12:57:47.963 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf99905700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf941415b0 con 0x7fdf940abdd0 2021-01-03T12:57:47.963 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf99905700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf940ac5c0 con 0x7fdf940b5120 2021-01-03T12:57:47.963 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf92ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf940abdd0 0x7fdf9413dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:47.963 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf92ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf940abdd0 0x7fdf9413dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59342/0 (socket says 172.21.15.133:59342) 2021-01-03T12:57:47.963 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf92ffd700 1 -- 172.21.15.133:0/500826654 learned_addr learned my addr 172.21.15.133:0/500826654 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:57:47.964 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf937fe700 1 --2- 172.21.15.133:0/500826654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf94060b00 0x7fdf940afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:47.964 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf93fff700 1 --2- 172.21.15.133:0/500826654 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf940b5120 0x7fdf9413e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:47.964 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf92ffd700 1 -- 172.21.15.133:0/500826654 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf940b5120 msgr2=0x7fdf9413e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:47.964 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf92ffd700 1 --2- 172.21.15.133:0/500826654 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf940b5120 0x7fdf9413e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:47.964 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf92ffd700 1 -- 172.21.15.133:0/500826654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf94060b00 msgr2=0x7fdf940afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:47.965 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf92ffd700 1 --2- 172.21.15.133:0/500826654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf94060b00 0x7fdf940afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:47.965 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf92ffd700 1 -- 172.21.15.133:0/500826654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf941417e0 con 0x7fdf940abdd0 2021-01-03T12:57:47.965 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf92ffd700 1 --2- 172.21.15.133:0/500826654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf940abdd0 0x7fdf9413dcc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fdf940af5f0 tx=0x7fdf88007a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:47.965 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf7bfff700 1 -- 172.21.15.133:0/500826654 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf880072e0 con 0x7fdf940abdd0 2021-01-03T12:57:47.965 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf7bfff700 1 -- 172.21.15.133:0/500826654 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf88007440 con 0x7fdf940abdd0 2021-01-03T12:57:47.966 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf99905700 1 -- 172.21.15.133:0/500826654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf94141a80 con 0x7fdf940abdd0 2021-01-03T12:57:47.966 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf7bfff700 1 -- 172.21.15.133:0/500826654 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf880057d0 con 0x7fdf940abdd0 2021-01-03T12:57:47.966 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf99905700 1 -- 172.21.15.133:0/500826654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf941274b0 con 0x7fdf940abdd0 2021-01-03T12:57:47.966 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.959+0000 7fdf7bfff700 1 -- 172.21.15.133:0/500826654 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 2) v1 ==== 33316+0+0 (secure 0 0 0) 0x7fdf88010070 con 0x7fdf940abdd0 2021-01-03T12:57:47.966 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.963+0000 7fdf7bfff700 1 -- 172.21.15.133:0/500826654 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7fdf8803adc0 con 0x7fdf940abdd0 2021-01-03T12:57:47.967 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.963+0000 7fdf99905700 1 -- 172.21.15.133:0/500826654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf94057300 con 0x7fdf940abdd0 2021-01-03T12:57:47.967 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:47.963+0000 7fdf7bfff700 1 -- 172.21.15.133:0/500826654 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fdf88005930 con 0x7fdf940abdd0 2021-01-03T12:57:48.032 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.035+0000 7fdf7bfff700 1 -- 172.21.15.133:0/500826654 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mgrmap(e 3) v1 ==== 66760+0+0 (secure 0 0 0) 0x7fdf88013450 con 0x7fdf940abdd0 2021-01-03T12:57:48.032 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.035+0000 7fdf99905700 1 -- 172.21.15.133:0/500826654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf9405ce00 con 0x7fdf940abdd0 2021-01-03T12:57:48.032 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.035+0000 7fdf7bfff700 1 --2- 172.21.15.133:0/500826654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf74055990 0x7fdf74057da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:48.033 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.035+0000 7fdf937fe700 1 --2- 172.21.15.133:0/500826654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf74055990 0x7fdf74057da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:48.034 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.035+0000 7fdf7bfff700 1 -- 172.21.15.133:0/500826654 <== mon.1 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+8254 (secure 0 0 0) 0x7fdf88045b60 con 0x7fdf940abdd0 2021-01-03T12:57:48.034 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.035+0000 7fdf937fe700 1 --2- 172.21.15.133:0/500826654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf74055990 0x7fdf74057da0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fdf8400b000 tx=0x7fdf84006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:48.035 INFO:teuthology.misc.health.smithi133.stdout: 2021-01-03T12:57:48.035 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":11,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:57:48.019621+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:57:48.036 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.039+0000 7fdf99905700 1 -- 172.21.15.133:0/500826654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf74055990 msgr2=0x7fdf74057da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:48.036 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.039+0000 7fdf99905700 1 --2- 172.21.15.133:0/500826654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf74055990 0x7fdf74057da0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fdf8400b000 tx=0x7fdf84006dc0).stop 2021-01-03T12:57:48.037 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.039+0000 7fdf99905700 1 -- 172.21.15.133:0/500826654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf940abdd0 msgr2=0x7fdf9413dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:48.037 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.039+0000 7fdf99905700 1 --2- 172.21.15.133:0/500826654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf940abdd0 0x7fdf9413dcc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fdf940af5f0 tx=0x7fdf88007a70).stop 2021-01-03T12:57:48.037 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.039+0000 7fdf99905700 1 -- 172.21.15.133:0/500826654 shutdown_connections 2021-01-03T12:57:48.037 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.039+0000 7fdf99905700 1 --2- 172.21.15.133:0/500826654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf74055990 0x7fdf74057da0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:48.037 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.039+0000 7fdf99905700 1 --2- 172.21.15.133:0/500826654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf94060b00 0x7fdf940afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:48.038 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.039+0000 7fdf99905700 1 --2- 172.21.15.133:0/500826654 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf940b5120 0x7fdf9413e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:48.038 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.039+0000 7fdf99905700 1 --2- 172.21.15.133:0/500826654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf940abdd0 0x7fdf9413dcc0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:48.038 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.039+0000 7fdf99905700 1 -- 172.21.15.133:0/500826654 >> 172.21.15.133:0/500826654 conn(0x7fdf9405bdf0 msgr2=0x7fdf940640c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:48.038 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.039+0000 7fdf99905700 1 -- 172.21.15.133:0/500826654 shutdown_connections 2021-01-03T12:57:48.038 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:48.039+0000 7fdf99905700 1 -- 172.21.15.133:0/500826654 wait complete. 2021-01-03T12:57:48.048 DEBUG:teuthology.misc:0 of 8 OSDs are up 2021-01-03T12:57:48.551 INFO:tasks.ceph.osd.2.smithi133.stderr:2021-01-03T12:57:48.551+0000 7fa84ed06d80 -1 osd.2 0 log_to_monitors {default=true} 2021-01-03T12:57:48.556 INFO:tasks.ceph.osd.6.smithi016.stderr:2021-01-03T12:57:48.555+0000 7f57aea94d80 -1 osd.6 0 log_to_monitors {default=true} 2021-01-03T12:57:48.603 INFO:tasks.ceph.osd.4.smithi016.stderr:2021-01-03T12:57:48.603+0000 7f2af5e54d80 -1 osd.4 0 log_to_monitors {default=true} 2021-01-03T12:57:48.634 INFO:tasks.ceph.osd.0.smithi133.stderr:2021-01-03T12:57:48.635+0000 7f31c19cbd80 -1 osd.0 0 log_to_monitors {default=true} 2021-01-03T12:57:48.778 INFO:tasks.ceph.osd.1.smithi133.stderr:2021-01-03T12:57:48.779+0000 7fb37a850d80 -1 osd.1 0 log_to_monitors {default=true} 2021-01-03T12:57:48.824 INFO:tasks.ceph.osd.7.smithi016.stderr:2021-01-03T12:57:48.823+0000 7fa01fa97d80 -1 osd.7 0 log_to_monitors {default=true} 2021-01-03T12:57:48.825 INFO:tasks.ceph.osd.5.smithi016.stderr:2021-01-03T12:57:48.823+0000 7f1c4f8f6d80 -1 osd.5 0 log_to_monitors {default=true} 2021-01-03T12:57:48.850 INFO:tasks.ceph.osd.3.smithi133.stderr:2021-01-03T12:57:48.851+0000 7f7f4f312d80 -1 osd.3 0 log_to_monitors {default=true} 2021-01-03T12:57:50.036 INFO:tasks.ceph.osd.0.smithi133.stderr:2021-01-03T12:57:50.039+0000 7f31aac16700 -1 osd.0 0 waiting for initial osdmap 2021-01-03T12:57:50.037 INFO:tasks.ceph.osd.5.smithi016.stderr:2021-01-03T12:57:50.035+0000 7f1c38b41700 -1 osd.5 0 waiting for initial osdmap 2021-01-03T12:57:50.037 INFO:tasks.ceph.osd.2.smithi133.stderr:2021-01-03T12:57:50.039+0000 7fa837f51700 -1 osd.2 0 waiting for initial osdmap 2021-01-03T12:57:50.038 INFO:tasks.ceph.osd.4.smithi016.stderr:2021-01-03T12:57:50.039+0000 7f2adf09f700 -1 osd.4 0 waiting for initial osdmap 2021-01-03T12:57:50.041 INFO:tasks.ceph.osd.6.smithi016.stderr:2021-01-03T12:57:50.039+0000 7f5797cdf700 -1 osd.6 0 waiting for initial osdmap 2021-01-03T12:57:50.048 INFO:tasks.ceph.osd.7.smithi016.stderr:2021-01-03T12:57:50.047+0000 7fa008ce2700 -1 osd.7 0 waiting for initial osdmap 2021-01-03T12:57:50.049 INFO:tasks.ceph.osd.1.smithi133.stderr:2021-01-03T12:57:50.051+0000 7fb363a9b700 -1 osd.1 0 waiting for initial osdmap 2021-01-03T12:57:50.049 INFO:tasks.ceph.osd.3.smithi133.stderr:2021-01-03T12:57:50.051+0000 7f7f3855d700 -1 osd.3 0 waiting for initial osdmap 2021-01-03T12:57:54.853 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-01-03T12:57:54.966 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.956+0000 7f474aac4700 1 Processor -- start 2021-01-03T12:57:54.966 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.956+0000 7f474aac4700 1 -- start start 2021-01-03T12:57:54.967 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474aac4700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f47440adc10 0x7f4744067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:54.967 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474aac4700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47440adff0 con 0x7f4744062450 2021-01-03T12:57:54.967 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474aac4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474405fb80 con 0x7f47440b33b0 2021-01-03T12:57:54.967 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474aac4700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47440b1930 con 0x7f47440adc10 2021-01-03T12:57:54.968 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474bd26700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f47440b33b0 0x7f474414f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52390/0 (socket says 172.21.15.133:52390) 2021-01-03T12:57:54.968 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474bd26700 1 -- 172.21.15.133:0/370464099 learned_addr learned my addr 172.21.15.133:0/370464099 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:57:54.968 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474a2c3700 1 --2- 172.21.15.133:0/370464099 >> v2:172.21.15.16:3300/0 conn(0x7f47440adc10 0x7f4744067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:54.968 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f47492c1700 1 -- 172.21.15.133:0/370464099 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795521692 0 0) 0x7f474405fb80 con 0x7f47440b33b0 2021-01-03T12:57:54.968 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f47492c1700 1 -- 172.21.15.133:0/370464099 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4730003230 con 0x7f47440b33b0 2021-01-03T12:57:54.969 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f47492c1700 1 -- 172.21.15.133:0/370464099 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478148621 0 0) 0x7f47440adff0 con 0x7f4744062450 2021-01-03T12:57:54.969 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f47492c1700 1 -- 172.21.15.133:0/370464099 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f474405fb80 con 0x7f4744062450 2021-01-03T12:57:54.969 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474a2c3700 1 -- 172.21.15.133:0/370464099 >> v1:172.21.15.133:6789/0 conn(0x7f47440b33b0 legacy=0x7f474414f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:54.969 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f47492c1700 1 -- 172.21.15.133:0/370464099 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4129591536 0 0) 0x7f4730003230 con 0x7f47440b33b0 2021-01-03T12:57:54.969 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474a2c3700 1 -- 172.21.15.133:0/370464099 >> v1:172.21.15.16:6789/0 conn(0x7f4744062450 legacy=0x7f47440b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:54.970 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474a2c3700 1 -- 172.21.15.133:0/370464099 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47440b3840 con 0x7f47440adc10 2021-01-03T12:57:54.970 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474a2c3700 1 --2- 172.21.15.133:0/370464099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47440adc10 0x7f4744067cb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f473c001450 tx=0x7f4740006dc0).ready entity=mon.0 client_cookie=e703bb77b0061624 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:54.970 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f47492c1700 1 -- 172.21.15.133:0/370464099 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f473c001a50 con 0x7f47440adc10 2021-01-03T12:57:54.970 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f47492c1700 1 -- 172.21.15.133:0/370464099 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474000d610 con 0x7f47440adc10 2021-01-03T12:57:54.970 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f47492c1700 1 -- 172.21.15.133:0/370464099 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f474000d780 con 0x7f47440adc10 2021-01-03T12:57:54.971 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474aac4700 1 -- 172.21.15.133:0/370464099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47440adc10 msgr2=0x7f4744067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:54.971 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474aac4700 1 --2- 172.21.15.133:0/370464099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47440adc10 0x7f4744067cb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f473c001450 tx=0x7f4740006dc0).stop 2021-01-03T12:57:54.971 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474aac4700 1 -- 172.21.15.133:0/370464099 shutdown_connections 2021-01-03T12:57:54.971 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474aac4700 1 --2- 172.21.15.133:0/370464099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47440adc10 0x7f4744067cb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:54.971 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474aac4700 1 -- 172.21.15.133:0/370464099 >> 172.21.15.133:0/370464099 conn(0x7f4744060d10 msgr2=0x7f4744061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:54.972 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474aac4700 1 -- 172.21.15.133:0/370464099 shutdown_connections 2021-01-03T12:57:54.972 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.960+0000 7f474aac4700 1 -- 172.21.15.133:0/370464099 wait complete. 2021-01-03T12:57:54.974 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.964+0000 7f474aac4700 1 Processor -- start 2021-01-03T12:57:54.975 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.964+0000 7f474aac4700 1 -- start start 2021-01-03T12:57:54.975 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.964+0000 7f474aac4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4744062450 0x7f474412c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:54.975 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.964+0000 7f474aac4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47440adc10 0x7f47440746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:54.975 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.964+0000 7f474aac4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47440b33b0 0x7f4744074bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:54.976 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.964+0000 7f474aac4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47440b4aa0 con 0x7f47440b33b0 2021-01-03T12:57:54.976 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.964+0000 7f474aac4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47440669b0 con 0x7f4744062450 2021-01-03T12:57:54.976 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f474aac4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474412db70 con 0x7f47440adc10 2021-01-03T12:57:54.976 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f474a2c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4744062450 0x7f474412c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:54.976 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f474a2c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4744062450 0x7f474412c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59592/0 (socket says 172.21.15.133:59592) 2021-01-03T12:57:54.977 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f474a2c3700 1 -- 172.21.15.133:0/270318891 learned_addr learned my addr 172.21.15.133:0/270318891 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:57:54.977 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f4749ac2700 1 --2- 172.21.15.133:0/270318891 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47440adc10 0x7f47440746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:54.977 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f474bd26700 1 --2- 172.21.15.133:0/270318891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47440b33b0 0x7f4744074bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:54.977 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f474a2c3700 1 -- 172.21.15.133:0/270318891 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47440adc10 msgr2=0x7f47440746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:54.977 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f474a2c3700 1 --2- 172.21.15.133:0/270318891 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47440adc10 0x7f47440746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:54.978 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f474a2c3700 1 -- 172.21.15.133:0/270318891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47440b33b0 msgr2=0x7f4744074bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:54.978 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f474a2c3700 1 --2- 172.21.15.133:0/270318891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47440b33b0 0x7f4744074bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:54.978 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f474a2c3700 1 -- 172.21.15.133:0/270318891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4744066620 con 0x7f4744062450 2021-01-03T12:57:54.978 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f474a2c3700 1 --2- 172.21.15.133:0/270318891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4744062450 0x7f474412c220 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f473c001450 tx=0x7f4740015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:54.978 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f473affd700 1 -- 172.21.15.133:0/270318891 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4740011a40 con 0x7f4744062450 2021-01-03T12:57:54.979 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f473affd700 1 -- 172.21.15.133:0/270318891 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4740011ba0 con 0x7f4744062450 2021-01-03T12:57:54.979 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f473affd700 1 -- 172.21.15.133:0/270318891 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f474001d480 con 0x7f4744062450 2021-01-03T12:57:54.979 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f474aac4700 1 -- 172.21.15.133:0/270318891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47440677b0 con 0x7f4744062450 2021-01-03T12:57:54.979 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f474aac4700 1 -- 172.21.15.133:0/270318891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f474412d070 con 0x7f4744062450 2021-01-03T12:57:54.979 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f474aac4700 1 -- 172.21.15.133:0/270318891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4744057300 con 0x7f4744062450 2021-01-03T12:57:54.980 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f473affd700 1 -- 172.21.15.133:0/270318891 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4740017030 con 0x7f4744062450 2021-01-03T12:57:54.980 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f473affd700 1 --2- 172.21.15.133:0/270318891 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f472c0553b0 0x7f472c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:54.980 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.968+0000 7f473affd700 1 -- 172.21.15.133:0/270318891 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f474006e6a0 con 0x7f4744062450 2021-01-03T12:57:54.980 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.972+0000 7f4749ac2700 1 --2- 172.21.15.133:0/270318891 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f472c0553b0 0x7f472c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:54.980 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.972+0000 7f4749ac2700 1 --2- 172.21.15.133:0/270318891 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f472c0553b0 0x7f472c057870 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f473400b000 tx=0x7f4734009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:54.981 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:54.976+0000 7f473affd700 1 -- 172.21.15.133:0/270318891 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4740044d90 con 0x7f4744062450 2021-01-03T12:57:55.117 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:55.112+0000 7f474aac4700 1 -- 172.21.15.133:0/270318891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47440b4be0 con 0x7f4744062450 2021-01-03T12:57:55.119 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:55.116+0000 7f473affd700 1 -- 172.21.15.133:0/270318891 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11853 (secure 0 0 0) 0x7f4740022070 con 0x7f4744062450 2021-01-03T12:57:55.119 INFO:teuthology.misc.health.smithi133.stdout: 2021-01-03T12:57:55.120 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":16,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:57:53.078677+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:57:55.122 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:55.120+0000 7f474aac4700 1 -- 172.21.15.133:0/270318891 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f472c0553b0 msgr2=0x7f472c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:55.123 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:55.120+0000 7f474aac4700 1 --2- 172.21.15.133:0/270318891 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f472c0553b0 0x7f472c057870 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f473400b000 tx=0x7f4734009040).stop 2021-01-03T12:57:55.123 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:55.120+0000 7f474aac4700 1 -- 172.21.15.133:0/270318891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4744062450 msgr2=0x7f474412c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:55.123 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:55.120+0000 7f474aac4700 1 --2- 172.21.15.133:0/270318891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4744062450 0x7f474412c220 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f473c001450 tx=0x7f4740015000).stop 2021-01-03T12:57:55.123 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:55.120+0000 7f474aac4700 1 -- 172.21.15.133:0/270318891 shutdown_connections 2021-01-03T12:57:55.123 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:55.120+0000 7f474aac4700 1 --2- 172.21.15.133:0/270318891 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f472c0553b0 0x7f472c057870 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:55.123 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:55.120+0000 7f474aac4700 1 --2- 172.21.15.133:0/270318891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47440b33b0 0x7f4744074bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:55.124 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:55.120+0000 7f474aac4700 1 --2- 172.21.15.133:0/270318891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4744062450 0x7f474412c220 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:55.124 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:55.120+0000 7f474aac4700 1 --2- 172.21.15.133:0/270318891 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47440adc10 0x7f47440746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:55.124 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:55.120+0000 7f474aac4700 1 -- 172.21.15.133:0/270318891 >> 172.21.15.133:0/270318891 conn(0x7f4744060d10 msgr2=0x7f47440b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:55.124 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:55.120+0000 7f474aac4700 1 -- 172.21.15.133:0/270318891 shutdown_connections 2021-01-03T12:57:55.124 INFO:teuthology.misc.health.smithi133.stderr:2021-01-03T12:57:55.120+0000 7f474aac4700 1 -- 172.21.15.133:0/270318891 wait complete. 2021-01-03T12:57:55.137 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-01-03T12:57:55.137 INFO:tasks.ceph:Creating RBD pool 2021-01-03T12:57:55.137 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd pool create rbd 8 2021-01-03T12:57:55.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6951935700 1 Processor -- start 2021-01-03T12:57:55.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6951935700 1 -- start start 2021-01-03T12:57:55.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6951935700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f694c062450 0x7f694c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:55.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6951935700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f694c0b33b0 0x7f694c14f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:55.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6951935700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f694c0adff0 con 0x7f694c0adc10 2021-01-03T12:57:55.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6951935700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f694c0b1930 con 0x7f694c0b33b0 2021-01-03T12:57:55.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6951935700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694c05fb80 con 0x7f694c062450 2021-01-03T12:57:55.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6951134700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f694c0adc10 0x7f694c0b2ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52400/0 (socket says 172.21.15.133:52400) 2021-01-03T12:57:55.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6951134700 1 -- 172.21.15.133:0/1546346133 learned_addr learned my addr 172.21.15.133:0/1546346133 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:57:55.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6950933700 1 --2- 172.21.15.133:0/1546346133 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f694c062450 0x7f694c067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6952b97700 1 --2- 172.21.15.133:0/1546346133 >> v2:172.21.15.16:3300/0 conn(0x7f694c0b33b0 0x7f694c14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6943fff700 1 -- 172.21.15.133:0/1546346133 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22533117 0 0) 0x7f694c0adff0 con 0x7f694c0adc10 2021-01-03T12:57:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6943fff700 1 -- 172.21.15.133:0/1546346133 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6934003230 con 0x7f694c0adc10 2021-01-03T12:57:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6943fff700 1 -- 172.21.15.133:0/1546346133 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2177884133 0 0) 0x7f6934003230 con 0x7f694c0adc10 2021-01-03T12:57:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6950933700 1 -- 172.21.15.133:0/1546346133 >> v2:172.21.15.16:3300/0 conn(0x7f694c0b33b0 msgr2=0x7f694c14f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6950933700 1 --2- 172.21.15.133:0/1546346133 >> v2:172.21.15.16:3300/0 conn(0x7f694c0b33b0 0x7f694c14f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6950933700 1 -- 172.21.15.133:0/1546346133 >> v1:172.21.15.133:6789/0 conn(0x7f694c0adc10 legacy=0x7f694c0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6950933700 1 -- 172.21.15.133:0/1546346133 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c05fed0 con 0x7f694c062450 2021-01-03T12:57:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6950933700 1 --2- 172.21.15.133:0/1546346133 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f694c062450 0x7f694c067cb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6948001bf0 tx=0x7f6944006dc0).ready entity=mon.2 client_cookie=4e9070d41f7e7077 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6943fff700 1 -- 172.21.15.133:0/1546346133 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6948001a50 con 0x7f694c062450 2021-01-03T12:57:55.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6943fff700 1 -- 172.21.15.133:0/1546346133 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694400d570 con 0x7f694c062450 2021-01-03T12:57:55.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6943fff700 1 -- 172.21.15.133:0/1546346133 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f694400d6e0 con 0x7f694c062450 2021-01-03T12:57:55.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6951935700 1 -- 172.21.15.133:0/1546346133 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f694c062450 msgr2=0x7f694c067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:55.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.244+0000 7f6951935700 1 --2- 172.21.15.133:0/1546346133 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f694c062450 0x7f694c067cb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f6948001bf0 tx=0x7f6944006dc0).stop 2021-01-03T12:57:55.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6951935700 1 -- 172.21.15.133:0/1546346133 shutdown_connections 2021-01-03T12:57:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6951935700 1 --2- 172.21.15.133:0/1546346133 >> v2:172.21.15.16:3300/0 conn(0x7f694c0b33b0 0x7f694c14f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6951935700 1 --2- 172.21.15.133:0/1546346133 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f694c062450 0x7f694c067cb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6951935700 1 -- 172.21.15.133:0/1546346133 >> 172.21.15.133:0/1546346133 conn(0x7f694c060d10 msgr2=0x7f694c061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6951935700 1 -- 172.21.15.133:0/1546346133 shutdown_connections 2021-01-03T12:57:55.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6951935700 1 -- 172.21.15.133:0/1546346133 wait complete. 2021-01-03T12:57:55.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6951935700 1 Processor -- start 2021-01-03T12:57:55.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6951935700 1 -- start start 2021-01-03T12:57:55.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6951935700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f694c062450 0x7f694c066e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:55.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6951935700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f694c0adc10 0x7f694c141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6951935700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f694c0b33b0 0x7f694c1424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6951935700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c12d6b0 con 0x7f694c0adc10 2021-01-03T12:57:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6951935700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c1429c0 con 0x7f694c062450 2021-01-03T12:57:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6951935700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694c13c1b0 con 0x7f694c0b33b0 2021-01-03T12:57:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6951134700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f694c062450 0x7f694c066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6951134700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f694c062450 0x7f694c066e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59610/0 (socket says 172.21.15.133:59610) 2021-01-03T12:57:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6951134700 1 -- 172.21.15.133:0/488852149 learned_addr learned my addr 172.21.15.133:0/488852149 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:57:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6950933700 1 --2- 172.21.15.133:0/488852149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f694c0adc10 0x7f694c141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.248+0000 7f6952b97700 1 --2- 172.21.15.133:0/488852149 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f694c0b33b0 0x7f694c1424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.252+0000 7f6951134700 1 -- 172.21.15.133:0/488852149 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f694c0b33b0 msgr2=0x7f694c1424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:55.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.252+0000 7f6951134700 1 --2- 172.21.15.133:0/488852149 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f694c0b33b0 0x7f694c1424d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:55.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.252+0000 7f6951134700 1 -- 172.21.15.133:0/488852149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f694c0adc10 msgr2=0x7f694c141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:55.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.252+0000 7f6951134700 1 --2- 172.21.15.133:0/488852149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f694c0adc10 0x7f694c141fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:55.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.252+0000 7f6951134700 1 -- 172.21.15.133:0/488852149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c080320 con 0x7f694c062450 2021-01-03T12:57:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.252+0000 7f6951134700 1 --2- 172.21.15.133:0/488852149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f694c062450 0x7f694c066e00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f6948001cb0 tx=0x7f6948001630).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.252+0000 7f6941ffb700 1 -- 172.21.15.133:0/488852149 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6948004a80 con 0x7f694c062450 2021-01-03T12:57:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.252+0000 7f6941ffb700 1 -- 172.21.15.133:0/488852149 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6948004be0 con 0x7f694c062450 2021-01-03T12:57:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.252+0000 7f6951935700 1 -- 172.21.15.133:0/488852149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f694c12d8e0 con 0x7f694c062450 2021-01-03T12:57:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.252+0000 7f6941ffb700 1 -- 172.21.15.133:0/488852149 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6948007170 con 0x7f694c062450 2021-01-03T12:57:55.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.252+0000 7f6951935700 1 -- 172.21.15.133:0/488852149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f694c0672f0 con 0x7f694c062450 2021-01-03T12:57:55.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.252+0000 7f6951935700 1 -- 172.21.15.133:0/488852149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694c057300 con 0x7f694c062450 2021-01-03T12:57:55.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.252+0000 7f6941ffb700 1 -- 172.21.15.133:0/488852149 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f694801b060 con 0x7f694c062450 2021-01-03T12:57:55.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.252+0000 7f6941ffb700 1 --2- 172.21.15.133:0/488852149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f692c0553b0 0x7f692c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:55.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.252+0000 7f6950933700 1 --2- 172.21.15.133:0/488852149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f692c0553b0 0x7f692c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:55.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.252+0000 7f6941ffb700 1 -- 172.21.15.133:0/488852149 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f694806d890 con 0x7f694c062450 2021-01-03T12:57:55.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.252+0000 7f6950933700 1 --2- 172.21.15.133:0/488852149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f692c0553b0 0x7f692c057870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f694401a000 tx=0x7f6944015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:55.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.260+0000 7f6941ffb700 1 -- 172.21.15.133:0/488852149 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6948044020 con 0x7f694c062450 2021-01-03T12:57:55.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:55.412+0000 7f6951935700 1 -- 172.21.15.133:0/488852149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f694c068660 con 0x7f694c062450 2021-01-03T12:57:56.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.328+0000 7f6941ffb700 1 -- 172.21.15.133:0/488852149 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f6948019070 con 0x7f694c062450 2021-01-03T12:57:56.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.332+0000 7f6951935700 1 -- 172.21.15.133:0/488852149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f692c0553b0 msgr2=0x7f692c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.332+0000 7f6951935700 1 --2- 172.21.15.133:0/488852149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f692c0553b0 0x7f692c057870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f694401a000 tx=0x7f6944015000).stop 2021-01-03T12:57:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.332+0000 7f6951935700 1 -- 172.21.15.133:0/488852149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f694c062450 msgr2=0x7f694c066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.332+0000 7f6951935700 1 --2- 172.21.15.133:0/488852149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f694c062450 0x7f694c066e00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f6948001cb0 tx=0x7f6948001630).stop 2021-01-03T12:57:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.332+0000 7f6951935700 1 -- 172.21.15.133:0/488852149 shutdown_connections 2021-01-03T12:57:56.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.332+0000 7f6951935700 1 --2- 172.21.15.133:0/488852149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f692c0553b0 0x7f692c057870 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.332+0000 7f6951935700 1 --2- 172.21.15.133:0/488852149 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f694c0b33b0 0x7f694c1424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.332+0000 7f6951935700 1 --2- 172.21.15.133:0/488852149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f694c062450 0x7f694c066e00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.332+0000 7f6951935700 1 --2- 172.21.15.133:0/488852149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f694c0adc10 0x7f694c141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.332+0000 7f6951935700 1 -- 172.21.15.133:0/488852149 >> 172.21.15.133:0/488852149 conn(0x7f694c060d10 msgr2=0x7f694c0aee90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.332+0000 7f6951935700 1 -- 172.21.15.133:0/488852149 shutdown_connections 2021-01-03T12:57:56.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.332+0000 7f6951935700 1 -- 172.21.15.133:0/488852149 wait complete. 2021-01-03T12:57:56.340 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'rbd' created 2021-01-03T12:57:56.350 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-01-03T12:57:56.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.460+0000 7f2a4315d700 1 Processor -- start 2021-01-03T12:57:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.460+0000 7f2a4315d700 1 -- start start 2021-01-03T12:57:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.460+0000 7f2a4315d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2a3c0adc10 0x7f2a3c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.460+0000 7f2a4315d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a3c062450 0x7f2a3c0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.460+0000 7f2a4315d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3c0adff0 con 0x7f2a3c0b3190 2021-01-03T12:57:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.460+0000 7f2a4315d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3c0b1930 con 0x7f2a3c0adc10 2021-01-03T12:57:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.460+0000 7f2a4315d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c05fb80 con 0x7f2a3c062450 2021-01-03T12:57:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a443bf700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2a3c0b3190 0x7f2a3c025140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52418/0 (socket says 172.21.15.133:52418) 2021-01-03T12:57:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a443bf700 1 -- 172.21.15.133:0/759740284 learned_addr learned my addr 172.21.15.133:0/759740284 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:57:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4295c700 1 --2- 172.21.15.133:0/759740284 >> v2:172.21.15.16:3300/0 conn(0x7f2a3c0adc10 0x7f2a3c067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4215b700 1 --2- 172.21.15.133:0/759740284 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a3c062450 0x7f2a3c0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4195a700 1 -- 172.21.15.133:0/759740284 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882528414 0 0) 0x7f2a3c0adff0 con 0x7f2a3c0b3190 2021-01-03T12:57:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4195a700 1 -- 172.21.15.133:0/759740284 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a28003230 con 0x7f2a3c0b3190 2021-01-03T12:57:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4215b700 1 -- 172.21.15.133:0/759740284 >> v2:172.21.15.16:3300/0 conn(0x7f2a3c0adc10 msgr2=0x7f2a3c067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4215b700 1 --2- 172.21.15.133:0/759740284 >> v2:172.21.15.16:3300/0 conn(0x7f2a3c0adc10 0x7f2a3c067cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4215b700 1 -- 172.21.15.133:0/759740284 >> v1:172.21.15.133:6789/0 conn(0x7f2a3c0b3190 legacy=0x7f2a3c025140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4215b700 1 -- 172.21.15.133:0/759740284 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c05fed0 con 0x7f2a3c062450 2021-01-03T12:57:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4215b700 1 --2- 172.21.15.133:0/759740284 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a3c062450 0x7f2a3c0b2ca0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2a2c002f30 tx=0x7f2a2c006dc0).ready entity=mon.2 client_cookie=17892e78006f307b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4195a700 1 -- 172.21.15.133:0/759740284 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a2c0096a0 con 0x7f2a3c062450 2021-01-03T12:57:56.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4195a700 1 -- 172.21.15.133:0/759740284 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c009800 con 0x7f2a3c062450 2021-01-03T12:57:56.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4195a700 1 -- 172.21.15.133:0/759740284 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a2c009b60 con 0x7f2a3c062450 2021-01-03T12:57:56.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4315d700 1 -- 172.21.15.133:0/759740284 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a3c062450 msgr2=0x7f2a3c0b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:56.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4315d700 1 --2- 172.21.15.133:0/759740284 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a3c062450 0x7f2a3c0b2ca0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f2a2c002f30 tx=0x7f2a2c006dc0).stop 2021-01-03T12:57:56.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4315d700 1 -- 172.21.15.133:0/759740284 shutdown_connections 2021-01-03T12:57:56.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4315d700 1 --2- 172.21.15.133:0/759740284 >> v2:172.21.15.16:3300/0 conn(0x7f2a3c0adc10 0x7f2a3c067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:56.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4315d700 1 --2- 172.21.15.133:0/759740284 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a3c062450 0x7f2a3c0b2ca0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:56.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4315d700 1 -- 172.21.15.133:0/759740284 >> 172.21.15.133:0/759740284 conn(0x7f2a3c060d10 msgr2=0x7f2a3c061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:56.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4315d700 1 -- 172.21.15.133:0/759740284 shutdown_connections 2021-01-03T12:57:56.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.464+0000 7f2a4315d700 1 -- 172.21.15.133:0/759740284 wait complete. 2021-01-03T12:57:56.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a4315d700 1 Processor -- start 2021-01-03T12:57:56.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a4315d700 1 -- start start 2021-01-03T12:57:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a4315d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a3c062450 0x7f2a3c12c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a4315d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a3c0adc10 0x7f2a3c130930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a4315d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c0b3190 0x7f2a3c140b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a4315d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c12bb90 con 0x7f2a3c062450 2021-01-03T12:57:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a4315d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c12bfa0 con 0x7f2a3c0b3190 2021-01-03T12:57:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a4315d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c12c240 con 0x7f2a3c0adc10 2021-01-03T12:57:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a443bf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c0b3190 0x7f2a3c140b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a443bf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c0b3190 0x7f2a3c140b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59624/0 (socket says 172.21.15.133:59624) 2021-01-03T12:57:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a443bf700 1 -- 172.21.15.133:0/3837829860 learned_addr learned my addr 172.21.15.133:0/3837829860 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:57:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a4215b700 1 --2- 172.21.15.133:0/3837829860 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a3c0adc10 0x7f2a3c130930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a4295c700 1 --2- 172.21.15.133:0/3837829860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a3c062450 0x7f2a3c12c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a443bf700 1 -- 172.21.15.133:0/3837829860 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a3c0adc10 msgr2=0x7f2a3c130930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a443bf700 1 --2- 172.21.15.133:0/3837829860 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a3c0adc10 0x7f2a3c130930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a443bf700 1 -- 172.21.15.133:0/3837829860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a3c062450 msgr2=0x7f2a3c12c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:56.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a443bf700 1 --2- 172.21.15.133:0/3837829860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a3c062450 0x7f2a3c12c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:56.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a443bf700 1 -- 172.21.15.133:0/3837829860 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c12c4e0 con 0x7f2a3c0b3190 2021-01-03T12:57:56.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a443bf700 1 --2- 172.21.15.133:0/3837829860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c0b3190 0x7f2a3c140b90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2a340010d0 tx=0x7f2a34007a50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:56.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.468+0000 7f2a337fe700 1 -- 172.21.15.133:0/3837829860 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a340072e0 con 0x7f2a3c0b3190 2021-01-03T12:57:56.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.472+0000 7f2a337fe700 1 -- 172.21.15.133:0/3837829860 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a34007440 con 0x7f2a3c0b3190 2021-01-03T12:57:56.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.472+0000 7f2a337fe700 1 -- 172.21.15.133:0/3837829860 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a340057d0 con 0x7f2a3c0b3190 2021-01-03T12:57:56.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.472+0000 7f2a4315d700 1 -- 172.21.15.133:0/3837829860 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3c130e20 con 0x7f2a3c0b3190 2021-01-03T12:57:56.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.472+0000 7f2a4315d700 1 -- 172.21.15.133:0/3837829860 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c12ae90 con 0x7f2a3c0b3190 2021-01-03T12:57:56.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.472+0000 7f2a4315d700 1 -- 172.21.15.133:0/3837829860 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3c057300 con 0x7f2a3c0b3190 2021-01-03T12:57:56.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.472+0000 7f2a337fe700 1 -- 172.21.15.133:0/3837829860 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2a34010070 con 0x7f2a3c0b3190 2021-01-03T12:57:56.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.472+0000 7f2a337fe700 1 --2- 172.21.15.133:0/3837829860 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a240553b0 0x7f2a24057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:56.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.472+0000 7f2a337fe700 1 -- 172.21.15.133:0/3837829860 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f2a3406d290 con 0x7f2a3c0b3190 2021-01-03T12:57:56.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.472+0000 7f2a4295c700 1 --2- 172.21.15.133:0/3837829860 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a240553b0 0x7f2a24057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:56.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.472+0000 7f2a4295c700 1 --2- 172.21.15.133:0/3837829860 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a240553b0 0x7f2a24057870 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2a3800b000 tx=0x7f2a380091a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:56.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.480+0000 7f2a337fe700 1 -- 172.21.15.133:0/3837829860 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2a34043830 con 0x7f2a3c0b3190 2021-01-03T12:57:56.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:56.623+0000 7f2a4315d700 1 -- 172.21.15.133:0/3837829860 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2a3c068660 con 0x7f2a3c0b3190 2021-01-03T12:57:57.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.331+0000 7f2a337fe700 1 -- 172.21.15.133:0/3837829860 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2a34046e50 con 0x7f2a3c0b3190 2021-01-03T12:57:57.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.335+0000 7f2a4315d700 1 -- 172.21.15.133:0/3837829860 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a240553b0 msgr2=0x7f2a24057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:57.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.335+0000 7f2a4315d700 1 --2- 172.21.15.133:0/3837829860 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a240553b0 0x7f2a24057870 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f2a3800b000 tx=0x7f2a380091a0).stop 2021-01-03T12:57:57.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.335+0000 7f2a4315d700 1 -- 172.21.15.133:0/3837829860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c0b3190 msgr2=0x7f2a3c140b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:57.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.335+0000 7f2a4315d700 1 --2- 172.21.15.133:0/3837829860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c0b3190 0x7f2a3c140b90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2a340010d0 tx=0x7f2a34007a50).stop 2021-01-03T12:57:57.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.335+0000 7f2a4315d700 1 -- 172.21.15.133:0/3837829860 shutdown_connections 2021-01-03T12:57:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.335+0000 7f2a4315d700 1 --2- 172.21.15.133:0/3837829860 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a240553b0 0x7f2a24057870 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.335+0000 7f2a4315d700 1 --2- 172.21.15.133:0/3837829860 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a3c062450 0x7f2a3c12c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.335+0000 7f2a4315d700 1 --2- 172.21.15.133:0/3837829860 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a3c0b3190 0x7f2a3c140b90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.335+0000 7f2a4315d700 1 --2- 172.21.15.133:0/3837829860 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a3c0adc10 0x7f2a3c130930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.335+0000 7f2a4315d700 1 -- 172.21.15.133:0/3837829860 >> 172.21.15.133:0/3837829860 conn(0x7f2a3c060d10 msgr2=0x7f2a3c0aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:57.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.335+0000 7f2a4315d700 1 -- 172.21.15.133:0/3837829860 shutdown_connections 2021-01-03T12:57:57.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.335+0000 7f2a4315d700 1 -- 172.21.15.133:0/3837829860 wait complete. 2021-01-03T12:57:57.344 INFO:teuthology.orchestra.run.smithi133.stderr:enabled application 'rbd' on pool 'rbd' 2021-01-03T12:57:57.356 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-01-03T12:57:57.357 INFO:tasks.ceph.mds.a:Restarting daemon 2021-01-03T12:57:57.357 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-01-03T12:57:57.367 INFO:tasks.ceph.mds.a:Started 2021-01-03T12:57:57.368 INFO:tasks.ceph.mds.c:Restarting daemon 2021-01-03T12:57:57.368 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-01-03T12:57:57.377 INFO:tasks.ceph.mds.c:Started 2021-01-03T12:57:57.378 INFO:tasks.ceph.mds.b:Restarting daemon 2021-01-03T12:57:57.378 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-01-03T12:57:57.383 INFO:tasks.ceph.mds.b:Started 2021-01-03T12:57:57.384 INFO:tasks.ceph:Setting up CephFS filesystem... 2021-01-03T12:57:57.384 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:57:57.432 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T12:57:57.449 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T12:57:57.460 INFO:tasks.ceph.mds.b.smithi016.stdout:starting mds.b at 2021-01-03T12:57:57.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.491+0000 7fe756d05700 1 Processor -- start 2021-01-03T12:57:57.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.491+0000 7fe756d05700 1 -- start start 2021-01-03T12:57:57.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.491+0000 7fe756d05700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe75005c130 0x7fe7500b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:57.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.491+0000 7fe756d05700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe7500b02b0 0x7fe7500b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:57.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.491+0000 7fe756d05700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe75005c510 con 0x7fe7500622f0 2021-01-03T12:57:57.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.491+0000 7fe756d05700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7501473d0 con 0x7fe75005c130 2021-01-03T12:57:57.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.491+0000 7fe756d05700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7500b0ab0 con 0x7fe7500b02b0 2021-01-03T12:57:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.491+0000 7fe756504700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe7500622f0 0x7fe7500668a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52464/0 (socket says 172.21.15.133:52464) 2021-01-03T12:57:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.491+0000 7fe756504700 1 -- 172.21.15.133:0/2869792788 learned_addr learned my addr 172.21.15.133:0/2869792788 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:57:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.491+0000 7fe755502700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe7500b02b0 0x7fe7500b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe755d03700 1 --2- 172.21.15.133:0/2869792788 >> v2:172.21.15.16:3300/0 conn(0x7fe75005c130 0x7fe7500b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:57.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe754d01700 1 -- 172.21.15.133:0/2869792788 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485686353 0 0) 0x7fe75005c510 con 0x7fe7500622f0 2021-01-03T12:57:57.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe754d01700 1 -- 172.21.15.133:0/2869792788 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe738003230 con 0x7fe7500622f0 2021-01-03T12:57:57.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe755502700 1 -- 172.21.15.133:0/2869792788 >> v2:172.21.15.16:3300/0 conn(0x7fe75005c130 msgr2=0x7fe7500b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:57.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe755502700 1 --2- 172.21.15.133:0/2869792788 >> v2:172.21.15.16:3300/0 conn(0x7fe75005c130 0x7fe7500b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe755502700 1 -- 172.21.15.133:0/2869792788 >> v1:172.21.15.133:6789/0 conn(0x7fe7500622f0 legacy=0x7fe7500668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:57.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe754d01700 1 -- 172.21.15.133:0/2869792788 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3420775095 0 0) 0x7fe738003230 con 0x7fe7500622f0 2021-01-03T12:57:57.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe755502700 1 -- 172.21.15.133:0/2869792788 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7500b15a0 con 0x7fe7500b02b0 2021-01-03T12:57:57.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe755502700 1 --2- 172.21.15.133:0/2869792788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7500b02b0 0x7fe7500b1ef0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe748001bf0 tx=0x7fe740006dc0).ready entity=mon.1 client_cookie=825ecf5d3386d927 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:57.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe754d01700 1 -- 172.21.15.133:0/2869792788 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe748001a50 con 0x7fe7500b02b0 2021-01-03T12:57:57.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe754d01700 1 -- 172.21.15.133:0/2869792788 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74000d5c0 con 0x7fe7500b02b0 2021-01-03T12:57:57.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe754d01700 1 -- 172.21.15.133:0/2869792788 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe74000d730 con 0x7fe7500b02b0 2021-01-03T12:57:57.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe756d05700 1 -- 172.21.15.133:0/2869792788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7500b02b0 msgr2=0x7fe7500b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:57.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe756d05700 1 --2- 172.21.15.133:0/2869792788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7500b02b0 0x7fe7500b1ef0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe748001bf0 tx=0x7fe740006dc0).stop 2021-01-03T12:57:57.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe756d05700 1 -- 172.21.15.133:0/2869792788 shutdown_connections 2021-01-03T12:57:57.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe756d05700 1 --2- 172.21.15.133:0/2869792788 >> v2:172.21.15.16:3300/0 conn(0x7fe75005c130 0x7fe7500b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe756d05700 1 --2- 172.21.15.133:0/2869792788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7500b02b0 0x7fe7500b1ef0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe756d05700 1 -- 172.21.15.133:0/2869792788 >> 172.21.15.133:0/2869792788 conn(0x7fe7500b6110 msgr2=0x7fe7500b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:57.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe756d05700 1 -- 172.21.15.133:0/2869792788 shutdown_connections 2021-01-03T12:57:57.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe756d05700 1 -- 172.21.15.133:0/2869792788 wait complete. 2021-01-03T12:57:57.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe756d05700 1 Processor -- start 2021-01-03T12:57:57.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe756d05700 1 -- start start 2021-01-03T12:57:57.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe756d05700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75005c130 0x7fe750141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:57.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe756d05700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe7500622f0 0x7fe750151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:57.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe756d05700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7500b02b0 0x7fe7501557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:57.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe756d05700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7500640a0 con 0x7fe7500b02b0 2021-01-03T12:57:57.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe756d05700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe750155070 con 0x7fe75005c130 2021-01-03T12:57:57.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe756d05700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe750155310 con 0x7fe7500622f0 2021-01-03T12:57:57.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe755d03700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75005c130 0x7fe750141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:57.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe755d03700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75005c130 0x7fe750141fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59666/0 (socket says 172.21.15.133:59666) 2021-01-03T12:57:57.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe755d03700 1 -- 172.21.15.133:0/3503078793 learned_addr learned my addr 172.21.15.133:0/3503078793 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:57:57.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe755502700 1 --2- 172.21.15.133:0/3503078793 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe7500622f0 0x7fe750151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:57.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.495+0000 7fe756504700 1 --2- 172.21.15.133:0/3503078793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7500b02b0 0x7fe7501557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:57.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe755d03700 1 -- 172.21.15.133:0/3503078793 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe7500622f0 msgr2=0x7fe750151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:57.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe755d03700 1 --2- 172.21.15.133:0/3503078793 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe7500622f0 0x7fe750151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe755d03700 1 -- 172.21.15.133:0/3503078793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7500b02b0 msgr2=0x7fe7501557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:57.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe755d03700 1 --2- 172.21.15.133:0/3503078793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7500b02b0 0x7fe7501557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe755d03700 1 -- 172.21.15.133:0/3503078793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe750151e70 con 0x7fe75005c130 2021-01-03T12:57:57.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe756504700 1 --2- 172.21.15.133:0/3503078793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7500b02b0 0x7fe7501557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:57:57.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe755d03700 1 --2- 172.21.15.133:0/3503078793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75005c130 0x7fe750141fb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fe74c006a50 tx=0x7fe74c006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:57.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe73effd700 1 -- 172.21.15.133:0/3503078793 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe74c00ca10 con 0x7fe75005c130 2021-01-03T12:57:57.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe73effd700 1 -- 172.21.15.133:0/3503078793 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c00cb70 con 0x7fe75005c130 2021-01-03T12:57:57.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe756d05700 1 -- 172.21.15.133:0/3503078793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7500a3800 con 0x7fe75005c130 2021-01-03T12:57:57.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe73effd700 1 -- 172.21.15.133:0/3503078793 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe74c0123f0 con 0x7fe75005c130 2021-01-03T12:57:57.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe756d05700 1 -- 172.21.15.133:0/3503078793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe750063b90 con 0x7fe75005c130 2021-01-03T12:57:57.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe756d05700 1 -- 172.21.15.133:0/3503078793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe750154e80 con 0x7fe75005c130 2021-01-03T12:57:57.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe73effd700 1 -- 172.21.15.133:0/3503078793 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe74c012550 con 0x7fe75005c130 2021-01-03T12:57:57.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe73effd700 1 --2- 172.21.15.133:0/3503078793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe730055440 0x7fe730057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:57.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe73effd700 1 -- 172.21.15.133:0/3503078793 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe74c06e100 con 0x7fe75005c130 2021-01-03T12:57:57.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe755502700 1 --2- 172.21.15.133:0/3503078793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe730055440 0x7fe730057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:57.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.499+0000 7fe755502700 1 --2- 172.21.15.133:0/3503078793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe730055440 0x7fe730057900 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe74001a000 tx=0x7fe740015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:57.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.511+0000 7fe73effd700 1 -- 172.21.15.133:0/3503078793 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe74c0446d0 con 0x7fe75005c130 2021-01-03T12:57:57.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.655+0000 7fe756d05700 1 -- 172.21.15.133:0/3503078793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe750057300 con 0x7fe75005c130 2021-01-03T12:57:57.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.659+0000 7fe73effd700 1 -- 172.21.15.133:0/3503078793 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13239 (secure 0 0 0) 0x7fe74c047cf0 con 0x7fe75005c130 2021-01-03T12:57:57.661 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:57.661 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":18,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:57:57.327919+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:57:57.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.659+0000 7fe756d05700 1 -- 172.21.15.133:0/3503078793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe730055440 msgr2=0x7fe730057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:57.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.659+0000 7fe756d05700 1 --2- 172.21.15.133:0/3503078793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe730055440 0x7fe730057900 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe74001a000 tx=0x7fe740015000).stop 2021-01-03T12:57:57.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.659+0000 7fe756d05700 1 -- 172.21.15.133:0/3503078793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75005c130 msgr2=0x7fe750141fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:57.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.659+0000 7fe756d05700 1 --2- 172.21.15.133:0/3503078793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75005c130 0x7fe750141fb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fe74c006a50 tx=0x7fe74c006dc0).stop 2021-01-03T12:57:57.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.659+0000 7fe756d05700 1 -- 172.21.15.133:0/3503078793 shutdown_connections 2021-01-03T12:57:57.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.659+0000 7fe756d05700 1 --2- 172.21.15.133:0/3503078793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe730055440 0x7fe730057900 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.659+0000 7fe756d05700 1 --2- 172.21.15.133:0/3503078793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe7500b02b0 0x7fe7501557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.659+0000 7fe756d05700 1 --2- 172.21.15.133:0/3503078793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe75005c130 0x7fe750141fb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.659+0000 7fe756d05700 1 --2- 172.21.15.133:0/3503078793 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe7500622f0 0x7fe750151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.659+0000 7fe756d05700 1 -- 172.21.15.133:0/3503078793 >> 172.21.15.133:0/3503078793 conn(0x7fe7500b6110 msgr2=0x7fe7500af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:57.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.659+0000 7fe756d05700 1 -- 172.21.15.133:0/3503078793 shutdown_connections 2021-01-03T12:57:57.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.659+0000 7fe756d05700 1 -- 172.21.15.133:0/3503078793 wait complete. 2021-01-03T12:57:57.675 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-01-03T12:57:57.676 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T12:57:57.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddffff700 1 Processor -- start 2021-01-03T12:57:57.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddffff700 1 -- start start 2021-01-03T12:57:57.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3de00b3670 0x7f3de00b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:57.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddffff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de00ac200 con 0x7f3de00b7910 2021-01-03T12:57:57.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de00ac430 con 0x7f3de00b1f30 2021-01-03T12:57:57.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddffff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de00ad720 con 0x7f3de00b3670 2021-01-03T12:57:57.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddf7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3de00b1f30 0x7f3de00b2ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52478/0 (socket says 172.21.15.133:52478) 2021-01-03T12:57:57.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddf7fe700 1 -- 172.21.15.133:0/4095899370 learned_addr learned my addr 172.21.15.133:0/4095899370 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:57:57.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dde7fc700 1 --2- 172.21.15.133:0/4095899370 >> v2:172.21.15.16:3300/0 conn(0x7f3de00b3670 0x7f3de00b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:57.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 -- 172.21.15.133:0/4095899370 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338545865 0 0) 0x7f3de00ac430 con 0x7f3de00b1f30 2021-01-03T12:57:57.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 -- 172.21.15.133:0/4095899370 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dc4003230 con 0x7f3de00b1f30 2021-01-03T12:57:57.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 -- 172.21.15.133:0/4095899370 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691195062 0 0) 0x7f3de00ac200 con 0x7f3de00b7910 2021-01-03T12:57:57.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 -- 172.21.15.133:0/4095899370 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de00ac430 con 0x7f3de00b7910 2021-01-03T12:57:57.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 -- 172.21.15.133:0/4095899370 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 728700649 0 0) 0x7f3dc4003230 con 0x7f3de00b1f30 2021-01-03T12:57:57.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 -- 172.21.15.133:0/4095899370 >> v2:172.21.15.16:3300/0 conn(0x7f3de00b3670 msgr2=0x7f3de00b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:57.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 --2- 172.21.15.133:0/4095899370 >> v2:172.21.15.16:3300/0 conn(0x7f3de00b3670 0x7f3de00b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 -- 172.21.15.133:0/4095899370 >> v1:172.21.15.16:6789/0 conn(0x7f3de00b7910 legacy=0x7f3de013e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:57.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 -- 172.21.15.133:0/4095899370 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de00ac6d0 con 0x7f3de00b1f30 2021-01-03T12:57:57.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 -- 172.21.15.133:0/4095899370 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f3dd8001a90 con 0x7f3de00b1f30 2021-01-03T12:57:57.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 -- 172.21.15.133:0/4095899370 >> v1:172.21.15.133:6789/0 conn(0x7f3de00b1f30 legacy=0x7f3de00b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:57.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 --2- 172.21.15.133:0/4095899370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc4003900 0x7f3dc4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:57.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 --2- 172.21.15.133:0/4095899370 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3dc40044d0 0x7f3dc4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:57.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 --2- 172.21.15.133:0/4095899370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3dc4004e90 0x7f3dc400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:57.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 -- 172.21.15.133:0/4095899370 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00ad720 con 0x7f3dc4004e90 2021-01-03T12:57:57.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 -- 172.21.15.133:0/4095899370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc400bc40 con 0x7f3dc4003900 2021-01-03T12:57:57.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 -- 172.21.15.133:0/4095899370 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc400be00 con 0x7f3dc40044d0 2021-01-03T12:57:57.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddeffd700 1 --2- 172.21.15.133:0/4095899370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc4003900 0x7f3dc4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:57.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddf7fe700 1 --2- 172.21.15.133:0/4095899370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3dc4004e90 0x7f3dc400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:57.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dde7fc700 1 --2- 172.21.15.133:0/4095899370 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3dc40044d0 0x7f3dc4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:57.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddeffd700 1 -- 172.21.15.133:0/4095899370 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3dc40044d0 msgr2=0x7f3dc4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:57.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddeffd700 1 --2- 172.21.15.133:0/4095899370 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3dc40044d0 0x7f3dc4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddeffd700 1 -- 172.21.15.133:0/4095899370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3dc4004e90 msgr2=0x7f3dc400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:57.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddeffd700 1 --2- 172.21.15.133:0/4095899370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3dc4004e90 0x7f3dc400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddf7fe700 1 -- 172.21.15.133:0/4095899370 reap_dead start 2021-01-03T12:57:57.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddeffd700 1 -- 172.21.15.133:0/4095899370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc4003230 con 0x7f3dc4003900 2021-01-03T12:57:57.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddeffd700 1 --2- 172.21.15.133:0/4095899370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc4003900 0x7f3dc4003d00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3dd00010d0 tx=0x7f3dd0007b60).ready entity=mon.1 client_cookie=b84cdd751b8dad0e server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:57.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 -- 172.21.15.133:0/4095899370 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dd000c660 con 0x7f3dc4003900 2021-01-03T12:57:57.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 -- 172.21.15.133:0/4095899370 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd000c7c0 con 0x7f3dc4003900 2021-01-03T12:57:57.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3dddffb700 1 -- 172.21.15.133:0/4095899370 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dd000cb20 con 0x7f3dc4003900 2021-01-03T12:57:57.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddffff700 1 -- 172.21.15.133:0/4095899370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc4003900 msgr2=0x7f3dc4003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:57.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.847+0000 7f3ddffff700 1 --2- 172.21.15.133:0/4095899370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc4003900 0x7f3dc4003d00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3dd00010d0 tx=0x7f3dd0007b60).stop 2021-01-03T12:57:57.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddffff700 1 -- 172.21.15.133:0/4095899370 shutdown_connections 2021-01-03T12:57:57.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddffff700 1 --2- 172.21.15.133:0/4095899370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc4003900 0x7f3dc4003d00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddffff700 1 -- 172.21.15.133:0/4095899370 >> 172.21.15.133:0/4095899370 conn(0x7f3de005c8c0 msgr2=0x7f3de00b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:57.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddffff700 1 -- 172.21.15.133:0/4095899370 shutdown_connections 2021-01-03T12:57:57.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddffff700 1 -- 172.21.15.133:0/4095899370 wait complete. 2021-01-03T12:57:57.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddffff700 1 Processor -- start 2021-01-03T12:57:57.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddffff700 1 -- start start 2021-01-03T12:57:57.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3dc4003900 0x7f3de013fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:57.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3de00b6530 0x7f3de00b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:57.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3de00b0e90 0x7f3de014fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:57.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de0153b60 con 0x7f3dc4003900 2021-01-03T12:57:57.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de0153e00 con 0x7f3de00b0e90 2021-01-03T12:57:57.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de0145460 con 0x7f3de00b6530 2021-01-03T12:57:57.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3de00b0e90 0x7f3de014fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:57.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3de00b0e90 0x7f3de014fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59690/0 (socket says 172.21.15.133:59690) 2021-01-03T12:57:57.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddf7fe700 1 -- 172.21.15.133:0/2319324745 learned_addr learned my addr 172.21.15.133:0/2319324745 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:57:57.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3dde7fc700 1 --2- 172.21.15.133:0/2319324745 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3de00b6530 0x7f3de00b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:57.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddeffd700 1 --2- 172.21.15.133:0/2319324745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3dc4003900 0x7f3de013fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:57.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddf7fe700 1 -- 172.21.15.133:0/2319324745 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3de00b6530 msgr2=0x7f3de00b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:57.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddf7fe700 1 --2- 172.21.15.133:0/2319324745 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3de00b6530 0x7f3de00b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddf7fe700 1 -- 172.21.15.133:0/2319324745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3dc4003900 msgr2=0x7f3de013fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:57.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.851+0000 7f3ddf7fe700 1 --2- 172.21.15.133:0/2319324745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3dc4003900 0x7f3de013fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:57.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.855+0000 7f3ddf7fe700 1 -- 172.21.15.133:0/2319324745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de0145700 con 0x7f3de00b0e90 2021-01-03T12:57:57.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.855+0000 7f3ddeffd700 1 --2- 172.21.15.133:0/2319324745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3dc4003900 0x7f3de013fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:57:57.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.855+0000 7f3ddf7fe700 1 --2- 172.21.15.133:0/2319324745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3de00b0e90 0x7f3de014fa80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3de00608e0 tx=0x7f3de00ac860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:57.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.855+0000 7f3dcffff700 1 -- 172.21.15.133:0/2319324745 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dd800fc30 con 0x7f3de00b0e90 2021-01-03T12:57:57.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.855+0000 7f3dcffff700 1 -- 172.21.15.133:0/2319324745 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd800fd90 con 0x7f3de00b0e90 2021-01-03T12:57:57.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.855+0000 7f3ddffff700 1 -- 172.21.15.133:0/2319324745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de013ff20 con 0x7f3de00b0e90 2021-01-03T12:57:57.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.855+0000 7f3dcffff700 1 -- 172.21.15.133:0/2319324745 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dd8012540 con 0x7f3de00b0e90 2021-01-03T12:57:57.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.855+0000 7f3ddffff700 1 -- 172.21.15.133:0/2319324745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de0140360 con 0x7f3de00b0e90 2021-01-03T12:57:57.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.855+0000 7f3ddffff700 1 -- 172.21.15.133:0/2319324745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de0145890 con 0x7f3de00b0e90 2021-01-03T12:57:57.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.855+0000 7f3dcffff700 1 -- 172.21.15.133:0/2319324745 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3dd80126a0 con 0x7f3de00b0e90 2021-01-03T12:57:57.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.855+0000 7f3dcffff700 1 --2- 172.21.15.133:0/2319324745 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3dbc055440 0x7f3dbc057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:57.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.855+0000 7f3dcffff700 1 -- 172.21.15.133:0/2319324745 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3dd806d470 con 0x7f3de00b0e90 2021-01-03T12:57:57.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.855+0000 7f3ddeffd700 1 --2- 172.21.15.133:0/2319324745 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3dbc055440 0x7f3dbc057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:57.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.855+0000 7f3ddeffd700 1 --2- 172.21.15.133:0/2319324745 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3dbc055440 0x7f3dbc057900 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3dd0019000 tx=0x7f3dd0017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:57.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:57.863+0000 7f3dcffff700 1 -- 172.21.15.133:0/2319324745 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3dd80439c0 con 0x7f3de00b0e90 2021-01-03T12:57:58.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.011+0000 7f3ddffff700 1 -- 172.21.15.133:0/2319324745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3de0057300 con 0x7f3de00b0e90 2021-01-03T12:57:58.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.011+0000 7f3dcffff700 1 -- 172.21.15.133:0/2319324745 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3dd8019030 con 0x7f3de00b0e90 2021-01-03T12:57:58.012 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T12:57:58.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.011+0000 7f3ddffff700 1 -- 172.21.15.133:0/2319324745 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3dbc055440 msgr2=0x7f3dbc057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.011+0000 7f3ddffff700 1 --2- 172.21.15.133:0/2319324745 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3dbc055440 0x7f3dbc057900 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3dd0019000 tx=0x7f3dd0017000).stop 2021-01-03T12:57:58.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.011+0000 7f3ddffff700 1 -- 172.21.15.133:0/2319324745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3de00b0e90 msgr2=0x7f3de014fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.011+0000 7f3ddffff700 1 --2- 172.21.15.133:0/2319324745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3de00b0e90 0x7f3de014fa80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3de00608e0 tx=0x7f3de00ac860).stop 2021-01-03T12:57:58.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.011+0000 7f3ddffff700 1 -- 172.21.15.133:0/2319324745 shutdown_connections 2021-01-03T12:57:58.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.011+0000 7f3ddffff700 1 --2- 172.21.15.133:0/2319324745 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3dbc055440 0x7f3dbc057900 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.011+0000 7f3ddffff700 1 --2- 172.21.15.133:0/2319324745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3dc4003900 0x7f3de013fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.011+0000 7f3ddffff700 1 --2- 172.21.15.133:0/2319324745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3de00b0e90 0x7f3de014fa80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.011+0000 7f3ddffff700 1 --2- 172.21.15.133:0/2319324745 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3de00b6530 0x7f3de00b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.011+0000 7f3ddffff700 1 -- 172.21.15.133:0/2319324745 >> 172.21.15.133:0/2319324745 conn(0x7f3de005c8c0 msgr2=0x7f3de0060140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:58.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.011+0000 7f3ddffff700 1 -- 172.21.15.133:0/2319324745 shutdown_connections 2021-01-03T12:57:58.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.011+0000 7f3ddffff700 1 -- 172.21.15.133:0/2319324745 wait complete. 2021-01-03T12:57:58.024 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T12:57:58.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.139+0000 7fd592628700 1 Processor -- start 2021-01-03T12:57:58.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.139+0000 7fd592628700 1 -- start start 2021-01-03T12:57:58.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd592628700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd58c0b7910 0x7fd58c0b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd592628700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd58c0b1f30 0x7fd58c0b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd592628700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58c0ac200 con 0x7fd58c0b3670 2021-01-03T12:57:58.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd592628700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58c0ad720 con 0x7fd58c0b1f30 2021-01-03T12:57:58.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd592628700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c0acc10 con 0x7fd58c0b7910 2021-01-03T12:57:58.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd591e27700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd58c0b1f30 0x7fd58c0b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd590e25700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd58c0b3670 0x7fd58c13e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52494/0 (socket says 172.21.15.133:52494) 2021-01-03T12:57:58.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd590e25700 1 -- 172.21.15.133:0/182427508 learned_addr learned my addr 172.21.15.133:0/182427508 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:57:58.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd591626700 1 --2- 172.21.15.133:0/182427508 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd58c0b7910 0x7fd58c0b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd57ffff700 1 -- 172.21.15.133:0/182427508 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461250336 0 0) 0x7fd58c0ac200 con 0x7fd58c0b3670 2021-01-03T12:57:58.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd57ffff700 1 -- 172.21.15.133:0/182427508 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd570003230 con 0x7fd58c0b3670 2021-01-03T12:57:58.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd591e27700 1 -- 172.21.15.133:0/182427508 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd58c0b7910 msgr2=0x7fd58c0b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:58.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd57ffff700 1 -- 172.21.15.133:0/182427508 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2969066786 0 0) 0x7fd570003230 con 0x7fd58c0b3670 2021-01-03T12:57:58.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd591e27700 1 --2- 172.21.15.133:0/182427508 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd58c0b7910 0x7fd58c0b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd591e27700 1 -- 172.21.15.133:0/182427508 >> v1:172.21.15.133:6789/0 conn(0x7fd58c0b3670 legacy=0x7fd58c13e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd591e27700 1 -- 172.21.15.133:0/182427508 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c0ac430 con 0x7fd58c0b1f30 2021-01-03T12:57:58.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd591626700 1 --2- 172.21.15.133:0/182427508 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd58c0b7910 0x7fd58c0b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:57:58.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd591e27700 1 --2- 172.21.15.133:0/182427508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd58c0b1f30 0x7fd58c0b2ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd5880019f0 tx=0x7fd5840091a0).ready entity=mon.1 client_cookie=88fb70fdc382b9d4 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:58.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd57ffff700 1 -- 172.21.15.133:0/182427508 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd588001850 con 0x7fd58c0b1f30 2021-01-03T12:57:58.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd57ffff700 1 -- 172.21.15.133:0/182427508 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58400b800 con 0x7fd58c0b1f30 2021-01-03T12:57:58.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd57ffff700 1 -- 172.21.15.133:0/182427508 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd58400b970 con 0x7fd58c0b1f30 2021-01-03T12:57:58.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd592628700 1 -- 172.21.15.133:0/182427508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd58c0b1f30 msgr2=0x7fd58c0b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd592628700 1 --2- 172.21.15.133:0/182427508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd58c0b1f30 0x7fd58c0b2ab0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd5880019f0 tx=0x7fd5840091a0).stop 2021-01-03T12:57:58.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd592628700 1 -- 172.21.15.133:0/182427508 shutdown_connections 2021-01-03T12:57:58.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd592628700 1 --2- 172.21.15.133:0/182427508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd58c0b1f30 0x7fd58c0b2ab0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd592628700 1 --2- 172.21.15.133:0/182427508 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd58c0b7910 0x7fd58c0b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd592628700 1 -- 172.21.15.133:0/182427508 >> 172.21.15.133:0/182427508 conn(0x7fd58c05c8c0 msgr2=0x7fd58c0b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:58.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd592628700 1 -- 172.21.15.133:0/182427508 shutdown_connections 2021-01-03T12:57:58.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.143+0000 7fd592628700 1 -- 172.21.15.133:0/182427508 wait complete. 2021-01-03T12:57:58.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd592628700 1 Processor -- start 2021-01-03T12:57:58.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd592628700 1 -- start start 2021-01-03T12:57:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd592628700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd58c0b1f30 0x7fd58c0af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd592628700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd58c0b3670 0x7fd58c0afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd592628700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd58c0b7910 0x7fd58c065d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd592628700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c151bb0 con 0x7fd58c0b1f30 2021-01-03T12:57:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd592628700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c151de0 con 0x7fd58c0b7910 2021-01-03T12:57:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd592628700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58c152080 con 0x7fd58c0b3670 2021-01-03T12:57:58.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd591e27700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd58c0b7910 0x7fd58c065d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd591e27700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd58c0b7910 0x7fd58c065d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59702/0 (socket says 172.21.15.133:59702) 2021-01-03T12:57:58.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd591e27700 1 -- 172.21.15.133:0/295223231 learned_addr learned my addr 172.21.15.133:0/295223231 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:57:58.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd591626700 1 --2- 172.21.15.133:0/295223231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd58c0b1f30 0x7fd58c0af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd590e25700 1 --2- 172.21.15.133:0/295223231 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd58c0b3670 0x7fd58c0afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd591e27700 1 -- 172.21.15.133:0/295223231 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd58c0b3670 msgr2=0x7fd58c0afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd591e27700 1 --2- 172.21.15.133:0/295223231 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd58c0b3670 0x7fd58c0afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd591e27700 1 -- 172.21.15.133:0/295223231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd58c0b1f30 msgr2=0x7fd58c0af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd591e27700 1 --2- 172.21.15.133:0/295223231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd58c0b1f30 0x7fd58c0af420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd591e27700 1 -- 172.21.15.133:0/295223231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c152320 con 0x7fd58c0b7910 2021-01-03T12:57:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd591626700 1 --2- 172.21.15.133:0/295223231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd58c0b1f30 0x7fd58c0af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:57:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd590e25700 1 --2- 172.21.15.133:0/295223231 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd58c0b3670 0x7fd58c0afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:57:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd591e27700 1 --2- 172.21.15.133:0/295223231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd58c0b7910 0x7fd58c065d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd5880019f0 tx=0x7fd584016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:58.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd57e7fc700 1 -- 172.21.15.133:0/295223231 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5840032d0 con 0x7fd58c0b7910 2021-01-03T12:57:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd57e7fc700 1 -- 172.21.15.133:0/295223231 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd584011ce0 con 0x7fd58c0b7910 2021-01-03T12:57:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd592628700 1 -- 172.21.15.133:0/295223231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58c065980 con 0x7fd58c0b7910 2021-01-03T12:57:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd57e7fc700 1 -- 172.21.15.133:0/295223231 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5840205f0 con 0x7fd58c0b7910 2021-01-03T12:57:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.147+0000 7fd592628700 1 -- 172.21.15.133:0/295223231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58c1527c0 con 0x7fd58c0b7910 2021-01-03T12:57:58.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.151+0000 7fd592628700 1 -- 172.21.15.133:0/295223231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58c057300 con 0x7fd58c0b7910 2021-01-03T12:57:58.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.151+0000 7fd57e7fc700 1 -- 172.21.15.133:0/295223231 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd584027030 con 0x7fd58c0b7910 2021-01-03T12:57:58.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.151+0000 7fd57e7fc700 1 --2- 172.21.15.133:0/295223231 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd574055330 0x7fd5740577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.151+0000 7fd591626700 1 --2- 172.21.15.133:0/295223231 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd574055330 0x7fd5740577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.151+0000 7fd57e7fc700 1 -- 172.21.15.133:0/295223231 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd58406e650 con 0x7fd58c0b7910 2021-01-03T12:57:58.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.151+0000 7fd591626700 1 --2- 172.21.15.133:0/295223231 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd574055330 0x7fd5740577f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd580008000 tx=0x7fd580008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:58.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.155+0000 7fd57e7fc700 1 -- 172.21.15.133:0/295223231 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd584044c00 con 0x7fd58c0b7910 2021-01-03T12:57:58.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.295+0000 7fd592628700 1 -- 172.21.15.133:0/295223231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd58c05ce00 con 0x7fd58c0b7910 2021-01-03T12:57:58.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.295+0000 7fd57e7fc700 1 -- 172.21.15.133:0/295223231 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd5840250a0 con 0x7fd58c0b7910 2021-01-03T12:57:58.298 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:57:58.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.299+0000 7fd592628700 1 -- 172.21.15.133:0/295223231 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd574055330 msgr2=0x7fd5740577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.299+0000 7fd592628700 1 --2- 172.21.15.133:0/295223231 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd574055330 0x7fd5740577f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd580008000 tx=0x7fd580008040).stop 2021-01-03T12:57:58.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.299+0000 7fd592628700 1 -- 172.21.15.133:0/295223231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd58c0b7910 msgr2=0x7fd58c065d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.299+0000 7fd592628700 1 --2- 172.21.15.133:0/295223231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd58c0b7910 0x7fd58c065d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fd5880019f0 tx=0x7fd584016000).stop 2021-01-03T12:57:58.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.299+0000 7fd592628700 1 -- 172.21.15.133:0/295223231 shutdown_connections 2021-01-03T12:57:58.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.299+0000 7fd592628700 1 --2- 172.21.15.133:0/295223231 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd574055330 0x7fd5740577f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.299+0000 7fd592628700 1 --2- 172.21.15.133:0/295223231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd58c0b1f30 0x7fd58c0af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.299+0000 7fd592628700 1 --2- 172.21.15.133:0/295223231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd58c0b7910 0x7fd58c065d70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.299+0000 7fd592628700 1 --2- 172.21.15.133:0/295223231 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd58c0b3670 0x7fd58c0afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.299+0000 7fd592628700 1 -- 172.21.15.133:0/295223231 >> 172.21.15.133:0/295223231 conn(0x7fd58c05c8c0 msgr2=0x7fd58c13bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:58.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.299+0000 7fd592628700 1 -- 172.21.15.133:0/295223231 shutdown_connections 2021-01-03T12:57:58.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.299+0000 7fd592628700 1 -- 172.21.15.133:0/295223231 wait complete. 2021-01-03T12:57:58.312 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-01-03T12:57:58.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.415+0000 7f3eae0f1700 1 Processor -- start 2021-01-03T12:57:58.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.415+0000 7f3eae0f1700 1 -- start start 2021-01-03T12:57:58.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.415+0000 7f3eae0f1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3ea80af7a0 0x7f3ea80afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.415+0000 7f3eae0f1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3ea805c7c0 0x7f3ea813fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.415+0000 7f3eae0f1700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea805cca0 con 0x7f3ea8140260 2021-01-03T12:57:58.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.415+0000 7f3eae0f1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea80b0070 con 0x7f3ea805c7c0 2021-01-03T12:57:58.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.415+0000 7f3eae0f1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80b0270 con 0x7f3ea80af7a0 2021-01-03T12:57:58.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3e9effd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3ea805c7c0 0x7f3ea813fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3e9effd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3ea805c7c0 0x7f3ea813fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59708/0 (socket says 172.21.15.133:59708) 2021-01-03T12:57:58.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3e9effd700 1 -- 172.21.15.133:0/745016028 learned_addr learned my addr 172.21.15.133:0/745016028 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:57:58.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3ea77fe700 1 --2- 172.21.15.133:0/745016028 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3ea80af7a0 0x7f3ea80afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3e9effd700 1 -- 172.21.15.133:0/745016028 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3ea80af7a0 msgr2=0x7f3ea80afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:58.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3e9effd700 1 --2- 172.21.15.133:0/745016028 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3ea80af7a0 0x7f3ea80afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3e9effd700 1 -- 172.21.15.133:0/745016028 >> v1:172.21.15.16:6789/0 conn(0x7f3ea8140260 legacy=0x7f3ea81466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3e9effd700 1 -- 172.21.15.133:0/745016028 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea80b0510 con 0x7f3ea805c7c0 2021-01-03T12:57:58.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3e9effd700 1 --2- 172.21.15.133:0/745016028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ea805c7c0 0x7f3ea813fd70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3e90002f30 tx=0x7f3e90006e80).ready entity=mon.1 client_cookie=fefebae60f4bdf1 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:58.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3ea6ffd700 1 -- 172.21.15.133:0/745016028 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e900097f0 con 0x7f3ea805c7c0 2021-01-03T12:57:58.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3ea6ffd700 1 -- 172.21.15.133:0/745016028 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e90009950 con 0x7f3ea805c7c0 2021-01-03T12:57:58.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3ea6ffd700 1 -- 172.21.15.133:0/745016028 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e90009cb0 con 0x7f3ea805c7c0 2021-01-03T12:57:58.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3eae0f1700 1 -- 172.21.15.133:0/745016028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ea805c7c0 msgr2=0x7f3ea813fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3eae0f1700 1 --2- 172.21.15.133:0/745016028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ea805c7c0 0x7f3ea813fd70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3e90002f30 tx=0x7f3e90006e80).stop 2021-01-03T12:57:58.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3eae0f1700 1 -- 172.21.15.133:0/745016028 shutdown_connections 2021-01-03T12:57:58.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3eae0f1700 1 --2- 172.21.15.133:0/745016028 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3ea80af7a0 0x7f3ea80afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3eae0f1700 1 --2- 172.21.15.133:0/745016028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ea805c7c0 0x7f3ea813fd70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3eae0f1700 1 -- 172.21.15.133:0/745016028 >> 172.21.15.133:0/745016028 conn(0x7f3ea80b9620 msgr2=0x7f3ea80b9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:58.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3eae0f1700 1 -- 172.21.15.133:0/745016028 shutdown_connections 2021-01-03T12:57:58.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3eae0f1700 1 -- 172.21.15.133:0/745016028 wait complete. 2021-01-03T12:57:58.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3eae0f1700 1 Processor -- start 2021-01-03T12:57:58.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.419+0000 7f3eae0f1700 1 -- start start 2021-01-03T12:57:58.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3eae0f1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ea805c7c0 0x7f3ea8145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3eae0f1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3ea80af7a0 0x7f3ea8155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3eae0f1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ea8140260 0x7f3ea8155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3eae0f1700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80b4250 con 0x7f3ea805c7c0 2021-01-03T12:57:58.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3eae0f1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80b8bc0 con 0x7f3ea8140260 2021-01-03T12:57:58.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3eae0f1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea809dac0 con 0x7f3ea80af7a0 2021-01-03T12:57:58.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3ea7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ea8140260 0x7f3ea8155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3ea7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ea8140260 0x7f3ea8155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59718/0 (socket says 172.21.15.133:59718) 2021-01-03T12:57:58.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3ea7fff700 1 -- 172.21.15.133:0/641945969 learned_addr learned my addr 172.21.15.133:0/641945969 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:57:58.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3e9effd700 1 --2- 172.21.15.133:0/641945969 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3ea80af7a0 0x7f3ea8155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3ea77fe700 1 --2- 172.21.15.133:0/641945969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ea805c7c0 0x7f3ea8145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3ea7fff700 1 -- 172.21.15.133:0/641945969 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3ea80af7a0 msgr2=0x7f3ea8155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3ea7fff700 1 --2- 172.21.15.133:0/641945969 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3ea80af7a0 0x7f3ea8155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3ea7fff700 1 -- 172.21.15.133:0/641945969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ea805c7c0 msgr2=0x7f3ea8145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3ea7fff700 1 --2- 172.21.15.133:0/641945969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ea805c7c0 0x7f3ea8145520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3ea7fff700 1 -- 172.21.15.133:0/641945969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea80b8920 con 0x7f3ea8140260 2021-01-03T12:57:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3ea7fff700 1 --2- 172.21.15.133:0/641945969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ea8140260 0x7f3ea8155e70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3ea805cbc0 tx=0x7f3ea0007f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3ea57fa700 1 -- 172.21.15.133:0/641945969 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ea000a5a0 con 0x7f3ea8140260 2021-01-03T12:57:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3ea57fa700 1 -- 172.21.15.133:0/641945969 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea000a700 con 0x7f3ea8140260 2021-01-03T12:57:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3eae0f1700 1 -- 172.21.15.133:0/641945969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea81554e0 con 0x7f3ea8140260 2021-01-03T12:57:58.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3ea57fa700 1 -- 172.21.15.133:0/641945969 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ea000aa60 con 0x7f3ea8140260 2021-01-03T12:57:58.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.423+0000 7f3eae0f1700 1 -- 172.21.15.133:0/641945969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea8145a10 con 0x7f3ea8140260 2021-01-03T12:57:58.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.427+0000 7f3eae0f1700 1 -- 172.21.15.133:0/641945969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea8057300 con 0x7f3ea8140260 2021-01-03T12:57:58.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.427+0000 7f3ea57fa700 1 -- 172.21.15.133:0/641945969 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3ea0019030 con 0x7f3ea8140260 2021-01-03T12:57:58.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.427+0000 7f3ea57fa700 1 --2- 172.21.15.133:0/641945969 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e8c055440 0x7f3e8c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.427+0000 7f3ea77fe700 1 --2- 172.21.15.133:0/641945969 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e8c055440 0x7f3e8c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.427+0000 7f3ea57fa700 1 -- 172.21.15.133:0/641945969 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3ea006d480 con 0x7f3ea8140260 2021-01-03T12:57:58.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.427+0000 7f3ea77fe700 1 --2- 172.21.15.133:0/641945969 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e8c055440 0x7f3e8c057900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3e9800c000 tx=0x7f3e98008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:58.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.435+0000 7f3ea57fa700 1 -- 172.21.15.133:0/641945969 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3ea00439a0 con 0x7f3ea8140260 2021-01-03T12:57:58.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.583+0000 7f3eae0f1700 1 -- 172.21.15.133:0/641945969 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3ea809f7c0 con 0x7f3ea8140260 2021-01-03T12:57:58.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.583+0000 7f3ea57fa700 1 -- 172.21.15.133:0/641945969 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+143 (secure 0 0 0) 0x7f3ea0046fc0 con 0x7f3ea8140260 2021-01-03T12:57:58.587 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:57:58.587 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2021-01-03T12:57:58.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:57:58.588 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2021-01-03T12:57:58.588 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2021-01-03T12:57:58.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:57:58.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:57:58.589 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2021-01-03T12:57:58.589 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2021-01-03T12:57:58.589 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:57:58.589 INFO:teuthology.orchestra.run.smithi133.stdout:] 2021-01-03T12:57:58.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.587+0000 7f3eae0f1700 1 -- 172.21.15.133:0/641945969 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e8c055440 msgr2=0x7f3e8c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.587+0000 7f3eae0f1700 1 --2- 172.21.15.133:0/641945969 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e8c055440 0x7f3e8c057900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3e9800c000 tx=0x7f3e98008040).stop 2021-01-03T12:57:58.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.587+0000 7f3eae0f1700 1 -- 172.21.15.133:0/641945969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ea8140260 msgr2=0x7f3ea8155e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.587+0000 7f3eae0f1700 1 --2- 172.21.15.133:0/641945969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ea8140260 0x7f3ea8155e70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3ea805cbc0 tx=0x7f3ea0007f70).stop 2021-01-03T12:57:58.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.587+0000 7f3eae0f1700 1 -- 172.21.15.133:0/641945969 shutdown_connections 2021-01-03T12:57:58.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.587+0000 7f3eae0f1700 1 --2- 172.21.15.133:0/641945969 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e8c055440 0x7f3e8c057900 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.587+0000 7f3eae0f1700 1 --2- 172.21.15.133:0/641945969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3ea805c7c0 0x7f3ea8145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.587+0000 7f3eae0f1700 1 --2- 172.21.15.133:0/641945969 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3ea8140260 0x7f3ea8155e70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.587+0000 7f3eae0f1700 1 --2- 172.21.15.133:0/641945969 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3ea80af7a0 0x7f3ea8155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.587+0000 7f3eae0f1700 1 -- 172.21.15.133:0/641945969 >> 172.21.15.133:0/641945969 conn(0x7f3ea80b9620 msgr2=0x7f3ea813fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:58.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.587+0000 7f3eae0f1700 1 -- 172.21.15.133:0/641945969 shutdown_connections 2021-01-03T12:57:58.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.587+0000 7f3eae0f1700 1 -- 172.21.15.133:0/641945969 wait complete. 2021-01-03T12:57:58.604 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-01-03T12:57:58.604 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-01-03T12:57:58.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.715+0000 7fc4a54d3700 1 Processor -- start 2021-01-03T12:57:58.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.715+0000 7fc4a54d3700 1 -- start start 2021-01-03T12:57:58.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.715+0000 7fc4a54d3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4a0060890 0x7fc4a00abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.715+0000 7fc4a54d3700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc4a00afa80 0x7fc4a00b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.715+0000 7fc4a54d3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a00aaa10 con 0x7fc4a00ae900 2021-01-03T12:57:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.715+0000 7fc4a54d3700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a00ab280 con 0x7fc4a00afa80 2021-01-03T12:57:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.715+0000 7fc4a54d3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a00b1470 con 0x7fc4a0060890 2021-01-03T12:57:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc49ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4a0060890 0x7fc4a00abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc4a4cd2700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc4a00ae900 0x7fc4a00aed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52528/0 (socket says 172.21.15.133:52528) 2021-01-03T12:57:58.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc4a4cd2700 1 -- 172.21.15.133:0/3203496067 learned_addr learned my addr 172.21.15.133:0/3203496067 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:57:58.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc49f7fe700 1 --2- 172.21.15.133:0/3203496067 >> v2:172.21.15.16:3300/0 conn(0x7fc4a00afa80 0x7fc4a00b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc49ffff700 1 -- 172.21.15.133:0/3203496067 >> v2:172.21.15.16:3300/0 conn(0x7fc4a00afa80 msgr2=0x7fc4a00b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:58.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc49ffff700 1 --2- 172.21.15.133:0/3203496067 >> v2:172.21.15.16:3300/0 conn(0x7fc4a00afa80 0x7fc4a00b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc49ffff700 1 -- 172.21.15.133:0/3203496067 >> v1:172.21.15.133:6789/0 conn(0x7fc4a00ae900 legacy=0x7fc4a00aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc49ffff700 1 -- 172.21.15.133:0/3203496067 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a00b0ab0 con 0x7fc4a0060890 2021-01-03T12:57:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc49effd700 1 -- 172.21.15.133:0/3203496067 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079378981 0 0) 0x7fc4a00aaa10 con 0x7fc4a00ae900 2021-01-03T12:57:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc49ffff700 1 --2- 172.21.15.133:0/3203496067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a0060890 0x7fc4a00abcc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc488002f30 tx=0x7fc488006dc0).ready entity=mon.1 client_cookie=1bbe647b72749c4f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc49effd700 1 -- 172.21.15.133:0/3203496067 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4880097b0 con 0x7fc4a0060890 2021-01-03T12:57:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc49effd700 1 -- 172.21.15.133:0/3203496067 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc488009910 con 0x7fc4a0060890 2021-01-03T12:57:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc49effd700 1 -- 172.21.15.133:0/3203496067 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc488009c70 con 0x7fc4a0060890 2021-01-03T12:57:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc4a54d3700 1 -- 172.21.15.133:0/3203496067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a0060890 msgr2=0x7fc4a00abcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc4a54d3700 1 --2- 172.21.15.133:0/3203496067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a0060890 0x7fc4a00abcc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc488002f30 tx=0x7fc488006dc0).stop 2021-01-03T12:57:58.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc4a54d3700 1 -- 172.21.15.133:0/3203496067 shutdown_connections 2021-01-03T12:57:58.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc4a54d3700 1 --2- 172.21.15.133:0/3203496067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a0060890 0x7fc4a00abcc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc4a54d3700 1 --2- 172.21.15.133:0/3203496067 >> v2:172.21.15.16:3300/0 conn(0x7fc4a00afa80 0x7fc4a00b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc4a54d3700 1 -- 172.21.15.133:0/3203496067 >> 172.21.15.133:0/3203496067 conn(0x7fc4a005bdf0 msgr2=0x7fc4a005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc4a54d3700 1 -- 172.21.15.133:0/3203496067 shutdown_connections 2021-01-03T12:57:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.719+0000 7fc4a54d3700 1 -- 172.21.15.133:0/3203496067 wait complete. 2021-01-03T12:57:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc4a54d3700 1 Processor -- start 2021-01-03T12:57:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc4a54d3700 1 -- start start 2021-01-03T12:57:58.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc4a54d3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4a0060890 0x7fc4a0065f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc4a54d3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a00ae900 0x7fc4a009a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc4a54d3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4a00afa80 0x7fc4a00901e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc4a54d3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0067370 con 0x7fc4a00afa80 2021-01-03T12:57:58.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc4a54d3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0067610 con 0x7fc4a00ae900 2021-01-03T12:57:58.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc4a54d3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a00678b0 con 0x7fc4a0060890 2021-01-03T12:57:58.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc49f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a00ae900 0x7fc4a009a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc49f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a00ae900 0x7fc4a009a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59732/0 (socket says 172.21.15.133:59732) 2021-01-03T12:57:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc49f7fe700 1 -- 172.21.15.133:0/3793254127 learned_addr learned my addr 172.21.15.133:0/3793254127 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:57:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc49ffff700 1 --2- 172.21.15.133:0/3793254127 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4a0060890 0x7fc4a0065f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc4a4cd2700 1 --2- 172.21.15.133:0/3793254127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4a00afa80 0x7fc4a00901e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc49f7fe700 1 -- 172.21.15.133:0/3793254127 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4a0060890 msgr2=0x7fc4a0065f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc49f7fe700 1 --2- 172.21.15.133:0/3793254127 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4a0060890 0x7fc4a0065f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc49f7fe700 1 -- 172.21.15.133:0/3793254127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4a00afa80 msgr2=0x7fc4a00901e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc49f7fe700 1 --2- 172.21.15.133:0/3793254127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4a00afa80 0x7fc4a00901e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:58.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc49f7fe700 1 -- 172.21.15.133:0/3793254127 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a00b1240 con 0x7fc4a00ae900 2021-01-03T12:57:58.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc49ffff700 1 --2- 172.21.15.133:0/3793254127 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4a0060890 0x7fc4a0065f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:57:58.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc4a4cd2700 1 --2- 172.21.15.133:0/3793254127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4a00afa80 0x7fc4a00901e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:57:58.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.723+0000 7fc49f7fe700 1 --2- 172.21.15.133:0/3793254127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a00ae900 0x7fc4a009a160 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc49000c000 tx=0x7fc490006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:58.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.727+0000 7fc49d7fa700 1 -- 172.21.15.133:0/3793254127 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc49000ca10 con 0x7fc4a00ae900 2021-01-03T12:57:58.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.727+0000 7fc49d7fa700 1 -- 172.21.15.133:0/3793254127 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49000cb70 con 0x7fc4a00ae900 2021-01-03T12:57:58.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.727+0000 7fc4a54d3700 1 -- 172.21.15.133:0/3793254127 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a008fd40 con 0x7fc4a00ae900 2021-01-03T12:57:58.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.727+0000 7fc49d7fa700 1 -- 172.21.15.133:0/3793254127 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc490013450 con 0x7fc4a00ae900 2021-01-03T12:57:58.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.727+0000 7fc4a54d3700 1 -- 172.21.15.133:0/3793254127 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a00668d0 con 0x7fc4a00ae900 2021-01-03T12:57:58.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.727+0000 7fc4a54d3700 1 -- 172.21.15.133:0/3793254127 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a008fed0 con 0x7fc4a00ae900 2021-01-03T12:57:58.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.727+0000 7fc49d7fa700 1 -- 172.21.15.133:0/3793254127 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc49001a030 con 0x7fc4a00ae900 2021-01-03T12:57:58.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.727+0000 7fc49d7fa700 1 --2- 172.21.15.133:0/3793254127 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc484055440 0x7fc484057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:58.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.727+0000 7fc49d7fa700 1 -- 172.21.15.133:0/3793254127 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc49006d9b0 con 0x7fc4a00ae900 2021-01-03T12:57:58.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.727+0000 7fc49ffff700 1 --2- 172.21.15.133:0/3793254127 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc484055440 0x7fc484057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:58.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.727+0000 7fc49ffff700 1 --2- 172.21.15.133:0/3793254127 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc484055440 0x7fc484057900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc488007000 tx=0x7fc488015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:58.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.735+0000 7fc49d7fa700 1 -- 172.21.15.133:0/3793254127 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc490042df0 con 0x7fc4a00ae900 2021-01-03T12:57:58.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:58.875+0000 7fc4a54d3700 1 -- 172.21.15.133:0/3793254127 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fc4a0057300 con 0x7fc4a00ae900 2021-01-03T12:57:59.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.471+0000 7fc49d7fa700 1 -- 172.21.15.133:0/3793254127 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v20) v1 ==== 133+0+0 (secure 0 0 0) 0x7fc490044030 con 0x7fc4a00ae900 2021-01-03T12:57:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.475+0000 7fc4a54d3700 1 -- 172.21.15.133:0/3793254127 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc484055440 msgr2=0x7fc484057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.475+0000 7fc4a54d3700 1 --2- 172.21.15.133:0/3793254127 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc484055440 0x7fc484057900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fc488007000 tx=0x7fc488015000).stop 2021-01-03T12:57:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.475+0000 7fc4a54d3700 1 -- 172.21.15.133:0/3793254127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a00ae900 msgr2=0x7fc4a009a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.475+0000 7fc4a54d3700 1 --2- 172.21.15.133:0/3793254127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a00ae900 0x7fc4a009a160 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fc49000c000 tx=0x7fc490006dc0).stop 2021-01-03T12:57:59.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.475+0000 7fc4a54d3700 1 -- 172.21.15.133:0/3793254127 shutdown_connections 2021-01-03T12:57:59.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.475+0000 7fc4a54d3700 1 --2- 172.21.15.133:0/3793254127 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc484055440 0x7fc484057900 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:59.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.475+0000 7fc4a54d3700 1 --2- 172.21.15.133:0/3793254127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4a00afa80 0x7fc4a00901e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:59.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.475+0000 7fc4a54d3700 1 --2- 172.21.15.133:0/3793254127 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4a0060890 0x7fc4a0065f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.475+0000 7fc4a54d3700 1 --2- 172.21.15.133:0/3793254127 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4a00ae900 0x7fc4a009a160 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.475+0000 7fc4a54d3700 1 -- 172.21.15.133:0/3793254127 >> 172.21.15.133:0/3793254127 conn(0x7fc4a005bdf0 msgr2=0x7fc4a01420d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.475+0000 7fc4a54d3700 1 -- 172.21.15.133:0/3793254127 shutdown_connections 2021-01-03T12:57:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.475+0000 7fc4a54d3700 1 -- 172.21.15.133:0/3793254127 wait complete. 2021-01-03T12:57:59.482 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2021-01-03T12:57:59.494 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-01-03T12:57:59.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.611+0000 7f7ce4d0d700 1 Processor -- start 2021-01-03T12:57:59.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.611+0000 7f7ce4d0d700 1 -- start start 2021-01-03T12:57:59.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7ce4d0d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7ce00b5c00 0x7f7ce01477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:59.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7ce4d0d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ce01442a0 0x7f7ce0144730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7ce4d0d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce00b0c10 con 0x7f7ce00b5260 2021-01-03T12:57:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7ce4d0d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce00b5640 con 0x7f7ce00b5c00 2021-01-03T12:57:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7ce4d0d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce009a4f0 con 0x7f7ce01442a0 2021-01-03T12:57:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7cdf7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7ce00b5260 0x7f7ce01470b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52538/0 (socket says 172.21.15.133:52538) 2021-01-03T12:57:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7cdf7fe700 1 -- 172.21.15.133:0/2374687403 learned_addr learned my addr 172.21.15.133:0/2374687403 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:57:59.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7cdffff700 1 --2- 172.21.15.133:0/2374687403 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ce01442a0 0x7f7ce0144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:59.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7cdeffd700 1 --2- 172.21.15.133:0/2374687403 >> v2:172.21.15.16:3300/0 conn(0x7f7ce00b5c00 0x7f7ce01477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:59.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7cde7fc700 1 -- 172.21.15.133:0/2374687403 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467087379 0 0) 0x7f7ce00b0c10 con 0x7f7ce00b5260 2021-01-03T12:57:59.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7cde7fc700 1 -- 172.21.15.133:0/2374687403 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cc4003230 con 0x7f7ce00b5260 2021-01-03T12:57:59.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7cde7fc700 1 -- 172.21.15.133:0/2374687403 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 881651477 0 0) 0x7f7cc4003230 con 0x7f7ce00b5260 2021-01-03T12:57:59.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7cdffff700 1 -- 172.21.15.133:0/2374687403 >> v2:172.21.15.16:3300/0 conn(0x7f7ce00b5c00 msgr2=0x7f7ce01477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:57:59.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7cdffff700 1 --2- 172.21.15.133:0/2374687403 >> v2:172.21.15.16:3300/0 conn(0x7f7ce00b5c00 0x7f7ce01477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:59.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7cdffff700 1 -- 172.21.15.133:0/2374687403 >> v1:172.21.15.133:6789/0 conn(0x7f7ce00b5260 legacy=0x7f7ce01470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:59.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7cdffff700 1 -- 172.21.15.133:0/2374687403 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce00b0e40 con 0x7f7ce01442a0 2021-01-03T12:57:59.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7cdffff700 1 --2- 172.21.15.133:0/2374687403 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ce01442a0 0x7f7ce0144730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7cc8001870 tx=0x7f7cd8006dc0).ready entity=mon.2 client_cookie=5f3451f7cb1301f1 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:59.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7cde7fc700 1 -- 172.21.15.133:0/2374687403 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cc80016d0 con 0x7f7ce01442a0 2021-01-03T12:57:59.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7cde7fc700 1 -- 172.21.15.133:0/2374687403 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd800d570 con 0x7f7ce01442a0 2021-01-03T12:57:59.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7cde7fc700 1 -- 172.21.15.133:0/2374687403 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cd800d6e0 con 0x7f7ce01442a0 2021-01-03T12:57:59.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7ce4d0d700 1 -- 172.21.15.133:0/2374687403 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ce01442a0 msgr2=0x7f7ce0144730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:59.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7ce4d0d700 1 --2- 172.21.15.133:0/2374687403 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ce01442a0 0x7f7ce0144730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7cc8001870 tx=0x7f7cd8006dc0).stop 2021-01-03T12:57:59.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7ce4d0d700 1 -- 172.21.15.133:0/2374687403 shutdown_connections 2021-01-03T12:57:59.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7ce4d0d700 1 --2- 172.21.15.133:0/2374687403 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ce01442a0 0x7f7ce0144730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:59.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7ce4d0d700 1 --2- 172.21.15.133:0/2374687403 >> v2:172.21.15.16:3300/0 conn(0x7f7ce00b5c00 0x7f7ce01477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:59.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7ce4d0d700 1 -- 172.21.15.133:0/2374687403 >> 172.21.15.133:0/2374687403 conn(0x7f7ce005bdf0 msgr2=0x7f7ce005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:57:59.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7ce4d0d700 1 -- 172.21.15.133:0/2374687403 shutdown_connections 2021-01-03T12:57:59.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.615+0000 7f7ce4d0d700 1 -- 172.21.15.133:0/2374687403 wait complete. 2021-01-03T12:57:59.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.619+0000 7f7ce4d0d700 1 Processor -- start 2021-01-03T12:57:59.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.619+0000 7f7ce4d0d700 1 -- start start 2021-01-03T12:57:59.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.619+0000 7f7ce4d0d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce00b5260 0x7f7ce0155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:59.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.619+0000 7f7ce4d0d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ce00b5c00 0x7f7ce0146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.619+0000 7f7ce4d0d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ce01442a0 0x7f7ce0063b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.619+0000 7f7ce4d0d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce00ae240 con 0x7f7ce01442a0 2021-01-03T12:57:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7ce4d0d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce00ae470 con 0x7f7ce00b5260 2021-01-03T12:57:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7ce4d0d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce00ae710 con 0x7f7ce00b5c00 2021-01-03T12:57:59.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7cdf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce00b5260 0x7f7ce0155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:59.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7cdeffd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ce00b5c00 0x7f7ce0146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:59.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7cdf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce00b5260 0x7f7ce0155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59744/0 (socket says 172.21.15.133:59744) 2021-01-03T12:57:59.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7cdf7fe700 1 -- 172.21.15.133:0/4224238772 learned_addr learned my addr 172.21.15.133:0/4224238772 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:57:59.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7cdffff700 1 --2- 172.21.15.133:0/4224238772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ce01442a0 0x7f7ce0063b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:59.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7cdf7fe700 1 -- 172.21.15.133:0/4224238772 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ce00b5c00 msgr2=0x7f7ce0146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:59.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7cdf7fe700 1 --2- 172.21.15.133:0/4224238772 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ce00b5c00 0x7f7ce0146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:59.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7cdf7fe700 1 -- 172.21.15.133:0/4224238772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ce01442a0 msgr2=0x7f7ce0063b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:57:59.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7cdf7fe700 1 --2- 172.21.15.133:0/4224238772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ce01442a0 0x7f7ce0063b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:57:59.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7cdf7fe700 1 -- 172.21.15.133:0/4224238772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce00636c0 con 0x7f7ce00b5260 2021-01-03T12:57:59.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7cdffff700 1 --2- 172.21.15.133:0/4224238772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ce01442a0 0x7f7ce0063b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:57:59.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7cdf7fe700 1 --2- 172.21.15.133:0/4224238772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce00b5260 0x7f7ce0155de0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7cc8001930 tx=0x7f7cc8001280).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:59.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7cdcff9700 1 -- 172.21.15.133:0/4224238772 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cc8007170 con 0x7f7ce00b5260 2021-01-03T12:57:59.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7ce4d0d700 1 -- 172.21.15.133:0/4224238772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce0146760 con 0x7f7ce00b5260 2021-01-03T12:57:59.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7cdcff9700 1 -- 172.21.15.133:0/4224238772 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc80072d0 con 0x7f7ce00b5260 2021-01-03T12:57:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7cdcff9700 1 -- 172.21.15.133:0/4224238772 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cc80048f0 con 0x7f7ce00b5260 2021-01-03T12:57:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.623+0000 7f7ce4d0d700 1 -- 172.21.15.133:0/4224238772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce0146e90 con 0x7f7ce00b5260 2021-01-03T12:57:59.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.627+0000 7f7ce4d0d700 1 -- 172.21.15.133:0/4224238772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce00ae000 con 0x7f7ce00b5260 2021-01-03T12:57:59.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.627+0000 7f7cdcff9700 1 -- 172.21.15.133:0/4224238772 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7cc8010070 con 0x7f7ce00b5260 2021-01-03T12:57:59.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.627+0000 7f7cdcff9700 1 --2- 172.21.15.133:0/4224238772 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7cb80553b0 0x7f7cb8057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:57:59.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.627+0000 7f7cdcff9700 1 -- 172.21.15.133:0/4224238772 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f7cc806d7b0 con 0x7f7ce00b5260 2021-01-03T12:57:59.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.627+0000 7f7cdeffd700 1 --2- 172.21.15.133:0/4224238772 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7cb80553b0 0x7f7cb8057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:57:59.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.627+0000 7f7cdeffd700 1 --2- 172.21.15.133:0/4224238772 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7cb80553b0 0x7f7cb8057870 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7cd000b000 tx=0x7f7cd00091a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:57:59.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.631+0000 7f7cdcff9700 1 -- 172.21.15.133:0/4224238772 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7ce00ae000 con 0x7f7ce00b5260 2021-01-03T12:57:59.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:57:59.767+0000 7f7ce4d0d700 1 -- 172.21.15.133:0/4224238772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f7ce0063520 con 0x7f7ce00b5260 2021-01-03T12:58:00.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.487+0000 7f7cdcff9700 1 -- 172.21.15.133:0/4224238772 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v21) v1 ==== 125+0+0 (secure 0 0 0) 0x7f7ce0063520 con 0x7f7ce00b5260 2021-01-03T12:58:00.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.495+0000 7f7ce4d0d700 1 -- 172.21.15.133:0/4224238772 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7cb80553b0 msgr2=0x7f7cb8057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:00.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.495+0000 7f7ce4d0d700 1 --2- 172.21.15.133:0/4224238772 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7cb80553b0 0x7f7cb8057870 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7cd000b000 tx=0x7f7cd00091a0).stop 2021-01-03T12:58:00.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.495+0000 7f7ce4d0d700 1 -- 172.21.15.133:0/4224238772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce00b5260 msgr2=0x7f7ce0155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:00.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.495+0000 7f7ce4d0d700 1 --2- 172.21.15.133:0/4224238772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce00b5260 0x7f7ce0155de0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7cc8001930 tx=0x7f7cc8001280).stop 2021-01-03T12:58:00.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.495+0000 7f7ce4d0d700 1 -- 172.21.15.133:0/4224238772 shutdown_connections 2021-01-03T12:58:00.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.495+0000 7f7ce4d0d700 1 --2- 172.21.15.133:0/4224238772 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7cb80553b0 0x7f7cb8057870 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0x7f7cd000b000 tx=0x7f7cd00091a0).stop 2021-01-03T12:58:00.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.495+0000 7f7ce4d0d700 1 --2- 172.21.15.133:0/4224238772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ce01442a0 0x7f7ce0063b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:00.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.495+0000 7f7ce4d0d700 1 --2- 172.21.15.133:0/4224238772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ce00b5260 0x7f7ce0155de0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0x7f7cc8001930 tx=0x7f7cc8001280).stop 2021-01-03T12:58:00.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.495+0000 7f7ce4d0d700 1 --2- 172.21.15.133:0/4224238772 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ce00b5c00 0x7f7ce0146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:00.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.495+0000 7f7ce4d0d700 1 -- 172.21.15.133:0/4224238772 >> 172.21.15.133:0/4224238772 conn(0x7f7ce005bdf0 msgr2=0x7f7ce00b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:00.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.495+0000 7f7ce4d0d700 1 -- 172.21.15.133:0/4224238772 shutdown_connections 2021-01-03T12:58:00.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.495+0000 7f7ce4d0d700 1 -- 172.21.15.133:0/4224238772 wait complete. 2021-01-03T12:58:00.498 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2021-01-03T12:58:00.513 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-01-03T12:58:00.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.619+0000 7f15421e4700 1 Processor -- start 2021-01-03T12:58:00.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.619+0000 7f15421e4700 1 -- start start 2021-01-03T12:58:00.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.619+0000 7f15421e4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f153c140410 0x7f153c146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:00.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.619+0000 7f15421e4700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f153c0b0470 0x7f153c05bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:00.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.619+0000 7f15421e4700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153c05cf20 con 0x7f153c1407f0 2021-01-03T12:58:00.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.619+0000 7f15421e4700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f153c0b02d0 con 0x7f153c0b0470 2021-01-03T12:58:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.619+0000 7f15421e4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f153c146390 con 0x7f153c140410 2021-01-03T12:58:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.619+0000 7f153b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f153c140410 0x7f153c146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.619+0000 7f153b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f153c140410 0x7f153c146cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59752/0 (socket says 172.21.15.133:59752) 2021-01-03T12:58:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.619+0000 7f153bfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f153c0b0470 0x7f153c05bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.619+0000 7f153b7fe700 1 -- 172.21.15.133:0/3890786889 learned_addr learned my addr 172.21.15.133:0/3890786889 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:00.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.619+0000 7f153b7fe700 1 -- 172.21.15.133:0/3890786889 >> v2:172.21.15.16:3300/0 conn(0x7f153c0b0470 msgr2=0x7f153c05bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:00.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.619+0000 7f153b7fe700 1 --2- 172.21.15.133:0/3890786889 >> v2:172.21.15.16:3300/0 conn(0x7f153c0b0470 0x7f153c05bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:00.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.619+0000 7f153b7fe700 1 -- 172.21.15.133:0/3890786889 >> v1:172.21.15.16:6789/0 conn(0x7f153c1407f0 legacy=0x7f153c142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:00.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.619+0000 7f153b7fe700 1 -- 172.21.15.133:0/3890786889 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c146580 con 0x7f153c140410 2021-01-03T12:58:00.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.619+0000 7f153b7fe700 1 --2- 172.21.15.133:0/3890786889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f153c140410 0x7f153c146cc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f1530002f30 tx=0x7f1530006e80).ready entity=mon.1 client_cookie=b72650820c4894a2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:00.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.623+0000 7f153a7fc700 1 -- 172.21.15.133:0/3890786889 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15300097f0 con 0x7f153c140410 2021-01-03T12:58:00.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.623+0000 7f153a7fc700 1 -- 172.21.15.133:0/3890786889 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1530009950 con 0x7f153c140410 2021-01-03T12:58:00.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.623+0000 7f153a7fc700 1 -- 172.21.15.133:0/3890786889 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1530009cb0 con 0x7f153c140410 2021-01-03T12:58:00.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.623+0000 7f15421e4700 1 -- 172.21.15.133:0/3890786889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f153c140410 msgr2=0x7f153c146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:00.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.623+0000 7f15421e4700 1 --2- 172.21.15.133:0/3890786889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f153c140410 0x7f153c146cc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f1530002f30 tx=0x7f1530006e80).stop 2021-01-03T12:58:00.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.623+0000 7f15421e4700 1 -- 172.21.15.133:0/3890786889 shutdown_connections 2021-01-03T12:58:00.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.623+0000 7f15421e4700 1 --2- 172.21.15.133:0/3890786889 >> v2:172.21.15.16:3300/0 conn(0x7f153c0b0470 0x7f153c05bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:00.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.623+0000 7f15421e4700 1 --2- 172.21.15.133:0/3890786889 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f153c140410 0x7f153c146cc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:00.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.623+0000 7f15421e4700 1 -- 172.21.15.133:0/3890786889 >> 172.21.15.133:0/3890786889 conn(0x7f153c0b95d0 msgr2=0x7f153c0b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:00.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.623+0000 7f15421e4700 1 -- 172.21.15.133:0/3890786889 shutdown_connections 2021-01-03T12:58:00.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.623+0000 7f15421e4700 1 -- 172.21.15.133:0/3890786889 wait complete. 2021-01-03T12:58:00.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.623+0000 7f15421e4700 1 Processor -- start 2021-01-03T12:58:00.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.623+0000 7f15421e4700 1 -- start start 2021-01-03T12:58:00.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f15421e4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f153c0b0470 0x7f153c09f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:00.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f15421e4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f153c140410 0x7f153c09c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:00.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f15421e4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f153c1407f0 0x7f153c142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:00.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f15421e4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c141ab0 con 0x7f153c1407f0 2021-01-03T12:58:00.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f15421e4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153c152bd0 con 0x7f153c0b0470 2021-01-03T12:58:00.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f15421e4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153c141ce0 con 0x7f153c140410 2021-01-03T12:58:00.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f153b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f153c0b0470 0x7f153c09f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:00.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f153b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f153c0b0470 0x7f153c09f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59758/0 (socket says 172.21.15.133:59758) 2021-01-03T12:58:00.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f153b7fe700 1 -- 172.21.15.133:0/1118787772 learned_addr learned my addr 172.21.15.133:0/1118787772 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:00.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f153affd700 1 --2- 172.21.15.133:0/1118787772 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f153c140410 0x7f153c09c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:00.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f153bfff700 1 --2- 172.21.15.133:0/1118787772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f153c1407f0 0x7f153c142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:00.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f153b7fe700 1 -- 172.21.15.133:0/1118787772 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f153c140410 msgr2=0x7f153c09c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:00.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f153b7fe700 1 --2- 172.21.15.133:0/1118787772 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f153c140410 0x7f153c09c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:00.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f153b7fe700 1 -- 172.21.15.133:0/1118787772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f153c1407f0 msgr2=0x7f153c142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:00.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f153b7fe700 1 --2- 172.21.15.133:0/1118787772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f153c1407f0 0x7f153c142420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:00.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f153b7fe700 1 -- 172.21.15.133:0/1118787772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c141f80 con 0x7f153c0b0470 2021-01-03T12:58:00.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f153b7fe700 1 --2- 172.21.15.133:0/1118787772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f153c0b0470 0x7f153c09f200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1530002f30 tx=0x7f1530015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:00.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f1538ff9700 1 -- 172.21.15.133:0/1118787772 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1530011b80 con 0x7f153c0b0470 2021-01-03T12:58:00.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f1538ff9700 1 -- 172.21.15.133:0/1118787772 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1530011ce0 con 0x7f153c0b0470 2021-01-03T12:58:00.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f15421e4700 1 -- 172.21.15.133:0/1118787772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153c152810 con 0x7f153c0b0470 2021-01-03T12:58:00.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f1538ff9700 1 -- 172.21.15.133:0/1118787772 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f153001e650 con 0x7f153c0b0470 2021-01-03T12:58:00.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.627+0000 7f15421e4700 1 -- 172.21.15.133:0/1118787772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153c142910 con 0x7f153c0b0470 2021-01-03T12:58:00.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.631+0000 7f15421e4700 1 -- 172.21.15.133:0/1118787772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153c142110 con 0x7f153c0b0470 2021-01-03T12:58:00.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.631+0000 7f1538ff9700 1 -- 172.21.15.133:0/1118787772 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1530025030 con 0x7f153c0b0470 2021-01-03T12:58:00.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.631+0000 7f1538ff9700 1 --2- 172.21.15.133:0/1118787772 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f151c055330 0x7f151c0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:00.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.631+0000 7f1538ff9700 1 -- 172.21.15.133:0/1118787772 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f153006f170 con 0x7f153c0b0470 2021-01-03T12:58:00.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.631+0000 7f153affd700 1 --2- 172.21.15.133:0/1118787772 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f151c055330 0x7f151c0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:00.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.631+0000 7f153affd700 1 --2- 172.21.15.133:0/1118787772 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f151c055330 0x7f151c0577f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f152c00d000 tx=0x7f152c007b60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:00.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.635+0000 7f1538ff9700 1 -- 172.21.15.133:0/1118787772 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f15300454e0 con 0x7f153c0b0470 2021-01-03T12:58:00.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.819+0000 7f15421e4700 1 -- 172.21.15.133:0/1118787772 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f153c057300 con 0x7f153c0b0470 2021-01-03T12:58:00.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.835+0000 7f1538ff9700 1 -- 172.21.15.133:0/1118787772 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 187+0+0 (secure 0 0 0) 0x7f1530023020 con 0x7f153c0b0470 2021-01-03T12:58:00.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.839+0000 7f15421e4700 1 -- 172.21.15.133:0/1118787772 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f151c055330 msgr2=0x7f151c0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:00.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.839+0000 7f15421e4700 1 --2- 172.21.15.133:0/1118787772 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f151c055330 0x7f151c0577f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f152c00d000 tx=0x7f152c007b60).stop 2021-01-03T12:58:00.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.839+0000 7f15421e4700 1 -- 172.21.15.133:0/1118787772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f153c0b0470 msgr2=0x7f153c09f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:00.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.839+0000 7f15421e4700 1 --2- 172.21.15.133:0/1118787772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f153c0b0470 0x7f153c09f200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1530002f30 tx=0x7f1530015000).stop 2021-01-03T12:58:00.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.839+0000 7f15421e4700 1 -- 172.21.15.133:0/1118787772 shutdown_connections 2021-01-03T12:58:00.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.839+0000 7f15421e4700 1 --2- 172.21.15.133:0/1118787772 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f151c055330 0x7f151c0577f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:00.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.839+0000 7f15421e4700 1 --2- 172.21.15.133:0/1118787772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f153c1407f0 0x7f153c142420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:00.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.839+0000 7f15421e4700 1 --2- 172.21.15.133:0/1118787772 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f153c0b0470 0x7f153c09f200 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:00.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.839+0000 7f15421e4700 1 --2- 172.21.15.133:0/1118787772 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f153c140410 0x7f153c09c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:00.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.839+0000 7f15421e4700 1 -- 172.21.15.133:0/1118787772 >> 172.21.15.133:0/1118787772 conn(0x7f153c0b95d0 msgr2=0x7f153c145180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:00.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.839+0000 7f15421e4700 1 -- 172.21.15.133:0/1118787772 shutdown_connections 2021-01-03T12:58:00.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.839+0000 7f15421e4700 1 -- 172.21.15.133:0/1118787772 wait complete. 2021-01-03T12:58:00.845 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 3 and data pool 4 2021-01-03T12:58:00.860 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:00.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.955+0000 7f15cf59e700 1 Processor -- start 2021-01-03T12:58:00.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.955+0000 7f15cf59e700 1 -- start start 2021-01-03T12:58:00.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.955+0000 7f15cf59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f15d00b9f40 0x7f15d0146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:00.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.955+0000 7f15cf59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15d0146920 0x7f15d014d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:00.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.955+0000 7f15cf59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d00605f0 con 0x7f15d00b9b60 2021-01-03T12:58:00.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.955+0000 7f15cf59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d00aed30 con 0x7f15d00b9f40 2021-01-03T12:58:00.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.955+0000 7f15cf59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00600b0 con 0x7f15d0146920 2021-01-03T12:58:00.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.955+0000 7f15cdd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f15d00b9f40 0x7f15d0146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:00.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.955+0000 7f15cdd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f15d00b9f40 0x7f15d0146430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59776/0 (socket says 172.21.15.133:59776) 2021-01-03T12:58:00.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.955+0000 7f15cdd9b700 1 -- 172.21.15.133:0/1466757560 learned_addr learned my addr 172.21.15.133:0/1466757560 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:00.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.955+0000 7f15ced9d700 1 --2- 172.21.15.133:0/1466757560 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15d0146920 0x7f15d014d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:00.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.955+0000 7f15cdd9b700 1 -- 172.21.15.133:0/1466757560 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15d0146920 msgr2=0x7f15d014d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:00.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.955+0000 7f15cdd9b700 1 --2- 172.21.15.133:0/1466757560 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15d0146920 0x7f15d014d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:00.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.955+0000 7f15cdd9b700 1 -- 172.21.15.133:0/1466757560 >> v1:172.21.15.133:6789/0 conn(0x7f15d00b9b60 legacy=0x7f15d00b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:00.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.955+0000 7f15cdd9b700 1 -- 172.21.15.133:0/1466757560 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d0060350 con 0x7f15d00b9f40 2021-01-03T12:58:00.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.955+0000 7f15ced9d700 1 --2- 172.21.15.133:0/1466757560 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15d0146920 0x7f15d014d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:00.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.955+0000 7f15cdd9b700 1 --2- 172.21.15.133:0/1466757560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15d00b9f40 0x7f15d0146430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f15c0002f30 tx=0x7f15c0006e80).ready entity=mon.1 client_cookie=43e40a1fd11a57d7 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:00.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cd59a700 1 -- 172.21.15.133:0/1466757560 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15c00097f0 con 0x7f15d00b9f40 2021-01-03T12:58:00.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cd59a700 1 -- 172.21.15.133:0/1466757560 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c0009950 con 0x7f15d00b9f40 2021-01-03T12:58:00.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cd59a700 1 -- 172.21.15.133:0/1466757560 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15c0009cb0 con 0x7f15d00b9f40 2021-01-03T12:58:00.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cf59e700 1 -- 172.21.15.133:0/1466757560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15d00b9f40 msgr2=0x7f15d0146430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:00.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cf59e700 1 --2- 172.21.15.133:0/1466757560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15d00b9f40 0x7f15d0146430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f15c0002f30 tx=0x7f15c0006e80).stop 2021-01-03T12:58:00.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cf59e700 1 -- 172.21.15.133:0/1466757560 shutdown_connections 2021-01-03T12:58:00.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cf59e700 1 --2- 172.21.15.133:0/1466757560 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15d0146920 0x7f15d014d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:00.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cf59e700 1 --2- 172.21.15.133:0/1466757560 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15d00b9f40 0x7f15d0146430 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:00.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cf59e700 1 -- 172.21.15.133:0/1466757560 >> 172.21.15.133:0/1466757560 conn(0x7f15d00b69e0 msgr2=0x7f15d00b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:00.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cf59e700 1 -- 172.21.15.133:0/1466757560 shutdown_connections 2021-01-03T12:58:00.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cf59e700 1 -- 172.21.15.133:0/1466757560 wait complete. 2021-01-03T12:58:00.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cf59e700 1 Processor -- start 2021-01-03T12:58:00.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cf59e700 1 -- start start 2021-01-03T12:58:00.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cf59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15d00b9b60 0x7f15d0148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:00.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cf59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15d00b9f40 0x7f15d0155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:00.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cf59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15d0146920 0x7f15d0155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:00.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cf59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d0140a30 con 0x7f15d0146920 2021-01-03T12:58:00.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cf59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d0154ee0 con 0x7f15d00b9f40 2021-01-03T12:58:00.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cf59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d0140c20 con 0x7f15d00b9b60 2021-01-03T12:58:00.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cdd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15d00b9f40 0x7f15d0155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:00.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cdd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15d00b9f40 0x7f15d0155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59782/0 (socket says 172.21.15.133:59782) 2021-01-03T12:58:00.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15cdd9b700 1 -- 172.21.15.133:0/4009226710 learned_addr learned my addr 172.21.15.133:0/4009226710 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:00.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15ce59c700 1 --2- 172.21.15.133:0/4009226710 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15d00b9b60 0x7f15d0148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:00.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.959+0000 7f15ced9d700 1 --2- 172.21.15.133:0/4009226710 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15d0146920 0x7f15d0155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:00.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.963+0000 7f15cdd9b700 1 -- 172.21.15.133:0/4009226710 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15d00b9b60 msgr2=0x7f15d0148530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:00.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.963+0000 7f15cdd9b700 1 --2- 172.21.15.133:0/4009226710 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15d00b9b60 0x7f15d0148530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:00.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.963+0000 7f15cdd9b700 1 -- 172.21.15.133:0/4009226710 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15d0146920 msgr2=0x7f15d0155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:00.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.963+0000 7f15cdd9b700 1 --2- 172.21.15.133:0/4009226710 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15d0146920 0x7f15d0155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:00.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.963+0000 7f15cdd9b700 1 -- 172.21.15.133:0/4009226710 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d0140ec0 con 0x7f15d00b9f40 2021-01-03T12:58:00.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.963+0000 7f15cdd9b700 1 --2- 172.21.15.133:0/4009226710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15d00b9f40 0x7f15d0155340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f15c0002f30 tx=0x7f15c0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:00.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.963+0000 7f15c77fe700 1 -- 172.21.15.133:0/4009226710 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15c0011c10 con 0x7f15d00b9f40 2021-01-03T12:58:00.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.963+0000 7f15c77fe700 1 -- 172.21.15.133:0/4009226710 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c0011d70 con 0x7f15d00b9f40 2021-01-03T12:58:00.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.963+0000 7f15cf59e700 1 -- 172.21.15.133:0/4009226710 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d00b1210 con 0x7f15d00b9f40 2021-01-03T12:58:00.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.963+0000 7f15c77fe700 1 -- 172.21.15.133:0/4009226710 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15c001e650 con 0x7f15d00b9f40 2021-01-03T12:58:00.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.963+0000 7f15cf59e700 1 -- 172.21.15.133:0/4009226710 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d00b9790 con 0x7f15d00b9f40 2021-01-03T12:58:00.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.963+0000 7f15cf59e700 1 -- 172.21.15.133:0/4009226710 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d0141050 con 0x7f15d00b9f40 2021-01-03T12:58:00.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.963+0000 7f15c77fe700 1 -- 172.21.15.133:0/4009226710 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f15c001a040 con 0x7f15d00b9f40 2021-01-03T12:58:00.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.963+0000 7f15c77fe700 1 --2- 172.21.15.133:0/4009226710 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f15b4055330 0x7f15b40577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:00.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.963+0000 7f15c77fe700 1 -- 172.21.15.133:0/4009226710 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f15c006f0a0 con 0x7f15d00b9f40 2021-01-03T12:58:00.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.963+0000 7f15ce59c700 1 --2- 172.21.15.133:0/4009226710 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f15b4055330 0x7f15b40577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:00.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.963+0000 7f15ce59c700 1 --2- 172.21.15.133:0/4009226710 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f15b4055330 0x7f15b40577f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f15b800d000 tx=0x7f15b8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:00.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:00.971+0000 7f15c77fe700 1 -- 172.21.15.133:0/4009226710 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f15d0141050 con 0x7f15d00b9f40 2021-01-03T12:58:01.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.111+0000 7f15cf59e700 1 -- 172.21.15.133:0/4009226710 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15d0141050 con 0x7f15d00b9f40 2021-01-03T12:58:01.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.111+0000 7f15c77fe700 1 -- 172.21.15.133:0/4009226710 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16099 (secure 0 0 0) 0x7f15d0141050 con 0x7f15d00b9f40 2021-01-03T12:58:01.114 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:01.114 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:00.825443+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:57:58.934952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-03T12:57:59.830134+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:01.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.115+0000 7f15cf59e700 1 -- 172.21.15.133:0/4009226710 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f15b4055330 msgr2=0x7f15b40577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.115+0000 7f15cf59e700 1 --2- 172.21.15.133:0/4009226710 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f15b4055330 0x7f15b40577f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f15b800d000 tx=0x7f15b8009040).stop 2021-01-03T12:58:01.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.115+0000 7f15cf59e700 1 -- 172.21.15.133:0/4009226710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15d00b9f40 msgr2=0x7f15d0155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.115+0000 7f15cf59e700 1 --2- 172.21.15.133:0/4009226710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15d00b9f40 0x7f15d0155340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f15c0002f30 tx=0x7f15c0015000).stop 2021-01-03T12:58:01.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.115+0000 7f15cf59e700 1 -- 172.21.15.133:0/4009226710 shutdown_connections 2021-01-03T12:58:01.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.115+0000 7f15cf59e700 1 --2- 172.21.15.133:0/4009226710 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f15b4055330 0x7f15b40577f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.115+0000 7f15cf59e700 1 --2- 172.21.15.133:0/4009226710 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15d0146920 0x7f15d0155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.115+0000 7f15cf59e700 1 --2- 172.21.15.133:0/4009226710 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15d00b9b60 0x7f15d0148530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.115+0000 7f15cf59e700 1 --2- 172.21.15.133:0/4009226710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15d00b9f40 0x7f15d0155340 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.115+0000 7f15cf59e700 1 -- 172.21.15.133:0/4009226710 >> 172.21.15.133:0/4009226710 conn(0x7f15d00b69e0 msgr2=0x7f15d00af460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:01.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.115+0000 7f15cf59e700 1 -- 172.21.15.133:0/4009226710 shutdown_connections 2021-01-03T12:58:01.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.115+0000 7f15cf59e700 1 -- 172.21.15.133:0/4009226710 wait complete. 2021-01-03T12:58:01.127 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:01.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.235+0000 7ff8f2168700 1 Processor -- start 2021-01-03T12:58:01.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.235+0000 7ff8f2168700 1 -- start start 2021-01-03T12:58:01.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.235+0000 7ff8f2168700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8ec060510 0x7ff8ec05c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:01.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.235+0000 7ff8f2168700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8ec05fd10 0x7ff8ec0b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:01.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.235+0000 7ff8f2168700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ec05bf00 con 0x7ff8ec0b4c20 2021-01-03T12:58:01.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.235+0000 7ff8f2168700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ec05c1a0 con 0x7ff8ec060510 2021-01-03T12:58:01.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.235+0000 7ff8f2168700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec05c440 con 0x7ff8ec05fd10 2021-01-03T12:58:01.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.235+0000 7ff8f1967700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8ec05fd10 0x7ff8ec0b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:01.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.235+0000 7ff8f0965700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8ec060510 0x7ff8ec05c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:01.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.235+0000 7ff8f1166700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff8ec0b4c20 0x7ff8ec0b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:59550/0 (socket says 172.21.15.133:59550) 2021-01-03T12:58:01.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.235+0000 7ff8f1967700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8ec05fd10 0x7ff8ec0b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:39862/0 (socket says 172.21.15.133:39862) 2021-01-03T12:58:01.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.235+0000 7ff8f1166700 1 -- 172.21.15.133:0/1532189448 learned_addr learned my addr 172.21.15.133:0/1532189448 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:01.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.235+0000 7ff8f1967700 1 -- 172.21.15.133:0/1532189448 >> v2:172.21.15.16:3300/0 conn(0x7ff8ec060510 msgr2=0x7ff8ec05c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:01.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.235+0000 7ff8f1967700 1 --2- 172.21.15.133:0/1532189448 >> v2:172.21.15.16:3300/0 conn(0x7ff8ec060510 0x7ff8ec05c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.235+0000 7ff8f1967700 1 -- 172.21.15.133:0/1532189448 >> v1:172.21.15.16:6789/0 conn(0x7ff8ec0b4c20 legacy=0x7ff8ec0b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.235+0000 7ff8f1967700 1 -- 172.21.15.133:0/1532189448 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec0b6ad0 con 0x7ff8ec05fd10 2021-01-03T12:58:01.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.235+0000 7ff8f0965700 1 --2- 172.21.15.133:0/1532189448 >> v2:172.21.15.16:3300/0 conn(0x7ff8ec060510 0x7ff8ec05c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:01.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f1967700 1 --2- 172.21.15.133:0/1532189448 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8ec05fd10 0x7ff8ec0b65e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff8e4002f30 tx=0x7ff8e4006dc0).ready entity=mon.2 client_cookie=44897a77a969d9f1 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:01.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8ebfff700 1 -- 172.21.15.133:0/1532189448 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e4009760 con 0x7ff8ec05fd10 2021-01-03T12:58:01.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8ebfff700 1 -- 172.21.15.133:0/1532189448 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e40098c0 con 0x7ff8ec05fd10 2021-01-03T12:58:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8ebfff700 1 -- 172.21.15.133:0/1532189448 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e4009c20 con 0x7ff8ec05fd10 2021-01-03T12:58:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f2168700 1 -- 172.21.15.133:0/1532189448 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8ec05fd10 msgr2=0x7ff8ec0b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f2168700 1 --2- 172.21.15.133:0/1532189448 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8ec05fd10 0x7ff8ec0b65e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ff8e4002f30 tx=0x7ff8e4006dc0).stop 2021-01-03T12:58:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f2168700 1 -- 172.21.15.133:0/1532189448 shutdown_connections 2021-01-03T12:58:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f2168700 1 --2- 172.21.15.133:0/1532189448 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8ec05fd10 0x7ff8ec0b65e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f2168700 1 --2- 172.21.15.133:0/1532189448 >> v2:172.21.15.16:3300/0 conn(0x7ff8ec060510 0x7ff8ec05c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f2168700 1 -- 172.21.15.133:0/1532189448 >> 172.21.15.133:0/1532189448 conn(0x7ff8ec0b9f00 msgr2=0x7ff8ec0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:01.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f2168700 1 -- 172.21.15.133:0/1532189448 shutdown_connections 2021-01-03T12:58:01.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f2168700 1 -- 172.21.15.133:0/1532189448 wait complete. 2021-01-03T12:58:01.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f2168700 1 Processor -- start 2021-01-03T12:58:01.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f2168700 1 -- start start 2021-01-03T12:58:01.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f2168700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8ec05fd10 0x7ff8ec09e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:01.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f2168700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ec060510 0x7ff8ec1488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:01.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f2168700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8ec0b4c20 0x7ff8ec155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:01.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f2168700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec151b40 con 0x7ff8ec05fd10 2021-01-03T12:58:01.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f2168700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec149a40 con 0x7ff8ec060510 2021-01-03T12:58:01.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f2168700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec149ce0 con 0x7ff8ec0b4c20 2021-01-03T12:58:01.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f0965700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ec060510 0x7ff8ec1488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:01.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.239+0000 7ff8f1166700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8ec05fd10 0x7ff8ec09e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:01.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8f0965700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ec060510 0x7ff8ec1488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59800/0 (socket says 172.21.15.133:59800) 2021-01-03T12:58:01.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8f1166700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8ec05fd10 0x7ff8ec09e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:58336/0 (socket says 172.21.15.133:58336) 2021-01-03T12:58:01.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8f1967700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8ec0b4c20 0x7ff8ec155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:01.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8f0965700 1 -- 172.21.15.133:0/18596059 learned_addr learned my addr 172.21.15.133:0/18596059 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:01.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8f1166700 1 -- 172.21.15.133:0/18596059 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8ec0b4c20 msgr2=0x7ff8ec155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8f1166700 1 --2- 172.21.15.133:0/18596059 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8ec0b4c20 0x7ff8ec155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8f1166700 1 -- 172.21.15.133:0/18596059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ec060510 msgr2=0x7ff8ec1488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8f1166700 1 --2- 172.21.15.133:0/18596059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ec060510 0x7ff8ec1488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8f1166700 1 -- 172.21.15.133:0/18596059 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec149f80 con 0x7ff8ec05fd10 2021-01-03T12:58:01.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8f1967700 1 --2- 172.21.15.133:0/18596059 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8ec0b4c20 0x7ff8ec155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:01.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8f0965700 1 --2- 172.21.15.133:0/18596059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ec060510 0x7ff8ec1488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:01.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8f1166700 1 --2- 172.21.15.133:0/18596059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8ec05fd10 0x7ff8ec09e6f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff8ec061cb0 tx=0x7ff8e0007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:01.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8ea7fc700 1 -- 172.21.15.133:0/18596059 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e000ce40 con 0x7ff8ec05fd10 2021-01-03T12:58:01.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8ea7fc700 1 -- 172.21.15.133:0/18596059 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e00072e0 con 0x7ff8ec05fd10 2021-01-03T12:58:01.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8f2168700 1 -- 172.21.15.133:0/18596059 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ec143740 con 0x7ff8ec05fd10 2021-01-03T12:58:01.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8ea7fc700 1 -- 172.21.15.133:0/18596059 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8e00057d0 con 0x7ff8ec05fd10 2021-01-03T12:58:01.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8f2168700 1 -- 172.21.15.133:0/18596059 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ec148f70 con 0x7ff8ec05fd10 2021-01-03T12:58:01.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.243+0000 7ff8f2168700 1 -- 172.21.15.133:0/18596059 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ec057300 con 0x7ff8ec05fd10 2021-01-03T12:58:01.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.247+0000 7ff8ea7fc700 1 -- 172.21.15.133:0/18596059 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff8e001a060 con 0x7ff8ec05fd10 2021-01-03T12:58:01.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.247+0000 7ff8ea7fc700 1 --2- 172.21.15.133:0/18596059 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff8cc0554e0 0x7ff8cc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:01.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.247+0000 7ff8ea7fc700 1 -- 172.21.15.133:0/18596059 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff8e006d890 con 0x7ff8ec05fd10 2021-01-03T12:58:01.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.247+0000 7ff8f0965700 1 --2- 172.21.15.133:0/18596059 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff8cc0554e0 0x7ff8cc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:01.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.247+0000 7ff8f0965700 1 --2- 172.21.15.133:0/18596059 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff8cc0554e0 0x7ff8cc0579a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff8dc00b000 tx=0x7ff8dc0091a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:01.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.255+0000 7ff8ea7fc700 1 -- 172.21.15.133:0/18596059 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff8e0043a80 con 0x7ff8ec05fd10 2021-01-03T12:58:01.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.395+0000 7ff8f2168700 1 -- 172.21.15.133:0/18596059 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8ec067a00 con 0x7ff8ec05fd10 2021-01-03T12:58:01.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.395+0000 7ff8ea7fc700 1 -- 172.21.15.133:0/18596059 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16099 (secure 0 0 0) 0x7ff8e0018070 con 0x7ff8ec05fd10 2021-01-03T12:58:01.397 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:01.398 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:00.825443+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:57:58.934952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-03T12:57:59.830134+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:01.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.399+0000 7ff8f2168700 1 -- 172.21.15.133:0/18596059 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff8cc0554e0 msgr2=0x7ff8cc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.399+0000 7ff8f2168700 1 --2- 172.21.15.133:0/18596059 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff8cc0554e0 0x7ff8cc0579a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7ff8dc00b000 tx=0x7ff8dc0091a0).stop 2021-01-03T12:58:01.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.399+0000 7ff8f2168700 1 -- 172.21.15.133:0/18596059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8ec05fd10 msgr2=0x7ff8ec09e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.399+0000 7ff8f2168700 1 --2- 172.21.15.133:0/18596059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8ec05fd10 0x7ff8ec09e6f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff8ec061cb0 tx=0x7ff8e0007bb0).stop 2021-01-03T12:58:01.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.399+0000 7ff8f2168700 1 -- 172.21.15.133:0/18596059 shutdown_connections 2021-01-03T12:58:01.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.399+0000 7ff8f2168700 1 --2- 172.21.15.133:0/18596059 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff8cc0554e0 0x7ff8cc0579a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.399+0000 7ff8f2168700 1 --2- 172.21.15.133:0/18596059 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8ec05fd10 0x7ff8ec09e6f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.399+0000 7ff8f2168700 1 --2- 172.21.15.133:0/18596059 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8ec0b4c20 0x7ff8ec155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.399+0000 7ff8f2168700 1 --2- 172.21.15.133:0/18596059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ec060510 0x7ff8ec1488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.399+0000 7ff8f2168700 1 -- 172.21.15.133:0/18596059 >> 172.21.15.133:0/18596059 conn(0x7ff8ec0b9f00 msgr2=0x7ff8ec0b7030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:01.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.399+0000 7ff8f2168700 1 -- 172.21.15.133:0/18596059 shutdown_connections 2021-01-03T12:58:01.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.399+0000 7ff8f2168700 1 -- 172.21.15.133:0/18596059 wait complete. 2021-01-03T12:58:01.411 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-01-03T12:58:01.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.527+0000 7fe7809a5700 1 Processor -- start 2021-01-03T12:58:01.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.527+0000 7fe7809a5700 1 -- start start 2021-01-03T12:58:01.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.527+0000 7fe7809a5700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe77c0b2e90 0x7fe77c13fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:01.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.527+0000 7fe7809a5700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c0ae800 0x7fe77c13cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:01.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.527+0000 7fe7809a5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe77c0af220 con 0x7fe77c0b0ac0 2021-01-03T12:58:01.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.527+0000 7fe7809a5700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77c1401c0 con 0x7fe77c0b2e90 2021-01-03T12:58:01.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.527+0000 7fe7809a5700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c144200 con 0x7fe77c0ae800 2021-01-03T12:58:01.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.527+0000 7fe77a59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe77c0b0ac0 0x7fe77c143af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52604/0 (socket says 172.21.15.133:52604) 2021-01-03T12:58:01.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.527+0000 7fe77a59c700 1 -- 172.21.15.133:0/821050341 learned_addr learned my addr 172.21.15.133:0/821050341 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:01.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.527+0000 7fe77b59e700 1 --2- 172.21.15.133:0/821050341 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c0ae800 0x7fe77c13cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:01.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe77ad9d700 1 --2- 172.21.15.133:0/821050341 >> v2:172.21.15.16:3300/0 conn(0x7fe77c0b2e90 0x7fe77c13fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:01.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe779d9b700 1 -- 172.21.15.133:0/821050341 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623799134 0 0) 0x7fe77c0af220 con 0x7fe77c0b0ac0 2021-01-03T12:58:01.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe779d9b700 1 -- 172.21.15.133:0/821050341 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe760003230 con 0x7fe77c0b0ac0 2021-01-03T12:58:01.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe77b59e700 1 -- 172.21.15.133:0/821050341 >> v2:172.21.15.16:3300/0 conn(0x7fe77c0b2e90 msgr2=0x7fe77c13fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:01.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe77b59e700 1 --2- 172.21.15.133:0/821050341 >> v2:172.21.15.16:3300/0 conn(0x7fe77c0b2e90 0x7fe77c13fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe779d9b700 1 -- 172.21.15.133:0/821050341 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1874244037 0 0) 0x7fe760003230 con 0x7fe77c0b0ac0 2021-01-03T12:58:01.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe77b59e700 1 -- 172.21.15.133:0/821050341 >> v1:172.21.15.133:6789/0 conn(0x7fe77c0b0ac0 legacy=0x7fe77c143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe77b59e700 1 -- 172.21.15.133:0/821050341 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c0b3270 con 0x7fe77c0ae800 2021-01-03T12:58:01.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe77b59e700 1 --2- 172.21.15.133:0/821050341 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c0ae800 0x7fe77c13cf60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe764001870 tx=0x7fe774006dc0).ready entity=mon.2 client_cookie=a6ec45c8a8047dde server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:01.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe779d9b700 1 -- 172.21.15.133:0/821050341 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7640016d0 con 0x7fe77c0ae800 2021-01-03T12:58:01.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe779d9b700 1 -- 172.21.15.133:0/821050341 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77400d570 con 0x7fe77c0ae800 2021-01-03T12:58:01.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe779d9b700 1 -- 172.21.15.133:0/821050341 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe77400d6e0 con 0x7fe77c0ae800 2021-01-03T12:58:01.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe7809a5700 1 -- 172.21.15.133:0/821050341 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c0ae800 msgr2=0x7fe77c13cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe7809a5700 1 --2- 172.21.15.133:0/821050341 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c0ae800 0x7fe77c13cf60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe764001870 tx=0x7fe774006dc0).stop 2021-01-03T12:58:01.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe7809a5700 1 -- 172.21.15.133:0/821050341 shutdown_connections 2021-01-03T12:58:01.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe7809a5700 1 --2- 172.21.15.133:0/821050341 >> v2:172.21.15.16:3300/0 conn(0x7fe77c0b2e90 0x7fe77c13fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe7809a5700 1 --2- 172.21.15.133:0/821050341 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c0ae800 0x7fe77c13cf60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe7809a5700 1 -- 172.21.15.133:0/821050341 >> 172.21.15.133:0/821050341 conn(0x7fe77c06a620 msgr2=0x7fe77c06aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:01.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe7809a5700 1 -- 172.21.15.133:0/821050341 shutdown_connections 2021-01-03T12:58:01.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe7809a5700 1 -- 172.21.15.133:0/821050341 wait complete. 2021-01-03T12:58:01.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe7809a5700 1 Processor -- start 2021-01-03T12:58:01.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.531+0000 7fe7809a5700 1 -- start start 2021-01-03T12:58:01.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe7809a5700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c0ae800 0x7fe77c1534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:01.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe7809a5700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c0b0ac0 0x7fe77c136fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:01.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe7809a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe77c0b2e90 0x7fe77c1355d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:01.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe7809a5700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c134e40 con 0x7fe77c0b0ac0 2021-01-03T12:58:01.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe7809a5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c065b20 con 0x7fe77c0b2e90 2021-01-03T12:58:01.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe7809a5700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c1374b0 con 0x7fe77c0ae800 2021-01-03T12:58:01.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe77b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe77c0b2e90 0x7fe77c1355d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:01.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe77b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe77c0b2e90 0x7fe77c1355d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59814/0 (socket says 172.21.15.133:59814) 2021-01-03T12:58:01.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe77b59e700 1 -- 172.21.15.133:0/1345994894 learned_addr learned my addr 172.21.15.133:0/1345994894 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:01.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe77ad9d700 1 --2- 172.21.15.133:0/1345994894 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c0ae800 0x7fe77c1534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:01.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe77a59c700 1 --2- 172.21.15.133:0/1345994894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c0b0ac0 0x7fe77c136fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:01.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe77b59e700 1 -- 172.21.15.133:0/1345994894 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c0ae800 msgr2=0x7fe77c1534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe77b59e700 1 --2- 172.21.15.133:0/1345994894 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c0ae800 0x7fe77c1534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe77b59e700 1 -- 172.21.15.133:0/1345994894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c0b0ac0 msgr2=0x7fe77c136fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe77b59e700 1 --2- 172.21.15.133:0/1345994894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c0b0ac0 0x7fe77c136fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe77b59e700 1 -- 172.21.15.133:0/1345994894 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c0655e0 con 0x7fe77c0b2e90 2021-01-03T12:58:01.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe77b59e700 1 --2- 172.21.15.133:0/1345994894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe77c0b2e90 0x7fe77c1355d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fe77c143200 tx=0x7fe774015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:01.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe773fff700 1 -- 172.21.15.133:0/1345994894 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe774011860 con 0x7fe77c0b2e90 2021-01-03T12:58:01.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe773fff700 1 -- 172.21.15.133:0/1345994894 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7740119c0 con 0x7fe77c0b2e90 2021-01-03T12:58:01.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe7809a5700 1 -- 172.21.15.133:0/1345994894 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c065880 con 0x7fe77c0b2e90 2021-01-03T12:58:01.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe773fff700 1 -- 172.21.15.133:0/1345994894 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe774011d20 con 0x7fe77c0b2e90 2021-01-03T12:58:01.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe7809a5700 1 -- 172.21.15.133:0/1345994894 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c153e30 con 0x7fe77c0b2e90 2021-01-03T12:58:01.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.535+0000 7fe7809a5700 1 -- 172.21.15.133:0/1345994894 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c0649e0 con 0x7fe77c0b2e90 2021-01-03T12:58:01.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.539+0000 7fe773fff700 1 -- 172.21.15.133:0/1345994894 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe774024030 con 0x7fe77c0b2e90 2021-01-03T12:58:01.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.539+0000 7fe773fff700 1 --2- 172.21.15.133:0/1345994894 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe7540553b0 0x7fe754057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:01.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.539+0000 7fe77ad9d700 1 --2- 172.21.15.133:0/1345994894 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe7540553b0 0x7fe754057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:01.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.539+0000 7fe773fff700 1 -- 172.21.15.133:0/1345994894 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe77406ef70 con 0x7fe77c0b2e90 2021-01-03T12:58:01.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.539+0000 7fe77ad9d700 1 --2- 172.21.15.133:0/1345994894 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe7540553b0 0x7fe754057870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe76c00b000 tx=0x7fe76c0091a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:01.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.547+0000 7fe773fff700 1 -- 172.21.15.133:0/1345994894 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe774045160 con 0x7fe77c0b2e90 2021-01-03T12:58:01.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.731+0000 7fe7809a5700 1 -- 172.21.15.133:0/1345994894 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe77c1539d0 con 0x7fe77c0b2e90 2021-01-03T12:58:01.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.843+0000 7fe773fff700 1 -- 172.21.15.133:0/1345994894 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe774022070 con 0x7fe77c0b2e90 2021-01-03T12:58:01.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.847+0000 7fe7809a5700 1 -- 172.21.15.133:0/1345994894 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe7540553b0 msgr2=0x7fe754057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.847+0000 7fe7809a5700 1 --2- 172.21.15.133:0/1345994894 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe7540553b0 0x7fe754057870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe76c00b000 tx=0x7fe76c0091a0).stop 2021-01-03T12:58:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.847+0000 7fe7809a5700 1 -- 172.21.15.133:0/1345994894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe77c0b2e90 msgr2=0x7fe77c1355d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.847+0000 7fe7809a5700 1 --2- 172.21.15.133:0/1345994894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe77c0b2e90 0x7fe77c1355d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fe77c143200 tx=0x7fe774015000).stop 2021-01-03T12:58:01.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.847+0000 7fe7809a5700 1 -- 172.21.15.133:0/1345994894 shutdown_connections 2021-01-03T12:58:01.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.847+0000 7fe7809a5700 1 --2- 172.21.15.133:0/1345994894 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe7540553b0 0x7fe754057870 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.847+0000 7fe7809a5700 1 --2- 172.21.15.133:0/1345994894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe77c0b2e90 0x7fe77c1355d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.847+0000 7fe7809a5700 1 --2- 172.21.15.133:0/1345994894 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c0ae800 0x7fe77c1534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.847+0000 7fe7809a5700 1 --2- 172.21.15.133:0/1345994894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c0b0ac0 0x7fe77c136fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.847+0000 7fe7809a5700 1 -- 172.21.15.133:0/1345994894 >> 172.21.15.133:0/1345994894 conn(0x7fe77c06a620 msgr2=0x7fe77c0ad490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:01.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.847+0000 7fe7809a5700 1 -- 172.21.15.133:0/1345994894 shutdown_connections 2021-01-03T12:58:01.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.847+0000 7fe7809a5700 1 -- 172.21.15.133:0/1345994894 wait complete. 2021-01-03T12:58:01.861 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T12:58:01.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.967+0000 7f6e58927700 1 Processor -- start 2021-01-03T12:58:01.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.967+0000 7f6e58927700 1 -- start start 2021-01-03T12:58:01.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.967+0000 7f6e58927700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e54146b40 0x7f6e5414e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:01.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.967+0000 7f6e58927700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e540605f0 con 0x7f6e540b9b60 2021-01-03T12:58:01.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.967+0000 7f6e58927700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e54146fd0 con 0x7f6e540b9f40 2021-01-03T12:58:01.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.967+0000 7f6e58927700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e540aed30 con 0x7f6e54146b40 2021-01-03T12:58:01.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.967+0000 7f6e4bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6e540b9f40 0x7f6e54146430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52620/0 (socket says 172.21.15.133:52620) 2021-01-03T12:58:01.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.967+0000 7f6e4bfff700 1 -- 172.21.15.133:0/1555733027 learned_addr learned my addr 172.21.15.133:0/1555733027 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:01.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.967+0000 7f6e5359e700 1 --2- 172.21.15.133:0/1555733027 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e54146b40 0x7f6e5414e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:01.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.967+0000 7f6e5259c700 1 -- 172.21.15.133:0/1555733027 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041963843 0 0) 0x7f6e54146fd0 con 0x7f6e540b9f40 2021-01-03T12:58:01.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.967+0000 7f6e5259c700 1 -- 172.21.15.133:0/1555733027 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e34003230 con 0x7f6e540b9f40 2021-01-03T12:58:01.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e5359e700 1 -- 172.21.15.133:0/1555733027 >> v1:172.21.15.133:6789/0 conn(0x7f6e540b9f40 legacy=0x7f6e54146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e5259c700 1 -- 172.21.15.133:0/1555733027 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183107315 0 0) 0x7f6e540605f0 con 0x7f6e540b9b60 2021-01-03T12:58:01.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e5359e700 1 -- 172.21.15.133:0/1555733027 >> v1:172.21.15.16:6789/0 conn(0x7f6e540b9b60 legacy=0x7f6e540b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e5359e700 1 -- 172.21.15.133:0/1555733027 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e540600b0 con 0x7f6e54146b40 2021-01-03T12:58:01.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e5359e700 1 --2- 172.21.15.133:0/1555733027 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e54146b40 0x7f6e5414e510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6e4c0032b0 tx=0x7f6e4c0091a0).ready entity=mon.2 client_cookie=31d3e084d323abdb server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:01.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e5259c700 1 -- 172.21.15.133:0/1555733027 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e4c00b9f0 con 0x7f6e54146b40 2021-01-03T12:58:01.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e5259c700 1 -- 172.21.15.133:0/1555733027 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c00bb50 con 0x7f6e54146b40 2021-01-03T12:58:01.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e5259c700 1 -- 172.21.15.133:0/1555733027 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e4c00bcc0 con 0x7f6e54146b40 2021-01-03T12:58:01.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e58927700 1 -- 172.21.15.133:0/1555733027 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e54146b40 msgr2=0x7f6e5414e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e58927700 1 --2- 172.21.15.133:0/1555733027 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e54146b40 0x7f6e5414e510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6e4c0032b0 tx=0x7f6e4c0091a0).stop 2021-01-03T12:58:01.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e58927700 1 -- 172.21.15.133:0/1555733027 shutdown_connections 2021-01-03T12:58:01.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e58927700 1 --2- 172.21.15.133:0/1555733027 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e54146b40 0x7f6e5414e510 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e58927700 1 -- 172.21.15.133:0/1555733027 >> 172.21.15.133:0/1555733027 conn(0x7f6e540b69e0 msgr2=0x7f6e540b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:01.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e58927700 1 -- 172.21.15.133:0/1555733027 shutdown_connections 2021-01-03T12:58:01.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e58927700 1 -- 172.21.15.133:0/1555733027 wait complete. 2021-01-03T12:58:01.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e58927700 1 Processor -- start 2021-01-03T12:58:01.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e58927700 1 -- start start 2021-01-03T12:58:01.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e58927700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e540b9b60 0x7f6e54141f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:01.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e58927700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e540b9f40 0x7f6e5409e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:01.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e58927700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e54146b40 0x7f6e541551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:01.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e58927700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5409e1e0 con 0x7f6e540b9f40 2021-01-03T12:58:01.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e58927700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54155cd0 con 0x7f6e540b9b60 2021-01-03T12:58:01.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.971+0000 7f6e58927700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54140ee0 con 0x7f6e54146b40 2021-01-03T12:58:01.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e52d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e540b9b60 0x7f6e54141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:01.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e4bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e540b9f40 0x7f6e5409e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:01.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e52d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e540b9b60 0x7f6e54141f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59828/0 (socket says 172.21.15.133:59828) 2021-01-03T12:58:01.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e52d9d700 1 -- 172.21.15.133:0/1250173489 learned_addr learned my addr 172.21.15.133:0/1250173489 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:01.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e5359e700 1 --2- 172.21.15.133:0/1250173489 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e54146b40 0x7f6e541551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:01.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e52d9d700 1 -- 172.21.15.133:0/1250173489 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e54146b40 msgr2=0x7f6e541551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e52d9d700 1 --2- 172.21.15.133:0/1250173489 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e54146b40 0x7f6e541551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e52d9d700 1 -- 172.21.15.133:0/1250173489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e540b9f40 msgr2=0x7f6e5409e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:01.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e52d9d700 1 --2- 172.21.15.133:0/1250173489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e540b9f40 0x7f6e5409e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:01.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e52d9d700 1 -- 172.21.15.133:0/1250173489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e54141180 con 0x7f6e540b9b60 2021-01-03T12:58:01.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e52d9d700 1 --2- 172.21.15.133:0/1250173489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e540b9b60 0x7f6e54141f80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6e540b8fb0 tx=0x7f6e3c007a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:01.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e50d99700 1 -- 172.21.15.133:0/1250173489 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e3c00f470 con 0x7f6e540b9b60 2021-01-03T12:58:01.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e50d99700 1 -- 172.21.15.133:0/1250173489 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c00f5d0 con 0x7f6e540b9b60 2021-01-03T12:58:01.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e50d99700 1 -- 172.21.15.133:0/1250173489 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e3c00f930 con 0x7f6e540b9b60 2021-01-03T12:58:01.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e58927700 1 -- 172.21.15.133:0/1250173489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e54141420 con 0x7f6e540b9b60 2021-01-03T12:58:01.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e58927700 1 -- 172.21.15.133:0/1250173489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e540b8b30 con 0x7f6e540b9b60 2021-01-03T12:58:01.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e58927700 1 -- 172.21.15.133:0/1250173489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5409e610 con 0x7f6e540b9b60 2021-01-03T12:58:01.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.975+0000 7f6e50d99700 1 -- 172.21.15.133:0/1250173489 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6e3c019030 con 0x7f6e540b9b60 2021-01-03T12:58:01.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.979+0000 7f6e50d99700 1 --2- 172.21.15.133:0/1250173489 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6e38055440 0x7f6e38057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:01.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.979+0000 7f6e50d99700 1 -- 172.21.15.133:0/1250173489 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6e3c06d3d0 con 0x7f6e540b9b60 2021-01-03T12:58:01.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.979+0000 7f6e4bfff700 1 --2- 172.21.15.133:0/1250173489 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6e38055440 0x7f6e38057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:01.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.979+0000 7f6e4bfff700 1 --2- 172.21.15.133:0/1250173489 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6e38055440 0x7f6e38057900 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6e4400d000 tx=0x7f6e44009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:01.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:01.983+0000 7f6e50d99700 1 -- 172.21.15.133:0/1250173489 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6e5409e610 con 0x7f6e540b9b60 2021-01-03T12:58:02.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.171+0000 7f6e58927700 1 -- 172.21.15.133:0/1250173489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e5409e610 con 0x7f6e540b9b60 2021-01-03T12:58:02.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.171+0000 7f6e50d99700 1 -- 172.21.15.133:0/1250173489 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2489 (secure 0 0 0) 0x7f6e5409e610 con 0x7f6e540b9b60 2021-01-03T12:58:02.175 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:02.175 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2255364706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2255364706},{"type":"v1","addr":"172.21.15.16:6833","nonce":2255364706}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/537740959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":537740959},{"type":"v1","addr":"172.21.15.133:6835","nonce":537740959}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T12:58:00.825803+0000","modified":"2021-01-03T12:58:01.829281+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6837/3158570988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3158570988},{"type":"v1","addr":"172.21.15.133:6837","nonce":3158570988}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-03T12:58:02.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.175+0000 7f6e58927700 1 -- 172.21.15.133:0/1250173489 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6e38055440 msgr2=0x7f6e38057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.175+0000 7f6e58927700 1 --2- 172.21.15.133:0/1250173489 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6e38055440 0x7f6e38057900 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6e4400d000 tx=0x7f6e44009040).stop 2021-01-03T12:58:02.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.175+0000 7f6e58927700 1 -- 172.21.15.133:0/1250173489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e540b9b60 msgr2=0x7f6e54141f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.175+0000 7f6e58927700 1 --2- 172.21.15.133:0/1250173489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e540b9b60 0x7f6e54141f80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6e540b8fb0 tx=0x7f6e3c007a90).stop 2021-01-03T12:58:02.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.175+0000 7f6e58927700 1 -- 172.21.15.133:0/1250173489 shutdown_connections 2021-01-03T12:58:02.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.175+0000 7f6e58927700 1 --2- 172.21.15.133:0/1250173489 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6e38055440 0x7f6e38057900 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.175+0000 7f6e58927700 1 --2- 172.21.15.133:0/1250173489 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e54146b40 0x7f6e541551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.175+0000 7f6e58927700 1 --2- 172.21.15.133:0/1250173489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e540b9b60 0x7f6e54141f80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.175+0000 7f6e58927700 1 --2- 172.21.15.133:0/1250173489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e540b9f40 0x7f6e5409e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.175+0000 7f6e58927700 1 -- 172.21.15.133:0/1250173489 >> 172.21.15.133:0/1250173489 conn(0x7f6e540b69e0 msgr2=0x7f6e54145140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:02.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.175+0000 7f6e58927700 1 -- 172.21.15.133:0/1250173489 shutdown_connections 2021-01-03T12:58:02.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.175+0000 7f6e58927700 1 -- 172.21.15.133:0/1250173489 wait complete. 2021-01-03T12:58:02.179 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 5 2021-01-03T12:58:02.189 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:02.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.295+0000 7f47ac101700 1 Processor -- start 2021-01-03T12:58:02.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.295+0000 7f47ac101700 1 -- start start 2021-01-03T12:58:02.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47ac101700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47a41486b0 0x7f47a414aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47ac101700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a4140700 con 0x7f47a405c840 2021-01-03T12:58:02.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47ac101700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a405cc20 con 0x7f47a413fb40 2021-01-03T12:58:02.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47ac101700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a40aa1f0 con 0x7f47a41486b0 2021-01-03T12:58:02.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47aa69e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47a41486b0 0x7f47a414aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47aa69e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f47a41486b0 0x7f47a414aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59838/0 (socket says 172.21.15.133:59838) 2021-01-03T12:58:02.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47a969c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f47a413fb40 0x7f47a413fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52636/0 (socket says 172.21.15.133:52636) 2021-01-03T12:58:02.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47aa69e700 1 -- 172.21.15.133:0/1957190915 learned_addr learned my addr 172.21.15.133:0/1957190915 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:02.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47aa69e700 1 -- 172.21.15.133:0/1957190915 >> v1:172.21.15.133:6789/0 conn(0x7f47a413fb40 legacy=0x7f47a413fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47aa69e700 1 -- 172.21.15.133:0/1957190915 >> v1:172.21.15.16:6789/0 conn(0x7f47a405c840 legacy=0x7f47a40b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47aa69e700 1 -- 172.21.15.133:0/1957190915 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a4143df0 con 0x7f47a41486b0 2021-01-03T12:58:02.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47aa69e700 1 --2- 172.21.15.133:0/1957190915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a41486b0 0x7f47a414aaa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f479c002f30 tx=0x7f479c006e80).ready entity=mon.1 client_cookie=d46b85c1ec8a5a75 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:02.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47a8e9b700 1 -- 172.21.15.133:0/1957190915 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f479c0097f0 con 0x7f47a41486b0 2021-01-03T12:58:02.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47a8e9b700 1 -- 172.21.15.133:0/1957190915 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479c009950 con 0x7f47a41486b0 2021-01-03T12:58:02.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47a8e9b700 1 -- 172.21.15.133:0/1957190915 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f479c009cb0 con 0x7f47a41486b0 2021-01-03T12:58:02.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47ac101700 1 -- 172.21.15.133:0/1957190915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a41486b0 msgr2=0x7f47a414aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47ac101700 1 --2- 172.21.15.133:0/1957190915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a41486b0 0x7f47a414aaa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f479c002f30 tx=0x7f479c006e80).stop 2021-01-03T12:58:02.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47ac101700 1 -- 172.21.15.133:0/1957190915 shutdown_connections 2021-01-03T12:58:02.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47ac101700 1 --2- 172.21.15.133:0/1957190915 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a41486b0 0x7f47a414aaa0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47ac101700 1 -- 172.21.15.133:0/1957190915 >> 172.21.15.133:0/1957190915 conn(0x7f47a406aeb0 msgr2=0x7f47a405bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:02.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47ac101700 1 -- 172.21.15.133:0/1957190915 shutdown_connections 2021-01-03T12:58:02.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.299+0000 7f47ac101700 1 -- 172.21.15.133:0/1957190915 wait complete. 2021-01-03T12:58:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47ac101700 1 Processor -- start 2021-01-03T12:58:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47ac101700 1 -- start start 2021-01-03T12:58:02.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47ac101700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47a405c840 0x7f47a40b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47ac101700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a413fb40 0x7f47a4140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47ac101700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47a41486b0 0x7f47a41413b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47ac101700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a41374a0 con 0x7f47a405c840 2021-01-03T12:58:02.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47ac101700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a414f520 con 0x7f47a413fb40 2021-01-03T12:58:02.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47ac101700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a414f750 con 0x7f47a41486b0 2021-01-03T12:58:02.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47a969c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a413fb40 0x7f47a4140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47a969c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a413fb40 0x7f47a4140ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59842/0 (socket says 172.21.15.133:59842) 2021-01-03T12:58:02.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47a969c700 1 -- 172.21.15.133:0/2893288363 learned_addr learned my addr 172.21.15.133:0/2893288363 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:02.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47a9e9d700 1 --2- 172.21.15.133:0/2893288363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47a405c840 0x7f47a40b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47aa69e700 1 --2- 172.21.15.133:0/2893288363 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47a41486b0 0x7f47a41413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47a969c700 1 -- 172.21.15.133:0/2893288363 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47a41486b0 msgr2=0x7f47a41413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47a969c700 1 --2- 172.21.15.133:0/2893288363 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47a41486b0 0x7f47a41413b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47a969c700 1 -- 172.21.15.133:0/2893288363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47a405c840 msgr2=0x7f47a40b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47a969c700 1 --2- 172.21.15.133:0/2893288363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47a405c840 0x7f47a40b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47a969c700 1 -- 172.21.15.133:0/2893288363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a414f9b0 con 0x7f47a413fb40 2021-01-03T12:58:02.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.303+0000 7f47aa69e700 1 --2- 172.21.15.133:0/2893288363 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47a41486b0 0x7f47a41413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:02.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.307+0000 7f47a969c700 1 --2- 172.21.15.133:0/2893288363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a413fb40 0x7f47a4140ec0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f47a41375e0 tx=0x7f4794007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:02.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.307+0000 7f4792ffd700 1 -- 172.21.15.133:0/2893288363 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47940072e0 con 0x7f47a413fb40 2021-01-03T12:58:02.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.307+0000 7f4792ffd700 1 -- 172.21.15.133:0/2893288363 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4794005520 con 0x7f47a413fb40 2021-01-03T12:58:02.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.307+0000 7f4792ffd700 1 -- 172.21.15.133:0/2893288363 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4794005880 con 0x7f47a413fb40 2021-01-03T12:58:02.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.307+0000 7f47ac101700 1 -- 172.21.15.133:0/2893288363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a4137000 con 0x7f47a413fb40 2021-01-03T12:58:02.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.307+0000 7f47ac101700 1 -- 172.21.15.133:0/2893288363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a4136570 con 0x7f47a413fb40 2021-01-03T12:58:02.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.307+0000 7f47ac101700 1 -- 172.21.15.133:0/2893288363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a4137190 con 0x7f47a413fb40 2021-01-03T12:58:02.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.307+0000 7f4792ffd700 1 -- 172.21.15.133:0/2893288363 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4794010070 con 0x7f47a413fb40 2021-01-03T12:58:02.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.307+0000 7f4792ffd700 1 --2- 172.21.15.133:0/2893288363 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4784055330 0x7f47840577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.307+0000 7f4792ffd700 1 -- 172.21.15.133:0/2893288363 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f479406d550 con 0x7f47a413fb40 2021-01-03T12:58:02.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.307+0000 7f47a9e9d700 1 --2- 172.21.15.133:0/2893288363 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4784055330 0x7f47840577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.307+0000 7f47a9e9d700 1 --2- 172.21.15.133:0/2893288363 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4784055330 0x7f47840577f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f47a000d000 tx=0x7f47a0007ee0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:02.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.315+0000 7f4792ffd700 1 -- 172.21.15.133:0/2893288363 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4794043850 con 0x7f47a413fb40 2021-01-03T12:58:02.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.459+0000 7f47ac101700 1 -- 172.21.15.133:0/2893288363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47a414fb40 con 0x7f47a413fb40 2021-01-03T12:58:02.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.459+0000 7f4792ffd700 1 -- 172.21.15.133:0/2893288363 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f4794018070 con 0x7f47a413fb40 2021-01-03T12:58:02.461 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:02.461 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":23,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:01.829379+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:57:58.934952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-03T12:57:59.830134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:02.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.463+0000 7f47ac101700 1 -- 172.21.15.133:0/2893288363 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4784055330 msgr2=0x7f47840577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.463+0000 7f47ac101700 1 --2- 172.21.15.133:0/2893288363 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4784055330 0x7f47840577f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f47a000d000 tx=0x7f47a0007ee0).stop 2021-01-03T12:58:02.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.463+0000 7f47ac101700 1 -- 172.21.15.133:0/2893288363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a413fb40 msgr2=0x7f47a4140ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.463+0000 7f47ac101700 1 --2- 172.21.15.133:0/2893288363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a413fb40 0x7f47a4140ec0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f47a41375e0 tx=0x7f4794007c10).stop 2021-01-03T12:58:02.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.463+0000 7f47ac101700 1 -- 172.21.15.133:0/2893288363 shutdown_connections 2021-01-03T12:58:02.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.463+0000 7f47ac101700 1 --2- 172.21.15.133:0/2893288363 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4784055330 0x7f47840577f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.463+0000 7f47ac101700 1 --2- 172.21.15.133:0/2893288363 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47a405c840 0x7f47a40b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.463+0000 7f47ac101700 1 --2- 172.21.15.133:0/2893288363 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47a41486b0 0x7f47a41413b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.463+0000 7f47ac101700 1 --2- 172.21.15.133:0/2893288363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47a413fb40 0x7f47a4140ec0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.463+0000 7f47ac101700 1 -- 172.21.15.133:0/2893288363 >> 172.21.15.133:0/2893288363 conn(0x7f47a406aeb0 msgr2=0x7f47a40aa330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:02.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.463+0000 7f47ac101700 1 -- 172.21.15.133:0/2893288363 shutdown_connections 2021-01-03T12:58:02.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.463+0000 7f47ac101700 1 -- 172.21.15.133:0/2893288363 wait complete. 2021-01-03T12:58:02.479 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:02.480 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-01-03T12:58:02.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.583+0000 7fb5e4910700 1 Processor -- start 2021-01-03T12:58:02.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.583+0000 7fb5e4910700 1 -- start start 2021-01-03T12:58:02.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.583+0000 7fb5e4910700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5e005c130 0x7fb5e00b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.583+0000 7fb5e4910700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb5e00b02b0 0x7fb5e00b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.583+0000 7fb5e4910700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e005c510 con 0x7fb5e00622f0 2021-01-03T12:58:02.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.583+0000 7fb5e4910700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e01473d0 con 0x7fb5e00b02b0 2021-01-03T12:58:02.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.583+0000 7fb5e4910700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e00b0ab0 con 0x7fb5e005c130 2021-01-03T12:58:02.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5de59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb5e00b02b0 0x7fb5e00b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5de59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb5e00b02b0 0x7fb5e00b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59848/0 (socket says 172.21.15.133:59848) 2021-01-03T12:58:02.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5de59c700 1 -- 172.21.15.133:0/3056059165 learned_addr learned my addr 172.21.15.133:0/3056059165 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:02.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5ded9d700 1 --2- 172.21.15.133:0/3056059165 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5e005c130 0x7fb5e00b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5de59c700 1 -- 172.21.15.133:0/3056059165 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5e005c130 msgr2=0x7fb5e00b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:02.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5de59c700 1 --2- 172.21.15.133:0/3056059165 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5e005c130 0x7fb5e00b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5de59c700 1 -- 172.21.15.133:0/3056059165 >> v1:172.21.15.16:6789/0 conn(0x7fb5e00622f0 legacy=0x7fb5e00668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:02.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5de59c700 1 -- 172.21.15.133:0/3056059165 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e00b15a0 con 0x7fb5e00b02b0 2021-01-03T12:58:02.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5de59c700 1 --2- 172.21.15.133:0/3056059165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5e00b02b0 0x7fb5e00b1ef0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fb5e00b6cd0 tx=0x7fb5d4006e80).ready entity=mon.1 client_cookie=5fdded9f46c0b78a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:02.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5ddd9b700 1 -- 172.21.15.133:0/3056059165 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5d40097b0 con 0x7fb5e00b02b0 2021-01-03T12:58:02.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5ddd9b700 1 -- 172.21.15.133:0/3056059165 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d4009910 con 0x7fb5e00b02b0 2021-01-03T12:58:02.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5ddd9b700 1 -- 172.21.15.133:0/3056059165 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5d4009a80 con 0x7fb5e00b02b0 2021-01-03T12:58:02.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5e4910700 1 -- 172.21.15.133:0/3056059165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5e00b02b0 msgr2=0x7fb5e00b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5e4910700 1 --2- 172.21.15.133:0/3056059165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5e00b02b0 0x7fb5e00b1ef0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fb5e00b6cd0 tx=0x7fb5d4006e80).stop 2021-01-03T12:58:02.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5e4910700 1 -- 172.21.15.133:0/3056059165 shutdown_connections 2021-01-03T12:58:02.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5e4910700 1 --2- 172.21.15.133:0/3056059165 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5e005c130 0x7fb5e00b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5e4910700 1 --2- 172.21.15.133:0/3056059165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5e00b02b0 0x7fb5e00b1ef0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5e4910700 1 -- 172.21.15.133:0/3056059165 >> 172.21.15.133:0/3056059165 conn(0x7fb5e00b6110 msgr2=0x7fb5e00b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:02.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5e4910700 1 -- 172.21.15.133:0/3056059165 shutdown_connections 2021-01-03T12:58:02.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5e4910700 1 -- 172.21.15.133:0/3056059165 wait complete. 2021-01-03T12:58:02.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5e4910700 1 Processor -- start 2021-01-03T12:58:02.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5e4910700 1 -- start start 2021-01-03T12:58:02.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5e4910700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5e005c130 0x7fb5e0149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5e4910700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5e00622f0 0x7fb5e01493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5e4910700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5e00b02b0 0x7fb5e01442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5e4910700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e00b5f20 con 0x7fb5e005c130 2021-01-03T12:58:02.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5e4910700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e0148a00 con 0x7fb5e00622f0 2021-01-03T12:58:02.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5e4910700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e0149890 con 0x7fb5e00b02b0 2021-01-03T12:58:02.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.587+0000 7fb5de59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5e00622f0 0x7fb5e01493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5de59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5e00622f0 0x7fb5e01493a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59856/0 (socket says 172.21.15.133:59856) 2021-01-03T12:58:02.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5de59c700 1 -- 172.21.15.133:0/3137164359 learned_addr learned my addr 172.21.15.133:0/3137164359 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:02.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5ded9d700 1 --2- 172.21.15.133:0/3137164359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5e005c130 0x7fb5e0149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5df59e700 1 --2- 172.21.15.133:0/3137164359 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5e00b02b0 0x7fb5e01442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5de59c700 1 -- 172.21.15.133:0/3137164359 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5e00b02b0 msgr2=0x7fb5e01442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5de59c700 1 --2- 172.21.15.133:0/3137164359 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5e00b02b0 0x7fb5e01442a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5de59c700 1 -- 172.21.15.133:0/3137164359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5e005c130 msgr2=0x7fb5e0149ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5de59c700 1 --2- 172.21.15.133:0/3137164359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5e005c130 0x7fb5e0149ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5de59c700 1 -- 172.21.15.133:0/3137164359 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e0148c60 con 0x7fb5e00622f0 2021-01-03T12:58:02.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5ded9d700 1 --2- 172.21.15.133:0/3137164359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5e005c130 0x7fb5e0149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:02.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5de59c700 1 --2- 172.21.15.133:0/3137164359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5e00622f0 0x7fb5e01493a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb5e0149a20 tx=0x7fb5d4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:02.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5cffff700 1 -- 172.21.15.133:0/3137164359 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5d4011e90 con 0x7fb5e00622f0 2021-01-03T12:58:02.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5cffff700 1 -- 172.21.15.133:0/3137164359 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d4020400 con 0x7fb5e00622f0 2021-01-03T12:58:02.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5e4910700 1 -- 172.21.15.133:0/3137164359 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e0148f00 con 0x7fb5e00622f0 2021-01-03T12:58:02.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5cffff700 1 -- 172.21.15.133:0/3137164359 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5d4020760 con 0x7fb5e00622f0 2021-01-03T12:58:02.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5e4910700 1 -- 172.21.15.133:0/3137164359 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e0151cf0 con 0x7fb5e00622f0 2021-01-03T12:58:02.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5e4910700 1 -- 172.21.15.133:0/3137164359 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e0149090 con 0x7fb5e00622f0 2021-01-03T12:58:02.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5cffff700 1 -- 172.21.15.133:0/3137164359 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb5d4027030 con 0x7fb5e00622f0 2021-01-03T12:58:02.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5cffff700 1 --2- 172.21.15.133:0/3137164359 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5bc0553b0 0x7fb5bc057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5ded9d700 1 --2- 172.21.15.133:0/3137164359 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5bc0553b0 0x7fb5bc057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.591+0000 7fb5cffff700 1 -- 172.21.15.133:0/3137164359 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb5d406ec00 con 0x7fb5e00622f0 2021-01-03T12:58:02.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.595+0000 7fb5ded9d700 1 --2- 172.21.15.133:0/3137164359 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5bc0553b0 0x7fb5bc057870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fb5d800c000 tx=0x7fb5d8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:02.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.599+0000 7fb5cffff700 1 -- 172.21.15.133:0/3137164359 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb5d4044fc0 con 0x7fb5e00622f0 2021-01-03T12:58:02.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.739+0000 7fb5e4910700 1 -- 172.21.15.133:0/3137164359 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5e0057300 con 0x7fb5e00622f0 2021-01-03T12:58:02.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.739+0000 7fb5cffff700 1 -- 172.21.15.133:0/3137164359 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7fb5d4025090 con 0x7fb5e00622f0 2021-01-03T12:58:02.741 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:02.742 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":23,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:01.829379+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:57:58.934952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-03T12:57:59.830134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:02.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.743+0000 7fb5e4910700 1 -- 172.21.15.133:0/3137164359 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5bc0553b0 msgr2=0x7fb5bc057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.743+0000 7fb5e4910700 1 --2- 172.21.15.133:0/3137164359 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5bc0553b0 0x7fb5bc057870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fb5d800c000 tx=0x7fb5d8008040).stop 2021-01-03T12:58:02.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.743+0000 7fb5e4910700 1 -- 172.21.15.133:0/3137164359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5e00622f0 msgr2=0x7fb5e01493a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.743+0000 7fb5e4910700 1 --2- 172.21.15.133:0/3137164359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5e00622f0 0x7fb5e01493a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fb5e0149a20 tx=0x7fb5d4016000).stop 2021-01-03T12:58:02.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.743+0000 7fb5e4910700 1 -- 172.21.15.133:0/3137164359 shutdown_connections 2021-01-03T12:58:02.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.743+0000 7fb5e4910700 1 --2- 172.21.15.133:0/3137164359 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5bc0553b0 0x7fb5bc057870 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.743+0000 7fb5e4910700 1 --2- 172.21.15.133:0/3137164359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5e005c130 0x7fb5e0149ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.743+0000 7fb5e4910700 1 --2- 172.21.15.133:0/3137164359 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5e00b02b0 0x7fb5e01442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.743+0000 7fb5e4910700 1 --2- 172.21.15.133:0/3137164359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5e00622f0 0x7fb5e01493a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.743+0000 7fb5e4910700 1 -- 172.21.15.133:0/3137164359 >> 172.21.15.133:0/3137164359 conn(0x7fb5e00b6110 msgr2=0x7fb5e00af630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:02.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.743+0000 7fb5e4910700 1 -- 172.21.15.133:0/3137164359 shutdown_connections 2021-01-03T12:58:02.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.743+0000 7fb5e4910700 1 -- 172.21.15.133:0/3137164359 wait complete. 2021-01-03T12:58:02.755 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T12:57:58.934952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T12:57:59.830134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T12:58:02.756 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T12:58:02.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.871+0000 7fdd74e6b700 1 Processor -- start 2021-01-03T12:58:02.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.871+0000 7fdd74e6b700 1 -- start start 2021-01-03T12:58:02.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd74e6b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd700b0a60 0x7fdd700a9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd74e6b700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd700b16a0 con 0x7fdd700b2460 2021-01-03T12:58:02.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd74e6b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd700b2840 con 0x7fdd700a8850 2021-01-03T12:58:02.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd74e6b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700aeae0 con 0x7fdd700b0a60 2021-01-03T12:58:02.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6ffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdd700a8850 0x7fdd700a8c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52666/0 (socket says 172.21.15.133:52666) 2021-01-03T12:58:02.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6ffff700 1 -- 172.21.15.133:0/1660337354 learned_addr learned my addr 172.21.15.133:0/1660337354 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:02.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd66ffd700 1 --2- 172.21.15.133:0/1660337354 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd700b0a60 0x7fdd700a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 -- 172.21.15.133:0/1660337354 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210282990 0 0) 0x7fdd700b2840 con 0x7fdd700a8850 2021-01-03T12:58:02.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 -- 172.21.15.133:0/1660337354 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd50003230 con 0x7fdd700a8850 2021-01-03T12:58:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 -- 172.21.15.133:0/1660337354 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537390228 0 0) 0x7fdd700b16a0 con 0x7fdd700b2460 2021-01-03T12:58:02.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 -- 172.21.15.133:0/1660337354 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd700b2840 con 0x7fdd700b2460 2021-01-03T12:58:02.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 -- 172.21.15.133:0/1660337354 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 314907475 0 0) 0x7fdd50003230 con 0x7fdd700a8850 2021-01-03T12:58:02.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 -- 172.21.15.133:0/1660337354 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd700b0a60 msgr2=0x7fdd700a9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:02.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 --2- 172.21.15.133:0/1660337354 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd700b0a60 0x7fdd700a9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 -- 172.21.15.133:0/1660337354 >> v1:172.21.15.16:6789/0 conn(0x7fdd700b2460 legacy=0x7fdd700ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 -- 172.21.15.133:0/1660337354 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd700b1160 con 0x7fdd700a8850 2021-01-03T12:58:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 -- 172.21.15.133:0/1660337354 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fdd68001ae0 con 0x7fdd700a8850 2021-01-03T12:58:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 -- 172.21.15.133:0/1660337354 >> v1:172.21.15.133:6789/0 conn(0x7fdd700a8850 legacy=0x7fdd700a8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 --2- 172.21.15.133:0/1660337354 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd700b0a60 0x7fdd500038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 --2- 172.21.15.133:0/1660337354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd50003df0 0x7fdd500044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 --2- 172.21.15.133:0/1660337354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd500049c0 0x7fdd50004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 -- 172.21.15.133:0/1660337354 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700aeae0 con 0x7fdd500049c0 2021-01-03T12:58:02.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 -- 172.21.15.133:0/1660337354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd50005390 con 0x7fdd50003df0 2021-01-03T12:58:02.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 -- 172.21.15.133:0/1660337354 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd50007780 con 0x7fdd700b0a60 2021-01-03T12:58:02.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd66ffd700 1 --2- 172.21.15.133:0/1660337354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd50003df0 0x7fdd500044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6f7fe700 1 --2- 172.21.15.133:0/1660337354 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd700b0a60 0x7fdd500038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6ffff700 1 --2- 172.21.15.133:0/1660337354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd500049c0 0x7fdd50004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd66ffd700 1 -- 172.21.15.133:0/1660337354 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd700b0a60 msgr2=0x7fdd500038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:02.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd66ffd700 1 --2- 172.21.15.133:0/1660337354 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd700b0a60 0x7fdd500038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd66ffd700 1 -- 172.21.15.133:0/1660337354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd500049c0 msgr2=0x7fdd50004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd66ffd700 1 --2- 172.21.15.133:0/1660337354 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd500049c0 0x7fdd50004e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd66ffd700 1 -- 172.21.15.133:0/1660337354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd50003230 con 0x7fdd50003df0 2021-01-03T12:58:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6f7fe700 1 --2- 172.21.15.133:0/1660337354 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd700b0a60 0x7fdd500038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:02.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd66ffd700 1 --2- 172.21.15.133:0/1660337354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd50003df0 0x7fdd500044d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fdd5800c000 tx=0x7fdd58008040).ready entity=mon.1 client_cookie=e73c3e362b435cef server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:02.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 -- 172.21.15.133:0/1660337354 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd5800e9d0 con 0x7fdd50003df0 2021-01-03T12:58:02.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 -- 172.21.15.133:0/1660337354 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5800eb30 con 0x7fdd50003df0 2021-01-03T12:58:02.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6effd700 1 -- 172.21.15.133:0/1660337354 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd5800ee90 con 0x7fdd50003df0 2021-01-03T12:58:02.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd74e6b700 1 -- 172.21.15.133:0/1660337354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd50003df0 msgr2=0x7fdd500044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd74e6b700 1 --2- 172.21.15.133:0/1660337354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd50003df0 0x7fdd500044d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fdd5800c000 tx=0x7fdd58008040).stop 2021-01-03T12:58:02.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.875+0000 7fdd6ffff700 1 -- 172.21.15.133:0/1660337354 reap_dead start 2021-01-03T12:58:02.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd74e6b700 1 -- 172.21.15.133:0/1660337354 shutdown_connections 2021-01-03T12:58:02.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd74e6b700 1 -- 172.21.15.133:0/1660337354 >> 172.21.15.133:0/1660337354 conn(0x7fdd7006b050 msgr2=0x7fdd70060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:02.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd74e6b700 1 -- 172.21.15.133:0/1660337354 shutdown_connections 2021-01-03T12:58:02.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd74e6b700 1 -- 172.21.15.133:0/1660337354 wait complete. 2021-01-03T12:58:02.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd74e6b700 1 Processor -- start 2021-01-03T12:58:02.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd74e6b700 1 -- start start 2021-01-03T12:58:02.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd74e6b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd70145240 0x7fdd7009f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd74e6b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd7014db30 0x7fdd7009f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd74e6b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd700667f0 0x7fdd7014e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd74e6b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700b4360 con 0x7fdd700667f0 2021-01-03T12:58:02.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd74e6b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700646a0 con 0x7fdd70145240 2021-01-03T12:58:02.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd74e6b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd70151c90 con 0x7fdd7014db30 2021-01-03T12:58:02.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd6f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd70145240 0x7fdd7009f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd6f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd70145240 0x7fdd7009f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59878/0 (socket says 172.21.15.133:59878) 2021-01-03T12:58:02.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd6f7fe700 1 -- 172.21.15.133:0/2265172140 learned_addr learned my addr 172.21.15.133:0/2265172140 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:02.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd66ffd700 1 --2- 172.21.15.133:0/2265172140 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd7014db30 0x7fdd7009f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd6ffff700 1 --2- 172.21.15.133:0/2265172140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd700667f0 0x7fdd7014e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd6f7fe700 1 -- 172.21.15.133:0/2265172140 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd7014db30 msgr2=0x7fdd7009f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd6f7fe700 1 --2- 172.21.15.133:0/2265172140 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd7014db30 0x7fdd7009f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd6f7fe700 1 -- 172.21.15.133:0/2265172140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd700667f0 msgr2=0x7fdd7014e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:02.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd6f7fe700 1 --2- 172.21.15.133:0/2265172140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd700667f0 0x7fdd7014e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:02.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd6f7fe700 1 -- 172.21.15.133:0/2265172140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd70064b40 con 0x7fdd70145240 2021-01-03T12:58:02.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd66ffd700 1 --2- 172.21.15.133:0/2265172140 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd7014db30 0x7fdd7009f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:02.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd6f7fe700 1 --2- 172.21.15.133:0/2265172140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd70145240 0x7fdd7009f230 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdd60008000 tx=0x7fdd60009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:02.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd6d7fa700 1 -- 172.21.15.133:0/2265172140 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd6000b590 con 0x7fdd70145240 2021-01-03T12:58:02.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd6d7fa700 1 -- 172.21.15.133:0/2265172140 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6000b6f0 con 0x7fdd70145240 2021-01-03T12:58:02.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd74e6b700 1 -- 172.21.15.133:0/2265172140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd70151f30 con 0x7fdd70145240 2021-01-03T12:58:02.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd6d7fa700 1 -- 172.21.15.133:0/2265172140 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd6000ba50 con 0x7fdd70145240 2021-01-03T12:58:02.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.879+0000 7fdd74e6b700 1 -- 172.21.15.133:0/2265172140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd701457c0 con 0x7fdd70145240 2021-01-03T12:58:02.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.883+0000 7fdd6d7fa700 1 -- 172.21.15.133:0/2265172140 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fdd6001a030 con 0x7fdd70145240 2021-01-03T12:58:02.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.883+0000 7fdd74e6b700 1 -- 172.21.15.133:0/2265172140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd480033e0 con 0x7fdd70145240 2021-01-03T12:58:02.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.883+0000 7fdd6d7fa700 1 --2- 172.21.15.133:0/2265172140 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdd540553b0 0x7fdd54057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:02.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.883+0000 7fdd6d7fa700 1 -- 172.21.15.133:0/2265172140 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdd6006da50 con 0x7fdd70145240 2021-01-03T12:58:02.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.883+0000 7fdd66ffd700 1 --2- 172.21.15.133:0/2265172140 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdd540553b0 0x7fdd54057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:02.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.883+0000 7fdd66ffd700 1 --2- 172.21.15.133:0/2265172140 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdd540553b0 0x7fdd54057870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fdd58008000 tx=0x7fdd5801a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:02.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:02.887+0000 7fdd6d7fa700 1 -- 172.21.15.133:0/2265172140 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdd60042df0 con 0x7fdd70145240 2021-01-03T12:58:03.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.023+0000 7fdd74e6b700 1 -- 172.21.15.133:0/2265172140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdd480022c0 con 0x7fdd70145240 2021-01-03T12:58:03.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.023+0000 7fdd6d7fa700 1 -- 172.21.15.133:0/2265172140 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdd60043cf0 con 0x7fdd70145240 2021-01-03T12:58:03.026 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T12:58:03.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.027+0000 7fdd74e6b700 1 -- 172.21.15.133:0/2265172140 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdd540553b0 msgr2=0x7fdd54057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.027+0000 7fdd74e6b700 1 --2- 172.21.15.133:0/2265172140 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdd540553b0 0x7fdd54057870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fdd58008000 tx=0x7fdd5801a000).stop 2021-01-03T12:58:03.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.027+0000 7fdd74e6b700 1 -- 172.21.15.133:0/2265172140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd70145240 msgr2=0x7fdd7009f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.027+0000 7fdd74e6b700 1 --2- 172.21.15.133:0/2265172140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd70145240 0x7fdd7009f230 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fdd60008000 tx=0x7fdd60009040).stop 2021-01-03T12:58:03.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.027+0000 7fdd74e6b700 1 -- 172.21.15.133:0/2265172140 shutdown_connections 2021-01-03T12:58:03.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.027+0000 7fdd74e6b700 1 --2- 172.21.15.133:0/2265172140 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdd540553b0 0x7fdd54057870 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.027+0000 7fdd74e6b700 1 --2- 172.21.15.133:0/2265172140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd700667f0 0x7fdd7014e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.027+0000 7fdd74e6b700 1 --2- 172.21.15.133:0/2265172140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd70145240 0x7fdd7009f230 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.027+0000 7fdd74e6b700 1 --2- 172.21.15.133:0/2265172140 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd7014db30 0x7fdd7009f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.027+0000 7fdd74e6b700 1 -- 172.21.15.133:0/2265172140 >> 172.21.15.133:0/2265172140 conn(0x7fdd7006b050 msgr2=0x7fdd700ab650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:03.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.027+0000 7fdd74e6b700 1 -- 172.21.15.133:0/2265172140 shutdown_connections 2021-01-03T12:58:03.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.027+0000 7fdd74e6b700 1 -- 172.21.15.133:0/2265172140 wait complete. 2021-01-03T12:58:03.038 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T12:58:03.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.151+0000 7f5984927700 1 Processor -- start 2021-01-03T12:58:03.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.151+0000 7f5984927700 1 -- start start 2021-01-03T12:58:03.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f5984927700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5980140410 0x7f5980146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f5984927700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f59801407f0 0x7f5980142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f5984927700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598005c500 con 0x7f59800b0470 2021-01-03T12:58:03.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f5984927700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59800b02d0 con 0x7f59801407f0 2021-01-03T12:58:03.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f5984927700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5980146390 con 0x7f5980140410 2021-01-03T12:58:03.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f597ed9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f59800b0470 0x7f598005bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52684/0 (socket says 172.21.15.133:52684) 2021-01-03T12:58:03.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f597ed9d700 1 -- 172.21.15.133:0/1565995247 learned_addr learned my addr 172.21.15.133:0/1565995247 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f597e59c700 1 --2- 172.21.15.133:0/1565995247 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5980140410 0x7f5980146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f597dd9b700 1 --2- 172.21.15.133:0/1565995247 >> v2:172.21.15.16:3300/0 conn(0x7f59801407f0 0x7f5980142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f597d59a700 1 -- 172.21.15.133:0/1565995247 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703055283 0 0) 0x7f598005c500 con 0x7f59800b0470 2021-01-03T12:58:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f597d59a700 1 -- 172.21.15.133:0/1565995247 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5960003230 con 0x7f59800b0470 2021-01-03T12:58:03.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f597e59c700 1 -- 172.21.15.133:0/1565995247 >> v2:172.21.15.16:3300/0 conn(0x7f59801407f0 msgr2=0x7f5980142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:03.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f597e59c700 1 --2- 172.21.15.133:0/1565995247 >> v2:172.21.15.16:3300/0 conn(0x7f59801407f0 0x7f5980142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f597e59c700 1 -- 172.21.15.133:0/1565995247 >> v1:172.21.15.133:6789/0 conn(0x7f59800b0470 legacy=0x7f598005bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f597e59c700 1 -- 172.21.15.133:0/1565995247 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598005cf20 con 0x7f5980140410 2021-01-03T12:58:03.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f597e59c700 1 --2- 172.21.15.133:0/1565995247 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5980140410 0x7f5980146cc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f5968002f30 tx=0x7f5968006dc0).ready entity=mon.2 client_cookie=85649a7d8a253526 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:03.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f597d59a700 1 -- 172.21.15.133:0/1565995247 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59680096a0 con 0x7f5980140410 2021-01-03T12:58:03.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f597d59a700 1 -- 172.21.15.133:0/1565995247 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968009800 con 0x7f5980140410 2021-01-03T12:58:03.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f597d59a700 1 -- 172.21.15.133:0/1565995247 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5968009b60 con 0x7f5980140410 2021-01-03T12:58:03.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f5984927700 1 -- 172.21.15.133:0/1565995247 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5980140410 msgr2=0x7f5980146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f5984927700 1 --2- 172.21.15.133:0/1565995247 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5980140410 0x7f5980146cc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f5968002f30 tx=0x7f5968006dc0).stop 2021-01-03T12:58:03.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f5984927700 1 -- 172.21.15.133:0/1565995247 shutdown_connections 2021-01-03T12:58:03.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f5984927700 1 --2- 172.21.15.133:0/1565995247 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5980140410 0x7f5980146cc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f5984927700 1 --2- 172.21.15.133:0/1565995247 >> v2:172.21.15.16:3300/0 conn(0x7f59801407f0 0x7f5980142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f5984927700 1 -- 172.21.15.133:0/1565995247 >> 172.21.15.133:0/1565995247 conn(0x7f59800b95d0 msgr2=0x7f59800b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:03.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f5984927700 1 -- 172.21.15.133:0/1565995247 shutdown_connections 2021-01-03T12:58:03.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.155+0000 7f5984927700 1 -- 172.21.15.133:0/1565995247 wait complete. 2021-01-03T12:58:03.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f5984927700 1 Processor -- start 2021-01-03T12:58:03.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f5984927700 1 -- start start 2021-01-03T12:58:03.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f5984927700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f59800b0470 0x7f5980149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f5984927700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5980140410 0x7f5980155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f5984927700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59801407f0 0x7f5980151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f5984927700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5980140fe0 con 0x7f59801407f0 2021-01-03T12:58:03.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f5984927700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59801552d0 con 0x7f5980140410 2021-01-03T12:58:03.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f5984927700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5980155570 con 0x7f59800b0470 2021-01-03T12:58:03.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f597dd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5980140410 0x7f5980155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f597dd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5980140410 0x7f5980155cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59888/0 (socket says 172.21.15.133:59888) 2021-01-03T12:58:03.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f597dd9b700 1 -- 172.21.15.133:0/4028869136 learned_addr learned my addr 172.21.15.133:0/4028869136 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:03.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f597ed9d700 1 --2- 172.21.15.133:0/4028869136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59801407f0 0x7f5980151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f597e59c700 1 --2- 172.21.15.133:0/4028869136 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f59800b0470 0x7f5980149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f597dd9b700 1 -- 172.21.15.133:0/4028869136 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f59800b0470 msgr2=0x7f5980149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f597dd9b700 1 --2- 172.21.15.133:0/4028869136 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f59800b0470 0x7f5980149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f597dd9b700 1 -- 172.21.15.133:0/4028869136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59801407f0 msgr2=0x7f5980151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f597dd9b700 1 --2- 172.21.15.133:0/4028869136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59801407f0 0x7f5980151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f597dd9b700 1 -- 172.21.15.133:0/4028869136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5980155810 con 0x7f5980140410 2021-01-03T12:58:03.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f597ed9d700 1 --2- 172.21.15.133:0/4028869136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59801407f0 0x7f5980151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:03.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f597dd9b700 1 --2- 172.21.15.133:0/4028869136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5980140410 0x7f5980155cb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f597000c000 tx=0x7f5970006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:03.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f59777fe700 1 -- 172.21.15.133:0/4028869136 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f597000ca10 con 0x7f5980140410 2021-01-03T12:58:03.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f59777fe700 1 -- 172.21.15.133:0/4028869136 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597000cb70 con 0x7f5980140410 2021-01-03T12:58:03.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f5984927700 1 -- 172.21.15.133:0/4028869136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59800b1b70 con 0x7f5980140410 2021-01-03T12:58:03.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f59777fe700 1 -- 172.21.15.133:0/4028869136 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59700123f0 con 0x7f5980140410 2021-01-03T12:58:03.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.159+0000 7f5984927700 1 -- 172.21.15.133:0/4028869136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5980140c60 con 0x7f5980140410 2021-01-03T12:58:03.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.163+0000 7f59777fe700 1 -- 172.21.15.133:0/4028869136 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5970012550 con 0x7f5980140410 2021-01-03T12:58:03.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.163+0000 7f5984927700 1 -- 172.21.15.133:0/4028869136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59801559a0 con 0x7f5980140410 2021-01-03T12:58:03.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.163+0000 7f59777fe700 1 --2- 172.21.15.133:0/4028869136 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5964055330 0x7f59640577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.163+0000 7f59777fe700 1 -- 172.21.15.133:0/4028869136 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f597006e4b0 con 0x7f5980140410 2021-01-03T12:58:03.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.163+0000 7f597e59c700 1 --2- 172.21.15.133:0/4028869136 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5964055330 0x7f59640577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.163+0000 7f597e59c700 1 --2- 172.21.15.133:0/4028869136 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5964055330 0x7f59640577f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f5968019000 tx=0x7f5968015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:03.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.167+0000 7f59777fe700 1 -- 172.21.15.133:0/4028869136 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f59700446b0 con 0x7f5980140410 2021-01-03T12:58:03.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.311+0000 7f5984927700 1 -- 172.21.15.133:0/4028869136 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5980057300 con 0x7f5980140410 2021-01-03T12:58:03.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.311+0000 7f59777fe700 1 -- 172.21.15.133:0/4028869136 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5970047cd0 con 0x7f5980140410 2021-01-03T12:58:03.315 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:03.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.315+0000 7f5984927700 1 -- 172.21.15.133:0/4028869136 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5964055330 msgr2=0x7f59640577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.315+0000 7f5984927700 1 --2- 172.21.15.133:0/4028869136 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5964055330 0x7f59640577f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f5968019000 tx=0x7f5968015000).stop 2021-01-03T12:58:03.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.315+0000 7f5984927700 1 -- 172.21.15.133:0/4028869136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5980140410 msgr2=0x7f5980155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.315+0000 7f5984927700 1 --2- 172.21.15.133:0/4028869136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5980140410 0x7f5980155cb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f597000c000 tx=0x7f5970006dc0).stop 2021-01-03T12:58:03.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.315+0000 7f5984927700 1 -- 172.21.15.133:0/4028869136 shutdown_connections 2021-01-03T12:58:03.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.315+0000 7f5984927700 1 --2- 172.21.15.133:0/4028869136 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5964055330 0x7f59640577f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.315+0000 7f5984927700 1 --2- 172.21.15.133:0/4028869136 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59801407f0 0x7f5980151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.315+0000 7f5984927700 1 --2- 172.21.15.133:0/4028869136 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f59800b0470 0x7f5980149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.315+0000 7f5984927700 1 --2- 172.21.15.133:0/4028869136 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5980140410 0x7f5980155cb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.315+0000 7f5984927700 1 -- 172.21.15.133:0/4028869136 >> 172.21.15.133:0/4028869136 conn(0x7f59800b95d0 msgr2=0x7f59800b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:03.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.315+0000 7f5984927700 1 -- 172.21.15.133:0/4028869136 shutdown_connections 2021-01-03T12:58:03.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.315+0000 7f5984927700 1 -- 172.21.15.133:0/4028869136 wait complete. 2021-01-03T12:58:03.328 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T12:58:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce69b5c700 1 Processor -- start 2021-01-03T12:58:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce69b5c700 1 -- start start 2021-01-03T12:58:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce69b5c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fce640b5c10 0x7fce640aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce69b5c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fce6414aee0 0x7fce64144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce69b5c700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce64098550 con 0x7fce640b0670 2021-01-03T12:58:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce69b5c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce640b5ff0 con 0x7fce6414aee0 2021-01-03T12:58:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce69b5c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce640b0b10 con 0x7fce640b5c10 2021-01-03T12:58:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce63fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fce6414aee0 0x7fce64144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce63fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fce6414aee0 0x7fce64144470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59900/0 (socket says 172.21.15.133:59900) 2021-01-03T12:58:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce63fff700 1 -- 172.21.15.133:0/3948946659 learned_addr learned my addr 172.21.15.133:0/3948946659 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce637fe700 1 --2- 172.21.15.133:0/3948946659 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fce640b5c10 0x7fce640aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce63fff700 1 -- 172.21.15.133:0/3948946659 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fce640b5c10 msgr2=0x7fce640aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce63fff700 1 --2- 172.21.15.133:0/3948946659 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fce640b5c10 0x7fce640aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce63fff700 1 -- 172.21.15.133:0/3948946659 >> v1:172.21.15.16:6789/0 conn(0x7fce640b0670 legacy=0x7fce6414a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce63fff700 1 -- 172.21.15.133:0/3948946659 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce64098780 con 0x7fce6414aee0 2021-01-03T12:58:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce63fff700 1 --2- 172.21.15.133:0/3948946659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce6414aee0 0x7fce64144470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fce5c0032b0 tx=0x7fce5c009270).ready entity=mon.1 client_cookie=55a5daf9a1005712 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce62ffd700 1 -- 172.21.15.133:0/3948946659 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce5c009e60 con 0x7fce6414aee0 2021-01-03T12:58:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce62ffd700 1 -- 172.21.15.133:0/3948946659 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5c00bc00 con 0x7fce6414aee0 2021-01-03T12:58:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce62ffd700 1 -- 172.21.15.133:0/3948946659 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce5c00bd70 con 0x7fce6414aee0 2021-01-03T12:58:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce69b5c700 1 -- 172.21.15.133:0/3948946659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce6414aee0 msgr2=0x7fce64144470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce69b5c700 1 --2- 172.21.15.133:0/3948946659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce6414aee0 0x7fce64144470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fce5c0032b0 tx=0x7fce5c009270).stop 2021-01-03T12:58:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce69b5c700 1 -- 172.21.15.133:0/3948946659 shutdown_connections 2021-01-03T12:58:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce69b5c700 1 --2- 172.21.15.133:0/3948946659 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fce640b5c10 0x7fce640aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce69b5c700 1 --2- 172.21.15.133:0/3948946659 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce6414aee0 0x7fce64144470 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce69b5c700 1 -- 172.21.15.133:0/3948946659 >> 172.21.15.133:0/3948946659 conn(0x7fce6405c8c0 msgr2=0x7fce640b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:03.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce69b5c700 1 -- 172.21.15.133:0/3948946659 shutdown_connections 2021-01-03T12:58:03.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.443+0000 7fce69b5c700 1 -- 172.21.15.133:0/3948946659 wait complete. 2021-01-03T12:58:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce69b5c700 1 Processor -- start 2021-01-03T12:58:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce69b5c700 1 -- start start 2021-01-03T12:58:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce69b5c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce640b0670 0x7fce6414d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce69b5c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce640b5c10 0x7fce640ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce69b5c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fce6414aee0 0x7fce640acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce69b5c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce64145850 con 0x7fce640b5c10 2021-01-03T12:58:03.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce69b5c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce640adab0 con 0x7fce640b0670 2021-01-03T12:58:03.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce69b5c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce640af2a0 con 0x7fce6414aee0 2021-01-03T12:58:03.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce637fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce640b0670 0x7fce6414d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce637fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce640b0670 0x7fce6414d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59902/0 (socket says 172.21.15.133:59902) 2021-01-03T12:58:03.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce637fe700 1 -- 172.21.15.133:0/3397906945 learned_addr learned my addr 172.21.15.133:0/3397906945 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:03.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce63fff700 1 --2- 172.21.15.133:0/3397906945 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fce6414aee0 0x7fce640acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce5bfff700 1 --2- 172.21.15.133:0/3397906945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce640b5c10 0x7fce640ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce637fe700 1 -- 172.21.15.133:0/3397906945 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fce6414aee0 msgr2=0x7fce640acb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce637fe700 1 --2- 172.21.15.133:0/3397906945 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fce6414aee0 0x7fce640acb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce637fe700 1 -- 172.21.15.133:0/3397906945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce640b5c10 msgr2=0x7fce640ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce637fe700 1 --2- 172.21.15.133:0/3397906945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce640b5c10 0x7fce640ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce637fe700 1 -- 172.21.15.133:0/3397906945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce640ae2e0 con 0x7fce640b0670 2021-01-03T12:58:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce63fff700 1 --2- 172.21.15.133:0/3397906945 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fce6414aee0 0x7fce640acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce637fe700 1 --2- 172.21.15.133:0/3397906945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce640b0670 0x7fce6414d0d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fce5400c000 tx=0x7fce54006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce617fa700 1 -- 172.21.15.133:0/3397906945 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce5400ca10 con 0x7fce640b0670 2021-01-03T12:58:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce617fa700 1 -- 172.21.15.133:0/3397906945 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5400cb70 con 0x7fce640b0670 2021-01-03T12:58:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce69b5c700 1 -- 172.21.15.133:0/3397906945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce640adf70 con 0x7fce640b0670 2021-01-03T12:58:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce617fa700 1 -- 172.21.15.133:0/3397906945 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce540123f0 con 0x7fce640b0670 2021-01-03T12:58:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.447+0000 7fce69b5c700 1 -- 172.21.15.133:0/3397906945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce640aee80 con 0x7fce640b0670 2021-01-03T12:58:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.451+0000 7fce69b5c700 1 -- 172.21.15.133:0/3397906945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce640af460 con 0x7fce640b0670 2021-01-03T12:58:03.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.451+0000 7fce617fa700 1 -- 172.21.15.133:0/3397906945 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fce54012550 con 0x7fce640b0670 2021-01-03T12:58:03.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.451+0000 7fce617fa700 1 --2- 172.21.15.133:0/3397906945 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fce480554e0 0x7fce480579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.451+0000 7fce617fa700 1 -- 172.21.15.133:0/3397906945 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fce5406e300 con 0x7fce640b0670 2021-01-03T12:58:03.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.451+0000 7fce5bfff700 1 --2- 172.21.15.133:0/3397906945 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fce480554e0 0x7fce480579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.451+0000 7fce5bfff700 1 --2- 172.21.15.133:0/3397906945 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fce480554e0 0x7fce480579a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fce4c00d000 tx=0x7fce4c007b60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:03.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.455+0000 7fce617fa700 1 -- 172.21.15.133:0/3397906945 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fce540445a0 con 0x7fce640b0670 2021-01-03T12:58:03.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.599+0000 7fce69b5c700 1 -- 172.21.15.133:0/3397906945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fce64057300 con 0x7fce640b0670 2021-01-03T12:58:03.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.599+0000 7fce617fa700 1 -- 172.21.15.133:0/3397906945 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fce54047bc0 con 0x7fce640b0670 2021-01-03T12:58:03.600 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:03.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.599+0000 7fce69b5c700 1 -- 172.21.15.133:0/3397906945 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fce480554e0 msgr2=0x7fce480579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.599+0000 7fce69b5c700 1 --2- 172.21.15.133:0/3397906945 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fce480554e0 0x7fce480579a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fce4c00d000 tx=0x7fce4c007b60).stop 2021-01-03T12:58:03.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.599+0000 7fce69b5c700 1 -- 172.21.15.133:0/3397906945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce640b0670 msgr2=0x7fce6414d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.599+0000 7fce69b5c700 1 --2- 172.21.15.133:0/3397906945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce640b0670 0x7fce6414d0d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fce5400c000 tx=0x7fce54006dc0).stop 2021-01-03T12:58:03.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.599+0000 7fce69b5c700 1 -- 172.21.15.133:0/3397906945 shutdown_connections 2021-01-03T12:58:03.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.599+0000 7fce69b5c700 1 --2- 172.21.15.133:0/3397906945 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fce480554e0 0x7fce480579a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.599+0000 7fce69b5c700 1 --2- 172.21.15.133:0/3397906945 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fce6414aee0 0x7fce640acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.599+0000 7fce69b5c700 1 --2- 172.21.15.133:0/3397906945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce640b0670 0x7fce6414d0d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.599+0000 7fce69b5c700 1 --2- 172.21.15.133:0/3397906945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fce640b5c10 0x7fce640ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.599+0000 7fce69b5c700 1 -- 172.21.15.133:0/3397906945 >> 172.21.15.133:0/3397906945 conn(0x7fce6405c8c0 msgr2=0x7fce640b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:03.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.599+0000 7fce69b5c700 1 -- 172.21.15.133:0/3397906945 shutdown_connections 2021-01-03T12:58:03.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.599+0000 7fce69b5c700 1 -- 172.21.15.133:0/3397906945 wait complete. 2021-01-03T12:58:03.614 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T12:58:03.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.727+0000 7f9adabf3700 1 Processor -- start 2021-01-03T12:58:03.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.727+0000 7f9adabf3700 1 -- start start 2021-01-03T12:58:03.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.727+0000 7f9adabf3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ad40b2e80 0x7f9ad40ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.727+0000 7f9adabf3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ad4144120 0x7f9ad41445b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.727+0000 7f9adabf3700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad40b7880 con 0x7f9ad40ace10 2021-01-03T12:58:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.727+0000 7f9adabf3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad40ad6e0 con 0x7f9ad40b2e80 2021-01-03T12:58:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.727+0000 7f9adabf3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad40adad0 con 0x7f9ad4144120 2021-01-03T12:58:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.727+0000 7f9ad93f0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ad40b2e80 0x7f9ad40ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.727+0000 7f9ad93f0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ad40b2e80 0x7f9ad40ad1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59910/0 (socket says 172.21.15.133:59910) 2021-01-03T12:58:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.727+0000 7f9ad93f0700 1 -- 172.21.15.133:0/222383192 learned_addr learned my addr 172.21.15.133:0/222383192 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.727+0000 7f9ada3f2700 1 --2- 172.21.15.133:0/222383192 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ad4144120 0x7f9ad41445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.731+0000 7f9ad93f0700 1 -- 172.21.15.133:0/222383192 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ad4144120 msgr2=0x7f9ad41445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.731+0000 7f9ad93f0700 1 --2- 172.21.15.133:0/222383192 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ad4144120 0x7f9ad41445b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.731+0000 7f9ad93f0700 1 -- 172.21.15.133:0/222383192 >> v1:172.21.15.16:6789/0 conn(0x7f9ad40ace10 legacy=0x7f9ad40b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.731+0000 7f9ad93f0700 1 -- 172.21.15.133:0/222383192 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad40add70 con 0x7f9ad40b2e80 2021-01-03T12:58:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.731+0000 7f9ada3f2700 1 --2- 172.21.15.133:0/222383192 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ad4144120 0x7f9ad41445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.731+0000 7f9ad93f0700 1 --2- 172.21.15.133:0/222383192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad40b2e80 0x7f9ad40ad1f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f9ac8002f30 tx=0x7f9ac8006e80).ready entity=mon.1 client_cookie=9b0fe08df281fda5 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.731+0000 7f9ad8bef700 1 -- 172.21.15.133:0/222383192 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ac80097f0 con 0x7f9ad40b2e80 2021-01-03T12:58:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.731+0000 7f9ad8bef700 1 -- 172.21.15.133:0/222383192 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac8009950 con 0x7f9ad40b2e80 2021-01-03T12:58:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.731+0000 7f9ad8bef700 1 -- 172.21.15.133:0/222383192 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ac8009cb0 con 0x7f9ad40b2e80 2021-01-03T12:58:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.731+0000 7f9adabf3700 1 -- 172.21.15.133:0/222383192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad40b2e80 msgr2=0x7f9ad40ad1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.731+0000 7f9adabf3700 1 --2- 172.21.15.133:0/222383192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad40b2e80 0x7f9ad40ad1f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f9ac8002f30 tx=0x7f9ac8006e80).stop 2021-01-03T12:58:03.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.731+0000 7f9adabf3700 1 -- 172.21.15.133:0/222383192 shutdown_connections 2021-01-03T12:58:03.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.731+0000 7f9adabf3700 1 --2- 172.21.15.133:0/222383192 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ad4144120 0x7f9ad41445b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.731+0000 7f9adabf3700 1 --2- 172.21.15.133:0/222383192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad40b2e80 0x7f9ad40ad1f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.731+0000 7f9adabf3700 1 -- 172.21.15.133:0/222383192 >> 172.21.15.133:0/222383192 conn(0x7f9ad405bdf0 msgr2=0x7f9ad405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.731+0000 7f9adabf3700 1 -- 172.21.15.133:0/222383192 shutdown_connections 2021-01-03T12:58:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.731+0000 7f9adabf3700 1 -- 172.21.15.133:0/222383192 wait complete. 2021-01-03T12:58:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9adabf3700 1 Processor -- start 2021-01-03T12:58:03.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9adabf3700 1 -- start start 2021-01-03T12:58:03.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9adabf3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad40ace10 0x7f9ad413f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9adabf3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ad40b2e80 0x7f9ad413fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9adabf3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ad4144120 0x7f9ad4140570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9adabf3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad413db20 con 0x7f9ad40b2e80 2021-01-03T12:58:03.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9adabf3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad413f0e0 con 0x7f9ad40ace10 2021-01-03T12:58:03.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9adabf3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad4141350 con 0x7f9ad4144120 2021-01-03T12:58:03.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9ad9bf1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad40ace10 0x7f9ad413f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9ad9bf1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad40ace10 0x7f9ad413f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59916/0 (socket says 172.21.15.133:59916) 2021-01-03T12:58:03.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9ad9bf1700 1 -- 172.21.15.133:0/2709196128 learned_addr learned my addr 172.21.15.133:0/2709196128 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:03.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9ada3f2700 1 --2- 172.21.15.133:0/2709196128 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ad4144120 0x7f9ad4140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9ad93f0700 1 --2- 172.21.15.133:0/2709196128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ad40b2e80 0x7f9ad413fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9ad9bf1700 1 -- 172.21.15.133:0/2709196128 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ad4144120 msgr2=0x7f9ad4140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9ad9bf1700 1 --2- 172.21.15.133:0/2709196128 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ad4144120 0x7f9ad4140570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9ad9bf1700 1 -- 172.21.15.133:0/2709196128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ad40b2e80 msgr2=0x7f9ad413fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9ad9bf1700 1 --2- 172.21.15.133:0/2709196128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ad40b2e80 0x7f9ad413fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9ad9bf1700 1 -- 172.21.15.133:0/2709196128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad4140a60 con 0x7f9ad40ace10 2021-01-03T12:58:03.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9ada3f2700 1 --2- 172.21.15.133:0/2709196128 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ad4144120 0x7f9ad4140570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:03.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9ad9bf1700 1 --2- 172.21.15.133:0/2709196128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad40ace10 0x7f9ad413f820 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f9ad4063f50 tx=0x7f9ad0007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:03.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9ac6ffd700 1 -- 172.21.15.133:0/2709196128 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ad00072a0 con 0x7f9ad40ace10 2021-01-03T12:58:03.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9ac6ffd700 1 -- 172.21.15.133:0/2709196128 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad00064e0 con 0x7f9ad40ace10 2021-01-03T12:58:03.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9ac6ffd700 1 -- 172.21.15.133:0/2709196128 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ad0006840 con 0x7f9ad40ace10 2021-01-03T12:58:03.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9adabf3700 1 -- 172.21.15.133:0/2709196128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad4062e80 con 0x7f9ad40ace10 2021-01-03T12:58:03.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.735+0000 7f9adabf3700 1 -- 172.21.15.133:0/2709196128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad409c0b0 con 0x7f9ad40ace10 2021-01-03T12:58:03.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.739+0000 7f9adabf3700 1 -- 172.21.15.133:0/2709196128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad413f250 con 0x7f9ad40ace10 2021-01-03T12:58:03.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.739+0000 7f9ac6ffd700 1 -- 172.21.15.133:0/2709196128 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9ad0019020 con 0x7f9ad40ace10 2021-01-03T12:58:03.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.739+0000 7f9ac6ffd700 1 --2- 172.21.15.133:0/2709196128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9ab4055330 0x7f9ab40577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:03.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.739+0000 7f9ad93f0700 1 --2- 172.21.15.133:0/2709196128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9ab4055330 0x7f9ab40577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:03.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.739+0000 7f9ac6ffd700 1 -- 172.21.15.133:0/2709196128 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9ad006d900 con 0x7f9ad40ace10 2021-01-03T12:58:03.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.739+0000 7f9ad93f0700 1 --2- 172.21.15.133:0/2709196128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9ab4055330 0x7f9ab40577f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9ac801a000 tx=0x7f9ac8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:03.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.743+0000 7f9ac6ffd700 1 -- 172.21.15.133:0/2709196128 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9ad0043a70 con 0x7f9ad40ace10 2021-01-03T12:58:03.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.887+0000 7f9adabf3700 1 -- 172.21.15.133:0/2709196128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ad4057300 con 0x7f9ad40ace10 2021-01-03T12:58:03.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.887+0000 7f9ac6ffd700 1 -- 172.21.15.133:0/2709196128 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9ad0047090 con 0x7f9ad40ace10 2021-01-03T12:58:03.890 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:03.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.891+0000 7f9adabf3700 1 -- 172.21.15.133:0/2709196128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9ab4055330 msgr2=0x7f9ab40577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.891+0000 7f9adabf3700 1 --2- 172.21.15.133:0/2709196128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9ab4055330 0x7f9ab40577f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f9ac801a000 tx=0x7f9ac8015000).stop 2021-01-03T12:58:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.891+0000 7f9adabf3700 1 -- 172.21.15.133:0/2709196128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad40ace10 msgr2=0x7f9ad413f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:03.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.891+0000 7f9adabf3700 1 --2- 172.21.15.133:0/2709196128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad40ace10 0x7f9ad413f820 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f9ad4063f50 tx=0x7f9ad0007be0).stop 2021-01-03T12:58:03.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.891+0000 7f9adabf3700 1 -- 172.21.15.133:0/2709196128 shutdown_connections 2021-01-03T12:58:03.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.891+0000 7f9adabf3700 1 --2- 172.21.15.133:0/2709196128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9ab4055330 0x7f9ab40577f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.891+0000 7f9adabf3700 1 --2- 172.21.15.133:0/2709196128 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ad4144120 0x7f9ad4140570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.891+0000 7f9adabf3700 1 --2- 172.21.15.133:0/2709196128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad40ace10 0x7f9ad413f820 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.891+0000 7f9adabf3700 1 --2- 172.21.15.133:0/2709196128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ad40b2e80 0x7f9ad413fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:03.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.891+0000 7f9adabf3700 1 -- 172.21.15.133:0/2709196128 >> 172.21.15.133:0/2709196128 conn(0x7f9ad405bdf0 msgr2=0x7f9ad405c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:03.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.891+0000 7f9adabf3700 1 -- 172.21.15.133:0/2709196128 shutdown_connections 2021-01-03T12:58:03.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:03.891+0000 7f9adabf3700 1 -- 172.21.15.133:0/2709196128 wait complete. 2021-01-03T12:58:03.903 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-01-03T12:58:03.904 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-01-03T12:58:03.904 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2021-01-03T12:58:04.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.015+0000 7fba992c3700 1 Processor -- start 2021-01-03T12:58:04.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.015+0000 7fba992c3700 1 -- start start 2021-01-03T12:58:04.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.015+0000 7fba992c3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fba940b9b60 0x7fba940b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.015+0000 7fba992c3700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fba940b4de0 0x7fba94146b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.015+0000 7fba992c3700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba94147030 con 0x7fba940b4980 2021-01-03T12:58:04.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.015+0000 7fba992c3700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba940aed30 con 0x7fba940b4de0 2021-01-03T12:58:04.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.015+0000 7fba992c3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba940605f0 con 0x7fba940b9b60 2021-01-03T12:58:04.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba93fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fba940b9b60 0x7fba940b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba937fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fba940b4980 0x7fba94146430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:59684/0 (socket says 172.21.15.133:59684) 2021-01-03T12:58:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba937fe700 1 -- 172.21.15.133:0/2465071428 learned_addr learned my addr 172.21.15.133:0/2465071428 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:04.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba92ffd700 1 -- 172.21.15.133:0/2465071428 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366893312 0 0) 0x7fba94147030 con 0x7fba940b4980 2021-01-03T12:58:04.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba92ffd700 1 -- 172.21.15.133:0/2465071428 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba74003230 con 0x7fba940b4980 2021-01-03T12:58:04.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba98ac2700 1 --2- 172.21.15.133:0/2465071428 >> v2:172.21.15.16:3300/0 conn(0x7fba940b4de0 0x7fba94146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba93fff700 1 -- 172.21.15.133:0/2465071428 >> v2:172.21.15.16:3300/0 conn(0x7fba940b4de0 msgr2=0x7fba94146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:04.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba93fff700 1 --2- 172.21.15.133:0/2465071428 >> v2:172.21.15.16:3300/0 conn(0x7fba940b4de0 0x7fba94146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba93fff700 1 -- 172.21.15.133:0/2465071428 >> v1:172.21.15.16:6789/0 conn(0x7fba940b4980 legacy=0x7fba94146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba93fff700 1 -- 172.21.15.133:0/2465071428 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba940600b0 con 0x7fba940b9b60 2021-01-03T12:58:04.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba98ac2700 1 --2- 172.21.15.133:0/2465071428 >> v2:172.21.15.16:3300/0 conn(0x7fba940b4de0 0x7fba94146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:04.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba93fff700 1 --2- 172.21.15.133:0/2465071428 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fba940b9b60 0x7fba940b9f40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fba840032b0 tx=0x7fba840091a0).ready entity=mon.2 client_cookie=b209514dbb4f2e5c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:04.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba92ffd700 1 -- 172.21.15.133:0/2465071428 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba8400b9a0 con 0x7fba940b9b60 2021-01-03T12:58:04.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba92ffd700 1 -- 172.21.15.133:0/2465071428 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8400bb00 con 0x7fba940b9b60 2021-01-03T12:58:04.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba92ffd700 1 -- 172.21.15.133:0/2465071428 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba8400bc70 con 0x7fba940b9b60 2021-01-03T12:58:04.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba992c3700 1 -- 172.21.15.133:0/2465071428 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fba940b9b60 msgr2=0x7fba940b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba992c3700 1 --2- 172.21.15.133:0/2465071428 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fba940b9b60 0x7fba940b9f40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fba840032b0 tx=0x7fba840091a0).stop 2021-01-03T12:58:04.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba992c3700 1 -- 172.21.15.133:0/2465071428 shutdown_connections 2021-01-03T12:58:04.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba992c3700 1 --2- 172.21.15.133:0/2465071428 >> v2:172.21.15.16:3300/0 conn(0x7fba940b4de0 0x7fba94146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba992c3700 1 --2- 172.21.15.133:0/2465071428 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fba940b9b60 0x7fba940b9f40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba992c3700 1 -- 172.21.15.133:0/2465071428 >> 172.21.15.133:0/2465071428 conn(0x7fba940b69e0 msgr2=0x7fba940b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:04.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba992c3700 1 -- 172.21.15.133:0/2465071428 shutdown_connections 2021-01-03T12:58:04.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.019+0000 7fba992c3700 1 -- 172.21.15.133:0/2465071428 wait complete. 2021-01-03T12:58:04.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba992c3700 1 Processor -- start 2021-01-03T12:58:04.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba992c3700 1 -- start start 2021-01-03T12:58:04.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba992c3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba940b4980 0x7fba94141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba992c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba940b4de0 0x7fba941422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba992c3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fba940b9b60 0x7fba940b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba992c3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba941556c0 con 0x7fba940b4980 2021-01-03T12:58:04.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba992c3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba941411b0 con 0x7fba940b4de0 2021-01-03T12:58:04.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba992c3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba94141be0 con 0x7fba940b9b60 2021-01-03T12:58:04.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba937fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba940b4de0 0x7fba941422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba937fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba940b4de0 0x7fba941422a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59932/0 (socket says 172.21.15.133:59932) 2021-01-03T12:58:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba937fe700 1 -- 172.21.15.133:0/592817398 learned_addr learned my addr 172.21.15.133:0/592817398 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba937fe700 1 -- 172.21.15.133:0/592817398 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fba940b9b60 msgr2=0x7fba940b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba937fe700 1 --2- 172.21.15.133:0/592817398 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fba940b9b60 0x7fba940b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T12:58:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba937fe700 1 -- 172.21.15.133:0/592817398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba940b4980 msgr2=0x7fba94141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba937fe700 1 --2- 172.21.15.133:0/592817398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba940b4980 0x7fba94141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T12:58:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba937fe700 1 -- 172.21.15.133:0/592817398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba94140f10 con 0x7fba940b4de0 2021-01-03T12:58:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba937fe700 1 --2- 172.21.15.133:0/592817398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba940b4de0 0x7fba941422a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fba7c0010d0 tx=0x7fba7c007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba917fa700 1 -- 172.21.15.133:0/592817398 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba7c007320 con 0x7fba940b4de0 2021-01-03T12:58:04.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba992c3700 1 -- 172.21.15.133:0/592817398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba94141940 con 0x7fba940b4de0 2021-01-03T12:58:04.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba917fa700 1 -- 172.21.15.133:0/592817398 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c007480 con 0x7fba940b4de0 2021-01-03T12:58:04.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba992c3700 1 -- 172.21.15.133:0/592817398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba94140c10 con 0x7fba940b4de0 2021-01-03T12:58:04.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba917fa700 1 -- 172.21.15.133:0/592817398 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba7c0057b0 con 0x7fba940b4de0 2021-01-03T12:58:04.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.023+0000 7fba992c3700 1 -- 172.21.15.133:0/592817398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6c0033e0 con 0x7fba940b4de0 2021-01-03T12:58:04.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.027+0000 7fba917fa700 1 -- 172.21.15.133:0/592817398 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fba7c010030 con 0x7fba940b4de0 2021-01-03T12:58:04.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.027+0000 7fba917fa700 1 --2- 172.21.15.133:0/592817398 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fba78055330 0x7fba780577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.027+0000 7fba917fa700 1 -- 172.21.15.133:0/592817398 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fba7c06dd50 con 0x7fba940b4de0 2021-01-03T12:58:04.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.027+0000 7fba93fff700 1 --2- 172.21.15.133:0/592817398 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fba78055330 0x7fba780577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.027+0000 7fba93fff700 1 --2- 172.21.15.133:0/592817398 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fba78055330 0x7fba780577f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fba840032b0 tx=0x7fba84016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:04.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.031+0000 7fba917fa700 1 -- 172.21.15.133:0/592817398 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fba7c043f50 con 0x7fba940b4de0 2021-01-03T12:58:04.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.211+0000 7fba992c3700 1 -- 172.21.15.133:0/592817398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fba6c002270 con 0x7fba940b4de0 2021-01-03T12:58:04.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.215+0000 7fba917fa700 1 -- 172.21.15.133:0/592817398 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+133624 (secure 0 0 0) 0x7fba7c047570 con 0x7fba940b4de0 2021-01-03T12:58:04.222 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:04.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.219+0000 7fba992c3700 1 -- 172.21.15.133:0/592817398 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fba78055330 msgr2=0x7fba780577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.219+0000 7fba992c3700 1 --2- 172.21.15.133:0/592817398 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fba78055330 0x7fba780577f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fba840032b0 tx=0x7fba84016000).stop 2021-01-03T12:58:04.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.219+0000 7fba992c3700 1 -- 172.21.15.133:0/592817398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba940b4de0 msgr2=0x7fba941422a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.219+0000 7fba992c3700 1 --2- 172.21.15.133:0/592817398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba940b4de0 0x7fba941422a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fba7c0010d0 tx=0x7fba7c007aa0).stop 2021-01-03T12:58:04.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.219+0000 7fba992c3700 1 -- 172.21.15.133:0/592817398 shutdown_connections 2021-01-03T12:58:04.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.219+0000 7fba992c3700 1 --2- 172.21.15.133:0/592817398 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fba78055330 0x7fba780577f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.219+0000 7fba992c3700 1 --2- 172.21.15.133:0/592817398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fba940b4980 0x7fba94141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T12:58:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.219+0000 7fba992c3700 1 --2- 172.21.15.133:0/592817398 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fba940b9b60 0x7fba940b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T12:58:04.226 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.219+0000 7fba992c3700 1 --2- 172.21.15.133:0/592817398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba940b4de0 0x7fba941422a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.219+0000 7fba992c3700 1 -- 172.21.15.133:0/592817398 >> 172.21.15.133:0/592817398 conn(0x7fba940b69e0 msgr2=0x7fba9405c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.219+0000 7fba992c3700 1 -- 172.21.15.133:0/592817398 shutdown_connections 2021-01-03T12:58:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.219+0000 7fba992c3700 1 -- 172.21.15.133:0/592817398 wait complete. 2021-01-03T12:58:04.234 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":5,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":11943},{"type":"v1","addr":"172.21.15.133:6801","nonce":11943}]},"active_addr":"172.21.15.133:6801/11943","active_change":"2021-01-03T12:57:47.016251+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":3118243384}]},{"addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":3513617879}]},{"addrvec":[{"type":"v2","addr":"172.21.15.133:0","nonce":2868315983}]}]}} 2021-01-03T12:58:04.276 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-01-03T12:58:04.276 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2021-01-03T12:58:04.277 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:04.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af835c700 1 Processor -- start 2021-01-03T12:58:04.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af835c700 1 -- start start 2021-01-03T12:58:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af835c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8af005cc10 0x7f8af01437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af835c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8af00b02d0 0x7f8af0146a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af835c700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af005c510 con 0x7f8af005c130 2021-01-03T12:58:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af835c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af00b0780 con 0x7f8af00b02d0 2021-01-03T12:58:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af835c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af00b5c10 con 0x7f8af005cc10 2021-01-03T12:58:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af58f7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8af005cc10 0x7f8af01437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af58f7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8af005cc10 0x7f8af01437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59938/0 (socket says 172.21.15.133:59938) 2021-01-03T12:58:04.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af58f7700 1 -- 172.21.15.133:0/297051940 learned_addr learned my addr 172.21.15.133:0/297051940 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:04.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af68f9700 1 --2- 172.21.15.133:0/297051940 >> v2:172.21.15.16:3300/0 conn(0x7f8af00b02d0 0x7f8af0146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af58f7700 1 -- 172.21.15.133:0/297051940 >> v2:172.21.15.16:3300/0 conn(0x7f8af00b02d0 msgr2=0x7f8af0146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:04.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af58f7700 1 --2- 172.21.15.133:0/297051940 >> v2:172.21.15.16:3300/0 conn(0x7f8af00b02d0 0x7f8af0146a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af58f7700 1 -- 172.21.15.133:0/297051940 >> v1:172.21.15.16:6789/0 conn(0x7f8af005c130 legacy=0x7f8af0146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:04.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af58f7700 1 -- 172.21.15.133:0/297051940 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af00af8f0 con 0x7f8af005cc10 2021-01-03T12:58:04.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af68f9700 1 --2- 172.21.15.133:0/297051940 >> v2:172.21.15.16:3300/0 conn(0x7f8af00b02d0 0x7f8af0146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:04.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af58f7700 1 --2- 172.21.15.133:0/297051940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8af005cc10 0x7f8af01437e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8af0067f50 tx=0x7f8aec006e80).ready entity=mon.1 client_cookie=e4a2e276f0fc180f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af50f6700 1 -- 172.21.15.133:0/297051940 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aec0097b0 con 0x7f8af005cc10 2021-01-03T12:58:04.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af50f6700 1 -- 172.21.15.133:0/297051940 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec009910 con 0x7f8af005cc10 2021-01-03T12:58:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af50f6700 1 -- 172.21.15.133:0/297051940 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aec009a80 con 0x7f8af005cc10 2021-01-03T12:58:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af835c700 1 -- 172.21.15.133:0/297051940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8af005cc10 msgr2=0x7f8af01437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.391+0000 7f8af835c700 1 --2- 172.21.15.133:0/297051940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8af005cc10 0x7f8af01437e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8af0067f50 tx=0x7f8aec006e80).stop 2021-01-03T12:58:04.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.395+0000 7f8af835c700 1 -- 172.21.15.133:0/297051940 shutdown_connections 2021-01-03T12:58:04.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.395+0000 7f8af835c700 1 --2- 172.21.15.133:0/297051940 >> v2:172.21.15.16:3300/0 conn(0x7f8af00b02d0 0x7f8af0146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.395+0000 7f8af835c700 1 --2- 172.21.15.133:0/297051940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8af005cc10 0x7f8af01437e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.395+0000 7f8af835c700 1 -- 172.21.15.133:0/297051940 >> 172.21.15.133:0/297051940 conn(0x7f8af00b95d0 msgr2=0x7f8af00b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:04.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.395+0000 7f8af835c700 1 -- 172.21.15.133:0/297051940 shutdown_connections 2021-01-03T12:58:04.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.395+0000 7f8af835c700 1 -- 172.21.15.133:0/297051940 wait complete. 2021-01-03T12:58:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.395+0000 7f8af835c700 1 Processor -- start 2021-01-03T12:58:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.395+0000 7f8af835c700 1 -- start start 2021-01-03T12:58:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.395+0000 7f8af835c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8af005c130 0x7f8af00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.395+0000 7f8af835c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8af005cc10 0x7f8af00b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.395+0000 7f8af835c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8af00b02d0 0x7f8af009d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.395+0000 7f8af835c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af00b2c50 con 0x7f8af00b02d0 2021-01-03T12:58:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.395+0000 7f8af835c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af0151f10 con 0x7f8af005c130 2021-01-03T12:58:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.395+0000 7f8af835c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af01521b0 con 0x7f8af005cc10 2021-01-03T12:58:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.395+0000 7f8af60f8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8af005c130 0x7f8af00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.395+0000 7f8af60f8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8af005c130 0x7f8af00b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59944/0 (socket says 172.21.15.133:59944) 2021-01-03T12:58:04.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.395+0000 7f8af60f8700 1 -- 172.21.15.133:0/2740847246 learned_addr learned my addr 172.21.15.133:0/2740847246 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:04.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8af58f7700 1 --2- 172.21.15.133:0/2740847246 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8af005cc10 0x7f8af00b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8af68f9700 1 --2- 172.21.15.133:0/2740847246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8af00b02d0 0x7f8af009d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8af60f8700 1 -- 172.21.15.133:0/2740847246 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8af005cc10 msgr2=0x7f8af00b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8af60f8700 1 --2- 172.21.15.133:0/2740847246 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8af005cc10 0x7f8af00b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8af60f8700 1 -- 172.21.15.133:0/2740847246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8af00b02d0 msgr2=0x7f8af009d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8af60f8700 1 --2- 172.21.15.133:0/2740847246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8af00b02d0 0x7f8af009d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8af60f8700 1 -- 172.21.15.133:0/2740847246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af009e590 con 0x7f8af005c130 2021-01-03T12:58:04.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8af60f8700 1 --2- 172.21.15.133:0/2740847246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8af005c130 0x7f8af00b2270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f8ae0001f60 tx=0x7f8ae0007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:04.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8adf7fe700 1 -- 172.21.15.133:0/2740847246 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ae000e4a0 con 0x7f8af005c130 2021-01-03T12:58:04.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8adf7fe700 1 -- 172.21.15.133:0/2740847246 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae000e600 con 0x7f8af005c130 2021-01-03T12:58:04.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8af835c700 1 -- 172.21.15.133:0/2740847246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af00b30d0 con 0x7f8af005c130 2021-01-03T12:58:04.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8adf7fe700 1 -- 172.21.15.133:0/2740847246 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ae000e960 con 0x7f8af005c130 2021-01-03T12:58:04.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8af835c700 1 -- 172.21.15.133:0/2740847246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af009c1b0 con 0x7f8af005c130 2021-01-03T12:58:04.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8af835c700 1 -- 172.21.15.133:0/2740847246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af009e790 con 0x7f8af005c130 2021-01-03T12:58:04.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8adf7fe700 1 -- 172.21.15.133:0/2740847246 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8ae0019030 con 0x7f8af005c130 2021-01-03T12:58:04.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8adf7fe700 1 --2- 172.21.15.133:0/2740847246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ad0055330 0x7f8ad00577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8adf7fe700 1 -- 172.21.15.133:0/2740847246 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8ae006d3d0 con 0x7f8af005c130 2021-01-03T12:58:04.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.399+0000 7f8af58f7700 1 --2- 172.21.15.133:0/2740847246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ad0055330 0x7f8ad00577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.403+0000 7f8af58f7700 1 --2- 172.21.15.133:0/2740847246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ad0055330 0x7f8ad00577f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f8aec019000 tx=0x7f8aec016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:04.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.407+0000 7f8adf7fe700 1 -- 172.21.15.133:0/2740847246 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8ae0041df0 con 0x7f8af005c130 2021-01-03T12:58:04.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.547+0000 7f8af835c700 1 -- 172.21.15.133:0/2740847246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8af0057300 con 0x7f8af005c130 2021-01-03T12:58:04.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.547+0000 7f8adf7fe700 1 -- 172.21.15.133:0/2740847246 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f8ae0024ef0 con 0x7f8af005c130 2021-01-03T12:58:04.550 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:04.550 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":23,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:01.829379+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:57:58.934952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-03T12:57:59.830134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:04.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.551+0000 7f8af835c700 1 -- 172.21.15.133:0/2740847246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ad0055330 msgr2=0x7f8ad00577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.551+0000 7f8af835c700 1 --2- 172.21.15.133:0/2740847246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ad0055330 0x7f8ad00577f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f8aec019000 tx=0x7f8aec016000).stop 2021-01-03T12:58:04.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.551+0000 7f8af835c700 1 -- 172.21.15.133:0/2740847246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8af005c130 msgr2=0x7f8af00b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.551+0000 7f8af835c700 1 --2- 172.21.15.133:0/2740847246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8af005c130 0x7f8af00b2270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f8ae0001f60 tx=0x7f8ae0007c00).stop 2021-01-03T12:58:04.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.551+0000 7f8af835c700 1 -- 172.21.15.133:0/2740847246 shutdown_connections 2021-01-03T12:58:04.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.551+0000 7f8af835c700 1 --2- 172.21.15.133:0/2740847246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ad0055330 0x7f8ad00577f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.551+0000 7f8af835c700 1 --2- 172.21.15.133:0/2740847246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8af00b02d0 0x7f8af009d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.551+0000 7f8af835c700 1 --2- 172.21.15.133:0/2740847246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8af005c130 0x7f8af00b2270 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.551+0000 7f8af835c700 1 --2- 172.21.15.133:0/2740847246 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8af005cc10 0x7f8af00b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.551+0000 7f8af835c700 1 -- 172.21.15.133:0/2740847246 >> 172.21.15.133:0/2740847246 conn(0x7f8af00b95d0 msgr2=0x7f8af00b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:04.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.551+0000 7f8af835c700 1 -- 172.21.15.133:0/2740847246 shutdown_connections 2021-01-03T12:58:04.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.551+0000 7f8af835c700 1 -- 172.21.15.133:0/2740847246 wait complete. 2021-01-03T12:58:04.564 INFO:tasks.ceph.ceph_manager.ceph:all up! 2021-01-03T12:58:04.565 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:04.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.671+0000 7fb875212700 1 Processor -- start 2021-01-03T12:58:04.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.671+0000 7fb875212700 1 -- start start 2021-01-03T12:58:04.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.671+0000 7fb875212700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb8700b6d50 0x7fb870146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.671+0000 7fb875212700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb870142e90 0x7fb870143320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.671+0000 7fb875212700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8700b7130 con 0x7fb870143810 2021-01-03T12:58:04.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.671+0000 7fb875212700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8700ae600 con 0x7fb8700b6d50 2021-01-03T12:58:04.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.671+0000 7fb875212700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8700ae8a0 con 0x7fb870142e90 2021-01-03T12:58:04.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.671+0000 7fb86e59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb870142e90 0x7fb870143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb86f59e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb870143810 0x7fb87005bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52756/0 (socket says 172.21.15.133:52756) 2021-01-03T12:58:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb86f59e700 1 -- 172.21.15.133:0/1749774824 learned_addr learned my addr 172.21.15.133:0/1749774824 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb86ed9d700 1 --2- 172.21.15.133:0/1749774824 >> v2:172.21.15.16:3300/0 conn(0x7fb8700b6d50 0x7fb870146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb86e59c700 1 -- 172.21.15.133:0/1749774824 >> v2:172.21.15.16:3300/0 conn(0x7fb8700b6d50 msgr2=0x7fb870146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb86e59c700 1 --2- 172.21.15.133:0/1749774824 >> v2:172.21.15.16:3300/0 conn(0x7fb8700b6d50 0x7fb870146bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb86e59c700 1 -- 172.21.15.133:0/1749774824 >> v1:172.21.15.133:6789/0 conn(0x7fb870143810 legacy=0x7fb87005bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb86dd9b700 1 -- 172.21.15.133:0/1749774824 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907981457 0 0) 0x7fb8700b7130 con 0x7fb870143810 2021-01-03T12:58:04.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb86e59c700 1 -- 172.21.15.133:0/1749774824 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8700aeb40 con 0x7fb870142e90 2021-01-03T12:58:04.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb86e59c700 1 --2- 172.21.15.133:0/1749774824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb870142e90 0x7fb870143320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb858002f30 tx=0x7fb858006dc0).ready entity=mon.1 client_cookie=4d1b7cb2dac2fa6f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:04.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb86dd9b700 1 -- 172.21.15.133:0/1749774824 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8580097b0 con 0x7fb870142e90 2021-01-03T12:58:04.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb86dd9b700 1 -- 172.21.15.133:0/1749774824 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb858009910 con 0x7fb870142e90 2021-01-03T12:58:04.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb86dd9b700 1 -- 172.21.15.133:0/1749774824 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb858009c70 con 0x7fb870142e90 2021-01-03T12:58:04.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb875212700 1 -- 172.21.15.133:0/1749774824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb870142e90 msgr2=0x7fb870143320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb875212700 1 --2- 172.21.15.133:0/1749774824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb870142e90 0x7fb870143320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb858002f30 tx=0x7fb858006dc0).stop 2021-01-03T12:58:04.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb875212700 1 -- 172.21.15.133:0/1749774824 shutdown_connections 2021-01-03T12:58:04.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb875212700 1 --2- 172.21.15.133:0/1749774824 >> v2:172.21.15.16:3300/0 conn(0x7fb8700b6d50 0x7fb870146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb875212700 1 --2- 172.21.15.133:0/1749774824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb870142e90 0x7fb870143320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb875212700 1 -- 172.21.15.133:0/1749774824 >> 172.21.15.133:0/1749774824 conn(0x7fb8700622f0 msgr2=0x7fb8700b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:04.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb875212700 1 -- 172.21.15.133:0/1749774824 shutdown_connections 2021-01-03T12:58:04.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.675+0000 7fb875212700 1 -- 172.21.15.133:0/1749774824 wait complete. 2021-01-03T12:58:04.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb875212700 1 Processor -- start 2021-01-03T12:58:04.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb875212700 1 -- start start 2021-01-03T12:58:04.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb875212700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb8700b6d50 0x7fb8700b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb875212700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb870142e90 0x7fb870152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb875212700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb870143810 0x7fb870152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb875212700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb870148f50 con 0x7fb870143810 2021-01-03T12:58:04.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb875212700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb870148a50 con 0x7fb870142e90 2021-01-03T12:58:04.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb875212700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8700b59a0 con 0x7fb8700b6d50 2021-01-03T12:58:04.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb86e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb870142e90 0x7fb870152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb86e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb870142e90 0x7fb870152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59960/0 (socket says 172.21.15.133:59960) 2021-01-03T12:58:04.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb86e59c700 1 -- 172.21.15.133:0/2841545488 learned_addr learned my addr 172.21.15.133:0/2841545488 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:04.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb86ed9d700 1 --2- 172.21.15.133:0/2841545488 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb8700b6d50 0x7fb8700b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb86f59e700 1 --2- 172.21.15.133:0/2841545488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb870143810 0x7fb870152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb86e59c700 1 -- 172.21.15.133:0/2841545488 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb8700b6d50 msgr2=0x7fb8700b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb86e59c700 1 --2- 172.21.15.133:0/2841545488 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb8700b6d50 0x7fb8700b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb86e59c700 1 -- 172.21.15.133:0/2841545488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb870143810 msgr2=0x7fb870152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb86e59c700 1 --2- 172.21.15.133:0/2841545488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb870143810 0x7fb870152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb86e59c700 1 -- 172.21.15.133:0/2841545488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb870148cb0 con 0x7fb870142e90 2021-01-03T12:58:04.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb86e59c700 1 --2- 172.21.15.133:0/2841545488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb870142e90 0x7fb870152140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fb870144850 tx=0x7fb858015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:04.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb867fff700 1 -- 172.21.15.133:0/2841545488 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb858011a50 con 0x7fb870142e90 2021-01-03T12:58:04.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb867fff700 1 -- 172.21.15.133:0/2841545488 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb858011bb0 con 0x7fb870142e90 2021-01-03T12:58:04.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb875212700 1 -- 172.21.15.133:0/2841545488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8700b3f00 con 0x7fb870142e90 2021-01-03T12:58:04.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb867fff700 1 -- 172.21.15.133:0/2841545488 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb85801d440 con 0x7fb870142e90 2021-01-03T12:58:04.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.679+0000 7fb875212700 1 -- 172.21.15.133:0/2841545488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8700b5660 con 0x7fb870142e90 2021-01-03T12:58:04.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.683+0000 7fb867fff700 1 -- 172.21.15.133:0/2841545488 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb858024030 con 0x7fb870142e90 2021-01-03T12:58:04.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.683+0000 7fb875212700 1 -- 172.21.15.133:0/2841545488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb870057300 con 0x7fb870142e90 2021-01-03T12:58:04.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.683+0000 7fb867fff700 1 --2- 172.21.15.133:0/2841545488 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb8540554e0 0x7fb8540579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.683+0000 7fb867fff700 1 -- 172.21.15.133:0/2841545488 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb85806ef60 con 0x7fb870142e90 2021-01-03T12:58:04.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.683+0000 7fb86ed9d700 1 --2- 172.21.15.133:0/2841545488 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb8540554e0 0x7fb8540579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.683+0000 7fb86ed9d700 1 --2- 172.21.15.133:0/2841545488 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb8540554e0 0x7fb8540579a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb86000b000 tx=0x7fb860008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:04.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.687+0000 7fb867fff700 1 -- 172.21.15.133:0/2841545488 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb858045150 con 0x7fb870142e90 2021-01-03T12:58:04.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.827+0000 7fb875212700 1 -- 172.21.15.133:0/2841545488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb87006b610 con 0x7fb870142e90 2021-01-03T12:58:04.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.827+0000 7fb867fff700 1 -- 172.21.15.133:0/2841545488 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7fb858022020 con 0x7fb870142e90 2021-01-03T12:58:04.831 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:04.831 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":23,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:01.829379+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:57:58.934952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-03T12:57:59.830134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:04.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.831+0000 7fb875212700 1 -- 172.21.15.133:0/2841545488 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb8540554e0 msgr2=0x7fb8540579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.831+0000 7fb875212700 1 --2- 172.21.15.133:0/2841545488 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb8540554e0 0x7fb8540579a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb86000b000 tx=0x7fb860008040).stop 2021-01-03T12:58:04.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.831+0000 7fb875212700 1 -- 172.21.15.133:0/2841545488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb870142e90 msgr2=0x7fb870152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.831+0000 7fb875212700 1 --2- 172.21.15.133:0/2841545488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb870142e90 0x7fb870152140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fb870144850 tx=0x7fb858015000).stop 2021-01-03T12:58:04.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.831+0000 7fb875212700 1 -- 172.21.15.133:0/2841545488 shutdown_connections 2021-01-03T12:58:04.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.831+0000 7fb875212700 1 --2- 172.21.15.133:0/2841545488 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb8540554e0 0x7fb8540579a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.831+0000 7fb875212700 1 --2- 172.21.15.133:0/2841545488 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb870143810 0x7fb870152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.831+0000 7fb875212700 1 --2- 172.21.15.133:0/2841545488 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb8700b6d50 0x7fb8700b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.831+0000 7fb875212700 1 --2- 172.21.15.133:0/2841545488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb870142e90 0x7fb870152140 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.831+0000 7fb875212700 1 -- 172.21.15.133:0/2841545488 >> 172.21.15.133:0/2841545488 conn(0x7fb8700622f0 msgr2=0x7fb8700b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:04.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.831+0000 7fb875212700 1 -- 172.21.15.133:0/2841545488 shutdown_connections 2021-01-03T12:58:04.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.831+0000 7fb875212700 1 -- 172.21.15.133:0/2841545488 wait complete. 2021-01-03T12:58:04.849 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2021-01-03T12:58:04.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.959+0000 7fc482ddc700 1 Processor -- start 2021-01-03T12:58:04.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.959+0000 7fc482ddc700 1 -- start start 2021-01-03T12:58:04.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc482ddc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc47c0b0c90 0x7fc47c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc482ddc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc47c0b5c00 0x7fc47c143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc482ddc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47c060da0 con 0x7fc47c0b52c0 2021-01-03T12:58:04.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc482ddc700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c067a90 con 0x7fc47c0b5c00 2021-01-03T12:58:04.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc482ddc700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0b0ad0 con 0x7fc47c0b0c90 2021-01-03T12:58:04.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc481dda700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc47c0b52c0 0x7fc47c098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52768/0 (socket says 172.21.15.133:52768) 2021-01-03T12:58:04.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc481dda700 1 -- 172.21.15.133:0/1707754861 learned_addr learned my addr 172.21.15.133:0/1707754861 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:04.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc4815d9700 1 --2- 172.21.15.133:0/1707754861 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc47c0b0c90 0x7fc47c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc4825db700 1 --2- 172.21.15.133:0/1707754861 >> v2:172.21.15.16:3300/0 conn(0x7fc47c0b5c00 0x7fc47c143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc480dd8700 1 -- 172.21.15.133:0/1707754861 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868558526 0 0) 0x7fc47c060da0 con 0x7fc47c0b52c0 2021-01-03T12:58:04.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc480dd8700 1 -- 172.21.15.133:0/1707754861 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc464003230 con 0x7fc47c0b52c0 2021-01-03T12:58:04.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc4815d9700 1 -- 172.21.15.133:0/1707754861 >> v2:172.21.15.16:3300/0 conn(0x7fc47c0b5c00 msgr2=0x7fc47c143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:04.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc4815d9700 1 --2- 172.21.15.133:0/1707754861 >> v2:172.21.15.16:3300/0 conn(0x7fc47c0b5c00 0x7fc47c143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc4815d9700 1 -- 172.21.15.133:0/1707754861 >> v1:172.21.15.133:6789/0 conn(0x7fc47c0b52c0 legacy=0x7fc47c098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc4815d9700 1 -- 172.21.15.133:0/1707754861 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c0b56a0 con 0x7fc47c0b0c90 2021-01-03T12:58:04.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc4815d9700 1 --2- 172.21.15.133:0/1707754861 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc47c0b0c90 0x7fc47c0b05e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc46c002f30 tx=0x7fc46c006dc0).ready entity=mon.2 client_cookie=3d7c8cf5822321d5 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:04.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc480dd8700 1 -- 172.21.15.133:0/1707754861 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc46c0096a0 con 0x7fc47c0b0c90 2021-01-03T12:58:04.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc480dd8700 1 -- 172.21.15.133:0/1707754861 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c009800 con 0x7fc47c0b0c90 2021-01-03T12:58:04.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc480dd8700 1 -- 172.21.15.133:0/1707754861 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc46c009b60 con 0x7fc47c0b0c90 2021-01-03T12:58:04.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc482ddc700 1 -- 172.21.15.133:0/1707754861 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc47c0b0c90 msgr2=0x7fc47c0b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc482ddc700 1 --2- 172.21.15.133:0/1707754861 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc47c0b0c90 0x7fc47c0b05e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc46c002f30 tx=0x7fc46c006dc0).stop 2021-01-03T12:58:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc482ddc700 1 -- 172.21.15.133:0/1707754861 shutdown_connections 2021-01-03T12:58:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc482ddc700 1 --2- 172.21.15.133:0/1707754861 >> v2:172.21.15.16:3300/0 conn(0x7fc47c0b5c00 0x7fc47c143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc482ddc700 1 --2- 172.21.15.133:0/1707754861 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc47c0b0c90 0x7fc47c0b05e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc482ddc700 1 -- 172.21.15.133:0/1707754861 >> 172.21.15.133:0/1707754861 conn(0x7fc47c05bdf0 msgr2=0x7fc47c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc482ddc700 1 -- 172.21.15.133:0/1707754861 shutdown_connections 2021-01-03T12:58:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc482ddc700 1 -- 172.21.15.133:0/1707754861 wait complete. 2021-01-03T12:58:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc482ddc700 1 Processor -- start 2021-01-03T12:58:04.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.963+0000 7fc482ddc700 1 -- start start 2021-01-03T12:58:04.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc482ddc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc47c0b0c90 0x7fc47c0af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc482ddc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc47c0b52c0 0x7fc47c0660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc482ddc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc47c0b5c00 0x7fc47c159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc482ddc700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0aea30 con 0x7fc47c0b52c0 2021-01-03T12:58:04.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc482ddc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c066bf0 con 0x7fc47c0b0c90 2021-01-03T12:58:04.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc482ddc700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0b4c70 con 0x7fc47c0b5c00 2021-01-03T12:58:04.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc481dda700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc47c0b0c90 0x7fc47c0af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc481dda700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc47c0b0c90 0x7fc47c0af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59972/0 (socket says 172.21.15.133:59972) 2021-01-03T12:58:04.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc481dda700 1 -- 172.21.15.133:0/3622379572 learned_addr learned my addr 172.21.15.133:0/3622379572 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:04.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc4815d9700 1 --2- 172.21.15.133:0/3622379572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc47c0b52c0 0x7fc47c0660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc4825db700 1 --2- 172.21.15.133:0/3622379572 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc47c0b5c00 0x7fc47c159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc481dda700 1 -- 172.21.15.133:0/3622379572 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc47c0b5c00 msgr2=0x7fc47c159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc481dda700 1 --2- 172.21.15.133:0/3622379572 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc47c0b5c00 0x7fc47c159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc481dda700 1 -- 172.21.15.133:0/3622379572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc47c0b52c0 msgr2=0x7fc47c0660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc481dda700 1 --2- 172.21.15.133:0/3622379572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc47c0b52c0 0x7fc47c0660b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc481dda700 1 -- 172.21.15.133:0/3622379572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c156ce0 con 0x7fc47c0b0c90 2021-01-03T12:58:04.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc4815d9700 1 --2- 172.21.15.133:0/3622379572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc47c0b52c0 0x7fc47c0660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:04.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc4825db700 1 --2- 172.21.15.133:0/3622379572 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc47c0b5c00 0x7fc47c159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:04.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc481dda700 1 --2- 172.21.15.133:0/3622379572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc47c0b0c90 0x7fc47c0af090 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc4780010d0 tx=0x7fc478007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:04.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc46affd700 1 -- 172.21.15.133:0/3622379572 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc478007320 con 0x7fc47c0b0c90 2021-01-03T12:58:04.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc46affd700 1 -- 172.21.15.133:0/3622379572 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc478007480 con 0x7fc47c0b0c90 2021-01-03T12:58:04.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc482ddc700 1 -- 172.21.15.133:0/3622379572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c0af580 con 0x7fc47c0b0c90 2021-01-03T12:58:04.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc46affd700 1 -- 172.21.15.133:0/3622379572 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4780057d0 con 0x7fc47c0b0c90 2021-01-03T12:58:04.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc482ddc700 1 -- 172.21.15.133:0/3622379572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c0636e0 con 0x7fc47c0b0c90 2021-01-03T12:58:04.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.967+0000 7fc482ddc700 1 -- 172.21.15.133:0/3622379572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc47c145800 con 0x7fc47c0b0c90 2021-01-03T12:58:04.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.971+0000 7fc46affd700 1 -- 172.21.15.133:0/3622379572 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc478010030 con 0x7fc47c0b0c90 2021-01-03T12:58:04.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.971+0000 7fc46affd700 1 --2- 172.21.15.133:0/3622379572 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc45c055470 0x7fc45c057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.971+0000 7fc46affd700 1 -- 172.21.15.133:0/3622379572 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc47806db80 con 0x7fc47c0b0c90 2021-01-03T12:58:04.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.971+0000 7fc4815d9700 1 --2- 172.21.15.133:0/3622379572 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc45c055470 0x7fc45c057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.971+0000 7fc46affd700 1 --2- 172.21.15.133:0/3622379572 >> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] conn(0x7fc45c05c860 0x7fc45c05ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:04.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.971+0000 7fc46affd700 1 -- 172.21.15.133:0/3622379572 --> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc45c05f240 con 0x7fc45c05c860 2021-01-03T12:58:04.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.971+0000 7fc46affd700 1 -- 172.21.15.133:0/3622379572 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc478072240 con 0x7fc47c0b0c90 2021-01-03T12:58:04.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.971+0000 7fc4825db700 1 --2- 172.21.15.133:0/3622379572 >> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] conn(0x7fc45c05c860 0x7fc45c05ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:04.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.971+0000 7fc4815d9700 1 --2- 172.21.15.133:0/3622379572 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc45c055470 0x7fc45c057930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc46c019000 tx=0x7fc46c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:04.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.971+0000 7fc4825db700 1 --2- 172.21.15.133:0/3622379572 >> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] conn(0x7fc45c05c860 0x7fc45c05ec80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:04.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.971+0000 7fc46affd700 1 -- 172.21.15.133:0/3622379572 <== osd.0 v2:172.21.15.133:6810/12124 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7fc45c05f240 con 0x7fc45c05c860 2021-01-03T12:58:04.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.991+0000 7fc482ddc700 1 -- 172.21.15.133:0/3622379572 --> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc47c066a70 con 0x7fc45c05c860 2021-01-03T12:58:04.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.991+0000 7fc46affd700 1 -- 172.21.15.133:0/3622379572 <== osd.0 v2:172.21.15.133:6810/12124 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc474009d40 con 0x7fc45c05c860 2021-01-03T12:58:04.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.991+0000 7fc482ddc700 1 -- 172.21.15.133:0/3622379572 >> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] conn(0x7fc45c05c860 msgr2=0x7fc45c05ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.991+0000 7fc482ddc700 1 --2- 172.21.15.133:0/3622379572 >> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] conn(0x7fc45c05c860 0x7fc45c05ec80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:04.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.995+0000 7fc482ddc700 1 -- 172.21.15.133:0/3622379572 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc45c055470 msgr2=0x7fc45c057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.995+0000 7fc482ddc700 1 --2- 172.21.15.133:0/3622379572 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc45c055470 0x7fc45c057930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc46c019000 tx=0x7fc46c015000).stop 2021-01-03T12:58:04.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.995+0000 7fc482ddc700 1 -- 172.21.15.133:0/3622379572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc47c0b0c90 msgr2=0x7fc47c0af090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:04.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.995+0000 7fc482ddc700 1 --2- 172.21.15.133:0/3622379572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc47c0b0c90 0x7fc47c0af090 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc4780010d0 tx=0x7fc478007aa0).stop 2021-01-03T12:58:04.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.995+0000 7fc4825db700 1 -- 172.21.15.133:0/3622379572 reap_dead start 2021-01-03T12:58:04.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.995+0000 7fc482ddc700 1 -- 172.21.15.133:0/3622379572 shutdown_connections 2021-01-03T12:58:04.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.995+0000 7fc482ddc700 1 -- 172.21.15.133:0/3622379572 >> 172.21.15.133:0/3622379572 conn(0x7fc47c05bdf0 msgr2=0x7fc47c143430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:04.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.995+0000 7fc482ddc700 1 -- 172.21.15.133:0/3622379572 shutdown_connections 2021-01-03T12:58:04.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:04.995+0000 7fc482ddc700 1 -- 172.21.15.133:0/3622379572 wait complete. 2021-01-03T12:58:05.012 INFO:teuthology.orchestra.run.smithi133.stdout:60129542149 2021-01-03T12:58:05.012 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2021-01-03T12:58:05.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.123+0000 7f661d3d9700 1 Processor -- start 2021-01-03T12:58:05.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.123+0000 7f661d3d9700 1 -- start start 2021-01-03T12:58:05.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f661d3d9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6618067350 0x7f661805fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f661d3d9700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66180afe70 con 0x7f66180b2750 2021-01-03T12:58:05.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f661d3d9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6618060310 con 0x7f6618066f70 2021-01-03T12:58:05.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f661d3d9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66180605a0 con 0x7f6618067350 2021-01-03T12:58:05.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f660f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6618067350 0x7f661805fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f6617fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6618066f70 0x7f66180af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52782/0 (socket says 172.21.15.133:52782) 2021-01-03T12:58:05.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f660f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6618067350 0x7f661805fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59984/0 (socket says 172.21.15.133:59984) 2021-01-03T12:58:05.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f6617fff700 1 -- 172.21.15.133:0/2206897174 learned_addr learned my addr 172.21.15.133:0/2206897174 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f660f7fe700 1 -- 172.21.15.133:0/2206897174 >> v1:172.21.15.133:6789/0 conn(0x7f6618066f70 legacy=0x7f66180af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f660f7fe700 1 -- 172.21.15.133:0/2206897174 >> v1:172.21.15.16:6789/0 conn(0x7f66180b2750 legacy=0x7f6618144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f66177fe700 1 -- 172.21.15.133:0/2206897174 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524900289 0 0) 0x7f6618060310 con 0x7f6618066f70 2021-01-03T12:58:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f660f7fe700 1 -- 172.21.15.133:0/2206897174 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66180b0b50 con 0x7f6618067350 2021-01-03T12:58:05.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f660f7fe700 1 --2- 172.21.15.133:0/2206897174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6618067350 0x7f661805fe20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f6600002f30 tx=0x7f6600006dc0).ready entity=mon.1 client_cookie=bdf43b1ee2dcc3ff server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f66177fe700 1 -- 172.21.15.133:0/2206897174 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66000097f0 con 0x7f6618067350 2021-01-03T12:58:05.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f66177fe700 1 -- 172.21.15.133:0/2206897174 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6600009950 con 0x7f6618067350 2021-01-03T12:58:05.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f66177fe700 1 -- 172.21.15.133:0/2206897174 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6600009cb0 con 0x7f6618067350 2021-01-03T12:58:05.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f661d3d9700 1 -- 172.21.15.133:0/2206897174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6618067350 msgr2=0x7f661805fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f661d3d9700 1 --2- 172.21.15.133:0/2206897174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6618067350 0x7f661805fe20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f6600002f30 tx=0x7f6600006dc0).stop 2021-01-03T12:58:05.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f661d3d9700 1 -- 172.21.15.133:0/2206897174 shutdown_connections 2021-01-03T12:58:05.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f661d3d9700 1 --2- 172.21.15.133:0/2206897174 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6618067350 0x7f661805fe20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f661d3d9700 1 -- 172.21.15.133:0/2206897174 >> 172.21.15.133:0/2206897174 conn(0x7f66180b6110 msgr2=0x7f66180b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:05.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f661d3d9700 1 -- 172.21.15.133:0/2206897174 shutdown_connections 2021-01-03T12:58:05.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.127+0000 7f661d3d9700 1 -- 172.21.15.133:0/2206897174 wait complete. 2021-01-03T12:58:05.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f661d3d9700 1 Processor -- start 2021-01-03T12:58:05.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f661d3d9700 1 -- start start 2021-01-03T12:58:05.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f661d3d9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6618066f70 0x7f661809f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f661d3d9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6618067350 0x7f661814fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f661d3d9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f66180b2750 0x7f6618150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f661d3d9700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6618153fc0 con 0x7f6618066f70 2021-01-03T12:58:05.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f661d3d9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6618153d20 con 0x7f6618067350 2021-01-03T12:58:05.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f661d3d9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661813ec10 con 0x7f66180b2750 2021-01-03T12:58:05.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f660f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6618067350 0x7f661814fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f660f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6618067350 0x7f661814fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59990/0 (socket says 172.21.15.133:59990) 2021-01-03T12:58:05.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f660f7fe700 1 -- 172.21.15.133:0/4080046623 learned_addr learned my addr 172.21.15.133:0/4080046623 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:05.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f6617fff700 1 --2- 172.21.15.133:0/4080046623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6618066f70 0x7f661809f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f661cbd8700 1 --2- 172.21.15.133:0/4080046623 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f66180b2750 0x7f6618150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f660f7fe700 1 -- 172.21.15.133:0/4080046623 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f66180b2750 msgr2=0x7f6618150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f660f7fe700 1 --2- 172.21.15.133:0/4080046623 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f66180b2750 0x7f6618150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f660f7fe700 1 -- 172.21.15.133:0/4080046623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6618066f70 msgr2=0x7f661809f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f660f7fe700 1 --2- 172.21.15.133:0/4080046623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6618066f70 0x7f661809f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f660f7fe700 1 -- 172.21.15.133:0/4080046623 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6618153a70 con 0x7f6618067350 2021-01-03T12:58:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f6617fff700 1 --2- 172.21.15.133:0/4080046623 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6618066f70 0x7f661809f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f660f7fe700 1 --2- 172.21.15.133:0/4080046623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6618067350 0x7f661814fb10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f661809f180 tx=0x7f6600015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f6615ffb700 1 -- 172.21.15.133:0/4080046623 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6600021070 con 0x7f6618067350 2021-01-03T12:58:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f6615ffb700 1 -- 172.21.15.133:0/4080046623 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660001d450 con 0x7f6618067350 2021-01-03T12:58:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f661d3d9700 1 -- 172.21.15.133:0/4080046623 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66181504f0 con 0x7f6618067350 2021-01-03T12:58:05.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f6615ffb700 1 -- 172.21.15.133:0/4080046623 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f660001d7b0 con 0x7f6618067350 2021-01-03T12:58:05.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.131+0000 7f661d3d9700 1 -- 172.21.15.133:0/4080046623 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661809fb80 con 0x7f6618067350 2021-01-03T12:58:05.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.135+0000 7f661d3d9700 1 -- 172.21.15.133:0/4080046623 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f661813edd0 con 0x7f6618067350 2021-01-03T12:58:05.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.135+0000 7f6615ffb700 1 -- 172.21.15.133:0/4080046623 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f660000f070 con 0x7f6618067350 2021-01-03T12:58:05.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.135+0000 7f6615ffb700 1 --2- 172.21.15.133:0/4080046623 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f65fc055330 0x7f65fc0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.135+0000 7f6617fff700 1 --2- 172.21.15.133:0/4080046623 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f65fc055330 0x7f65fc0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.135+0000 7f6615ffb700 1 -- 172.21.15.133:0/4080046623 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f660006f9a0 con 0x7f6618067350 2021-01-03T12:58:05.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.135+0000 7f6615ffb700 1 --2- 172.21.15.133:0/4080046623 >> [v2:172.21.15.133:6818/12123,v1:172.21.15.133:6819/12123] conn(0x7f65fc05c7c0 0x7f65fc05ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.135+0000 7f6615ffb700 1 -- 172.21.15.133:0/4080046623 --> [v2:172.21.15.133:6818/12123,v1:172.21.15.133:6819/12123] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f65fc05f240 con 0x7f65fc05c7c0 2021-01-03T12:58:05.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.135+0000 7f6615ffb700 1 -- 172.21.15.133:0/4080046623 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f660006fd80 con 0x7f6618067350 2021-01-03T12:58:05.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.135+0000 7f6617fff700 1 --2- 172.21.15.133:0/4080046623 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f65fc055330 0x7f65fc0577f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f660800b000 tx=0x7f6608009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.135+0000 7f661cbd8700 1 --2- 172.21.15.133:0/4080046623 >> [v2:172.21.15.133:6818/12123,v1:172.21.15.133:6819/12123] conn(0x7f65fc05c7c0 0x7f65fc05ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.135+0000 7f661cbd8700 1 --2- 172.21.15.133:0/4080046623 >> [v2:172.21.15.133:6818/12123,v1:172.21.15.133:6819/12123] conn(0x7f65fc05c7c0 0x7f65fc05ebe0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.139+0000 7f6615ffb700 1 -- 172.21.15.133:0/4080046623 <== osd.1 v2:172.21.15.133:6818/12123 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7f65fc05f240 con 0x7f65fc05c7c0 2021-01-03T12:58:05.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.155+0000 7f661d3d9700 1 -- 172.21.15.133:0/4080046623 --> [v2:172.21.15.133:6818/12123,v1:172.21.15.133:6819/12123] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6618057300 con 0x7f65fc05c7c0 2021-01-03T12:58:05.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.155+0000 7f6615ffb700 1 -- 172.21.15.133:0/4080046623 <== osd.1 v2:172.21.15.133:6818/12123 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6618057300 con 0x7f65fc05c7c0 2021-01-03T12:58:05.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.159+0000 7f661d3d9700 1 -- 172.21.15.133:0/4080046623 >> [v2:172.21.15.133:6818/12123,v1:172.21.15.133:6819/12123] conn(0x7f65fc05c7c0 msgr2=0x7f65fc05ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.159+0000 7f661d3d9700 1 --2- 172.21.15.133:0/4080046623 >> [v2:172.21.15.133:6818/12123,v1:172.21.15.133:6819/12123] conn(0x7f65fc05c7c0 0x7f65fc05ebe0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.159+0000 7f661d3d9700 1 -- 172.21.15.133:0/4080046623 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f65fc055330 msgr2=0x7f65fc0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.159+0000 7f661d3d9700 1 --2- 172.21.15.133:0/4080046623 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f65fc055330 0x7f65fc0577f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f660800b000 tx=0x7f6608009040).stop 2021-01-03T12:58:05.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.159+0000 7f661d3d9700 1 -- 172.21.15.133:0/4080046623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6618067350 msgr2=0x7f661814fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.159+0000 7f661d3d9700 1 --2- 172.21.15.133:0/4080046623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6618067350 0x7f661814fb10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f661809f180 tx=0x7f6600015000).stop 2021-01-03T12:58:05.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.159+0000 7f661cbd8700 1 -- 172.21.15.133:0/4080046623 reap_dead start 2021-01-03T12:58:05.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.159+0000 7f661d3d9700 1 -- 172.21.15.133:0/4080046623 shutdown_connections 2021-01-03T12:58:05.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.159+0000 7f661d3d9700 1 -- 172.21.15.133:0/4080046623 >> 172.21.15.133:0/4080046623 conn(0x7f66180b6110 msgr2=0x7f66180b5940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:05.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.159+0000 7f661d3d9700 1 -- 172.21.15.133:0/4080046623 shutdown_connections 2021-01-03T12:58:05.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.159+0000 7f661d3d9700 1 -- 172.21.15.133:0/4080046623 wait complete. 2021-01-03T12:58:05.171 INFO:teuthology.orchestra.run.smithi133.stdout:60129542149 2021-01-03T12:58:05.172 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2021-01-03T12:58:05.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f60a5c01700 1 Processor -- start 2021-01-03T12:58:05.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f60a5c01700 1 -- start start 2021-01-03T12:58:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f60a5c01700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f60a0066f30 0x7f60a00b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f60a5c01700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a005fd00 con 0x7f60a00b1590 2021-01-03T12:58:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f60a5c01700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a00accd0 con 0x7f60a005f920 2021-01-03T12:58:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f60a5c01700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a00b2980 con 0x7f60a0066f30 2021-01-03T12:58:05.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f60a4bff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f60a005f920 0x7f60a00b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52798/0 (socket says 172.21.15.133:52798) 2021-01-03T12:58:05.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f60a4bff700 1 -- 172.21.15.133:0/114124964 learned_addr learned my addr 172.21.15.133:0/114124964 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:05.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f609ffff700 1 --2- 172.21.15.133:0/114124964 >> v2:172.21.15.133:3300/0 conn(0x7f60a0066f30 0x7f60a00b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f609f7fe700 1 -- 172.21.15.133:0/114124964 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774789544 0 0) 0x7f60a00accd0 con 0x7f60a005f920 2021-01-03T12:58:05.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f609f7fe700 1 -- 172.21.15.133:0/114124964 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f608c003230 con 0x7f60a005f920 2021-01-03T12:58:05.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f609ffff700 1 -- 172.21.15.133:0/114124964 >> v1:172.21.15.133:6789/0 conn(0x7f60a005f920 legacy=0x7f60a00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f609ffff700 1 -- 172.21.15.133:0/114124964 >> v1:172.21.15.16:6789/0 conn(0x7f60a00b1590 legacy=0x7f60a013ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f609ffff700 1 -- 172.21.15.133:0/114124964 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a00acf70 con 0x7f60a0066f30 2021-01-03T12:58:05.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f609ffff700 1 --2- 172.21.15.133:0/114124964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60a0066f30 0x7f60a00b0ab0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f6094002f30 tx=0x7f6094006dc0).ready entity=mon.1 client_cookie=14483266d1886 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f609f7fe700 1 -- 172.21.15.133:0/114124964 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6094009800 con 0x7f60a0066f30 2021-01-03T12:58:05.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f609f7fe700 1 -- 172.21.15.133:0/114124964 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6094009960 con 0x7f60a0066f30 2021-01-03T12:58:05.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f60a5c01700 1 -- 172.21.15.133:0/114124964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60a0066f30 msgr2=0x7f60a00b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f609f7fe700 1 -- 172.21.15.133:0/114124964 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6094009cc0 con 0x7f60a0066f30 2021-01-03T12:58:05.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f60a5c01700 1 --2- 172.21.15.133:0/114124964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60a0066f30 0x7f60a00b0ab0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f6094002f30 tx=0x7f6094006dc0).stop 2021-01-03T12:58:05.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f60a5c01700 1 -- 172.21.15.133:0/114124964 shutdown_connections 2021-01-03T12:58:05.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.291+0000 7f60a5c01700 1 --2- 172.21.15.133:0/114124964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60a0066f30 0x7f60a00b0ab0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f60a5c01700 1 -- 172.21.15.133:0/114124964 >> 172.21.15.133:0/114124964 conn(0x7f60a00b6110 msgr2=0x7f60a00b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:05.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f60a5c01700 1 -- 172.21.15.133:0/114124964 shutdown_connections 2021-01-03T12:58:05.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f60a5c01700 1 -- 172.21.15.133:0/114124964 wait complete. 2021-01-03T12:58:05.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f60a5c01700 1 Processor -- start 2021-01-03T12:58:05.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f60a5c01700 1 -- start start 2021-01-03T12:58:05.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f60a5c01700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60a005f920 0x7f60a0137750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f60a5c01700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60a0066f30 0x7f60a0130060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f60a5c01700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60a00b1590 0x7f60a0130550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f60a5c01700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a0066390 con 0x7f60a00b1590 2021-01-03T12:58:05.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f60a5c01700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a00650e0 con 0x7f60a0066f30 2021-01-03T12:58:05.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f60a5c01700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a0137c40 con 0x7f60a005f920 2021-01-03T12:58:05.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f609ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60a0066f30 0x7f60a0130060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f609ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60a0066f30 0x7f60a0130060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60006/0 (socket says 172.21.15.133:60006) 2021-01-03T12:58:05.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f609ffff700 1 -- 172.21.15.133:0/3565004617 learned_addr learned my addr 172.21.15.133:0/3565004617 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:05.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f60a4bff700 1 --2- 172.21.15.133:0/3565004617 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60a005f920 0x7f60a0137750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f60a5400700 1 --2- 172.21.15.133:0/3565004617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60a00b1590 0x7f60a0130550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f609ffff700 1 -- 172.21.15.133:0/3565004617 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60a005f920 msgr2=0x7f60a0137750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f609ffff700 1 --2- 172.21.15.133:0/3565004617 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60a005f920 0x7f60a0137750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f609ffff700 1 -- 172.21.15.133:0/3565004617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60a00b1590 msgr2=0x7f60a0130550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f609ffff700 1 --2- 172.21.15.133:0/3565004617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60a00b1590 0x7f60a0130550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f609ffff700 1 -- 172.21.15.133:0/3565004617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a0065f90 con 0x7f60a0066f30 2021-01-03T12:58:05.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f60a5400700 1 --2- 172.21.15.133:0/3565004617 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60a00b1590 0x7f60a0130550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:05.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.295+0000 7f609ffff700 1 --2- 172.21.15.133:0/3565004617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60a0066f30 0x7f60a0130060 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6094002f30 tx=0x7f6094015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.299+0000 7f609dffb700 1 -- 172.21.15.133:0/3565004617 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6094011c30 con 0x7f60a0066f30 2021-01-03T12:58:05.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.299+0000 7f60a5c01700 1 -- 172.21.15.133:0/3565004617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a01362b0 con 0x7f60a0066f30 2021-01-03T12:58:05.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.299+0000 7f609dffb700 1 -- 172.21.15.133:0/3565004617 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6094011d90 con 0x7f60a0066f30 2021-01-03T12:58:05.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.299+0000 7f609dffb700 1 -- 172.21.15.133:0/3565004617 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609401d630 con 0x7f60a0066f30 2021-01-03T12:58:05.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.299+0000 7f60a5c01700 1 -- 172.21.15.133:0/3565004617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a012df60 con 0x7f60a0066f30 2021-01-03T12:58:05.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.299+0000 7f60a5c01700 1 -- 172.21.15.133:0/3565004617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60a00652e0 con 0x7f60a0066f30 2021-01-03T12:58:05.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.299+0000 7f609dffb700 1 -- 172.21.15.133:0/3565004617 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6094017070 con 0x7f60a0066f30 2021-01-03T12:58:05.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.299+0000 7f609dffb700 1 --2- 172.21.15.133:0/3565004617 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f60800554e0 0x7f60800579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.299+0000 7f609dffb700 1 -- 172.21.15.133:0/3565004617 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f609406ec20 con 0x7f60a0066f30 2021-01-03T12:58:05.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.299+0000 7f60a4bff700 1 --2- 172.21.15.133:0/3565004617 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f60800554e0 0x7f60800579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.299+0000 7f609dffb700 1 --2- 172.21.15.133:0/3565004617 >> [v2:172.21.15.133:6802/12122,v1:172.21.15.133:6803/12122] conn(0x7f608005c850 0x7f608005ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.299+0000 7f609dffb700 1 -- 172.21.15.133:0/3565004617 --> [v2:172.21.15.133:6802/12122,v1:172.21.15.133:6803/12122] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f608005f230 con 0x7f608005c850 2021-01-03T12:58:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.299+0000 7f609dffb700 1 -- 172.21.15.133:0/3565004617 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6094071290 con 0x7f60a0066f30 2021-01-03T12:58:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.299+0000 7f60a5400700 1 --2- 172.21.15.133:0/3565004617 >> [v2:172.21.15.133:6802/12122,v1:172.21.15.133:6803/12122] conn(0x7f608005c850 0x7f608005ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.303+0000 7f60a4bff700 1 --2- 172.21.15.133:0/3565004617 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f60800554e0 0x7f60800579a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f609000d000 tx=0x7f6090009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.303+0000 7f60a5400700 1 --2- 172.21.15.133:0/3565004617 >> [v2:172.21.15.133:6802/12122,v1:172.21.15.133:6803/12122] conn(0x7f608005c850 0x7f608005ec70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.303+0000 7f609dffb700 1 -- 172.21.15.133:0/3565004617 <== osd.2 v2:172.21.15.133:6802/12122 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7f608005f230 con 0x7f608005c850 2021-01-03T12:58:05.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.323+0000 7f60a5c01700 1 -- 172.21.15.133:0/3565004617 --> [v2:172.21.15.133:6802/12122,v1:172.21.15.133:6803/12122] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f60a0063ab0 con 0x7f608005c850 2021-01-03T12:58:05.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.323+0000 7f609dffb700 1 -- 172.21.15.133:0/3565004617 <== osd.2 v2:172.21.15.133:6802/12122 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f60a0063ab0 con 0x7f608005c850 2021-01-03T12:58:05.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.323+0000 7f60a5c01700 1 -- 172.21.15.133:0/3565004617 >> [v2:172.21.15.133:6802/12122,v1:172.21.15.133:6803/12122] conn(0x7f608005c850 msgr2=0x7f608005ec70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.323+0000 7f60a5c01700 1 --2- 172.21.15.133:0/3565004617 >> [v2:172.21.15.133:6802/12122,v1:172.21.15.133:6803/12122] conn(0x7f608005c850 0x7f608005ec70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.323+0000 7f60a5c01700 1 -- 172.21.15.133:0/3565004617 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f60800554e0 msgr2=0x7f60800579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.323+0000 7f60a5c01700 1 --2- 172.21.15.133:0/3565004617 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f60800554e0 0x7f60800579a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f609000d000 tx=0x7f6090009040).stop 2021-01-03T12:58:05.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.323+0000 7f60a5c01700 1 -- 172.21.15.133:0/3565004617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60a0066f30 msgr2=0x7f60a0130060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.323+0000 7f60a5c01700 1 --2- 172.21.15.133:0/3565004617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60a0066f30 0x7f60a0130060 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6094002f30 tx=0x7f6094015000).stop 2021-01-03T12:58:05.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.323+0000 7f60a5400700 1 -- 172.21.15.133:0/3565004617 reap_dead start 2021-01-03T12:58:05.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.323+0000 7f60a5c01700 1 -- 172.21.15.133:0/3565004617 shutdown_connections 2021-01-03T12:58:05.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.323+0000 7f60a5c01700 1 -- 172.21.15.133:0/3565004617 >> 172.21.15.133:0/3565004617 conn(0x7f60a00b6110 msgr2=0x7f60a00b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:05.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.323+0000 7f60a5c01700 1 -- 172.21.15.133:0/3565004617 shutdown_connections 2021-01-03T12:58:05.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.323+0000 7f60a5c01700 1 -- 172.21.15.133:0/3565004617 wait complete. 2021-01-03T12:58:05.337 INFO:teuthology.orchestra.run.smithi133.stdout:60129542149 2021-01-03T12:58:05.338 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2021-01-03T12:58:05.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8723f700 1 Processor -- start 2021-01-03T12:58:05.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8723f700 1 -- start start 2021-01-03T12:58:05.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8723f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcb800b52c0 0x7fcb800b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8723f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb800b5c00 0x7fcb80143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8723f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb80060da0 con 0x7fcb800b0c90 2021-01-03T12:58:05.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8723f700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb80067a90 con 0x7fcb800b52c0 2021-01-03T12:58:05.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8723f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb800b0ad0 con 0x7fcb800b5c00 2021-01-03T12:58:05.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb85a3c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcb800b0c90 0x7fcb80098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52816/0 (socket says 172.21.15.133:52816) 2021-01-03T12:58:05.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb85a3c700 1 -- 172.21.15.133:0/4283270461 learned_addr learned my addr 172.21.15.133:0/4283270461 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:05.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8623d700 1 --2- 172.21.15.133:0/4283270461 >> v2:172.21.15.16:3300/0 conn(0x7fcb800b52c0 0x7fcb800b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb86a3e700 1 --2- 172.21.15.133:0/4283270461 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb800b5c00 0x7fcb80143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8523b700 1 -- 172.21.15.133:0/4283270461 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285363938 0 0) 0x7fcb80060da0 con 0x7fcb800b0c90 2021-01-03T12:58:05.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8523b700 1 -- 172.21.15.133:0/4283270461 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb68003230 con 0x7fcb800b0c90 2021-01-03T12:58:05.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8623d700 1 -- 172.21.15.133:0/4283270461 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb800b5c00 msgr2=0x7fcb80143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:05.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8623d700 1 --2- 172.21.15.133:0/4283270461 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb800b5c00 0x7fcb80143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8623d700 1 -- 172.21.15.133:0/4283270461 >> v1:172.21.15.133:6789/0 conn(0x7fcb800b0c90 legacy=0x7fcb80098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8623d700 1 -- 172.21.15.133:0/4283270461 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb800b56a0 con 0x7fcb800b52c0 2021-01-03T12:58:05.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8623d700 1 --2- 172.21.15.133:0/4283270461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb800b52c0 0x7fcb800b05e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fcb7c0032b0 tx=0x7fcb7c0091a0).ready entity=mon.0 client_cookie=144f90a8960660b1 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8523b700 1 -- 172.21.15.133:0/4283270461 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb7c00b940 con 0x7fcb800b52c0 2021-01-03T12:58:05.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8523b700 1 -- 172.21.15.133:0/4283270461 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c00baa0 con 0x7fcb800b52c0 2021-01-03T12:58:05.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8523b700 1 -- 172.21.15.133:0/4283270461 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb7c00bc10 con 0x7fcb800b52c0 2021-01-03T12:58:05.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8723f700 1 -- 172.21.15.133:0/4283270461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb800b52c0 msgr2=0x7fcb800b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.455+0000 7fcb8723f700 1 --2- 172.21.15.133:0/4283270461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb800b52c0 0x7fcb800b05e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fcb7c0032b0 tx=0x7fcb7c0091a0).stop 2021-01-03T12:58:05.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb8723f700 1 -- 172.21.15.133:0/4283270461 shutdown_connections 2021-01-03T12:58:05.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb8723f700 1 --2- 172.21.15.133:0/4283270461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb800b52c0 0x7fcb800b05e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb8723f700 1 --2- 172.21.15.133:0/4283270461 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb800b5c00 0x7fcb80143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb8723f700 1 -- 172.21.15.133:0/4283270461 >> 172.21.15.133:0/4283270461 conn(0x7fcb8005bdf0 msgr2=0x7fcb8005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:05.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb8723f700 1 -- 172.21.15.133:0/4283270461 shutdown_connections 2021-01-03T12:58:05.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb8723f700 1 -- 172.21.15.133:0/4283270461 wait complete. 2021-01-03T12:58:05.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb8723f700 1 Processor -- start 2021-01-03T12:58:05.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb8723f700 1 -- start start 2021-01-03T12:58:05.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb8723f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb800b0c90 0x7fcb800ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb8723f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb800b52c0 0x7fcb80066580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb8723f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb800b5c00 0x7fcb800aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb8723f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb80065ef0 con 0x7fcb800b5c00 2021-01-03T12:58:05.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb8723f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb800b47d0 con 0x7fcb800b52c0 2021-01-03T12:58:05.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb8723f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb800b4a70 con 0x7fcb800b0c90 2021-01-03T12:58:05.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb85a3c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb800b52c0 0x7fcb80066580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb85a3c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb800b52c0 0x7fcb80066580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60022/0 (socket says 172.21.15.133:60022) 2021-01-03T12:58:05.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb85a3c700 1 -- 172.21.15.133:0/3527646380 learned_addr learned my addr 172.21.15.133:0/3527646380 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:05.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb8623d700 1 --2- 172.21.15.133:0/3527646380 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb800b0c90 0x7fcb800ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.459+0000 7fcb86a3e700 1 --2- 172.21.15.133:0/3527646380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb800b5c00 0x7fcb800aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb85a3c700 1 -- 172.21.15.133:0/3527646380 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb800b0c90 msgr2=0x7fcb800ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb85a3c700 1 --2- 172.21.15.133:0/3527646380 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb800b0c90 0x7fcb800ae700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb85a3c700 1 -- 172.21.15.133:0/3527646380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb800b5c00 msgr2=0x7fcb800aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb85a3c700 1 --2- 172.21.15.133:0/3527646380 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb800b5c00 0x7fcb800aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb85a3c700 1 -- 172.21.15.133:0/3527646380 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb800660e0 con 0x7fcb800b52c0 2021-01-03T12:58:05.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb85a3c700 1 --2- 172.21.15.133:0/3527646380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb800b52c0 0x7fcb80066580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fcb800adc60 tx=0x7fcb70007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb6f7fe700 1 -- 172.21.15.133:0/3527646380 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb700072e0 con 0x7fcb800b52c0 2021-01-03T12:58:05.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb6f7fe700 1 -- 172.21.15.133:0/3527646380 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb70007440 con 0x7fcb800b52c0 2021-01-03T12:58:05.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb6f7fe700 1 -- 172.21.15.133:0/3527646380 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb700057d0 con 0x7fcb800b52c0 2021-01-03T12:58:05.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb8723f700 1 -- 172.21.15.133:0/3527646380 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb800b4450 con 0x7fcb800b52c0 2021-01-03T12:58:05.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb8723f700 1 -- 172.21.15.133:0/3527646380 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb800af570 con 0x7fcb800b52c0 2021-01-03T12:58:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb8723f700 1 -- 172.21.15.133:0/3527646380 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb800687f0 con 0x7fcb800b52c0 2021-01-03T12:58:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb6f7fe700 1 -- 172.21.15.133:0/3527646380 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fcb70010070 con 0x7fcb800b52c0 2021-01-03T12:58:05.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb6f7fe700 1 --2- 172.21.15.133:0/3527646380 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb60055330 0x7fcb600577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb6f7fe700 1 -- 172.21.15.133:0/3527646380 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcb7006d4e0 con 0x7fcb800b52c0 2021-01-03T12:58:05.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb8623d700 1 --2- 172.21.15.133:0/3527646380 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb60055330 0x7fcb600577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb6f7fe700 1 --2- 172.21.15.133:0/3527646380 >> [v2:172.21.15.133:6826/12136,v1:172.21.15.133:6827/12136] conn(0x7fcb6005c7c0 0x7fcb6005ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.463+0000 7fcb6f7fe700 1 -- 172.21.15.133:0/3527646380 --> [v2:172.21.15.133:6826/12136,v1:172.21.15.133:6827/12136] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb6005f240 con 0x7fcb6005c7c0 2021-01-03T12:58:05.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.467+0000 7fcb6f7fe700 1 -- 172.21.15.133:0/3527646380 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb7006fb10 con 0x7fcb800b52c0 2021-01-03T12:58:05.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.467+0000 7fcb86a3e700 1 --2- 172.21.15.133:0/3527646380 >> [v2:172.21.15.133:6826/12136,v1:172.21.15.133:6827/12136] conn(0x7fcb6005c7c0 0x7fcb6005ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.467+0000 7fcb8623d700 1 --2- 172.21.15.133:0/3527646380 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb60055330 0x7fcb600577f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fcb7c01b000 tx=0x7fcb7c016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.467+0000 7fcb86a3e700 1 --2- 172.21.15.133:0/3527646380 >> [v2:172.21.15.133:6826/12136,v1:172.21.15.133:6827/12136] conn(0x7fcb6005c7c0 0x7fcb6005ebe0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.467+0000 7fcb6f7fe700 1 -- 172.21.15.133:0/3527646380 <== osd.3 v2:172.21.15.133:6826/12136 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7fcb6005f240 con 0x7fcb6005c7c0 2021-01-03T12:58:05.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.487+0000 7fcb8723f700 1 -- 172.21.15.133:0/3527646380 --> [v2:172.21.15.133:6826/12136,v1:172.21.15.133:6827/12136] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb800af570 con 0x7fcb6005c7c0 2021-01-03T12:58:05.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.487+0000 7fcb6f7fe700 1 -- 172.21.15.133:0/3527646380 <== osd.3 v2:172.21.15.133:6826/12136 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcb800af570 con 0x7fcb6005c7c0 2021-01-03T12:58:05.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.487+0000 7fcb8723f700 1 -- 172.21.15.133:0/3527646380 >> [v2:172.21.15.133:6826/12136,v1:172.21.15.133:6827/12136] conn(0x7fcb6005c7c0 msgr2=0x7fcb6005ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.487+0000 7fcb8723f700 1 --2- 172.21.15.133:0/3527646380 >> [v2:172.21.15.133:6826/12136,v1:172.21.15.133:6827/12136] conn(0x7fcb6005c7c0 0x7fcb6005ebe0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.487+0000 7fcb8723f700 1 -- 172.21.15.133:0/3527646380 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb60055330 msgr2=0x7fcb600577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.487+0000 7fcb8723f700 1 --2- 172.21.15.133:0/3527646380 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb60055330 0x7fcb600577f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fcb7c01b000 tx=0x7fcb7c016000).stop 2021-01-03T12:58:05.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.487+0000 7fcb8723f700 1 -- 172.21.15.133:0/3527646380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb800b52c0 msgr2=0x7fcb80066580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.487+0000 7fcb8723f700 1 --2- 172.21.15.133:0/3527646380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb800b52c0 0x7fcb80066580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fcb800adc60 tx=0x7fcb70007aa0).stop 2021-01-03T12:58:05.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.487+0000 7fcb86a3e700 1 -- 172.21.15.133:0/3527646380 reap_dead start 2021-01-03T12:58:05.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.487+0000 7fcb8723f700 1 -- 172.21.15.133:0/3527646380 shutdown_connections 2021-01-03T12:58:05.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.487+0000 7fcb8723f700 1 -- 172.21.15.133:0/3527646380 >> 172.21.15.133:0/3527646380 conn(0x7fcb8005bdf0 msgr2=0x7fcb80143500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:05.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.487+0000 7fcb8723f700 1 -- 172.21.15.133:0/3527646380 shutdown_connections 2021-01-03T12:58:05.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.487+0000 7fcb8723f700 1 -- 172.21.15.133:0/3527646380 wait complete. 2021-01-03T12:58:05.503 INFO:teuthology.orchestra.run.smithi133.stdout:60129542149 2021-01-03T12:58:05.503 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2021-01-03T12:58:05.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.615+0000 7f76f9516700 1 Processor -- start 2021-01-03T12:58:05.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.615+0000 7f76f9516700 1 -- start start 2021-01-03T12:58:05.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.615+0000 7f76f9516700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f76f40a7570 0x7f76f40671e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.615+0000 7f76f9516700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f40b1110 con 0x7f76f40b2350 2021-01-03T12:58:05.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.615+0000 7f76f9516700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f40b0520 con 0x7f76f40b1b20 2021-01-03T12:58:05.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.615+0000 7f76f9516700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f40a7cb0 con 0x7f76f40a7570 2021-01-03T12:58:05.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f8d15700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f76f40b1b20 0x7f76f40676d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52834/0 (socket says 172.21.15.133:52834) 2021-01-03T12:58:05.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f8d15700 1 -- 172.21.15.133:0/1640162666 learned_addr learned my addr 172.21.15.133:0/1640162666 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:05.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f37fe700 1 --2- 172.21.15.133:0/1640162666 >> v2:172.21.15.16:3300/0 conn(0x7f76f40a7570 0x7f76f40671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 -- 172.21.15.133:0/1640162666 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504354233 0 0) 0x7f76f40b0520 con 0x7f76f40b1b20 2021-01-03T12:58:05.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 -- 172.21.15.133:0/1640162666 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76e0003230 con 0x7f76f40b1b20 2021-01-03T12:58:05.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 -- 172.21.15.133:0/1640162666 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 130041143 0 0) 0x7f76e0003230 con 0x7f76f40b1b20 2021-01-03T12:58:05.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 -- 172.21.15.133:0/1640162666 >> v2:172.21.15.16:3300/0 conn(0x7f76f40a7570 msgr2=0x7f76f40671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:05.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 --2- 172.21.15.133:0/1640162666 >> v2:172.21.15.16:3300/0 conn(0x7f76f40a7570 0x7f76f40671e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 -- 172.21.15.133:0/1640162666 >> v1:172.21.15.16:6789/0 conn(0x7f76f40b2350 legacy=0x7f76f414a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 -- 172.21.15.133:0/1640162666 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f40b0bd0 con 0x7f76f40b1b20 2021-01-03T12:58:05.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 -- 172.21.15.133:0/1640162666 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f76ec001a50 con 0x7f76f40b1b20 2021-01-03T12:58:05.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 -- 172.21.15.133:0/1640162666 >> v1:172.21.15.133:6789/0 conn(0x7f76f40b1b20 legacy=0x7f76f40676d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 --2- 172.21.15.133:0/1640162666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76e0003720 0x7f76e0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 --2- 172.21.15.133:0/1640162666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76e00044d0 0x7f76e0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 --2- 172.21.15.133:0/1640162666 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76e0004e40 0x7f76e000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 -- 172.21.15.133:0/1640162666 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f40a7cb0 con 0x7f76e00044d0 2021-01-03T12:58:05.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 -- 172.21.15.133:0/1640162666 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e0004250 con 0x7f76e0003720 2021-01-03T12:58:05.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 -- 172.21.15.133:0/1640162666 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e000bc10 con 0x7f76e0004e40 2021-01-03T12:58:05.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f3fff700 1 --2- 172.21.15.133:0/1640162666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76e0003720 0x7f76e0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f37fe700 1 --2- 172.21.15.133:0/1640162666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76e00044d0 0x7f76e0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f8d15700 1 --2- 172.21.15.133:0/1640162666 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76e0004e40 0x7f76e000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f3fff700 1 -- 172.21.15.133:0/1640162666 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76e0004e40 msgr2=0x7f76e000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:05.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f3fff700 1 --2- 172.21.15.133:0/1640162666 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76e0004e40 0x7f76e000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f3fff700 1 -- 172.21.15.133:0/1640162666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76e00044d0 msgr2=0x7f76e0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:05.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f3fff700 1 --2- 172.21.15.133:0/1640162666 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76e00044d0 0x7f76e0004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f3fff700 1 -- 172.21.15.133:0/1640162666 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e0003230 con 0x7f76e0003720 2021-01-03T12:58:05.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f8d15700 1 -- 172.21.15.133:0/1640162666 reap_dead start 2021-01-03T12:58:05.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f3fff700 1 --2- 172.21.15.133:0/1640162666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76e0003720 0x7f76e0003b40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f76f405cea0 tx=0x7f76e4007b60).ready entity=mon.1 client_cookie=23689f1fc5abc539 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 -- 172.21.15.133:0/1640162666 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76e400c660 con 0x7f76e0003720 2021-01-03T12:58:05.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 -- 172.21.15.133:0/1640162666 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e400c7c0 con 0x7f76e0003720 2021-01-03T12:58:05.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f2ffd700 1 -- 172.21.15.133:0/1640162666 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76e400cb20 con 0x7f76e0003720 2021-01-03T12:58:05.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f9516700 1 -- 172.21.15.133:0/1640162666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76e0003720 msgr2=0x7f76e0003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f9516700 1 --2- 172.21.15.133:0/1640162666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76e0003720 0x7f76e0003b40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f76f405cea0 tx=0x7f76e4007b60).stop 2021-01-03T12:58:05.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f9516700 1 -- 172.21.15.133:0/1640162666 shutdown_connections 2021-01-03T12:58:05.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f9516700 1 --2- 172.21.15.133:0/1640162666 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76e0003720 0x7f76e0003b40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f9516700 1 -- 172.21.15.133:0/1640162666 >> 172.21.15.133:0/1640162666 conn(0x7f76f406b050 msgr2=0x7f76f4060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:05.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f9516700 1 -- 172.21.15.133:0/1640162666 shutdown_connections 2021-01-03T12:58:05.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.619+0000 7f76f9516700 1 -- 172.21.15.133:0/1640162666 wait complete. 2021-01-03T12:58:05.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.623+0000 7f76f9516700 1 Processor -- start 2021-01-03T12:58:05.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.623+0000 7f76f9516700 1 -- start start 2021-01-03T12:58:05.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.623+0000 7f76f9516700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76e0003720 0x7f76f414cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.623+0000 7f76f9516700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76f40b3970 0x7f76f4159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.623+0000 7f76f9516700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76f40b3df0 0x7f76f4159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f9516700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f415a4c0 con 0x7f76f40b3970 2021-01-03T12:58:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f9516700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f41566d0 con 0x7f76e0003720 2021-01-03T12:58:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76e0003720 0x7f76f414cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f9516700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f4156970 con 0x7f76f40b3df0 2021-01-03T12:58:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76e0003720 0x7f76f414cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60042/0 (socket says 172.21.15.133:60042) 2021-01-03T12:58:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f3fff700 1 -- 172.21.15.133:0/871786923 learned_addr learned my addr 172.21.15.133:0/871786923 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f8d15700 1 --2- 172.21.15.133:0/871786923 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76f40b3df0 0x7f76f4159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f37fe700 1 --2- 172.21.15.133:0/871786923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76f40b3970 0x7f76f4159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f3fff700 1 -- 172.21.15.133:0/871786923 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76f40b3df0 msgr2=0x7f76f4159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f3fff700 1 --2- 172.21.15.133:0/871786923 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76f40b3df0 0x7f76f4159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f3fff700 1 -- 172.21.15.133:0/871786923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76f40b3970 msgr2=0x7f76f4159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f3fff700 1 --2- 172.21.15.133:0/871786923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76f40b3970 0x7f76f4159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f3fff700 1 -- 172.21.15.133:0/871786923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f4156c10 con 0x7f76e0003720 2021-01-03T12:58:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f3fff700 1 --2- 172.21.15.133:0/871786923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76e0003720 0x7f76f414cae0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f76f405cea0 tx=0x7f76e4017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f17fa700 1 -- 172.21.15.133:0/871786923 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76e4001ea0 con 0x7f76e0003720 2021-01-03T12:58:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f17fa700 1 -- 172.21.15.133:0/871786923 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e4007220 con 0x7f76e0003720 2021-01-03T12:58:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f9516700 1 -- 172.21.15.133:0/871786923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f4156eb0 con 0x7f76e0003720 2021-01-03T12:58:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f17fa700 1 -- 172.21.15.133:0/871786923 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76e40066d0 con 0x7f76e0003720 2021-01-03T12:58:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f9516700 1 -- 172.21.15.133:0/871786923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f414cfd0 con 0x7f76e0003720 2021-01-03T12:58:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f9516700 1 -- 172.21.15.133:0/871786923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76f4157040 con 0x7f76e0003720 2021-01-03T12:58:05.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f17fa700 1 -- 172.21.15.133:0/871786923 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f76e4023020 con 0x7f76e0003720 2021-01-03T12:58:05.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f17fa700 1 --2- 172.21.15.133:0/871786923 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f76d4055470 0x7f76d4057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f17fa700 1 -- 172.21.15.133:0/871786923 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f76e406e810 con 0x7f76e0003720 2021-01-03T12:58:05.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f37fe700 1 --2- 172.21.15.133:0/871786923 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f76d4055470 0x7f76d4057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f17fa700 1 --2- 172.21.15.133:0/871786923 >> [v2:172.21.15.16:6808/12672,v1:172.21.15.16:6809/12672] conn(0x7f76d405c860 0x7f76d405ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f17fa700 1 -- 172.21.15.133:0/871786923 --> [v2:172.21.15.16:6808/12672,v1:172.21.15.16:6809/12672] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76d405f240 con 0x7f76d405c860 2021-01-03T12:58:05.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.627+0000 7f76f17fa700 1 -- 172.21.15.133:0/871786923 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76e4073240 con 0x7f76e0003720 2021-01-03T12:58:05.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.631+0000 7f76f8d15700 1 --2- 172.21.15.133:0/871786923 >> [v2:172.21.15.16:6808/12672,v1:172.21.15.16:6809/12672] conn(0x7f76d405c860 0x7f76d405ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.631+0000 7f76f37fe700 1 --2- 172.21.15.133:0/871786923 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f76d4055470 0x7f76d4057930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f76e8008000 tx=0x7f76e8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.631+0000 7f76f8d15700 1 --2- 172.21.15.133:0/871786923 >> [v2:172.21.15.16:6808/12672,v1:172.21.15.16:6809/12672] conn(0x7f76d405c860 0x7f76d405ec80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.631+0000 7f76f17fa700 1 -- 172.21.15.133:0/871786923 <== osd.4 v2:172.21.15.16:6808/12672 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7f76d405f240 con 0x7f76d405c860 2021-01-03T12:58:05.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.651+0000 7f76f9516700 1 -- 172.21.15.133:0/871786923 --> [v2:172.21.15.16:6808/12672,v1:172.21.15.16:6809/12672] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f76f4057300 con 0x7f76d405c860 2021-01-03T12:58:05.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.655+0000 7f76f17fa700 1 -- 172.21.15.133:0/871786923 <== osd.4 v2:172.21.15.16:6808/12672 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f76f4057300 con 0x7f76d405c860 2021-01-03T12:58:05.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.655+0000 7f76f9516700 1 -- 172.21.15.133:0/871786923 >> [v2:172.21.15.16:6808/12672,v1:172.21.15.16:6809/12672] conn(0x7f76d405c860 msgr2=0x7f76d405ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.655+0000 7f76f9516700 1 --2- 172.21.15.133:0/871786923 >> [v2:172.21.15.16:6808/12672,v1:172.21.15.16:6809/12672] conn(0x7f76d405c860 0x7f76d405ec80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.655+0000 7f76f9516700 1 -- 172.21.15.133:0/871786923 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f76d4055470 msgr2=0x7f76d4057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.655+0000 7f76f9516700 1 --2- 172.21.15.133:0/871786923 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f76d4055470 0x7f76d4057930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f76e8008000 tx=0x7f76e8008040).stop 2021-01-03T12:58:05.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.655+0000 7f76f9516700 1 -- 172.21.15.133:0/871786923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76e0003720 msgr2=0x7f76f414cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.655+0000 7f76f9516700 1 --2- 172.21.15.133:0/871786923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76e0003720 0x7f76f414cae0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f76f405cea0 tx=0x7f76e4017000).stop 2021-01-03T12:58:05.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.655+0000 7f76f8d15700 1 -- 172.21.15.133:0/871786923 reap_dead start 2021-01-03T12:58:05.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.655+0000 7f76f9516700 1 -- 172.21.15.133:0/871786923 shutdown_connections 2021-01-03T12:58:05.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.655+0000 7f76f9516700 1 -- 172.21.15.133:0/871786923 >> 172.21.15.133:0/871786923 conn(0x7f76f406b050 msgr2=0x7f76f40ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:05.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.655+0000 7f76f9516700 1 -- 172.21.15.133:0/871786923 shutdown_connections 2021-01-03T12:58:05.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.655+0000 7f76f9516700 1 -- 172.21.15.133:0/871786923 wait complete. 2021-01-03T12:58:05.669 INFO:teuthology.orchestra.run.smithi133.stdout:60129542148 2021-01-03T12:58:05.669 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2021-01-03T12:58:05.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.787+0000 7f85de0ab700 1 Processor -- start 2021-01-03T12:58:05.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.787+0000 7f85de0ab700 1 -- start start 2021-01-03T12:58:05.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85de0ab700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f85d8146b40 0x7f85d814e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85de0ab700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d80605f0 con 0x7f85d80b9b60 2021-01-03T12:58:05.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85de0ab700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d80600b0 con 0x7f85d80b9f40 2021-01-03T12:58:05.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85de0ab700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d80aed30 con 0x7f85d8146b40 2021-01-03T12:58:05.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85dd8aa700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f85d8146b40 0x7f85d814e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85dd8aa700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f85d8146b40 0x7f85d814e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60056/0 (socket says 172.21.15.133:60056) 2021-01-03T12:58:05.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85dc8a8700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f85d80b9f40 0x7f85d8146430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52852/0 (socket says 172.21.15.133:52852) 2021-01-03T12:58:05.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85dd8aa700 1 -- 172.21.15.133:0/4047389946 learned_addr learned my addr 172.21.15.133:0/4047389946 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:05.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85dd8aa700 1 -- 172.21.15.133:0/4047389946 >> v1:172.21.15.133:6789/0 conn(0x7f85d80b9f40 legacy=0x7f85d8146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85dd8aa700 1 -- 172.21.15.133:0/4047389946 >> v1:172.21.15.16:6789/0 conn(0x7f85d80b9b60 legacy=0x7f85d80b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85dd8aa700 1 -- 172.21.15.133:0/4047389946 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d8060350 con 0x7f85d8146b40 2021-01-03T12:58:05.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85dd8aa700 1 --2- 172.21.15.133:0/4047389946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d8146b40 0x7f85d814e510 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f85d00032b0 tx=0x7f85d0009270).ready entity=mon.1 client_cookie=80c08b8fbf151597 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85cbfff700 1 -- 172.21.15.133:0/4047389946 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85d000bc00 con 0x7f85d8146b40 2021-01-03T12:58:05.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85cbfff700 1 -- 172.21.15.133:0/4047389946 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d000bd60 con 0x7f85d8146b40 2021-01-03T12:58:05.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85cbfff700 1 -- 172.21.15.133:0/4047389946 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85d0011400 con 0x7f85d8146b40 2021-01-03T12:58:05.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85de0ab700 1 -- 172.21.15.133:0/4047389946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d8146b40 msgr2=0x7f85d814e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85de0ab700 1 --2- 172.21.15.133:0/4047389946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d8146b40 0x7f85d814e510 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f85d00032b0 tx=0x7f85d0009270).stop 2021-01-03T12:58:05.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85de0ab700 1 -- 172.21.15.133:0/4047389946 shutdown_connections 2021-01-03T12:58:05.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85de0ab700 1 --2- 172.21.15.133:0/4047389946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d8146b40 0x7f85d814e510 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85de0ab700 1 -- 172.21.15.133:0/4047389946 >> 172.21.15.133:0/4047389946 conn(0x7f85d80b69e0 msgr2=0x7f85d80b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:05.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85de0ab700 1 -- 172.21.15.133:0/4047389946 shutdown_connections 2021-01-03T12:58:05.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.791+0000 7f85de0ab700 1 -- 172.21.15.133:0/4047389946 wait complete. 2021-01-03T12:58:05.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85de0ab700 1 Processor -- start 2021-01-03T12:58:05.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85de0ab700 1 -- start start 2021-01-03T12:58:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85de0ab700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85d80b9b60 0x7f85d81442d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85de0ab700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d80b9f40 0x7f85d8152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85de0ab700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f85d8146b40 0x7f85d80b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85de0ab700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d809ef70 con 0x7f85d80b9b60 2021-01-03T12:58:05.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85de0ab700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d809f160 con 0x7f85d80b9f40 2021-01-03T12:58:05.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85de0ab700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d8151cf0 con 0x7f85d8146b40 2021-01-03T12:58:05.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85dc8a8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d80b9f40 0x7f85d8152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85dc8a8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d80b9f40 0x7f85d8152430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60060/0 (socket says 172.21.15.133:60060) 2021-01-03T12:58:05.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85dc8a8700 1 -- 172.21.15.133:0/2520816917 learned_addr learned my addr 172.21.15.133:0/2520816917 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:05.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85dd8aa700 1 --2- 172.21.15.133:0/2520816917 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f85d8146b40 0x7f85d80b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85dd0a9700 1 --2- 172.21.15.133:0/2520816917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85d80b9b60 0x7f85d81442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85dc8a8700 1 -- 172.21.15.133:0/2520816917 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f85d8146b40 msgr2=0x7f85d80b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85dc8a8700 1 --2- 172.21.15.133:0/2520816917 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f85d8146b40 0x7f85d80b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85dc8a8700 1 -- 172.21.15.133:0/2520816917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85d80b9b60 msgr2=0x7f85d81442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85dc8a8700 1 --2- 172.21.15.133:0/2520816917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85d80b9b60 0x7f85d81442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85dc8a8700 1 -- 172.21.15.133:0/2520816917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d8151f90 con 0x7f85d80b9f40 2021-01-03T12:58:05.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85dd0a9700 1 --2- 172.21.15.133:0/2520816917 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85d80b9b60 0x7f85d81442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:05.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85dc8a8700 1 --2- 172.21.15.133:0/2520816917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d80b9f40 0x7f85d8152430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f85d80909e0 tx=0x7f85d4007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85ca7fc700 1 -- 172.21.15.133:0/2520816917 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85d40072e0 con 0x7f85d80b9f40 2021-01-03T12:58:05.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85ca7fc700 1 -- 172.21.15.133:0/2520816917 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d4005520 con 0x7f85d80b9f40 2021-01-03T12:58:05.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85de0ab700 1 -- 172.21.15.133:0/2520816917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d8142370 con 0x7f85d80b9f40 2021-01-03T12:58:05.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85ca7fc700 1 -- 172.21.15.133:0/2520816917 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85d4005880 con 0x7f85d80b9f40 2021-01-03T12:58:05.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.795+0000 7f85de0ab700 1 -- 172.21.15.133:0/2520816917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d80913f0 con 0x7f85d80b9f40 2021-01-03T12:58:05.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.799+0000 7f85de0ab700 1 -- 172.21.15.133:0/2520816917 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85d8152120 con 0x7f85d80b9f40 2021-01-03T12:58:05.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.799+0000 7f85ca7fc700 1 -- 172.21.15.133:0/2520816917 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f85d401a060 con 0x7f85d80b9f40 2021-01-03T12:58:05.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.799+0000 7f85ca7fc700 1 --2- 172.21.15.133:0/2520816917 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f85c00554e0 0x7f85c00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.799+0000 7f85ca7fc700 1 -- 172.21.15.133:0/2520816917 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f85d406ddc0 con 0x7f85d80b9f40 2021-01-03T12:58:05.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.799+0000 7f85dd0a9700 1 --2- 172.21.15.133:0/2520816917 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f85c00554e0 0x7f85c00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.799+0000 7f85ca7fc700 1 --2- 172.21.15.133:0/2520816917 >> [v2:172.21.15.16:6817/12673,v1:172.21.15.16:6819/12673] conn(0x7f85c005c8d0 0x7f85c005ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.799+0000 7f85ca7fc700 1 -- 172.21.15.133:0/2520816917 --> [v2:172.21.15.16:6817/12673,v1:172.21.15.16:6819/12673] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85c005f2b0 con 0x7f85c005c8d0 2021-01-03T12:58:05.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.799+0000 7f85ca7fc700 1 -- 172.21.15.133:0/2520816917 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85d406e1a0 con 0x7f85d80b9f40 2021-01-03T12:58:05.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.799+0000 7f85dd0a9700 1 --2- 172.21.15.133:0/2520816917 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f85c00554e0 0x7f85c00579a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f85cc00b000 tx=0x7f85cc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.799+0000 7f85dd8aa700 1 --2- 172.21.15.133:0/2520816917 >> [v2:172.21.15.16:6817/12673,v1:172.21.15.16:6819/12673] conn(0x7f85c005c8d0 0x7f85c005ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.803+0000 7f85dd8aa700 1 --2- 172.21.15.133:0/2520816917 >> [v2:172.21.15.16:6817/12673,v1:172.21.15.16:6819/12673] conn(0x7f85c005c8d0 0x7f85c005ecf0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.803+0000 7f85ca7fc700 1 -- 172.21.15.133:0/2520816917 <== osd.5 v2:172.21.15.16:6817/12673 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7f85c005f2b0 con 0x7f85c005c8d0 2021-01-03T12:58:05.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.827+0000 7f85de0ab700 1 -- 172.21.15.133:0/2520816917 --> [v2:172.21.15.16:6817/12673,v1:172.21.15.16:6819/12673] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f85d8057300 con 0x7f85c005c8d0 2021-01-03T12:58:05.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.827+0000 7f85ca7fc700 1 -- 172.21.15.133:0/2520816917 <== osd.5 v2:172.21.15.16:6817/12673 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f85d8057300 con 0x7f85c005c8d0 2021-01-03T12:58:05.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.827+0000 7f85de0ab700 1 -- 172.21.15.133:0/2520816917 >> [v2:172.21.15.16:6817/12673,v1:172.21.15.16:6819/12673] conn(0x7f85c005c8d0 msgr2=0x7f85c005ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.827+0000 7f85de0ab700 1 --2- 172.21.15.133:0/2520816917 >> [v2:172.21.15.16:6817/12673,v1:172.21.15.16:6819/12673] conn(0x7f85c005c8d0 0x7f85c005ecf0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.827+0000 7f85de0ab700 1 -- 172.21.15.133:0/2520816917 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f85c00554e0 msgr2=0x7f85c00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.827+0000 7f85de0ab700 1 --2- 172.21.15.133:0/2520816917 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f85c00554e0 0x7f85c00579a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f85cc00b000 tx=0x7f85cc009040).stop 2021-01-03T12:58:05.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.827+0000 7f85de0ab700 1 -- 172.21.15.133:0/2520816917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d80b9f40 msgr2=0x7f85d8152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.827+0000 7f85de0ab700 1 --2- 172.21.15.133:0/2520816917 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f85d80b9f40 0x7f85d8152430 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f85d80909e0 tx=0x7f85d4007bd0).stop 2021-01-03T12:58:05.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.827+0000 7f85dd8aa700 1 -- 172.21.15.133:0/2520816917 reap_dead start 2021-01-03T12:58:05.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.827+0000 7f85de0ab700 1 -- 172.21.15.133:0/2520816917 shutdown_connections 2021-01-03T12:58:05.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.827+0000 7f85de0ab700 1 -- 172.21.15.133:0/2520816917 >> 172.21.15.133:0/2520816917 conn(0x7f85d80b69e0 msgr2=0x7f85d8142c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:05.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.827+0000 7f85de0ab700 1 -- 172.21.15.133:0/2520816917 shutdown_connections 2021-01-03T12:58:05.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.827+0000 7f85de0ab700 1 -- 172.21.15.133:0/2520816917 wait complete. 2021-01-03T12:58:05.841 INFO:teuthology.orchestra.run.smithi133.stdout:60129542149 2021-01-03T12:58:05.842 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2021-01-03T12:58:05.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.955+0000 7fdf10f9a700 1 Processor -- start 2021-01-03T12:58:05.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.955+0000 7fdf10f9a700 1 -- start start 2021-01-03T12:58:05.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.955+0000 7fdf10f9a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf0c0b52c0 0x7fdf0c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.955+0000 7fdf10f9a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0c060da0 con 0x7fdf0c0b0c90 2021-01-03T12:58:05.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.955+0000 7fdf10f9a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0c0b0ad0 con 0x7fdf0c0b5c00 2021-01-03T12:58:05.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.955+0000 7fdf10f9a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c067a90 con 0x7fdf0c0b52c0 2021-01-03T12:58:05.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdf0c0b5c00 0x7fdf0c143eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52872/0 (socket says 172.21.15.133:52872) 2021-01-03T12:58:05.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0bfff700 1 -- 172.21.15.133:0/3879688465 learned_addr learned my addr 172.21.15.133:0/3879688465 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:05.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0b7fe700 1 --2- 172.21.15.133:0/3879688465 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf0c0b52c0 0x7fdf0c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 -- 172.21.15.133:0/3879688465 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943138072 0 0) 0x7fdf04001450 con 0x7fdf0c0b5c00 2021-01-03T12:58:05.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 -- 172.21.15.133:0/3879688465 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeec003230 con 0x7fdf0c0b5c00 2021-01-03T12:58:05.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 -- 172.21.15.133:0/3879688465 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187008178 0 0) 0x7fdf0c060da0 con 0x7fdf0c0b0c90 2021-01-03T12:58:05.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 -- 172.21.15.133:0/3879688465 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf04001450 con 0x7fdf0c0b0c90 2021-01-03T12:58:05.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 -- 172.21.15.133:0/3879688465 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4001347712 0 0) 0x7fdeec003230 con 0x7fdf0c0b5c00 2021-01-03T12:58:05.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 -- 172.21.15.133:0/3879688465 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf0c0b52c0 msgr2=0x7fdf0c0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:05.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 --2- 172.21.15.133:0/3879688465 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf0c0b52c0 0x7fdf0c0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 -- 172.21.15.133:0/3879688465 >> v1:172.21.15.16:6789/0 conn(0x7fdf0c0b0c90 legacy=0x7fdf0c098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 -- 172.21.15.133:0/3879688465 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c0b56a0 con 0x7fdf0c0b5c00 2021-01-03T12:58:05.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 -- 172.21.15.133:0/3879688465 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fdf04001be0 con 0x7fdf0c0b5c00 2021-01-03T12:58:05.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 -- 172.21.15.133:0/3879688465 >> v1:172.21.15.133:6789/0 conn(0x7fdf0c0b5c00 legacy=0x7fdf0c143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 --2- 172.21.15.133:0/3879688465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec0038b0 0x7fdeec003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 --2- 172.21.15.133:0/3879688465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdeec0044d0 0x7fdeec004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 --2- 172.21.15.133:0/3879688465 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf0c0b52c0 0x7fdeec004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 -- 172.21.15.133:0/3879688465 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c067a90 con 0x7fdeec0038b0 2021-01-03T12:58:05.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 -- 172.21.15.133:0/3879688465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec005330 con 0x7fdeec0044d0 2021-01-03T12:58:05.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 -- 172.21.15.133:0/3879688465 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec00b750 con 0x7fdf0c0b52c0 2021-01-03T12:58:05.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf02ffd700 1 --2- 172.21.15.133:0/3879688465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdeec0044d0 0x7fdeec004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0b7fe700 1 --2- 172.21.15.133:0/3879688465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec0038b0 0x7fdeec003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0bfff700 1 --2- 172.21.15.133:0/3879688465 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf0c0b52c0 0x7fdeec004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf02ffd700 1 -- 172.21.15.133:0/3879688465 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf0c0b52c0 msgr2=0x7fdeec004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:05.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf02ffd700 1 --2- 172.21.15.133:0/3879688465 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf0c0b52c0 0x7fdeec004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf02ffd700 1 -- 172.21.15.133:0/3879688465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec0038b0 msgr2=0x7fdeec003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:05.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf02ffd700 1 --2- 172.21.15.133:0/3879688465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec0038b0 0x7fdeec003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf02ffd700 1 -- 172.21.15.133:0/3879688465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec003230 con 0x7fdeec0044d0 2021-01-03T12:58:05.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0b7fe700 1 --2- 172.21.15.133:0/3879688465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdeec0038b0 0x7fdeec003cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:05.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0bfff700 1 --2- 172.21.15.133:0/3879688465 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf0c0b52c0 0x7fdeec004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:05.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf02ffd700 1 --2- 172.21.15.133:0/3879688465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdeec0044d0 0x7fdeec004950 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fdeec004440 tx=0x7fdef4007b60).ready entity=mon.1 client_cookie=84086686f6e70b00 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 -- 172.21.15.133:0/3879688465 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdef400c830 con 0x7fdeec0044d0 2021-01-03T12:58:05.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 -- 172.21.15.133:0/3879688465 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef400c990 con 0x7fdeec0044d0 2021-01-03T12:58:05.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0affd700 1 -- 172.21.15.133:0/3879688465 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdef400ccf0 con 0x7fdeec0044d0 2021-01-03T12:58:05.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf10f9a700 1 -- 172.21.15.133:0/3879688465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdeec0044d0 msgr2=0x7fdeec004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf10f9a700 1 --2- 172.21.15.133:0/3879688465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdeec0044d0 0x7fdeec004950 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fdeec004440 tx=0x7fdef4007b60).stop 2021-01-03T12:58:05.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf0bfff700 1 -- 172.21.15.133:0/3879688465 reap_dead start 2021-01-03T12:58:05.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf10f9a700 1 -- 172.21.15.133:0/3879688465 shutdown_connections 2021-01-03T12:58:05.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf10f9a700 1 -- 172.21.15.133:0/3879688465 >> 172.21.15.133:0/3879688465 conn(0x7fdf0c05bdf0 msgr2=0x7fdf0c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:05.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf10f9a700 1 -- 172.21.15.133:0/3879688465 shutdown_connections 2021-01-03T12:58:05.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.959+0000 7fdf10f9a700 1 -- 172.21.15.133:0/3879688465 wait complete. 2021-01-03T12:58:05.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf10f9a700 1 Processor -- start 2021-01-03T12:58:05.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf10f9a700 1 -- start start 2021-01-03T12:58:05.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf10f9a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf0c0b41a0 0x7fdf0c063a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf10f9a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf0c0644c0 0x7fdf0c142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf10f9a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf0c0668f0 0x7fdf0c142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf10f9a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c0b4580 con 0x7fdf0c0668f0 2021-01-03T12:58:05.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf10f9a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c0aeab0 con 0x7fdf0c0b41a0 2021-01-03T12:58:05.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf10f9a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c0aed50 con 0x7fdf0c0644c0 2021-01-03T12:58:05.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf0b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf0c0b41a0 0x7fdf0c063a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf0b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf0c0b41a0 0x7fdf0c063a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60080/0 (socket says 172.21.15.133:60080) 2021-01-03T12:58:05.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf0b7fe700 1 -- 172.21.15.133:0/3318753506 learned_addr learned my addr 172.21.15.133:0/3318753506 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:05.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf0bfff700 1 --2- 172.21.15.133:0/3318753506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf0c0668f0 0x7fdf0c142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf0b7fe700 1 -- 172.21.15.133:0/3318753506 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf0c0644c0 msgr2=0x7fdf0c142260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-03T12:58:05.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf0b7fe700 1 --2- 172.21.15.133:0/3318753506 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf0c0644c0 0x7fdf0c142260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T12:58:05.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf0b7fe700 1 -- 172.21.15.133:0/3318753506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf0c0668f0 msgr2=0x7fdf0c142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf0b7fe700 1 --2- 172.21.15.133:0/3318753506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf0c0668f0 0x7fdf0c142750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf0b7fe700 1 -- 172.21.15.133:0/3318753506 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c0635e0 con 0x7fdf0c0b41a0 2021-01-03T12:58:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf0b7fe700 1 --2- 172.21.15.133:0/3318753506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf0c0b41a0 0x7fdf0c063a80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fdefc000b20 tx=0x7fdefc008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf097fa700 1 -- 172.21.15.133:0/3318753506 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdefc00fca0 con 0x7fdf0c0b41a0 2021-01-03T12:58:05.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf097fa700 1 -- 172.21.15.133:0/3318753506 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc00fe00 con 0x7fdf0c0b41a0 2021-01-03T12:58:05.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf097fa700 1 -- 172.21.15.133:0/3318753506 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdefc014440 con 0x7fdf0c0b41a0 2021-01-03T12:58:05.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf10f9a700 1 -- 172.21.15.133:0/3318753506 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0c066620 con 0x7fdf0c0b41a0 2021-01-03T12:58:05.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.963+0000 7fdf10f9a700 1 -- 172.21.15.133:0/3318753506 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c0ae1f0 con 0x7fdf0c0b41a0 2021-01-03T12:58:05.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.967+0000 7fdf10f9a700 1 -- 172.21.15.133:0/3318753506 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf0c0ae930 con 0x7fdf0c0b41a0 2021-01-03T12:58:05.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.967+0000 7fdf097fa700 1 -- 172.21.15.133:0/3318753506 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fdefc0145a0 con 0x7fdf0c0b41a0 2021-01-03T12:58:05.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.967+0000 7fdf097fa700 1 --2- 172.21.15.133:0/3318753506 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdef0055440 0x7fdef0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.967+0000 7fdf097fa700 1 -- 172.21.15.133:0/3318753506 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdefc06e720 con 0x7fdf0c0b41a0 2021-01-03T12:58:05.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.967+0000 7fdf02ffd700 1 --2- 172.21.15.133:0/3318753506 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdef0055440 0x7fdef0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.967+0000 7fdf097fa700 1 --2- 172.21.15.133:0/3318753506 >> [v2:172.21.15.16:6800/12662,v1:172.21.15.16:6801/12662] conn(0x7fdef005c830 0x7fdef005ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:05.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.967+0000 7fdf097fa700 1 -- 172.21.15.133:0/3318753506 --> [v2:172.21.15.16:6800/12662,v1:172.21.15.16:6801/12662] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdef005f210 con 0x7fdef005c830 2021-01-03T12:58:05.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.967+0000 7fdf097fa700 1 -- 172.21.15.133:0/3318753506 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdefc070d30 con 0x7fdf0c0b41a0 2021-01-03T12:58:05.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.967+0000 7fdf0bfff700 1 --2- 172.21.15.133:0/3318753506 >> [v2:172.21.15.16:6800/12662,v1:172.21.15.16:6801/12662] conn(0x7fdef005c830 0x7fdef005ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:05.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.967+0000 7fdf02ffd700 1 --2- 172.21.15.133:0/3318753506 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdef0055440 0x7fdef0057900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fdeec004440 tx=0x7fdef4017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.967+0000 7fdf0bfff700 1 --2- 172.21.15.133:0/3318753506 >> [v2:172.21.15.16:6800/12662,v1:172.21.15.16:6801/12662] conn(0x7fdef005c830 0x7fdef005ec50 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:05.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.971+0000 7fdf097fa700 1 -- 172.21.15.133:0/3318753506 <== osd.6 v2:172.21.15.16:6800/12662 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7fdef005f210 con 0x7fdef005c830 2021-01-03T12:58:05.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.991+0000 7fdf10f9a700 1 -- 172.21.15.133:0/3318753506 --> [v2:172.21.15.16:6800/12662,v1:172.21.15.16:6801/12662] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdf0c0642b0 con 0x7fdef005c830 2021-01-03T12:58:05.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.991+0000 7fdf097fa700 1 -- 172.21.15.133:0/3318753506 <== osd.6 v2:172.21.15.16:6800/12662 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdf0c0642b0 con 0x7fdef005c830 2021-01-03T12:58:05.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.991+0000 7fdf10f9a700 1 -- 172.21.15.133:0/3318753506 >> [v2:172.21.15.16:6800/12662,v1:172.21.15.16:6801/12662] conn(0x7fdef005c830 msgr2=0x7fdef005ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.991+0000 7fdf10f9a700 1 --2- 172.21.15.133:0/3318753506 >> [v2:172.21.15.16:6800/12662,v1:172.21.15.16:6801/12662] conn(0x7fdef005c830 0x7fdef005ec50 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.991+0000 7fdf10f9a700 1 -- 172.21.15.133:0/3318753506 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdef0055440 msgr2=0x7fdef0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.991+0000 7fdf10f9a700 1 --2- 172.21.15.133:0/3318753506 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdef0055440 0x7fdef0057900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fdeec004440 tx=0x7fdef4017000).stop 2021-01-03T12:58:05.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.991+0000 7fdf10f9a700 1 -- 172.21.15.133:0/3318753506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf0c0b41a0 msgr2=0x7fdf0c063a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:05.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.991+0000 7fdf10f9a700 1 --2- 172.21.15.133:0/3318753506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf0c0b41a0 0x7fdf0c063a80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fdefc000b20 tx=0x7fdefc008040).stop 2021-01-03T12:58:05.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.991+0000 7fdf0bfff700 1 -- 172.21.15.133:0/3318753506 reap_dead start 2021-01-03T12:58:05.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.991+0000 7fdf10f9a700 1 -- 172.21.15.133:0/3318753506 shutdown_connections 2021-01-03T12:58:05.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.991+0000 7fdf10f9a700 1 -- 172.21.15.133:0/3318753506 >> 172.21.15.133:0/3318753506 conn(0x7fdf0c05bdf0 msgr2=0x7fdf0c098e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:05.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.991+0000 7fdf10f9a700 1 -- 172.21.15.133:0/3318753506 shutdown_connections 2021-01-03T12:58:05.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:05.991+0000 7fdf10f9a700 1 -- 172.21.15.133:0/3318753506 wait complete. 2021-01-03T12:58:06.009 INFO:teuthology.orchestra.run.smithi133.stdout:60129542149 2021-01-03T12:58:06.010 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2021-01-03T12:58:06.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.123+0000 7fbbbb3bb700 1 Processor -- start 2021-01-03T12:58:06.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.123+0000 7fbbbb3bb700 1 -- start start 2021-01-03T12:58:06.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.123+0000 7fbbbb3bb700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbbb40b5ae0 0x7fbbb40abd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:06.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.123+0000 7fbbbb3bb700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb40b5710 con 0x7fbbb4099ff0 2021-01-03T12:58:06.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.123+0000 7fbbbb3bb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb40ac270 con 0x7fbbb40b5330 2021-01-03T12:58:06.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.123+0000 7fbbbb3bb700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb40b10f0 con 0x7fbbb40b5ae0 2021-01-03T12:58:06.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.123+0000 7fbbba3b9700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbbb40b5330 0x7fbbb4142c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52890/0 (socket says 172.21.15.133:52890) 2021-01-03T12:58:06.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.123+0000 7fbbba3b9700 1 -- 172.21.15.133:0/3750597182 learned_addr learned my addr 172.21.15.133:0/3750597182 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:06.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.123+0000 7fbbb9bb8700 1 --2- 172.21.15.133:0/3750597182 >> v2:172.21.15.16:3300/0 conn(0x7fbbb40b5ae0 0x7fbbb40abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:06.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.123+0000 7fbbb93b7700 1 -- 172.21.15.133:0/3750597182 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039852697 0 0) 0x7fbbb40ac270 con 0x7fbbb40b5330 2021-01-03T12:58:06.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.123+0000 7fbbb93b7700 1 -- 172.21.15.133:0/3750597182 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb9c003230 con 0x7fbbb40b5330 2021-01-03T12:58:06.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbb9bb8700 1 -- 172.21.15.133:0/3750597182 >> v1:172.21.15.133:6789/0 conn(0x7fbbb40b5330 legacy=0x7fbbb4142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbb9bb8700 1 -- 172.21.15.133:0/3750597182 >> v1:172.21.15.16:6789/0 conn(0x7fbbb4099ff0 legacy=0x7fbbb413fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbb9bb8700 1 -- 172.21.15.133:0/3750597182 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb40ab280 con 0x7fbbb40b5ae0 2021-01-03T12:58:06.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbb9bb8700 1 --2- 172.21.15.133:0/3750597182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb40b5ae0 0x7fbbb40abd80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fbba8002f30 tx=0x7fbba8006dc0).ready entity=mon.0 client_cookie=189e37781422a46 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:06.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbb93b7700 1 -- 172.21.15.133:0/3750597182 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbba8009800 con 0x7fbbb40b5ae0 2021-01-03T12:58:06.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbb93b7700 1 -- 172.21.15.133:0/3750597182 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba8009960 con 0x7fbbb40b5ae0 2021-01-03T12:58:06.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbb93b7700 1 -- 172.21.15.133:0/3750597182 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbba8009cc0 con 0x7fbbb40b5ae0 2021-01-03T12:58:06.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbbb3bb700 1 -- 172.21.15.133:0/3750597182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb40b5ae0 msgr2=0x7fbbb40abd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbbb3bb700 1 --2- 172.21.15.133:0/3750597182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb40b5ae0 0x7fbbb40abd80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fbba8002f30 tx=0x7fbba8006dc0).stop 2021-01-03T12:58:06.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbbb3bb700 1 -- 172.21.15.133:0/3750597182 shutdown_connections 2021-01-03T12:58:06.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbbb3bb700 1 --2- 172.21.15.133:0/3750597182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb40b5ae0 0x7fbbb40abd80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbbb3bb700 1 -- 172.21.15.133:0/3750597182 >> 172.21.15.133:0/3750597182 conn(0x7fbbb405bdf0 msgr2=0x7fbbb405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:06.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbbb3bb700 1 -- 172.21.15.133:0/3750597182 shutdown_connections 2021-01-03T12:58:06.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbbb3bb700 1 -- 172.21.15.133:0/3750597182 wait complete. 2021-01-03T12:58:06.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbbb3bb700 1 Processor -- start 2021-01-03T12:58:06.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbbb3bb700 1 -- start start 2021-01-03T12:58:06.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbbb3bb700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb4099ff0 0x7fbbb40aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:06.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbbb3bb700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbbb40b5330 0x7fbbb4143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:06.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbbb3bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb40b5ae0 0x7fbbb4141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:06.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbbb3bb700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb4140b80 con 0x7fbbb4099ff0 2021-01-03T12:58:06.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbbb3bb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb40ae040 con 0x7fbbb40b5ae0 2021-01-03T12:58:06.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.127+0000 7fbbbb3bb700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb40ae2e0 con 0x7fbbb40b5330 2021-01-03T12:58:06.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbbba3b9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb4099ff0 0x7fbbb40aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:06.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbbbabba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb40b5ae0 0x7fbbb4141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:06.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbbba3b9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb4099ff0 0x7fbbb40aea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:58634/0 (socket says 172.21.15.133:58634) 2021-01-03T12:58:06.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbbba3b9700 1 -- 172.21.15.133:0/2327982022 learned_addr learned my addr 172.21.15.133:0/2327982022 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:06.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbbb9bb8700 1 --2- 172.21.15.133:0/2327982022 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbbb40b5330 0x7fbbb4143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:06.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbbbabba700 1 -- 172.21.15.133:0/2327982022 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbbb40b5330 msgr2=0x7fbbb4143500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbbbabba700 1 --2- 172.21.15.133:0/2327982022 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbbb40b5330 0x7fbbb4143500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbbbabba700 1 -- 172.21.15.133:0/2327982022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb4099ff0 msgr2=0x7fbbb40aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbbbabba700 1 --2- 172.21.15.133:0/2327982022 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb4099ff0 0x7fbbb40aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbbbabba700 1 -- 172.21.15.133:0/2327982022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb40af420 con 0x7fbbb40b5ae0 2021-01-03T12:58:06.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbbbabba700 1 --2- 172.21.15.133:0/2327982022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb40b5ae0 0x7fbbb4141090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fbbb4061d80 tx=0x7fbbac007e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:06.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbba77fe700 1 -- 172.21.15.133:0/2327982022 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbac010510 con 0x7fbbb40b5ae0 2021-01-03T12:58:06.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbba77fe700 1 -- 172.21.15.133:0/2327982022 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac010670 con 0x7fbbb40b5ae0 2021-01-03T12:58:06.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbbbb3bb700 1 -- 172.21.15.133:0/2327982022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb4143e60 con 0x7fbbb40b5ae0 2021-01-03T12:58:06.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbba77fe700 1 -- 172.21.15.133:0/2327982022 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbac0107e0 con 0x7fbbb40b5ae0 2021-01-03T12:58:06.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbbbb3bb700 1 -- 172.21.15.133:0/2327982022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb4141720 con 0x7fbbb40b5ae0 2021-01-03T12:58:06.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbbbb3bb700 1 -- 172.21.15.133:0/2327982022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbbb41440a0 con 0x7fbbb40b5ae0 2021-01-03T12:58:06.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbba77fe700 1 -- 172.21.15.133:0/2327982022 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fbbac010070 con 0x7fbbb40b5ae0 2021-01-03T12:58:06.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbba77fe700 1 --2- 172.21.15.133:0/2327982022 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbb940553b0 0x7fbb94057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:06.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbba77fe700 1 -- 172.21.15.133:0/2327982022 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbbac06d9d0 con 0x7fbbb40b5ae0 2021-01-03T12:58:06.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbbba3b9700 1 --2- 172.21.15.133:0/2327982022 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbb940553b0 0x7fbb94057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:06.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbba77fe700 1 --2- 172.21.15.133:0/2327982022 >> [v2:172.21.15.16:6816/12674,v1:172.21.15.16:6818/12674] conn(0x7fbb9405c7a0 0x7fbb9405ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:06.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbba77fe700 1 -- 172.21.15.133:0/2327982022 --> [v2:172.21.15.16:6816/12674,v1:172.21.15.16:6818/12674] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbb9405f220 con 0x7fbb9405c7a0 2021-01-03T12:58:06.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.131+0000 7fbba77fe700 1 -- 172.21.15.133:0/2327982022 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbac072220 con 0x7fbbb40b5ae0 2021-01-03T12:58:06.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.135+0000 7fbbb9bb8700 1 --2- 172.21.15.133:0/2327982022 >> [v2:172.21.15.16:6816/12674,v1:172.21.15.16:6818/12674] conn(0x7fbb9405c7a0 0x7fbb9405ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:06.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.135+0000 7fbbba3b9700 1 --2- 172.21.15.133:0/2327982022 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbb940553b0 0x7fbb94057870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fbbb000d000 tx=0x7fbbb0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:06.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.135+0000 7fbbb9bb8700 1 --2- 172.21.15.133:0/2327982022 >> [v2:172.21.15.16:6816/12674,v1:172.21.15.16:6818/12674] conn(0x7fbb9405c7a0 0x7fbb9405ebc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:06.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.135+0000 7fbba77fe700 1 -- 172.21.15.133:0/2327982022 <== osd.7 v2:172.21.15.16:6816/12674 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7fbb9405f220 con 0x7fbb9405c7a0 2021-01-03T12:58:06.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.155+0000 7fbbbb3bb700 1 -- 172.21.15.133:0/2327982022 --> [v2:172.21.15.16:6816/12674,v1:172.21.15.16:6818/12674] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbbb413f530 con 0x7fbb9405c7a0 2021-01-03T12:58:06.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.155+0000 7fbba77fe700 1 -- 172.21.15.133:0/2327982022 <== osd.7 v2:172.21.15.16:6816/12674 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbbb413f530 con 0x7fbb9405c7a0 2021-01-03T12:58:06.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.155+0000 7fbbbb3bb700 1 -- 172.21.15.133:0/2327982022 >> [v2:172.21.15.16:6816/12674,v1:172.21.15.16:6818/12674] conn(0x7fbb9405c7a0 msgr2=0x7fbb9405ebc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.155+0000 7fbbbb3bb700 1 --2- 172.21.15.133:0/2327982022 >> [v2:172.21.15.16:6816/12674,v1:172.21.15.16:6818/12674] conn(0x7fbb9405c7a0 0x7fbb9405ebc0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.155+0000 7fbbbb3bb700 1 -- 172.21.15.133:0/2327982022 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbb940553b0 msgr2=0x7fbb94057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.155+0000 7fbbbb3bb700 1 --2- 172.21.15.133:0/2327982022 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbb940553b0 0x7fbb94057870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fbbb000d000 tx=0x7fbbb0009040).stop 2021-01-03T12:58:06.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.155+0000 7fbbbb3bb700 1 -- 172.21.15.133:0/2327982022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb40b5ae0 msgr2=0x7fbbb4141090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.155+0000 7fbbbb3bb700 1 --2- 172.21.15.133:0/2327982022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb40b5ae0 0x7fbbb4141090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fbbb4061d80 tx=0x7fbbac007e40).stop 2021-01-03T12:58:06.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.155+0000 7fbbbabba700 1 -- 172.21.15.133:0/2327982022 reap_dead start 2021-01-03T12:58:06.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.155+0000 7fbbbb3bb700 1 -- 172.21.15.133:0/2327982022 shutdown_connections 2021-01-03T12:58:06.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.155+0000 7fbbbb3bb700 1 -- 172.21.15.133:0/2327982022 >> 172.21.15.133:0/2327982022 conn(0x7fbbb405bdf0 msgr2=0x7fbbb413e510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:06.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.155+0000 7fbbbb3bb700 1 -- 172.21.15.133:0/2327982022 shutdown_connections 2021-01-03T12:58:06.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.155+0000 7fbbbb3bb700 1 -- 172.21.15.133:0/2327982022 wait complete. 2021-01-03T12:58:06.170 INFO:teuthology.orchestra.run.smithi133.stdout:60129542149 2021-01-03T12:58:06.170 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2021-01-03T12:58:06.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.283+0000 7f829759e700 1 Processor -- start 2021-01-03T12:58:06.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.283+0000 7f829759e700 1 -- start start 2021-01-03T12:58:06.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.283+0000 7f829759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82980b0c90 0x7f82980b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:06.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.283+0000 7f829759e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8298060da0 con 0x7f82980b5c00 2021-01-03T12:58:06.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.283+0000 7f829759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82980b0ad0 con 0x7f82980b52c0 2021-01-03T12:58:06.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.283+0000 7f829759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8298067a90 con 0x7f82980b0c90 2021-01-03T12:58:06.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.283+0000 7f8295d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82980b0c90 0x7f82980b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:06.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.283+0000 7f8295d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82980b0c90 0x7f82980b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60104/0 (socket says 172.21.15.133:60104) 2021-01-03T12:58:06.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.283+0000 7f829659c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f82980b52c0 0x7f8298098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52902/0 (socket says 172.21.15.133:52902) 2021-01-03T12:58:06.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.283+0000 7f8295d9b700 1 -- 172.21.15.133:0/1503314733 learned_addr learned my addr 172.21.15.133:0/1503314733 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:06.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.287+0000 7f8295d9b700 1 -- 172.21.15.133:0/1503314733 >> v1:172.21.15.133:6789/0 conn(0x7f82980b52c0 legacy=0x7f8298098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.287+0000 7f8295d9b700 1 -- 172.21.15.133:0/1503314733 >> v1:172.21.15.16:6789/0 conn(0x7f82980b5c00 legacy=0x7f8298143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.287+0000 7f8295d9b700 1 -- 172.21.15.133:0/1503314733 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82980b56a0 con 0x7f82980b0c90 2021-01-03T12:58:06.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.287+0000 7f8295d9b700 1 --2- 172.21.15.133:0/1503314733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82980b0c90 0x7f82980b05e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f82900032b0 tx=0x7f8290009270).ready entity=mon.1 client_cookie=632f6526ec779e9c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:06.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.287+0000 7f829559a700 1 -- 172.21.15.133:0/1503314733 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f829000bc00 con 0x7f82980b0c90 2021-01-03T12:58:06.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.287+0000 7f829559a700 1 -- 172.21.15.133:0/1503314733 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829000bd60 con 0x7f82980b0c90 2021-01-03T12:58:06.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.287+0000 7f829559a700 1 -- 172.21.15.133:0/1503314733 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8290011400 con 0x7f82980b0c90 2021-01-03T12:58:06.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.287+0000 7f829759e700 1 -- 172.21.15.133:0/1503314733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82980b0c90 msgr2=0x7f82980b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.287+0000 7f829759e700 1 --2- 172.21.15.133:0/1503314733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82980b0c90 0x7f82980b05e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f82900032b0 tx=0x7f8290009270).stop 2021-01-03T12:58:06.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.287+0000 7f829759e700 1 -- 172.21.15.133:0/1503314733 shutdown_connections 2021-01-03T12:58:06.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.287+0000 7f829759e700 1 --2- 172.21.15.133:0/1503314733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82980b0c90 0x7f82980b05e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.287+0000 7f829759e700 1 -- 172.21.15.133:0/1503314733 >> 172.21.15.133:0/1503314733 conn(0x7f829805bdf0 msgr2=0x7f829805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:06.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.287+0000 7f829759e700 1 -- 172.21.15.133:0/1503314733 shutdown_connections 2021-01-03T12:58:06.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.287+0000 7f829759e700 1 -- 172.21.15.133:0/1503314733 wait complete. 2021-01-03T12:58:06.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829759e700 1 Processor -- start 2021-01-03T12:58:06.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829759e700 1 -- start start 2021-01-03T12:58:06.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82980b0c90 0x7f82980aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:06.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829759e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82980b52c0 0x7f82981565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:06.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829759e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82980b5c00 0x7f8298156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:06.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829759e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8298156f80 con 0x7f82980b5c00 2021-01-03T12:58:06.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8298149bf0 con 0x7f82980b0c90 2021-01-03T12:58:06.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829759e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8298149e90 con 0x7f82980b52c0 2021-01-03T12:58:06.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82980b0c90 0x7f82980aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:06.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82980b0c90 0x7f82980aa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60108/0 (socket says 172.21.15.133:60108) 2021-01-03T12:58:06.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829659c700 1 -- 172.21.15.133:0/2005213735 learned_addr learned my addr 172.21.15.133:0/2005213735 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:06.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f8295d9b700 1 --2- 172.21.15.133:0/2005213735 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82980b52c0 0x7f82981565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:06.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f8296d9d700 1 --2- 172.21.15.133:0/2005213735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82980b5c00 0x7f8298156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:06.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829659c700 1 -- 172.21.15.133:0/2005213735 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82980b52c0 msgr2=0x7f82981565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829659c700 1 --2- 172.21.15.133:0/2005213735 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82980b52c0 0x7f82981565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829659c700 1 -- 172.21.15.133:0/2005213735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82980b5c00 msgr2=0x7f8298156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829659c700 1 --2- 172.21.15.133:0/2005213735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82980b5c00 0x7f8298156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829659c700 1 -- 172.21.15.133:0/2005213735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829814a130 con 0x7f82980b0c90 2021-01-03T12:58:06.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829659c700 1 --2- 172.21.15.133:0/2005213735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82980b0c90 0x7f82980aa430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8298061fd0 tx=0x7f8280007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:06.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f828f7fe700 1 -- 172.21.15.133:0/2005213735 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82800072e0 con 0x7f82980b0c90 2021-01-03T12:58:06.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f828f7fe700 1 -- 172.21.15.133:0/2005213735 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8280005520 con 0x7f82980b0c90 2021-01-03T12:58:06.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f828f7fe700 1 -- 172.21.15.133:0/2005213735 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8280005880 con 0x7f82980b0c90 2021-01-03T12:58:06.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829759e700 1 -- 172.21.15.133:0/2005213735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829814d4a0 con 0x7f82980b0c90 2021-01-03T12:58:06.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.291+0000 7f829759e700 1 -- 172.21.15.133:0/2005213735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8298159640 con 0x7f82980b0c90 2021-01-03T12:58:06.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.295+0000 7f829759e700 1 -- 172.21.15.133:0/2005213735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82981562b0 con 0x7f82980b0c90 2021-01-03T12:58:06.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.295+0000 7f828f7fe700 1 -- 172.21.15.133:0/2005213735 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8280010070 con 0x7f82980b0c90 2021-01-03T12:58:06.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.295+0000 7f828f7fe700 1 --2- 172.21.15.133:0/2005213735 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8270055440 0x7f8270057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:06.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.295+0000 7f828f7fe700 1 -- 172.21.15.133:0/2005213735 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f828006d3d0 con 0x7f82980b0c90 2021-01-03T12:58:06.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.295+0000 7f8295d9b700 1 --2- 172.21.15.133:0/2005213735 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8270055440 0x7f8270057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:06.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.295+0000 7f8295d9b700 1 --2- 172.21.15.133:0/2005213735 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8270055440 0x7f8270057900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f829001a000 tx=0x7f8290016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:06.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.299+0000 7f828f7fe700 1 -- 172.21.15.133:0/2005213735 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f82800435c0 con 0x7f82980b0c90 2021-01-03T12:58:06.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.439+0000 7f829759e700 1 -- 172.21.15.133:0/2005213735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f82980b0ad0 con 0x7f82980b0c90 2021-01-03T12:58:06.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.439+0000 7f828f7fe700 1 -- 172.21.15.133:0/2005213735 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f82980b0ad0 con 0x7f82980b0c90 2021-01-03T12:58:06.443 INFO:teuthology.orchestra.run.smithi133.stdout:60129542149 2021-01-03T12:58:06.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.443+0000 7f829759e700 1 -- 172.21.15.133:0/2005213735 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8270055440 msgr2=0x7f8270057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.443+0000 7f829759e700 1 --2- 172.21.15.133:0/2005213735 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8270055440 0x7f8270057900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f829001a000 tx=0x7f8290016000).stop 2021-01-03T12:58:06.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.443+0000 7f829759e700 1 -- 172.21.15.133:0/2005213735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82980b0c90 msgr2=0x7f82980aa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.443+0000 7f829759e700 1 --2- 172.21.15.133:0/2005213735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82980b0c90 0x7f82980aa430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8298061fd0 tx=0x7f8280007c10).stop 2021-01-03T12:58:06.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.443+0000 7f829759e700 1 -- 172.21.15.133:0/2005213735 shutdown_connections 2021-01-03T12:58:06.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.443+0000 7f829759e700 1 --2- 172.21.15.133:0/2005213735 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8270055440 0x7f8270057900 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.443+0000 7f829759e700 1 --2- 172.21.15.133:0/2005213735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82980b5c00 0x7f8298156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.443+0000 7f829759e700 1 --2- 172.21.15.133:0/2005213735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82980b0c90 0x7f82980aa430 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.443+0000 7f829759e700 1 --2- 172.21.15.133:0/2005213735 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82980b52c0 0x7f82981565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.443+0000 7f829759e700 1 -- 172.21.15.133:0/2005213735 >> 172.21.15.133:0/2005213735 conn(0x7f829805bdf0 msgr2=0x7f8298098e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:06.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.443+0000 7f829759e700 1 -- 172.21.15.133:0/2005213735 shutdown_connections 2021-01-03T12:58:06.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.443+0000 7f829759e700 1 -- 172.21.15.133:0/2005213735 wait complete. 2021-01-03T12:58:06.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2021-01-03T12:58:06.456 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2021-01-03T12:58:06.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.563+0000 7f2f3949f700 1 Processor -- start 2021-01-03T12:58:06.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f3949f700 1 -- start start 2021-01-03T12:58:06.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f3949f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2f3405c840 0x7f2f34143940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:06.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f3949f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2f34146dc0 0x7f2f340b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:06.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f3949f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3405cc20 con 0x7f2f34067710 2021-01-03T12:58:06.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f3949f700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f340ad5a0 con 0x7f2f34146dc0 2021-01-03T12:58:06.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f3949f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f34142f60 con 0x7f2f3405c840 2021-01-03T12:58:06.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f32ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2f3405c840 0x7f2f34143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:06.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f337fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2f34067710 0x7f2f340b2480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52920/0 (socket says 172.21.15.133:52920) 2021-01-03T12:58:06.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f337fe700 1 -- 172.21.15.133:0/2438366218 learned_addr learned my addr 172.21.15.133:0/2438366218 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:06.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f327fc700 1 --2- 172.21.15.133:0/2438366218 >> v2:172.21.15.16:3300/0 conn(0x7f2f34146dc0 0x7f2f340b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:06.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f32ffd700 1 -- 172.21.15.133:0/2438366218 >> v2:172.21.15.16:3300/0 conn(0x7f2f34146dc0 msgr2=0x7f2f340b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:06.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f32ffd700 1 --2- 172.21.15.133:0/2438366218 >> v2:172.21.15.16:3300/0 conn(0x7f2f34146dc0 0x7f2f340b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f32ffd700 1 -- 172.21.15.133:0/2438366218 >> v1:172.21.15.133:6789/0 conn(0x7f2f34067710 legacy=0x7f2f340b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f32ffd700 1 -- 172.21.15.133:0/2438366218 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f34143200 con 0x7f2f3405c840 2021-01-03T12:58:06.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f31ffb700 1 -- 172.21.15.133:0/2438366218 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742101353 0 0) 0x7f2f3405cc20 con 0x7f2f34067710 2021-01-03T12:58:06.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f327fc700 1 --2- 172.21.15.133:0/2438366218 >> v2:172.21.15.16:3300/0 conn(0x7f2f34146dc0 0x7f2f340b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:06.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f32ffd700 1 --2- 172.21.15.133:0/2438366218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f3405c840 0x7f2f34143940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f2f3406ad30 tx=0x7f2f24006dc0).ready entity=mon.1 client_cookie=a9710c8dd42019e server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:06.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f31ffb700 1 -- 172.21.15.133:0/2438366218 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f240097b0 con 0x7f2f3405c840 2021-01-03T12:58:06.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f31ffb700 1 -- 172.21.15.133:0/2438366218 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f24009910 con 0x7f2f3405c840 2021-01-03T12:58:06.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f31ffb700 1 -- 172.21.15.133:0/2438366218 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f24009c70 con 0x7f2f3405c840 2021-01-03T12:58:06.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f3949f700 1 -- 172.21.15.133:0/2438366218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f3405c840 msgr2=0x7f2f34143940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f3949f700 1 --2- 172.21.15.133:0/2438366218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f3405c840 0x7f2f34143940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f2f3406ad30 tx=0x7f2f24006dc0).stop 2021-01-03T12:58:06.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f3949f700 1 -- 172.21.15.133:0/2438366218 shutdown_connections 2021-01-03T12:58:06.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f3949f700 1 --2- 172.21.15.133:0/2438366218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f3405c840 0x7f2f34143940 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f3949f700 1 --2- 172.21.15.133:0/2438366218 >> v2:172.21.15.16:3300/0 conn(0x7f2f34146dc0 0x7f2f340b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f3949f700 1 -- 172.21.15.133:0/2438366218 >> 172.21.15.133:0/2438366218 conn(0x7f2f3406aeb0 msgr2=0x7f2f3405bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:06.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f3949f700 1 -- 172.21.15.133:0/2438366218 shutdown_connections 2021-01-03T12:58:06.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.567+0000 7f2f3949f700 1 -- 172.21.15.133:0/2438366218 wait complete. 2021-01-03T12:58:06.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.571+0000 7f2f3949f700 1 Processor -- start 2021-01-03T12:58:06.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.571+0000 7f2f3949f700 1 -- start start 2021-01-03T12:58:06.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f3949f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f3405c840 0x7f2f34155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:06.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f3949f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f34067710 0x7f2f3413e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:06.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f3949f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f34146dc0 0x7f2f34139170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:06.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f3949f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3413fbf0 con 0x7f2f3405c840 2021-01-03T12:58:06.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f3949f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f341407b0 con 0x7f2f34067710 2021-01-03T12:58:06.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f3949f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3413dd20 con 0x7f2f34146dc0 2021-01-03T12:58:06.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f327fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f34067710 0x7f2f3413e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:06.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f327fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f34067710 0x7f2f3413e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60124/0 (socket says 172.21.15.133:60124) 2021-01-03T12:58:06.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f327fc700 1 -- 172.21.15.133:0/3108041908 learned_addr learned my addr 172.21.15.133:0/3108041908 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:06.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f32ffd700 1 --2- 172.21.15.133:0/3108041908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f3405c840 0x7f2f34155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:06.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f337fe700 1 --2- 172.21.15.133:0/3108041908 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f34146dc0 0x7f2f34139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:06.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f327fc700 1 -- 172.21.15.133:0/3108041908 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f34146dc0 msgr2=0x7f2f34139170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f327fc700 1 --2- 172.21.15.133:0/3108041908 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f34146dc0 0x7f2f34139170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f327fc700 1 -- 172.21.15.133:0/3108041908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f3405c840 msgr2=0x7f2f34155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f327fc700 1 --2- 172.21.15.133:0/3108041908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f3405c840 0x7f2f34155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f327fc700 1 -- 172.21.15.133:0/3108041908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3413dac0 con 0x7f2f34067710 2021-01-03T12:58:06.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f327fc700 1 --2- 172.21.15.133:0/3108041908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f34067710 0x7f2f3413e880 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f2f1c006910 tx=0x7f2f1c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:06.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f2bfff700 1 -- 172.21.15.133:0/3108041908 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f1c011780 con 0x7f2f34067710 2021-01-03T12:58:06.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f2bfff700 1 -- 172.21.15.133:0/3108041908 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c0118e0 con 0x7f2f34067710 2021-01-03T12:58:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f3949f700 1 -- 172.21.15.133:0/3108041908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f34140510 con 0x7f2f34067710 2021-01-03T12:58:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f2bfff700 1 -- 172.21.15.133:0/3108041908 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f1c011c40 con 0x7f2f34067710 2021-01-03T12:58:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f3949f700 1 -- 172.21.15.133:0/3108041908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f34155900 con 0x7f2f34067710 2021-01-03T12:58:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f3949f700 1 -- 172.21.15.133:0/3108041908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f34057300 con 0x7f2f34067710 2021-01-03T12:58:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.575+0000 7f2f2bfff700 1 -- 172.21.15.133:0/3108041908 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2f1c01c460 con 0x7f2f34067710 2021-01-03T12:58:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.579+0000 7f2f2bfff700 1 --2- 172.21.15.133:0/3108041908 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f180554e0 0x7f2f180579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.579+0000 7f2f2bfff700 1 -- 172.21.15.133:0/3108041908 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2f1c06e2e0 con 0x7f2f34067710 2021-01-03T12:58:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.579+0000 7f2f32ffd700 1 --2- 172.21.15.133:0/3108041908 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f180554e0 0x7f2f180579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.579+0000 7f2f32ffd700 1 --2- 172.21.15.133:0/3108041908 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f180554e0 0x7f2f180579a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f2f2401b000 tx=0x7f2f24015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:06.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.583+0000 7f2f2bfff700 1 -- 172.21.15.133:0/3108041908 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2f1c0444e0 con 0x7f2f34067710 2021-01-03T12:58:06.660 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:58:06.663 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:58:06.665 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:58:06.667 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:58:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.727+0000 7f2f3949f700 1 -- 172.21.15.133:0/3108041908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2f3405ce00 con 0x7f2f34067710 2021-01-03T12:58:06.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.727+0000 7f2f2bfff700 1 -- 172.21.15.133:0/3108041908 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2f1c047b00 con 0x7f2f34067710 2021-01-03T12:58:06.728 INFO:teuthology.orchestra.run.smithi133.stdout:60129542148 2021-01-03T12:58:06.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.727+0000 7f2f3949f700 1 -- 172.21.15.133:0/3108041908 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f180554e0 msgr2=0x7f2f180579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.727+0000 7f2f3949f700 1 --2- 172.21.15.133:0/3108041908 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f180554e0 0x7f2f180579a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f2f2401b000 tx=0x7f2f24015000).stop 2021-01-03T12:58:06.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.727+0000 7f2f3949f700 1 -- 172.21.15.133:0/3108041908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f34067710 msgr2=0x7f2f3413e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:06.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.727+0000 7f2f3949f700 1 --2- 172.21.15.133:0/3108041908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f34067710 0x7f2f3413e880 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f2f1c006910 tx=0x7f2f1c008040).stop 2021-01-03T12:58:06.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.727+0000 7f2f3949f700 1 -- 172.21.15.133:0/3108041908 shutdown_connections 2021-01-03T12:58:06.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.727+0000 7f2f3949f700 1 --2- 172.21.15.133:0/3108041908 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f180554e0 0x7f2f180579a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.727+0000 7f2f3949f700 1 --2- 172.21.15.133:0/3108041908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f3405c840 0x7f2f34155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.727+0000 7f2f3949f700 1 --2- 172.21.15.133:0/3108041908 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f34146dc0 0x7f2f34139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.727+0000 7f2f3949f700 1 --2- 172.21.15.133:0/3108041908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f34067710 0x7f2f3413e880 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:06.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.727+0000 7f2f3949f700 1 -- 172.21.15.133:0/3108041908 >> 172.21.15.133:0/3108041908 conn(0x7f2f3406aeb0 msgr2=0x7f2f340af250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:06.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.727+0000 7f2f3949f700 1 -- 172.21.15.133:0/3108041908 shutdown_connections 2021-01-03T12:58:06.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:06.727+0000 7f2f3949f700 1 -- 172.21.15.133:0/3108041908 wait complete. 2021-01-03T12:58:06.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.1 2021-01-03T12:58:07.743 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2021-01-03T12:58:07.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.863+0000 7f0a600ff700 1 Processor -- start 2021-01-03T12:58:07.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.863+0000 7f0a600ff700 1 -- start start 2021-01-03T12:58:07.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.863+0000 7f0a600ff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a5805c130 0x7f0a581437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:07.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.863+0000 7f0a600ff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5805c510 con 0x7f0a580b02d0 2021-01-03T12:58:07.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.863+0000 7f0a600ff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a58147190 con 0x7f0a5805cc10 2021-01-03T12:58:07.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.863+0000 7f0a600ff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a580b0780 con 0x7f0a5805c130 2021-01-03T12:58:07.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.863+0000 7f0a5de9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a5805c130 0x7f0a581437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:07.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.863+0000 7f0a5d69a700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0a5805cc10 0x7f0a58146370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52930/0 (socket says 172.21.15.133:52930) 2021-01-03T12:58:07.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.863+0000 7f0a5d69a700 1 -- 172.21.15.133:0/1416756736 learned_addr learned my addr 172.21.15.133:0/1416756736 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:07.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.867+0000 7f0a5de9b700 1 -- 172.21.15.133:0/1416756736 >> v1:172.21.15.133:6789/0 conn(0x7f0a5805cc10 legacy=0x7f0a58146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:07.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.867+0000 7f0a5de9b700 1 -- 172.21.15.133:0/1416756736 >> v1:172.21.15.16:6789/0 conn(0x7f0a580b02d0 legacy=0x7f0a58146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:07.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.867+0000 7f0a5ce99700 1 -- 172.21.15.133:0/1416756736 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039989435 0 0) 0x7f0a58147190 con 0x7f0a5805cc10 2021-01-03T12:58:07.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.867+0000 7f0a5de9b700 1 -- 172.21.15.133:0/1416756736 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a580b5c10 con 0x7f0a5805c130 2021-01-03T12:58:07.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.867+0000 7f0a5de9b700 1 --2- 172.21.15.133:0/1416756736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a5805c130 0x7f0a581437e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f0a50001450 tx=0x7f0a4c006dc0).ready entity=mon.1 client_cookie=7735a5aae94b6f4 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:07.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.867+0000 7f0a5ce99700 1 -- 172.21.15.133:0/1416756736 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a4c0096b0 con 0x7f0a5805c130 2021-01-03T12:58:07.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.867+0000 7f0a5ce99700 1 -- 172.21.15.133:0/1416756736 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c009810 con 0x7f0a5805c130 2021-01-03T12:58:07.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.867+0000 7f0a5ce99700 1 -- 172.21.15.133:0/1416756736 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a4c009b70 con 0x7f0a5805c130 2021-01-03T12:58:07.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.867+0000 7f0a600ff700 1 -- 172.21.15.133:0/1416756736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a5805c130 msgr2=0x7f0a581437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:07.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.867+0000 7f0a600ff700 1 --2- 172.21.15.133:0/1416756736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a5805c130 0x7f0a581437e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f0a50001450 tx=0x7f0a4c006dc0).stop 2021-01-03T12:58:07.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.867+0000 7f0a600ff700 1 -- 172.21.15.133:0/1416756736 shutdown_connections 2021-01-03T12:58:07.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.867+0000 7f0a600ff700 1 --2- 172.21.15.133:0/1416756736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a5805c130 0x7f0a581437e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:07.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.867+0000 7f0a600ff700 1 -- 172.21.15.133:0/1416756736 >> 172.21.15.133:0/1416756736 conn(0x7f0a580b95d0 msgr2=0x7f0a580b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:07.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.867+0000 7f0a600ff700 1 -- 172.21.15.133:0/1416756736 shutdown_connections 2021-01-03T12:58:07.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.867+0000 7f0a600ff700 1 -- 172.21.15.133:0/1416756736 wait complete. 2021-01-03T12:58:07.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.867+0000 7f0a600ff700 1 Processor -- start 2021-01-03T12:58:07.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.867+0000 7f0a600ff700 1 -- start start 2021-01-03T12:58:07.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a600ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a5805c130 0x7f0a58142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:07.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a600ff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0a5805cc10 0x7f0a58155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:07.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a600ff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a580b02d0 0x7f0a580b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:07.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a600ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a58142d60 con 0x7f0a5805c130 2021-01-03T12:58:07.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a600ff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a581419c0 con 0x7f0a580b02d0 2021-01-03T12:58:07.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a600ff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a58141c60 con 0x7f0a5805cc10 2021-01-03T12:58:07.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a5e69c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a580b02d0 0x7f0a580b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:07.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a5e69c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a580b02d0 0x7f0a580b2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60138/0 (socket says 172.21.15.133:60138) 2021-01-03T12:58:07.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a5de9b700 1 --2- 172.21.15.133:0/2575341891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a5805c130 0x7f0a58142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:07.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a5e69c700 1 -- 172.21.15.133:0/2575341891 learned_addr learned my addr 172.21.15.133:0/2575341891 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:07.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a5d69a700 1 --2- 172.21.15.133:0/2575341891 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0a5805cc10 0x7f0a58155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:07.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a5e69c700 1 -- 172.21.15.133:0/2575341891 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0a5805cc10 msgr2=0x7f0a58155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:07.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a5e69c700 1 --2- 172.21.15.133:0/2575341891 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0a5805cc10 0x7f0a58155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:07.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a5e69c700 1 -- 172.21.15.133:0/2575341891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a5805c130 msgr2=0x7f0a58142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:07.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a5e69c700 1 --2- 172.21.15.133:0/2575341891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a5805c130 0x7f0a58142510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:07.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a5e69c700 1 -- 172.21.15.133:0/2575341891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a58141f00 con 0x7f0a580b02d0 2021-01-03T12:58:07.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a5de9b700 1 --2- 172.21.15.133:0/2575341891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a5805c130 0x7f0a58142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:07.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a5e69c700 1 --2- 172.21.15.133:0/2575341891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a580b02d0 0x7f0a580b2ec0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f0a50001320 tx=0x7f0a50007f10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:07.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a4affd700 1 -- 172.21.15.133:0/2575341891 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a5000a600 con 0x7f0a580b02d0 2021-01-03T12:58:07.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a4affd700 1 -- 172.21.15.133:0/2575341891 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5000a760 con 0x7f0a580b02d0 2021-01-03T12:58:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a4affd700 1 -- 172.21.15.133:0/2575341891 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a5000a8d0 con 0x7f0a580b02d0 2021-01-03T12:58:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a600ff700 1 -- 172.21.15.133:0/2575341891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a58156130 con 0x7f0a580b02d0 2021-01-03T12:58:07.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a600ff700 1 -- 172.21.15.133:0/2575341891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a58141700 con 0x7f0a580b02d0 2021-01-03T12:58:07.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.871+0000 7f0a600ff700 1 -- 172.21.15.133:0/2575341891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a58057300 con 0x7f0a580b02d0 2021-01-03T12:58:07.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.875+0000 7f0a4affd700 1 -- 172.21.15.133:0/2575341891 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0a50010070 con 0x7f0a580b02d0 2021-01-03T12:58:07.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.875+0000 7f0a4affd700 1 --2- 172.21.15.133:0/2575341891 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a380553b0 0x7f0a38057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:07.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.875+0000 7f0a5de9b700 1 --2- 172.21.15.133:0/2575341891 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a380553b0 0x7f0a38057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:07.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.875+0000 7f0a4affd700 1 -- 172.21.15.133:0/2575341891 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0a5006dcf0 con 0x7f0a580b02d0 2021-01-03T12:58:07.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.875+0000 7f0a5de9b700 1 --2- 172.21.15.133:0/2575341891 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a380553b0 0x7f0a38057870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f0a4c01b000 tx=0x7f0a4c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:07.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:07.879+0000 7f0a4affd700 1 -- 172.21.15.133:0/2575341891 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0a50043e00 con 0x7f0a580b02d0 2021-01-03T12:58:08.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.023+0000 7f0a600ff700 1 -- 172.21.15.133:0/2575341891 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0a5805d270 con 0x7f0a580b02d0 2021-01-03T12:58:08.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.023+0000 7f0a4affd700 1 -- 172.21.15.133:0/2575341891 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a500182b0 con 0x7f0a580b02d0 2021-01-03T12:58:08.025 INFO:teuthology.orchestra.run.smithi133.stdout:60129542149 2021-01-03T12:58:08.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.027+0000 7f0a600ff700 1 -- 172.21.15.133:0/2575341891 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a380553b0 msgr2=0x7f0a38057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.027+0000 7f0a600ff700 1 --2- 172.21.15.133:0/2575341891 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a380553b0 0x7f0a38057870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f0a4c01b000 tx=0x7f0a4c015000).stop 2021-01-03T12:58:08.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.027+0000 7f0a600ff700 1 -- 172.21.15.133:0/2575341891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a580b02d0 msgr2=0x7f0a580b2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.027+0000 7f0a600ff700 1 --2- 172.21.15.133:0/2575341891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a580b02d0 0x7f0a580b2ec0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f0a50001320 tx=0x7f0a50007f10).stop 2021-01-03T12:58:08.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.027+0000 7f0a600ff700 1 -- 172.21.15.133:0/2575341891 shutdown_connections 2021-01-03T12:58:08.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.027+0000 7f0a600ff700 1 --2- 172.21.15.133:0/2575341891 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a380553b0 0x7f0a38057870 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.027+0000 7f0a600ff700 1 --2- 172.21.15.133:0/2575341891 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a5805c130 0x7f0a58142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.027+0000 7f0a600ff700 1 --2- 172.21.15.133:0/2575341891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a580b02d0 0x7f0a580b2ec0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.027+0000 7f0a600ff700 1 --2- 172.21.15.133:0/2575341891 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0a5805cc10 0x7f0a58155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.027+0000 7f0a600ff700 1 -- 172.21.15.133:0/2575341891 >> 172.21.15.133:0/2575341891 conn(0x7f0a580b95d0 msgr2=0x7f0a5813bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:08.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.027+0000 7f0a600ff700 1 -- 172.21.15.133:0/2575341891 shutdown_connections 2021-01-03T12:58:08.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.027+0000 7f0a600ff700 1 -- 172.21.15.133:0/2575341891 wait complete. 2021-01-03T12:58:08.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2021-01-03T12:58:08.043 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2021-01-03T12:58:08.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bf59e700 1 Processor -- start 2021-01-03T12:58:08.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bf59e700 1 -- start start 2021-01-03T12:58:08.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bf59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff7c00b72b0 0x7ff7c0144020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bf59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff7c00b7eb0 0x7ff7c013e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bf59e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c009c0b0 con 0x7ff7c00b2e00 2021-01-03T12:58:08.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bf59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c00ae480 con 0x7ff7c00b72b0 2021-01-03T12:58:08.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bf59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c009c2e0 con 0x7ff7c00b7eb0 2021-01-03T12:58:08.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff7c00b7eb0 0x7ff7c013e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff7c00b7eb0 0x7ff7c013e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60148/0 (socket says 172.21.15.133:60148) 2021-01-03T12:58:08.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7be59c700 1 --2- 172.21.15.133:0/3234636846 >> v2:172.21.15.16:3300/0 conn(0x7ff7c00b72b0 0x7ff7c0144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bed9d700 1 -- 172.21.15.133:0/3234636846 learned_addr learned my addr 172.21.15.133:0/3234636846 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bed9d700 1 -- 172.21.15.133:0/3234636846 >> v2:172.21.15.16:3300/0 conn(0x7ff7c00b72b0 msgr2=0x7ff7c0144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bed9d700 1 --2- 172.21.15.133:0/3234636846 >> v2:172.21.15.16:3300/0 conn(0x7ff7c00b72b0 0x7ff7c0144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bed9d700 1 -- 172.21.15.133:0/3234636846 >> v1:172.21.15.16:6789/0 conn(0x7ff7c00b2e00 legacy=0x7ff7c00ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bed9d700 1 -- 172.21.15.133:0/3234636846 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c009c580 con 0x7ff7c00b7eb0 2021-01-03T12:58:08.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bed9d700 1 --2- 172.21.15.133:0/3234636846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7c00b7eb0 0x7ff7c013e040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ff7b80032b0 tx=0x7ff7b8009270).ready entity=mon.1 client_cookie=1813d4a61b8cc455 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:08.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bd59a700 1 -- 172.21.15.133:0/3234636846 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7b8009e60 con 0x7ff7c00b7eb0 2021-01-03T12:58:08.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bd59a700 1 -- 172.21.15.133:0/3234636846 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b800bc00 con 0x7ff7c00b7eb0 2021-01-03T12:58:08.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bd59a700 1 -- 172.21.15.133:0/3234636846 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7b800bd70 con 0x7ff7c00b7eb0 2021-01-03T12:58:08.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bf59e700 1 -- 172.21.15.133:0/3234636846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7c00b7eb0 msgr2=0x7ff7c013e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bf59e700 1 --2- 172.21.15.133:0/3234636846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7c00b7eb0 0x7ff7c013e040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7ff7b80032b0 tx=0x7ff7b8009270).stop 2021-01-03T12:58:08.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bf59e700 1 -- 172.21.15.133:0/3234636846 shutdown_connections 2021-01-03T12:58:08.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bf59e700 1 --2- 172.21.15.133:0/3234636846 >> v2:172.21.15.16:3300/0 conn(0x7ff7c00b72b0 0x7ff7c0144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bf59e700 1 --2- 172.21.15.133:0/3234636846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7c00b7eb0 0x7ff7c013e040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bf59e700 1 -- 172.21.15.133:0/3234636846 >> 172.21.15.133:0/3234636846 conn(0x7ff7c005bdf0 msgr2=0x7ff7c005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:08.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bf59e700 1 -- 172.21.15.133:0/3234636846 shutdown_connections 2021-01-03T12:58:08.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.151+0000 7ff7bf59e700 1 -- 172.21.15.133:0/3234636846 wait complete. 2021-01-03T12:58:08.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bf59e700 1 Processor -- start 2021-01-03T12:58:08.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bf59e700 1 -- start start 2021-01-03T12:58:08.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bf59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7c00b2e00 0x7ff7c013d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bf59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7c00b72b0 0x7ff7c01409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bf59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7c0144b40 0x7ff7c013f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bf59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c008fd40 con 0x7ff7c00b72b0 2021-01-03T12:58:08.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bf59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c008ff70 con 0x7ff7c0144b40 2021-01-03T12:58:08.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bf59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c0155a50 con 0x7ff7c00b2e00 2021-01-03T12:58:08.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7c0144b40 0x7ff7c013f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7c0144b40 0x7ff7c013f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60154/0 (socket says 172.21.15.133:60154) 2021-01-03T12:58:08.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bed9d700 1 -- 172.21.15.133:0/1920059829 learned_addr learned my addr 172.21.15.133:0/1920059829 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:08.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7be59c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7c00b2e00 0x7ff7c013d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bdd9b700 1 --2- 172.21.15.133:0/1920059829 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7c00b72b0 0x7ff7c01409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bed9d700 1 -- 172.21.15.133:0/1920059829 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7c00b2e00 msgr2=0x7ff7c013d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bed9d700 1 --2- 172.21.15.133:0/1920059829 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7c00b2e00 0x7ff7c013d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bed9d700 1 -- 172.21.15.133:0/1920059829 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7c00b72b0 msgr2=0x7ff7c01409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bed9d700 1 --2- 172.21.15.133:0/1920059829 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7c00b72b0 0x7ff7c01409f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bed9d700 1 -- 172.21.15.133:0/1920059829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c0155cf0 con 0x7ff7c0144b40 2021-01-03T12:58:08.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7be59c700 1 --2- 172.21.15.133:0/1920059829 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7c00b2e00 0x7ff7c013d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:08.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bed9d700 1 --2- 172.21.15.133:0/1920059829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7c0144b40 0x7ff7c013f8c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ff7b80032b0 tx=0x7ff7b8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:08.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7af7fe700 1 -- 172.21.15.133:0/1920059829 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7b80105b0 con 0x7ff7c0144b40 2021-01-03T12:58:08.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7af7fe700 1 -- 172.21.15.133:0/1920059829 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b8010710 con 0x7ff7c0144b40 2021-01-03T12:58:08.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bf59e700 1 -- 172.21.15.133:0/1920059829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c009bb20 con 0x7ff7c0144b40 2021-01-03T12:58:08.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7af7fe700 1 -- 172.21.15.133:0/1920059829 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7b8010a70 con 0x7ff7c0144b40 2021-01-03T12:58:08.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.155+0000 7ff7bf59e700 1 -- 172.21.15.133:0/1920059829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c0141080 con 0x7ff7c0144b40 2021-01-03T12:58:08.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.159+0000 7ff7bf59e700 1 -- 172.21.15.133:0/1920059829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c0155e80 con 0x7ff7c0144b40 2021-01-03T12:58:08.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.159+0000 7ff7af7fe700 1 -- 172.21.15.133:0/1920059829 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff7b800f070 con 0x7ff7c0144b40 2021-01-03T12:58:08.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.159+0000 7ff7af7fe700 1 --2- 172.21.15.133:0/1920059829 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff79c0554e0 0x7ff79c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.159+0000 7ff7af7fe700 1 -- 172.21.15.133:0/1920059829 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff7b806f560 con 0x7ff7c0144b40 2021-01-03T12:58:08.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.159+0000 7ff7be59c700 1 --2- 172.21.15.133:0/1920059829 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff79c0554e0 0x7ff79c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.159+0000 7ff7be59c700 1 --2- 172.21.15.133:0/1920059829 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff79c0554e0 0x7ff79c0579a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff7b000b000 tx=0x7ff7b0006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:08.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.163+0000 7ff7af7fe700 1 -- 172.21.15.133:0/1920059829 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff7b8045860 con 0x7ff7c0144b40 2021-01-03T12:58:08.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.307+0000 7ff7bf59e700 1 -- 172.21.15.133:0/1920059829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff7c0057300 con 0x7ff7c0144b40 2021-01-03T12:58:08.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.307+0000 7ff7af7fe700 1 -- 172.21.15.133:0/1920059829 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff7b8015090 con 0x7ff7c0144b40 2021-01-03T12:58:08.308 INFO:teuthology.orchestra.run.smithi133.stdout:60129542149 2021-01-03T12:58:08.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.307+0000 7ff7bf59e700 1 -- 172.21.15.133:0/1920059829 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff79c0554e0 msgr2=0x7ff79c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.307+0000 7ff7bf59e700 1 --2- 172.21.15.133:0/1920059829 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff79c0554e0 0x7ff79c0579a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff7b000b000 tx=0x7ff7b0006dc0).stop 2021-01-03T12:58:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.307+0000 7ff7bf59e700 1 -- 172.21.15.133:0/1920059829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7c0144b40 msgr2=0x7ff7c013f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.307+0000 7ff7bf59e700 1 --2- 172.21.15.133:0/1920059829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7c0144b40 0x7ff7c013f8c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7ff7b80032b0 tx=0x7ff7b8016000).stop 2021-01-03T12:58:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.307+0000 7ff7bf59e700 1 -- 172.21.15.133:0/1920059829 shutdown_connections 2021-01-03T12:58:08.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.307+0000 7ff7bf59e700 1 --2- 172.21.15.133:0/1920059829 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff79c0554e0 0x7ff79c0579a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.307+0000 7ff7bf59e700 1 --2- 172.21.15.133:0/1920059829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7c0144b40 0x7ff7c013f8c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.307+0000 7ff7bf59e700 1 --2- 172.21.15.133:0/1920059829 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7c00b2e00 0x7ff7c013d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.307+0000 7ff7bf59e700 1 --2- 172.21.15.133:0/1920059829 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7c00b72b0 0x7ff7c01409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.307+0000 7ff7bf59e700 1 -- 172.21.15.133:0/1920059829 >> 172.21.15.133:0/1920059829 conn(0x7ff7c005bdf0 msgr2=0x7ff7c00b4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:08.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.307+0000 7ff7bf59e700 1 -- 172.21.15.133:0/1920059829 shutdown_connections 2021-01-03T12:58:08.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.307+0000 7ff7bf59e700 1 -- 172.21.15.133:0/1920059829 wait complete. 2021-01-03T12:58:08.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.2 2021-01-03T12:58:08.321 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2021-01-03T12:58:08.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f570488a700 1 Processor -- start 2021-01-03T12:58:08.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f570488a700 1 -- start start 2021-01-03T12:58:08.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f570488a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57000b9b60 0x7f57000b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f570488a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57000b4980 0x7f57000b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f570488a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57000605f0 con 0x7f5700146430 2021-01-03T12:58:08.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f570488a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57000aed30 con 0x7f57000b4980 2021-01-03T12:58:08.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f570488a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5700146fd0 con 0x7f57000b9b60 2021-01-03T12:58:08.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f56feffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57000b4980 0x7f57000b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f56fffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5700146430 0x7f57001468c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52962/0 (socket says 172.21.15.133:52962) 2021-01-03T12:58:08.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f56fffff700 1 -- 172.21.15.133:0/2386694277 learned_addr learned my addr 172.21.15.133:0/2386694277 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:08.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f56ff7fe700 1 --2- 172.21.15.133:0/2386694277 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57000b9b60 0x7f57000b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f56feffd700 1 -- 172.21.15.133:0/2386694277 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57000b9b60 msgr2=0x7f57000b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:08.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f56feffd700 1 --2- 172.21.15.133:0/2386694277 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57000b9b60 0x7f57000b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f56feffd700 1 -- 172.21.15.133:0/2386694277 >> v1:172.21.15.133:6789/0 conn(0x7f5700146430 legacy=0x7f57001468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f56fe7fc700 1 -- 172.21.15.133:0/2386694277 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285841386 0 0) 0x7f57000605f0 con 0x7f5700146430 2021-01-03T12:58:08.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f56feffd700 1 -- 172.21.15.133:0/2386694277 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57000600b0 con 0x7f57000b4980 2021-01-03T12:58:08.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f56ff7fe700 1 --2- 172.21.15.133:0/2386694277 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57000b9b60 0x7f57000b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:08.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f56feffd700 1 --2- 172.21.15.133:0/2386694277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57000b4980 0x7f57000b4de0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f56e8002f30 tx=0x7f56e8006dc0).ready entity=mon.1 client_cookie=cd4a468259908c4a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:08.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f56fe7fc700 1 -- 172.21.15.133:0/2386694277 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56e80097f0 con 0x7f57000b4980 2021-01-03T12:58:08.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f56fe7fc700 1 -- 172.21.15.133:0/2386694277 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e8009950 con 0x7f57000b4980 2021-01-03T12:58:08.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f570488a700 1 -- 172.21.15.133:0/2386694277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57000b4980 msgr2=0x7f57000b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f56fe7fc700 1 -- 172.21.15.133:0/2386694277 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56e8009cb0 con 0x7f57000b4980 2021-01-03T12:58:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f570488a700 1 --2- 172.21.15.133:0/2386694277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57000b4980 0x7f57000b4de0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f56e8002f30 tx=0x7f56e8006dc0).stop 2021-01-03T12:58:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f570488a700 1 -- 172.21.15.133:0/2386694277 shutdown_connections 2021-01-03T12:58:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f570488a700 1 --2- 172.21.15.133:0/2386694277 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57000b9b60 0x7f57000b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f570488a700 1 --2- 172.21.15.133:0/2386694277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57000b4980 0x7f57000b4de0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f570488a700 1 -- 172.21.15.133:0/2386694277 >> 172.21.15.133:0/2386694277 conn(0x7f57000b69e0 msgr2=0x7f57000b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:08.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f570488a700 1 -- 172.21.15.133:0/2386694277 shutdown_connections 2021-01-03T12:58:08.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.431+0000 7f570488a700 1 -- 172.21.15.133:0/2386694277 wait complete. 2021-01-03T12:58:08.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f570488a700 1 Processor -- start 2021-01-03T12:58:08.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f570488a700 1 -- start start 2021-01-03T12:58:08.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f570488a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57000b4980 0x7f57000b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f570488a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57000b9b60 0x7f5700151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f570488a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5700146430 0x7f5700152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f570488a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57000b0940 con 0x7f57000b4980 2021-01-03T12:58:08.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f570488a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5700152560 con 0x7f57000b9b60 2021-01-03T12:58:08.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f570488a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57000b1c00 con 0x7f5700146430 2021-01-03T12:58:08.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f56feffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57000b9b60 0x7f5700151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f56feffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57000b9b60 0x7f5700151b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60166/0 (socket says 172.21.15.133:60166) 2021-01-03T12:58:08.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f56feffd700 1 -- 172.21.15.133:0/3527062013 learned_addr learned my addr 172.21.15.133:0/3527062013 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:08.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f56ff7fe700 1 --2- 172.21.15.133:0/3527062013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57000b4980 0x7f57000b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f56fffff700 1 --2- 172.21.15.133:0/3527062013 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5700146430 0x7f5700152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f56feffd700 1 -- 172.21.15.133:0/3527062013 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5700146430 msgr2=0x7f5700152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f56feffd700 1 --2- 172.21.15.133:0/3527062013 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5700146430 0x7f5700152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f56feffd700 1 -- 172.21.15.133:0/3527062013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57000b4980 msgr2=0x7f57000b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f56feffd700 1 --2- 172.21.15.133:0/3527062013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57000b4980 0x7f57000b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f56feffd700 1 -- 172.21.15.133:0/3527062013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5700141a20 con 0x7f57000b9b60 2021-01-03T12:58:08.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f56ff7fe700 1 --2- 172.21.15.133:0/3527062013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57000b4980 0x7f57000b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:08.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f56fffff700 1 --2- 172.21.15.133:0/3527062013 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5700146430 0x7f5700152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:08.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f56feffd700 1 --2- 172.21.15.133:0/3527062013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57000b9b60 0x7f5700151b80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f56e8002f30 tx=0x7f56e8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:08.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f56fcff9700 1 -- 172.21.15.133:0/3527062013 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56e8011ce0 con 0x7f57000b9b60 2021-01-03T12:58:08.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f56fcff9700 1 -- 172.21.15.133:0/3527062013 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e8011e40 con 0x7f57000b9b60 2021-01-03T12:58:08.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f570488a700 1 -- 172.21.15.133:0/3527062013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5700141cc0 con 0x7f57000b9b60 2021-01-03T12:58:08.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f56fcff9700 1 -- 172.21.15.133:0/3527062013 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56e801d640 con 0x7f57000b9b60 2021-01-03T12:58:08.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.435+0000 7f570488a700 1 -- 172.21.15.133:0/3527062013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5700141760 con 0x7f57000b9b60 2021-01-03T12:58:08.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.439+0000 7f570488a700 1 -- 172.21.15.133:0/3527062013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5700057300 con 0x7f57000b9b60 2021-01-03T12:58:08.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.439+0000 7f56fcff9700 1 -- 172.21.15.133:0/3527062013 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f56e8024030 con 0x7f57000b9b60 2021-01-03T12:58:08.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.439+0000 7f56fcff9700 1 --2- 172.21.15.133:0/3527062013 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f56e4055330 0x7f56e40577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.439+0000 7f56ff7fe700 1 --2- 172.21.15.133:0/3527062013 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f56e4055330 0x7f56e40577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.439+0000 7f56fcff9700 1 -- 172.21.15.133:0/3527062013 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f56e806f260 con 0x7f57000b9b60 2021-01-03T12:58:08.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.439+0000 7f56ff7fe700 1 --2- 172.21.15.133:0/3527062013 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f56e4055330 0x7f56e40577f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f56f000c000 tx=0x7f56f0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:08.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.443+0000 7f56fcff9700 1 -- 172.21.15.133:0/3527062013 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f56e8045450 con 0x7f57000b9b60 2021-01-03T12:58:08.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.583+0000 7f570488a700 1 -- 172.21.15.133:0/3527062013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f57000ae6c0 con 0x7f57000b9b60 2021-01-03T12:58:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.587+0000 7f56fcff9700 1 -- 172.21.15.133:0/3527062013 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f56e8022020 con 0x7f57000b9b60 2021-01-03T12:58:08.587 INFO:teuthology.orchestra.run.smithi133.stdout:60129542149 2021-01-03T12:58:08.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.587+0000 7f570488a700 1 -- 172.21.15.133:0/3527062013 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f56e4055330 msgr2=0x7f56e40577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.587+0000 7f570488a700 1 --2- 172.21.15.133:0/3527062013 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f56e4055330 0x7f56e40577f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f56f000c000 tx=0x7f56f0008040).stop 2021-01-03T12:58:08.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.587+0000 7f570488a700 1 -- 172.21.15.133:0/3527062013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57000b9b60 msgr2=0x7f5700151b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.587+0000 7f570488a700 1 --2- 172.21.15.133:0/3527062013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57000b9b60 0x7f5700151b80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f56e8002f30 tx=0x7f56e8015000).stop 2021-01-03T12:58:08.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.587+0000 7f570488a700 1 -- 172.21.15.133:0/3527062013 shutdown_connections 2021-01-03T12:58:08.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.587+0000 7f570488a700 1 --2- 172.21.15.133:0/3527062013 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f56e4055330 0x7f56e40577f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.587+0000 7f570488a700 1 --2- 172.21.15.133:0/3527062013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57000b4980 0x7f57000b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.587+0000 7f570488a700 1 --2- 172.21.15.133:0/3527062013 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5700146430 0x7f5700152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.587+0000 7f570488a700 1 --2- 172.21.15.133:0/3527062013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57000b9b60 0x7f5700151b80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.587+0000 7f570488a700 1 -- 172.21.15.133:0/3527062013 >> 172.21.15.133:0/3527062013 conn(0x7f57000b69e0 msgr2=0x7f57001468c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:08.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.587+0000 7f570488a700 1 -- 172.21.15.133:0/3527062013 shutdown_connections 2021-01-03T12:58:08.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.587+0000 7f570488a700 1 -- 172.21.15.133:0/3527062013 wait complete. 2021-01-03T12:58:08.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2021-01-03T12:58:08.600 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2021-01-03T12:58:08.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.707+0000 7fc0bf59e700 1 Processor -- start 2021-01-03T12:58:08.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.707+0000 7fc0bf59e700 1 -- start start 2021-01-03T12:58:08.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bf59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc0c0146b40 0x7fc0c014e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bf59e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c00605f0 con 0x7fc0c00b9f40 2021-01-03T12:58:08.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bf59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c00600b0 con 0x7fc0c00b9b60 2021-01-03T12:58:08.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bf59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c00aed30 con 0x7fc0c0146b40 2021-01-03T12:58:08.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0be59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc0c00b9b60 0x7fc0c00b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52972/0 (socket says 172.21.15.133:52972) 2021-01-03T12:58:08.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0be59c700 1 -- 172.21.15.133:0/3948502111 learned_addr learned my addr 172.21.15.133:0/3948502111 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:08.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bed9d700 1 --2- 172.21.15.133:0/3948502111 >> v2:172.21.15.16:3300/0 conn(0x7fc0c0146b40 0x7fc0c014e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bd59a700 1 -- 172.21.15.133:0/3948502111 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741442527 0 0) 0x7fc0c00600b0 con 0x7fc0c00b9b60 2021-01-03T12:58:08.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bd59a700 1 -- 172.21.15.133:0/3948502111 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a4003230 con 0x7fc0c00b9b60 2021-01-03T12:58:08.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bd59a700 1 -- 172.21.15.133:0/3948502111 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650752302 0 0) 0x7fc0c00605f0 con 0x7fc0c00b9f40 2021-01-03T12:58:08.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bd59a700 1 -- 172.21.15.133:0/3948502111 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0c00600b0 con 0x7fc0c00b9f40 2021-01-03T12:58:08.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bd59a700 1 -- 172.21.15.133:0/3948502111 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2918456126 0 0) 0x7fc0a4003230 con 0x7fc0c00b9b60 2021-01-03T12:58:08.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bed9d700 1 -- 172.21.15.133:0/3948502111 >> v1:172.21.15.133:6789/0 conn(0x7fc0c00b9b60 legacy=0x7fc0c00b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bed9d700 1 -- 172.21.15.133:0/3948502111 >> v1:172.21.15.16:6789/0 conn(0x7fc0c00b9f40 legacy=0x7fc0c0146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bed9d700 1 -- 172.21.15.133:0/3948502111 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c0060350 con 0x7fc0c0146b40 2021-01-03T12:58:08.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bed9d700 1 --2- 172.21.15.133:0/3948502111 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c0146b40 0x7fc0c014e510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc0b40010d0 tx=0x7fc0b80091a0).ready entity=mon.0 client_cookie=2e4a43a262146741 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:08.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bd59a700 1 -- 172.21.15.133:0/3948502111 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0b40016d0 con 0x7fc0c0146b40 2021-01-03T12:58:08.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bd59a700 1 -- 172.21.15.133:0/3948502111 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b800b920 con 0x7fc0c0146b40 2021-01-03T12:58:08.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bd59a700 1 -- 172.21.15.133:0/3948502111 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0b800ba90 con 0x7fc0c0146b40 2021-01-03T12:58:08.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bf59e700 1 -- 172.21.15.133:0/3948502111 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c0146b40 msgr2=0x7fc0c014e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bf59e700 1 --2- 172.21.15.133:0/3948502111 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c0146b40 0x7fc0c014e510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc0b40010d0 tx=0x7fc0b80091a0).stop 2021-01-03T12:58:08.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bf59e700 1 -- 172.21.15.133:0/3948502111 shutdown_connections 2021-01-03T12:58:08.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bf59e700 1 --2- 172.21.15.133:0/3948502111 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c0146b40 0x7fc0c014e510 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bf59e700 1 -- 172.21.15.133:0/3948502111 >> 172.21.15.133:0/3948502111 conn(0x7fc0c00b69e0 msgr2=0x7fc0c00b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:08.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bf59e700 1 -- 172.21.15.133:0/3948502111 shutdown_connections 2021-01-03T12:58:08.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.711+0000 7fc0bf59e700 1 -- 172.21.15.133:0/3948502111 wait complete. 2021-01-03T12:58:08.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0bf59e700 1 Processor -- start 2021-01-03T12:58:08.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0bf59e700 1 -- start start 2021-01-03T12:58:08.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0bf59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0c00b9b60 0x7fc0c00b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0bf59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c00b9f40 0x7fc0c0154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0bf59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c0146b40 0x7fc0c0155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0bf59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c01557f0 con 0x7fc0c00b9f40 2021-01-03T12:58:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0bf59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00907c0 con 0x7fc0c0146b40 2021-01-03T12:58:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0bf59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00b3130 con 0x7fc0c00b9b60 2021-01-03T12:58:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0bed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c0146b40 0x7fc0c0155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0bed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c0146b40 0x7fc0c0155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60182/0 (socket says 172.21.15.133:60182) 2021-01-03T12:58:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0bed9d700 1 -- 172.21.15.133:0/3131600911 learned_addr learned my addr 172.21.15.133:0/3131600911 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0be59c700 1 --2- 172.21.15.133:0/3131600911 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0c00b9b60 0x7fc0c00b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0bdd9b700 1 --2- 172.21.15.133:0/3131600911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c00b9f40 0x7fc0c0154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0bed9d700 1 -- 172.21.15.133:0/3131600911 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0c00b9b60 msgr2=0x7fc0c00b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0bed9d700 1 --2- 172.21.15.133:0/3131600911 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0c00b9b60 0x7fc0c00b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0bed9d700 1 -- 172.21.15.133:0/3131600911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c00b9f40 msgr2=0x7fc0c0154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0bed9d700 1 --2- 172.21.15.133:0/3131600911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c00b9f40 0x7fc0c0154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.715+0000 7fc0bed9d700 1 -- 172.21.15.133:0/3131600911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c00b1920 con 0x7fc0c0146b40 2021-01-03T12:58:08.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.719+0000 7fc0bed9d700 1 --2- 172.21.15.133:0/3131600911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c0146b40 0x7fc0c0155300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fc0c0155930 tx=0x7fc0b8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:08.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.719+0000 7fc0af7fe700 1 -- 172.21.15.133:0/3131600911 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0b8011ce0 con 0x7fc0c0146b40 2021-01-03T12:58:08.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.719+0000 7fc0af7fe700 1 -- 172.21.15.133:0/3131600911 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b8011e40 con 0x7fc0c0146b40 2021-01-03T12:58:08.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.719+0000 7fc0af7fe700 1 -- 172.21.15.133:0/3131600911 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0b80205f0 con 0x7fc0c0146b40 2021-01-03T12:58:08.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.719+0000 7fc0bf59e700 1 -- 172.21.15.133:0/3131600911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c00909f0 con 0x7fc0c0146b40 2021-01-03T12:58:08.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.719+0000 7fc0bf59e700 1 -- 172.21.15.133:0/3131600911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c0091130 con 0x7fc0c0146b40 2021-01-03T12:58:08.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.719+0000 7fc0bf59e700 1 -- 172.21.15.133:0/3131600911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c00b16e0 con 0x7fc0c0146b40 2021-01-03T12:58:08.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.719+0000 7fc0af7fe700 1 -- 172.21.15.133:0/3131600911 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc0b8027030 con 0x7fc0c0146b40 2021-01-03T12:58:08.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.719+0000 7fc0af7fe700 1 --2- 172.21.15.133:0/3131600911 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc09c0554e0 0x7fc09c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.719+0000 7fc0af7fe700 1 -- 172.21.15.133:0/3131600911 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc0b806ec90 con 0x7fc0c0146b40 2021-01-03T12:58:08.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.719+0000 7fc0be59c700 1 --2- 172.21.15.133:0/3131600911 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc09c0554e0 0x7fc09c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.719+0000 7fc0be59c700 1 --2- 172.21.15.133:0/3131600911 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc09c0554e0 0x7fc09c0579a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fc0b400b000 tx=0x7fc0b4000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:08.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.727+0000 7fc0af7fe700 1 -- 172.21.15.133:0/3131600911 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc0c00b16e0 con 0x7fc0c0146b40 2021-01-03T12:58:08.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.867+0000 7fc0bf59e700 1 -- 172.21.15.133:0/3131600911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc0c00b16e0 con 0x7fc0c0146b40 2021-01-03T12:58:08.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.867+0000 7fc0af7fe700 1 -- 172.21.15.133:0/3131600911 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc0c00b16e0 con 0x7fc0c0146b40 2021-01-03T12:58:08.869 INFO:teuthology.orchestra.run.smithi133.stdout:60129542148 2021-01-03T12:58:08.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.871+0000 7fc0bf59e700 1 -- 172.21.15.133:0/3131600911 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc09c0554e0 msgr2=0x7fc09c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.871+0000 7fc0bf59e700 1 --2- 172.21.15.133:0/3131600911 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc09c0554e0 0x7fc09c0579a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fc0b400b000 tx=0x7fc0b4000b80).stop 2021-01-03T12:58:08.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.871+0000 7fc0bf59e700 1 -- 172.21.15.133:0/3131600911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c0146b40 msgr2=0x7fc0c0155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.871+0000 7fc0bf59e700 1 --2- 172.21.15.133:0/3131600911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c0146b40 0x7fc0c0155300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fc0c0155930 tx=0x7fc0b8016000).stop 2021-01-03T12:58:08.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.871+0000 7fc0bf59e700 1 -- 172.21.15.133:0/3131600911 shutdown_connections 2021-01-03T12:58:08.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.871+0000 7fc0bf59e700 1 --2- 172.21.15.133:0/3131600911 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc09c0554e0 0x7fc09c0579a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.871+0000 7fc0bf59e700 1 --2- 172.21.15.133:0/3131600911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c0146b40 0x7fc0c0155300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.871+0000 7fc0bf59e700 1 --2- 172.21.15.133:0/3131600911 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0c00b9b60 0x7fc0c00b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.871+0000 7fc0bf59e700 1 --2- 172.21.15.133:0/3131600911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c00b9f40 0x7fc0c0154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.871+0000 7fc0bf59e700 1 -- 172.21.15.133:0/3131600911 >> 172.21.15.133:0/3131600911 conn(0x7fc0c00b69e0 msgr2=0x7fc0c00b9060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:08.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.871+0000 7fc0bf59e700 1 -- 172.21.15.133:0/3131600911 shutdown_connections 2021-01-03T12:58:08.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.871+0000 7fc0bf59e700 1 -- 172.21.15.133:0/3131600911 wait complete. 2021-01-03T12:58:08.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.4 2021-01-03T12:58:08.882 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2021-01-03T12:58:08.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbda395700 1 Processor -- start 2021-01-03T12:58:08.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbda395700 1 -- start start 2021-01-03T12:58:08.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbda395700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcbd40b3060 0x7fcbd4141660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbda395700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcbd405f5e0 0x7fcbd413def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:08.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbda395700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd40b24f0 con 0x7fcbd40b3870 2021-01-03T12:58:08.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbda395700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd40b3440 con 0x7fcbd405f5e0 2021-01-03T12:58:08.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbda395700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd4140c80 con 0x7fcbd40b3060 2021-01-03T12:58:08.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbd9b94700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcbd405f5e0 0x7fcbd413def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbd9b94700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcbd405f5e0 0x7fcbd413def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60190/0 (socket says 172.21.15.133:60190) 2021-01-03T12:58:08.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbd9b94700 1 -- 172.21.15.133:0/3213927299 learned_addr learned my addr 172.21.15.133:0/3213927299 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:08.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbd9393700 1 --2- 172.21.15.133:0/3213927299 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcbd40b3060 0x7fcbd4141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:08.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbd9b94700 1 -- 172.21.15.133:0/3213927299 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcbd40b3060 msgr2=0x7fcbd4141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:08.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbd9b94700 1 --2- 172.21.15.133:0/3213927299 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcbd40b3060 0x7fcbd4141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:08.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbd9b94700 1 -- 172.21.15.133:0/3213927299 >> v1:172.21.15.16:6789/0 conn(0x7fcbd40b3870 legacy=0x7fcbd40b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:08.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbd9b94700 1 -- 172.21.15.133:0/3213927299 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd4140f20 con 0x7fcbd405f5e0 2021-01-03T12:58:08.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbd9b94700 1 --2- 172.21.15.133:0/3213927299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd405f5e0 0x7fcbd413def0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fcbcc0032b0 tx=0x7fcbcc009270).ready entity=mon.1 client_cookie=ee6fedf13320e160 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:09.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbc7fff700 1 -- 172.21.15.133:0/3213927299 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbcc009e60 con 0x7fcbd405f5e0 2021-01-03T12:58:09.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbc7fff700 1 -- 172.21.15.133:0/3213927299 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc00bc00 con 0x7fcbd405f5e0 2021-01-03T12:58:09.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbda395700 1 -- 172.21.15.133:0/3213927299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd405f5e0 msgr2=0x7fcbd413def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbc7fff700 1 -- 172.21.15.133:0/3213927299 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbcc00bd70 con 0x7fcbd405f5e0 2021-01-03T12:58:09.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.991+0000 7fcbda395700 1 --2- 172.21.15.133:0/3213927299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd405f5e0 0x7fcbd413def0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fcbcc0032b0 tx=0x7fcbcc009270).stop 2021-01-03T12:58:09.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbda395700 1 -- 172.21.15.133:0/3213927299 shutdown_connections 2021-01-03T12:58:09.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbda395700 1 --2- 172.21.15.133:0/3213927299 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcbd40b3060 0x7fcbd4141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbda395700 1 --2- 172.21.15.133:0/3213927299 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd405f5e0 0x7fcbd413def0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbda395700 1 -- 172.21.15.133:0/3213927299 >> 172.21.15.133:0/3213927299 conn(0x7fcbd40b7200 msgr2=0x7fcbd40b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:09.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbda395700 1 -- 172.21.15.133:0/3213927299 shutdown_connections 2021-01-03T12:58:09.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbda395700 1 -- 172.21.15.133:0/3213927299 wait complete. 2021-01-03T12:58:09.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbda395700 1 Processor -- start 2021-01-03T12:58:09.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbda395700 1 -- start start 2021-01-03T12:58:09.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbda395700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcbd405f5e0 0x7fcbd40b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbda395700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd40b3060 0x7fcbd40656d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbda395700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbd40b3870 0x7fcbd4065db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbda395700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd4044630 con 0x7fcbd40b3870 2021-01-03T12:58:09.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbda395700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd4065bc0 con 0x7fcbd40b3060 2021-01-03T12:58:09.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbda395700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd4062510 con 0x7fcbd405f5e0 2021-01-03T12:58:09.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbd8b92700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd40b3060 0x7fcbd40656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbd8b92700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd40b3060 0x7fcbd40656d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60194/0 (socket says 172.21.15.133:60194) 2021-01-03T12:58:09.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbd8b92700 1 -- 172.21.15.133:0/1586294542 learned_addr learned my addr 172.21.15.133:0/1586294542 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:09.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbd9393700 1 --2- 172.21.15.133:0/1586294542 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcbd405f5e0 0x7fcbd40b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbd9b94700 1 --2- 172.21.15.133:0/1586294542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbd40b3870 0x7fcbd4065db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbd8b92700 1 -- 172.21.15.133:0/1586294542 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcbd405f5e0 msgr2=0x7fcbd40b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbd8b92700 1 --2- 172.21.15.133:0/1586294542 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcbd405f5e0 0x7fcbd40b60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbd8b92700 1 -- 172.21.15.133:0/1586294542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbd40b3870 msgr2=0x7fcbd4065db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbd8b92700 1 --2- 172.21.15.133:0/1586294542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbd40b3870 0x7fcbd4065db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbd8b92700 1 -- 172.21.15.133:0/1586294542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd41481a0 con 0x7fcbd40b3060 2021-01-03T12:58:09.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbd8b92700 1 --2- 172.21.15.133:0/1586294542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd40b3060 0x7fcbd40656d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fcbd4141540 tx=0x7fcbd0007bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:09.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbc6ffd700 1 -- 172.21.15.133:0/1586294542 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbd0013410 con 0x7fcbd40b3060 2021-01-03T12:58:09.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbc6ffd700 1 -- 172.21.15.133:0/1586294542 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd0013570 con 0x7fcbd40b3060 2021-01-03T12:58:09.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbda395700 1 -- 172.21.15.133:0/1586294542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd4062fa0 con 0x7fcbd40b3060 2021-01-03T12:58:09.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbc6ffd700 1 -- 172.21.15.133:0/1586294542 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbd00138d0 con 0x7fcbd40b3060 2021-01-03T12:58:09.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.995+0000 7fcbda395700 1 -- 172.21.15.133:0/1586294542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd4065230 con 0x7fcbd40b3060 2021-01-03T12:58:09.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.999+0000 7fcbc6ffd700 1 -- 172.21.15.133:0/1586294542 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fcbd0010030 con 0x7fcbd40b3060 2021-01-03T12:58:09.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.999+0000 7fcbda395700 1 -- 172.21.15.133:0/1586294542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd40653f0 con 0x7fcbd40b3060 2021-01-03T12:58:09.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.999+0000 7fcbc6ffd700 1 --2- 172.21.15.133:0/1586294542 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcbb0055440 0x7fcbb0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.999+0000 7fcbc6ffd700 1 -- 172.21.15.133:0/1586294542 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcbd006dd80 con 0x7fcbd40b3060 2021-01-03T12:58:09.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.999+0000 7fcbd9393700 1 --2- 172.21.15.133:0/1586294542 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcbb0055440 0x7fcbb0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:08.999+0000 7fcbd9393700 1 --2- 172.21.15.133:0/1586294542 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcbb0055440 0x7fcbb0057900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fcbc800b000 tx=0x7fcbc8006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:09.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.003+0000 7fcbc6ffd700 1 -- 172.21.15.133:0/1586294542 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcbd0043f70 con 0x7fcbd40b3060 2021-01-03T12:58:09.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.143+0000 7fcbda395700 1 -- 172.21.15.133:0/1586294542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fcbd4057300 con 0x7fcbd40b3060 2021-01-03T12:58:09.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.143+0000 7fcbc6ffd700 1 -- 172.21.15.133:0/1586294542 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcbd0047590 con 0x7fcbd40b3060 2021-01-03T12:58:09.145 INFO:teuthology.orchestra.run.smithi133.stdout:60129542149 2021-01-03T12:58:09.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.147+0000 7fcbda395700 1 -- 172.21.15.133:0/1586294542 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcbb0055440 msgr2=0x7fcbb0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.147+0000 7fcbda395700 1 --2- 172.21.15.133:0/1586294542 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcbb0055440 0x7fcbb0057900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fcbc800b000 tx=0x7fcbc8006dc0).stop 2021-01-03T12:58:09.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.147+0000 7fcbda395700 1 -- 172.21.15.133:0/1586294542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd40b3060 msgr2=0x7fcbd40656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.147+0000 7fcbda395700 1 --2- 172.21.15.133:0/1586294542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd40b3060 0x7fcbd40656d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fcbd4141540 tx=0x7fcbd0007bf0).stop 2021-01-03T12:58:09.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.147+0000 7fcbda395700 1 -- 172.21.15.133:0/1586294542 shutdown_connections 2021-01-03T12:58:09.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.147+0000 7fcbda395700 1 --2- 172.21.15.133:0/1586294542 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcbb0055440 0x7fcbb0057900 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.147+0000 7fcbda395700 1 --2- 172.21.15.133:0/1586294542 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcbd40b3870 0x7fcbd4065db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.147+0000 7fcbda395700 1 --2- 172.21.15.133:0/1586294542 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcbd405f5e0 0x7fcbd40b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.147+0000 7fcbda395700 1 --2- 172.21.15.133:0/1586294542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbd40b3060 0x7fcbd40656d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.147+0000 7fcbda395700 1 -- 172.21.15.133:0/1586294542 >> 172.21.15.133:0/1586294542 conn(0x7fcbd40b7200 msgr2=0x7fcbd40b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:09.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.147+0000 7fcbda395700 1 -- 172.21.15.133:0/1586294542 shutdown_connections 2021-01-03T12:58:09.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.147+0000 7fcbda395700 1 -- 172.21.15.133:0/1586294542 wait complete. 2021-01-03T12:58:09.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2021-01-03T12:58:09.164 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2021-01-03T12:58:09.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.271+0000 7feb8af02700 1 Processor -- start 2021-01-03T12:58:09.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.271+0000 7feb8af02700 1 -- start start 2021-01-03T12:58:09.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8af02700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb84063270 0x7feb840ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8af02700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb840accf0 0x7feb8413bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8af02700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb84063650 con 0x7feb840b0250 2021-01-03T12:58:09.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8af02700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb840afd30 con 0x7feb840accf0 2021-01-03T12:58:09.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8af02700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb840b30e0 con 0x7feb84063270 2021-01-03T12:58:09.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb896ff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feb840b0250 0x7feb840ae8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53000/0 (socket says 172.21.15.133:53000) 2021-01-03T12:58:09.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8a701700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb840accf0 0x7feb8413bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb896ff700 1 -- 172.21.15.133:0/2520991032 learned_addr learned my addr 172.21.15.133:0/2520991032 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:09.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb89f00700 1 --2- 172.21.15.133:0/2520991032 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb84063270 0x7feb840ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8a701700 1 -- 172.21.15.133:0/2520991032 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb84063270 msgr2=0x7feb840ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8a701700 1 --2- 172.21.15.133:0/2520991032 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb84063270 0x7feb840ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8a701700 1 -- 172.21.15.133:0/2520991032 >> v1:172.21.15.133:6789/0 conn(0x7feb840b0250 legacy=0x7feb840ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8a701700 1 -- 172.21.15.133:0/2520991032 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb840af5f0 con 0x7feb840accf0 2021-01-03T12:58:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8a701700 1 --2- 172.21.15.133:0/2520991032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb840accf0 0x7feb8413bd80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7feb74002f30 tx=0x7feb74006dc0).ready entity=mon.1 client_cookie=cea22c10b771db0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb88efe700 1 -- 172.21.15.133:0/2520991032 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb74009760 con 0x7feb840accf0 2021-01-03T12:58:09.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb88efe700 1 -- 172.21.15.133:0/2520991032 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb740098c0 con 0x7feb840accf0 2021-01-03T12:58:09.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb88efe700 1 -- 172.21.15.133:0/2520991032 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb74009c20 con 0x7feb840accf0 2021-01-03T12:58:09.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8af02700 1 -- 172.21.15.133:0/2520991032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb840accf0 msgr2=0x7feb8413bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8af02700 1 --2- 172.21.15.133:0/2520991032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb840accf0 0x7feb8413bd80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7feb74002f30 tx=0x7feb74006dc0).stop 2021-01-03T12:58:09.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8af02700 1 -- 172.21.15.133:0/2520991032 shutdown_connections 2021-01-03T12:58:09.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8af02700 1 --2- 172.21.15.133:0/2520991032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb840accf0 0x7feb8413bd80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8af02700 1 --2- 172.21.15.133:0/2520991032 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb84063270 0x7feb840ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8af02700 1 -- 172.21.15.133:0/2520991032 >> 172.21.15.133:0/2520991032 conn(0x7feb840617b0 msgr2=0x7feb8406aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:09.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8af02700 1 -- 172.21.15.133:0/2520991032 shutdown_connections 2021-01-03T12:58:09.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.275+0000 7feb8af02700 1 -- 172.21.15.133:0/2520991032 wait complete. 2021-01-03T12:58:09.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb8af02700 1 Processor -- start 2021-01-03T12:58:09.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb8af02700 1 -- start start 2021-01-03T12:58:09.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb8af02700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb84063270 0x7feb840b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb8af02700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb840accf0 0x7feb84142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb8af02700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb840b0250 0x7feb84142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb8af02700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb84141530 con 0x7feb840b0250 2021-01-03T12:58:09.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb8af02700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8413ae80 con 0x7feb84063270 2021-01-03T12:58:09.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb8af02700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb840b1d30 con 0x7feb840accf0 2021-01-03T12:58:09.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb89f00700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb84063270 0x7feb840b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb89f00700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb84063270 0x7feb840b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60206/0 (socket says 172.21.15.133:60206) 2021-01-03T12:58:09.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb89f00700 1 -- 172.21.15.133:0/1434486722 learned_addr learned my addr 172.21.15.133:0/1434486722 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:09.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb896ff700 1 --2- 172.21.15.133:0/1434486722 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb840accf0 0x7feb84142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb8a701700 1 --2- 172.21.15.133:0/1434486722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb840b0250 0x7feb84142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb89f00700 1 -- 172.21.15.133:0/1434486722 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb840accf0 msgr2=0x7feb84142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb89f00700 1 --2- 172.21.15.133:0/1434486722 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb840accf0 0x7feb84142530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb89f00700 1 -- 172.21.15.133:0/1434486722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb840b0250 msgr2=0x7feb84142a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb89f00700 1 --2- 172.21.15.133:0/1434486722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb840b0250 0x7feb84142a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb89f00700 1 -- 172.21.15.133:0/1434486722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8413abe0 con 0x7feb84063270 2021-01-03T12:58:09.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb8a701700 1 --2- 172.21.15.133:0/1434486722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb840b0250 0x7feb84142a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:09.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb89f00700 1 --2- 172.21.15.133:0/1434486722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb84063270 0x7feb840b1670 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7feb7800c000 tx=0x7feb78006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:09.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.279+0000 7feb82ffd700 1 -- 172.21.15.133:0/1434486722 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb7800ca80 con 0x7feb84063270 2021-01-03T12:58:09.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.283+0000 7feb82ffd700 1 -- 172.21.15.133:0/1434486722 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7800cbe0 con 0x7feb84063270 2021-01-03T12:58:09.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.283+0000 7feb8af02700 1 -- 172.21.15.133:0/1434486722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8413b7a0 con 0x7feb84063270 2021-01-03T12:58:09.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.283+0000 7feb82ffd700 1 -- 172.21.15.133:0/1434486722 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb780123f0 con 0x7feb84063270 2021-01-03T12:58:09.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.283+0000 7feb8af02700 1 -- 172.21.15.133:0/1434486722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb84139c80 con 0x7feb84063270 2021-01-03T12:58:09.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.283+0000 7feb8af02700 1 -- 172.21.15.133:0/1434486722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb84057300 con 0x7feb84063270 2021-01-03T12:58:09.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.283+0000 7feb82ffd700 1 -- 172.21.15.133:0/1434486722 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7feb78012550 con 0x7feb84063270 2021-01-03T12:58:09.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.283+0000 7feb82ffd700 1 --2- 172.21.15.133:0/1434486722 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb64055330 0x7feb640577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.283+0000 7feb82ffd700 1 -- 172.21.15.133:0/1434486722 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feb7806e410 con 0x7feb84063270 2021-01-03T12:58:09.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.283+0000 7feb896ff700 1 --2- 172.21.15.133:0/1434486722 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb64055330 0x7feb640577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.283+0000 7feb896ff700 1 --2- 172.21.15.133:0/1434486722 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb64055330 0x7feb640577f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7feb7c00b000 tx=0x7feb7c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:09.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.291+0000 7feb82ffd700 1 -- 172.21.15.133:0/1434486722 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7feb780446b0 con 0x7feb84063270 2021-01-03T12:58:09.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.431+0000 7feb8af02700 1 -- 172.21.15.133:0/1434486722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7feb8405f080 con 0x7feb84063270 2021-01-03T12:58:09.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.431+0000 7feb82ffd700 1 -- 172.21.15.133:0/1434486722 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feb78047cd0 con 0x7feb84063270 2021-01-03T12:58:09.432 INFO:teuthology.orchestra.run.smithi133.stdout:60129542149 2021-01-03T12:58:09.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.431+0000 7feb8af02700 1 -- 172.21.15.133:0/1434486722 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb64055330 msgr2=0x7feb640577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.431+0000 7feb8af02700 1 --2- 172.21.15.133:0/1434486722 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb64055330 0x7feb640577f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7feb7c00b000 tx=0x7feb7c009040).stop 2021-01-03T12:58:09.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.431+0000 7feb8af02700 1 -- 172.21.15.133:0/1434486722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb84063270 msgr2=0x7feb840b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.431+0000 7feb8af02700 1 --2- 172.21.15.133:0/1434486722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb84063270 0x7feb840b1670 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7feb7800c000 tx=0x7feb78006dc0).stop 2021-01-03T12:58:09.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.431+0000 7feb8af02700 1 -- 172.21.15.133:0/1434486722 shutdown_connections 2021-01-03T12:58:09.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.431+0000 7feb8af02700 1 --2- 172.21.15.133:0/1434486722 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb64055330 0x7feb640577f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.431+0000 7feb8af02700 1 --2- 172.21.15.133:0/1434486722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb840b0250 0x7feb84142a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.431+0000 7feb8af02700 1 --2- 172.21.15.133:0/1434486722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb84063270 0x7feb840b1670 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.431+0000 7feb8af02700 1 --2- 172.21.15.133:0/1434486722 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb840accf0 0x7feb84142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.431+0000 7feb8af02700 1 -- 172.21.15.133:0/1434486722 >> 172.21.15.133:0/1434486722 conn(0x7feb840617b0 msgr2=0x7feb8413e970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:09.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.431+0000 7feb8af02700 1 -- 172.21.15.133:0/1434486722 shutdown_connections 2021-01-03T12:58:09.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.431+0000 7feb8af02700 1 -- 172.21.15.133:0/1434486722 wait complete. 2021-01-03T12:58:09.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2021-01-03T12:58:09.445 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2021-01-03T12:58:09.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.555+0000 7f0bb1f57700 1 Processor -- start 2021-01-03T12:58:09.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.555+0000 7f0bb1f57700 1 -- start start 2021-01-03T12:58:09.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb1f57700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0bac0b9b60 0x7f0bac0b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb1f57700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bac0605f0 con 0x7f0bac0b4980 2021-01-03T12:58:09.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb1f57700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bac0600b0 con 0x7f0bac0b4e10 2021-01-03T12:58:09.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb1f57700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bac0aed30 con 0x7f0bac0b9b60 2021-01-03T12:58:09.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb1756700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0bac0b4e10 0x7f0bac14d500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53018/0 (socket says 172.21.15.133:53018) 2021-01-03T12:58:09.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb0f55700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0bac0b9b60 0x7f0bac0b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb1756700 1 -- 172.21.15.133:0/1160073269 learned_addr learned my addr 172.21.15.133:0/1160073269 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:09.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bab7fe700 1 -- 172.21.15.133:0/1160073269 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037323844 0 0) 0x7f0bac0600b0 con 0x7f0bac0b4e10 2021-01-03T12:58:09.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bab7fe700 1 -- 172.21.15.133:0/1160073269 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b8c003230 con 0x7f0bac0b4e10 2021-01-03T12:58:09.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bab7fe700 1 -- 172.21.15.133:0/1160073269 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4104014349 0 0) 0x7f0b8c003230 con 0x7f0bac0b4e10 2021-01-03T12:58:09.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb0f55700 1 -- 172.21.15.133:0/1160073269 >> v1:172.21.15.133:6789/0 conn(0x7f0bac0b4e10 legacy=0x7f0bac14d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb0f55700 1 -- 172.21.15.133:0/1160073269 >> v1:172.21.15.16:6789/0 conn(0x7f0bac0b4980 legacy=0x7f0bac146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb0f55700 1 -- 172.21.15.133:0/1160073269 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac060350 con 0x7f0bac0b9b60 2021-01-03T12:58:09.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb0f55700 1 --2- 172.21.15.133:0/1160073269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bac0b9b60 0x7f0bac0b9f40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f0b9c001bf0 tx=0x7f0ba4006dc0).ready entity=mon.1 client_cookie=c586c5518ff11929 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:09.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bab7fe700 1 -- 172.21.15.133:0/1160073269 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b9c001a50 con 0x7f0bac0b9b60 2021-01-03T12:58:09.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bab7fe700 1 -- 172.21.15.133:0/1160073269 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba4009670 con 0x7f0bac0b9b60 2021-01-03T12:58:09.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bab7fe700 1 -- 172.21.15.133:0/1160073269 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ba40097e0 con 0x7f0bac0b9b60 2021-01-03T12:58:09.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb1f57700 1 -- 172.21.15.133:0/1160073269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bac0b9b60 msgr2=0x7f0bac0b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb1f57700 1 --2- 172.21.15.133:0/1160073269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bac0b9b60 0x7f0bac0b9f40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f0b9c001bf0 tx=0x7f0ba4006dc0).stop 2021-01-03T12:58:09.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb1f57700 1 -- 172.21.15.133:0/1160073269 shutdown_connections 2021-01-03T12:58:09.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb1f57700 1 --2- 172.21.15.133:0/1160073269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bac0b9b60 0x7f0bac0b9f40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb1f57700 1 -- 172.21.15.133:0/1160073269 >> 172.21.15.133:0/1160073269 conn(0x7f0bac0b69e0 msgr2=0x7f0bac0b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:09.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb1f57700 1 -- 172.21.15.133:0/1160073269 shutdown_connections 2021-01-03T12:58:09.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.559+0000 7f0bb1f57700 1 -- 172.21.15.133:0/1160073269 wait complete. 2021-01-03T12:58:09.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1f57700 1 Processor -- start 2021-01-03T12:58:09.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1f57700 1 -- start start 2021-01-03T12:58:09.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1f57700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0bac0b4980 0x7f0bac09c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1f57700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bac0b4e10 0x7f0bac09dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1f57700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bac0b9b60 0x7f0bac09e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1f57700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac151980 con 0x7f0bac0b4e10 2021-01-03T12:58:09.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1f57700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac146dd0 con 0x7f0bac0b9b60 2021-01-03T12:58:09.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1f57700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0b0dc0 con 0x7f0bac0b4980 2021-01-03T12:58:09.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1756700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bac0b9b60 0x7f0bac09e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1756700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bac0b9b60 0x7f0bac09e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60222/0 (socket says 172.21.15.133:60222) 2021-01-03T12:58:09.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1756700 1 -- 172.21.15.133:0/890269078 learned_addr learned my addr 172.21.15.133:0/890269078 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:09.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb0f55700 1 --2- 172.21.15.133:0/890269078 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0bac0b4980 0x7f0bac09c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0babfff700 1 --2- 172.21.15.133:0/890269078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bac0b4e10 0x7f0bac09dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1756700 1 -- 172.21.15.133:0/890269078 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0bac0b4980 msgr2=0x7f0bac09c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1756700 1 --2- 172.21.15.133:0/890269078 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0bac0b4980 0x7f0bac09c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1756700 1 -- 172.21.15.133:0/890269078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bac0b4e10 msgr2=0x7f0bac09dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1756700 1 --2- 172.21.15.133:0/890269078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bac0b4e10 0x7f0bac09dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1756700 1 -- 172.21.15.133:0/890269078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac145050 con 0x7f0bac0b9b60 2021-01-03T12:58:09.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1756700 1 --2- 172.21.15.133:0/890269078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bac0b9b60 0x7f0bac09e120 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f0bac0b2fc0 tx=0x7f0b9c001600).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:09.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0ba9ffb700 1 -- 172.21.15.133:0/890269078 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b9c004a80 con 0x7f0bac0b9b60 2021-01-03T12:58:09.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1f57700 1 -- 172.21.15.133:0/890269078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bac09e610 con 0x7f0bac0b9b60 2021-01-03T12:58:09.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0ba9ffb700 1 -- 172.21.15.133:0/890269078 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9c004be0 con 0x7f0bac0b9b60 2021-01-03T12:58:09.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0ba9ffb700 1 -- 172.21.15.133:0/890269078 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b9c007170 con 0x7f0bac0b9b60 2021-01-03T12:58:09.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1f57700 1 -- 172.21.15.133:0/890269078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bac0b0490 con 0x7f0bac0b9b60 2021-01-03T12:58:09.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.563+0000 7f0bb1f57700 1 -- 172.21.15.133:0/890269078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bac057300 con 0x7f0bac0b9b60 2021-01-03T12:58:09.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.567+0000 7f0ba9ffb700 1 -- 172.21.15.133:0/890269078 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0b9c010070 con 0x7f0bac0b9b60 2021-01-03T12:58:09.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.567+0000 7f0ba9ffb700 1 --2- 172.21.15.133:0/890269078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0b90055330 0x7f0b900577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.567+0000 7f0ba9ffb700 1 -- 172.21.15.133:0/890269078 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0b9c06dc60 con 0x7f0bac0b9b60 2021-01-03T12:58:09.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.567+0000 7f0bb0f55700 1 --2- 172.21.15.133:0/890269078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0b90055330 0x7f0b900577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.567+0000 7f0bb0f55700 1 --2- 172.21.15.133:0/890269078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0b90055330 0x7f0b900577f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f0ba401b000 tx=0x7f0ba4015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:09.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.571+0000 7f0ba9ffb700 1 -- 172.21.15.133:0/890269078 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0b9c043dd0 con 0x7f0bac0b9b60 2021-01-03T12:58:09.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.711+0000 7f0bb1f57700 1 -- 172.21.15.133:0/890269078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0bac09d8b0 con 0x7f0bac0b9b60 2021-01-03T12:58:09.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.711+0000 7f0ba9ffb700 1 -- 172.21.15.133:0/890269078 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0b9c0473f0 con 0x7f0bac0b9b60 2021-01-03T12:58:09.716 INFO:teuthology.orchestra.run.smithi133.stdout:60129542150 2021-01-03T12:58:09.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.715+0000 7f0bb1f57700 1 -- 172.21.15.133:0/890269078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0b90055330 msgr2=0x7f0b900577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.715+0000 7f0bb1f57700 1 --2- 172.21.15.133:0/890269078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0b90055330 0x7f0b900577f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f0ba401b000 tx=0x7f0ba4015000).stop 2021-01-03T12:58:09.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.715+0000 7f0bb1f57700 1 -- 172.21.15.133:0/890269078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bac0b9b60 msgr2=0x7f0bac09e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.715+0000 7f0bb1f57700 1 --2- 172.21.15.133:0/890269078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bac0b9b60 0x7f0bac09e120 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f0bac0b2fc0 tx=0x7f0b9c001600).stop 2021-01-03T12:58:09.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.715+0000 7f0bb1f57700 1 -- 172.21.15.133:0/890269078 shutdown_connections 2021-01-03T12:58:09.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.715+0000 7f0bb1f57700 1 --2- 172.21.15.133:0/890269078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0b90055330 0x7f0b900577f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.715+0000 7f0bb1f57700 1 --2- 172.21.15.133:0/890269078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bac0b9b60 0x7f0bac09e120 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.715+0000 7f0bb1f57700 1 --2- 172.21.15.133:0/890269078 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0bac0b4980 0x7f0bac09c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.715+0000 7f0bb1f57700 1 --2- 172.21.15.133:0/890269078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bac0b4e10 0x7f0bac09dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.715+0000 7f0bb1f57700 1 -- 172.21.15.133:0/890269078 >> 172.21.15.133:0/890269078 conn(0x7f0bac0b69e0 msgr2=0x7f0bac1434e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:09.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.715+0000 7f0bb1f57700 1 -- 172.21.15.133:0/890269078 shutdown_connections 2021-01-03T12:58:09.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.715+0000 7f0bb1f57700 1 -- 172.21.15.133:0/890269078 wait complete. 2021-01-03T12:58:09.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.7 2021-01-03T12:58:09.733 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-01-03T12:58:09.734 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2021-01-03T12:58:09.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f8948700 1 Processor -- start 2021-01-03T12:58:09.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f8948700 1 -- start start 2021-01-03T12:58:09.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f8948700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f83f40b9f40 0x7f83f4146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f8948700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83f4146920 0x7f83f414d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f8948700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f40605f0 con 0x7f83f40b9b60 2021-01-03T12:58:09.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f8948700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f40aed30 con 0x7f83f4146920 2021-01-03T12:58:09.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f8948700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f40600b0 con 0x7f83f40b9f40 2021-01-03T12:58:09.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83f4146920 0x7f83f414d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f2d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f83f40b9b60 0x7f83f40b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53030/0 (socket says 172.21.15.133:53030) 2021-01-03T12:58:09.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f2d9d700 1 -- 172.21.15.133:0/1929408305 learned_addr learned my addr 172.21.15.133:0/1929408305 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:09.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83ea59c700 1 --2- 172.21.15.133:0/1929408305 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f83f40b9f40 0x7f83f4146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f359e700 1 -- 172.21.15.133:0/1929408305 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f83f40b9f40 msgr2=0x7f83f4146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:09.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f359e700 1 --2- 172.21.15.133:0/1929408305 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f83f40b9f40 0x7f83f4146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f359e700 1 -- 172.21.15.133:0/1929408305 >> v1:172.21.15.133:6789/0 conn(0x7f83f40b9b60 legacy=0x7f83f40b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f259c700 1 -- 172.21.15.133:0/1929408305 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818117436 0 0) 0x7f83f40605f0 con 0x7f83f40b9b60 2021-01-03T12:58:09.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f359e700 1 -- 172.21.15.133:0/1929408305 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4060350 con 0x7f83f4146920 2021-01-03T12:58:09.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f359e700 1 --2- 172.21.15.133:0/1929408305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83f4146920 0x7f83f414d500 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f83ec0032b0 tx=0x7f83ec0091a0).ready entity=mon.1 client_cookie=ffaaebc75e13168e server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:09.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f259c700 1 -- 172.21.15.133:0/1929408305 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83ec00b9a0 con 0x7f83f4146920 2021-01-03T12:58:09.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f259c700 1 -- 172.21.15.133:0/1929408305 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec00bb00 con 0x7f83f4146920 2021-01-03T12:58:09.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f259c700 1 -- 172.21.15.133:0/1929408305 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83ec00bc70 con 0x7f83f4146920 2021-01-03T12:58:09.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f8948700 1 -- 172.21.15.133:0/1929408305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83f4146920 msgr2=0x7f83f414d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f8948700 1 --2- 172.21.15.133:0/1929408305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83f4146920 0x7f83f414d500 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f83ec0032b0 tx=0x7f83ec0091a0).stop 2021-01-03T12:58:09.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f8948700 1 -- 172.21.15.133:0/1929408305 shutdown_connections 2021-01-03T12:58:09.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f8948700 1 --2- 172.21.15.133:0/1929408305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83f4146920 0x7f83f414d500 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f8948700 1 --2- 172.21.15.133:0/1929408305 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f83f40b9f40 0x7f83f4146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.847+0000 7f83f8948700 1 -- 172.21.15.133:0/1929408305 >> 172.21.15.133:0/1929408305 conn(0x7f83f40b69e0 msgr2=0x7f83f40b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:09.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f8948700 1 -- 172.21.15.133:0/1929408305 shutdown_connections 2021-01-03T12:58:09.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f8948700 1 -- 172.21.15.133:0/1929408305 wait complete. 2021-01-03T12:58:09.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f8948700 1 Processor -- start 2021-01-03T12:58:09.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f8948700 1 -- start start 2021-01-03T12:58:09.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f8948700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83f40b9b60 0x7f83f41522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f8948700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f83f40b9f40 0x7f83f4141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f8948700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83f4146920 0x7f83f40b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f8948700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f4152850 con 0x7f83f4146920 2021-01-03T12:58:09.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f8948700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f4140de0 con 0x7f83f40b9b60 2021-01-03T12:58:09.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f8948700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f4141080 con 0x7f83f40b9f40 2021-01-03T12:58:09.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f2d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83f40b9b60 0x7f83f41522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f2d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83f40b9b60 0x7f83f41522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60236/0 (socket says 172.21.15.133:60236) 2021-01-03T12:58:09.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f2d9d700 1 -- 172.21.15.133:0/2935230961 learned_addr learned my addr 172.21.15.133:0/2935230961 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:09.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83ea59c700 1 --2- 172.21.15.133:0/2935230961 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f83f40b9f40 0x7f83f4141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f359e700 1 --2- 172.21.15.133:0/2935230961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83f4146920 0x7f83f40b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f2d9d700 1 -- 172.21.15.133:0/2935230961 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f83f40b9f40 msgr2=0x7f83f4141810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f2d9d700 1 --2- 172.21.15.133:0/2935230961 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f83f40b9f40 0x7f83f4141810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f2d9d700 1 -- 172.21.15.133:0/2935230961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83f4146920 msgr2=0x7f83f40b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:09.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f2d9d700 1 --2- 172.21.15.133:0/2935230961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83f4146920 0x7f83f40b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:09.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.851+0000 7f83f2d9d700 1 -- 172.21.15.133:0/2935230961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4141320 con 0x7f83f40b9b60 2021-01-03T12:58:09.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.855+0000 7f83f2d9d700 1 --2- 172.21.15.133:0/2935230961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83f40b9b60 0x7f83f41522a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f83e4000e90 tx=0x7f83e4007a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:09.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.855+0000 7f83f0d99700 1 -- 172.21.15.133:0/2935230961 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83e40072e0 con 0x7f83f40b9b60 2021-01-03T12:58:09.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.855+0000 7f83f0d99700 1 -- 172.21.15.133:0/2935230961 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e4007440 con 0x7f83f40b9b60 2021-01-03T12:58:09.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.855+0000 7f83f0d99700 1 -- 172.21.15.133:0/2935230961 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83e40057d0 con 0x7f83f40b9b60 2021-01-03T12:58:09.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.855+0000 7f83f8948700 1 -- 172.21.15.133:0/2935230961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f40b1fc0 con 0x7f83f40b9b60 2021-01-03T12:58:09.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.855+0000 7f83f8948700 1 -- 172.21.15.133:0/2935230961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f409e850 con 0x7f83f40b9b60 2021-01-03T12:58:09.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.855+0000 7f83f8948700 1 -- 172.21.15.133:0/2935230961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f41414b0 con 0x7f83f40b9b60 2021-01-03T12:58:09.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.855+0000 7f83f0d99700 1 -- 172.21.15.133:0/2935230961 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f83e4010070 con 0x7f83f40b9b60 2021-01-03T12:58:09.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.855+0000 7f83f0d99700 1 --2- 172.21.15.133:0/2935230961 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f83d8055500 0x7f83d80579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:09.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.855+0000 7f83f0d99700 1 -- 172.21.15.133:0/2935230961 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f83e406db60 con 0x7f83f40b9b60 2021-01-03T12:58:09.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.855+0000 7f83ea59c700 1 --2- 172.21.15.133:0/2935230961 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f83d8055500 0x7f83d80579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:09.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.859+0000 7f83ea59c700 1 --2- 172.21.15.133:0/2935230961 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f83d8055500 0x7f83d80579c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f83dc00b000 tx=0x7f83dc006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:09.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.859+0000 7f83f0d99700 1 -- 172.21.15.133:0/2935230961 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f83e4043e60 con 0x7f83f40b9b60 2021-01-03T12:58:09.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:09.995+0000 7f83f8948700 1 -- 172.21.15.133:0/2935230961 --> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83f40b40c0 con 0x7f83d8055500 2021-01-03T12:58:10.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.011+0000 7f83f0d99700 1 -- 172.21.15.133:0/2935230961 <== mgr.4110 v2:172.21.15.133:6800/11943 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82245 (secure 0 0 0) 0x7f83f40b40c0 con 0x7f83d8055500 2021-01-03T12:58:10.013 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:10.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.011+0000 7f83f8948700 1 -- 172.21.15.133:0/2935230961 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f83d8055500 msgr2=0x7f83d80579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.011+0000 7f83f8948700 1 --2- 172.21.15.133:0/2935230961 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f83d8055500 0x7f83d80579c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f83dc00b000 tx=0x7f83dc006dc0).stop 2021-01-03T12:58:10.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.011+0000 7f83f8948700 1 -- 172.21.15.133:0/2935230961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83f40b9b60 msgr2=0x7f83f41522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.011+0000 7f83f8948700 1 --2- 172.21.15.133:0/2935230961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83f40b9b60 0x7f83f41522a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f83e4000e90 tx=0x7f83e4007a90).stop 2021-01-03T12:58:10.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.011+0000 7f83f8948700 1 -- 172.21.15.133:0/2935230961 shutdown_connections 2021-01-03T12:58:10.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.011+0000 7f83f8948700 1 --2- 172.21.15.133:0/2935230961 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f83d8055500 0x7f83d80579c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.011+0000 7f83f8948700 1 --2- 172.21.15.133:0/2935230961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83f4146920 0x7f83f40b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.011+0000 7f83f8948700 1 --2- 172.21.15.133:0/2935230961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83f40b9b60 0x7f83f41522a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.011+0000 7f83f8948700 1 --2- 172.21.15.133:0/2935230961 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f83f40b9f40 0x7f83f4141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.011+0000 7f83f8948700 1 -- 172.21.15.133:0/2935230961 >> 172.21.15.133:0/2935230961 conn(0x7f83f40b69e0 msgr2=0x7f83f41449b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:10.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.011+0000 7f83f8948700 1 -- 172.21.15.133:0/2935230961 shutdown_connections 2021-01-03T12:58:10.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.011+0000 7f83f8948700 1 -- 172.21.15.133:0/2935230961 wait complete. 2021-01-03T12:58:10.017 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2021-01-03T12:58:10.028 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2021-01-03T12:58:09.032150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390592,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584128,"statfs":{"total":773094113280,"available":764502147072,"internally_reserved":8589934592,"allocated":1966080,"data_stored":710680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.203271"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.857235+0000","last_change":"2021-01-03T12:58:00.852223+0000","last_active":"2021-01-03T12:58:00.857235+0000","last_peered":"2021-01-03T12:58:00.857235+0000","last_clean":"2021-01-03T12:58:00.857235+0000","last_became_active":"2021-01-03T12:58:00.850578+0000","last_became_peered":"2021-01-03T12:58:00.850578+0000","last_unstale":"2021-01-03T12:58:00.857235+0000","last_undegraded":"2021-01-03T12:58:00.857235+0000","last_fullsized":"2021-01-03T12:58:00.857235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_clean_scrub_stamp":"2021-01-03T12:58:00.470425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.837240+0000","last_change":"2021-01-03T12:57:57.354556+0000","last_active":"2021-01-03T12:58:00.837240+0000","last_peered":"2021-01-03T12:58:00.837240+0000","last_clean":"2021-01-03T12:58:00.837240+0000","last_became_active":"2021-01-03T12:57:57.354020+0000","last_became_peered":"2021-01-03T12:57:57.354020+0000","last_unstale":"2021-01-03T12:58:00.837240+0000","last_undegraded":"2021-01-03T12:58:00.837240+0000","last_fullsized":"2021-01-03T12:58:00.837240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'6","reported_seq":"16","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.858123+0000","last_change":"2021-01-03T12:58:00.502445+0000","last_active":"2021-01-03T12:58:00.858123+0000","last_peered":"2021-01-03T12:58:00.858123+0000","last_clean":"2021-01-03T12:58:00.858123+0000","last_became_active":"2021-01-03T12:58:00.501962+0000","last_became_peered":"2021-01-03T12:58:00.501962+0000","last_unstale":"2021-01-03T12:58:00.858123+0000","last_undegraded":"2021-01-03T12:58:00.858123+0000","last_fullsized":"2021-01-03T12:58:00.858123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_clean_scrub_stamp":"2021-01-03T12:57:59.466393+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.855685+0000","last_change":"2021-01-03T12:58:00.848508+0000","last_active":"2021-01-03T12:58:00.855685+0000","last_peered":"2021-01-03T12:58:00.855685+0000","last_clean":"2021-01-03T12:58:00.855685+0000","last_became_active":"2021-01-03T12:58:00.848156+0000","last_became_peered":"2021-01-03T12:58:00.848156+0000","last_unstale":"2021-01-03T12:58:00.855685+0000","last_undegraded":"2021-01-03T12:58:00.855685+0000","last_fullsized":"2021-01-03T12:58:00.855685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_clean_scrub_stamp":"2021-01-03T12:58:00.470425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.848008+0000","last_change":"2021-01-03T12:57:57.348550+0000","last_active":"2021-01-03T12:58:00.848008+0000","last_peered":"2021-01-03T12:58:00.848008+0000","last_clean":"2021-01-03T12:58:00.848008+0000","last_became_active":"2021-01-03T12:57:57.348011+0000","last_became_peered":"2021-01-03T12:57:57.348011+0000","last_unstale":"2021-01-03T12:58:00.848008+0000","last_undegraded":"2021-01-03T12:58:00.848008+0000","last_fullsized":"2021-01-03T12:58:00.848008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'5","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.858658+0000","last_change":"2021-01-03T12:58:00.498238+0000","last_active":"2021-01-03T12:58:00.858658+0000","last_peered":"2021-01-03T12:58:00.858658+0000","last_clean":"2021-01-03T12:58:00.858658+0000","last_became_active":"2021-01-03T12:58:00.497701+0000","last_became_peered":"2021-01-03T12:58:00.497701+0000","last_unstale":"2021-01-03T12:58:00.858658+0000","last_undegraded":"2021-01-03T12:58:00.858658+0000","last_fullsized":"2021-01-03T12:58:00.858658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_clean_scrub_stamp":"2021-01-03T12:57:59.466393+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.857028+0000","last_change":"2021-01-03T12:58:00.852045+0000","last_active":"2021-01-03T12:58:00.857028+0000","last_peered":"2021-01-03T12:58:00.857028+0000","last_clean":"2021-01-03T12:58:00.857028+0000","last_became_active":"2021-01-03T12:58:00.851731+0000","last_became_peered":"2021-01-03T12:58:00.851731+0000","last_unstale":"2021-01-03T12:58:00.857028+0000","last_undegraded":"2021-01-03T12:58:00.857028+0000","last_fullsized":"2021-01-03T12:58:00.857028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_clean_scrub_stamp":"2021-01-03T12:58:00.470425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.834899+0000","last_change":"2021-01-03T12:57:57.494403+0000","last_active":"2021-01-03T12:58:00.834899+0000","last_peered":"2021-01-03T12:58:00.834899+0000","last_clean":"2021-01-03T12:58:00.834899+0000","last_became_active":"2021-01-03T12:57:57.493742+0000","last_became_peered":"2021-01-03T12:57:57.493742+0000","last_unstale":"2021-01-03T12:58:00.834899+0000","last_undegraded":"2021-01-03T12:58:00.834899+0000","last_fullsized":"2021-01-03T12:58:00.834899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'8","reported_seq":"18","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.859039+0000","last_change":"2021-01-03T12:58:00.501105+0000","last_active":"2021-01-03T12:58:00.859039+0000","last_peered":"2021-01-03T12:58:00.859039+0000","last_clean":"2021-01-03T12:58:00.859039+0000","last_became_active":"2021-01-03T12:58:00.500682+0000","last_became_peered":"2021-01-03T12:58:00.500682+0000","last_unstale":"2021-01-03T12:58:00.859039+0000","last_undegraded":"2021-01-03T12:58:00.859039+0000","last_fullsized":"2021-01-03T12:58:00.859039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_clean_scrub_stamp":"2021-01-03T12:57:59.466393+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.842761+0000","last_change":"2021-01-03T12:58:00.842093+0000","last_active":"2021-01-03T12:58:00.842761+0000","last_peered":"2021-01-03T12:58:00.842761+0000","last_clean":"2021-01-03T12:58:00.842761+0000","last_became_active":"2021-01-03T12:58:00.841588+0000","last_became_peered":"2021-01-03T12:58:00.841588+0000","last_unstale":"2021-01-03T12:58:00.842761+0000","last_undegraded":"2021-01-03T12:58:00.842761+0000","last_fullsized":"2021-01-03T12:58:00.842761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_clean_scrub_stamp":"2021-01-03T12:58:00.470425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.847961+0000","last_change":"2021-01-03T12:57:57.345066+0000","last_active":"2021-01-03T12:58:00.847961+0000","last_peered":"2021-01-03T12:58:00.847961+0000","last_clean":"2021-01-03T12:58:00.847961+0000","last_became_active":"2021-01-03T12:57:57.344536+0000","last_became_peered":"2021-01-03T12:57:57.344536+0000","last_unstale":"2021-01-03T12:58:00.847961+0000","last_undegraded":"2021-01-03T12:58:00.847961+0000","last_fullsized":"2021-01-03T12:58:00.847961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"18","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.833770+0000","last_change":"2021-01-03T12:57:52.089767+0000","last_active":"2021-01-03T12:58:00.833770+0000","last_peered":"2021-01-03T12:58:00.833770+0000","last_clean":"2021-01-03T12:58:00.833770+0000","last_became_active":"2021-01-03T12:57:52.088788+0000","last_became_peered":"2021-01-03T12:57:52.088788+0000","last_unstale":"2021-01-03T12:58:00.833770+0000","last_undegraded":"2021-01-03T12:58:00.833770+0000","last_fullsized":"2021-01-03T12:58:00.833770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:48.019621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:48.019621+0000","last_clean_scrub_stamp":"2021-01-03T12:57:48.019621+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"22'1","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.850151+0000","last_change":"2021-01-03T12:58:00.500847+0000","last_active":"2021-01-03T12:58:00.850151+0000","last_peered":"2021-01-03T12:58:00.850151+0000","last_clean":"2021-01-03T12:58:00.850151+0000","last_became_active":"2021-01-03T12:58:00.500315+0000","last_became_peered":"2021-01-03T12:58:00.500315+0000","last_unstale":"2021-01-03T12:58:00.850151+0000","last_undegraded":"2021-01-03T12:58:00.850151+0000","last_fullsized":"2021-01-03T12:58:00.850151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_clean_scrub_stamp":"2021-01-03T12:57:59.466393+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.856284+0000","last_change":"2021-01-03T12:58:00.852915+0000","last_active":"2021-01-03T12:58:00.856284+0000","last_peered":"2021-01-03T12:58:00.856284+0000","last_clean":"2021-01-03T12:58:00.856284+0000","last_became_active":"2021-01-03T12:58:00.852408+0000","last_became_peered":"2021-01-03T12:58:00.852408+0000","last_unstale":"2021-01-03T12:58:00.856284+0000","last_undegraded":"2021-01-03T12:58:00.856284+0000","last_fullsized":"2021-01-03T12:58:00.856284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_clean_scrub_stamp":"2021-01-03T12:58:00.470425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.834025+0000","last_change":"2021-01-03T12:57:57.344690+0000","last_active":"2021-01-03T12:58:00.834025+0000","last_peered":"2021-01-03T12:58:00.834025+0000","last_clean":"2021-01-03T12:58:00.834025+0000","last_became_active":"2021-01-03T12:57:57.344012+0000","last_became_peered":"2021-01-03T12:57:57.344012+0000","last_unstale":"2021-01-03T12:58:00.834025+0000","last_undegraded":"2021-01-03T12:58:00.834025+0000","last_fullsized":"2021-01-03T12:58:00.834025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.842644+0000","last_change":"2021-01-03T12:58:00.494905+0000","last_active":"2021-01-03T12:58:00.842644+0000","last_peered":"2021-01-03T12:58:00.842644+0000","last_clean":"2021-01-03T12:58:00.842644+0000","last_became_active":"2021-01-03T12:58:00.494423+0000","last_became_peered":"2021-01-03T12:58:00.494423+0000","last_unstale":"2021-01-03T12:58:00.842644+0000","last_undegraded":"2021-01-03T12:58:00.842644+0000","last_fullsized":"2021-01-03T12:58:00.842644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_clean_scrub_stamp":"2021-01-03T12:57:59.466393+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.855824+0000","last_change":"2021-01-03T12:58:00.850182+0000","last_active":"2021-01-03T12:58:00.855824+0000","last_peered":"2021-01-03T12:58:00.855824+0000","last_clean":"2021-01-03T12:58:00.855824+0000","last_became_active":"2021-01-03T12:58:00.849768+0000","last_became_peered":"2021-01-03T12:58:00.849768+0000","last_unstale":"2021-01-03T12:58:00.855824+0000","last_undegraded":"2021-01-03T12:58:00.855824+0000","last_fullsized":"2021-01-03T12:58:00.855824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_clean_scrub_stamp":"2021-01-03T12:58:00.470425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.833864+0000","last_change":"2021-01-03T12:57:57.356385+0000","last_active":"2021-01-03T12:58:00.833864+0000","last_peered":"2021-01-03T12:58:00.833864+0000","last_clean":"2021-01-03T12:58:00.833864+0000","last_became_active":"2021-01-03T12:57:57.355963+0000","last_became_peered":"2021-01-03T12:57:57.355963+0000","last_unstale":"2021-01-03T12:58:00.833864+0000","last_undegraded":"2021-01-03T12:58:00.833864+0000","last_fullsized":"2021-01-03T12:58:00.833864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'8","reported_seq":"18","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.864504+0000","last_change":"2021-01-03T12:58:00.502552+0000","last_active":"2021-01-03T12:58:00.864504+0000","last_peered":"2021-01-03T12:58:00.864504+0000","last_clean":"2021-01-03T12:58:00.864504+0000","last_became_active":"2021-01-03T12:58:00.502109+0000","last_became_peered":"2021-01-03T12:58:00.502109+0000","last_unstale":"2021-01-03T12:58:00.864504+0000","last_undegraded":"2021-01-03T12:58:00.864504+0000","last_fullsized":"2021-01-03T12:58:00.864504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_clean_scrub_stamp":"2021-01-03T12:57:59.466393+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.841934+0000","last_change":"2021-01-03T12:58:00.838955+0000","last_active":"2021-01-03T12:58:00.841934+0000","last_peered":"2021-01-03T12:58:00.841934+0000","last_clean":"2021-01-03T12:58:00.841934+0000","last_became_active":"2021-01-03T12:58:00.838667+0000","last_became_peered":"2021-01-03T12:58:00.838667+0000","last_unstale":"2021-01-03T12:58:00.841934+0000","last_undegraded":"2021-01-03T12:58:00.841934+0000","last_fullsized":"2021-01-03T12:58:00.841934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_clean_scrub_stamp":"2021-01-03T12:58:00.470425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"22'7","reported_seq":"17","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.856073+0000","last_change":"2021-01-03T12:58:00.501172+0000","last_active":"2021-01-03T12:58:00.856073+0000","last_peered":"2021-01-03T12:58:00.856073+0000","last_clean":"2021-01-03T12:58:00.856073+0000","last_became_active":"2021-01-03T12:58:00.500813+0000","last_became_peered":"2021-01-03T12:58:00.500813+0000","last_unstale":"2021-01-03T12:58:00.856073+0000","last_undegraded":"2021-01-03T12:58:00.856073+0000","last_fullsized":"2021-01-03T12:58:00.856073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_clean_scrub_stamp":"2021-01-03T12:57:59.466393+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.836078+0000","last_change":"2021-01-03T12:57:57.342113+0000","last_active":"2021-01-03T12:58:00.836078+0000","last_peered":"2021-01-03T12:58:00.836078+0000","last_clean":"2021-01-03T12:58:00.836078+0000","last_became_active":"2021-01-03T12:57:57.341496+0000","last_became_peered":"2021-01-03T12:57:57.341496+0000","last_unstale":"2021-01-03T12:58:00.836078+0000","last_undegraded":"2021-01-03T12:58:00.836078+0000","last_fullsized":"2021-01-03T12:58:00.836078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.852891+0000","last_change":"2021-01-03T12:58:00.851233+0000","last_active":"2021-01-03T12:58:00.852891+0000","last_peered":"2021-01-03T12:58:00.852891+0000","last_clean":"2021-01-03T12:58:00.852891+0000","last_became_active":"2021-01-03T12:58:00.850700+0000","last_became_peered":"2021-01-03T12:58:00.850700+0000","last_unstale":"2021-01-03T12:58:00.852891+0000","last_undegraded":"2021-01-03T12:58:00.852891+0000","last_fullsized":"2021-01-03T12:58:00.852891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_clean_scrub_stamp":"2021-01-03T12:58:00.470425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.838771+0000","last_change":"2021-01-03T12:57:57.346557+0000","last_active":"2021-01-03T12:58:00.838771+0000","last_peered":"2021-01-03T12:58:00.838771+0000","last_clean":"2021-01-03T12:58:00.838771+0000","last_became_active":"2021-01-03T12:57:57.346072+0000","last_became_peered":"2021-01-03T12:57:57.346072+0000","last_unstale":"2021-01-03T12:58:00.838771+0000","last_undegraded":"2021-01-03T12:58:00.838771+0000","last_fullsized":"2021-01-03T12:58:00.838771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'4","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2021-01-03T12:58:02.047732+0000","last_change":"2021-01-03T12:58:00.501283+0000","last_active":"2021-01-03T12:58:02.047732+0000","last_peered":"2021-01-03T12:58:02.047732+0000","last_clean":"2021-01-03T12:58:02.047732+0000","last_became_active":"2021-01-03T12:58:00.500869+0000","last_became_peered":"2021-01-03T12:58:00.500869+0000","last_unstale":"2021-01-03T12:58:02.047732+0000","last_undegraded":"2021-01-03T12:58:02.047732+0000","last_fullsized":"2021-01-03T12:58:02.047732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_clean_scrub_stamp":"2021-01-03T12:57:59.466393+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":88834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.867}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6319999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.21}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2839999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.645}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7559999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048816,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323024,"statfs":{"total":96636764160,"available":95562776576,"internally_reserved":1073741824,"allocated":237568,"data_stored":88259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.738}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2250000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.853}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3170000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.734}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":89794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.679}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3250000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.46}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8279999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.641}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1230000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":88293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5150000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3140000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0579999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4540000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":89794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1629999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.476}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8540000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.819}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3759999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":88994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3140000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6910000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7749999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6190000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5150000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":88293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4409999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5710000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6440000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4630000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":88419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2930000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4710000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.097}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5569999999999999}]}]}]}} 2021-01-03T12:58:10.031 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2021-01-03T12:58:10.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.131+0000 7fe3edf0c700 1 Processor -- start 2021-01-03T12:58:10.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.131+0000 7fe3edf0c700 1 -- start start 2021-01-03T12:58:10.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.131+0000 7fe3edf0c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe3e80b7ab0 0x7fe3e8064cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.131+0000 7fe3edf0c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3e80b3800 0x7fe3e8144050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.131+0000 7fe3edf0c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe3e813e040 0x7fe3e813e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.131+0000 7fe3edf0c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e80651e0 con 0x7fe3e80b7ab0 2021-01-03T12:58:10.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.131+0000 7fe3edf0c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e80acba0 con 0x7fe3e813e040 2021-01-03T12:58:10.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.131+0000 7fe3edf0c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e80b2140 con 0x7fe3e80b3800 2021-01-03T12:58:10.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3ed70b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe3e813e040 0x7fe3e813e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3ecf0a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe3e80b7ab0 0x7fe3e8064cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3ed70b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe3e813e040 0x7fe3e813e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60244/0 (socket says 172.21.15.133:60244) 2021-01-03T12:58:10.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3ed70b700 1 -- 172.21.15.133:0/2438683322 learned_addr learned my addr 172.21.15.133:0/2438683322 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:10.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3e7fff700 1 --2- 172.21.15.133:0/2438683322 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3e80b3800 0x7fe3e8144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3ed70b700 1 -- 172.21.15.133:0/2438683322 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3e80b3800 msgr2=0x7fe3e8144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:10.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3ed70b700 1 --2- 172.21.15.133:0/2438683322 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3e80b3800 0x7fe3e8144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3ed70b700 1 -- 172.21.15.133:0/2438683322 >> v2:172.21.15.16:3300/0 conn(0x7fe3e80b7ab0 msgr2=0x7fe3e8064cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:10.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3ed70b700 1 --2- 172.21.15.133:0/2438683322 >> v2:172.21.15.16:3300/0 conn(0x7fe3e80b7ab0 0x7fe3e8064cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3ed70b700 1 -- 172.21.15.133:0/2438683322 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e80b2e30 con 0x7fe3e813e040 2021-01-03T12:58:10.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3ed70b700 1 --2- 172.21.15.133:0/2438683322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3e813e040 0x7fe3e813e490 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fe3e0002f30 tx=0x7fe3e0006e80).ready entity=mon.1 client_cookie=ce28b3906baa3d3a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:10.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3e77fe700 1 -- 172.21.15.133:0/2438683322 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3e0009640 con 0x7fe3e813e040 2021-01-03T12:58:10.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3e77fe700 1 -- 172.21.15.133:0/2438683322 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e00097a0 con 0x7fe3e813e040 2021-01-03T12:58:10.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3e77fe700 1 -- 172.21.15.133:0/2438683322 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3e0009b00 con 0x7fe3e813e040 2021-01-03T12:58:10.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3edf0c700 1 -- 172.21.15.133:0/2438683322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3e813e040 msgr2=0x7fe3e813e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3edf0c700 1 --2- 172.21.15.133:0/2438683322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3e813e040 0x7fe3e813e490 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fe3e0002f30 tx=0x7fe3e0006e80).stop 2021-01-03T12:58:10.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3edf0c700 1 -- 172.21.15.133:0/2438683322 shutdown_connections 2021-01-03T12:58:10.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3edf0c700 1 --2- 172.21.15.133:0/2438683322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3e813e040 0x7fe3e813e490 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3edf0c700 1 --2- 172.21.15.133:0/2438683322 >> v2:172.21.15.16:3300/0 conn(0x7fe3e80b7ab0 0x7fe3e8064cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3edf0c700 1 --2- 172.21.15.133:0/2438683322 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3e80b3800 0x7fe3e8144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3edf0c700 1 -- 172.21.15.133:0/2438683322 >> 172.21.15.133:0/2438683322 conn(0x7fe3e805c8c0 msgr2=0x7fe3e80b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:10.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3edf0c700 1 -- 172.21.15.133:0/2438683322 shutdown_connections 2021-01-03T12:58:10.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3edf0c700 1 -- 172.21.15.133:0/2438683322 wait complete. 2021-01-03T12:58:10.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3edf0c700 1 Processor -- start 2021-01-03T12:58:10.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3edf0c700 1 -- start start 2021-01-03T12:58:10.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3edf0c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3e80b3800 0x7fe3e8067580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3edf0c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3e80b7ab0 0x7fe3e8152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3edf0c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3e813e040 0x7fe3e8150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3edf0c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e80af1d0 con 0x7fe3e80b3800 2021-01-03T12:58:10.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3edf0c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e814f9c0 con 0x7fe3e80b7ab0 2021-01-03T12:58:10.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.135+0000 7fe3edf0c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e814fc60 con 0x7fe3e813e040 2021-01-03T12:58:10.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3e7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3e80b7ab0 0x7fe3e8152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3e7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3e80b7ab0 0x7fe3e8152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60250/0 (socket says 172.21.15.133:60250) 2021-01-03T12:58:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3e7fff700 1 -- 172.21.15.133:0/1970067423 learned_addr learned my addr 172.21.15.133:0/1970067423 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3ecf0a700 1 --2- 172.21.15.133:0/1970067423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3e80b3800 0x7fe3e8067580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3ed70b700 1 --2- 172.21.15.133:0/1970067423 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3e813e040 0x7fe3e8150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3e7fff700 1 -- 172.21.15.133:0/1970067423 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3e813e040 msgr2=0x7fe3e8150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3e7fff700 1 --2- 172.21.15.133:0/1970067423 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3e813e040 0x7fe3e8150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3e7fff700 1 -- 172.21.15.133:0/1970067423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3e80b3800 msgr2=0x7fe3e8067580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3e7fff700 1 --2- 172.21.15.133:0/1970067423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3e80b3800 0x7fe3e8067580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3e7fff700 1 -- 172.21.15.133:0/1970067423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e8143c00 con 0x7fe3e80b7ab0 2021-01-03T12:58:10.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3ed70b700 1 --2- 172.21.15.133:0/1970067423 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3e813e040 0x7fe3e8150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:10.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3ecf0a700 1 --2- 172.21.15.133:0/1970067423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3e80b3800 0x7fe3e8067580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:10.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3e7fff700 1 --2- 172.21.15.133:0/1970067423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3e80b7ab0 0x7fe3e8152dd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fe3dc00c000 tx=0x7fe3dc006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:10.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3e5ffb700 1 -- 172.21.15.133:0/1970067423 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3dc00ca80 con 0x7fe3e80b7ab0 2021-01-03T12:58:10.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3e5ffb700 1 -- 172.21.15.133:0/1970067423 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc00cbe0 con 0x7fe3e80b7ab0 2021-01-03T12:58:10.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3edf0c700 1 -- 172.21.15.133:0/1970067423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e81505f0 con 0x7fe3e80b7ab0 2021-01-03T12:58:10.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3e5ffb700 1 -- 172.21.15.133:0/1970067423 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3dc0123f0 con 0x7fe3e80b7ab0 2021-01-03T12:58:10.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3edf0c700 1 -- 172.21.15.133:0/1970067423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e80aeea0 con 0x7fe3e80b7ab0 2021-01-03T12:58:10.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3edf0c700 1 -- 172.21.15.133:0/1970067423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e80af3d0 con 0x7fe3e80b7ab0 2021-01-03T12:58:10.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3e5ffb700 1 -- 172.21.15.133:0/1970067423 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe3dc012550 con 0x7fe3e80b7ab0 2021-01-03T12:58:10.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3e5ffb700 1 --2- 172.21.15.133:0/1970067423 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3c8055330 0x7fe3c80577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3e5ffb700 1 -- 172.21.15.133:0/1970067423 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe3dc06f210 con 0x7fe3e80b7ab0 2021-01-03T12:58:10.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.139+0000 7fe3ecf0a700 1 --2- 172.21.15.133:0/1970067423 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3c8055330 0x7fe3c80577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.143+0000 7fe3ecf0a700 1 --2- 172.21.15.133:0/1970067423 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3c8055330 0x7fe3c80577f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fe3d800b000 tx=0x7fe3d8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:10.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.147+0000 7fe3e5ffb700 1 -- 172.21.15.133:0/1970067423 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe3dc0454b0 con 0x7fe3e80b7ab0 2021-01-03T12:58:10.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.279+0000 7fe3edf0c700 1 -- 172.21.15.133:0/1970067423 --> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3e814f840 con 0x7fe3c8055330 2021-01-03T12:58:10.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.283+0000 7fe3e5ffb700 1 -- 172.21.15.133:0/1970067423 <== mgr.4110 v2:172.21.15.133:6800/11943 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82245 (secure 0 0 0) 0x7fe3d8009e80 con 0x7fe3c8055330 2021-01-03T12:58:10.285 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:10.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.283+0000 7fe3edf0c700 1 -- 172.21.15.133:0/1970067423 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3c8055330 msgr2=0x7fe3c80577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.283+0000 7fe3edf0c700 1 --2- 172.21.15.133:0/1970067423 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3c8055330 0x7fe3c80577f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fe3d800b000 tx=0x7fe3d8008040).stop 2021-01-03T12:58:10.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.283+0000 7fe3edf0c700 1 -- 172.21.15.133:0/1970067423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3e80b7ab0 msgr2=0x7fe3e8152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.283+0000 7fe3edf0c700 1 --2- 172.21.15.133:0/1970067423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3e80b7ab0 0x7fe3e8152dd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fe3dc00c000 tx=0x7fe3dc006dc0).stop 2021-01-03T12:58:10.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.283+0000 7fe3edf0c700 1 -- 172.21.15.133:0/1970067423 shutdown_connections 2021-01-03T12:58:10.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.283+0000 7fe3edf0c700 1 --2- 172.21.15.133:0/1970067423 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3c8055330 0x7fe3c80577f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.283+0000 7fe3edf0c700 1 --2- 172.21.15.133:0/1970067423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3e80b3800 0x7fe3e8067580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.283+0000 7fe3edf0c700 1 --2- 172.21.15.133:0/1970067423 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3e813e040 0x7fe3e8150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.283+0000 7fe3edf0c700 1 --2- 172.21.15.133:0/1970067423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3e80b7ab0 0x7fe3e8152dd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.283+0000 7fe3edf0c700 1 -- 172.21.15.133:0/1970067423 >> 172.21.15.133:0/1970067423 conn(0x7fe3e805c8c0 msgr2=0x7fe3e80b6090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:10.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.283+0000 7fe3edf0c700 1 -- 172.21.15.133:0/1970067423 shutdown_connections 2021-01-03T12:58:10.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.283+0000 7fe3edf0c700 1 -- 172.21.15.133:0/1970067423 wait complete. 2021-01-03T12:58:10.289 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2021-01-03T12:58:10.297 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2021-01-03T12:58:09.032150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390592,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584128,"statfs":{"total":773094113280,"available":764502147072,"internally_reserved":8589934592,"allocated":1966080,"data_stored":710680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.203271"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.857235+0000","last_change":"2021-01-03T12:58:00.852223+0000","last_active":"2021-01-03T12:58:00.857235+0000","last_peered":"2021-01-03T12:58:00.857235+0000","last_clean":"2021-01-03T12:58:00.857235+0000","last_became_active":"2021-01-03T12:58:00.850578+0000","last_became_peered":"2021-01-03T12:58:00.850578+0000","last_unstale":"2021-01-03T12:58:00.857235+0000","last_undegraded":"2021-01-03T12:58:00.857235+0000","last_fullsized":"2021-01-03T12:58:00.857235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_clean_scrub_stamp":"2021-01-03T12:58:00.470425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.837240+0000","last_change":"2021-01-03T12:57:57.354556+0000","last_active":"2021-01-03T12:58:00.837240+0000","last_peered":"2021-01-03T12:58:00.837240+0000","last_clean":"2021-01-03T12:58:00.837240+0000","last_became_active":"2021-01-03T12:57:57.354020+0000","last_became_peered":"2021-01-03T12:57:57.354020+0000","last_unstale":"2021-01-03T12:58:00.837240+0000","last_undegraded":"2021-01-03T12:58:00.837240+0000","last_fullsized":"2021-01-03T12:58:00.837240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'6","reported_seq":"16","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.858123+0000","last_change":"2021-01-03T12:58:00.502445+0000","last_active":"2021-01-03T12:58:00.858123+0000","last_peered":"2021-01-03T12:58:00.858123+0000","last_clean":"2021-01-03T12:58:00.858123+0000","last_became_active":"2021-01-03T12:58:00.501962+0000","last_became_peered":"2021-01-03T12:58:00.501962+0000","last_unstale":"2021-01-03T12:58:00.858123+0000","last_undegraded":"2021-01-03T12:58:00.858123+0000","last_fullsized":"2021-01-03T12:58:00.858123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_clean_scrub_stamp":"2021-01-03T12:57:59.466393+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.855685+0000","last_change":"2021-01-03T12:58:00.848508+0000","last_active":"2021-01-03T12:58:00.855685+0000","last_peered":"2021-01-03T12:58:00.855685+0000","last_clean":"2021-01-03T12:58:00.855685+0000","last_became_active":"2021-01-03T12:58:00.848156+0000","last_became_peered":"2021-01-03T12:58:00.848156+0000","last_unstale":"2021-01-03T12:58:00.855685+0000","last_undegraded":"2021-01-03T12:58:00.855685+0000","last_fullsized":"2021-01-03T12:58:00.855685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_clean_scrub_stamp":"2021-01-03T12:58:00.470425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.848008+0000","last_change":"2021-01-03T12:57:57.348550+0000","last_active":"2021-01-03T12:58:00.848008+0000","last_peered":"2021-01-03T12:58:00.848008+0000","last_clean":"2021-01-03T12:58:00.848008+0000","last_became_active":"2021-01-03T12:57:57.348011+0000","last_became_peered":"2021-01-03T12:57:57.348011+0000","last_unstale":"2021-01-03T12:58:00.848008+0000","last_undegraded":"2021-01-03T12:58:00.848008+0000","last_fullsized":"2021-01-03T12:58:00.848008+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'5","reported_seq":"15","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.858658+0000","last_change":"2021-01-03T12:58:00.498238+0000","last_active":"2021-01-03T12:58:00.858658+0000","last_peered":"2021-01-03T12:58:00.858658+0000","last_clean":"2021-01-03T12:58:00.858658+0000","last_became_active":"2021-01-03T12:58:00.497701+0000","last_became_peered":"2021-01-03T12:58:00.497701+0000","last_unstale":"2021-01-03T12:58:00.858658+0000","last_undegraded":"2021-01-03T12:58:00.858658+0000","last_fullsized":"2021-01-03T12:58:00.858658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_clean_scrub_stamp":"2021-01-03T12:57:59.466393+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.857028+0000","last_change":"2021-01-03T12:58:00.852045+0000","last_active":"2021-01-03T12:58:00.857028+0000","last_peered":"2021-01-03T12:58:00.857028+0000","last_clean":"2021-01-03T12:58:00.857028+0000","last_became_active":"2021-01-03T12:58:00.851731+0000","last_became_peered":"2021-01-03T12:58:00.851731+0000","last_unstale":"2021-01-03T12:58:00.857028+0000","last_undegraded":"2021-01-03T12:58:00.857028+0000","last_fullsized":"2021-01-03T12:58:00.857028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_clean_scrub_stamp":"2021-01-03T12:58:00.470425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.834899+0000","last_change":"2021-01-03T12:57:57.494403+0000","last_active":"2021-01-03T12:58:00.834899+0000","last_peered":"2021-01-03T12:58:00.834899+0000","last_clean":"2021-01-03T12:58:00.834899+0000","last_became_active":"2021-01-03T12:57:57.493742+0000","last_became_peered":"2021-01-03T12:57:57.493742+0000","last_unstale":"2021-01-03T12:58:00.834899+0000","last_undegraded":"2021-01-03T12:58:00.834899+0000","last_fullsized":"2021-01-03T12:58:00.834899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'8","reported_seq":"18","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.859039+0000","last_change":"2021-01-03T12:58:00.501105+0000","last_active":"2021-01-03T12:58:00.859039+0000","last_peered":"2021-01-03T12:58:00.859039+0000","last_clean":"2021-01-03T12:58:00.859039+0000","last_became_active":"2021-01-03T12:58:00.500682+0000","last_became_peered":"2021-01-03T12:58:00.500682+0000","last_unstale":"2021-01-03T12:58:00.859039+0000","last_undegraded":"2021-01-03T12:58:00.859039+0000","last_fullsized":"2021-01-03T12:58:00.859039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_clean_scrub_stamp":"2021-01-03T12:57:59.466393+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.842761+0000","last_change":"2021-01-03T12:58:00.842093+0000","last_active":"2021-01-03T12:58:00.842761+0000","last_peered":"2021-01-03T12:58:00.842761+0000","last_clean":"2021-01-03T12:58:00.842761+0000","last_became_active":"2021-01-03T12:58:00.841588+0000","last_became_peered":"2021-01-03T12:58:00.841588+0000","last_unstale":"2021-01-03T12:58:00.842761+0000","last_undegraded":"2021-01-03T12:58:00.842761+0000","last_fullsized":"2021-01-03T12:58:00.842761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_clean_scrub_stamp":"2021-01-03T12:58:00.470425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.847961+0000","last_change":"2021-01-03T12:57:57.345066+0000","last_active":"2021-01-03T12:58:00.847961+0000","last_peered":"2021-01-03T12:58:00.847961+0000","last_clean":"2021-01-03T12:58:00.847961+0000","last_became_active":"2021-01-03T12:57:57.344536+0000","last_became_peered":"2021-01-03T12:57:57.344536+0000","last_unstale":"2021-01-03T12:58:00.847961+0000","last_undegraded":"2021-01-03T12:58:00.847961+0000","last_fullsized":"2021-01-03T12:58:00.847961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"18","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.833770+0000","last_change":"2021-01-03T12:57:52.089767+0000","last_active":"2021-01-03T12:58:00.833770+0000","last_peered":"2021-01-03T12:58:00.833770+0000","last_clean":"2021-01-03T12:58:00.833770+0000","last_became_active":"2021-01-03T12:57:52.088788+0000","last_became_peered":"2021-01-03T12:57:52.088788+0000","last_unstale":"2021-01-03T12:58:00.833770+0000","last_undegraded":"2021-01-03T12:58:00.833770+0000","last_fullsized":"2021-01-03T12:58:00.833770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:48.019621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:48.019621+0000","last_clean_scrub_stamp":"2021-01-03T12:57:48.019621+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"22'1","reported_seq":"11","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.850151+0000","last_change":"2021-01-03T12:58:00.500847+0000","last_active":"2021-01-03T12:58:00.850151+0000","last_peered":"2021-01-03T12:58:00.850151+0000","last_clean":"2021-01-03T12:58:00.850151+0000","last_became_active":"2021-01-03T12:58:00.500315+0000","last_became_peered":"2021-01-03T12:58:00.500315+0000","last_unstale":"2021-01-03T12:58:00.850151+0000","last_undegraded":"2021-01-03T12:58:00.850151+0000","last_fullsized":"2021-01-03T12:58:00.850151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_clean_scrub_stamp":"2021-01-03T12:57:59.466393+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.856284+0000","last_change":"2021-01-03T12:58:00.852915+0000","last_active":"2021-01-03T12:58:00.856284+0000","last_peered":"2021-01-03T12:58:00.856284+0000","last_clean":"2021-01-03T12:58:00.856284+0000","last_became_active":"2021-01-03T12:58:00.852408+0000","last_became_peered":"2021-01-03T12:58:00.852408+0000","last_unstale":"2021-01-03T12:58:00.856284+0000","last_undegraded":"2021-01-03T12:58:00.856284+0000","last_fullsized":"2021-01-03T12:58:00.856284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_clean_scrub_stamp":"2021-01-03T12:58:00.470425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.834025+0000","last_change":"2021-01-03T12:57:57.344690+0000","last_active":"2021-01-03T12:58:00.834025+0000","last_peered":"2021-01-03T12:58:00.834025+0000","last_clean":"2021-01-03T12:58:00.834025+0000","last_became_active":"2021-01-03T12:57:57.344012+0000","last_became_peered":"2021-01-03T12:57:57.344012+0000","last_unstale":"2021-01-03T12:58:00.834025+0000","last_undegraded":"2021-01-03T12:58:00.834025+0000","last_fullsized":"2021-01-03T12:58:00.834025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.842644+0000","last_change":"2021-01-03T12:58:00.494905+0000","last_active":"2021-01-03T12:58:00.842644+0000","last_peered":"2021-01-03T12:58:00.842644+0000","last_clean":"2021-01-03T12:58:00.842644+0000","last_became_active":"2021-01-03T12:58:00.494423+0000","last_became_peered":"2021-01-03T12:58:00.494423+0000","last_unstale":"2021-01-03T12:58:00.842644+0000","last_undegraded":"2021-01-03T12:58:00.842644+0000","last_fullsized":"2021-01-03T12:58:00.842644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_clean_scrub_stamp":"2021-01-03T12:57:59.466393+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.855824+0000","last_change":"2021-01-03T12:58:00.850182+0000","last_active":"2021-01-03T12:58:00.855824+0000","last_peered":"2021-01-03T12:58:00.855824+0000","last_clean":"2021-01-03T12:58:00.855824+0000","last_became_active":"2021-01-03T12:58:00.849768+0000","last_became_peered":"2021-01-03T12:58:00.849768+0000","last_unstale":"2021-01-03T12:58:00.855824+0000","last_undegraded":"2021-01-03T12:58:00.855824+0000","last_fullsized":"2021-01-03T12:58:00.855824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_clean_scrub_stamp":"2021-01-03T12:58:00.470425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.833864+0000","last_change":"2021-01-03T12:57:57.356385+0000","last_active":"2021-01-03T12:58:00.833864+0000","last_peered":"2021-01-03T12:58:00.833864+0000","last_clean":"2021-01-03T12:58:00.833864+0000","last_became_active":"2021-01-03T12:57:57.355963+0000","last_became_peered":"2021-01-03T12:57:57.355963+0000","last_unstale":"2021-01-03T12:58:00.833864+0000","last_undegraded":"2021-01-03T12:58:00.833864+0000","last_fullsized":"2021-01-03T12:58:00.833864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'8","reported_seq":"18","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.864504+0000","last_change":"2021-01-03T12:58:00.502552+0000","last_active":"2021-01-03T12:58:00.864504+0000","last_peered":"2021-01-03T12:58:00.864504+0000","last_clean":"2021-01-03T12:58:00.864504+0000","last_became_active":"2021-01-03T12:58:00.502109+0000","last_became_peered":"2021-01-03T12:58:00.502109+0000","last_unstale":"2021-01-03T12:58:00.864504+0000","last_undegraded":"2021-01-03T12:58:00.864504+0000","last_fullsized":"2021-01-03T12:58:00.864504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_clean_scrub_stamp":"2021-01-03T12:57:59.466393+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.841934+0000","last_change":"2021-01-03T12:58:00.838955+0000","last_active":"2021-01-03T12:58:00.841934+0000","last_peered":"2021-01-03T12:58:00.841934+0000","last_clean":"2021-01-03T12:58:00.841934+0000","last_became_active":"2021-01-03T12:58:00.838667+0000","last_became_peered":"2021-01-03T12:58:00.838667+0000","last_unstale":"2021-01-03T12:58:00.841934+0000","last_undegraded":"2021-01-03T12:58:00.841934+0000","last_fullsized":"2021-01-03T12:58:00.841934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_clean_scrub_stamp":"2021-01-03T12:58:00.470425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"22'7","reported_seq":"17","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.856073+0000","last_change":"2021-01-03T12:58:00.501172+0000","last_active":"2021-01-03T12:58:00.856073+0000","last_peered":"2021-01-03T12:58:00.856073+0000","last_clean":"2021-01-03T12:58:00.856073+0000","last_became_active":"2021-01-03T12:58:00.500813+0000","last_became_peered":"2021-01-03T12:58:00.500813+0000","last_unstale":"2021-01-03T12:58:00.856073+0000","last_undegraded":"2021-01-03T12:58:00.856073+0000","last_fullsized":"2021-01-03T12:58:00.856073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_clean_scrub_stamp":"2021-01-03T12:57:59.466393+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.836078+0000","last_change":"2021-01-03T12:57:57.342113+0000","last_active":"2021-01-03T12:58:00.836078+0000","last_peered":"2021-01-03T12:58:00.836078+0000","last_clean":"2021-01-03T12:58:00.836078+0000","last_became_active":"2021-01-03T12:57:57.341496+0000","last_became_peered":"2021-01-03T12:57:57.341496+0000","last_unstale":"2021-01-03T12:58:00.836078+0000","last_undegraded":"2021-01-03T12:58:00.836078+0000","last_fullsized":"2021-01-03T12:58:00.836078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"9","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.852891+0000","last_change":"2021-01-03T12:58:00.851233+0000","last_active":"2021-01-03T12:58:00.852891+0000","last_peered":"2021-01-03T12:58:00.852891+0000","last_clean":"2021-01-03T12:58:00.852891+0000","last_became_active":"2021-01-03T12:58:00.850700+0000","last_became_peered":"2021-01-03T12:58:00.850700+0000","last_unstale":"2021-01-03T12:58:00.852891+0000","last_undegraded":"2021-01-03T12:58:00.852891+0000","last_fullsized":"2021-01-03T12:58:00.852891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:58:00.470425+0000","last_clean_scrub_stamp":"2021-01-03T12:58:00.470425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"13","reported_epoch":"22","state":"active+clean","last_fresh":"2021-01-03T12:58:00.838771+0000","last_change":"2021-01-03T12:57:57.346557+0000","last_active":"2021-01-03T12:58:00.838771+0000","last_peered":"2021-01-03T12:58:00.838771+0000","last_clean":"2021-01-03T12:58:00.838771+0000","last_became_active":"2021-01-03T12:57:57.346072+0000","last_became_peered":"2021-01-03T12:57:57.346072+0000","last_unstale":"2021-01-03T12:58:00.838771+0000","last_undegraded":"2021-01-03T12:58:00.838771+0000","last_fullsized":"2021-01-03T12:58:00.838771+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'4","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2021-01-03T12:58:02.047732+0000","last_change":"2021-01-03T12:58:00.501283+0000","last_active":"2021-01-03T12:58:02.047732+0000","last_peered":"2021-01-03T12:58:02.047732+0000","last_clean":"2021-01-03T12:58:02.047732+0000","last_became_active":"2021-01-03T12:58:00.500869+0000","last_became_peered":"2021-01-03T12:58:00.500869+0000","last_unstale":"2021-01-03T12:58:02.047732+0000","last_undegraded":"2021-01-03T12:58:02.047732+0000","last_fullsized":"2021-01-03T12:58:02.047732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:59.466393+0000","last_clean_scrub_stamp":"2021-01-03T12:57:59.466393+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":88834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.786}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.867}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6319999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.21}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2839999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.645}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7559999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048816,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323024,"statfs":{"total":96636764160,"available":95562776576,"internally_reserved":1073741824,"allocated":237568,"data_stored":88259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.738}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2250000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.853}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3170000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.734}]}]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":89794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.679}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3250000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.46}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8279999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.641}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1230000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":88293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4219999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5150000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3140000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0579999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4540000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048828,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323012,"statfs":{"total":96636764160,"available":95562764288,"internally_reserved":1073741824,"allocated":249856,"data_stored":89794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1629999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.476}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8540000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.819}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3759999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":88994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3140000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6910000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7749999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6190000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5150000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":88293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4409999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5710000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6440000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4630000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":88419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2930000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4710000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.097}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5569999999999999}]}]}]}} 2021-01-03T12:58:10.300 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-01-03T12:58:10.300 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-01-03T12:58:10.300 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2021-01-03T12:58:10.301 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2021-01-03T12:58:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca216be700 1 Processor -- start 2021-01-03T12:58:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca216be700 1 -- start start 2021-01-03T12:58:10.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca216be700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fca1c067350 0x7fca1c05fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca216be700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca1c0b2750 0x7fca1c144260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca216be700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca1c0afe70 con 0x7fca1c066f70 2021-01-03T12:58:10.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca216be700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1c060310 con 0x7fca1c067350 2021-01-03T12:58:10.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca216be700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1c0605a0 con 0x7fca1c0b2750 2021-01-03T12:58:10.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca20ebd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca1c0b2750 0x7fca1c144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca20ebd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca1c0b2750 0x7fca1c144260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60260/0 (socket says 172.21.15.133:60260) 2021-01-03T12:58:10.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca20ebd700 1 -- 172.21.15.133:0/556334736 learned_addr learned my addr 172.21.15.133:0/556334736 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:10.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca1b7fe700 1 --2- 172.21.15.133:0/556334736 >> v2:172.21.15.16:3300/0 conn(0x7fca1c067350 0x7fca1c05fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca1affd700 1 -- 172.21.15.133:0/556334736 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524281903 0 0) 0x7fca1c0afe70 con 0x7fca1c066f70 2021-01-03T12:58:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca1affd700 1 -- 172.21.15.133:0/556334736 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca08003230 con 0x7fca1c066f70 2021-01-03T12:58:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca20ebd700 1 -- 172.21.15.133:0/556334736 >> v2:172.21.15.16:3300/0 conn(0x7fca1c067350 msgr2=0x7fca1c05fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca20ebd700 1 --2- 172.21.15.133:0/556334736 >> v2:172.21.15.16:3300/0 conn(0x7fca1c067350 0x7fca1c05fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca20ebd700 1 -- 172.21.15.133:0/556334736 >> v1:172.21.15.16:6789/0 conn(0x7fca1c066f70 legacy=0x7fca1c0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca20ebd700 1 -- 172.21.15.133:0/556334736 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1c0b0b50 con 0x7fca1c0b2750 2021-01-03T12:58:10.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.411+0000 7fca20ebd700 1 --2- 172.21.15.133:0/556334736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca1c0b2750 0x7fca1c144260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fca14002f30 tx=0x7fca14006e80).ready entity=mon.1 client_cookie=22c9db3cd989fbf8 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:10.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.415+0000 7fca1affd700 1 -- 172.21.15.133:0/556334736 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca14009640 con 0x7fca1c0b2750 2021-01-03T12:58:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.415+0000 7fca1affd700 1 -- 172.21.15.133:0/556334736 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca140097a0 con 0x7fca1c0b2750 2021-01-03T12:58:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.415+0000 7fca1affd700 1 -- 172.21.15.133:0/556334736 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca14009b00 con 0x7fca1c0b2750 2021-01-03T12:58:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.415+0000 7fca216be700 1 -- 172.21.15.133:0/556334736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca1c0b2750 msgr2=0x7fca1c144260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.415+0000 7fca216be700 1 --2- 172.21.15.133:0/556334736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca1c0b2750 0x7fca1c144260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fca14002f30 tx=0x7fca14006e80).stop 2021-01-03T12:58:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.415+0000 7fca216be700 1 -- 172.21.15.133:0/556334736 shutdown_connections 2021-01-03T12:58:10.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.415+0000 7fca216be700 1 --2- 172.21.15.133:0/556334736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca1c0b2750 0x7fca1c144260 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.415+0000 7fca216be700 1 --2- 172.21.15.133:0/556334736 >> v2:172.21.15.16:3300/0 conn(0x7fca1c067350 0x7fca1c05fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.415+0000 7fca216be700 1 -- 172.21.15.133:0/556334736 >> 172.21.15.133:0/556334736 conn(0x7fca1c0b6110 msgr2=0x7fca1c0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:10.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.415+0000 7fca216be700 1 -- 172.21.15.133:0/556334736 shutdown_connections 2021-01-03T12:58:10.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.415+0000 7fca216be700 1 -- 172.21.15.133:0/556334736 wait complete. 2021-01-03T12:58:10.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.415+0000 7fca216be700 1 Processor -- start 2021-01-03T12:58:10.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.415+0000 7fca216be700 1 -- start start 2021-01-03T12:58:10.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca216be700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca1c066f70 0x7fca1c0654e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca216be700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca1c067350 0x7fca1c140620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca216be700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fca1c0b2750 0x7fca1c0649a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca216be700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c145c10 con 0x7fca1c067350 2021-01-03T12:58:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca216be700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c066280 con 0x7fca1c066f70 2021-01-03T12:58:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca216be700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c13ddc0 con 0x7fca1c0b2750 2021-01-03T12:58:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca1bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca1c066f70 0x7fca1c0654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca1bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca1c066f70 0x7fca1c0654e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60262/0 (socket says 172.21.15.133:60262) 2021-01-03T12:58:10.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca1bfff700 1 -- 172.21.15.133:0/3528575162 learned_addr learned my addr 172.21.15.133:0/3528575162 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:10.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca20ebd700 1 --2- 172.21.15.133:0/3528575162 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fca1c0b2750 0x7fca1c0649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca1b7fe700 1 --2- 172.21.15.133:0/3528575162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca1c067350 0x7fca1c140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca1bfff700 1 -- 172.21.15.133:0/3528575162 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fca1c0b2750 msgr2=0x7fca1c0649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca1bfff700 1 --2- 172.21.15.133:0/3528575162 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fca1c0b2750 0x7fca1c0649a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca1bfff700 1 -- 172.21.15.133:0/3528575162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca1c067350 msgr2=0x7fca1c140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca1bfff700 1 --2- 172.21.15.133:0/3528575162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca1c067350 0x7fca1c140620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca1bfff700 1 -- 172.21.15.133:0/3528575162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1c13db20 con 0x7fca1c066f70 2021-01-03T12:58:10.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca1bfff700 1 --2- 172.21.15.133:0/3528575162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca1c066f70 0x7fca1c0654e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fca0c001450 tx=0x7fca0c007de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:10.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca197fa700 1 -- 172.21.15.133:0/3528575162 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca0c002240 con 0x7fca1c066f70 2021-01-03T12:58:10.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca197fa700 1 -- 172.21.15.133:0/3528575162 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0c0023a0 con 0x7fca1c066f70 2021-01-03T12:58:10.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca197fa700 1 -- 172.21.15.133:0/3528575162 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca0c001800 con 0x7fca1c066f70 2021-01-03T12:58:10.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca216be700 1 -- 172.21.15.133:0/3528575162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1c140b10 con 0x7fca1c066f70 2021-01-03T12:58:10.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca216be700 1 -- 172.21.15.133:0/3528575162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1c141080 con 0x7fca1c066f70 2021-01-03T12:58:10.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.419+0000 7fca216be700 1 -- 172.21.15.133:0/3528575162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca1c065350 con 0x7fca1c066f70 2021-01-03T12:58:10.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.423+0000 7fca197fa700 1 -- 172.21.15.133:0/3528575162 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fca0c019030 con 0x7fca1c066f70 2021-01-03T12:58:10.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.423+0000 7fca197fa700 1 --2- 172.21.15.133:0/3528575162 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9fc0554e0 0x7fc9fc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.423+0000 7fca197fa700 1 -- 172.21.15.133:0/3528575162 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fca0c06d6e0 con 0x7fca1c066f70 2021-01-03T12:58:10.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.423+0000 7fca1b7fe700 1 --2- 172.21.15.133:0/3528575162 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9fc0554e0 0x7fc9fc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.423+0000 7fca1b7fe700 1 --2- 172.21.15.133:0/3528575162 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9fc0554e0 0x7fc9fc0579a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fca1000b000 tx=0x7fca10006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:10.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.427+0000 7fca197fa700 1 -- 172.21.15.133:0/3528575162 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fca0c043980 con 0x7fca1c066f70 2021-01-03T12:58:10.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.615+0000 7fca216be700 1 -- 172.21.15.133:0/3528575162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fca1c057300 con 0x7fca1c066f70 2021-01-03T12:58:10.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.619+0000 7fca197fa700 1 -- 172.21.15.133:0/3528575162 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fca0c046fa0 con 0x7fca1c066f70 2021-01-03T12:58:10.620 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:10.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.619+0000 7fca216be700 1 -- 172.21.15.133:0/3528575162 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9fc0554e0 msgr2=0x7fc9fc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.619+0000 7fca216be700 1 --2- 172.21.15.133:0/3528575162 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9fc0554e0 0x7fc9fc0579a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fca1000b000 tx=0x7fca10006dc0).stop 2021-01-03T12:58:10.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.619+0000 7fca216be700 1 -- 172.21.15.133:0/3528575162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca1c066f70 msgr2=0x7fca1c0654e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.619+0000 7fca216be700 1 --2- 172.21.15.133:0/3528575162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca1c066f70 0x7fca1c0654e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fca0c001450 tx=0x7fca0c007de0).stop 2021-01-03T12:58:10.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.619+0000 7fca216be700 1 -- 172.21.15.133:0/3528575162 shutdown_connections 2021-01-03T12:58:10.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.619+0000 7fca216be700 1 --2- 172.21.15.133:0/3528575162 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9fc0554e0 0x7fc9fc0579a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.619+0000 7fca216be700 1 --2- 172.21.15.133:0/3528575162 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fca1c0b2750 0x7fca1c0649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.619+0000 7fca216be700 1 --2- 172.21.15.133:0/3528575162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca1c066f70 0x7fca1c0654e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.619+0000 7fca216be700 1 --2- 172.21.15.133:0/3528575162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca1c067350 0x7fca1c140620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.619+0000 7fca216be700 1 -- 172.21.15.133:0/3528575162 >> 172.21.15.133:0/3528575162 conn(0x7fca1c0b6110 msgr2=0x7fca1c0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:10.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.619+0000 7fca216be700 1 -- 172.21.15.133:0/3528575162 shutdown_connections 2021-01-03T12:58:10.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.619+0000 7fca216be700 1 -- 172.21.15.133:0/3528575162 wait complete. 2021-01-03T12:58:10.637 INFO:teuthology.orchestra.run.smithi133.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-01-03T12:58:10.637 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2021-01-03T12:58:10.638 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:10.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff92acb1700 1 Processor -- start 2021-01-03T12:58:10.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff92acb1700 1 -- start start 2021-01-03T12:58:10.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff92acb1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9240b0670 0x7ff9240aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff92acb1700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff924098550 con 0x7ff92414aee0 2021-01-03T12:58:10.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff92acb1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9240b5ff0 con 0x7ff9240b5c10 2021-01-03T12:58:10.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff92acb1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9240b0b10 con 0x7ff9240b0670 2021-01-03T12:58:10.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff91bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9240b0670 0x7ff9240aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff91bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9240b0670 0x7ff9240aae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60270/0 (socket says 172.21.15.133:60270) 2021-01-03T12:58:10.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff928a4d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff9240b5c10 0x7ff92414a7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53074/0 (socket says 172.21.15.133:53074) 2021-01-03T12:58:10.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff91bfff700 1 -- 172.21.15.133:0/3560644340 learned_addr learned my addr 172.21.15.133:0/3560644340 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:10.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff91bfff700 1 -- 172.21.15.133:0/3560644340 >> v1:172.21.15.133:6789/0 conn(0x7ff9240b5c10 legacy=0x7ff92414a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff91bfff700 1 -- 172.21.15.133:0/3560644340 >> v1:172.21.15.16:6789/0 conn(0x7ff92414aee0 legacy=0x7ff924144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff91bfff700 1 -- 172.21.15.133:0/3560644340 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff924098780 con 0x7ff9240b0670 2021-01-03T12:58:10.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff91bfff700 1 --2- 172.21.15.133:0/3560644340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9240b0670 0x7ff9240aae70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ff920002f30 tx=0x7ff920006e80).ready entity=mon.1 client_cookie=e0456d31daf59cfd server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:10.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff91b7fe700 1 -- 172.21.15.133:0/3560644340 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9200097f0 con 0x7ff9240b0670 2021-01-03T12:58:10.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff91b7fe700 1 -- 172.21.15.133:0/3560644340 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff920009950 con 0x7ff9240b0670 2021-01-03T12:58:10.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff91b7fe700 1 -- 172.21.15.133:0/3560644340 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff920009cb0 con 0x7ff9240b0670 2021-01-03T12:58:10.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff92acb1700 1 -- 172.21.15.133:0/3560644340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9240b0670 msgr2=0x7ff9240aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.747+0000 7ff92acb1700 1 --2- 172.21.15.133:0/3560644340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9240b0670 0x7ff9240aae70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ff920002f30 tx=0x7ff920006e80).stop 2021-01-03T12:58:10.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff92acb1700 1 -- 172.21.15.133:0/3560644340 shutdown_connections 2021-01-03T12:58:10.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff92acb1700 1 --2- 172.21.15.133:0/3560644340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9240b0670 0x7ff9240aae70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff92acb1700 1 -- 172.21.15.133:0/3560644340 >> 172.21.15.133:0/3560644340 conn(0x7ff92405c8c0 msgr2=0x7ff9240b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:10.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff92acb1700 1 -- 172.21.15.133:0/3560644340 shutdown_connections 2021-01-03T12:58:10.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff92acb1700 1 -- 172.21.15.133:0/3560644340 wait complete. 2021-01-03T12:58:10.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff92acb1700 1 Processor -- start 2021-01-03T12:58:10.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff92acb1700 1 -- start start 2021-01-03T12:58:10.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff92acb1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9240b0670 0x7ff924156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff92acb1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff9240b5c10 0x7ff924147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff92acb1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff92414aee0 0x7ff924140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff92acb1700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9241570d0 con 0x7ff92414aee0 2021-01-03T12:58:10.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff92acb1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9241490a0 con 0x7ff9240b0670 2021-01-03T12:58:10.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff92acb1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff924149340 con 0x7ff9240b5c10 2021-01-03T12:58:10.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff928a4d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9240b0670 0x7ff924156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff928a4d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9240b0670 0x7ff924156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60280/0 (socket says 172.21.15.133:60280) 2021-01-03T12:58:10.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff928a4d700 1 -- 172.21.15.133:0/3180005547 learned_addr learned my addr 172.21.15.133:0/3180005547 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:10.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff92924e700 1 --2- 172.21.15.133:0/3180005547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff92414aee0 0x7ff924140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff91bfff700 1 --2- 172.21.15.133:0/3180005547 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff9240b5c10 0x7ff924147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff928a4d700 1 -- 172.21.15.133:0/3180005547 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff9240b5c10 msgr2=0x7ff924147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff928a4d700 1 --2- 172.21.15.133:0/3180005547 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff9240b5c10 0x7ff924147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff928a4d700 1 -- 172.21.15.133:0/3180005547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff92414aee0 msgr2=0x7ff924140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff928a4d700 1 --2- 172.21.15.133:0/3180005547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff92414aee0 0x7ff924140040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff928a4d700 1 -- 172.21.15.133:0/3180005547 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff924142cc0 con 0x7ff9240b0670 2021-01-03T12:58:10.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff928a4d700 1 --2- 172.21.15.133:0/3180005547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9240b0670 0x7ff924156be0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7ff9240b0450 tx=0x7ff914007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:10.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff919ffb700 1 -- 172.21.15.133:0/3180005547 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9140073b0 con 0x7ff9240b0670 2021-01-03T12:58:10.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff919ffb700 1 -- 172.21.15.133:0/3180005547 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff914005520 con 0x7ff9240b0670 2021-01-03T12:58:10.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff919ffb700 1 -- 172.21.15.133:0/3180005547 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff914005880 con 0x7ff9240b0670 2021-01-03T12:58:10.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.751+0000 7ff92acb1700 1 -- 172.21.15.133:0/3180005547 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9241495e0 con 0x7ff9240b0670 2021-01-03T12:58:10.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.755+0000 7ff92acb1700 1 -- 172.21.15.133:0/3180005547 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff924147b80 con 0x7ff9240b0670 2021-01-03T12:58:10.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.755+0000 7ff919ffb700 1 -- 172.21.15.133:0/3180005547 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff914010070 con 0x7ff9240b0670 2021-01-03T12:58:10.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.755+0000 7ff92acb1700 1 -- 172.21.15.133:0/3180005547 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff924057300 con 0x7ff9240b0670 2021-01-03T12:58:10.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.755+0000 7ff919ffb700 1 --2- 172.21.15.133:0/3180005547 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff904055440 0x7ff904057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:10.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.755+0000 7ff919ffb700 1 -- 172.21.15.133:0/3180005547 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff91406d550 con 0x7ff9240b0670 2021-01-03T12:58:10.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.755+0000 7ff91bfff700 1 --2- 172.21.15.133:0/3180005547 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff904055440 0x7ff904057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:10.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.755+0000 7ff91bfff700 1 --2- 172.21.15.133:0/3180005547 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff904055440 0x7ff904057900 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ff92001c000 tx=0x7ff920015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:10.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.763+0000 7ff919ffb700 1 -- 172.21.15.133:0/3180005547 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff914043850 con 0x7ff9240b0670 2021-01-03T12:58:10.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.903+0000 7ff92acb1700 1 -- 172.21.15.133:0/3180005547 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff92405ce00 con 0x7ff9240b0670 2021-01-03T12:58:10.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.907+0000 7ff919ffb700 1 -- 172.21.15.133:0/3180005547 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7ff914018070 con 0x7ff9240b0670 2021-01-03T12:58:10.908 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:10.908 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":23,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:01.829379+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:57:58.934952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-03T12:57:59.830134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:10.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.907+0000 7ff92acb1700 1 -- 172.21.15.133:0/3180005547 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff904055440 msgr2=0x7ff904057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.907+0000 7ff92acb1700 1 --2- 172.21.15.133:0/3180005547 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff904055440 0x7ff904057900 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ff92001c000 tx=0x7ff920015000).stop 2021-01-03T12:58:10.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.907+0000 7ff92acb1700 1 -- 172.21.15.133:0/3180005547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9240b0670 msgr2=0x7ff924156be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:10.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.907+0000 7ff92acb1700 1 --2- 172.21.15.133:0/3180005547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9240b0670 0x7ff924156be0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7ff9240b0450 tx=0x7ff914007c10).stop 2021-01-03T12:58:10.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.907+0000 7ff92acb1700 1 -- 172.21.15.133:0/3180005547 shutdown_connections 2021-01-03T12:58:10.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.907+0000 7ff92acb1700 1 --2- 172.21.15.133:0/3180005547 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff904055440 0x7ff904057900 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.907+0000 7ff92acb1700 1 --2- 172.21.15.133:0/3180005547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff92414aee0 0x7ff924140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.907+0000 7ff92acb1700 1 --2- 172.21.15.133:0/3180005547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9240b0670 0x7ff924156be0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.907+0000 7ff92acb1700 1 --2- 172.21.15.133:0/3180005547 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff9240b5c10 0x7ff924147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:10.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.907+0000 7ff92acb1700 1 -- 172.21.15.133:0/3180005547 >> 172.21.15.133:0/3180005547 conn(0x7ff92405c8c0 msgr2=0x7ff9240b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:10.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.907+0000 7ff92acb1700 1 -- 172.21.15.133:0/3180005547 shutdown_connections 2021-01-03T12:58:10.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:10.907+0000 7ff92acb1700 1 -- 172.21.15.133:0/3180005547 wait complete. 2021-01-03T12:58:10.921 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T12:57:58.934952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T12:57:59.830134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T12:58:10.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T12:58:11.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6396e88700 1 Processor -- start 2021-01-03T12:58:11.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6396e88700 1 -- start start 2021-01-03T12:58:11.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6396e88700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6390060510 0x7f639005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6396e88700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f639005fd10 0x7f63900b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6396e88700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f639005bf00 con 0x7f63900b4c20 2021-01-03T12:58:11.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6396e88700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639005c1a0 con 0x7f6390060510 2021-01-03T12:58:11.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6396e88700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639005c440 con 0x7f639005fd10 2021-01-03T12:58:11.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6396687700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f639005fd10 0x7f63900b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6395e86700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f63900b4c20 0x7f63900b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53086/0 (socket says 172.21.15.133:53086) 2021-01-03T12:58:11.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6395e86700 1 -- 172.21.15.133:0/1492807720 learned_addr learned my addr 172.21.15.133:0/1492807720 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:11.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6395685700 1 --2- 172.21.15.133:0/1492807720 >> v2:172.21.15.16:3300/0 conn(0x7f6390060510 0x7f639005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6396687700 1 -- 172.21.15.133:0/1492807720 >> v2:172.21.15.16:3300/0 conn(0x7f6390060510 msgr2=0x7f639005c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:11.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6396687700 1 --2- 172.21.15.133:0/1492807720 >> v2:172.21.15.16:3300/0 conn(0x7f6390060510 0x7f639005c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6396687700 1 -- 172.21.15.133:0/1492807720 >> v1:172.21.15.133:6789/0 conn(0x7f63900b4c20 legacy=0x7f63900b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6394e84700 1 -- 172.21.15.133:0/1492807720 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756033756 0 0) 0x7f639005bf00 con 0x7f63900b4c20 2021-01-03T12:58:11.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6396687700 1 -- 172.21.15.133:0/1492807720 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63900b6ad0 con 0x7f639005fd10 2021-01-03T12:58:11.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6395685700 1 --2- 172.21.15.133:0/1492807720 >> v2:172.21.15.16:3300/0 conn(0x7f6390060510 0x7f639005c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:11.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6396687700 1 --2- 172.21.15.133:0/1492807720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f639005fd10 0x7f63900b65e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f63880032b0 tx=0x7f63880091a0).ready entity=mon.1 client_cookie=ce56d59094661169 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:11.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6394e84700 1 -- 172.21.15.133:0/1492807720 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f638800ba50 con 0x7f639005fd10 2021-01-03T12:58:11.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6394e84700 1 -- 172.21.15.133:0/1492807720 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638800bbb0 con 0x7f639005fd10 2021-01-03T12:58:11.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6394e84700 1 -- 172.21.15.133:0/1492807720 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f638800bd20 con 0x7f639005fd10 2021-01-03T12:58:11.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6396e88700 1 -- 172.21.15.133:0/1492807720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f639005fd10 msgr2=0x7f63900b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.039+0000 7f6396e88700 1 --2- 172.21.15.133:0/1492807720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f639005fd10 0x7f63900b65e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f63880032b0 tx=0x7f63880091a0).stop 2021-01-03T12:58:11.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.043+0000 7f6396e88700 1 -- 172.21.15.133:0/1492807720 shutdown_connections 2021-01-03T12:58:11.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.043+0000 7f6396e88700 1 --2- 172.21.15.133:0/1492807720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f639005fd10 0x7f63900b65e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.043+0000 7f6396e88700 1 --2- 172.21.15.133:0/1492807720 >> v2:172.21.15.16:3300/0 conn(0x7f6390060510 0x7f639005c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.043+0000 7f6396e88700 1 -- 172.21.15.133:0/1492807720 >> 172.21.15.133:0/1492807720 conn(0x7f63900b9f00 msgr2=0x7f63900b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:11.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.043+0000 7f6396e88700 1 -- 172.21.15.133:0/1492807720 shutdown_connections 2021-01-03T12:58:11.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.043+0000 7f6396e88700 1 -- 172.21.15.133:0/1492807720 wait complete. 2021-01-03T12:58:11.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.043+0000 7f6396e88700 1 Processor -- start 2021-01-03T12:58:11.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.043+0000 7f6396e88700 1 -- start start 2021-01-03T12:58:11.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6396e88700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f639005fd10 0x7f639009d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6396e88700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6390060510 0x7f639013c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6396e88700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b4c20 0x7f639013c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6396e88700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6390155e70 con 0x7f6390060510 2021-01-03T12:58:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6396e88700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63901559a0 con 0x7f63900b4c20 2021-01-03T12:58:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6396e88700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6390151950 con 0x7f639005fd10 2021-01-03T12:58:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6396687700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b4c20 0x7f639013c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6396687700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b4c20 0x7f639013c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60294/0 (socket says 172.21.15.133:60294) 2021-01-03T12:58:11.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6396687700 1 -- 172.21.15.133:0/3580624988 learned_addr learned my addr 172.21.15.133:0/3580624988 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:11.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6395685700 1 --2- 172.21.15.133:0/3580624988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6390060510 0x7f639013c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6395e86700 1 --2- 172.21.15.133:0/3580624988 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f639005fd10 0x7f639009d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6396687700 1 -- 172.21.15.133:0/3580624988 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f639005fd10 msgr2=0x7f639009d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6396687700 1 --2- 172.21.15.133:0/3580624988 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f639005fd10 0x7f639009d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6396687700 1 -- 172.21.15.133:0/3580624988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6390060510 msgr2=0x7f639013c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6396687700 1 --2- 172.21.15.133:0/3580624988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6390060510 0x7f639013c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6396687700 1 -- 172.21.15.133:0/3580624988 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6390141a00 con 0x7f63900b4c20 2021-01-03T12:58:11.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6396687700 1 --2- 172.21.15.133:0/3580624988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b4c20 0x7f639013c9f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f6390155fb0 tx=0x7f6388016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:11.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6382ffd700 1 -- 172.21.15.133:0/3580624988 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f638801f5e0 con 0x7f63900b4c20 2021-01-03T12:58:11.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6382ffd700 1 -- 172.21.15.133:0/3580624988 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638801f740 con 0x7f63900b4c20 2021-01-03T12:58:11.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6382ffd700 1 -- 172.21.15.133:0/3580624988 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f638801faa0 con 0x7f63900b4c20 2021-01-03T12:58:11.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6396e88700 1 -- 172.21.15.133:0/3580624988 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63901413a0 con 0x7f63900b4c20 2021-01-03T12:58:11.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.047+0000 7f6396e88700 1 -- 172.21.15.133:0/3580624988 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639013cee0 con 0x7f63900b4c20 2021-01-03T12:58:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.051+0000 7f6396e88700 1 -- 172.21.15.133:0/3580624988 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6390151a90 con 0x7f63900b4c20 2021-01-03T12:58:11.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.051+0000 7f6382ffd700 1 -- 172.21.15.133:0/3580624988 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6388026030 con 0x7f63900b4c20 2021-01-03T12:58:11.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.051+0000 7f6382ffd700 1 --2- 172.21.15.133:0/3580624988 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63700554e0 0x7f63700579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.051+0000 7f6382ffd700 1 -- 172.21.15.133:0/3580624988 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f638806f100 con 0x7f63900b4c20 2021-01-03T12:58:11.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.051+0000 7f6395e86700 1 --2- 172.21.15.133:0/3580624988 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63700554e0 0x7f63700579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.051+0000 7f6395e86700 1 --2- 172.21.15.133:0/3580624988 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63700554e0 0x7f63700579a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f638400d000 tx=0x7f6384007bf0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:11.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.055+0000 7f6382ffd700 1 -- 172.21.15.133:0/3580624988 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6388045440 con 0x7f63900b4c20 2021-01-03T12:58:11.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.195+0000 7f6396e88700 1 -- 172.21.15.133:0/3580624988 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6390057300 con 0x7f63900b4c20 2021-01-03T12:58:11.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.195+0000 7f6382ffd700 1 -- 172.21.15.133:0/3580624988 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6388024020 con 0x7f63900b4c20 2021-01-03T12:58:11.198 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T12:58:11.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.199+0000 7f6396e88700 1 -- 172.21.15.133:0/3580624988 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63700554e0 msgr2=0x7f63700579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.199+0000 7f6396e88700 1 --2- 172.21.15.133:0/3580624988 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63700554e0 0x7f63700579a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f638400d000 tx=0x7f6384007bf0).stop 2021-01-03T12:58:11.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.199+0000 7f6396e88700 1 -- 172.21.15.133:0/3580624988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b4c20 msgr2=0x7f639013c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.199+0000 7f6396e88700 1 --2- 172.21.15.133:0/3580624988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b4c20 0x7f639013c9f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f6390155fb0 tx=0x7f6388016000).stop 2021-01-03T12:58:11.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.199+0000 7f6396e88700 1 -- 172.21.15.133:0/3580624988 shutdown_connections 2021-01-03T12:58:11.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.199+0000 7f6396e88700 1 --2- 172.21.15.133:0/3580624988 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63700554e0 0x7f63700579a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.199+0000 7f6396e88700 1 --2- 172.21.15.133:0/3580624988 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b4c20 0x7f639013c9f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.199+0000 7f6396e88700 1 --2- 172.21.15.133:0/3580624988 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f639005fd10 0x7f639009d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.199+0000 7f6396e88700 1 --2- 172.21.15.133:0/3580624988 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6390060510 0x7f639013c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.199+0000 7f6396e88700 1 -- 172.21.15.133:0/3580624988 >> 172.21.15.133:0/3580624988 conn(0x7f63900b9f00 msgr2=0x7f63900b7030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:11.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.199+0000 7f6396e88700 1 -- 172.21.15.133:0/3580624988 shutdown_connections 2021-01-03T12:58:11.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.199+0000 7f6396e88700 1 -- 172.21.15.133:0/3580624988 wait complete. 2021-01-03T12:58:11.212 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T12:58:11.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.319+0000 7f0a9c884700 1 Processor -- start 2021-01-03T12:58:11.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.319+0000 7f0a9c884700 1 -- start start 2021-01-03T12:58:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.319+0000 7f0a9c884700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a980b5260 0x7f0a981470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.319+0000 7f0a9c884700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0a980b5c00 0x7f0a981475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.319+0000 7f0a9c884700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a980b0c10 con 0x7f0a981442a0 2021-01-03T12:58:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.319+0000 7f0a9c884700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a98144e00 con 0x7f0a980b5c00 2021-01-03T12:58:11.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.319+0000 7f0a9c884700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a980b5640 con 0x7f0a980b5260 2021-01-03T12:58:11.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.319+0000 7f0a977fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a980b5260 0x7f0a981470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.319+0000 7f0a977fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a980b5260 0x7f0a981470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60302/0 (socket says 172.21.15.133:60302) 2021-01-03T12:58:11.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.319+0000 7f0a977fe700 1 -- 172.21.15.133:0/1995673648 learned_addr learned my addr 172.21.15.133:0/1995673648 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:11.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.319+0000 7f0a96ffd700 1 --2- 172.21.15.133:0/1995673648 >> v2:172.21.15.16:3300/0 conn(0x7f0a980b5c00 0x7f0a981475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.319+0000 7f0a977fe700 1 -- 172.21.15.133:0/1995673648 >> v2:172.21.15.16:3300/0 conn(0x7f0a980b5c00 msgr2=0x7f0a981475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:11.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.319+0000 7f0a977fe700 1 --2- 172.21.15.133:0/1995673648 >> v2:172.21.15.16:3300/0 conn(0x7f0a980b5c00 0x7f0a981475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.319+0000 7f0a977fe700 1 -- 172.21.15.133:0/1995673648 >> v1:172.21.15.16:6789/0 conn(0x7f0a981442a0 legacy=0x7f0a981446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.319+0000 7f0a977fe700 1 -- 172.21.15.133:0/1995673648 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9809a4f0 con 0x7f0a980b5260 2021-01-03T12:58:11.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.319+0000 7f0a977fe700 1 --2- 172.21.15.133:0/1995673648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a980b5260 0x7f0a981470b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f0a900032b0 tx=0x7f0a90009270).ready entity=mon.1 client_cookie=334382f4dd87f1b4 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:11.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.319+0000 7f0a967fc700 1 -- 172.21.15.133:0/1995673648 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a90009e60 con 0x7f0a980b5260 2021-01-03T12:58:11.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a967fc700 1 -- 172.21.15.133:0/1995673648 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9000bc00 con 0x7f0a980b5260 2021-01-03T12:58:11.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a967fc700 1 -- 172.21.15.133:0/1995673648 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a9000bd70 con 0x7f0a980b5260 2021-01-03T12:58:11.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a9c884700 1 -- 172.21.15.133:0/1995673648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a980b5260 msgr2=0x7f0a981470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a9c884700 1 --2- 172.21.15.133:0/1995673648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a980b5260 0x7f0a981470b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f0a900032b0 tx=0x7f0a90009270).stop 2021-01-03T12:58:11.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a9c884700 1 -- 172.21.15.133:0/1995673648 shutdown_connections 2021-01-03T12:58:11.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a9c884700 1 --2- 172.21.15.133:0/1995673648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a980b5260 0x7f0a981470b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a9c884700 1 --2- 172.21.15.133:0/1995673648 >> v2:172.21.15.16:3300/0 conn(0x7f0a980b5c00 0x7f0a981475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a9c884700 1 -- 172.21.15.133:0/1995673648 >> 172.21.15.133:0/1995673648 conn(0x7f0a9805bdf0 msgr2=0x7f0a9805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:11.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a9c884700 1 -- 172.21.15.133:0/1995673648 shutdown_connections 2021-01-03T12:58:11.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a9c884700 1 -- 172.21.15.133:0/1995673648 wait complete. 2021-01-03T12:58:11.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a9c884700 1 Processor -- start 2021-01-03T12:58:11.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a9c884700 1 -- start start 2021-01-03T12:58:11.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a9c884700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a980b5260 0x7f0a9814dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a9c884700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0a980b5c00 0x7f0a980670d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a9c884700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a981442a0 0x7f0a98159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a9c884700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a981470c0 con 0x7f0a981442a0 2021-01-03T12:58:11.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a9c884700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a98066990 con 0x7f0a980b5260 2021-01-03T12:58:11.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a9c884700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a98066c30 con 0x7f0a980b5c00 2021-01-03T12:58:11.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a977fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a980b5260 0x7f0a9814dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a977fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a980b5260 0x7f0a9814dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60304/0 (socket says 172.21.15.133:60304) 2021-01-03T12:58:11.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a977fe700 1 -- 172.21.15.133:0/3784906657 learned_addr learned my addr 172.21.15.133:0/3784906657 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a96ffd700 1 --2- 172.21.15.133:0/3784906657 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0a980b5c00 0x7f0a980670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a97fff700 1 --2- 172.21.15.133:0/3784906657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a981442a0 0x7f0a98159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a977fe700 1 -- 172.21.15.133:0/3784906657 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0a980b5c00 msgr2=0x7f0a980670d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a977fe700 1 --2- 172.21.15.133:0/3784906657 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0a980b5c00 0x7f0a980670d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.323+0000 7f0a977fe700 1 -- 172.21.15.133:0/3784906657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a981442a0 msgr2=0x7f0a98159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.327+0000 7f0a977fe700 1 --2- 172.21.15.133:0/3784906657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a981442a0 0x7f0a98159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.327+0000 7f0a977fe700 1 -- 172.21.15.133:0/3784906657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a980664e0 con 0x7f0a980b5260 2021-01-03T12:58:11.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.327+0000 7f0a97fff700 1 --2- 172.21.15.133:0/3784906657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a981442a0 0x7f0a98159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:11.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.327+0000 7f0a977fe700 1 --2- 172.21.15.133:0/3784906657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a980b5260 0x7f0a9814dfd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f0a900032b0 tx=0x7f0a90016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:11.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.327+0000 7f0a94ff9700 1 -- 172.21.15.133:0/3784906657 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a900107a0 con 0x7f0a980b5260 2021-01-03T12:58:11.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.327+0000 7f0a94ff9700 1 -- 172.21.15.133:0/3784906657 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a90010900 con 0x7f0a980b5260 2021-01-03T12:58:11.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.327+0000 7f0a9c884700 1 -- 172.21.15.133:0/3784906657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a98159950 con 0x7f0a980b5260 2021-01-03T12:58:11.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.327+0000 7f0a94ff9700 1 -- 172.21.15.133:0/3784906657 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a90010c60 con 0x7f0a980b5260 2021-01-03T12:58:11.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.327+0000 7f0a9c884700 1 -- 172.21.15.133:0/3784906657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a98146d90 con 0x7f0a980b5260 2021-01-03T12:58:11.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.327+0000 7f0a94ff9700 1 -- 172.21.15.133:0/3784906657 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0a9000f070 con 0x7f0a980b5260 2021-01-03T12:58:11.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.327+0000 7f0a9c884700 1 -- 172.21.15.133:0/3784906657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a980667f0 con 0x7f0a980b5260 2021-01-03T12:58:11.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.327+0000 7f0a94ff9700 1 --2- 172.21.15.133:0/3784906657 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a700553b0 0x7f0a70057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.327+0000 7f0a96ffd700 1 --2- 172.21.15.133:0/3784906657 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a700553b0 0x7f0a70057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.327+0000 7f0a94ff9700 1 -- 172.21.15.133:0/3784906657 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0a9006f830 con 0x7f0a980b5260 2021-01-03T12:58:11.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.327+0000 7f0a96ffd700 1 --2- 172.21.15.133:0/3784906657 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a700553b0 0x7f0a70057870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f0a8000b000 tx=0x7f0a80008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.335+0000 7f0a94ff9700 1 -- 172.21.15.133:0/3784906657 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0a980667f0 con 0x7f0a980b5260 2021-01-03T12:58:11.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.475+0000 7f0a9c884700 1 -- 172.21.15.133:0/3784906657 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0a980667f0 con 0x7f0a980b5260 2021-01-03T12:58:11.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.475+0000 7f0a94ff9700 1 -- 172.21.15.133:0/3784906657 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0a980667f0 con 0x7f0a980b5260 2021-01-03T12:58:11.478 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:11.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.479+0000 7f0a9c884700 1 -- 172.21.15.133:0/3784906657 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a700553b0 msgr2=0x7f0a70057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.479+0000 7f0a9c884700 1 --2- 172.21.15.133:0/3784906657 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a700553b0 0x7f0a70057870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f0a8000b000 tx=0x7f0a80008040).stop 2021-01-03T12:58:11.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.479+0000 7f0a9c884700 1 -- 172.21.15.133:0/3784906657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a980b5260 msgr2=0x7f0a9814dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.479+0000 7f0a9c884700 1 --2- 172.21.15.133:0/3784906657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a980b5260 0x7f0a9814dfd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f0a900032b0 tx=0x7f0a90016000).stop 2021-01-03T12:58:11.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.479+0000 7f0a9c884700 1 -- 172.21.15.133:0/3784906657 shutdown_connections 2021-01-03T12:58:11.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.479+0000 7f0a9c884700 1 --2- 172.21.15.133:0/3784906657 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a700553b0 0x7f0a70057870 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.479+0000 7f0a9c884700 1 --2- 172.21.15.133:0/3784906657 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a981442a0 0x7f0a98159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.479+0000 7f0a9c884700 1 --2- 172.21.15.133:0/3784906657 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a980b5260 0x7f0a9814dfd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.479+0000 7f0a9c884700 1 --2- 172.21.15.133:0/3784906657 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0a980b5c00 0x7f0a980670d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.479+0000 7f0a9c884700 1 -- 172.21.15.133:0/3784906657 >> 172.21.15.133:0/3784906657 conn(0x7f0a9805bdf0 msgr2=0x7f0a980aad80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:11.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.479+0000 7f0a9c884700 1 -- 172.21.15.133:0/3784906657 shutdown_connections 2021-01-03T12:58:11.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.479+0000 7f0a9c884700 1 -- 172.21.15.133:0/3784906657 wait complete. 2021-01-03T12:58:11.496 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T12:58:11.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb6a5f61700 1 Processor -- start 2021-01-03T12:58:11.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb6a5f61700 1 -- start start 2021-01-03T12:58:11.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb6a5f61700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6a0062270 0x7fb6a0144370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb6a5f61700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb6a00b2350 0x7fb6a014aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb6a5f61700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a0062650 con 0x7fb6a00b1ab0 2021-01-03T12:58:11.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb6a5f61700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a01471c0 con 0x7fb6a00b2350 2021-01-03T12:58:11.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb6a5f61700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a0060be0 con 0x7fb6a0062270 2021-01-03T12:58:11.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb69f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6a0062270 0x7fb6a0144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb69f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6a0062270 0x7fb6a0144370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60312/0 (socket says 172.21.15.133:60312) 2021-01-03T12:58:11.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb69f7fe700 1 -- 172.21.15.133:0/2710805640 learned_addr learned my addr 172.21.15.133:0/2710805640 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:11.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb69ffff700 1 --2- 172.21.15.133:0/2710805640 >> v2:172.21.15.16:3300/0 conn(0x7fb6a00b2350 0x7fb6a014aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb69f7fe700 1 -- 172.21.15.133:0/2710805640 >> v2:172.21.15.16:3300/0 conn(0x7fb6a00b2350 msgr2=0x7fb6a014aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:11.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb69f7fe700 1 --2- 172.21.15.133:0/2710805640 >> v2:172.21.15.16:3300/0 conn(0x7fb6a00b2350 0x7fb6a014aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb69f7fe700 1 -- 172.21.15.133:0/2710805640 >> v1:172.21.15.16:6789/0 conn(0x7fb6a00b1ab0 legacy=0x7fb6a0144860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb69f7fe700 1 -- 172.21.15.133:0/2710805640 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a00606a0 con 0x7fb6a0062270 2021-01-03T12:58:11.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb69ffff700 1 --2- 172.21.15.133:0/2710805640 >> v2:172.21.15.16:3300/0 conn(0x7fb6a00b2350 0x7fb6a014aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:11.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb69f7fe700 1 --2- 172.21.15.133:0/2710805640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a0062270 0x7fb6a0144370 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fb690002f30 tx=0x7fb690006e80).ready entity=mon.1 client_cookie=bf7950ec6d7d3b75 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:11.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb69e7fc700 1 -- 172.21.15.133:0/2710805640 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6900097f0 con 0x7fb6a0062270 2021-01-03T12:58:11.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb69e7fc700 1 -- 172.21.15.133:0/2710805640 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb690009950 con 0x7fb6a0062270 2021-01-03T12:58:11.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb69e7fc700 1 -- 172.21.15.133:0/2710805640 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb690009cb0 con 0x7fb6a0062270 2021-01-03T12:58:11.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb6a5f61700 1 -- 172.21.15.133:0/2710805640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a0062270 msgr2=0x7fb6a0144370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.615+0000 7fb6a5f61700 1 --2- 172.21.15.133:0/2710805640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a0062270 0x7fb6a0144370 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fb690002f30 tx=0x7fb690006e80).stop 2021-01-03T12:58:11.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb6a5f61700 1 -- 172.21.15.133:0/2710805640 shutdown_connections 2021-01-03T12:58:11.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb6a5f61700 1 --2- 172.21.15.133:0/2710805640 >> v2:172.21.15.16:3300/0 conn(0x7fb6a00b2350 0x7fb6a014aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb6a5f61700 1 --2- 172.21.15.133:0/2710805640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a0062270 0x7fb6a0144370 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb6a5f61700 1 -- 172.21.15.133:0/2710805640 >> 172.21.15.133:0/2710805640 conn(0x7fb6a00b6db0 msgr2=0x7fb6a0061820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:11.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb6a5f61700 1 -- 172.21.15.133:0/2710805640 shutdown_connections 2021-01-03T12:58:11.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb6a5f61700 1 -- 172.21.15.133:0/2710805640 wait complete. 2021-01-03T12:58:11.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb6a5f61700 1 Processor -- start 2021-01-03T12:58:11.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb6a5f61700 1 -- start start 2021-01-03T12:58:11.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb6a5f61700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a0062270 0x7fb6a013ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb6a5f61700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6a00b1ab0 0x7fb6a01464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb6a5f61700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6a00b2350 0x7fb6a013cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb6a5f61700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a0141840 con 0x7fb6a00b1ab0 2021-01-03T12:58:11.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb6a5f61700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a013f6f0 con 0x7fb6a0062270 2021-01-03T12:58:11.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb6a5f61700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a013edb0 con 0x7fb6a00b2350 2021-01-03T12:58:11.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb69f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a0062270 0x7fb6a013ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb69f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a0062270 0x7fb6a013ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60320/0 (socket says 172.21.15.133:60320) 2021-01-03T12:58:11.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb69f7fe700 1 -- 172.21.15.133:0/2413100998 learned_addr learned my addr 172.21.15.133:0/2413100998 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:11.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb69ffff700 1 --2- 172.21.15.133:0/2413100998 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6a00b2350 0x7fb6a013cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb69effd700 1 --2- 172.21.15.133:0/2413100998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6a00b1ab0 0x7fb6a01464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb69f7fe700 1 -- 172.21.15.133:0/2413100998 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6a00b2350 msgr2=0x7fb6a013cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb69f7fe700 1 --2- 172.21.15.133:0/2413100998 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6a00b2350 0x7fb6a013cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb69f7fe700 1 -- 172.21.15.133:0/2413100998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6a00b1ab0 msgr2=0x7fb6a01464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb69f7fe700 1 --2- 172.21.15.133:0/2413100998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6a00b1ab0 0x7fb6a01464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb69f7fe700 1 -- 172.21.15.133:0/2413100998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a013f920 con 0x7fb6a0062270 2021-01-03T12:58:11.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb69ffff700 1 --2- 172.21.15.133:0/2413100998 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6a00b2350 0x7fb6a013cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:11.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb69f7fe700 1 --2- 172.21.15.133:0/2413100998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a0062270 0x7fb6a013ba30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fb6a0141980 tx=0x7fb690015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:11.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb69cff9700 1 -- 172.21.15.133:0/2413100998 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb690011c80 con 0x7fb6a0062270 2021-01-03T12:58:11.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb69cff9700 1 -- 172.21.15.133:0/2413100998 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb690011de0 con 0x7fb6a0062270 2021-01-03T12:58:11.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb6a5f61700 1 -- 172.21.15.133:0/2413100998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a01469b0 con 0x7fb6a0062270 2021-01-03T12:58:11.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb69cff9700 1 -- 172.21.15.133:0/2413100998 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb69001e650 con 0x7fb6a0062270 2021-01-03T12:58:11.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.619+0000 7fb6a5f61700 1 -- 172.21.15.133:0/2413100998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a0146de0 con 0x7fb6a0062270 2021-01-03T12:58:11.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.623+0000 7fb6a5f61700 1 -- 172.21.15.133:0/2413100998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a013fab0 con 0x7fb6a0062270 2021-01-03T12:58:11.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.623+0000 7fb69cff9700 1 -- 172.21.15.133:0/2413100998 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb690025030 con 0x7fb6a0062270 2021-01-03T12:58:11.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.623+0000 7fb69cff9700 1 --2- 172.21.15.133:0/2413100998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6800553b0 0x7fb680057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.623+0000 7fb69effd700 1 --2- 172.21.15.133:0/2413100998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6800553b0 0x7fb680057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.623+0000 7fb69cff9700 1 -- 172.21.15.133:0/2413100998 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb69006f230 con 0x7fb6a0062270 2021-01-03T12:58:11.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.623+0000 7fb69effd700 1 --2- 172.21.15.133:0/2413100998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6800553b0 0x7fb680057870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fb69400d000 tx=0x7fb694007b60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:11.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.631+0000 7fb69cff9700 1 -- 172.21.15.133:0/2413100998 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb690045530 con 0x7fb6a0062270 2021-01-03T12:58:11.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.767+0000 7fb6a5f61700 1 -- 172.21.15.133:0/2413100998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6a0057300 con 0x7fb6a0062270 2021-01-03T12:58:11.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.767+0000 7fb69cff9700 1 -- 172.21.15.133:0/2413100998 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb6900230a0 con 0x7fb6a0062270 2021-01-03T12:58:11.768 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:11.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.767+0000 7fb6a5f61700 1 -- 172.21.15.133:0/2413100998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6800553b0 msgr2=0x7fb680057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.767+0000 7fb6a5f61700 1 --2- 172.21.15.133:0/2413100998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6800553b0 0x7fb680057870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fb69400d000 tx=0x7fb694007b60).stop 2021-01-03T12:58:11.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.767+0000 7fb6a5f61700 1 -- 172.21.15.133:0/2413100998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a0062270 msgr2=0x7fb6a013ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.767+0000 7fb6a5f61700 1 --2- 172.21.15.133:0/2413100998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a0062270 0x7fb6a013ba30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fb6a0141980 tx=0x7fb690015000).stop 2021-01-03T12:58:11.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.767+0000 7fb6a5f61700 1 -- 172.21.15.133:0/2413100998 shutdown_connections 2021-01-03T12:58:11.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.767+0000 7fb6a5f61700 1 --2- 172.21.15.133:0/2413100998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6800553b0 0x7fb680057870 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.767+0000 7fb6a5f61700 1 --2- 172.21.15.133:0/2413100998 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6a00b2350 0x7fb6a013cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.767+0000 7fb6a5f61700 1 --2- 172.21.15.133:0/2413100998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6a0062270 0x7fb6a013ba30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.767+0000 7fb6a5f61700 1 --2- 172.21.15.133:0/2413100998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6a00b1ab0 0x7fb6a01464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.767+0000 7fb6a5f61700 1 -- 172.21.15.133:0/2413100998 >> 172.21.15.133:0/2413100998 conn(0x7fb6a00b6db0 msgr2=0x7fb6a00aed10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:11.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.767+0000 7fb6a5f61700 1 -- 172.21.15.133:0/2413100998 shutdown_connections 2021-01-03T12:58:11.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.767+0000 7fb6a5f61700 1 -- 172.21.15.133:0/2413100998 wait complete. 2021-01-03T12:58:11.781 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T12:58:11.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a91684700 1 Processor -- start 2021-01-03T12:58:11.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a91684700 1 -- start start 2021-01-03T12:58:11.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a91684700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a8c0b6d50 0x7f0a8c0af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a91684700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c0b0e60 con 0x7f0a8c0afbe0 2021-01-03T12:58:11.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a91684700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c0b0050 con 0x7f0a8c0b18e0 2021-01-03T12:58:11.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a91684700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c0b7130 con 0x7f0a8c0b6d50 2021-01-03T12:58:11.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a8affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0a8c0b6d50 0x7f0a8c0af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a8a7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0a8c0b18e0 0x7f0a8c05f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53128/0 (socket says 172.21.15.133:53128) 2021-01-03T12:58:11.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a8a7fc700 1 -- 172.21.15.133:0/3820189193 learned_addr learned my addr 172.21.15.133:0/3820189193 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:11.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a8affd700 1 -- 172.21.15.133:0/3820189193 >> v1:172.21.15.133:6789/0 conn(0x7f0a8c0b18e0 legacy=0x7f0a8c05f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a8affd700 1 -- 172.21.15.133:0/3820189193 >> v1:172.21.15.16:6789/0 conn(0x7f0a8c0afbe0 legacy=0x7f0a8c05fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a89ffb700 1 -- 172.21.15.133:0/3820189193 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481494077 0 0) 0x7f0a8c0b0050 con 0x7f0a8c0b18e0 2021-01-03T12:58:11.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a8affd700 1 -- 172.21.15.133:0/3820189193 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c060400 con 0x7f0a8c0b6d50 2021-01-03T12:58:11.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a8affd700 1 --2- 172.21.15.133:0/3820189193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a8c0b6d50 0x7f0a8c0af6f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f0a7c002f30 tx=0x7f0a7c006dc0).ready entity=mon.1 client_cookie=7a8c1e80a01e9a3d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:11.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a89ffb700 1 -- 172.21.15.133:0/3820189193 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a7c0097f0 con 0x7f0a8c0b6d50 2021-01-03T12:58:11.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a89ffb700 1 -- 172.21.15.133:0/3820189193 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c009950 con 0x7f0a8c0b6d50 2021-01-03T12:58:11.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a89ffb700 1 -- 172.21.15.133:0/3820189193 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a7c009cb0 con 0x7f0a8c0b6d50 2021-01-03T12:58:11.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a91684700 1 -- 172.21.15.133:0/3820189193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a8c0b6d50 msgr2=0x7f0a8c0af6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.899+0000 7f0a91684700 1 --2- 172.21.15.133:0/3820189193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a8c0b6d50 0x7f0a8c0af6f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f0a7c002f30 tx=0x7f0a7c006dc0).stop 2021-01-03T12:58:11.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a91684700 1 -- 172.21.15.133:0/3820189193 shutdown_connections 2021-01-03T12:58:11.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a91684700 1 --2- 172.21.15.133:0/3820189193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a8c0b6d50 0x7f0a8c0af6f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a91684700 1 -- 172.21.15.133:0/3820189193 >> 172.21.15.133:0/3820189193 conn(0x7f0a8c0622f0 msgr2=0x7f0a8c0b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:11.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a91684700 1 -- 172.21.15.133:0/3820189193 shutdown_connections 2021-01-03T12:58:11.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a91684700 1 -- 172.21.15.133:0/3820189193 wait complete. 2021-01-03T12:58:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a91684700 1 Processor -- start 2021-01-03T12:58:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a91684700 1 -- start start 2021-01-03T12:58:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a91684700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a8c0afbe0 0x7f0a8c0b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a91684700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a8c0b18e0 0x7f0a8c1315c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a91684700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0a8c0b6d50 0x7f0a8c13d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a91684700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0b5f50 con 0x7f0a8c0afbe0 2021-01-03T12:58:11.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a91684700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c13ef00 con 0x7f0a8c0b18e0 2021-01-03T12:58:11.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a91684700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c13f490 con 0x7f0a8c0b6d50 2021-01-03T12:58:11.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a8a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a8c0b18e0 0x7f0a8c1315c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a8a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a8c0b18e0 0x7f0a8c1315c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60334/0 (socket says 172.21.15.133:60334) 2021-01-03T12:58:11.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a8a7fc700 1 -- 172.21.15.133:0/1478905730 learned_addr learned my addr 172.21.15.133:0/1478905730 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:11.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a8b7fe700 1 --2- 172.21.15.133:0/1478905730 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0a8c0b6d50 0x7f0a8c13d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a8affd700 1 --2- 172.21.15.133:0/1478905730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a8c0afbe0 0x7f0a8c0b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a8a7fc700 1 -- 172.21.15.133:0/1478905730 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0a8c0b6d50 msgr2=0x7f0a8c13d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a8a7fc700 1 --2- 172.21.15.133:0/1478905730 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0a8c0b6d50 0x7f0a8c13d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a8a7fc700 1 -- 172.21.15.133:0/1478905730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a8c0afbe0 msgr2=0x7f0a8c0b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:11.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a8a7fc700 1 --2- 172.21.15.133:0/1478905730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a8c0afbe0 0x7f0a8c0b5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:11.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a8a7fc700 1 -- 172.21.15.133:0/1478905730 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c131ab0 con 0x7f0a8c0b18e0 2021-01-03T12:58:11.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a8affd700 1 --2- 172.21.15.133:0/1478905730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a8c0afbe0 0x7f0a8c0b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:11.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a8a7fc700 1 --2- 172.21.15.133:0/1478905730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a8c0b18e0 0x7f0a8c1315c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f0a80000b80 tx=0x7f0a80007a30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:11.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a7bfff700 1 -- 172.21.15.133:0/1478905730 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a80007320 con 0x7f0a8c0b18e0 2021-01-03T12:58:11.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a7bfff700 1 -- 172.21.15.133:0/1478905730 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a80007480 con 0x7f0a8c0b18e0 2021-01-03T12:58:11.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a91684700 1 -- 172.21.15.133:0/1478905730 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8c13ddf0 con 0x7f0a8c0b18e0 2021-01-03T12:58:11.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.903+0000 7f0a7bfff700 1 -- 172.21.15.133:0/1478905730 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a800057d0 con 0x7f0a8c0b18e0 2021-01-03T12:58:11.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.907+0000 7f0a91684700 1 -- 172.21.15.133:0/1478905730 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8c063a70 con 0x7f0a8c0b18e0 2021-01-03T12:58:11.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.907+0000 7f0a7bfff700 1 -- 172.21.15.133:0/1478905730 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0a80010030 con 0x7f0a8c0b18e0 2021-01-03T12:58:11.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.907+0000 7f0a7bfff700 1 --2- 172.21.15.133:0/1478905730 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a680554e0 0x7f0a680579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:11.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.907+0000 7f0a7bfff700 1 -- 172.21.15.133:0/1478905730 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0a8006dca0 con 0x7f0a8c0b18e0 2021-01-03T12:58:11.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.907+0000 7f0a8affd700 1 --2- 172.21.15.133:0/1478905730 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a680554e0 0x7f0a680579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:11.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.907+0000 7f0a91684700 1 -- 172.21.15.133:0/1478905730 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8c13f2f0 con 0x7f0a8c0b18e0 2021-01-03T12:58:11.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.907+0000 7f0a8affd700 1 --2- 172.21.15.133:0/1478905730 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a680554e0 0x7f0a680579a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f0a7c016000 tx=0x7f0a7c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:11.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:11.911+0000 7f0a7bfff700 1 -- 172.21.15.133:0/1478905730 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0a8c13f2f0 con 0x7f0a8c0b18e0 2021-01-03T12:58:12.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.055+0000 7f0a91684700 1 -- 172.21.15.133:0/1478905730 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0a8c13f2f0 con 0x7f0a8c0b18e0 2021-01-03T12:58:12.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.055+0000 7f0a7bfff700 1 -- 172.21.15.133:0/1478905730 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f0a8c13f2f0 con 0x7f0a8c0b18e0 2021-01-03T12:58:12.056 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:12.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.055+0000 7f0a91684700 1 -- 172.21.15.133:0/1478905730 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a680554e0 msgr2=0x7f0a680579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:12.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.055+0000 7f0a91684700 1 --2- 172.21.15.133:0/1478905730 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a680554e0 0x7f0a680579a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f0a7c016000 tx=0x7f0a7c015000).stop 2021-01-03T12:58:12.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.055+0000 7f0a91684700 1 -- 172.21.15.133:0/1478905730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a8c0b18e0 msgr2=0x7f0a8c1315c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:12.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.055+0000 7f0a91684700 1 --2- 172.21.15.133:0/1478905730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a8c0b18e0 0x7f0a8c1315c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f0a80000b80 tx=0x7f0a80007a30).stop 2021-01-03T12:58:12.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.055+0000 7f0a91684700 1 -- 172.21.15.133:0/1478905730 shutdown_connections 2021-01-03T12:58:12.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.055+0000 7f0a91684700 1 --2- 172.21.15.133:0/1478905730 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0a680554e0 0x7f0a680579a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:12.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.055+0000 7f0a91684700 1 --2- 172.21.15.133:0/1478905730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a8c0afbe0 0x7f0a8c0b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:12.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.055+0000 7f0a91684700 1 --2- 172.21.15.133:0/1478905730 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0a8c0b6d50 0x7f0a8c13d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:12.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.055+0000 7f0a91684700 1 --2- 172.21.15.133:0/1478905730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a8c0b18e0 0x7f0a8c1315c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:12.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.055+0000 7f0a91684700 1 -- 172.21.15.133:0/1478905730 >> 172.21.15.133:0/1478905730 conn(0x7f0a8c0622f0 msgr2=0x7f0a8c0b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:12.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.055+0000 7f0a91684700 1 -- 172.21.15.133:0/1478905730 shutdown_connections 2021-01-03T12:58:12.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.055+0000 7f0a91684700 1 -- 172.21.15.133:0/1478905730 wait complete. 2021-01-03T12:58:12.069 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T12:58:12.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd573fff700 1 Processor -- start 2021-01-03T12:58:12.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd573fff700 1 -- start start 2021-01-03T12:58:12.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd573fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5740b0c90 0x7fd5740b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:12.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd573fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd5740b5c00 0x7fd574143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:12.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd573fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd574060da0 con 0x7fd5740b52c0 2021-01-03T12:58:12.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd573fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd574067a90 con 0x7fd5740b5c00 2021-01-03T12:58:12.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd573fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740b0ad0 con 0x7fd5740b0c90 2021-01-03T12:58:12.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd572ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd5740b52c0 0x7fd574098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53142/0 (socket says 172.21.15.133:53142) 2021-01-03T12:58:12.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd572ffd700 1 -- 172.21.15.133:0/1121059995 learned_addr learned my addr 172.21.15.133:0/1121059995 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:12.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd5727fc700 1 --2- 172.21.15.133:0/1121059995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5740b0c90 0x7fd5740b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:12.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd5737fe700 1 --2- 172.21.15.133:0/1121059995 >> v2:172.21.15.16:3300/0 conn(0x7fd5740b5c00 0x7fd574143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:12.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd571ffb700 1 -- 172.21.15.133:0/1121059995 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243461873 0 0) 0x7fd574060da0 con 0x7fd5740b52c0 2021-01-03T12:58:12.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd571ffb700 1 -- 172.21.15.133:0/1121059995 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd558003230 con 0x7fd5740b52c0 2021-01-03T12:58:12.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd571ffb700 1 -- 172.21.15.133:0/1121059995 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2399870217 0 0) 0x7fd558003230 con 0x7fd5740b52c0 2021-01-03T12:58:12.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd571ffb700 1 -- 172.21.15.133:0/1121059995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5740b0c90 msgr2=0x7fd5740b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:12.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd571ffb700 1 --2- 172.21.15.133:0/1121059995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5740b0c90 0x7fd5740b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:12.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd571ffb700 1 -- 172.21.15.133:0/1121059995 >> v2:172.21.15.16:3300/0 conn(0x7fd5740b5c00 msgr2=0x7fd574143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:12.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd571ffb700 1 --2- 172.21.15.133:0/1121059995 >> v2:172.21.15.16:3300/0 conn(0x7fd5740b5c00 0x7fd574143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:12.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd571ffb700 1 -- 172.21.15.133:0/1121059995 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5740b56a0 con 0x7fd5740b52c0 2021-01-03T12:58:12.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd571ffb700 1 -- 172.21.15.133:0/1121059995 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fd5640016d0 con 0x7fd5740b52c0 2021-01-03T12:58:12.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd571ffb700 1 -- 172.21.15.133:0/1121059995 >> v1:172.21.15.133:6789/0 conn(0x7fd5740b52c0 legacy=0x7fd574098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:12.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd571ffb700 1 --2- 172.21.15.133:0/1121059995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd558003720 0x7fd558003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:12.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd571ffb700 1 --2- 172.21.15.133:0/1121059995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5740b0c90 0x7fd5580044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:12.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd571ffb700 1 --2- 172.21.15.133:0/1121059995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5580049c0 0x7fd558004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:12.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd571ffb700 1 -- 172.21.15.133:0/1121059995 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd574067a90 con 0x7fd5580049c0 2021-01-03T12:58:12.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd571ffb700 1 -- 172.21.15.133:0/1121059995 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740b0ad0 con 0x7fd558003720 2021-01-03T12:58:12.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.183+0000 7fd571ffb700 1 -- 172.21.15.133:0/1121059995 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5580041c0 con 0x7fd5740b0c90 2021-01-03T12:58:12.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd5737fe700 1 --2- 172.21.15.133:0/1121059995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5580049c0 0x7fd558004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:12.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd572ffd700 1 --2- 172.21.15.133:0/1121059995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd558003720 0x7fd558003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:12.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd5727fc700 1 --2- 172.21.15.133:0/1121059995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5740b0c90 0x7fd5580044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:12.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd572ffd700 1 -- 172.21.15.133:0/1121059995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5740b0c90 msgr2=0x7fd5580044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:12.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd572ffd700 1 --2- 172.21.15.133:0/1121059995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5740b0c90 0x7fd5580044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:12.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd572ffd700 1 -- 172.21.15.133:0/1121059995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5580049c0 msgr2=0x7fd558004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:12.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd572ffd700 1 --2- 172.21.15.133:0/1121059995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5580049c0 0x7fd558004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:12.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd572ffd700 1 -- 172.21.15.133:0/1121059995 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd558003230 con 0x7fd558003720 2021-01-03T12:58:12.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd572ffd700 1 --2- 172.21.15.133:0/1121059995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd558003720 0x7fd558003b40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fd5640013e0 tx=0x7fd5740b0070).ready entity=mon.1 client_cookie=3c2530926a9bc2d7 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:12.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd571ffb700 1 -- 172.21.15.133:0/1121059995 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd56400ce00 con 0x7fd558003720 2021-01-03T12:58:12.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd571ffb700 1 -- 172.21.15.133:0/1121059995 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5640072e0 con 0x7fd558003720 2021-01-03T12:58:12.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd571ffb700 1 -- 172.21.15.133:0/1121059995 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5640055e0 con 0x7fd558003720 2021-01-03T12:58:12.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd573fff700 1 -- 172.21.15.133:0/1121059995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd558003720 msgr2=0x7fd558003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:12.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd573fff700 1 --2- 172.21.15.133:0/1121059995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd558003720 0x7fd558003b40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fd5640013e0 tx=0x7fd5740b0070).stop 2021-01-03T12:58:12.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd5737fe700 1 -- 172.21.15.133:0/1121059995 reap_dead start 2021-01-03T12:58:12.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd573fff700 1 -- 172.21.15.133:0/1121059995 shutdown_connections 2021-01-03T12:58:12.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd573fff700 1 -- 172.21.15.133:0/1121059995 >> 172.21.15.133:0/1121059995 conn(0x7fd57405bdf0 msgr2=0x7fd57405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:12.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd573fff700 1 -- 172.21.15.133:0/1121059995 shutdown_connections 2021-01-03T12:58:12.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd573fff700 1 -- 172.21.15.133:0/1121059995 wait complete. 2021-01-03T12:58:12.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd573fff700 1 Processor -- start 2021-01-03T12:58:12.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.187+0000 7fd573fff700 1 -- start start 2021-01-03T12:58:12.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd573fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5740af3e0 0x7fd5740ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:12.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd573fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5740ae3a0 0x7fd5741564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:12.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd573fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5741569c0 0x7fd5741594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:12.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd573fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5740af7c0 con 0x7fd5741569c0 2021-01-03T12:58:12.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd573fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd574066c50 con 0x7fd5740af3e0 2021-01-03T12:58:12.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd573fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd574156e40 con 0x7fd5740ae3a0 2021-01-03T12:58:12.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd572ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5740af3e0 0x7fd5740ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:12.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd572ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5740af3e0 0x7fd5740ab1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60352/0 (socket says 172.21.15.133:60352) 2021-01-03T12:58:12.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd572ffd700 1 -- 172.21.15.133:0/404382785 learned_addr learned my addr 172.21.15.133:0/404382785 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:12.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd5727fc700 1 --2- 172.21.15.133:0/404382785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5740ae3a0 0x7fd5741564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:12.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd5737fe700 1 --2- 172.21.15.133:0/404382785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5741569c0 0x7fd5741594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:12.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd572ffd700 1 -- 172.21.15.133:0/404382785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5740ae3a0 msgr2=0x7fd5741564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:12.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd572ffd700 1 --2- 172.21.15.133:0/404382785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5740ae3a0 0x7fd5741564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:12.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd572ffd700 1 -- 172.21.15.133:0/404382785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5741569c0 msgr2=0x7fd5741594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:12.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd572ffd700 1 --2- 172.21.15.133:0/404382785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5741569c0 0x7fd5741594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:12.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd572ffd700 1 -- 172.21.15.133:0/404382785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5740ae920 con 0x7fd5740af3e0 2021-01-03T12:58:12.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd5737fe700 1 --2- 172.21.15.133:0/404382785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5741569c0 0x7fd5741594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:12.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd572ffd700 1 --2- 172.21.15.133:0/404382785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5740af3e0 0x7fd5740ab1c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fd5640013e0 tx=0x7fd564013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:12.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd563fff700 1 -- 172.21.15.133:0/404382785 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd56401a070 con 0x7fd5740af3e0 2021-01-03T12:58:12.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd563fff700 1 -- 172.21.15.133:0/404382785 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd564005b40 con 0x7fd5740af3e0 2021-01-03T12:58:12.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd573fff700 1 -- 172.21.15.133:0/404382785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5740aebc0 con 0x7fd5740af3e0 2021-01-03T12:58:12.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd563fff700 1 -- 172.21.15.133:0/404382785 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd564005ea0 con 0x7fd5740af3e0 2021-01-03T12:58:12.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd573fff700 1 -- 172.21.15.133:0/404382785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd574156030 con 0x7fd5740af3e0 2021-01-03T12:58:12.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.191+0000 7fd573fff700 1 -- 172.21.15.133:0/404382785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd574057300 con 0x7fd5740af3e0 2021-01-03T12:58:12.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.195+0000 7fd563fff700 1 -- 172.21.15.133:0/404382785 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd564026070 con 0x7fd5740af3e0 2021-01-03T12:58:12.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.195+0000 7fd563fff700 1 --2- 172.21.15.133:0/404382785 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd550055350 0x7fd550057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:12.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.195+0000 7fd563fff700 1 -- 172.21.15.133:0/404382785 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd56406e630 con 0x7fd5740af3e0 2021-01-03T12:58:12.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.195+0000 7fd5727fc700 1 --2- 172.21.15.133:0/404382785 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd550055350 0x7fd550057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:12.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.195+0000 7fd5727fc700 1 --2- 172.21.15.133:0/404382785 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd550055350 0x7fd550057810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fd568008000 tx=0x7fd568008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:12.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.199+0000 7fd563fff700 1 -- 172.21.15.133:0/404382785 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd564044930 con 0x7fd5740af3e0 2021-01-03T12:58:12.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.383+0000 7fd573fff700 1 -- 172.21.15.133:0/404382785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd57406b0f0 con 0x7fd5740af3e0 2021-01-03T12:58:12.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.383+0000 7fd563fff700 1 -- 172.21.15.133:0/404382785 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2489 (secure 0 0 0) 0x7fd564047f50 con 0x7fd5740af3e0 2021-01-03T12:58:12.386 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:12.386 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2255364706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2255364706},{"type":"v1","addr":"172.21.15.16:6833","nonce":2255364706}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/537740959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":537740959},{"type":"v1","addr":"172.21.15.133:6835","nonce":537740959}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T12:58:00.825803+0000","modified":"2021-01-03T12:58:01.829281+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6837/3158570988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3158570988},{"type":"v1","addr":"172.21.15.133:6837","nonce":3158570988}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-03T12:58:12.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.387+0000 7fd573fff700 1 -- 172.21.15.133:0/404382785 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd550055350 msgr2=0x7fd550057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:12.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.387+0000 7fd573fff700 1 --2- 172.21.15.133:0/404382785 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd550055350 0x7fd550057810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fd568008000 tx=0x7fd568008040).stop 2021-01-03T12:58:12.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.387+0000 7fd573fff700 1 -- 172.21.15.133:0/404382785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5740af3e0 msgr2=0x7fd5740ab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:12.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.387+0000 7fd573fff700 1 --2- 172.21.15.133:0/404382785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5740af3e0 0x7fd5740ab1c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fd5640013e0 tx=0x7fd564013000).stop 2021-01-03T12:58:12.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.387+0000 7fd573fff700 1 -- 172.21.15.133:0/404382785 shutdown_connections 2021-01-03T12:58:12.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.387+0000 7fd573fff700 1 --2- 172.21.15.133:0/404382785 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd550055350 0x7fd550057810 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:12.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.387+0000 7fd573fff700 1 --2- 172.21.15.133:0/404382785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5741569c0 0x7fd5741594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:12.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.387+0000 7fd573fff700 1 --2- 172.21.15.133:0/404382785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5740af3e0 0x7fd5740ab1c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:12.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.387+0000 7fd573fff700 1 --2- 172.21.15.133:0/404382785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5740ae3a0 0x7fd5741564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:12.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.387+0000 7fd573fff700 1 -- 172.21.15.133:0/404382785 >> 172.21.15.133:0/404382785 conn(0x7fd57405bdf0 msgr2=0x7fd574146eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:12.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.387+0000 7fd573fff700 1 -- 172.21.15.133:0/404382785 shutdown_connections 2021-01-03T12:58:12.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:12.387+0000 7fd573fff700 1 -- 172.21.15.133:0/404382785 wait complete. 2021-01-03T12:58:12.390 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 5 2021-01-03T12:58:12.700 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T12:58:00.825803+0000', 'modified': '2021-01-03T12:58:01.829281+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4258}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4258': {'gid': 4258, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.133:6837/3158570988', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 3158570988}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 3158570988}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T12:58:12.701 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T12:58:12.701 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T12:58:12.830 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":4258,"want_state":"up:active","state":"up:active","rank_uptime":11.99155169,"mdsmap_epoch":5,"osdmap_epoch":23,"osdmap_epoch_barrier":22,"uptime":15.368861315} 2021-01-03T12:58:12.831 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 4258, "mdsmap_epoch": 5, "osdmap_epoch": 23, "osdmap_epoch_barrier": 22, "rank_uptime": 11.99155169, "state": "up:active", "uptime": 15.368861315, "want_state": "up:active", "whoami": 0 } 2021-01-03T12:58:12.831 INFO:teuthology.run_tasks:Running task ceph-fuse... 2021-01-03T12:58:12.872 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2021-01-03T12:58:12.874 INFO:tasks.ceph_fuse:config is None 2021-01-03T12:58:12.874 INFO:tasks.ceph_fuse:new config is {'client.0': None, 'client.1': None} 2021-01-03T12:58:12.875 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2021-01-03T12:58:12.876 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:13.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.003+0000 7f377112d700 1 Processor -- start 2021-01-03T12:58:13.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.003+0000 7f377112d700 1 -- start start 2021-01-03T12:58:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.003+0000 7f377112d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f376c146b40 0x7f376c14e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.003+0000 7f377112d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376c0605f0 con 0x7f376c0b9b60 2021-01-03T12:58:13.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.003+0000 7f377112d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376c0600b0 con 0x7f376c0b9f40 2021-01-03T12:58:13.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.003+0000 7f377112d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376c0aed30 con 0x7f376c146b40 2021-01-03T12:58:13.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.003+0000 7f376b7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f376c0b9f40 0x7f376c146430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53160/0 (socket says 172.21.15.133:53160) 2021-01-03T12:58:13.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.003+0000 7f376b7fe700 1 -- 172.21.15.133:0/2421962637 learned_addr learned my addr 172.21.15.133:0/2421962637 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:13.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.003+0000 7f377092c700 1 --2- 172.21.15.133:0/2421962637 >> v2:172.21.15.16:3300/0 conn(0x7f376c146b40 0x7f376c14e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f376affd700 1 -- 172.21.15.133:0/2421962637 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406865529 0 0) 0x7f376c0600b0 con 0x7f376c0b9f40 2021-01-03T12:58:13.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f376affd700 1 -- 172.21.15.133:0/2421962637 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3758003230 con 0x7f376c0b9f40 2021-01-03T12:58:13.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f377092c700 1 -- 172.21.15.133:0/2421962637 >> v1:172.21.15.133:6789/0 conn(0x7f376c0b9f40 legacy=0x7f376c146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f377092c700 1 -- 172.21.15.133:0/2421962637 >> v1:172.21.15.16:6789/0 conn(0x7f376c0b9b60 legacy=0x7f376c0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f377092c700 1 -- 172.21.15.133:0/2421962637 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c060350 con 0x7f376c146b40 2021-01-03T12:58:13.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f377092c700 1 --2- 172.21.15.133:0/2421962637 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f376c146b40 0x7f376c14e510 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f37640032b0 tx=0x7f37640091a0).ready entity=mon.0 client_cookie=fe2f5e96371c31df server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:13.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f376affd700 1 -- 172.21.15.133:0/2421962637 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f376400b9a0 con 0x7f376c146b40 2021-01-03T12:58:13.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f376affd700 1 -- 172.21.15.133:0/2421962637 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376400bb00 con 0x7f376c146b40 2021-01-03T12:58:13.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f376affd700 1 -- 172.21.15.133:0/2421962637 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f376400bc70 con 0x7f376c146b40 2021-01-03T12:58:13.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f377112d700 1 -- 172.21.15.133:0/2421962637 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f376c146b40 msgr2=0x7f376c14e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f377112d700 1 --2- 172.21.15.133:0/2421962637 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f376c146b40 0x7f376c14e510 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f37640032b0 tx=0x7f37640091a0).stop 2021-01-03T12:58:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f377112d700 1 -- 172.21.15.133:0/2421962637 shutdown_connections 2021-01-03T12:58:13.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f377112d700 1 --2- 172.21.15.133:0/2421962637 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f376c146b40 0x7f376c14e510 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f377112d700 1 -- 172.21.15.133:0/2421962637 >> 172.21.15.133:0/2421962637 conn(0x7f376c0b69e0 msgr2=0x7f376c0b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:13.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f377112d700 1 -- 172.21.15.133:0/2421962637 shutdown_connections 2021-01-03T12:58:13.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f377112d700 1 -- 172.21.15.133:0/2421962637 wait complete. 2021-01-03T12:58:13.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f377112d700 1 Processor -- start 2021-01-03T12:58:13.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.007+0000 7f377112d700 1 -- start start 2021-01-03T12:58:13.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f377112d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f376c0b9b60 0x7f376c13da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f377112d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f376c0b9f40 0x7f376c154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f377112d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f376c146b40 0x7f376c155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f377112d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0b79e0 con 0x7f376c0b9b60 2021-01-03T12:58:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f377112d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0b7c10 con 0x7f376c0b9f40 2021-01-03T12:58:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f377112d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0b7eb0 con 0x7f376c146b40 2021-01-03T12:58:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f376b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f376c0b9f40 0x7f376c154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f376b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f376c0b9f40 0x7f376c154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60364/0 (socket says 172.21.15.133:60364) 2021-01-03T12:58:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f376b7fe700 1 -- 172.21.15.133:0/2975295749 learned_addr learned my addr 172.21.15.133:0/2975295749 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f377092c700 1 --2- 172.21.15.133:0/2975295749 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f376c146b40 0x7f376c155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f376bfff700 1 --2- 172.21.15.133:0/2975295749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f376c0b9b60 0x7f376c13da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f376b7fe700 1 -- 172.21.15.133:0/2975295749 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f376c146b40 msgr2=0x7f376c155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f376b7fe700 1 --2- 172.21.15.133:0/2975295749 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f376c146b40 0x7f376c155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f376b7fe700 1 -- 172.21.15.133:0/2975295749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f376c0b9b60 msgr2=0x7f376c13da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f376b7fe700 1 --2- 172.21.15.133:0/2975295749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f376c0b9b60 0x7f376c13da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f376b7fe700 1 -- 172.21.15.133:0/2975295749 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c0b0ac0 con 0x7f376c0b9f40 2021-01-03T12:58:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f376bfff700 1 --2- 172.21.15.133:0/2975295749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f376c0b9b60 0x7f376c13da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f376b7fe700 1 --2- 172.21.15.133:0/2975295749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f376c0b9f40 0x7f376c154d60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f375c0010d0 tx=0x7f375c007a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f37697fa700 1 -- 172.21.15.133:0/2975295749 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f375c0072e0 con 0x7f376c0b9f40 2021-01-03T12:58:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f377112d700 1 -- 172.21.15.133:0/2975295749 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376c13e200 con 0x7f376c0b9f40 2021-01-03T12:58:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f37697fa700 1 -- 172.21.15.133:0/2975295749 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c007440 con 0x7f376c0b9f40 2021-01-03T12:58:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f37697fa700 1 -- 172.21.15.133:0/2975295749 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f375c0057d0 con 0x7f376c0b9f40 2021-01-03T12:58:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f377112d700 1 -- 172.21.15.133:0/2975295749 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376c0b75e0 con 0x7f376c0b9f40 2021-01-03T12:58:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.011+0000 7f377112d700 1 -- 172.21.15.133:0/2975295749 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376c0b0920 con 0x7f376c0b9f40 2021-01-03T12:58:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.015+0000 7f37697fa700 1 -- 172.21.15.133:0/2975295749 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f375c010070 con 0x7f376c0b9f40 2021-01-03T12:58:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.015+0000 7f37697fa700 1 --2- 172.21.15.133:0/2975295749 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f374c0553b0 0x7f374c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.015+0000 7f376bfff700 1 --2- 172.21.15.133:0/2975295749 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f374c0553b0 0x7f374c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.015+0000 7f37697fa700 1 -- 172.21.15.133:0/2975295749 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f375c06d600 con 0x7f376c0b9f40 2021-01-03T12:58:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.015+0000 7f376bfff700 1 --2- 172.21.15.133:0/2975295749 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f374c0553b0 0x7f374c057870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f3760008000 tx=0x7f3760009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.023+0000 7f37697fa700 1 -- 172.21.15.133:0/2975295749 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f376c0b0920 con 0x7f376c0b9f40 2021-01-03T12:58:13.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.163+0000 7f377112d700 1 -- 172.21.15.133:0/2975295749 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f376c0b0920 con 0x7f376c0b9f40 2021-01-03T12:58:13.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.163+0000 7f37697fa700 1 -- 172.21.15.133:0/2975295749 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f376c0b0920 con 0x7f376c0b9f40 2021-01-03T12:58:13.166 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:13.167 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":23,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:01.829379+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:57:58.934952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-03T12:57:59.830134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:13.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.167+0000 7f377112d700 1 -- 172.21.15.133:0/2975295749 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f374c0553b0 msgr2=0x7f374c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.167+0000 7f377112d700 1 --2- 172.21.15.133:0/2975295749 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f374c0553b0 0x7f374c057870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f3760008000 tx=0x7f3760009040).stop 2021-01-03T12:58:13.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.167+0000 7f377112d700 1 -- 172.21.15.133:0/2975295749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f376c0b9f40 msgr2=0x7f376c154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.167+0000 7f377112d700 1 --2- 172.21.15.133:0/2975295749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f376c0b9f40 0x7f376c154d60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f375c0010d0 tx=0x7f375c007a70).stop 2021-01-03T12:58:13.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.167+0000 7f377112d700 1 -- 172.21.15.133:0/2975295749 shutdown_connections 2021-01-03T12:58:13.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.167+0000 7f377112d700 1 --2- 172.21.15.133:0/2975295749 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f374c0553b0 0x7f374c057870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.167+0000 7f377112d700 1 --2- 172.21.15.133:0/2975295749 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f376c0b9b60 0x7f376c13da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.167+0000 7f377112d700 1 --2- 172.21.15.133:0/2975295749 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f376c146b40 0x7f376c155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.167+0000 7f377112d700 1 --2- 172.21.15.133:0/2975295749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f376c0b9f40 0x7f376c154d60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.167+0000 7f377112d700 1 -- 172.21.15.133:0/2975295749 >> 172.21.15.133:0/2975295749 conn(0x7f376c0b69e0 msgr2=0x7f376c141cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:13.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.167+0000 7f377112d700 1 -- 172.21.15.133:0/2975295749 shutdown_connections 2021-01-03T12:58:13.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.167+0000 7f377112d700 1 -- 172.21.15.133:0/2975295749 wait complete. 2021-01-03T12:58:13.187 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T12:57:58.934952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T12:57:59.830134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T12:58:13.188 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T12:58:13.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.303+0000 7f095ffff700 1 Processor -- start 2021-01-03T12:58:13.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095ffff700 1 -- start start 2021-01-03T12:58:13.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0960060890 0x7f09600abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095ffff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09600aaa10 con 0x7f09600ae900 2021-01-03T12:58:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095ffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09600b0ab0 con 0x7f09600afa80 2021-01-03T12:58:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095ffff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09600ab280 con 0x7f0960060890 2021-01-03T12:58:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095effd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0960060890 0x7f09600abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095e7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f09600afa80 0x7f09600b4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53172/0 (socket says 172.21.15.133:53172) 2021-01-03T12:58:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095e7fc700 1 -- 172.21.15.133:0/393461835 learned_addr learned my addr 172.21.15.133:0/393461835 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095effd700 1 -- 172.21.15.133:0/393461835 >> v1:172.21.15.133:6789/0 conn(0x7f09600afa80 legacy=0x7f09600b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095effd700 1 -- 172.21.15.133:0/393461835 >> v1:172.21.15.16:6789/0 conn(0x7f09600ae900 legacy=0x7f09600aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095dffb700 1 -- 172.21.15.133:0/393461835 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979403801 0 0) 0x7f09600b0ab0 con 0x7f09600afa80 2021-01-03T12:58:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095effd700 1 -- 172.21.15.133:0/393461835 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09600b1240 con 0x7f0960060890 2021-01-03T12:58:13.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095effd700 1 --2- 172.21.15.133:0/393461835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0960060890 0x7f09600abcc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f0950002f30 tx=0x7f0950006dc0).ready entity=mon.1 client_cookie=a482231b2597acbd server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:13.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095dffb700 1 -- 172.21.15.133:0/393461835 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09500097f0 con 0x7f0960060890 2021-01-03T12:58:13.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095dffb700 1 -- 172.21.15.133:0/393461835 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0950009950 con 0x7f0960060890 2021-01-03T12:58:13.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095dffb700 1 -- 172.21.15.133:0/393461835 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0950009cb0 con 0x7f0960060890 2021-01-03T12:58:13.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095ffff700 1 -- 172.21.15.133:0/393461835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0960060890 msgr2=0x7f09600abcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095ffff700 1 --2- 172.21.15.133:0/393461835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0960060890 0x7f09600abcc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f0950002f30 tx=0x7f0950006dc0).stop 2021-01-03T12:58:13.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095ffff700 1 -- 172.21.15.133:0/393461835 shutdown_connections 2021-01-03T12:58:13.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095ffff700 1 --2- 172.21.15.133:0/393461835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0960060890 0x7f09600abcc0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095ffff700 1 -- 172.21.15.133:0/393461835 >> 172.21.15.133:0/393461835 conn(0x7f096005bdf0 msgr2=0x7f096005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:13.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095ffff700 1 -- 172.21.15.133:0/393461835 shutdown_connections 2021-01-03T12:58:13.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.307+0000 7f095ffff700 1 -- 172.21.15.133:0/393461835 wait complete. 2021-01-03T12:58:13.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.311+0000 7f095ffff700 1 Processor -- start 2021-01-03T12:58:13.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.311+0000 7f095ffff700 1 -- start start 2021-01-03T12:58:13.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.311+0000 7f095ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0960060890 0x7f0960137890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.311+0000 7f095ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09600ae900 0x7f09601348b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.311+0000 7f095ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09600afa80 0x7f0960134da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.311+0000 7f095ffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0960067800 con 0x7f09600ae900 2021-01-03T12:58:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.311+0000 7f095ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09600ae140 con 0x7f0960060890 2021-01-03T12:58:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.311+0000 7f095ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09600ae3e0 con 0x7f09600afa80 2021-01-03T12:58:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.311+0000 7f095effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0960060890 0x7f0960137890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.311+0000 7f095effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0960060890 0x7f0960137890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60378/0 (socket says 172.21.15.133:60378) 2021-01-03T12:58:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.311+0000 7f095effd700 1 -- 172.21.15.133:0/2207934232 learned_addr learned my addr 172.21.15.133:0/2207934232 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.315+0000 7f095effd700 1 -- 172.21.15.133:0/2207934232 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09600afa80 msgr2=0x7f0960134da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.315+0000 7f095f7fe700 1 --2- 172.21.15.133:0/2207934232 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09600afa80 0x7f0960134da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.315+0000 7f095effd700 1 --2- 172.21.15.133:0/2207934232 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09600afa80 0x7f0960134da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.315+0000 7f095effd700 1 -- 172.21.15.133:0/2207934232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09600ae900 msgr2=0x7f09601348b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.315+0000 7f095effd700 1 --2- 172.21.15.133:0/2207934232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09600ae900 0x7f09601348b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T12:58:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.315+0000 7f095effd700 1 -- 172.21.15.133:0/2207934232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09600ae680 con 0x7f0960060890 2021-01-03T12:58:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.315+0000 7f095effd700 1 --2- 172.21.15.133:0/2207934232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0960060890 0x7f0960137890 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f0950002f30 tx=0x7f0950015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.315+0000 7f094ffff700 1 -- 172.21.15.133:0/2207934232 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f095001d450 con 0x7f0960060890 2021-01-03T12:58:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.315+0000 7f094ffff700 1 -- 172.21.15.133:0/2207934232 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095001d5b0 con 0x7f0960060890 2021-01-03T12:58:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.315+0000 7f095ffff700 1 -- 172.21.15.133:0/2207934232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0960137d80 con 0x7f0960060890 2021-01-03T12:58:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.315+0000 7f094ffff700 1 -- 172.21.15.133:0/2207934232 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f095001d910 con 0x7f0960060890 2021-01-03T12:58:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.315+0000 7f095ffff700 1 -- 172.21.15.133:0/2207934232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0960135290 con 0x7f0960060890 2021-01-03T12:58:13.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.315+0000 7f095ffff700 1 -- 172.21.15.133:0/2207934232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0960134610 con 0x7f0960060890 2021-01-03T12:58:13.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.315+0000 7f094ffff700 1 -- 172.21.15.133:0/2207934232 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0950024030 con 0x7f0960060890 2021-01-03T12:58:13.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.315+0000 7f094ffff700 1 --2- 172.21.15.133:0/2207934232 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f093c0554e0 0x7f093c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.315+0000 7f095e7fc700 1 --2- 172.21.15.133:0/2207934232 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f093c0554e0 0x7f093c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.315+0000 7f094ffff700 1 -- 172.21.15.133:0/2207934232 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f095006f1f0 con 0x7f0960060890 2021-01-03T12:58:13.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.319+0000 7f095e7fc700 1 --2- 172.21.15.133:0/2207934232 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f093c0554e0 0x7f093c0579a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f0954000b80 tx=0x7f0954007850).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:13.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.323+0000 7f094ffff700 1 -- 172.21.15.133:0/2207934232 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0960134610 con 0x7f0960060890 2021-01-03T12:58:13.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.463+0000 7f095ffff700 1 -- 172.21.15.133:0/2207934232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0960134610 con 0x7f0960060890 2021-01-03T12:58:13.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.463+0000 7f094ffff700 1 -- 172.21.15.133:0/2207934232 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0960134610 con 0x7f0960060890 2021-01-03T12:58:13.464 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T12:58:13.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.463+0000 7f095ffff700 1 -- 172.21.15.133:0/2207934232 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f093c0554e0 msgr2=0x7f093c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.463+0000 7f095ffff700 1 --2- 172.21.15.133:0/2207934232 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f093c0554e0 0x7f093c0579a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f0954000b80 tx=0x7f0954007850).stop 2021-01-03T12:58:13.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.463+0000 7f095ffff700 1 -- 172.21.15.133:0/2207934232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0960060890 msgr2=0x7f0960137890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.463+0000 7f095ffff700 1 --2- 172.21.15.133:0/2207934232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0960060890 0x7f0960137890 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f0950002f30 tx=0x7f0950015000).stop 2021-01-03T12:58:13.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.463+0000 7f095ffff700 1 -- 172.21.15.133:0/2207934232 shutdown_connections 2021-01-03T12:58:13.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.463+0000 7f095ffff700 1 --2- 172.21.15.133:0/2207934232 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f093c0554e0 0x7f093c0579a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.463+0000 7f095ffff700 1 --2- 172.21.15.133:0/2207934232 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09600afa80 0x7f0960134da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.463+0000 7f095ffff700 1 --2- 172.21.15.133:0/2207934232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0960060890 0x7f0960137890 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.463+0000 7f095ffff700 1 --2- 172.21.15.133:0/2207934232 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09600ae900 0x7f09601348b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T12:58:13.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.463+0000 7f095ffff700 1 -- 172.21.15.133:0/2207934232 >> 172.21.15.133:0/2207934232 conn(0x7f096005bdf0 msgr2=0x7f0960069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:13.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.467+0000 7f095ffff700 1 -- 172.21.15.133:0/2207934232 shutdown_connections 2021-01-03T12:58:13.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.467+0000 7f095ffff700 1 -- 172.21.15.133:0/2207934232 wait complete. 2021-01-03T12:58:13.486 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T12:58:13.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ee628700 1 Processor -- start 2021-01-03T12:58:13.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ee628700 1 -- start start 2021-01-03T12:58:13.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ee628700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62e80b4c20 0x7f62e805c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ee628700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f62e805fd10 0x7f62e80b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ee628700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e805bf00 con 0x7f62e8060510 2021-01-03T12:58:13.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ee628700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e805c1a0 con 0x7f62e80b4c20 2021-01-03T12:58:13.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ee628700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e805c440 con 0x7f62e805fd10 2021-01-03T12:58:13.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ed626700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62e80b4c20 0x7f62e805c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ed626700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f62e80b4c20 0x7f62e805c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60388/0 (socket says 172.21.15.133:60388) 2021-01-03T12:58:13.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ed626700 1 -- 172.21.15.133:0/4085442032 learned_addr learned my addr 172.21.15.133:0/4085442032 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:13.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ede27700 1 --2- 172.21.15.133:0/4085442032 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f62e805fd10 0x7f62e80b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ed626700 1 -- 172.21.15.133:0/4085442032 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f62e805fd10 msgr2=0x7f62e80b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:13.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ed626700 1 --2- 172.21.15.133:0/4085442032 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f62e805fd10 0x7f62e80b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ed626700 1 -- 172.21.15.133:0/4085442032 >> v1:172.21.15.16:6789/0 conn(0x7f62e8060510 legacy=0x7f62e80b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ed626700 1 -- 172.21.15.133:0/4085442032 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e80b6ad0 con 0x7f62e80b4c20 2021-01-03T12:58:13.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ed626700 1 --2- 172.21.15.133:0/4085442032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62e80b4c20 0x7f62e805c8e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f62d80032b0 tx=0x7f62d8009270).ready entity=mon.1 client_cookie=af2242f8282f0485 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:13.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62e7fff700 1 -- 172.21.15.133:0/4085442032 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62d8009e60 con 0x7f62e80b4c20 2021-01-03T12:58:13.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62e7fff700 1 -- 172.21.15.133:0/4085442032 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d800bc00 con 0x7f62e80b4c20 2021-01-03T12:58:13.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62e7fff700 1 -- 172.21.15.133:0/4085442032 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62d800bd70 con 0x7f62e80b4c20 2021-01-03T12:58:13.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ee628700 1 -- 172.21.15.133:0/4085442032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62e80b4c20 msgr2=0x7f62e805c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.603+0000 7f62ee628700 1 --2- 172.21.15.133:0/4085442032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62e80b4c20 0x7f62e805c8e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f62d80032b0 tx=0x7f62d8009270).stop 2021-01-03T12:58:13.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ee628700 1 -- 172.21.15.133:0/4085442032 shutdown_connections 2021-01-03T12:58:13.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ee628700 1 --2- 172.21.15.133:0/4085442032 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f62e805fd10 0x7f62e80b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ee628700 1 --2- 172.21.15.133:0/4085442032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62e80b4c20 0x7f62e805c8e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ee628700 1 -- 172.21.15.133:0/4085442032 >> 172.21.15.133:0/4085442032 conn(0x7f62e80b9f00 msgr2=0x7f62e80b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:13.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ee628700 1 -- 172.21.15.133:0/4085442032 shutdown_connections 2021-01-03T12:58:13.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ee628700 1 -- 172.21.15.133:0/4085442032 wait complete. 2021-01-03T12:58:13.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ee628700 1 Processor -- start 2021-01-03T12:58:13.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ee628700 1 -- start start 2021-01-03T12:58:13.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ee628700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f62e805fd10 0x7f62e80b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ee628700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62e8060510 0x7f62e809e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ee628700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62e80b4c20 0x7f62e8155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ee628700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e80b2b10 con 0x7f62e8060510 2021-01-03T12:58:13.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ee628700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e80b2240 con 0x7f62e80b4c20 2021-01-03T12:58:13.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ee628700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e8155090 con 0x7f62e805fd10 2021-01-03T12:58:13.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ede27700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62e80b4c20 0x7f62e8155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ede27700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62e80b4c20 0x7f62e8155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60396/0 (socket says 172.21.15.133:60396) 2021-01-03T12:58:13.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ede27700 1 -- 172.21.15.133:0/3001961672 learned_addr learned my addr 172.21.15.133:0/3001961672 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:13.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ed626700 1 --2- 172.21.15.133:0/3001961672 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f62e805fd10 0x7f62e80b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.607+0000 7f62ece25700 1 --2- 172.21.15.133:0/3001961672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62e8060510 0x7f62e809e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.611+0000 7f62ede27700 1 -- 172.21.15.133:0/3001961672 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f62e805fd10 msgr2=0x7f62e80b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.611+0000 7f62ede27700 1 --2- 172.21.15.133:0/3001961672 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f62e805fd10 0x7f62e80b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.611+0000 7f62ede27700 1 -- 172.21.15.133:0/3001961672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62e8060510 msgr2=0x7f62e809e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.611+0000 7f62ede27700 1 --2- 172.21.15.133:0/3001961672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62e8060510 0x7f62e809e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.611+0000 7f62ede27700 1 -- 172.21.15.133:0/3001961672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e80b2d40 con 0x7f62e80b4c20 2021-01-03T12:58:13.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.611+0000 7f62ece25700 1 --2- 172.21.15.133:0/3001961672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62e8060510 0x7f62e809e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:13.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.611+0000 7f62ede27700 1 --2- 172.21.15.133:0/3001961672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62e80b4c20 0x7f62e8155560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f62e80b3010 tx=0x7f62e0006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:13.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.611+0000 7f62e67fc700 1 -- 172.21.15.133:0/3001961672 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62e000ca10 con 0x7f62e80b4c20 2021-01-03T12:58:13.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.611+0000 7f62e67fc700 1 -- 172.21.15.133:0/3001961672 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e000cb70 con 0x7f62e80b4c20 2021-01-03T12:58:13.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.611+0000 7f62ee628700 1 -- 172.21.15.133:0/3001961672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e80b2470 con 0x7f62e80b4c20 2021-01-03T12:58:13.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.611+0000 7f62e67fc700 1 -- 172.21.15.133:0/3001961672 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62e00123f0 con 0x7f62e80b4c20 2021-01-03T12:58:13.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.611+0000 7f62ee628700 1 -- 172.21.15.133:0/3001961672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e8092770 con 0x7f62e80b4c20 2021-01-03T12:58:13.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.611+0000 7f62ee628700 1 -- 172.21.15.133:0/3001961672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e8057300 con 0x7f62e80b4c20 2021-01-03T12:58:13.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.611+0000 7f62e67fc700 1 -- 172.21.15.133:0/3001961672 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f62e0012550 con 0x7f62e80b4c20 2021-01-03T12:58:13.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.611+0000 7f62e67fc700 1 --2- 172.21.15.133:0/3001961672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62cc0553b0 0x7f62cc057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.611+0000 7f62e67fc700 1 -- 172.21.15.133:0/3001961672 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f62e006e330 con 0x7f62e80b4c20 2021-01-03T12:58:13.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.611+0000 7f62ed626700 1 --2- 172.21.15.133:0/3001961672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62cc0553b0 0x7f62cc057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.615+0000 7f62ed626700 1 --2- 172.21.15.133:0/3001961672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62cc0553b0 0x7f62cc057870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f62d801b000 tx=0x7f62d8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:13.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.619+0000 7f62e67fc700 1 -- 172.21.15.133:0/3001961672 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f62e00445d0 con 0x7f62e80b4c20 2021-01-03T12:58:13.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.759+0000 7f62ee628700 1 -- 172.21.15.133:0/3001961672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f62e8067a00 con 0x7f62e80b4c20 2021-01-03T12:58:13.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.759+0000 7f62e67fc700 1 -- 172.21.15.133:0/3001961672 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f62e0047bf0 con 0x7f62e80b4c20 2021-01-03T12:58:13.761 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:13.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.759+0000 7f62ee628700 1 -- 172.21.15.133:0/3001961672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62cc0553b0 msgr2=0x7f62cc057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.759+0000 7f62ee628700 1 --2- 172.21.15.133:0/3001961672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62cc0553b0 0x7f62cc057870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f62d801b000 tx=0x7f62d8016000).stop 2021-01-03T12:58:13.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.759+0000 7f62ee628700 1 -- 172.21.15.133:0/3001961672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62e80b4c20 msgr2=0x7f62e8155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.759+0000 7f62ee628700 1 --2- 172.21.15.133:0/3001961672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62e80b4c20 0x7f62e8155560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f62e80b3010 tx=0x7f62e0006dc0).stop 2021-01-03T12:58:13.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.759+0000 7f62ee628700 1 -- 172.21.15.133:0/3001961672 shutdown_connections 2021-01-03T12:58:13.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.759+0000 7f62ee628700 1 --2- 172.21.15.133:0/3001961672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62cc0553b0 0x7f62cc057870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.759+0000 7f62ee628700 1 --2- 172.21.15.133:0/3001961672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62e80b4c20 0x7f62e8155560 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.759+0000 7f62ee628700 1 --2- 172.21.15.133:0/3001961672 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f62e805fd10 0x7f62e80b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.763+0000 7f62ee628700 1 --2- 172.21.15.133:0/3001961672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62e8060510 0x7f62e809e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.763+0000 7f62ee628700 1 -- 172.21.15.133:0/3001961672 >> 172.21.15.133:0/3001961672 conn(0x7f62e80b9f00 msgr2=0x7f62e80ae430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:13.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.763+0000 7f62ee628700 1 -- 172.21.15.133:0/3001961672 shutdown_connections 2021-01-03T12:58:13.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.763+0000 7f62ee628700 1 -- 172.21.15.133:0/3001961672 wait complete. 2021-01-03T12:58:13.775 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T12:58:13.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.891+0000 7fb575a4a700 1 Processor -- start 2021-01-03T12:58:13.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.891+0000 7fb575a4a700 1 -- start start 2021-01-03T12:58:13.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.891+0000 7fb575a4a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb5700af060 0x7fb57005bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.891+0000 7fb575a4a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5700679c0 0x7fb570140c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.891+0000 7fb575a4a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5700aa350 con 0x7fb57005c690 2021-01-03T12:58:13.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.891+0000 7fb575a4a700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5700aa5f0 con 0x7fb5700af060 2021-01-03T12:58:13.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.891+0000 7fb575a4a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700aa890 con 0x7fb5700679c0 2021-01-03T12:58:13.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.891+0000 7fb56ffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb57005c690 0x7fb5700672b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53202/0 (socket says 172.21.15.133:53202) 2021-01-03T12:58:13.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.891+0000 7fb56ffff700 1 -- 172.21.15.133:0/1342107682 learned_addr learned my addr 172.21.15.133:0/1342107682 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:13.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.891+0000 7fb574a48700 1 --2- 172.21.15.133:0/1342107682 >> v2:172.21.15.16:3300/0 conn(0x7fb5700af060 0x7fb57005bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.891+0000 7fb575249700 1 --2- 172.21.15.133:0/1342107682 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5700679c0 0x7fb570140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb56f7fe700 1 -- 172.21.15.133:0/1342107682 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783386604 0 0) 0x7fb5700aa350 con 0x7fb57005c690 2021-01-03T12:58:13.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb56f7fe700 1 -- 172.21.15.133:0/1342107682 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb550003230 con 0x7fb57005c690 2021-01-03T12:58:13.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb56f7fe700 1 -- 172.21.15.133:0/1342107682 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1444270519 0 0) 0x7fb550003230 con 0x7fb57005c690 2021-01-03T12:58:13.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb575249700 1 -- 172.21.15.133:0/1342107682 >> v2:172.21.15.16:3300/0 conn(0x7fb5700af060 msgr2=0x7fb57005bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:13.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb575249700 1 --2- 172.21.15.133:0/1342107682 >> v2:172.21.15.16:3300/0 conn(0x7fb5700af060 0x7fb57005bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb575249700 1 -- 172.21.15.133:0/1342107682 >> v1:172.21.15.133:6789/0 conn(0x7fb57005c690 legacy=0x7fb5700672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb575249700 1 -- 172.21.15.133:0/1342107682 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5700aab30 con 0x7fb5700679c0 2021-01-03T12:58:13.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb575249700 1 --2- 172.21.15.133:0/1342107682 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5700679c0 0x7fb570140c80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb558001870 tx=0x7fb5680091a0).ready entity=mon.2 client_cookie=ebcda3aae4359471 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:13.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb56f7fe700 1 -- 172.21.15.133:0/1342107682 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5580016d0 con 0x7fb5700679c0 2021-01-03T12:58:13.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb56f7fe700 1 -- 172.21.15.133:0/1342107682 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56800b800 con 0x7fb5700679c0 2021-01-03T12:58:13.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb56f7fe700 1 -- 172.21.15.133:0/1342107682 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb56800b970 con 0x7fb5700679c0 2021-01-03T12:58:13.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb575a4a700 1 -- 172.21.15.133:0/1342107682 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5700679c0 msgr2=0x7fb570140c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb575a4a700 1 --2- 172.21.15.133:0/1342107682 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5700679c0 0x7fb570140c80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb558001870 tx=0x7fb5680091a0).stop 2021-01-03T12:58:13.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb575a4a700 1 -- 172.21.15.133:0/1342107682 shutdown_connections 2021-01-03T12:58:13.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb575a4a700 1 --2- 172.21.15.133:0/1342107682 >> v2:172.21.15.16:3300/0 conn(0x7fb5700af060 0x7fb57005bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb575a4a700 1 --2- 172.21.15.133:0/1342107682 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5700679c0 0x7fb570140c80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb575a4a700 1 -- 172.21.15.133:0/1342107682 >> 172.21.15.133:0/1342107682 conn(0x7fb57006b050 msgr2=0x7fb570060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:13.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb575a4a700 1 -- 172.21.15.133:0/1342107682 shutdown_connections 2021-01-03T12:58:13.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.895+0000 7fb575a4a700 1 -- 172.21.15.133:0/1342107682 wait complete. 2021-01-03T12:58:13.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb575a4a700 1 Processor -- start 2021-01-03T12:58:13.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb575a4a700 1 -- start start 2021-01-03T12:58:13.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb575a4a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb57005c690 0x7fb5700b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb575a4a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5700679c0 0x7fb570144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb575a4a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5700af060 0x7fb570146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb575a4a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb570141f50 con 0x7fb5700679c0 2021-01-03T12:58:13.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb575a4a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb570144c70 con 0x7fb57005c690 2021-01-03T12:58:13.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb575a4a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5701474a0 con 0x7fb5700af060 2021-01-03T12:58:13.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb574a48700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb57005c690 0x7fb5700b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb574a48700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb57005c690 0x7fb5700b2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60406/0 (socket says 172.21.15.133:60406) 2021-01-03T12:58:13.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb574a48700 1 -- 172.21.15.133:0/1931800454 learned_addr learned my addr 172.21.15.133:0/1931800454 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:13.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb56ffff700 1 --2- 172.21.15.133:0/1931800454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5700679c0 0x7fb570144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb575249700 1 --2- 172.21.15.133:0/1931800454 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5700af060 0x7fb570146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb574a48700 1 -- 172.21.15.133:0/1931800454 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5700af060 msgr2=0x7fb570146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb574a48700 1 --2- 172.21.15.133:0/1931800454 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5700af060 0x7fb570146360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb574a48700 1 -- 172.21.15.133:0/1931800454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5700679c0 msgr2=0x7fb570144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:13.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb574a48700 1 --2- 172.21.15.133:0/1931800454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5700679c0 0x7fb570144780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:13.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb574a48700 1 -- 172.21.15.133:0/1931800454 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb570142180 con 0x7fb57005c690 2021-01-03T12:58:13.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb574a48700 1 --2- 172.21.15.133:0/1931800454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb57005c690 0x7fb5700b2330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fb570147b70 tx=0x7fb560006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:13.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb56dffb700 1 -- 172.21.15.133:0/1931800454 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb56000ca10 con 0x7fb57005c690 2021-01-03T12:58:13.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb56dffb700 1 -- 172.21.15.133:0/1931800454 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56000cb70 con 0x7fb57005c690 2021-01-03T12:58:13.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb575a4a700 1 -- 172.21.15.133:0/1931800454 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb570147740 con 0x7fb57005c690 2021-01-03T12:58:13.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb56dffb700 1 -- 172.21.15.133:0/1931800454 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5600123f0 con 0x7fb57005c690 2021-01-03T12:58:13.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.899+0000 7fb575a4a700 1 -- 172.21.15.133:0/1931800454 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb570145430 con 0x7fb57005c690 2021-01-03T12:58:13.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.903+0000 7fb56dffb700 1 -- 172.21.15.133:0/1931800454 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb560012550 con 0x7fb57005c690 2021-01-03T12:58:13.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.903+0000 7fb575a4a700 1 -- 172.21.15.133:0/1931800454 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb570142310 con 0x7fb57005c690 2021-01-03T12:58:13.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.903+0000 7fb56dffb700 1 --2- 172.21.15.133:0/1931800454 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5540554e0 0x7fb5540579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:13.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.903+0000 7fb56ffff700 1 --2- 172.21.15.133:0/1931800454 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5540554e0 0x7fb5540579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:13.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.903+0000 7fb56dffb700 1 -- 172.21.15.133:0/1931800454 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb56006e240 con 0x7fb57005c690 2021-01-03T12:58:13.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.903+0000 7fb56ffff700 1 --2- 172.21.15.133:0/1931800454 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5540554e0 0x7fb5540579a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb55800d000 tx=0x7fb558000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:13.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:13.907+0000 7fb56dffb700 1 -- 172.21.15.133:0/1931800454 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb560044460 con 0x7fb57005c690 2021-01-03T12:58:14.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.047+0000 7fb575a4a700 1 -- 172.21.15.133:0/1931800454 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb570057300 con 0x7fb57005c690 2021-01-03T12:58:14.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.047+0000 7fb56dffb700 1 -- 172.21.15.133:0/1931800454 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb560047a80 con 0x7fb57005c690 2021-01-03T12:58:14.049 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:14.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.051+0000 7fb575a4a700 1 -- 172.21.15.133:0/1931800454 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5540554e0 msgr2=0x7fb5540579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:14.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.051+0000 7fb575a4a700 1 --2- 172.21.15.133:0/1931800454 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5540554e0 0x7fb5540579a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb55800d000 tx=0x7fb558000b80).stop 2021-01-03T12:58:14.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.051+0000 7fb575a4a700 1 -- 172.21.15.133:0/1931800454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb57005c690 msgr2=0x7fb5700b2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:14.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.051+0000 7fb575a4a700 1 --2- 172.21.15.133:0/1931800454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb57005c690 0x7fb5700b2330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fb570147b70 tx=0x7fb560006dc0).stop 2021-01-03T12:58:14.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.051+0000 7fb575a4a700 1 -- 172.21.15.133:0/1931800454 shutdown_connections 2021-01-03T12:58:14.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.051+0000 7fb575a4a700 1 --2- 172.21.15.133:0/1931800454 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5540554e0 0x7fb5540579a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.051+0000 7fb575a4a700 1 --2- 172.21.15.133:0/1931800454 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5700af060 0x7fb570146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.051+0000 7fb575a4a700 1 --2- 172.21.15.133:0/1931800454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb57005c690 0x7fb5700b2330 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.051+0000 7fb575a4a700 1 --2- 172.21.15.133:0/1931800454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5700679c0 0x7fb570144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.051+0000 7fb575a4a700 1 -- 172.21.15.133:0/1931800454 >> 172.21.15.133:0/1931800454 conn(0x7fb57006b050 msgr2=0x7fb5700b03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:14.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.051+0000 7fb575a4a700 1 -- 172.21.15.133:0/1931800454 shutdown_connections 2021-01-03T12:58:14.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.051+0000 7fb575a4a700 1 -- 172.21.15.133:0/1931800454 wait complete. 2021-01-03T12:58:14.063 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T12:58:14.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe5359cf700 1 Processor -- start 2021-01-03T12:58:14.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe5359cf700 1 -- start start 2021-01-03T12:58:14.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe5359cf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe5300b4c20 0x7fe53005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:14.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe5359cf700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe530060510 0x7fe5300b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:14.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe5359cf700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe53005fd10 0x7fe5300b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:14.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe5359cf700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53005bf00 con 0x7fe53005fd10 2021-01-03T12:58:14.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe5359cf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53005c1a0 con 0x7fe5300b4c20 2021-01-03T12:58:14.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe5359cf700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53005c440 con 0x7fe530060510 2021-01-03T12:58:14.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe5349cd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe5300b4c20 0x7fe53005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:14.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe5349cd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe5300b4c20 0x7fe53005c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60412/0 (socket says 172.21.15.133:60412) 2021-01-03T12:58:14.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe5349cd700 1 -- 172.21.15.133:0/2713932870 learned_addr learned my addr 172.21.15.133:0/2713932870 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:14.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe52ffff700 1 --2- 172.21.15.133:0/2713932870 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe530060510 0x7fe5300b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:14.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe5351ce700 1 --2- 172.21.15.133:0/2713932870 >> v2:172.21.15.16:3300/0 conn(0x7fe53005fd10 0x7fe5300b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:14.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe5349cd700 1 -- 172.21.15.133:0/2713932870 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe530060510 msgr2=0x7fe5300b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:14.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe5349cd700 1 --2- 172.21.15.133:0/2713932870 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe530060510 0x7fe5300b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe5349cd700 1 -- 172.21.15.133:0/2713932870 >> v2:172.21.15.16:3300/0 conn(0x7fe53005fd10 msgr2=0x7fe5300b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:14.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe5349cd700 1 --2- 172.21.15.133:0/2713932870 >> v2:172.21.15.16:3300/0 conn(0x7fe53005fd10 0x7fe5300b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.175+0000 7fe5349cd700 1 -- 172.21.15.133:0/2713932870 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5300b54f0 con 0x7fe5300b4c20 2021-01-03T12:58:14.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5349cd700 1 --2- 172.21.15.133:0/2713932870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5300b4c20 0x7fe53005c8e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fe518002f30 tx=0x7fe518006e80).ready entity=mon.1 client_cookie=81ad17820f12a223 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:14.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe52f7fe700 1 -- 172.21.15.133:0/2713932870 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe518009640 con 0x7fe5300b4c20 2021-01-03T12:58:14.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe52f7fe700 1 -- 172.21.15.133:0/2713932870 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5180097a0 con 0x7fe5300b4c20 2021-01-03T12:58:14.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe52f7fe700 1 -- 172.21.15.133:0/2713932870 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe518009b00 con 0x7fe5300b4c20 2021-01-03T12:58:14.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5359cf700 1 -- 172.21.15.133:0/2713932870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5300b4c20 msgr2=0x7fe53005c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:14.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5359cf700 1 --2- 172.21.15.133:0/2713932870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5300b4c20 0x7fe53005c8e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fe518002f30 tx=0x7fe518006e80).stop 2021-01-03T12:58:14.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5359cf700 1 -- 172.21.15.133:0/2713932870 shutdown_connections 2021-01-03T12:58:14.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5359cf700 1 --2- 172.21.15.133:0/2713932870 >> v2:172.21.15.16:3300/0 conn(0x7fe53005fd10 0x7fe5300b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5359cf700 1 --2- 172.21.15.133:0/2713932870 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5300b4c20 0x7fe53005c8e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5359cf700 1 --2- 172.21.15.133:0/2713932870 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe530060510 0x7fe5300b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5359cf700 1 -- 172.21.15.133:0/2713932870 >> 172.21.15.133:0/2713932870 conn(0x7fe5300b9f00 msgr2=0x7fe5300b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:14.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5359cf700 1 -- 172.21.15.133:0/2713932870 shutdown_connections 2021-01-03T12:58:14.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5359cf700 1 -- 172.21.15.133:0/2713932870 wait complete. 2021-01-03T12:58:14.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5359cf700 1 Processor -- start 2021-01-03T12:58:14.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5359cf700 1 -- start start 2021-01-03T12:58:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5359cf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe53005fd10 0x7fe5300b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5359cf700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe530060510 0x7fe53009e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5359cf700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5300b4c20 0x7fe5300b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:14.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5359cf700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53009f1a0 con 0x7fe530060510 2021-01-03T12:58:14.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5359cf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5300b2be0 con 0x7fe53005fd10 2021-01-03T12:58:14.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.179+0000 7fe5359cf700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5300b38c0 con 0x7fe5300b4c20 2021-01-03T12:58:14.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe5349cd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe53005fd10 0x7fe5300b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:14.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe5349cd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe53005fd10 0x7fe5300b1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60418/0 (socket says 172.21.15.133:60418) 2021-01-03T12:58:14.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe5349cd700 1 -- 172.21.15.133:0/302431376 learned_addr learned my addr 172.21.15.133:0/302431376 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:14.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe5351ce700 1 --2- 172.21.15.133:0/302431376 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5300b4c20 0x7fe5300b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:14.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe52ffff700 1 --2- 172.21.15.133:0/302431376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe530060510 0x7fe53009e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:14.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe5349cd700 1 -- 172.21.15.133:0/302431376 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5300b4c20 msgr2=0x7fe5300b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:14.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe5349cd700 1 --2- 172.21.15.133:0/302431376 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5300b4c20 0x7fe5300b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe5349cd700 1 -- 172.21.15.133:0/302431376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe530060510 msgr2=0x7fe53009e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:14.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe5349cd700 1 --2- 172.21.15.133:0/302431376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe530060510 0x7fe53009e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe5349cd700 1 -- 172.21.15.133:0/302431376 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5300b3b10 con 0x7fe53005fd10 2021-01-03T12:58:14.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe52ffff700 1 --2- 172.21.15.133:0/302431376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe530060510 0x7fe53009e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:14.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe5349cd700 1 --2- 172.21.15.133:0/302431376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe53005fd10 0x7fe5300b1410 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fe5300b4080 tx=0x7fe518015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:14.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe52dffb700 1 -- 172.21.15.133:0/302431376 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe518009e80 con 0x7fe53005fd10 2021-01-03T12:58:14.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe5359cf700 1 -- 172.21.15.133:0/302431376 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5300b3db0 con 0x7fe53005fd10 2021-01-03T12:58:14.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe52dffb700 1 -- 172.21.15.133:0/302431376 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe518011b70 con 0x7fe53005fd10 2021-01-03T12:58:14.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe52dffb700 1 -- 172.21.15.133:0/302431376 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe51801d450 con 0x7fe53005fd10 2021-01-03T12:58:14.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe5359cf700 1 -- 172.21.15.133:0/302431376 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5301422b0 con 0x7fe53005fd10 2021-01-03T12:58:14.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe5359cf700 1 -- 172.21.15.133:0/302431376 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe530142470 con 0x7fe53005fd10 2021-01-03T12:58:14.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe52dffb700 1 -- 172.21.15.133:0/302431376 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe51800f070 con 0x7fe53005fd10 2021-01-03T12:58:14.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe52dffb700 1 --2- 172.21.15.133:0/302431376 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe514055330 0x7fe5140577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:14.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.183+0000 7fe52dffb700 1 -- 172.21.15.133:0/302431376 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe51806f920 con 0x7fe53005fd10 2021-01-03T12:58:14.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.187+0000 7fe52ffff700 1 --2- 172.21.15.133:0/302431376 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe514055330 0x7fe5140577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:14.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.187+0000 7fe52ffff700 1 --2- 172.21.15.133:0/302431376 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe514055330 0x7fe5140577f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fe52000b000 tx=0x7fe520008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:14.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.195+0000 7fe52dffb700 1 -- 172.21.15.133:0/302431376 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe518045c40 con 0x7fe53005fd10 2021-01-03T12:58:14.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.335+0000 7fe5359cf700 1 -- 172.21.15.133:0/302431376 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe530057300 con 0x7fe53005fd10 2021-01-03T12:58:14.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.335+0000 7fe52dffb700 1 -- 172.21.15.133:0/302431376 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fe5180491a0 con 0x7fe53005fd10 2021-01-03T12:58:14.337 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:14.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.335+0000 7fe5359cf700 1 -- 172.21.15.133:0/302431376 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe514055330 msgr2=0x7fe5140577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:14.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.335+0000 7fe5359cf700 1 --2- 172.21.15.133:0/302431376 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe514055330 0x7fe5140577f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fe52000b000 tx=0x7fe520008040).stop 2021-01-03T12:58:14.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.335+0000 7fe5359cf700 1 -- 172.21.15.133:0/302431376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe53005fd10 msgr2=0x7fe5300b1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:14.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.335+0000 7fe5359cf700 1 --2- 172.21.15.133:0/302431376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe53005fd10 0x7fe5300b1410 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fe5300b4080 tx=0x7fe518015000).stop 2021-01-03T12:58:14.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.335+0000 7fe5359cf700 1 -- 172.21.15.133:0/302431376 shutdown_connections 2021-01-03T12:58:14.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.335+0000 7fe5359cf700 1 --2- 172.21.15.133:0/302431376 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe514055330 0x7fe5140577f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.335+0000 7fe5359cf700 1 --2- 172.21.15.133:0/302431376 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5300b4c20 0x7fe5300b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.335+0000 7fe5359cf700 1 --2- 172.21.15.133:0/302431376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe53005fd10 0x7fe5300b1410 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.335+0000 7fe5359cf700 1 --2- 172.21.15.133:0/302431376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe530060510 0x7fe53009e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.335+0000 7fe5359cf700 1 -- 172.21.15.133:0/302431376 >> 172.21.15.133:0/302431376 conn(0x7fe5300b9f00 msgr2=0x7fe53013f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:14.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.335+0000 7fe5359cf700 1 -- 172.21.15.133:0/302431376 shutdown_connections 2021-01-03T12:58:14.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.335+0000 7fe5359cf700 1 -- 172.21.15.133:0/302431376 wait complete. 2021-01-03T12:58:14.350 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T12:58:14.350 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T12:58:14.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee8d73700 1 Processor -- start 2021-01-03T12:58:14.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee8d73700 1 -- start start 2021-01-03T12:58:14.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee8d73700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2ee40b2e00 0x7f2ee4144020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:14.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee8d73700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee409c0b0 con 0x7f2ee40b72b0 2021-01-03T12:58:14.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee8d73700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee40ae480 con 0x7f2ee40b7eb0 2021-01-03T12:58:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee8d73700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee413e750 con 0x7f2ee40b2e00 2021-01-03T12:58:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2ee40b7eb0 0x7f2ee413e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53230/0 (socket says 172.21.15.133:53230) 2021-01-03T12:58:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee3fff700 1 -- 172.21.15.133:0/3683311471 learned_addr learned my addr 172.21.15.133:0/3683311471 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee2ffd700 1 --2- 172.21.15.133:0/3683311471 >> v2:172.21.15.16:3300/0 conn(0x7f2ee40b2e00 0x7f2ee4144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee27fc700 1 -- 172.21.15.133:0/3683311471 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328093988 0 0) 0x7f2ee40ae480 con 0x7f2ee40b7eb0 2021-01-03T12:58:14.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee27fc700 1 -- 172.21.15.133:0/3683311471 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ec8003230 con 0x7f2ee40b7eb0 2021-01-03T12:58:14.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee2ffd700 1 -- 172.21.15.133:0/3683311471 >> v1:172.21.15.133:6789/0 conn(0x7f2ee40b7eb0 legacy=0x7f2ee413e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:14.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee2ffd700 1 -- 172.21.15.133:0/3683311471 >> v1:172.21.15.16:6789/0 conn(0x7f2ee40b72b0 legacy=0x7f2ee40ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:14.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee2ffd700 1 -- 172.21.15.133:0/3683311471 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee409c2e0 con 0x7f2ee40b2e00 2021-01-03T12:58:14.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee2ffd700 1 --2- 172.21.15.133:0/3683311471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ee40b2e00 0x7f2ee4144020 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2edc002f30 tx=0x7f2edc006dc0).ready entity=mon.0 client_cookie=a00a34e8fc08f60e server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:14.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee27fc700 1 -- 172.21.15.133:0/3683311471 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2edc009800 con 0x7f2ee40b2e00 2021-01-03T12:58:14.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee27fc700 1 -- 172.21.15.133:0/3683311471 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2edc009960 con 0x7f2ee40b2e00 2021-01-03T12:58:14.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee27fc700 1 -- 172.21.15.133:0/3683311471 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2edc009cc0 con 0x7f2ee40b2e00 2021-01-03T12:58:14.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee8d73700 1 -- 172.21.15.133:0/3683311471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ee40b2e00 msgr2=0x7f2ee4144020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:14.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.463+0000 7f2ee8d73700 1 --2- 172.21.15.133:0/3683311471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ee40b2e00 0x7f2ee4144020 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2edc002f30 tx=0x7f2edc006dc0).stop 2021-01-03T12:58:14.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee8d73700 1 -- 172.21.15.133:0/3683311471 shutdown_connections 2021-01-03T12:58:14.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee8d73700 1 --2- 172.21.15.133:0/3683311471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ee40b2e00 0x7f2ee4144020 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee8d73700 1 -- 172.21.15.133:0/3683311471 >> 172.21.15.133:0/3683311471 conn(0x7f2ee405bdf0 msgr2=0x7f2ee405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:14.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee8d73700 1 -- 172.21.15.133:0/3683311471 shutdown_connections 2021-01-03T12:58:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee8d73700 1 -- 172.21.15.133:0/3683311471 wait complete. 2021-01-03T12:58:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee8d73700 1 Processor -- start 2021-01-03T12:58:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee8d73700 1 -- start start 2021-01-03T12:58:14.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee8d73700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ee40b2e00 0x7f2ee4140e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:14.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee8d73700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2ee40b72b0 0x7f2ee41435c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:14.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee8d73700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ee40b6c70 0x7f2ee4143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:14.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee8d73700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee41440a0 con 0x7f2ee40b2e00 2021-01-03T12:58:14.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee8d73700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40af860 con 0x7f2ee40b6c70 2021-01-03T12:58:14.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee8d73700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee4142400 con 0x7f2ee40b72b0 2021-01-03T12:58:14.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ee40b6c70 0x7f2ee4143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:14.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ee40b6c70 0x7f2ee4143ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60436/0 (socket says 172.21.15.133:60436) 2021-01-03T12:58:14.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee3fff700 1 -- 172.21.15.133:0/501573942 learned_addr learned my addr 172.21.15.133:0/501573942 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:14.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee37fe700 1 --2- 172.21.15.133:0/501573942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ee40b2e00 0x7f2ee4140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:14.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee2ffd700 1 --2- 172.21.15.133:0/501573942 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2ee40b72b0 0x7f2ee41435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:14.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee3fff700 1 -- 172.21.15.133:0/501573942 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2ee40b72b0 msgr2=0x7f2ee41435c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:14.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee3fff700 1 --2- 172.21.15.133:0/501573942 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2ee40b72b0 0x7f2ee41435c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee3fff700 1 -- 172.21.15.133:0/501573942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ee40b2e00 msgr2=0x7f2ee4140e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:14.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee3fff700 1 --2- 172.21.15.133:0/501573942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ee40b2e00 0x7f2ee4140e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee3fff700 1 -- 172.21.15.133:0/501573942 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee41426a0 con 0x7f2ee40b6c70 2021-01-03T12:58:14.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee3fff700 1 --2- 172.21.15.133:0/501573942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ee40b6c70 0x7f2ee4143ab0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f2ecc001110 tx=0x7f2ecc0079d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:14.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee0ff9700 1 -- 172.21.15.133:0/501573942 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ecc0072e0 con 0x7f2ee40b6c70 2021-01-03T12:58:14.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee0ff9700 1 -- 172.21.15.133:0/501573942 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc007440 con 0x7f2ee40b6c70 2021-01-03T12:58:14.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee0ff9700 1 -- 172.21.15.133:0/501573942 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ecc0057d0 con 0x7f2ee40b6c70 2021-01-03T12:58:14.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee8d73700 1 -- 172.21.15.133:0/501573942 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee41442d0 con 0x7f2ee40b6c70 2021-01-03T12:58:14.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.467+0000 7f2ee8d73700 1 -- 172.21.15.133:0/501573942 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee4152e30 con 0x7f2ee40b6c70 2021-01-03T12:58:14.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.471+0000 7f2ee8d73700 1 -- 172.21.15.133:0/501573942 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee4057300 con 0x7f2ee40b6c70 2021-01-03T12:58:14.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.471+0000 7f2ee0ff9700 1 -- 172.21.15.133:0/501573942 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2ecc010070 con 0x7f2ee40b6c70 2021-01-03T12:58:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.471+0000 7f2ee0ff9700 1 --2- 172.21.15.133:0/501573942 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2ebc055440 0x7f2ebc057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.471+0000 7f2ee0ff9700 1 -- 172.21.15.133:0/501573942 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2ecc06d490 con 0x7f2ee40b6c70 2021-01-03T12:58:14.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.471+0000 7f2ee37fe700 1 --2- 172.21.15.133:0/501573942 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2ebc055440 0x7f2ebc057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:14.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.471+0000 7f2ee37fe700 1 --2- 172.21.15.133:0/501573942 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2ebc055440 0x7f2ebc057900 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f2ed400d000 tx=0x7f2ed4000f00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:14.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.475+0000 7f2ee0ff9700 1 -- 172.21.15.133:0/501573942 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2ecc043790 con 0x7f2ee40b6c70 2021-01-03T12:58:14.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.659+0000 7f2ee8d73700 1 -- 172.21.15.133:0/501573942 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ee405ce00 con 0x7f2ee40b6c70 2021-01-03T12:58:14.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.663+0000 7f2ee0ff9700 1 -- 172.21.15.133:0/501573942 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2489 (secure 0 0 0) 0x7f2ecc046db0 con 0x7f2ee40b6c70 2021-01-03T12:58:14.663 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:14.663 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2255364706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2255364706},{"type":"v1","addr":"172.21.15.16:6833","nonce":2255364706}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/537740959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":537740959},{"type":"v1","addr":"172.21.15.133:6835","nonce":537740959}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T12:58:00.825803+0000","modified":"2021-01-03T12:58:01.829281+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6837/3158570988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3158570988},{"type":"v1","addr":"172.21.15.133:6837","nonce":3158570988}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-03T12:58:14.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.663+0000 7f2ee8d73700 1 -- 172.21.15.133:0/501573942 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2ebc055440 msgr2=0x7f2ebc057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:14.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.663+0000 7f2ee8d73700 1 --2- 172.21.15.133:0/501573942 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2ebc055440 0x7f2ebc057900 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f2ed400d000 tx=0x7f2ed4000f00).stop 2021-01-03T12:58:14.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.663+0000 7f2ee8d73700 1 -- 172.21.15.133:0/501573942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ee40b6c70 msgr2=0x7f2ee4143ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:14.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.663+0000 7f2ee8d73700 1 --2- 172.21.15.133:0/501573942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ee40b6c70 0x7f2ee4143ab0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f2ecc001110 tx=0x7f2ecc0079d0).stop 2021-01-03T12:58:14.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.663+0000 7f2ee8d73700 1 -- 172.21.15.133:0/501573942 shutdown_connections 2021-01-03T12:58:14.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.663+0000 7f2ee8d73700 1 --2- 172.21.15.133:0/501573942 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2ebc055440 0x7f2ebc057900 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.663+0000 7f2ee8d73700 1 --2- 172.21.15.133:0/501573942 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ee40b2e00 0x7f2ee4140e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.663+0000 7f2ee8d73700 1 --2- 172.21.15.133:0/501573942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ee40b6c70 0x7f2ee4143ab0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.663+0000 7f2ee8d73700 1 --2- 172.21.15.133:0/501573942 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2ee40b72b0 0x7f2ee41435c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:14.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.663+0000 7f2ee8d73700 1 -- 172.21.15.133:0/501573942 >> 172.21.15.133:0/501573942 conn(0x7f2ee405bdf0 msgr2=0x7f2ee405fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:14.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.663+0000 7f2ee8d73700 1 -- 172.21.15.133:0/501573942 shutdown_connections 2021-01-03T12:58:14.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:14.663+0000 7f2ee8d73700 1 -- 172.21.15.133:0/501573942 wait complete. 2021-01-03T12:58:14.668 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 5 2021-01-03T12:58:14.980 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T12:58:00.825803+0000', 'modified': '2021-01-03T12:58:01.829281+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4258}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4258': {'gid': 4258, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.133:6837/3158570988', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 3158570988}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 3158570988}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T12:58:14.980 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T12:58:14.981 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T12:58:15.118 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":4258,"want_state":"up:active","state":"up:active","rank_uptime":14.2740194,"mdsmap_epoch":5,"osdmap_epoch":23,"osdmap_epoch_barrier":22,"uptime":17.651319312999998} 2021-01-03T12:58:15.119 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 4258, "mdsmap_epoch": 5, "osdmap_epoch": 23, "osdmap_epoch_barrier": 22, "rank_uptime": 14.2740194, "state": "up:active", "uptime": 17.651319313, "want_state": "up:active", "whoami": 0 } 2021-01-03T12:58:15.120 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T12:58:15.120 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-01-03T12:58:15.121 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi007.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-01-03T12:58:15.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:15.122 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:58:15.152 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T12:58:15.209 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T12:58:15.210 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T12:58:15.264 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T12:58:15.265 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T12:58:15.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:15.266 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T12:58:15.315 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T12:58:15.316 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:58:15.359 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T12:58:15.376 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T12:58:15.377 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T12:58:15.430 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T12:58:15.431 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T12:58:15.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:15.432 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T12:58:15.443 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2021-01-03T12:58:15.439+0000 7fdbb0cf70c0 -1 init, newargv = 0x55d17fb6b2d0 newargc=9 2021-01-03T12:58:15.443 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[11562]: starting ceph client 2021-01-03T12:58:15.454 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[11562]: starting fuse 2021-01-03T12:58:16.548 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T12:58:16.564 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T12:58:16.565 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T12:58:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T12:58:16.621 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T12:58:16.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:16.622 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T12:58:16.671 INFO:teuthology.orchestra.run.smithi007.stdout:50 2021-01-03T12:58:16.672 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T12:58:16.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:16.673 DEBUG:teuthology.orchestra.run.smithi007:> sudo python3 -c ' 2021-01-03T12:58:16.673 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2021-01-03T12:58:16.673 DEBUG:teuthology.orchestra.run.smithi007:> import re 2021-01-03T12:58:16.674 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T12:58:16.674 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2021-01-03T12:58:16.674 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T12:58:16.675 DEBUG:teuthology.orchestra.run.smithi007:> def find_socket(client_name): 2021-01-03T12:58:16.675 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-01-03T12:58:16.675 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2021-01-03T12:58:16.676 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T12:58:16.676 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2021-01-03T12:58:16.676 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2021-01-03T12:58:16.677 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2021-01-03T12:58:16.677 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2021-01-03T12:58:16.678 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T12:58:16.678 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2021-01-03T12:58:16.679 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T12:58:16.679 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T12:58:16.679 DEBUG:teuthology.orchestra.run.smithi007:> return f 2021-01-03T12:58:16.680 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T12:58:16.680 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T12:58:16.681 DEBUG:teuthology.orchestra.run.smithi007:> print(find_socket("client.0")) 2021-01-03T12:58:16.681 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T12:58:16.764 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.11562.asok 2021-01-03T12:58:16.769 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.11562.asok 2021-01-03T12:58:16.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:16.770 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.11562.asok status 2021-01-03T12:58:16.916 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2021-01-03T12:58:16.916 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2021-01-03T12:58:16.917 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T12:58:16.917 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T12:58:16.917 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2021-01-03T12:58:16.917 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2021-01-03T12:58:16.918 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-01-03T12:58:16.918 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "11562", 2021-01-03T12:58:16.918 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2021-01-03T12:58:16.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T12:58:16.918 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2021-01-03T12:58:16.919 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2021-01-03T12:58:16.919 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4451, 2021-01-03T12:58:16.919 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2021-01-03T12:58:16.919 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2021-01-03T12:58:16.919 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2021-01-03T12:58:16.920 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 4451 2021-01-03T12:58:16.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T12:58:16.920 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T12:58:16.920 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T12:58:16.920 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T12:58:16.920 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2151454529 2021-01-03T12:58:16.921 INFO:teuthology.orchestra.run.smithi007.stdout: } 2021-01-03T12:58:16.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T12:58:16.921 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T12:58:16.921 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T12:58:16.921 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T12:58:16.922 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2151454529 2021-01-03T12:58:16.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T12:58:16.922 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.4451 172.21.15.7:0/2151454529", 2021-01-03T12:58:16.922 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "172.21.15.7:0/2151454529", 2021-01-03T12:58:16.922 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2021-01-03T12:58:16.923 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 5, 2021-01-03T12:58:16.923 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 23, 2021-01-03T12:58:16.923 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2021-01-03T12:58:16.923 INFO:teuthology.orchestra.run.smithi007.stdout: "blacklisted": false, 2021-01-03T12:58:16.923 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2021-01-03T12:58:16.924 INFO:teuthology.orchestra.run.smithi007.stdout:} 2021-01-03T12:58:16.928 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:17.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.043+0000 7f05e988f700 1 Processor -- start 2021-01-03T12:58:17.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.043+0000 7f05e988f700 1 -- start start 2021-01-03T12:58:17.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.043+0000 7f05e988f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f05e40b3060 0x7f05e4141660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.043+0000 7f05e988f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05e40b3870 0x7f05e40b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.043+0000 7f05e988f700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e40b24f0 con 0x7f05e405f5e0 2021-01-03T12:58:17.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.043+0000 7f05e988f700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e40b3440 con 0x7f05e40b3060 2021-01-03T12:58:17.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.043+0000 7f05e988f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e4140c80 con 0x7f05e40b3870 2021-01-03T12:58:17.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e888d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f05e40b3060 0x7f05e4141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e3fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05e40b3870 0x7f05e40b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e908e700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f05e405f5e0 0x7f05e413def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:60200/0 (socket says 172.21.15.133:60200) 2021-01-03T12:58:17.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e908e700 1 -- 172.21.15.133:0/1829895316 learned_addr learned my addr 172.21.15.133:0/1829895316 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:17.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e3fff700 1 -- 172.21.15.133:0/1829895316 >> v2:172.21.15.16:3300/0 conn(0x7f05e40b3060 msgr2=0x7f05e4141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:17.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e3fff700 1 --2- 172.21.15.133:0/1829895316 >> v2:172.21.15.16:3300/0 conn(0x7f05e40b3060 0x7f05e4141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e3fff700 1 -- 172.21.15.133:0/1829895316 >> v1:172.21.15.16:6789/0 conn(0x7f05e405f5e0 legacy=0x7f05e413def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e3fff700 1 -- 172.21.15.133:0/1829895316 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e4140f20 con 0x7f05e40b3870 2021-01-03T12:58:17.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e888d700 1 --2- 172.21.15.133:0/1829895316 >> v2:172.21.15.16:3300/0 conn(0x7f05e40b3060 0x7f05e4141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:17.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e3fff700 1 --2- 172.21.15.133:0/1829895316 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05e40b3870 0x7f05e40b1cc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f05cc002f30 tx=0x7f05cc006dc0).ready entity=mon.2 client_cookie=65566102fe9e440f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:17.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e37fe700 1 -- 172.21.15.133:0/1829895316 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05cc009760 con 0x7f05e40b3870 2021-01-03T12:58:17.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e37fe700 1 -- 172.21.15.133:0/1829895316 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc0098c0 con 0x7f05e40b3870 2021-01-03T12:58:17.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e37fe700 1 -- 172.21.15.133:0/1829895316 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05cc009c20 con 0x7f05e40b3870 2021-01-03T12:58:17.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e988f700 1 -- 172.21.15.133:0/1829895316 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05e40b3870 msgr2=0x7f05e40b1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e988f700 1 --2- 172.21.15.133:0/1829895316 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05e40b3870 0x7f05e40b1cc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f05cc002f30 tx=0x7f05cc006dc0).stop 2021-01-03T12:58:17.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e988f700 1 -- 172.21.15.133:0/1829895316 shutdown_connections 2021-01-03T12:58:17.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e988f700 1 --2- 172.21.15.133:0/1829895316 >> v2:172.21.15.16:3300/0 conn(0x7f05e40b3060 0x7f05e4141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e988f700 1 --2- 172.21.15.133:0/1829895316 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05e40b3870 0x7f05e40b1cc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e988f700 1 -- 172.21.15.133:0/1829895316 >> 172.21.15.133:0/1829895316 conn(0x7f05e40b7200 msgr2=0x7f05e40b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:17.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e988f700 1 -- 172.21.15.133:0/1829895316 shutdown_connections 2021-01-03T12:58:17.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.047+0000 7f05e988f700 1 -- 172.21.15.133:0/1829895316 wait complete. 2021-01-03T12:58:17.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e988f700 1 Processor -- start 2021-01-03T12:58:17.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e988f700 1 -- start start 2021-01-03T12:58:17.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e988f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05e405f5e0 0x7f05e40ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e988f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05e40b3060 0x7f05e4152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e988f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05e40b3870 0x7f05e4155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e988f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e4151e50 con 0x7f05e40b3870 2021-01-03T12:58:17.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e988f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e40b4f80 con 0x7f05e40b3060 2021-01-03T12:58:17.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e988f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e4152040 con 0x7f05e405f5e0 2021-01-03T12:58:17.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05e40b3060 0x7f05e4152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05e40b3060 0x7f05e4152780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60446/0 (socket says 172.21.15.133:60446) 2021-01-03T12:58:17.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e3fff700 1 -- 172.21.15.133:0/2257725865 learned_addr learned my addr 172.21.15.133:0/2257725865 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:17.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e888d700 1 --2- 172.21.15.133:0/2257725865 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05e405f5e0 0x7f05e40ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e908e700 1 --2- 172.21.15.133:0/2257725865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05e40b3870 0x7f05e4155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e3fff700 1 -- 172.21.15.133:0/2257725865 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05e405f5e0 msgr2=0x7f05e40ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e3fff700 1 --2- 172.21.15.133:0/2257725865 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05e405f5e0 0x7f05e40ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e3fff700 1 -- 172.21.15.133:0/2257725865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05e40b3870 msgr2=0x7f05e4155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e3fff700 1 --2- 172.21.15.133:0/2257725865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05e40b3870 0x7f05e4155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e3fff700 1 -- 172.21.15.133:0/2257725865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e41522e0 con 0x7f05e40b3060 2021-01-03T12:58:17.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e888d700 1 --2- 172.21.15.133:0/2257725865 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05e405f5e0 0x7f05e40ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:17.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e3fff700 1 --2- 172.21.15.133:0/2257725865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05e40b3060 0x7f05e4152780 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f05e4063530 tx=0x7f05cc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:17.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e1ffb700 1 -- 172.21.15.133:0/2257725865 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05cc0119b0 con 0x7f05e40b3060 2021-01-03T12:58:17.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e1ffb700 1 -- 172.21.15.133:0/2257725865 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc011b10 con 0x7f05e40b3060 2021-01-03T12:58:17.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e1ffb700 1 -- 172.21.15.133:0/2257725865 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05cc011e70 con 0x7f05e40b3060 2021-01-03T12:58:17.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e988f700 1 -- 172.21.15.133:0/2257725865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e40aeda0 con 0x7f05e40b3060 2021-01-03T12:58:17.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e988f700 1 -- 172.21.15.133:0/2257725865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e4152c70 con 0x7f05e40b3060 2021-01-03T12:58:17.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.051+0000 7f05e988f700 1 -- 172.21.15.133:0/2257725865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e40b5140 con 0x7f05e40b3060 2021-01-03T12:58:17.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.055+0000 7f05e1ffb700 1 -- 172.21.15.133:0/2257725865 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f05cc024030 con 0x7f05e40b3060 2021-01-03T12:58:17.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.055+0000 7f05e1ffb700 1 --2- 172.21.15.133:0/2257725865 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f05c8055330 0x7f05c80577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.055+0000 7f05e1ffb700 1 -- 172.21.15.133:0/2257725865 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f05cc06ecb0 con 0x7f05e40b3060 2021-01-03T12:58:17.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.055+0000 7f05e888d700 1 --2- 172.21.15.133:0/2257725865 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f05c8055330 0x7f05c80577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.055+0000 7f05e888d700 1 --2- 172.21.15.133:0/2257725865 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f05c8055330 0x7f05c80577f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f05d400b000 tx=0x7f05d4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:17.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.063+0000 7f05e1ffb700 1 -- 172.21.15.133:0/2257725865 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f05cc044fb0 con 0x7f05e40b3060 2021-01-03T12:58:17.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.203+0000 7f05e988f700 1 -- 172.21.15.133:0/2257725865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05e4057300 con 0x7f05e40b3060 2021-01-03T12:58:17.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.203+0000 7f05e1ffb700 1 -- 172.21.15.133:0/2257725865 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f05cc022020 con 0x7f05e40b3060 2021-01-03T12:58:17.205 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:17.206 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":23,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:01.829379+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:57:58.934952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-03T12:57:59.830134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:17.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.207+0000 7f05e988f700 1 -- 172.21.15.133:0/2257725865 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f05c8055330 msgr2=0x7f05c80577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.207+0000 7f05e988f700 1 --2- 172.21.15.133:0/2257725865 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f05c8055330 0x7f05c80577f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f05d400b000 tx=0x7f05d4008040).stop 2021-01-03T12:58:17.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.207+0000 7f05e988f700 1 -- 172.21.15.133:0/2257725865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05e40b3060 msgr2=0x7f05e4152780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.207+0000 7f05e988f700 1 --2- 172.21.15.133:0/2257725865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05e40b3060 0x7f05e4152780 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f05e4063530 tx=0x7f05cc015000).stop 2021-01-03T12:58:17.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.207+0000 7f05e988f700 1 -- 172.21.15.133:0/2257725865 shutdown_connections 2021-01-03T12:58:17.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.207+0000 7f05e988f700 1 --2- 172.21.15.133:0/2257725865 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f05c8055330 0x7f05c80577f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.207+0000 7f05e988f700 1 --2- 172.21.15.133:0/2257725865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05e40b3870 0x7f05e4155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.207+0000 7f05e988f700 1 --2- 172.21.15.133:0/2257725865 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05e405f5e0 0x7f05e40ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.207+0000 7f05e988f700 1 --2- 172.21.15.133:0/2257725865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05e40b3060 0x7f05e4152780 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.207+0000 7f05e988f700 1 -- 172.21.15.133:0/2257725865 >> 172.21.15.133:0/2257725865 conn(0x7f05e40b7200 msgr2=0x7f05e413ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:17.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.207+0000 7f05e988f700 1 -- 172.21.15.133:0/2257725865 shutdown_connections 2021-01-03T12:58:17.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.207+0000 7f05e988f700 1 -- 172.21.15.133:0/2257725865 wait complete. 2021-01-03T12:58:17.223 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T12:57:58.934952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T12:57:59.830134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T12:58:17.224 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T12:58:17.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.339+0000 7fcebabfd700 1 Processor -- start 2021-01-03T12:58:17.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.339+0000 7fcebabfd700 1 -- start start 2021-01-03T12:58:17.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fcebabfd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fceb405c130 0x7fceb40b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fcebabfd700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb405c510 con 0x7fceb40622f0 2021-01-03T12:58:17.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fcebabfd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb40b15a0 con 0x7fceb40b02b0 2021-01-03T12:58:17.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fcebabfd700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb41473d0 con 0x7fceb405c130 2021-01-03T12:58:17.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fceb93fa700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fceb40b02b0 0x7fceb40668a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53254/0 (socket says 172.21.15.133:53254) 2021-01-03T12:58:17.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fceb93fa700 1 -- 172.21.15.133:0/3068905586 learned_addr learned my addr 172.21.15.133:0/3068905586 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:17.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fceb9bfb700 1 --2- 172.21.15.133:0/3068905586 >> v2:172.21.15.16:3300/0 conn(0x7fceb405c130 0x7fceb40b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fceb8bf9700 1 -- 172.21.15.133:0/3068905586 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945583820 0 0) 0x7fceb40b15a0 con 0x7fceb40b02b0 2021-01-03T12:58:17.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fceb8bf9700 1 -- 172.21.15.133:0/3068905586 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce9c003230 con 0x7fceb40b02b0 2021-01-03T12:58:17.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fceb9bfb700 1 -- 172.21.15.133:0/3068905586 >> v1:172.21.15.133:6789/0 conn(0x7fceb40b02b0 legacy=0x7fceb40668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fceb9bfb700 1 -- 172.21.15.133:0/3068905586 >> v1:172.21.15.16:6789/0 conn(0x7fceb40622f0 legacy=0x7fceb414d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fceb9bfb700 1 -- 172.21.15.133:0/3068905586 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb4061920 con 0x7fceb405c130 2021-01-03T12:58:17.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fceb9bfb700 1 --2- 172.21.15.133:0/3068905586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceb405c130 0x7fceb40b1a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fceac0032b0 tx=0x7fceac0091a0).ready entity=mon.0 client_cookie=e6b44ea574612b1f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:17.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fceb8bf9700 1 -- 172.21.15.133:0/3068905586 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fceac00b9a0 con 0x7fceb405c130 2021-01-03T12:58:17.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fceb8bf9700 1 -- 172.21.15.133:0/3068905586 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac00bb00 con 0x7fceb405c130 2021-01-03T12:58:17.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fceb8bf9700 1 -- 172.21.15.133:0/3068905586 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fceac00bc70 con 0x7fceb405c130 2021-01-03T12:58:17.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fcebabfd700 1 -- 172.21.15.133:0/3068905586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceb405c130 msgr2=0x7fceb40b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fcebabfd700 1 --2- 172.21.15.133:0/3068905586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceb405c130 0x7fceb40b1a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fceac0032b0 tx=0x7fceac0091a0).stop 2021-01-03T12:58:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fcebabfd700 1 -- 172.21.15.133:0/3068905586 shutdown_connections 2021-01-03T12:58:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fcebabfd700 1 --2- 172.21.15.133:0/3068905586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceb405c130 0x7fceb40b1a00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fcebabfd700 1 -- 172.21.15.133:0/3068905586 >> 172.21.15.133:0/3068905586 conn(0x7fceb40b6110 msgr2=0x7fceb40b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fcebabfd700 1 -- 172.21.15.133:0/3068905586 shutdown_connections 2021-01-03T12:58:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.343+0000 7fcebabfd700 1 -- 172.21.15.133:0/3068905586 wait complete. 2021-01-03T12:58:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fcebabfd700 1 Processor -- start 2021-01-03T12:58:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fcebabfd700 1 -- start start 2021-01-03T12:58:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fcebabfd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fceb405c130 0x7fceb41408f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fcebabfd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceb40622f0 0x7fceb41496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fcebabfd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceb40b02b0 0x7fceb4149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fcebabfd700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb4068660 con 0x7fceb40622f0 2021-01-03T12:58:17.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fcebabfd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb4144a00 con 0x7fceb40b02b0 2021-01-03T12:58:17.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fcebabfd700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb41418f0 con 0x7fceb405c130 2021-01-03T12:58:17.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fceba3fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceb40b02b0 0x7fceb4149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fceba3fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceb40b02b0 0x7fceb4149be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60462/0 (socket says 172.21.15.133:60462) 2021-01-03T12:58:17.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fceba3fc700 1 -- 172.21.15.133:0/3831129538 learned_addr learned my addr 172.21.15.133:0/3831129538 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:17.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fceb93fa700 1 --2- 172.21.15.133:0/3831129538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceb40622f0 0x7fceb41496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fceb9bfb700 1 --2- 172.21.15.133:0/3831129538 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fceb405c130 0x7fceb41408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fceba3fc700 1 -- 172.21.15.133:0/3831129538 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fceb405c130 msgr2=0x7fceb41408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fceba3fc700 1 --2- 172.21.15.133:0/3831129538 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fceb405c130 0x7fceb41408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fceba3fc700 1 -- 172.21.15.133:0/3831129538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceb40622f0 msgr2=0x7fceb41496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fceba3fc700 1 --2- 172.21.15.133:0/3831129538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceb40622f0 0x7fceb41496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fceba3fc700 1 -- 172.21.15.133:0/3831129538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb4141b90 con 0x7fceb40b02b0 2021-01-03T12:58:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fceba3fc700 1 --2- 172.21.15.133:0/3831129538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceb40b02b0 0x7fceb4149be0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fceb40b6cd0 tx=0x7fceb0007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fcea2ffd700 1 -- 172.21.15.133:0/3831129538 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fceb0013410 con 0x7fceb40b02b0 2021-01-03T12:58:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fcea2ffd700 1 -- 172.21.15.133:0/3831129538 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb0013570 con 0x7fceb40b02b0 2021-01-03T12:58:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fcebabfd700 1 -- 172.21.15.133:0/3831129538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb41442c0 con 0x7fceb40b02b0 2021-01-03T12:58:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fcea2ffd700 1 -- 172.21.15.133:0/3831129538 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fceb00138d0 con 0x7fceb40b02b0 2021-01-03T12:58:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.347+0000 7fcebabfd700 1 -- 172.21.15.133:0/3831129538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb414a270 con 0x7fceb40b02b0 2021-01-03T12:58:17.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.351+0000 7fcebabfd700 1 -- 172.21.15.133:0/3831129538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb4144bd0 con 0x7fceb40b02b0 2021-01-03T12:58:17.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.351+0000 7fcea2ffd700 1 -- 172.21.15.133:0/3831129538 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fceb0010030 con 0x7fceb40b02b0 2021-01-03T12:58:17.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.351+0000 7fcea2ffd700 1 --2- 172.21.15.133:0/3831129538 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fce94055440 0x7fce94057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.351+0000 7fcea2ffd700 1 -- 172.21.15.133:0/3831129538 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fceb0001e40 con 0x7fceb40b02b0 2021-01-03T12:58:17.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.351+0000 7fceb9bfb700 1 --2- 172.21.15.133:0/3831129538 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fce94055440 0x7fce94057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.351+0000 7fceb9bfb700 1 --2- 172.21.15.133:0/3831129538 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fce94055440 0x7fce94057900 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fceac01b000 tx=0x7fceac016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:17.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.355+0000 7fcea2ffd700 1 -- 172.21.15.133:0/3831129538 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fceb0043ef0 con 0x7fceb40b02b0 2021-01-03T12:58:17.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.495+0000 7fcebabfd700 1 -- 172.21.15.133:0/3831129538 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fceb4141d20 con 0x7fceb40b02b0 2021-01-03T12:58:17.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.495+0000 7fcea2ffd700 1 -- 172.21.15.133:0/3831129538 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7fceb0047510 con 0x7fceb40b02b0 2021-01-03T12:58:17.498 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T12:58:17.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.499+0000 7fcebabfd700 1 -- 172.21.15.133:0/3831129538 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fce94055440 msgr2=0x7fce94057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.499+0000 7fcebabfd700 1 --2- 172.21.15.133:0/3831129538 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fce94055440 0x7fce94057900 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fceac01b000 tx=0x7fceac016000).stop 2021-01-03T12:58:17.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.499+0000 7fcebabfd700 1 -- 172.21.15.133:0/3831129538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceb40b02b0 msgr2=0x7fceb4149be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.499+0000 7fcebabfd700 1 --2- 172.21.15.133:0/3831129538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceb40b02b0 0x7fceb4149be0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fceb40b6cd0 tx=0x7fceb0007b90).stop 2021-01-03T12:58:17.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.499+0000 7fcebabfd700 1 -- 172.21.15.133:0/3831129538 shutdown_connections 2021-01-03T12:58:17.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.499+0000 7fcebabfd700 1 --2- 172.21.15.133:0/3831129538 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fce94055440 0x7fce94057900 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.499+0000 7fcebabfd700 1 --2- 172.21.15.133:0/3831129538 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fceb40b02b0 0x7fceb4149be0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.499+0000 7fcebabfd700 1 --2- 172.21.15.133:0/3831129538 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fceb405c130 0x7fceb41408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.499+0000 7fcebabfd700 1 --2- 172.21.15.133:0/3831129538 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fceb40622f0 0x7fceb41496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.499+0000 7fcebabfd700 1 -- 172.21.15.133:0/3831129538 >> 172.21.15.133:0/3831129538 conn(0x7fceb40b6110 msgr2=0x7fceb40b5460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:17.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.499+0000 7fcebabfd700 1 -- 172.21.15.133:0/3831129538 shutdown_connections 2021-01-03T12:58:17.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.499+0000 7fcebabfd700 1 -- 172.21.15.133:0/3831129538 wait complete. 2021-01-03T12:58:17.511 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T12:58:17.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.623+0000 7fc34bfff700 1 Processor -- start 2021-01-03T12:58:17.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.623+0000 7fc34bfff700 1 -- start start 2021-01-03T12:58:17.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.623+0000 7fc34bfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc34c05f920 0x7fc34c0b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.623+0000 7fc34bfff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34c05fd00 con 0x7fc34c0b1590 2021-01-03T12:58:17.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc34bfff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc34c0accd0 con 0x7fc34c066f30 2021-01-03T12:58:17.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc34bfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c0b2980 con 0x7fc34c05f920 2021-01-03T12:58:17.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc34a7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc34c066f30 0x7fc34c0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53270/0 (socket says 172.21.15.133:53270) 2021-01-03T12:58:17.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc34a7fc700 1 -- 172.21.15.133:0/3749162163 learned_addr learned my addr 172.21.15.133:0/3749162163 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:17.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc34affd700 1 --2- 172.21.15.133:0/3749162163 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc34c05f920 0x7fc34c0b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc349ffb700 1 -- 172.21.15.133:0/3749162163 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973781023 0 0) 0x7fc34c0accd0 con 0x7fc34c066f30 2021-01-03T12:58:17.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc349ffb700 1 -- 172.21.15.133:0/3749162163 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc32c003230 con 0x7fc34c066f30 2021-01-03T12:58:17.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc349ffb700 1 -- 172.21.15.133:0/3749162163 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535447025 0 0) 0x7fc34c05fd00 con 0x7fc34c0b1590 2021-01-03T12:58:17.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc34affd700 1 -- 172.21.15.133:0/3749162163 >> v1:172.21.15.133:6789/0 conn(0x7fc34c066f30 legacy=0x7fc34c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc34affd700 1 -- 172.21.15.133:0/3749162163 >> v1:172.21.15.16:6789/0 conn(0x7fc34c0b1590 legacy=0x7fc34c13ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc34affd700 1 -- 172.21.15.133:0/3749162163 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c0acf70 con 0x7fc34c05f920 2021-01-03T12:58:17.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc34affd700 1 --2- 172.21.15.133:0/3749162163 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc34c05f920 0x7fc34c0b0ab0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc33c0032b0 tx=0x7fc33c0091a0).ready entity=mon.2 client_cookie=6b73095a6d0bba1f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:17.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc349ffb700 1 -- 172.21.15.133:0/3749162163 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc33c00b9f0 con 0x7fc34c05f920 2021-01-03T12:58:17.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc349ffb700 1 -- 172.21.15.133:0/3749162163 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c00bb50 con 0x7fc34c05f920 2021-01-03T12:58:17.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc349ffb700 1 -- 172.21.15.133:0/3749162163 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc33c00bcc0 con 0x7fc34c05f920 2021-01-03T12:58:17.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc34bfff700 1 -- 172.21.15.133:0/3749162163 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc34c05f920 msgr2=0x7fc34c0b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc34bfff700 1 --2- 172.21.15.133:0/3749162163 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc34c05f920 0x7fc34c0b0ab0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fc33c0032b0 tx=0x7fc33c0091a0).stop 2021-01-03T12:58:17.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc34bfff700 1 -- 172.21.15.133:0/3749162163 shutdown_connections 2021-01-03T12:58:17.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc34bfff700 1 --2- 172.21.15.133:0/3749162163 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc34c05f920 0x7fc34c0b0ab0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc34bfff700 1 -- 172.21.15.133:0/3749162163 >> 172.21.15.133:0/3749162163 conn(0x7fc34c0b6110 msgr2=0x7fc34c0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:17.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc34bfff700 1 -- 172.21.15.133:0/3749162163 shutdown_connections 2021-01-03T12:58:17.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc34bfff700 1 -- 172.21.15.133:0/3749162163 wait complete. 2021-01-03T12:58:17.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.627+0000 7fc34bfff700 1 Processor -- start 2021-01-03T12:58:17.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34bfff700 1 -- start start 2021-01-03T12:58:17.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc34c05f920 0x7fc34c13f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34bfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc34c066f30 0x7fc34c064830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc34c0b1590 0x7fc34c064d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34bfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c139300 con 0x7fc34c0b1590 2021-01-03T12:58:17.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34bfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c13c140 con 0x7fc34c05f920 2021-01-03T12:58:17.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34bfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34c05ca60 con 0x7fc34c066f30 2021-01-03T12:58:17.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc34c05f920 0x7fc34c13f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc34c05f920 0x7fc34c13f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60474/0 (socket says 172.21.15.133:60474) 2021-01-03T12:58:17.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34affd700 1 -- 172.21.15.133:0/4011986335 learned_addr learned my addr 172.21.15.133:0/4011986335 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:17.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34a7fc700 1 --2- 172.21.15.133:0/4011986335 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc34c066f30 0x7fc34c064830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34b7fe700 1 --2- 172.21.15.133:0/4011986335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc34c0b1590 0x7fc34c064d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34affd700 1 -- 172.21.15.133:0/4011986335 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc34c066f30 msgr2=0x7fc34c064830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34affd700 1 --2- 172.21.15.133:0/4011986335 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc34c066f30 0x7fc34c064830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34affd700 1 -- 172.21.15.133:0/4011986335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc34c0b1590 msgr2=0x7fc34c064d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34affd700 1 --2- 172.21.15.133:0/4011986335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc34c0b1590 0x7fc34c064d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34affd700 1 -- 172.21.15.133:0/4011986335 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c13bc70 con 0x7fc34c05f920 2021-01-03T12:58:17.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34affd700 1 --2- 172.21.15.133:0/4011986335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc34c05f920 0x7fc34c13f7c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fc33c0032b0 tx=0x7fc33c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:17.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc343fff700 1 -- 172.21.15.133:0/4011986335 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc33c0107a0 con 0x7fc34c05f920 2021-01-03T12:58:17.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc343fff700 1 -- 172.21.15.133:0/4011986335 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c010900 con 0x7fc34c05f920 2021-01-03T12:58:17.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34bfff700 1 -- 172.21.15.133:0/4011986335 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34c151790 con 0x7fc34c05f920 2021-01-03T12:58:17.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc343fff700 1 -- 172.21.15.133:0/4011986335 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc33c010c60 con 0x7fc34c05f920 2021-01-03T12:58:17.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.631+0000 7fc34bfff700 1 -- 172.21.15.133:0/4011986335 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc34c13b7a0 con 0x7fc34c05f920 2021-01-03T12:58:17.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.635+0000 7fc34bfff700 1 -- 172.21.15.133:0/4011986335 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34c1515c0 con 0x7fc34c05f920 2021-01-03T12:58:17.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.635+0000 7fc343fff700 1 -- 172.21.15.133:0/4011986335 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc33c00f070 con 0x7fc34c05f920 2021-01-03T12:58:17.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.635+0000 7fc343fff700 1 --2- 172.21.15.133:0/4011986335 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3300553b0 0x7fc330057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.635+0000 7fc343fff700 1 -- 172.21.15.133:0/4011986335 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc33c06ee40 con 0x7fc34c05f920 2021-01-03T12:58:17.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.635+0000 7fc34a7fc700 1 --2- 172.21.15.133:0/4011986335 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3300553b0 0x7fc330057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.635+0000 7fc34a7fc700 1 --2- 172.21.15.133:0/4011986335 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3300553b0 0x7fc330057870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fc33400b000 tx=0x7fc334009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:17.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.643+0000 7fc343fff700 1 -- 172.21.15.133:0/4011986335 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc33c0450a0 con 0x7fc34c05f920 2021-01-03T12:58:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.775+0000 7fc34bfff700 1 -- 172.21.15.133:0/4011986335 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc34c057300 con 0x7fc34c05f920 2021-01-03T12:58:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.779+0000 7fc343fff700 1 -- 172.21.15.133:0/4011986335 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc33c0486c0 con 0x7fc34c05f920 2021-01-03T12:58:17.780 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:17.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.779+0000 7fc34bfff700 1 -- 172.21.15.133:0/4011986335 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3300553b0 msgr2=0x7fc330057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.779+0000 7fc34bfff700 1 --2- 172.21.15.133:0/4011986335 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3300553b0 0x7fc330057870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fc33400b000 tx=0x7fc334009040).stop 2021-01-03T12:58:17.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.779+0000 7fc34bfff700 1 -- 172.21.15.133:0/4011986335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc34c05f920 msgr2=0x7fc34c13f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.779+0000 7fc34bfff700 1 --2- 172.21.15.133:0/4011986335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc34c05f920 0x7fc34c13f7c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fc33c0032b0 tx=0x7fc33c016000).stop 2021-01-03T12:58:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.779+0000 7fc34bfff700 1 -- 172.21.15.133:0/4011986335 shutdown_connections 2021-01-03T12:58:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.779+0000 7fc34bfff700 1 --2- 172.21.15.133:0/4011986335 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3300553b0 0x7fc330057870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.779+0000 7fc34bfff700 1 --2- 172.21.15.133:0/4011986335 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc34c0b1590 0x7fc34c064d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.779+0000 7fc34bfff700 1 --2- 172.21.15.133:0/4011986335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc34c05f920 0x7fc34c13f7c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.779+0000 7fc34bfff700 1 --2- 172.21.15.133:0/4011986335 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc34c066f30 0x7fc34c064830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.779+0000 7fc34bfff700 1 -- 172.21.15.133:0/4011986335 >> 172.21.15.133:0/4011986335 conn(0x7fc34c0b6110 msgr2=0x7fc34c0ad650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:17.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.779+0000 7fc34bfff700 1 -- 172.21.15.133:0/4011986335 shutdown_connections 2021-01-03T12:58:17.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.779+0000 7fc34bfff700 1 -- 172.21.15.133:0/4011986335 wait complete. 2021-01-03T12:58:17.792 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T12:58:17.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.907+0000 7f36b359e700 1 Processor -- start 2021-01-03T12:58:17.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.907+0000 7f36b359e700 1 -- start start 2021-01-03T12:58:17.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.907+0000 7f36b359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f36b40b4c20 0x7f36b405c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.907+0000 7f36b359e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b40b6cf0 con 0x7f36b405fd10 2021-01-03T12:58:17.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.907+0000 7f36b359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b405bf00 con 0x7f36b4060510 2021-01-03T12:58:17.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.907+0000 7f36b359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b405c1a0 con 0x7f36b40b4c20 2021-01-03T12:58:17.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.907+0000 7f36abfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f36b4060510 0x7f36b40b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53282/0 (socket says 172.21.15.133:53282) 2021-01-03T12:58:17.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.907+0000 7f36b259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f36b40b4c20 0x7f36b405c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.907+0000 7f36abfff700 1 -- 172.21.15.133:0/3255796824 learned_addr learned my addr 172.21.15.133:0/3255796824 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:17.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.907+0000 7f36b1d9b700 1 -- 172.21.15.133:0/3255796824 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3894817929 0 0) 0x7f36b405bf00 con 0x7f36b4060510 2021-01-03T12:58:17.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.907+0000 7f36b1d9b700 1 -- 172.21.15.133:0/3255796824 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3694003230 con 0x7f36b4060510 2021-01-03T12:58:17.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.907+0000 7f36b259c700 1 -- 172.21.15.133:0/3255796824 >> v1:172.21.15.133:6789/0 conn(0x7f36b4060510 legacy=0x7f36b40b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.907+0000 7f36b259c700 1 -- 172.21.15.133:0/3255796824 >> v1:172.21.15.16:6789/0 conn(0x7f36b405fd10 legacy=0x7f36b40b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.907+0000 7f36b259c700 1 -- 172.21.15.133:0/3255796824 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b405c440 con 0x7f36b40b4c20 2021-01-03T12:58:17.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.907+0000 7f36b259c700 1 --2- 172.21.15.133:0/3255796824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b40b4c20 0x7f36b405c8e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f369c002f30 tx=0x7f369c006dc0).ready entity=mon.1 client_cookie=f777005eed9a886f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:17.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.907+0000 7f36b1d9b700 1 -- 172.21.15.133:0/3255796824 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f369c009800 con 0x7f36b40b4c20 2021-01-03T12:58:17.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b1d9b700 1 -- 172.21.15.133:0/3255796824 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c009960 con 0x7f36b40b4c20 2021-01-03T12:58:17.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b1d9b700 1 -- 172.21.15.133:0/3255796824 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f369c009cc0 con 0x7f36b40b4c20 2021-01-03T12:58:17.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b359e700 1 -- 172.21.15.133:0/3255796824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b40b4c20 msgr2=0x7f36b405c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b359e700 1 --2- 172.21.15.133:0/3255796824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b40b4c20 0x7f36b405c8e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f369c002f30 tx=0x7f369c006dc0).stop 2021-01-03T12:58:17.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b359e700 1 -- 172.21.15.133:0/3255796824 shutdown_connections 2021-01-03T12:58:17.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b359e700 1 --2- 172.21.15.133:0/3255796824 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b40b4c20 0x7f36b405c8e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b359e700 1 -- 172.21.15.133:0/3255796824 >> 172.21.15.133:0/3255796824 conn(0x7f36b40b9f00 msgr2=0x7f36b40b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:17.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b359e700 1 -- 172.21.15.133:0/3255796824 shutdown_connections 2021-01-03T12:58:17.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b359e700 1 -- 172.21.15.133:0/3255796824 wait complete. 2021-01-03T12:58:17.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b359e700 1 Processor -- start 2021-01-03T12:58:17.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b359e700 1 -- start start 2021-01-03T12:58:17.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36b405fd10 0x7f36b409e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4060510 0x7f36b4155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36b40b4c20 0x7f36b4155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:17.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b359e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b4155d60 con 0x7f36b40b4c20 2021-01-03T12:58:17.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b4143340 con 0x7f36b4060510 2021-01-03T12:58:17.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b41435e0 con 0x7f36b405fd10 2021-01-03T12:58:17.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36abfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4060510 0x7f36b4155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36abfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4060510 0x7f36b4155380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60488/0 (socket says 172.21.15.133:60488) 2021-01-03T12:58:17.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36abfff700 1 -- 172.21.15.133:0/224600343 learned_addr learned my addr 172.21.15.133:0/224600343 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:17.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b259c700 1 --2- 172.21.15.133:0/224600343 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36b405fd10 0x7f36b409e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b2d9d700 1 --2- 172.21.15.133:0/224600343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36b40b4c20 0x7f36b4155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:17.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36abfff700 1 -- 172.21.15.133:0/224600343 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36b405fd10 msgr2=0x7f36b409e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36abfff700 1 --2- 172.21.15.133:0/224600343 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36b405fd10 0x7f36b409e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36abfff700 1 -- 172.21.15.133:0/224600343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36b40b4c20 msgr2=0x7f36b4155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:17.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36abfff700 1 --2- 172.21.15.133:0/224600343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36b40b4c20 0x7f36b4155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:17.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36abfff700 1 -- 172.21.15.133:0/224600343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b4143880 con 0x7f36b4060510 2021-01-03T12:58:17.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36abfff700 1 --2- 172.21.15.133:0/224600343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4060510 0x7f36b4155380 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f36b4155ea0 tx=0x7f36a4007a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:17.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36ab7fe700 1 -- 172.21.15.133:0/224600343 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36a40072e0 con 0x7f36b4060510 2021-01-03T12:58:17.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36ab7fe700 1 -- 172.21.15.133:0/224600343 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a4007440 con 0x7f36b4060510 2021-01-03T12:58:17.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.911+0000 7f36b359e700 1 -- 172.21.15.133:0/224600343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b4154ee0 con 0x7f36b4060510 2021-01-03T12:58:17.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.915+0000 7f36ab7fe700 1 -- 172.21.15.133:0/224600343 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36a40057d0 con 0x7f36b4060510 2021-01-03T12:58:17.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.915+0000 7f36b359e700 1 -- 172.21.15.133:0/224600343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b4142ea0 con 0x7f36b4060510 2021-01-03T12:58:17.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.915+0000 7f36b359e700 1 -- 172.21.15.133:0/224600343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b4148d70 con 0x7f36b4060510 2021-01-03T12:58:17.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.915+0000 7f36ab7fe700 1 -- 172.21.15.133:0/224600343 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f36a4010070 con 0x7f36b4060510 2021-01-03T12:58:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.915+0000 7f36ab7fe700 1 --2- 172.21.15.133:0/224600343 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3698055440 0x7f3698057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.915+0000 7f36ab7fe700 1 -- 172.21.15.133:0/224600343 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f36a406d6a0 con 0x7f36b4060510 2021-01-03T12:58:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.915+0000 7f36b259c700 1 --2- 172.21.15.133:0/224600343 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3698055440 0x7f3698057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.915+0000 7f36b259c700 1 --2- 172.21.15.133:0/224600343 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3698055440 0x7f3698057900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f369c018000 tx=0x7f369c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:18.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:17.923+0000 7f36ab7fe700 1 -- 172.21.15.133:0/224600343 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f36b4148d70 con 0x7f36b4060510 2021-01-03T12:58:18.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.063+0000 7f36b359e700 1 -- 172.21.15.133:0/224600343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36b4148d70 con 0x7f36b4060510 2021-01-03T12:58:18.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.067+0000 7f36ab7fe700 1 -- 172.21.15.133:0/224600343 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f36b4148d70 con 0x7f36b4060510 2021-01-03T12:58:18.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.067+0000 7f36b359e700 1 -- 172.21.15.133:0/224600343 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3698055440 msgr2=0x7f3698057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:18.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.067+0000 7f36b359e700 1 --2- 172.21.15.133:0/224600343 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3698055440 0x7f3698057900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f369c018000 tx=0x7f369c015000).stop 2021-01-03T12:58:18.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.067+0000 7f36b359e700 1 -- 172.21.15.133:0/224600343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4060510 msgr2=0x7f36b4155380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:18.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.067+0000 7f36b359e700 1 --2- 172.21.15.133:0/224600343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4060510 0x7f36b4155380 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f36b4155ea0 tx=0x7f36a4007a70).stop 2021-01-03T12:58:18.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.067+0000 7f36b359e700 1 -- 172.21.15.133:0/224600343 shutdown_connections 2021-01-03T12:58:18.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.067+0000 7f36b359e700 1 --2- 172.21.15.133:0/224600343 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3698055440 0x7f3698057900 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.067+0000 7f36b359e700 1 --2- 172.21.15.133:0/224600343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36b40b4c20 0x7f36b4155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.067+0000 7f36b359e700 1 --2- 172.21.15.133:0/224600343 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36b405fd10 0x7f36b409e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.067+0000 7f36b359e700 1 --2- 172.21.15.133:0/224600343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36b4060510 0x7f36b4155380 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.067+0000 7f36b359e700 1 -- 172.21.15.133:0/224600343 >> 172.21.15.133:0/224600343 conn(0x7f36b40b9f00 msgr2=0x7f36b406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:18.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.067+0000 7f36b359e700 1 -- 172.21.15.133:0/224600343 shutdown_connections 2021-01-03T12:58:18.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.067+0000 7f36b359e700 1 -- 172.21.15.133:0/224600343 wait complete. 2021-01-03T12:58:18.367 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:18.367 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T12:58:18.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.491+0000 7ff593fff700 1 Processor -- start 2021-01-03T12:58:18.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.491+0000 7ff593fff700 1 -- start start 2021-01-03T12:58:18.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.491+0000 7ff593fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5940b5260 0x7ff5941470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:18.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.491+0000 7ff593fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff5941442a0 0x7ff594144750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:18.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff593fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5940b0c10 con 0x7ff5940b5c00 2021-01-03T12:58:18.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff593fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5940b5640 con 0x7ff5941442a0 2021-01-03T12:58:18.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff593fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59409a4f0 con 0x7ff5940b5260 2021-01-03T12:58:18.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff5927fc700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff5940b5c00 0x7ff5941475a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:60256/0 (socket says 172.21.15.133:60256) 2021-01-03T12:58:18.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff5937fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff5941442a0 0x7ff594144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:18.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff5927fc700 1 -- 172.21.15.133:0/3120549072 learned_addr learned my addr 172.21.15.133:0/3120549072 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:18.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff592ffd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5940b5260 0x7ff5941470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:18.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff591ffb700 1 -- 172.21.15.133:0/3120549072 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914381466 0 0) 0x7ff5940b0c10 con 0x7ff5940b5c00 2021-01-03T12:58:18.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff591ffb700 1 -- 172.21.15.133:0/3120549072 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff574003230 con 0x7ff5940b5c00 2021-01-03T12:58:18.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff5937fe700 1 -- 172.21.15.133:0/3120549072 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5940b5260 msgr2=0x7ff5941470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:18.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff5937fe700 1 --2- 172.21.15.133:0/3120549072 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5940b5260 0x7ff5941470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff5937fe700 1 -- 172.21.15.133:0/3120549072 >> v1:172.21.15.16:6789/0 conn(0x7ff5940b5c00 legacy=0x7ff5941475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:18.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff5937fe700 1 -- 172.21.15.133:0/3120549072 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5940b0e40 con 0x7ff5941442a0 2021-01-03T12:58:18.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff592ffd700 1 --2- 172.21.15.133:0/3120549072 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5940b5260 0x7ff5941470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:18.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff5937fe700 1 --2- 172.21.15.133:0/3120549072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5941442a0 0x7ff594144750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7ff58c002f30 tx=0x7ff58c006dc0).ready entity=mon.0 client_cookie=db6648f0c2e7da34 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:18.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff591ffb700 1 -- 172.21.15.133:0/3120549072 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff58c0096a0 con 0x7ff5941442a0 2021-01-03T12:58:18.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff591ffb700 1 -- 172.21.15.133:0/3120549072 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c009800 con 0x7ff5941442a0 2021-01-03T12:58:18.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff591ffb700 1 -- 172.21.15.133:0/3120549072 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff58c009b60 con 0x7ff5941442a0 2021-01-03T12:58:18.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff593fff700 1 -- 172.21.15.133:0/3120549072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5941442a0 msgr2=0x7ff594144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:18.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff593fff700 1 --2- 172.21.15.133:0/3120549072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5941442a0 0x7ff594144750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7ff58c002f30 tx=0x7ff58c006dc0).stop 2021-01-03T12:58:18.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff593fff700 1 -- 172.21.15.133:0/3120549072 shutdown_connections 2021-01-03T12:58:18.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff593fff700 1 --2- 172.21.15.133:0/3120549072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5941442a0 0x7ff594144750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff593fff700 1 --2- 172.21.15.133:0/3120549072 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5940b5260 0x7ff5941470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff593fff700 1 -- 172.21.15.133:0/3120549072 >> 172.21.15.133:0/3120549072 conn(0x7ff59405bdf0 msgr2=0x7ff59405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:18.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff593fff700 1 -- 172.21.15.133:0/3120549072 shutdown_connections 2021-01-03T12:58:18.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.495+0000 7ff593fff700 1 -- 172.21.15.133:0/3120549072 wait complete. 2021-01-03T12:58:18.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff593fff700 1 Processor -- start 2021-01-03T12:58:18.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff593fff700 1 -- start start 2021-01-03T12:58:18.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff593fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5940b5260 0x7ff5940aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:18.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff593fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5940b5c00 0x7ff594159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:18.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff593fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5941442a0 0x7ff594159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:18.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff593fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5941464d0 con 0x7ff5940b5260 2021-01-03T12:58:18.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff593fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff594159160 con 0x7ff5940b5c00 2021-01-03T12:58:18.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff593fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff594067110 con 0x7ff5941442a0 2021-01-03T12:58:18.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff5927fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5940b5c00 0x7ff594159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:18.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff5927fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5940b5c00 0x7ff594159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60504/0 (socket says 172.21.15.133:60504) 2021-01-03T12:58:18.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff5927fc700 1 -- 172.21.15.133:0/2996807923 learned_addr learned my addr 172.21.15.133:0/2996807923 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:18.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff592ffd700 1 --2- 172.21.15.133:0/2996807923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5940b5260 0x7ff5940aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:18.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff5937fe700 1 --2- 172.21.15.133:0/2996807923 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5941442a0 0x7ff594159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:18.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff5927fc700 1 -- 172.21.15.133:0/2996807923 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5941442a0 msgr2=0x7ff594159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:18.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff5927fc700 1 --2- 172.21.15.133:0/2996807923 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5941442a0 0x7ff594159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff5927fc700 1 -- 172.21.15.133:0/2996807923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5940b5260 msgr2=0x7ff5940aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:18.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff5927fc700 1 --2- 172.21.15.133:0/2996807923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5940b5260 0x7ff5940aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff5927fc700 1 -- 172.21.15.133:0/2996807923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5941454c0 con 0x7ff5940b5c00 2021-01-03T12:58:18.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff5927fc700 1 --2- 172.21.15.133:0/2996807923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5940b5c00 0x7ff594159590 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7ff5941471e0 tx=0x7ff584007df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:18.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff58bfff700 1 -- 172.21.15.133:0/2996807923 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff584005b70 con 0x7ff5940b5c00 2021-01-03T12:58:18.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff58bfff700 1 -- 172.21.15.133:0/2996807923 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff584005cd0 con 0x7ff5940b5c00 2021-01-03T12:58:18.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff593fff700 1 -- 172.21.15.133:0/2996807923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff594067370 con 0x7ff5940b5c00 2021-01-03T12:58:18.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff58bfff700 1 -- 172.21.15.133:0/2996807923 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff584007300 con 0x7ff5940b5c00 2021-01-03T12:58:18.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.499+0000 7ff593fff700 1 -- 172.21.15.133:0/2996807923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5941481e0 con 0x7ff5940b5c00 2021-01-03T12:58:18.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.503+0000 7ff593fff700 1 -- 172.21.15.133:0/2996807923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5941592a0 con 0x7ff5940b5c00 2021-01-03T12:58:18.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.503+0000 7ff58bfff700 1 -- 172.21.15.133:0/2996807923 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff584010030 con 0x7ff5940b5c00 2021-01-03T12:58:18.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.503+0000 7ff58bfff700 1 --2- 172.21.15.133:0/2996807923 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5780553b0 0x7ff578057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:18.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.503+0000 7ff58bfff700 1 -- 172.21.15.133:0/2996807923 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff58406deb0 con 0x7ff5940b5c00 2021-01-03T12:58:18.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.503+0000 7ff592ffd700 1 --2- 172.21.15.133:0/2996807923 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5780553b0 0x7ff578057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:18.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.503+0000 7ff592ffd700 1 --2- 172.21.15.133:0/2996807923 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5780553b0 0x7ff578057870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff57c00b000 tx=0x7ff57c006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:18.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.507+0000 7ff58bfff700 1 -- 172.21.15.133:0/2996807923 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff5840441b0 con 0x7ff5940b5c00 2021-01-03T12:58:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.651+0000 7ff593fff700 1 -- 172.21.15.133:0/2996807923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff594057300 con 0x7ff5940b5c00 2021-01-03T12:58:18.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.655+0000 7ff58bfff700 1 -- 172.21.15.133:0/2996807923 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff5840477d0 con 0x7ff5940b5c00 2021-01-03T12:58:18.656 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:18.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.655+0000 7ff593fff700 1 -- 172.21.15.133:0/2996807923 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5780553b0 msgr2=0x7ff578057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:18.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.655+0000 7ff593fff700 1 --2- 172.21.15.133:0/2996807923 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5780553b0 0x7ff578057870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff57c00b000 tx=0x7ff57c006dc0).stop 2021-01-03T12:58:18.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.655+0000 7ff593fff700 1 -- 172.21.15.133:0/2996807923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5940b5c00 msgr2=0x7ff594159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:18.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.655+0000 7ff593fff700 1 --2- 172.21.15.133:0/2996807923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5940b5c00 0x7ff594159590 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7ff5941471e0 tx=0x7ff584007df0).stop 2021-01-03T12:58:18.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.655+0000 7ff593fff700 1 -- 172.21.15.133:0/2996807923 shutdown_connections 2021-01-03T12:58:18.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.655+0000 7ff593fff700 1 --2- 172.21.15.133:0/2996807923 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5780553b0 0x7ff578057870 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.655+0000 7ff593fff700 1 --2- 172.21.15.133:0/2996807923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5940b5260 0x7ff5940aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.655+0000 7ff593fff700 1 --2- 172.21.15.133:0/2996807923 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5941442a0 0x7ff594159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.655+0000 7ff593fff700 1 --2- 172.21.15.133:0/2996807923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5940b5c00 0x7ff594159590 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.655+0000 7ff593fff700 1 -- 172.21.15.133:0/2996807923 >> 172.21.15.133:0/2996807923 conn(0x7ff59405bdf0 msgr2=0x7ff59405c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:18.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.655+0000 7ff593fff700 1 -- 172.21.15.133:0/2996807923 shutdown_connections 2021-01-03T12:58:18.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.655+0000 7ff593fff700 1 -- 172.21.15.133:0/2996807923 wait complete. 2021-01-03T12:58:18.672 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T12:58:18.673 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T12:58:18.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.779+0000 7fded14c3700 1 Processor -- start 2021-01-03T12:58:18.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.779+0000 7fded14c3700 1 -- start start 2021-01-03T12:58:18.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.779+0000 7fded14c3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdecc0b21b0 0x7fdecc142890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:18.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.779+0000 7fded14c3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdecc0b1980 0x7fdecc142d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:18.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.779+0000 7fded14c3700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdecc0b2590 con 0x7fdecc0aadf0 2021-01-03T12:58:18.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.779+0000 7fded14c3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdecc0ab430 con 0x7fdecc0b21b0 2021-01-03T12:58:18.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.779+0000 7fded14c3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc143270 con 0x7fdecc0b1980 2021-01-03T12:58:18.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.779+0000 7fdecbfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdecc0b21b0 0x7fdecc142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:18.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.779+0000 7fdecbfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdecc0b21b0 0x7fdecc142890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60510/0 (socket says 172.21.15.133:60510) 2021-01-03T12:58:18.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.779+0000 7fdecbfff700 1 -- 172.21.15.133:0/996519579 learned_addr learned my addr 172.21.15.133:0/996519579 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:18.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.779+0000 7fded0cc2700 1 --2- 172.21.15.133:0/996519579 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdecc0b1980 0x7fdecc142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:18.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fdecaffd700 1 -- 172.21.15.133:0/996519579 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555941878 0 0) 0x7fdecc0b2590 con 0x7fdecc0aadf0 2021-01-03T12:58:18.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fdecaffd700 1 -- 172.21.15.133:0/996519579 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeac003230 con 0x7fdecc0aadf0 2021-01-03T12:58:18.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fded0cc2700 1 -- 172.21.15.133:0/996519579 >> v2:172.21.15.133:3300/0 conn(0x7fdecc0b21b0 msgr2=0x7fdecc142890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:18.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fded0cc2700 1 --2- 172.21.15.133:0/996519579 >> v2:172.21.15.133:3300/0 conn(0x7fdecc0b21b0 0x7fdecc142890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fded0cc2700 1 -- 172.21.15.133:0/996519579 >> v1:172.21.15.16:6789/0 conn(0x7fdecc0aadf0 legacy=0x7fdecc0b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:18.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fded0cc2700 1 -- 172.21.15.133:0/996519579 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc0ac570 con 0x7fdecc0b1980 2021-01-03T12:58:18.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fdecbfff700 1 --2- 172.21.15.133:0/996519579 >> v2:172.21.15.133:3300/0 conn(0x7fdecc0b21b0 0x7fdecc142890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:18.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fded0cc2700 1 --2- 172.21.15.133:0/996519579 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdecc0b1980 0x7fdecc142d80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fdecc0ac1b0 tx=0x7fdec40091a0).ready entity=mon.2 client_cookie=ec660e190ebaa2d9 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:18.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fdecaffd700 1 -- 172.21.15.133:0/996519579 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdec400b900 con 0x7fdecc0b1980 2021-01-03T12:58:18.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fdecaffd700 1 -- 172.21.15.133:0/996519579 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec400ba60 con 0x7fdecc0b1980 2021-01-03T12:58:18.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fdecaffd700 1 -- 172.21.15.133:0/996519579 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdec400bbd0 con 0x7fdecc0b1980 2021-01-03T12:58:18.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fded14c3700 1 -- 172.21.15.133:0/996519579 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdecc0b1980 msgr2=0x7fdecc142d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:18.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fded14c3700 1 --2- 172.21.15.133:0/996519579 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdecc0b1980 0x7fdecc142d80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fdecc0ac1b0 tx=0x7fdec40091a0).stop 2021-01-03T12:58:18.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fded14c3700 1 -- 172.21.15.133:0/996519579 shutdown_connections 2021-01-03T12:58:18.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fded14c3700 1 --2- 172.21.15.133:0/996519579 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdecc0b1980 0x7fdecc142d80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fded14c3700 1 --2- 172.21.15.133:0/996519579 >> v2:172.21.15.133:3300/0 conn(0x7fdecc0b21b0 0x7fdecc142890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fded14c3700 1 -- 172.21.15.133:0/996519579 >> 172.21.15.133:0/996519579 conn(0x7fdecc05bdf0 msgr2=0x7fdecc05c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:18.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fded14c3700 1 -- 172.21.15.133:0/996519579 shutdown_connections 2021-01-03T12:58:18.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.783+0000 7fded14c3700 1 -- 172.21.15.133:0/996519579 wait complete. 2021-01-03T12:58:18.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fded14c3700 1 Processor -- start 2021-01-03T12:58:18.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fded14c3700 1 -- start start 2021-01-03T12:58:18.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fded14c3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdecc0aadf0 0x7fdecc1436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:18.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fded14c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdecc0b1980 0x7fdecc14e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:18.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fded14c3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdecc0b21b0 0x7fdecc14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:18.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fded14c3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc14f3d0 con 0x7fdecc0b21b0 2021-01-03T12:58:18.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fded14c3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc144010 con 0x7fdecc0b1980 2021-01-03T12:58:18.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fded14c3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc065740 con 0x7fdecc0aadf0 2021-01-03T12:58:18.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fdecb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdecc0b1980 0x7fdecc14e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:18.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fdecb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdecc0b1980 0x7fdecc14e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60518/0 (socket says 172.21.15.133:60518) 2021-01-03T12:58:18.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fdecb7fe700 1 -- 172.21.15.133:0/2164450161 learned_addr learned my addr 172.21.15.133:0/2164450161 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:18.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fded0cc2700 1 --2- 172.21.15.133:0/2164450161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdecc0b21b0 0x7fdecc14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:18.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fdecbfff700 1 --2- 172.21.15.133:0/2164450161 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdecc0aadf0 0x7fdecc1436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:18.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fdecb7fe700 1 -- 172.21.15.133:0/2164450161 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdecc0aadf0 msgr2=0x7fdecc1436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:18.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fdecb7fe700 1 --2- 172.21.15.133:0/2164450161 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdecc0aadf0 0x7fdecc1436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fdecb7fe700 1 -- 172.21.15.133:0/2164450161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdecc0b21b0 msgr2=0x7fdecc14eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:18.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fdecb7fe700 1 --2- 172.21.15.133:0/2164450161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdecc0b21b0 0x7fdecc14eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fdecb7fe700 1 -- 172.21.15.133:0/2164450161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc144240 con 0x7fdecc0b1980 2021-01-03T12:58:18.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fdecbfff700 1 --2- 172.21.15.133:0/2164450161 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdecc0aadf0 0x7fdecc1436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:18.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fdecb7fe700 1 --2- 172.21.15.133:0/2164450161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdecc0b1980 0x7fdecc14e9f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fdebc0010d0 tx=0x7fdebc007ab0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:18.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fdec97fa700 1 -- 172.21.15.133:0/2164450161 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdebc010510 con 0x7fdecc0b1980 2021-01-03T12:58:18.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fdec97fa700 1 -- 172.21.15.133:0/2164450161 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc010670 con 0x7fdecc0b1980 2021-01-03T12:58:18.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fded14c3700 1 -- 172.21.15.133:0/2164450161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdecc066690 con 0x7fdecc0b1980 2021-01-03T12:58:18.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fdec97fa700 1 -- 172.21.15.133:0/2164450161 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdebc0107e0 con 0x7fdecc0b1980 2021-01-03T12:58:18.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.787+0000 7fded14c3700 1 -- 172.21.15.133:0/2164450161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdecc064720 con 0x7fdecc0b1980 2021-01-03T12:58:18.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.791+0000 7fded14c3700 1 -- 172.21.15.133:0/2164450161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdecc057300 con 0x7fdecc0b1980 2021-01-03T12:58:18.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.791+0000 7fdec97fa700 1 -- 172.21.15.133:0/2164450161 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fdebc010070 con 0x7fdecc0b1980 2021-01-03T12:58:18.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.791+0000 7fdec97fa700 1 --2- 172.21.15.133:0/2164450161 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdeb0055330 0x7fdeb00577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:18.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.791+0000 7fdec97fa700 1 -- 172.21.15.133:0/2164450161 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdebc06d860 con 0x7fdecc0b1980 2021-01-03T12:58:18.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.791+0000 7fdecbfff700 1 --2- 172.21.15.133:0/2164450161 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdeb0055330 0x7fdeb00577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:18.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.795+0000 7fdecbfff700 1 --2- 172.21.15.133:0/2164450161 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdeb0055330 0x7fdeb00577f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fdeb400b000 tx=0x7fdeb4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:18.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.799+0000 7fdec97fa700 1 -- 172.21.15.133:0/2164450161 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdebc043b60 con 0x7fdecc0b1980 2021-01-03T12:58:18.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.979+0000 7fded14c3700 1 -- 172.21.15.133:0/2164450161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdecc065880 con 0x7fdecc0b1980 2021-01-03T12:58:18.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.979+0000 7fdec97fa700 1 -- 172.21.15.133:0/2164450161 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2489 (secure 0 0 0) 0x7fdebc047180 con 0x7fdecc0b1980 2021-01-03T12:58:18.983 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:18.983 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2255364706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2255364706},{"type":"v1","addr":"172.21.15.16:6833","nonce":2255364706}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/537740959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":537740959},{"type":"v1","addr":"172.21.15.133:6835","nonce":537740959}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T12:58:00.825803+0000","modified":"2021-01-03T12:58:01.829281+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6837/3158570988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3158570988},{"type":"v1","addr":"172.21.15.133:6837","nonce":3158570988}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-03T12:58:18.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.983+0000 7fded14c3700 1 -- 172.21.15.133:0/2164450161 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdeb0055330 msgr2=0x7fdeb00577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:18.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.983+0000 7fded14c3700 1 --2- 172.21.15.133:0/2164450161 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdeb0055330 0x7fdeb00577f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fdeb400b000 tx=0x7fdeb4008040).stop 2021-01-03T12:58:18.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.983+0000 7fded14c3700 1 -- 172.21.15.133:0/2164450161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdecc0b1980 msgr2=0x7fdecc14e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:18.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.983+0000 7fded14c3700 1 --2- 172.21.15.133:0/2164450161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdecc0b1980 0x7fdecc14e9f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fdebc0010d0 tx=0x7fdebc007ab0).stop 2021-01-03T12:58:18.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.983+0000 7fded14c3700 1 -- 172.21.15.133:0/2164450161 shutdown_connections 2021-01-03T12:58:18.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.983+0000 7fded14c3700 1 --2- 172.21.15.133:0/2164450161 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdeb0055330 0x7fdeb00577f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.983+0000 7fded14c3700 1 --2- 172.21.15.133:0/2164450161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdecc0b21b0 0x7fdecc14eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.983+0000 7fded14c3700 1 --2- 172.21.15.133:0/2164450161 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdecc0aadf0 0x7fdecc1436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.983+0000 7fded14c3700 1 --2- 172.21.15.133:0/2164450161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdecc0b1980 0x7fdecc14e9f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:18.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.983+0000 7fded14c3700 1 -- 172.21.15.133:0/2164450161 >> 172.21.15.133:0/2164450161 conn(0x7fdecc05bdf0 msgr2=0x7fdecc0b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:18.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.983+0000 7fded14c3700 1 -- 172.21.15.133:0/2164450161 shutdown_connections 2021-01-03T12:58:18.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:18.983+0000 7fded14c3700 1 -- 172.21.15.133:0/2164450161 wait complete. 2021-01-03T12:58:18.988 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 5 2021-01-03T12:58:19.304 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T12:58:00.825803+0000', 'modified': '2021-01-03T12:58:01.829281+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4258}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4258': {'gid': 4258, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.133:6837/3158570988', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 3158570988}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 3158570988}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T12:58:19.305 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T12:58:19.305 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T12:58:19.437 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":4258,"want_state":"up:active","state":"up:active","rank_uptime":18.598645303000001,"mdsmap_epoch":5,"osdmap_epoch":23,"osdmap_epoch_barrier":22,"uptime":21.975955784} 2021-01-03T12:58:19.437 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 4258, "mdsmap_epoch": 5, "osdmap_epoch": 23, "osdmap_epoch_barrier": 22, "rank_uptime": 18.598645303, "state": "up:active", "uptime": 21.975955784, "want_state": "up:active", "whoami": 0 } 2021-01-03T12:58:19.438 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T12:58:19.438 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-01-03T12:58:19.439 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi036.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-01-03T12:58:19.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:19.439 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-01-03T12:58:19.447 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T12:58:19.504 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T12:58:19.505 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T12:58:19.559 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T12:58:19.560 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T12:58:19.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:19.561 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T12:58:19.608 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T12:58:19.609 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-01-03T12:58:19.656 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T12:58:19.672 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T12:58:19.673 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T12:58:19.727 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T12:58:19.728 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T12:58:19.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:19.729 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T12:58:19.744 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:2021-01-03T12:58:19.739+0000 7f8b966340c0 -1 init, newargv = 0x55e2753158c0 newargc=9 2021-01-03T12:58:19.744 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[11517]: starting ceph client 2021-01-03T12:58:19.757 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[11517]: starting fuse 2021-01-03T12:58:20.850 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T12:58:20.866 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T12:58:20.867 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T12:58:20.925 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T12:58:20.926 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T12:58:20.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:20.927 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T12:58:20.972 INFO:teuthology.orchestra.run.smithi036.stdout:49 2021-01-03T12:58:20.973 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2021-01-03T12:58:20.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:20.973 DEBUG:teuthology.orchestra.run.smithi036:> sudo python3 -c ' 2021-01-03T12:58:20.974 DEBUG:teuthology.orchestra.run.smithi036:> import glob 2021-01-03T12:58:20.974 DEBUG:teuthology.orchestra.run.smithi036:> import re 2021-01-03T12:58:20.974 DEBUG:teuthology.orchestra.run.smithi036:> import os 2021-01-03T12:58:20.975 DEBUG:teuthology.orchestra.run.smithi036:> import subprocess 2021-01-03T12:58:20.975 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T12:58:20.975 DEBUG:teuthology.orchestra.run.smithi036:> def find_socket(client_name): 2021-01-03T12:58:20.976 DEBUG:teuthology.orchestra.run.smithi036:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-01-03T12:58:20.976 DEBUG:teuthology.orchestra.run.smithi036:> files = glob.glob(asok_path) 2021-01-03T12:58:20.976 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T12:58:20.977 DEBUG:teuthology.orchestra.run.smithi036:> # Given a non-glob path, it better be there 2021-01-03T12:58:20.977 DEBUG:teuthology.orchestra.run.smithi036:> if "*" not in asok_path: 2021-01-03T12:58:20.977 DEBUG:teuthology.orchestra.run.smithi036:> assert(len(files) == 1) 2021-01-03T12:58:20.977 DEBUG:teuthology.orchestra.run.smithi036:> return files[0] 2021-01-03T12:58:20.978 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T12:58:20.978 DEBUG:teuthology.orchestra.run.smithi036:> for f in files: 2021-01-03T12:58:20.978 DEBUG:teuthology.orchestra.run.smithi036:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T12:58:20.979 DEBUG:teuthology.orchestra.run.smithi036:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T12:58:20.979 DEBUG:teuthology.orchestra.run.smithi036:> return f 2021-01-03T12:58:20.979 DEBUG:teuthology.orchestra.run.smithi036:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T12:58:20.980 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T12:58:20.980 DEBUG:teuthology.orchestra.run.smithi036:> print(find_socket("client.1")) 2021-01-03T12:58:20.980 DEBUG:teuthology.orchestra.run.smithi036:> ' 2021-01-03T12:58:21.065 INFO:teuthology.orchestra.run.smithi036.stdout:/var/run/ceph/ceph-client.1.11517.asok 2021-01-03T12:58:21.070 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.11517.asok 2021-01-03T12:58:21.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:21.071 DEBUG:teuthology.orchestra.run.smithi036:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.11517.asok status 2021-01-03T12:58:21.242 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2021-01-03T12:58:21.242 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": { 2021-01-03T12:58:21.242 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T12:58:21.242 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T12:58:21.243 INFO:teuthology.orchestra.run.smithi036.stdout: "entity_id": "1", 2021-01-03T12:58:21.243 INFO:teuthology.orchestra.run.smithi036.stdout: "hostname": "smithi036", 2021-01-03T12:58:21.243 INFO:teuthology.orchestra.run.smithi036.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-01-03T12:58:21.243 INFO:teuthology.orchestra.run.smithi036.stdout: "pid": "11517", 2021-01-03T12:58:21.243 INFO:teuthology.orchestra.run.smithi036.stdout: "root": "/" 2021-01-03T12:58:21.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T12:58:21.244 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_count": 0, 2021-01-03T12:58:21.244 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_pinned_count": 0, 2021-01-03T12:58:21.244 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 4635, 2021-01-03T12:58:21.244 INFO:teuthology.orchestra.run.smithi036.stdout: "inst": { 2021-01-03T12:58:21.245 INFO:teuthology.orchestra.run.smithi036.stdout: "name": { 2021-01-03T12:58:21.245 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "client", 2021-01-03T12:58:21.245 INFO:teuthology.orchestra.run.smithi036.stdout: "num": 4635 2021-01-03T12:58:21.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T12:58:21.245 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T12:58:21.246 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T12:58:21.246 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T12:58:21.246 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 3404339262 2021-01-03T12:58:21.246 INFO:teuthology.orchestra.run.smithi036.stdout: } 2021-01-03T12:58:21.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T12:58:21.247 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T12:58:21.247 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T12:58:21.247 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T12:58:21.247 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 3404339262 2021-01-03T12:58:21.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T12:58:21.248 INFO:teuthology.orchestra.run.smithi036.stdout: "inst_str": "client.4635 172.21.15.36:0/3404339262", 2021-01-03T12:58:21.248 INFO:teuthology.orchestra.run.smithi036.stdout: "addr_str": "172.21.15.36:0/3404339262", 2021-01-03T12:58:21.248 INFO:teuthology.orchestra.run.smithi036.stdout: "inode_count": 1, 2021-01-03T12:58:21.248 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_epoch": 5, 2021-01-03T12:58:21.248 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch": 23, 2021-01-03T12:58:21.249 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch_barrier": 0, 2021-01-03T12:58:21.249 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklisted": false, 2021-01-03T12:58:21.249 INFO:teuthology.orchestra.run.smithi036.stdout: "fs_name": "cephfs" 2021-01-03T12:58:21.249 INFO:teuthology.orchestra.run.smithi036.stdout:} 2021-01-03T12:58:21.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:21.253 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T12:58:21.254 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:58:21.262 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T12:58:21.263 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T12:58:21.263 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:21.263 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:58:21.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:21.325 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T12:58:21.325 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T12:58:21.334 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T12:58:21.335 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T12:58:21.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:21.335 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-01-03T12:58:21.403 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2021-01-03T12:58:21.420 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:21.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.535+0000 7f2caffff700 1 Processor -- start 2021-01-03T12:58:21.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2caffff700 1 -- start start 2021-01-03T12:58:21.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2caffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2cb00b5750 0x7f2cb00b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:21.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2caffff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb014a570 con 0x7f2cb005ff30 2021-01-03T12:58:21.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2caffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb00604b0 con 0x7f2cb00b9b60 2021-01-03T12:58:21.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2caffff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb014a7a0 con 0x7f2cb00b5750 2021-01-03T12:58:21.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2caeffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2cb00b9b60 0x7f2cb014aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53324/0 (socket says 172.21.15.133:53324) 2021-01-03T12:58:21.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2caeffd700 1 -- 172.21.15.133:0/1553746521 learned_addr learned my addr 172.21.15.133:0/1553746521 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:21.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2cae7fc700 1 --2- 172.21.15.133:0/1553746521 >> v2:172.21.15.16:3300/0 conn(0x7f2cb00b5750 0x7f2cb00b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:21.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2cadffb700 1 -- 172.21.15.133:0/1553746521 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469626171 0 0) 0x7f2cb00604b0 con 0x7f2cb00b9b60 2021-01-03T12:58:21.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2cadffb700 1 -- 172.21.15.133:0/1553746521 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c94003230 con 0x7f2cb00b9b60 2021-01-03T12:58:21.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2cae7fc700 1 -- 172.21.15.133:0/1553746521 >> v1:172.21.15.133:6789/0 conn(0x7f2cb00b9b60 legacy=0x7f2cb014aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:21.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2cae7fc700 1 -- 172.21.15.133:0/1553746521 >> v1:172.21.15.16:6789/0 conn(0x7f2cb005ff30 legacy=0x7f2cb0147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:21.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2cadffb700 1 -- 172.21.15.133:0/1553746521 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397003521 0 0) 0x7f2cb014a570 con 0x7f2cb005ff30 2021-01-03T12:58:21.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2cae7fc700 1 -- 172.21.15.133:0/1553746521 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb014aa40 con 0x7f2cb00b5750 2021-01-03T12:58:21.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2cae7fc700 1 --2- 172.21.15.133:0/1553746521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cb00b5750 0x7f2cb00b9f40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2ca0002f30 tx=0x7f2ca0006dc0).ready entity=mon.0 client_cookie=6b9c860133d2f5ea server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:21.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2cadffb700 1 -- 172.21.15.133:0/1553746521 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ca0009800 con 0x7f2cb00b5750 2021-01-03T12:58:21.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2cadffb700 1 -- 172.21.15.133:0/1553746521 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca0009960 con 0x7f2cb00b5750 2021-01-03T12:58:21.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2cadffb700 1 -- 172.21.15.133:0/1553746521 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ca0009cc0 con 0x7f2cb00b5750 2021-01-03T12:58:21.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2caffff700 1 -- 172.21.15.133:0/1553746521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cb00b5750 msgr2=0x7f2cb00b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:21.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.539+0000 7f2caffff700 1 --2- 172.21.15.133:0/1553746521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cb00b5750 0x7f2cb00b9f40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2ca0002f30 tx=0x7f2ca0006dc0).stop 2021-01-03T12:58:21.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2caffff700 1 -- 172.21.15.133:0/1553746521 shutdown_connections 2021-01-03T12:58:21.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2caffff700 1 --2- 172.21.15.133:0/1553746521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cb00b5750 0x7f2cb00b9f40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:21.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2caffff700 1 -- 172.21.15.133:0/1553746521 >> 172.21.15.133:0/1553746521 conn(0x7f2cb00b69e0 msgr2=0x7f2cb00b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:21.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2caffff700 1 -- 172.21.15.133:0/1553746521 shutdown_connections 2021-01-03T12:58:21.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2caffff700 1 -- 172.21.15.133:0/1553746521 wait complete. 2021-01-03T12:58:21.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2caffff700 1 Processor -- start 2021-01-03T12:58:21.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2caffff700 1 -- start start 2021-01-03T12:58:21.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2caffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cb005ff30 0x7f2cb009a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:21.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2caffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2cb00b5750 0x7f2cb009efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:21.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2caffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cb00b9b60 0x7f2cb0098550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:21.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2caffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb0156e10 con 0x7f2cb00b9b60 2021-01-03T12:58:21.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2caffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb0156900 con 0x7f2cb005ff30 2021-01-03T12:58:21.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2caffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb0156b70 con 0x7f2cb00b5750 2021-01-03T12:58:21.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2caeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cb005ff30 0x7f2cb009a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:21.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2caeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cb005ff30 0x7f2cb009a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60530/0 (socket says 172.21.15.133:60530) 2021-01-03T12:58:21.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2caeffd700 1 -- 172.21.15.133:0/2358809607 learned_addr learned my addr 172.21.15.133:0/2358809607 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:21.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2cae7fc700 1 --2- 172.21.15.133:0/2358809607 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2cb00b5750 0x7f2cb009efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:21.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.543+0000 7f2caf7fe700 1 --2- 172.21.15.133:0/2358809607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cb00b9b60 0x7f2cb0098550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:21.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.547+0000 7f2caeffd700 1 -- 172.21.15.133:0/2358809607 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2cb00b5750 msgr2=0x7f2cb009efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:21.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.547+0000 7f2caeffd700 1 --2- 172.21.15.133:0/2358809607 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2cb00b5750 0x7f2cb009efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:21.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.547+0000 7f2caeffd700 1 -- 172.21.15.133:0/2358809607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cb00b9b60 msgr2=0x7f2cb0098550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:21.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.547+0000 7f2caeffd700 1 --2- 172.21.15.133:0/2358809607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cb00b9b60 0x7f2cb0098550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:21.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.547+0000 7f2caeffd700 1 -- 172.21.15.133:0/2358809607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb00b8c40 con 0x7f2cb005ff30 2021-01-03T12:58:21.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.547+0000 7f2caeffd700 1 --2- 172.21.15.133:0/2358809607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cb005ff30 0x7f2cb009a0e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f2cb009ed60 tx=0x7f2ca4007a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:21.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.547+0000 7f2c9ffff700 1 -- 172.21.15.133:0/2358809607 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ca40072e0 con 0x7f2cb005ff30 2021-01-03T12:58:21.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.547+0000 7f2c9ffff700 1 -- 172.21.15.133:0/2358809607 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca4007440 con 0x7f2cb005ff30 2021-01-03T12:58:21.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.547+0000 7f2caffff700 1 -- 172.21.15.133:0/2358809607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb009a5d0 con 0x7f2cb005ff30 2021-01-03T12:58:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.547+0000 7f2c9ffff700 1 -- 172.21.15.133:0/2358809607 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ca40057d0 con 0x7f2cb005ff30 2021-01-03T12:58:21.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.547+0000 7f2caffff700 1 -- 172.21.15.133:0/2358809607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb00b90e0 con 0x7f2cb005ff30 2021-01-03T12:58:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.547+0000 7f2caffff700 1 -- 172.21.15.133:0/2358809607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb00b8dd0 con 0x7f2cb005ff30 2021-01-03T12:58:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.547+0000 7f2c9ffff700 1 -- 172.21.15.133:0/2358809607 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2ca4010070 con 0x7f2cb005ff30 2021-01-03T12:58:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.551+0000 7f2c9ffff700 1 --2- 172.21.15.133:0/2358809607 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2c8c055440 0x7f2c8c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.551+0000 7f2c9ffff700 1 -- 172.21.15.133:0/2358809607 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2ca406d4b0 con 0x7f2cb005ff30 2021-01-03T12:58:21.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.551+0000 7f2cae7fc700 1 --2- 172.21.15.133:0/2358809607 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2c8c055440 0x7f2c8c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:21.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.551+0000 7f2cae7fc700 1 --2- 172.21.15.133:0/2358809607 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2c8c055440 0x7f2c8c057900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f2ca001a000 tx=0x7f2ca0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:21.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.555+0000 7f2c9ffff700 1 -- 172.21.15.133:0/2358809607 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2ca40436a0 con 0x7f2cb005ff30 2021-01-03T12:58:21.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.699+0000 7f2caffff700 1 -- 172.21.15.133:0/2358809607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cb0057300 con 0x7f2cb005ff30 2021-01-03T12:58:21.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.699+0000 7f2c9ffff700 1 -- 172.21.15.133:0/2358809607 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f2ca4046cc0 con 0x7f2cb005ff30 2021-01-03T12:58:21.702 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:21.702 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":23,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:01.829379+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:57:58.934952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-03T12:57:59.830134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:21.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.703+0000 7f2caffff700 1 -- 172.21.15.133:0/2358809607 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2c8c055440 msgr2=0x7f2c8c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:21.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.703+0000 7f2caffff700 1 --2- 172.21.15.133:0/2358809607 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2c8c055440 0x7f2c8c057900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f2ca001a000 tx=0x7f2ca0015000).stop 2021-01-03T12:58:21.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.703+0000 7f2caffff700 1 -- 172.21.15.133:0/2358809607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cb005ff30 msgr2=0x7f2cb009a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:21.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.703+0000 7f2caffff700 1 --2- 172.21.15.133:0/2358809607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cb005ff30 0x7f2cb009a0e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f2cb009ed60 tx=0x7f2ca4007a70).stop 2021-01-03T12:58:21.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.703+0000 7f2caffff700 1 -- 172.21.15.133:0/2358809607 shutdown_connections 2021-01-03T12:58:21.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.703+0000 7f2caffff700 1 --2- 172.21.15.133:0/2358809607 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2c8c055440 0x7f2c8c057900 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:21.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.703+0000 7f2caffff700 1 --2- 172.21.15.133:0/2358809607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cb00b9b60 0x7f2cb0098550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:21.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.703+0000 7f2caffff700 1 --2- 172.21.15.133:0/2358809607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cb005ff30 0x7f2cb009a0e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:21.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.703+0000 7f2caffff700 1 --2- 172.21.15.133:0/2358809607 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2cb00b5750 0x7f2cb009efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:21.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.703+0000 7f2caffff700 1 -- 172.21.15.133:0/2358809607 >> 172.21.15.133:0/2358809607 conn(0x7f2cb00b69e0 msgr2=0x7f2cb01471c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:21.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.703+0000 7f2caffff700 1 -- 172.21.15.133:0/2358809607 shutdown_connections 2021-01-03T12:58:21.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.703+0000 7f2caffff700 1 -- 172.21.15.133:0/2358809607 wait complete. 2021-01-03T12:58:21.715 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T12:57:58.934952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T12:57:59.830134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T12:58:21.715 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T12:58:21.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.827+0000 7fc6cc259700 1 Processor -- start 2021-01-03T12:58:21.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.827+0000 7fc6cc259700 1 -- start start 2021-01-03T12:58:21.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.827+0000 7fc6cc259700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc6c40b1b50 0x7fc6c4141320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:21.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.827+0000 7fc6cc259700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c405cc20 con 0x7fc6c405c840 2021-01-03T12:58:21.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.827+0000 7fc6cc259700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c40ab220 con 0x7fc6c40b27a0 2021-01-03T12:58:21.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.827+0000 7fc6cc259700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c4144360 con 0x7fc6c40b1b50 2021-01-03T12:58:21.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6ca7f6700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc6c40b27a0 0x7fc6c413ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53342/0 (socket says 172.21.15.133:53342) 2021-01-03T12:58:21.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6ca7f6700 1 -- 172.21.15.133:0/2562424385 learned_addr learned my addr 172.21.15.133:0/2562424385 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:21.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c97f4700 1 --2- 172.21.15.133:0/2562424385 >> v2:172.21.15.16:3300/0 conn(0x7fc6c40b1b50 0x7fc6c4141320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:21.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 -- 172.21.15.133:0/2562424385 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380494271 0 0) 0x7fc6c40ab220 con 0x7fc6c40b27a0 2021-01-03T12:58:21.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 -- 172.21.15.133:0/2562424385 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6b0003230 con 0x7fc6c40b27a0 2021-01-03T12:58:21.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 -- 172.21.15.133:0/2562424385 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1625625016 0 0) 0x7fc6b0003230 con 0x7fc6c40b27a0 2021-01-03T12:58:21.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 -- 172.21.15.133:0/2562424385 >> v2:172.21.15.16:3300/0 conn(0x7fc6c40b1b50 msgr2=0x7fc6c4141320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:21.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 --2- 172.21.15.133:0/2562424385 >> v2:172.21.15.16:3300/0 conn(0x7fc6c40b1b50 0x7fc6c4141320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:21.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 -- 172.21.15.133:0/2562424385 >> v1:172.21.15.16:6789/0 conn(0x7fc6c405c840 legacy=0x7fc6c4140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:21.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 -- 172.21.15.133:0/2562424385 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c4144600 con 0x7fc6c40b27a0 2021-01-03T12:58:21.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 -- 172.21.15.133:0/2562424385 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fc6b40016d0 con 0x7fc6c40b27a0 2021-01-03T12:58:21.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c97f4700 1 --2- 172.21.15.133:0/2562424385 >> v2:172.21.15.16:3300/0 conn(0x7fc6c40b1b50 0x7fc6c4141320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:21.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 -- 172.21.15.133:0/2562424385 >> v1:172.21.15.133:6789/0 conn(0x7fc6c40b27a0 legacy=0x7fc6c413ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:21.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 --2- 172.21.15.133:0/2562424385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6b0003720 0x7fc6b0003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:21.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 --2- 172.21.15.133:0/2562424385 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6b00044d0 0x7fc6b0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:21.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 --2- 172.21.15.133:0/2562424385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6b0004e40 0x7fc6b000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:21.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 -- 172.21.15.133:0/2562424385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c4144360 con 0x7fc6b0004e40 2021-01-03T12:58:21.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 -- 172.21.15.133:0/2562424385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b00041c0 con 0x7fc6b0003720 2021-01-03T12:58:21.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 -- 172.21.15.133:0/2562424385 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b000bc10 con 0x7fc6b00044d0 2021-01-03T12:58:21.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c9ff5700 1 --2- 172.21.15.133:0/2562424385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6b0003720 0x7fc6b0003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:21.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6ca7f6700 1 --2- 172.21.15.133:0/2562424385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6b0004e40 0x7fc6b000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:21.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c97f4700 1 --2- 172.21.15.133:0/2562424385 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6b00044d0 0x7fc6b0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:21.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c9ff5700 1 -- 172.21.15.133:0/2562424385 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6b00044d0 msgr2=0x7fc6b0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:21.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c9ff5700 1 --2- 172.21.15.133:0/2562424385 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6b00044d0 0x7fc6b0004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:21.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c9ff5700 1 -- 172.21.15.133:0/2562424385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6b0004e40 msgr2=0x7fc6b000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:21.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c9ff5700 1 --2- 172.21.15.133:0/2562424385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6b0004e40 0x7fc6b000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:21.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6ca7f6700 1 -- 172.21.15.133:0/2562424385 reap_dead start 2021-01-03T12:58:21.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c9ff5700 1 -- 172.21.15.133:0/2562424385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b0003230 con 0x7fc6b0003720 2021-01-03T12:58:21.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c9ff5700 1 --2- 172.21.15.133:0/2562424385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6b0003720 0x7fc6b0003b00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fc6c4141810 tx=0x7fc6bc007ee0).ready entity=mon.1 client_cookie=c9c5f0b69d6857b6 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:21.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 -- 172.21.15.133:0/2562424385 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6bc00ca50 con 0x7fc6b0003720 2021-01-03T12:58:21.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 -- 172.21.15.133:0/2562424385 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc00cbb0 con 0x7fc6b0003720 2021-01-03T12:58:21.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6c8ff3700 1 -- 172.21.15.133:0/2562424385 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6bc013410 con 0x7fc6b0003720 2021-01-03T12:58:21.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6cc259700 1 -- 172.21.15.133:0/2562424385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6b0003720 msgr2=0x7fc6b0003b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:21.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6cc259700 1 --2- 172.21.15.133:0/2562424385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6b0003720 0x7fc6b0003b00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fc6c4141810 tx=0x7fc6bc007ee0).stop 2021-01-03T12:58:21.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6cc259700 1 -- 172.21.15.133:0/2562424385 shutdown_connections 2021-01-03T12:58:21.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6cc259700 1 --2- 172.21.15.133:0/2562424385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6b0003720 0x7fc6b0003b00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:21.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6cc259700 1 -- 172.21.15.133:0/2562424385 >> 172.21.15.133:0/2562424385 conn(0x7fc6c406aeb0 msgr2=0x7fc6c405bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:21.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6cc259700 1 -- 172.21.15.133:0/2562424385 shutdown_connections 2021-01-03T12:58:21.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.831+0000 7fc6cc259700 1 -- 172.21.15.133:0/2562424385 wait complete. 2021-01-03T12:58:21.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6cc259700 1 Processor -- start 2021-01-03T12:58:21.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6cc259700 1 -- start start 2021-01-03T12:58:21.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6cc259700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6b0003720 0x7fc6c4142460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:21.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6cc259700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c40b53a0 0x7fc6c413d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:21.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6cc259700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6c4143570 0x7fc6c4143a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:21.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6cc259700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40b0970 con 0x7fc6b0003720 2021-01-03T12:58:21.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6cc259700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c41430a0 con 0x7fc6c40b53a0 2021-01-03T12:58:21.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6cc259700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40b4020 con 0x7fc6c4143570 2021-01-03T12:58:21.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6c97f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c40b53a0 0x7fc6c413d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:21.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6c97f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c40b53a0 0x7fc6c413d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60552/0 (socket says 172.21.15.133:60552) 2021-01-03T12:58:21.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6c97f4700 1 -- 172.21.15.133:0/3161700760 learned_addr learned my addr 172.21.15.133:0/3161700760 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:21.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6ca7f6700 1 --2- 172.21.15.133:0/3161700760 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6c4143570 0x7fc6c4143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:21.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6c9ff5700 1 --2- 172.21.15.133:0/3161700760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6b0003720 0x7fc6c4142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:21.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6c97f4700 1 -- 172.21.15.133:0/3161700760 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6c4143570 msgr2=0x7fc6c4143a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:21.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6c97f4700 1 --2- 172.21.15.133:0/3161700760 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6c4143570 0x7fc6c4143a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:21.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6c97f4700 1 -- 172.21.15.133:0/3161700760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6b0003720 msgr2=0x7fc6c4142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:21.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6c97f4700 1 --2- 172.21.15.133:0/3161700760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6b0003720 0x7fc6c4142460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:21.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6c97f4700 1 -- 172.21.15.133:0/3161700760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c4142b60 con 0x7fc6c40b53a0 2021-01-03T12:58:21.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6c9ff5700 1 --2- 172.21.15.133:0/3161700760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6b0003720 0x7fc6c4142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:21.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6c97f4700 1 --2- 172.21.15.133:0/3161700760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c40b53a0 0x7fc6c413d220 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fc6c413ef40 tx=0x7fc6b8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:21.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6c2ffd700 1 -- 172.21.15.133:0/3161700760 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6b800eb60 con 0x7fc6c40b53a0 2021-01-03T12:58:21.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6cc259700 1 -- 172.21.15.133:0/3161700760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c4142e00 con 0x7fc6c40b53a0 2021-01-03T12:58:21.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6c2ffd700 1 -- 172.21.15.133:0/3161700760 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b800ecc0 con 0x7fc6c40b53a0 2021-01-03T12:58:21.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6c2ffd700 1 -- 172.21.15.133:0/3161700760 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6b8014470 con 0x7fc6c40b53a0 2021-01-03T12:58:21.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.835+0000 7fc6cc259700 1 -- 172.21.15.133:0/3161700760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c413f060 con 0x7fc6c40b53a0 2021-01-03T12:58:21.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.839+0000 7fc6cc259700 1 -- 172.21.15.133:0/3161700760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c4057300 con 0x7fc6c40b53a0 2021-01-03T12:58:21.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.839+0000 7fc6c2ffd700 1 -- 172.21.15.133:0/3161700760 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc6b80145d0 con 0x7fc6c40b53a0 2021-01-03T12:58:21.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.839+0000 7fc6c2ffd700 1 --2- 172.21.15.133:0/3161700760 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc6a4055330 0x7fc6a40577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:21.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.839+0000 7fc6c2ffd700 1 -- 172.21.15.133:0/3161700760 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc6b806e9a0 con 0x7fc6c40b53a0 2021-01-03T12:58:21.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.839+0000 7fc6c9ff5700 1 --2- 172.21.15.133:0/3161700760 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc6a4055330 0x7fc6a40577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:21.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.839+0000 7fc6c9ff5700 1 --2- 172.21.15.133:0/3161700760 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc6a4055330 0x7fc6a40577f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fc6bc019000 tx=0x7fc6bc016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:21.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.847+0000 7fc6c2ffd700 1 -- 172.21.15.133:0/3161700760 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc6b8044ba0 con 0x7fc6c40b53a0 2021-01-03T12:58:21.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.987+0000 7fc6cc259700 1 -- 172.21.15.133:0/3161700760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc6c40ab000 con 0x7fc6c40b53a0 2021-01-03T12:58:21.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.987+0000 7fc6c2ffd700 1 -- 172.21.15.133:0/3161700760 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc6b8018070 con 0x7fc6c40b53a0 2021-01-03T12:58:21.989 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T12:58:21.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.987+0000 7fc6cc259700 1 -- 172.21.15.133:0/3161700760 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc6a4055330 msgr2=0x7fc6a40577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:21.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.987+0000 7fc6cc259700 1 --2- 172.21.15.133:0/3161700760 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc6a4055330 0x7fc6a40577f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fc6bc019000 tx=0x7fc6bc016000).stop 2021-01-03T12:58:21.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.987+0000 7fc6cc259700 1 -- 172.21.15.133:0/3161700760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c40b53a0 msgr2=0x7fc6c413d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:21.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.987+0000 7fc6cc259700 1 --2- 172.21.15.133:0/3161700760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c40b53a0 0x7fc6c413d220 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fc6c413ef40 tx=0x7fc6b8008040).stop 2021-01-03T12:58:21.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.987+0000 7fc6cc259700 1 -- 172.21.15.133:0/3161700760 shutdown_connections 2021-01-03T12:58:21.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.987+0000 7fc6cc259700 1 --2- 172.21.15.133:0/3161700760 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc6a4055330 0x7fc6a40577f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:21.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.987+0000 7fc6cc259700 1 --2- 172.21.15.133:0/3161700760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6b0003720 0x7fc6c4142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:21.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.987+0000 7fc6cc259700 1 --2- 172.21.15.133:0/3161700760 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6c4143570 0x7fc6c4143a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:21.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.987+0000 7fc6cc259700 1 --2- 172.21.15.133:0/3161700760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6c40b53a0 0x7fc6c413d220 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:21.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.991+0000 7fc6cc259700 1 -- 172.21.15.133:0/3161700760 >> 172.21.15.133:0/3161700760 conn(0x7fc6c406aeb0 msgr2=0x7fc6c4069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:21.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.991+0000 7fc6cc259700 1 -- 172.21.15.133:0/3161700760 shutdown_connections 2021-01-03T12:58:21.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:21.991+0000 7fc6cc259700 1 -- 172.21.15.133:0/3161700760 wait complete. 2021-01-03T12:58:22.002 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T12:58:22.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64f0860700 1 Processor -- start 2021-01-03T12:58:22.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64f0860700 1 -- start start 2021-01-03T12:58:22.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64f0860700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f64ec0b2e90 0x7f64ec13fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64f0860700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ec0af220 con 0x7f64ec0b0ac0 2021-01-03T12:58:22.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64f0860700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ec0b3270 con 0x7f64ec0ae800 2021-01-03T12:58:22.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64f0860700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ec1401c0 con 0x7f64ec0b2e90 2021-01-03T12:58:22.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64ebfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f64ec0ae800 0x7f64ec13cf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53358/0 (socket says 172.21.15.133:53358) 2021-01-03T12:58:22.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64ebfff700 1 -- 172.21.15.133:0/1200633504 learned_addr learned my addr 172.21.15.133:0/1200633504 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:22.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64eb7fe700 1 --2- 172.21.15.133:0/1200633504 >> v2:172.21.15.16:3300/0 conn(0x7f64ec0b2e90 0x7f64ec13fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64ea7fc700 1 -- 172.21.15.133:0/1200633504 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524210513 0 0) 0x7f64ec0b3270 con 0x7f64ec0ae800 2021-01-03T12:58:22.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64ea7fc700 1 -- 172.21.15.133:0/1200633504 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64cc003230 con 0x7f64ec0ae800 2021-01-03T12:58:22.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64ea7fc700 1 -- 172.21.15.133:0/1200633504 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855049848 0 0) 0x7f64ec0af220 con 0x7f64ec0b0ac0 2021-01-03T12:58:22.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64ea7fc700 1 -- 172.21.15.133:0/1200633504 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64ec0b3270 con 0x7f64ec0b0ac0 2021-01-03T12:58:22.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64ea7fc700 1 -- 172.21.15.133:0/1200633504 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2876524230 0 0) 0x7f64cc003230 con 0x7f64ec0ae800 2021-01-03T12:58:22.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64eb7fe700 1 -- 172.21.15.133:0/1200633504 >> v1:172.21.15.133:6789/0 conn(0x7f64ec0ae800 legacy=0x7f64ec13cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64eb7fe700 1 -- 172.21.15.133:0/1200633504 >> v1:172.21.15.16:6789/0 conn(0x7f64ec0b0ac0 legacy=0x7f64ec143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64eb7fe700 1 -- 172.21.15.133:0/1200633504 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec0aef80 con 0x7f64ec0b2e90 2021-01-03T12:58:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64eb7fe700 1 --2- 172.21.15.133:0/1200633504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64ec0b2e90 0x7f64ec13fcd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f64e4001870 tx=0x7f64dc0091a0).ready entity=mon.0 client_cookie=b8adafe7433b1a0b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.115+0000 7f64ea7fc700 1 -- 172.21.15.133:0/1200633504 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64e40016d0 con 0x7f64ec0b2e90 2021-01-03T12:58:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64ea7fc700 1 -- 172.21.15.133:0/1200633504 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64dc00b920 con 0x7f64ec0b2e90 2021-01-03T12:58:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64ea7fc700 1 -- 172.21.15.133:0/1200633504 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64dc00ba90 con 0x7f64ec0b2e90 2021-01-03T12:58:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64f0860700 1 -- 172.21.15.133:0/1200633504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64ec0b2e90 msgr2=0x7f64ec13fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64f0860700 1 --2- 172.21.15.133:0/1200633504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64ec0b2e90 0x7f64ec13fcd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f64e4001870 tx=0x7f64dc0091a0).stop 2021-01-03T12:58:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64f0860700 1 -- 172.21.15.133:0/1200633504 shutdown_connections 2021-01-03T12:58:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64f0860700 1 --2- 172.21.15.133:0/1200633504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64ec0b2e90 0x7f64ec13fcd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64f0860700 1 -- 172.21.15.133:0/1200633504 >> 172.21.15.133:0/1200633504 conn(0x7f64ec06a620 msgr2=0x7f64ec06aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64f0860700 1 -- 172.21.15.133:0/1200633504 shutdown_connections 2021-01-03T12:58:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64f0860700 1 -- 172.21.15.133:0/1200633504 wait complete. 2021-01-03T12:58:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64f0860700 1 Processor -- start 2021-01-03T12:58:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64f0860700 1 -- start start 2021-01-03T12:58:22.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64f0860700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64ec0ae800 0x7f64ec13cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64f0860700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64ec0b0ac0 0x7f64ec13e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64f0860700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64ec0b2e90 0x7f64ec13ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64f0860700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec1455a0 con 0x7f64ec0ae800 2021-01-03T12:58:22.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64f0860700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec0b4c70 con 0x7f64ec0b2e90 2021-01-03T12:58:22.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64f0860700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec0b5780 con 0x7f64ec0b0ac0 2021-01-03T12:58:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64ebfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64ec0b2e90 0x7f64ec13ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64ebfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64ec0b2e90 0x7f64ec13ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60568/0 (socket says 172.21.15.133:60568) 2021-01-03T12:58:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64ebfff700 1 -- 172.21.15.133:0/2398440892 learned_addr learned my addr 172.21.15.133:0/2398440892 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64eaffd700 1 --2- 172.21.15.133:0/2398440892 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64ec0b0ac0 0x7f64ec13e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.119+0000 7f64eb7fe700 1 --2- 172.21.15.133:0/2398440892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64ec0ae800 0x7f64ec13cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.123+0000 7f64ebfff700 1 -- 172.21.15.133:0/2398440892 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64ec0b0ac0 msgr2=0x7f64ec13e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.123+0000 7f64ebfff700 1 --2- 172.21.15.133:0/2398440892 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64ec0b0ac0 0x7f64ec13e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.123+0000 7f64ebfff700 1 -- 172.21.15.133:0/2398440892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64ec0ae800 msgr2=0x7f64ec13cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.123+0000 7f64ebfff700 1 --2- 172.21.15.133:0/2398440892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64ec0ae800 0x7f64ec13cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.123+0000 7f64ebfff700 1 -- 172.21.15.133:0/2398440892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec0b5a20 con 0x7f64ec0b2e90 2021-01-03T12:58:22.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.123+0000 7f64eb7fe700 1 --2- 172.21.15.133:0/2398440892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64ec0ae800 0x7f64ec13cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:22.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.123+0000 7f64ebfff700 1 --2- 172.21.15.133:0/2398440892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64ec0b2e90 0x7f64ec13ea20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f64e4001830 tx=0x7f64e4001b00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:22.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.123+0000 7f64e8ff9700 1 -- 172.21.15.133:0/2398440892 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64e400ce70 con 0x7f64ec0b2e90 2021-01-03T12:58:22.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.123+0000 7f64e8ff9700 1 -- 172.21.15.133:0/2398440892 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e4007170 con 0x7f64ec0b2e90 2021-01-03T12:58:22.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.123+0000 7f64f0860700 1 -- 172.21.15.133:0/2398440892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ec0b5cc0 con 0x7f64ec0b2e90 2021-01-03T12:58:22.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.123+0000 7f64e8ff9700 1 -- 172.21.15.133:0/2398440892 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64e4004700 con 0x7f64ec0b2e90 2021-01-03T12:58:22.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.123+0000 7f64f0860700 1 -- 172.21.15.133:0/2398440892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ec1452b0 con 0x7f64ec0b2e90 2021-01-03T12:58:22.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.123+0000 7f64f0860700 1 -- 172.21.15.133:0/2398440892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ec13e290 con 0x7f64ec0b2e90 2021-01-03T12:58:22.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.123+0000 7f64e8ff9700 1 -- 172.21.15.133:0/2398440892 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f64e401b060 con 0x7f64ec0b2e90 2021-01-03T12:58:22.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.123+0000 7f64e8ff9700 1 --2- 172.21.15.133:0/2398440892 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64d00553b0 0x7f64d0057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.127+0000 7f64eb7fe700 1 --2- 172.21.15.133:0/2398440892 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64d00553b0 0x7f64d0057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.127+0000 7f64e8ff9700 1 -- 172.21.15.133:0/2398440892 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f64e406dca0 con 0x7f64ec0b2e90 2021-01-03T12:58:22.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.127+0000 7f64eb7fe700 1 --2- 172.21.15.133:0/2398440892 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64d00553b0 0x7f64d0057870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f64dc01a000 tx=0x7f64dc016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:22.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.131+0000 7f64e8ff9700 1 -- 172.21.15.133:0/2398440892 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f64ec13e290 con 0x7f64ec0b2e90 2021-01-03T12:58:22.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.275+0000 7f64f0860700 1 -- 172.21.15.133:0/2398440892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f64ec13e290 con 0x7f64ec0b2e90 2021-01-03T12:58:22.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.275+0000 7f64e8ff9700 1 -- 172.21.15.133:0/2398440892 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f64ec13e290 con 0x7f64ec0b2e90 2021-01-03T12:58:22.276 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:22.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.275+0000 7f64f0860700 1 -- 172.21.15.133:0/2398440892 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64d00553b0 msgr2=0x7f64d0057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.275+0000 7f64f0860700 1 --2- 172.21.15.133:0/2398440892 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64d00553b0 0x7f64d0057870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f64dc01a000 tx=0x7f64dc016000).stop 2021-01-03T12:58:22.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.275+0000 7f64f0860700 1 -- 172.21.15.133:0/2398440892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64ec0b2e90 msgr2=0x7f64ec13ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.275+0000 7f64f0860700 1 --2- 172.21.15.133:0/2398440892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64ec0b2e90 0x7f64ec13ea20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f64e4001830 tx=0x7f64e4001b00).stop 2021-01-03T12:58:22.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.275+0000 7f64f0860700 1 -- 172.21.15.133:0/2398440892 shutdown_connections 2021-01-03T12:58:22.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.275+0000 7f64f0860700 1 --2- 172.21.15.133:0/2398440892 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64d00553b0 0x7f64d0057870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.275+0000 7f64f0860700 1 --2- 172.21.15.133:0/2398440892 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64ec0ae800 0x7f64ec13cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.275+0000 7f64f0860700 1 --2- 172.21.15.133:0/2398440892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64ec0b2e90 0x7f64ec13ea20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.275+0000 7f64f0860700 1 --2- 172.21.15.133:0/2398440892 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64ec0b0ac0 0x7f64ec13e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.275+0000 7f64f0860700 1 -- 172.21.15.133:0/2398440892 >> 172.21.15.133:0/2398440892 conn(0x7f64ec06a620 msgr2=0x7f64ec140300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:22.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.275+0000 7f64f0860700 1 -- 172.21.15.133:0/2398440892 shutdown_connections 2021-01-03T12:58:22.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.275+0000 7f64f0860700 1 -- 172.21.15.133:0/2398440892 wait complete. 2021-01-03T12:58:22.290 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T12:58:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.407+0000 7f0ee50ce700 1 Processor -- start 2021-01-03T12:58:22.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.407+0000 7f0ee50ce700 1 -- start start 2021-01-03T12:58:22.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.407+0000 7f0ee50ce700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ee00b5260 0x7f0ee01470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.407+0000 7f0ee50ce700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ee00b5c00 0x7f0ee01475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.407+0000 7f0ee50ce700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee00b0c10 con 0x7f0ee01442a0 2021-01-03T12:58:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.407+0000 7f0ee50ce700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee00b5640 con 0x7f0ee00b5260 2021-01-03T12:58:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.407+0000 7f0ee50ce700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee009a4f0 con 0x7f0ee00b5c00 2021-01-03T12:58:22.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.407+0000 7f0edffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ee00b5260 0x7f0ee01470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.407+0000 7f0edffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ee00b5260 0x7f0ee01470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60572/0 (socket says 172.21.15.133:60572) 2021-01-03T12:58:22.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0edffff700 1 -- 172.21.15.133:0/913898362 learned_addr learned my addr 172.21.15.133:0/913898362 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:22.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0edf7fe700 1 --2- 172.21.15.133:0/913898362 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ee00b5c00 0x7f0ee01475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0edeffd700 1 -- 172.21.15.133:0/913898362 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465765491 0 0) 0x7f0ee00b0c10 con 0x7f0ee01442a0 2021-01-03T12:58:22.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0edeffd700 1 -- 172.21.15.133:0/913898362 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec4003230 con 0x7f0ee01442a0 2021-01-03T12:58:22.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0edffff700 1 -- 172.21.15.133:0/913898362 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ee00b5c00 msgr2=0x7f0ee01475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:22.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0edffff700 1 --2- 172.21.15.133:0/913898362 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ee00b5c00 0x7f0ee01475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0edffff700 1 -- 172.21.15.133:0/913898362 >> v1:172.21.15.16:6789/0 conn(0x7f0ee01442a0 legacy=0x7f0ee0144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0edffff700 1 -- 172.21.15.133:0/913898362 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee00b0e40 con 0x7f0ee00b5260 2021-01-03T12:58:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0edffff700 1 --2- 172.21.15.133:0/913898362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee00b5260 0x7f0ee01470b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f0ec8002f30 tx=0x7f0ec8006e80).ready entity=mon.1 client_cookie=e309f94b3b772bb3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0edeffd700 1 -- 172.21.15.133:0/913898362 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ec8009640 con 0x7f0ee00b5260 2021-01-03T12:58:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0edeffd700 1 -- 172.21.15.133:0/913898362 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec80097a0 con 0x7f0ee00b5260 2021-01-03T12:58:22.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0edeffd700 1 -- 172.21.15.133:0/913898362 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ec8009b00 con 0x7f0ee00b5260 2021-01-03T12:58:22.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0ee50ce700 1 -- 172.21.15.133:0/913898362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee00b5260 msgr2=0x7f0ee01470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0ee50ce700 1 --2- 172.21.15.133:0/913898362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee00b5260 0x7f0ee01470b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f0ec8002f30 tx=0x7f0ec8006e80).stop 2021-01-03T12:58:22.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0ee50ce700 1 -- 172.21.15.133:0/913898362 shutdown_connections 2021-01-03T12:58:22.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0ee50ce700 1 --2- 172.21.15.133:0/913898362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee00b5260 0x7f0ee01470b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0ee50ce700 1 --2- 172.21.15.133:0/913898362 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ee00b5c00 0x7f0ee01475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0ee50ce700 1 -- 172.21.15.133:0/913898362 >> 172.21.15.133:0/913898362 conn(0x7f0ee005bdf0 msgr2=0x7f0ee005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:22.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0ee50ce700 1 -- 172.21.15.133:0/913898362 shutdown_connections 2021-01-03T12:58:22.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.411+0000 7f0ee50ce700 1 -- 172.21.15.133:0/913898362 wait complete. 2021-01-03T12:58:22.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0ee50ce700 1 Processor -- start 2021-01-03T12:58:22.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0ee50ce700 1 -- start start 2021-01-03T12:58:22.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0ee50ce700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ee00b5260 0x7f0ee00aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0ee50ce700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee00b5c00 0x7f0ee0065f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0ee50ce700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ee01442a0 0x7f0ee0143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0ee50ce700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee00657f0 con 0x7f0ee01442a0 2021-01-03T12:58:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0ee50ce700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0145290 con 0x7f0ee00b5c00 2021-01-03T12:58:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0ee50ce700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0067270 con 0x7f0ee00b5260 2021-01-03T12:58:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0edf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee00b5c00 0x7f0ee0065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0edf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee00b5c00 0x7f0ee0065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60580/0 (socket says 172.21.15.133:60580) 2021-01-03T12:58:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0edf7fe700 1 -- 172.21.15.133:0/1634906083 learned_addr learned my addr 172.21.15.133:0/1634906083 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:22.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0edffff700 1 --2- 172.21.15.133:0/1634906083 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ee00b5260 0x7f0ee00aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0ee48cd700 1 --2- 172.21.15.133:0/1634906083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ee01442a0 0x7f0ee0143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0edf7fe700 1 -- 172.21.15.133:0/1634906083 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ee00b5260 msgr2=0x7f0ee00aa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0edf7fe700 1 --2- 172.21.15.133:0/1634906083 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ee00b5260 0x7f0ee00aa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0edf7fe700 1 -- 172.21.15.133:0/1634906083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ee01442a0 msgr2=0x7f0ee0143200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0edf7fe700 1 --2- 172.21.15.133:0/1634906083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ee01442a0 0x7f0ee0143200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0edf7fe700 1 -- 172.21.15.133:0/1634906083 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee0065a20 con 0x7f0ee00b5c00 2021-01-03T12:58:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0edf7fe700 1 --2- 172.21.15.133:0/1634906083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee00b5c00 0x7f0ee0065f10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f0ed800c000 tx=0x7f0ed80091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0edd7fa700 1 -- 172.21.15.133:0/1634906083 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ed800cbb0 con 0x7f0ee00b5c00 2021-01-03T12:58:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0edd7fa700 1 -- 172.21.15.133:0/1634906083 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed800cd10 con 0x7f0ee00b5c00 2021-01-03T12:58:22.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0ee50ce700 1 -- 172.21.15.133:0/1634906083 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee0144ff0 con 0x7f0ee00b5c00 2021-01-03T12:58:22.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0edd7fa700 1 -- 172.21.15.133:0/1634906083 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ed80125e0 con 0x7f0ee00b5c00 2021-01-03T12:58:22.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.415+0000 7f0ee50ce700 1 -- 172.21.15.133:0/1634906083 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee0066400 con 0x7f0ee00b5c00 2021-01-03T12:58:22.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.419+0000 7f0ee50ce700 1 -- 172.21.15.133:0/1634906083 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee0057300 con 0x7f0ee00b5c00 2021-01-03T12:58:22.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.419+0000 7f0edd7fa700 1 -- 172.21.15.133:0/1634906083 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0ed8022070 con 0x7f0ee00b5c00 2021-01-03T12:58:22.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.419+0000 7f0edd7fa700 1 --2- 172.21.15.133:0/1634906083 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0eb8055440 0x7f0eb8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.419+0000 7f0edd7fa700 1 -- 172.21.15.133:0/1634906083 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0ed806e730 con 0x7f0ee00b5c00 2021-01-03T12:58:22.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.419+0000 7f0edffff700 1 --2- 172.21.15.133:0/1634906083 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0eb8055440 0x7f0eb8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.419+0000 7f0edffff700 1 --2- 172.21.15.133:0/1634906083 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0eb8055440 0x7f0eb8057900 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f0ec8019000 tx=0x7f0ec8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:22.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.427+0000 7f0edd7fa700 1 -- 172.21.15.133:0/1634906083 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0ed8044a30 con 0x7f0ee00b5c00 2021-01-03T12:58:22.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.567+0000 7f0ee50ce700 1 -- 172.21.15.133:0/1634906083 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ee005ce00 con 0x7f0ee00b5c00 2021-01-03T12:58:22.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.567+0000 7f0edd7fa700 1 -- 172.21.15.133:0/1634906083 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0ed8048050 con 0x7f0ee00b5c00 2021-01-03T12:58:22.570 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:22.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.571+0000 7f0ee50ce700 1 -- 172.21.15.133:0/1634906083 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0eb8055440 msgr2=0x7f0eb8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.571+0000 7f0ee50ce700 1 --2- 172.21.15.133:0/1634906083 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0eb8055440 0x7f0eb8057900 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f0ec8019000 tx=0x7f0ec8015000).stop 2021-01-03T12:58:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.571+0000 7f0ee50ce700 1 -- 172.21.15.133:0/1634906083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee00b5c00 msgr2=0x7f0ee0065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.571+0000 7f0ee50ce700 1 --2- 172.21.15.133:0/1634906083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee00b5c00 0x7f0ee0065f10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f0ed800c000 tx=0x7f0ed80091a0).stop 2021-01-03T12:58:22.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.571+0000 7f0ee50ce700 1 -- 172.21.15.133:0/1634906083 shutdown_connections 2021-01-03T12:58:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.571+0000 7f0ee50ce700 1 --2- 172.21.15.133:0/1634906083 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0eb8055440 0x7f0eb8057900 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.571+0000 7f0ee50ce700 1 --2- 172.21.15.133:0/1634906083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ee01442a0 0x7f0ee0143200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.571+0000 7f0ee50ce700 1 --2- 172.21.15.133:0/1634906083 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ee00b5260 0x7f0ee00aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.571+0000 7f0ee50ce700 1 --2- 172.21.15.133:0/1634906083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee00b5c00 0x7f0ee0065f10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.571+0000 7f0ee50ce700 1 -- 172.21.15.133:0/1634906083 >> 172.21.15.133:0/1634906083 conn(0x7f0ee005bdf0 msgr2=0x7f0ee00b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:22.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.571+0000 7f0ee50ce700 1 -- 172.21.15.133:0/1634906083 shutdown_connections 2021-01-03T12:58:22.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.571+0000 7f0ee50ce700 1 -- 172.21.15.133:0/1634906083 wait complete. 2021-01-03T12:58:22.583 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T12:58:22.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.699+0000 7f5e72a77700 1 Processor -- start 2021-01-03T12:58:22.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.699+0000 7f5e72a77700 1 -- start start 2021-01-03T12:58:22.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72a77700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5e6c144c60 0x7f5e6c141620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72a77700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5e6c05bdf0 0x7f5e6c0ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72a77700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6c0af5e0 con 0x7f5e6c0af200 2021-01-03T12:58:22.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72a77700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6c05c2a0 con 0x7f5e6c144c60 2021-01-03T12:58:22.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72a77700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6c05c4c0 con 0x7f5e6c05bdf0 2021-01-03T12:58:22.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72276700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5e6c05bdf0 0x7f5e6c0ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72276700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5e6c05bdf0 0x7f5e6c0ab0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60590/0 (socket says 172.21.15.133:60590) 2021-01-03T12:58:22.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72276700 1 -- 172.21.15.133:0/4210282182 learned_addr learned my addr 172.21.15.133:0/4210282182 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:22.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e71274700 1 --2- 172.21.15.133:0/4210282182 >> v2:172.21.15.16:3300/0 conn(0x7f5e6c144c60 0x7f5e6c141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72276700 1 -- 172.21.15.133:0/4210282182 >> v2:172.21.15.16:3300/0 conn(0x7f5e6c144c60 msgr2=0x7f5e6c141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:22.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72276700 1 --2- 172.21.15.133:0/4210282182 >> v2:172.21.15.16:3300/0 conn(0x7f5e6c144c60 0x7f5e6c141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72276700 1 -- 172.21.15.133:0/4210282182 >> v1:172.21.15.16:6789/0 conn(0x7f5e6c0af200 legacy=0x7f5e6c144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72276700 1 -- 172.21.15.133:0/4210282182 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c05c760 con 0x7f5e6c05bdf0 2021-01-03T12:58:22.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72276700 1 --2- 172.21.15.133:0/4210282182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e6c05bdf0 0x7f5e6c0ab0d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f5e64003300 tx=0x7f5e64009250).ready entity=mon.1 client_cookie=a2ab01fd8775ffd3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:22.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e70a73700 1 -- 172.21.15.133:0/4210282182 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e6400bc00 con 0x7f5e6c05bdf0 2021-01-03T12:58:22.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e70a73700 1 -- 172.21.15.133:0/4210282182 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6400bd60 con 0x7f5e6c05bdf0 2021-01-03T12:58:22.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e70a73700 1 -- 172.21.15.133:0/4210282182 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e64011400 con 0x7f5e6c05bdf0 2021-01-03T12:58:22.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72a77700 1 -- 172.21.15.133:0/4210282182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e6c05bdf0 msgr2=0x7f5e6c0ab0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72a77700 1 --2- 172.21.15.133:0/4210282182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e6c05bdf0 0x7f5e6c0ab0d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f5e64003300 tx=0x7f5e64009250).stop 2021-01-03T12:58:22.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72a77700 1 -- 172.21.15.133:0/4210282182 shutdown_connections 2021-01-03T12:58:22.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72a77700 1 --2- 172.21.15.133:0/4210282182 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e6c05bdf0 0x7f5e6c0ab0d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72a77700 1 --2- 172.21.15.133:0/4210282182 >> v2:172.21.15.16:3300/0 conn(0x7f5e6c144c60 0x7f5e6c141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72a77700 1 -- 172.21.15.133:0/4210282182 >> 172.21.15.133:0/4210282182 conn(0x7f5e6c06b050 msgr2=0x7f5e6c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:22.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72a77700 1 -- 172.21.15.133:0/4210282182 shutdown_connections 2021-01-03T12:58:22.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72a77700 1 -- 172.21.15.133:0/4210282182 wait complete. 2021-01-03T12:58:22.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.703+0000 7f5e72a77700 1 Processor -- start 2021-01-03T12:58:22.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72a77700 1 -- start start 2021-01-03T12:58:22.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72a77700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e6c05bdf0 0x7f5e6c147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72a77700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5e6c0af200 0x7f5e6c13da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72a77700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e6c144c60 0x7f5e6c13df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72a77700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c141ee0 con 0x7f5e6c05bdf0 2021-01-03T12:58:22.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72a77700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c142180 con 0x7f5e6c144c60 2021-01-03T12:58:22.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72a77700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c063010 con 0x7f5e6c0af200 2021-01-03T12:58:22.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72276700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e6c144c60 0x7f5e6c13df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72276700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e6c144c60 0x7f5e6c13df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60596/0 (socket says 172.21.15.133:60596) 2021-01-03T12:58:22.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72276700 1 -- 172.21.15.133:0/848903635 learned_addr learned my addr 172.21.15.133:0/848903635 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:22.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e71274700 1 --2- 172.21.15.133:0/848903635 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5e6c0af200 0x7f5e6c13da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e71a75700 1 --2- 172.21.15.133:0/848903635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e6c05bdf0 0x7f5e6c147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72276700 1 -- 172.21.15.133:0/848903635 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5e6c0af200 msgr2=0x7f5e6c13da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72276700 1 --2- 172.21.15.133:0/848903635 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5e6c0af200 0x7f5e6c13da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72276700 1 -- 172.21.15.133:0/848903635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e6c05bdf0 msgr2=0x7f5e6c147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72276700 1 --2- 172.21.15.133:0/848903635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e6c05bdf0 0x7f5e6c147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72276700 1 -- 172.21.15.133:0/848903635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c063390 con 0x7f5e6c144c60 2021-01-03T12:58:22.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72276700 1 --2- 172.21.15.133:0/848903635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e6c144c60 0x7f5e6c13df10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f5e64003300 tx=0x7f5e64016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:22.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e5effd700 1 -- 172.21.15.133:0/848903635 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e640068c0 con 0x7f5e6c144c60 2021-01-03T12:58:22.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e5effd700 1 -- 172.21.15.133:0/848903635 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6400bed0 con 0x7f5e6c144c60 2021-01-03T12:58:22.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72a77700 1 -- 172.21.15.133:0/848903635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6c065160 con 0x7f5e6c144c60 2021-01-03T12:58:22.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e5effd700 1 -- 172.21.15.133:0/848903635 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e6401f610 con 0x7f5e6c144c60 2021-01-03T12:58:22.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72a77700 1 -- 172.21.15.133:0/848903635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6c0abf40 con 0x7f5e6c144c60 2021-01-03T12:58:22.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.707+0000 7f5e72a77700 1 -- 172.21.15.133:0/848903635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e6c057300 con 0x7f5e6c144c60 2021-01-03T12:58:22.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.711+0000 7f5e5effd700 1 -- 172.21.15.133:0/848903635 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5e6400f070 con 0x7f5e6c144c60 2021-01-03T12:58:22.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.711+0000 7f5e5effd700 1 --2- 172.21.15.133:0/848903635 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5e4c055330 0x7f5e4c0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.711+0000 7f5e5effd700 1 -- 172.21.15.133:0/848903635 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5e6406ed40 con 0x7f5e6c144c60 2021-01-03T12:58:22.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.711+0000 7f5e71a75700 1 --2- 172.21.15.133:0/848903635 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5e4c055330 0x7f5e4c0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.711+0000 7f5e71a75700 1 --2- 172.21.15.133:0/848903635 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5e4c055330 0x7f5e4c0577f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f5e6800b000 tx=0x7f5e68009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:22.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.715+0000 7f5e5effd700 1 -- 172.21.15.133:0/848903635 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5e64048e60 con 0x7f5e6c144c60 2021-01-03T12:58:22.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.855+0000 7f5e72a77700 1 -- 172.21.15.133:0/848903635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e6c05f080 con 0x7f5e6c144c60 2021-01-03T12:58:22.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.855+0000 7f5e5effd700 1 -- 172.21.15.133:0/848903635 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5e64024070 con 0x7f5e6c144c60 2021-01-03T12:58:22.855 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:22.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.855+0000 7f5e72a77700 1 -- 172.21.15.133:0/848903635 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5e4c055330 msgr2=0x7f5e4c0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.855+0000 7f5e72a77700 1 --2- 172.21.15.133:0/848903635 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5e4c055330 0x7f5e4c0577f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f5e6800b000 tx=0x7f5e68009040).stop 2021-01-03T12:58:22.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.855+0000 7f5e72a77700 1 -- 172.21.15.133:0/848903635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e6c144c60 msgr2=0x7f5e6c13df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.855+0000 7f5e72a77700 1 --2- 172.21.15.133:0/848903635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e6c144c60 0x7f5e6c13df10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f5e64003300 tx=0x7f5e64016000).stop 2021-01-03T12:58:22.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.855+0000 7f5e72a77700 1 -- 172.21.15.133:0/848903635 shutdown_connections 2021-01-03T12:58:22.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.855+0000 7f5e72a77700 1 --2- 172.21.15.133:0/848903635 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5e4c055330 0x7f5e4c0577f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.855+0000 7f5e72a77700 1 --2- 172.21.15.133:0/848903635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e6c05bdf0 0x7f5e6c147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.855+0000 7f5e72a77700 1 --2- 172.21.15.133:0/848903635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5e6c144c60 0x7f5e6c13df10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.855+0000 7f5e72a77700 1 --2- 172.21.15.133:0/848903635 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5e6c0af200 0x7f5e6c13da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.855+0000 7f5e72a77700 1 -- 172.21.15.133:0/848903635 >> 172.21.15.133:0/848903635 conn(0x7f5e6c06b050 msgr2=0x7f5e6c067660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:22.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.855+0000 7f5e72a77700 1 -- 172.21.15.133:0/848903635 shutdown_connections 2021-01-03T12:58:22.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.855+0000 7f5e72a77700 1 -- 172.21.15.133:0/848903635 wait complete. 2021-01-03T12:58:22.869 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:22.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.975+0000 7fcc432c7700 1 Processor -- start 2021-01-03T12:58:22.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.975+0000 7fcc432c7700 1 -- start start 2021-01-03T12:58:22.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.975+0000 7fcc432c7700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcc3c0b52c0 0x7fcc3c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.975+0000 7fcc432c7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc3c0b5c00 0x7fcc3c143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.975+0000 7fcc432c7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3c060da0 con 0x7fcc3c0b0c90 2021-01-03T12:58:22.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.975+0000 7fcc432c7700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3c067a90 con 0x7fcc3c0b52c0 2021-01-03T12:58:22.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.975+0000 7fcc432c7700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c0b0ad0 con 0x7fcc3c0b5c00 2021-01-03T12:58:22.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc41ac4700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcc3c0b0c90 0x7fcc3c098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53400/0 (socket says 172.21.15.133:53400) 2021-01-03T12:58:22.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc41ac4700 1 -- 172.21.15.133:0/1284230534 learned_addr learned my addr 172.21.15.133:0/1284230534 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:22.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc42ac6700 1 --2- 172.21.15.133:0/1284230534 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc3c0b5c00 0x7fcc3c143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc422c5700 1 --2- 172.21.15.133:0/1284230534 >> v2:172.21.15.16:3300/0 conn(0x7fcc3c0b52c0 0x7fcc3c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 -- 172.21.15.133:0/1284230534 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788885337 0 0) 0x7fcc3c060da0 con 0x7fcc3c0b0c90 2021-01-03T12:58:22.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 -- 172.21.15.133:0/1284230534 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc28003230 con 0x7fcc3c0b0c90 2021-01-03T12:58:22.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 -- 172.21.15.133:0/1284230534 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3330497984 0 0) 0x7fcc28003230 con 0x7fcc3c0b0c90 2021-01-03T12:58:22.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 -- 172.21.15.133:0/1284230534 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc3c0b5c00 msgr2=0x7fcc3c143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:22.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 --2- 172.21.15.133:0/1284230534 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc3c0b5c00 0x7fcc3c143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 -- 172.21.15.133:0/1284230534 >> v2:172.21.15.16:3300/0 conn(0x7fcc3c0b52c0 msgr2=0x7fcc3c0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:22.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 --2- 172.21.15.133:0/1284230534 >> v2:172.21.15.16:3300/0 conn(0x7fcc3c0b52c0 0x7fcc3c0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 -- 172.21.15.133:0/1284230534 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c0b56a0 con 0x7fcc3c0b0c90 2021-01-03T12:58:22.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 -- 172.21.15.133:0/1284230534 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fcc2c0016d0 con 0x7fcc3c0b0c90 2021-01-03T12:58:22.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 -- 172.21.15.133:0/1284230534 >> v1:172.21.15.133:6789/0 conn(0x7fcc3c0b0c90 legacy=0x7fcc3c098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 --2- 172.21.15.133:0/1284230534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc28003720 0x7fcc28003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 --2- 172.21.15.133:0/1284230534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc280044d0 0x7fcc28004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 --2- 172.21.15.133:0/1284230534 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc3c0b5c00 0x7fcc28004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 -- 172.21.15.133:0/1284230534 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c067a90 con 0x7fcc28003720 2021-01-03T12:58:22.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 -- 172.21.15.133:0/1284230534 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c0b0ad0 con 0x7fcc280044d0 2021-01-03T12:58:22.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 -- 172.21.15.133:0/1284230534 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc28004260 con 0x7fcc3c0b5c00 2021-01-03T12:58:22.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc41ac4700 1 --2- 172.21.15.133:0/1284230534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc280044d0 0x7fcc28004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc42ac6700 1 --2- 172.21.15.133:0/1284230534 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc3c0b5c00 0x7fcc28004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc41ac4700 1 -- 172.21.15.133:0/1284230534 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc3c0b5c00 msgr2=0x7fcc28004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:22.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc41ac4700 1 --2- 172.21.15.133:0/1284230534 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc3c0b5c00 0x7fcc28004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc41ac4700 1 -- 172.21.15.133:0/1284230534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc28003720 msgr2=0x7fcc28003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:22.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc41ac4700 1 --2- 172.21.15.133:0/1284230534 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc28003720 0x7fcc28003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-03T12:58:22.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc41ac4700 1 -- 172.21.15.133:0/1284230534 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc28003230 con 0x7fcc280044d0 2021-01-03T12:58:22.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc41ac4700 1 --2- 172.21.15.133:0/1284230534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc280044d0 0x7fcc28004950 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fcc2c0013e0 tx=0x7fcc3c0b0070).ready entity=mon.1 client_cookie=1756f1f03cf05a9d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:22.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 -- 172.21.15.133:0/1284230534 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc2c00ce00 con 0x7fcc280044d0 2021-01-03T12:58:22.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 -- 172.21.15.133:0/1284230534 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c0072e0 con 0x7fcc280044d0 2021-01-03T12:58:22.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc412c3700 1 -- 172.21.15.133:0/1284230534 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc2c0055e0 con 0x7fcc280044d0 2021-01-03T12:58:22.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc432c7700 1 -- 172.21.15.133:0/1284230534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc280044d0 msgr2=0x7fcc28004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc432c7700 1 --2- 172.21.15.133:0/1284230534 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc280044d0 0x7fcc28004950 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fcc2c0013e0 tx=0x7fcc3c0b0070).stop 2021-01-03T12:58:22.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc42ac6700 1 -- 172.21.15.133:0/1284230534 reap_dead start 2021-01-03T12:58:22.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc432c7700 1 -- 172.21.15.133:0/1284230534 shutdown_connections 2021-01-03T12:58:22.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc432c7700 1 -- 172.21.15.133:0/1284230534 >> 172.21.15.133:0/1284230534 conn(0x7fcc3c05bdf0 msgr2=0x7fcc3c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:22.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc432c7700 1 -- 172.21.15.133:0/1284230534 shutdown_connections 2021-01-03T12:58:22.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.979+0000 7fcc432c7700 1 -- 172.21.15.133:0/1284230534 wait complete. 2021-01-03T12:58:22.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc432c7700 1 Processor -- start 2021-01-03T12:58:22.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc432c7700 1 -- start start 2021-01-03T12:58:22.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc432c7700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc3c0adea0 0x7fcc3c0aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc432c7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc3c156b20 0x7fcc3c0abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc432c7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc3c0ac0c0 0x7fcc3c1594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc432c7700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c066a60 con 0x7fcc3c0adea0 2021-01-03T12:58:22.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc432c7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c0ae6e0 con 0x7fcc3c156b20 2021-01-03T12:58:22.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc432c7700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c067360 con 0x7fcc3c0ac0c0 2021-01-03T12:58:22.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc41ac4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc3c156b20 0x7fcc3c0abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc41ac4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc3c156b20 0x7fcc3c0abbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60616/0 (socket says 172.21.15.133:60616) 2021-01-03T12:58:22.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc41ac4700 1 -- 172.21.15.133:0/2720362756 learned_addr learned my addr 172.21.15.133:0/2720362756 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:22.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc422c5700 1 --2- 172.21.15.133:0/2720362756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc3c0adea0 0x7fcc3c0aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc42ac6700 1 --2- 172.21.15.133:0/2720362756 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc3c0ac0c0 0x7fcc3c1594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc41ac4700 1 -- 172.21.15.133:0/2720362756 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc3c0ac0c0 msgr2=0x7fcc3c1594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc41ac4700 1 --2- 172.21.15.133:0/2720362756 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc3c0ac0c0 0x7fcc3c1594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc41ac4700 1 -- 172.21.15.133:0/2720362756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc3c0adea0 msgr2=0x7fcc3c0aaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:22.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc41ac4700 1 --2- 172.21.15.133:0/2720362756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc3c0adea0 0x7fcc3c0aaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:22.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc41ac4700 1 -- 172.21.15.133:0/2720362756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c0aed80 con 0x7fcc3c156b20 2021-01-03T12:58:22.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc41ac4700 1 --2- 172.21.15.133:0/2720362756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc3c156b20 0x7fcc3c0abbd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fcc3c0ae820 tx=0x7fcc2c013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:22.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc3b7fe700 1 -- 172.21.15.133:0/2720362756 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc2c01b070 con 0x7fcc3c156b20 2021-01-03T12:58:22.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc3b7fe700 1 -- 172.21.15.133:0/2720362756 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c0049b0 con 0x7fcc3c156b20 2021-01-03T12:58:22.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc432c7700 1 -- 172.21.15.133:0/2720362756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3c153b30 con 0x7fcc3c156b20 2021-01-03T12:58:22.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc3b7fe700 1 -- 172.21.15.133:0/2720362756 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc2c004d10 con 0x7fcc3c156b20 2021-01-03T12:58:22.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc432c7700 1 -- 172.21.15.133:0/2720362756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3c0ab3c0 con 0x7fcc3c156b20 2021-01-03T12:58:22.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc432c7700 1 -- 172.21.15.133:0/2720362756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3c156940 con 0x7fcc3c156b20 2021-01-03T12:58:22.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.983+0000 7fcc3b7fe700 1 -- 172.21.15.133:0/2720362756 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fcc2c010070 con 0x7fcc3c156b20 2021-01-03T12:58:22.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.987+0000 7fcc3b7fe700 1 --2- 172.21.15.133:0/2720362756 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcc1c055330 0x7fcc1c0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:22.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.987+0000 7fcc422c5700 1 --2- 172.21.15.133:0/2720362756 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcc1c055330 0x7fcc1c0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:22.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.987+0000 7fcc3b7fe700 1 -- 172.21.15.133:0/2720362756 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcc2c06dfe0 con 0x7fcc3c156b20 2021-01-03T12:58:22.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.987+0000 7fcc422c5700 1 --2- 172.21.15.133:0/2720362756 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcc1c055330 0x7fcc1c0577f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fcc3000b000 tx=0x7fcc30006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:22.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:22.991+0000 7fcc3b7fe700 1 -- 172.21.15.133:0/2720362756 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcc2c0442e0 con 0x7fcc3c156b20 2021-01-03T12:58:23.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.131+0000 7fcc432c7700 1 -- 172.21.15.133:0/2720362756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc3c057300 con 0x7fcc3c156b20 2021-01-03T12:58:23.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.131+0000 7fcc3b7fe700 1 -- 172.21.15.133:0/2720362756 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7fcc2c047900 con 0x7fcc3c156b20 2021-01-03T12:58:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:23.136 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":23,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:01.829379+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:57:58.934952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-03T12:57:59.830134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:23.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.135+0000 7fcc432c7700 1 -- 172.21.15.133:0/2720362756 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcc1c055330 msgr2=0x7fcc1c0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:23.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.135+0000 7fcc432c7700 1 --2- 172.21.15.133:0/2720362756 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcc1c055330 0x7fcc1c0577f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fcc3000b000 tx=0x7fcc30006dc0).stop 2021-01-03T12:58:23.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.135+0000 7fcc432c7700 1 -- 172.21.15.133:0/2720362756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc3c156b20 msgr2=0x7fcc3c0abbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:23.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.135+0000 7fcc432c7700 1 --2- 172.21.15.133:0/2720362756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc3c156b20 0x7fcc3c0abbd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fcc3c0ae820 tx=0x7fcc2c013000).stop 2021-01-03T12:58:23.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.135+0000 7fcc432c7700 1 -- 172.21.15.133:0/2720362756 shutdown_connections 2021-01-03T12:58:23.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.135+0000 7fcc432c7700 1 --2- 172.21.15.133:0/2720362756 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcc1c055330 0x7fcc1c0577f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.135+0000 7fcc432c7700 1 --2- 172.21.15.133:0/2720362756 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc3c0adea0 0x7fcc3c0aaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.135+0000 7fcc432c7700 1 --2- 172.21.15.133:0/2720362756 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc3c0ac0c0 0x7fcc3c1594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.135+0000 7fcc432c7700 1 --2- 172.21.15.133:0/2720362756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc3c156b20 0x7fcc3c0abbd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.135+0000 7fcc432c7700 1 -- 172.21.15.133:0/2720362756 >> 172.21.15.133:0/2720362756 conn(0x7fcc3c05bdf0 msgr2=0x7fcc3c0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:23.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.135+0000 7fcc432c7700 1 -- 172.21.15.133:0/2720362756 shutdown_connections 2021-01-03T12:58:23.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.135+0000 7fcc432c7700 1 -- 172.21.15.133:0/2720362756 wait complete. 2021-01-03T12:58:23.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T12:57:58.934952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T12:57:59.830134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T12:58:23.155 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T12:58:23.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.283+0000 7f7aeadda700 1 Processor -- start 2021-01-03T12:58:23.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.283+0000 7f7aeadda700 1 -- start start 2021-01-03T12:58:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.283+0000 7f7aeadda700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ae405c840 0x7f7ae4143940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.283+0000 7f7aeadda700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7ae4067710 0x7f7ae413c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.283+0000 7f7aeadda700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae405cc20 con 0x7f7ae4146dc0 2021-01-03T12:58:23.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.283+0000 7f7aeadda700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae40ad5a0 con 0x7f7ae4067710 2021-01-03T12:58:23.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.283+0000 7f7aeadda700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae40b10b0 con 0x7f7ae405c840 2021-01-03T12:58:23.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7ae8b76700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ae405c840 0x7f7ae4143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7ae3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7ae4146dc0 0x7f7ae40b09a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53420/0 (socket says 172.21.15.133:53420) 2021-01-03T12:58:23.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7ae3fff700 1 -- 172.21.15.133:0/2954934785 learned_addr learned my addr 172.21.15.133:0/2954934785 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:23.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7ae9377700 1 --2- 172.21.15.133:0/2954934785 >> v2:172.21.15.16:3300/0 conn(0x7f7ae4067710 0x7f7ae413c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7ae8b76700 1 -- 172.21.15.133:0/2954934785 >> v2:172.21.15.16:3300/0 conn(0x7f7ae4067710 msgr2=0x7f7ae413c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:23.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7ae8b76700 1 --2- 172.21.15.133:0/2954934785 >> v2:172.21.15.16:3300/0 conn(0x7f7ae4067710 0x7f7ae413c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7ae8b76700 1 -- 172.21.15.133:0/2954934785 >> v1:172.21.15.133:6789/0 conn(0x7f7ae4146dc0 legacy=0x7f7ae40b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:23.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7ae8b76700 1 -- 172.21.15.133:0/2954934785 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4142f60 con 0x7f7ae405c840 2021-01-03T12:58:23.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7ae8b76700 1 --2- 172.21.15.133:0/2954934785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae405c840 0x7f7ae4143940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f7ae406ad30 tx=0x7f7ad8006dc0).ready entity=mon.1 client_cookie=8a8945ecca789582 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:23.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7ae37fe700 1 -- 172.21.15.133:0/2954934785 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ad80097b0 con 0x7f7ae405c840 2021-01-03T12:58:23.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7ae37fe700 1 -- 172.21.15.133:0/2954934785 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad8009910 con 0x7f7ae405c840 2021-01-03T12:58:23.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7ae37fe700 1 -- 172.21.15.133:0/2954934785 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ad8009c70 con 0x7f7ae405c840 2021-01-03T12:58:23.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7aeadda700 1 -- 172.21.15.133:0/2954934785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae405c840 msgr2=0x7f7ae4143940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:23.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7aeadda700 1 --2- 172.21.15.133:0/2954934785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae405c840 0x7f7ae4143940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f7ae406ad30 tx=0x7f7ad8006dc0).stop 2021-01-03T12:58:23.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7aeadda700 1 -- 172.21.15.133:0/2954934785 shutdown_connections 2021-01-03T12:58:23.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7aeadda700 1 --2- 172.21.15.133:0/2954934785 >> v2:172.21.15.16:3300/0 conn(0x7f7ae4067710 0x7f7ae413c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7aeadda700 1 --2- 172.21.15.133:0/2954934785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae405c840 0x7f7ae4143940 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7aeadda700 1 -- 172.21.15.133:0/2954934785 >> 172.21.15.133:0/2954934785 conn(0x7f7ae406aeb0 msgr2=0x7f7ae405bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:23.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7aeadda700 1 -- 172.21.15.133:0/2954934785 shutdown_connections 2021-01-03T12:58:23.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7aeadda700 1 -- 172.21.15.133:0/2954934785 wait complete. 2021-01-03T12:58:23.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7aeadda700 1 Processor -- start 2021-01-03T12:58:23.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7aeadda700 1 -- start start 2021-01-03T12:58:23.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7aeadda700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae405c840 0x7f7ae40b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7aeadda700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ae4067710 0x7f7ae4152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7aeadda700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ae4146dc0 0x7f7ae412bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7aeadda700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae41521a0 con 0x7f7ae4146dc0 2021-01-03T12:58:23.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7aeadda700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae4155660 con 0x7f7ae405c840 2021-01-03T12:58:23.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7aeadda700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae41523d0 con 0x7f7ae4067710 2021-01-03T12:58:23.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7ae8b76700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae405c840 0x7f7ae40b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7ae8b76700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae405c840 0x7f7ae40b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60626/0 (socket says 172.21.15.133:60626) 2021-01-03T12:58:23.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.287+0000 7f7ae8b76700 1 -- 172.21.15.133:0/2711874453 learned_addr learned my addr 172.21.15.133:0/2711874453 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:23.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7ae8b76700 1 -- 172.21.15.133:0/2711874453 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ae4067710 msgr2=0x7f7ae4152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:23.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7ae8b76700 1 --2- 172.21.15.133:0/2711874453 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ae4067710 0x7f7ae4152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T12:58:23.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7ae8b76700 1 -- 172.21.15.133:0/2711874453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ae4146dc0 msgr2=0x7f7ae412bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:23.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7ae9377700 1 --2- 172.21.15.133:0/2711874453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ae4146dc0 0x7f7ae412bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7ae8b76700 1 --2- 172.21.15.133:0/2711874453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ae4146dc0 0x7f7ae412bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7ae8b76700 1 -- 172.21.15.133:0/2711874453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4155900 con 0x7f7ae405c840 2021-01-03T12:58:23.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7ae9377700 1 --2- 172.21.15.133:0/2711874453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ae4146dc0 0x7f7ae412bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:23.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7ae8b76700 1 --2- 172.21.15.133:0/2711874453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae405c840 0x7f7ae40b2bc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f7ae406ad30 tx=0x7f7ad8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:23.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7ae1ffb700 1 -- 172.21.15.133:0/2711874453 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ad8011ca0 con 0x7f7ae405c840 2021-01-03T12:58:23.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7ae1ffb700 1 -- 172.21.15.133:0/2711874453 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad8011e00 con 0x7f7ae405c840 2021-01-03T12:58:23.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7ae1ffb700 1 -- 172.21.15.133:0/2711874453 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ad801d640 con 0x7f7ae405c840 2021-01-03T12:58:23.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7aeadda700 1 -- 172.21.15.133:0/2711874453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae41441e0 con 0x7f7ae405c840 2021-01-03T12:58:23.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7aeadda700 1 -- 172.21.15.133:0/2711874453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae413b9d0 con 0x7f7ae405c840 2021-01-03T12:58:23.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7ae1ffb700 1 -- 172.21.15.133:0/2711874453 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7ad8024030 con 0x7f7ae405c840 2021-01-03T12:58:23.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7aeadda700 1 -- 172.21.15.133:0/2711874453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae4057300 con 0x7f7ae405c840 2021-01-03T12:58:23.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7ae1ffb700 1 --2- 172.21.15.133:0/2711874453 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7acc0554e0 0x7f7acc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7ae3fff700 1 --2- 172.21.15.133:0/2711874453 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7acc0554e0 0x7f7acc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.291+0000 7f7ae1ffb700 1 -- 172.21.15.133:0/2711874453 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7ad806f2c0 con 0x7f7ae405c840 2021-01-03T12:58:23.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.295+0000 7f7ae3fff700 1 --2- 172.21.15.133:0/2711874453 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7acc0554e0 0x7f7acc0579a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f7ae40adfa0 tx=0x7f7ad00077f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:23.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.295+0000 7f7ae1ffb700 1 -- 172.21.15.133:0/2711874453 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7ad80455c0 con 0x7f7ae405c840 2021-01-03T12:58:23.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.435+0000 7f7aeadda700 1 -- 172.21.15.133:0/2711874453 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7ae405ce00 con 0x7f7ae405c840 2021-01-03T12:58:23.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.435+0000 7f7ae1ffb700 1 -- 172.21.15.133:0/2711874453 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7ad8022020 con 0x7f7ae405c840 2021-01-03T12:58:23.437 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T12:58:23.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.439+0000 7f7aeadda700 1 -- 172.21.15.133:0/2711874453 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7acc0554e0 msgr2=0x7f7acc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:23.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.439+0000 7f7aeadda700 1 --2- 172.21.15.133:0/2711874453 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7acc0554e0 0x7f7acc0579a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f7ae40adfa0 tx=0x7f7ad00077f0).stop 2021-01-03T12:58:23.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.439+0000 7f7aeadda700 1 -- 172.21.15.133:0/2711874453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae405c840 msgr2=0x7f7ae40b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:23.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.439+0000 7f7aeadda700 1 --2- 172.21.15.133:0/2711874453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae405c840 0x7f7ae40b2bc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f7ae406ad30 tx=0x7f7ad8015000).stop 2021-01-03T12:58:23.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.439+0000 7f7aeadda700 1 -- 172.21.15.133:0/2711874453 shutdown_connections 2021-01-03T12:58:23.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.439+0000 7f7aeadda700 1 --2- 172.21.15.133:0/2711874453 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7acc0554e0 0x7f7acc0579a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.439+0000 7f7aeadda700 1 --2- 172.21.15.133:0/2711874453 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ae4146dc0 0x7f7ae412bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.439+0000 7f7aeadda700 1 --2- 172.21.15.133:0/2711874453 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ae405c840 0x7f7ae40b2bc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.439+0000 7f7aeadda700 1 --2- 172.21.15.133:0/2711874453 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ae4067710 0x7f7ae4152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T12:58:23.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.439+0000 7f7aeadda700 1 -- 172.21.15.133:0/2711874453 >> 172.21.15.133:0/2711874453 conn(0x7f7ae406aeb0 msgr2=0x7f7ae40b5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:23.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.439+0000 7f7aeadda700 1 -- 172.21.15.133:0/2711874453 shutdown_connections 2021-01-03T12:58:23.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.439+0000 7f7aeadda700 1 -- 172.21.15.133:0/2711874453 wait complete. 2021-01-03T12:58:23.450 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T12:58:23.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1e0ae2700 1 Processor -- start 2021-01-03T12:58:23.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1e0ae2700 1 -- start start 2021-01-03T12:58:23.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1e0ae2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1dc0b6d50 0x7fc1dc0af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1e0ae2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1dc0b18e0 0x7fc1dc0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1e0ae2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1dc0b0e60 con 0x7fc1dc05f5e0 2021-01-03T12:58:23.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1e0ae2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1dc0b7130 con 0x7fc1dc0b6d50 2021-01-03T12:58:23.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1e0ae2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc0b0260 con 0x7fc1dc0b18e0 2021-01-03T12:58:23.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1da59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1dc0b6d50 0x7fc1dc0af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1dad9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc1dc05f5e0 0x7fc1dc05fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53436/0 (socket says 172.21.15.133:53436) 2021-01-03T12:58:23.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1dad9d700 1 -- 172.21.15.133:0/718654813 learned_addr learned my addr 172.21.15.133:0/718654813 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:23.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1d9d9b700 1 --2- 172.21.15.133:0/718654813 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1dc0b18e0 0x7fc1dc0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1da59c700 1 -- 172.21.15.133:0/718654813 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1dc0b18e0 msgr2=0x7fc1dc0afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1da59c700 1 --2- 172.21.15.133:0/718654813 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1dc0b18e0 0x7fc1dc0afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1da59c700 1 -- 172.21.15.133:0/718654813 >> v1:172.21.15.133:6789/0 conn(0x7fc1dc05f5e0 legacy=0x7fc1dc05fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1d959a700 1 -- 172.21.15.133:0/718654813 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245422401 0 0) 0x7fc1dc0b0e60 con 0x7fc1dc05f5e0 2021-01-03T12:58:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1da59c700 1 -- 172.21.15.133:0/718654813 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc0b1090 con 0x7fc1dc0b6d50 2021-01-03T12:58:23.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1d9d9b700 1 --2- 172.21.15.133:0/718654813 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1dc0b18e0 0x7fc1dc0afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:23.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1da59c700 1 --2- 172.21.15.133:0/718654813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1dc0b6d50 0x7fc1dc0af6f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fc1cc002f30 tx=0x7fc1cc006dc0).ready entity=mon.1 client_cookie=7ad1268a072f881d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:23.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1d959a700 1 -- 172.21.15.133:0/718654813 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1cc0097f0 con 0x7fc1dc0b6d50 2021-01-03T12:58:23.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1d959a700 1 -- 172.21.15.133:0/718654813 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc009950 con 0x7fc1dc0b6d50 2021-01-03T12:58:23.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1d959a700 1 -- 172.21.15.133:0/718654813 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1cc009cb0 con 0x7fc1dc0b6d50 2021-01-03T12:58:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1e0ae2700 1 -- 172.21.15.133:0/718654813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1dc0b6d50 msgr2=0x7fc1dc0af6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.567+0000 7fc1e0ae2700 1 --2- 172.21.15.133:0/718654813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1dc0b6d50 0x7fc1dc0af6f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fc1cc002f30 tx=0x7fc1cc006dc0).stop 2021-01-03T12:58:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1e0ae2700 1 -- 172.21.15.133:0/718654813 shutdown_connections 2021-01-03T12:58:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1e0ae2700 1 --2- 172.21.15.133:0/718654813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1dc0b6d50 0x7fc1dc0af6f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1e0ae2700 1 --2- 172.21.15.133:0/718654813 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1dc0b18e0 0x7fc1dc0afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1e0ae2700 1 -- 172.21.15.133:0/718654813 >> 172.21.15.133:0/718654813 conn(0x7fc1dc0622f0 msgr2=0x7fc1dc0b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:23.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1e0ae2700 1 -- 172.21.15.133:0/718654813 shutdown_connections 2021-01-03T12:58:23.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1e0ae2700 1 -- 172.21.15.133:0/718654813 wait complete. 2021-01-03T12:58:23.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1e0ae2700 1 Processor -- start 2021-01-03T12:58:23.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1e0ae2700 1 -- start start 2021-01-03T12:58:23.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1e0ae2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1dc05f5e0 0x7fc1dc1428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1e0ae2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1dc0b18e0 0x7fc1dc12eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1e0ae2700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1dc0b6d50 0x7fc1dc0b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1e0ae2700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc142280 con 0x7fc1dc0b6d50 2021-01-03T12:58:23.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1e0ae2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc12efb0 con 0x7fc1dc05f5e0 2021-01-03T12:58:23.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1e0ae2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1dc141d40 con 0x7fc1dc0b18e0 2021-01-03T12:58:23.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1da59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1dc05f5e0 0x7fc1dc1428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1da59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1dc05f5e0 0x7fc1dc1428f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60640/0 (socket says 172.21.15.133:60640) 2021-01-03T12:58:23.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1da59c700 1 -- 172.21.15.133:0/2174683057 learned_addr learned my addr 172.21.15.133:0/2174683057 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:23.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1d9d9b700 1 --2- 172.21.15.133:0/2174683057 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1dc0b18e0 0x7fc1dc12eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1dad9d700 1 --2- 172.21.15.133:0/2174683057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1dc0b6d50 0x7fc1dc0b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1da59c700 1 -- 172.21.15.133:0/2174683057 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1dc0b18e0 msgr2=0x7fc1dc12eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:23.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1da59c700 1 --2- 172.21.15.133:0/2174683057 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1dc0b18e0 0x7fc1dc12eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1da59c700 1 -- 172.21.15.133:0/2174683057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1dc0b6d50 msgr2=0x7fc1dc0b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:23.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1da59c700 1 --2- 172.21.15.133:0/2174683057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1dc0b6d50 0x7fc1dc0b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1da59c700 1 -- 172.21.15.133:0/2174683057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc141fe0 con 0x7fc1dc05f5e0 2021-01-03T12:58:23.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1dad9d700 1 --2- 172.21.15.133:0/2174683057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1dc0b6d50 0x7fc1dc0b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:23.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.571+0000 7fc1d9d9b700 1 --2- 172.21.15.133:0/2174683057 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1dc0b18e0 0x7fc1dc12eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:23.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.575+0000 7fc1da59c700 1 --2- 172.21.15.133:0/2174683057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1dc05f5e0 0x7fc1dc1428f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fc1cc002f30 tx=0x7fc1cc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:23.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.575+0000 7fc1d37fe700 1 -- 172.21.15.133:0/2174683057 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1cc011db0 con 0x7fc1dc05f5e0 2021-01-03T12:58:23.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.575+0000 7fc1d37fe700 1 -- 172.21.15.133:0/2174683057 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc01d450 con 0x7fc1dc05f5e0 2021-01-03T12:58:23.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.575+0000 7fc1d37fe700 1 -- 172.21.15.133:0/2174683057 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1cc01d7b0 con 0x7fc1dc05f5e0 2021-01-03T12:58:23.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.575+0000 7fc1e0ae2700 1 -- 172.21.15.133:0/2174683057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1dc0b1650 con 0x7fc1dc05f5e0 2021-01-03T12:58:23.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.575+0000 7fc1e0ae2700 1 -- 172.21.15.133:0/2174683057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1dc0b43f0 con 0x7fc1dc05f5e0 2021-01-03T12:58:23.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.575+0000 7fc1d37fe700 1 -- 172.21.15.133:0/2174683057 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc1cc024030 con 0x7fc1dc05f5e0 2021-01-03T12:58:23.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.575+0000 7fc1e0ae2700 1 -- 172.21.15.133:0/2174683057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1dc141ba0 con 0x7fc1dc05f5e0 2021-01-03T12:58:23.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.575+0000 7fc1d37fe700 1 --2- 172.21.15.133:0/2174683057 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc1c0055440 0x7fc1c0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.575+0000 7fc1d9d9b700 1 --2- 172.21.15.133:0/2174683057 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc1c0055440 0x7fc1c0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.575+0000 7fc1d37fe700 1 -- 172.21.15.133:0/2174683057 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc1cc06f510 con 0x7fc1dc05f5e0 2021-01-03T12:58:23.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.575+0000 7fc1d9d9b700 1 --2- 172.21.15.133:0/2174683057 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc1c0055440 0x7fc1c0057900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc1c400b000 tx=0x7fc1c4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:23.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.579+0000 7fc1d37fe700 1 -- 172.21.15.133:0/2174683057 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc1dc141ba0 con 0x7fc1dc05f5e0 2021-01-03T12:58:23.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.715+0000 7fc1e0ae2700 1 -- 172.21.15.133:0/2174683057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc1dc141ba0 con 0x7fc1dc05f5e0 2021-01-03T12:58:23.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.715+0000 7fc1d37fe700 1 -- 172.21.15.133:0/2174683057 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc1dc141ba0 con 0x7fc1dc05f5e0 2021-01-03T12:58:23.719 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:23.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.719+0000 7fc1e0ae2700 1 -- 172.21.15.133:0/2174683057 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc1c0055440 msgr2=0x7fc1c0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:23.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.719+0000 7fc1e0ae2700 1 --2- 172.21.15.133:0/2174683057 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc1c0055440 0x7fc1c0057900 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fc1c400b000 tx=0x7fc1c4008040).stop 2021-01-03T12:58:23.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.719+0000 7fc1e0ae2700 1 -- 172.21.15.133:0/2174683057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1dc05f5e0 msgr2=0x7fc1dc1428f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:23.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.719+0000 7fc1e0ae2700 1 --2- 172.21.15.133:0/2174683057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1dc05f5e0 0x7fc1dc1428f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fc1cc002f30 tx=0x7fc1cc015000).stop 2021-01-03T12:58:23.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.719+0000 7fc1e0ae2700 1 -- 172.21.15.133:0/2174683057 shutdown_connections 2021-01-03T12:58:23.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.719+0000 7fc1e0ae2700 1 --2- 172.21.15.133:0/2174683057 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc1c0055440 0x7fc1c0057900 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.719+0000 7fc1e0ae2700 1 --2- 172.21.15.133:0/2174683057 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1dc0b6d50 0x7fc1dc0b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.719+0000 7fc1e0ae2700 1 --2- 172.21.15.133:0/2174683057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1dc05f5e0 0x7fc1dc1428f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.719+0000 7fc1e0ae2700 1 --2- 172.21.15.133:0/2174683057 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1dc0b18e0 0x7fc1dc12eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.719+0000 7fc1e0ae2700 1 -- 172.21.15.133:0/2174683057 >> 172.21.15.133:0/2174683057 conn(0x7fc1dc0622f0 msgr2=0x7fc1dc060a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:23.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.719+0000 7fc1e0ae2700 1 -- 172.21.15.133:0/2174683057 shutdown_connections 2021-01-03T12:58:23.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.719+0000 7fc1e0ae2700 1 -- 172.21.15.133:0/2174683057 wait complete. 2021-01-03T12:58:23.736 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T12:58:23.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b69d3700 1 Processor -- start 2021-01-03T12:58:23.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b69d3700 1 -- start start 2021-01-03T12:58:23.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b69d3700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe3b00b9b60 0x7fe3b00b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b69d3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe3b00b4980 0x7fe3b0146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b69d3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3b00b4e10 0x7fe3b0146920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b69d3700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b00aed30 con 0x7fe3b00b9b60 2021-01-03T12:58:23.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b69d3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b00605f0 con 0x7fe3b00b4980 2021-01-03T12:58:23.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b69d3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b00600b0 con 0x7fe3b00b4e10 2021-01-03T12:58:23.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b51d0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe3b00b4980 0x7fe3b0146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b51d0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe3b00b4980 0x7fe3b0146430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60650/0 (socket says 172.21.15.133:60650) 2021-01-03T12:58:23.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b51d0700 1 -- 172.21.15.133:0/39845612 learned_addr learned my addr 172.21.15.133:0/39845612 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:23.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b59d1700 1 --2- 172.21.15.133:0/39845612 >> v2:172.21.15.16:3300/0 conn(0x7fe3b00b9b60 0x7fe3b00b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b61d2700 1 --2- 172.21.15.133:0/39845612 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3b00b4e10 0x7fe3b0146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b51d0700 1 -- 172.21.15.133:0/39845612 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3b00b4e10 msgr2=0x7fe3b0146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:23.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b51d0700 1 --2- 172.21.15.133:0/39845612 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3b00b4e10 0x7fe3b0146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b51d0700 1 -- 172.21.15.133:0/39845612 >> v2:172.21.15.16:3300/0 conn(0x7fe3b00b9b60 msgr2=0x7fe3b00b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:23.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b51d0700 1 --2- 172.21.15.133:0/39845612 >> v2:172.21.15.16:3300/0 conn(0x7fe3b00b9b60 0x7fe3b00b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b51d0700 1 -- 172.21.15.133:0/39845612 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b0060350 con 0x7fe3b00b4980 2021-01-03T12:58:23.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b51d0700 1 --2- 172.21.15.133:0/39845612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3b00b4980 0x7fe3b0146430 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fe3a4002f30 tx=0x7fe3a4006e80).ready entity=mon.1 client_cookie=baa3130c65e5b3bf server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:23.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b49cf700 1 -- 172.21.15.133:0/39845612 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3a4009640 con 0x7fe3b00b4980 2021-01-03T12:58:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b49cf700 1 -- 172.21.15.133:0/39845612 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a40097a0 con 0x7fe3b00b4980 2021-01-03T12:58:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b49cf700 1 -- 172.21.15.133:0/39845612 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3a4009b00 con 0x7fe3b00b4980 2021-01-03T12:58:23.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b69d3700 1 -- 172.21.15.133:0/39845612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3b00b4980 msgr2=0x7fe3b0146430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:23.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.847+0000 7fe3b69d3700 1 --2- 172.21.15.133:0/39845612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3b00b4980 0x7fe3b0146430 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fe3a4002f30 tx=0x7fe3a4006e80).stop 2021-01-03T12:58:23.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b69d3700 1 -- 172.21.15.133:0/39845612 shutdown_connections 2021-01-03T12:58:23.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b69d3700 1 --2- 172.21.15.133:0/39845612 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3b00b4e10 0x7fe3b0146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b69d3700 1 --2- 172.21.15.133:0/39845612 >> v2:172.21.15.16:3300/0 conn(0x7fe3b00b9b60 0x7fe3b00b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b69d3700 1 --2- 172.21.15.133:0/39845612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3b00b4980 0x7fe3b0146430 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b69d3700 1 -- 172.21.15.133:0/39845612 >> 172.21.15.133:0/39845612 conn(0x7fe3b00b69e0 msgr2=0x7fe3b00b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:23.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b69d3700 1 -- 172.21.15.133:0/39845612 shutdown_connections 2021-01-03T12:58:23.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b69d3700 1 -- 172.21.15.133:0/39845612 wait complete. 2021-01-03T12:58:23.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b69d3700 1 Processor -- start 2021-01-03T12:58:23.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b69d3700 1 -- start start 2021-01-03T12:58:23.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b69d3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3b00b4980 0x7fe3b009c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b69d3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3b00b4e10 0x7fe3b0155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b69d3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3b00b9b60 0x7fe3b0155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b69d3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b00b7ed0 con 0x7fe3b00b4e10 2021-01-03T12:58:23.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b69d3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b0146ff0 con 0x7fe3b00b9b60 2021-01-03T12:58:23.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b69d3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b00b93e0 con 0x7fe3b00b4980 2021-01-03T12:58:23.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b61d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3b00b9b60 0x7fe3b0155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b61d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3b00b9b60 0x7fe3b0155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60658/0 (socket says 172.21.15.133:60658) 2021-01-03T12:58:23.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b61d2700 1 -- 172.21.15.133:0/1584226520 learned_addr learned my addr 172.21.15.133:0/1584226520 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:23.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b51d0700 1 --2- 172.21.15.133:0/1584226520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3b00b4e10 0x7fe3b0155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b59d1700 1 --2- 172.21.15.133:0/1584226520 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3b00b4980 0x7fe3b009c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b61d2700 1 -- 172.21.15.133:0/1584226520 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3b00b4980 msgr2=0x7fe3b009c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:23.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b61d2700 1 --2- 172.21.15.133:0/1584226520 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3b00b4980 0x7fe3b009c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b61d2700 1 -- 172.21.15.133:0/1584226520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3b00b4e10 msgr2=0x7fe3b0155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:23.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b61d2700 1 --2- 172.21.15.133:0/1584226520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3b00b4e10 0x7fe3b0155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:23.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b61d2700 1 -- 172.21.15.133:0/1584226520 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b00b9680 con 0x7fe3b00b9b60 2021-01-03T12:58:23.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b59d1700 1 --2- 172.21.15.133:0/1584226520 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3b00b4980 0x7fe3b009c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:23.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b61d2700 1 --2- 172.21.15.133:0/1584226520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3b00b9b60 0x7fe3b0155a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fe3a000c000 tx=0x7fe3a0006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:23.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3aeffd700 1 -- 172.21.15.133:0/1584226520 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3a000ca10 con 0x7fe3b00b9b60 2021-01-03T12:58:23.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3aeffd700 1 -- 172.21.15.133:0/1584226520 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a000cb70 con 0x7fe3b00b9b60 2021-01-03T12:58:23.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b69d3700 1 -- 172.21.15.133:0/1584226520 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b01550e0 con 0x7fe3b00b9b60 2021-01-03T12:58:23.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3aeffd700 1 -- 172.21.15.133:0/1584226520 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3a00123f0 con 0x7fe3b00b9b60 2021-01-03T12:58:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.851+0000 7fe3b69d3700 1 -- 172.21.15.133:0/1584226520 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b00b7b50 con 0x7fe3b00b9b60 2021-01-03T12:58:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.855+0000 7fe3aeffd700 1 -- 172.21.15.133:0/1584226520 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe3a0012550 con 0x7fe3b00b9b60 2021-01-03T12:58:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.855+0000 7fe3b69d3700 1 -- 172.21.15.133:0/1584226520 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b0057300 con 0x7fe3b00b9b60 2021-01-03T12:58:23.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.855+0000 7fe3aeffd700 1 --2- 172.21.15.133:0/1584226520 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3900553f0 0x7fe3900578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:23.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.855+0000 7fe3aeffd700 1 -- 172.21.15.133:0/1584226520 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe3a006e480 con 0x7fe3b00b9b60 2021-01-03T12:58:23.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.855+0000 7fe3b59d1700 1 --2- 172.21.15.133:0/1584226520 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3900553f0 0x7fe3900578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:23.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.855+0000 7fe3b59d1700 1 --2- 172.21.15.133:0/1584226520 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3900553f0 0x7fe3900578b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe3a800b000 tx=0x7fe3a8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:23.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.859+0000 7fe3aeffd700 1 -- 172.21.15.133:0/1584226520 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe3a0044610 con 0x7fe3b00b9b60 2021-01-03T12:58:23.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.995+0000 7fe3b69d3700 1 -- 172.21.15.133:0/1584226520 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe3b009bf20 con 0x7fe3b00b9b60 2021-01-03T12:58:23.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.995+0000 7fe3aeffd700 1 -- 172.21.15.133:0/1584226520 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe3a0047c30 con 0x7fe3b00b9b60 2021-01-03T12:58:23.998 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:23.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.999+0000 7fe3b69d3700 1 -- 172.21.15.133:0/1584226520 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3900553f0 msgr2=0x7fe3900578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.999+0000 7fe3b69d3700 1 --2- 172.21.15.133:0/1584226520 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3900553f0 0x7fe3900578b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe3a800b000 tx=0x7fe3a8008040).stop 2021-01-03T12:58:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.999+0000 7fe3b69d3700 1 -- 172.21.15.133:0/1584226520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3b00b9b60 msgr2=0x7fe3b0155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.999+0000 7fe3b69d3700 1 --2- 172.21.15.133:0/1584226520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3b00b9b60 0x7fe3b0155a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fe3a000c000 tx=0x7fe3a0006dc0).stop 2021-01-03T12:58:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.999+0000 7fe3b69d3700 1 -- 172.21.15.133:0/1584226520 shutdown_connections 2021-01-03T12:58:24.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.999+0000 7fe3b69d3700 1 --2- 172.21.15.133:0/1584226520 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3900553f0 0x7fe3900578b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.999+0000 7fe3b69d3700 1 --2- 172.21.15.133:0/1584226520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3b00b9b60 0x7fe3b0155a70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.999+0000 7fe3b69d3700 1 --2- 172.21.15.133:0/1584226520 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe3b00b4980 0x7fe3b009c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.999+0000 7fe3b69d3700 1 --2- 172.21.15.133:0/1584226520 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe3b00b4e10 0x7fe3b0155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.999+0000 7fe3b69d3700 1 -- 172.21.15.133:0/1584226520 >> 172.21.15.133:0/1584226520 conn(0x7fe3b00b69e0 msgr2=0x7fe3b0145770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:24.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.999+0000 7fe3b69d3700 1 -- 172.21.15.133:0/1584226520 shutdown_connections 2021-01-03T12:58:24.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:23.999+0000 7fe3b69d3700 1 -- 172.21.15.133:0/1584226520 wait complete. 2021-01-03T12:58:24.011 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T12:58:24.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.127+0000 7fccead30700 1 Processor -- start 2021-01-03T12:58:24.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.127+0000 7fccead30700 1 -- start start 2021-01-03T12:58:24.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.127+0000 7fccead30700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcce4140410 0x7fcce4146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.127+0000 7fccead30700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcce41407f0 0x7fcce4142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fccead30700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcce40b0470 0x7fcce405bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fccead30700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce40b02d0 con 0x7fcce41407f0 2021-01-03T12:58:24.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fccead30700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcce4146390 con 0x7fcce4140410 2021-01-03T12:58:24.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fccead30700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce405cf20 con 0x7fcce40b0470 2021-01-03T12:58:24.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fcce8acc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcce4140410 0x7fcce4146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fcce8acc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcce4140410 0x7fcce4146cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60662/0 (socket says 172.21.15.133:60662) 2021-01-03T12:58:24.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fcce8acc700 1 -- 172.21.15.133:0/1232119315 learned_addr learned my addr 172.21.15.133:0/1232119315 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:24.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fcce3fff700 1 --2- 172.21.15.133:0/1232119315 >> v2:172.21.15.16:3300/0 conn(0x7fcce41407f0 0x7fcce4142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fcce92cd700 1 --2- 172.21.15.133:0/1232119315 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcce40b0470 0x7fcce405bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fcce8acc700 1 -- 172.21.15.133:0/1232119315 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcce40b0470 msgr2=0x7fcce405bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:24.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fcce8acc700 1 --2- 172.21.15.133:0/1232119315 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcce40b0470 0x7fcce405bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fcce8acc700 1 -- 172.21.15.133:0/1232119315 >> v2:172.21.15.16:3300/0 conn(0x7fcce41407f0 msgr2=0x7fcce4142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fcce8acc700 1 --2- 172.21.15.133:0/1232119315 >> v2:172.21.15.16:3300/0 conn(0x7fcce41407f0 0x7fcce4142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fcce8acc700 1 -- 172.21.15.133:0/1232119315 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce4146580 con 0x7fcce4140410 2021-01-03T12:58:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fcce8acc700 1 --2- 172.21.15.133:0/1232119315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce4140410 0x7fcce4146cc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fccd8002f30 tx=0x7fccd8006e80).ready entity=mon.1 client_cookie=94e58d5581afff7d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fcce37fe700 1 -- 172.21.15.133:0/1232119315 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccd8009640 con 0x7fcce4140410 2021-01-03T12:58:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fcce37fe700 1 -- 172.21.15.133:0/1232119315 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd80097a0 con 0x7fcce4140410 2021-01-03T12:58:24.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fcce37fe700 1 -- 172.21.15.133:0/1232119315 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccd8009b00 con 0x7fcce4140410 2021-01-03T12:58:24.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fccead30700 1 -- 172.21.15.133:0/1232119315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce4140410 msgr2=0x7fcce4146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fccead30700 1 --2- 172.21.15.133:0/1232119315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce4140410 0x7fcce4146cc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fccd8002f30 tx=0x7fccd8006e80).stop 2021-01-03T12:58:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fccead30700 1 -- 172.21.15.133:0/1232119315 shutdown_connections 2021-01-03T12:58:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fccead30700 1 --2- 172.21.15.133:0/1232119315 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcce40b0470 0x7fcce405bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fccead30700 1 --2- 172.21.15.133:0/1232119315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce4140410 0x7fcce4146cc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fccead30700 1 --2- 172.21.15.133:0/1232119315 >> v2:172.21.15.16:3300/0 conn(0x7fcce41407f0 0x7fcce4142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fccead30700 1 -- 172.21.15.133:0/1232119315 >> 172.21.15.133:0/1232119315 conn(0x7fcce40b95d0 msgr2=0x7fcce40b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:24.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fccead30700 1 -- 172.21.15.133:0/1232119315 shutdown_connections 2021-01-03T12:58:24.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.131+0000 7fccead30700 1 -- 172.21.15.133:0/1232119315 wait complete. 2021-01-03T12:58:24.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fccead30700 1 Processor -- start 2021-01-03T12:58:24.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fccead30700 1 -- start start 2021-01-03T12:58:24.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fccead30700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce40b0470 0x7fcce41411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fccead30700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcce4140410 0x7fcce40b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fccead30700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce41407f0 0x7fcce40b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fccead30700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4151b60 con 0x7fcce41407f0 2021-01-03T12:58:24.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fccead30700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce40b3db0 con 0x7fcce40b0470 2021-01-03T12:58:24.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fccead30700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce4151d50 con 0x7fcce4140410 2021-01-03T12:58:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fcce8acc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce40b0470 0x7fcce41411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fcce8acc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce40b0470 0x7fcce41411e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60668/0 (socket says 172.21.15.133:60668) 2021-01-03T12:58:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fcce8acc700 1 -- 172.21.15.133:0/1463810957 learned_addr learned my addr 172.21.15.133:0/1463810957 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fcce92cd700 1 --2- 172.21.15.133:0/1463810957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce41407f0 0x7fcce40b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fcce3fff700 1 --2- 172.21.15.133:0/1463810957 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcce4140410 0x7fcce40b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fcce8acc700 1 -- 172.21.15.133:0/1463810957 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcce4140410 msgr2=0x7fcce40b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fcce8acc700 1 --2- 172.21.15.133:0/1463810957 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcce4140410 0x7fcce40b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fcce8acc700 1 -- 172.21.15.133:0/1463810957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce41407f0 msgr2=0x7fcce40b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fcce8acc700 1 --2- 172.21.15.133:0/1463810957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce41407f0 0x7fcce40b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fcce8acc700 1 -- 172.21.15.133:0/1463810957 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce4151ff0 con 0x7fcce40b0470 2021-01-03T12:58:24.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fcce3fff700 1 --2- 172.21.15.133:0/1463810957 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcce4140410 0x7fcce40b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:24.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fcce8acc700 1 --2- 172.21.15.133:0/1463810957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce40b0470 0x7fcce41411e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fccd8002f30 tx=0x7fccd8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:24.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fcce1ffb700 1 -- 172.21.15.133:0/1463810957 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccd8011ad0 con 0x7fcce40b0470 2021-01-03T12:58:24.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fcce1ffb700 1 -- 172.21.15.133:0/1463810957 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd8011c30 con 0x7fcce40b0470 2021-01-03T12:58:24.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fcce1ffb700 1 -- 172.21.15.133:0/1463810957 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccd801d450 con 0x7fcce40b0470 2021-01-03T12:58:24.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fccead30700 1 -- 172.21.15.133:0/1463810957 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce4152290 con 0x7fcce40b0470 2021-01-03T12:58:24.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.135+0000 7fccead30700 1 -- 172.21.15.133:0/1463810957 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce41529d0 con 0x7fcce40b0470 2021-01-03T12:58:24.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.139+0000 7fcce1ffb700 1 -- 172.21.15.133:0/1463810957 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fccd800f070 con 0x7fcce40b0470 2021-01-03T12:58:24.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.139+0000 7fccead30700 1 -- 172.21.15.133:0/1463810957 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcce4057300 con 0x7fcce40b0470 2021-01-03T12:58:24.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.139+0000 7fcce1ffb700 1 --2- 172.21.15.133:0/1463810957 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fccc4055330 0x7fccc40577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.139+0000 7fcce1ffb700 1 -- 172.21.15.133:0/1463810957 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fccd806f890 con 0x7fcce40b0470 2021-01-03T12:58:24.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.139+0000 7fcce3fff700 1 --2- 172.21.15.133:0/1463810957 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fccc4055330 0x7fccc40577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.139+0000 7fcce3fff700 1 --2- 172.21.15.133:0/1463810957 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fccc4055330 0x7fccc40577f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fccd400b000 tx=0x7fccd4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:24.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.147+0000 7fcce1ffb700 1 -- 172.21.15.133:0/1463810957 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fccd8045c50 con 0x7fcce40b0470 2021-01-03T12:58:24.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.291+0000 7fccead30700 1 -- 172.21.15.133:0/1463810957 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcce405d270 con 0x7fcce40b0470 2021-01-03T12:58:24.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.291+0000 7fcce1ffb700 1 -- 172.21.15.133:0/1463810957 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fccd80491b0 con 0x7fcce40b0470 2021-01-03T12:58:24.292 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:24.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.291+0000 7fccead30700 1 -- 172.21.15.133:0/1463810957 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fccc4055330 msgr2=0x7fccc40577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.291+0000 7fccead30700 1 --2- 172.21.15.133:0/1463810957 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fccc4055330 0x7fccc40577f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fccd400b000 tx=0x7fccd4008040).stop 2021-01-03T12:58:24.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.291+0000 7fccead30700 1 -- 172.21.15.133:0/1463810957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce40b0470 msgr2=0x7fcce41411e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.291+0000 7fccead30700 1 --2- 172.21.15.133:0/1463810957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce40b0470 0x7fcce41411e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fccd8002f30 tx=0x7fccd8015000).stop 2021-01-03T12:58:24.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.291+0000 7fccead30700 1 -- 172.21.15.133:0/1463810957 shutdown_connections 2021-01-03T12:58:24.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.291+0000 7fccead30700 1 --2- 172.21.15.133:0/1463810957 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fccc4055330 0x7fccc40577f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.291+0000 7fccead30700 1 --2- 172.21.15.133:0/1463810957 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcce41407f0 0x7fcce40b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.291+0000 7fccead30700 1 --2- 172.21.15.133:0/1463810957 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcce40b0470 0x7fcce41411e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.291+0000 7fccead30700 1 --2- 172.21.15.133:0/1463810957 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcce4140410 0x7fcce40b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.291+0000 7fccead30700 1 -- 172.21.15.133:0/1463810957 >> 172.21.15.133:0/1463810957 conn(0x7fcce40b95d0 msgr2=0x7fcce405bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:24.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.291+0000 7fccead30700 1 -- 172.21.15.133:0/1463810957 shutdown_connections 2021-01-03T12:58:24.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.291+0000 7fccead30700 1 -- 172.21.15.133:0/1463810957 wait complete. 2021-01-03T12:58:24.306 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:24.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e09fb0700 1 Processor -- start 2021-01-03T12:58:24.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e09fb0700 1 -- start start 2021-01-03T12:58:24.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e09fb0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1e040af200 0x7f1e0405bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e09fb0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1e040b0210 0x7f1e04141180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e09fb0700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1e04144bb0 0x7f1e040ab300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e09fb0700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e040af5e0 con 0x7f1e04144bb0 2021-01-03T12:58:24.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e09fb0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e0405c620 con 0x7f1e040b0210 2021-01-03T12:58:24.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e09fb0700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0405c8c0 con 0x7f1e040af200 2021-01-03T12:58:24.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e03fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1e040b0210 0x7f1e04141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e03fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1e040b0210 0x7f1e04141180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60678/0 (socket says 172.21.15.133:60678) 2021-01-03T12:58:24.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e03fff700 1 -- 172.21.15.133:0/3745185038 learned_addr learned my addr 172.21.15.133:0/3745185038 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:24.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e097af700 1 --2- 172.21.15.133:0/3745185038 >> v2:172.21.15.16:3300/0 conn(0x7f1e04144bb0 0x7f1e040ab300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e08fae700 1 --2- 172.21.15.133:0/3745185038 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1e040af200 0x7f1e0405bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e03fff700 1 -- 172.21.15.133:0/3745185038 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1e040af200 msgr2=0x7f1e0405bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:24.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e03fff700 1 --2- 172.21.15.133:0/3745185038 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1e040af200 0x7f1e0405bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e03fff700 1 -- 172.21.15.133:0/3745185038 >> v2:172.21.15.16:3300/0 conn(0x7f1e04144bb0 msgr2=0x7f1e040ab300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:24.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e03fff700 1 --2- 172.21.15.133:0/3745185038 >> v2:172.21.15.16:3300/0 conn(0x7f1e04144bb0 0x7f1e040ab300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e03fff700 1 -- 172.21.15.133:0/3745185038 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e04140a40 con 0x7f1e040b0210 2021-01-03T12:58:24.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e03fff700 1 --2- 172.21.15.133:0/3745185038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e040b0210 0x7f1e04141180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f1df0002f30 tx=0x7f1df0006e80).ready entity=mon.1 client_cookie=c4830fdddf044896 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:24.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e037fe700 1 -- 172.21.15.133:0/3745185038 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1df0009640 con 0x7f1e040b0210 2021-01-03T12:58:24.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e037fe700 1 -- 172.21.15.133:0/3745185038 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df00097a0 con 0x7f1e040b0210 2021-01-03T12:58:24.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e037fe700 1 -- 172.21.15.133:0/3745185038 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1df0009b00 con 0x7f1e040b0210 2021-01-03T12:58:24.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e09fb0700 1 -- 172.21.15.133:0/3745185038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e040b0210 msgr2=0x7f1e04141180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.423+0000 7f1e09fb0700 1 --2- 172.21.15.133:0/3745185038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e040b0210 0x7f1e04141180 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f1df0002f30 tx=0x7f1df0006e80).stop 2021-01-03T12:58:24.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e09fb0700 1 -- 172.21.15.133:0/3745185038 shutdown_connections 2021-01-03T12:58:24.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e09fb0700 1 --2- 172.21.15.133:0/3745185038 >> v2:172.21.15.16:3300/0 conn(0x7f1e04144bb0 0x7f1e040ab300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e09fb0700 1 --2- 172.21.15.133:0/3745185038 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1e040af200 0x7f1e0405bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e09fb0700 1 --2- 172.21.15.133:0/3745185038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e040b0210 0x7f1e04141180 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e09fb0700 1 -- 172.21.15.133:0/3745185038 >> 172.21.15.133:0/3745185038 conn(0x7f1e0406b050 msgr2=0x7f1e04060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:24.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e09fb0700 1 -- 172.21.15.133:0/3745185038 shutdown_connections 2021-01-03T12:58:24.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e09fb0700 1 -- 172.21.15.133:0/3745185038 wait complete. 2021-01-03T12:58:24.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e09fb0700 1 Processor -- start 2021-01-03T12:58:24.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e09fb0700 1 -- start start 2021-01-03T12:58:24.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e09fb0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e040af200 0x7f1e0413f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e09fb0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e040b0210 0x7f1e040b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e09fb0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1e04144bb0 0x7f1e040b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e09fb0700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e040b5700 con 0x7f1e040b0210 2021-01-03T12:58:24.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e09fb0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e04154070 con 0x7f1e040af200 2021-01-03T12:58:24.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e09fb0700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e040b4880 con 0x7f1e04144bb0 2021-01-03T12:58:24.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e08fae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e040af200 0x7f1e0413f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e08fae700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e040af200 0x7f1e0413f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60680/0 (socket says 172.21.15.133:60680) 2021-01-03T12:58:24.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e08fae700 1 -- 172.21.15.133:0/2635210543 learned_addr learned my addr 172.21.15.133:0/2635210543 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:24.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e097af700 1 --2- 172.21.15.133:0/2635210543 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1e04144bb0 0x7f1e040b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e03fff700 1 --2- 172.21.15.133:0/2635210543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e040b0210 0x7f1e040b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e08fae700 1 -- 172.21.15.133:0/2635210543 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1e04144bb0 msgr2=0x7f1e040b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e08fae700 1 --2- 172.21.15.133:0/2635210543 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1e04144bb0 0x7f1e040b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e08fae700 1 -- 172.21.15.133:0/2635210543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e040b0210 msgr2=0x7f1e040b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e08fae700 1 --2- 172.21.15.133:0/2635210543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e040b0210 0x7f1e040b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e08fae700 1 -- 172.21.15.133:0/2635210543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e04153d40 con 0x7f1e040af200 2021-01-03T12:58:24.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e08fae700 1 --2- 172.21.15.133:0/2635210543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e040af200 0x7f1e0413f9a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f1e040b5840 tx=0x7f1df8006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:24.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e01ffb700 1 -- 172.21.15.133:0/2635210543 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1df800ca10 con 0x7f1e040af200 2021-01-03T12:58:24.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e09fb0700 1 -- 172.21.15.133:0/2635210543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e041444c0 con 0x7f1e040af200 2021-01-03T12:58:24.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e09fb0700 1 -- 172.21.15.133:0/2635210543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e040b5b80 con 0x7f1e040af200 2021-01-03T12:58:24.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e01ffb700 1 -- 172.21.15.133:0/2635210543 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df800cb70 con 0x7f1e040af200 2021-01-03T12:58:24.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.427+0000 7f1e01ffb700 1 -- 172.21.15.133:0/2635210543 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1df800ced0 con 0x7f1e040af200 2021-01-03T12:58:24.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.431+0000 7f1e09fb0700 1 -- 172.21.15.133:0/2635210543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e040b4a40 con 0x7f1e040af200 2021-01-03T12:58:24.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.431+0000 7f1e01ffb700 1 -- 172.21.15.133:0/2635210543 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1df801c460 con 0x7f1e040af200 2021-01-03T12:58:24.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.431+0000 7f1e01ffb700 1 --2- 172.21.15.133:0/2635210543 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1dec0553b0 0x7f1dec057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.431+0000 7f1e01ffb700 1 -- 172.21.15.133:0/2635210543 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1df806e3d0 con 0x7f1e040af200 2021-01-03T12:58:24.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.431+0000 7f1e03fff700 1 --2- 172.21.15.133:0/2635210543 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1dec0553b0 0x7f1dec057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.431+0000 7f1e03fff700 1 --2- 172.21.15.133:0/2635210543 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1dec0553b0 0x7f1dec057870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f1df001b000 tx=0x7f1df0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:24.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.439+0000 7f1e01ffb700 1 -- 172.21.15.133:0/2635210543 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1df80445d0 con 0x7f1e040af200 2021-01-03T12:58:24.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.579+0000 7f1e09fb0700 1 -- 172.21.15.133:0/2635210543 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e04057300 con 0x7f1e040af200 2021-01-03T12:58:24.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.583+0000 7f1e01ffb700 1 -- 172.21.15.133:0/2635210543 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f1df8047bf0 con 0x7f1e040af200 2021-01-03T12:58:24.583 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:24.583 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":23,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:01.829379+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:57:58.934952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-03T12:57:59.830134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:24.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.583+0000 7f1e09fb0700 1 -- 172.21.15.133:0/2635210543 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1dec0553b0 msgr2=0x7f1dec057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.583+0000 7f1e09fb0700 1 --2- 172.21.15.133:0/2635210543 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1dec0553b0 0x7f1dec057870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f1df001b000 tx=0x7f1df0015000).stop 2021-01-03T12:58:24.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.583+0000 7f1e09fb0700 1 -- 172.21.15.133:0/2635210543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e040af200 msgr2=0x7f1e0413f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.583+0000 7f1e09fb0700 1 --2- 172.21.15.133:0/2635210543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e040af200 0x7f1e0413f9a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f1e040b5840 tx=0x7f1df8006dc0).stop 2021-01-03T12:58:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.583+0000 7f1e09fb0700 1 -- 172.21.15.133:0/2635210543 shutdown_connections 2021-01-03T12:58:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.583+0000 7f1e09fb0700 1 --2- 172.21.15.133:0/2635210543 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1dec0553b0 0x7f1dec057870 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.583+0000 7f1e09fb0700 1 --2- 172.21.15.133:0/2635210543 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1e04144bb0 0x7f1e040b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.583+0000 7f1e09fb0700 1 --2- 172.21.15.133:0/2635210543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1e040af200 0x7f1e0413f9a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.583+0000 7f1e09fb0700 1 --2- 172.21.15.133:0/2635210543 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1e040b0210 0x7f1e040b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.583+0000 7f1e09fb0700 1 -- 172.21.15.133:0/2635210543 >> 172.21.15.133:0/2635210543 conn(0x7f1e0406b050 msgr2=0x7f1e04060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:24.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.583+0000 7f1e09fb0700 1 -- 172.21.15.133:0/2635210543 shutdown_connections 2021-01-03T12:58:24.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.583+0000 7f1e09fb0700 1 -- 172.21.15.133:0/2635210543 wait complete. 2021-01-03T12:58:24.597 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T12:57:58.934952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T12:57:59.830134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T12:58:24.597 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T12:58:24.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.711+0000 7f3e6b138700 1 Processor -- start 2021-01-03T12:58:24.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.711+0000 7f3e6b138700 1 -- start start 2021-01-03T12:58:24.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.711+0000 7f3e6b138700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3e640b2750 0x7f3e6405fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.711+0000 7f3e6b138700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e640afe70 con 0x7f3e64066f70 2021-01-03T12:58:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.711+0000 7f3e6b138700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e64060310 con 0x7f3e64067350 2021-01-03T12:58:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.711+0000 7f3e6b138700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e640605a0 con 0x7f3e640b2750 2021-01-03T12:58:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.711+0000 7f3e69935700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3e64067350 0x7f3e64144260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53490/0 (socket says 172.21.15.133:53490) 2021-01-03T12:58:24.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.711+0000 7f3e69935700 1 -- 172.21.15.133:0/2937163396 learned_addr learned my addr 172.21.15.133:0/2937163396 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:24.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.711+0000 7f3e6a937700 1 --2- 172.21.15.133:0/2937163396 >> v2:172.21.15.16:3300/0 conn(0x7f3e640b2750 0x7f3e6405fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.711+0000 7f3e69134700 1 -- 172.21.15.133:0/2937163396 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918197592 0 0) 0x7f3e64060310 con 0x7f3e64067350 2021-01-03T12:58:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.711+0000 7f3e69134700 1 -- 172.21.15.133:0/2937163396 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e4c003230 con 0x7f3e64067350 2021-01-03T12:58:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.711+0000 7f3e69134700 1 -- 172.21.15.133:0/2937163396 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532095985 0 0) 0x7f3e640afe70 con 0x7f3e64066f70 2021-01-03T12:58:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.711+0000 7f3e69134700 1 -- 172.21.15.133:0/2937163396 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e64060310 con 0x7f3e64066f70 2021-01-03T12:58:24.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.711+0000 7f3e69134700 1 -- 172.21.15.133:0/2937163396 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3689370447 0 0) 0x7f3e4c003230 con 0x7f3e64067350 2021-01-03T12:58:24.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.711+0000 7f3e6a937700 1 -- 172.21.15.133:0/2937163396 >> v1:172.21.15.133:6789/0 conn(0x7f3e64067350 legacy=0x7f3e64144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.711+0000 7f3e6a937700 1 -- 172.21.15.133:0/2937163396 >> v1:172.21.15.16:6789/0 conn(0x7f3e64066f70 legacy=0x7f3e640af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.715+0000 7f3e6a937700 1 -- 172.21.15.133:0/2937163396 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e640b0b50 con 0x7f3e640b2750 2021-01-03T12:58:24.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.715+0000 7f3e6a937700 1 --2- 172.21.15.133:0/2937163396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e640b2750 0x7f3e6405fe20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f3e540010d0 tx=0x7f3e5c0091a0).ready entity=mon.0 client_cookie=225ebcb969f5df07 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.715+0000 7f3e69134700 1 -- 172.21.15.133:0/2937163396 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e540016d0 con 0x7f3e640b2750 2021-01-03T12:58:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.715+0000 7f3e69134700 1 -- 172.21.15.133:0/2937163396 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c00b920 con 0x7f3e640b2750 2021-01-03T12:58:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.715+0000 7f3e69134700 1 -- 172.21.15.133:0/2937163396 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e5c00ba90 con 0x7f3e640b2750 2021-01-03T12:58:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.715+0000 7f3e6b138700 1 -- 172.21.15.133:0/2937163396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e640b2750 msgr2=0x7f3e6405fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.715+0000 7f3e6b138700 1 --2- 172.21.15.133:0/2937163396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e640b2750 0x7f3e6405fe20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f3e540010d0 tx=0x7f3e5c0091a0).stop 2021-01-03T12:58:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.715+0000 7f3e6b138700 1 -- 172.21.15.133:0/2937163396 shutdown_connections 2021-01-03T12:58:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.715+0000 7f3e6b138700 1 --2- 172.21.15.133:0/2937163396 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e640b2750 0x7f3e6405fe20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.715+0000 7f3e6b138700 1 -- 172.21.15.133:0/2937163396 >> 172.21.15.133:0/2937163396 conn(0x7f3e640b6110 msgr2=0x7f3e640b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.715+0000 7f3e6b138700 1 -- 172.21.15.133:0/2937163396 shutdown_connections 2021-01-03T12:58:24.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.715+0000 7f3e6b138700 1 -- 172.21.15.133:0/2937163396 wait complete. 2021-01-03T12:58:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.715+0000 7f3e6b138700 1 Processor -- start 2021-01-03T12:58:24.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.715+0000 7f3e6b138700 1 -- start start 2021-01-03T12:58:24.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e6b138700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3e64066f70 0x7f3e6409ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e6b138700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e64067350 0x7f3e6413f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e6b138700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e640b2750 0x7f3e6413fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e6b138700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e64141010 con 0x7f3e640b2750 2021-01-03T12:58:24.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e6b138700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e64140230 con 0x7f3e64067350 2021-01-03T12:58:24.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e6b138700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e64147970 con 0x7f3e64066f70 2021-01-03T12:58:24.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e69935700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e64067350 0x7f3e6413f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e69935700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e64067350 0x7f3e6413f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60696/0 (socket says 172.21.15.133:60696) 2021-01-03T12:58:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e69935700 1 -- 172.21.15.133:0/1327112150 learned_addr learned my addr 172.21.15.133:0/1327112150 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e6a937700 1 --2- 172.21.15.133:0/1327112150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e640b2750 0x7f3e6413fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e6a136700 1 --2- 172.21.15.133:0/1327112150 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3e64066f70 0x7f3e6409ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e69935700 1 -- 172.21.15.133:0/1327112150 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3e64066f70 msgr2=0x7f3e6409ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e69935700 1 --2- 172.21.15.133:0/1327112150 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3e64066f70 0x7f3e6409ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e69935700 1 -- 172.21.15.133:0/1327112150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e640b2750 msgr2=0x7f3e6413fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e69935700 1 --2- 172.21.15.133:0/1327112150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e640b2750 0x7f3e6413fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e69935700 1 -- 172.21.15.133:0/1327112150 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e64150740 con 0x7f3e64067350 2021-01-03T12:58:24.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e6a136700 1 --2- 172.21.15.133:0/1327112150 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3e64066f70 0x7f3e6409ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:24.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e69935700 1 --2- 172.21.15.133:0/1327112150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e64067350 0x7f3e6413f850 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f3e54000fa0 tx=0x7f3e54001a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:24.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e537fe700 1 -- 172.21.15.133:0/1327112150 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e54007320 con 0x7f3e64067350 2021-01-03T12:58:24.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e537fe700 1 -- 172.21.15.133:0/1327112150 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e54007480 con 0x7f3e64067350 2021-01-03T12:58:24.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e6b138700 1 -- 172.21.15.133:0/1327112150 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e641504a0 con 0x7f3e64067350 2021-01-03T12:58:24.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e537fe700 1 -- 172.21.15.133:0/1327112150 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e540057d0 con 0x7f3e64067350 2021-01-03T12:58:24.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e6b138700 1 -- 172.21.15.133:0/1327112150 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e64147dd0 con 0x7f3e64067350 2021-01-03T12:58:24.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.719+0000 7f3e6b138700 1 -- 172.21.15.133:0/1327112150 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e64057300 con 0x7f3e64067350 2021-01-03T12:58:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.723+0000 7f3e537fe700 1 -- 172.21.15.133:0/1327112150 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3e54010030 con 0x7f3e64067350 2021-01-03T12:58:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.723+0000 7f3e537fe700 1 --2- 172.21.15.133:0/1327112150 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e440553b0 0x7f3e44057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.723+0000 7f3e537fe700 1 -- 172.21.15.133:0/1327112150 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3e5406df00 con 0x7f3e64067350 2021-01-03T12:58:24.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.723+0000 7f3e6a136700 1 --2- 172.21.15.133:0/1327112150 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e440553b0 0x7f3e44057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.723+0000 7f3e6a136700 1 --2- 172.21.15.133:0/1327112150 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e440553b0 0x7f3e44057870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f3e6000b000 tx=0x7f3e60009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:24.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.727+0000 7f3e537fe700 1 -- 172.21.15.133:0/1327112150 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3e54044180 con 0x7f3e64067350 2021-01-03T12:58:24.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.867+0000 7f3e6b138700 1 -- 172.21.15.133:0/1327112150 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3e64061020 con 0x7f3e64067350 2021-01-03T12:58:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.867+0000 7f3e537fe700 1 -- 172.21.15.133:0/1327112150 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3e540477a0 con 0x7f3e64067350 2021-01-03T12:58:24.868 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T12:58:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.867+0000 7f3e6b138700 1 -- 172.21.15.133:0/1327112150 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e440553b0 msgr2=0x7f3e44057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.867+0000 7f3e6b138700 1 --2- 172.21.15.133:0/1327112150 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e440553b0 0x7f3e44057870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f3e6000b000 tx=0x7f3e60009040).stop 2021-01-03T12:58:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.867+0000 7f3e6b138700 1 -- 172.21.15.133:0/1327112150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e64067350 msgr2=0x7f3e6413f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.867+0000 7f3e6b138700 1 --2- 172.21.15.133:0/1327112150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e64067350 0x7f3e6413f850 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f3e54000fa0 tx=0x7f3e54001a70).stop 2021-01-03T12:58:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.867+0000 7f3e6b138700 1 -- 172.21.15.133:0/1327112150 shutdown_connections 2021-01-03T12:58:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.867+0000 7f3e6b138700 1 --2- 172.21.15.133:0/1327112150 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e440553b0 0x7f3e44057870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.867+0000 7f3e6b138700 1 --2- 172.21.15.133:0/1327112150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e640b2750 0x7f3e6413fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.867+0000 7f3e6b138700 1 --2- 172.21.15.133:0/1327112150 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3e64066f70 0x7f3e6409ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.867+0000 7f3e6b138700 1 --2- 172.21.15.133:0/1327112150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e64067350 0x7f3e6413f850 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.867+0000 7f3e6b138700 1 -- 172.21.15.133:0/1327112150 >> 172.21.15.133:0/1327112150 conn(0x7f3e640b6110 msgr2=0x7f3e640acaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:24.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.871+0000 7f3e6b138700 1 -- 172.21.15.133:0/1327112150 shutdown_connections 2021-01-03T12:58:24.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.871+0000 7f3e6b138700 1 -- 172.21.15.133:0/1327112150 wait complete. 2021-01-03T12:58:24.888 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T12:58:25.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:24.999+0000 7fefb934f700 1 Processor -- start 2021-01-03T12:58:25.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb934f700 1 -- start start 2021-01-03T12:58:25.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb934f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefb4062270 0x7fefb41443b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb934f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fefb4060da0 0x7fefb41448a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb934f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb4062650 con 0x7fefb4144d90 2021-01-03T12:58:25.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb934f700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb40b0990 con 0x7fefb4060da0 2021-01-03T12:58:25.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb934f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb405f760 con 0x7fefb4062270 2021-01-03T12:58:25.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb37fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fefb4144d90 0x7fefb405bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53504/0 (socket says 172.21.15.133:53504) 2021-01-03T12:58:25.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb37fe700 1 -- 172.21.15.133:0/1744904565 learned_addr learned my addr 172.21.15.133:0/1744904565 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:25.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb27fc700 1 --2- 172.21.15.133:0/1744904565 >> v2:172.21.15.16:3300/0 conn(0x7fefb4060da0 0x7fefb41448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb2ffd700 1 --2- 172.21.15.133:0/1744904565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefb4062270 0x7fefb41443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 -- 172.21.15.133:0/1744904565 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 588449975 0 0) 0x7fefb4062650 con 0x7fefb4144d90 2021-01-03T12:58:25.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 -- 172.21.15.133:0/1744904565 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef98003230 con 0x7fefb4144d90 2021-01-03T12:58:25.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 -- 172.21.15.133:0/1744904565 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3196636147 0 0) 0x7fef98003230 con 0x7fefb4144d90 2021-01-03T12:58:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 -- 172.21.15.133:0/1744904565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefb4062270 msgr2=0x7fefb41443b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 --2- 172.21.15.133:0/1744904565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefb4062270 0x7fefb41443b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 -- 172.21.15.133:0/1744904565 >> v2:172.21.15.16:3300/0 conn(0x7fefb4060da0 msgr2=0x7fefb41448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:25.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 --2- 172.21.15.133:0/1744904565 >> v2:172.21.15.16:3300/0 conn(0x7fefb4060da0 0x7fefb41448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 -- 172.21.15.133:0/1744904565 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb40b1310 con 0x7fefb4144d90 2021-01-03T12:58:25.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 -- 172.21.15.133:0/1744904565 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fefac001a50 con 0x7fefb4144d90 2021-01-03T12:58:25.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 -- 172.21.15.133:0/1744904565 >> v1:172.21.15.133:6789/0 conn(0x7fefb4144d90 legacy=0x7fefb405bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 --2- 172.21.15.133:0/1744904565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef98003720 0x7fef98003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 --2- 172.21.15.133:0/1744904565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef980044d0 0x7fef98004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 --2- 172.21.15.133:0/1744904565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefb4062270 0x7fef98004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 -- 172.21.15.133:0/1744904565 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40b0990 con 0x7fef98003720 2021-01-03T12:58:25.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 -- 172.21.15.133:0/1744904565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb405f760 con 0x7fef980044d0 2021-01-03T12:58:25.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb27fc700 1 --2- 172.21.15.133:0/1744904565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef980044d0 0x7fef98004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 -- 172.21.15.133:0/1744904565 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef98004260 con 0x7fefb4062270 2021-01-03T12:58:25.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb2ffd700 1 --2- 172.21.15.133:0/1744904565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef98003720 0x7fef98003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb37fe700 1 --2- 172.21.15.133:0/1744904565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefb4062270 0x7fef98004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb27fc700 1 -- 172.21.15.133:0/1744904565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefb4062270 msgr2=0x7fef98004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:25.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb27fc700 1 --2- 172.21.15.133:0/1744904565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefb4062270 0x7fef98004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb27fc700 1 -- 172.21.15.133:0/1744904565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef98003720 msgr2=0x7fef98003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:25.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb27fc700 1 --2- 172.21.15.133:0/1744904565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef98003720 0x7fef98003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb27fc700 1 -- 172.21.15.133:0/1744904565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef98003230 con 0x7fef980044d0 2021-01-03T12:58:25.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb27fc700 1 --2- 172.21.15.133:0/1744904565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef980044d0 0x7fef98004950 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fefa400c000 tx=0x7fefa4008040).ready entity=mon.1 client_cookie=92797c2081a4e4af server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:25.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 -- 172.21.15.133:0/1744904565 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefa400e9d0 con 0x7fef980044d0 2021-01-03T12:58:25.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 -- 172.21.15.133:0/1744904565 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa400eb30 con 0x7fef980044d0 2021-01-03T12:58:25.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb1ffb700 1 -- 172.21.15.133:0/1744904565 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefa400ee90 con 0x7fef980044d0 2021-01-03T12:58:25.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb934f700 1 -- 172.21.15.133:0/1744904565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef980044d0 msgr2=0x7fef98004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb934f700 1 --2- 172.21.15.133:0/1744904565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef980044d0 0x7fef98004950 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fefa400c000 tx=0x7fefa4008040).stop 2021-01-03T12:58:25.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.003+0000 7fefb37fe700 1 -- 172.21.15.133:0/1744904565 reap_dead start 2021-01-03T12:58:25.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb934f700 1 -- 172.21.15.133:0/1744904565 shutdown_connections 2021-01-03T12:58:25.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb934f700 1 -- 172.21.15.133:0/1744904565 >> 172.21.15.133:0/1744904565 conn(0x7fefb40b6db0 msgr2=0x7fefb4061820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:25.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb934f700 1 -- 172.21.15.133:0/1744904565 shutdown_connections 2021-01-03T12:58:25.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb934f700 1 -- 172.21.15.133:0/1744904565 wait complete. 2021-01-03T12:58:25.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb934f700 1 Processor -- start 2021-01-03T12:58:25.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb934f700 1 -- start start 2021-01-03T12:58:25.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb934f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefb41390f0 0x7fefb4136910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb934f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefb4136e00 0x7fefb4137280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb934f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb40ad760 0x7fefb40adc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb934f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40b4050 con 0x7fefb4136e00 2021-01-03T12:58:25.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb934f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb413e400 con 0x7fefb40ad760 2021-01-03T12:58:25.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb934f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40af270 con 0x7fefb41390f0 2021-01-03T12:58:25.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb40ad760 0x7fefb40adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb40ad760 0x7fefb40adc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60718/0 (socket says 172.21.15.133:60718) 2021-01-03T12:58:25.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb37fe700 1 -- 172.21.15.133:0/3130891130 learned_addr learned my addr 172.21.15.133:0/3130891130 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:25.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb27fc700 1 --2- 172.21.15.133:0/3130891130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefb4136e00 0x7fefb4137280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb2ffd700 1 --2- 172.21.15.133:0/3130891130 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefb41390f0 0x7fefb4136910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb37fe700 1 -- 172.21.15.133:0/3130891130 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefb41390f0 msgr2=0x7fefb4136910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb37fe700 1 --2- 172.21.15.133:0/3130891130 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefb41390f0 0x7fefb4136910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb37fe700 1 -- 172.21.15.133:0/3130891130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefb4136e00 msgr2=0x7fefb4137280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb37fe700 1 --2- 172.21.15.133:0/3130891130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefb4136e00 0x7fefb4137280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb37fe700 1 -- 172.21.15.133:0/3130891130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb41394d0 con 0x7fefb40ad760 2021-01-03T12:58:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb37fe700 1 --2- 172.21.15.133:0/3130891130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb40ad760 0x7fefb40adc10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fefb4135770 tx=0x7fefb4140bb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefa3fff700 1 -- 172.21.15.133:0/3130891130 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefac00c9a0 con 0x7fefb40ad760 2021-01-03T12:58:25.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefa3fff700 1 -- 172.21.15.133:0/3130891130 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac00cb00 con 0x7fefb40ad760 2021-01-03T12:58:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefa3fff700 1 -- 172.21.15.133:0/3130891130 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefac00ce60 con 0x7fefb40ad760 2021-01-03T12:58:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.007+0000 7fefb934f700 1 -- 172.21.15.133:0/3130891130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb40aef70 con 0x7fefb40ad760 2021-01-03T12:58:25.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.011+0000 7fefb934f700 1 -- 172.21.15.133:0/3130891130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb40af4a0 con 0x7fefb40ad760 2021-01-03T12:58:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.011+0000 7fefb934f700 1 -- 172.21.15.133:0/3130891130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb4136730 con 0x7fefb40ad760 2021-01-03T12:58:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.011+0000 7fefa3fff700 1 -- 172.21.15.133:0/3130891130 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fefac014430 con 0x7fefb40ad760 2021-01-03T12:58:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.011+0000 7fefa3fff700 1 --2- 172.21.15.133:0/3130891130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef90055330 0x7fef900577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.011+0000 7fefa3fff700 1 -- 172.21.15.133:0/3130891130 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fefac06d630 con 0x7fefb40ad760 2021-01-03T12:58:25.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.011+0000 7fefb2ffd700 1 --2- 172.21.15.133:0/3130891130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef90055330 0x7fef900577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.011+0000 7fefb2ffd700 1 --2- 172.21.15.133:0/3130891130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef90055330 0x7fef900577f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fefa8008000 tx=0x7fefa8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:25.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.019+0000 7fefa3fff700 1 -- 172.21.15.133:0/3130891130 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fefac043830 con 0x7fefb40ad760 2021-01-03T12:58:25.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.155+0000 7fefb934f700 1 -- 172.21.15.133:0/3130891130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fefb4057300 con 0x7fefb40ad760 2021-01-03T12:58:25.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.159+0000 7fefa3fff700 1 -- 172.21.15.133:0/3130891130 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fefac001510 con 0x7fefb40ad760 2021-01-03T12:58:25.159 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:25.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.159+0000 7fefb934f700 1 -- 172.21.15.133:0/3130891130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef90055330 msgr2=0x7fef900577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.159+0000 7fefb934f700 1 --2- 172.21.15.133:0/3130891130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef90055330 0x7fef900577f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fefa8008000 tx=0x7fefa8008040).stop 2021-01-03T12:58:25.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.159+0000 7fefb934f700 1 -- 172.21.15.133:0/3130891130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb40ad760 msgr2=0x7fefb40adc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.159+0000 7fefb934f700 1 --2- 172.21.15.133:0/3130891130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb40ad760 0x7fefb40adc10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fefb4135770 tx=0x7fefb4140bb0).stop 2021-01-03T12:58:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.159+0000 7fefb934f700 1 -- 172.21.15.133:0/3130891130 shutdown_connections 2021-01-03T12:58:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.159+0000 7fefb934f700 1 --2- 172.21.15.133:0/3130891130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef90055330 0x7fef900577f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.159+0000 7fefb934f700 1 --2- 172.21.15.133:0/3130891130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefb40ad760 0x7fefb40adc10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.159+0000 7fefb934f700 1 --2- 172.21.15.133:0/3130891130 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefb41390f0 0x7fefb4136910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.159+0000 7fefb934f700 1 --2- 172.21.15.133:0/3130891130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefb4136e00 0x7fefb4137280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.159+0000 7fefb934f700 1 -- 172.21.15.133:0/3130891130 >> 172.21.15.133:0/3130891130 conn(0x7fefb40b6db0 msgr2=0x7fefb405bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.159+0000 7fefb934f700 1 -- 172.21.15.133:0/3130891130 shutdown_connections 2021-01-03T12:58:25.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.159+0000 7fefb934f700 1 -- 172.21.15.133:0/3130891130 wait complete. 2021-01-03T12:58:25.178 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T12:58:25.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.291+0000 7f0d4eacc700 1 Processor -- start 2021-01-03T12:58:25.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.291+0000 7f0d4eacc700 1 -- start start 2021-01-03T12:58:25.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4eacc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0d48140410 0x7f0d48146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4eacc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0d481407f0 0x7f0d48142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4eacc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0d480b0470 0x7f0d4805bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4eacc700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d480b02d0 con 0x7f0d480b0470 2021-01-03T12:58:25.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4eacc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d48146390 con 0x7f0d48140410 2021-01-03T12:58:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4eacc700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4805cf20 con 0x7f0d481407f0 2021-01-03T12:58:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4c868700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0d48140410 0x7f0d48146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4c868700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0d48140410 0x7f0d48146cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60724/0 (socket says 172.21.15.133:60724) 2021-01-03T12:58:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4c868700 1 -- 172.21.15.133:0/3294651349 learned_addr learned my addr 172.21.15.133:0/3294651349 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:25.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4d069700 1 --2- 172.21.15.133:0/3294651349 >> v2:172.21.15.16:3300/0 conn(0x7f0d480b0470 0x7f0d4805bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d47fff700 1 --2- 172.21.15.133:0/3294651349 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0d481407f0 0x7f0d48142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4c868700 1 -- 172.21.15.133:0/3294651349 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0d481407f0 msgr2=0x7f0d48142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4c868700 1 --2- 172.21.15.133:0/3294651349 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0d481407f0 0x7f0d48142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4c868700 1 -- 172.21.15.133:0/3294651349 >> v2:172.21.15.16:3300/0 conn(0x7f0d480b0470 msgr2=0x7f0d4805bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4c868700 1 --2- 172.21.15.133:0/3294651349 >> v2:172.21.15.16:3300/0 conn(0x7f0d480b0470 0x7f0d4805bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4c868700 1 -- 172.21.15.133:0/3294651349 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d48146580 con 0x7f0d48140410 2021-01-03T12:58:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4d069700 1 --2- 172.21.15.133:0/3294651349 >> v2:172.21.15.16:3300/0 conn(0x7f0d480b0470 0x7f0d4805bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:25.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4c868700 1 --2- 172.21.15.133:0/3294651349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d48140410 0x7f0d48146cc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f0d38002f30 tx=0x7f0d38006e80).ready entity=mon.1 client_cookie=5668b8ba10cdf2ff server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:25.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d477fe700 1 -- 172.21.15.133:0/3294651349 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d380097f0 con 0x7f0d48140410 2021-01-03T12:58:25.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d477fe700 1 -- 172.21.15.133:0/3294651349 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d38009950 con 0x7f0d48140410 2021-01-03T12:58:25.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d477fe700 1 -- 172.21.15.133:0/3294651349 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d38009cb0 con 0x7f0d48140410 2021-01-03T12:58:25.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4eacc700 1 -- 172.21.15.133:0/3294651349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d48140410 msgr2=0x7f0d48146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4eacc700 1 --2- 172.21.15.133:0/3294651349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d48140410 0x7f0d48146cc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f0d38002f30 tx=0x7f0d38006e80).stop 2021-01-03T12:58:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4eacc700 1 -- 172.21.15.133:0/3294651349 shutdown_connections 2021-01-03T12:58:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4eacc700 1 --2- 172.21.15.133:0/3294651349 >> v2:172.21.15.16:3300/0 conn(0x7f0d480b0470 0x7f0d4805bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4eacc700 1 --2- 172.21.15.133:0/3294651349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d48140410 0x7f0d48146cc0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4eacc700 1 --2- 172.21.15.133:0/3294651349 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0d481407f0 0x7f0d48142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4eacc700 1 -- 172.21.15.133:0/3294651349 >> 172.21.15.133:0/3294651349 conn(0x7f0d480b95d0 msgr2=0x7f0d480b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4eacc700 1 -- 172.21.15.133:0/3294651349 shutdown_connections 2021-01-03T12:58:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.295+0000 7f0d4eacc700 1 -- 172.21.15.133:0/3294651349 wait complete. 2021-01-03T12:58:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4eacc700 1 Processor -- start 2021-01-03T12:58:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4eacc700 1 -- start start 2021-01-03T12:58:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4eacc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0d480b0470 0x7f0d480b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4eacc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d48140410 0x7f0d48142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4eacc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d481407f0 0x7f0d481429f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4eacc700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d48141930 con 0x7f0d48140410 2021-01-03T12:58:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4eacc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d48140d80 con 0x7f0d481407f0 2021-01-03T12:58:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4eacc700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4814a570 con 0x7f0d480b0470 2021-01-03T12:58:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4d069700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d481407f0 0x7f0d481429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4d069700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d481407f0 0x7f0d481429f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60732/0 (socket says 172.21.15.133:60732) 2021-01-03T12:58:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4d069700 1 -- 172.21.15.133:0/3848738681 learned_addr learned my addr 172.21.15.133:0/3848738681 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:25.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4c868700 1 --2- 172.21.15.133:0/3848738681 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0d480b0470 0x7f0d480b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d47fff700 1 --2- 172.21.15.133:0/3848738681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d48140410 0x7f0d48142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4d069700 1 -- 172.21.15.133:0/3848738681 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0d480b0470 msgr2=0x7f0d480b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4d069700 1 --2- 172.21.15.133:0/3848738681 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0d480b0470 0x7f0d480b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4d069700 1 -- 172.21.15.133:0/3848738681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d48140410 msgr2=0x7f0d48142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4d069700 1 --2- 172.21.15.133:0/3848738681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d48140410 0x7f0d48142500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4d069700 1 -- 172.21.15.133:0/3848738681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4809f040 con 0x7f0d481407f0 2021-01-03T12:58:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d47fff700 1 --2- 172.21.15.133:0/3848738681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d48140410 0x7f0d48142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4d069700 1 --2- 172.21.15.133:0/3848738681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d481407f0 0x7f0d481429f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f0d40006dd0 tx=0x7f0d40008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d45ffb700 1 -- 172.21.15.133:0/3848738681 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d4000c870 con 0x7f0d481407f0 2021-01-03T12:58:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d45ffb700 1 -- 172.21.15.133:0/3848738681 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4000c9d0 con 0x7f0d481407f0 2021-01-03T12:58:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4eacc700 1 -- 172.21.15.133:0/3848738681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d48152960 con 0x7f0d481407f0 2021-01-03T12:58:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d45ffb700 1 -- 172.21.15.133:0/3848738681 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d4000cd30 con 0x7f0d481407f0 2021-01-03T12:58:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.299+0000 7f0d4eacc700 1 -- 172.21.15.133:0/3848738681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d481415b0 con 0x7f0d481407f0 2021-01-03T12:58:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.303+0000 7f0d4eacc700 1 -- 172.21.15.133:0/3848738681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d48141350 con 0x7f0d481407f0 2021-01-03T12:58:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.303+0000 7f0d45ffb700 1 -- 172.21.15.133:0/3848738681 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0d4001d460 con 0x7f0d481407f0 2021-01-03T12:58:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.303+0000 7f0d45ffb700 1 --2- 172.21.15.133:0/3848738681 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0d280553f0 0x7f0d280578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.303+0000 7f0d45ffb700 1 -- 172.21.15.133:0/3848738681 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0d4006e3c0 con 0x7f0d481407f0 2021-01-03T12:58:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.303+0000 7f0d4c868700 1 --2- 172.21.15.133:0/3848738681 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0d280553f0 0x7f0d280578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.303+0000 7f0d4c868700 1 --2- 172.21.15.133:0/3848738681 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0d280553f0 0x7f0d280578b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f0d3801c000 tx=0x7f0d38015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:25.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.311+0000 7f0d45ffb700 1 -- 172.21.15.133:0/3848738681 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0d40044710 con 0x7f0d481407f0 2021-01-03T12:58:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.451+0000 7f0d4eacc700 1 -- 172.21.15.133:0/3848738681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0d48057300 con 0x7f0d481407f0 2021-01-03T12:58:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.451+0000 7f0d45ffb700 1 -- 172.21.15.133:0/3848738681 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0d40047d30 con 0x7f0d481407f0 2021-01-03T12:58:25.454 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:25.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.455+0000 7f0d4eacc700 1 -- 172.21.15.133:0/3848738681 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0d280553f0 msgr2=0x7f0d280578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.455+0000 7f0d4eacc700 1 --2- 172.21.15.133:0/3848738681 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0d280553f0 0x7f0d280578b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f0d3801c000 tx=0x7f0d38015000).stop 2021-01-03T12:58:25.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.455+0000 7f0d4eacc700 1 -- 172.21.15.133:0/3848738681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d481407f0 msgr2=0x7f0d481429f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.455+0000 7f0d4eacc700 1 --2- 172.21.15.133:0/3848738681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d481407f0 0x7f0d481429f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f0d40006dd0 tx=0x7f0d40008040).stop 2021-01-03T12:58:25.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.455+0000 7f0d4eacc700 1 -- 172.21.15.133:0/3848738681 shutdown_connections 2021-01-03T12:58:25.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.455+0000 7f0d4eacc700 1 --2- 172.21.15.133:0/3848738681 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0d280553f0 0x7f0d280578b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.455+0000 7f0d4eacc700 1 --2- 172.21.15.133:0/3848738681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d481407f0 0x7f0d481429f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.455+0000 7f0d4eacc700 1 --2- 172.21.15.133:0/3848738681 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0d480b0470 0x7f0d480b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.455+0000 7f0d4eacc700 1 --2- 172.21.15.133:0/3848738681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0d48140410 0x7f0d48142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.455+0000 7f0d4eacc700 1 -- 172.21.15.133:0/3848738681 >> 172.21.15.133:0/3848738681 conn(0x7f0d480b95d0 msgr2=0x7f0d48069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:25.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.455+0000 7f0d4eacc700 1 -- 172.21.15.133:0/3848738681 shutdown_connections 2021-01-03T12:58:25.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.455+0000 7f0d4eacc700 1 -- 172.21.15.133:0/3848738681 wait complete. 2021-01-03T12:58:25.468 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T12:58:25.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.583+0000 7fcaca86c700 1 Processor -- start 2021-01-03T12:58:25.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.583+0000 7fcaca86c700 1 -- start start 2021-01-03T12:58:25.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.583+0000 7fcaca86c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcac40b7910 0x7fcac40b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.583+0000 7fcaca86c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcac40b3670 0x7fcac40b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.583+0000 7fcaca86c700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac40ac200 con 0x7fcac413e040 2021-01-03T12:58:25.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.583+0000 7fcaca86c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac40ad720 con 0x7fcac40b3670 2021-01-03T12:58:25.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.583+0000 7fcaca86c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac40acc10 con 0x7fcac40b7910 2021-01-03T12:58:25.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.583+0000 7fcac986a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcac40b7910 0x7fcac40b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.583+0000 7fcac986a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcac40b7910 0x7fcac40b7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60738/0 (socket says 172.21.15.133:60738) 2021-01-03T12:58:25.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.583+0000 7fcac986a700 1 -- 172.21.15.133:0/2471153680 learned_addr learned my addr 172.21.15.133:0/2471153680 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:25.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.583+0000 7fcac9069700 1 --2- 172.21.15.133:0/2471153680 >> v2:172.21.15.16:3300/0 conn(0x7fcac40b3670 0x7fcac40b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.583+0000 7fcac986a700 1 -- 172.21.15.133:0/2471153680 >> v2:172.21.15.16:3300/0 conn(0x7fcac40b3670 msgr2=0x7fcac40b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:25.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.583+0000 7fcac986a700 1 --2- 172.21.15.133:0/2471153680 >> v2:172.21.15.16:3300/0 conn(0x7fcac40b3670 0x7fcac40b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.583+0000 7fcac986a700 1 -- 172.21.15.133:0/2471153680 >> v1:172.21.15.16:6789/0 conn(0x7fcac413e040 legacy=0x7fcac40b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.583+0000 7fcac986a700 1 -- 172.21.15.133:0/2471153680 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac40ac430 con 0x7fcac40b7910 2021-01-03T12:58:25.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.583+0000 7fcac986a700 1 --2- 172.21.15.133:0/2471153680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac40b7910 0x7fcac40b7cf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fcab8002f30 tx=0x7fcab8006e80).ready entity=mon.1 client_cookie=949bd7b8b4726a75 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:25.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.587+0000 7fcac8868700 1 -- 172.21.15.133:0/2471153680 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcab80097f0 con 0x7fcac40b7910 2021-01-03T12:58:25.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.587+0000 7fcac8868700 1 -- 172.21.15.133:0/2471153680 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab8009950 con 0x7fcac40b7910 2021-01-03T12:58:25.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.587+0000 7fcac8868700 1 -- 172.21.15.133:0/2471153680 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcab8009cb0 con 0x7fcac40b7910 2021-01-03T12:58:25.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.587+0000 7fcaca86c700 1 -- 172.21.15.133:0/2471153680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac40b7910 msgr2=0x7fcac40b7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.587+0000 7fcaca86c700 1 --2- 172.21.15.133:0/2471153680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac40b7910 0x7fcac40b7cf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fcab8002f30 tx=0x7fcab8006e80).stop 2021-01-03T12:58:25.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.587+0000 7fcaca86c700 1 -- 172.21.15.133:0/2471153680 shutdown_connections 2021-01-03T12:58:25.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.587+0000 7fcaca86c700 1 --2- 172.21.15.133:0/2471153680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac40b7910 0x7fcac40b7cf0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.587+0000 7fcaca86c700 1 --2- 172.21.15.133:0/2471153680 >> v2:172.21.15.16:3300/0 conn(0x7fcac40b3670 0x7fcac40b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.587+0000 7fcaca86c700 1 -- 172.21.15.133:0/2471153680 >> 172.21.15.133:0/2471153680 conn(0x7fcac405c8c0 msgr2=0x7fcac40b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:25.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.587+0000 7fcaca86c700 1 -- 172.21.15.133:0/2471153680 shutdown_connections 2021-01-03T12:58:25.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.587+0000 7fcaca86c700 1 -- 172.21.15.133:0/2471153680 wait complete. 2021-01-03T12:58:25.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.587+0000 7fcaca86c700 1 Processor -- start 2021-01-03T12:58:25.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.587+0000 7fcaca86c700 1 -- start start 2021-01-03T12:58:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca86c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcac40b3670 0x7fcac40b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca86c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcac40b7910 0x7fcac405fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca86c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac413e040 0x7fcac40613e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca86c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac4152840 con 0x7fcac40b3670 2021-01-03T12:58:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca86c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac4152ae0 con 0x7fcac413e040 2021-01-03T12:58:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca86c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac40b4ea0 con 0x7fcac40b7910 2021-01-03T12:58:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca06b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac413e040 0x7fcac40613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca06b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac413e040 0x7fcac40613e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60746/0 (socket says 172.21.15.133:60746) 2021-01-03T12:58:25.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca06b700 1 -- 172.21.15.133:0/975120861 learned_addr learned my addr 172.21.15.133:0/975120861 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:25.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcac9069700 1 --2- 172.21.15.133:0/975120861 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcac40b7910 0x7fcac405fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcac986a700 1 --2- 172.21.15.133:0/975120861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcac40b3670 0x7fcac40b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca06b700 1 -- 172.21.15.133:0/975120861 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcac40b7910 msgr2=0x7fcac405fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca06b700 1 --2- 172.21.15.133:0/975120861 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcac40b7910 0x7fcac405fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca06b700 1 -- 172.21.15.133:0/975120861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcac40b3670 msgr2=0x7fcac40b55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca06b700 1 --2- 172.21.15.133:0/975120861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcac40b3670 0x7fcac40b55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca06b700 1 -- 172.21.15.133:0/975120861 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac40b5140 con 0x7fcac413e040 2021-01-03T12:58:25.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcac9069700 1 --2- 172.21.15.133:0/975120861 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcac40b7910 0x7fcac405fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcac986a700 1 --2- 172.21.15.133:0/975120861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcac40b3670 0x7fcac40b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca06b700 1 --2- 172.21.15.133:0/975120861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac413e040 0x7fcac40613e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fcac40608e0 tx=0x7fcabc007f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcab77fe700 1 -- 172.21.15.133:0/975120861 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcabc003080 con 0x7fcac413e040 2021-01-03T12:58:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcab77fe700 1 -- 172.21.15.133:0/975120861 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc00a7b0 con 0x7fcac413e040 2021-01-03T12:58:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca86c700 1 -- 172.21.15.133:0/975120861 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac4136ae0 con 0x7fcac413e040 2021-01-03T12:58:25.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcab77fe700 1 -- 172.21.15.133:0/975120861 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcabc00ab10 con 0x7fcac413e040 2021-01-03T12:58:25.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca86c700 1 -- 172.21.15.133:0/975120861 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac40618d0 con 0x7fcac413e040 2021-01-03T12:58:25.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcaca86c700 1 -- 172.21.15.133:0/975120861 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac4136830 con 0x7fcac413e040 2021-01-03T12:58:25.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcab77fe700 1 -- 172.21.15.133:0/975120861 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fcabc019030 con 0x7fcac413e040 2021-01-03T12:58:25.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.591+0000 7fcab77fe700 1 --2- 172.21.15.133:0/975120861 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaa0055440 0x7fcaa0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.595+0000 7fcab77fe700 1 -- 172.21.15.133:0/975120861 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcabc06d6a0 con 0x7fcac413e040 2021-01-03T12:58:25.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.595+0000 7fcac986a700 1 --2- 172.21.15.133:0/975120861 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaa0055440 0x7fcaa0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.595+0000 7fcac986a700 1 --2- 172.21.15.133:0/975120861 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaa0055440 0x7fcaa0057900 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fcab801a000 tx=0x7fcab8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:25.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.599+0000 7fcab77fe700 1 -- 172.21.15.133:0/975120861 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcac4136830 con 0x7fcac413e040 2021-01-03T12:58:25.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.739+0000 7fcaca86c700 1 -- 172.21.15.133:0/975120861 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcac4136830 con 0x7fcac413e040 2021-01-03T12:58:25.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.739+0000 7fcab77fe700 1 -- 172.21.15.133:0/975120861 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7fcac4136830 con 0x7fcac413e040 2021-01-03T12:58:25.740 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:25.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.739+0000 7fcaca86c700 1 -- 172.21.15.133:0/975120861 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaa0055440 msgr2=0x7fcaa0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.739+0000 7fcaca86c700 1 --2- 172.21.15.133:0/975120861 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaa0055440 0x7fcaa0057900 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fcab801a000 tx=0x7fcab8015000).stop 2021-01-03T12:58:25.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.739+0000 7fcaca86c700 1 -- 172.21.15.133:0/975120861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac413e040 msgr2=0x7fcac40613e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.739+0000 7fcaca86c700 1 --2- 172.21.15.133:0/975120861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac413e040 0x7fcac40613e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fcac40608e0 tx=0x7fcabc007f70).stop 2021-01-03T12:58:25.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.739+0000 7fcaca86c700 1 -- 172.21.15.133:0/975120861 shutdown_connections 2021-01-03T12:58:25.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.739+0000 7fcaca86c700 1 --2- 172.21.15.133:0/975120861 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaa0055440 0x7fcaa0057900 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.739+0000 7fcaca86c700 1 --2- 172.21.15.133:0/975120861 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcac40b3670 0x7fcac40b55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.739+0000 7fcaca86c700 1 --2- 172.21.15.133:0/975120861 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac413e040 0x7fcac40613e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.739+0000 7fcaca86c700 1 --2- 172.21.15.133:0/975120861 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcac40b7910 0x7fcac405fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.739+0000 7fcaca86c700 1 -- 172.21.15.133:0/975120861 >> 172.21.15.133:0/975120861 conn(0x7fcac405c8c0 msgr2=0x7fcac4142370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:25.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.743+0000 7fcaca86c700 1 -- 172.21.15.133:0/975120861 shutdown_connections 2021-01-03T12:58:25.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.743+0000 7fcaca86c700 1 -- 172.21.15.133:0/975120861 wait complete. 2021-01-03T12:58:25.754 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:25.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.863+0000 7fad24d86700 1 Processor -- start 2021-01-03T12:58:25.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.863+0000 7fad24d86700 1 -- start start 2021-01-03T12:58:25.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.863+0000 7fad24d86700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fad200b52c0 0x7fad200b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.863+0000 7fad24d86700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad200b0c90 0x7fad20098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.863+0000 7fad24d86700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad20060da0 con 0x7fad200b5c00 2021-01-03T12:58:25.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.863+0000 7fad24d86700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad20067a90 con 0x7fad200b52c0 2021-01-03T12:58:25.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.863+0000 7fad24d86700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad200b0ad0 con 0x7fad200b0c90 2021-01-03T12:58:25.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad1effd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad200b0c90 0x7fad20098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad1f7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fad200b52c0 0x7fad200b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad1effd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad200b0c90 0x7fad20098ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60752/0 (socket says 172.21.15.133:60752) 2021-01-03T12:58:25.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad1effd700 1 -- 172.21.15.133:0/3674288500 learned_addr learned my addr 172.21.15.133:0/3674288500 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:25.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad1effd700 1 -- 172.21.15.133:0/3674288500 >> v2:172.21.15.16:3300/0 conn(0x7fad200b52c0 msgr2=0x7fad200b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:25.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad1effd700 1 --2- 172.21.15.133:0/3674288500 >> v2:172.21.15.16:3300/0 conn(0x7fad200b52c0 0x7fad200b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad1effd700 1 -- 172.21.15.133:0/3674288500 >> v1:172.21.15.16:6789/0 conn(0x7fad200b5c00 legacy=0x7fad2014a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad1effd700 1 -- 172.21.15.133:0/3674288500 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad200b56a0 con 0x7fad200b0c90 2021-01-03T12:58:25.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad1f7fe700 1 --2- 172.21.15.133:0/3674288500 >> v2:172.21.15.16:3300/0 conn(0x7fad200b52c0 0x7fad200b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:25.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad1effd700 1 --2- 172.21.15.133:0/3674288500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad200b0c90 0x7fad20098ec0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fad14002f30 tx=0x7fad14006e80).ready entity=mon.1 client_cookie=761903e2f03a0a00 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:25.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad1e7fc700 1 -- 172.21.15.133:0/3674288500 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad140097f0 con 0x7fad200b0c90 2021-01-03T12:58:25.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad1e7fc700 1 -- 172.21.15.133:0/3674288500 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad14009950 con 0x7fad200b0c90 2021-01-03T12:58:25.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad1e7fc700 1 -- 172.21.15.133:0/3674288500 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad14009cb0 con 0x7fad200b0c90 2021-01-03T12:58:25.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad24d86700 1 -- 172.21.15.133:0/3674288500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad200b0c90 msgr2=0x7fad20098ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad24d86700 1 --2- 172.21.15.133:0/3674288500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad200b0c90 0x7fad20098ec0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fad14002f30 tx=0x7fad14006e80).stop 2021-01-03T12:58:25.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad24d86700 1 -- 172.21.15.133:0/3674288500 shutdown_connections 2021-01-03T12:58:25.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad24d86700 1 --2- 172.21.15.133:0/3674288500 >> v2:172.21.15.16:3300/0 conn(0x7fad200b52c0 0x7fad200b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad24d86700 1 --2- 172.21.15.133:0/3674288500 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad200b0c90 0x7fad20098ec0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad24d86700 1 -- 172.21.15.133:0/3674288500 >> 172.21.15.133:0/3674288500 conn(0x7fad2005bdf0 msgr2=0x7fad2005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:25.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad24d86700 1 -- 172.21.15.133:0/3674288500 shutdown_connections 2021-01-03T12:58:25.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad24d86700 1 -- 172.21.15.133:0/3674288500 wait complete. 2021-01-03T12:58:25.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad24d86700 1 Processor -- start 2021-01-03T12:58:25.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.867+0000 7fad24d86700 1 -- start start 2021-01-03T12:58:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad24d86700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad200b0c90 0x7fad200aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad24d86700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad200b52c0 0x7fad20155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad24d86700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad200b5c00 0x7fad20156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad24d86700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad200ae220 con 0x7fad200b0c90 2021-01-03T12:58:25.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad24d86700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad20066e50 con 0x7fad200b52c0 2021-01-03T12:58:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad24d86700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad200670f0 con 0x7fad200b5c00 2021-01-03T12:58:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad1effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad200b52c0 0x7fad20155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad1effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad200b52c0 0x7fad20155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60760/0 (socket says 172.21.15.133:60760) 2021-01-03T12:58:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad1f7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad200b0c90 0x7fad200aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad1effd700 1 -- 172.21.15.133:0/3319849757 learned_addr learned my addr 172.21.15.133:0/3319849757 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:25.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad1ffff700 1 --2- 172.21.15.133:0/3319849757 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad200b5c00 0x7fad20156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad1effd700 1 -- 172.21.15.133:0/3319849757 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad200b5c00 msgr2=0x7fad20156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad1effd700 1 --2- 172.21.15.133:0/3319849757 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad200b5c00 0x7fad20156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad1effd700 1 -- 172.21.15.133:0/3319849757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad200b0c90 msgr2=0x7fad200aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:25.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad1effd700 1 --2- 172.21.15.133:0/3319849757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad200b0c90 0x7fad200aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:25.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad1effd700 1 -- 172.21.15.133:0/3319849757 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad20067390 con 0x7fad200b52c0 2021-01-03T12:58:25.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad1effd700 1 --2- 172.21.15.133:0/3319849757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad200b52c0 0x7fad20155f90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fad14002f30 tx=0x7fad14015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:25.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad1cff9700 1 -- 172.21.15.133:0/3319849757 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad1400bee0 con 0x7fad200b52c0 2021-01-03T12:58:25.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad1cff9700 1 -- 172.21.15.133:0/3319849757 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad14011e50 con 0x7fad200b52c0 2021-01-03T12:58:25.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad1cff9700 1 -- 172.21.15.133:0/3319849757 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad1401e460 con 0x7fad200b52c0 2021-01-03T12:58:25.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad24d86700 1 -- 172.21.15.133:0/3319849757 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad20066ac0 con 0x7fad200b52c0 2021-01-03T12:58:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad24d86700 1 -- 172.21.15.133:0/3319849757 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad20063ae0 con 0x7fad200b52c0 2021-01-03T12:58:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.871+0000 7fad24d86700 1 -- 172.21.15.133:0/3319849757 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad200687f0 con 0x7fad200b52c0 2021-01-03T12:58:25.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.875+0000 7fad1cff9700 1 -- 172.21.15.133:0/3319849757 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fad14025030 con 0x7fad200b52c0 2021-01-03T12:58:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.875+0000 7fad1cff9700 1 --2- 172.21.15.133:0/3319849757 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fad00055350 0x7fad00057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.875+0000 7fad1f7fe700 1 --2- 172.21.15.133:0/3319849757 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fad00055350 0x7fad00057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.875+0000 7fad1cff9700 1 -- 172.21.15.133:0/3319849757 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fad1406eee0 con 0x7fad200b52c0 2021-01-03T12:58:25.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.875+0000 7fad1f7fe700 1 --2- 172.21.15.133:0/3319849757 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fad00055350 0x7fad00057810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fad1800b000 tx=0x7fad180091a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:25.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:25.879+0000 7fad1cff9700 1 -- 172.21.15.133:0/3319849757 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fad200687f0 con 0x7fad200b52c0 2021-01-03T12:58:26.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.023+0000 7fad24d86700 1 -- 172.21.15.133:0/3319849757 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad200687f0 con 0x7fad200b52c0 2021-01-03T12:58:26.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.027+0000 7fad1cff9700 1 -- 172.21.15.133:0/3319849757 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16086 (secure 0 0 0) 0x7fad200687f0 con 0x7fad200b52c0 2021-01-03T12:58:26.027 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:26.027 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":23,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:01.829379+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:57:58.934952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2021-01-03T12:57:59.830134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:26.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.027+0000 7fad24d86700 1 -- 172.21.15.133:0/3319849757 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fad00055350 msgr2=0x7fad00057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.027+0000 7fad24d86700 1 --2- 172.21.15.133:0/3319849757 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fad00055350 0x7fad00057810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fad1800b000 tx=0x7fad180091a0).stop 2021-01-03T12:58:26.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.027+0000 7fad24d86700 1 -- 172.21.15.133:0/3319849757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad200b52c0 msgr2=0x7fad20155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.027+0000 7fad24d86700 1 --2- 172.21.15.133:0/3319849757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad200b52c0 0x7fad20155f90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fad14002f30 tx=0x7fad14015000).stop 2021-01-03T12:58:26.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.027+0000 7fad24d86700 1 -- 172.21.15.133:0/3319849757 shutdown_connections 2021-01-03T12:58:26.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.027+0000 7fad24d86700 1 --2- 172.21.15.133:0/3319849757 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fad00055350 0x7fad00057810 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.027+0000 7fad24d86700 1 --2- 172.21.15.133:0/3319849757 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad200b0c90 0x7fad200aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.027+0000 7fad24d86700 1 --2- 172.21.15.133:0/3319849757 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad200b5c00 0x7fad20156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.027+0000 7fad24d86700 1 --2- 172.21.15.133:0/3319849757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad200b52c0 0x7fad20155f90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.027+0000 7fad24d86700 1 -- 172.21.15.133:0/3319849757 >> 172.21.15.133:0/3319849757 conn(0x7fad2005bdf0 msgr2=0x7fad20144350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:26.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.027+0000 7fad24d86700 1 -- 172.21.15.133:0/3319849757 shutdown_connections 2021-01-03T12:58:26.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.027+0000 7fad24d86700 1 -- 172.21.15.133:0/3319849757 wait complete. 2021-01-03T12:58:26.041 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T12:57:58.934952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T12:57:59.830134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T12:58:26.041 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T12:58:26.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.151+0000 7f98ed352700 1 Processor -- start 2021-01-03T12:58:26.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.151+0000 7f98ed352700 1 -- start start 2021-01-03T12:58:26.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ed352700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f98e80b4c20 0x7f98e805c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ed352700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98e805fd10 0x7f98e80b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ed352700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e805bf00 con 0x7f98e8060510 2021-01-03T12:58:26.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ed352700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e805c1a0 con 0x7f98e80b4c20 2021-01-03T12:58:26.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ed352700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e805c440 con 0x7f98e805fd10 2021-01-03T12:58:26.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98e7fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f98e80b4c20 0x7f98e805c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ecb51700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98e805fd10 0x7f98e80b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98e77fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f98e8060510 0x7f98e80b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:60524/0 (socket says 172.21.15.133:60524) 2021-01-03T12:58:26.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98e77fe700 1 -- 172.21.15.133:0/3585095443 learned_addr learned my addr 172.21.15.133:0/3585095443 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:26.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98e6ffd700 1 -- 172.21.15.133:0/3585095443 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508121959 0 0) 0x7f98e805bf00 con 0x7f98e8060510 2021-01-03T12:58:26.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98e6ffd700 1 -- 172.21.15.133:0/3585095443 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98d4003230 con 0x7f98e8060510 2021-01-03T12:58:26.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ecb51700 1 -- 172.21.15.133:0/3585095443 >> v2:172.21.15.16:3300/0 conn(0x7f98e80b4c20 msgr2=0x7f98e805c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:26.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ecb51700 1 --2- 172.21.15.133:0/3585095443 >> v2:172.21.15.16:3300/0 conn(0x7f98e80b4c20 0x7f98e805c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ecb51700 1 -- 172.21.15.133:0/3585095443 >> v1:172.21.15.16:6789/0 conn(0x7f98e8060510 legacy=0x7f98e80b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ecb51700 1 -- 172.21.15.133:0/3585095443 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e80b6ad0 con 0x7f98e805fd10 2021-01-03T12:58:26.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98e7fff700 1 --2- 172.21.15.133:0/3585095443 >> v2:172.21.15.16:3300/0 conn(0x7f98e80b4c20 0x7f98e805c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:26.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ecb51700 1 --2- 172.21.15.133:0/3585095443 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98e805fd10 0x7f98e80b65e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f98e00032b0 tx=0x7f98e00091a0).ready entity=mon.2 client_cookie=215b9679827a5123 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:26.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98e6ffd700 1 -- 172.21.15.133:0/3585095443 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98e000b940 con 0x7f98e805fd10 2021-01-03T12:58:26.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98e6ffd700 1 -- 172.21.15.133:0/3585095443 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e000baa0 con 0x7f98e805fd10 2021-01-03T12:58:26.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98e6ffd700 1 -- 172.21.15.133:0/3585095443 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98e000bc10 con 0x7f98e805fd10 2021-01-03T12:58:26.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ed352700 1 -- 172.21.15.133:0/3585095443 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98e805fd10 msgr2=0x7f98e80b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ed352700 1 --2- 172.21.15.133:0/3585095443 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98e805fd10 0x7f98e80b65e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f98e00032b0 tx=0x7f98e00091a0).stop 2021-01-03T12:58:26.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ed352700 1 -- 172.21.15.133:0/3585095443 shutdown_connections 2021-01-03T12:58:26.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ed352700 1 --2- 172.21.15.133:0/3585095443 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98e805fd10 0x7f98e80b65e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ed352700 1 --2- 172.21.15.133:0/3585095443 >> v2:172.21.15.16:3300/0 conn(0x7f98e80b4c20 0x7f98e805c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ed352700 1 -- 172.21.15.133:0/3585095443 >> 172.21.15.133:0/3585095443 conn(0x7f98e80b9f00 msgr2=0x7f98e80b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:26.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ed352700 1 -- 172.21.15.133:0/3585095443 shutdown_connections 2021-01-03T12:58:26.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.155+0000 7f98ed352700 1 -- 172.21.15.133:0/3585095443 wait complete. 2021-01-03T12:58:26.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98ed352700 1 Processor -- start 2021-01-03T12:58:26.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98ed352700 1 -- start start 2021-01-03T12:58:26.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98ed352700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98e805fd10 0x7f98e80af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98ed352700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98e8060510 0x7f98e80b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98ed352700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98e80b4c20 0x7f98e8151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98ed352700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80b2f70 con 0x7f98e805fd10 2021-01-03T12:58:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98ed352700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e81517f0 con 0x7f98e80b4c20 2021-01-03T12:58:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98ed352700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80b31a0 con 0x7f98e8060510 2021-01-03T12:58:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98ecb51700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98e80b4c20 0x7f98e8151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98e7fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98e805fd10 0x7f98e80af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98ecb51700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98e80b4c20 0x7f98e8151c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60774/0 (socket says 172.21.15.133:60774) 2021-01-03T12:58:26.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98ecb51700 1 -- 172.21.15.133:0/2139541907 learned_addr learned my addr 172.21.15.133:0/2139541907 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:26.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98e77fe700 1 --2- 172.21.15.133:0/2139541907 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98e8060510 0x7f98e80b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98e7fff700 1 -- 172.21.15.133:0/2139541907 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98e8060510 msgr2=0x7f98e80b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98e7fff700 1 --2- 172.21.15.133:0/2139541907 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98e8060510 0x7f98e80b1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98e7fff700 1 -- 172.21.15.133:0/2139541907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98e80b4c20 msgr2=0x7f98e8151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98e7fff700 1 --2- 172.21.15.133:0/2139541907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98e80b4c20 0x7f98e8151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98e7fff700 1 -- 172.21.15.133:0/2139541907 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e80b3440 con 0x7f98e805fd10 2021-01-03T12:58:26.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98e7fff700 1 --2- 172.21.15.133:0/2139541907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98e805fd10 0x7f98e80af6c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f98dc00c000 tx=0x7f98dc006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:26.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98e57fa700 1 -- 172.21.15.133:0/2139541907 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98dc00ca10 con 0x7f98e805fd10 2021-01-03T12:58:26.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98e57fa700 1 -- 172.21.15.133:0/2139541907 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98dc00cb70 con 0x7f98e805fd10 2021-01-03T12:58:26.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98ed352700 1 -- 172.21.15.133:0/2139541907 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e80b36e0 con 0x7f98e805fd10 2021-01-03T12:58:26.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98e57fa700 1 -- 172.21.15.133:0/2139541907 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98dc0123f0 con 0x7f98e805fd10 2021-01-03T12:58:26.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.159+0000 7f98ed352700 1 -- 172.21.15.133:0/2139541907 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e80b1f50 con 0x7f98e805fd10 2021-01-03T12:58:26.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.163+0000 7f98ed352700 1 -- 172.21.15.133:0/2139541907 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e8057300 con 0x7f98e805fd10 2021-01-03T12:58:26.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.163+0000 7f98e57fa700 1 -- 172.21.15.133:0/2139541907 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f98dc012550 con 0x7f98e805fd10 2021-01-03T12:58:26.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.163+0000 7f98e57fa700 1 --2- 172.21.15.133:0/2139541907 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98c8055440 0x7f98c8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.163+0000 7f98e77fe700 1 --2- 172.21.15.133:0/2139541907 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98c8055440 0x7f98c8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.163+0000 7f98e57fa700 1 -- 172.21.15.133:0/2139541907 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f98dc06e550 con 0x7f98e805fd10 2021-01-03T12:58:26.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.163+0000 7f98e77fe700 1 --2- 172.21.15.133:0/2139541907 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98c8055440 0x7f98c8057900 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f98d800d000 tx=0x7f98d8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:26.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.171+0000 7f98e57fa700 1 -- 172.21.15.133:0/2139541907 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f98dc0446e0 con 0x7f98e805fd10 2021-01-03T12:58:26.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.311+0000 7f98ed352700 1 -- 172.21.15.133:0/2139541907 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f98e80b3870 con 0x7f98e805fd10 2021-01-03T12:58:26.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.311+0000 7f98e57fa700 1 -- 172.21.15.133:0/2139541907 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v23) v1 ==== 110+0+10 (secure 0 0 0) 0x7f98dc047d00 con 0x7f98e805fd10 2021-01-03T12:58:26.314 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T12:58:26.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.315+0000 7f98ed352700 1 -- 172.21.15.133:0/2139541907 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98c8055440 msgr2=0x7f98c8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.315+0000 7f98ed352700 1 --2- 172.21.15.133:0/2139541907 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98c8055440 0x7f98c8057900 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f98d800d000 tx=0x7f98d8009040).stop 2021-01-03T12:58:26.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.315+0000 7f98ed352700 1 -- 172.21.15.133:0/2139541907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98e805fd10 msgr2=0x7f98e80af6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.315+0000 7f98ed352700 1 --2- 172.21.15.133:0/2139541907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98e805fd10 0x7f98e80af6c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f98dc00c000 tx=0x7f98dc006dc0).stop 2021-01-03T12:58:26.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.315+0000 7f98ed352700 1 -- 172.21.15.133:0/2139541907 shutdown_connections 2021-01-03T12:58:26.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.315+0000 7f98ed352700 1 --2- 172.21.15.133:0/2139541907 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98c8055440 0x7f98c8057900 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.315+0000 7f98ed352700 1 --2- 172.21.15.133:0/2139541907 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98e805fd10 0x7f98e80af6c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.315+0000 7f98ed352700 1 --2- 172.21.15.133:0/2139541907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98e80b4c20 0x7f98e8151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.315+0000 7f98ed352700 1 --2- 172.21.15.133:0/2139541907 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98e8060510 0x7f98e80b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.315+0000 7f98ed352700 1 -- 172.21.15.133:0/2139541907 >> 172.21.15.133:0/2139541907 conn(0x7f98e80b9f00 msgr2=0x7f98e809ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:26.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.315+0000 7f98ed352700 1 -- 172.21.15.133:0/2139541907 shutdown_connections 2021-01-03T12:58:26.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.315+0000 7f98ed352700 1 -- 172.21.15.133:0/2139541907 wait complete. 2021-01-03T12:58:26.326 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T12:58:26.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.443+0000 7fc5c7fff700 1 Processor -- start 2021-01-03T12:58:26.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.443+0000 7fc5c7fff700 1 -- start start 2021-01-03T12:58:26.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.443+0000 7fc5c7fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc5c80b0a00 0x7fc5c813c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.443+0000 7fc5c7fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c80b5880 con 0x7fc5c80abed0 2021-01-03T12:58:26.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.443+0000 7fc5c7fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c80b5b20 con 0x7fc5c80ab3e0 2021-01-03T12:58:26.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.443+0000 7fc5c7fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c80b1390 con 0x7fc5c80b0a00 2021-01-03T12:58:26.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.443+0000 7fc5c6ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc5c80ab3e0 0x7fc5c80ab7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53578/0 (socket says 172.21.15.133:53578) 2021-01-03T12:58:26.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.443+0000 7fc5c6ffd700 1 -- 172.21.15.133:0/1777475181 learned_addr learned my addr 172.21.15.133:0/1777475181 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:26.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c77fe700 1 --2- 172.21.15.133:0/1777475181 >> v2:172.21.15.16:3300/0 conn(0x7fc5c80b0a00 0x7fc5c813c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c5ffb700 1 -- 172.21.15.133:0/1777475181 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86824260 0 0) 0x7fc5c80b5b20 con 0x7fc5c80ab3e0 2021-01-03T12:58:26.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c5ffb700 1 -- 172.21.15.133:0/1777475181 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5ac003230 con 0x7fc5c80ab3e0 2021-01-03T12:58:26.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c5ffb700 1 -- 172.21.15.133:0/1777475181 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515968845 0 0) 0x7fc5c80b5880 con 0x7fc5c80abed0 2021-01-03T12:58:26.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c5ffb700 1 -- 172.21.15.133:0/1777475181 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5c80b5b20 con 0x7fc5c80abed0 2021-01-03T12:58:26.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c5ffb700 1 -- 172.21.15.133:0/1777475181 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 909607267 0 0) 0x7fc5ac003230 con 0x7fc5c80ab3e0 2021-01-03T12:58:26.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c77fe700 1 -- 172.21.15.133:0/1777475181 >> v1:172.21.15.133:6789/0 conn(0x7fc5c80ab3e0 legacy=0x7fc5c80ab7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c77fe700 1 -- 172.21.15.133:0/1777475181 >> v1:172.21.15.16:6789/0 conn(0x7fc5c80abed0 legacy=0x7fc5c813be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c77fe700 1 -- 172.21.15.133:0/1777475181 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c80b1630 con 0x7fc5c80b0a00 2021-01-03T12:58:26.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c77fe700 1 --2- 172.21.15.133:0/1777475181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5c80b0a00 0x7fc5c813c540 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc5b00010d0 tx=0x7fc5b8006dc0).ready entity=mon.0 client_cookie=1168ebf33911e0c0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:26.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c5ffb700 1 -- 172.21.15.133:0/1777475181 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5b00016d0 con 0x7fc5c80b0a00 2021-01-03T12:58:26.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c5ffb700 1 -- 172.21.15.133:0/1777475181 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b800d610 con 0x7fc5c80b0a00 2021-01-03T12:58:26.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c5ffb700 1 -- 172.21.15.133:0/1777475181 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5b800d780 con 0x7fc5c80b0a00 2021-01-03T12:58:26.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c7fff700 1 -- 172.21.15.133:0/1777475181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5c80b0a00 msgr2=0x7fc5c813c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c7fff700 1 --2- 172.21.15.133:0/1777475181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5c80b0a00 0x7fc5c813c540 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc5b00010d0 tx=0x7fc5b8006dc0).stop 2021-01-03T12:58:26.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c7fff700 1 -- 172.21.15.133:0/1777475181 shutdown_connections 2021-01-03T12:58:26.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c7fff700 1 --2- 172.21.15.133:0/1777475181 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5c80b0a00 0x7fc5c813c540 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c7fff700 1 -- 172.21.15.133:0/1777475181 >> 172.21.15.133:0/1777475181 conn(0x7fc5c805bdf0 msgr2=0x7fc5c805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:26.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c7fff700 1 -- 172.21.15.133:0/1777475181 shutdown_connections 2021-01-03T12:58:26.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c7fff700 1 -- 172.21.15.133:0/1777475181 wait complete. 2021-01-03T12:58:26.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.447+0000 7fc5c7fff700 1 Processor -- start 2021-01-03T12:58:26.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c7fff700 1 -- start start 2021-01-03T12:58:26.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5c80ab3e0 0x7fc5c8060820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c7fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc5c80abed0 0x7fc5c8152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c7fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5c80b0a00 0x7fc5c81532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c7fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c80afda0 con 0x7fc5c80b0a00 2021-01-03T12:58:26.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c7fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c80b0270 con 0x7fc5c80ab3e0 2021-01-03T12:58:26.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c7fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c81537e0 con 0x7fc5c80abed0 2021-01-03T12:58:26.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5c80ab3e0 0x7fc5c8060820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5c80ab3e0 0x7fc5c8060820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60784/0 (socket says 172.21.15.133:60784) 2021-01-03T12:58:26.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c6ffd700 1 -- 172.21.15.133:0/3363741159 learned_addr learned my addr 172.21.15.133:0/3363741159 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:26.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c77fe700 1 --2- 172.21.15.133:0/3363741159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5c80b0a00 0x7fc5c81532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c67fc700 1 --2- 172.21.15.133:0/3363741159 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc5c80abed0 0x7fc5c8152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c6ffd700 1 -- 172.21.15.133:0/3363741159 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc5c80abed0 msgr2=0x7fc5c8152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c6ffd700 1 --2- 172.21.15.133:0/3363741159 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc5c80abed0 0x7fc5c8152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c6ffd700 1 -- 172.21.15.133:0/3363741159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5c80b0a00 msgr2=0x7fc5c81532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c6ffd700 1 --2- 172.21.15.133:0/3363741159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5c80b0a00 0x7fc5c81532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c6ffd700 1 -- 172.21.15.133:0/3363741159 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c80affd0 con 0x7fc5c80ab3e0 2021-01-03T12:58:26.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c6ffd700 1 --2- 172.21.15.133:0/3363741159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5c80ab3e0 0x7fc5c8060820 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fc5c8065e10 tx=0x7fc5b0001280).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:26.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5bffff700 1 -- 172.21.15.133:0/3363741159 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5b0007170 con 0x7fc5c80ab3e0 2021-01-03T12:58:26.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5bffff700 1 -- 172.21.15.133:0/3363741159 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b00072d0 con 0x7fc5c80ab3e0 2021-01-03T12:58:26.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c7fff700 1 -- 172.21.15.133:0/3363741159 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c8066680 con 0x7fc5c80ab3e0 2021-01-03T12:58:26.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5bffff700 1 -- 172.21.15.133:0/3363741159 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5b00048f0 con 0x7fc5c80ab3e0 2021-01-03T12:58:26.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c7fff700 1 -- 172.21.15.133:0/3363741159 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c80659b0 con 0x7fc5c80ab3e0 2021-01-03T12:58:26.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.451+0000 7fc5c7fff700 1 -- 172.21.15.133:0/3363741159 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c8057300 con 0x7fc5c80ab3e0 2021-01-03T12:58:26.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.455+0000 7fc5bffff700 1 -- 172.21.15.133:0/3363741159 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc5b0010070 con 0x7fc5c80ab3e0 2021-01-03T12:58:26.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.455+0000 7fc5bffff700 1 --2- 172.21.15.133:0/3363741159 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc5a0055500 0x7fc5a00579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.455+0000 7fc5bffff700 1 -- 172.21.15.133:0/3363741159 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc5b006db90 con 0x7fc5c80ab3e0 2021-01-03T12:58:26.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.455+0000 7fc5c67fc700 1 --2- 172.21.15.133:0/3363741159 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc5a0055500 0x7fc5a00579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.455+0000 7fc5c67fc700 1 --2- 172.21.15.133:0/3363741159 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc5a0055500 0x7fc5a00579c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fc5c000b000 tx=0x7fc5c0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:26.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.463+0000 7fc5bffff700 1 -- 172.21.15.133:0/3363741159 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc5b0043e90 con 0x7fc5c80ab3e0 2021-01-03T12:58:26.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.595+0000 7fc5c7fff700 1 -- 172.21.15.133:0/3363741159 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc5c80678e0 con 0x7fc5c80ab3e0 2021-01-03T12:58:26.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.599+0000 7fc5bffff700 1 -- 172.21.15.133:0/3363741159 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc5b00474b0 con 0x7fc5c80ab3e0 2021-01-03T12:58:26.599 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:26.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.599+0000 7fc5c7fff700 1 -- 172.21.15.133:0/3363741159 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc5a0055500 msgr2=0x7fc5a00579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.599+0000 7fc5c7fff700 1 --2- 172.21.15.133:0/3363741159 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc5a0055500 0x7fc5a00579c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fc5c000b000 tx=0x7fc5c0009040).stop 2021-01-03T12:58:26.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.599+0000 7fc5c7fff700 1 -- 172.21.15.133:0/3363741159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5c80ab3e0 msgr2=0x7fc5c8060820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.599+0000 7fc5c7fff700 1 --2- 172.21.15.133:0/3363741159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5c80ab3e0 0x7fc5c8060820 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fc5c8065e10 tx=0x7fc5b0001280).stop 2021-01-03T12:58:26.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.599+0000 7fc5c7fff700 1 -- 172.21.15.133:0/3363741159 shutdown_connections 2021-01-03T12:58:26.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.599+0000 7fc5c7fff700 1 --2- 172.21.15.133:0/3363741159 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc5a0055500 0x7fc5a00579c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.599+0000 7fc5c7fff700 1 --2- 172.21.15.133:0/3363741159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5c80b0a00 0x7fc5c81532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.599+0000 7fc5c7fff700 1 --2- 172.21.15.133:0/3363741159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5c80ab3e0 0x7fc5c8060820 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.599+0000 7fc5c7fff700 1 --2- 172.21.15.133:0/3363741159 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc5c80abed0 0x7fc5c8152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.599+0000 7fc5c7fff700 1 -- 172.21.15.133:0/3363741159 >> 172.21.15.133:0/3363741159 conn(0x7fc5c805bdf0 msgr2=0x7fc5c813cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:26.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.599+0000 7fc5c7fff700 1 -- 172.21.15.133:0/3363741159 shutdown_connections 2021-01-03T12:58:26.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.599+0000 7fc5c7fff700 1 -- 172.21.15.133:0/3363741159 wait complete. 2021-01-03T12:58:26.613 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T12:58:26.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27569e4700 1 Processor -- start 2021-01-03T12:58:26.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27569e4700 1 -- start start 2021-01-03T12:58:26.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27569e4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27500677a0 0x7f27500ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27569e4700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f275005c670 0x7f27500b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27569e4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2750140ae0 con 0x7f2750146320 2021-01-03T12:58:26.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27569e4700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27500ace10 con 0x7f275005c670 2021-01-03T12:58:26.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27569e4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2750067b80 con 0x7f27500677a0 2021-01-03T12:58:26.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27561e3700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2750146320 0x7f27500a8a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53596/0 (socket says 172.21.15.133:53596) 2021-01-03T12:58:26.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27561e3700 1 -- 172.21.15.133:0/2669341842 learned_addr learned my addr 172.21.15.133:0/2669341842 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:26.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27551e1700 1 --2- 172.21.15.133:0/2669341842 >> v2:172.21.15.16:3300/0 conn(0x7f275005c670 0x7f27500b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27559e2700 1 --2- 172.21.15.133:0/2669341842 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27500677a0 0x7f27500ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 -- 172.21.15.133:0/2669341842 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308329856 0 0) 0x7f2750140ae0 con 0x7f2750146320 2021-01-03T12:58:26.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 -- 172.21.15.133:0/2669341842 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2738003230 con 0x7f2750146320 2021-01-03T12:58:26.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 -- 172.21.15.133:0/2669341842 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1627094299 0 0) 0x7f2738003230 con 0x7f2750146320 2021-01-03T12:58:26.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 -- 172.21.15.133:0/2669341842 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27500677a0 msgr2=0x7f27500ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:26.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 --2- 172.21.15.133:0/2669341842 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27500677a0 0x7f27500ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 -- 172.21.15.133:0/2669341842 >> v2:172.21.15.16:3300/0 conn(0x7f275005c670 msgr2=0x7f27500b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:26.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 --2- 172.21.15.133:0/2669341842 >> v2:172.21.15.16:3300/0 conn(0x7f275005c670 0x7f27500b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 -- 172.21.15.133:0/2669341842 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27500b1560 con 0x7f2750146320 2021-01-03T12:58:26.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 -- 172.21.15.133:0/2669341842 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f2748001aa0 con 0x7f2750146320 2021-01-03T12:58:26.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 -- 172.21.15.133:0/2669341842 >> v1:172.21.15.133:6789/0 conn(0x7f2750146320 legacy=0x7f27500a8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 --2- 172.21.15.133:0/2669341842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2738003720 0x7f2738003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 --2- 172.21.15.133:0/2669341842 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27500677a0 0x7f27380044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 --2- 172.21.15.133:0/2669341842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27380049c0 0x7f2738004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 -- 172.21.15.133:0/2669341842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27500ace10 con 0x7f27380049c0 2021-01-03T12:58:26.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 -- 172.21.15.133:0/2669341842 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2750067b80 con 0x7f2738003720 2021-01-03T12:58:26.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 -- 172.21.15.133:0/2669341842 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27380041c0 con 0x7f27500677a0 2021-01-03T12:58:26.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27559e2700 1 --2- 172.21.15.133:0/2669341842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2738003720 0x7f2738003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27551e1700 1 --2- 172.21.15.133:0/2669341842 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27500677a0 0x7f27380044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27559e2700 1 -- 172.21.15.133:0/2669341842 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27500677a0 msgr2=0x7f27380044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:26.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27559e2700 1 --2- 172.21.15.133:0/2669341842 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27500677a0 0x7f27380044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27559e2700 1 -- 172.21.15.133:0/2669341842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27380049c0 msgr2=0x7f2738004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:26.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27559e2700 1 --2- 172.21.15.133:0/2669341842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27380049c0 0x7f2738004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-03T12:58:26.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27559e2700 1 -- 172.21.15.133:0/2669341842 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2738003230 con 0x7f2738003720 2021-01-03T12:58:26.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27551e1700 1 --2- 172.21.15.133:0/2669341842 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27500677a0 0x7f27380044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:26.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27559e2700 1 --2- 172.21.15.133:0/2669341842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2738003720 0x7f2738003b40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f274c00c000 tx=0x7f274c008040).ready entity=mon.1 client_cookie=94abbb2ada6d7f79 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:26.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 -- 172.21.15.133:0/2669341842 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f274c00e9d0 con 0x7f2738003720 2021-01-03T12:58:26.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 -- 172.21.15.133:0/2669341842 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c00eb30 con 0x7f2738003720 2021-01-03T12:58:26.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27549e0700 1 -- 172.21.15.133:0/2669341842 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f274c00ee90 con 0x7f2738003720 2021-01-03T12:58:26.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27569e4700 1 -- 172.21.15.133:0/2669341842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2738003720 msgr2=0x7f2738003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27569e4700 1 --2- 172.21.15.133:0/2669341842 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2738003720 0x7f2738003b40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f274c00c000 tx=0x7f274c008040).stop 2021-01-03T12:58:26.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27561e3700 1 -- 172.21.15.133:0/2669341842 reap_dead start 2021-01-03T12:58:26.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27569e4700 1 -- 172.21.15.133:0/2669341842 shutdown_connections 2021-01-03T12:58:26.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27569e4700 1 -- 172.21.15.133:0/2669341842 >> 172.21.15.133:0/2669341842 conn(0x7f275006b050 msgr2=0x7f2750060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:26.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27569e4700 1 -- 172.21.15.133:0/2669341842 shutdown_connections 2021-01-03T12:58:26.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.727+0000 7f27569e4700 1 -- 172.21.15.133:0/2669341842 wait complete. 2021-01-03T12:58:26.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27569e4700 1 Processor -- start 2021-01-03T12:58:26.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27569e4700 1 -- start start 2021-01-03T12:58:26.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27569e4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f275013de70 0x7f27501473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27569e4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27500b4ad0 0x7f2750152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27569e4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f275013e250 0x7f27500abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27569e4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2750151e00 con 0x7f275013de70 2021-01-03T12:58:26.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27569e4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27500b5560 con 0x7f275013e250 2021-01-03T12:58:26.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27569e4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2750147890 con 0x7f27500b4ad0 2021-01-03T12:58:26.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27561e3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f275013e250 0x7f27500abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27561e3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f275013e250 0x7f27500abc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60808/0 (socket says 172.21.15.133:60808) 2021-01-03T12:58:26.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27561e3700 1 -- 172.21.15.133:0/3314380579 learned_addr learned my addr 172.21.15.133:0/3314380579 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:26.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27559e2700 1 --2- 172.21.15.133:0/3314380579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f275013de70 0x7f27501473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27551e1700 1 --2- 172.21.15.133:0/3314380579 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27500b4ad0 0x7f2750152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27561e3700 1 -- 172.21.15.133:0/3314380579 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27500b4ad0 msgr2=0x7f2750152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27561e3700 1 --2- 172.21.15.133:0/3314380579 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27500b4ad0 0x7f2750152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27561e3700 1 -- 172.21.15.133:0/3314380579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f275013de70 msgr2=0x7f27501473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27561e3700 1 --2- 172.21.15.133:0/3314380579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f275013de70 0x7f27501473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27561e3700 1 -- 172.21.15.133:0/3314380579 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2750155de0 con 0x7f275013e250 2021-01-03T12:58:26.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27551e1700 1 --2- 172.21.15.133:0/3314380579 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27500b4ad0 0x7f2750152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:26.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27561e3700 1 --2- 172.21.15.133:0/3314380579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f275013e250 0x7f27500abc90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f2748001d00 tx=0x7f27500adaf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:26.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f273effd700 1 -- 172.21.15.133:0/3314380579 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2748004b90 con 0x7f275013e250 2021-01-03T12:58:26.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f273effd700 1 -- 172.21.15.133:0/3314380579 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2748004cf0 con 0x7f275013e250 2021-01-03T12:58:26.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27569e4700 1 -- 172.21.15.133:0/3314380579 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2750156080 con 0x7f275013e250 2021-01-03T12:58:26.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f273effd700 1 -- 172.21.15.133:0/3314380579 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f274800a6b0 con 0x7f275013e250 2021-01-03T12:58:26.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.731+0000 7f27569e4700 1 -- 172.21.15.133:0/3314380579 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2750152290 con 0x7f275013e250 2021-01-03T12:58:26.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.735+0000 7f27569e4700 1 -- 172.21.15.133:0/3314380579 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275013e8a0 con 0x7f275013e250 2021-01-03T12:58:26.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.735+0000 7f273effd700 1 -- 172.21.15.133:0/3314380579 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2748010070 con 0x7f275013e250 2021-01-03T12:58:26.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.735+0000 7f273effd700 1 --2- 172.21.15.133:0/3314380579 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27300553b0 0x7f2730057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:26.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.735+0000 7f273effd700 1 -- 172.21.15.133:0/3314380579 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f274806d4c0 con 0x7f275013e250 2021-01-03T12:58:26.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.735+0000 7f27559e2700 1 --2- 172.21.15.133:0/3314380579 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27300553b0 0x7f2730057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:26.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.735+0000 7f27559e2700 1 --2- 172.21.15.133:0/3314380579 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27300553b0 0x7f2730057870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f274c01c000 tx=0x7f274c01a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:26.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.739+0000 7f273effd700 1 -- 172.21.15.133:0/3314380579 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f27480437c0 con 0x7f275013e250 2021-01-03T12:58:26.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.879+0000 7f27569e4700 1 -- 172.21.15.133:0/3314380579 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2750152450 con 0x7f275013e250 2021-01-03T12:58:26.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.883+0000 7f273effd700 1 -- 172.21.15.133:0/3314380579 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2748004e60 con 0x7f275013e250 2021-01-03T12:58:26.882 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:26.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.883+0000 7f27569e4700 1 -- 172.21.15.133:0/3314380579 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27300553b0 msgr2=0x7f2730057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.883+0000 7f27569e4700 1 --2- 172.21.15.133:0/3314380579 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27300553b0 0x7f2730057870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f274c01c000 tx=0x7f274c01a000).stop 2021-01-03T12:58:26.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.883+0000 7f27569e4700 1 -- 172.21.15.133:0/3314380579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f275013e250 msgr2=0x7f27500abc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:26.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.883+0000 7f27569e4700 1 --2- 172.21.15.133:0/3314380579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f275013e250 0x7f27500abc90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f2748001d00 tx=0x7f27500adaf0).stop 2021-01-03T12:58:26.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.883+0000 7f27569e4700 1 -- 172.21.15.133:0/3314380579 shutdown_connections 2021-01-03T12:58:26.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.883+0000 7f27569e4700 1 --2- 172.21.15.133:0/3314380579 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27300553b0 0x7f2730057870 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.883+0000 7f27569e4700 1 --2- 172.21.15.133:0/3314380579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f275013de70 0x7f27501473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.883+0000 7f27569e4700 1 --2- 172.21.15.133:0/3314380579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f275013e250 0x7f27500abc90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.883+0000 7f27569e4700 1 --2- 172.21.15.133:0/3314380579 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27500b4ad0 0x7f2750152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:26.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.883+0000 7f27569e4700 1 -- 172.21.15.133:0/3314380579 >> 172.21.15.133:0/3314380579 conn(0x7f275006b050 msgr2=0x7f27500ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:26.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.883+0000 7f27569e4700 1 -- 172.21.15.133:0/3314380579 shutdown_connections 2021-01-03T12:58:26.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:26.883+0000 7f27569e4700 1 -- 172.21.15.133:0/3314380579 wait complete. 2021-01-03T12:58:26.900 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T12:58:27.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.011+0000 7f9ed89a3700 1 Processor -- start 2021-01-03T12:58:27.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.011+0000 7f9ed89a3700 1 -- start start 2021-01-03T12:58:27.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.011+0000 7f9ed89a3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ed40b4c20 0x7f9ed405c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:27.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.011+0000 7f9ed89a3700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9ed405fd10 0x7f9ed40b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:27.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.011+0000 7f9ed89a3700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed405bf00 con 0x7f9ed4060510 2021-01-03T12:58:27.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.011+0000 7f9ed89a3700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed405c1a0 con 0x7f9ed405fd10 2021-01-03T12:58:27.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.011+0000 7f9ed89a3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed405c440 con 0x7f9ed40b4c20 2021-01-03T12:58:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.011+0000 7f9ed359e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9ed405fd10 0x7f9ed40b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.011+0000 7f9ed2d9d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ed40b4c20 0x7f9ed405c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.011+0000 7f9eca59c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9ed4060510 0x7f9ed40b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:60572/0 (socket says 172.21.15.133:60572) 2021-01-03T12:58:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.011+0000 7f9eca59c700 1 -- 172.21.15.133:0/1494301937 learned_addr learned my addr 172.21.15.133:0/1494301937 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:27.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed2d9d700 1 -- 172.21.15.133:0/1494301937 >> v2:172.21.15.16:3300/0 conn(0x7f9ed405fd10 msgr2=0x7f9ed40b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:27.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed2d9d700 1 --2- 172.21.15.133:0/1494301937 >> v2:172.21.15.16:3300/0 conn(0x7f9ed405fd10 0x7f9ed40b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:27.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed2d9d700 1 -- 172.21.15.133:0/1494301937 >> v1:172.21.15.16:6789/0 conn(0x7f9ed4060510 legacy=0x7f9ed40b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:27.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed2d9d700 1 -- 172.21.15.133:0/1494301937 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed40b6ad0 con 0x7f9ed40b4c20 2021-01-03T12:58:27.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed2d9d700 1 --2- 172.21.15.133:0/1494301937 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ed40b4c20 0x7f9ed405c8e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9ec4002f30 tx=0x7f9ec4006dc0).ready entity=mon.2 client_cookie=3da46aebf43e6ebf server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:27.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed259c700 1 -- 172.21.15.133:0/1494301937 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ec4009760 con 0x7f9ed40b4c20 2021-01-03T12:58:27.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed259c700 1 -- 172.21.15.133:0/1494301937 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec40098c0 con 0x7f9ed40b4c20 2021-01-03T12:58:27.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed259c700 1 -- 172.21.15.133:0/1494301937 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ec4009c20 con 0x7f9ed40b4c20 2021-01-03T12:58:27.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed89a3700 1 -- 172.21.15.133:0/1494301937 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ed40b4c20 msgr2=0x7f9ed405c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:27.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed89a3700 1 --2- 172.21.15.133:0/1494301937 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ed40b4c20 0x7f9ed405c8e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9ec4002f30 tx=0x7f9ec4006dc0).stop 2021-01-03T12:58:27.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed89a3700 1 -- 172.21.15.133:0/1494301937 shutdown_connections 2021-01-03T12:58:27.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed89a3700 1 --2- 172.21.15.133:0/1494301937 >> v2:172.21.15.16:3300/0 conn(0x7f9ed405fd10 0x7f9ed40b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:27.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed89a3700 1 --2- 172.21.15.133:0/1494301937 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ed40b4c20 0x7f9ed405c8e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed89a3700 1 -- 172.21.15.133:0/1494301937 >> 172.21.15.133:0/1494301937 conn(0x7f9ed40b9f00 msgr2=0x7f9ed40b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed89a3700 1 -- 172.21.15.133:0/1494301937 shutdown_connections 2021-01-03T12:58:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed89a3700 1 -- 172.21.15.133:0/1494301937 wait complete. 2021-01-03T12:58:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed89a3700 1 Processor -- start 2021-01-03T12:58:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.015+0000 7f9ed89a3700 1 -- start start 2021-01-03T12:58:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9ed89a3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ed405fd10 0x7f9ed409e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9ed89a3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ed4060510 0x7f9ed4142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9ed89a3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ed40b4c20 0x7f9ed4143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9ed89a3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4143720 con 0x7f9ed40b4c20 2021-01-03T12:58:27.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9ed89a3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed4141570 con 0x7f9ed4060510 2021-01-03T12:58:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9ed89a3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed41412d0 con 0x7f9ed405fd10 2021-01-03T12:58:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9eca59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ed4060510 0x7f9ed4142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9eca59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ed4060510 0x7f9ed4142c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60818/0 (socket says 172.21.15.133:60818) 2021-01-03T12:58:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9eca59c700 1 -- 172.21.15.133:0/1371254019 learned_addr learned my addr 172.21.15.133:0/1371254019 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:27.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9ed2d9d700 1 --2- 172.21.15.133:0/1371254019 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ed405fd10 0x7f9ed409e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:27.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9ed359e700 1 --2- 172.21.15.133:0/1371254019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ed40b4c20 0x7f9ed4143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:27.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9eca59c700 1 -- 172.21.15.133:0/1371254019 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ed405fd10 msgr2=0x7f9ed409e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:27.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9eca59c700 1 --2- 172.21.15.133:0/1371254019 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ed405fd10 0x7f9ed409e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:27.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9eca59c700 1 -- 172.21.15.133:0/1371254019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ed40b4c20 msgr2=0x7f9ed4143140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:27.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9eca59c700 1 --2- 172.21.15.133:0/1371254019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ed40b4c20 0x7f9ed4143140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:27.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9eca59c700 1 -- 172.21.15.133:0/1371254019 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed41483b0 con 0x7f9ed4060510 2021-01-03T12:58:27.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9eca59c700 1 --2- 172.21.15.133:0/1371254019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ed4060510 0x7f9ed4142c50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f9ed405f8c0 tx=0x7f9ebc007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:27.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9ed0d99700 1 -- 172.21.15.133:0/1371254019 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ebc0072e0 con 0x7f9ed4060510 2021-01-03T12:58:27.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9ed0d99700 1 -- 172.21.15.133:0/1371254019 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc007440 con 0x7f9ed4060510 2021-01-03T12:58:27.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9ed89a3700 1 -- 172.21.15.133:0/1371254019 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed4148650 con 0x7f9ed4060510 2021-01-03T12:58:27.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9ed0d99700 1 -- 172.21.15.133:0/1371254019 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ebc0057d0 con 0x7f9ed4060510 2021-01-03T12:58:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9ed89a3700 1 -- 172.21.15.133:0/1371254019 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed4148d90 con 0x7f9ed4060510 2021-01-03T12:58:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9ed89a3700 1 -- 172.21.15.133:0/1371254019 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed4057300 con 0x7f9ed4060510 2021-01-03T12:58:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.019+0000 7f9ed0d99700 1 -- 172.21.15.133:0/1371254019 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9ebc01a060 con 0x7f9ed4060510 2021-01-03T12:58:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.023+0000 7f9ed0d99700 1 --2- 172.21.15.133:0/1371254019 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9eb8055440 0x7f9eb8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:27.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.023+0000 7f9ed2d9d700 1 --2- 172.21.15.133:0/1371254019 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9eb8055440 0x7f9eb8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:27.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.023+0000 7f9ed0d99700 1 -- 172.21.15.133:0/1371254019 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9ebc06d650 con 0x7f9ed4060510 2021-01-03T12:58:27.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.023+0000 7f9ed2d9d700 1 --2- 172.21.15.133:0/1371254019 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9eb8055440 0x7f9eb8057900 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f9ec401a000 tx=0x7f9ec4015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:27.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.027+0000 7f9ed0d99700 1 -- 172.21.15.133:0/1371254019 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9ebc043950 con 0x7f9ed4060510 2021-01-03T12:58:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.167+0000 7f9ed89a3700 1 -- 172.21.15.133:0/1371254019 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ed40b3f90 con 0x7f9ed4060510 2021-01-03T12:58:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.167+0000 7f9ed0d99700 1 -- 172.21.15.133:0/1371254019 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9ebc018020 con 0x7f9ed4060510 2021-01-03T12:58:27.170 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.171+0000 7f9ed89a3700 1 -- 172.21.15.133:0/1371254019 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9eb8055440 msgr2=0x7f9eb8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.171+0000 7f9ed89a3700 1 --2- 172.21.15.133:0/1371254019 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9eb8055440 0x7f9eb8057900 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f9ec401a000 tx=0x7f9ec4015000).stop 2021-01-03T12:58:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.171+0000 7f9ed89a3700 1 -- 172.21.15.133:0/1371254019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ed4060510 msgr2=0x7f9ed4142c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.171+0000 7f9ed89a3700 1 --2- 172.21.15.133:0/1371254019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ed4060510 0x7f9ed4142c50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f9ed405f8c0 tx=0x7f9ebc007c30).stop 2021-01-03T12:58:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.171+0000 7f9ed89a3700 1 -- 172.21.15.133:0/1371254019 shutdown_connections 2021-01-03T12:58:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.171+0000 7f9ed89a3700 1 --2- 172.21.15.133:0/1371254019 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9eb8055440 0x7f9eb8057900 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.171+0000 7f9ed89a3700 1 --2- 172.21.15.133:0/1371254019 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ed40b4c20 0x7f9ed4143140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.171+0000 7f9ed89a3700 1 --2- 172.21.15.133:0/1371254019 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ed405fd10 0x7f9ed409e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.171+0000 7f9ed89a3700 1 --2- 172.21.15.133:0/1371254019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ed4060510 0x7f9ed4142c50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.171+0000 7f9ed89a3700 1 -- 172.21.15.133:0/1371254019 >> 172.21.15.133:0/1371254019 conn(0x7f9ed40b9f00 msgr2=0x7f9ed409c690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.171+0000 7f9ed89a3700 1 -- 172.21.15.133:0/1371254019 shutdown_connections 2021-01-03T12:58:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.171+0000 7f9ed89a3700 1 -- 172.21.15.133:0/1371254019 wait complete. 2021-01-03T12:58:27.195 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) 2021-01-03T12:58:27.196 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-01-03T12:58:27.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.303+0000 7fb6d8792700 1 Processor -- start 2021-01-03T12:58:27.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.303+0000 7fb6d8792700 1 -- start start 2021-01-03T12:58:27.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.303+0000 7fb6d8792700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6d005c130 0x7fb6d01437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:27.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.303+0000 7fb6d8792700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6d005cc10 0x7fb6d00b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:27.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.303+0000 7fb6d8792700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d005c510 con 0x7fb6d0146370 2021-01-03T12:58:27.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.303+0000 7fb6d8792700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d00b5c10 con 0x7fb6d005cc10 2021-01-03T12:58:27.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.303+0000 7fb6d8792700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d00af8f0 con 0x7fb6d005c130 2021-01-03T12:58:27.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.303+0000 7fb6d5d2d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6d005cc10 0x7fb6d00b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:27.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.303+0000 7fb6d5d2d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6d005cc10 0x7fb6d00b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60828/0 (socket says 172.21.15.133:60828) 2021-01-03T12:58:27.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.303+0000 7fb6d5d2d700 1 -- 172.21.15.133:0/3684586999 learned_addr learned my addr 172.21.15.133:0/3684586999 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:27.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.303+0000 7fb6d652e700 1 --2- 172.21.15.133:0/3684586999 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6d005c130 0x7fb6d01437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:27.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.303+0000 7fb6d5d2d700 1 -- 172.21.15.133:0/3684586999 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6d005c130 msgr2=0x7fb6d01437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:27.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.307+0000 7fb6d5d2d700 1 --2- 172.21.15.133:0/3684586999 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6d005c130 0x7fb6d01437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:27.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.307+0000 7fb6d5d2d700 1 -- 172.21.15.133:0/3684586999 >> v1:172.21.15.16:6789/0 conn(0x7fb6d0146370 legacy=0x7fb6d0146800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:27.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.307+0000 7fb6d5d2d700 1 -- 172.21.15.133:0/3684586999 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d00afb90 con 0x7fb6d005cc10 2021-01-03T12:58:27.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.307+0000 7fb6d5d2d700 1 --2- 172.21.15.133:0/3684586999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6d005cc10 0x7fb6d00b02d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fb6cc002f30 tx=0x7fb6cc006e80).ready entity=mon.1 client_cookie=208e9c1c631c18c9 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.307+0000 7fb6d552c700 1 -- 172.21.15.133:0/3684586999 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6cc0097f0 con 0x7fb6d005cc10 2021-01-03T12:58:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.307+0000 7fb6d552c700 1 -- 172.21.15.133:0/3684586999 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6cc009950 con 0x7fb6d005cc10 2021-01-03T12:58:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.307+0000 7fb6d552c700 1 -- 172.21.15.133:0/3684586999 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6cc009cb0 con 0x7fb6d005cc10 2021-01-03T12:58:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.307+0000 7fb6d8792700 1 -- 172.21.15.133:0/3684586999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6d005cc10 msgr2=0x7fb6d00b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:27.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.307+0000 7fb6d8792700 1 --2- 172.21.15.133:0/3684586999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6d005cc10 0x7fb6d00b02d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fb6cc002f30 tx=0x7fb6cc006e80).stop 2021-01-03T12:58:27.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.307+0000 7fb6d8792700 1 -- 172.21.15.133:0/3684586999 shutdown_connections 2021-01-03T12:58:27.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.307+0000 7fb6d8792700 1 --2- 172.21.15.133:0/3684586999 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6d005c130 0x7fb6d01437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:27.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.307+0000 7fb6d8792700 1 --2- 172.21.15.133:0/3684586999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6d005cc10 0x7fb6d00b02d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:27.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.307+0000 7fb6d8792700 1 -- 172.21.15.133:0/3684586999 >> 172.21.15.133:0/3684586999 conn(0x7fb6d00b95d0 msgr2=0x7fb6d00b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:27.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.307+0000 7fb6d8792700 1 -- 172.21.15.133:0/3684586999 shutdown_connections 2021-01-03T12:58:27.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.307+0000 7fb6d8792700 1 -- 172.21.15.133:0/3684586999 wait complete. 2021-01-03T12:58:27.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d8792700 1 Processor -- start 2021-01-03T12:58:27.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d8792700 1 -- start start 2021-01-03T12:58:27.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d8792700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6d005c130 0x7fb6d00b8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:27.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d8792700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6d005cc10 0x7fb6d0145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:27.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d8792700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6d0146370 0x7fb6d009ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:27.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d8792700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d00b92d0 con 0x7fb6d005cc10 2021-01-03T12:58:27.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d8792700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d009dab0 con 0x7fb6d005c130 2021-01-03T12:58:27.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d8792700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d00b87f0 con 0x7fb6d0146370 2021-01-03T12:58:27.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d652e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6d005c130 0x7fb6d00b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:27.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d652e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6d005c130 0x7fb6d00b8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60832/0 (socket says 172.21.15.133:60832) 2021-01-03T12:58:27.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d652e700 1 -- 172.21.15.133:0/2723459393 learned_addr learned my addr 172.21.15.133:0/2723459393 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d5d2d700 1 --2- 172.21.15.133:0/2723459393 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6d005cc10 0x7fb6d0145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d6d2f700 1 --2- 172.21.15.133:0/2723459393 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6d0146370 0x7fb6d009ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d652e700 1 -- 172.21.15.133:0/2723459393 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6d0146370 msgr2=0x7fb6d009ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d652e700 1 --2- 172.21.15.133:0/2723459393 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6d0146370 0x7fb6d009ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d652e700 1 -- 172.21.15.133:0/2723459393 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6d005cc10 msgr2=0x7fb6d0145b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:27.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d652e700 1 --2- 172.21.15.133:0/2723459393 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6d005cc10 0x7fb6d0145b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:27.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d652e700 1 -- 172.21.15.133:0/2723459393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d00b8d90 con 0x7fb6d005c130 2021-01-03T12:58:27.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6d652e700 1 --2- 172.21.15.133:0/2723459393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6d005c130 0x7fb6d00b8300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fb6c0003070 tx=0x7fb6c0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:27.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.311+0000 7fb6bf7fe700 1 -- 172.21.15.133:0/2723459393 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c0009790 con 0x7fb6d005c130 2021-01-03T12:58:27.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.315+0000 7fb6bf7fe700 1 -- 172.21.15.133:0/2723459393 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c00098f0 con 0x7fb6d005c130 2021-01-03T12:58:27.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.315+0000 7fb6bf7fe700 1 -- 172.21.15.133:0/2723459393 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c0009c50 con 0x7fb6d005c130 2021-01-03T12:58:27.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.315+0000 7fb6d8792700 1 -- 172.21.15.133:0/2723459393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d00b9030 con 0x7fb6d005c130 2021-01-03T12:58:27.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.315+0000 7fb6d8792700 1 -- 172.21.15.133:0/2723459393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d00b3be0 con 0x7fb6d005c130 2021-01-03T12:58:27.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.315+0000 7fb6d8792700 1 -- 172.21.15.133:0/2723459393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d0057300 con 0x7fb6d005c130 2021-01-03T12:58:27.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.315+0000 7fb6bf7fe700 1 -- 172.21.15.133:0/2723459393 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb6c0009db0 con 0x7fb6d005c130 2021-01-03T12:58:27.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.315+0000 7fb6bf7fe700 1 --2- 172.21.15.133:0/2723459393 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6b0055500 0x7fb6b00579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:27.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.315+0000 7fb6bf7fe700 1 -- 172.21.15.133:0/2723459393 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb6c006e3a0 con 0x7fb6d005c130 2021-01-03T12:58:27.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.315+0000 7fb6d5d2d700 1 --2- 172.21.15.133:0/2723459393 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6b0055500 0x7fb6b00579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:27.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.315+0000 7fb6d5d2d700 1 --2- 172.21.15.133:0/2723459393 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6b0055500 0x7fb6b00579c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb6cc01c000 tx=0x7fb6cc015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:27.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.323+0000 7fb6bf7fe700 1 -- 172.21.15.133:0/2723459393 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb6c0044590 con 0x7fb6d005c130 2021-01-03T12:58:27.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:27.511+0000 7fb6d8792700 1 -- 172.21.15.133:0/2723459393 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7fb6d005d270 con 0x7fb6d005c130 2021-01-03T12:58:28.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.123+0000 7fb6bf7fe700 1 -- 172.21.15.133:0/2723459393 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v43) v1 ==== 142+0+0 (secure 0 0 0) 0x7fb6c0047bb0 con 0x7fb6d005c130 2021-01-03T12:58:28.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.127+0000 7fb6d8792700 1 -- 172.21.15.133:0/2723459393 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6b0055500 msgr2=0x7fb6b00579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:28.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.127+0000 7fb6d8792700 1 --2- 172.21.15.133:0/2723459393 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6b0055500 0x7fb6b00579c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb6cc01c000 tx=0x7fb6cc015000).stop 2021-01-03T12:58:28.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.127+0000 7fb6d8792700 1 -- 172.21.15.133:0/2723459393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6d005c130 msgr2=0x7fb6d00b8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:28.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.127+0000 7fb6d8792700 1 --2- 172.21.15.133:0/2723459393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6d005c130 0x7fb6d00b8300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fb6c0003070 tx=0x7fb6c0008040).stop 2021-01-03T12:58:28.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.127+0000 7fb6d8792700 1 -- 172.21.15.133:0/2723459393 shutdown_connections 2021-01-03T12:58:28.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.127+0000 7fb6d8792700 1 --2- 172.21.15.133:0/2723459393 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6b0055500 0x7fb6b00579c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:28.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.127+0000 7fb6d8792700 1 --2- 172.21.15.133:0/2723459393 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6d0146370 0x7fb6d009ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:28.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.127+0000 7fb6d8792700 1 --2- 172.21.15.133:0/2723459393 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6d005c130 0x7fb6d00b8300 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:28.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.127+0000 7fb6d8792700 1 --2- 172.21.15.133:0/2723459393 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6d005cc10 0x7fb6d0145b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:28.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.127+0000 7fb6d8792700 1 -- 172.21.15.133:0/2723459393 >> 172.21.15.133:0/2723459393 conn(0x7fb6d00b95d0 msgr2=0x7fb6d0144640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:28.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.127+0000 7fb6d8792700 1 -- 172.21.15.133:0/2723459393 shutdown_connections 2021-01-03T12:58:28.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.127+0000 7fb6d8792700 1 -- 172.21.15.133:0/2723459393 wait complete. 2021-01-03T12:58:28.145 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-01-03T12:58:28.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f984dfc4700 1 Processor -- start 2021-01-03T12:58:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f984dfc4700 1 -- start start 2021-01-03T12:58:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f984dfc4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98480b5260 0x7f98481470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f984dfc4700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f98481442a0 0x7f9848144750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f984dfc4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98480b0c10 con 0x7f98480b5c00 2021-01-03T12:58:28.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f984dfc4700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98480b5640 con 0x7f98481442a0 2021-01-03T12:58:28.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f984dfc4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984809a4f0 con 0x7f98480b5260 2021-01-03T12:58:28.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f9847fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f98480b5c00 0x7f98481475a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53642/0 (socket says 172.21.15.133:53642) 2021-01-03T12:58:28.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f9847fff700 1 -- 172.21.15.133:0/1568861120 learned_addr learned my addr 172.21.15.133:0/1568861120 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:28.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f984d7c3700 1 --2- 172.21.15.133:0/1568861120 >> v2:172.21.15.16:3300/0 conn(0x7f98481442a0 0x7f9848144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:28.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f984cfc2700 1 --2- 172.21.15.133:0/1568861120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98480b5260 0x7f98481470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:28.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f98477fe700 1 -- 172.21.15.133:0/1568861120 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127800149 0 0) 0x7f98480b0c10 con 0x7f98480b5c00 2021-01-03T12:58:28.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f98477fe700 1 -- 172.21.15.133:0/1568861120 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9834003230 con 0x7f98480b5c00 2021-01-03T12:58:28.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f984d7c3700 1 -- 172.21.15.133:0/1568861120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98480b5260 msgr2=0x7f98481470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:28.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f984d7c3700 1 --2- 172.21.15.133:0/1568861120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98480b5260 0x7f98481470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:28.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f984d7c3700 1 -- 172.21.15.133:0/1568861120 >> v1:172.21.15.133:6789/0 conn(0x7f98480b5c00 legacy=0x7f98481475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:28.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f984d7c3700 1 -- 172.21.15.133:0/1568861120 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98480b0e40 con 0x7f98481442a0 2021-01-03T12:58:28.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f984cfc2700 1 --2- 172.21.15.133:0/1568861120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98480b5260 0x7f98481470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:28.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f984d7c3700 1 --2- 172.21.15.133:0/1568861120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98481442a0 0x7f9848144750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f98400032b0 tx=0x7f98400091a0).ready entity=mon.0 client_cookie=ac93f5451949f328 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:28.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.271+0000 7f98477fe700 1 -- 172.21.15.133:0/1568861120 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f984000b940 con 0x7f98481442a0 2021-01-03T12:58:28.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.275+0000 7f98477fe700 1 -- 172.21.15.133:0/1568861120 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984000baa0 con 0x7f98481442a0 2021-01-03T12:58:28.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.275+0000 7f98477fe700 1 -- 172.21.15.133:0/1568861120 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f984000bc10 con 0x7f98481442a0 2021-01-03T12:58:28.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.275+0000 7f984dfc4700 1 -- 172.21.15.133:0/1568861120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98481442a0 msgr2=0x7f9848144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:28.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.275+0000 7f984dfc4700 1 --2- 172.21.15.133:0/1568861120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98481442a0 0x7f9848144750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f98400032b0 tx=0x7f98400091a0).stop 2021-01-03T12:58:28.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.275+0000 7f984dfc4700 1 -- 172.21.15.133:0/1568861120 shutdown_connections 2021-01-03T12:58:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.275+0000 7f984dfc4700 1 --2- 172.21.15.133:0/1568861120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98481442a0 0x7f9848144750 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.275+0000 7f984dfc4700 1 --2- 172.21.15.133:0/1568861120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98480b5260 0x7f98481470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.275+0000 7f984dfc4700 1 -- 172.21.15.133:0/1568861120 >> 172.21.15.133:0/1568861120 conn(0x7f984805bdf0 msgr2=0x7f984805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.275+0000 7f984dfc4700 1 -- 172.21.15.133:0/1568861120 shutdown_connections 2021-01-03T12:58:28.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.275+0000 7f984dfc4700 1 -- 172.21.15.133:0/1568861120 wait complete. 2021-01-03T12:58:28.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.275+0000 7f984dfc4700 1 Processor -- start 2021-01-03T12:58:28.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.275+0000 7f984dfc4700 1 -- start start 2021-01-03T12:58:28.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f984dfc4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98480b5260 0x7f98480aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:28.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f984dfc4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98480b5c00 0x7f98481597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:28.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f984dfc4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98481442a0 0x7f9848159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:28.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f984dfc4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9848067030 con 0x7f98480b5260 2021-01-03T12:58:28.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f984dfc4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9848067290 con 0x7f98480b5c00 2021-01-03T12:58:28.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f984dfc4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9848067530 con 0x7f98481442a0 2021-01-03T12:58:28.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f9847fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98480b5c00 0x7f98481597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:28.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f9847fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98480b5c00 0x7f98481597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60846/0 (socket says 172.21.15.133:60846) 2021-01-03T12:58:28.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f9847fff700 1 -- 172.21.15.133:0/1696608120 learned_addr learned my addr 172.21.15.133:0/1696608120 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:28.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f984cfc2700 1 --2- 172.21.15.133:0/1696608120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98480b5260 0x7f98480aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:28.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f984d7c3700 1 --2- 172.21.15.133:0/1696608120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98481442a0 0x7f9848159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:28.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f9847fff700 1 -- 172.21.15.133:0/1696608120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98481442a0 msgr2=0x7f9848159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:28.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f9847fff700 1 --2- 172.21.15.133:0/1696608120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98481442a0 0x7f9848159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:28.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f9847fff700 1 -- 172.21.15.133:0/1696608120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98480b5260 msgr2=0x7f98480aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:28.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f9847fff700 1 --2- 172.21.15.133:0/1696608120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98480b5260 0x7f98480aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:28.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f9847fff700 1 -- 172.21.15.133:0/1696608120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9848159350 con 0x7f98480b5c00 2021-01-03T12:58:28.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f9847fff700 1 --2- 172.21.15.133:0/1696608120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98480b5c00 0x7f98481597f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f983c0010d0 tx=0x7f983c007a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:28.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f9845ffb700 1 -- 172.21.15.133:0/1696608120 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f983c0072e0 con 0x7f98480b5c00 2021-01-03T12:58:28.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f9845ffb700 1 -- 172.21.15.133:0/1696608120 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983c007440 con 0x7f98480b5c00 2021-01-03T12:58:28.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f984dfc4700 1 -- 172.21.15.133:0/1696608120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9848148220 con 0x7f98480b5c00 2021-01-03T12:58:28.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f9845ffb700 1 -- 172.21.15.133:0/1696608120 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f983c0057d0 con 0x7f98480b5c00 2021-01-03T12:58:28.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.279+0000 7f984dfc4700 1 -- 172.21.15.133:0/1696608120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9848155c40 con 0x7f98480b5c00 2021-01-03T12:58:28.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.283+0000 7f984dfc4700 1 -- 172.21.15.133:0/1696608120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9848155f50 con 0x7f98480b5c00 2021-01-03T12:58:28.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.283+0000 7f9845ffb700 1 -- 172.21.15.133:0/1696608120 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f983c01a060 con 0x7f98480b5c00 2021-01-03T12:58:28.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.283+0000 7f9845ffb700 1 --2- 172.21.15.133:0/1696608120 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98280553b0 0x7f9828057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:28.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.283+0000 7f9845ffb700 1 -- 172.21.15.133:0/1696608120 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f983c06d330 con 0x7f98480b5c00 2021-01-03T12:58:28.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.283+0000 7f984cfc2700 1 --2- 172.21.15.133:0/1696608120 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98280553b0 0x7f9828057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:28.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.283+0000 7f984cfc2700 1 --2- 172.21.15.133:0/1696608120 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98280553b0 0x7f9828057870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f983800b000 tx=0x7f9838006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:28.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.287+0000 7f9845ffb700 1 -- 172.21.15.133:0/1696608120 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f983c0435d0 con 0x7f98480b5c00 2021-01-03T12:58:28.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.431+0000 7f984dfc4700 1 -- 172.21.15.133:0/1696608120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7f98481594e0 con 0x7f98480b5c00 2021-01-03T12:58:28.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.443+0000 7f9845ffb700 1 -- 172.21.15.133:0/1696608120 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f983c018020 con 0x7f98480b5c00 2021-01-03T12:58:28.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.443+0000 7f984dfc4700 1 -- 172.21.15.133:0/1696608120 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98280553b0 msgr2=0x7f9828057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:28.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.443+0000 7f984dfc4700 1 --2- 172.21.15.133:0/1696608120 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98280553b0 0x7f9828057870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f983800b000 tx=0x7f9838006dc0).stop 2021-01-03T12:58:28.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.443+0000 7f984dfc4700 1 -- 172.21.15.133:0/1696608120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98480b5c00 msgr2=0x7f98481597f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:28.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.443+0000 7f984dfc4700 1 --2- 172.21.15.133:0/1696608120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98480b5c00 0x7f98481597f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f983c0010d0 tx=0x7f983c007a70).stop 2021-01-03T12:58:28.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.443+0000 7f984dfc4700 1 -- 172.21.15.133:0/1696608120 shutdown_connections 2021-01-03T12:58:28.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.443+0000 7f984dfc4700 1 --2- 172.21.15.133:0/1696608120 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98280553b0 0x7f9828057870 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:28.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.443+0000 7f984dfc4700 1 --2- 172.21.15.133:0/1696608120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98480b5260 0x7f98480aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:28.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.443+0000 7f984dfc4700 1 --2- 172.21.15.133:0/1696608120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98481442a0 0x7f9848159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:28.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.443+0000 7f984dfc4700 1 --2- 172.21.15.133:0/1696608120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98480b5c00 0x7f98481597f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:28.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.443+0000 7f984dfc4700 1 -- 172.21.15.133:0/1696608120 >> 172.21.15.133:0/1696608120 conn(0x7f984805bdf0 msgr2=0x7f984805c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:28.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.443+0000 7f984dfc4700 1 -- 172.21.15.133:0/1696608120 shutdown_connections 2021-01-03T12:58:28.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:28.443+0000 7f984dfc4700 1 -- 172.21.15.133:0/1696608120 wait complete. 2021-01-03T12:58:28.458 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T12:58:28.459 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T12:58:28.480 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T12:58:28.508 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T12:58:28.540 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T12:58:28.571 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T12:58:28.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:28.573 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T12:58:28.573 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:58:28.586 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T12:58:28.587 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T12:58:28.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:28.589 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T12:58:28.589 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:58:28.642 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T12:58:28.644 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T12:58:28.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:28.645 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T12:58:28.646 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:58:28.692 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-01-03T12:58:28.693 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T12:58:28.693 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-01-03T12:58:28.694 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T12:58:28.694 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T12:58:28.695 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:58:28.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:28.792 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T12:58:28.793 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:58:28.800 INFO:teuthology.orchestra.run.smithi007.stdout:ext2/ext3 2021-01-03T12:58:28.801 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T12:58:28.801 INFO:teuthology.orchestra.run:waiting for 900 2021-01-03T12:58:28.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T12:58:28.802 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:58:28.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:28.860 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T12:58:28.861 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T12:58:28.871 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T12:58:28.872 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T12:58:28.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:28.873 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T12:58:28.873 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T12:58:28.922 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T12:58:28.923 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T12:58:28.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:28.924 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T12:58:28.925 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T12:58:28.973 INFO:teuthology.orchestra.run.smithi036.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': Transport endpoint is not connected 2021-01-03T12:58:28.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T12:58:28.974 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.1 2021-01-03T12:58:28.975 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi036.front.sepia.ceph.com... 2021-01-03T12:58:28.975 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T12:58:28.976 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-01-03T12:58:29.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:29.082 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T12:58:29.082 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T12:58:29.089 INFO:teuthology.orchestra.run.smithi036.stdout:ext2/ext3 2021-01-03T12:58:29.090 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T12:58:29.091 INFO:teuthology.orchestra.run:waiting for 900 2021-01-03T12:58:29.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T12:58:29.091 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T12:58:29.145 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-01-03T12:58:29.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9eef9b700 1 Processor -- start 2021-01-03T12:58:29.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9eef9b700 1 -- start start 2021-01-03T12:58:29.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9eef9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb9e80b5ae0 0x7fb9e80abd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:29.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9eef9b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9e8099ff0 0x7fb9e813fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:29.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9eef9b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e80b5710 con 0x7fb9e80b5330 2021-01-03T12:58:29.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9eef9b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e80b10f0 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9eef9b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80ac270 con 0x7fb9e8099ff0 2021-01-03T12:58:29.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9edf99700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb9e80b5330 0x7fb9e8142c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53654/0 (socket says 172.21.15.133:53654) 2021-01-03T12:58:29.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9edf99700 1 -- 172.21.15.133:0/1116104055 learned_addr learned my addr 172.21.15.133:0/1116104055 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:29.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9ed798700 1 --2- 172.21.15.133:0/1116104055 >> v2:172.21.15.133:3300/0 conn(0x7fb9e80b5ae0 0x7fb9e80abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:29.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9ee79a700 1 --2- 172.21.15.133:0/1116104055 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9e8099ff0 0x7fb9e813fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:29.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9ecf97700 1 -- 172.21.15.133:0/1116104055 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942345662 0 0) 0x7fb9e80b5710 con 0x7fb9e80b5330 2021-01-03T12:58:29.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9ecf97700 1 -- 172.21.15.133:0/1116104055 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d0003230 con 0x7fb9e80b5330 2021-01-03T12:58:29.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9ed798700 1 -- 172.21.15.133:0/1116104055 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9e8099ff0 msgr2=0x7fb9e813fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:29.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9ed798700 1 --2- 172.21.15.133:0/1116104055 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9e8099ff0 0x7fb9e813fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9ed798700 1 -- 172.21.15.133:0/1116104055 >> v1:172.21.15.133:6789/0 conn(0x7fb9e80b5330 legacy=0x7fb9e8142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:29.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9ed798700 1 -- 172.21.15.133:0/1116104055 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e80ab280 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9ed798700 1 --2- 172.21.15.133:0/1116104055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e80b5ae0 0x7fb9e80abd80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fb9d8002f30 tx=0x7fb9d8006dc0).ready entity=mon.1 client_cookie=3f5cfe16e6e7fc0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9ecf97700 1 -- 172.21.15.133:0/1116104055 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9d80096a0 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9ecf97700 1 -- 172.21.15.133:0/1116104055 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d8009800 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9eef9b700 1 -- 172.21.15.133:0/1116104055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e80b5ae0 msgr2=0x7fb9e80abd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:29.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9ecf97700 1 -- 172.21.15.133:0/1116104055 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9d8009b60 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.263+0000 7fb9eef9b700 1 --2- 172.21.15.133:0/1116104055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e80b5ae0 0x7fb9e80abd80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fb9d8002f30 tx=0x7fb9d8006dc0).stop 2021-01-03T12:58:29.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9eef9b700 1 -- 172.21.15.133:0/1116104055 shutdown_connections 2021-01-03T12:58:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9eef9b700 1 --2- 172.21.15.133:0/1116104055 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9e8099ff0 0x7fb9e813fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9eef9b700 1 --2- 172.21.15.133:0/1116104055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e80b5ae0 0x7fb9e80abd80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9eef9b700 1 -- 172.21.15.133:0/1116104055 >> 172.21.15.133:0/1116104055 conn(0x7fb9e805bdf0 msgr2=0x7fb9e805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9eef9b700 1 -- 172.21.15.133:0/1116104055 shutdown_connections 2021-01-03T12:58:29.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9eef9b700 1 -- 172.21.15.133:0/1116104055 wait complete. 2021-01-03T12:58:29.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9eef9b700 1 Processor -- start 2021-01-03T12:58:29.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9eef9b700 1 -- start start 2021-01-03T12:58:29.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9eef9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e8099ff0 0x7fb9e8141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:29.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9eef9b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9e80b5330 0x7fb9e81468a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:29.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9eef9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e80b5ae0 0x7fb9e8151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:29.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9eef9b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e80ad1a0 con 0x7fb9e8099ff0 2021-01-03T12:58:29.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9eef9b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e8143590 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9eef9b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e8146d90 con 0x7fb9e80b5330 2021-01-03T12:58:29.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9ee79a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e80b5ae0 0x7fb9e8151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:29.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9ee79a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e80b5ae0 0x7fb9e8151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60864/0 (socket says 172.21.15.133:60864) 2021-01-03T12:58:29.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9ee79a700 1 -- 172.21.15.133:0/1104026795 learned_addr learned my addr 172.21.15.133:0/1104026795 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:29.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9ed798700 1 --2- 172.21.15.133:0/1104026795 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9e80b5330 0x7fb9e81468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:29.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9edf99700 1 --2- 172.21.15.133:0/1104026795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e8099ff0 0x7fb9e8141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:29.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9ee79a700 1 -- 172.21.15.133:0/1104026795 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9e80b5330 msgr2=0x7fb9e81468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:29.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9ee79a700 1 --2- 172.21.15.133:0/1104026795 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9e80b5330 0x7fb9e81468a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9ee79a700 1 -- 172.21.15.133:0/1104026795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e8099ff0 msgr2=0x7fb9e8141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:29.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9ee79a700 1 --2- 172.21.15.133:0/1104026795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e8099ff0 0x7fb9e8141e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9ee79a700 1 -- 172.21.15.133:0/1104026795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e81461a0 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9edf99700 1 --2- 172.21.15.133:0/1104026795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e8099ff0 0x7fb9e8141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:29.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9ee79a700 1 --2- 172.21.15.133:0/1104026795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e80b5ae0 0x7fb9e8151a90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fb9e81460f0 tx=0x7fb9e00091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:29.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9d6ffd700 1 -- 172.21.15.133:0/1104026795 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9e000ee60 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9d6ffd700 1 -- 172.21.15.133:0/1104026795 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e000cb50 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9eef9b700 1 -- 172.21.15.133:0/1104026795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e81437c0 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9d6ffd700 1 -- 172.21.15.133:0/1104026795 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9e000ceb0 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.267+0000 7fb9eef9b700 1 -- 172.21.15.133:0/1104026795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e80ac440 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.271+0000 7fb9eef9b700 1 -- 172.21.15.133:0/1104026795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e80ae4a0 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.271+0000 7fb9d6ffd700 1 -- 172.21.15.133:0/1104026795 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb9e0022070 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.271+0000 7fb9d6ffd700 1 --2- 172.21.15.133:0/1104026795 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb9c8055330 0x7fb9c80577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:29.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.271+0000 7fb9edf99700 1 --2- 172.21.15.133:0/1104026795 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb9c8055330 0x7fb9c80577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:29.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.271+0000 7fb9d6ffd700 1 -- 172.21.15.133:0/1104026795 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb9e006e730 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.275+0000 7fb9edf99700 1 --2- 172.21.15.133:0/1104026795 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb9c8055330 0x7fb9c80577f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fb9e4008000 tx=0x7fb9e4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:29.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.279+0000 7fb9d6ffd700 1 -- 172.21.15.133:0/1104026795 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb9e0044920 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.419+0000 7fb9eef9b700 1 -- 172.21.15.133:0/1104026795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb9e8152120 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.419+0000 7fb9d6ffd700 1 -- 172.21.15.133:0/1104026795 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v23) v1 ==== 81+0+33693 (secure 0 0 0) 0x7fb9e0016070 con 0x7fb9e80b5ae0 2021-01-03T12:58:29.421 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:29.421 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T12:58:29.421 INFO:teuthology.orchestra.run.smithi133.stdout: "epoch": 23, 2021-01-03T12:58:29.422 INFO:teuthology.orchestra.run.smithi133.stdout: "fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", 2021-01-03T12:58:29.422 INFO:teuthology.orchestra.run.smithi133.stdout: "created": "2021-01-03T12:57:43.298835+0000", 2021-01-03T12:58:29.422 INFO:teuthology.orchestra.run.smithi133.stdout: "modified": "2021-01-03T12:58:01.829379+0000", 2021-01-03T12:58:29.422 INFO:teuthology.orchestra.run.smithi133.stdout: "last_up_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T12:58:29.423 INFO:teuthology.orchestra.run.smithi133.stdout: "last_in_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T12:58:29.423 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-01-03T12:58:29.423 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_num": 5799936, 2021-01-03T12:58:29.423 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_set": [ 2021-01-03T12:58:29.423 INFO:teuthology.orchestra.run.smithi133.stdout: "pglog_hardlimit", 2021-01-03T12:58:29.424 INFO:teuthology.orchestra.run.smithi133.stdout: "purged_snapdirs", 2021-01-03T12:58:29.424 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_deletes", 2021-01-03T12:58:29.424 INFO:teuthology.orchestra.run.smithi133.stdout: "sortbitwise" 2021-01-03T12:58:29.424 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T12:58:29.425 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_version": 4, 2021-01-03T12:58:29.425 INFO:teuthology.orchestra.run.smithi133.stdout: "full_ratio": 0.94999998807907104, 2021-01-03T12:58:29.425 INFO:teuthology.orchestra.run.smithi133.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-01-03T12:58:29.426 INFO:teuthology.orchestra.run.smithi133.stdout: "nearfull_ratio": 0.85000002384185791, 2021-01-03T12:58:29.426 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_snapshot": "", 2021-01-03T12:58:29.427 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_max": 4, 2021-01-03T12:58:29.427 INFO:teuthology.orchestra.run.smithi133.stdout: "max_osd": 8, 2021-01-03T12:58:29.427 INFO:teuthology.orchestra.run.smithi133.stdout: "require_min_compat_client": "jewel", 2021-01-03T12:58:29.428 INFO:teuthology.orchestra.run.smithi133.stdout: "min_compat_client": "jewel", 2021-01-03T12:58:29.428 INFO:teuthology.orchestra.run.smithi133.stdout: "require_osd_release": "octopus", 2021-01-03T12:58:29.428 INFO:teuthology.orchestra.run.smithi133.stdout: "pools": [ 2021-01-03T12:58:29.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.429 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 1, 2021-01-03T12:58:29.430 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "device_health_metrics", 2021-01-03T12:58:29.430 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:47.102954+0000", 2021-01-03T12:58:29.430 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T12:58:29.431 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T12:58:29.431 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T12:58:29.432 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T12:58:29.432 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T12:58:29.432 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T12:58:29.433 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T12:58:29.433 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T12:58:29.433 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 1, 2021-01-03T12:58:29.434 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 1, 2021-01-03T12:58:29.434 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 1, 2021-01-03T12:58:29.435 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 1, 2021-01-03T12:58:29.435 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 1, 2021-01-03T12:58:29.435 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T12:58:29.436 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T12:58:29.436 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T12:58:29.437 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T12:58:29.437 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T12:58:29.438 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T12:58:29.438 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T12:58:29.438 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.439 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "16", 2021-01-03T12:58:29.439 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T12:58:29.440 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T12:58:29.440 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T12:58:29.441 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T12:58:29.441 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T12:58:29.441 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T12:58:29.442 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T12:58:29.442 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T12:58:29.443 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T12:58:29.443 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T12:58:29.444 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T12:58:29.444 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T12:58:29.444 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T12:58:29.445 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T12:58:29.445 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T12:58:29.446 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T12:58:29.446 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T12:58:29.446 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T12:58:29.447 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T12:58:29.447 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T12:58:29.448 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T12:58:29.448 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T12:58:29.448 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T12:58:29.449 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T12:58:29.449 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T12:58:29.450 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T12:58:29.450 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T12:58:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T12:58:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T12:58:29.452 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T12:58:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T12:58:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T12:58:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T12:58:29.453 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T12:58:29.454 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T12:58:29.454 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T12:58:29.454 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T12:58:29.454 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T12:58:29.455 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 1 2021-01-03T12:58:29.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.455 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T12:58:29.455 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr_devicehealth": {} 2021-01-03T12:58:29.456 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.456 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.456 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.456 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 2, 2021-01-03T12:58:29.456 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "rbd", 2021-01-03T12:58:29.457 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:55.472799+0000", 2021-01-03T12:58:29.457 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T12:58:29.457 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T12:58:29.457 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T12:58:29.458 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T12:58:29.458 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T12:58:29.458 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T12:58:29.459 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T12:58:29.459 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T12:58:29.459 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T12:58:29.460 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T12:58:29.460 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T12:58:29.460 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T12:58:29.460 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T12:58:29.461 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T12:58:29.461 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T12:58:29.461 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T12:58:29.462 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T12:58:29.462 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T12:58:29.462 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T12:58:29.462 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T12:58:29.463 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.463 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "19", 2021-01-03T12:58:29.463 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T12:58:29.463 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T12:58:29.464 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T12:58:29.464 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T12:58:29.464 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T12:58:29.464 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T12:58:29.464 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T12:58:29.465 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T12:58:29.465 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T12:58:29.465 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T12:58:29.465 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T12:58:29.465 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T12:58:29.466 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T12:58:29.466 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T12:58:29.466 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T12:58:29.466 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T12:58:29.467 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T12:58:29.467 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T12:58:29.467 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T12:58:29.467 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T12:58:29.468 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T12:58:29.468 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T12:58:29.468 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T12:58:29.468 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T12:58:29.469 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T12:58:29.469 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T12:58:29.469 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.469 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T12:58:29.469 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T12:58:29.470 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T12:58:29.470 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T12:58:29.470 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T12:58:29.470 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T12:58:29.471 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T12:58:29.471 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T12:58:29.471 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T12:58:29.471 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T12:58:29.472 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T12:58:29.472 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T12:58:29.472 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T12:58:29.472 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd": {} 2021-01-03T12:58:29.472 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.473 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.473 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.473 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 3, 2021-01-03T12:58:29.473 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_metadata", 2021-01-03T12:58:29.474 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:58.934952+0000", 2021-01-03T12:58:29.474 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T12:58:29.474 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T12:58:29.474 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T12:58:29.475 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T12:58:29.475 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T12:58:29.475 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T12:58:29.475 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T12:58:29.475 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T12:58:29.476 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T12:58:29.476 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T12:58:29.476 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T12:58:29.476 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T12:58:29.476 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T12:58:29.477 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T12:58:29.477 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T12:58:29.477 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T12:58:29.477 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T12:58:29.477 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T12:58:29.477 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T12:58:29.478 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T12:58:29.478 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.478 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "22", 2021-01-03T12:58:29.478 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T12:58:29.479 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T12:58:29.479 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T12:58:29.479 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T12:58:29.479 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T12:58:29.479 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T12:58:29.480 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T12:58:29.480 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T12:58:29.480 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T12:58:29.480 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T12:58:29.480 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T12:58:29.481 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T12:58:29.481 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T12:58:29.481 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T12:58:29.481 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T12:58:29.481 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T12:58:29.482 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T12:58:29.482 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T12:58:29.482 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T12:58:29.482 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T12:58:29.482 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T12:58:29.483 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T12:58:29.483 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T12:58:29.483 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T12:58:29.483 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T12:58:29.484 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T12:58:29.484 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.484 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T12:58:29.484 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T12:58:29.485 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T12:58:29.485 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T12:58:29.485 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T12:58:29.485 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T12:58:29.485 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T12:58:29.486 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T12:58:29.486 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T12:58:29.486 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T12:58:29.486 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T12:58:29.487 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T12:58:29.487 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_bias": 4, 2021-01-03T12:58:29.487 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 16, 2021-01-03T12:58:29.487 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_priority": 5 2021-01-03T12:58:29.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.488 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T12:58:29.488 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T12:58:29.488 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": "cephfs" 2021-01-03T12:58:29.488 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.489 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.489 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.489 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.489 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 4, 2021-01-03T12:58:29.489 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_data", 2021-01-03T12:58:29.490 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:59.830134+0000", 2021-01-03T12:58:29.490 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T12:58:29.490 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T12:58:29.490 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T12:58:29.490 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T12:58:29.491 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T12:58:29.491 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T12:58:29.491 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T12:58:29.491 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T12:58:29.491 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T12:58:29.492 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T12:58:29.492 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T12:58:29.492 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T12:58:29.492 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T12:58:29.492 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T12:58:29.493 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T12:58:29.493 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T12:58:29.493 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T12:58:29.493 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T12:58:29.493 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T12:58:29.494 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T12:58:29.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.494 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "23", 2021-01-03T12:58:29.494 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T12:58:29.494 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T12:58:29.495 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T12:58:29.495 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T12:58:29.495 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T12:58:29.495 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T12:58:29.495 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T12:58:29.496 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T12:58:29.496 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T12:58:29.496 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T12:58:29.496 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T12:58:29.496 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T12:58:29.497 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T12:58:29.497 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T12:58:29.497 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T12:58:29.497 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T12:58:29.497 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T12:58:29.498 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T12:58:29.498 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T12:58:29.498 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T12:58:29.498 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T12:58:29.498 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T12:58:29.499 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T12:58:29.499 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T12:58:29.499 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T12:58:29.499 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T12:58:29.499 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.500 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T12:58:29.500 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T12:58:29.500 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T12:58:29.500 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T12:58:29.500 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T12:58:29.501 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T12:58:29.501 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T12:58:29.501 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T12:58:29.501 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T12:58:29.501 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T12:58:29.502 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T12:58:29.502 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T12:58:29.502 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T12:58:29.502 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T12:58:29.502 INFO:teuthology.orchestra.run.smithi133.stdout: "data": "cephfs" 2021-01-03T12:58:29.503 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.503 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.503 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.503 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T12:58:29.503 INFO:teuthology.orchestra.run.smithi133.stdout: "osds": [ 2021-01-03T12:58:29.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.504 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T12:58:29.504 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a", 2021-01-03T12:58:29.504 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T12:58:29.504 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T12:58:29.505 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T12:58:29.505 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T12:58:29.505 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T12:58:29.505 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T12:58:29.505 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T12:58:29.506 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 21, 2021-01-03T12:58:29.506 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T12:58:29.506 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T12:58:29.506 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T12:58:29.506 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.507 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.507 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.507 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6810", 2021-01-03T12:58:29.507 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T12:58:29.507 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.508 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.508 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6811", 2021-01-03T12:58:29.508 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T12:58:29.508 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.509 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.509 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.509 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T12:58:29.509 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.509 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.510 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.510 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6812", 2021-01-03T12:58:29.510 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T12:58:29.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.511 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.511 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6813", 2021-01-03T12:58:29.511 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T12:58:29.511 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.511 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.512 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T12:58:29.512 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.512 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.513 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6816", 2021-01-03T12:58:29.513 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T12:58:29.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.513 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.513 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.514 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6817", 2021-01-03T12:58:29.514 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T12:58:29.514 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.514 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.514 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.515 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T12:58:29.515 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.515 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.515 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.515 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6814", 2021-01-03T12:58:29.516 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T12:58:29.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.516 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.516 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.516 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6815", 2021-01-03T12:58:29.517 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T12:58:29.517 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.517 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.517 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6811/12124", 2021-01-03T12:58:29.518 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6813/12124", 2021-01-03T12:58:29.518 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6817/12124", 2021-01-03T12:58:29.518 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6815/12124", 2021-01-03T12:58:29.518 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T12:58:29.518 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T12:58:29.519 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T12:58:29.519 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.519 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.519 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.519 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T12:58:29.520 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9170d1de-58d4-4dfd-b9de-80dc15ca9e60", 2021-01-03T12:58:29.520 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T12:58:29.520 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T12:58:29.520 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T12:58:29.520 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T12:58:29.521 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T12:58:29.521 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T12:58:29.521 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T12:58:29.521 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 21, 2021-01-03T12:58:29.521 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T12:58:29.522 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T12:58:29.522 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T12:58:29.522 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.523 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.523 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6818", 2021-01-03T12:58:29.523 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T12:58:29.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.523 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.524 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.524 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6819", 2021-01-03T12:58:29.524 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T12:58:29.524 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.524 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.525 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T12:58:29.525 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.525 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.526 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6820", 2021-01-03T12:58:29.526 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T12:58:29.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.526 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.527 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.527 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6821", 2021-01-03T12:58:29.527 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T12:58:29.527 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.527 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.528 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T12:58:29.528 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.528 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.528 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6824", 2021-01-03T12:58:29.529 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T12:58:29.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.529 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.530 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6825", 2021-01-03T12:58:29.530 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T12:58:29.530 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.530 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.531 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.531 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T12:58:29.531 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.531 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.531 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.532 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6822", 2021-01-03T12:58:29.532 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T12:58:29.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.532 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.533 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.533 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6823", 2021-01-03T12:58:29.533 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T12:58:29.533 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.533 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.534 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6819/12123", 2021-01-03T12:58:29.534 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6821/12123", 2021-01-03T12:58:29.534 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6825/12123", 2021-01-03T12:58:29.534 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6823/12123", 2021-01-03T12:58:29.535 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T12:58:29.535 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T12:58:29.535 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T12:58:29.535 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.535 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.535 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.536 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T12:58:29.536 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9fc5adf9-3537-4953-9c65-0c67ecb53776", 2021-01-03T12:58:29.536 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T12:58:29.536 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T12:58:29.536 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T12:58:29.537 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T12:58:29.537 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T12:58:29.537 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T12:58:29.537 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T12:58:29.537 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 17, 2021-01-03T12:58:29.538 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T12:58:29.538 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T12:58:29.538 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T12:58:29.538 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.539 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.539 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6802", 2021-01-03T12:58:29.539 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T12:58:29.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.540 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.540 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6803", 2021-01-03T12:58:29.540 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T12:58:29.540 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.540 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.541 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.541 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T12:58:29.541 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.541 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.541 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.542 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6804", 2021-01-03T12:58:29.542 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T12:58:29.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.542 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.543 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6805", 2021-01-03T12:58:29.543 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T12:58:29.543 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.543 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.544 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T12:58:29.544 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.544 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.544 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.544 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6808", 2021-01-03T12:58:29.545 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T12:58:29.545 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.545 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.545 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6809", 2021-01-03T12:58:29.546 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T12:58:29.546 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.546 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.546 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T12:58:29.547 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.547 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.547 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.547 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6806", 2021-01-03T12:58:29.547 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T12:58:29.548 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.548 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.548 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.548 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6807", 2021-01-03T12:58:29.548 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T12:58:29.549 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.549 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.549 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6803/12122", 2021-01-03T12:58:29.549 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6805/12122", 2021-01-03T12:58:29.550 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6809/12122", 2021-01-03T12:58:29.550 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6807/12122", 2021-01-03T12:58:29.550 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T12:58:29.550 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T12:58:29.550 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T12:58:29.551 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.551 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.551 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.551 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T12:58:29.551 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "0ad45ce5-6635-4089-bbf8-c966d0fe5338", 2021-01-03T12:58:29.552 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T12:58:29.552 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T12:58:29.552 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T12:58:29.552 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T12:58:29.552 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T12:58:29.553 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T12:58:29.553 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T12:58:29.553 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 21, 2021-01-03T12:58:29.553 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T12:58:29.553 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T12:58:29.553 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T12:58:29.554 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.554 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.554 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.554 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6826", 2021-01-03T12:58:29.554 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T12:58:29.555 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.555 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.555 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6827", 2021-01-03T12:58:29.555 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T12:58:29.556 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.556 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.556 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T12:58:29.556 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.557 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.557 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.557 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6828", 2021-01-03T12:58:29.557 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T12:58:29.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.558 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.558 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6829", 2021-01-03T12:58:29.558 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T12:58:29.558 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.559 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.559 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T12:58:29.559 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.560 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.560 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6832", 2021-01-03T12:58:29.560 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T12:58:29.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.561 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.561 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6833", 2021-01-03T12:58:29.561 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T12:58:29.561 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.561 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.562 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.562 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T12:58:29.562 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.562 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.562 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.563 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6830", 2021-01-03T12:58:29.563 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T12:58:29.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.563 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.563 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.564 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6831", 2021-01-03T12:58:29.564 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T12:58:29.564 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.564 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.565 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6827/12136", 2021-01-03T12:58:29.565 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6829/12136", 2021-01-03T12:58:29.565 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6833/12136", 2021-01-03T12:58:29.565 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6831/12136", 2021-01-03T12:58:29.565 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T12:58:29.566 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T12:58:29.566 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T12:58:29.566 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.566 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.567 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T12:58:29.567 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "86b8d6d5-271b-4a70-ae7b-a227afb38d7c", 2021-01-03T12:58:29.567 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T12:58:29.567 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T12:58:29.568 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T12:58:29.568 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T12:58:29.568 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T12:58:29.568 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T12:58:29.568 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T12:58:29.569 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 21, 2021-01-03T12:58:29.569 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T12:58:29.569 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T12:58:29.569 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T12:58:29.569 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.570 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.570 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6808", 2021-01-03T12:58:29.570 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T12:58:29.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.571 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.571 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6809", 2021-01-03T12:58:29.571 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T12:58:29.571 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.572 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.572 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.572 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T12:58:29.572 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.572 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.573 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.573 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6810", 2021-01-03T12:58:29.573 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T12:58:29.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.574 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.574 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6811", 2021-01-03T12:58:29.574 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T12:58:29.574 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.574 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.575 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T12:58:29.575 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.575 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.575 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.576 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6814", 2021-01-03T12:58:29.576 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T12:58:29.576 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.576 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.577 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6815", 2021-01-03T12:58:29.577 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T12:58:29.577 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.577 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.578 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T12:58:29.578 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.578 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.578 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.578 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6812", 2021-01-03T12:58:29.579 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T12:58:29.579 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.579 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.579 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.579 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6813", 2021-01-03T12:58:29.580 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T12:58:29.580 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.580 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.580 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6809/12672", 2021-01-03T12:58:29.581 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6811/12672", 2021-01-03T12:58:29.581 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6815/12672", 2021-01-03T12:58:29.581 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6813/12672", 2021-01-03T12:58:29.581 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T12:58:29.581 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T12:58:29.582 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T12:58:29.582 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.582 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.582 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T12:58:29.583 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "173feb9d-f596-4030-85d8-1f4b46a9ffe5", 2021-01-03T12:58:29.583 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T12:58:29.583 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T12:58:29.583 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T12:58:29.583 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T12:58:29.584 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T12:58:29.584 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T12:58:29.584 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T12:58:29.584 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 20, 2021-01-03T12:58:29.584 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T12:58:29.585 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T12:58:29.585 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T12:58:29.585 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.585 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.585 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.586 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6817", 2021-01-03T12:58:29.586 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T12:58:29.586 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.586 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.587 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6819", 2021-01-03T12:58:29.587 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T12:58:29.587 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.587 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.588 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T12:58:29.588 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.588 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.588 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6820", 2021-01-03T12:58:29.589 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T12:58:29.589 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.589 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.589 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6822", 2021-01-03T12:58:29.590 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T12:58:29.590 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.590 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.590 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T12:58:29.591 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.591 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.591 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6828", 2021-01-03T12:58:29.591 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T12:58:29.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.592 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.592 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6830", 2021-01-03T12:58:29.592 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T12:58:29.593 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.593 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.593 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T12:58:29.594 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.594 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.594 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.594 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6824", 2021-01-03T12:58:29.594 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T12:58:29.595 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.595 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.595 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.595 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6826", 2021-01-03T12:58:29.595 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T12:58:29.595 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.596 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.596 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6819/12673", 2021-01-03T12:58:29.596 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6822/12673", 2021-01-03T12:58:29.596 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6830/12673", 2021-01-03T12:58:29.597 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6826/12673", 2021-01-03T12:58:29.597 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T12:58:29.597 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T12:58:29.597 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T12:58:29.598 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.598 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.598 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T12:58:29.598 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "b487980e-ad4d-43c1-91fa-4845f7af3d4d", 2021-01-03T12:58:29.599 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T12:58:29.599 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T12:58:29.599 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T12:58:29.599 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T12:58:29.599 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T12:58:29.600 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T12:58:29.600 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T12:58:29.600 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 21, 2021-01-03T12:58:29.600 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T12:58:29.600 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T12:58:29.601 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T12:58:29.601 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.601 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.601 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.601 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6800", 2021-01-03T12:58:29.602 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T12:58:29.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.602 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.602 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6801", 2021-01-03T12:58:29.603 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T12:58:29.603 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.603 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.603 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T12:58:29.604 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.604 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.604 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6802", 2021-01-03T12:58:29.604 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T12:58:29.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.605 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.605 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6803", 2021-01-03T12:58:29.605 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T12:58:29.606 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.606 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.606 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.606 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T12:58:29.606 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.607 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.607 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6806", 2021-01-03T12:58:29.607 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T12:58:29.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.608 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.608 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6807", 2021-01-03T12:58:29.608 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T12:58:29.608 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.609 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.609 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T12:58:29.609 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.610 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.610 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6804", 2021-01-03T12:58:29.610 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T12:58:29.610 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.610 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.611 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.611 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6805", 2021-01-03T12:58:29.611 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T12:58:29.611 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.611 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.612 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6801/12662", 2021-01-03T12:58:29.612 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6803/12662", 2021-01-03T12:58:29.612 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6807/12662", 2021-01-03T12:58:29.612 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6805/12662", 2021-01-03T12:58:29.612 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T12:58:29.613 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T12:58:29.613 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T12:58:29.613 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.613 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.614 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T12:58:29.614 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "38ea839a-451f-4c09-a545-4514e049b178", 2021-01-03T12:58:29.614 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T12:58:29.614 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T12:58:29.614 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T12:58:29.615 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T12:58:29.615 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T12:58:29.615 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T12:58:29.615 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T12:58:29.615 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 17, 2021-01-03T12:58:29.616 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T12:58:29.616 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T12:58:29.616 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T12:58:29.616 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.617 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.617 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6816", 2021-01-03T12:58:29.617 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T12:58:29.617 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.617 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.618 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.618 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6818", 2021-01-03T12:58:29.618 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T12:58:29.618 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.618 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.619 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.619 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T12:58:29.619 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.619 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.619 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.620 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6821", 2021-01-03T12:58:29.620 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T12:58:29.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.620 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.621 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6823", 2021-01-03T12:58:29.621 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T12:58:29.621 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.621 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.621 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.622 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T12:58:29.622 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.622 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.622 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6829", 2021-01-03T12:58:29.623 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T12:58:29.623 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.623 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.623 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.623 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6831", 2021-01-03T12:58:29.624 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T12:58:29.624 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.624 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.624 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T12:58:29.624 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:58:29.625 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.625 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:58:29.625 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6825", 2021-01-03T12:58:29.625 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T12:58:29.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.626 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:58:29.626 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6827", 2021-01-03T12:58:29.626 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T12:58:29.627 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.627 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.627 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.627 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6818/12674", 2021-01-03T12:58:29.627 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6823/12674", 2021-01-03T12:58:29.627 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6831/12674", 2021-01-03T12:58:29.628 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6827/12674", 2021-01-03T12:58:29.628 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T12:58:29.628 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T12:58:29.628 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T12:58:29.628 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:29.629 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.629 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T12:58:29.629 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_xinfo": [ 2021-01-03T12:58:29.629 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.629 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T12:58:29.630 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T12:58:29.630 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T12:58:29.630 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T12:58:29.630 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T12:58:29.630 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T12:58:29.631 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.659942+0000", 2021-01-03T12:58:29.631 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T12:58:29.631 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.631 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.631 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T12:58:29.632 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T12:58:29.632 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T12:58:29.632 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T12:58:29.632 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T12:58:29.632 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T12:58:29.633 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.750326+0000", 2021-01-03T12:58:29.633 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T12:58:29.633 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.633 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.633 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T12:58:29.634 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T12:58:29.634 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T12:58:29.634 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T12:58:29.634 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T12:58:29.634 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T12:58:29.635 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.587742+0000", 2021-01-03T12:58:29.635 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T12:58:29.635 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.635 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.635 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T12:58:29.636 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T12:58:29.636 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T12:58:29.636 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T12:58:29.636 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T12:58:29.636 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T12:58:29.637 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.855073+0000", 2021-01-03T12:58:29.637 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T12:58:29.637 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.637 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.637 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T12:58:29.638 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T12:58:29.638 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T12:58:29.638 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T12:58:29.638 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T12:58:29.638 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T12:58:29.639 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.565030+0000", 2021-01-03T12:58:29.639 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T12:58:29.639 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.639 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.639 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T12:58:29.640 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T12:58:29.640 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T12:58:29.640 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T12:58:29.640 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T12:58:29.640 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T12:58:29.641 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.786206+0000", 2021-01-03T12:58:29.641 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T12:58:29.641 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.641 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.641 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T12:58:29.641 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T12:58:29.642 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T12:58:29.642 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T12:58:29.642 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T12:58:29.642 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T12:58:29.642 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.576185+0000", 2021-01-03T12:58:29.643 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T12:58:29.643 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:29.643 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T12:58:29.643 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T12:58:29.644 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T12:58:29.644 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T12:58:29.644 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T12:58:29.644 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T12:58:29.644 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.823786+0000", 2021-01-03T12:58:29.645 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T12:58:29.645 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.645 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T12:58:29.645 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap": [], 2021-01-03T12:58:29.645 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap_items": [], 2021-01-03T12:58:29.646 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_temp": [], 2021-01-03T12:58:29.646 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_temp": [], 2021-01-03T12:58:29.646 INFO:teuthology.orchestra.run.smithi133.stdout: "blacklist": {}, 2021-01-03T12:58:29.646 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profiles": { 2021-01-03T12:58:29.646 INFO:teuthology.orchestra.run.smithi133.stdout: "default": { 2021-01-03T12:58:29.647 INFO:teuthology.orchestra.run.smithi133.stdout: "crush-failure-domain": "osd", 2021-01-03T12:58:29.647 INFO:teuthology.orchestra.run.smithi133.stdout: "k": "2", 2021-01-03T12:58:29.647 INFO:teuthology.orchestra.run.smithi133.stdout: "m": "1", 2021-01-03T12:58:29.647 INFO:teuthology.orchestra.run.smithi133.stdout: "plugin": "jerasure", 2021-01-03T12:58:29.647 INFO:teuthology.orchestra.run.smithi133.stdout: "ruleset-failure-domain": "osd", 2021-01-03T12:58:29.648 INFO:teuthology.orchestra.run.smithi133.stdout: "technique": "reed_sol_van" 2021-01-03T12:58:29.648 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:29.648 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:29.648 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps_queue": [], 2021-01-03T12:58:29.648 INFO:teuthology.orchestra.run.smithi133.stdout: "new_removed_snaps": [], 2021-01-03T12:58:29.649 INFO:teuthology.orchestra.run.smithi133.stdout: "new_purged_snaps": [], 2021-01-03T12:58:29.649 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_node_flags": {}, 2021-01-03T12:58:29.649 INFO:teuthology.orchestra.run.smithi133.stdout: "device_class_flags": {} 2021-01-03T12:58:29.649 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T12:58:29.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.423+0000 7fb9eef9b700 1 -- 172.21.15.133:0/1104026795 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb9c8055330 msgr2=0x7fb9c80577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:29.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.423+0000 7fb9eef9b700 1 --2- 172.21.15.133:0/1104026795 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb9c8055330 0x7fb9c80577f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fb9e4008000 tx=0x7fb9e4009040).stop 2021-01-03T12:58:29.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.423+0000 7fb9eef9b700 1 -- 172.21.15.133:0/1104026795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e80b5ae0 msgr2=0x7fb9e8151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.423+0000 7fb9eef9b700 1 --2- 172.21.15.133:0/1104026795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e80b5ae0 0x7fb9e8151a90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fb9e81460f0 tx=0x7fb9e00091a0).stop 2021-01-03T12:58:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.423+0000 7fb9eef9b700 1 -- 172.21.15.133:0/1104026795 shutdown_connections 2021-01-03T12:58:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.423+0000 7fb9eef9b700 1 --2- 172.21.15.133:0/1104026795 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb9c8055330 0x7fb9c80577f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.423+0000 7fb9eef9b700 1 --2- 172.21.15.133:0/1104026795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e8099ff0 0x7fb9e8141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.423+0000 7fb9eef9b700 1 --2- 172.21.15.133:0/1104026795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e80b5ae0 0x7fb9e8151a90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.423+0000 7fb9eef9b700 1 --2- 172.21.15.133:0/1104026795 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9e80b5330 0x7fb9e81468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.423+0000 7fb9eef9b700 1 -- 172.21.15.133:0/1104026795 >> 172.21.15.133:0/1104026795 conn(0x7fb9e805bdf0 msgr2=0x7fb9e80b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:29.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.423+0000 7fb9eef9b700 1 -- 172.21.15.133:0/1104026795 shutdown_connections 2021-01-03T12:58:29.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.423+0000 7fb9eef9b700 1 -- 172.21.15.133:0/1104026795 wait complete. 2021-01-03T12:58:29.654 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T12:58:29.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.779+0000 7fab3759e700 1 Processor -- start 2021-01-03T12:58:29.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.779+0000 7fab3759e700 1 -- start start 2021-01-03T12:58:29.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.779+0000 7fab3759e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fab380b72b0 0x7fab38144020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:29.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.779+0000 7fab3759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fab380b7eb0 0x7fab3813e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:29.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.779+0000 7fab3759e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab3809c0b0 con 0x7fab380b2e00 2021-01-03T12:58:29.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.779+0000 7fab3759e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab380ae480 con 0x7fab380b72b0 2021-01-03T12:58:29.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.779+0000 7fab3759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab3809c2e0 con 0x7fab380b7eb0 2021-01-03T12:58:29.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.779+0000 7fab36d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fab380b7eb0 0x7fab3813e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:29.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.779+0000 7fab36d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fab380b7eb0 0x7fab3813e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60872/0 (socket says 172.21.15.133:60872) 2021-01-03T12:58:29.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.779+0000 7fab36d9d700 1 -- 172.21.15.133:0/147134921 learned_addr learned my addr 172.21.15.133:0/147134921 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:29.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.779+0000 7fab3659c700 1 --2- 172.21.15.133:0/147134921 >> v2:172.21.15.16:3300/0 conn(0x7fab380b72b0 0x7fab38144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:29.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.779+0000 7fab36d9d700 1 -- 172.21.15.133:0/147134921 >> v2:172.21.15.16:3300/0 conn(0x7fab380b72b0 msgr2=0x7fab38144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:29.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.779+0000 7fab36d9d700 1 --2- 172.21.15.133:0/147134921 >> v2:172.21.15.16:3300/0 conn(0x7fab380b72b0 0x7fab38144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.779+0000 7fab36d9d700 1 -- 172.21.15.133:0/147134921 >> v1:172.21.15.16:6789/0 conn(0x7fab380b2e00 legacy=0x7fab380ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:29.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.779+0000 7fab36d9d700 1 -- 172.21.15.133:0/147134921 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3809c580 con 0x7fab380b7eb0 2021-01-03T12:58:29.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.779+0000 7fab36d9d700 1 --2- 172.21.15.133:0/147134921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab380b7eb0 0x7fab3813e040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fab300032b0 tx=0x7fab30009270).ready entity=mon.1 client_cookie=4c2006c464b9d6fc server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:29.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.783+0000 7fab35d9b700 1 -- 172.21.15.133:0/147134921 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab30009e60 con 0x7fab380b7eb0 2021-01-03T12:58:29.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.783+0000 7fab35d9b700 1 -- 172.21.15.133:0/147134921 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3000bc00 con 0x7fab380b7eb0 2021-01-03T12:58:29.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.783+0000 7fab35d9b700 1 -- 172.21.15.133:0/147134921 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab3000bd70 con 0x7fab380b7eb0 2021-01-03T12:58:29.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.783+0000 7fab3759e700 1 -- 172.21.15.133:0/147134921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab380b7eb0 msgr2=0x7fab3813e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:29.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.783+0000 7fab3759e700 1 --2- 172.21.15.133:0/147134921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab380b7eb0 0x7fab3813e040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fab300032b0 tx=0x7fab30009270).stop 2021-01-03T12:58:29.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.783+0000 7fab3759e700 1 -- 172.21.15.133:0/147134921 shutdown_connections 2021-01-03T12:58:29.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.783+0000 7fab3759e700 1 --2- 172.21.15.133:0/147134921 >> v2:172.21.15.16:3300/0 conn(0x7fab380b72b0 0x7fab38144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.783+0000 7fab3759e700 1 --2- 172.21.15.133:0/147134921 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab380b7eb0 0x7fab3813e040 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.783+0000 7fab3759e700 1 -- 172.21.15.133:0/147134921 >> 172.21.15.133:0/147134921 conn(0x7fab3805bdf0 msgr2=0x7fab3805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:29.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.783+0000 7fab3759e700 1 -- 172.21.15.133:0/147134921 shutdown_connections 2021-01-03T12:58:29.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.783+0000 7fab3759e700 1 -- 172.21.15.133:0/147134921 wait complete. 2021-01-03T12:58:29.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.783+0000 7fab3759e700 1 Processor -- start 2021-01-03T12:58:29.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.783+0000 7fab3759e700 1 -- start start 2021-01-03T12:58:29.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab3759e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab380b2e00 0x7fab38140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:29.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab3759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab380b72b0 0x7fab381414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:29.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab3759e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab38143e40 0x7fab3813f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:29.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab3759e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab38144350 con 0x7fab380b2e00 2021-01-03T12:58:29.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab3759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab38141ef0 con 0x7fab380b72b0 2021-01-03T12:58:29.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab3759e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab38144580 con 0x7fab38143e40 2021-01-03T12:58:29.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab2ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab380b72b0 0x7fab381414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:29.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab2ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab380b72b0 0x7fab381414b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60874/0 (socket says 172.21.15.133:60874) 2021-01-03T12:58:29.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab2ffff700 1 -- 172.21.15.133:0/1358799747 learned_addr learned my addr 172.21.15.133:0/1358799747 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:29.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab36d9d700 1 --2- 172.21.15.133:0/1358799747 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab38143e40 0x7fab3813f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:29.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab3659c700 1 --2- 172.21.15.133:0/1358799747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab380b2e00 0x7fab38140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:29.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab2ffff700 1 -- 172.21.15.133:0/1358799747 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab38143e40 msgr2=0x7fab3813f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:29.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab2ffff700 1 --2- 172.21.15.133:0/1358799747 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab38143e40 0x7fab3813f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab2ffff700 1 -- 172.21.15.133:0/1358799747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab380b2e00 msgr2=0x7fab38140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:29.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab2ffff700 1 --2- 172.21.15.133:0/1358799747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab380b2e00 0x7fab38140fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab2ffff700 1 -- 172.21.15.133:0/1358799747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab38142850 con 0x7fab380b72b0 2021-01-03T12:58:29.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab2ffff700 1 --2- 172.21.15.133:0/1358799747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab380b72b0 0x7fab381414b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fab38063f40 tx=0x7fab20007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:29.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab2f7fe700 1 -- 172.21.15.133:0/1358799747 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab20007240 con 0x7fab380b72b0 2021-01-03T12:58:29.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab2f7fe700 1 -- 172.21.15.133:0/1358799747 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab200073a0 con 0x7fab380b72b0 2021-01-03T12:58:29.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab3759e700 1 -- 172.21.15.133:0/1358799747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab380b2ab0 con 0x7fab380b72b0 2021-01-03T12:58:29.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab2f7fe700 1 -- 172.21.15.133:0/1358799747 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab200064e0 con 0x7fab380b72b0 2021-01-03T12:58:29.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab3759e700 1 -- 172.21.15.133:0/1358799747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab38142320 con 0x7fab380b72b0 2021-01-03T12:58:29.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.787+0000 7fab3759e700 1 -- 172.21.15.133:0/1358799747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab38057300 con 0x7fab380b72b0 2021-01-03T12:58:29.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.791+0000 7fab2f7fe700 1 -- 172.21.15.133:0/1358799747 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fab20010070 con 0x7fab380b72b0 2021-01-03T12:58:29.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.791+0000 7fab2f7fe700 1 --2- 172.21.15.133:0/1358799747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fab100554e0 0x7fab100579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:29.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.791+0000 7fab2f7fe700 1 -- 172.21.15.133:0/1358799747 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fab2006d650 con 0x7fab380b72b0 2021-01-03T12:58:29.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.791+0000 7fab3659c700 1 --2- 172.21.15.133:0/1358799747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fab100554e0 0x7fab100579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:29.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.791+0000 7fab3659c700 1 --2- 172.21.15.133:0/1358799747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fab100554e0 0x7fab100579a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fab2800b000 tx=0x7fab28006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:29.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.795+0000 7fab2f7fe700 1 -- 172.21.15.133:0/1358799747 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fab200437e0 con 0x7fab380b72b0 2021-01-03T12:58:29.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.983+0000 7fab3759e700 1 -- 172.21.15.133:0/1358799747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab38142030 con 0x7fab380b72b0 2021-01-03T12:58:29.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.983+0000 7fab2f7fe700 1 -- 172.21.15.133:0/1358799747 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2489 (secure 0 0 0) 0x7fab20018030 con 0x7fab380b72b0 2021-01-03T12:58:29.984 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:29.985 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2255364706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2255364706},{"type":"v1","addr":"172.21.15.16:6833","nonce":2255364706}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/537740959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":537740959},{"type":"v1","addr":"172.21.15.133:6835","nonce":537740959}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T12:58:00.825803+0000","modified":"2021-01-03T12:58:01.829281+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.133:6837/3158570988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3158570988},{"type":"v1","addr":"172.21.15.133:6837","nonce":3158570988}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-03T12:58:29.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.983+0000 7fab3759e700 1 -- 172.21.15.133:0/1358799747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fab100554e0 msgr2=0x7fab100579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:29.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.983+0000 7fab3759e700 1 --2- 172.21.15.133:0/1358799747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fab100554e0 0x7fab100579a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fab2800b000 tx=0x7fab28006dc0).stop 2021-01-03T12:58:29.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.983+0000 7fab3759e700 1 -- 172.21.15.133:0/1358799747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab380b72b0 msgr2=0x7fab381414b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:29.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.983+0000 7fab3759e700 1 --2- 172.21.15.133:0/1358799747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab380b72b0 0x7fab381414b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fab38063f40 tx=0x7fab20007be0).stop 2021-01-03T12:58:29.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.983+0000 7fab3759e700 1 -- 172.21.15.133:0/1358799747 shutdown_connections 2021-01-03T12:58:29.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.983+0000 7fab3759e700 1 --2- 172.21.15.133:0/1358799747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fab100554e0 0x7fab100579a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.983+0000 7fab3759e700 1 --2- 172.21.15.133:0/1358799747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab380b2e00 0x7fab38140fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.983+0000 7fab3759e700 1 --2- 172.21.15.133:0/1358799747 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab38143e40 0x7fab3813f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.983+0000 7fab3759e700 1 --2- 172.21.15.133:0/1358799747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab380b72b0 0x7fab381414b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:29.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.983+0000 7fab3759e700 1 -- 172.21.15.133:0/1358799747 >> 172.21.15.133:0/1358799747 conn(0x7fab3805bdf0 msgr2=0x7fab380b61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:29.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.983+0000 7fab3759e700 1 -- 172.21.15.133:0/1358799747 shutdown_connections 2021-01-03T12:58:29.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:29.983+0000 7fab3759e700 1 -- 172.21.15.133:0/1358799747 wait complete. 2021-01-03T12:58:29.989 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 5 2021-01-03T12:58:29.997 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-01-03T12:58:30.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.111+0000 7f02aa702700 1 Processor -- start 2021-01-03T12:58:30.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.111+0000 7f02aa702700 1 -- start start 2021-01-03T12:58:30.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02aa702700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f02a40b02b0 0x7f02a40668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:30.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02aa702700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a405c510 con 0x7f02a40622f0 2021-01-03T12:58:30.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02aa702700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a40b15a0 con 0x7f02a405c130 2021-01-03T12:58:30.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02aa702700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a41473d0 con 0x7f02a40b02b0 2021-01-03T12:58:30.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02a9700700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f02a405c130 0x7f02a40b1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53682/0 (socket says 172.21.15.133:53682) 2021-01-03T12:58:30.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02a9700700 1 -- 172.21.15.133:0/137209694 learned_addr learned my addr 172.21.15.133:0/137209694 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:30.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02a8eff700 1 --2- 172.21.15.133:0/137209694 >> v2:172.21.15.16:3300/0 conn(0x7f02a40b02b0 0x7f02a40668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:30.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 -- 172.21.15.133:0/137209694 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393322755 0 0) 0x7f02a40b15a0 con 0x7f02a405c130 2021-01-03T12:58:30.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 -- 172.21.15.133:0/137209694 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0288003230 con 0x7f02a405c130 2021-01-03T12:58:30.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 -- 172.21.15.133:0/137209694 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2099022108 0 0) 0x7f0288003230 con 0x7f02a405c130 2021-01-03T12:58:30.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 -- 172.21.15.133:0/137209694 >> v2:172.21.15.16:3300/0 conn(0x7f02a40b02b0 msgr2=0x7f02a40668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:30.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 --2- 172.21.15.133:0/137209694 >> v2:172.21.15.16:3300/0 conn(0x7f02a40b02b0 0x7f02a40668a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:30.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 -- 172.21.15.133:0/137209694 >> v1:172.21.15.16:6789/0 conn(0x7f02a40622f0 legacy=0x7f02a4066d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:30.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 -- 172.21.15.133:0/137209694 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a4061920 con 0x7f02a405c130 2021-01-03T12:58:30.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 -- 172.21.15.133:0/137209694 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f0294001730 con 0x7f02a405c130 2021-01-03T12:58:30.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 -- 172.21.15.133:0/137209694 >> v1:172.21.15.133:6789/0 conn(0x7f02a405c130 legacy=0x7f02a40b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:30.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 --2- 172.21.15.133:0/137209694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0288003720 0x7f0288003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:30.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 --2- 172.21.15.133:0/137209694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02880044d0 0x7f0288004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:30.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 --2- 172.21.15.133:0/137209694 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0288004e40 0x7f028800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:30.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 -- 172.21.15.133:0/137209694 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a41473d0 con 0x7f02880044d0 2021-01-03T12:58:30.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 -- 172.21.15.133:0/137209694 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0288004250 con 0x7f0288003720 2021-01-03T12:58:30.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 -- 172.21.15.133:0/137209694 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028800bc10 con 0x7f0288004e40 2021-01-03T12:58:30.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02a8eff700 1 --2- 172.21.15.133:0/137209694 >> v2:172.21.15.16:3300/0 conn(0x7f02a40b02b0 0x7f02a40668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:30.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02a9700700 1 --2- 172.21.15.133:0/137209694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0288003720 0x7f0288003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:30.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02a8eff700 1 --2- 172.21.15.133:0/137209694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02880044d0 0x7f0288004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:30.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02a9f01700 1 --2- 172.21.15.133:0/137209694 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0288004e40 0x7f028800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:30.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02a9700700 1 -- 172.21.15.133:0/137209694 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0288004e40 msgr2=0x7f028800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:30.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02a9700700 1 --2- 172.21.15.133:0/137209694 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0288004e40 0x7f028800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:30.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02a9700700 1 -- 172.21.15.133:0/137209694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02880044d0 msgr2=0x7f0288004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:30.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02a9700700 1 --2- 172.21.15.133:0/137209694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02880044d0 0x7f0288004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:30.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02a9f01700 1 -- 172.21.15.133:0/137209694 reap_dead start 2021-01-03T12:58:30.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02a9700700 1 -- 172.21.15.133:0/137209694 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0288003230 con 0x7f0288003720 2021-01-03T12:58:30.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02a8eff700 1 --2- 172.21.15.133:0/137209694 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02880044d0 0x7f0288004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:30.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02a9700700 1 --2- 172.21.15.133:0/137209694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0288003720 0x7f0288003b40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f0294001440 tx=0x7f0294007770).ready entity=mon.1 client_cookie=43d4722651d3bd28 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:30.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 -- 172.21.15.133:0/137209694 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02940070d0 con 0x7f0288003720 2021-01-03T12:58:30.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 -- 172.21.15.133:0/137209694 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0294007230 con 0x7f0288003720 2021-01-03T12:58:30.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02aa702700 1 -- 172.21.15.133:0/137209694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0288003720 msgr2=0x7f0288003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:30.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f029bfff700 1 -- 172.21.15.133:0/137209694 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02940045b0 con 0x7f0288003720 2021-01-03T12:58:30.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02aa702700 1 --2- 172.21.15.133:0/137209694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0288003720 0x7f0288003b40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f0294001440 tx=0x7f0294007770).stop 2021-01-03T12:58:30.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02aa702700 1 -- 172.21.15.133:0/137209694 shutdown_connections 2021-01-03T12:58:30.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02aa702700 1 --2- 172.21.15.133:0/137209694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0288003720 0x7f0288003b40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:30.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02aa702700 1 -- 172.21.15.133:0/137209694 >> 172.21.15.133:0/137209694 conn(0x7f02a40b6110 msgr2=0x7f02a40b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:30.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02aa702700 1 -- 172.21.15.133:0/137209694 shutdown_connections 2021-01-03T12:58:30.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.115+0000 7f02aa702700 1 -- 172.21.15.133:0/137209694 wait complete. 2021-01-03T12:58:30.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02aa702700 1 Processor -- start 2021-01-03T12:58:30.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02aa702700 1 -- start start 2021-01-03T12:58:30.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02aa702700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0288003720 0x7f02a40a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:30.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02aa702700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02a40a5f80 0x7f02a40a3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:30.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02aa702700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02a40a2f10 0x7f02a40a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:30.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02aa702700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40a3df0 con 0x7f02a40a5f80 2021-01-03T12:58:30.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02aa702700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a4152a70 con 0x7f02a40a2f10 2021-01-03T12:58:30.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02aa702700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40662e0 con 0x7f0288003720 2021-01-03T12:58:30.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02a9f01700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02a40a2f10 0x7f02a40a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:30.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02a9f01700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02a40a2f10 0x7f02a40a3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60898/0 (socket says 172.21.15.133:60898) 2021-01-03T12:58:30.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02a9f01700 1 -- 172.21.15.133:0/2620537212 learned_addr learned my addr 172.21.15.133:0/2620537212 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:30.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02a8eff700 1 --2- 172.21.15.133:0/2620537212 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02a40a5f80 0x7f02a40a3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:30.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02a9700700 1 --2- 172.21.15.133:0/2620537212 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0288003720 0x7f02a40a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:30.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02a9f01700 1 -- 172.21.15.133:0/2620537212 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0288003720 msgr2=0x7f02a40a5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:30.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02a9f01700 1 --2- 172.21.15.133:0/2620537212 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0288003720 0x7f02a40a5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:30.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02a9f01700 1 -- 172.21.15.133:0/2620537212 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02a40a5f80 msgr2=0x7f02a40a3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:30.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02a9f01700 1 --2- 172.21.15.133:0/2620537212 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02a40a5f80 0x7f02a40a3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:30.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02a9f01700 1 -- 172.21.15.133:0/2620537212 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a4066580 con 0x7f02a40a2f10 2021-01-03T12:58:30.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02a8eff700 1 --2- 172.21.15.133:0/2620537212 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02a40a5f80 0x7f02a40a3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:30.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02a9f01700 1 --2- 172.21.15.133:0/2620537212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02a40a2f10 0x7f02a40a3900 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f02a414fad0 tx=0x7f029c009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:30.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f029a7fc700 1 -- 172.21.15.133:0/2620537212 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f029c001540 con 0x7f02a40a2f10 2021-01-03T12:58:30.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f029a7fc700 1 -- 172.21.15.133:0/2620537212 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c0016a0 con 0x7f02a40a2f10 2021-01-03T12:58:30.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02aa702700 1 -- 172.21.15.133:0/2620537212 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a4066820 con 0x7f02a40a2f10 2021-01-03T12:58:30.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f029a7fc700 1 -- 172.21.15.133:0/2620537212 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f029c001a00 con 0x7f02a40a2f10 2021-01-03T12:58:30.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.119+0000 7f02aa702700 1 -- 172.21.15.133:0/2620537212 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a4152620 con 0x7f02a40a2f10 2021-01-03T12:58:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.123+0000 7f029a7fc700 1 -- 172.21.15.133:0/2620537212 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f029c001b60 con 0x7f02a40a2f10 2021-01-03T12:58:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.123+0000 7f02aa702700 1 -- 172.21.15.133:0/2620537212 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a40669b0 con 0x7f02a40a2f10 2021-01-03T12:58:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.123+0000 7f029a7fc700 1 --2- 172.21.15.133:0/2620537212 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f028c0554e0 0x7f028c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.123+0000 7f029a7fc700 1 -- 172.21.15.133:0/2620537212 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f029c06dcd0 con 0x7f02a40a2f10 2021-01-03T12:58:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.123+0000 7f02a9700700 1 --2- 172.21.15.133:0/2620537212 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f028c0554e0 0x7f028c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.123+0000 7f02a9700700 1 --2- 172.21.15.133:0/2620537212 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f028c0554e0 0x7f028c0579a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f0294016000 tx=0x7f0294015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.127+0000 7f029a7fc700 1 -- 172.21.15.133:0/2620537212 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f029c042df0 con 0x7f02a40a2f10 2021-01-03T12:58:30.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:30.311+0000 7f02aa702700 1 -- 172.21.15.133:0/2620537212 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f02a4057300 con 0x7f02a40a2f10 2021-01-03T12:58:31.132 INFO:tasks.ceph.mon.b.smithi016.stderr:2021-01-03T12:58:31.129+0000 7fba5c9c4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-01-03T12:58:31.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.139+0000 7f029a7fc700 1 -- 172.21.15.133:0/2620537212 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v6) v1 ==== 161+0+0 (secure 0 0 0) 0x7f029c047a00 con 0x7f02a40a2f10 2021-01-03T12:58:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.143+0000 7f02aa702700 1 -- 172.21.15.133:0/2620537212 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f028c0554e0 msgr2=0x7f028c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.143+0000 7f02aa702700 1 --2- 172.21.15.133:0/2620537212 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f028c0554e0 0x7f028c0579a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f0294016000 tx=0x7f0294015000).stop 2021-01-03T12:58:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.143+0000 7f02aa702700 1 -- 172.21.15.133:0/2620537212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02a40a2f10 msgr2=0x7f02a40a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.143+0000 7f02aa702700 1 --2- 172.21.15.133:0/2620537212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02a40a2f10 0x7f02a40a3900 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f02a414fad0 tx=0x7f029c009040).stop 2021-01-03T12:58:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.143+0000 7f02aa702700 1 -- 172.21.15.133:0/2620537212 shutdown_connections 2021-01-03T12:58:31.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.143+0000 7f02aa702700 1 --2- 172.21.15.133:0/2620537212 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f028c0554e0 0x7f028c0579a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:31.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.143+0000 7f02aa702700 1 --2- 172.21.15.133:0/2620537212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02a40a2f10 0x7f02a40a3900 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:31.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.143+0000 7f02aa702700 1 --2- 172.21.15.133:0/2620537212 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0288003720 0x7f02a40a5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:31.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.143+0000 7f02aa702700 1 --2- 172.21.15.133:0/2620537212 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02a40a5f80 0x7f02a40a3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:31.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.143+0000 7f02aa702700 1 -- 172.21.15.133:0/2620537212 >> 172.21.15.133:0/2620537212 conn(0x7f02a40b6110 msgr2=0x7f02a4142690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:31.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.143+0000 7f02aa702700 1 -- 172.21.15.133:0/2620537212 shutdown_connections 2021-01-03T12:58:31.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.143+0000 7f02aa702700 1 -- 172.21.15.133:0/2620537212 wait complete. 2021-01-03T12:58:31.147 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-01-03T12:58:31.161 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T12:58:31.164 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T12:58:31.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.267+0000 7f336b026700 1 Processor -- start 2021-01-03T12:58:31.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.267+0000 7f336b026700 1 -- start start 2021-01-03T12:58:31.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f336b026700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3364066f70 0x7f336405fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:31.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f336b026700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33640afe70 con 0x7f3364067350 2021-01-03T12:58:31.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f336b026700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3364060310 con 0x7f33640b2750 2021-01-03T12:58:31.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f336b026700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33640605a0 con 0x7f3364066f70 2021-01-03T12:58:31.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f336a825700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f33640b2750 0x7f3364144260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53716/0 (socket says 172.21.15.133:53716) 2021-01-03T12:58:31.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f336a825700 1 -- 172.21.15.133:0/2279543240 learned_addr learned my addr 172.21.15.133:0/2279543240 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:31.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f336a024700 1 --2- 172.21.15.133:0/2279543240 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3364066f70 0x7f336405fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:31.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f3369022700 1 -- 172.21.15.133:0/2279543240 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033107610 0 0) 0x7f3364060310 con 0x7f33640b2750 2021-01-03T12:58:31.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f3369022700 1 -- 172.21.15.133:0/2279543240 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3350003230 con 0x7f33640b2750 2021-01-03T12:58:31.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f3369022700 1 -- 172.21.15.133:0/2279543240 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067424736 0 0) 0x7f33640afe70 con 0x7f3364067350 2021-01-03T12:58:31.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f3369022700 1 -- 172.21.15.133:0/2279543240 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3364060310 con 0x7f3364067350 2021-01-03T12:58:31.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f336a024700 1 -- 172.21.15.133:0/2279543240 >> v1:172.21.15.133:6789/0 conn(0x7f33640b2750 legacy=0x7f3364144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:31.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f3369022700 1 -- 172.21.15.133:0/2279543240 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 595787331 0 0) 0x7f3350003230 con 0x7f33640b2750 2021-01-03T12:58:31.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f336a024700 1 -- 172.21.15.133:0/2279543240 >> v1:172.21.15.16:6789/0 conn(0x7f3364067350 legacy=0x7f33640af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:31.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f336a024700 1 -- 172.21.15.133:0/2279543240 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33640b0b50 con 0x7f3364066f70 2021-01-03T12:58:31.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f336a024700 1 --2- 172.21.15.133:0/2279543240 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3364066f70 0x7f336405fe20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f335c0010d0 tx=0x7f33540091a0).ready entity=mon.2 client_cookie=3e0fa07b6fa45928 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:31.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f3369022700 1 -- 172.21.15.133:0/2279543240 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f335c0016d0 con 0x7f3364066f70 2021-01-03T12:58:31.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f3369022700 1 -- 172.21.15.133:0/2279543240 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335400b880 con 0x7f3364066f70 2021-01-03T12:58:31.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f3369022700 1 -- 172.21.15.133:0/2279543240 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f335400b9f0 con 0x7f3364066f70 2021-01-03T12:58:31.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f336b026700 1 -- 172.21.15.133:0/2279543240 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3364066f70 msgr2=0x7f336405fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:31.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.271+0000 7f336b026700 1 --2- 172.21.15.133:0/2279543240 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3364066f70 0x7f336405fe20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f335c0010d0 tx=0x7f33540091a0).stop 2021-01-03T12:58:31.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.275+0000 7f336b026700 1 -- 172.21.15.133:0/2279543240 shutdown_connections 2021-01-03T12:58:31.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.275+0000 7f336b026700 1 --2- 172.21.15.133:0/2279543240 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3364066f70 0x7f336405fe20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:31.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.275+0000 7f336b026700 1 -- 172.21.15.133:0/2279543240 >> 172.21.15.133:0/2279543240 conn(0x7f33640b6110 msgr2=0x7f33640b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:31.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.275+0000 7f336b026700 1 -- 172.21.15.133:0/2279543240 shutdown_connections 2021-01-03T12:58:31.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.275+0000 7f336b026700 1 -- 172.21.15.133:0/2279543240 wait complete. 2021-01-03T12:58:31.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.275+0000 7f336b026700 1 Processor -- start 2021-01-03T12:58:31.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.275+0000 7f336b026700 1 -- start start 2021-01-03T12:58:31.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.275+0000 7f336b026700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364066f70 0x7f336413f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:31.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.275+0000 7f336b026700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3364067350 0x7f336414ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:31.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.275+0000 7f336b026700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f33640b2750 0x7f33641503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:31.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.275+0000 7f336b026700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336409ff90 con 0x7f3364066f70 2021-01-03T12:58:31.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.275+0000 7f336b026700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33641508e0 con 0x7f3364067350 2021-01-03T12:58:31.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.275+0000 7f336b026700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3364064840 con 0x7f33640b2750 2021-01-03T12:58:31.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.275+0000 7f3369823700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3364067350 0x7f336414ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:31.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f3369823700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3364067350 0x7f336414ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60922/0 (socket says 172.21.15.133:60922) 2021-01-03T12:58:31.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f3369823700 1 -- 172.21.15.133:0/109294016 learned_addr learned my addr 172.21.15.133:0/109294016 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:31.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f336a825700 1 --2- 172.21.15.133:0/109294016 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f33640b2750 0x7f33641503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:31.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f336a024700 1 --2- 172.21.15.133:0/109294016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364066f70 0x7f336413f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:31.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f3369823700 1 -- 172.21.15.133:0/109294016 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f33640b2750 msgr2=0x7f33641503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:31.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f3369823700 1 --2- 172.21.15.133:0/109294016 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f33640b2750 0x7f33641503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:31.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f3369823700 1 -- 172.21.15.133:0/109294016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364066f70 msgr2=0x7f336413f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:31.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f3369823700 1 --2- 172.21.15.133:0/109294016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364066f70 0x7f336413f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f3369823700 1 -- 172.21.15.133:0/109294016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3364064ae0 con 0x7f3364067350 2021-01-03T12:58:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f336a024700 1 --2- 172.21.15.133:0/109294016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364066f70 0x7f336413f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f336a825700 1 --2- 172.21.15.133:0/109294016 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f33640b2750 0x7f33641503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f3369823700 1 --2- 172.21.15.133:0/109294016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3364067350 0x7f336414ff00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f33580010d0 tx=0x7f3358007ab0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:31.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f33637fe700 1 -- 172.21.15.133:0/109294016 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3358010510 con 0x7f3364067350 2021-01-03T12:58:31.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f33637fe700 1 -- 172.21.15.133:0/109294016 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3358010670 con 0x7f3364067350 2021-01-03T12:58:31.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f336b026700 1 -- 172.21.15.133:0/109294016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3364064d80 con 0x7f3364067350 2021-01-03T12:58:31.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f33637fe700 1 -- 172.21.15.133:0/109294016 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33580107e0 con 0x7f3364067350 2021-01-03T12:58:31.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f336b026700 1 -- 172.21.15.133:0/109294016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3364152f80 con 0x7f3364067350 2021-01-03T12:58:31.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f336b026700 1 -- 172.21.15.133:0/109294016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3364057300 con 0x7f3364067350 2021-01-03T12:58:31.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f33637fe700 1 -- 172.21.15.133:0/109294016 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3358010070 con 0x7f3364067350 2021-01-03T12:58:31.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f33637fe700 1 --2- 172.21.15.133:0/109294016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3344055440 0x7f3344057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:31.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f33637fe700 1 -- 172.21.15.133:0/109294016 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f335806d860 con 0x7f3364067350 2021-01-03T12:58:31.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.279+0000 7f336a024700 1 --2- 172.21.15.133:0/109294016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3344055440 0x7f3344057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:31.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.283+0000 7f336a024700 1 --2- 172.21.15.133:0/109294016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3344055440 0x7f3344057900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f3354019000 tx=0x7f3354016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:31.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.287+0000 7f33637fe700 1 -- 172.21.15.133:0/109294016 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3358043b10 con 0x7f3364067350 2021-01-03T12:58:31.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.475+0000 7f336b026700 1 -- 172.21.15.133:0/109294016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3364061020 con 0x7f3364067350 2021-01-03T12:58:31.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.475+0000 7f33637fe700 1 -- 172.21.15.133:0/109294016 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2126 (secure 0 0 0) 0x7f3358047130 con 0x7f3364067350 2021-01-03T12:58:31.477 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:31.477 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2255364706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2255364706},{"type":"v1","addr":"172.21.15.16:6833","nonce":2255364706}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/537740959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":537740959},{"type":"v1","addr":"172.21.15.133:6835","nonce":537740959}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":5}],"filesystems":[{"mdsmap":{"epoch":6,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T12:58:00.825803+0000","modified":"2021-01-03T12:58:31.132791+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":24,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2021-01-03T12:58:31.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.479+0000 7f336b026700 1 -- 172.21.15.133:0/109294016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3344055440 msgr2=0x7f3344057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:31.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.479+0000 7f336b026700 1 --2- 172.21.15.133:0/109294016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3344055440 0x7f3344057900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f3354019000 tx=0x7f3354016000).stop 2021-01-03T12:58:31.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.479+0000 7f336b026700 1 -- 172.21.15.133:0/109294016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3364067350 msgr2=0x7f336414ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:31.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.479+0000 7f336b026700 1 --2- 172.21.15.133:0/109294016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3364067350 0x7f336414ff00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f33580010d0 tx=0x7f3358007ab0).stop 2021-01-03T12:58:31.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.479+0000 7f336b026700 1 -- 172.21.15.133:0/109294016 shutdown_connections 2021-01-03T12:58:31.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.479+0000 7f336b026700 1 --2- 172.21.15.133:0/109294016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3344055440 0x7f3344057900 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:31.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.479+0000 7f336b026700 1 --2- 172.21.15.133:0/109294016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3364066f70 0x7f336413f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:31.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.479+0000 7f336b026700 1 --2- 172.21.15.133:0/109294016 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f33640b2750 0x7f33641503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:31.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.479+0000 7f336b026700 1 --2- 172.21.15.133:0/109294016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3364067350 0x7f336414ff00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:31.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.479+0000 7f336b026700 1 -- 172.21.15.133:0/109294016 >> 172.21.15.133:0/109294016 conn(0x7f33640b6110 msgr2=0x7f33640b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:31.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.479+0000 7f336b026700 1 -- 172.21.15.133:0/109294016 shutdown_connections 2021-01-03T12:58:31.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.479+0000 7f336b026700 1 -- 172.21.15.133:0/109294016 wait complete. 2021-01-03T12:58:31.482 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 6 2021-01-03T12:58:31.490 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-01-03T12:58:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.651+0000 7f3a3124f700 1 Processor -- start 2021-01-03T12:58:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.651+0000 7f3a3124f700 1 -- start start 2021-01-03T12:58:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.651+0000 7f3a3124f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3a2c05cc10 0x7f3a2c1437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.651+0000 7f3a3124f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3a2c0b02d0 0x7f3a2c146a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.651+0000 7f3a3124f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2c05c510 con 0x7f3a2c05c130 2021-01-03T12:58:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.651+0000 7f3a3124f700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2c0b0780 con 0x7f3a2c0b02d0 2021-01-03T12:58:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.651+0000 7f3a3124f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2c0b5c10 con 0x7f3a2c05cc10 2021-01-03T12:58:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.651+0000 7f3a2a59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3a2c05cc10 0x7f3a2c1437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:31.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.651+0000 7f3a2a59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3a2c05cc10 0x7f3a2c1437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60928/0 (socket says 172.21.15.133:60928) 2021-01-03T12:58:31.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.651+0000 7f3a2a59c700 1 -- 172.21.15.133:0/2555656642 learned_addr learned my addr 172.21.15.133:0/2555656642 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:31.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.651+0000 7f3a2ad9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3a2c05c130 0x7f3a2c146370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53726/0 (socket says 172.21.15.133:53726) 2021-01-03T12:58:31.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.651+0000 7f3a2b59e700 1 --2- 172.21.15.133:0/2555656642 >> v2:172.21.15.16:3300/0 conn(0x7f3a2c0b02d0 0x7f3a2c146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.651+0000 7f3a2a59c700 1 -- 172.21.15.133:0/2555656642 >> v2:172.21.15.16:3300/0 conn(0x7f3a2c0b02d0 msgr2=0x7f3a2c146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.651+0000 7f3a2a59c700 1 --2- 172.21.15.133:0/2555656642 >> v2:172.21.15.16:3300/0 conn(0x7f3a2c0b02d0 0x7f3a2c146a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.651+0000 7f3a2a59c700 1 -- 172.21.15.133:0/2555656642 >> v1:172.21.15.133:6789/0 conn(0x7f3a2c05c130 legacy=0x7f3a2c146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.651+0000 7f3a2a59c700 1 -- 172.21.15.133:0/2555656642 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c0af8f0 con 0x7f3a2c05cc10 2021-01-03T12:58:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.651+0000 7f3a2a59c700 1 --2- 172.21.15.133:0/2555656642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c05cc10 0x7f3a2c1437e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f3a1c002f30 tx=0x7f3a1c006e80).ready entity=mon.1 client_cookie=f9a9afe38012147d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:31.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.655+0000 7f3a29d9b700 1 -- 172.21.15.133:0/2555656642 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1c0097f0 con 0x7f3a2c05cc10 2021-01-03T12:58:31.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.655+0000 7f3a29d9b700 1 -- 172.21.15.133:0/2555656642 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1c009950 con 0x7f3a2c05cc10 2021-01-03T12:58:31.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.655+0000 7f3a29d9b700 1 -- 172.21.15.133:0/2555656642 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1c009cf0 con 0x7f3a2c05cc10 2021-01-03T12:58:31.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.655+0000 7f3a3124f700 1 -- 172.21.15.133:0/2555656642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c05cc10 msgr2=0x7f3a2c1437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:31.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.655+0000 7f3a3124f700 1 --2- 172.21.15.133:0/2555656642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c05cc10 0x7f3a2c1437e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f3a1c002f30 tx=0x7f3a1c006e80).stop 2021-01-03T12:58:31.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.655+0000 7f3a3124f700 1 -- 172.21.15.133:0/2555656642 shutdown_connections 2021-01-03T12:58:31.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.655+0000 7f3a3124f700 1 --2- 172.21.15.133:0/2555656642 >> v2:172.21.15.16:3300/0 conn(0x7f3a2c0b02d0 0x7f3a2c146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:31.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.655+0000 7f3a3124f700 1 --2- 172.21.15.133:0/2555656642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c05cc10 0x7f3a2c1437e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:31.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.655+0000 7f3a3124f700 1 -- 172.21.15.133:0/2555656642 >> 172.21.15.133:0/2555656642 conn(0x7f3a2c0b95d0 msgr2=0x7f3a2c0b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:31.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.655+0000 7f3a3124f700 1 -- 172.21.15.133:0/2555656642 shutdown_connections 2021-01-03T12:58:31.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.655+0000 7f3a3124f700 1 -- 172.21.15.133:0/2555656642 wait complete. 2021-01-03T12:58:31.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.655+0000 7f3a3124f700 1 Processor -- start 2021-01-03T12:58:31.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.655+0000 7f3a3124f700 1 -- start start 2021-01-03T12:58:31.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a3124f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c05c130 0x7f3a2c0b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:31.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a3124f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c05cc10 0x7f3a2c144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:31.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a3124f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3a2c0b02d0 0x7f3a2c151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:31.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a3124f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c155f10 con 0x7f3a2c05cc10 2021-01-03T12:58:31.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a3124f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c0b1590 con 0x7f3a2c05c130 2021-01-03T12:58:31.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a3124f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c156170 con 0x7f3a2c0b02d0 2021-01-03T12:58:31.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a2ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c05c130 0x7f3a2c0b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:31.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a2ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c05c130 0x7f3a2c0b10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60932/0 (socket says 172.21.15.133:60932) 2021-01-03T12:58:31.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a2ad9d700 1 -- 172.21.15.133:0/3586863054 learned_addr learned my addr 172.21.15.133:0/3586863054 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:31.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a2b59e700 1 --2- 172.21.15.133:0/3586863054 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3a2c0b02d0 0x7f3a2c151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:31.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a2a59c700 1 --2- 172.21.15.133:0/3586863054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c05cc10 0x7f3a2c144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:31.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a2ad9d700 1 -- 172.21.15.133:0/3586863054 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3a2c0b02d0 msgr2=0x7f3a2c151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:31.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a2ad9d700 1 --2- 172.21.15.133:0/3586863054 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3a2c0b02d0 0x7f3a2c151f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:31.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a2ad9d700 1 -- 172.21.15.133:0/3586863054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c05cc10 msgr2=0x7f3a2c144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:31.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a2ad9d700 1 --2- 172.21.15.133:0/3586863054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c05cc10 0x7f3a2c144530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:31.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a2ad9d700 1 -- 172.21.15.133:0/3586863054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c0b0c00 con 0x7f3a2c05c130 2021-01-03T12:58:31.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a2ad9d700 1 --2- 172.21.15.133:0/3586863054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c05c130 0x7f3a2c0b10a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f3a2c067f50 tx=0x7f3a20007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:31.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a1bfff700 1 -- 172.21.15.133:0/3586863054 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a200072e0 con 0x7f3a2c05c130 2021-01-03T12:58:31.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a1bfff700 1 -- 172.21.15.133:0/3586863054 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a20005520 con 0x7f3a2c05c130 2021-01-03T12:58:31.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a1bfff700 1 -- 172.21.15.133:0/3586863054 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a20005880 con 0x7f3a2c05c130 2021-01-03T12:58:31.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a3124f700 1 -- 172.21.15.133:0/3586863054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2c144a20 con 0x7f3a2c05c130 2021-01-03T12:58:31.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.659+0000 7f3a3124f700 1 -- 172.21.15.133:0/3586863054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c152400 con 0x7f3a2c05c130 2021-01-03T12:58:31.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.663+0000 7f3a3124f700 1 -- 172.21.15.133:0/3586863054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2c057300 con 0x7f3a2c05c130 2021-01-03T12:58:31.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.663+0000 7f3a1bfff700 1 -- 172.21.15.133:0/3586863054 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3a20010070 con 0x7f3a2c05c130 2021-01-03T12:58:31.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.663+0000 7f3a1bfff700 1 --2- 172.21.15.133:0/3586863054 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3a080553b0 0x7f3a08057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:31.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.663+0000 7f3a1bfff700 1 -- 172.21.15.133:0/3586863054 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3a2006d6c0 con 0x7f3a2c05c130 2021-01-03T12:58:31.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.663+0000 7f3a2a59c700 1 --2- 172.21.15.133:0/3586863054 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3a080553b0 0x7f3a08057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:31.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.663+0000 7f3a2a59c700 1 --2- 172.21.15.133:0/3586863054 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3a080553b0 0x7f3a08057870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f3a1c01c000 tx=0x7f3a1c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:31.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.667+0000 7f3a1bfff700 1 -- 172.21.15.133:0/3586863054 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3a20043860 con 0x7f3a2c05c130 2021-01-03T12:58:31.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:31.851+0000 7f3a3124f700 1 -- 172.21.15.133:0/3586863054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3a2c05d270 con 0x7f3a2c05c130 2021-01-03T12:58:32.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.155+0000 7f3a1bfff700 1 -- 172.21.15.133:0/3586863054 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3a20046e80 con 0x7f3a2c05c130 2021-01-03T12:58:32.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.159+0000 7f3a3124f700 1 -- 172.21.15.133:0/3586863054 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3a080553b0 msgr2=0x7f3a08057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:32.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.159+0000 7f3a3124f700 1 --2- 172.21.15.133:0/3586863054 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3a080553b0 0x7f3a08057870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f3a1c01c000 tx=0x7f3a1c015000).stop 2021-01-03T12:58:32.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.159+0000 7f3a3124f700 1 -- 172.21.15.133:0/3586863054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c05c130 msgr2=0x7f3a2c0b10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:32.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.159+0000 7f3a3124f700 1 --2- 172.21.15.133:0/3586863054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c05c130 0x7f3a2c0b10a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f3a2c067f50 tx=0x7f3a20007bd0).stop 2021-01-03T12:58:32.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.159+0000 7f3a3124f700 1 -- 172.21.15.133:0/3586863054 shutdown_connections 2021-01-03T12:58:32.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.159+0000 7f3a3124f700 1 --2- 172.21.15.133:0/3586863054 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3a080553b0 0x7f3a08057870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:32.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.159+0000 7f3a3124f700 1 --2- 172.21.15.133:0/3586863054 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3a2c0b02d0 0x7f3a2c151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:32.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.159+0000 7f3a3124f700 1 --2- 172.21.15.133:0/3586863054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a2c05c130 0x7f3a2c0b10a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:32.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.159+0000 7f3a3124f700 1 --2- 172.21.15.133:0/3586863054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a2c05cc10 0x7f3a2c144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:32.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.159+0000 7f3a3124f700 1 -- 172.21.15.133:0/3586863054 >> 172.21.15.133:0/3586863054 conn(0x7f3a2c0b95d0 msgr2=0x7f3a2c0b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:32.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.159+0000 7f3a3124f700 1 -- 172.21.15.133:0/3586863054 shutdown_connections 2021-01-03T12:58:32.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.159+0000 7f3a3124f700 1 -- 172.21.15.133:0/3586863054 wait complete. 2021-01-03T12:58:32.177 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-01-03T12:58:32.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.299+0000 7f6e1ad81700 1 Processor -- start 2021-01-03T12:58:32.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.299+0000 7f6e1ad81700 1 -- start start 2021-01-03T12:58:32.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1ad81700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6e14144c60 0x7f6e14141620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:32.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1ad81700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e1405bdf0 0x7f6e140ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:32.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1ad81700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e140af5e0 con 0x7f6e140af200 2021-01-03T12:58:32.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1ad81700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e1405c2a0 con 0x7f6e14144c60 2021-01-03T12:58:32.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1ad81700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1405c4c0 con 0x7f6e1405bdf0 2021-01-03T12:58:32.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e19d7f700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6e140af200 0x7f6e14144550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53742/0 (socket says 172.21.15.133:53742) 2021-01-03T12:58:32.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e19d7f700 1 -- 172.21.15.133:0/594945399 learned_addr learned my addr 172.21.15.133:0/594945399 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:32.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1a580700 1 --2- 172.21.15.133:0/594945399 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e1405bdf0 0x7f6e140ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:32.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 -- 172.21.15.133:0/594945399 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251295414 0 0) 0x7f6e140af5e0 con 0x7f6e140af200 2021-01-03T12:58:32.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 -- 172.21.15.133:0/594945399 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e00003230 con 0x7f6e140af200 2021-01-03T12:58:32.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1957e700 1 --2- 172.21.15.133:0/594945399 >> v2:172.21.15.16:3300/0 conn(0x7f6e14144c60 0x7f6e14141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:32.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 -- 172.21.15.133:0/594945399 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1054574487 0 0) 0x7f6e00003230 con 0x7f6e140af200 2021-01-03T12:58:32.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 -- 172.21.15.133:0/594945399 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e1405bdf0 msgr2=0x7f6e140ab0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:32.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 --2- 172.21.15.133:0/594945399 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e1405bdf0 0x7f6e140ab0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:32.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 -- 172.21.15.133:0/594945399 >> v2:172.21.15.16:3300/0 conn(0x7f6e14144c60 msgr2=0x7f6e14141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:32.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 --2- 172.21.15.133:0/594945399 >> v2:172.21.15.16:3300/0 conn(0x7f6e14144c60 0x7f6e14141620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:32.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 -- 172.21.15.133:0/594945399 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1405c760 con 0x7f6e140af200 2021-01-03T12:58:32.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 -- 172.21.15.133:0/594945399 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f6e04001a50 con 0x7f6e140af200 2021-01-03T12:58:32.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 -- 172.21.15.133:0/594945399 >> v1:172.21.15.133:6789/0 conn(0x7f6e140af200 legacy=0x7f6e14144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:32.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 --2- 172.21.15.133:0/594945399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e00003720 0x7f6e00003b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:32.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 --2- 172.21.15.133:0/594945399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e000044d0 0x7f6e00004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:32.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 --2- 172.21.15.133:0/594945399 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e1405bdf0 0x7f6e00004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:32.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 -- 172.21.15.133:0/594945399 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1405c2a0 con 0x7f6e000044d0 2021-01-03T12:58:32.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 -- 172.21.15.133:0/594945399 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1405c4c0 con 0x7f6e00003720 2021-01-03T12:58:32.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 -- 172.21.15.133:0/594945399 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e00004280 con 0x7f6e1405bdf0 2021-01-03T12:58:32.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1957e700 1 --2- 172.21.15.133:0/594945399 >> v2:172.21.15.16:3300/0 conn(0x7f6e14144c60 0x7f6e14141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:32.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e19d7f700 1 --2- 172.21.15.133:0/594945399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e00003720 0x7f6e00003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:32.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1a580700 1 --2- 172.21.15.133:0/594945399 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e1405bdf0 0x7f6e00004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:32.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1957e700 1 --2- 172.21.15.133:0/594945399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e000044d0 0x7f6e00004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:32.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e19d7f700 1 -- 172.21.15.133:0/594945399 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e1405bdf0 msgr2=0x7f6e00004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:32.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e19d7f700 1 --2- 172.21.15.133:0/594945399 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e1405bdf0 0x7f6e00004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:32.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e19d7f700 1 -- 172.21.15.133:0/594945399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e000044d0 msgr2=0x7f6e00004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:32.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e19d7f700 1 --2- 172.21.15.133:0/594945399 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e000044d0 0x7f6e00004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:32.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e19d7f700 1 -- 172.21.15.133:0/594945399 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e00003230 con 0x7f6e00003720 2021-01-03T12:58:32.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1a580700 1 --2- 172.21.15.133:0/594945399 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e1405bdf0 0x7f6e00004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:32.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e19d7f700 1 --2- 172.21.15.133:0/594945399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e00003720 0x7f6e00003b60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f6e04001760 tx=0x7f6e140aa050).ready entity=mon.1 client_cookie=3511908ed40db012 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:32.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 -- 172.21.15.133:0/594945399 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e04005b70 con 0x7f6e00003720 2021-01-03T12:58:32.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 -- 172.21.15.133:0/594945399 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e04005cd0 con 0x7f6e00003720 2021-01-03T12:58:32.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e18d7d700 1 -- 172.21.15.133:0/594945399 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e040072c0 con 0x7f6e00003720 2021-01-03T12:58:32.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1ad81700 1 -- 172.21.15.133:0/594945399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e00003720 msgr2=0x7f6e00003b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:32.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1ad81700 1 --2- 172.21.15.133:0/594945399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e00003720 0x7f6e00003b60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f6e04001760 tx=0x7f6e140aa050).stop 2021-01-03T12:58:32.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1a580700 1 -- 172.21.15.133:0/594945399 reap_dead start 2021-01-03T12:58:32.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1ad81700 1 -- 172.21.15.133:0/594945399 shutdown_connections 2021-01-03T12:58:32.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1ad81700 1 -- 172.21.15.133:0/594945399 >> 172.21.15.133:0/594945399 conn(0x7f6e1406b050 msgr2=0x7f6e14060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:32.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1ad81700 1 -- 172.21.15.133:0/594945399 shutdown_connections 2021-01-03T12:58:32.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.303+0000 7f6e1ad81700 1 -- 172.21.15.133:0/594945399 wait complete. 2021-01-03T12:58:32.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e1ad81700 1 Processor -- start 2021-01-03T12:58:32.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e1ad81700 1 -- start start 2021-01-03T12:58:32.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e1ad81700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e140b3f00 0x7f6e14141e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:32.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e1ad81700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e140b5320 0x7f6e1414e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:32.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e1ad81700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e14062f70 0x7f6e14150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:32.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e1ad81700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e140b42e0 con 0x7f6e140b5320 2021-01-03T12:58:32.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e1ad81700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1414d9d0 con 0x7f6e140b3f00 2021-01-03T12:58:32.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e1ad81700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e14142330 con 0x7f6e14062f70 2021-01-03T12:58:32.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e19d7f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e140b3f00 0x7f6e14141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:32.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e19d7f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e140b3f00 0x7f6e14141e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60956/0 (socket says 172.21.15.133:60956) 2021-01-03T12:58:32.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e1a580700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e14062f70 0x7f6e14150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:32.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e19d7f700 1 -- 172.21.15.133:0/2088373219 learned_addr learned my addr 172.21.15.133:0/2088373219 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:32.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e1957e700 1 --2- 172.21.15.133:0/2088373219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e140b5320 0x7f6e1414e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:32.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e19d7f700 1 -- 172.21.15.133:0/2088373219 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e14062f70 msgr2=0x7f6e14150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:32.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e19d7f700 1 --2- 172.21.15.133:0/2088373219 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e14062f70 0x7f6e14150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:32.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e19d7f700 1 -- 172.21.15.133:0/2088373219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e140b5320 msgr2=0x7f6e1414e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e19d7f700 1 --2- 172.21.15.133:0/2088373219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e140b5320 0x7f6e1414e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.307+0000 7f6e19d7f700 1 -- 172.21.15.133:0/2088373219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e140b37f0 con 0x7f6e140b3f00 2021-01-03T12:58:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.311+0000 7f6e19d7f700 1 --2- 172.21.15.133:0/2088373219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e140b3f00 0x7f6e14141e40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f6e04001760 tx=0x7f6e04010000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:32.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.311+0000 7f6e12ffd700 1 -- 172.21.15.133:0/2088373219 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e0401a070 con 0x7f6e140b3f00 2021-01-03T12:58:32.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.311+0000 7f6e1ad81700 1 -- 172.21.15.133:0/2088373219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1414dc30 con 0x7f6e140b3f00 2021-01-03T12:58:32.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.311+0000 7f6e1ad81700 1 -- 172.21.15.133:0/2088373219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1414e860 con 0x7f6e140b3f00 2021-01-03T12:58:32.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.311+0000 7f6e12ffd700 1 -- 172.21.15.133:0/2088373219 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e04001a50 con 0x7f6e140b3f00 2021-01-03T12:58:32.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.311+0000 7f6e12ffd700 1 -- 172.21.15.133:0/2088373219 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e04007900 con 0x7f6e140b3f00 2021-01-03T12:58:32.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.311+0000 7f6e1ad81700 1 -- 172.21.15.133:0/2088373219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e14057300 con 0x7f6e140b3f00 2021-01-03T12:58:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.311+0000 7f6e12ffd700 1 -- 172.21.15.133:0/2088373219 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6e04026070 con 0x7f6e140b3f00 2021-01-03T12:58:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.311+0000 7f6e12ffd700 1 --2- 172.21.15.133:0/2088373219 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6df4055330 0x7f6df40577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.315+0000 7f6e12ffd700 1 -- 172.21.15.133:0/2088373219 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6e0406e9a0 con 0x7f6e140b3f00 2021-01-03T12:58:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.315+0000 7f6e1957e700 1 --2- 172.21.15.133:0/2088373219 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6df4055330 0x7f6df40577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:32.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.315+0000 7f6e1957e700 1 --2- 172.21.15.133:0/2088373219 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6df4055330 0x7f6df40577f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f6e0800c000 tx=0x7f6e08008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:32.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.319+0000 7f6e12ffd700 1 -- 172.21.15.133:0/2088373219 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6e04044ac0 con 0x7f6e140b3f00 2021-01-03T12:58:32.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:32.463+0000 7f6e1ad81700 1 -- 172.21.15.133:0/2088373219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6e140b3980 con 0x7f6e140b3f00 2021-01-03T12:58:33.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.167+0000 7f6e12ffd700 1 -- 172.21.15.133:0/2088373219 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 185+0+0 (secure 0 0 0) 0x7f6e04002020 con 0x7f6e140b3f00 2021-01-03T12:58:33.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.171+0000 7f6e1ad81700 1 -- 172.21.15.133:0/2088373219 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6df4055330 msgr2=0x7f6df40577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:33.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.171+0000 7f6e1ad81700 1 --2- 172.21.15.133:0/2088373219 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6df4055330 0x7f6df40577f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f6e0800c000 tx=0x7f6e08008040).stop 2021-01-03T12:58:33.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.171+0000 7f6e1ad81700 1 -- 172.21.15.133:0/2088373219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e140b3f00 msgr2=0x7f6e14141e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:33.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.171+0000 7f6e1ad81700 1 --2- 172.21.15.133:0/2088373219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e140b3f00 0x7f6e14141e40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f6e04001760 tx=0x7f6e04010000).stop 2021-01-03T12:58:33.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.171+0000 7f6e1ad81700 1 -- 172.21.15.133:0/2088373219 shutdown_connections 2021-01-03T12:58:33.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.171+0000 7f6e1ad81700 1 --2- 172.21.15.133:0/2088373219 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6df4055330 0x7f6df40577f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:33.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.171+0000 7f6e1ad81700 1 --2- 172.21.15.133:0/2088373219 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e14062f70 0x7f6e14150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:33.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.171+0000 7f6e1ad81700 1 --2- 172.21.15.133:0/2088373219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e140b3f00 0x7f6e14141e40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:33.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.171+0000 7f6e1ad81700 1 --2- 172.21.15.133:0/2088373219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e140b5320 0x7f6e1414e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:33.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.171+0000 7f6e1ad81700 1 -- 172.21.15.133:0/2088373219 >> 172.21.15.133:0/2088373219 conn(0x7f6e1406b050 msgr2=0x7f6e1413ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:33.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.171+0000 7f6e1ad81700 1 -- 172.21.15.133:0/2088373219 shutdown_connections 2021-01-03T12:58:33.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.171+0000 7f6e1ad81700 1 -- 172.21.15.133:0/2088373219 wait complete. 2021-01-03T12:58:33.174 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2021-01-03T12:58:33.186 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-01-03T12:58:33.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb1718700 1 Processor -- start 2021-01-03T12:58:33.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb1718700 1 -- start start 2021-01-03T12:58:33.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb1718700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6cac0ace10 0x7f6cac0ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:33.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb1718700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6cac144120 0x7f6cac144570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:33.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb1718700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cac0b7880 con 0x7f6cac0b2e80 2021-01-03T12:58:33.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb1718700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cac0ad6e0 con 0x7f6cac0ace10 2021-01-03T12:58:33.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb1718700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cac0adad0 con 0x7f6cac144120 2021-01-03T12:58:33.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb0f17700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6cac144120 0x7f6cac144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:33.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb0f17700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6cac144120 0x7f6cac144570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60964/0 (socket says 172.21.15.133:60964) 2021-01-03T12:58:33.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb0f17700 1 -- 172.21.15.133:0/4033799835 learned_addr learned my addr 172.21.15.133:0/4033799835 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:33.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cab7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6cac0b2e80 0x7f6cac0b7170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53766/0 (socket says 172.21.15.133:53766) 2021-01-03T12:58:33.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cabfff700 1 --2- 172.21.15.133:0/4033799835 >> v2:172.21.15.16:3300/0 conn(0x7f6cac0ace10 0x7f6cac0ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:33.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb0f17700 1 -- 172.21.15.133:0/4033799835 >> v2:172.21.15.16:3300/0 conn(0x7f6cac0ace10 msgr2=0x7f6cac0ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:33.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb0f17700 1 --2- 172.21.15.133:0/4033799835 >> v2:172.21.15.16:3300/0 conn(0x7f6cac0ace10 0x7f6cac0ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:33.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb0f17700 1 -- 172.21.15.133:0/4033799835 >> v1:172.21.15.133:6789/0 conn(0x7f6cac0b2e80 legacy=0x7f6cac0b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:33.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb0f17700 1 -- 172.21.15.133:0/4033799835 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac0add70 con 0x7f6cac144120 2021-01-03T12:58:33.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb0f17700 1 --2- 172.21.15.133:0/4033799835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac144120 0x7f6cac144570 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f6ca40032b0 tx=0x7f6ca4009270).ready entity=mon.1 client_cookie=dee54f9a46088749 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:33.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6caaffd700 1 -- 172.21.15.133:0/4033799835 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ca400bc00 con 0x7f6cac144120 2021-01-03T12:58:33.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6caaffd700 1 -- 172.21.15.133:0/4033799835 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca400bd60 con 0x7f6cac144120 2021-01-03T12:58:33.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6caaffd700 1 -- 172.21.15.133:0/4033799835 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ca4011400 con 0x7f6cac144120 2021-01-03T12:58:33.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb1718700 1 -- 172.21.15.133:0/4033799835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac144120 msgr2=0x7f6cac144570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:33.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb1718700 1 --2- 172.21.15.133:0/4033799835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac144120 0x7f6cac144570 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f6ca40032b0 tx=0x7f6ca4009270).stop 2021-01-03T12:58:33.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb1718700 1 -- 172.21.15.133:0/4033799835 shutdown_connections 2021-01-03T12:58:33.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb1718700 1 --2- 172.21.15.133:0/4033799835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac144120 0x7f6cac144570 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:33.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb1718700 1 --2- 172.21.15.133:0/4033799835 >> v2:172.21.15.16:3300/0 conn(0x7f6cac0ace10 0x7f6cac0ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:33.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb1718700 1 -- 172.21.15.133:0/4033799835 >> 172.21.15.133:0/4033799835 conn(0x7f6cac05bdf0 msgr2=0x7f6cac05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:33.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb1718700 1 -- 172.21.15.133:0/4033799835 shutdown_connections 2021-01-03T12:58:33.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.303+0000 7f6cb1718700 1 -- 172.21.15.133:0/4033799835 wait complete. 2021-01-03T12:58:33.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb1718700 1 Processor -- start 2021-01-03T12:58:33.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb1718700 1 -- start start 2021-01-03T12:58:33.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb1718700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6cac0ace10 0x7f6cac146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:33.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb1718700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cac0b2e80 0x7f6cac13ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:33.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb1718700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac144120 0x7f6cac155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:33.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb1718700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac140090 con 0x7f6cac0b2e80 2021-01-03T12:58:33.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb1718700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac1414f0 con 0x7f6cac144120 2021-01-03T12:58:33.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb1718700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac1402c0 con 0x7f6cac0ace10 2021-01-03T12:58:33.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb0f17700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac144120 0x7f6cac155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:33.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb0f17700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac144120 0x7f6cac155490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60972/0 (socket says 172.21.15.133:60972) 2021-01-03T12:58:33.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb0f17700 1 -- 172.21.15.133:0/4092592124 learned_addr learned my addr 172.21.15.133:0/4092592124 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:33.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cabfff700 1 --2- 172.21.15.133:0/4092592124 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6cac0ace10 0x7f6cac146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:33.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cab7fe700 1 --2- 172.21.15.133:0/4092592124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cac0b2e80 0x7f6cac13ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:33.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb0f17700 1 -- 172.21.15.133:0/4092592124 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6cac0ace10 msgr2=0x7f6cac146720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:33.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb0f17700 1 --2- 172.21.15.133:0/4092592124 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6cac0ace10 0x7f6cac146720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:33.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb0f17700 1 -- 172.21.15.133:0/4092592124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cac0b2e80 msgr2=0x7f6cac13ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:33.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb0f17700 1 --2- 172.21.15.133:0/4092592124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cac0b2e80 0x7f6cac13ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:33.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb0f17700 1 -- 172.21.15.133:0/4092592124 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac13f8b0 con 0x7f6cac144120 2021-01-03T12:58:33.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cabfff700 1 --2- 172.21.15.133:0/4092592124 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6cac0ace10 0x7f6cac146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:33.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb0f17700 1 --2- 172.21.15.133:0/4092592124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac144120 0x7f6cac155490 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f6ca40032b0 tx=0x7f6ca4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:33.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6ca97fa700 1 -- 172.21.15.133:0/4092592124 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ca401f5e0 con 0x7f6cac144120 2021-01-03T12:58:33.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6ca97fa700 1 -- 172.21.15.133:0/4092592124 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca401f740 con 0x7f6cac144120 2021-01-03T12:58:33.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6ca97fa700 1 -- 172.21.15.133:0/4092592124 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ca401faa0 con 0x7f6cac144120 2021-01-03T12:58:33.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb1718700 1 -- 172.21.15.133:0/4092592124 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cac067460 con 0x7f6cac144120 2021-01-03T12:58:33.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.307+0000 7f6cb1718700 1 -- 172.21.15.133:0/4092592124 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cac146c10 con 0x7f6cac144120 2021-01-03T12:58:33.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.311+0000 7f6cb1718700 1 -- 172.21.15.133:0/4092592124 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cac1416b0 con 0x7f6cac144120 2021-01-03T12:58:33.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.311+0000 7f6ca97fa700 1 -- 172.21.15.133:0/4092592124 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6ca400f070 con 0x7f6cac144120 2021-01-03T12:58:33.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.311+0000 7f6ca97fa700 1 --2- 172.21.15.133:0/4092592124 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6c8c0553f0 0x7f6c8c0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:33.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.311+0000 7f6ca97fa700 1 -- 172.21.15.133:0/4092592124 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f6ca406eb40 con 0x7f6cac144120 2021-01-03T12:58:33.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.311+0000 7f6cabfff700 1 --2- 172.21.15.133:0/4092592124 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6c8c0553f0 0x7f6c8c0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:33.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.311+0000 7f6cabfff700 1 --2- 172.21.15.133:0/4092592124 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6c8c0553f0 0x7f6c8c0578b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f6c9c00c000 tx=0x7f6c9c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:33.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.315+0000 7f6ca97fa700 1 -- 172.21.15.133:0/4092592124 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6ca4044fa0 con 0x7f6cac144120 2021-01-03T12:58:33.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:33.459+0000 7f6cb1718700 1 -- 172.21.15.133:0/4092592124 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6cac057300 con 0x7f6cac144120 2021-01-03T12:58:34.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.175+0000 7f6ca97fa700 1 -- 172.21.15.133:0/4092592124 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 173+0+0 (secure 0 0 0) 0x7f6ca4024020 con 0x7f6cac144120 2021-01-03T12:58:34.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.179+0000 7f6cb1718700 1 -- 172.21.15.133:0/4092592124 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6c8c0553f0 msgr2=0x7f6c8c0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:34.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.179+0000 7f6cb1718700 1 --2- 172.21.15.133:0/4092592124 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6c8c0553f0 0x7f6c8c0578b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f6c9c00c000 tx=0x7f6c9c008040).stop 2021-01-03T12:58:34.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.179+0000 7f6cb1718700 1 -- 172.21.15.133:0/4092592124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac144120 msgr2=0x7f6cac155490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:34.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.179+0000 7f6cb1718700 1 --2- 172.21.15.133:0/4092592124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac144120 0x7f6cac155490 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f6ca40032b0 tx=0x7f6ca4016000).stop 2021-01-03T12:58:34.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.179+0000 7f6cb1718700 1 -- 172.21.15.133:0/4092592124 shutdown_connections 2021-01-03T12:58:34.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.179+0000 7f6cb1718700 1 --2- 172.21.15.133:0/4092592124 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6c8c0553f0 0x7f6c8c0578b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:34.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.179+0000 7f6cb1718700 1 --2- 172.21.15.133:0/4092592124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6cac144120 0x7f6cac155490 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:34.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.179+0000 7f6cb1718700 1 --2- 172.21.15.133:0/4092592124 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6cac0ace10 0x7f6cac146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:34.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.179+0000 7f6cb1718700 1 --2- 172.21.15.133:0/4092592124 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cac0b2e80 0x7f6cac13ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:34.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.179+0000 7f6cb1718700 1 -- 172.21.15.133:0/4092592124 >> 172.21.15.133:0/4092592124 conn(0x7f6cac05bdf0 msgr2=0x7f6cac13d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:34.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.179+0000 7f6cb1718700 1 -- 172.21.15.133:0/4092592124 shutdown_connections 2021-01-03T12:58:34.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.179+0000 7f6cb1718700 1 -- 172.21.15.133:0/4092592124 wait complete. 2021-01-03T12:58:34.184 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2021-01-03T12:58:34.195 INFO:tasks.ceph.mds.a:Restarting daemon 2021-01-03T12:58:34.195 INFO:tasks.ceph.mds.a:Stopping old one... 2021-01-03T12:58:34.195 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-01-03T12:58:34.196 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T12:58:34.196 INFO:tasks.ceph.mds.c:Restarting daemon 2021-01-03T12:58:34.196 INFO:tasks.ceph.mds.c:Stopping old one... 2021-01-03T12:58:34.197 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-01-03T12:58:34.197 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T12:58:34.197 INFO:tasks.ceph.mds.b:Restarting daemon 2021-01-03T12:58:34.197 INFO:tasks.ceph.mds.b:Stopping old one... 2021-01-03T12:58:34.198 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-01-03T12:58:34.198 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T12:58:34.208 INFO:tasks.ceph.mds.a:Stopped 2021-01-03T12:58:34.209 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-01-03T12:58:34.210 INFO:tasks.ceph.mds.c:Stopped 2021-01-03T12:58:34.211 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-01-03T12:58:34.213 INFO:tasks.ceph.mds.b:Stopped 2021-01-03T12:58:34.214 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-01-03T12:58:34.255 INFO:tasks.ceph.mds.a:Started 2021-01-03T12:58:34.256 DEBUG:teuthology.parallel:result is None 2021-01-03T12:58:34.257 INFO:tasks.ceph.mds.b:Started 2021-01-03T12:58:34.257 DEBUG:teuthology.parallel:result is None 2021-01-03T12:58:34.258 INFO:tasks.ceph.mds.c:Started 2021-01-03T12:58:34.259 DEBUG:teuthology.parallel:result is None 2021-01-03T12:58:34.259 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-01-03T12:58:34.326 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T12:58:34.328 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T12:58:34.335 INFO:tasks.ceph.mds.b.smithi016.stdout:starting mds.b at 2021-01-03T12:58:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.375+0000 7efcf577e700 1 Processor -- start 2021-01-03T12:58:34.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.375+0000 7efcf577e700 1 -- start start 2021-01-03T12:58:34.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.375+0000 7efcf577e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efcf005f920 0x7efcf00b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:34.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.375+0000 7efcf577e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efcf00b1590 0x7efcf013ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:34.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.375+0000 7efcf577e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf005fd00 con 0x7efcf0066f30 2021-01-03T12:58:34.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.375+0000 7efcf577e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf00b2980 con 0x7efcf00b1590 2021-01-03T12:58:34.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.375+0000 7efcf577e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf00ae700 con 0x7efcf005f920 2021-01-03T12:58:34.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efceffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efcf005f920 0x7efcf00b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:34.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efceffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efcf005f920 0x7efcf00b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32768/0 (socket says 172.21.15.133:32768) 2021-01-03T12:58:34.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efcef7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efcf0066f30 0x7efcf00b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53802/0 (socket says 172.21.15.133:53802) 2021-01-03T12:58:34.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efceffff700 1 -- 172.21.15.133:0/1266614153 learned_addr learned my addr 172.21.15.133:0/1266614153 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:34.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efcf4f7d700 1 --2- 172.21.15.133:0/1266614153 >> v2:172.21.15.16:3300/0 conn(0x7efcf00b1590 0x7efcf013ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:34.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efceffff700 1 -- 172.21.15.133:0/1266614153 >> v2:172.21.15.16:3300/0 conn(0x7efcf00b1590 msgr2=0x7efcf013ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:34.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efceffff700 1 --2- 172.21.15.133:0/1266614153 >> v2:172.21.15.16:3300/0 conn(0x7efcf00b1590 0x7efcf013ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:34.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efceffff700 1 -- 172.21.15.133:0/1266614153 >> v1:172.21.15.133:6789/0 conn(0x7efcf0066f30 legacy=0x7efcf00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:34.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efceffff700 1 -- 172.21.15.133:0/1266614153 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf00accd0 con 0x7efcf005f920 2021-01-03T12:58:34.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efceffff700 1 --2- 172.21.15.133:0/1266614153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf005f920 0x7efcf00b0ab0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7efce0002f30 tx=0x7efce0006e80).ready entity=mon.1 client_cookie=310f103663a748e0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:34.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efceeffd700 1 -- 172.21.15.133:0/1266614153 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efce00097f0 con 0x7efcf005f920 2021-01-03T12:58:34.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efceeffd700 1 -- 172.21.15.133:0/1266614153 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce0009950 con 0x7efcf005f920 2021-01-03T12:58:34.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efceeffd700 1 -- 172.21.15.133:0/1266614153 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efce0009cb0 con 0x7efcf005f920 2021-01-03T12:58:34.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efcf577e700 1 -- 172.21.15.133:0/1266614153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf005f920 msgr2=0x7efcf00b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:34.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efcf577e700 1 --2- 172.21.15.133:0/1266614153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf005f920 0x7efcf00b0ab0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7efce0002f30 tx=0x7efce0006e80).stop 2021-01-03T12:58:34.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efcf577e700 1 -- 172.21.15.133:0/1266614153 shutdown_connections 2021-01-03T12:58:34.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efcf577e700 1 --2- 172.21.15.133:0/1266614153 >> v2:172.21.15.16:3300/0 conn(0x7efcf00b1590 0x7efcf013ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:34.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efcf577e700 1 --2- 172.21.15.133:0/1266614153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf005f920 0x7efcf00b0ab0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:34.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efcf577e700 1 -- 172.21.15.133:0/1266614153 >> 172.21.15.133:0/1266614153 conn(0x7efcf00b6110 msgr2=0x7efcf00b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:34.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efcf577e700 1 -- 172.21.15.133:0/1266614153 shutdown_connections 2021-01-03T12:58:34.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efcf577e700 1 -- 172.21.15.133:0/1266614153 wait complete. 2021-01-03T12:58:34.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efcf577e700 1 Processor -- start 2021-01-03T12:58:34.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.379+0000 7efcf577e700 1 -- start start 2021-01-03T12:58:34.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efcf577e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf005f920 0x7efcf0065a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:34.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efcf577e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efcf0066f30 0x7efcf0139630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:34.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efcf577e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efcf00b1590 0x7efcf014fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:34.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efcf577e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf01326e0 con 0x7efcf0066f30 2021-01-03T12:58:34.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efcf577e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf00669d0 con 0x7efcf005f920 2021-01-03T12:58:34.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efcf577e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf01323c0 con 0x7efcf00b1590 2021-01-03T12:58:34.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efceffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf005f920 0x7efcf0065a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:34.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efceffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf005f920 0x7efcf0065a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32774/0 (socket says 172.21.15.133:32774) 2021-01-03T12:58:34.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efceffff700 1 -- 172.21.15.133:0/2933590432 learned_addr learned my addr 172.21.15.133:0/2933590432 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:34.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efcef7fe700 1 --2- 172.21.15.133:0/2933590432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efcf0066f30 0x7efcf0139630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:34.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efcf4f7d700 1 --2- 172.21.15.133:0/2933590432 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efcf00b1590 0x7efcf014fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:34.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efceffff700 1 -- 172.21.15.133:0/2933590432 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efcf00b1590 msgr2=0x7efcf014fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:34.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efceffff700 1 --2- 172.21.15.133:0/2933590432 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efcf00b1590 0x7efcf014fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:34.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efceffff700 1 -- 172.21.15.133:0/2933590432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efcf0066f30 msgr2=0x7efcf0139630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:34.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efceffff700 1 --2- 172.21.15.133:0/2933590432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efcf0066f30 0x7efcf0139630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:34.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efceffff700 1 -- 172.21.15.133:0/2933590432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0065ff0 con 0x7efcf005f920 2021-01-03T12:58:34.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efcef7fe700 1 --2- 172.21.15.133:0/2933590432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efcf0066f30 0x7efcf0139630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:34.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efcf4f7d700 1 --2- 172.21.15.133:0/2933590432 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efcf00b1590 0x7efcf014fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:34.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efceffff700 1 --2- 172.21.15.133:0/2933590432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf005f920 0x7efcf0065a10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7efce0002f30 tx=0x7efce0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efced7fa700 1 -- 172.21.15.133:0/2933590432 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efce0011d30 con 0x7efcf005f920 2021-01-03T12:58:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efced7fa700 1 -- 172.21.15.133:0/2933590432 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce0011e90 con 0x7efcf005f920 2021-01-03T12:58:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efcf577e700 1 -- 172.21.15.133:0/2933590432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf0066290 con 0x7efcf005f920 2021-01-03T12:58:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efced7fa700 1 -- 172.21.15.133:0/2933590432 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efce001e650 con 0x7efcf005f920 2021-01-03T12:58:34.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.383+0000 7efcf577e700 1 -- 172.21.15.133:0/2933590432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf01320b0 con 0x7efcf005f920 2021-01-03T12:58:34.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.387+0000 7efcf577e700 1 -- 172.21.15.133:0/2933590432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf0057300 con 0x7efcf005f920 2021-01-03T12:58:34.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.387+0000 7efced7fa700 1 -- 172.21.15.133:0/2933590432 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7efce0025030 con 0x7efcf005f920 2021-01-03T12:58:34.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.387+0000 7efced7fa700 1 --2- 172.21.15.133:0/2933590432 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efcd4055440 0x7efcd4057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:34.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.387+0000 7efced7fa700 1 -- 172.21.15.133:0/2933590432 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5339+0+0 (secure 0 0 0) 0x7efce006efe0 con 0x7efcf005f920 2021-01-03T12:58:34.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.387+0000 7efcef7fe700 1 --2- 172.21.15.133:0/2933590432 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efcd4055440 0x7efcd4057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:34.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.387+0000 7efcef7fe700 1 --2- 172.21.15.133:0/2933590432 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efcd4055440 0x7efcd4057900 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7efcd800b000 tx=0x7efcd80070e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:34.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.391+0000 7efced7fa700 1 -- 172.21.15.133:0/2933590432 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7efce0045670 con 0x7efcf005f920 2021-01-03T12:58:34.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:34.551+0000 7efcf577e700 1 -- 172.21.15.133:0/2933590432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7efcf0061020 con 0x7efcf005f920 2021-01-03T12:58:35.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.367+0000 7efced7fa700 1 -- 172.21.15.133:0/2933590432 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7efce0023070 con 0x7efcf005f920 2021-01-03T12:58:35.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.371+0000 7efcf577e700 1 -- 172.21.15.133:0/2933590432 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efcd4055440 msgr2=0x7efcd4057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:35.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.371+0000 7efcf577e700 1 --2- 172.21.15.133:0/2933590432 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efcd4055440 0x7efcd4057900 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7efcd800b000 tx=0x7efcd80070e0).stop 2021-01-03T12:58:35.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.371+0000 7efcf577e700 1 -- 172.21.15.133:0/2933590432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf005f920 msgr2=0x7efcf0065a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:35.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.371+0000 7efcf577e700 1 --2- 172.21.15.133:0/2933590432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf005f920 0x7efcf0065a10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7efce0002f30 tx=0x7efce0015000).stop 2021-01-03T12:58:35.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.371+0000 7efcf577e700 1 -- 172.21.15.133:0/2933590432 shutdown_connections 2021-01-03T12:58:35.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.371+0000 7efcf577e700 1 --2- 172.21.15.133:0/2933590432 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efcd4055440 0x7efcd4057900 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.371+0000 7efcf577e700 1 --2- 172.21.15.133:0/2933590432 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efcf00b1590 0x7efcf014fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.371+0000 7efcf577e700 1 --2- 172.21.15.133:0/2933590432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcf005f920 0x7efcf0065a10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.371+0000 7efcf577e700 1 --2- 172.21.15.133:0/2933590432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efcf0066f30 0x7efcf0139630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.371+0000 7efcf577e700 1 -- 172.21.15.133:0/2933590432 >> 172.21.15.133:0/2933590432 conn(0x7efcf00b6110 msgr2=0x7efcf00b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:35.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.371+0000 7efcf577e700 1 -- 172.21.15.133:0/2933590432 shutdown_connections 2021-01-03T12:58:35.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.371+0000 7efcf577e700 1 -- 172.21.15.133:0/2933590432 wait complete. 2021-01-03T12:58:35.376 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blacklist entries 2021-01-03T12:58:35.390 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-01-03T12:58:35.390 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-01-03T12:58:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.499+0000 7fb0fcba4700 1 Processor -- start 2021-01-03T12:58:35.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.499+0000 7fb0fcba4700 1 -- start start 2021-01-03T12:58:35.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.499+0000 7fb0fcba4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb0f80b9f40 0x7fb0f8146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:35.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.499+0000 7fb0fcba4700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb0f8146920 0x7fb0f814d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:35.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.499+0000 7fb0fcba4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f80605f0 con 0x7fb0f80b9b60 2021-01-03T12:58:35.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.499+0000 7fb0fcba4700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f80aed30 con 0x7fb0f8146920 2021-01-03T12:58:35.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.499+0000 7fb0fcba4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f80600b0 con 0x7fb0f80b9f40 2021-01-03T12:58:35.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0f6ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb0f80b9f40 0x7fb0f8146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:35.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0f77fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb0f80b9b60 0x7fb0f80b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53820/0 (socket says 172.21.15.133:53820) 2021-01-03T12:58:35.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0f77fe700 1 -- 172.21.15.133:0/2315923065 learned_addr learned my addr 172.21.15.133:0/2315923065 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:35.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0f7fff700 1 --2- 172.21.15.133:0/2315923065 >> v2:172.21.15.16:3300/0 conn(0x7fb0f8146920 0x7fb0f814d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:35.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0f6ffd700 1 -- 172.21.15.133:0/2315923065 >> v2:172.21.15.16:3300/0 conn(0x7fb0f8146920 msgr2=0x7fb0f814d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:35.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0f6ffd700 1 --2- 172.21.15.133:0/2315923065 >> v2:172.21.15.16:3300/0 conn(0x7fb0f8146920 0x7fb0f814d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0f6ffd700 1 -- 172.21.15.133:0/2315923065 >> v1:172.21.15.133:6789/0 conn(0x7fb0f80b9b60 legacy=0x7fb0f80b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:35.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0f67fc700 1 -- 172.21.15.133:0/2315923065 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133455425 0 0) 0x7fb0f80605f0 con 0x7fb0f80b9b60 2021-01-03T12:58:35.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0f6ffd700 1 -- 172.21.15.133:0/2315923065 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f8060350 con 0x7fb0f80b9f40 2021-01-03T12:58:35.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0f7fff700 1 --2- 172.21.15.133:0/2315923065 >> v2:172.21.15.16:3300/0 conn(0x7fb0f8146920 0x7fb0f814d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:35.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0f6ffd700 1 --2- 172.21.15.133:0/2315923065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0f80b9f40 0x7fb0f8146430 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fb0e8002f30 tx=0x7fb0e8006dc0).ready entity=mon.1 client_cookie=5846e2464a48dd07 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:35.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0f67fc700 1 -- 172.21.15.133:0/2315923065 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0e80097f0 con 0x7fb0f80b9f40 2021-01-03T12:58:35.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0f67fc700 1 -- 172.21.15.133:0/2315923065 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e8009950 con 0x7fb0f80b9f40 2021-01-03T12:58:35.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0f67fc700 1 -- 172.21.15.133:0/2315923065 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0e8009cb0 con 0x7fb0f80b9f40 2021-01-03T12:58:35.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0fcba4700 1 -- 172.21.15.133:0/2315923065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0f80b9f40 msgr2=0x7fb0f8146430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:35.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0fcba4700 1 --2- 172.21.15.133:0/2315923065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0f80b9f40 0x7fb0f8146430 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fb0e8002f30 tx=0x7fb0e8006dc0).stop 2021-01-03T12:58:35.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0fcba4700 1 -- 172.21.15.133:0/2315923065 shutdown_connections 2021-01-03T12:58:35.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0fcba4700 1 --2- 172.21.15.133:0/2315923065 >> v2:172.21.15.16:3300/0 conn(0x7fb0f8146920 0x7fb0f814d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0fcba4700 1 --2- 172.21.15.133:0/2315923065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0f80b9f40 0x7fb0f8146430 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0fcba4700 1 -- 172.21.15.133:0/2315923065 >> 172.21.15.133:0/2315923065 conn(0x7fb0f80b69e0 msgr2=0x7fb0f80b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:35.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0fcba4700 1 -- 172.21.15.133:0/2315923065 shutdown_connections 2021-01-03T12:58:35.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0fcba4700 1 -- 172.21.15.133:0/2315923065 wait complete. 2021-01-03T12:58:35.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0fcba4700 1 Processor -- start 2021-01-03T12:58:35.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.503+0000 7fb0fcba4700 1 -- start start 2021-01-03T12:58:35.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0fcba4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0f80b9b60 0x7fb0f809d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:35.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0fcba4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0f80b9f40 0x7fb0f809daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:35.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0fcba4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb0f8146920 0x7fb0f8152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:35.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0fcba4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f809dfe0 con 0x7fb0f80b9f40 2021-01-03T12:58:35.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0fcba4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f8152920 con 0x7fb0f80b9b60 2021-01-03T12:58:35.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0fcba4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f809e220 con 0x7fb0f8146920 2021-01-03T12:58:35.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0f77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0f80b9b60 0x7fb0f809d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:35.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0f77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0f80b9b60 0x7fb0f809d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32792/0 (socket says 172.21.15.133:32792) 2021-01-03T12:58:35.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0f77fe700 1 -- 172.21.15.133:0/947937763 learned_addr learned my addr 172.21.15.133:0/947937763 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:35.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0f6ffd700 1 --2- 172.21.15.133:0/947937763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0f80b9f40 0x7fb0f809daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:35.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0f7fff700 1 --2- 172.21.15.133:0/947937763 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb0f8146920 0x7fb0f8152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:35.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0f77fe700 1 -- 172.21.15.133:0/947937763 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb0f8146920 msgr2=0x7fb0f8152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:35.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0f77fe700 1 --2- 172.21.15.133:0/947937763 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb0f8146920 0x7fb0f8152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0f77fe700 1 -- 172.21.15.133:0/947937763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0f80b9f40 msgr2=0x7fb0f809daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:35.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0f77fe700 1 --2- 172.21.15.133:0/947937763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0f80b9f40 0x7fb0f809daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0f77fe700 1 -- 172.21.15.133:0/947937763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f8151cf0 con 0x7fb0f80b9b60 2021-01-03T12:58:35.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0f6ffd700 1 --2- 172.21.15.133:0/947937763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0f80b9f40 0x7fb0f809daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0f77fe700 1 --2- 172.21.15.133:0/947937763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0f80b9b60 0x7fb0f809d270 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fb0e0000e90 tx=0x7fb0e0007a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0f4ff9700 1 -- 172.21.15.133:0/947937763 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0e00072e0 con 0x7fb0f80b9b60 2021-01-03T12:58:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0f4ff9700 1 -- 172.21.15.133:0/947937763 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e0007440 con 0x7fb0f80b9b60 2021-01-03T12:58:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0fcba4700 1 -- 172.21.15.133:0/947937763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f8151f90 con 0x7fb0f80b9b60 2021-01-03T12:58:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0f4ff9700 1 -- 172.21.15.133:0/947937763 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0e00057d0 con 0x7fb0f80b9b60 2021-01-03T12:58:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0fcba4700 1 -- 172.21.15.133:0/947937763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f809ca20 con 0x7fb0f80b9b60 2021-01-03T12:58:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.507+0000 7fb0fcba4700 1 -- 172.21.15.133:0/947937763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f8152120 con 0x7fb0f80b9b60 2021-01-03T12:58:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.511+0000 7fb0f4ff9700 1 -- 172.21.15.133:0/947937763 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb0e001a060 con 0x7fb0f80b9b60 2021-01-03T12:58:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.511+0000 7fb0f4ff9700 1 --2- 172.21.15.133:0/947937763 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb0dc055330 0x7fb0dc0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.511+0000 7fb0f4ff9700 1 -- 172.21.15.133:0/947937763 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb0e006d370 con 0x7fb0f80b9b60 2021-01-03T12:58:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.511+0000 7fb0f6ffd700 1 --2- 172.21.15.133:0/947937763 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb0dc055330 0x7fb0dc0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.511+0000 7fb0f6ffd700 1 --2- 172.21.15.133:0/947937763 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb0dc055330 0x7fb0dc0577f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb0e801b000 tx=0x7fb0e8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.519+0000 7fb0f4ff9700 1 -- 172.21.15.133:0/947937763 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb0e00439a0 con 0x7fb0f80b9b60 2021-01-03T12:58:35.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.703+0000 7fb0fcba4700 1 -- 172.21.15.133:0/947937763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb0f8057300 con 0x7fb0f80b9b60 2021-01-03T12:58:35.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.703+0000 7fb0f4ff9700 1 -- 172.21.15.133:0/947937763 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+5621 (secure 0 0 0) 0x7fb0e0018070 con 0x7fb0f80b9b60 2021-01-03T12:58:35.705 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:35.705 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T12:58:35.706 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2021-01-03T12:58:35.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.706 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2021-01-03T12:58:35.706 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Fflox9BxAA6coLDFV/FaQ/G/cvtonWgg==", 2021-01-03T12:58:35.706 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T12:58:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:58:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:58:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:58:35.707 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2021-01-03T12:58:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfrnWWFRAA3PHH/FJOvDozCChrb1T8Dg==", 2021-01-03T12:58:35.708 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T12:58:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:58:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:58:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:58:35.709 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.710 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.710 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2021-01-03T12:58:35.710 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfpPPLDxAAVvg80vLejYKDH485/L1gSQ==", 2021-01-03T12:58:35.710 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.711 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T12:58:35.711 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:58:35.711 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:58:35.711 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:58:35.711 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.712 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2021-01-03T12:58:35.712 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAnv/FfQ+CcDRAAUkTDLby5scMkNzxa0lVdAQ==", 2021-01-03T12:58:35.712 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.713 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:58:35.713 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:58:35.713 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:58:35.713 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.714 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2021-01-03T12:58:35.714 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApv/Ff1iilLhAAbK9hZmL772nNKAEJ4i+pkw==", 2021-01-03T12:58:35.714 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.714 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:58:35.715 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:58:35.715 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:58:35.715 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.716 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2021-01-03T12:58:35.716 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAsv/Ffmoe2FhAA1EbxU5yHncN+pbC/EX6d9A==", 2021-01-03T12:58:35.716 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.716 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:58:35.716 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:58:35.716 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:58:35.717 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.717 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2021-01-03T12:58:35.717 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAuv/FfJh/VORAAG9aCOh5s/2Lw+yN9hBFWLw==", 2021-01-03T12:58:35.718 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.718 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:58:35.718 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:58:35.718 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:58:35.718 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.719 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2021-01-03T12:58:35.719 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyv/Ffus0NJhAALX1TIqQ9EIupaX8KtRu7rQ==", 2021-01-03T12:58:35.719 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.720 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:58:35.720 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:58:35.720 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:58:35.720 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.720 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.721 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2021-01-03T12:58:35.721 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1v/FfoL6kDBAAggoRy/o0qas/41yLYqDVgA==", 2021-01-03T12:58:35.721 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.721 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:58:35.722 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:58:35.722 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:58:35.722 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.722 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.723 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2021-01-03T12:58:35.723 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA3v/FfwOPCMBAAGOt8ShPQ/szNbCfaP/uZEQ==", 2021-01-03T12:58:35.723 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.723 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:58:35.723 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:58:35.724 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:58:35.724 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.724 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2021-01-03T12:58:35.725 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA6v/Ffoz5xFxAAn3xvUDSeNSWrBJTa1Nsb6w==", 2021-01-03T12:58:35.725 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.725 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:58:35.725 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:58:35.725 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:58:35.725 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.726 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.726 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.726 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2021-01-03T12:58:35.726 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfyGlbGxAALm0NezvPiTAnlwu8iPEuCw==", 2021-01-03T12:58:35.726 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.727 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T12:58:35.727 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2021-01-03T12:58:35.727 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2021-01-03T12:58:35.727 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2021-01-03T12:58:35.727 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.728 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.728 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2021-01-03T12:58:35.728 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Ffa2AFHhAAD4Pq5zMJ28SqqEosBA9vnQ==", 2021-01-03T12:58:35.728 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.729 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T12:58:35.729 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2021-01-03T12:58:35.729 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2021-01-03T12:58:35.729 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2021-01-03T12:58:35.729 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.730 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2021-01-03T12:58:35.730 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjv/FfjxN8JxAAkV2Ia66fh21QYMX5fr1gTw==", 2021-01-03T12:58:35.730 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.731 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T12:58:35.731 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:58:35.731 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:58:35.731 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:58:35.731 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.732 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-mds", 2021-01-03T12:58:35.732 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBHv/FfT5DvERAABI6zEx6gZjLxSc8XEji52A==", 2021-01-03T12:58:35.732 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.733 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-mds" 2021-01-03T12:58:35.733 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.733 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.733 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.733 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-mgr", 2021-01-03T12:58:35.734 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBHv/Ff867vERAAHk4shI8jJDyTBlCypYVcUg==", 2021-01-03T12:58:35.734 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.734 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-mgr" 2021-01-03T12:58:35.734 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.735 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.735 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-osd", 2021-01-03T12:58:35.736 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBHv/FfTMfvERAAddIzhsroCJ667I/nnHuGlw==", 2021-01-03T12:58:35.736 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.736 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-osd" 2021-01-03T12:58:35.736 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.736 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.737 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.737 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-rbd", 2021-01-03T12:58:35.737 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBHv/Ffs+DvERAAn52P9IpEi/uK26DgIDBFGg==", 2021-01-03T12:58:35.737 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.737 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-rbd" 2021-01-03T12:58:35.738 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.738 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.738 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.738 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-rbd-mirror", 2021-01-03T12:58:35.738 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBHv/FfSvvvERAAiLYvrYcWzFJWtUEJsYpD1g==", 2021-01-03T12:58:35.739 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.739 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2021-01-03T12:58:35.739 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.739 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.739 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.740 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-rgw", 2021-01-03T12:58:35.740 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBHv/Ff/hTwERAAhOChsYZ+h4S0xe6wqxLu2w==", 2021-01-03T12:58:35.740 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.740 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-rgw" 2021-01-03T12:58:35.740 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.741 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.741 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.741 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2021-01-03T12:58:35.741 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAU/DBBAASi+hx05pZEsP+dV9iwbz4g==", 2021-01-03T12:58:35.741 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.742 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T12:58:35.742 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T12:58:35.742 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:58:35.742 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.742 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:35.743 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:35.743 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2021-01-03T12:58:35.743 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAOFAAhAAPQOSkofyJoEYvcAqKK2+Mg==", 2021-01-03T12:58:35.743 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:58:35.743 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T12:58:35.744 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T12:58:35.744 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:58:35.744 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.744 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:35.744 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:58:35.745 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T12:58:35.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.707+0000 7fb0fcba4700 1 -- 172.21.15.133:0/947937763 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb0dc055330 msgr2=0x7fb0dc0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:35.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.707+0000 7fb0fcba4700 1 --2- 172.21.15.133:0/947937763 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb0dc055330 0x7fb0dc0577f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb0e801b000 tx=0x7fb0e8015000).stop 2021-01-03T12:58:35.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.707+0000 7fb0fcba4700 1 -- 172.21.15.133:0/947937763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0f80b9b60 msgr2=0x7fb0f809d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:35.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.707+0000 7fb0fcba4700 1 --2- 172.21.15.133:0/947937763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0f80b9b60 0x7fb0f809d270 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fb0e0000e90 tx=0x7fb0e0007a90).stop 2021-01-03T12:58:35.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.707+0000 7fb0fcba4700 1 -- 172.21.15.133:0/947937763 shutdown_connections 2021-01-03T12:58:35.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.707+0000 7fb0fcba4700 1 --2- 172.21.15.133:0/947937763 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb0dc055330 0x7fb0dc0577f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.707+0000 7fb0fcba4700 1 --2- 172.21.15.133:0/947937763 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb0f8146920 0x7fb0f8152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.707+0000 7fb0fcba4700 1 --2- 172.21.15.133:0/947937763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0f80b9b60 0x7fb0f809d270 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.707+0000 7fb0fcba4700 1 --2- 172.21.15.133:0/947937763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0f80b9f40 0x7fb0f809daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.707+0000 7fb0fcba4700 1 -- 172.21.15.133:0/947937763 >> 172.21.15.133:0/947937763 conn(0x7fb0f80b69e0 msgr2=0x7fb0f80b7050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:35.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.707+0000 7fb0fcba4700 1 -- 172.21.15.133:0/947937763 shutdown_connections 2021-01-03T12:58:35.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.707+0000 7fb0fcba4700 1 -- 172.21.15.133:0/947937763 wait complete. 2021-01-03T12:58:35.749 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-mds 2021-01-03T12:58:35.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.863+0000 7fca0ccd4700 1 Processor -- start 2021-01-03T12:58:35.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.863+0000 7fca0ccd4700 1 -- start start 2021-01-03T12:58:35.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.863+0000 7fca0ccd4700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fca080b5330 0x7fca080abd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:35.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.863+0000 7fca0ccd4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca080b5ae0 0x7fca08142c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:35.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.863+0000 7fca0ccd4700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca080b5710 con 0x7fca08099ff0 2021-01-03T12:58:35.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.863+0000 7fca0ccd4700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca080b10f0 con 0x7fca080b5330 2021-01-03T12:58:35.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.863+0000 7fca0ccd4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca080ac270 con 0x7fca080b5ae0 2021-01-03T12:58:35.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.863+0000 7fca06ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca080b5ae0 0x7fca08142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:35.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.863+0000 7fca06ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fca080b5ae0 0x7fca08142c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32802/0 (socket says 172.21.15.133:32802) 2021-01-03T12:58:35.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.863+0000 7fca06ffd700 1 -- 172.21.15.133:0/219814983 learned_addr learned my addr 172.21.15.133:0/219814983 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:35.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.863+0000 7fca077fe700 1 --2- 172.21.15.133:0/219814983 >> v2:172.21.15.16:3300/0 conn(0x7fca080b5330 0x7fca080abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:35.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.863+0000 7fca06ffd700 1 -- 172.21.15.133:0/219814983 >> v2:172.21.15.16:3300/0 conn(0x7fca080b5330 msgr2=0x7fca080abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:35.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.863+0000 7fca06ffd700 1 --2- 172.21.15.133:0/219814983 >> v2:172.21.15.16:3300/0 conn(0x7fca080b5330 0x7fca080abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.863+0000 7fca06ffd700 1 -- 172.21.15.133:0/219814983 >> v1:172.21.15.16:6789/0 conn(0x7fca08099ff0 legacy=0x7fca0813fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:35.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.863+0000 7fca06ffd700 1 -- 172.21.15.133:0/219814983 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca080ab280 con 0x7fca080b5ae0 2021-01-03T12:58:35.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca06ffd700 1 --2- 172.21.15.133:0/219814983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca080b5ae0 0x7fca08142c90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fc9f0002f30 tx=0x7fc9f0006e80).ready entity=mon.1 client_cookie=ab51971cc5ec00a8 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:35.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca067fc700 1 -- 172.21.15.133:0/219814983 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9f00097f0 con 0x7fca080b5ae0 2021-01-03T12:58:35.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca067fc700 1 -- 172.21.15.133:0/219814983 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f0009950 con 0x7fca080b5ae0 2021-01-03T12:58:35.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca067fc700 1 -- 172.21.15.133:0/219814983 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9f0009cb0 con 0x7fca080b5ae0 2021-01-03T12:58:35.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca0ccd4700 1 -- 172.21.15.133:0/219814983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca080b5ae0 msgr2=0x7fca08142c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:35.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca0ccd4700 1 --2- 172.21.15.133:0/219814983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca080b5ae0 0x7fca08142c90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fc9f0002f30 tx=0x7fc9f0006e80).stop 2021-01-03T12:58:35.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca0ccd4700 1 -- 172.21.15.133:0/219814983 shutdown_connections 2021-01-03T12:58:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca0ccd4700 1 --2- 172.21.15.133:0/219814983 >> v2:172.21.15.16:3300/0 conn(0x7fca080b5330 0x7fca080abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca0ccd4700 1 --2- 172.21.15.133:0/219814983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca080b5ae0 0x7fca08142c90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca0ccd4700 1 -- 172.21.15.133:0/219814983 >> 172.21.15.133:0/219814983 conn(0x7fca0805bdf0 msgr2=0x7fca0805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca0ccd4700 1 -- 172.21.15.133:0/219814983 shutdown_connections 2021-01-03T12:58:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca0ccd4700 1 -- 172.21.15.133:0/219814983 wait complete. 2021-01-03T12:58:35.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca0ccd4700 1 Processor -- start 2021-01-03T12:58:35.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca0ccd4700 1 -- start start 2021-01-03T12:58:35.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca0ccd4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca08099ff0 0x7fca081489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca0ccd4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fca080b5330 0x7fca08155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca0ccd4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca080b5ae0 0x7fca08155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca0ccd4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca08143710 con 0x7fca08099ff0 2021-01-03T12:58:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca0ccd4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca08152820 con 0x7fca080b5ae0 2021-01-03T12:58:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.867+0000 7fca0ccd4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca08145550 con 0x7fca080b5330 2021-01-03T12:58:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca07fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca080b5ae0 0x7fca08155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca07fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca080b5ae0 0x7fca08155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32810/0 (socket says 172.21.15.133:32810) 2021-01-03T12:58:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca077fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca08099ff0 0x7fca081489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca07fff700 1 -- 172.21.15.133:0/1115357530 learned_addr learned my addr 172.21.15.133:0/1115357530 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:35.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca06ffd700 1 --2- 172.21.15.133:0/1115357530 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fca080b5330 0x7fca08155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:35.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca07fff700 1 -- 172.21.15.133:0/1115357530 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fca080b5330 msgr2=0x7fca08155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:35.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca07fff700 1 --2- 172.21.15.133:0/1115357530 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fca080b5330 0x7fca08155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca07fff700 1 -- 172.21.15.133:0/1115357530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca08099ff0 msgr2=0x7fca081489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:35.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca07fff700 1 --2- 172.21.15.133:0/1115357530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca08099ff0 0x7fca081489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:35.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca07fff700 1 -- 172.21.15.133:0/1115357530 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca081457f0 con 0x7fca080b5ae0 2021-01-03T12:58:35.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca07fff700 1 --2- 172.21.15.133:0/1115357530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca080b5ae0 0x7fca08155550 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fca08061d80 tx=0x7fca00007f10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:35.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca04ff9700 1 -- 172.21.15.133:0/1115357530 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca0000ce20 con 0x7fca080b5ae0 2021-01-03T12:58:35.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca04ff9700 1 -- 172.21.15.133:0/1115357530 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0000a7b0 con 0x7fca080b5ae0 2021-01-03T12:58:35.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca0ccd4700 1 -- 172.21.15.133:0/1115357530 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca08152510 con 0x7fca080b5ae0 2021-01-03T12:58:35.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca04ff9700 1 -- 172.21.15.133:0/1115357530 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca0000ab10 con 0x7fca080b5ae0 2021-01-03T12:58:35.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca0ccd4700 1 -- 172.21.15.133:0/1115357530 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca08145c90 con 0x7fca080b5ae0 2021-01-03T12:58:35.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca0ccd4700 1 -- 172.21.15.133:0/1115357530 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca08145f40 con 0x7fca080b5ae0 2021-01-03T12:58:35.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.871+0000 7fca04ff9700 1 -- 172.21.15.133:0/1115357530 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fca00019030 con 0x7fca080b5ae0 2021-01-03T12:58:35.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.875+0000 7fca04ff9700 1 --2- 172.21.15.133:0/1115357530 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9ec055440 0x7fc9ec057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:35.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.875+0000 7fca077fe700 1 --2- 172.21.15.133:0/1115357530 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9ec055440 0x7fc9ec057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:35.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.875+0000 7fca04ff9700 1 -- 172.21.15.133:0/1115357530 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fca0006d510 con 0x7fca080b5ae0 2021-01-03T12:58:35.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.875+0000 7fca077fe700 1 --2- 172.21.15.133:0/1115357530 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9ec055440 0x7fc9ec057900 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fc9f800b000 tx=0x7fc9f8006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:35.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:35.879+0000 7fca04ff9700 1 -- 172.21.15.133:0/1115357530 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fca00043b40 con 0x7fca080b5ae0 2021-01-03T12:58:36.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.067+0000 7fca0ccd4700 1 -- 172.21.15.133:0/1115357530 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fca081529f0 con 0x7fca080b5ae0 2021-01-03T12:58:36.078 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.075+0000 7fca04ff9700 1 -- 172.21.15.133:0/1115357530 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v5) v1 ==== 97+0+0 (secure 0 0 0) 0x7fca00047160 con 0x7fca080b5ae0 2021-01-03T12:58:36.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.079+0000 7fca0ccd4700 1 -- 172.21.15.133:0/1115357530 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9ec055440 msgr2=0x7fc9ec057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.079+0000 7fca0ccd4700 1 --2- 172.21.15.133:0/1115357530 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9ec055440 0x7fc9ec057900 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fc9f800b000 tx=0x7fc9f8006dc0).stop 2021-01-03T12:58:36.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.079+0000 7fca0ccd4700 1 -- 172.21.15.133:0/1115357530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca080b5ae0 msgr2=0x7fca08155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.079+0000 7fca0ccd4700 1 --2- 172.21.15.133:0/1115357530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca080b5ae0 0x7fca08155550 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fca08061d80 tx=0x7fca00007f10).stop 2021-01-03T12:58:36.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.079+0000 7fca0ccd4700 1 -- 172.21.15.133:0/1115357530 shutdown_connections 2021-01-03T12:58:36.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.079+0000 7fca0ccd4700 1 --2- 172.21.15.133:0/1115357530 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9ec055440 0x7fc9ec057900 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.079+0000 7fca0ccd4700 1 --2- 172.21.15.133:0/1115357530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fca08099ff0 0x7fca081489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.079+0000 7fca0ccd4700 1 --2- 172.21.15.133:0/1115357530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca080b5ae0 0x7fca08155550 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.079+0000 7fca0ccd4700 1 --2- 172.21.15.133:0/1115357530 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fca080b5330 0x7fca08155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.079+0000 7fca0ccd4700 1 -- 172.21.15.133:0/1115357530 >> 172.21.15.133:0/1115357530 conn(0x7fca0805bdf0 msgr2=0x7fca080af920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:36.083 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.079+0000 7fca0ccd4700 1 -- 172.21.15.133:0/1115357530 shutdown_connections 2021-01-03T12:58:36.083 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.079+0000 7fca0ccd4700 1 -- 172.21.15.133:0/1115357530 wait complete. 2021-01-03T12:58:36.083 INFO:teuthology.orchestra.run.smithi133.stderr:updated 2021-01-03T12:58:36.092 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-mgr 2021-01-03T12:58:36.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f87230b1700 1 Processor -- start 2021-01-03T12:58:36.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f87230b1700 1 -- start start 2021-01-03T12:58:36.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f87230b1700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f871c140480 0x7f871c0afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:36.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f87230b1700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871c05cca0 con 0x7f871c0af7a0 2021-01-03T12:58:36.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f87230b1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f871c0b0270 con 0x7f871c05c7c0 2021-01-03T12:58:36.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f87230b1700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871c0b0070 con 0x7f871c140480 2021-01-03T12:58:36.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f871bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f871c05c7c0 0x7f871c1466c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53848/0 (socket says 172.21.15.133:53848) 2021-01-03T12:58:36.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f871bfff700 1 -- 172.21.15.133:0/4145363974 learned_addr learned my addr 172.21.15.133:0/4145363974 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:36.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f872164e700 1 --2- 172.21.15.133:0/4145363974 >> v2:172.21.15.16:3300/0 conn(0x7f871c140480 0x7f871c0afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:36.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f871b7fe700 1 -- 172.21.15.133:0/4145363974 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497661808 0 0) 0x7f871c0b0270 con 0x7f871c05c7c0 2021-01-03T12:58:36.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f871b7fe700 1 -- 172.21.15.133:0/4145363974 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8708003230 con 0x7f871c05c7c0 2021-01-03T12:58:36.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f872164e700 1 -- 172.21.15.133:0/4145363974 >> v1:172.21.15.133:6789/0 conn(0x7f871c05c7c0 legacy=0x7f871c1466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f872164e700 1 -- 172.21.15.133:0/4145363974 >> v1:172.21.15.16:6789/0 conn(0x7f871c0af7a0 legacy=0x7f871c13fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f872164e700 1 -- 172.21.15.133:0/4145363974 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c0b0510 con 0x7f871c140480 2021-01-03T12:58:36.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f872164e700 1 --2- 172.21.15.133:0/4145363974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f871c140480 0x7f871c0afb80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f870c002f30 tx=0x7f870c006dc0).ready entity=mon.0 client_cookie=1aab8f607ff63067 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:36.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f871b7fe700 1 -- 172.21.15.133:0/4145363974 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f870c009800 con 0x7f871c140480 2021-01-03T12:58:36.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f871b7fe700 1 -- 172.21.15.133:0/4145363974 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c009960 con 0x7f871c140480 2021-01-03T12:58:36.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f871b7fe700 1 -- 172.21.15.133:0/4145363974 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f870c009cc0 con 0x7f871c140480 2021-01-03T12:58:36.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f87230b1700 1 -- 172.21.15.133:0/4145363974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f871c140480 msgr2=0x7f871c0afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.203+0000 7f87230b1700 1 --2- 172.21.15.133:0/4145363974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f871c140480 0x7f871c0afb80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f870c002f30 tx=0x7f870c006dc0).stop 2021-01-03T12:58:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f87230b1700 1 -- 172.21.15.133:0/4145363974 shutdown_connections 2021-01-03T12:58:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f87230b1700 1 --2- 172.21.15.133:0/4145363974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f871c140480 0x7f871c0afb80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f87230b1700 1 -- 172.21.15.133:0/4145363974 >> 172.21.15.133:0/4145363974 conn(0x7f871c0b9620 msgr2=0x7f871c0b9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:36.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f87230b1700 1 -- 172.21.15.133:0/4145363974 shutdown_connections 2021-01-03T12:58:36.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f87230b1700 1 -- 172.21.15.133:0/4145363974 wait complete. 2021-01-03T12:58:36.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f87230b1700 1 Processor -- start 2021-01-03T12:58:36.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f87230b1700 1 -- start start 2021-01-03T12:58:36.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f87230b1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f871c05c7c0 0x7f871c13ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:36.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f87230b1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f871c0af7a0 0x7f871c155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:36.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f87230b1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f871c140480 0x7f871c155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:36.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f87230b1700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c0b8a40 con 0x7f871c0af7a0 2021-01-03T12:58:36.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f87230b1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c144470 con 0x7f871c05c7c0 2021-01-03T12:58:36.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f87230b1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c144710 con 0x7f871c140480 2021-01-03T12:58:36.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f8720e4d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f871c05c7c0 0x7f871c13ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:36.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f8720e4d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f871c05c7c0 0x7f871c13ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32820/0 (socket says 172.21.15.133:32820) 2021-01-03T12:58:36.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f8720e4d700 1 -- 172.21.15.133:0/3556923142 learned_addr learned my addr 172.21.15.133:0/3556923142 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:36.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f871bfff700 1 --2- 172.21.15.133:0/3556923142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f871c0af7a0 0x7f871c155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:36.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f872164e700 1 --2- 172.21.15.133:0/3556923142 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f871c140480 0x7f871c155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f8720e4d700 1 -- 172.21.15.133:0/3556923142 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f871c140480 msgr2=0x7f871c155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f8720e4d700 1 --2- 172.21.15.133:0/3556923142 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f871c140480 0x7f871c155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f8720e4d700 1 -- 172.21.15.133:0/3556923142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f871c0af7a0 msgr2=0x7f871c155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f8720e4d700 1 --2- 172.21.15.133:0/3556923142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f871c0af7a0 0x7f871c155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f8720e4d700 1 -- 172.21.15.133:0/3556923142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c0b9200 con 0x7f871c05c7c0 2021-01-03T12:58:36.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.207+0000 7f8720e4d700 1 --2- 172.21.15.133:0/3556923142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f871c05c7c0 0x7f871c13ebc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f871c06b1a0 tx=0x7f8714001460).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:36.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.211+0000 7f8719ffb700 1 -- 172.21.15.133:0/3556923142 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f871400ce40 con 0x7f871c05c7c0 2021-01-03T12:58:36.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.211+0000 7f8719ffb700 1 -- 172.21.15.133:0/3556923142 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871400a7b0 con 0x7f871c05c7c0 2021-01-03T12:58:36.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.211+0000 7f87230b1700 1 -- 172.21.15.133:0/3556923142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871c145480 con 0x7f871c05c7c0 2021-01-03T12:58:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.211+0000 7f8719ffb700 1 -- 172.21.15.133:0/3556923142 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f871400ab10 con 0x7f871c05c7c0 2021-01-03T12:58:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.211+0000 7f87230b1700 1 -- 172.21.15.133:0/3556923142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871c1459b0 con 0x7f871c05c7c0 2021-01-03T12:58:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.211+0000 7f87230b1700 1 -- 172.21.15.133:0/3556923142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871c0b8bb0 con 0x7f871c05c7c0 2021-01-03T12:58:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.211+0000 7f8719ffb700 1 -- 172.21.15.133:0/3556923142 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8714019030 con 0x7f871c05c7c0 2021-01-03T12:58:36.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.211+0000 7f8719ffb700 1 --2- 172.21.15.133:0/3556923142 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f86fc0554e0 0x7f86fc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.211+0000 7f871bfff700 1 --2- 172.21.15.133:0/3556923142 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f86fc0554e0 0x7f86fc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.211+0000 7f8719ffb700 1 -- 172.21.15.133:0/3556923142 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f871406d520 con 0x7f871c05c7c0 2021-01-03T12:58:36.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.211+0000 7f871bfff700 1 --2- 172.21.15.133:0/3556923142 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f86fc0554e0 0x7f86fc0579a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f871000d000 tx=0x7f8710009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:36.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.215+0000 7f8719ffb700 1 -- 172.21.15.133:0/3556923142 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f871c0b8bb0 con 0x7f871c05c7c0 2021-01-03T12:58:36.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.407+0000 7f87230b1700 1 -- 172.21.15.133:0/3556923142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f871c0b8bb0 con 0x7f871c05c7c0 2021-01-03T12:58:36.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.419+0000 7f8719ffb700 1 -- 172.21.15.133:0/3556923142 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7f871c0b8bb0 con 0x7f871c05c7c0 2021-01-03T12:58:36.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.423+0000 7f87230b1700 1 -- 172.21.15.133:0/3556923142 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f86fc0554e0 msgr2=0x7f86fc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.423+0000 7f87230b1700 1 --2- 172.21.15.133:0/3556923142 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f86fc0554e0 0x7f86fc0579a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f871000d000 tx=0x7f8710009040).stop 2021-01-03T12:58:36.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.423+0000 7f87230b1700 1 -- 172.21.15.133:0/3556923142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f871c05c7c0 msgr2=0x7f871c13ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.423+0000 7f87230b1700 1 --2- 172.21.15.133:0/3556923142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f871c05c7c0 0x7f871c13ebc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f871c06b1a0 tx=0x7f8714001460).stop 2021-01-03T12:58:36.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.423+0000 7f87230b1700 1 -- 172.21.15.133:0/3556923142 shutdown_connections 2021-01-03T12:58:36.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.423+0000 7f87230b1700 1 --2- 172.21.15.133:0/3556923142 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f86fc0554e0 0x7f86fc0579a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.423+0000 7f87230b1700 1 --2- 172.21.15.133:0/3556923142 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f871c140480 0x7f871c155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.423+0000 7f87230b1700 1 --2- 172.21.15.133:0/3556923142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f871c05c7c0 0x7f871c13ebc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.423+0000 7f87230b1700 1 --2- 172.21.15.133:0/3556923142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f871c0af7a0 0x7f871c155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.423+0000 7f87230b1700 1 -- 172.21.15.133:0/3556923142 >> 172.21.15.133:0/3556923142 conn(0x7f871c0b9620 msgr2=0x7f871c139870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:36.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.423+0000 7f87230b1700 1 -- 172.21.15.133:0/3556923142 shutdown_connections 2021-01-03T12:58:36.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.423+0000 7f87230b1700 1 -- 172.21.15.133:0/3556923142 wait complete. 2021-01-03T12:58:36.429 INFO:teuthology.orchestra.run.smithi133.stderr:updated 2021-01-03T12:58:36.440 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-osd 2021-01-03T12:58:36.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.551+0000 7f2684b04700 1 Processor -- start 2021-01-03T12:58:36.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.551+0000 7f2684b04700 1 -- start start 2021-01-03T12:58:36.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.551+0000 7f2684b04700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26800b9b60 0x7f26800b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:36.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f2684b04700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26800605f0 con 0x7f26800b4e10 2021-01-03T12:58:36.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f2684b04700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26800600b0 con 0x7f26800b4980 2021-01-03T12:58:36.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f2684b04700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26800aed30 con 0x7f26800b9b60 2021-01-03T12:58:36.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f267f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26800b9b60 0x7f26800b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:36.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f267effd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f26800b4980 0x7f2680146430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53860/0 (socket says 172.21.15.133:53860) 2021-01-03T12:58:36.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f267effd700 1 -- 172.21.15.133:0/2420487593 learned_addr learned my addr 172.21.15.133:0/2420487593 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:36.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f267f7fe700 1 -- 172.21.15.133:0/2420487593 >> v1:172.21.15.133:6789/0 conn(0x7f26800b4980 legacy=0x7f2680146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f267f7fe700 1 -- 172.21.15.133:0/2420487593 >> v1:172.21.15.16:6789/0 conn(0x7f26800b4e10 legacy=0x7f268014d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f267e7fc700 1 -- 172.21.15.133:0/2420487593 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209875473 0 0) 0x7f26800600b0 con 0x7f26800b4980 2021-01-03T12:58:36.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f267f7fe700 1 -- 172.21.15.133:0/2420487593 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2680060350 con 0x7f26800b9b60 2021-01-03T12:58:36.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f267f7fe700 1 --2- 172.21.15.133:0/2420487593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26800b9b60 0x7f26800b9f40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f2668002f30 tx=0x7f2668006dc0).ready entity=mon.1 client_cookie=5ad9e2bfc2052f4a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:36.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f267e7fc700 1 -- 172.21.15.133:0/2420487593 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26680097f0 con 0x7f26800b9b60 2021-01-03T12:58:36.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f267e7fc700 1 -- 172.21.15.133:0/2420487593 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2668009950 con 0x7f26800b9b60 2021-01-03T12:58:36.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f267e7fc700 1 -- 172.21.15.133:0/2420487593 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2668009cb0 con 0x7f26800b9b60 2021-01-03T12:58:36.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f2684b04700 1 -- 172.21.15.133:0/2420487593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26800b9b60 msgr2=0x7f26800b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f2684b04700 1 --2- 172.21.15.133:0/2420487593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26800b9b60 0x7f26800b9f40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f2668002f30 tx=0x7f2668006dc0).stop 2021-01-03T12:58:36.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f2684b04700 1 -- 172.21.15.133:0/2420487593 shutdown_connections 2021-01-03T12:58:36.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f2684b04700 1 --2- 172.21.15.133:0/2420487593 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26800b9b60 0x7f26800b9f40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f2684b04700 1 -- 172.21.15.133:0/2420487593 >> 172.21.15.133:0/2420487593 conn(0x7f26800b69e0 msgr2=0x7f26800b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f2684b04700 1 -- 172.21.15.133:0/2420487593 shutdown_connections 2021-01-03T12:58:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.555+0000 7f2684b04700 1 -- 172.21.15.133:0/2420487593 wait complete. 2021-01-03T12:58:36.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.559+0000 7f2684b04700 1 Processor -- start 2021-01-03T12:58:36.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.559+0000 7f2684b04700 1 -- start start 2021-01-03T12:58:36.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.559+0000 7f2684b04700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f26800b4980 0x7f26801482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:36.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.559+0000 7f2684b04700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26800b4e10 0x7f26800b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:36.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.559+0000 7f2684b04700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26800b9b60 0x7f26800b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:36.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.559+0000 7f2684b04700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2680147490 con 0x7f26800b4e10 2021-01-03T12:58:36.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.559+0000 7f2684b04700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26800b02f0 con 0x7f26800b9b60 2021-01-03T12:58:36.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.559+0000 7f2684b04700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2680155330 con 0x7f26800b4980 2021-01-03T12:58:36.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.559+0000 7f267ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26800b9b60 0x7f26800b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.559+0000 7f267f7fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f26800b4980 0x7f26801482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.559+0000 7f267ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26800b9b60 0x7f26800b31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32838/0 (socket says 172.21.15.133:32838) 2021-01-03T12:58:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.559+0000 7f267ffff700 1 -- 172.21.15.133:0/2290580815 learned_addr learned my addr 172.21.15.133:0/2290580815 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:36.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.559+0000 7f267effd700 1 --2- 172.21.15.133:0/2290580815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26800b4e10 0x7f26800b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:36.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.563+0000 7f267f7fe700 1 -- 172.21.15.133:0/2290580815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26800b9b60 msgr2=0x7f26800b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.563+0000 7f267f7fe700 1 --2- 172.21.15.133:0/2290580815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26800b9b60 0x7f26800b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.563+0000 7f267f7fe700 1 -- 172.21.15.133:0/2290580815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26800b4e10 msgr2=0x7f26800b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.563+0000 7f267f7fe700 1 --2- 172.21.15.133:0/2290580815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26800b4e10 0x7f26800b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.563+0000 7f267f7fe700 1 -- 172.21.15.133:0/2290580815 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2680147ba0 con 0x7f26800b4980 2021-01-03T12:58:36.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.563+0000 7f267f7fe700 1 --2- 172.21.15.133:0/2290580815 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f26800b4980 0x7f26801482e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2668002f30 tx=0x7f2668015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:36.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.563+0000 7f267cff9700 1 -- 172.21.15.133:0/2290580815 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2668011e50 con 0x7f26800b4980 2021-01-03T12:58:36.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.563+0000 7f2684b04700 1 -- 172.21.15.133:0/2290580815 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2680147e40 con 0x7f26800b4980 2021-01-03T12:58:36.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.563+0000 7f267cff9700 1 -- 172.21.15.133:0/2290580815 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266801d450 con 0x7f26800b4980 2021-01-03T12:58:36.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.563+0000 7f267cff9700 1 -- 172.21.15.133:0/2290580815 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f266801d5c0 con 0x7f26800b4980 2021-01-03T12:58:36.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.563+0000 7f2684b04700 1 -- 172.21.15.133:0/2290580815 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268009f360 con 0x7f26800b4980 2021-01-03T12:58:36.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.563+0000 7f2684b04700 1 -- 172.21.15.133:0/2290580815 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2680057300 con 0x7f26800b4980 2021-01-03T12:58:36.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.563+0000 7f267cff9700 1 -- 172.21.15.133:0/2290580815 <== mon.2 v2:172.21.15.16:3301/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2668023030 con 0x7f26800b4980 2021-01-03T12:58:36.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.567+0000 7f267cff9700 1 --2- 172.21.15.133:0/2290580815 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2664055440 0x7f2664057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:36.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.567+0000 7f267cff9700 1 -- 172.21.15.133:0/2290580815 <== mon.2 v2:172.21.15.16:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f266806ea70 con 0x7f26800b4980 2021-01-03T12:58:36.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.567+0000 7f267effd700 1 --2- 172.21.15.133:0/2290580815 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2664055440 0x7f2664057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:36.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.567+0000 7f267effd700 1 --2- 172.21.15.133:0/2290580815 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2664055440 0x7f2664057900 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f267000d000 tx=0x7f2670001160).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:36.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.575+0000 7f267cff9700 1 -- 172.21.15.133:0/2290580815 <== mon.2 v2:172.21.15.16:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2668044f10 con 0x7f26800b4980 2021-01-03T12:58:36.707 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:58:36.711 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:58:36.715 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:58:36.717 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:58:36.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.767+0000 7f2684b04700 1 -- 172.21.15.133:0/2290580815 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f2680060940 con 0x7f26800b4980 2021-01-03T12:58:36.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.779+0000 7f267cff9700 1 -- 172.21.15.133:0/2290580815 <== mon.2 v2:172.21.15.16:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2668048530 con 0x7f26800b4980 2021-01-03T12:58:36.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.779+0000 7f2684b04700 1 -- 172.21.15.133:0/2290580815 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2664055440 msgr2=0x7f2664057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.779+0000 7f2684b04700 1 --2- 172.21.15.133:0/2290580815 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2664055440 0x7f2664057900 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f267000d000 tx=0x7f2670001160).stop 2021-01-03T12:58:36.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.779+0000 7f2684b04700 1 -- 172.21.15.133:0/2290580815 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f26800b4980 msgr2=0x7f26801482e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.779+0000 7f2684b04700 1 --2- 172.21.15.133:0/2290580815 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f26800b4980 0x7f26801482e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2668002f30 tx=0x7f2668015000).stop 2021-01-03T12:58:36.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.779+0000 7f2684b04700 1 -- 172.21.15.133:0/2290580815 shutdown_connections 2021-01-03T12:58:36.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.779+0000 7f2684b04700 1 --2- 172.21.15.133:0/2290580815 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2664055440 0x7f2664057900 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.779+0000 7f2684b04700 1 --2- 172.21.15.133:0/2290580815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26800b9b60 0x7f26800b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.779+0000 7f2684b04700 1 --2- 172.21.15.133:0/2290580815 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f26800b4980 0x7f26801482e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.779+0000 7f2684b04700 1 --2- 172.21.15.133:0/2290580815 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f26800b4e10 0x7f26800b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.779+0000 7f2684b04700 1 -- 172.21.15.133:0/2290580815 >> 172.21.15.133:0/2290580815 conn(0x7f26800b69e0 msgr2=0x7f26801437a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:36.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.779+0000 7f2684b04700 1 -- 172.21.15.133:0/2290580815 shutdown_connections 2021-01-03T12:58:36.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.779+0000 7f2684b04700 1 -- 172.21.15.133:0/2290580815 wait complete. 2021-01-03T12:58:36.784 INFO:teuthology.orchestra.run.smithi133.stderr:updated 2021-01-03T12:58:36.795 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rbd 2021-01-03T12:58:36.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.951+0000 7fdd6d19c700 1 Processor -- start 2021-01-03T12:58:36.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.951+0000 7fdd6d19c700 1 -- start start 2021-01-03T12:58:36.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.951+0000 7fdd6d19c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd680b3060 0x7fdd68141660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:36.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.951+0000 7fdd6d19c700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd680b24f0 con 0x7fdd680b3870 2021-01-03T12:58:36.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.951+0000 7fdd6d19c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd680b3440 con 0x7fdd6805f5e0 2021-01-03T12:58:36.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.951+0000 7fdd6d19c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd68140c80 con 0x7fdd680b3060 2021-01-03T12:58:36.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.951+0000 7fdd6c99b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdd6805f5e0 0x7fdd6813def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53878/0 (socket says 172.21.15.133:53878) 2021-01-03T12:58:36.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.951+0000 7fdd6c99b700 1 -- 172.21.15.133:0/4227051144 learned_addr learned my addr 172.21.15.133:0/4227051144 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:36.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.951+0000 7fdd67fff700 1 --2- 172.21.15.133:0/4227051144 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd680b3060 0x7fdd68141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:36.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.951+0000 7fdd66ffd700 1 -- 172.21.15.133:0/4227051144 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193534506 0 0) 0x7fdd680b3440 con 0x7fdd6805f5e0 2021-01-03T12:58:36.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.951+0000 7fdd66ffd700 1 -- 172.21.15.133:0/4227051144 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd54003230 con 0x7fdd6805f5e0 2021-01-03T12:58:36.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.951+0000 7fdd66ffd700 1 -- 172.21.15.133:0/4227051144 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670101094 0 0) 0x7fdd680b24f0 con 0x7fdd680b3870 2021-01-03T12:58:36.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.951+0000 7fdd67fff700 1 -- 172.21.15.133:0/4227051144 >> v1:172.21.15.133:6789/0 conn(0x7fdd6805f5e0 legacy=0x7fdd6813def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.951+0000 7fdd67fff700 1 -- 172.21.15.133:0/4227051144 >> v1:172.21.15.16:6789/0 conn(0x7fdd680b3870 legacy=0x7fdd680b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.951+0000 7fdd67fff700 1 -- 172.21.15.133:0/4227051144 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd68140f20 con 0x7fdd680b3060 2021-01-03T12:58:36.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.955+0000 7fdd67fff700 1 --2- 172.21.15.133:0/4227051144 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd680b3060 0x7fdd68141660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdd58002f30 tx=0x7fdd58006dc0).ready entity=mon.2 client_cookie=f775873fac32a878 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:36.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.955+0000 7fdd66ffd700 1 -- 172.21.15.133:0/4227051144 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd580097b0 con 0x7fdd680b3060 2021-01-03T12:58:36.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.955+0000 7fdd66ffd700 1 -- 172.21.15.133:0/4227051144 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd58009910 con 0x7fdd680b3060 2021-01-03T12:58:36.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.955+0000 7fdd66ffd700 1 -- 172.21.15.133:0/4227051144 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd58009c70 con 0x7fdd680b3060 2021-01-03T12:58:36.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.955+0000 7fdd6d19c700 1 -- 172.21.15.133:0/4227051144 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd680b3060 msgr2=0x7fdd68141660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.955+0000 7fdd6d19c700 1 --2- 172.21.15.133:0/4227051144 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd680b3060 0x7fdd68141660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdd58002f30 tx=0x7fdd58006dc0).stop 2021-01-03T12:58:36.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.955+0000 7fdd6d19c700 1 -- 172.21.15.133:0/4227051144 shutdown_connections 2021-01-03T12:58:36.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.955+0000 7fdd6d19c700 1 --2- 172.21.15.133:0/4227051144 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd680b3060 0x7fdd68141660 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.955+0000 7fdd6d19c700 1 -- 172.21.15.133:0/4227051144 >> 172.21.15.133:0/4227051144 conn(0x7fdd680b7200 msgr2=0x7fdd680b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:36.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.955+0000 7fdd6d19c700 1 -- 172.21.15.133:0/4227051144 shutdown_connections 2021-01-03T12:58:36.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.955+0000 7fdd6d19c700 1 -- 172.21.15.133:0/4227051144 wait complete. 2021-01-03T12:58:36.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd6d19c700 1 Processor -- start 2021-01-03T12:58:36.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd6d19c700 1 -- start start 2021-01-03T12:58:36.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd6d19c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd6805f5e0 0x7fdd680672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:36.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd6d19c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd680b3060 0x7fdd681442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:36.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd6d19c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd680b3870 0x7fdd681447d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:36.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd6d19c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd68150790 con 0x7fdd680b3060 2021-01-03T12:58:36.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd6d19c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd68150a30 con 0x7fdd6805f5e0 2021-01-03T12:58:36.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd6d19c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6813ff10 con 0x7fdd680b3870 2021-01-03T12:58:36.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd67fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd6805f5e0 0x7fdd680672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:36.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd67fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd6805f5e0 0x7fdd680672e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32850/0 (socket says 172.21.15.133:32850) 2021-01-03T12:58:36.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd67fff700 1 -- 172.21.15.133:0/3381390184 learned_addr learned my addr 172.21.15.133:0/3381390184 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:36.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd6c99b700 1 --2- 172.21.15.133:0/3381390184 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd680b3870 0x7fdd681447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:36.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd677fe700 1 --2- 172.21.15.133:0/3381390184 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd680b3060 0x7fdd681442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:36.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd67fff700 1 -- 172.21.15.133:0/3381390184 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd680b3870 msgr2=0x7fdd681447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd67fff700 1 --2- 172.21.15.133:0/3381390184 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd680b3870 0x7fdd681447d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd67fff700 1 -- 172.21.15.133:0/3381390184 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd680b3060 msgr2=0x7fdd681442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd67fff700 1 --2- 172.21.15.133:0/3381390184 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd680b3060 0x7fdd681442e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd67fff700 1 -- 172.21.15.133:0/3381390184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd681401b0 con 0x7fdd6805f5e0 2021-01-03T12:58:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.959+0000 7fdd67fff700 1 --2- 172.21.15.133:0/3381390184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd6805f5e0 0x7fdd680672e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fdd58002f30 tx=0x7fdd58015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.963+0000 7fdd657fa700 1 -- 172.21.15.133:0/3381390184 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd58009c10 con 0x7fdd6805f5e0 2021-01-03T12:58:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.963+0000 7fdd6d19c700 1 -- 172.21.15.133:0/3381390184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd681504e0 con 0x7fdd6805f5e0 2021-01-03T12:58:36.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.963+0000 7fdd657fa700 1 -- 172.21.15.133:0/3381390184 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd58009e20 con 0x7fdd6805f5e0 2021-01-03T12:58:36.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.963+0000 7fdd657fa700 1 -- 172.21.15.133:0/3381390184 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd5801d450 con 0x7fdd6805f5e0 2021-01-03T12:58:36.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.963+0000 7fdd6d19c700 1 -- 172.21.15.133:0/3381390184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6813e9a0 con 0x7fdd6805f5e0 2021-01-03T12:58:36.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.963+0000 7fdd6d19c700 1 -- 172.21.15.133:0/3381390184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd68140340 con 0x7fdd6805f5e0 2021-01-03T12:58:36.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.963+0000 7fdd657fa700 1 -- 172.21.15.133:0/3381390184 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fdd58024030 con 0x7fdd6805f5e0 2021-01-03T12:58:36.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.963+0000 7fdd657fa700 1 --2- 172.21.15.133:0/3381390184 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdd48055330 0x7fdd480577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:36.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.963+0000 7fdd677fe700 1 --2- 172.21.15.133:0/3381390184 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdd48055330 0x7fdd480577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:36.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.963+0000 7fdd657fa700 1 -- 172.21.15.133:0/3381390184 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fdd5806ed30 con 0x7fdd6805f5e0 2021-01-03T12:58:36.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.967+0000 7fdd677fe700 1 --2- 172.21.15.133:0/3381390184 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdd48055330 0x7fdd480577f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fdd5c003040 tx=0x7fdd5c007b40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:36.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:36.971+0000 7fdd657fa700 1 -- 172.21.15.133:0/3381390184 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdd580453a0 con 0x7fdd6805f5e0 2021-01-03T12:58:37.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.163+0000 7fdd6d19c700 1 -- 172.21.15.133:0/3381390184 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fdd68057300 con 0x7fdd6805f5e0 2021-01-03T12:58:37.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.175+0000 7fdd657fa700 1 -- 172.21.15.133:0/3381390184 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdd58022070 con 0x7fdd6805f5e0 2021-01-03T12:58:37.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.175+0000 7fdd6d19c700 1 -- 172.21.15.133:0/3381390184 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdd48055330 msgr2=0x7fdd480577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:37.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.175+0000 7fdd6d19c700 1 --2- 172.21.15.133:0/3381390184 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdd48055330 0x7fdd480577f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fdd5c003040 tx=0x7fdd5c007b40).stop 2021-01-03T12:58:37.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.175+0000 7fdd6d19c700 1 -- 172.21.15.133:0/3381390184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd6805f5e0 msgr2=0x7fdd680672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:37.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.175+0000 7fdd6d19c700 1 --2- 172.21.15.133:0/3381390184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd6805f5e0 0x7fdd680672e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fdd58002f30 tx=0x7fdd58015000).stop 2021-01-03T12:58:37.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.175+0000 7fdd6d19c700 1 -- 172.21.15.133:0/3381390184 shutdown_connections 2021-01-03T12:58:37.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.175+0000 7fdd6d19c700 1 --2- 172.21.15.133:0/3381390184 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdd48055330 0x7fdd480577f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.175+0000 7fdd6d19c700 1 --2- 172.21.15.133:0/3381390184 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd680b3870 0x7fdd681447d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.175+0000 7fdd6d19c700 1 --2- 172.21.15.133:0/3381390184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd6805f5e0 0x7fdd680672e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.175+0000 7fdd6d19c700 1 --2- 172.21.15.133:0/3381390184 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd680b3060 0x7fdd681442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.175+0000 7fdd6d19c700 1 -- 172.21.15.133:0/3381390184 >> 172.21.15.133:0/3381390184 conn(0x7fdd680b7200 msgr2=0x7fdd680ac4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:37.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.175+0000 7fdd6d19c700 1 -- 172.21.15.133:0/3381390184 shutdown_connections 2021-01-03T12:58:37.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.179+0000 7fdd6d19c700 1 -- 172.21.15.133:0/3381390184 wait complete. 2021-01-03T12:58:37.182 INFO:teuthology.orchestra.run.smithi133.stderr:updated 2021-01-03T12:58:37.192 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rbd-mirror 2021-01-03T12:58:37.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.303+0000 7f43d4a2a700 1 Processor -- start 2021-01-03T12:58:37.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43d4a2a700 1 -- start start 2021-01-03T12:58:37.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43d4a2a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f43d00b52c0 0x7f43d00b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:37.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43d4a2a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f43d00b5c00 0x7f43d0143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:37.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43d4a2a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d0060da0 con 0x7f43d00b0c90 2021-01-03T12:58:37.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43d4a2a700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d0067a90 con 0x7f43d00b5c00 2021-01-03T12:58:37.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43d4a2a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d00b0ad0 con 0x7f43d00b52c0 2021-01-03T12:58:37.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43cf7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f43d00b52c0 0x7f43d00b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:37.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43cf7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f43d00b52c0 0x7f43d00b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32860/0 (socket says 172.21.15.133:32860) 2021-01-03T12:58:37.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43cffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f43d00b5c00 0x7f43d0143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:37.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43ceffd700 1 --1- 172.21.15.133:0/655003670 >> v1:172.21.15.16:6789/0 conn(0x7f43d00b0c90 0x7f43d0098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:60848/0 (socket says 172.21.15.133:60848) 2021-01-03T12:58:37.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43cf7fe700 1 -- 172.21.15.133:0/655003670 learned_addr learned my addr 172.21.15.133:0/655003670 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:37.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43cf7fe700 1 -- 172.21.15.133:0/655003670 >> v2:172.21.15.16:3300/0 conn(0x7f43d00b5c00 msgr2=0x7f43d0143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:37.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43cf7fe700 1 --2- 172.21.15.133:0/655003670 >> v2:172.21.15.16:3300/0 conn(0x7f43d00b5c00 0x7f43d0143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43cf7fe700 1 -- 172.21.15.133:0/655003670 >> v1:172.21.15.16:6789/0 conn(0x7f43d00b0c90 legacy=0x7f43d0098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:37.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43ce7fc700 1 -- 172.21.15.133:0/655003670 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204148812 0 0) 0x7f43d0060da0 con 0x7f43d00b0c90 2021-01-03T12:58:37.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43cf7fe700 1 -- 172.21.15.133:0/655003670 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d00b56a0 con 0x7f43d00b52c0 2021-01-03T12:58:37.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43cffff700 1 --2- 172.21.15.133:0/655003670 >> v2:172.21.15.16:3300/0 conn(0x7f43d00b5c00 0x7f43d0143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:37.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43cf7fe700 1 --2- 172.21.15.133:0/655003670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43d00b52c0 0x7f43d00b05e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f43b8002f30 tx=0x7f43b8006e80).ready entity=mon.1 client_cookie=378c108d3af5edae server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:37.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43ce7fc700 1 -- 172.21.15.133:0/655003670 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43b80097f0 con 0x7f43d00b52c0 2021-01-03T12:58:37.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43ce7fc700 1 -- 172.21.15.133:0/655003670 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b8009950 con 0x7f43d00b52c0 2021-01-03T12:58:37.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43ce7fc700 1 -- 172.21.15.133:0/655003670 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43b8009cb0 con 0x7f43d00b52c0 2021-01-03T12:58:37.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43d4a2a700 1 -- 172.21.15.133:0/655003670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43d00b52c0 msgr2=0x7f43d00b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:37.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43d4a2a700 1 --2- 172.21.15.133:0/655003670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43d00b52c0 0x7f43d00b05e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f43b8002f30 tx=0x7f43b8006e80).stop 2021-01-03T12:58:37.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43d4a2a700 1 -- 172.21.15.133:0/655003670 shutdown_connections 2021-01-03T12:58:37.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43d4a2a700 1 --2- 172.21.15.133:0/655003670 >> v2:172.21.15.16:3300/0 conn(0x7f43d00b5c00 0x7f43d0143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43d4a2a700 1 --2- 172.21.15.133:0/655003670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43d00b52c0 0x7f43d00b05e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43d4a2a700 1 -- 172.21.15.133:0/655003670 >> 172.21.15.133:0/655003670 conn(0x7f43d005bdf0 msgr2=0x7f43d005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:37.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43d4a2a700 1 -- 172.21.15.133:0/655003670 shutdown_connections 2021-01-03T12:58:37.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.307+0000 7f43d4a2a700 1 -- 172.21.15.133:0/655003670 wait complete. 2021-01-03T12:58:37.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43d4a2a700 1 Processor -- start 2021-01-03T12:58:37.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43d4a2a700 1 -- start start 2021-01-03T12:58:37.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43d4a2a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d00b0c90 0x7f43d0149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:37.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43d4a2a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f43d00b52c0 0x7f43d00ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:37.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43d4a2a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43d00b5c00 0x7f43d00af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:37.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43d4a2a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00aee20 con 0x7f43d00b0c90 2021-01-03T12:58:37.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43d4a2a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00ae610 con 0x7f43d00b5c00 2021-01-03T12:58:37.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43d4a2a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d014a150 con 0x7f43d00b52c0 2021-01-03T12:58:37.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43cffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43d00b5c00 0x7f43d00af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:37.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43cffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43d00b5c00 0x7f43d00af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32866/0 (socket says 172.21.15.133:32866) 2021-01-03T12:58:37.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43cffff700 1 -- 172.21.15.133:0/3335527437 learned_addr learned my addr 172.21.15.133:0/3335527437 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:37.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43ceffd700 1 --2- 172.21.15.133:0/3335527437 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f43d00b52c0 0x7f43d00ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:37.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43cf7fe700 1 --2- 172.21.15.133:0/3335527437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d00b0c90 0x7f43d0149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:37.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43cffff700 1 -- 172.21.15.133:0/3335527437 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f43d00b52c0 msgr2=0x7f43d00ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:37.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43cffff700 1 --2- 172.21.15.133:0/3335527437 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f43d00b52c0 0x7f43d00ae120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43cffff700 1 -- 172.21.15.133:0/3335527437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d00b0c90 msgr2=0x7f43d0149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:37.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43cffff700 1 --2- 172.21.15.133:0/3335527437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d00b0c90 0x7f43d0149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43cffff700 1 -- 172.21.15.133:0/3335527437 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d014a3f0 con 0x7f43d00b5c00 2021-01-03T12:58:37.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43cf7fe700 1 --2- 172.21.15.133:0/3335527437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d00b0c90 0x7f43d0149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:37.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43ceffd700 1 --2- 172.21.15.133:0/3335527437 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f43d00b52c0 0x7f43d00ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:37.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43cffff700 1 --2- 172.21.15.133:0/3335527437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43d00b5c00 0x7f43d00af250 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f43c800c000 tx=0x7f43c80091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:37.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43ccff9700 1 -- 172.21.15.133:0/3335527437 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43c800cc80 con 0x7f43d00b5c00 2021-01-03T12:58:37.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43ccff9700 1 -- 172.21.15.133:0/3335527437 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c800cde0 con 0x7f43d00b5c00 2021-01-03T12:58:37.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43ccff9700 1 -- 172.21.15.133:0/3335527437 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43c80125e0 con 0x7f43d00b5c00 2021-01-03T12:58:37.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43d4a2a700 1 -- 172.21.15.133:0/3335527437 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d00af740 con 0x7f43d00b5c00 2021-01-03T12:58:37.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.311+0000 7f43d4a2a700 1 -- 172.21.15.133:0/3335527437 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d014b180 con 0x7f43d00b5c00 2021-01-03T12:58:37.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.315+0000 7f43ccff9700 1 -- 172.21.15.133:0/3335527437 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f43c8022070 con 0x7f43d00b5c00 2021-01-03T12:58:37.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.315+0000 7f43d4a2a700 1 -- 172.21.15.133:0/3335527437 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d014acb0 con 0x7f43d00b5c00 2021-01-03T12:58:37.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.315+0000 7f43ccff9700 1 --2- 172.21.15.133:0/3335527437 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f43b4055440 0x7f43b4057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:37.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.315+0000 7f43ccff9700 1 -- 172.21.15.133:0/3335527437 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f43c806e560 con 0x7f43d00b5c00 2021-01-03T12:58:37.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.315+0000 7f43cf7fe700 1 --2- 172.21.15.133:0/3335527437 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f43b4055440 0x7f43b4057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:37.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.315+0000 7f43cf7fe700 1 --2- 172.21.15.133:0/3335527437 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f43b4055440 0x7f43b4057900 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f43b801a000 tx=0x7f43b8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:37.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.319+0000 7f43ccff9700 1 -- 172.21.15.133:0/3335527437 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f43d014acb0 con 0x7f43d00b5c00 2021-01-03T12:58:37.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.503+0000 7f43d4a2a700 1 -- 172.21.15.133:0/3335527437 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f43d0149fb0 con 0x7f43d00b5c00 2021-01-03T12:58:37.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.511+0000 7f43ccff9700 1 -- 172.21.15.133:0/3335527437 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f43d0149fb0 con 0x7f43d00b5c00 2021-01-03T12:58:37.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.511+0000 7f43d4a2a700 1 -- 172.21.15.133:0/3335527437 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f43b4055440 msgr2=0x7f43b4057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:37.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.511+0000 7f43d4a2a700 1 --2- 172.21.15.133:0/3335527437 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f43b4055440 0x7f43b4057900 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f43b801a000 tx=0x7f43b8015000).stop 2021-01-03T12:58:37.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.511+0000 7f43d4a2a700 1 -- 172.21.15.133:0/3335527437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43d00b5c00 msgr2=0x7f43d00af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:37.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.511+0000 7f43d4a2a700 1 --2- 172.21.15.133:0/3335527437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43d00b5c00 0x7f43d00af250 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f43c800c000 tx=0x7f43c80091a0).stop 2021-01-03T12:58:37.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.511+0000 7f43d4a2a700 1 -- 172.21.15.133:0/3335527437 shutdown_connections 2021-01-03T12:58:37.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.511+0000 7f43d4a2a700 1 --2- 172.21.15.133:0/3335527437 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f43b4055440 0x7f43b4057900 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.511+0000 7f43d4a2a700 1 --2- 172.21.15.133:0/3335527437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43d00b0c90 0x7f43d0149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.511+0000 7f43d4a2a700 1 --2- 172.21.15.133:0/3335527437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43d00b5c00 0x7f43d00af250 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.511+0000 7f43d4a2a700 1 --2- 172.21.15.133:0/3335527437 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f43d00b52c0 0x7f43d00ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.511+0000 7f43d4a2a700 1 -- 172.21.15.133:0/3335527437 >> 172.21.15.133:0/3335527437 conn(0x7f43d005bdf0 msgr2=0x7f43d00600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:37.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.511+0000 7f43d4a2a700 1 -- 172.21.15.133:0/3335527437 shutdown_connections 2021-01-03T12:58:37.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.511+0000 7f43d4a2a700 1 -- 172.21.15.133:0/3335527437 wait complete. 2021-01-03T12:58:37.517 INFO:teuthology.orchestra.run.smithi133.stderr:updated 2021-01-03T12:58:37.527 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rgw 2021-01-03T12:58:37.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.635+0000 7f99fa123700 1 Processor -- start 2021-01-03T12:58:37.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.635+0000 7f99fa123700 1 -- start start 2021-01-03T12:58:37.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99fa123700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f99f40b9f40 0x7f99f4146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:37.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99fa123700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99f4146920 0x7f99f414d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:37.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99fa123700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f40605f0 con 0x7f99f40b9b60 2021-01-03T12:58:37.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99fa123700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f40aed30 con 0x7f99f40b9f40 2021-01-03T12:58:37.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99fa123700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f40600b0 con 0x7f99f4146920 2021-01-03T12:58:37.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99f9121700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f99f40b9b60 0x7f99f40b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53902/0 (socket says 172.21.15.133:53902) 2021-01-03T12:58:37.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99f9121700 1 -- 172.21.15.133:0/1094626321 learned_addr learned my addr 172.21.15.133:0/1094626321 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:37.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99f9922700 1 --2- 172.21.15.133:0/1094626321 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99f4146920 0x7f99f414d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:37.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99f8920700 1 --2- 172.21.15.133:0/1094626321 >> v2:172.21.15.16:3300/0 conn(0x7f99f40b9f40 0x7f99f4146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:37.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99e7fff700 1 -- 172.21.15.133:0/1094626321 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917640743 0 0) 0x7f99f40605f0 con 0x7f99f40b9b60 2021-01-03T12:58:37.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99e7fff700 1 -- 172.21.15.133:0/1094626321 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99d8003230 con 0x7f99f40b9b60 2021-01-03T12:58:37.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99f9922700 1 -- 172.21.15.133:0/1094626321 >> v2:172.21.15.16:3300/0 conn(0x7f99f40b9f40 msgr2=0x7f99f4146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:37.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99f9922700 1 --2- 172.21.15.133:0/1094626321 >> v2:172.21.15.16:3300/0 conn(0x7f99f40b9f40 0x7f99f4146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99f9922700 1 -- 172.21.15.133:0/1094626321 >> v1:172.21.15.133:6789/0 conn(0x7f99f40b9b60 legacy=0x7f99f40b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:37.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99f9922700 1 -- 172.21.15.133:0/1094626321 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f4060350 con 0x7f99f4146920 2021-01-03T12:58:37.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99f9922700 1 --2- 172.21.15.133:0/1094626321 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99f4146920 0x7f99f414d500 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f99ec0032b0 tx=0x7f99ec0091a0).ready entity=mon.2 client_cookie=9636d3997a231c7f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:37.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99e7fff700 1 -- 172.21.15.133:0/1094626321 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99ec00b940 con 0x7f99f4146920 2021-01-03T12:58:37.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99e7fff700 1 -- 172.21.15.133:0/1094626321 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ec00baa0 con 0x7f99f4146920 2021-01-03T12:58:37.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99e7fff700 1 -- 172.21.15.133:0/1094626321 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99ec00bc10 con 0x7f99f4146920 2021-01-03T12:58:37.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99fa123700 1 -- 172.21.15.133:0/1094626321 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99f4146920 msgr2=0x7f99f414d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:37.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99fa123700 1 --2- 172.21.15.133:0/1094626321 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99f4146920 0x7f99f414d500 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f99ec0032b0 tx=0x7f99ec0091a0).stop 2021-01-03T12:58:37.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99fa123700 1 -- 172.21.15.133:0/1094626321 shutdown_connections 2021-01-03T12:58:37.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99fa123700 1 --2- 172.21.15.133:0/1094626321 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99f4146920 0x7f99f414d500 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99fa123700 1 --2- 172.21.15.133:0/1094626321 >> v2:172.21.15.16:3300/0 conn(0x7f99f40b9f40 0x7f99f4146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99fa123700 1 -- 172.21.15.133:0/1094626321 >> 172.21.15.133:0/1094626321 conn(0x7f99f40b69e0 msgr2=0x7f99f40b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:37.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.639+0000 7f99fa123700 1 -- 172.21.15.133:0/1094626321 shutdown_connections 2021-01-03T12:58:37.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.643+0000 7f99fa123700 1 -- 172.21.15.133:0/1094626321 wait complete. 2021-01-03T12:58:37.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.643+0000 7f99fa123700 1 Processor -- start 2021-01-03T12:58:37.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.643+0000 7f99fa123700 1 -- start start 2021-01-03T12:58:37.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.643+0000 7f99fa123700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99f40b9b60 0x7f99f409d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:37.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.643+0000 7f99fa123700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f40b9f40 0x7f99f409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:37.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.643+0000 7f99fa123700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99f4146920 0x7f99f409e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:37.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.643+0000 7f99fa123700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f4151b10 con 0x7f99f4146920 2021-01-03T12:58:37.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.643+0000 7f99fa123700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f4151db0 con 0x7f99f40b9f40 2021-01-03T12:58:37.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.643+0000 7f99fa123700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f4152050 con 0x7f99f40b9b60 2021-01-03T12:58:37.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.643+0000 7f99f8920700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f40b9f40 0x7f99f409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:37.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.643+0000 7f99f8920700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f40b9f40 0x7f99f409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32878/0 (socket says 172.21.15.133:32878) 2021-01-03T12:58:37.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.643+0000 7f99f8920700 1 -- 172.21.15.133:0/3496724078 learned_addr learned my addr 172.21.15.133:0/3496724078 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:37.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.643+0000 7f99f9922700 1 --2- 172.21.15.133:0/3496724078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99f4146920 0x7f99f409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:37.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.643+0000 7f99f9121700 1 --2- 172.21.15.133:0/3496724078 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99f40b9b60 0x7f99f409d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:37.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.643+0000 7f99f8920700 1 -- 172.21.15.133:0/3496724078 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99f40b9b60 msgr2=0x7f99f409d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:37.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.643+0000 7f99f8920700 1 --2- 172.21.15.133:0/3496724078 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99f40b9b60 0x7f99f409d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.647+0000 7f99f8920700 1 -- 172.21.15.133:0/3496724078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99f4146920 msgr2=0x7f99f409e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:37.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.647+0000 7f99f8920700 1 --2- 172.21.15.133:0/3496724078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99f4146920 0x7f99f409e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.647+0000 7f99f8920700 1 -- 172.21.15.133:0/3496724078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f41522f0 con 0x7f99f40b9f40 2021-01-03T12:58:37.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.647+0000 7f99f9922700 1 --2- 172.21.15.133:0/3496724078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99f4146920 0x7f99f409e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:37.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.647+0000 7f99f8920700 1 --2- 172.21.15.133:0/3496724078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f40b9f40 0x7f99f409dc30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f99e800c000 tx=0x7f99e8006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:37.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.647+0000 7f99e67fc700 1 -- 172.21.15.133:0/3496724078 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99e800ca10 con 0x7f99f40b9f40 2021-01-03T12:58:37.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.647+0000 7f99e67fc700 1 -- 172.21.15.133:0/3496724078 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e800cb70 con 0x7f99f40b9f40 2021-01-03T12:58:37.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.647+0000 7f99fa123700 1 -- 172.21.15.133:0/3496724078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f4152790 con 0x7f99f40b9f40 2021-01-03T12:58:37.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.647+0000 7f99e67fc700 1 -- 172.21.15.133:0/3496724078 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99e80123f0 con 0x7f99f40b9f40 2021-01-03T12:58:37.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.647+0000 7f99fa123700 1 -- 172.21.15.133:0/3496724078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f40b1ea0 con 0x7f99f40b9f40 2021-01-03T12:58:37.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.647+0000 7f99fa123700 1 -- 172.21.15.133:0/3496724078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f4152480 con 0x7f99f40b9f40 2021-01-03T12:58:37.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.647+0000 7f99e67fc700 1 -- 172.21.15.133:0/3496724078 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f99e8012550 con 0x7f99f40b9f40 2021-01-03T12:58:37.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.647+0000 7f99e67fc700 1 --2- 172.21.15.133:0/3496724078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f99dc055440 0x7f99dc057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:37.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.651+0000 7f99e67fc700 1 -- 172.21.15.133:0/3496724078 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f99e806dff0 con 0x7f99f40b9f40 2021-01-03T12:58:37.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.651+0000 7f99f9121700 1 --2- 172.21.15.133:0/3496724078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f99dc055440 0x7f99dc057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:37.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.651+0000 7f99f9121700 1 --2- 172.21.15.133:0/3496724078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f99dc055440 0x7f99dc057900 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f99f000d000 tx=0x7f99f0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:37.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.655+0000 7f99e67fc700 1 -- 172.21.15.133:0/3496724078 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f99e80445c0 con 0x7f99f40b9f40 2021-01-03T12:58:37.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.847+0000 7f99fa123700 1 -- 172.21.15.133:0/3496724078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f99f4057300 con 0x7f99f40b9f40 2021-01-03T12:58:37.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.859+0000 7f99e67fc700 1 -- 172.21.15.133:0/3496724078 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f99e8047be0 con 0x7f99f40b9f40 2021-01-03T12:58:37.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.859+0000 7f99fa123700 1 -- 172.21.15.133:0/3496724078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f99dc055440 msgr2=0x7f99dc057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:37.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.859+0000 7f99fa123700 1 --2- 172.21.15.133:0/3496724078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f99dc055440 0x7f99dc057900 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f99f000d000 tx=0x7f99f0009040).stop 2021-01-03T12:58:37.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.859+0000 7f99fa123700 1 -- 172.21.15.133:0/3496724078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f40b9f40 msgr2=0x7f99f409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:37.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.859+0000 7f99fa123700 1 --2- 172.21.15.133:0/3496724078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f40b9f40 0x7f99f409dc30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f99e800c000 tx=0x7f99e8006dc0).stop 2021-01-03T12:58:37.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.859+0000 7f99fa123700 1 -- 172.21.15.133:0/3496724078 shutdown_connections 2021-01-03T12:58:37.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.859+0000 7f99fa123700 1 --2- 172.21.15.133:0/3496724078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f99dc055440 0x7f99dc057900 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.859+0000 7f99fa123700 1 --2- 172.21.15.133:0/3496724078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99f4146920 0x7f99f409e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.859+0000 7f99fa123700 1 --2- 172.21.15.133:0/3496724078 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99f40b9b60 0x7f99f409d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.859+0000 7f99fa123700 1 --2- 172.21.15.133:0/3496724078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f40b9f40 0x7f99f409dc30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.859+0000 7f99fa123700 1 -- 172.21.15.133:0/3496724078 >> 172.21.15.133:0/3496724078 conn(0x7f99f40b69e0 msgr2=0x7f99f4145930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:37.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.859+0000 7f99fa123700 1 -- 172.21.15.133:0/3496724078 shutdown_connections 2021-01-03T12:58:37.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.859+0000 7f99fa123700 1 -- 172.21.15.133:0/3496724078 wait complete. 2021-01-03T12:58:37.865 INFO:teuthology.orchestra.run.smithi133.stderr:updated 2021-01-03T12:58:37.878 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:37.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.987+0000 7fe24de19700 1 Processor -- start 2021-01-03T12:58:37.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.987+0000 7fe24de19700 1 -- start start 2021-01-03T12:58:37.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.987+0000 7fe24de19700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe24805c130 0x7fe2480b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:37.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.987+0000 7fe24de19700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24805c510 con 0x7fe2481479e0 2021-01-03T12:58:37.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.987+0000 7fe24de19700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24814a930 con 0x7fe248061890 2021-01-03T12:58:37.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.987+0000 7fe24de19700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24814abd0 con 0x7fe24805c130 2021-01-03T12:58:37.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.987+0000 7fe247fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe248061890 0x7fe2481472d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53916/0 (socket says 172.21.15.133:53916) 2021-01-03T12:58:37.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.987+0000 7fe247fff700 1 -- 172.21.15.133:0/64159454 learned_addr learned my addr 172.21.15.133:0/64159454 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:37.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.987+0000 7fe24ce17700 1 --2- 172.21.15.133:0/64159454 >> v2:172.21.15.133:3300/0 conn(0x7fe24805c130 0x7fe2480b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:37.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe2477fe700 1 -- 172.21.15.133:0/64159454 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581365728 0 0) 0x7fe24814a930 con 0x7fe248061890 2021-01-03T12:58:37.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe2477fe700 1 -- 172.21.15.133:0/64159454 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe234003230 con 0x7fe248061890 2021-01-03T12:58:37.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe24ce17700 1 -- 172.21.15.133:0/64159454 >> v1:172.21.15.133:6789/0 conn(0x7fe248061890 legacy=0x7fe2481472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:37.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe2477fe700 1 -- 172.21.15.133:0/64159454 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1330209831 0 0) 0x7fe234003230 con 0x7fe248061890 2021-01-03T12:58:37.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe24ce17700 1 -- 172.21.15.133:0/64159454 >> v1:172.21.15.16:6789/0 conn(0x7fe2481479e0 legacy=0x7fe2481445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:37.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe24ce17700 1 -- 172.21.15.133:0/64159454 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24814ae70 con 0x7fe24805c130 2021-01-03T12:58:37.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe24ce17700 1 --2- 172.21.15.133:0/64159454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe24805c130 0x7fe2480b25d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fe240001450 tx=0x7fe238006dc0).ready entity=mon.1 client_cookie=2fa82fe8d725dc6 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:37.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe2477fe700 1 -- 172.21.15.133:0/64159454 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe23c0016f0 con 0x7fe24805c130 2021-01-03T12:58:37.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe2477fe700 1 -- 172.21.15.133:0/64159454 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23800d5c0 con 0x7fe24805c130 2021-01-03T12:58:37.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe2477fe700 1 -- 172.21.15.133:0/64159454 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe23800d730 con 0x7fe24805c130 2021-01-03T12:58:37.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe24de19700 1 -- 172.21.15.133:0/64159454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe24805c130 msgr2=0x7fe2480b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:37.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe24de19700 1 --2- 172.21.15.133:0/64159454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe24805c130 0x7fe2480b25d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fe240001450 tx=0x7fe238006dc0).stop 2021-01-03T12:58:37.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe24de19700 1 -- 172.21.15.133:0/64159454 shutdown_connections 2021-01-03T12:58:37.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe24de19700 1 --2- 172.21.15.133:0/64159454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe24805c130 0x7fe2480b25d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:37.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe24de19700 1 -- 172.21.15.133:0/64159454 >> 172.21.15.133:0/64159454 conn(0x7fe2480b6110 msgr2=0x7fe2480b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:37.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe24de19700 1 -- 172.21.15.133:0/64159454 shutdown_connections 2021-01-03T12:58:37.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe24de19700 1 -- 172.21.15.133:0/64159454 wait complete. 2021-01-03T12:58:37.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.991+0000 7fe24de19700 1 Processor -- start 2021-01-03T12:58:37.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24de19700 1 -- start start 2021-01-03T12:58:37.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24de19700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24805c130 0x7fe248149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:37.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24de19700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe248061890 0x7fe2480ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24de19700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2481479e0 0x7fe248145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24de19700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24814a3c0 con 0x7fe24805c130 2021-01-03T12:58:38.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24de19700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24814a620 con 0x7fe2481479e0 2021-01-03T12:58:38.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24de19700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24814a8c0 con 0x7fe248061890 2021-01-03T12:58:38.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24d618700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2481479e0 0x7fe248145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24d618700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2481479e0 0x7fe248145be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32894/0 (socket says 172.21.15.133:32894) 2021-01-03T12:58:38.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe247fff700 1 --2- 172.21.15.133:0/3007157370 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe248061890 0x7fe2480ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24d618700 1 -- 172.21.15.133:0/3007157370 learned_addr learned my addr 172.21.15.133:0/3007157370 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:38.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24ce17700 1 --2- 172.21.15.133:0/3007157370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24805c130 0x7fe248149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24d618700 1 -- 172.21.15.133:0/3007157370 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe248061890 msgr2=0x7fe2480ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24d618700 1 --2- 172.21.15.133:0/3007157370 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe248061890 0x7fe2480ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24d618700 1 -- 172.21.15.133:0/3007157370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24805c130 msgr2=0x7fe248149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24d618700 1 --2- 172.21.15.133:0/3007157370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24805c130 0x7fe248149780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24d618700 1 -- 172.21.15.133:0/3007157370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe248145740 con 0x7fe2481479e0 2021-01-03T12:58:38.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24d618700 1 --2- 172.21.15.133:0/3007157370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2481479e0 0x7fe248145be0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fe240001340 tx=0x7fe240007f10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:38.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe245ffb700 1 -- 172.21.15.133:0/3007157370 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe240006860 con 0x7fe2481479e0 2021-01-03T12:58:38.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe245ffb700 1 -- 172.21.15.133:0/3007157370 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2400069c0 con 0x7fe2481479e0 2021-01-03T12:58:38.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24de19700 1 -- 172.21.15.133:0/3007157370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2480adff0 con 0x7fe2481479e0 2021-01-03T12:58:38.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe245ffb700 1 -- 172.21.15.133:0/3007157370 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe240006b30 con 0x7fe2481479e0 2021-01-03T12:58:38.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.995+0000 7fe24de19700 1 -- 172.21.15.133:0/3007157370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe248149d60 con 0x7fe2481479e0 2021-01-03T12:58:38.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.999+0000 7fe24de19700 1 -- 172.21.15.133:0/3007157370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2481458d0 con 0x7fe2481479e0 2021-01-03T12:58:38.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.999+0000 7fe245ffb700 1 -- 172.21.15.133:0/3007157370 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe240018020 con 0x7fe2481479e0 2021-01-03T12:58:38.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.999+0000 7fe245ffb700 1 --2- 172.21.15.133:0/3007157370 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe2280554e0 0x7fe2280579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.999+0000 7fe24ce17700 1 --2- 172.21.15.133:0/3007157370 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe2280554e0 0x7fe2280579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.999+0000 7fe245ffb700 1 -- 172.21.15.133:0/3007157370 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe24006d660 con 0x7fe2481479e0 2021-01-03T12:58:38.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:37.999+0000 7fe24ce17700 1 --2- 172.21.15.133:0/3007157370 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe2280554e0 0x7fe2280579a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fe23801a000 tx=0x7fe24805ce90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:38.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.003+0000 7fe245ffb700 1 -- 172.21.15.133:0/3007157370 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe240043c90 con 0x7fe2481479e0 2021-01-03T12:58:38.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.147+0000 7fe24de19700 1 -- 172.21.15.133:0/3007157370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe248057300 con 0x7fe2481479e0 2021-01-03T12:58:38.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.147+0000 7fe245ffb700 1 -- 172.21.15.133:0/3007157370 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+13229 (secure 0 0 0) 0x7fe240016020 con 0x7fe2481479e0 2021-01-03T12:58:38.149 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:38.150 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":30,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:35.357924+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:38.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.151+0000 7fe24de19700 1 -- 172.21.15.133:0/3007157370 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe2280554e0 msgr2=0x7fe2280579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.151+0000 7fe24de19700 1 --2- 172.21.15.133:0/3007157370 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe2280554e0 0x7fe2280579a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fe23801a000 tx=0x7fe24805ce90).stop 2021-01-03T12:58:38.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.151+0000 7fe24de19700 1 -- 172.21.15.133:0/3007157370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2481479e0 msgr2=0x7fe248145be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.151+0000 7fe24de19700 1 --2- 172.21.15.133:0/3007157370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2481479e0 0x7fe248145be0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fe240001340 tx=0x7fe240007f10).stop 2021-01-03T12:58:38.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.151+0000 7fe24de19700 1 -- 172.21.15.133:0/3007157370 shutdown_connections 2021-01-03T12:58:38.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.151+0000 7fe24de19700 1 --2- 172.21.15.133:0/3007157370 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe2280554e0 0x7fe2280579a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.151+0000 7fe24de19700 1 --2- 172.21.15.133:0/3007157370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24805c130 0x7fe248149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.151+0000 7fe24de19700 1 --2- 172.21.15.133:0/3007157370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2481479e0 0x7fe248145be0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.151+0000 7fe24de19700 1 --2- 172.21.15.133:0/3007157370 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe248061890 0x7fe2480ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.151+0000 7fe24de19700 1 -- 172.21.15.133:0/3007157370 >> 172.21.15.133:0/3007157370 conn(0x7fe2480b6110 msgr2=0x7fe2480b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:38.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.151+0000 7fe24de19700 1 -- 172.21.15.133:0/3007157370 shutdown_connections 2021-01-03T12:58:38.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.151+0000 7fe24de19700 1 -- 172.21.15.133:0/3007157370 wait complete. 2021-01-03T12:58:38.163 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-01-03T12:58:38.163 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T12:58:38.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.275+0000 7f57ad9a1700 1 Processor -- start 2021-01-03T12:58:38.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.275+0000 7f57ad9a1700 1 -- start start 2021-01-03T12:58:38.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.275+0000 7f57ad9a1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57a80b5c00 0x7f57a81477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.275+0000 7f57ad9a1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57a81442a0 0x7f57a8144730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.275+0000 7f57ad9a1700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a80b0c10 con 0x7f57a80b5260 2021-01-03T12:58:38.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.275+0000 7f57ad9a1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a80b5640 con 0x7f57a80b5c00 2021-01-03T12:58:38.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.275+0000 7f57ad9a1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a809a4f0 con 0x7f57a81442a0 2021-01-03T12:58:38.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57a7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57a80b5c00 0x7f57a81477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57a7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57a80b5c00 0x7f57a81477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32902/0 (socket says 172.21.15.133:32902) 2021-01-03T12:58:38.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57a7fff700 1 -- 172.21.15.133:0/106664114 learned_addr learned my addr 172.21.15.133:0/106664114 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:38.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57ad1a0700 1 --2- 172.21.15.133:0/106664114 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57a81442a0 0x7f57a8144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57a7fff700 1 -- 172.21.15.133:0/106664114 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57a81442a0 msgr2=0x7f57a8144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:38.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57a7fff700 1 --2- 172.21.15.133:0/106664114 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57a81442a0 0x7f57a8144730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57a7fff700 1 -- 172.21.15.133:0/106664114 >> v1:172.21.15.16:6789/0 conn(0x7f57a80b5260 legacy=0x7f57a81470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57a7fff700 1 -- 172.21.15.133:0/106664114 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a80b0e40 con 0x7f57a80b5c00 2021-01-03T12:58:38.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57a7fff700 1 --2- 172.21.15.133:0/106664114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a80b5c00 0x7f57a81477c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f5790002f30 tx=0x7f5790006e80).ready entity=mon.1 client_cookie=21c1ff4687b583ce server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:38.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57a77fe700 1 -- 172.21.15.133:0/106664114 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57900097f0 con 0x7f57a80b5c00 2021-01-03T12:58:38.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57a77fe700 1 -- 172.21.15.133:0/106664114 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5790009950 con 0x7f57a80b5c00 2021-01-03T12:58:38.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57a77fe700 1 -- 172.21.15.133:0/106664114 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5790009cb0 con 0x7f57a80b5c00 2021-01-03T12:58:38.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57ad9a1700 1 -- 172.21.15.133:0/106664114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a80b5c00 msgr2=0x7f57a81477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57ad9a1700 1 --2- 172.21.15.133:0/106664114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a80b5c00 0x7f57a81477c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f5790002f30 tx=0x7f5790006e80).stop 2021-01-03T12:58:38.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57ad9a1700 1 -- 172.21.15.133:0/106664114 shutdown_connections 2021-01-03T12:58:38.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57ad9a1700 1 --2- 172.21.15.133:0/106664114 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57a81442a0 0x7f57a8144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57ad9a1700 1 --2- 172.21.15.133:0/106664114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a80b5c00 0x7f57a81477c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57ad9a1700 1 -- 172.21.15.133:0/106664114 >> 172.21.15.133:0/106664114 conn(0x7f57a805bdf0 msgr2=0x7f57a805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:38.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57ad9a1700 1 -- 172.21.15.133:0/106664114 shutdown_connections 2021-01-03T12:58:38.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.279+0000 7f57ad9a1700 1 -- 172.21.15.133:0/106664114 wait complete. 2021-01-03T12:58:38.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ad9a1700 1 Processor -- start 2021-01-03T12:58:38.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ad9a1700 1 -- start start 2021-01-03T12:58:38.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ad9a1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a80b5260 0x7f57a80ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ad9a1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57a80b5c00 0x7f57a81560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ad9a1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57a81442a0 0x7f57a81565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ad9a1700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a8146a20 con 0x7f57a81442a0 2021-01-03T12:58:38.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ad9a1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a80ae340 con 0x7f57a80b5260 2021-01-03T12:58:38.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ad9a1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a80ac9f0 con 0x7f57a80b5c00 2021-01-03T12:58:38.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ac99f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a80b5260 0x7f57a80ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ac99f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a80b5260 0x7f57a80ad3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32904/0 (socket says 172.21.15.133:32904) 2021-01-03T12:58:38.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ac99f700 1 -- 172.21.15.133:0/3681661236 learned_addr learned my addr 172.21.15.133:0/3681661236 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:38.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57a7fff700 1 --2- 172.21.15.133:0/3681661236 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57a80b5c00 0x7f57a81560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ad1a0700 1 --2- 172.21.15.133:0/3681661236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57a81442a0 0x7f57a81565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ac99f700 1 -- 172.21.15.133:0/3681661236 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57a80b5c00 msgr2=0x7f57a81560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ac99f700 1 --2- 172.21.15.133:0/3681661236 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57a80b5c00 0x7f57a81560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ac99f700 1 -- 172.21.15.133:0/3681661236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57a81442a0 msgr2=0x7f57a81565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ac99f700 1 --2- 172.21.15.133:0/3681661236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57a81442a0 0x7f57a81565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ac99f700 1 -- 172.21.15.133:0/3681661236 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a80acc20 con 0x7f57a80b5260 2021-01-03T12:58:38.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.283+0000 7f57ad1a0700 1 --2- 172.21.15.133:0/3681661236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57a81442a0 0x7f57a81565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:38.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.287+0000 7f57ac99f700 1 --2- 172.21.15.133:0/3681661236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a80b5260 0x7f57a80ad3c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f57a8062160 tx=0x7f5798007f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:38.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.287+0000 7f57a5ffb700 1 -- 172.21.15.133:0/3681661236 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5798006a70 con 0x7f57a80b5260 2021-01-03T12:58:38.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.287+0000 7f57a5ffb700 1 -- 172.21.15.133:0/3681661236 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5798006bd0 con 0x7f57a80b5260 2021-01-03T12:58:38.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.287+0000 7f57a5ffb700 1 -- 172.21.15.133:0/3681661236 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5798007030 con 0x7f57a80b5260 2021-01-03T12:58:38.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.287+0000 7f57ad9a1700 1 -- 172.21.15.133:0/3681661236 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a80add60 con 0x7f57a80b5260 2021-01-03T12:58:38.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.287+0000 7f57ad9a1700 1 -- 172.21.15.133:0/3681661236 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a80ab270 con 0x7f57a80b5260 2021-01-03T12:58:38.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.287+0000 7f57a5ffb700 1 -- 172.21.15.133:0/3681661236 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5798010030 con 0x7f57a80b5260 2021-01-03T12:58:38.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.287+0000 7f57ad9a1700 1 -- 172.21.15.133:0/3681661236 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a80adef0 con 0x7f57a80b5260 2021-01-03T12:58:38.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.287+0000 7f57a5ffb700 1 --2- 172.21.15.133:0/3681661236 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5780055440 0x7f5780057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.287+0000 7f57a5ffb700 1 -- 172.21.15.133:0/3681661236 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f579806dca0 con 0x7f57a80b5260 2021-01-03T12:58:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.287+0000 7f57a7fff700 1 --2- 172.21.15.133:0/3681661236 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5780055440 0x7f5780057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.287+0000 7f57a7fff700 1 --2- 172.21.15.133:0/3681661236 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5780055440 0x7f5780057900 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f579001c000 tx=0x7f5790015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.291+0000 7f57a5ffb700 1 -- 172.21.15.133:0/3681661236 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5798072070 con 0x7f57a80b5260 2021-01-03T12:58:38.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.435+0000 7f57ad9a1700 1 -- 172.21.15.133:0/3681661236 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f57a8057300 con 0x7f57a80b5260 2021-01-03T12:58:38.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.435+0000 7f57a5ffb700 1 -- 172.21.15.133:0/3681661236 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v30) v1 ==== 110+0+10 (secure 0 0 0) 0x7f57980442d0 con 0x7f57a80b5260 2021-01-03T12:58:38.436 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T12:58:38.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.435+0000 7f57ad9a1700 1 -- 172.21.15.133:0/3681661236 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5780055440 msgr2=0x7f5780057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.435+0000 7f57ad9a1700 1 --2- 172.21.15.133:0/3681661236 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5780055440 0x7f5780057900 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f579001c000 tx=0x7f5790015000).stop 2021-01-03T12:58:38.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.435+0000 7f57ad9a1700 1 -- 172.21.15.133:0/3681661236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a80b5260 msgr2=0x7f57a80ad3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.435+0000 7f57ad9a1700 1 --2- 172.21.15.133:0/3681661236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a80b5260 0x7f57a80ad3c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f57a8062160 tx=0x7f5798007f60).stop 2021-01-03T12:58:38.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.435+0000 7f57ad9a1700 1 -- 172.21.15.133:0/3681661236 shutdown_connections 2021-01-03T12:58:38.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.435+0000 7f57ad9a1700 1 --2- 172.21.15.133:0/3681661236 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5780055440 0x7f5780057900 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.435+0000 7f57ad9a1700 1 --2- 172.21.15.133:0/3681661236 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57a81442a0 0x7f57a81565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.435+0000 7f57ad9a1700 1 --2- 172.21.15.133:0/3681661236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57a80b5260 0x7f57a80ad3c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.435+0000 7f57ad9a1700 1 --2- 172.21.15.133:0/3681661236 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57a80b5c00 0x7f57a81560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.435+0000 7f57ad9a1700 1 -- 172.21.15.133:0/3681661236 >> 172.21.15.133:0/3681661236 conn(0x7f57a805bdf0 msgr2=0x7f57a80b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:38.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.435+0000 7f57ad9a1700 1 -- 172.21.15.133:0/3681661236 shutdown_connections 2021-01-03T12:58:38.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.435+0000 7f57ad9a1700 1 -- 172.21.15.133:0/3681661236 wait complete. 2021-01-03T12:58:38.449 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T12:58:38.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.563+0000 7fd11ffff700 1 Processor -- start 2021-01-03T12:58:38.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.563+0000 7fd11ffff700 1 -- start start 2021-01-03T12:58:38.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11ffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd1200afa80 0x7fd1200b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11ffff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1200aaa10 con 0x7fd1200ae900 2021-01-03T12:58:38.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11ffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1200b0ab0 con 0x7fd120060890 2021-01-03T12:58:38.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11ffff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1200ab280 con 0x7fd1200afa80 2021-01-03T12:58:38.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11effd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd120060890 0x7fd1200abcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53944/0 (socket says 172.21.15.133:53944) 2021-01-03T12:58:38.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11effd700 1 -- 172.21.15.133:0/4215000011 learned_addr learned my addr 172.21.15.133:0/4215000011 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:38.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11e7fc700 1 --2- 172.21.15.133:0/4215000011 >> v2:172.21.15.16:3300/0 conn(0x7fd1200afa80 0x7fd1200b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 -- 172.21.15.133:0/4215000011 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400741044 0 0) 0x7fd1200b0ab0 con 0x7fd120060890 2021-01-03T12:58:38.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 -- 172.21.15.133:0/4215000011 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd104003230 con 0x7fd120060890 2021-01-03T12:58:38.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 -- 172.21.15.133:0/4215000011 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 530652770 0 0) 0x7fd104003230 con 0x7fd120060890 2021-01-03T12:58:38.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 -- 172.21.15.133:0/4215000011 >> v2:172.21.15.16:3300/0 conn(0x7fd1200afa80 msgr2=0x7fd1200b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:38.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 --2- 172.21.15.133:0/4215000011 >> v2:172.21.15.16:3300/0 conn(0x7fd1200afa80 0x7fd1200b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 -- 172.21.15.133:0/4215000011 >> v1:172.21.15.16:6789/0 conn(0x7fd1200ae900 legacy=0x7fd1200aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 -- 172.21.15.133:0/4215000011 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1200b1240 con 0x7fd120060890 2021-01-03T12:58:38.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11e7fc700 1 --2- 172.21.15.133:0/4215000011 >> v2:172.21.15.16:3300/0 conn(0x7fd1200afa80 0x7fd1200b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:38.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 -- 172.21.15.133:0/4215000011 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fd1100016d0 con 0x7fd120060890 2021-01-03T12:58:38.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 -- 172.21.15.133:0/4215000011 >> v1:172.21.15.133:6789/0 conn(0x7fd120060890 legacy=0x7fd1200abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 --2- 172.21.15.133:0/4215000011 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd104003720 0x7fd104003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 --2- 172.21.15.133:0/4215000011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1040044d0 0x7fd104004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 --2- 172.21.15.133:0/4215000011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd104004e40 0x7fd10400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 -- 172.21.15.133:0/4215000011 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200ab280 con 0x7fd104004e40 2021-01-03T12:58:38.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 -- 172.21.15.133:0/4215000011 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd104004250 con 0x7fd1040044d0 2021-01-03T12:58:38.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 -- 172.21.15.133:0/4215000011 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10400bc10 con 0x7fd104003720 2021-01-03T12:58:38.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11e7fc700 1 --2- 172.21.15.133:0/4215000011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1040044d0 0x7fd104004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11effd700 1 --2- 172.21.15.133:0/4215000011 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd104003720 0x7fd104003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11f7fe700 1 --2- 172.21.15.133:0/4215000011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd104004e40 0x7fd10400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11e7fc700 1 -- 172.21.15.133:0/4215000011 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd104003720 msgr2=0x7fd104003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:38.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11e7fc700 1 --2- 172.21.15.133:0/4215000011 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd104003720 0x7fd104003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11e7fc700 1 -- 172.21.15.133:0/4215000011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd104004e40 msgr2=0x7fd10400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:38.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11e7fc700 1 --2- 172.21.15.133:0/4215000011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd104004e40 0x7fd10400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11e7fc700 1 -- 172.21.15.133:0/4215000011 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd104003230 con 0x7fd1040044d0 2021-01-03T12:58:38.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11f7fe700 1 --2- 172.21.15.133:0/4215000011 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd104004e40 0x7fd10400b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:38.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11f7fe700 1 -- 172.21.15.133:0/4215000011 reap_dead start 2021-01-03T12:58:38.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11e7fc700 1 --2- 172.21.15.133:0/4215000011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1040044d0 0x7fd104004950 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fd11400c000 tx=0x7fd1140091a0).ready entity=mon.1 client_cookie=dca8df1e33008d26 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:38.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 -- 172.21.15.133:0/4215000011 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd11400ede0 con 0x7fd1040044d0 2021-01-03T12:58:38.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 -- 172.21.15.133:0/4215000011 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1140123f0 con 0x7fd1040044d0 2021-01-03T12:58:38.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11dffb700 1 -- 172.21.15.133:0/4215000011 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd114012750 con 0x7fd1040044d0 2021-01-03T12:58:38.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11ffff700 1 -- 172.21.15.133:0/4215000011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1040044d0 msgr2=0x7fd104004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11ffff700 1 --2- 172.21.15.133:0/4215000011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1040044d0 0x7fd104004950 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fd11400c000 tx=0x7fd1140091a0).stop 2021-01-03T12:58:38.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11ffff700 1 -- 172.21.15.133:0/4215000011 shutdown_connections 2021-01-03T12:58:38.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11ffff700 1 --2- 172.21.15.133:0/4215000011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1040044d0 0x7fd104004950 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11ffff700 1 -- 172.21.15.133:0/4215000011 >> 172.21.15.133:0/4215000011 conn(0x7fd12005bdf0 msgr2=0x7fd12005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:38.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11ffff700 1 -- 172.21.15.133:0/4215000011 shutdown_connections 2021-01-03T12:58:38.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.567+0000 7fd11ffff700 1 -- 172.21.15.133:0/4215000011 wait complete. 2021-01-03T12:58:38.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11ffff700 1 Processor -- start 2021-01-03T12:58:38.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11ffff700 1 -- start start 2021-01-03T12:58:38.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1040044d0 0x7fd120149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd120092990 0x7fd1200965f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd120092ea0 0x7fd120096ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11ffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd120155970 con 0x7fd120092990 2021-01-03T12:58:38.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd120155e70 con 0x7fd120092ea0 2021-01-03T12:58:38.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd120093c40 con 0x7fd1040044d0 2021-01-03T12:58:38.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd120092ea0 0x7fd120096ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd120092ea0 0x7fd120096ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32928/0 (socket says 172.21.15.133:32928) 2021-01-03T12:58:38.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11f7fe700 1 -- 172.21.15.133:0/2049625320 learned_addr learned my addr 172.21.15.133:0/2049625320 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:38.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11e7fc700 1 --2- 172.21.15.133:0/2049625320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd120092990 0x7fd1200965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11effd700 1 --2- 172.21.15.133:0/2049625320 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1040044d0 0x7fd120149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11f7fe700 1 -- 172.21.15.133:0/2049625320 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1040044d0 msgr2=0x7fd120149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11f7fe700 1 --2- 172.21.15.133:0/2049625320 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1040044d0 0x7fd120149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11f7fe700 1 -- 172.21.15.133:0/2049625320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd120092990 msgr2=0x7fd1200965f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11f7fe700 1 --2- 172.21.15.133:0/2049625320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd120092990 0x7fd1200965f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11f7fe700 1 -- 172.21.15.133:0/2049625320 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd120155bd0 con 0x7fd120092ea0 2021-01-03T12:58:38.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11e7fc700 1 --2- 172.21.15.133:0/2049625320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd120092990 0x7fd1200965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:38.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11effd700 1 --2- 172.21.15.133:0/2049625320 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1040044d0 0x7fd120149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:38.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11f7fe700 1 --2- 172.21.15.133:0/2049625320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd120092ea0 0x7fd120096ae0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fd1200ab9a0 tx=0x7fd118009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:38.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd10ffff700 1 -- 172.21.15.133:0/2049625320 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd118013420 con 0x7fd120092ea0 2021-01-03T12:58:38.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd10ffff700 1 -- 172.21.15.133:0/2049625320 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd118013580 con 0x7fd120092ea0 2021-01-03T12:58:38.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11ffff700 1 -- 172.21.15.133:0/2049625320 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1200926f0 con 0x7fd120092ea0 2021-01-03T12:58:38.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd10ffff700 1 -- 172.21.15.133:0/2049625320 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1180138e0 con 0x7fd120092ea0 2021-01-03T12:58:38.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.571+0000 7fd11ffff700 1 -- 172.21.15.133:0/2049625320 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1200941c0 con 0x7fd120092ea0 2021-01-03T12:58:38.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.575+0000 7fd10ffff700 1 -- 172.21.15.133:0/2049625320 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd11801d070 con 0x7fd120092ea0 2021-01-03T12:58:38.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.575+0000 7fd11ffff700 1 -- 172.21.15.133:0/2049625320 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd120096310 con 0x7fd120092ea0 2021-01-03T12:58:38.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.575+0000 7fd10ffff700 1 --2- 172.21.15.133:0/2049625320 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd0fc055440 0x7fd0fc057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.575+0000 7fd11effd700 1 --2- 172.21.15.133:0/2049625320 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd0fc055440 0x7fd0fc057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.575+0000 7fd10ffff700 1 -- 172.21.15.133:0/2049625320 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd11806cec0 con 0x7fd120092ea0 2021-01-03T12:58:38.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.575+0000 7fd11effd700 1 --2- 172.21.15.133:0/2049625320 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd0fc055440 0x7fd0fc057900 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fd110005000 tx=0x7fd110009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:38.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.583+0000 7fd10ffff700 1 -- 172.21.15.133:0/2049625320 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd1180433e0 con 0x7fd120092ea0 2021-01-03T12:58:38.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.715+0000 7fd11ffff700 1 -- 172.21.15.133:0/2049625320 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd120057300 con 0x7fd120092ea0 2021-01-03T12:58:38.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.715+0000 7fd10ffff700 1 -- 172.21.15.133:0/2049625320 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd118046a00 con 0x7fd120092ea0 2021-01-03T12:58:38.717 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:38.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.719+0000 7fd11ffff700 1 -- 172.21.15.133:0/2049625320 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd0fc055440 msgr2=0x7fd0fc057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.719+0000 7fd11ffff700 1 --2- 172.21.15.133:0/2049625320 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd0fc055440 0x7fd0fc057900 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fd110005000 tx=0x7fd110009040).stop 2021-01-03T12:58:38.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.719+0000 7fd11ffff700 1 -- 172.21.15.133:0/2049625320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd120092ea0 msgr2=0x7fd120096ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.719+0000 7fd11ffff700 1 --2- 172.21.15.133:0/2049625320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd120092ea0 0x7fd120096ae0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fd1200ab9a0 tx=0x7fd118009040).stop 2021-01-03T12:58:38.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.719+0000 7fd11ffff700 1 -- 172.21.15.133:0/2049625320 shutdown_connections 2021-01-03T12:58:38.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.719+0000 7fd11ffff700 1 --2- 172.21.15.133:0/2049625320 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd0fc055440 0x7fd0fc057900 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.719+0000 7fd11ffff700 1 --2- 172.21.15.133:0/2049625320 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd120092ea0 0x7fd120096ae0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.719+0000 7fd11ffff700 1 --2- 172.21.15.133:0/2049625320 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1040044d0 0x7fd120149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.719+0000 7fd11ffff700 1 --2- 172.21.15.133:0/2049625320 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd120092990 0x7fd1200965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.719+0000 7fd11ffff700 1 -- 172.21.15.133:0/2049625320 >> 172.21.15.133:0/2049625320 conn(0x7fd12005bdf0 msgr2=0x7fd12005f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:38.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.719+0000 7fd11ffff700 1 -- 172.21.15.133:0/2049625320 shutdown_connections 2021-01-03T12:58:38.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.719+0000 7fd11ffff700 1 -- 172.21.15.133:0/2049625320 wait complete. 2021-01-03T12:58:38.730 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-01-03T12:58:38.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc1109c5700 1 Processor -- start 2021-01-03T12:58:38.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc1109c5700 1 -- start start 2021-01-03T12:58:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc1109c5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc10c0b02b0 0x7fc10c0668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc1109c5700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10c05c510 con 0x7fc10c05c130 2021-01-03T12:58:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc1109c5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10c0b15a0 con 0x7fc10c0622f0 2021-01-03T12:58:38.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc1109c5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10c1473d0 con 0x7fc10c0b02b0 2021-01-03T12:58:38.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc10b59e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc10c0622f0 0x7fc10c066d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:53968/0 (socket says 172.21.15.133:53968) 2021-01-03T12:58:38.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc10b59e700 1 -- 172.21.15.133:0/1610632985 learned_addr learned my addr 172.21.15.133:0/1610632985 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:38.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc10a59c700 1 --2- 172.21.15.133:0/1610632985 >> v2:172.21.15.133:3300/0 conn(0x7fc10c0b02b0 0x7fc10c0668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc109d9b700 1 -- 172.21.15.133:0/1610632985 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1688015466 0 0) 0x7fc10c0b15a0 con 0x7fc10c0622f0 2021-01-03T12:58:38.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc109d9b700 1 -- 172.21.15.133:0/1610632985 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0f0003230 con 0x7fc10c0622f0 2021-01-03T12:58:38.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc10a59c700 1 -- 172.21.15.133:0/1610632985 >> v1:172.21.15.133:6789/0 conn(0x7fc10c0622f0 legacy=0x7fc10c066d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc109d9b700 1 -- 172.21.15.133:0/1610632985 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 504030120 0 0) 0x7fc0f0003230 con 0x7fc10c0622f0 2021-01-03T12:58:38.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc10a59c700 1 -- 172.21.15.133:0/1610632985 >> v1:172.21.15.16:6789/0 conn(0x7fc10c05c130 legacy=0x7fc10c0b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc10a59c700 1 -- 172.21.15.133:0/1610632985 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c061920 con 0x7fc10c0b02b0 2021-01-03T12:58:38.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc10a59c700 1 --2- 172.21.15.133:0/1610632985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10c0b02b0 0x7fc10c0668a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fc1040018d0 tx=0x7fc100006dc0).ready entity=mon.1 client_cookie=74572c72bcf371d3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:38.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc109d9b700 1 -- 172.21.15.133:0/1610632985 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc104001730 con 0x7fc10c0b02b0 2021-01-03T12:58:38.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc109d9b700 1 -- 172.21.15.133:0/1610632985 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc100009670 con 0x7fc10c0b02b0 2021-01-03T12:58:38.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc109d9b700 1 -- 172.21.15.133:0/1610632985 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1000097e0 con 0x7fc10c0b02b0 2021-01-03T12:58:38.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc1109c5700 1 -- 172.21.15.133:0/1610632985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10c0b02b0 msgr2=0x7fc10c0668a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.843+0000 7fc1109c5700 1 --2- 172.21.15.133:0/1610632985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10c0b02b0 0x7fc10c0668a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fc1040018d0 tx=0x7fc100006dc0).stop 2021-01-03T12:58:38.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc1109c5700 1 -- 172.21.15.133:0/1610632985 shutdown_connections 2021-01-03T12:58:38.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc1109c5700 1 --2- 172.21.15.133:0/1610632985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10c0b02b0 0x7fc10c0668a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc1109c5700 1 -- 172.21.15.133:0/1610632985 >> 172.21.15.133:0/1610632985 conn(0x7fc10c0b6110 msgr2=0x7fc10c0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:38.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc1109c5700 1 -- 172.21.15.133:0/1610632985 shutdown_connections 2021-01-03T12:58:38.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc1109c5700 1 -- 172.21.15.133:0/1610632985 wait complete. 2021-01-03T12:58:38.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc1109c5700 1 Processor -- start 2021-01-03T12:58:38.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc1109c5700 1 -- start start 2021-01-03T12:58:38.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc1109c5700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc10c05c130 0x7fc10c0ac790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc1109c5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10c0622f0 0x7fc10c1524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc1109c5700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc10c0b02b0 0x7fc10c1529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc1109c5700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c151e30 con 0x7fc10c05c130 2021-01-03T12:58:38.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc1109c5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c063870 con 0x7fc10c0622f0 2021-01-03T12:58:38.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc1109c5700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c063aa0 con 0x7fc10c0b02b0 2021-01-03T12:58:38.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc10a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10c0622f0 0x7fc10c1524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc10a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10c0622f0 0x7fc10c1524c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32938/0 (socket says 172.21.15.133:32938) 2021-01-03T12:58:38.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc10a59c700 1 -- 172.21.15.133:0/1236292192 learned_addr learned my addr 172.21.15.133:0/1236292192 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:38.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc10b59e700 1 --2- 172.21.15.133:0/1236292192 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc10c0b02b0 0x7fc10c1529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc10ad9d700 1 --2- 172.21.15.133:0/1236292192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc10c05c130 0x7fc10c0ac790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc10a59c700 1 -- 172.21.15.133:0/1236292192 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc10c0b02b0 msgr2=0x7fc10c1529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc10a59c700 1 --2- 172.21.15.133:0/1236292192 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc10c0b02b0 0x7fc10c1529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc10a59c700 1 -- 172.21.15.133:0/1236292192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc10c05c130 msgr2=0x7fc10c0ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:38.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc10a59c700 1 --2- 172.21.15.133:0/1236292192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc10c05c130 0x7fc10c0ac790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:38.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc10a59c700 1 -- 172.21.15.133:0/1236292192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c152020 con 0x7fc10c0622f0 2021-01-03T12:58:38.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.847+0000 7fc10b59e700 1 --2- 172.21.15.133:0/1236292192 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc10c0b02b0 0x7fc10c1529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:38.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.851+0000 7fc10a59c700 1 --2- 172.21.15.133:0/1236292192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10c0622f0 0x7fc10c1524c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fc1040018d0 tx=0x7fc100015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:38.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.851+0000 7fc0fbfff700 1 -- 172.21.15.133:0/1236292192 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc100011ce0 con 0x7fc10c0622f0 2021-01-03T12:58:38.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.851+0000 7fc0fbfff700 1 -- 172.21.15.133:0/1236292192 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc100011e40 con 0x7fc10c0622f0 2021-01-03T12:58:38.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.851+0000 7fc1109c5700 1 -- 172.21.15.133:0/1236292192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10c0a3de0 con 0x7fc10c0622f0 2021-01-03T12:58:38.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.851+0000 7fc0fbfff700 1 -- 172.21.15.133:0/1236292192 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc10001d640 con 0x7fc10c0622f0 2021-01-03T12:58:38.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.851+0000 7fc1109c5700 1 -- 172.21.15.133:0/1236292192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10c0646b0 con 0x7fc10c0622f0 2021-01-03T12:58:38.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.851+0000 7fc1109c5700 1 -- 172.21.15.133:0/1236292192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10c063c60 con 0x7fc10c0622f0 2021-01-03T12:58:38.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.851+0000 7fc0fbfff700 1 -- 172.21.15.133:0/1236292192 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc100024030 con 0x7fc10c0622f0 2021-01-03T12:58:38.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.851+0000 7fc0fbfff700 1 --2- 172.21.15.133:0/1236292192 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc0e8055440 0x7fc0e8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:38.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.851+0000 7fc10ad9d700 1 --2- 172.21.15.133:0/1236292192 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc0e8055440 0x7fc0e8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:38.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.851+0000 7fc0fbfff700 1 -- 172.21.15.133:0/1236292192 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc10006ed80 con 0x7fc10c0622f0 2021-01-03T12:58:38.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.851+0000 7fc10ad9d700 1 --2- 172.21.15.133:0/1236292192 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc0e8055440 0x7fc0e8057900 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fc0fc00b000 tx=0x7fc0fc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:38.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:38.859+0000 7fc0fbfff700 1 -- 172.21.15.133:0/1236292192 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc1000452a0 con 0x7fc10c0622f0 2021-01-03T12:58:39.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.003+0000 7fc1109c5700 1 -- 172.21.15.133:0/1236292192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc10c1521b0 con 0x7fc10c0622f0 2021-01-03T12:58:39.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.003+0000 7fc0fbfff700 1 -- 172.21.15.133:0/1236292192 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+143 (secure 0 0 0) 0x7fc100022070 con 0x7fc10c0622f0 2021-01-03T12:58:39.004 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:39.005 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2021-01-03T12:58:39.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:39.005 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2021-01-03T12:58:39.005 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2021-01-03T12:58:39.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:58:39.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:58:39.006 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2021-01-03T12:58:39.006 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2021-01-03T12:58:39.007 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:58:39.007 INFO:teuthology.orchestra.run.smithi133.stdout:] 2021-01-03T12:58:39.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.003+0000 7fc1109c5700 1 -- 172.21.15.133:0/1236292192 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc0e8055440 msgr2=0x7fc0e8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:39.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.003+0000 7fc1109c5700 1 --2- 172.21.15.133:0/1236292192 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc0e8055440 0x7fc0e8057900 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fc0fc00b000 tx=0x7fc0fc009040).stop 2021-01-03T12:58:39.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.003+0000 7fc1109c5700 1 -- 172.21.15.133:0/1236292192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10c0622f0 msgr2=0x7fc10c1524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:39.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.003+0000 7fc1109c5700 1 --2- 172.21.15.133:0/1236292192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10c0622f0 0x7fc10c1524c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fc1040018d0 tx=0x7fc100015000).stop 2021-01-03T12:58:39.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.003+0000 7fc1109c5700 1 -- 172.21.15.133:0/1236292192 shutdown_connections 2021-01-03T12:58:39.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.003+0000 7fc1109c5700 1 --2- 172.21.15.133:0/1236292192 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc0e8055440 0x7fc0e8057900 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:39.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.003+0000 7fc1109c5700 1 --2- 172.21.15.133:0/1236292192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc10c05c130 0x7fc10c0ac790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:39.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.003+0000 7fc1109c5700 1 --2- 172.21.15.133:0/1236292192 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc10c0b02b0 0x7fc10c1529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:39.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.003+0000 7fc1109c5700 1 --2- 172.21.15.133:0/1236292192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc10c0622f0 0x7fc10c1524c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:39.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.003+0000 7fc1109c5700 1 -- 172.21.15.133:0/1236292192 >> 172.21.15.133:0/1236292192 conn(0x7fc10c0b6110 msgr2=0x7fc10c0b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:39.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.003+0000 7fc1109c5700 1 -- 172.21.15.133:0/1236292192 shutdown_connections 2021-01-03T12:58:39.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.003+0000 7fc1109c5700 1 -- 172.21.15.133:0/1236292192 wait complete. 2021-01-03T12:58:39.017 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-01-03T12:58:39.018 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-01-03T12:58:39.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36cb0ff700 1 Processor -- start 2021-01-03T12:58:39.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36cb0ff700 1 -- start start 2021-01-03T12:58:39.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36cb0ff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36c40b5260 0x7f36c41470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:39.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36cb0ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f36c40b5c00 0x7f36c41475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:39.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36cb0ff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f36c41442a0 0x7f36c4144750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:39.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36cb0ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c40b0c10 con 0x7f36c40b5c00 2021-01-03T12:58:39.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36cb0ff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36c40b5640 con 0x7f36c41442a0 2021-01-03T12:58:39.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36cb0ff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c409a4f0 con 0x7f36c40b5260 2021-01-03T12:58:39.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36ca8fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f36c41442a0 0x7f36c4144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:39.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36ca8fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f36c41442a0 0x7f36c4144750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32950/0 (socket says 172.21.15.133:32950) 2021-01-03T12:58:39.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36ca8fe700 1 -- 172.21.15.133:0/1719851370 learned_addr learned my addr 172.21.15.133:0/1719851370 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:39.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36ca0fd700 1 --2- 172.21.15.133:0/1719851370 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36c40b5260 0x7f36c41470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:39.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36c98fc700 1 --2- 172.21.15.133:0/1719851370 >> v2:172.21.15.16:3300/0 conn(0x7f36c40b5c00 0x7f36c41475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:39.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36ca8fe700 1 -- 172.21.15.133:0/1719851370 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36c40b5260 msgr2=0x7f36c41470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:39.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36ca8fe700 1 --2- 172.21.15.133:0/1719851370 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36c40b5260 0x7f36c41470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:39.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36ca8fe700 1 -- 172.21.15.133:0/1719851370 >> v2:172.21.15.16:3300/0 conn(0x7f36c40b5c00 msgr2=0x7f36c41475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:39.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36ca8fe700 1 --2- 172.21.15.133:0/1719851370 >> v2:172.21.15.16:3300/0 conn(0x7f36c40b5c00 0x7f36c41475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:39.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36ca8fe700 1 -- 172.21.15.133:0/1719851370 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c40b0e40 con 0x7f36c41442a0 2021-01-03T12:58:39.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36ca8fe700 1 --2- 172.21.15.133:0/1719851370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c41442a0 0x7f36c4144750 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f36bc0032b0 tx=0x7f36bc009270).ready entity=mon.1 client_cookie=619209b06f2d8933 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:39.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36c90fb700 1 -- 172.21.15.133:0/1719851370 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36bc009e60 con 0x7f36c41442a0 2021-01-03T12:58:39.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36c90fb700 1 -- 172.21.15.133:0/1719851370 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36bc00bb50 con 0x7f36c41442a0 2021-01-03T12:58:39.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36c90fb700 1 -- 172.21.15.133:0/1719851370 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36bc00bcc0 con 0x7f36c41442a0 2021-01-03T12:58:39.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36cb0ff700 1 -- 172.21.15.133:0/1719851370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c41442a0 msgr2=0x7f36c4144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:39.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36cb0ff700 1 --2- 172.21.15.133:0/1719851370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c41442a0 0x7f36c4144750 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f36bc0032b0 tx=0x7f36bc009270).stop 2021-01-03T12:58:39.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36cb0ff700 1 -- 172.21.15.133:0/1719851370 shutdown_connections 2021-01-03T12:58:39.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36cb0ff700 1 --2- 172.21.15.133:0/1719851370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c41442a0 0x7f36c4144750 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:39.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36cb0ff700 1 --2- 172.21.15.133:0/1719851370 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36c40b5260 0x7f36c41470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:39.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36cb0ff700 1 --2- 172.21.15.133:0/1719851370 >> v2:172.21.15.16:3300/0 conn(0x7f36c40b5c00 0x7f36c41475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:39.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36cb0ff700 1 -- 172.21.15.133:0/1719851370 >> 172.21.15.133:0/1719851370 conn(0x7f36c405bdf0 msgr2=0x7f36c405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:39.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36cb0ff700 1 -- 172.21.15.133:0/1719851370 shutdown_connections 2021-01-03T12:58:39.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.131+0000 7f36cb0ff700 1 -- 172.21.15.133:0/1719851370 wait complete. 2021-01-03T12:58:39.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36cb0ff700 1 Processor -- start 2021-01-03T12:58:39.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36cb0ff700 1 -- start start 2021-01-03T12:58:39.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36cb0ff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36c40b5260 0x7f36c4146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:39.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36cb0ff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c40b5c00 0x7f36c41415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:39.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36cb0ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36c41442a0 0x7f36c4141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:39.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36cb0ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40af3f0 con 0x7f36c41442a0 2021-01-03T12:58:39.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36cb0ff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c40636c0 con 0x7f36c40b5c00 2021-01-03T12:58:39.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36cb0ff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c4063960 con 0x7f36c40b5260 2021-01-03T12:58:39.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36c98fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c40b5c00 0x7f36c41415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:39.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36c98fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c40b5c00 0x7f36c41415c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32952/0 (socket says 172.21.15.133:32952) 2021-01-03T12:58:39.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36c98fc700 1 -- 172.21.15.133:0/3922941771 learned_addr learned my addr 172.21.15.133:0/3922941771 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:39.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36ca0fd700 1 --2- 172.21.15.133:0/3922941771 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36c40b5260 0x7f36c4146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:39.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36c98fc700 1 -- 172.21.15.133:0/3922941771 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36c40b5260 msgr2=0x7f36c4146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:39.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36ca8fe700 1 --2- 172.21.15.133:0/3922941771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36c41442a0 0x7f36c4141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:39.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36c98fc700 1 --2- 172.21.15.133:0/3922941771 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36c40b5260 0x7f36c4146410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:39.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36c98fc700 1 -- 172.21.15.133:0/3922941771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36c41442a0 msgr2=0x7f36c4141ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:39.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36c98fc700 1 --2- 172.21.15.133:0/3922941771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36c41442a0 0x7f36c4141ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:39.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36c98fc700 1 -- 172.21.15.133:0/3922941771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c4065d80 con 0x7f36c40b5c00 2021-01-03T12:58:39.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36ca0fd700 1 --2- 172.21.15.133:0/3922941771 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36c40b5260 0x7f36c4146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:39.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36ca8fe700 1 --2- 172.21.15.133:0/3922941771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36c41442a0 0x7f36c4141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:39.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36c98fc700 1 --2- 172.21.15.133:0/3922941771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c40b5c00 0x7f36c41415c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f36b400c000 tx=0x7f36b4006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:39.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36b37fe700 1 -- 172.21.15.133:0/3922941771 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36b400ca10 con 0x7f36c40b5c00 2021-01-03T12:58:39.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36b37fe700 1 -- 172.21.15.133:0/3922941771 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b400cb70 con 0x7f36c40b5c00 2021-01-03T12:58:39.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36cb0ff700 1 -- 172.21.15.133:0/3922941771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36c4146a40 con 0x7f36c40b5c00 2021-01-03T12:58:39.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36b37fe700 1 -- 172.21.15.133:0/3922941771 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36b40123f0 con 0x7f36c40b5c00 2021-01-03T12:58:39.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.135+0000 7f36cb0ff700 1 -- 172.21.15.133:0/3922941771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36c40aed30 con 0x7f36c40b5c00 2021-01-03T12:58:39.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.139+0000 7f36b37fe700 1 -- 172.21.15.133:0/3922941771 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f36b4012550 con 0x7f36c40b5c00 2021-01-03T12:58:39.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.139+0000 7f36cb0ff700 1 -- 172.21.15.133:0/3922941771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36c40687f0 con 0x7f36c40b5c00 2021-01-03T12:58:39.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.139+0000 7f36b37fe700 1 --2- 172.21.15.133:0/3922941771 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f36a40553b0 0x7f36a4057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:39.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.139+0000 7f36ca0fd700 1 --2- 172.21.15.133:0/3922941771 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f36a40553b0 0x7f36a4057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:39.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.139+0000 7f36b37fe700 1 -- 172.21.15.133:0/3922941771 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f36b406e240 con 0x7f36c40b5c00 2021-01-03T12:58:39.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.139+0000 7f36ca0fd700 1 --2- 172.21.15.133:0/3922941771 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f36a40553b0 0x7f36a4057870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f36c000b000 tx=0x7f36c0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:39.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.143+0000 7f36b37fe700 1 -- 172.21.15.133:0/3922941771 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f36c40687f0 con 0x7f36c40b5c00 2021-01-03T12:58:39.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:39.283+0000 7f36cb0ff700 1 -- 172.21.15.133:0/3922941771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f36c4063520 con 0x7f36c40b5c00 2021-01-03T12:58:40.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.215+0000 7f36b37fe700 1 -- 172.21.15.133:0/3922941771 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v31) v1 ==== 133+0+0 (secure 0 0 0) 0x7f36c4063520 con 0x7f36c40b5c00 2021-01-03T12:58:40.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.219+0000 7f36cb0ff700 1 -- 172.21.15.133:0/3922941771 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f36a40553b0 msgr2=0x7f36a4057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:40.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.219+0000 7f36cb0ff700 1 --2- 172.21.15.133:0/3922941771 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f36a40553b0 0x7f36a4057870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f36c000b000 tx=0x7f36c0008040).stop 2021-01-03T12:58:40.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.219+0000 7f36cb0ff700 1 -- 172.21.15.133:0/3922941771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c40b5c00 msgr2=0x7f36c41415c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:40.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.219+0000 7f36cb0ff700 1 --2- 172.21.15.133:0/3922941771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c40b5c00 0x7f36c41415c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f36b400c000 tx=0x7f36b4006dc0).stop 2021-01-03T12:58:40.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.219+0000 7f36cb0ff700 1 -- 172.21.15.133:0/3922941771 shutdown_connections 2021-01-03T12:58:40.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.219+0000 7f36cb0ff700 1 --2- 172.21.15.133:0/3922941771 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f36a40553b0 0x7f36a4057870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:40.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.219+0000 7f36cb0ff700 1 --2- 172.21.15.133:0/3922941771 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36c41442a0 0x7f36c4141ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:40.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.219+0000 7f36cb0ff700 1 --2- 172.21.15.133:0/3922941771 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36c40b5260 0x7f36c4146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:40.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.219+0000 7f36cb0ff700 1 --2- 172.21.15.133:0/3922941771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36c40b5c00 0x7f36c41415c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:40.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.219+0000 7f36cb0ff700 1 -- 172.21.15.133:0/3922941771 >> 172.21.15.133:0/3922941771 conn(0x7f36c405bdf0 msgr2=0x7f36c40b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:40.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.219+0000 7f36cb0ff700 1 -- 172.21.15.133:0/3922941771 shutdown_connections 2021-01-03T12:58:40.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.219+0000 7f36cb0ff700 1 -- 172.21.15.133:0/3922941771 wait complete. 2021-01-03T12:58:40.223 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2021-01-03T12:58:40.236 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-01-03T12:58:40.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.351+0000 7ff5e5038700 1 Processor -- start 2021-01-03T12:58:40.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.351+0000 7ff5e5038700 1 -- start start 2021-01-03T12:58:40.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5e5038700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff5e00ab3e0 0x7ff5e00ab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:40.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5e5038700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5e00abcb0 0x7ff5e013be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:40.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5e5038700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e00b5880 con 0x7ff5e013c320 2021-01-03T12:58:40.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5e5038700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e00b5b20 con 0x7ff5e00ab3e0 2021-01-03T12:58:40.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5e5038700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e00b1390 con 0x7ff5e00abcb0 2021-01-03T12:58:40.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5df7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5e00abcb0 0x7ff5e013be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:40.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5df7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5e00abcb0 0x7ff5e013be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32960/0 (socket says 172.21.15.133:32960) 2021-01-03T12:58:40.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5df7fe700 1 -- 172.21.15.133:0/2494152688 learned_addr learned my addr 172.21.15.133:0/2494152688 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:40.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5dffff700 1 --2- 172.21.15.133:0/2494152688 >> v2:172.21.15.16:3300/0 conn(0x7ff5e00ab3e0 0x7ff5e00ab7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:40.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5df7fe700 1 -- 172.21.15.133:0/2494152688 >> v2:172.21.15.16:3300/0 conn(0x7ff5e00ab3e0 msgr2=0x7ff5e00ab7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:40.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5df7fe700 1 --2- 172.21.15.133:0/2494152688 >> v2:172.21.15.16:3300/0 conn(0x7ff5e00ab3e0 0x7ff5e00ab7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:40.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5df7fe700 1 -- 172.21.15.133:0/2494152688 >> v1:172.21.15.16:6789/0 conn(0x7ff5e013c320 legacy=0x7ff5e01426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:40.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5df7fe700 1 -- 172.21.15.133:0/2494152688 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e00b1630 con 0x7ff5e00abcb0 2021-01-03T12:58:40.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5df7fe700 1 --2- 172.21.15.133:0/2494152688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e00abcb0 0x7ff5e013be30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7ff5d0002f30 tx=0x7ff5d0006e80).ready entity=mon.1 client_cookie=e9d63ea7ba0194e9 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:40.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5deffd700 1 -- 172.21.15.133:0/2494152688 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5d00097f0 con 0x7ff5e00abcb0 2021-01-03T12:58:40.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5deffd700 1 -- 172.21.15.133:0/2494152688 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d0009950 con 0x7ff5e00abcb0 2021-01-03T12:58:40.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5deffd700 1 -- 172.21.15.133:0/2494152688 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5d0009cb0 con 0x7ff5e00abcb0 2021-01-03T12:58:40.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5e5038700 1 -- 172.21.15.133:0/2494152688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e00abcb0 msgr2=0x7ff5e013be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:40.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5e5038700 1 --2- 172.21.15.133:0/2494152688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e00abcb0 0x7ff5e013be30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7ff5d0002f30 tx=0x7ff5d0006e80).stop 2021-01-03T12:58:40.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5e5038700 1 -- 172.21.15.133:0/2494152688 shutdown_connections 2021-01-03T12:58:40.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5e5038700 1 --2- 172.21.15.133:0/2494152688 >> v2:172.21.15.16:3300/0 conn(0x7ff5e00ab3e0 0x7ff5e00ab7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:40.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5e5038700 1 --2- 172.21.15.133:0/2494152688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e00abcb0 0x7ff5e013be30 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:40.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5e5038700 1 -- 172.21.15.133:0/2494152688 >> 172.21.15.133:0/2494152688 conn(0x7ff5e005bdf0 msgr2=0x7ff5e005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:40.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5e5038700 1 -- 172.21.15.133:0/2494152688 shutdown_connections 2021-01-03T12:58:40.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.355+0000 7ff5e5038700 1 -- 172.21.15.133:0/2494152688 wait complete. 2021-01-03T12:58:40.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5e5038700 1 Processor -- start 2021-01-03T12:58:40.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5e5038700 1 -- start start 2021-01-03T12:58:40.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5e5038700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e00ab3e0 0x7ff5e00608c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:40.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5e5038700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5e00abcb0 0x7ff5e00b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:40.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5e5038700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5e013c320 0x7ff5e00644d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:40.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5e5038700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e00af5f0 con 0x7ff5e00abcb0 2021-01-03T12:58:40.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5e5038700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0067500 con 0x7ff5e00ab3e0 2021-01-03T12:58:40.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5e5038700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0067030 con 0x7ff5e013c320 2021-01-03T12:58:40.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5dffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e00ab3e0 0x7ff5e00608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:40.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5dffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e00ab3e0 0x7ff5e00608c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32966/0 (socket says 172.21.15.133:32966) 2021-01-03T12:58:40.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5dffff700 1 -- 172.21.15.133:0/2476117845 learned_addr learned my addr 172.21.15.133:0/2476117845 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:40.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5df7fe700 1 --2- 172.21.15.133:0/2476117845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5e00abcb0 0x7ff5e00b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:40.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5e4837700 1 --2- 172.21.15.133:0/2476117845 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5e013c320 0x7ff5e00644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:40.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5dffff700 1 -- 172.21.15.133:0/2476117845 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5e013c320 msgr2=0x7ff5e00644d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:40.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5dffff700 1 --2- 172.21.15.133:0/2476117845 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5e013c320 0x7ff5e00644d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:40.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5dffff700 1 -- 172.21.15.133:0/2476117845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5e00abcb0 msgr2=0x7ff5e00b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:40.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5dffff700 1 --2- 172.21.15.133:0/2476117845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5e00abcb0 0x7ff5e00b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:40.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5dffff700 1 -- 172.21.15.133:0/2476117845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e00af910 con 0x7ff5e00ab3e0 2021-01-03T12:58:40.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5dffff700 1 --2- 172.21.15.133:0/2476117845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e00ab3e0 0x7ff5e00608c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7ff5d4003070 tx=0x7ff5d4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:40.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5dd7fa700 1 -- 172.21.15.133:0/2476117845 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5d4009790 con 0x7ff5e00ab3e0 2021-01-03T12:58:40.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5dd7fa700 1 -- 172.21.15.133:0/2476117845 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d40098f0 con 0x7ff5e00ab3e0 2021-01-03T12:58:40.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5e5038700 1 -- 172.21.15.133:0/2476117845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e0067260 con 0x7ff5e00ab3e0 2021-01-03T12:58:40.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.359+0000 7ff5dd7fa700 1 -- 172.21.15.133:0/2476117845 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5d4009c50 con 0x7ff5e00ab3e0 2021-01-03T12:58:40.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.363+0000 7ff5e5038700 1 -- 172.21.15.133:0/2476117845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e00649c0 con 0x7ff5e00ab3e0 2021-01-03T12:58:40.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.363+0000 7ff5e5038700 1 -- 172.21.15.133:0/2476117845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e00af770 con 0x7ff5e00ab3e0 2021-01-03T12:58:40.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.363+0000 7ff5dd7fa700 1 -- 172.21.15.133:0/2476117845 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff5d4013480 con 0x7ff5e00ab3e0 2021-01-03T12:58:40.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.363+0000 7ff5dd7fa700 1 --2- 172.21.15.133:0/2476117845 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5c0055440 0x7ff5c0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:40.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.363+0000 7ff5dd7fa700 1 -- 172.21.15.133:0/2476117845 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5607+0+0 (secure 0 0 0) 0x7ff5d406e3f0 con 0x7ff5e00ab3e0 2021-01-03T12:58:40.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.363+0000 7ff5df7fe700 1 --2- 172.21.15.133:0/2476117845 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5c0055440 0x7ff5c0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:40.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.367+0000 7ff5df7fe700 1 --2- 172.21.15.133:0/2476117845 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5c0055440 0x7ff5c0057900 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7ff5d001c000 tx=0x7ff5d0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:40.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.371+0000 7ff5dd7fa700 1 -- 172.21.15.133:0/2476117845 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff5e00af770 con 0x7ff5e00ab3e0 2021-01-03T12:58:40.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:40.515+0000 7ff5e5038700 1 -- 172.21.15.133:0/2476117845 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7ff5e00af770 con 0x7ff5e00ab3e0 2021-01-03T12:58:41.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.219+0000 7ff5dd7fa700 1 -- 172.21.15.133:0/2476117845 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v32) v1 ==== 125+0+0 (secure 0 0 0) 0x7ff5e00af770 con 0x7ff5e00ab3e0 2021-01-03T12:58:41.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.227+0000 7ff5e5038700 1 -- 172.21.15.133:0/2476117845 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5c0055440 msgr2=0x7ff5c0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.227+0000 7ff5e5038700 1 --2- 172.21.15.133:0/2476117845 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5c0055440 0x7ff5c0057900 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7ff5d001c000 tx=0x7ff5d0015000).stop 2021-01-03T12:58:41.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.227+0000 7ff5e5038700 1 -- 172.21.15.133:0/2476117845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e00ab3e0 msgr2=0x7ff5e00608c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.227+0000 7ff5e5038700 1 --2- 172.21.15.133:0/2476117845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e00ab3e0 0x7ff5e00608c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7ff5d4003070 tx=0x7ff5d4008040).stop 2021-01-03T12:58:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.227+0000 7ff5e5038700 1 -- 172.21.15.133:0/2476117845 shutdown_connections 2021-01-03T12:58:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.227+0000 7ff5e5038700 1 --2- 172.21.15.133:0/2476117845 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5c0055440 0x7ff5c0057900 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.227+0000 7ff5e5038700 1 --2- 172.21.15.133:0/2476117845 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5e013c320 0x7ff5e00644d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.227+0000 7ff5e5038700 1 --2- 172.21.15.133:0/2476117845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5e00ab3e0 0x7ff5e00608c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.227+0000 7ff5e5038700 1 --2- 172.21.15.133:0/2476117845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5e00abcb0 0x7ff5e00b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.227+0000 7ff5e5038700 1 -- 172.21.15.133:0/2476117845 >> 172.21.15.133:0/2476117845 conn(0x7ff5e005bdf0 msgr2=0x7ff5e013e120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:41.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.227+0000 7ff5e5038700 1 -- 172.21.15.133:0/2476117845 shutdown_connections 2021-01-03T12:58:41.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.231+0000 7ff5e5038700 1 -- 172.21.15.133:0/2476117845 wait complete. 2021-01-03T12:58:41.232 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2021-01-03T12:58:41.244 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-01-03T12:58:41.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d5d12f700 1 Processor -- start 2021-01-03T12:58:41.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d5d12f700 1 -- start start 2021-01-03T12:58:41.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d5d12f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8d580b5c00 0x7f8d581477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d5d12f700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d580b0c10 con 0x7f8d580b5260 2021-01-03T12:58:41.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d5d12f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d580b5640 con 0x7f8d581442a0 2021-01-03T12:58:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d5d12f700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d58144e00 con 0x7f8d580b5c00 2021-01-03T12:58:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d5c92e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8d581442a0 0x7f8d581446f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54006/0 (socket says 172.21.15.133:54006) 2021-01-03T12:58:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d5c92e700 1 -- 172.21.15.133:0/1887149325 learned_addr learned my addr 172.21.15.133:0/1887149325 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d577fe700 1 --2- 172.21.15.133:0/1887149325 >> v2:172.21.15.16:3300/0 conn(0x7f8d580b5c00 0x7f8d581477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 -- 172.21.15.133:0/1887149325 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660183335 0 0) 0x7f8d580b5640 con 0x7f8d581442a0 2021-01-03T12:58:41.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 -- 172.21.15.133:0/1887149325 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d38003230 con 0x7f8d581442a0 2021-01-03T12:58:41.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 -- 172.21.15.133:0/1887149325 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 366667747 0 0) 0x7f8d38003230 con 0x7f8d581442a0 2021-01-03T12:58:41.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 -- 172.21.15.133:0/1887149325 >> v2:172.21.15.16:3300/0 conn(0x7f8d580b5c00 msgr2=0x7f8d581477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:41.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 --2- 172.21.15.133:0/1887149325 >> v2:172.21.15.16:3300/0 conn(0x7f8d580b5c00 0x7f8d581477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 -- 172.21.15.133:0/1887149325 >> v1:172.21.15.16:6789/0 conn(0x7f8d580b5260 legacy=0x7f8d581470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 -- 172.21.15.133:0/1887149325 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5809a4f0 con 0x7f8d581442a0 2021-01-03T12:58:41.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 -- 172.21.15.133:0/1887149325 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f8d48001710 con 0x7f8d581442a0 2021-01-03T12:58:41.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 -- 172.21.15.133:0/1887149325 >> v1:172.21.15.133:6789/0 conn(0x7f8d581442a0 legacy=0x7f8d581446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 --2- 172.21.15.133:0/1887149325 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d38003720 0x7f8d38003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 --2- 172.21.15.133:0/1887149325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d380044d0 0x7f8d38004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 --2- 172.21.15.133:0/1887149325 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d38004e40 0x7f8d3800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 -- 172.21.15.133:0/1887149325 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d38004250 con 0x7f8d38003720 2021-01-03T12:58:41.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 -- 172.21.15.133:0/1887149325 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3800bc10 con 0x7f8d380044d0 2021-01-03T12:58:41.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 -- 172.21.15.133:0/1887149325 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3800bd50 con 0x7f8d38004e40 2021-01-03T12:58:41.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d577fe700 1 --2- 172.21.15.133:0/1887149325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d380044d0 0x7f8d38004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d5c92e700 1 --2- 172.21.15.133:0/1887149325 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d38004e40 0x7f8d3800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d577fe700 1 -- 172.21.15.133:0/1887149325 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d38004e40 msgr2=0x7f8d3800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:41.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d57fff700 1 --2- 172.21.15.133:0/1887149325 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d38003720 0x7f8d38003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d577fe700 1 --2- 172.21.15.133:0/1887149325 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d38004e40 0x7f8d3800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d577fe700 1 -- 172.21.15.133:0/1887149325 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d38003720 msgr2=0x7f8d38003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:41.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d577fe700 1 --2- 172.21.15.133:0/1887149325 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d38003720 0x7f8d38003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d577fe700 1 -- 172.21.15.133:0/1887149325 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d38003230 con 0x7f8d380044d0 2021-01-03T12:58:41.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d5c92e700 1 -- 172.21.15.133:0/1887149325 reap_dead start 2021-01-03T12:58:41.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d57fff700 1 --2- 172.21.15.133:0/1887149325 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d38003720 0x7f8d38003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:41.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d577fe700 1 --2- 172.21.15.133:0/1887149325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d380044d0 0x7f8d38004950 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f8d4000c000 tx=0x7f8d40008040).ready entity=mon.1 client_cookie=d9cc3386f36869eb server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:41.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 -- 172.21.15.133:0/1887149325 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d4000e970 con 0x7f8d380044d0 2021-01-03T12:58:41.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 -- 172.21.15.133:0/1887149325 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4000ead0 con 0x7f8d380044d0 2021-01-03T12:58:41.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d56ffd700 1 -- 172.21.15.133:0/1887149325 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d4000ee30 con 0x7f8d380044d0 2021-01-03T12:58:41.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d5d12f700 1 -- 172.21.15.133:0/1887149325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d380044d0 msgr2=0x7f8d38004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.359+0000 7f8d5d12f700 1 --2- 172.21.15.133:0/1887149325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d380044d0 0x7f8d38004950 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f8d4000c000 tx=0x7f8d40008040).stop 2021-01-03T12:58:41.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5d12f700 1 -- 172.21.15.133:0/1887149325 shutdown_connections 2021-01-03T12:58:41.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5d12f700 1 --2- 172.21.15.133:0/1887149325 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d380044d0 0x7f8d38004950 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5d12f700 1 -- 172.21.15.133:0/1887149325 >> 172.21.15.133:0/1887149325 conn(0x7f8d5805bdf0 msgr2=0x7f8d5805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:41.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5d12f700 1 -- 172.21.15.133:0/1887149325 shutdown_connections 2021-01-03T12:58:41.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5d12f700 1 -- 172.21.15.133:0/1887149325 wait complete. 2021-01-03T12:58:41.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5d12f700 1 Processor -- start 2021-01-03T12:58:41.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5d12f700 1 -- start start 2021-01-03T12:58:41.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5d12f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d380044d0 0x7f8d580ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5d12f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d58159130 0x7f8d581595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5d12f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d580b00d0 0x7f8d580b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5d12f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d58159aa0 con 0x7f8d58159130 2021-01-03T12:58:41.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5d12f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d580661a0 con 0x7f8d580b00d0 2021-01-03T12:58:41.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5d12f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d580b0a70 con 0x7f8d380044d0 2021-01-03T12:58:41.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5c92e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d580b00d0 0x7f8d580b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5c92e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d580b00d0 0x7f8d580b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32986/0 (socket says 172.21.15.133:32986) 2021-01-03T12:58:41.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5c92e700 1 -- 172.21.15.133:0/2605182306 learned_addr learned my addr 172.21.15.133:0/2605182306 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:41.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d57fff700 1 --2- 172.21.15.133:0/2605182306 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d380044d0 0x7f8d580ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d577fe700 1 --2- 172.21.15.133:0/2605182306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d58159130 0x7f8d581595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5c92e700 1 -- 172.21.15.133:0/2605182306 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d380044d0 msgr2=0x7f8d580ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5c92e700 1 --2- 172.21.15.133:0/2605182306 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d380044d0 0x7f8d580ae700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5c92e700 1 -- 172.21.15.133:0/2605182306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d58159130 msgr2=0x7f8d581595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5c92e700 1 --2- 172.21.15.133:0/2605182306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d58159130 0x7f8d581595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5c92e700 1 -- 172.21.15.133:0/2605182306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d58067370 con 0x7f8d580b00d0 2021-01-03T12:58:41.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5c92e700 1 --2- 172.21.15.133:0/2605182306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d580b00d0 0x7f8d580b0580 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f8d48000e50 tx=0x7f8d58098d30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:41.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d557fa700 1 -- 172.21.15.133:0/2605182306 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d48010710 con 0x7f8d580b00d0 2021-01-03T12:58:41.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5d12f700 1 -- 172.21.15.133:0/2605182306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d58065f00 con 0x7f8d580b00d0 2021-01-03T12:58:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d557fa700 1 -- 172.21.15.133:0/2605182306 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d48010870 con 0x7f8d580b00d0 2021-01-03T12:58:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d557fa700 1 -- 172.21.15.133:0/2605182306 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d48010bd0 con 0x7f8d580b00d0 2021-01-03T12:58:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.363+0000 7f8d5d12f700 1 -- 172.21.15.133:0/2605182306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d580675c0 con 0x7f8d580b00d0 2021-01-03T12:58:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.367+0000 7f8d557fa700 1 -- 172.21.15.133:0/2605182306 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8d48010d30 con 0x7f8d580b00d0 2021-01-03T12:58:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.367+0000 7f8d5d12f700 1 -- 172.21.15.133:0/2605182306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d58065c20 con 0x7f8d580b00d0 2021-01-03T12:58:41.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.367+0000 7f8d557fa700 1 --2- 172.21.15.133:0/2605182306 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d3c055330 0x7f8d3c0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.367+0000 7f8d557fa700 1 -- 172.21.15.133:0/2605182306 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f8d4806d640 con 0x7f8d580b00d0 2021-01-03T12:58:41.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.367+0000 7f8d57fff700 1 --2- 172.21.15.133:0/2605182306 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d3c055330 0x7f8d3c0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.367+0000 7f8d57fff700 1 --2- 172.21.15.133:0/2605182306 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d3c055330 0x7f8d3c0577f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f8d5000e000 tx=0x7f8d50009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:41.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.371+0000 7f8d557fa700 1 -- 172.21.15.133:0/2605182306 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8d48043910 con 0x7f8d580b00d0 2021-01-03T12:58:41.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.555+0000 7f8d5d12f700 1 -- 172.21.15.133:0/2605182306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f8d58057300 con 0x7f8d580b00d0 2021-01-03T12:58:41.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.567+0000 7f8d557fa700 1 -- 172.21.15.133:0/2605182306 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 5 and data pool 6 v9) v1 ==== 187+0+0 (secure 0 0 0) 0x7f8d48046f30 con 0x7f8d580b00d0 2021-01-03T12:58:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.571+0000 7f8d5d12f700 1 -- 172.21.15.133:0/2605182306 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d3c055330 msgr2=0x7f8d3c0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.575+0000 7f8d5d12f700 1 --2- 172.21.15.133:0/2605182306 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d3c055330 0x7f8d3c0577f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f8d5000e000 tx=0x7f8d50009040).stop 2021-01-03T12:58:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.575+0000 7f8d5d12f700 1 -- 172.21.15.133:0/2605182306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d580b00d0 msgr2=0x7f8d580b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.575+0000 7f8d5d12f700 1 --2- 172.21.15.133:0/2605182306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d580b00d0 0x7f8d580b0580 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f8d48000e50 tx=0x7f8d58098d30).stop 2021-01-03T12:58:41.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.575+0000 7f8d5d12f700 1 -- 172.21.15.133:0/2605182306 shutdown_connections 2021-01-03T12:58:41.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.575+0000 7f8d5d12f700 1 --2- 172.21.15.133:0/2605182306 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d3c055330 0x7f8d3c0577f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.575+0000 7f8d5d12f700 1 --2- 172.21.15.133:0/2605182306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d580b00d0 0x7f8d580b0580 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.575+0000 7f8d5d12f700 1 --2- 172.21.15.133:0/2605182306 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d380044d0 0x7f8d580ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.575+0000 7f8d5d12f700 1 --2- 172.21.15.133:0/2605182306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d58159130 0x7f8d581595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.575+0000 7f8d5d12f700 1 -- 172.21.15.133:0/2605182306 >> 172.21.15.133:0/2605182306 conn(0x7f8d5805bdf0 msgr2=0x7f8d58142190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:41.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.579+0000 7f8d5d12f700 1 -- 172.21.15.133:0/2605182306 shutdown_connections 2021-01-03T12:58:41.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.579+0000 7f8d5d12f700 1 -- 172.21.15.133:0/2605182306 wait complete. 2021-01-03T12:58:41.584 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 5 and data pool 6 2021-01-03T12:58:41.596 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:41.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.695+0000 7fe572780700 1 Processor -- start 2021-01-03T12:58:41.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.695+0000 7fe572780700 1 -- start start 2021-01-03T12:58:41.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.695+0000 7fe572780700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe56c060510 0x7fe56c05c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.695+0000 7fe572780700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe56c05fd10 0x7fe56c0b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.695+0000 7fe572780700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56c05bf00 con 0x7fe56c0b4c20 2021-01-03T12:58:41.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.695+0000 7fe572780700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56c05c1a0 con 0x7fe56c05fd10 2021-01-03T12:58:41.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.695+0000 7fe572780700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c05c440 con 0x7fe56c060510 2021-01-03T12:58:41.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.695+0000 7fe570f7d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe56c060510 0x7fe56c05c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.695+0000 7fe571f7f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe56c05fd10 0x7fe56c0b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.695+0000 7fe570f7d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe56c060510 0x7fe56c05c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:41308/0 (socket says 172.21.15.133:41308) 2021-01-03T12:58:41.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.695+0000 7fe570f7d700 1 -- 172.21.15.133:0/579870300 learned_addr learned my addr 172.21.15.133:0/579870300 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:41.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.695+0000 7fe570f7d700 1 -- 172.21.15.133:0/579870300 >> v2:172.21.15.16:3300/0 conn(0x7fe56c05fd10 msgr2=0x7fe56c0b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:41.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.695+0000 7fe570f7d700 1 --2- 172.21.15.133:0/579870300 >> v2:172.21.15.16:3300/0 conn(0x7fe56c05fd10 0x7fe56c0b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.695+0000 7fe570f7d700 1 -- 172.21.15.133:0/579870300 >> v1:172.21.15.16:6789/0 conn(0x7fe56c0b4c20 legacy=0x7fe56c0b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.695+0000 7fe570f7d700 1 -- 172.21.15.133:0/579870300 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c0b6ad0 con 0x7fe56c060510 2021-01-03T12:58:41.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.695+0000 7fe571f7f700 1 --2- 172.21.15.133:0/579870300 >> v2:172.21.15.16:3300/0 conn(0x7fe56c05fd10 0x7fe56c0b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:41.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.695+0000 7fe570f7d700 1 --2- 172.21.15.133:0/579870300 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe56c060510 0x7fe56c05c8e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe5680032b0 tx=0x7fe568009270).ready entity=mon.2 client_cookie=339b22ef4dbd38c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:41.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.699+0000 7fe55ffff700 1 -- 172.21.15.133:0/579870300 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe568009e60 con 0x7fe56c060510 2021-01-03T12:58:41.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.699+0000 7fe55ffff700 1 -- 172.21.15.133:0/579870300 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56800bc00 con 0x7fe56c060510 2021-01-03T12:58:41.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.699+0000 7fe55ffff700 1 -- 172.21.15.133:0/579870300 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe56800bd70 con 0x7fe56c060510 2021-01-03T12:58:41.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.699+0000 7fe572780700 1 -- 172.21.15.133:0/579870300 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe56c060510 msgr2=0x7fe56c05c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.699+0000 7fe572780700 1 --2- 172.21.15.133:0/579870300 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe56c060510 0x7fe56c05c8e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe5680032b0 tx=0x7fe568009270).stop 2021-01-03T12:58:41.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.699+0000 7fe572780700 1 -- 172.21.15.133:0/579870300 shutdown_connections 2021-01-03T12:58:41.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.699+0000 7fe572780700 1 --2- 172.21.15.133:0/579870300 >> v2:172.21.15.16:3300/0 conn(0x7fe56c05fd10 0x7fe56c0b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.699+0000 7fe572780700 1 --2- 172.21.15.133:0/579870300 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe56c060510 0x7fe56c05c8e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.699+0000 7fe572780700 1 -- 172.21.15.133:0/579870300 >> 172.21.15.133:0/579870300 conn(0x7fe56c0b9f00 msgr2=0x7fe56c0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:41.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.699+0000 7fe572780700 1 -- 172.21.15.133:0/579870300 shutdown_connections 2021-01-03T12:58:41.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.699+0000 7fe572780700 1 -- 172.21.15.133:0/579870300 wait complete. 2021-01-03T12:58:41.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.699+0000 7fe572780700 1 Processor -- start 2021-01-03T12:58:41.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.699+0000 7fe572780700 1 -- start start 2021-01-03T12:58:41.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe572780700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe56c05fd10 0x7fe56c13a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe572780700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe56c060510 0x7fe56c142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe572780700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe56c0b4c20 0x7fe56c1381f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe572780700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c141de0 con 0x7fe56c05fd10 2021-01-03T12:58:41.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe572780700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c142060 con 0x7fe56c0b4c20 2021-01-03T12:58:41.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe572780700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c142300 con 0x7fe56c060510 2021-01-03T12:58:41.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe571f7f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe56c0b4c20 0x7fe56c1381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe571f7f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe56c0b4c20 0x7fe56c1381f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33012/0 (socket says 172.21.15.133:33012) 2021-01-03T12:58:41.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe571f7f700 1 -- 172.21.15.133:0/658799361 learned_addr learned my addr 172.21.15.133:0/658799361 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:41.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe570f7d700 1 --2- 172.21.15.133:0/658799361 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe56c060510 0x7fe56c142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe57177e700 1 --2- 172.21.15.133:0/658799361 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe56c05fd10 0x7fe56c13a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe571f7f700 1 -- 172.21.15.133:0/658799361 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe56c060510 msgr2=0x7fe56c142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe571f7f700 1 --2- 172.21.15.133:0/658799361 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe56c060510 0x7fe56c142a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe571f7f700 1 -- 172.21.15.133:0/658799361 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe56c05fd10 msgr2=0x7fe56c13a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe571f7f700 1 --2- 172.21.15.133:0/658799361 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe56c05fd10 0x7fe56c13a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe571f7f700 1 -- 172.21.15.133:0/658799361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c1425a0 con 0x7fe56c0b4c20 2021-01-03T12:58:41.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe571f7f700 1 --2- 172.21.15.133:0/658799361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe56c0b4c20 0x7fe56c1381f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fe56000c000 tx=0x7fe560006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:41.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe55e7fc700 1 -- 172.21.15.133:0/658799361 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe56000cae0 con 0x7fe56c0b4c20 2021-01-03T12:58:41.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe55e7fc700 1 -- 172.21.15.133:0/658799361 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56000cc40 con 0x7fe56c0b4c20 2021-01-03T12:58:41.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe572780700 1 -- 172.21.15.133:0/658799361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56c1396a0 con 0x7fe56c0b4c20 2021-01-03T12:58:41.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe55e7fc700 1 -- 172.21.15.133:0/658799361 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5600123f0 con 0x7fe56c0b4c20 2021-01-03T12:58:41.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe572780700 1 -- 172.21.15.133:0/658799361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56c13b1d0 con 0x7fe56c0b4c20 2021-01-03T12:58:41.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.703+0000 7fe572780700 1 -- 172.21.15.133:0/658799361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56c0b8740 con 0x7fe56c0b4c20 2021-01-03T12:58:41.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.707+0000 7fe55e7fc700 1 -- 172.21.15.133:0/658799361 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe560012550 con 0x7fe56c0b4c20 2021-01-03T12:58:41.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.707+0000 7fe55e7fc700 1 --2- 172.21.15.133:0/658799361 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe554055440 0x7fe554057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.707+0000 7fe55e7fc700 1 -- 172.21.15.133:0/658799361 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe56006e640 con 0x7fe56c0b4c20 2021-01-03T12:58:41.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.707+0000 7fe57177e700 1 --2- 172.21.15.133:0/658799361 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe554055440 0x7fe554057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.707+0000 7fe57177e700 1 --2- 172.21.15.133:0/658799361 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe554055440 0x7fe554057900 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fe56400d000 tx=0x7fe564009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:41.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.711+0000 7fe55e7fc700 1 -- 172.21.15.133:0/658799361 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe56c0b8740 con 0x7fe56c0b4c20 2021-01-03T12:58:41.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.855+0000 7fe572780700 1 -- 172.21.15.133:0/658799361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe56c0b8740 con 0x7fe56c0b4c20 2021-01-03T12:58:41.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.855+0000 7fe55e7fc700 1 -- 172.21.15.133:0/658799361 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16099 (secure 0 0 0) 0x7fe56c0b8740 con 0x7fe56c0b4c20 2021-01-03T12:58:41.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.855+0000 7fe572780700 1 -- 172.21.15.133:0/658799361 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe554055440 msgr2=0x7fe554057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.855+0000 7fe572780700 1 --2- 172.21.15.133:0/658799361 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe554055440 0x7fe554057900 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fe56400d000 tx=0x7fe564009040).stop 2021-01-03T12:58:41.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.855+0000 7fe572780700 1 -- 172.21.15.133:0/658799361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe56c0b4c20 msgr2=0x7fe56c1381f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.855+0000 7fe572780700 1 --2- 172.21.15.133:0/658799361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe56c0b4c20 0x7fe56c1381f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fe56000c000 tx=0x7fe560006dc0).stop 2021-01-03T12:58:41.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.855+0000 7fe572780700 1 -- 172.21.15.133:0/658799361 shutdown_connections 2021-01-03T12:58:41.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.855+0000 7fe572780700 1 --2- 172.21.15.133:0/658799361 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe554055440 0x7fe554057900 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.855+0000 7fe572780700 1 --2- 172.21.15.133:0/658799361 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe56c05fd10 0x7fe56c13a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.855+0000 7fe572780700 1 --2- 172.21.15.133:0/658799361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe56c0b4c20 0x7fe56c1381f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.855+0000 7fe572780700 1 --2- 172.21.15.133:0/658799361 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe56c060510 0x7fe56c142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.855+0000 7fe572780700 1 -- 172.21.15.133:0/658799361 >> 172.21.15.133:0/658799361 conn(0x7fe56c0b9f00 msgr2=0x7fe56c0afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:41.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.859+0000 7fe572780700 1 -- 172.21.15.133:0/658799361 shutdown_connections 2021-01-03T12:58:41.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.859+0000 7fe572780700 1 -- 172.21.15.133:0/658799361 wait complete. 2021-01-03T12:58:41.862 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:41.862 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":33,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:41.558213+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:58:39.345665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-01-03T12:58:40.570679+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:41.870 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:41.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.979+0000 7f174f59e700 1 Processor -- start 2021-01-03T12:58:41.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.979+0000 7f174f59e700 1 -- start start 2021-01-03T12:58:41.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.979+0000 7f174f59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17500b52c0 0x7f17500b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.979+0000 7f174f59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f17500b5c00 0x7f1750143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.979+0000 7f174f59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1750060da0 con 0x7f17500b0c90 2021-01-03T12:58:41.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.979+0000 7f174f59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1750067a90 con 0x7f17500b5c00 2021-01-03T12:58:41.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.979+0000 7f174f59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17500b0ad0 con 0x7f17500b52c0 2021-01-03T12:58:41.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.979+0000 7f174dd9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f17500b0c90 0x7f1750098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54048/0 (socket says 172.21.15.133:54048) 2021-01-03T12:58:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.979+0000 7f174dd9b700 1 -- 172.21.15.133:0/3164461996 learned_addr learned my addr 172.21.15.133:0/3164461996 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.979+0000 7f174e59c700 1 --2- 172.21.15.133:0/3164461996 >> v2:172.21.15.133:3300/0 conn(0x7f17500b52c0 0x7f17500b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.979+0000 7f174ed9d700 1 --2- 172.21.15.133:0/3164461996 >> v2:172.21.15.16:3300/0 conn(0x7f17500b5c00 0x7f1750143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174d59a700 1 -- 172.21.15.133:0/3164461996 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092427354 0 0) 0x7f1750060da0 con 0x7f17500b0c90 2021-01-03T12:58:41.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174d59a700 1 -- 172.21.15.133:0/3164461996 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1734003230 con 0x7f17500b0c90 2021-01-03T12:58:41.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174e59c700 1 -- 172.21.15.133:0/3164461996 >> v2:172.21.15.16:3300/0 conn(0x7f17500b5c00 msgr2=0x7f1750143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:41.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174e59c700 1 --2- 172.21.15.133:0/3164461996 >> v2:172.21.15.16:3300/0 conn(0x7f17500b5c00 0x7f1750143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174e59c700 1 -- 172.21.15.133:0/3164461996 >> v1:172.21.15.133:6789/0 conn(0x7f17500b0c90 legacy=0x7f1750098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174e59c700 1 -- 172.21.15.133:0/3164461996 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17500b56a0 con 0x7f17500b52c0 2021-01-03T12:58:41.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174e59c700 1 --2- 172.21.15.133:0/3164461996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17500b52c0 0x7f17500b05e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f1744002f30 tx=0x7f1744006dc0).ready entity=mon.1 client_cookie=2777a2eb20f404b6 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:41.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174d59a700 1 -- 172.21.15.133:0/3164461996 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17440096f0 con 0x7f17500b52c0 2021-01-03T12:58:41.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174d59a700 1 -- 172.21.15.133:0/3164461996 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1744009850 con 0x7f17500b52c0 2021-01-03T12:58:41.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174d59a700 1 -- 172.21.15.133:0/3164461996 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1744009bb0 con 0x7f17500b52c0 2021-01-03T12:58:41.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174f59e700 1 -- 172.21.15.133:0/3164461996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17500b52c0 msgr2=0x7f17500b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174f59e700 1 --2- 172.21.15.133:0/3164461996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17500b52c0 0x7f17500b05e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f1744002f30 tx=0x7f1744006dc0).stop 2021-01-03T12:58:41.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174f59e700 1 -- 172.21.15.133:0/3164461996 shutdown_connections 2021-01-03T12:58:41.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174f59e700 1 --2- 172.21.15.133:0/3164461996 >> v2:172.21.15.16:3300/0 conn(0x7f17500b5c00 0x7f1750143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174f59e700 1 --2- 172.21.15.133:0/3164461996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17500b52c0 0x7f17500b05e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174f59e700 1 -- 172.21.15.133:0/3164461996 >> 172.21.15.133:0/3164461996 conn(0x7f175005bdf0 msgr2=0x7f175005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:41.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174f59e700 1 -- 172.21.15.133:0/3164461996 shutdown_connections 2021-01-03T12:58:41.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174f59e700 1 -- 172.21.15.133:0/3164461996 wait complete. 2021-01-03T12:58:41.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174f59e700 1 Processor -- start 2021-01-03T12:58:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174f59e700 1 -- start start 2021-01-03T12:58:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17500b0c90 0x7f1750156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174f59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17500b52c0 0x7f175014ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174f59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f17500b5c00 0x7f17501592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174f59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1750155d30 con 0x7f17500b52c0 2021-01-03T12:58:41.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1750155f20 con 0x7f17500b0c90 2021-01-03T12:58:41.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174f59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17501561c0 con 0x7f17500b5c00 2021-01-03T12:58:41.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17500b0c90 0x7f1750156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17500b0c90 0x7f1750156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33022/0 (socket says 172.21.15.133:33022) 2021-01-03T12:58:41.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174e59c700 1 -- 172.21.15.133:0/2117446546 learned_addr learned my addr 172.21.15.133:0/2117446546 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:41.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174dd9b700 1 --2- 172.21.15.133:0/2117446546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17500b52c0 0x7f175014ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.983+0000 7f174ed9d700 1 --2- 172.21.15.133:0/2117446546 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f17500b5c00 0x7f17501592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.987+0000 7f174e59c700 1 -- 172.21.15.133:0/2117446546 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f17500b5c00 msgr2=0x7f17501592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.987+0000 7f174e59c700 1 --2- 172.21.15.133:0/2117446546 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f17500b5c00 0x7f17501592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.987+0000 7f174e59c700 1 -- 172.21.15.133:0/2117446546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17500b52c0 msgr2=0x7f175014ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:41.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.987+0000 7f174e59c700 1 --2- 172.21.15.133:0/2117446546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17500b52c0 0x7f175014ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:41.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.987+0000 7f174e59c700 1 -- 172.21.15.133:0/2117446546 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1750156460 con 0x7f17500b0c90 2021-01-03T12:58:41.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.987+0000 7f174e59c700 1 --2- 172.21.15.133:0/2117446546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17500b0c90 0x7f1750156900 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f1744002f30 tx=0x7f1744015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:41.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.987+0000 7f173f7fe700 1 -- 172.21.15.133:0/2117446546 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1744011b80 con 0x7f17500b0c90 2021-01-03T12:58:41.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.987+0000 7f173f7fe700 1 -- 172.21.15.133:0/2117446546 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1744011ce0 con 0x7f17500b0c90 2021-01-03T12:58:41.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.987+0000 7f174f59e700 1 -- 172.21.15.133:0/2117446546 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175014dbc0 con 0x7f17500b0c90 2021-01-03T12:58:41.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.987+0000 7f173f7fe700 1 -- 172.21.15.133:0/2117446546 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f174401d640 con 0x7f17500b0c90 2021-01-03T12:58:41.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.987+0000 7f174f59e700 1 -- 172.21.15.133:0/2117446546 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17501599d0 con 0x7f17500b0c90 2021-01-03T12:58:41.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.987+0000 7f173f7fe700 1 -- 172.21.15.133:0/2117446546 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1744024030 con 0x7f17500b0c90 2021-01-03T12:58:41.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.987+0000 7f174f59e700 1 -- 172.21.15.133:0/2117446546 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1750057300 con 0x7f17500b0c90 2021-01-03T12:58:41.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.987+0000 7f173f7fe700 1 --2- 172.21.15.133:0/2117446546 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f172c055440 0x7f172c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:41.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.987+0000 7f174dd9b700 1 --2- 172.21.15.133:0/2117446546 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f172c055440 0x7f172c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:41.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.987+0000 7f173f7fe700 1 -- 172.21.15.133:0/2117446546 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f174406f0f0 con 0x7f17500b0c90 2021-01-03T12:58:41.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.991+0000 7f174dd9b700 1 --2- 172.21.15.133:0/2117446546 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f172c055440 0x7f172c057900 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f174000d000 tx=0x7f1740009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:41.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:41.995+0000 7f173f7fe700 1 -- 172.21.15.133:0/2117446546 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1744045360 con 0x7f17500b0c90 2021-01-03T12:58:42.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.135+0000 7f174f59e700 1 -- 172.21.15.133:0/2117446546 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f175005ce00 con 0x7f17500b0c90 2021-01-03T12:58:42.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.135+0000 7f173f7fe700 1 -- 172.21.15.133:0/2117446546 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16099 (secure 0 0 0) 0x7f1744022020 con 0x7f17500b0c90 2021-01-03T12:58:42.137 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:42.138 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":33,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:41.558213+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:58:39.345665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-01-03T12:58:40.570679+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:42.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.139+0000 7f174f59e700 1 -- 172.21.15.133:0/2117446546 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f172c055440 msgr2=0x7f172c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:42.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.139+0000 7f174f59e700 1 --2- 172.21.15.133:0/2117446546 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f172c055440 0x7f172c057900 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f174000d000 tx=0x7f1740009040).stop 2021-01-03T12:58:42.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.139+0000 7f174f59e700 1 -- 172.21.15.133:0/2117446546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17500b0c90 msgr2=0x7f1750156900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:42.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.139+0000 7f174f59e700 1 --2- 172.21.15.133:0/2117446546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17500b0c90 0x7f1750156900 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f1744002f30 tx=0x7f1744015000).stop 2021-01-03T12:58:42.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.139+0000 7f174f59e700 1 -- 172.21.15.133:0/2117446546 shutdown_connections 2021-01-03T12:58:42.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.139+0000 7f174f59e700 1 --2- 172.21.15.133:0/2117446546 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f172c055440 0x7f172c057900 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.139+0000 7f174f59e700 1 --2- 172.21.15.133:0/2117446546 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f17500b5c00 0x7f17501592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.139+0000 7f174f59e700 1 --2- 172.21.15.133:0/2117446546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17500b0c90 0x7f1750156900 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.139+0000 7f174f59e700 1 --2- 172.21.15.133:0/2117446546 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f17500b52c0 0x7f175014ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.139+0000 7f174f59e700 1 -- 172.21.15.133:0/2117446546 >> 172.21.15.133:0/2117446546 conn(0x7f175005bdf0 msgr2=0x7f17501450d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:42.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.139+0000 7f174f59e700 1 -- 172.21.15.133:0/2117446546 shutdown_connections 2021-01-03T12:58:42.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.139+0000 7f174f59e700 1 -- 172.21.15.133:0/2117446546 wait complete. 2021-01-03T12:58:42.153 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-01-03T12:58:42.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.279+0000 7f270ce84700 1 Processor -- start 2021-01-03T12:58:42.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.279+0000 7f270ce84700 1 -- start start 2021-01-03T12:58:42.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.279+0000 7f270ce84700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f27081449b0 0x7f27081477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:42.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.279+0000 7f270ce84700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27080b0c10 con 0x7f27080b5c00 2021-01-03T12:58:42.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.279+0000 7f270ce84700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27080b5640 con 0x7f27080b5260 2021-01-03T12:58:42.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.279+0000 7f270ce84700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2708144e00 con 0x7f27081449b0 2021-01-03T12:58:42.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.279+0000 7f2707fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f27081449b0 0x7f27081477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:42.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.279+0000 7f27077fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f27080b5260 0x7f27081470b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54062/0 (socket says 172.21.15.133:54062) 2021-01-03T12:58:42.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.279+0000 7f2707fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f27081449b0 0x7f27081477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33032/0 (socket says 172.21.15.133:33032) 2021-01-03T12:58:42.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.279+0000 7f27077fe700 1 -- 172.21.15.133:0/2338083688 learned_addr learned my addr 172.21.15.133:0/2338083688 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:42.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f2707fff700 1 -- 172.21.15.133:0/2338083688 >> v1:172.21.15.133:6789/0 conn(0x7f27080b5260 legacy=0x7f27081470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:42.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f2707fff700 1 -- 172.21.15.133:0/2338083688 >> v1:172.21.15.16:6789/0 conn(0x7f27080b5c00 legacy=0x7f27081442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:42.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f27067fc700 1 -- 172.21.15.133:0/2338083688 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073264764 0 0) 0x7f27080b5640 con 0x7f27080b5260 2021-01-03T12:58:42.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f2707fff700 1 -- 172.21.15.133:0/2338083688 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270809a4f0 con 0x7f27081449b0 2021-01-03T12:58:42.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f2707fff700 1 --2- 172.21.15.133:0/2338083688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27081449b0 0x7f27081477c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f26f8002f30 tx=0x7f26f8006dc0).ready entity=mon.1 client_cookie=835930a19bad0575 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:42.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f27067fc700 1 -- 172.21.15.133:0/2338083688 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f80097f0 con 0x7f27081449b0 2021-01-03T12:58:42.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f27067fc700 1 -- 172.21.15.133:0/2338083688 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f8009950 con 0x7f27081449b0 2021-01-03T12:58:42.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f27067fc700 1 -- 172.21.15.133:0/2338083688 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f8009cb0 con 0x7f27081449b0 2021-01-03T12:58:42.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f270ce84700 1 -- 172.21.15.133:0/2338083688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27081449b0 msgr2=0x7f27081477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:42.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f270ce84700 1 --2- 172.21.15.133:0/2338083688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27081449b0 0x7f27081477c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f26f8002f30 tx=0x7f26f8006dc0).stop 2021-01-03T12:58:42.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f270ce84700 1 -- 172.21.15.133:0/2338083688 shutdown_connections 2021-01-03T12:58:42.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f270ce84700 1 --2- 172.21.15.133:0/2338083688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27081449b0 0x7f27081477c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f270ce84700 1 -- 172.21.15.133:0/2338083688 >> 172.21.15.133:0/2338083688 conn(0x7f270805bdf0 msgr2=0x7f270805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:42.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f270ce84700 1 -- 172.21.15.133:0/2338083688 shutdown_connections 2021-01-03T12:58:42.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f270ce84700 1 -- 172.21.15.133:0/2338083688 wait complete. 2021-01-03T12:58:42.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f270ce84700 1 Processor -- start 2021-01-03T12:58:42.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f270ce84700 1 -- start start 2021-01-03T12:58:42.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f270ce84700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27080b5260 0x7f27080ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:42.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f270ce84700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27080b5c00 0x7f2708064e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:42.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.283+0000 7f270ce84700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27081449b0 0x7f2708065320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:42.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f270ce84700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2708142a70 con 0x7f27080b5c00 2021-01-03T12:58:42.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f270ce84700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2708063850 con 0x7f27081449b0 2021-01-03T12:58:42.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f270ce84700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2708142ca0 con 0x7f27080b5260 2021-01-03T12:58:42.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f2707fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27081449b0 0x7f2708065320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:42.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f2707fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27081449b0 0x7f2708065320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33040/0 (socket says 172.21.15.133:33040) 2021-01-03T12:58:42.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f2707fff700 1 -- 172.21.15.133:0/3641948609 learned_addr learned my addr 172.21.15.133:0/3641948609 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:42.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f27077fe700 1 --2- 172.21.15.133:0/3641948609 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27080b5260 0x7f27080ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:42.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f2706ffd700 1 --2- 172.21.15.133:0/3641948609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27080b5c00 0x7f2708064e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:42.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f2707fff700 1 -- 172.21.15.133:0/3641948609 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27080b5260 msgr2=0x7f27080ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:42.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f2707fff700 1 --2- 172.21.15.133:0/3641948609 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27080b5260 0x7f27080ad550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f2707fff700 1 -- 172.21.15.133:0/3641948609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27080b5c00 msgr2=0x7f2708064e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:42.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f2707fff700 1 --2- 172.21.15.133:0/3641948609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27080b5c00 0x7f2708064e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f2707fff700 1 -- 172.21.15.133:0/3641948609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2708063540 con 0x7f27081449b0 2021-01-03T12:58:42.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f27077fe700 1 --2- 172.21.15.133:0/3641948609 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27080b5260 0x7f27080ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:58:42.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f2707fff700 1 --2- 172.21.15.133:0/3641948609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27081449b0 0x7f2708065320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f26f8002f30 tx=0x7f26f8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:42.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f2704ff9700 1 -- 172.21.15.133:0/3641948609 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f8021070 con 0x7f27081449b0 2021-01-03T12:58:42.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f2704ff9700 1 -- 172.21.15.133:0/3641948609 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f8009c50 con 0x7f27081449b0 2021-01-03T12:58:42.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f270ce84700 1 -- 172.21.15.133:0/3641948609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2708065810 con 0x7f27081449b0 2021-01-03T12:58:42.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f2704ff9700 1 -- 172.21.15.133:0/3641948609 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26f801d640 con 0x7f27081449b0 2021-01-03T12:58:42.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f270ce84700 1 -- 172.21.15.133:0/3641948609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27080add30 con 0x7f27081449b0 2021-01-03T12:58:42.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f270ce84700 1 -- 172.21.15.133:0/3641948609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2708063a10 con 0x7f27081449b0 2021-01-03T12:58:42.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f2704ff9700 1 -- 172.21.15.133:0/3641948609 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f26f800f070 con 0x7f27081449b0 2021-01-03T12:58:42.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f2704ff9700 1 --2- 172.21.15.133:0/3641948609 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f26e0055330 0x7f26e00577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:42.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f2704ff9700 1 -- 172.21.15.133:0/3641948609 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f26f806f870 con 0x7f27081449b0 2021-01-03T12:58:42.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.287+0000 7f27077fe700 1 --2- 172.21.15.133:0/3641948609 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f26e0055330 0x7f26e00577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:42.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.291+0000 7f27077fe700 1 --2- 172.21.15.133:0/3641948609 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f26e0055330 0x7f26e00577f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f26f0008000 tx=0x7f26f0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:42.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.291+0000 7f2704ff9700 1 -- 172.21.15.133:0/3641948609 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f26f8045b10 con 0x7f27081449b0 2021-01-03T12:58:42.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.475+0000 7f270ce84700 1 -- 172.21.15.133:0/3641948609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2708057300 con 0x7f27081449b0 2021-01-03T12:58:42.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.567+0000 7f2704ff9700 1 -- 172.21.15.133:0/3641948609 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v10) v1 ==== 118+0+0 (secure 0 0 0) 0x7f26f8049130 con 0x7f27081449b0 2021-01-03T12:58:42.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.571+0000 7f270ce84700 1 -- 172.21.15.133:0/3641948609 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f26e0055330 msgr2=0x7f26e00577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:42.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.571+0000 7f270ce84700 1 --2- 172.21.15.133:0/3641948609 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f26e0055330 0x7f26e00577f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f26f0008000 tx=0x7f26f0009040).stop 2021-01-03T12:58:42.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.571+0000 7f270ce84700 1 -- 172.21.15.133:0/3641948609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27081449b0 msgr2=0x7f2708065320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:42.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.571+0000 7f270ce84700 1 --2- 172.21.15.133:0/3641948609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27081449b0 0x7f2708065320 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f26f8002f30 tx=0x7f26f8015000).stop 2021-01-03T12:58:42.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.571+0000 7f270ce84700 1 -- 172.21.15.133:0/3641948609 shutdown_connections 2021-01-03T12:58:42.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.571+0000 7f270ce84700 1 --2- 172.21.15.133:0/3641948609 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f26e0055330 0x7f26e00577f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.571+0000 7f270ce84700 1 --2- 172.21.15.133:0/3641948609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27081449b0 0x7f2708065320 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.571+0000 7f270ce84700 1 --2- 172.21.15.133:0/3641948609 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f27080b5260 0x7f27080ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.571+0000 7f270ce84700 1 --2- 172.21.15.133:0/3641948609 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27080b5c00 0x7f2708064e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.571+0000 7f270ce84700 1 -- 172.21.15.133:0/3641948609 >> 172.21.15.133:0/3641948609 conn(0x7f270805bdf0 msgr2=0x7f2708147340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:42.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.571+0000 7f270ce84700 1 -- 172.21.15.133:0/3641948609 shutdown_connections 2021-01-03T12:58:42.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.571+0000 7f270ce84700 1 -- 172.21.15.133:0/3641948609 wait complete. 2021-01-03T12:58:42.591 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T12:58:42.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.703+0000 7f40db49b700 1 Processor -- start 2021-01-03T12:58:42.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.703+0000 7f40db49b700 1 -- start start 2021-01-03T12:58:42.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.703+0000 7f40db49b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f40d40b4c20 0x7f40d405c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:42.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.703+0000 7f40db49b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40d405fd10 0x7f40d40b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:42.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.703+0000 7f40db49b700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d405bf00 con 0x7f40d4060510 2021-01-03T12:58:42.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.703+0000 7f40db49b700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d405c1a0 con 0x7f40d40b4c20 2021-01-03T12:58:42.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.703+0000 7f40db49b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d405c440 con 0x7f40d405fd10 2021-01-03T12:58:42.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.703+0000 7f40dac9a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40d405fd10 0x7f40d40b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:42.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.703+0000 7f40dac9a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40d405fd10 0x7f40d40b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33048/0 (socket says 172.21.15.133:33048) 2021-01-03T12:58:42.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.703+0000 7f40dac9a700 1 -- 172.21.15.133:0/1742776734 learned_addr learned my addr 172.21.15.133:0/1742776734 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:42.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.703+0000 7f40da499700 1 --2- 172.21.15.133:0/1742776734 >> v2:172.21.15.16:3300/0 conn(0x7f40d40b4c20 0x7f40d405c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:42.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40dac9a700 1 -- 172.21.15.133:0/1742776734 >> v2:172.21.15.16:3300/0 conn(0x7f40d40b4c20 msgr2=0x7f40d405c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:42.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40dac9a700 1 --2- 172.21.15.133:0/1742776734 >> v2:172.21.15.16:3300/0 conn(0x7f40d40b4c20 0x7f40d405c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40dac9a700 1 -- 172.21.15.133:0/1742776734 >> v1:172.21.15.16:6789/0 conn(0x7f40d4060510 legacy=0x7f40d40b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:42.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40dac9a700 1 -- 172.21.15.133:0/1742776734 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d40b6ad0 con 0x7f40d405fd10 2021-01-03T12:58:42.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40dac9a700 1 --2- 172.21.15.133:0/1742776734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40d405fd10 0x7f40d40b65e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f40cc0032b0 tx=0x7f40cc009270).ready entity=mon.1 client_cookie=33f8e5c563873433 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:42.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40d9497700 1 -- 172.21.15.133:0/1742776734 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40cc009e60 con 0x7f40d405fd10 2021-01-03T12:58:42.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40d9497700 1 -- 172.21.15.133:0/1742776734 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40cc00bc00 con 0x7f40d405fd10 2021-01-03T12:58:42.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40d9497700 1 -- 172.21.15.133:0/1742776734 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40cc00bd70 con 0x7f40d405fd10 2021-01-03T12:58:42.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40db49b700 1 -- 172.21.15.133:0/1742776734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40d405fd10 msgr2=0x7f40d40b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:42.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40db49b700 1 --2- 172.21.15.133:0/1742776734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40d405fd10 0x7f40d40b65e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f40cc0032b0 tx=0x7f40cc009270).stop 2021-01-03T12:58:42.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40db49b700 1 -- 172.21.15.133:0/1742776734 shutdown_connections 2021-01-03T12:58:42.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40db49b700 1 --2- 172.21.15.133:0/1742776734 >> v2:172.21.15.16:3300/0 conn(0x7f40d40b4c20 0x7f40d405c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40db49b700 1 --2- 172.21.15.133:0/1742776734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40d405fd10 0x7f40d40b65e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40db49b700 1 -- 172.21.15.133:0/1742776734 >> 172.21.15.133:0/1742776734 conn(0x7f40d40b9f00 msgr2=0x7f40d40b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:42.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40db49b700 1 -- 172.21.15.133:0/1742776734 shutdown_connections 2021-01-03T12:58:42.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40db49b700 1 -- 172.21.15.133:0/1742776734 wait complete. 2021-01-03T12:58:42.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40db49b700 1 Processor -- start 2021-01-03T12:58:42.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.707+0000 7f40db49b700 1 -- start start 2021-01-03T12:58:42.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40db49b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40d405fd10 0x7f40d40af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:42.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40db49b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40d4060510 0x7f40d40b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:42.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40db49b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f40d40b4c20 0x7f40d4151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:42.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40db49b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d4142210 con 0x7f40d4060510 2021-01-03T12:58:42.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40db49b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d40b2d50 con 0x7f40d405fd10 2021-01-03T12:58:42.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40db49b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d40b34d0 con 0x7f40d40b4c20 2021-01-03T12:58:42.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40da499700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40d405fd10 0x7f40d40af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:42.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40da499700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40d405fd10 0x7f40d40af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33052/0 (socket says 172.21.15.133:33052) 2021-01-03T12:58:42.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40da499700 1 -- 172.21.15.133:0/684704692 learned_addr learned my addr 172.21.15.133:0/684704692 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:42.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40d9c98700 1 --2- 172.21.15.133:0/684704692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40d4060510 0x7f40d40b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:42.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40dac9a700 1 --2- 172.21.15.133:0/684704692 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f40d40b4c20 0x7f40d4151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:42.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40da499700 1 -- 172.21.15.133:0/684704692 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f40d40b4c20 msgr2=0x7f40d4151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:42.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40da499700 1 --2- 172.21.15.133:0/684704692 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f40d40b4c20 0x7f40d4151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40da499700 1 -- 172.21.15.133:0/684704692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40d4060510 msgr2=0x7f40d40b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:42.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40da499700 1 --2- 172.21.15.133:0/684704692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40d4060510 0x7f40d40b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40da499700 1 -- 172.21.15.133:0/684704692 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d40b2810 con 0x7f40d405fd10 2021-01-03T12:58:42.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40dac9a700 1 --2- 172.21.15.133:0/684704692 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f40d40b4c20 0x7f40d4151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:42.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40da499700 1 --2- 172.21.15.133:0/684704692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40d405fd10 0x7f40d40af770 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f40d000c000 tx=0x7f40d0006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:42.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40c37fe700 1 -- 172.21.15.133:0/684704692 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40d000ca10 con 0x7f40d405fd10 2021-01-03T12:58:42.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40c37fe700 1 -- 172.21.15.133:0/684704692 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d000cb70 con 0x7f40d405fd10 2021-01-03T12:58:42.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40c37fe700 1 -- 172.21.15.133:0/684704692 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40d00123f0 con 0x7f40d405fd10 2021-01-03T12:58:42.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40db49b700 1 -- 172.21.15.133:0/684704692 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d40b2ab0 con 0x7f40d405fd10 2021-01-03T12:58:42.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40db49b700 1 -- 172.21.15.133:0/684704692 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d41521b0 con 0x7f40d405fd10 2021-01-03T12:58:42.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.711+0000 7f40db49b700 1 -- 172.21.15.133:0/684704692 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d4057300 con 0x7f40d405fd10 2021-01-03T12:58:42.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.715+0000 7f40c37fe700 1 -- 172.21.15.133:0/684704692 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f40d0012550 con 0x7f40d405fd10 2021-01-03T12:58:42.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.715+0000 7f40c37fe700 1 --2- 172.21.15.133:0/684704692 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f40b4055330 0x7f40b40577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:42.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.715+0000 7f40c37fe700 1 -- 172.21.15.133:0/684704692 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f40d006e230 con 0x7f40d405fd10 2021-01-03T12:58:42.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.715+0000 7f40d9c98700 1 --2- 172.21.15.133:0/684704692 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f40b4055330 0x7f40b40577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:42.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.715+0000 7f40d9c98700 1 --2- 172.21.15.133:0/684704692 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f40b4055330 0x7f40b40577f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f40c400d000 tx=0x7f40c4000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:42.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.719+0000 7f40c37fe700 1 -- 172.21.15.133:0/684704692 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f40d00444d0 con 0x7f40d405fd10 2021-01-03T12:58:42.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.899+0000 7f40db49b700 1 -- 172.21.15.133:0/684704692 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40d4067a00 con 0x7f40d405fd10 2021-01-03T12:58:42.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.899+0000 7f40c37fe700 1 -- 172.21.15.133:0/684704692 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2494 (secure 0 0 0) 0x7f40d0047af0 con 0x7f40d405fd10 2021-01-03T12:58:42.903 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:42.904 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4628,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2847550436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2847550436},{"type":"v1","addr":"172.21.15.16:6833","nonce":2847550436}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1321910656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1321910656},{"type":"v1","addr":"172.21.15.133:6835","nonce":1321910656}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T12:58:41.558757+0000","modified":"2021-01-03T12:58:42.561830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1532041867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1532041867},{"type":"v1","addr":"172.21.15.133:6837","nonce":1532041867}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-01-03T12:58:42.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.903+0000 7f40db49b700 1 -- 172.21.15.133:0/684704692 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f40b4055330 msgr2=0x7f40b40577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:42.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.903+0000 7f40db49b700 1 --2- 172.21.15.133:0/684704692 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f40b4055330 0x7f40b40577f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f40c400d000 tx=0x7f40c4000b80).stop 2021-01-03T12:58:42.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.903+0000 7f40db49b700 1 -- 172.21.15.133:0/684704692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40d405fd10 msgr2=0x7f40d40af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:42.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.903+0000 7f40db49b700 1 --2- 172.21.15.133:0/684704692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40d405fd10 0x7f40d40af770 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f40d000c000 tx=0x7f40d0006dc0).stop 2021-01-03T12:58:42.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.903+0000 7f40db49b700 1 -- 172.21.15.133:0/684704692 shutdown_connections 2021-01-03T12:58:42.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.903+0000 7f40db49b700 1 --2- 172.21.15.133:0/684704692 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f40b4055330 0x7f40b40577f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.903+0000 7f40db49b700 1 --2- 172.21.15.133:0/684704692 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f40d40b4c20 0x7f40d4151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.903+0000 7f40db49b700 1 --2- 172.21.15.133:0/684704692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40d405fd10 0x7f40d40af770 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.903+0000 7f40db49b700 1 --2- 172.21.15.133:0/684704692 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f40d4060510 0x7f40d40b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:42.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.903+0000 7f40db49b700 1 -- 172.21.15.133:0/684704692 >> 172.21.15.133:0/684704692 conn(0x7f40d40b9f00 msgr2=0x7f40d40b7030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:42.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.903+0000 7f40db49b700 1 -- 172.21.15.133:0/684704692 shutdown_connections 2021-01-03T12:58:42.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:42.903+0000 7f40db49b700 1 -- 172.21.15.133:0/684704692 wait complete. 2021-01-03T12:58:42.912 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 10 2021-01-03T12:58:42.919 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:43.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.035+0000 7f2bbeb3d700 1 Processor -- start 2021-01-03T12:58:43.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.035+0000 7f2bbeb3d700 1 -- start start 2021-01-03T12:58:43.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbeb3d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2bb80b52c0 0x7f2bb80b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbeb3d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2bb80b5c00 0x7f2bb8143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbeb3d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb8060da0 con 0x7f2bb80b0c90 2021-01-03T12:58:43.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbeb3d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb8067a90 con 0x7f2bb80b5c00 2021-01-03T12:58:43.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbeb3d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb80b0ad0 con 0x7f2bb80b52c0 2021-01-03T12:58:43.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbe33c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2bb80b5c00 0x7f2bb8143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbe33c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2bb80b5c00 0x7f2bb8143eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33060/0 (socket says 172.21.15.133:33060) 2021-01-03T12:58:43.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbe33c700 1 -- 172.21.15.133:0/3512771201 learned_addr learned my addr 172.21.15.133:0/3512771201 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:43.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbdb3b700 1 --2- 172.21.15.133:0/3512771201 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2bb80b52c0 0x7f2bb80b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbe33c700 1 -- 172.21.15.133:0/3512771201 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2bb80b52c0 msgr2=0x7f2bb80b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:43.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbe33c700 1 --2- 172.21.15.133:0/3512771201 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2bb80b52c0 0x7f2bb80b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbe33c700 1 -- 172.21.15.133:0/3512771201 >> v1:172.21.15.16:6789/0 conn(0x7f2bb80b0c90 legacy=0x7f2bb8098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbe33c700 1 -- 172.21.15.133:0/3512771201 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb80b56a0 con 0x7f2bb80b5c00 2021-01-03T12:58:43.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbe33c700 1 --2- 172.21.15.133:0/3512771201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bb80b5c00 0x7f2bb8143eb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f2bb00032b0 tx=0x7f2bb0009270).ready entity=mon.1 client_cookie=fa6f9146fb9b268b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:43.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbcb39700 1 -- 172.21.15.133:0/3512771201 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bb000bc00 con 0x7f2bb80b5c00 2021-01-03T12:58:43.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbcb39700 1 -- 172.21.15.133:0/3512771201 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb000bd60 con 0x7f2bb80b5c00 2021-01-03T12:58:43.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbcb39700 1 -- 172.21.15.133:0/3512771201 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bb0011400 con 0x7f2bb80b5c00 2021-01-03T12:58:43.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbeb3d700 1 -- 172.21.15.133:0/3512771201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bb80b5c00 msgr2=0x7f2bb8143eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbeb3d700 1 --2- 172.21.15.133:0/3512771201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bb80b5c00 0x7f2bb8143eb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f2bb00032b0 tx=0x7f2bb0009270).stop 2021-01-03T12:58:43.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbeb3d700 1 -- 172.21.15.133:0/3512771201 shutdown_connections 2021-01-03T12:58:43.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbeb3d700 1 --2- 172.21.15.133:0/3512771201 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2bb80b52c0 0x7f2bb80b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbeb3d700 1 --2- 172.21.15.133:0/3512771201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bb80b5c00 0x7f2bb8143eb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbeb3d700 1 -- 172.21.15.133:0/3512771201 >> 172.21.15.133:0/3512771201 conn(0x7f2bb805bdf0 msgr2=0x7f2bb805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:43.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbeb3d700 1 -- 172.21.15.133:0/3512771201 shutdown_connections 2021-01-03T12:58:43.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.039+0000 7f2bbeb3d700 1 -- 172.21.15.133:0/3512771201 wait complete. 2021-01-03T12:58:43.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.043+0000 7f2bbeb3d700 1 Processor -- start 2021-01-03T12:58:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.043+0000 7f2bbeb3d700 1 -- start start 2021-01-03T12:58:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.043+0000 7f2bbeb3d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bb80b0c90 0x7f2bb8159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.043+0000 7f2bbeb3d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2bb80b52c0 0x7f2bb80b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.043+0000 7f2bbeb3d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bb80b5c00 0x7f2bb8067000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.043+0000 7f2bbeb3d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb80ae930 con 0x7f2bb80b0c90 2021-01-03T12:58:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.043+0000 7f2bbeb3d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb8066060 con 0x7f2bb80b5c00 2021-01-03T12:58:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.043+0000 7f2bbeb3d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb8066300 con 0x7f2bb80b52c0 2021-01-03T12:58:43.066 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.043+0000 7f2bbe33c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bb80b5c00 0x7f2bb8067000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.066 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.043+0000 7f2bbd33a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2bb80b52c0 0x7f2bb80b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.066 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.043+0000 7f2bbe33c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bb80b5c00 0x7f2bb8067000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33068/0 (socket says 172.21.15.133:33068) 2021-01-03T12:58:43.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.043+0000 7f2bbe33c700 1 -- 172.21.15.133:0/3902794439 learned_addr learned my addr 172.21.15.133:0/3902794439 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:43.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.043+0000 7f2bbdb3b700 1 --2- 172.21.15.133:0/3902794439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bb80b0c90 0x7f2bb8159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.047+0000 7f2bbe33c700 1 -- 172.21.15.133:0/3902794439 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2bb80b52c0 msgr2=0x7f2bb80b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.047+0000 7f2bbe33c700 1 --2- 172.21.15.133:0/3902794439 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2bb80b52c0 0x7f2bb80b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.047+0000 7f2bbe33c700 1 -- 172.21.15.133:0/3902794439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bb80b0c90 msgr2=0x7f2bb8159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.047+0000 7f2bbe33c700 1 --2- 172.21.15.133:0/3902794439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bb80b0c90 0x7f2bb8159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.047+0000 7f2bbe33c700 1 -- 172.21.15.133:0/3902794439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb80aec80 con 0x7f2bb80b5c00 2021-01-03T12:58:43.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.047+0000 7f2bbd33a700 1 --2- 172.21.15.133:0/3902794439 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2bb80b52c0 0x7f2bb80b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:43.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.047+0000 7f2bbe33c700 1 --2- 172.21.15.133:0/3902794439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bb80b5c00 0x7f2bb8067000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f2bb80aea70 tx=0x7f2bb0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:43.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.047+0000 7f2ba6ffd700 1 -- 172.21.15.133:0/3902794439 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bb0011e90 con 0x7f2bb80b5c00 2021-01-03T12:58:43.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.047+0000 7f2ba6ffd700 1 -- 172.21.15.133:0/3902794439 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb001f3f0 con 0x7f2bb80b5c00 2021-01-03T12:58:43.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.047+0000 7f2bbeb3d700 1 -- 172.21.15.133:0/3902794439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb80674f0 con 0x7f2bb80b5c00 2021-01-03T12:58:43.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.047+0000 7f2ba6ffd700 1 -- 172.21.15.133:0/3902794439 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bb001f750 con 0x7f2bb80b5c00 2021-01-03T12:58:43.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.047+0000 7f2bbeb3d700 1 -- 172.21.15.133:0/3902794439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb80af120 con 0x7f2bb80b5c00 2021-01-03T12:58:43.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.047+0000 7f2ba6ffd700 1 -- 172.21.15.133:0/3902794439 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2bb0026030 con 0x7f2bb80b5c00 2021-01-03T12:58:43.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.047+0000 7f2bbeb3d700 1 -- 172.21.15.133:0/3902794439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb80aee10 con 0x7f2bb80b5c00 2021-01-03T12:58:43.074 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.047+0000 7f2ba6ffd700 1 --2- 172.21.15.133:0/3902794439 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2b98055440 0x7f2b98057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.074 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.047+0000 7f2ba6ffd700 1 -- 172.21.15.133:0/3902794439 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2bb006ea70 con 0x7f2bb80b5c00 2021-01-03T12:58:43.075 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.047+0000 7f2bbdb3b700 1 --2- 172.21.15.133:0/3902794439 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2b98055440 0x7f2b98057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.075 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.051+0000 7f2bbdb3b700 1 --2- 172.21.15.133:0/3902794439 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2b98055440 0x7f2b98057900 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2ba800c000 tx=0x7f2ba8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:43.075 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.055+0000 7f2ba6ffd700 1 -- 172.21.15.133:0/3902794439 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2bb0044d70 con 0x7f2bb80b5c00 2021-01-03T12:58:43.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.195+0000 7f2bbeb3d700 1 -- 172.21.15.133:0/3902794439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bb80664c0 con 0x7f2bb80b5c00 2021-01-03T12:58:43.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.195+0000 7f2ba6ffd700 1 -- 172.21.15.133:0/3902794439 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f2bb0015090 con 0x7f2bb80b5c00 2021-01-03T12:58:43.197 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:43.198 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":34,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:42.562578+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:58:39.345665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-01-03T12:58:40.570679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:43.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.199+0000 7f2bbeb3d700 1 -- 172.21.15.133:0/3902794439 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2b98055440 msgr2=0x7f2b98057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.199+0000 7f2bbeb3d700 1 --2- 172.21.15.133:0/3902794439 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2b98055440 0x7f2b98057900 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2ba800c000 tx=0x7f2ba8008040).stop 2021-01-03T12:58:43.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.199+0000 7f2bbeb3d700 1 -- 172.21.15.133:0/3902794439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bb80b5c00 msgr2=0x7f2bb8067000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.199+0000 7f2bbeb3d700 1 --2- 172.21.15.133:0/3902794439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bb80b5c00 0x7f2bb8067000 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f2bb80aea70 tx=0x7f2bb0016000).stop 2021-01-03T12:58:43.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.199+0000 7f2bbeb3d700 1 -- 172.21.15.133:0/3902794439 shutdown_connections 2021-01-03T12:58:43.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.199+0000 7f2bbeb3d700 1 --2- 172.21.15.133:0/3902794439 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2b98055440 0x7f2b98057900 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.199+0000 7f2bbeb3d700 1 --2- 172.21.15.133:0/3902794439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2bb80b0c90 0x7f2bb8159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.199+0000 7f2bbeb3d700 1 --2- 172.21.15.133:0/3902794439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2bb80b5c00 0x7f2bb8067000 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.199+0000 7f2bbeb3d700 1 --2- 172.21.15.133:0/3902794439 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2bb80b52c0 0x7f2bb80b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.199+0000 7f2bbeb3d700 1 -- 172.21.15.133:0/3902794439 >> 172.21.15.133:0/3902794439 conn(0x7f2bb805bdf0 msgr2=0x7f2bb8060320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:43.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.199+0000 7f2bbeb3d700 1 -- 172.21.15.133:0/3902794439 shutdown_connections 2021-01-03T12:58:43.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.199+0000 7f2bbeb3d700 1 -- 172.21.15.133:0/3902794439 wait complete. 2021-01-03T12:58:43.211 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T12:58:43.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.331+0000 7f278412f700 1 Processor -- start 2021-01-03T12:58:43.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.331+0000 7f278412f700 1 -- start start 2021-01-03T12:58:43.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.331+0000 7f278412f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f277c0b5120 0x7f277c0ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.331+0000 7f278412f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f277c060b00 0x7f277c0abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.331+0000 7f278412f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277c09a380 con 0x7f277c0af9f0 2021-01-03T12:58:43.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.331+0000 7f278412f700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277c062340 con 0x7f277c060b00 2021-01-03T12:58:43.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.331+0000 7f278412f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277c0ac2c0 con 0x7f277c0b5120 2021-01-03T12:58:43.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.331+0000 7f2782ecd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f277c0af9f0 0x7f277c0afea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54108/0 (socket says 172.21.15.133:54108) 2021-01-03T12:58:43.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.331+0000 7f2782ecd700 1 -- 172.21.15.133:0/770679799 learned_addr learned my addr 172.21.15.133:0/770679799 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:43.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.331+0000 7f27826cc700 1 --2- 172.21.15.133:0/770679799 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f277c0b5120 0x7f277c0ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.331+0000 7f2781ecb700 1 --2- 172.21.15.133:0/770679799 >> v2:172.21.15.16:3300/0 conn(0x7f277c060b00 0x7f277c0abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f27816ca700 1 -- 172.21.15.133:0/770679799 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357829055 0 0) 0x7f277c09a380 con 0x7f277c0af9f0 2021-01-03T12:58:43.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f27816ca700 1 -- 172.21.15.133:0/770679799 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2768003230 con 0x7f277c0af9f0 2021-01-03T12:58:43.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f27816ca700 1 -- 172.21.15.133:0/770679799 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4089113530 0 0) 0x7f2768003230 con 0x7f277c0af9f0 2021-01-03T12:58:43.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f2781ecb700 1 -- 172.21.15.133:0/770679799 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f277c0b5120 msgr2=0x7f277c0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:43.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f2781ecb700 1 --2- 172.21.15.133:0/770679799 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f277c0b5120 0x7f277c0ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f2781ecb700 1 -- 172.21.15.133:0/770679799 >> v1:172.21.15.133:6789/0 conn(0x7f277c0af9f0 legacy=0x7f277c0afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f2781ecb700 1 -- 172.21.15.133:0/770679799 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c060090 con 0x7f277c060b00 2021-01-03T12:58:43.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f27826cc700 1 --2- 172.21.15.133:0/770679799 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f277c0b5120 0x7f277c0ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:43.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f2781ecb700 1 --2- 172.21.15.133:0/770679799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f277c060b00 0x7f277c0abdd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f2774001870 tx=0x7f276c006dc0).ready entity=mon.0 client_cookie=80d4469bdd804b23 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:43.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f27816ca700 1 -- 172.21.15.133:0/770679799 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27740016d0 con 0x7f277c060b00 2021-01-03T12:58:43.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f27816ca700 1 -- 172.21.15.133:0/770679799 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276c00d570 con 0x7f277c060b00 2021-01-03T12:58:43.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f27816ca700 1 -- 172.21.15.133:0/770679799 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f276c00d6e0 con 0x7f277c060b00 2021-01-03T12:58:43.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f278412f700 1 -- 172.21.15.133:0/770679799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f277c060b00 msgr2=0x7f277c0abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f278412f700 1 --2- 172.21.15.133:0/770679799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f277c060b00 0x7f277c0abdd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f2774001870 tx=0x7f276c006dc0).stop 2021-01-03T12:58:43.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f278412f700 1 -- 172.21.15.133:0/770679799 shutdown_connections 2021-01-03T12:58:43.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f278412f700 1 --2- 172.21.15.133:0/770679799 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f277c0b5120 0x7f277c0ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f278412f700 1 --2- 172.21.15.133:0/770679799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f277c060b00 0x7f277c0abdd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f278412f700 1 -- 172.21.15.133:0/770679799 >> 172.21.15.133:0/770679799 conn(0x7f277c05bdf0 msgr2=0x7f277c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:43.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f278412f700 1 -- 172.21.15.133:0/770679799 shutdown_connections 2021-01-03T12:58:43.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.335+0000 7f278412f700 1 -- 172.21.15.133:0/770679799 wait complete. 2021-01-03T12:58:43.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f278412f700 1 Processor -- start 2021-01-03T12:58:43.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f278412f700 1 -- start start 2021-01-03T12:58:43.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f278412f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f277c060b00 0x7f277c12f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f278412f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f277c0af9f0 0x7f277c13db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f278412f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f277c0b5120 0x7f277c13e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f278412f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c13e570 con 0x7f277c0b5120 2021-01-03T12:58:43.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f278412f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c0671f0 con 0x7f277c0af9f0 2021-01-03T12:58:43.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f278412f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277c0ae490 con 0x7f277c060b00 2021-01-03T12:58:43.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f2781ecb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f277c0af9f0 0x7f277c13db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f2781ecb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f277c0af9f0 0x7f277c13db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33080/0 (socket says 172.21.15.133:33080) 2021-01-03T12:58:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f2781ecb700 1 -- 172.21.15.133:0/2312825134 learned_addr learned my addr 172.21.15.133:0/2312825134 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f27826cc700 1 --2- 172.21.15.133:0/2312825134 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f277c060b00 0x7f277c12f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f2782ecd700 1 --2- 172.21.15.133:0/2312825134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f277c0b5120 0x7f277c13e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f2781ecb700 1 -- 172.21.15.133:0/2312825134 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f277c060b00 msgr2=0x7f277c12f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f2781ecb700 1 --2- 172.21.15.133:0/2312825134 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f277c060b00 0x7f277c12f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f2781ecb700 1 -- 172.21.15.133:0/2312825134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f277c0b5120 msgr2=0x7f277c13e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f2781ecb700 1 --2- 172.21.15.133:0/2312825134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f277c0b5120 0x7f277c13e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f2781ecb700 1 -- 172.21.15.133:0/2312825134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c0ae730 con 0x7f277c0af9f0 2021-01-03T12:58:43.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f2781ecb700 1 --2- 172.21.15.133:0/2312825134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f277c0af9f0 0x7f277c13db90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f277c13e6b0 tx=0x7f276c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:43.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f2772ffd700 1 -- 172.21.15.133:0/2312825134 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f276c011b70 con 0x7f277c0af9f0 2021-01-03T12:58:43.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f2772ffd700 1 -- 172.21.15.133:0/2312825134 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276c011cd0 con 0x7f277c0af9f0 2021-01-03T12:58:43.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f278412f700 1 -- 172.21.15.133:0/2312825134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277c0ae9d0 con 0x7f277c0af9f0 2021-01-03T12:58:43.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f2772ffd700 1 -- 172.21.15.133:0/2312825134 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f276c01e650 con 0x7f277c0af9f0 2021-01-03T12:58:43.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.339+0000 7f278412f700 1 -- 172.21.15.133:0/2312825134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277c12fcb0 con 0x7f277c0af9f0 2021-01-03T12:58:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.343+0000 7f278412f700 1 -- 172.21.15.133:0/2312825134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277c0ae200 con 0x7f277c0af9f0 2021-01-03T12:58:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.343+0000 7f2772ffd700 1 -- 172.21.15.133:0/2312825134 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f276c025030 con 0x7f277c0af9f0 2021-01-03T12:58:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.343+0000 7f2772ffd700 1 --2- 172.21.15.133:0/2312825134 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2764055500 0x7f27640579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.343+0000 7f2772ffd700 1 -- 172.21.15.133:0/2312825134 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f276c06f0a0 con 0x7f277c0af9f0 2021-01-03T12:58:43.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.343+0000 7f27826cc700 1 --2- 172.21.15.133:0/2312825134 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2764055500 0x7f27640579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.343+0000 7f27826cc700 1 --2- 172.21.15.133:0/2312825134 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2764055500 0x7f27640579c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f277800b000 tx=0x7f27780091a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:43.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.351+0000 7f2772ffd700 1 -- 172.21.15.133:0/2312825134 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f276c045290 con 0x7f277c0af9f0 2021-01-03T12:58:43.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.539+0000 7f278412f700 1 -- 172.21.15.133:0/2312825134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f277c057300 con 0x7f277c0af9f0 2021-01-03T12:58:43.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.547+0000 7f2772ffd700 1 -- 172.21.15.133:0/2312825134 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v11) v1 ==== 184+0+0 (secure 0 0 0) 0x7f276c023070 con 0x7f277c0af9f0 2021-01-03T12:58:43.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.551+0000 7f278412f700 1 -- 172.21.15.133:0/2312825134 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2764055500 msgr2=0x7f27640579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.551+0000 7f278412f700 1 --2- 172.21.15.133:0/2312825134 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2764055500 0x7f27640579c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f277800b000 tx=0x7f27780091a0).stop 2021-01-03T12:58:43.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.551+0000 7f278412f700 1 -- 172.21.15.133:0/2312825134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f277c0af9f0 msgr2=0x7f277c13db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.551+0000 7f278412f700 1 --2- 172.21.15.133:0/2312825134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f277c0af9f0 0x7f277c13db90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f277c13e6b0 tx=0x7f276c015000).stop 2021-01-03T12:58:43.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.551+0000 7f278412f700 1 -- 172.21.15.133:0/2312825134 shutdown_connections 2021-01-03T12:58:43.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.551+0000 7f278412f700 1 --2- 172.21.15.133:0/2312825134 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2764055500 0x7f27640579c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.551+0000 7f278412f700 1 --2- 172.21.15.133:0/2312825134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f277c0b5120 0x7f277c13e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.551+0000 7f278412f700 1 --2- 172.21.15.133:0/2312825134 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f277c060b00 0x7f277c12f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.551+0000 7f278412f700 1 --2- 172.21.15.133:0/2312825134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f277c0af9f0 0x7f277c13db90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.551+0000 7f278412f700 1 -- 172.21.15.133:0/2312825134 >> 172.21.15.133:0/2312825134 conn(0x7f277c05bdf0 msgr2=0x7f277c130360 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:43.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.551+0000 7f278412f700 1 -- 172.21.15.133:0/2312825134 shutdown_connections 2021-01-03T12:58:43.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.551+0000 7f278412f700 1 -- 172.21.15.133:0/2312825134 wait complete. 2021-01-03T12:58:43.558 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2021-01-03T12:58:43.568 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T12:58:43.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.683+0000 7f565bfff700 1 Processor -- start 2021-01-03T12:58:43.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.683+0000 7f565bfff700 1 -- start start 2021-01-03T12:58:43.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565bfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f565c0adc10 0x7f565c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f565c062450 0x7f565c0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565bfff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565c0adff0 con 0x7f565c0b3190 2021-01-03T12:58:43.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565bfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565c0b1930 con 0x7f565c062450 2021-01-03T12:58:43.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565bfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c05fb80 con 0x7f565c0adc10 2021-01-03T12:58:43.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f565c062450 0x7f565c0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f5661838700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f565c0b3190 0x7f565c025140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54122/0 (socket says 172.21.15.133:54122) 2021-01-03T12:58:43.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f5661838700 1 -- 172.21.15.133:0/1099611643 learned_addr learned my addr 172.21.15.133:0/1099611643 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:43.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565b7fe700 1 --2- 172.21.15.133:0/1099611643 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f565c0adc10 0x7f565c067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565affd700 1 -- 172.21.15.133:0/1099611643 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f565c0adc10 msgr2=0x7f565c067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:43.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565affd700 1 --2- 172.21.15.133:0/1099611643 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f565c0adc10 0x7f565c067cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565affd700 1 -- 172.21.15.133:0/1099611643 >> v1:172.21.15.133:6789/0 conn(0x7f565c0b3190 legacy=0x7f565c025140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565affd700 1 -- 172.21.15.133:0/1099611643 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c05fed0 con 0x7f565c062450 2021-01-03T12:58:43.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565b7fe700 1 --2- 172.21.15.133:0/1099611643 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f565c0adc10 0x7f565c067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:43.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565a7fc700 1 -- 172.21.15.133:0/1099611643 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580503205 0 0) 0x7f565c0adff0 con 0x7f565c0b3190 2021-01-03T12:58:43.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565affd700 1 --2- 172.21.15.133:0/1099611643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f565c062450 0x7f565c0b2ca0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f5650002f30 tx=0x7f5650006dc0).ready entity=mon.1 client_cookie=d29b28f046d04f8a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:43.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565a7fc700 1 -- 172.21.15.133:0/1099611643 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56500097f0 con 0x7f565c062450 2021-01-03T12:58:43.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565a7fc700 1 -- 172.21.15.133:0/1099611643 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5650009950 con 0x7f565c062450 2021-01-03T12:58:43.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565a7fc700 1 -- 172.21.15.133:0/1099611643 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5650009cb0 con 0x7f565c062450 2021-01-03T12:58:43.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565bfff700 1 -- 172.21.15.133:0/1099611643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f565c062450 msgr2=0x7f565c0b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565bfff700 1 --2- 172.21.15.133:0/1099611643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f565c062450 0x7f565c0b2ca0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f5650002f30 tx=0x7f5650006dc0).stop 2021-01-03T12:58:43.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565bfff700 1 -- 172.21.15.133:0/1099611643 shutdown_connections 2021-01-03T12:58:43.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565bfff700 1 --2- 172.21.15.133:0/1099611643 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f565c0adc10 0x7f565c067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565bfff700 1 --2- 172.21.15.133:0/1099611643 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f565c062450 0x7f565c0b2ca0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565bfff700 1 -- 172.21.15.133:0/1099611643 >> 172.21.15.133:0/1099611643 conn(0x7f565c060d10 msgr2=0x7f565c061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:43.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565bfff700 1 -- 172.21.15.133:0/1099611643 shutdown_connections 2021-01-03T12:58:43.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.687+0000 7f565bfff700 1 -- 172.21.15.133:0/1099611643 wait complete. 2021-01-03T12:58:43.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565bfff700 1 Processor -- start 2021-01-03T12:58:43.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565bfff700 1 -- start start 2021-01-03T12:58:43.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f565c062450 0x7f565c13b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f565c0adc10 0x7f565c1535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565bfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f565c0b3190 0x7f565c0af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565bfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c066e90 con 0x7f565c062450 2021-01-03T12:58:43.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565bfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c0670c0 con 0x7f565c0adc10 2021-01-03T12:58:43.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565bfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c067360 con 0x7f565c0b3190 2021-01-03T12:58:43.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f565c0adc10 0x7f565c1535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f565c0adc10 0x7f565c1535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33094/0 (socket says 172.21.15.133:33094) 2021-01-03T12:58:43.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565affd700 1 -- 172.21.15.133:0/2199552153 learned_addr learned my addr 172.21.15.133:0/2199552153 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:43.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f5661838700 1 --2- 172.21.15.133:0/2199552153 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f565c0b3190 0x7f565c0af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565b7fe700 1 --2- 172.21.15.133:0/2199552153 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f565c062450 0x7f565c13b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565affd700 1 -- 172.21.15.133:0/2199552153 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f565c0b3190 msgr2=0x7f565c0af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565affd700 1 --2- 172.21.15.133:0/2199552153 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f565c0b3190 0x7f565c0af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565affd700 1 -- 172.21.15.133:0/2199552153 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f565c062450 msgr2=0x7f565c13b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565affd700 1 --2- 172.21.15.133:0/2199552153 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f565c062450 0x7f565c13b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565affd700 1 -- 172.21.15.133:0/2199552153 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c067600 con 0x7f565c0adc10 2021-01-03T12:58:43.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565affd700 1 --2- 172.21.15.133:0/2199552153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f565c0adc10 0x7f565c1535c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f5650002f30 tx=0x7f5650015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:43.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f5643fff700 1 -- 172.21.15.133:0/2199552153 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5650009c50 con 0x7f565c0adc10 2021-01-03T12:58:43.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f5643fff700 1 -- 172.21.15.133:0/2199552153 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565001d450 con 0x7f565c0adc10 2021-01-03T12:58:43.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565bfff700 1 -- 172.21.15.133:0/2199552153 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565c153ab0 con 0x7f565c0adc10 2021-01-03T12:58:43.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f5643fff700 1 -- 172.21.15.133:0/2199552153 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f565001d7b0 con 0x7f565c0adc10 2021-01-03T12:58:43.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.691+0000 7f565bfff700 1 -- 172.21.15.133:0/2199552153 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565c0b06e0 con 0x7f565c0adc10 2021-01-03T12:58:43.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.695+0000 7f5643fff700 1 -- 172.21.15.133:0/2199552153 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5650024030 con 0x7f565c0adc10 2021-01-03T12:58:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.695+0000 7f565bfff700 1 -- 172.21.15.133:0/2199552153 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565c067790 con 0x7f565c0adc10 2021-01-03T12:58:43.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.695+0000 7f5643fff700 1 --2- 172.21.15.133:0/2199552153 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f563c0553b0 0x7f563c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:43.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.695+0000 7f565b7fe700 1 --2- 172.21.15.133:0/2199552153 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f563c0553b0 0x7f563c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:43.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.695+0000 7f5643fff700 1 -- 172.21.15.133:0/2199552153 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f565006f240 con 0x7f565c0adc10 2021-01-03T12:58:43.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.695+0000 7f565b7fe700 1 --2- 172.21.15.133:0/2199552153 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f563c0553b0 0x7f563c057870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f564c00c000 tx=0x7f564c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:43.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.699+0000 7f5643fff700 1 -- 172.21.15.133:0/2199552153 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f56500454a0 con 0x7f565c0adc10 2021-01-03T12:58:43.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.887+0000 7f565bfff700 1 -- 172.21.15.133:0/2199552153 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f565c057300 con 0x7f565c0adc10 2021-01-03T12:58:43.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.895+0000 7f5643fff700 1 -- 172.21.15.133:0/2199552153 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5650022020 con 0x7f565c0adc10 2021-01-03T12:58:43.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.899+0000 7f565bfff700 1 -- 172.21.15.133:0/2199552153 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f563c0553b0 msgr2=0x7f563c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.899+0000 7f565bfff700 1 --2- 172.21.15.133:0/2199552153 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f563c0553b0 0x7f563c057870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f564c00c000 tx=0x7f564c008040).stop 2021-01-03T12:58:43.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.899+0000 7f565bfff700 1 -- 172.21.15.133:0/2199552153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f565c0adc10 msgr2=0x7f565c1535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:43.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.899+0000 7f565bfff700 1 --2- 172.21.15.133:0/2199552153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f565c0adc10 0x7f565c1535c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f5650002f30 tx=0x7f5650015000).stop 2021-01-03T12:58:43.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.899+0000 7f565bfff700 1 -- 172.21.15.133:0/2199552153 shutdown_connections 2021-01-03T12:58:43.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.899+0000 7f565bfff700 1 --2- 172.21.15.133:0/2199552153 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f563c0553b0 0x7f563c057870 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.899+0000 7f565bfff700 1 --2- 172.21.15.133:0/2199552153 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f565c062450 0x7f565c13b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.899+0000 7f565bfff700 1 --2- 172.21.15.133:0/2199552153 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f565c0b3190 0x7f565c0af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.899+0000 7f565bfff700 1 --2- 172.21.15.133:0/2199552153 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f565c0adc10 0x7f565c1535c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:43.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.899+0000 7f565bfff700 1 -- 172.21.15.133:0/2199552153 >> 172.21.15.133:0/2199552153 conn(0x7f565c060d10 msgr2=0x7f565c1599e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:43.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.899+0000 7f565bfff700 1 -- 172.21.15.133:0/2199552153 shutdown_connections 2021-01-03T12:58:43.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:43.899+0000 7f565bfff700 1 -- 172.21.15.133:0/2199552153 wait complete. 2021-01-03T12:58:43.903 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.1 2021-01-03T12:58:43.913 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T12:58:44.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.027+0000 7ffb0ffff700 1 Processor -- start 2021-01-03T12:58:44.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.027+0000 7ffb0ffff700 1 -- start start 2021-01-03T12:58:44.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.027+0000 7ffb0ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffb100b9b60 0x7ffb100b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:44.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.027+0000 7ffb0ffff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1014a570 con 0x7ffb1005ff30 2021-01-03T12:58:44.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.027+0000 7ffb0ffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb100604b0 con 0x7ffb100b5750 2021-01-03T12:58:44.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.027+0000 7ffb0ffff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1014a7a0 con 0x7ffb100b9b60 2021-01-03T12:58:44.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.027+0000 7ffb0e7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ffb100b5750 0x7ffb1014aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54132/0 (socket says 172.21.15.133:54132) 2021-01-03T12:58:44.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.027+0000 7ffb0e7fc700 1 -- 172.21.15.133:0/4176059595 learned_addr learned my addr 172.21.15.133:0/4176059595 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:44.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.027+0000 7ffb0effd700 1 --2- 172.21.15.133:0/4176059595 >> v2:172.21.15.133:3300/0 conn(0x7ffb100b9b60 0x7ffb100b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:44.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.027+0000 7ffb0dffb700 1 -- 172.21.15.133:0/4176059595 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349951525 0 0) 0x7ffb100604b0 con 0x7ffb100b5750 2021-01-03T12:58:44.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.027+0000 7ffb0dffb700 1 -- 172.21.15.133:0/4176059595 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaf0003230 con 0x7ffb100b5750 2021-01-03T12:58:44.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.031+0000 7ffb0dffb700 1 -- 172.21.15.133:0/4176059595 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2580823823 0 0) 0x7ffaf0003230 con 0x7ffb100b5750 2021-01-03T12:58:44.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.031+0000 7ffb0effd700 1 -- 172.21.15.133:0/4176059595 >> v1:172.21.15.133:6789/0 conn(0x7ffb100b5750 legacy=0x7ffb1014aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:44.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.031+0000 7ffb0effd700 1 -- 172.21.15.133:0/4176059595 >> v1:172.21.15.16:6789/0 conn(0x7ffb1005ff30 legacy=0x7ffb10147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:44.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.031+0000 7ffb0effd700 1 -- 172.21.15.133:0/4176059595 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1014aa40 con 0x7ffb100b9b60 2021-01-03T12:58:44.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.031+0000 7ffb0effd700 1 --2- 172.21.15.133:0/4176059595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb100b9b60 0x7ffb100b9f40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7ffb080010d0 tx=0x7ffaf8006dc0).ready entity=mon.1 client_cookie=821114f1d6a9f344 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:44.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.031+0000 7ffb0dffb700 1 -- 172.21.15.133:0/4176059595 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb00001a50 con 0x7ffb100b9b60 2021-01-03T12:58:44.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.031+0000 7ffb0dffb700 1 -- 172.21.15.133:0/4176059595 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf8009620 con 0x7ffb100b9b60 2021-01-03T12:58:44.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.031+0000 7ffb0dffb700 1 -- 172.21.15.133:0/4176059595 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaf8009790 con 0x7ffb100b9b60 2021-01-03T12:58:44.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.031+0000 7ffb0ffff700 1 -- 172.21.15.133:0/4176059595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb100b9b60 msgr2=0x7ffb100b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:44.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.031+0000 7ffb0ffff700 1 --2- 172.21.15.133:0/4176059595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb100b9b60 0x7ffb100b9f40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7ffb080010d0 tx=0x7ffaf8006dc0).stop 2021-01-03T12:58:44.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.031+0000 7ffb0ffff700 1 -- 172.21.15.133:0/4176059595 shutdown_connections 2021-01-03T12:58:44.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.031+0000 7ffb0ffff700 1 --2- 172.21.15.133:0/4176059595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb100b9b60 0x7ffb100b9f40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:44.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.031+0000 7ffb0ffff700 1 -- 172.21.15.133:0/4176059595 >> 172.21.15.133:0/4176059595 conn(0x7ffb100b69e0 msgr2=0x7ffb100b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:44.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.031+0000 7ffb0ffff700 1 -- 172.21.15.133:0/4176059595 shutdown_connections 2021-01-03T12:58:44.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.031+0000 7ffb0ffff700 1 -- 172.21.15.133:0/4176059595 wait complete. 2021-01-03T12:58:44.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.031+0000 7ffb0ffff700 1 Processor -- start 2021-01-03T12:58:44.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.031+0000 7ffb0ffff700 1 -- start start 2021-01-03T12:58:44.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb1005ff30 0x7ffb101461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:44.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb100b5750 0x7ffb100b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:44.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffb100b9b60 0x7ffb100b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:44.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0ffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb100b3820 con 0x7ffb1005ff30 2021-01-03T12:58:44.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1015a190 con 0x7ffb100b5750 2021-01-03T12:58:44.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb100b3a50 con 0x7ffb100b9b60 2021-01-03T12:58:44.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb100b5750 0x7ffb100b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:44.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb100b5750 0x7ffb100b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33108/0 (socket says 172.21.15.133:33108) 2021-01-03T12:58:44.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0e7fc700 1 -- 172.21.15.133:0/3642024496 learned_addr learned my addr 172.21.15.133:0/3642024496 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:44.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0f7fe700 1 --2- 172.21.15.133:0/3642024496 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffb100b9b60 0x7ffb100b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:44.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0effd700 1 --2- 172.21.15.133:0/3642024496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb1005ff30 0x7ffb101461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:44.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0e7fc700 1 -- 172.21.15.133:0/3642024496 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffb100b9b60 msgr2=0x7ffb100b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:44.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0e7fc700 1 --2- 172.21.15.133:0/3642024496 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffb100b9b60 0x7ffb100b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:44.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0e7fc700 1 -- 172.21.15.133:0/3642024496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb1005ff30 msgr2=0x7ffb101461e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:44.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0e7fc700 1 --2- 172.21.15.133:0/3642024496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb1005ff30 0x7ffb101461e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:44.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0e7fc700 1 -- 172.21.15.133:0/3642024496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb100b3cf0 con 0x7ffb100b5750 2021-01-03T12:58:44.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0e7fc700 1 --2- 172.21.15.133:0/3642024496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb100b5750 0x7ffb100b2ab0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7ffb00001cb0 tx=0x7ffb000021b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:44.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb07fff700 1 -- 172.21.15.133:0/3642024496 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb00005b70 con 0x7ffb100b5750 2021-01-03T12:58:44.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb07fff700 1 -- 172.21.15.133:0/3642024496 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb00005cd0 con 0x7ffb100b5750 2021-01-03T12:58:44.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb07fff700 1 -- 172.21.15.133:0/3642024496 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb00004a60 con 0x7ffb100b5750 2021-01-03T12:58:44.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0ffff700 1 -- 172.21.15.133:0/3642024496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb101466d0 con 0x7ffb100b5750 2021-01-03T12:58:44.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.035+0000 7ffb0ffff700 1 -- 172.21.15.133:0/3642024496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb10159db0 con 0x7ffb100b5750 2021-01-03T12:58:44.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.039+0000 7ffb0ffff700 1 -- 172.21.15.133:0/3642024496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb10057300 con 0x7ffb100b5750 2021-01-03T12:58:44.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.039+0000 7ffb07fff700 1 -- 172.21.15.133:0/3642024496 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ffb00010070 con 0x7ffb100b5750 2021-01-03T12:58:44.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.039+0000 7ffb07fff700 1 --2- 172.21.15.133:0/3642024496 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ffaf40554e0 0x7ffaf40579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:44.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.039+0000 7ffb0effd700 1 --2- 172.21.15.133:0/3642024496 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ffaf40554e0 0x7ffaf40579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:44.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.039+0000 7ffb07fff700 1 -- 172.21.15.133:0/3642024496 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffb0006dbc0 con 0x7ffb100b5750 2021-01-03T12:58:44.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.039+0000 7ffb0effd700 1 --2- 172.21.15.133:0/3642024496 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ffaf40554e0 0x7ffaf40579a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7ffaf8018000 tx=0x7ffb100603a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:44.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.047+0000 7ffb07fff700 1 -- 172.21.15.133:0/3642024496 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ffb00043db0 con 0x7ffb100b5750 2021-01-03T12:58:44.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.235+0000 7ffb0ffff700 1 -- 172.21.15.133:0/3642024496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb1015a2d0 con 0x7ffb100b5750 2021-01-03T12:58:44.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.235+0000 7ffb07fff700 1 -- 172.21.15.133:0/3642024496 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2494 (secure 0 0 0) 0x7ffb00019030 con 0x7ffb100b5750 2021-01-03T12:58:44.238 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:44.238 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4628,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2847550436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2847550436},{"type":"v1","addr":"172.21.15.16:6833","nonce":2847550436}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1321910656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1321910656},{"type":"v1","addr":"172.21.15.133:6835","nonce":1321910656}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T12:58:41.558757+0000","modified":"2021-01-03T12:58:42.561830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1532041867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1532041867},{"type":"v1","addr":"172.21.15.133:6837","nonce":1532041867}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-01-03T12:58:44.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.239+0000 7ffb0ffff700 1 -- 172.21.15.133:0/3642024496 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ffaf40554e0 msgr2=0x7ffaf40579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:44.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.239+0000 7ffb0ffff700 1 --2- 172.21.15.133:0/3642024496 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ffaf40554e0 0x7ffaf40579a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7ffaf8018000 tx=0x7ffb100603a0).stop 2021-01-03T12:58:44.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.239+0000 7ffb0ffff700 1 -- 172.21.15.133:0/3642024496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb100b5750 msgr2=0x7ffb100b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:44.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.239+0000 7ffb0ffff700 1 --2- 172.21.15.133:0/3642024496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb100b5750 0x7ffb100b2ab0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7ffb00001cb0 tx=0x7ffb000021b0).stop 2021-01-03T12:58:44.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.239+0000 7ffb0ffff700 1 -- 172.21.15.133:0/3642024496 shutdown_connections 2021-01-03T12:58:44.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.239+0000 7ffb0ffff700 1 --2- 172.21.15.133:0/3642024496 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ffaf40554e0 0x7ffaf40579a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:44.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.239+0000 7ffb0ffff700 1 --2- 172.21.15.133:0/3642024496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffb1005ff30 0x7ffb101461e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:44.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.239+0000 7ffb0ffff700 1 --2- 172.21.15.133:0/3642024496 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffb100b9b60 0x7ffb100b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:44.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.239+0000 7ffb0ffff700 1 --2- 172.21.15.133:0/3642024496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffb100b5750 0x7ffb100b2ab0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:44.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.239+0000 7ffb0ffff700 1 -- 172.21.15.133:0/3642024496 >> 172.21.15.133:0/3642024496 conn(0x7ffb100b69e0 msgr2=0x7ffb10062770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:44.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.239+0000 7ffb0ffff700 1 -- 172.21.15.133:0/3642024496 shutdown_connections 2021-01-03T12:58:44.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.239+0000 7ffb0ffff700 1 -- 172.21.15.133:0/3642024496 wait complete. 2021-01-03T12:58:44.243 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 10 2021-01-03T12:58:44.554 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T12:58:41.558757+0000', 'modified': '2021-01-03T12:58:42.561830+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4888}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4888': {'gid': 4888, 'name': 'a', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/1532041867', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 1532041867}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 1532041867}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T12:58:44.554 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T12:58:44.555 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-01-03T12:58:44.682 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":4888,"want_state":"up:active","state":"up:active","rank_uptime":3.1100562520000001,"mdsmap_epoch":10,"osdmap_epoch":34,"osdmap_epoch_barrier":33,"uptime":10.342031725} 2021-01-03T12:58:44.683 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 4888, "mdsmap_epoch": 10, "osdmap_epoch": 34, "osdmap_epoch_barrier": 33, "rank_uptime": 3.110056252, "state": "up:active", "uptime": 10.342031725, "want_state": "up:active", "whoami": 0 } 2021-01-03T12:58:44.683 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:58:44.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.791+0000 7f0b7b59e700 1 Processor -- start 2021-01-03T12:58:44.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.791+0000 7f0b7b59e700 1 -- start start 2021-01-03T12:58:44.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.791+0000 7f0b7b59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0b7c0b1300 0x7f0b7c1428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:44.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.791+0000 7f0b7b59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0b7c0b2050 0x7f0b7c06a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:44.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.791+0000 7f0b7b59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7c0afa40 con 0x7f0b7c0b0c30 2021-01-03T12:58:44.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.791+0000 7f0b7b59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7c0b25d0 con 0x7f0b7c0b2050 2021-01-03T12:58:44.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.791+0000 7f0b7b59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c0b2870 con 0x7f0b7c0b1300 2021-01-03T12:58:44.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.791+0000 7f0b79d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0b7c0b0c30 0x7f0b7c0ad4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54146/0 (socket says 172.21.15.133:54146) 2021-01-03T12:58:44.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.791+0000 7f0b79d9b700 1 -- 172.21.15.133:0/607882216 learned_addr learned my addr 172.21.15.133:0/607882216 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:44.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.791+0000 7f0b7a59c700 1 --2- 172.21.15.133:0/607882216 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0b7c0b1300 0x7f0b7c1428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:44.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.791+0000 7f0b7ad9d700 1 --2- 172.21.15.133:0/607882216 >> v2:172.21.15.16:3300/0 conn(0x7f0b7c0b2050 0x7f0b7c06a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:44.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.791+0000 7f0b7959a700 1 -- 172.21.15.133:0/607882216 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86755857 0 0) 0x7f0b7c0afa40 con 0x7f0b7c0b0c30 2021-01-03T12:58:44.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.791+0000 7f0b7959a700 1 -- 172.21.15.133:0/607882216 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b60003230 con 0x7f0b7c0b0c30 2021-01-03T12:58:44.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7959a700 1 -- 172.21.15.133:0/607882216 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 337517309 0 0) 0x7f0b60003230 con 0x7f0b7c0b0c30 2021-01-03T12:58:44.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7a59c700 1 -- 172.21.15.133:0/607882216 >> v2:172.21.15.16:3300/0 conn(0x7f0b7c0b2050 msgr2=0x7f0b7c06a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:44.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7a59c700 1 --2- 172.21.15.133:0/607882216 >> v2:172.21.15.16:3300/0 conn(0x7f0b7c0b2050 0x7f0b7c06a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:44.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7a59c700 1 -- 172.21.15.133:0/607882216 >> v1:172.21.15.133:6789/0 conn(0x7f0b7c0b0c30 legacy=0x7f0b7c0ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:44.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7a59c700 1 -- 172.21.15.133:0/607882216 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c0ad040 con 0x7f0b7c0b1300 2021-01-03T12:58:44.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7ad9d700 1 --2- 172.21.15.133:0/607882216 >> v2:172.21.15.16:3300/0 conn(0x7f0b7c0b2050 0x7f0b7c06a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:44.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7a59c700 1 --2- 172.21.15.133:0/607882216 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0b7c0b1300 0x7f0b7c1428c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0b6c001870 tx=0x7f0b70006dc0).ready entity=mon.2 client_cookie=c5dc48a96adf18f1 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:44.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7959a700 1 -- 172.21.15.133:0/607882216 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b6c0016d0 con 0x7f0b7c0b1300 2021-01-03T12:58:44.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7959a700 1 -- 172.21.15.133:0/607882216 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7000d570 con 0x7f0b7c0b1300 2021-01-03T12:58:44.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7959a700 1 -- 172.21.15.133:0/607882216 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b7000d6e0 con 0x7f0b7c0b1300 2021-01-03T12:58:44.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7b59e700 1 -- 172.21.15.133:0/607882216 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0b7c0b1300 msgr2=0x7f0b7c1428c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:44.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7b59e700 1 --2- 172.21.15.133:0/607882216 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0b7c0b1300 0x7f0b7c1428c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0b6c001870 tx=0x7f0b70006dc0).stop 2021-01-03T12:58:44.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7b59e700 1 -- 172.21.15.133:0/607882216 shutdown_connections 2021-01-03T12:58:44.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7b59e700 1 --2- 172.21.15.133:0/607882216 >> v2:172.21.15.16:3300/0 conn(0x7f0b7c0b2050 0x7f0b7c06a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:44.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7b59e700 1 --2- 172.21.15.133:0/607882216 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0b7c0b1300 0x7f0b7c1428c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:44.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7b59e700 1 -- 172.21.15.133:0/607882216 >> 172.21.15.133:0/607882216 conn(0x7f0b7c06b050 msgr2=0x7f0b7c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:44.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7b59e700 1 -- 172.21.15.133:0/607882216 shutdown_connections 2021-01-03T12:58:44.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.795+0000 7f0b7b59e700 1 -- 172.21.15.133:0/607882216 wait complete. 2021-01-03T12:58:44.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b7b59e700 1 Processor -- start 2021-01-03T12:58:44.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b7b59e700 1 -- start start 2021-01-03T12:58:44.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b7b59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0b7c0b0c30 0x7f0b7c145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:44.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b7b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b7c0b1300 0x7f0b7c140860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:44.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b7b59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b7c0b2050 0x7f0b7c140d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:44.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b7b59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c143770 con 0x7f0b7c0b2050 2021-01-03T12:58:44.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b7b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c142c70 con 0x7f0b7c0b1300 2021-01-03T12:58:44.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b7b59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c143230 con 0x7f0b7c0b0c30 2021-01-03T12:58:44.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b79d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b7c0b1300 0x7f0b7c140860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:44.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b79d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b7c0b1300 0x7f0b7c140860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33120/0 (socket says 172.21.15.133:33120) 2021-01-03T12:58:44.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b79d9b700 1 -- 172.21.15.133:0/212249286 learned_addr learned my addr 172.21.15.133:0/212249286 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:44.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b7ad9d700 1 --2- 172.21.15.133:0/212249286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b7c0b2050 0x7f0b7c140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:44.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b7a59c700 1 --2- 172.21.15.133:0/212249286 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0b7c0b0c30 0x7f0b7c145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:44.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b79d9b700 1 -- 172.21.15.133:0/212249286 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0b7c0b0c30 msgr2=0x7f0b7c145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:44.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b79d9b700 1 --2- 172.21.15.133:0/212249286 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0b7c0b0c30 0x7f0b7c145470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:44.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b79d9b700 1 -- 172.21.15.133:0/212249286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b7c0b2050 msgr2=0x7f0b7c140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:44.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b79d9b700 1 --2- 172.21.15.133:0/212249286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b7c0b2050 0x7f0b7c140d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:44.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b79d9b700 1 -- 172.21.15.133:0/212249286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c1434d0 con 0x7f0b7c0b1300 2021-01-03T12:58:44.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b7ad9d700 1 --2- 172.21.15.133:0/212249286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b7c0b2050 0x7f0b7c140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:44.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b79d9b700 1 --2- 172.21.15.133:0/212249286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b7c0b1300 0x7f0b7c140860 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f0b7c065810 tx=0x7f0b6c001690).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:44.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b6b7fe700 1 -- 172.21.15.133:0/212249286 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b6c007320 con 0x7f0b7c0b1300 2021-01-03T12:58:44.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b6b7fe700 1 -- 172.21.15.133:0/212249286 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c007480 con 0x7f0b7c0b1300 2021-01-03T12:58:44.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b7b59e700 1 -- 172.21.15.133:0/212249286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7c0662d0 con 0x7f0b7c0b1300 2021-01-03T12:58:44.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b6b7fe700 1 -- 172.21.15.133:0/212249286 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b6c0057d0 con 0x7f0b7c0b1300 2021-01-03T12:58:44.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.799+0000 7f0b7b59e700 1 -- 172.21.15.133:0/212249286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7c1419a0 con 0x7f0b7c0b1300 2021-01-03T12:58:44.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.803+0000 7f0b7b59e700 1 -- 172.21.15.133:0/212249286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7c1405a0 con 0x7f0b7c0b1300 2021-01-03T12:58:44.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.803+0000 7f0b6b7fe700 1 -- 172.21.15.133:0/212249286 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0b6c010030 con 0x7f0b7c0b1300 2021-01-03T12:58:44.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.803+0000 7f0b6b7fe700 1 --2- 172.21.15.133:0/212249286 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0b580554e0 0x7f0b580579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:44.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.803+0000 7f0b7a59c700 1 --2- 172.21.15.133:0/212249286 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0b580554e0 0x7f0b580579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:44.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.803+0000 7f0b6b7fe700 1 -- 172.21.15.133:0/212249286 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0b6c06dcd0 con 0x7f0b7c0b1300 2021-01-03T12:58:44.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.803+0000 7f0b7a59c700 1 --2- 172.21.15.133:0/212249286 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0b580554e0 0x7f0b580579a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f0b70018000 tx=0x7f0b70015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:44.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.811+0000 7f0b6b7fe700 1 -- 172.21.15.133:0/212249286 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0b7c1405a0 con 0x7f0b7c0b1300 2021-01-03T12:58:44.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.951+0000 7f0b7b59e700 1 -- 172.21.15.133:0/212249286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b7c1405a0 con 0x7f0b7c0b1300 2021-01-03T12:58:44.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.951+0000 7f0b6b7fe700 1 -- 172.21.15.133:0/212249286 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f0b7c1405a0 con 0x7f0b7c0b1300 2021-01-03T12:58:44.953 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:44.953 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":34,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:58:42.562578+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:58:39.345665+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2021-01-03T12:58:40.570679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:58:44.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.955+0000 7f0b7b59e700 1 -- 172.21.15.133:0/212249286 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0b580554e0 msgr2=0x7f0b580579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:44.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.955+0000 7f0b7b59e700 1 --2- 172.21.15.133:0/212249286 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0b580554e0 0x7f0b580579a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f0b70018000 tx=0x7f0b70015000).stop 2021-01-03T12:58:44.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.955+0000 7f0b7b59e700 1 -- 172.21.15.133:0/212249286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b7c0b1300 msgr2=0x7f0b7c140860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:44.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.955+0000 7f0b7b59e700 1 --2- 172.21.15.133:0/212249286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b7c0b1300 0x7f0b7c140860 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f0b7c065810 tx=0x7f0b6c001690).stop 2021-01-03T12:58:44.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.955+0000 7f0b7b59e700 1 -- 172.21.15.133:0/212249286 shutdown_connections 2021-01-03T12:58:44.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.955+0000 7f0b7b59e700 1 --2- 172.21.15.133:0/212249286 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0b580554e0 0x7f0b580579a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:44.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.955+0000 7f0b7b59e700 1 --2- 172.21.15.133:0/212249286 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b7c0b2050 0x7f0b7c140d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:44.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.955+0000 7f0b7b59e700 1 --2- 172.21.15.133:0/212249286 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0b7c0b0c30 0x7f0b7c145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:44.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.955+0000 7f0b7b59e700 1 --2- 172.21.15.133:0/212249286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b7c0b1300 0x7f0b7c140860 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:44.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.955+0000 7f0b7b59e700 1 -- 172.21.15.133:0/212249286 >> 172.21.15.133:0/212249286 conn(0x7f0b7c06b050 msgr2=0x7f0b7c13f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:44.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.955+0000 7f0b7b59e700 1 -- 172.21.15.133:0/212249286 shutdown_connections 2021-01-03T12:58:44.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:44.955+0000 7f0b7b59e700 1 -- 172.21.15.133:0/212249286 wait complete. 2021-01-03T12:58:44.967 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T12:58:39.345665+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T12:58:40.570679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T12:58:44.967 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T12:58:45.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.079+0000 7fb199c52700 1 Processor -- start 2021-01-03T12:58:45.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.079+0000 7fb199c52700 1 -- start start 2021-01-03T12:58:45.083 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb199c52700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb1940b3f90 0x7fb194143950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb199c52700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb1940b2e80 0x7fb1941402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb199c52700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb194146a60 con 0x7fb1940b3890 2021-01-03T12:58:45.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb199c52700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb194142dc0 con 0x7fb1940b3f90 2021-01-03T12:58:45.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb199c52700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1940b3520 con 0x7fb1940b2e80 2021-01-03T12:58:45.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb192ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb1940b3890 0x7fb194146350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54160/0 (socket says 172.21.15.133:54160) 2021-01-03T12:58:45.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb192ffd700 1 -- 172.21.15.133:0/1169204583 learned_addr learned my addr 172.21.15.133:0/1169204583 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:45.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb193fff700 1 --2- 172.21.15.133:0/1169204583 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb1940b2e80 0x7fb1941402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb1937fe700 1 --2- 172.21.15.133:0/1169204583 >> v2:172.21.15.16:3300/0 conn(0x7fb1940b3f90 0x7fb194143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb1927fc700 1 -- 172.21.15.133:0/1169204583 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600606382 0 0) 0x7fb194146a60 con 0x7fb1940b3890 2021-01-03T12:58:45.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb1927fc700 1 -- 172.21.15.133:0/1169204583 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb180003230 con 0x7fb1940b3890 2021-01-03T12:58:45.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb193fff700 1 -- 172.21.15.133:0/1169204583 >> v2:172.21.15.16:3300/0 conn(0x7fb1940b3f90 msgr2=0x7fb194143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:45.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb193fff700 1 --2- 172.21.15.133:0/1169204583 >> v2:172.21.15.16:3300/0 conn(0x7fb1940b3f90 0x7fb194143950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb193fff700 1 -- 172.21.15.133:0/1169204583 >> v1:172.21.15.133:6789/0 conn(0x7fb1940b3890 legacy=0x7fb194146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb193fff700 1 -- 172.21.15.133:0/1169204583 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1940b32d0 con 0x7fb1940b2e80 2021-01-03T12:58:45.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb193fff700 1 --2- 172.21.15.133:0/1169204583 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb1940b2e80 0x7fb1941402a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb18c0032b0 tx=0x7fb18c0091a0).ready entity=mon.2 client_cookie=f7a15668a3de857f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:45.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb1927fc700 1 -- 172.21.15.133:0/1169204583 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb18c00b9a0 con 0x7fb1940b2e80 2021-01-03T12:58:45.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb1927fc700 1 -- 172.21.15.133:0/1169204583 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c00bb00 con 0x7fb1940b2e80 2021-01-03T12:58:45.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb1927fc700 1 -- 172.21.15.133:0/1169204583 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb18c00bc70 con 0x7fb1940b2e80 2021-01-03T12:58:45.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb199c52700 1 -- 172.21.15.133:0/1169204583 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb1940b2e80 msgr2=0x7fb1941402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.083+0000 7fb199c52700 1 --2- 172.21.15.133:0/1169204583 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb1940b2e80 0x7fb1941402a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb18c0032b0 tx=0x7fb18c0091a0).stop 2021-01-03T12:58:45.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb199c52700 1 -- 172.21.15.133:0/1169204583 shutdown_connections 2021-01-03T12:58:45.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb199c52700 1 --2- 172.21.15.133:0/1169204583 >> v2:172.21.15.16:3300/0 conn(0x7fb1940b3f90 0x7fb194143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb199c52700 1 --2- 172.21.15.133:0/1169204583 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb1940b2e80 0x7fb1941402a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb199c52700 1 -- 172.21.15.133:0/1169204583 >> 172.21.15.133:0/1169204583 conn(0x7fb19405bdf0 msgr2=0x7fb19405c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:45.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb199c52700 1 -- 172.21.15.133:0/1169204583 shutdown_connections 2021-01-03T12:58:45.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb199c52700 1 -- 172.21.15.133:0/1169204583 wait complete. 2021-01-03T12:58:45.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb199c52700 1 Processor -- start 2021-01-03T12:58:45.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb199c52700 1 -- start start 2021-01-03T12:58:45.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb199c52700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1940b2e80 0x7fb194149610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb199c52700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1940b3890 0x7fb194145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb199c52700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb1940b3f90 0x7fb194147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb199c52700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb194148860 con 0x7fb1940b2e80 2021-01-03T12:58:45.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb199c52700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb194155b00 con 0x7fb1940b3890 2021-01-03T12:58:45.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb199c52700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb194155d70 con 0x7fb1940b3f90 2021-01-03T12:58:45.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb192ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1940b3890 0x7fb194145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb192ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1940b3890 0x7fb194145ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33136/0 (socket says 172.21.15.133:33136) 2021-01-03T12:58:45.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb192ffd700 1 -- 172.21.15.133:0/200942732 learned_addr learned my addr 172.21.15.133:0/200942732 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:45.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb193fff700 1 --2- 172.21.15.133:0/200942732 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb1940b3f90 0x7fb194147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb1937fe700 1 --2- 172.21.15.133:0/200942732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1940b2e80 0x7fb194149610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb192ffd700 1 -- 172.21.15.133:0/200942732 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb1940b3f90 msgr2=0x7fb194147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb192ffd700 1 --2- 172.21.15.133:0/200942732 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb1940b3f90 0x7fb194147460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb192ffd700 1 -- 172.21.15.133:0/200942732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1940b2e80 msgr2=0x7fb194149610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb192ffd700 1 --2- 172.21.15.133:0/200942732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1940b2e80 0x7fb194149610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb192ffd700 1 -- 172.21.15.133:0/200942732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb194156010 con 0x7fb1940b3890 2021-01-03T12:58:45.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb192ffd700 1 --2- 172.21.15.133:0/200942732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1940b3890 0x7fb194145ec0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fb1880010d0 tx=0x7fb188007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:45.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb190ff9700 1 -- 172.21.15.133:0/200942732 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb188007320 con 0x7fb1940b3890 2021-01-03T12:58:45.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb190ff9700 1 -- 172.21.15.133:0/200942732 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb188007480 con 0x7fb1940b3890 2021-01-03T12:58:45.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb199c52700 1 -- 172.21.15.133:0/200942732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1940b1500 con 0x7fb1940b3890 2021-01-03T12:58:45.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb190ff9700 1 -- 172.21.15.133:0/200942732 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1880057d0 con 0x7fb1940b3890 2021-01-03T12:58:45.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.087+0000 7fb199c52700 1 -- 172.21.15.133:0/200942732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1941463b0 con 0x7fb1940b3890 2021-01-03T12:58:45.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.091+0000 7fb199c52700 1 -- 172.21.15.133:0/200942732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb194146660 con 0x7fb1940b3890 2021-01-03T12:58:45.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.091+0000 7fb190ff9700 1 -- 172.21.15.133:0/200942732 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb188010030 con 0x7fb1940b3890 2021-01-03T12:58:45.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.091+0000 7fb190ff9700 1 --2- 172.21.15.133:0/200942732 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb1740553b0 0x7fb174057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.091+0000 7fb1937fe700 1 --2- 172.21.15.133:0/200942732 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb1740553b0 0x7fb174057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.091+0000 7fb190ff9700 1 -- 172.21.15.133:0/200942732 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb18806dc50 con 0x7fb1940b3890 2021-01-03T12:58:45.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.091+0000 7fb1937fe700 1 --2- 172.21.15.133:0/200942732 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb1740553b0 0x7fb174057870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb18400c000 tx=0x7fb184008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:45.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.099+0000 7fb190ff9700 1 -- 172.21.15.133:0/200942732 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb188043ef0 con 0x7fb1940b3890 2021-01-03T12:58:45.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.235+0000 7fb199c52700 1 -- 172.21.15.133:0/200942732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb194057300 con 0x7fb1940b3890 2021-01-03T12:58:45.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.239+0000 7fb190ff9700 1 -- 172.21.15.133:0/200942732 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v34) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb188005930 con 0x7fb1940b3890 2021-01-03T12:58:45.240 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T12:58:45.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.239+0000 7fb199c52700 1 -- 172.21.15.133:0/200942732 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb1740553b0 msgr2=0x7fb174057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.239+0000 7fb199c52700 1 --2- 172.21.15.133:0/200942732 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb1740553b0 0x7fb174057870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb18400c000 tx=0x7fb184008040).stop 2021-01-03T12:58:45.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.239+0000 7fb199c52700 1 -- 172.21.15.133:0/200942732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1940b3890 msgr2=0x7fb194145ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.239+0000 7fb199c52700 1 --2- 172.21.15.133:0/200942732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1940b3890 0x7fb194145ec0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fb1880010d0 tx=0x7fb188007aa0).stop 2021-01-03T12:58:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.239+0000 7fb199c52700 1 -- 172.21.15.133:0/200942732 shutdown_connections 2021-01-03T12:58:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.239+0000 7fb199c52700 1 --2- 172.21.15.133:0/200942732 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb1740553b0 0x7fb174057870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.239+0000 7fb199c52700 1 --2- 172.21.15.133:0/200942732 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb1940b2e80 0x7fb194149610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.239+0000 7fb199c52700 1 --2- 172.21.15.133:0/200942732 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb1940b3f90 0x7fb194147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.239+0000 7fb199c52700 1 --2- 172.21.15.133:0/200942732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1940b3890 0x7fb194145ec0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.239+0000 7fb199c52700 1 -- 172.21.15.133:0/200942732 >> 172.21.15.133:0/200942732 conn(0x7fb19405bdf0 msgr2=0x7fb1940b7480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:45.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.239+0000 7fb199c52700 1 -- 172.21.15.133:0/200942732 shutdown_connections 2021-01-03T12:58:45.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.239+0000 7fb199c52700 1 -- 172.21.15.133:0/200942732 wait complete. 2021-01-03T12:58:45.257 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T12:58:45.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.371+0000 7f23a8d11700 1 Processor -- start 2021-01-03T12:58:45.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.371+0000 7f23a8d11700 1 -- start start 2021-01-03T12:58:45.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.371+0000 7f23a8d11700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f23a41407f0 0x7f23a4142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.371+0000 7f23a8d11700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23a40b0470 0x7f23a405bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.371+0000 7f23a8d11700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a405cf20 con 0x7f23a4140410 2021-01-03T12:58:45.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.371+0000 7f23a8d11700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a40b02d0 con 0x7f23a41407f0 2021-01-03T12:58:45.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.371+0000 7f23a8d11700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a4146390 con 0x7f23a40b0470 2021-01-03T12:58:45.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.371+0000 7f23a2d9d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23a40b0470 0x7f23a405bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.371+0000 7f239bfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f23a41407f0 0x7f23a4142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.371+0000 7f23a2d9d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23a40b0470 0x7f23a405bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:41448/0 (socket says 172.21.15.133:41448) 2021-01-03T12:58:45.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.371+0000 7f23a2d9d700 1 -- 172.21.15.133:0/1032424539 learned_addr learned my addr 172.21.15.133:0/1032424539 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:45.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.371+0000 7f23a2d9d700 1 -- 172.21.15.133:0/1032424539 >> v2:172.21.15.16:3300/0 conn(0x7f23a41407f0 msgr2=0x7f23a4142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:45.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.371+0000 7f23a2d9d700 1 --2- 172.21.15.133:0/1032424539 >> v2:172.21.15.16:3300/0 conn(0x7f23a41407f0 0x7f23a4142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.371+0000 7f23a2d9d700 1 -- 172.21.15.133:0/1032424539 >> v1:172.21.15.16:6789/0 conn(0x7f23a4140410 legacy=0x7f23a4146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.371+0000 7f23a2d9d700 1 -- 172.21.15.133:0/1032424539 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a4146580 con 0x7f23a40b0470 2021-01-03T12:58:45.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.375+0000 7f23a2d9d700 1 --2- 172.21.15.133:0/1032424539 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23a40b0470 0x7f23a405bdf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f239c0032b0 tx=0x7f239c009270).ready entity=mon.2 client_cookie=58165e8a68d9947d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:45.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.375+0000 7f23a1d9b700 1 -- 172.21.15.133:0/1032424539 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f239c009e60 con 0x7f23a40b0470 2021-01-03T12:58:45.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.375+0000 7f23a1d9b700 1 -- 172.21.15.133:0/1032424539 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239c00bc00 con 0x7f23a40b0470 2021-01-03T12:58:45.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.375+0000 7f23a1d9b700 1 -- 172.21.15.133:0/1032424539 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f239c00bd70 con 0x7f23a40b0470 2021-01-03T12:58:45.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.375+0000 7f23a8d11700 1 -- 172.21.15.133:0/1032424539 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23a40b0470 msgr2=0x7f23a405bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.375+0000 7f23a8d11700 1 --2- 172.21.15.133:0/1032424539 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23a40b0470 0x7f23a405bdf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f239c0032b0 tx=0x7f239c009270).stop 2021-01-03T12:58:45.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.375+0000 7f23a8d11700 1 -- 172.21.15.133:0/1032424539 shutdown_connections 2021-01-03T12:58:45.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.375+0000 7f23a8d11700 1 --2- 172.21.15.133:0/1032424539 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23a40b0470 0x7f23a405bdf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.375+0000 7f23a8d11700 1 --2- 172.21.15.133:0/1032424539 >> v2:172.21.15.16:3300/0 conn(0x7f23a41407f0 0x7f23a4142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.375+0000 7f23a8d11700 1 -- 172.21.15.133:0/1032424539 >> 172.21.15.133:0/1032424539 conn(0x7f23a40b95d0 msgr2=0x7f23a40b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:45.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.375+0000 7f23a8d11700 1 -- 172.21.15.133:0/1032424539 shutdown_connections 2021-01-03T12:58:45.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.375+0000 7f23a8d11700 1 -- 172.21.15.133:0/1032424539 wait complete. 2021-01-03T12:58:45.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.375+0000 7f23a8d11700 1 Processor -- start 2021-01-03T12:58:45.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.375+0000 7f23a8d11700 1 -- start start 2021-01-03T12:58:45.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.375+0000 7f23a8d11700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23a40b0470 0x7f23a40b1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a8d11700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23a4140410 0x7f23a4141550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a8d11700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23a41407f0 0x7f23a41431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a8d11700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a40b09a0 con 0x7f23a41407f0 2021-01-03T12:58:45.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a8d11700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a4155df0 con 0x7f23a40b0470 2021-01-03T12:58:45.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a8d11700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a4156090 con 0x7f23a4140410 2021-01-03T12:58:45.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23a40b0470 0x7f23a40b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23a40b0470 0x7f23a40b1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33148/0 (socket says 172.21.15.133:33148) 2021-01-03T12:58:45.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a259c700 1 -- 172.21.15.133:0/1611024411 learned_addr learned my addr 172.21.15.133:0/1611024411 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:45.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a2d9d700 1 --2- 172.21.15.133:0/1611024411 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23a41407f0 0x7f23a41431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f239bfff700 1 --2- 172.21.15.133:0/1611024411 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23a4140410 0x7f23a4141550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a259c700 1 -- 172.21.15.133:0/1611024411 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23a4140410 msgr2=0x7f23a4141550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a259c700 1 --2- 172.21.15.133:0/1611024411 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23a4140410 0x7f23a4141550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a259c700 1 -- 172.21.15.133:0/1611024411 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23a41407f0 msgr2=0x7f23a41431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a259c700 1 --2- 172.21.15.133:0/1611024411 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23a41407f0 0x7f23a41431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a259c700 1 -- 172.21.15.133:0/1611024411 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a40b0bd0 con 0x7f23a40b0470 2021-01-03T12:58:45.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a259c700 1 --2- 172.21.15.133:0/1611024411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23a40b0470 0x7f23a40b1240 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f23a4141160 tx=0x7f238c007c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:45.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f239b7fe700 1 -- 172.21.15.133:0/1611024411 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f238c00e4a0 con 0x7f23a40b0470 2021-01-03T12:58:45.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f239b7fe700 1 -- 172.21.15.133:0/1611024411 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c00e600 con 0x7f23a40b0470 2021-01-03T12:58:45.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a8d11700 1 -- 172.21.15.133:0/1611024411 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a409e5b0 con 0x7f23a40b0470 2021-01-03T12:58:45.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f239b7fe700 1 -- 172.21.15.133:0/1611024411 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f238c00e960 con 0x7f23a40b0470 2021-01-03T12:58:45.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a8d11700 1 -- 172.21.15.133:0/1611024411 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a4141c60 con 0x7f23a40b0470 2021-01-03T12:58:45.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f23a8d11700 1 -- 172.21.15.133:0/1611024411 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a40b0d60 con 0x7f23a40b0470 2021-01-03T12:58:45.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f239b7fe700 1 -- 172.21.15.133:0/1611024411 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f238c010030 con 0x7f23a40b0470 2021-01-03T12:58:45.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f239b7fe700 1 --2- 172.21.15.133:0/1611024411 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f237c055330 0x7f237c0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.379+0000 7f239b7fe700 1 -- 172.21.15.133:0/1611024411 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f238c06de70 con 0x7f23a40b0470 2021-01-03T12:58:45.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.383+0000 7f239bfff700 1 --2- 172.21.15.133:0/1611024411 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f237c055330 0x7f237c0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.383+0000 7f239bfff700 1 --2- 172.21.15.133:0/1611024411 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f237c055330 0x7f237c0577f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f239400b000 tx=0x7f2394006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:45.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.383+0000 7f239b7fe700 1 -- 172.21.15.133:0/1611024411 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f238c044170 con 0x7f23a40b0470 2021-01-03T12:58:45.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.527+0000 7f23a8d11700 1 -- 172.21.15.133:0/1611024411 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f23a4057300 con 0x7f23a40b0470 2021-01-03T12:58:45.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.527+0000 7f239b7fe700 1 -- 172.21.15.133:0/1611024411 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7f238c047790 con 0x7f23a40b0470 2021-01-03T12:58:45.527 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:45.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.527+0000 7f23a8d11700 1 -- 172.21.15.133:0/1611024411 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f237c055330 msgr2=0x7f237c0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.527+0000 7f23a8d11700 1 --2- 172.21.15.133:0/1611024411 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f237c055330 0x7f237c0577f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f239400b000 tx=0x7f2394006dc0).stop 2021-01-03T12:58:45.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.527+0000 7f23a8d11700 1 -- 172.21.15.133:0/1611024411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23a40b0470 msgr2=0x7f23a40b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.527+0000 7f23a8d11700 1 --2- 172.21.15.133:0/1611024411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23a40b0470 0x7f23a40b1240 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f23a4141160 tx=0x7f238c007c20).stop 2021-01-03T12:58:45.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.527+0000 7f23a8d11700 1 -- 172.21.15.133:0/1611024411 shutdown_connections 2021-01-03T12:58:45.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.527+0000 7f23a8d11700 1 --2- 172.21.15.133:0/1611024411 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f237c055330 0x7f237c0577f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.527+0000 7f23a8d11700 1 --2- 172.21.15.133:0/1611024411 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23a41407f0 0x7f23a41431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.527+0000 7f23a8d11700 1 --2- 172.21.15.133:0/1611024411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23a40b0470 0x7f23a40b1240 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.527+0000 7f23a8d11700 1 --2- 172.21.15.133:0/1611024411 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23a4140410 0x7f23a4141550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.527+0000 7f23a8d11700 1 -- 172.21.15.133:0/1611024411 >> 172.21.15.133:0/1611024411 conn(0x7f23a40b95d0 msgr2=0x7f23a405bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:45.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.527+0000 7f23a8d11700 1 -- 172.21.15.133:0/1611024411 shutdown_connections 2021-01-03T12:58:45.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.527+0000 7f23a8d11700 1 -- 172.21.15.133:0/1611024411 wait complete. 2021-01-03T12:58:45.541 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T12:58:45.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.655+0000 7f310ffff700 1 Processor -- start 2021-01-03T12:58:45.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.655+0000 7f310ffff700 1 -- start start 2021-01-03T12:58:45.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f31100b9b60 0x7f31100b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310ffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f31100b4980 0x7f31100b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310ffff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31100605f0 con 0x7f3110146430 2021-01-03T12:58:45.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310ffff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31100aed30 con 0x7f31100b4980 2021-01-03T12:58:45.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3110146fd0 con 0x7f31100b9b60 2021-01-03T12:58:45.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310e7fc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f31100b4980 0x7f31100b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310f7fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3110146430 0x7f31101468c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:32920/0 (socket says 172.21.15.133:32920) 2021-01-03T12:58:45.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310f7fe700 1 -- 172.21.15.133:0/2106448044 learned_addr learned my addr 172.21.15.133:0/2106448044 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:45.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310effd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f31100b9b60 0x7f31100b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310e7fc700 1 -- 172.21.15.133:0/2106448044 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f31100b9b60 msgr2=0x7f31100b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:45.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310e7fc700 1 --2- 172.21.15.133:0/2106448044 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f31100b9b60 0x7f31100b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310e7fc700 1 -- 172.21.15.133:0/2106448044 >> v1:172.21.15.16:6789/0 conn(0x7f3110146430 legacy=0x7f31101468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310e7fc700 1 -- 172.21.15.133:0/2106448044 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31100600b0 con 0x7f31100b4980 2021-01-03T12:58:45.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310e7fc700 1 --2- 172.21.15.133:0/2106448044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31100b4980 0x7f31100b4de0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f30f8002f30 tx=0x7f30f8006dc0).ready entity=mon.0 client_cookie=b1d5633b9978e54d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:45.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310dffb700 1 -- 172.21.15.133:0/2106448044 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f8009760 con 0x7f31100b4980 2021-01-03T12:58:45.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310dffb700 1 -- 172.21.15.133:0/2106448044 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f80098c0 con 0x7f31100b4980 2021-01-03T12:58:45.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310dffb700 1 -- 172.21.15.133:0/2106448044 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f8009c20 con 0x7f31100b4980 2021-01-03T12:58:45.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310ffff700 1 -- 172.21.15.133:0/2106448044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31100b4980 msgr2=0x7f31100b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310ffff700 1 --2- 172.21.15.133:0/2106448044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31100b4980 0x7f31100b4de0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f30f8002f30 tx=0x7f30f8006dc0).stop 2021-01-03T12:58:45.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310ffff700 1 -- 172.21.15.133:0/2106448044 shutdown_connections 2021-01-03T12:58:45.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310ffff700 1 --2- 172.21.15.133:0/2106448044 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f31100b9b60 0x7f31100b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310ffff700 1 --2- 172.21.15.133:0/2106448044 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31100b4980 0x7f31100b4de0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310ffff700 1 -- 172.21.15.133:0/2106448044 >> 172.21.15.133:0/2106448044 conn(0x7f31100b69e0 msgr2=0x7f31100b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:45.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310ffff700 1 -- 172.21.15.133:0/2106448044 shutdown_connections 2021-01-03T12:58:45.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.659+0000 7f310ffff700 1 -- 172.21.15.133:0/2106448044 wait complete. 2021-01-03T12:58:45.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.663+0000 7f310ffff700 1 Processor -- start 2021-01-03T12:58:45.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.663+0000 7f310ffff700 1 -- start start 2021-01-03T12:58:45.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.663+0000 7f310ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31100b4980 0x7f311009eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.663+0000 7f310ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f31100b9b60 0x7f311013f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.663+0000 7f310ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3110146430 0x7f311013fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.663+0000 7f310ffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31101434c0 con 0x7f31100b4980 2021-01-03T12:58:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.663+0000 7f310ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31101448e0 con 0x7f3110146430 2021-01-03T12:58:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.663+0000 7f310ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3110140a10 con 0x7f31100b9b60 2021-01-03T12:58:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.663+0000 7f310f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3110146430 0x7f311013fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.663+0000 7f310e7fc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f31100b9b60 0x7f311013f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f310f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3110146430 0x7f311013fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33166/0 (socket says 172.21.15.133:33166) 2021-01-03T12:58:45.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f310e7fc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f31100b9b60 0x7f311013f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:41466/0 (socket says 172.21.15.133:41466) 2021-01-03T12:58:45.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f310f7fe700 1 -- 172.21.15.133:0/896927277 learned_addr learned my addr 172.21.15.133:0/896927277 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:45.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f310effd700 1 --2- 172.21.15.133:0/896927277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31100b4980 0x7f311009eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f310f7fe700 1 -- 172.21.15.133:0/896927277 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f31100b9b60 msgr2=0x7f311013f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f310f7fe700 1 --2- 172.21.15.133:0/896927277 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f31100b9b60 0x7f311013f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f310f7fe700 1 -- 172.21.15.133:0/896927277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31100b4980 msgr2=0x7f311009eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f310f7fe700 1 --2- 172.21.15.133:0/896927277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31100b4980 0x7f311009eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f310f7fe700 1 -- 172.21.15.133:0/896927277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3110140cb0 con 0x7f3110146430 2021-01-03T12:58:45.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f310e7fc700 1 --2- 172.21.15.133:0/896927277 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f31100b9b60 0x7f311013f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:58:45.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f310f7fe700 1 --2- 172.21.15.133:0/896927277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3110146430 0x7f311013fd90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f31100af260 tx=0x7f310800cb40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:45.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f3107fff700 1 -- 172.21.15.133:0/896927277 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3108005b70 con 0x7f3110146430 2021-01-03T12:58:45.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f3107fff700 1 -- 172.21.15.133:0/896927277 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3108005cd0 con 0x7f3110146430 2021-01-03T12:58:45.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f310ffff700 1 -- 172.21.15.133:0/896927277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3110140f50 con 0x7f3110146430 2021-01-03T12:58:45.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f3107fff700 1 -- 172.21.15.133:0/896927277 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3108007300 con 0x7f3110146430 2021-01-03T12:58:45.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f310ffff700 1 -- 172.21.15.133:0/896927277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3110143bf0 con 0x7f3110146430 2021-01-03T12:58:45.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f310ffff700 1 -- 172.21.15.133:0/896927277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31101410e0 con 0x7f3110146430 2021-01-03T12:58:45.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.667+0000 7f3107fff700 1 -- 172.21.15.133:0/896927277 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3108010030 con 0x7f3110146430 2021-01-03T12:58:45.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.671+0000 7f3107fff700 1 --2- 172.21.15.133:0/896927277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30e8055440 0x7f30e8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.671+0000 7f3107fff700 1 -- 172.21.15.133:0/896927277 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f310806de40 con 0x7f3110146430 2021-01-03T12:58:45.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.671+0000 7f310effd700 1 --2- 172.21.15.133:0/896927277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30e8055440 0x7f30e8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.671+0000 7f310effd700 1 --2- 172.21.15.133:0/896927277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30e8055440 0x7f30e8057900 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f310000b000 tx=0x7f3100006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:45.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.675+0000 7f3107fff700 1 -- 172.21.15.133:0/896927277 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f31080440a0 con 0x7f3110146430 2021-01-03T12:58:45.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.815+0000 7f310ffff700 1 -- 172.21.15.133:0/896927277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3110144a70 con 0x7f3110146430 2021-01-03T12:58:45.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.815+0000 7f3107fff700 1 -- 172.21.15.133:0/896927277 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+10 (secure 0 0 0) 0x7f31080476c0 con 0x7f3110146430 2021-01-03T12:58:45.818 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:45.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.819+0000 7f310ffff700 1 -- 172.21.15.133:0/896927277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30e8055440 msgr2=0x7f30e8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.819+0000 7f310ffff700 1 --2- 172.21.15.133:0/896927277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30e8055440 0x7f30e8057900 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f310000b000 tx=0x7f3100006dc0).stop 2021-01-03T12:58:45.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.819+0000 7f310ffff700 1 -- 172.21.15.133:0/896927277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3110146430 msgr2=0x7f311013fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.819+0000 7f310ffff700 1 --2- 172.21.15.133:0/896927277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3110146430 0x7f311013fd90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f31100af260 tx=0x7f310800cb40).stop 2021-01-03T12:58:45.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.819+0000 7f310ffff700 1 -- 172.21.15.133:0/896927277 shutdown_connections 2021-01-03T12:58:45.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.819+0000 7f310ffff700 1 --2- 172.21.15.133:0/896927277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30e8055440 0x7f30e8057900 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.819+0000 7f310ffff700 1 --2- 172.21.15.133:0/896927277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31100b4980 0x7f311009eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.819+0000 7f310ffff700 1 --2- 172.21.15.133:0/896927277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3110146430 0x7f311013fd90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.819+0000 7f310ffff700 1 --2- 172.21.15.133:0/896927277 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f31100b9b60 0x7f311013f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.819+0000 7f310ffff700 1 -- 172.21.15.133:0/896927277 >> 172.21.15.133:0/896927277 conn(0x7f31100b69e0 msgr2=0x7f31101458a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:45.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.819+0000 7f310ffff700 1 -- 172.21.15.133:0/896927277 shutdown_connections 2021-01-03T12:58:45.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.819+0000 7f310ffff700 1 -- 172.21.15.133:0/896927277 wait complete. 2021-01-03T12:58:45.831 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T12:58:45.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.943+0000 7f1be5788700 1 Processor -- start 2021-01-03T12:58:45.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.943+0000 7f1be5788700 1 -- start start 2021-01-03T12:58:45.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.943+0000 7f1be5788700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1be00ae900 0x7f1be00aed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.943+0000 7f1be5788700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be00aaa10 con 0x7f1be00afa80 2021-01-03T12:58:45.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.943+0000 7f1be5788700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be00b0ab0 con 0x7f1be0060890 2021-01-03T12:58:45.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.943+0000 7f1be5788700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be00ab280 con 0x7f1be00ae900 2021-01-03T12:58:45.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.943+0000 7f1bdffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1be0060890 0x7f1be00abcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54202/0 (socket says 172.21.15.133:54202) 2021-01-03T12:58:45.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.943+0000 7f1bdffff700 1 -- 172.21.15.133:0/759776183 learned_addr learned my addr 172.21.15.133:0/759776183 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:45.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.943+0000 7f1be4f87700 1 --2- 172.21.15.133:0/759776183 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1be00ae900 0x7f1be00aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 -- 172.21.15.133:0/759776183 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358593969 0 0) 0x7f1be00b0ab0 con 0x7f1be0060890 2021-01-03T12:58:45.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 -- 172.21.15.133:0/759776183 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bc0003230 con 0x7f1be0060890 2021-01-03T12:58:45.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 -- 172.21.15.133:0/759776183 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923626970 0 0) 0x7f1be00aaa10 con 0x7f1be00afa80 2021-01-03T12:58:45.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 -- 172.21.15.133:0/759776183 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1be00b0ab0 con 0x7f1be00afa80 2021-01-03T12:58:45.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 -- 172.21.15.133:0/759776183 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1441759633 0 0) 0x7f1bc0003230 con 0x7f1be0060890 2021-01-03T12:58:45.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 -- 172.21.15.133:0/759776183 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1be00ae900 msgr2=0x7f1be00aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:45.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 --2- 172.21.15.133:0/759776183 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1be00ae900 0x7f1be00aed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 -- 172.21.15.133:0/759776183 >> v1:172.21.15.16:6789/0 conn(0x7f1be00afa80 legacy=0x7f1be00b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 -- 172.21.15.133:0/759776183 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be00b1240 con 0x7f1be0060890 2021-01-03T12:58:45.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 -- 172.21.15.133:0/759776183 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f1bd00016d0 con 0x7f1be0060890 2021-01-03T12:58:45.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 -- 172.21.15.133:0/759776183 >> v1:172.21.15.133:6789/0 conn(0x7f1be0060890 legacy=0x7f1be00abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 --2- 172.21.15.133:0/759776183 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1be00ae900 0x7f1bc00038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 --2- 172.21.15.133:0/759776183 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bc0003da0 0x7f1bc00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 --2- 172.21.15.133:0/759776183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc00049c0 0x7f1bc0004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 -- 172.21.15.133:0/759776183 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be00ab280 con 0x7f1bc0003da0 2021-01-03T12:58:45.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 -- 172.21.15.133:0/759776183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc0005330 con 0x7f1bc00049c0 2021-01-03T12:58:45.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 -- 172.21.15.133:0/759776183 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc000b750 con 0x7f1be00ae900 2021-01-03T12:58:45.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1be4f87700 1 --2- 172.21.15.133:0/759776183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc00049c0 0x7f1bc0004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdffff700 1 --2- 172.21.15.133:0/759776183 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1be00ae900 0x7f1bc00038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdf7fe700 1 --2- 172.21.15.133:0/759776183 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bc0003da0 0x7f1bc00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1be4f87700 1 -- 172.21.15.133:0/759776183 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1be00ae900 msgr2=0x7f1bc00038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:45.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1be4f87700 1 --2- 172.21.15.133:0/759776183 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1be00ae900 0x7f1bc00038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1be4f87700 1 -- 172.21.15.133:0/759776183 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bc0003da0 msgr2=0x7f1bc00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:45.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1be4f87700 1 --2- 172.21.15.133:0/759776183 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bc0003da0 0x7f1bc00044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1be4f87700 1 -- 172.21.15.133:0/759776183 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc0003230 con 0x7f1bc00049c0 2021-01-03T12:58:45.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdffff700 1 --2- 172.21.15.133:0/759776183 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1be00ae900 0x7f1bc00038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:45.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1be4f87700 1 --2- 172.21.15.133:0/759776183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc00049c0 0x7f1bc0004e40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f1bd800c000 tx=0x7f1bd8008040).ready entity=mon.1 client_cookie=1f4969e49c692cf1 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:45.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 -- 172.21.15.133:0/759776183 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bd800e9d0 con 0x7f1bc00049c0 2021-01-03T12:58:45.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 -- 172.21.15.133:0/759776183 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd800eb30 con 0x7f1bc00049c0 2021-01-03T12:58:45.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1bdeffd700 1 -- 172.21.15.133:0/759776183 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bd800ee90 con 0x7f1bc00049c0 2021-01-03T12:58:45.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1be5788700 1 -- 172.21.15.133:0/759776183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc00049c0 msgr2=0x7f1bc0004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1be5788700 1 --2- 172.21.15.133:0/759776183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc00049c0 0x7f1bc0004e40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f1bd800c000 tx=0x7f1bd8008040).stop 2021-01-03T12:58:45.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1be4f87700 1 -- 172.21.15.133:0/759776183 reap_dead start 2021-01-03T12:58:45.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1be5788700 1 -- 172.21.15.133:0/759776183 shutdown_connections 2021-01-03T12:58:45.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1be5788700 1 -- 172.21.15.133:0/759776183 >> 172.21.15.133:0/759776183 conn(0x7f1be005bdf0 msgr2=0x7f1be005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:45.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1be5788700 1 -- 172.21.15.133:0/759776183 shutdown_connections 2021-01-03T12:58:45.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.947+0000 7f1be5788700 1 -- 172.21.15.133:0/759776183 wait complete. 2021-01-03T12:58:45.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1be5788700 1 Processor -- start 2021-01-03T12:58:45.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1be5788700 1 -- start start 2021-01-03T12:58:45.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1be5788700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1be0065cc0 0x7f1be0063540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1be5788700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be0148b40 0x7f1be0141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1be5788700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1be0141560 0x7f1be01419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1be5788700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0141ed0 con 0x7f1be0065cc0 2021-01-03T12:58:45.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1be5788700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0146f00 con 0x7f1be0148b40 2021-01-03T12:58:45.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1be5788700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be01486a0 con 0x7f1be0141560 2021-01-03T12:58:45.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1bdf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be0148b40 0x7f1be0141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1bdf7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be0148b40 0x7f1be0141070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33184/0 (socket says 172.21.15.133:33184) 2021-01-03T12:58:45.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1bdf7fe700 1 -- 172.21.15.133:0/87224105 learned_addr learned my addr 172.21.15.133:0/87224105 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:45.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1bdffff700 1 --2- 172.21.15.133:0/87224105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1be0065cc0 0x7f1be0063540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1be4f87700 1 --2- 172.21.15.133:0/87224105 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1be0141560 0x7f1be01419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1bdf7fe700 1 -- 172.21.15.133:0/87224105 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1be0141560 msgr2=0x7f1be01419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1bdf7fe700 1 --2- 172.21.15.133:0/87224105 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1be0141560 0x7f1be01419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1bdf7fe700 1 -- 172.21.15.133:0/87224105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1be0065cc0 msgr2=0x7f1be0063540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:45.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1bdf7fe700 1 --2- 172.21.15.133:0/87224105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1be0065cc0 0x7f1be0063540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:45.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1bdf7fe700 1 -- 172.21.15.133:0/87224105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be0067130 con 0x7f1be0148b40 2021-01-03T12:58:45.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1be4f87700 1 --2- 172.21.15.133:0/87224105 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1be0141560 0x7f1be01419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:45.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1bdf7fe700 1 --2- 172.21.15.133:0/87224105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be0148b40 0x7f1be0141070 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f1bc800b000 tx=0x7f1bc8009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:45.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1bdd7fa700 1 -- 172.21.15.133:0/87224105 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bc8003510 con 0x7f1be0148b40 2021-01-03T12:58:45.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1bdd7fa700 1 -- 172.21.15.133:0/87224105 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc8010040 con 0x7f1be0148b40 2021-01-03T12:58:45.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1bdd7fa700 1 -- 172.21.15.133:0/87224105 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bc8001890 con 0x7f1be0148b40 2021-01-03T12:58:45.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1be5788700 1 -- 172.21.15.133:0/87224105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be01471a0 con 0x7f1be0148b40 2021-01-03T12:58:45.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.951+0000 7f1be5788700 1 -- 172.21.15.133:0/87224105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be0148fc0 con 0x7f1be0148b40 2021-01-03T12:58:45.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.955+0000 7f1be5788700 1 -- 172.21.15.133:0/87224105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be0146d40 con 0x7f1be0148b40 2021-01-03T12:58:45.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.955+0000 7f1bdd7fa700 1 -- 172.21.15.133:0/87224105 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1bc80019f0 con 0x7f1be0148b40 2021-01-03T12:58:45.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.955+0000 7f1bdd7fa700 1 --2- 172.21.15.133:0/87224105 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bc4055440 0x7f1bc4057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:45.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.955+0000 7f1bdd7fa700 1 -- 172.21.15.133:0/87224105 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1bc806e340 con 0x7f1be0148b40 2021-01-03T12:58:45.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.955+0000 7f1bdffff700 1 --2- 172.21.15.133:0/87224105 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bc4055440 0x7f1bc4057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:45.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.955+0000 7f1bdffff700 1 --2- 172.21.15.133:0/87224105 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bc4055440 0x7f1bc4057900 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f1bd000d000 tx=0x7f1bd0007040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:45.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:45.959+0000 7f1bdd7fa700 1 -- 172.21.15.133:0/87224105 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1bc8044640 con 0x7f1be0148b40 2021-01-03T12:58:46.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.099+0000 7f1be5788700 1 -- 172.21.15.133:0/87224105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1be0148860 con 0x7f1be0148b40 2021-01-03T12:58:46.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.103+0000 7f1bdd7fa700 1 -- 172.21.15.133:0/87224105 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1bc8047c60 con 0x7f1be0148b40 2021-01-03T12:58:46.103 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:58:46.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.103+0000 7f1be5788700 1 -- 172.21.15.133:0/87224105 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bc4055440 msgr2=0x7f1bc4057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.103+0000 7f1be5788700 1 --2- 172.21.15.133:0/87224105 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bc4055440 0x7f1bc4057900 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f1bd000d000 tx=0x7f1bd0007040).stop 2021-01-03T12:58:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.103+0000 7f1be5788700 1 -- 172.21.15.133:0/87224105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be0148b40 msgr2=0x7f1be0141070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.103+0000 7f1be5788700 1 --2- 172.21.15.133:0/87224105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be0148b40 0x7f1be0141070 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f1bc800b000 tx=0x7f1bc8009040).stop 2021-01-03T12:58:46.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.103+0000 7f1be5788700 1 -- 172.21.15.133:0/87224105 shutdown_connections 2021-01-03T12:58:46.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.103+0000 7f1be5788700 1 --2- 172.21.15.133:0/87224105 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bc4055440 0x7f1bc4057900 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:46.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.103+0000 7f1be5788700 1 --2- 172.21.15.133:0/87224105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1be0065cc0 0x7f1be0063540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:46.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.103+0000 7f1be5788700 1 --2- 172.21.15.133:0/87224105 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1be0141560 0x7f1be01419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:46.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.103+0000 7f1be5788700 1 --2- 172.21.15.133:0/87224105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1be0148b40 0x7f1be0141070 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:46.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.103+0000 7f1be5788700 1 -- 172.21.15.133:0/87224105 >> 172.21.15.133:0/87224105 conn(0x7f1be005bdf0 msgr2=0x7f1be0099ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:46.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.103+0000 7f1be5788700 1 -- 172.21.15.133:0/87224105 shutdown_connections 2021-01-03T12:58:46.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.103+0000 7f1be5788700 1 -- 172.21.15.133:0/87224105 wait complete. 2021-01-03T12:58:46.123 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T12:58:46.124 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T12:58:46.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.231+0000 7fb4569df700 1 Processor -- start 2021-01-03T12:58:46.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.231+0000 7fb4569df700 1 -- start start 2021-01-03T12:58:46.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.231+0000 7fb4569df700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb450060510 0x7fb45005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:46.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.231+0000 7fb4569df700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb45005fd10 0x7fb4500b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:46.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.231+0000 7fb4569df700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45005bf00 con 0x7fb4500b4c20 2021-01-03T12:58:46.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.231+0000 7fb4569df700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45005c1a0 con 0x7fb45005fd10 2021-01-03T12:58:46.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.231+0000 7fb4569df700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45005c440 con 0x7fb450060510 2021-01-03T12:58:46.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.231+0000 7fb4561de700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb45005fd10 0x7fb4500b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:46.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.231+0000 7fb4559dd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb4500b4c20 0x7fb4500b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:32950/0 (socket says 172.21.15.133:32950) 2021-01-03T12:58:46.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.231+0000 7fb4559dd700 1 -- 172.21.15.133:0/258220201 learned_addr learned my addr 172.21.15.133:0/258220201 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:58:46.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.231+0000 7fb4551dc700 1 --2- 172.21.15.133:0/258220201 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb450060510 0x7fb45005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:46.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4549db700 1 -- 172.21.15.133:0/258220201 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451968038 0 0) 0x7fb45005bf00 con 0x7fb4500b4c20 2021-01-03T12:58:46.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4549db700 1 -- 172.21.15.133:0/258220201 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb43c003230 con 0x7fb4500b4c20 2021-01-03T12:58:46.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4561de700 1 -- 172.21.15.133:0/258220201 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb450060510 msgr2=0x7fb45005c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:58:46.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4561de700 1 --2- 172.21.15.133:0/258220201 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb450060510 0x7fb45005c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:46.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4561de700 1 -- 172.21.15.133:0/258220201 >> v1:172.21.15.16:6789/0 conn(0x7fb4500b4c20 legacy=0x7fb4500b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:46.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4561de700 1 -- 172.21.15.133:0/258220201 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4500b6ad0 con 0x7fb45005fd10 2021-01-03T12:58:46.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4561de700 1 --2- 172.21.15.133:0/258220201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb45005fd10 0x7fb4500b65e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fb4480032b0 tx=0x7fb4480091a0).ready entity=mon.0 client_cookie=406345da697207a8 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:46.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4549db700 1 -- 172.21.15.133:0/258220201 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb44800b940 con 0x7fb45005fd10 2021-01-03T12:58:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4549db700 1 -- 172.21.15.133:0/258220201 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44800baa0 con 0x7fb45005fd10 2021-01-03T12:58:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4549db700 1 -- 172.21.15.133:0/258220201 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb44800bc10 con 0x7fb45005fd10 2021-01-03T12:58:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4569df700 1 -- 172.21.15.133:0/258220201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb45005fd10 msgr2=0x7fb4500b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4569df700 1 --2- 172.21.15.133:0/258220201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb45005fd10 0x7fb4500b65e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fb4480032b0 tx=0x7fb4480091a0).stop 2021-01-03T12:58:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4569df700 1 -- 172.21.15.133:0/258220201 shutdown_connections 2021-01-03T12:58:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4569df700 1 --2- 172.21.15.133:0/258220201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb45005fd10 0x7fb4500b65e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4569df700 1 --2- 172.21.15.133:0/258220201 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb450060510 0x7fb45005c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4569df700 1 -- 172.21.15.133:0/258220201 >> 172.21.15.133:0/258220201 conn(0x7fb4500b9f00 msgr2=0x7fb4500b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:46.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4569df700 1 -- 172.21.15.133:0/258220201 shutdown_connections 2021-01-03T12:58:46.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4569df700 1 -- 172.21.15.133:0/258220201 wait complete. 2021-01-03T12:58:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4569df700 1 Processor -- start 2021-01-03T12:58:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4569df700 1 -- start start 2021-01-03T12:58:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4569df700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb45005fd10 0x7fb45009e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4569df700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb450060510 0x7fb450151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4569df700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4500b4c20 0x7fb450152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:46.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4569df700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb450151990 con 0x7fb450060510 2021-01-03T12:58:46.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4569df700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb450146cd0 con 0x7fb45005fd10 2021-01-03T12:58:46.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.235+0000 7fb4569df700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb450149bc0 con 0x7fb4500b4c20 2021-01-03T12:58:46.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb4559dd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb45005fd10 0x7fb45009e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:46.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb4559dd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb45005fd10 0x7fb45009e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33196/0 (socket says 172.21.15.133:33196) 2021-01-03T12:58:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb4559dd700 1 -- 172.21.15.133:0/1724671362 learned_addr learned my addr 172.21.15.133:0/1724671362 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:58:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb4561de700 1 --2- 172.21.15.133:0/1724671362 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4500b4c20 0x7fb450152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb4551dc700 1 --2- 172.21.15.133:0/1724671362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb450060510 0x7fb450151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb4559dd700 1 -- 172.21.15.133:0/1724671362 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4500b4c20 msgr2=0x7fb450152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb4559dd700 1 --2- 172.21.15.133:0/1724671362 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4500b4c20 0x7fb450152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb4559dd700 1 -- 172.21.15.133:0/1724671362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb450060510 msgr2=0x7fb450151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb4559dd700 1 --2- 172.21.15.133:0/1724671362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb450060510 0x7fb450151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb4559dd700 1 -- 172.21.15.133:0/1724671362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb450149df0 con 0x7fb45005fd10 2021-01-03T12:58:46.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb4561de700 1 --2- 172.21.15.133:0/1724671362 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4500b4c20 0x7fb450152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:58:46.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb4559dd700 1 --2- 172.21.15.133:0/1724671362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb45005fd10 0x7fb45009e640 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fb4400010d0 tx=0x7fb440007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:46.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb44effd700 1 -- 172.21.15.133:0/1724671362 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4400072e0 con 0x7fb45005fd10 2021-01-03T12:58:46.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb44effd700 1 -- 172.21.15.133:0/1724671362 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb440007440 con 0x7fb45005fd10 2021-01-03T12:58:46.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb4569df700 1 -- 172.21.15.133:0/1724671362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45014a090 con 0x7fb45005fd10 2021-01-03T12:58:46.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb44effd700 1 -- 172.21.15.133:0/1724671362 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4400057d0 con 0x7fb45005fd10 2021-01-03T12:58:46.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb4569df700 1 -- 172.21.15.133:0/1724671362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45009f1d0 con 0x7fb45005fd10 2021-01-03T12:58:46.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb4569df700 1 -- 172.21.15.133:0/1724671362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4501496b0 con 0x7fb45005fd10 2021-01-03T12:58:46.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb44effd700 1 -- 172.21.15.133:0/1724671362 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb440010070 con 0x7fb45005fd10 2021-01-03T12:58:46.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb44effd700 1 --2- 172.21.15.133:0/1724671362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb430055440 0x7fb430057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:58:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb44effd700 1 -- 172.21.15.133:0/1724671362 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb44006d610 con 0x7fb45005fd10 2021-01-03T12:58:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.239+0000 7fb4551dc700 1 --2- 172.21.15.133:0/1724671362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb430055440 0x7fb430057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:58:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.243+0000 7fb4551dc700 1 --2- 172.21.15.133:0/1724671362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb430055440 0x7fb430057900 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fb44400b000 tx=0x7fb444006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:58:46.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.251+0000 7fb44effd700 1 -- 172.21.15.133:0/1724671362 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb440043910 con 0x7fb45005fd10 2021-01-03T12:58:46.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.431+0000 7fb4569df700 1 -- 172.21.15.133:0/1724671362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb450152890 con 0x7fb45005fd10 2021-01-03T12:58:46.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.435+0000 7fb44effd700 1 -- 172.21.15.133:0/1724671362 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2494 (secure 0 0 0) 0x7fb440046f30 con 0x7fb45005fd10 2021-01-03T12:58:46.435 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:58:46.436 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4628,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2847550436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2847550436},{"type":"v1","addr":"172.21.15.16:6833","nonce":2847550436}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1321910656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1321910656},{"type":"v1","addr":"172.21.15.133:6835","nonce":1321910656}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T12:58:41.558757+0000","modified":"2021-01-03T12:58:42.561830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1532041867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1532041867},{"type":"v1","addr":"172.21.15.133:6837","nonce":1532041867}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-01-03T12:58:46.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.435+0000 7fb4569df700 1 -- 172.21.15.133:0/1724671362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb430055440 msgr2=0x7fb430057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:46.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.435+0000 7fb4569df700 1 --2- 172.21.15.133:0/1724671362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb430055440 0x7fb430057900 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fb44400b000 tx=0x7fb444006dc0).stop 2021-01-03T12:58:46.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.435+0000 7fb4569df700 1 -- 172.21.15.133:0/1724671362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb45005fd10 msgr2=0x7fb45009e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:58:46.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.435+0000 7fb4569df700 1 --2- 172.21.15.133:0/1724671362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb45005fd10 0x7fb45009e640 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fb4400010d0 tx=0x7fb440007aa0).stop 2021-01-03T12:58:46.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.435+0000 7fb4569df700 1 -- 172.21.15.133:0/1724671362 shutdown_connections 2021-01-03T12:58:46.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.435+0000 7fb4569df700 1 --2- 172.21.15.133:0/1724671362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb430055440 0x7fb430057900 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:46.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.435+0000 7fb4569df700 1 --2- 172.21.15.133:0/1724671362 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4500b4c20 0x7fb450152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:46.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.435+0000 7fb4569df700 1 --2- 172.21.15.133:0/1724671362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb45005fd10 0x7fb45009e640 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:46.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.435+0000 7fb4569df700 1 --2- 172.21.15.133:0/1724671362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb450060510 0x7fb450151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:58:46.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.435+0000 7fb4569df700 1 -- 172.21.15.133:0/1724671362 >> 172.21.15.133:0/1724671362 conn(0x7fb4500b9f00 msgr2=0x7fb45013eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:58:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.435+0000 7fb4569df700 1 -- 172.21.15.133:0/1724671362 shutdown_connections 2021-01-03T12:58:46.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:58:46.435+0000 7fb4569df700 1 -- 172.21.15.133:0/1724671362 wait complete. 2021-01-03T12:58:46.443 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 10 2021-01-03T12:58:46.749 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T12:58:41.558757+0000', 'modified': '2021-01-03T12:58:42.561830+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4888}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4888': {'gid': 4888, 'name': 'a', 'rank': 0, 'incarnation': 9, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/1532041867', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 1532041867}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 1532041867}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T12:58:46.750 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T12:58:46.750 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-01-03T12:58:46.880 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":4888,"want_state":"up:active","state":"up:active","rank_uptime":5.3081128050000004,"mdsmap_epoch":10,"osdmap_epoch":34,"osdmap_epoch_barrier":33,"uptime":12.540085755} 2021-01-03T12:58:46.880 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 4888, "mdsmap_epoch": 10, "osdmap_epoch": 34, "osdmap_epoch_barrier": 33, "rank_uptime": 5.308112805, "state": "up:active", "uptime": 12.540085755, "want_state": "up:active", "whoami": 0 } 2021-01-03T12:58:46.881 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T12:58:46.881 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-01-03T12:58:46.882 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi007.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-01-03T12:58:46.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:46.883 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:58:46.890 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T12:58:46.948 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T12:58:46.948 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T12:58:47.007 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T12:58:47.008 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T12:58:47.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:47.010 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T12:58:47.054 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T12:58:47.055 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:58:47.099 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T12:58:47.114 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T12:58:47.114 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T12:58:47.172 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T12:58:47.173 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T12:58:47.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:47.174 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T12:58:47.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2021-01-03T12:58:47.175+0000 7f0490d6c0c0 -1 init, newargv = 0x55fa5514a2e0 newargc=9ceph-fuse[11646]: starting ceph client 2021-01-03T12:58:47.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr: 2021-01-03T12:58:47.190 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[11646]: starting fuse 2021-01-03T12:58:48.286 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T12:58:48.302 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T12:58:48.303 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T12:58:48.363 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T12:58:48.365 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T12:58:48.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:48.366 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T12:58:48.411 INFO:teuthology.orchestra.run.smithi007.stdout:50 2021-01-03T12:58:48.412 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T12:58:48.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:48.413 DEBUG:teuthology.orchestra.run.smithi007:> sudo python3 -c ' 2021-01-03T12:58:48.414 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2021-01-03T12:58:48.415 DEBUG:teuthology.orchestra.run.smithi007:> import re 2021-01-03T12:58:48.416 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T12:58:48.416 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2021-01-03T12:58:48.417 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T12:58:48.417 DEBUG:teuthology.orchestra.run.smithi007:> def find_socket(client_name): 2021-01-03T12:58:48.417 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-01-03T12:58:48.418 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2021-01-03T12:58:48.418 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T12:58:48.419 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2021-01-03T12:58:48.419 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2021-01-03T12:58:48.420 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2021-01-03T12:58:48.420 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2021-01-03T12:58:48.420 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T12:58:48.421 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2021-01-03T12:58:48.421 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T12:58:48.422 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T12:58:48.422 DEBUG:teuthology.orchestra.run.smithi007:> return f 2021-01-03T12:58:48.423 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T12:58:48.423 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T12:58:48.423 DEBUG:teuthology.orchestra.run.smithi007:> print(find_socket("client.0")) 2021-01-03T12:58:48.424 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T12:58:48.501 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.11646.asok 2021-01-03T12:58:48.506 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.11646.asok 2021-01-03T12:58:48.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:48.507 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.11646.asok status 2021-01-03T12:58:48.607 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2021-01-03T12:58:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2021-01-03T12:58:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T12:58:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T12:58:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2021-01-03T12:58:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2021-01-03T12:58:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-01-03T12:58:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "11646", 2021-01-03T12:58:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2021-01-03T12:58:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T12:58:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2021-01-03T12:58:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2021-01-03T12:58:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5049, 2021-01-03T12:58:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2021-01-03T12:58:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2021-01-03T12:58:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2021-01-03T12:58:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 5049 2021-01-03T12:58:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T12:58:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T12:58:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T12:58:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T12:58:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2132541087 2021-01-03T12:58:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: } 2021-01-03T12:58:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T12:58:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T12:58:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T12:58:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T12:58:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2132541087 2021-01-03T12:58:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T12:58:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.5049 172.21.15.7:0/2132541087", 2021-01-03T12:58:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "172.21.15.7:0/2132541087", 2021-01-03T12:58:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2021-01-03T12:58:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 10, 2021-01-03T12:58:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 34, 2021-01-03T12:58:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2021-01-03T12:58:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "blacklisted": false, 2021-01-03T12:58:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2021-01-03T12:58:48.614 INFO:teuthology.orchestra.run.smithi007.stdout:} 2021-01-03T12:58:48.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:48.617 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T12:58:48.617 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:58:48.624 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T12:58:48.625 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T12:58:48.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:48.626 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:58:48.685 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_min_caps_per_client 2021-01-03T12:58:48.802 INFO:teuthology.orchestra.run.smithi133.stdout:{"mds_min_caps_per_client":"100"} 2021-01-03T12:58:48.802 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_min_caps_per_client": "100" } 2021-01-03T12:58:48.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:58:48.803 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T12:58:48.804 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:58:48.811 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T12:58:48.812 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T12:58:48.813 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-01-03T12:58:48.814 DEBUG:teuthology.orchestra.run.smithi007:> import sys 2021-01-03T12:58:48.814 DEBUG:teuthology.orchestra.run.smithi007:> import time 2021-01-03T12:58:48.814 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T12:58:48.815 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T12:58:48.815 DEBUG:teuthology.orchestra.run.smithi007:> n = 1000 2021-01-03T12:58:48.815 DEBUG:teuthology.orchestra.run.smithi007:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-01-03T12:58:48.816 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T12:58:48.816 DEBUG:teuthology.orchestra.run.smithi007:> if not os.path.exists(os.path.dirname(abs_path)): 2021-01-03T12:58:48.817 DEBUG:teuthology.orchestra.run.smithi007:> os.makedirs(os.path.dirname(abs_path)) 2021-01-03T12:58:48.817 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T12:58:48.817 DEBUG:teuthology.orchestra.run.smithi007:> for i in range(0, n): 2021-01-03T12:58:48.818 DEBUG:teuthology.orchestra.run.smithi007:> fname = "{0}_{1}".format(abs_path, i) 2021-01-03T12:58:48.818 DEBUG:teuthology.orchestra.run.smithi007:> with open(fname, '"'"'w'"'"') as f: 2021-01-03T12:58:48.818 DEBUG:teuthology.orchestra.run.smithi007:> f.write('"'"'content'"'"') 2021-01-03T12:58:48.819 DEBUG:teuthology.orchestra.run.smithi007:> if True: 2021-01-03T12:58:48.819 DEBUG:teuthology.orchestra.run.smithi007:> f.flush() 2021-01-03T12:58:48.820 DEBUG:teuthology.orchestra.run.smithi007:> os.fsync(f.fileno()) 2021-01-03T12:58:48.820 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T12:59:01.540 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T12:59:01.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2ddb26c700 1 Processor -- start 2021-01-03T12:59:01.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2ddb26c700 1 -- start start 2021-01-03T12:59:01.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2ddb26c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2dd405cc10 0x7f2dd41437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2ddb26c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dd40b02d0 0x7f2dd4146a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2ddb26c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd405c510 con 0x7f2dd405c130 2021-01-03T12:59:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2ddb26c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd40b0780 con 0x7f2dd405cc10 2021-01-03T12:59:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2ddb26c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd40b5c10 con 0x7f2dd40b02d0 2021-01-03T12:59:01.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2dd9008700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2dd405c130 0x7f2dd4146370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54242/0 (socket says 172.21.15.133:54242) 2021-01-03T12:59:01.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2dd9008700 1 -- 172.21.15.133:0/2374673884 learned_addr learned my addr 172.21.15.133:0/2374673884 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:59:01.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2dd8807700 1 --2- 172.21.15.133:0/2374673884 >> v2:172.21.15.16:3300/0 conn(0x7f2dd405cc10 0x7f2dd41437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:01.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2dd9809700 1 --2- 172.21.15.133:0/2374673884 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dd40b02d0 0x7f2dd4146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:01.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2dd3fff700 1 -- 172.21.15.133:0/2374673884 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453181188 0 0) 0x7f2dd405c510 con 0x7f2dd405c130 2021-01-03T12:59:01.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2dd3fff700 1 -- 172.21.15.133:0/2374673884 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dc0003230 con 0x7f2dd405c130 2021-01-03T12:59:01.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2dd8807700 1 -- 172.21.15.133:0/2374673884 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dd40b02d0 msgr2=0x7f2dd4146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:01.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2dd8807700 1 --2- 172.21.15.133:0/2374673884 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dd40b02d0 0x7f2dd4146a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:01.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2dd8807700 1 -- 172.21.15.133:0/2374673884 >> v1:172.21.15.133:6789/0 conn(0x7f2dd405c130 legacy=0x7f2dd4146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:01.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2dd8807700 1 -- 172.21.15.133:0/2374673884 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd40af8f0 con 0x7f2dd405cc10 2021-01-03T12:59:01.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2dd9809700 1 --2- 172.21.15.133:0/2374673884 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dd40b02d0 0x7f2dd4146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:59:01.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2dd8807700 1 --2- 172.21.15.133:0/2374673884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dd405cc10 0x7f2dd41437e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f2dc8002f30 tx=0x7f2dc8006dc0).ready entity=mon.0 client_cookie=cc861e5bc050b9a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:01.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2dd3fff700 1 -- 172.21.15.133:0/2374673884 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dc80096a0 con 0x7f2dd405cc10 2021-01-03T12:59:01.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2dd3fff700 1 -- 172.21.15.133:0/2374673884 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc8009800 con 0x7f2dd405cc10 2021-01-03T12:59:01.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2ddb26c700 1 -- 172.21.15.133:0/2374673884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dd405cc10 msgr2=0x7f2dd41437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:01.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2dd3fff700 1 -- 172.21.15.133:0/2374673884 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dc8009b60 con 0x7f2dd405cc10 2021-01-03T12:59:01.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.659+0000 7f2ddb26c700 1 --2- 172.21.15.133:0/2374673884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dd405cc10 0x7f2dd41437e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f2dc8002f30 tx=0x7f2dc8006dc0).stop 2021-01-03T12:59:01.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2ddb26c700 1 -- 172.21.15.133:0/2374673884 shutdown_connections 2021-01-03T12:59:01.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2ddb26c700 1 --2- 172.21.15.133:0/2374673884 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dd40b02d0 0x7f2dd4146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:01.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2ddb26c700 1 --2- 172.21.15.133:0/2374673884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dd405cc10 0x7f2dd41437e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2ddb26c700 1 -- 172.21.15.133:0/2374673884 >> 172.21.15.133:0/2374673884 conn(0x7f2dd40b95d0 msgr2=0x7f2dd40b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2ddb26c700 1 -- 172.21.15.133:0/2374673884 shutdown_connections 2021-01-03T12:59:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2ddb26c700 1 -- 172.21.15.133:0/2374673884 wait complete. 2021-01-03T12:59:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2ddb26c700 1 Processor -- start 2021-01-03T12:59:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2ddb26c700 1 -- start start 2021-01-03T12:59:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2ddb26c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dd405c130 0x7f2dd409cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2ddb26c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dd405cc10 0x7f2dd409cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2ddb26c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd40b02d0 0x7f2dd4152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2ddb26c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd41419c0 con 0x7f2dd405c130 2021-01-03T12:59:01.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2ddb26c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd4141c60 con 0x7f2dd40b02d0 2021-01-03T12:59:01.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2ddb26c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd4141f00 con 0x7f2dd405cc10 2021-01-03T12:59:01.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2dd9809700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd40b02d0 0x7f2dd4152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:01.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2dd9809700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd40b02d0 0x7f2dd4152220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33220/0 (socket says 172.21.15.133:33220) 2021-01-03T12:59:01.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2dd9008700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dd405c130 0x7f2dd409cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:01.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2dd9809700 1 -- 172.21.15.133:0/2585860937 learned_addr learned my addr 172.21.15.133:0/2585860937 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:01.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.663+0000 7f2dd8807700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dd405cc10 0x7f2dd409cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:01.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.667+0000 7f2dd9809700 1 -- 172.21.15.133:0/2585860937 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dd405cc10 msgr2=0x7f2dd409cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:01.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.667+0000 7f2dd9809700 1 --2- 172.21.15.133:0/2585860937 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dd405cc10 0x7f2dd409cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:01.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.667+0000 7f2dd9809700 1 -- 172.21.15.133:0/2585860937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dd405c130 msgr2=0x7f2dd409cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:01.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.667+0000 7f2dd9809700 1 --2- 172.21.15.133:0/2585860937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dd405c130 0x7f2dd409cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:01.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.667+0000 7f2dd9809700 1 -- 172.21.15.133:0/2585860937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd4151d50 con 0x7f2dd40b02d0 2021-01-03T12:59:01.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.667+0000 7f2dd8807700 1 --2- 172.21.15.133:0/2585860937 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dd405cc10 0x7f2dd409cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:59:01.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.667+0000 7f2dd9809700 1 --2- 172.21.15.133:0/2585860937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd40b02d0 0x7f2dd4152220 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f2dcc00c000 tx=0x7f2dcc008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:01.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.667+0000 7f2dd27fc700 1 -- 172.21.15.133:0/2585860937 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dcc00c820 con 0x7f2dd40b02d0 2021-01-03T12:59:01.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.667+0000 7f2dd27fc700 1 -- 172.21.15.133:0/2585860937 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc00c980 con 0x7f2dd40b02d0 2021-01-03T12:59:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.667+0000 7f2ddb26c700 1 -- 172.21.15.133:0/2585860937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd4142c10 con 0x7f2dd40b02d0 2021-01-03T12:59:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.667+0000 7f2dd27fc700 1 -- 172.21.15.133:0/2585860937 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dcc00cce0 con 0x7f2dd40b02d0 2021-01-03T12:59:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.667+0000 7f2ddb26c700 1 -- 172.21.15.133:0/2585860937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd4141710 con 0x7f2dd40b02d0 2021-01-03T12:59:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.667+0000 7f2ddb26c700 1 -- 172.21.15.133:0/2585860937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd4151f40 con 0x7f2dd40b02d0 2021-01-03T12:59:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.667+0000 7f2dd27fc700 1 -- 172.21.15.133:0/2585860937 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2dcc022070 con 0x7f2dd40b02d0 2021-01-03T12:59:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.667+0000 7f2dd27fc700 1 --2- 172.21.15.133:0/2585860937 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2db40554e0 0x7f2db40579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.667+0000 7f2dd27fc700 1 -- 172.21.15.133:0/2585860937 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2dcc06e480 con 0x7f2dd40b02d0 2021-01-03T12:59:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.671+0000 7f2dd9008700 1 --2- 172.21.15.133:0/2585860937 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2db40554e0 0x7f2db40579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:01.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.671+0000 7f2dd9008700 1 --2- 172.21.15.133:0/2585860937 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2db40554e0 0x7f2db40579a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f2dc400d000 tx=0x7f2dc4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:01.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.675+0000 7f2dd27fc700 1 -- 172.21.15.133:0/2585860937 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2dcc0446e0 con 0x7f2dd40b02d0 2021-01-03T12:59:01.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.855+0000 7f2ddb26c700 1 -- 172.21.15.133:0/2585860937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2dd4057300 con 0x7f2dd40b02d0 2021-01-03T12:59:01.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.855+0000 7f2dd27fc700 1 -- 172.21.15.133:0/2585860937 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2494 (secure 0 0 0) 0x7f2dcc016070 con 0x7f2dd40b02d0 2021-01-03T12:59:01.856 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:59:01.857 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4628,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2847550436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2847550436},{"type":"v1","addr":"172.21.15.16:6833","nonce":2847550436}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1321910656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1321910656},{"type":"v1","addr":"172.21.15.133:6835","nonce":1321910656}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T12:58:41.558757+0000","modified":"2021-01-03T12:58:42.561830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1532041867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1532041867},{"type":"v1","addr":"172.21.15.133:6837","nonce":1532041867}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-01-03T12:59:01.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.859+0000 7f2ddb26c700 1 -- 172.21.15.133:0/2585860937 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2db40554e0 msgr2=0x7f2db40579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:01.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.859+0000 7f2ddb26c700 1 --2- 172.21.15.133:0/2585860937 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2db40554e0 0x7f2db40579a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f2dc400d000 tx=0x7f2dc4009040).stop 2021-01-03T12:59:01.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.859+0000 7f2ddb26c700 1 -- 172.21.15.133:0/2585860937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd40b02d0 msgr2=0x7f2dd4152220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:01.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.859+0000 7f2ddb26c700 1 --2- 172.21.15.133:0/2585860937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd40b02d0 0x7f2dd4152220 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f2dcc00c000 tx=0x7f2dcc008040).stop 2021-01-03T12:59:01.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.859+0000 7f2ddb26c700 1 -- 172.21.15.133:0/2585860937 shutdown_connections 2021-01-03T12:59:01.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.859+0000 7f2ddb26c700 1 --2- 172.21.15.133:0/2585860937 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2db40554e0 0x7f2db40579a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:01.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.859+0000 7f2ddb26c700 1 --2- 172.21.15.133:0/2585860937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dd405c130 0x7f2dd409cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:01.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.859+0000 7f2ddb26c700 1 --2- 172.21.15.133:0/2585860937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd40b02d0 0x7f2dd4152220 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:01.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.859+0000 7f2ddb26c700 1 --2- 172.21.15.133:0/2585860937 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dd405cc10 0x7f2dd409cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:01.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.859+0000 7f2ddb26c700 1 -- 172.21.15.133:0/2585860937 >> 172.21.15.133:0/2585860937 conn(0x7f2dd40b95d0 msgr2=0x7f2dd41435b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:01.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.859+0000 7f2ddb26c700 1 -- 172.21.15.133:0/2585860937 shutdown_connections 2021-01-03T12:59:01.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:01.859+0000 7f2ddb26c700 1 -- 172.21.15.133:0/2585860937 wait complete. 2021-01-03T12:59:01.861 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 10 2021-01-03T12:59:01.869 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-01-03T12:59:01.978 INFO:teuthology.orchestra.run.smithi133.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-01-03T12:59:01.979 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-01-03T12:59:01.979 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T12:59:02.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.091+0000 7fb4abfff700 1 Processor -- start 2021-01-03T12:59:02.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.091+0000 7fb4abfff700 1 -- start start 2021-01-03T12:59:02.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.091+0000 7fb4abfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4ac0b52c0 0x7fb4ac0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.091+0000 7fb4abfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb4ac0b0c90 0x7fb4ac098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.091+0000 7fb4abfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4ac0b5c00 0x7fb4ac14a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.091+0000 7fb4abfff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ac067a90 con 0x7fb4ac0b0c90 2021-01-03T12:59:02.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.091+0000 7fb4abfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ac060da0 con 0x7fb4ac0b5c00 2021-01-03T12:59:02.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.091+0000 7fb4abfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0b0ad0 con 0x7fb4ac0b52c0 2021-01-03T12:59:02.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.091+0000 7fb4ab7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4ac0b5c00 0x7fb4ac14a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.091+0000 7fb4ab7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4ac0b5c00 0x7fb4ac14a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33224/0 (socket says 172.21.15.133:33224) 2021-01-03T12:59:02.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.091+0000 7fb4ab7fe700 1 -- 172.21.15.133:0/1439820081 learned_addr learned my addr 172.21.15.133:0/1439820081 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:02.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.091+0000 7fb4aa7fc700 1 --2- 172.21.15.133:0/1439820081 >> v2:172.21.15.16:3300/0 conn(0x7fb4ac0b0c90 0x7fb4ac098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.091+0000 7fb4aaffd700 1 --2- 172.21.15.133:0/1439820081 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4ac0b52c0 0x7fb4ac0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.091+0000 7fb4ab7fe700 1 -- 172.21.15.133:0/1439820081 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4ac0b52c0 msgr2=0x7fb4ac0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:02.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.091+0000 7fb4ab7fe700 1 --2- 172.21.15.133:0/1439820081 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4ac0b52c0 0x7fb4ac0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.091+0000 7fb4ab7fe700 1 -- 172.21.15.133:0/1439820081 >> v2:172.21.15.16:3300/0 conn(0x7fb4ac0b0c90 msgr2=0x7fb4ac098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:02.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4ab7fe700 1 --2- 172.21.15.133:0/1439820081 >> v2:172.21.15.16:3300/0 conn(0x7fb4ac0b0c90 0x7fb4ac098ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4ab7fe700 1 -- 172.21.15.133:0/1439820081 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac0b56a0 con 0x7fb4ac0b5c00 2021-01-03T12:59:02.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4ab7fe700 1 --2- 172.21.15.133:0/1439820081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4ac0b5c00 0x7fb4ac14a780 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fb4a40032b0 tx=0x7fb4a4009270).ready entity=mon.1 client_cookie=71dc948a49c78c93 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:02.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4a9ffb700 1 -- 172.21.15.133:0/1439820081 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4a4009e60 con 0x7fb4ac0b5c00 2021-01-03T12:59:02.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4a9ffb700 1 -- 172.21.15.133:0/1439820081 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a400bb50 con 0x7fb4ac0b5c00 2021-01-03T12:59:02.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4a9ffb700 1 -- 172.21.15.133:0/1439820081 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4a400bcc0 con 0x7fb4ac0b5c00 2021-01-03T12:59:02.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4abfff700 1 -- 172.21.15.133:0/1439820081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4ac0b5c00 msgr2=0x7fb4ac14a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4abfff700 1 --2- 172.21.15.133:0/1439820081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4ac0b5c00 0x7fb4ac14a780 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fb4a40032b0 tx=0x7fb4a4009270).stop 2021-01-03T12:59:02.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4abfff700 1 -- 172.21.15.133:0/1439820081 shutdown_connections 2021-01-03T12:59:02.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4abfff700 1 --2- 172.21.15.133:0/1439820081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4ac0b5c00 0x7fb4ac14a780 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4abfff700 1 --2- 172.21.15.133:0/1439820081 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4ac0b52c0 0x7fb4ac0b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4abfff700 1 --2- 172.21.15.133:0/1439820081 >> v2:172.21.15.16:3300/0 conn(0x7fb4ac0b0c90 0x7fb4ac098ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4abfff700 1 -- 172.21.15.133:0/1439820081 >> 172.21.15.133:0/1439820081 conn(0x7fb4ac05bdf0 msgr2=0x7fb4ac05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:02.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4abfff700 1 -- 172.21.15.133:0/1439820081 shutdown_connections 2021-01-03T12:59:02.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4abfff700 1 -- 172.21.15.133:0/1439820081 wait complete. 2021-01-03T12:59:02.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4abfff700 1 Processor -- start 2021-01-03T12:59:02.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4abfff700 1 -- start start 2021-01-03T12:59:02.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4abfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4ac0b0c90 0x7fb4ac0b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4abfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4ac0b52c0 0x7fb4ac159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4abfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4ac0b5c00 0x7fb4ac066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4abfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0af470 con 0x7fb4ac0b0c90 2021-01-03T12:59:02.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4abfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0aef30 con 0x7fb4ac0b5c00 2021-01-03T12:59:02.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4abfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac0af1d0 con 0x7fb4ac0b52c0 2021-01-03T12:59:02.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.095+0000 7fb4aaffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4ac0b0c90 0x7fb4ac0b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.099+0000 7fb4aaffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4ac0b0c90 0x7fb4ac0b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:60000/0 (socket says 172.21.15.133:60000) 2021-01-03T12:59:02.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.099+0000 7fb4aaffd700 1 -- 172.21.15.133:0/1397648112 learned_addr learned my addr 172.21.15.133:0/1397648112 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:02.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.099+0000 7fb4aa7fc700 1 --2- 172.21.15.133:0/1397648112 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4ac0b52c0 0x7fb4ac159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.099+0000 7fb4ab7fe700 1 --2- 172.21.15.133:0/1397648112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4ac0b5c00 0x7fb4ac066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.099+0000 7fb4aaffd700 1 -- 172.21.15.133:0/1397648112 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4ac0b52c0 msgr2=0x7fb4ac159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.099+0000 7fb4aaffd700 1 --2- 172.21.15.133:0/1397648112 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4ac0b52c0 0x7fb4ac159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.099+0000 7fb4aaffd700 1 -- 172.21.15.133:0/1397648112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4ac0b5c00 msgr2=0x7fb4ac066570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.099+0000 7fb4aaffd700 1 --2- 172.21.15.133:0/1397648112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4ac0b5c00 0x7fb4ac066570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.099+0000 7fb4aaffd700 1 -- 172.21.15.133:0/1397648112 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac0660d0 con 0x7fb4ac0b0c90 2021-01-03T12:59:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.099+0000 7fb4aaffd700 1 --2- 172.21.15.133:0/1397648112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4ac0b0c90 0x7fb4ac0b4570 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fb49c00c000 tx=0x7fb49c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.099+0000 7fb4a3fff700 1 -- 172.21.15.133:0/1397648112 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb49c00ca80 con 0x7fb4ac0b0c90 2021-01-03T12:59:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.099+0000 7fb4a3fff700 1 -- 172.21.15.133:0/1397648112 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c00cbe0 con 0x7fb4ac0b0c90 2021-01-03T12:59:02.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.099+0000 7fb4abfff700 1 -- 172.21.15.133:0/1397648112 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ac159780 con 0x7fb4ac0b0c90 2021-01-03T12:59:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.099+0000 7fb4a3fff700 1 -- 172.21.15.133:0/1397648112 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb49c0123f0 con 0x7fb4ac0b0c90 2021-01-03T12:59:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.099+0000 7fb4abfff700 1 -- 172.21.15.133:0/1397648112 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ac063620 con 0x7fb4ac0b0c90 2021-01-03T12:59:02.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.099+0000 7fb4abfff700 1 -- 172.21.15.133:0/1397648112 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4ac066260 con 0x7fb4ac0b0c90 2021-01-03T12:59:02.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.099+0000 7fb4a3fff700 1 -- 172.21.15.133:0/1397648112 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb49c0327e0 con 0x7fb4ac0b0c90 2021-01-03T12:59:02.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.103+0000 7fb4a3fff700 1 --2- 172.21.15.133:0/1397648112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb484055330 0x7fb4840577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.103+0000 7fb4a3fff700 1 -- 172.21.15.133:0/1397648112 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb49c06e6f0 con 0x7fb4ac0b0c90 2021-01-03T12:59:02.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.103+0000 7fb4aa7fc700 1 --2- 172.21.15.133:0/1397648112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb484055330 0x7fb4840577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.103+0000 7fb4aa7fc700 1 --2- 172.21.15.133:0/1397648112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb484055330 0x7fb4840577f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fb49400b000 tx=0x7fb494006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:02.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.111+0000 7fb4a3fff700 1 -- 172.21.15.133:0/1397648112 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb49c0449f0 con 0x7fb4ac0b0c90 2021-01-03T12:59:02.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.299+0000 7fb4abfff700 1 -- 172.21.15.133:0/1397648112 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4ac057300 con 0x7fb4ac0b0c90 2021-01-03T12:59:02.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.299+0000 7fb4a3fff700 1 -- 172.21.15.133:0/1397648112 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2494 (secure 0 0 0) 0x7fb49c048010 con 0x7fb4ac0b0c90 2021-01-03T12:59:02.302 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:59:02.302 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4628,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2847550436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2847550436},{"type":"v1","addr":"172.21.15.16:6833","nonce":2847550436}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1321910656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1321910656},{"type":"v1","addr":"172.21.15.133:6835","nonce":1321910656}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T12:58:41.558757+0000","modified":"2021-01-03T12:58:42.561830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1532041867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1532041867},{"type":"v1","addr":"172.21.15.133:6837","nonce":1532041867}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-01-03T12:59:02.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.303+0000 7fb4abfff700 1 -- 172.21.15.133:0/1397648112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb484055330 msgr2=0x7fb4840577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.303+0000 7fb4abfff700 1 --2- 172.21.15.133:0/1397648112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb484055330 0x7fb4840577f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fb49400b000 tx=0x7fb494006dc0).stop 2021-01-03T12:59:02.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.303+0000 7fb4abfff700 1 -- 172.21.15.133:0/1397648112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4ac0b0c90 msgr2=0x7fb4ac0b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.303+0000 7fb4abfff700 1 --2- 172.21.15.133:0/1397648112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4ac0b0c90 0x7fb4ac0b4570 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fb49c00c000 tx=0x7fb49c006dc0).stop 2021-01-03T12:59:02.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.303+0000 7fb4abfff700 1 -- 172.21.15.133:0/1397648112 shutdown_connections 2021-01-03T12:59:02.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.303+0000 7fb4abfff700 1 --2- 172.21.15.133:0/1397648112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb484055330 0x7fb4840577f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.303+0000 7fb4abfff700 1 --2- 172.21.15.133:0/1397648112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4ac0b0c90 0x7fb4ac0b4570 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.303+0000 7fb4abfff700 1 --2- 172.21.15.133:0/1397648112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4ac0b5c00 0x7fb4ac066570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.303+0000 7fb4abfff700 1 --2- 172.21.15.133:0/1397648112 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4ac0b52c0 0x7fb4ac159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.303+0000 7fb4abfff700 1 -- 172.21.15.133:0/1397648112 >> 172.21.15.133:0/1397648112 conn(0x7fb4ac05bdf0 msgr2=0x7fb4ac1434e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:02.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.303+0000 7fb4abfff700 1 -- 172.21.15.133:0/1397648112 shutdown_connections 2021-01-03T12:59:02.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.303+0000 7fb4abfff700 1 -- 172.21.15.133:0/1397648112 wait complete. 2021-01-03T12:59:02.306 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 10 2021-01-03T12:59:02.315 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-01-03T12:59:02.425 INFO:teuthology.orchestra.run.smithi133.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-01-03T12:59:02.425 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-01-03T12:59:02.426 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T12:59:02.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.535+0000 7f8ab1bdf700 1 Processor -- start 2021-01-03T12:59:02.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.535+0000 7f8ab1bdf700 1 -- start start 2021-01-03T12:59:02.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8ab1bdf700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8aac063270 0x7f8aac0b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8ab1bdf700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aac0b6290 con 0x7f8aac13d9c0 2021-01-03T12:59:02.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8ab1bdf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aac063650 con 0x7f8aac0b06b0 2021-01-03T12:59:02.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8ab1bdf700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aac0b2bd0 con 0x7f8aac063270 2021-01-03T12:59:02.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aabfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8aac0b06b0 0x7f8aac0a8ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54268/0 (socket says 172.21.15.133:54268) 2021-01-03T12:59:02.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aabfff700 1 -- 172.21.15.133:0/885592863 learned_addr learned my addr 172.21.15.133:0/885592863 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:59:02.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8ab0bdd700 1 --2- 172.21.15.133:0/885592863 >> v2:172.21.15.16:3300/0 conn(0x7f8aac063270 0x7f8aac0b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 -- 172.21.15.133:0/885592863 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691300348 0 0) 0x7f8aac063650 con 0x7f8aac0b06b0 2021-01-03T12:59:02.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 -- 172.21.15.133:0/885592863 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a98003230 con 0x7f8aac0b06b0 2021-01-03T12:59:02.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 -- 172.21.15.133:0/885592863 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344577596 0 0) 0x7f8aac0b6290 con 0x7f8aac13d9c0 2021-01-03T12:59:02.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 -- 172.21.15.133:0/885592863 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aac063650 con 0x7f8aac13d9c0 2021-01-03T12:59:02.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 -- 172.21.15.133:0/885592863 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 164033441 0 0) 0x7f8a98003230 con 0x7f8aac0b06b0 2021-01-03T12:59:02.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 -- 172.21.15.133:0/885592863 >> v2:172.21.15.16:3300/0 conn(0x7f8aac063270 msgr2=0x7f8aac0b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:02.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 --2- 172.21.15.133:0/885592863 >> v2:172.21.15.16:3300/0 conn(0x7f8aac063270 0x7f8aac0b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 -- 172.21.15.133:0/885592863 >> v1:172.21.15.16:6789/0 conn(0x7f8aac13d9c0 legacy=0x7f8aac13de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 -- 172.21.15.133:0/885592863 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac0b5d50 con 0x7f8aac0b06b0 2021-01-03T12:59:02.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 -- 172.21.15.133:0/885592863 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f8aa00016d0 con 0x7f8aac0b06b0 2021-01-03T12:59:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 -- 172.21.15.133:0/885592863 >> v1:172.21.15.133:6789/0 conn(0x7f8aac0b06b0 legacy=0x7f8aac0a8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 --2- 172.21.15.133:0/885592863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a980038b0 0x7f8a98003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 --2- 172.21.15.133:0/885592863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a980044d0 0x7f8a98004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 --2- 172.21.15.133:0/885592863 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8a98004e40 0x7f8a9800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 -- 172.21.15.133:0/885592863 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac0b2bd0 con 0x7f8a980044d0 2021-01-03T12:59:02.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 -- 172.21.15.133:0/885592863 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9800bc10 con 0x7f8a980038b0 2021-01-03T12:59:02.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 -- 172.21.15.133:0/885592863 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9800bd50 con 0x7f8a98004e40 2021-01-03T12:59:02.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8ab0bdd700 1 --2- 172.21.15.133:0/885592863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a980038b0 0x7f8a98003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aabfff700 1 --2- 172.21.15.133:0/885592863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a980044d0 0x7f8a98004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8ab13de700 1 --2- 172.21.15.133:0/885592863 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8a98004e40 0x7f8a9800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8ab0bdd700 1 -- 172.21.15.133:0/885592863 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8a98004e40 msgr2=0x7f8a9800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:02.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8ab0bdd700 1 --2- 172.21.15.133:0/885592863 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8a98004e40 0x7f8a9800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8ab0bdd700 1 -- 172.21.15.133:0/885592863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a980044d0 msgr2=0x7f8a98004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:02.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8ab0bdd700 1 --2- 172.21.15.133:0/885592863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a980044d0 0x7f8a98004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8ab13de700 1 -- 172.21.15.133:0/885592863 reap_dead start 2021-01-03T12:59:02.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8ab0bdd700 1 -- 172.21.15.133:0/885592863 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a98003230 con 0x7f8a980038b0 2021-01-03T12:59:02.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8ab0bdd700 1 --2- 172.21.15.133:0/885592863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a980038b0 0x7f8a98003c90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f8a98004440 tx=0x7f8a9c0091a0).ready entity=mon.1 client_cookie=21496ee6b2faa792 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:02.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.539+0000 7f8aab7fe700 1 -- 172.21.15.133:0/885592863 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a9c00eb80 con 0x7f8a980038b0 2021-01-03T12:59:02.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8aab7fe700 1 -- 172.21.15.133:0/885592863 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c00ece0 con 0x7f8a980038b0 2021-01-03T12:59:02.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8aab7fe700 1 -- 172.21.15.133:0/885592863 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a9c0123f0 con 0x7f8a980038b0 2021-01-03T12:59:02.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8ab1bdf700 1 -- 172.21.15.133:0/885592863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a980038b0 msgr2=0x7f8a98003c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8ab1bdf700 1 --2- 172.21.15.133:0/885592863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a980038b0 0x7f8a98003c90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f8a98004440 tx=0x7f8a9c0091a0).stop 2021-01-03T12:59:02.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8ab1bdf700 1 -- 172.21.15.133:0/885592863 shutdown_connections 2021-01-03T12:59:02.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8ab1bdf700 1 --2- 172.21.15.133:0/885592863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8a980038b0 0x7f8a98003c90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8ab1bdf700 1 -- 172.21.15.133:0/885592863 >> 172.21.15.133:0/885592863 conn(0x7f8aac0617b0 msgr2=0x7f8aac06aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:02.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8ab1bdf700 1 -- 172.21.15.133:0/885592863 shutdown_connections 2021-01-03T12:59:02.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8ab1bdf700 1 -- 172.21.15.133:0/885592863 wait complete. 2021-01-03T12:59:02.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8ab1bdf700 1 Processor -- start 2021-01-03T12:59:02.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8ab1bdf700 1 -- start start 2021-01-03T12:59:02.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8ab1bdf700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a980038b0 0x7f8aac152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8ab1bdf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8aac13fbc0 0x7f8aac138290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8ab1bdf700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8aac1531a0 0x7f8aac138e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8ab1bdf700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac0ac4d0 con 0x7f8a980038b0 2021-01-03T12:59:02.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8ab1bdf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac0aad60 con 0x7f8aac13fbc0 2021-01-03T12:59:02.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8ab1bdf700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac140950 con 0x7f8aac1531a0 2021-01-03T12:59:02.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.543+0000 7f8aabfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8aac13fbc0 0x7f8aac138290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.547+0000 7f8aabfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8aac13fbc0 0x7f8aac138290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33252/0 (socket says 172.21.15.133:33252) 2021-01-03T12:59:02.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.547+0000 7f8aabfff700 1 -- 172.21.15.133:0/3919440271 learned_addr learned my addr 172.21.15.133:0/3919440271 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:02.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.547+0000 7f8ab13de700 1 --2- 172.21.15.133:0/3919440271 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8aac1531a0 0x7f8aac138e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.547+0000 7f8ab0bdd700 1 --2- 172.21.15.133:0/3919440271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a980038b0 0x7f8aac152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.547+0000 7f8aabfff700 1 -- 172.21.15.133:0/3919440271 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8aac1531a0 msgr2=0x7f8aac138e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.547+0000 7f8aabfff700 1 --2- 172.21.15.133:0/3919440271 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8aac1531a0 0x7f8aac138e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.547+0000 7f8aabfff700 1 -- 172.21.15.133:0/3919440271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a980038b0 msgr2=0x7f8aac152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.547+0000 7f8aabfff700 1 --2- 172.21.15.133:0/3919440271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a980038b0 0x7f8aac152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.547+0000 7f8aabfff700 1 -- 172.21.15.133:0/3919440271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac138780 con 0x7f8aac13fbc0 2021-01-03T12:59:02.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.547+0000 7f8aabfff700 1 --2- 172.21.15.133:0/3919440271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8aac13fbc0 0x7f8aac138290 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f8aa000c000 tx=0x7f8aac0b5c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:02.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.547+0000 7f8aa9ffb700 1 -- 172.21.15.133:0/3919440271 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aa000faf0 con 0x7f8aac13fbc0 2021-01-03T12:59:02.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.547+0000 7f8aa9ffb700 1 -- 172.21.15.133:0/3919440271 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa000fc50 con 0x7f8aac13fbc0 2021-01-03T12:59:02.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.547+0000 7f8ab1bdf700 1 -- 172.21.15.133:0/3919440271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aac138a30 con 0x7f8aac13fbc0 2021-01-03T12:59:02.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.547+0000 7f8aa9ffb700 1 -- 172.21.15.133:0/3919440271 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8aa0016440 con 0x7f8aac13fbc0 2021-01-03T12:59:02.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.547+0000 7f8ab1bdf700 1 -- 172.21.15.133:0/3919440271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aac13f5c0 con 0x7f8aac13fbc0 2021-01-03T12:59:02.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.547+0000 7f8ab1bdf700 1 -- 172.21.15.133:0/3919440271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aac0aaba0 con 0x7f8aac13fbc0 2021-01-03T12:59:02.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.547+0000 7f8aa9ffb700 1 -- 172.21.15.133:0/3919440271 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8aa00165a0 con 0x7f8aac13fbc0 2021-01-03T12:59:02.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.551+0000 7f8aa9ffb700 1 --2- 172.21.15.133:0/3919440271 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8a8c055440 0x7f8a8c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.551+0000 7f8aa9ffb700 1 -- 172.21.15.133:0/3919440271 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8aa006e170 con 0x7f8aac13fbc0 2021-01-03T12:59:02.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.551+0000 7f8ab0bdd700 1 --2- 172.21.15.133:0/3919440271 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8a8c055440 0x7f8a8c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.551+0000 7f8ab0bdd700 1 --2- 172.21.15.133:0/3919440271 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8a8c055440 0x7f8a8c057900 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f8a9c01e000 tx=0x7f8a9c01a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:02.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.555+0000 7f8aa9ffb700 1 -- 172.21.15.133:0/3919440271 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8aa0044410 con 0x7f8aac13fbc0 2021-01-03T12:59:02.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.743+0000 7f8ab1bdf700 1 -- 172.21.15.133:0/3919440271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8aac057300 con 0x7f8aac13fbc0 2021-01-03T12:59:02.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.743+0000 7f8aa9ffb700 1 -- 172.21.15.133:0/3919440271 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2494 (secure 0 0 0) 0x7f8aa0047a30 con 0x7f8aac13fbc0 2021-01-03T12:59:02.743 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:59:02.744 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4628,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2847550436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2847550436},{"type":"v1","addr":"172.21.15.16:6833","nonce":2847550436}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1321910656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1321910656},{"type":"v1","addr":"172.21.15.133:6835","nonce":1321910656}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T12:58:41.558757+0000","modified":"2021-01-03T12:58:42.561830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1532041867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1532041867},{"type":"v1","addr":"172.21.15.133:6837","nonce":1532041867}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-01-03T12:59:02.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.747+0000 7f8ab1bdf700 1 -- 172.21.15.133:0/3919440271 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8a8c055440 msgr2=0x7f8a8c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.747+0000 7f8ab1bdf700 1 --2- 172.21.15.133:0/3919440271 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8a8c055440 0x7f8a8c057900 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f8a9c01e000 tx=0x7f8a9c01a000).stop 2021-01-03T12:59:02.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.747+0000 7f8ab1bdf700 1 -- 172.21.15.133:0/3919440271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8aac13fbc0 msgr2=0x7f8aac138290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.747+0000 7f8ab1bdf700 1 --2- 172.21.15.133:0/3919440271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8aac13fbc0 0x7f8aac138290 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f8aa000c000 tx=0x7f8aac0b5c40).stop 2021-01-03T12:59:02.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.747+0000 7f8ab1bdf700 1 -- 172.21.15.133:0/3919440271 shutdown_connections 2021-01-03T12:59:02.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.747+0000 7f8ab1bdf700 1 --2- 172.21.15.133:0/3919440271 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8a8c055440 0x7f8a8c057900 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.747+0000 7f8ab1bdf700 1 --2- 172.21.15.133:0/3919440271 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a980038b0 0x7f8aac152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.747+0000 7f8ab1bdf700 1 --2- 172.21.15.133:0/3919440271 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8aac1531a0 0x7f8aac138e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.747+0000 7f8ab1bdf700 1 --2- 172.21.15.133:0/3919440271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8aac13fbc0 0x7f8aac138290 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.747+0000 7f8ab1bdf700 1 -- 172.21.15.133:0/3919440271 >> 172.21.15.133:0/3919440271 conn(0x7f8aac0617b0 msgr2=0x7f8aac13d290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:02.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.747+0000 7f8ab1bdf700 1 -- 172.21.15.133:0/3919440271 shutdown_connections 2021-01-03T12:59:02.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.747+0000 7f8ab1bdf700 1 -- 172.21.15.133:0/3919440271 wait complete. 2021-01-03T12:59:02.750 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 10 2021-01-03T12:59:02.762 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mds.a cache drop 2021-01-03T12:59:02.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.875+0000 7f0516bf5700 1 Processor -- start 2021-01-03T12:59:02.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.875+0000 7f0516bf5700 1 -- start start 2021-01-03T12:59:02.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0516bf5700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f05100b9b60 0x7f05100b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0516bf5700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05100b4980 0x7f05100b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0516bf5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0510146430 0x7f05101468c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0516bf5700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05100aed30 con 0x7f05100b9b60 2021-01-03T12:59:02.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0516bf5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05100605f0 con 0x7f0510146430 2021-01-03T12:59:02.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0516bf5700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05100600b0 con 0x7f05100b4980 2021-01-03T12:59:02.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f05163f4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0510146430 0x7f05101468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f05163f4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0510146430 0x7f05101468c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33258/0 (socket says 172.21.15.133:33258) 2021-01-03T12:59:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f05163f4700 1 -- 172.21.15.133:0/2597533166 learned_addr learned my addr 172.21.15.133:0/2597533166 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f05153f2700 1 --2- 172.21.15.133:0/2597533166 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05100b4980 0x7f05100b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0515bf3700 1 --2- 172.21.15.133:0/2597533166 >> v2:172.21.15.16:3300/0 conn(0x7f05100b9b60 0x7f05100b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f05163f4700 1 -- 172.21.15.133:0/2597533166 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05100b4980 msgr2=0x7f05100b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:02.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f05163f4700 1 --2- 172.21.15.133:0/2597533166 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05100b4980 0x7f05100b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f05163f4700 1 -- 172.21.15.133:0/2597533166 >> v2:172.21.15.16:3300/0 conn(0x7f05100b9b60 msgr2=0x7f05100b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:02.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f05163f4700 1 --2- 172.21.15.133:0/2597533166 >> v2:172.21.15.16:3300/0 conn(0x7f05100b9b60 0x7f05100b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f05163f4700 1 -- 172.21.15.133:0/2597533166 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0510060350 con 0x7f0510146430 2021-01-03T12:59:02.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0515bf3700 1 --2- 172.21.15.133:0/2597533166 >> v2:172.21.15.16:3300/0 conn(0x7f05100b9b60 0x7f05100b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:59:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f05163f4700 1 --2- 172.21.15.133:0/2597533166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0510146430 0x7f05101468c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f050c002f30 tx=0x7f050c006e80).ready entity=mon.1 client_cookie=7c0acb4f612a3af6 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0514bf1700 1 -- 172.21.15.133:0/2597533166 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f050c0097f0 con 0x7f0510146430 2021-01-03T12:59:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0514bf1700 1 -- 172.21.15.133:0/2597533166 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050c009950 con 0x7f0510146430 2021-01-03T12:59:02.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0514bf1700 1 -- 172.21.15.133:0/2597533166 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f050c009cb0 con 0x7f0510146430 2021-01-03T12:59:02.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0516bf5700 1 -- 172.21.15.133:0/2597533166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0510146430 msgr2=0x7f05101468c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0516bf5700 1 --2- 172.21.15.133:0/2597533166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0510146430 0x7f05101468c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f050c002f30 tx=0x7f050c006e80).stop 2021-01-03T12:59:02.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0516bf5700 1 -- 172.21.15.133:0/2597533166 shutdown_connections 2021-01-03T12:59:02.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0516bf5700 1 --2- 172.21.15.133:0/2597533166 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0510146430 0x7f05101468c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0516bf5700 1 --2- 172.21.15.133:0/2597533166 >> v2:172.21.15.16:3300/0 conn(0x7f05100b9b60 0x7f05100b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0516bf5700 1 --2- 172.21.15.133:0/2597533166 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05100b4980 0x7f05100b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0516bf5700 1 -- 172.21.15.133:0/2597533166 >> 172.21.15.133:0/2597533166 conn(0x7f05100b69e0 msgr2=0x7f05100b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:02.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0516bf5700 1 -- 172.21.15.133:0/2597533166 shutdown_connections 2021-01-03T12:59:02.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0516bf5700 1 -- 172.21.15.133:0/2597533166 wait complete. 2021-01-03T12:59:02.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0516bf5700 1 Processor -- start 2021-01-03T12:59:02.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.879+0000 7f0516bf5700 1 -- start start 2021-01-03T12:59:02.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f0516bf5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05100b4980 0x7f051013c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f0516bf5700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05100b9b60 0x7f05100b8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f0516bf5700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0510146430 0x7f0510148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f0516bf5700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05101523d0 con 0x7f05100b9b60 2021-01-03T12:59:02.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f0516bf5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0510152670 con 0x7f05100b4980 2021-01-03T12:59:02.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f0516bf5700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05101481b0 con 0x7f0510146430 2021-01-03T12:59:02.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f0515bf3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05100b4980 0x7f051013c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f0515bf3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05100b4980 0x7f051013c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33262/0 (socket says 172.21.15.133:33262) 2021-01-03T12:59:02.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f0515bf3700 1 -- 172.21.15.133:0/540438978 learned_addr learned my addr 172.21.15.133:0/540438978 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:02.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f05163f4700 1 --2- 172.21.15.133:0/540438978 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0510146430 0x7f0510148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f05153f2700 1 --2- 172.21.15.133:0/540438978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05100b9b60 0x7f05100b8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f0515bf3700 1 -- 172.21.15.133:0/540438978 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0510146430 msgr2=0x7f0510148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f0515bf3700 1 --2- 172.21.15.133:0/540438978 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0510146430 0x7f0510148650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f0515bf3700 1 -- 172.21.15.133:0/540438978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05100b9b60 msgr2=0x7f05100b8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f0515bf3700 1 --2- 172.21.15.133:0/540438978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05100b9b60 0x7f05100b8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f0515bf3700 1 -- 172.21.15.133:0/540438978 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051013c740 con 0x7f05100b4980 2021-01-03T12:59:02.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f05153f2700 1 --2- 172.21.15.133:0/540438978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05100b9b60 0x7f05100b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:59:02.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f05163f4700 1 --2- 172.21.15.133:0/540438978 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0510146430 0x7f0510148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:59:02.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f0515bf3700 1 --2- 172.21.15.133:0/540438978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05100b4980 0x7f051013c250 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f0500006910 tx=0x7f0500008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:02.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f04feffd700 1 -- 172.21.15.133:0/540438978 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0500009920 con 0x7f05100b4980 2021-01-03T12:59:02.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f04feffd700 1 -- 172.21.15.133:0/540438978 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0500009a80 con 0x7f05100b4980 2021-01-03T12:59:02.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f04feffd700 1 -- 172.21.15.133:0/540438978 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0500009de0 con 0x7f05100b4980 2021-01-03T12:59:02.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f0516bf5700 1 -- 172.21.15.133:0/540438978 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f051009cba0 con 0x7f05100b4980 2021-01-03T12:59:02.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f0516bf5700 1 -- 172.21.15.133:0/540438978 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051009c8a0 con 0x7f05100b4980 2021-01-03T12:59:02.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.883+0000 7f04feffd700 1 -- 172.21.15.133:0/540438978 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0500013480 con 0x7f05100b4980 2021-01-03T12:59:02.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f04feffd700 1 --2- 172.21.15.133:0/540438978 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f04f0055330 0x7f04f00577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05153f2700 1 --2- 172.21.15.133:0/540438978 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f04f0055330 0x7f04f00577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f04feffd700 1 -- 172.21.15.133:0/540438978 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f050006e7e0 con 0x7f05100b4980 2021-01-03T12:59:02.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05153f2700 1 --2- 172.21.15.133:0/540438978 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f04f0055330 0x7f04f00577f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f050800b000 tx=0x7f0508008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:02.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05267f2740 1 Processor -- start 2021-01-03T12:59:02.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05267f2740 1 -- start start 2021-01-03T12:59:02.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05267f2740 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x161f750 0x1669ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05267f2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1487800 0x16a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05267f2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1419c00 0x16a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05267f2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x158dd60 con 0x1487800 2021-01-03T12:59:02.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05267f2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x14a0690 con 0x1419c00 2021-01-03T12:59:02.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05267f2740 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x15c3e00 con 0x161f750 2021-01-03T12:59:02.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05163f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1419c00 0x16a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05163f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1419c00 0x16a1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33274/0 (socket says 172.21.15.133:33274) 2021-01-03T12:59:02.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05163f4700 1 -- 172.21.15.133:0/1845350333 learned_addr learned my addr 172.21.15.133:0/1845350333 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:02.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f0515bf3700 1 --2- 172.21.15.133:0/1845350333 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x161f750 0x1669ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05153f2700 1 --2- 172.21.15.133:0/1845350333 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1487800 0x16a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05163f4700 1 -- 172.21.15.133:0/1845350333 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x161f750 msgr2=0x1669ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:02.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05163f4700 1 --2- 172.21.15.133:0/1845350333 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x161f750 0x1669ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05163f4700 1 -- 172.21.15.133:0/1845350333 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1487800 msgr2=0x16a1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:02.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05163f4700 1 --2- 172.21.15.133:0/1845350333 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1487800 0x16a1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05163f4700 1 -- 172.21.15.133:0/1845350333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x15a3d20 con 0x1419c00 2021-01-03T12:59:02.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.887+0000 7f05163f4700 1 --2- 172.21.15.133:0/1845350333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1419c00 0x16a1f80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x166c830 tx=0x7f050c015000).ready entity=mon.1 client_cookie=f0a7ad085e0726f2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:02.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f0516bf5700 1 -- 172.21.15.133:0/1845350333 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f050c006bd0 con 0x1419c00 2021-01-03T12:59:02.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f0516bf5700 1 -- 172.21.15.133:0/1845350333 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050c009a00 con 0x1419c00 2021-01-03T12:59:02.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f0516bf5700 1 -- 172.21.15.133:0/1845350333 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f050c009b70 con 0x1419c00 2021-01-03T12:59:02.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 1 -- 172.21.15.133:0/1845350333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1419c00 msgr2=0x16a1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 1 --2- 172.21.15.133:0/1845350333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1419c00 0x16a1f80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x166c830 tx=0x7f050c015000).stop 2021-01-03T12:59:02.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 1 -- 172.21.15.133:0/1845350333 shutdown_connections 2021-01-03T12:59:02.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 1 --2- 172.21.15.133:0/1845350333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1419c00 0x16a1f80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 1 --2- 172.21.15.133:0/1845350333 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x161f750 0x1669ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 1 --2- 172.21.15.133:0/1845350333 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1487800 0x16a1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 1 -- 172.21.15.133:0/1845350333 >> 172.21.15.133:0/1845350333 conn(0x164ef30 msgr2=0x166ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:02.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 1 -- 172.21.15.133:0/1845350333 shutdown_connections 2021-01-03T12:59:02.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 1 -- 172.21.15.133:0/1845350333 wait complete. 2021-01-03T12:59:02.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 1 -- start start 2021-01-03T12:59:02.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 1 Processor -- start 2021-01-03T12:59:02.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1419c00 0x16a0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1487800 0x16a0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x161f750 0x16b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x15c3f40 con 0x1419c00 2021-01-03T12:59:02.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x15c5510 con 0x161f750 2021-01-03T12:59:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x15a6790 con 0x1487800 2021-01-03T12:59:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05267f2740 10 client.0 ll_register_callbacks cb 0x164ee90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-01-03T12:59:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05163f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x161f750 0x16b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05163f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x161f750 0x16b0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33280/0 (socket says 172.21.15.133:33280) 2021-01-03T12:59:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05163f4700 1 -- 172.21.15.133:0/2948760565 learned_addr learned my addr 172.21.15.133:0/2948760565 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:02.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f0515bf3700 1 --2- 172.21.15.133:0/2948760565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1419c00 0x16a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05153f2700 1 --2- 172.21.15.133:0/2948760565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1487800 0x16a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05163f4700 1 -- 172.21.15.133:0/2948760565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1487800 msgr2=0x16a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:02.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05163f4700 1 --2- 172.21.15.133:0/2948760565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1487800 0x16a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05163f4700 1 -- 172.21.15.133:0/2948760565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1419c00 msgr2=0x16a0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:02.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05163f4700 1 --2- 172.21.15.133:0/2948760565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1419c00 0x16a0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05163f4700 1 -- 172.21.15.133:0/2948760565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x15b4ff0 con 0x161f750 2021-01-03T12:59:02.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05153f2700 1 --2- 172.21.15.133:0/2948760565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1487800 0x16a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:59:02.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f05163f4700 1 --2- 172.21.15.133:0/2948760565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x161f750 0x16b0ed0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x166c830 tx=0x7f050c020000).ready entity=mon.1 client_cookie=505878ecff759485 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:02.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.891+0000 7f04ecff9700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2021-01-03T12:59:02.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f04ecff9700 1 -- 172.21.15.133:0/2948760565 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f050c006bd0 con 0x161f750 2021-01-03T12:59:02.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f04ecff9700 1 -- 172.21.15.133:0/2948760565 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f050c01fd20 con 0x161f750 2021-01-03T12:59:02.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 1 -- 172.21.15.133:0/2948760565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x14ac8b0 con 0x161f750 2021-01-03T12:59:02.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f04ecff9700 1 -- 172.21.15.133:0/2948760565 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f050c028460 con 0x161f750 2021-01-03T12:59:02.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 10 client.5119 fetch_fsmap learned FSMap version 10 2021-01-03T12:59:02.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 1 -- 172.21.15.133:0/2948760565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x1437770 con 0x161f750 2021-01-03T12:59:02.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f04ecff9700 1 -- 172.21.15.133:0/2948760565 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x14ac8b0 con 0x161f750 2021-01-03T12:59:02.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f04ecff9700 1 -- 172.21.15.133:0/2948760565 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 10) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f050c028bd0 con 0x161f750 2021-01-03T12:59:02.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 10 client.5119 fetch_fsmap finished waiting for FSMap version 10 2021-01-03T12:59:02.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 10 client.5119 resolve_mds: resolved ID 'a' to GID 4888 2021-01-03T12:59:02.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 20 client.5119 populate_metadata read hostname 'smithi133' 2021-01-03T12:59:02.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 1 --2- 172.21.15.133:0/2948760565 >> [v2:172.21.15.133:6836/1532041867,v1:172.21.15.133:6837/1532041867] conn(0x166dd50 0x16b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 4 client.5119 mds_command: new command op to 4888 tid=0[{"prefix": "get_command_descriptions"}] 2021-01-03T12:59:02.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 1 -- 172.21.15.133:0/2948760565 --> [v2:172.21.15.133:6836/1532041867,v1:172.21.15.133:6837/1532041867] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x147d4b0 con 0x166dd50 2021-01-03T12:59:02.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f0515bf3700 1 --2- 172.21.15.133:0/2948760565 >> [v2:172.21.15.133:6836/1532041867,v1:172.21.15.133:6837/1532041867] conn(0x166dd50 0x16b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f04ecff9700 10 client.5119 ms_handle_connect on v2:172.21.15.133:6836/1532041867 2021-01-03T12:59:02.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f0515bf3700 1 --2- 172.21.15.133:0/2948760565 >> [v2:172.21.15.133:6836/1532041867,v1:172.21.15.133:6837/1532041867] conn(0x166dd50 0x16b13c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=688e369c7f0f923b server_cookie=e3738d4de0b93c58 in_seq=0 out_seq=0 2021-01-03T12:59:02.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f04ecff9700 1 -- 172.21.15.133:0/2948760565 <== mds.0 v2:172.21.15.133:6836/1532041867 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x147d4b0 con 0x166dd50 2021-01-03T12:59:02.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f04ecff9700 10 client.5119 handle_command_reply: tid=0 2021-01-03T12:59:02.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 1 client.5119 shutdown 2021-01-03T12:59:02.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 1 -- 172.21.15.133:0/2948760565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x161f750 msgr2=0x16b0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 1 --2- 172.21.15.133:0/2948760565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x161f750 0x16b0ed0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x166c830 tx=0x7f050c020000).stop 2021-01-03T12:59:02.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 1 -- 172.21.15.133:0/2948760565 shutdown_connections 2021-01-03T12:59:02.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 1 --2- 172.21.15.133:0/2948760565 >> [v2:172.21.15.133:6836/1532041867,v1:172.21.15.133:6837/1532041867] conn(0x166dd50 0x16b13c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 1 --2- 172.21.15.133:0/2948760565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1419c00 0x16a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 1 --2- 172.21.15.133:0/2948760565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x161f750 0x16b0ed0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 1 --2- 172.21.15.133:0/2948760565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1487800 0x16a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f04ecff9700 0 client.5119 ms_handle_reset on v2:172.21.15.133:6836/1532041867 2021-01-03T12:59:02.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 1 -- 172.21.15.133:0/2948760565 >> 172.21.15.133:0/2948760565 conn(0x164ef30 msgr2=0x1669ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:02.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 1 -- 172.21.15.133:0/2948760565 shutdown_connections 2021-01-03T12:59:02.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 1 -- 172.21.15.133:0/2948760565 wait complete. 2021-01-03T12:59:02.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.895+0000 7f05267f2740 20 client.5119 trim_cache size 0 max 16384 2021-01-03T12:59:02.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05267f2740 1 Processor -- start 2021-01-03T12:59:02.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05267f2740 1 -- start start 2021-01-03T12:59:02.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05267f2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1419c00 0x16695b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05267f2740 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1487800 0x166a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05267f2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x161f750 0x169c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05267f2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x16663a0 con 0x1419c00 2021-01-03T12:59:02.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05267f2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x166d0d0 con 0x161f750 2021-01-03T12:59:02.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05267f2740 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x166d950 con 0x1487800 2021-01-03T12:59:02.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05163f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x161f750 0x169c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05163f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x161f750 0x169c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33286/0 (socket says 172.21.15.133:33286) 2021-01-03T12:59:02.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05163f4700 1 -- 172.21.15.133:0/460331834 learned_addr learned my addr 172.21.15.133:0/460331834 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:02.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f0515bf3700 1 --2- 172.21.15.133:0/460331834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1419c00 0x16695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05153f2700 1 --2- 172.21.15.133:0/460331834 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1487800 0x166a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05163f4700 1 -- 172.21.15.133:0/460331834 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1487800 msgr2=0x166a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:02.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05163f4700 1 --2- 172.21.15.133:0/460331834 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1487800 0x166a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05163f4700 1 -- 172.21.15.133:0/460331834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1419c00 msgr2=0x16695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:02.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05163f4700 1 --2- 172.21.15.133:0/460331834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1419c00 0x16695b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05163f4700 1 -- 172.21.15.133:0/460331834 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05100b7e00 con 0x161f750 2021-01-03T12:59:02.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05163f4700 1 --2- 172.21.15.133:0/460331834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x161f750 0x169c950 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x169c110 tx=0x7f050c02b070).ready entity=mon.1 client_cookie=674ba8a3132bda51 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:02.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f04eeffd700 1 -- 172.21.15.133:0/460331834 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f050c028670 con 0x161f750 2021-01-03T12:59:02.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f04eeffd700 1 -- 172.21.15.133:0/460331834 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050c0287d0 con 0x161f750 2021-01-03T12:59:02.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f04eeffd700 1 -- 172.21.15.133:0/460331834 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f050c028940 con 0x161f750 2021-01-03T12:59:02.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05267f2740 1 -- 172.21.15.133:0/460331834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x161f750 msgr2=0x169c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:02.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.915+0000 7f05267f2740 1 --2- 172.21.15.133:0/460331834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x161f750 0x169c950 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x169c110 tx=0x7f050c02b070).stop 2021-01-03T12:59:02.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.919+0000 7f05267f2740 1 -- 172.21.15.133:0/460331834 shutdown_connections 2021-01-03T12:59:02.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.919+0000 7f05267f2740 1 --2- 172.21.15.133:0/460331834 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1419c00 0x16695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.919+0000 7f05267f2740 1 --2- 172.21.15.133:0/460331834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x161f750 0x169c950 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.919+0000 7f05267f2740 1 --2- 172.21.15.133:0/460331834 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1487800 0x166a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.919+0000 7f05267f2740 1 -- 172.21.15.133:0/460331834 >> 172.21.15.133:0/460331834 conn(0x164ef30 msgr2=0x166bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:02.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.919+0000 7f05267f2740 1 -- 172.21.15.133:0/460331834 shutdown_connections 2021-01-03T12:59:02.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.919+0000 7f05267f2740 1 -- 172.21.15.133:0/460331834 wait complete. 2021-01-03T12:59:02.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.919+0000 7f05267f2740 1 -- start start 2021-01-03T12:59:02.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.919+0000 7f05267f2740 1 Processor -- start 2021-01-03T12:59:02.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.919+0000 7f05267f2740 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1419c00 0x15965f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.919+0000 7f05267f2740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1487800 0x1702670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.919+0000 7f05267f2740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x161f750 0x16fc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.919+0000 7f05267f2740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x1702d10 con 0x161f750 2021-01-03T12:59:02.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.919+0000 7f05267f2740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1702fb0 con 0x1487800 2021-01-03T12:59:02.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.919+0000 7f05267f2740 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x1703250 con 0x1419c00 2021-01-03T12:59:02.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.919+0000 7f05267f2740 10 client.0 ll_register_callbacks cb 0x166e150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-01-03T12:59:02.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.919+0000 7f05153f2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1487800 0x1702670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f0515bf3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1419c00 0x15965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f0515bf3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1419c00 0x15965f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:41592/0 (socket says 172.21.15.133:41592) 2021-01-03T12:59:02.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f05153f2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1487800 0x1702670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33292/0 (socket says 172.21.15.133:33292) 2021-01-03T12:59:02.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f0515bf3700 1 -- 172.21.15.133:0/1982839013 learned_addr learned my addr 172.21.15.133:0/1982839013 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:02.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f05163f4700 1 --2- 172.21.15.133:0/1982839013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x161f750 0x16fc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f05153f2700 1 -- 172.21.15.133:0/1982839013 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1419c00 msgr2=0x15965f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:02.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f05153f2700 1 --2- 172.21.15.133:0/1982839013 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1419c00 0x15965f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f05153f2700 1 -- 172.21.15.133:0/1982839013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x161f750 msgr2=0x16fc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:02.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f05153f2700 1 --2- 172.21.15.133:0/1982839013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x161f750 0x16fc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:02.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f05153f2700 1 -- 172.21.15.133:0/1982839013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1442e50 con 0x1487800 2021-01-03T12:59:02.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f05153f2700 1 --2- 172.21.15.133:0/1982839013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1487800 0x1702670 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f050801a000 tx=0x7f0508018040).ready entity=mon.1 client_cookie=88921ec0bffbbcc6 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:02.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f04edffb700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2021-01-03T12:59:02.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f04edffb700 1 -- 172.21.15.133:0/1982839013 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0508014840 con 0x1487800 2021-01-03T12:59:02.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f04edffb700 1 -- 172.21.15.133:0/1982839013 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f05080149a0 con 0x1487800 2021-01-03T12:59:02.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f05267f2740 1 -- 172.21.15.133:0/1982839013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x14cb710 con 0x1487800 2021-01-03T12:59:02.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f04edffb700 1 -- 172.21.15.133:0/1982839013 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0508014b60 con 0x1487800 2021-01-03T12:59:02.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f05267f2740 10 client.5125 fetch_fsmap learned FSMap version 10 2021-01-03T12:59:02.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f05267f2740 1 -- 172.21.15.133:0/1982839013 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x16fc8a0 con 0x1487800 2021-01-03T12:59:02.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f04edffb700 1 -- 172.21.15.133:0/1982839013 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x14cb710 con 0x1487800 2021-01-03T12:59:02.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f04edffb700 1 -- 172.21.15.133:0/1982839013 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 10) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f0508022040 con 0x1487800 2021-01-03T12:59:02.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f05267f2740 10 client.5125 fetch_fsmap finished waiting for FSMap version 10 2021-01-03T12:59:02.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f05267f2740 10 client.5125 resolve_mds: resolved ID 'a' to GID 4888 2021-01-03T12:59:02.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f05267f2740 20 client.5125 populate_metadata read hostname 'smithi133' 2021-01-03T12:59:02.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f05267f2740 1 --2- 172.21.15.133:0/1982839013 >> [v2:172.21.15.133:6836/1532041867,v1:172.21.15.133:6837/1532041867] conn(0x16ff430 0x16ff810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:02.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f05267f2740 4 client.5125 mds_command: new command op to 4888 tid=0[{"prefix": "cache drop"}] 2021-01-03T12:59:02.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f05267f2740 1 -- 172.21.15.133:0/1982839013 --> [v2:172.21.15.133:6836/1532041867,v1:172.21.15.133:6837/1532041867] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x1419150 con 0x16ff430 2021-01-03T12:59:02.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f0515bf3700 1 --2- 172.21.15.133:0/1982839013 >> [v2:172.21.15.133:6836/1532041867,v1:172.21.15.133:6837/1532041867] conn(0x16ff430 0x16ff810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:02.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f04edffb700 10 client.5125 ms_handle_connect on v2:172.21.15.133:6836/1532041867 2021-01-03T12:59:02.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:02.923+0000 7f0515bf3700 1 --2- 172.21.15.133:0/1982839013 >> [v2:172.21.15.133:6836/1532041867,v1:172.21.15.133:6837/1532041867] conn(0x16ff430 0x16ff810 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=cc3cc784a3addbc9 server_cookie=acc4d48829a9c5b8 in_seq=0 out_seq=0 2021-01-03T12:59:06.764 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:59:06.766 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:59:06.769 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:59:06.771 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:59:36.912 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:59:36.915 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:59:36.917 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:59:36.919 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T12:59:47.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f04edffb700 1 -- 172.21.15.133:0/1982839013 <== mds.0 v2:172.21.15.133:6836/1532041867 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+386 (crc 0 0 0) 0x1419150 con 0x16ff430 2021-01-03T12:59:47.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f04edffb700 10 client.5125 handle_command_reply: tid=0 2021-01-03T12:59:47.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f05267f2740 1 client.5125 shutdown 2021-01-03T12:59:47.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f05267f2740 1 -- 172.21.15.133:0/1982839013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1487800 msgr2=0x1702670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:47.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f05267f2740 1 --2- 172.21.15.133:0/1982839013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1487800 0x1702670 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f050801a000 tx=0x7f0508018040).stop 2021-01-03T12:59:47.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f05267f2740 1 -- 172.21.15.133:0/1982839013 shutdown_connections 2021-01-03T12:59:47.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f05267f2740 1 --2- 172.21.15.133:0/1982839013 >> [v2:172.21.15.133:6836/1532041867,v1:172.21.15.133:6837/1532041867] conn(0x16ff430 0x16ff810 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:47.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f05267f2740 1 --2- 172.21.15.133:0/1982839013 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x161f750 0x16fc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:47.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f05267f2740 1 --2- 172.21.15.133:0/1982839013 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1419c00 0x15965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:47.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f05267f2740 1 --2- 172.21.15.133:0/1982839013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1487800 0x1702670 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:47.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f05267f2740 1 -- 172.21.15.133:0/1982839013 >> 172.21.15.133:0/1982839013 conn(0x164ef30 msgr2=0x169eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:47.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f04edffb700 0 client.5125 ms_handle_reset on v2:172.21.15.133:6836/1532041867 2021-01-03T12:59:47.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f05267f2740 1 -- 172.21.15.133:0/1982839013 shutdown_connections 2021-01-03T12:59:47.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f05267f2740 1 -- 172.21.15.133:0/1982839013 wait complete. 2021-01-03T12:59:47.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f05267f2740 20 client.5125 trim_cache size 0 max 16384 2021-01-03T12:59:47.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f0516bf5700 1 -- 172.21.15.133:0/540438978 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f04f0055330 msgr2=0x7f04f00577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:47.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f0516bf5700 1 --2- 172.21.15.133:0/540438978 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f04f0055330 0x7f04f00577f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f050800b000 tx=0x7f0508008040).stop 2021-01-03T12:59:47.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f0516bf5700 1 -- 172.21.15.133:0/540438978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05100b4980 msgr2=0x7f051013c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:47.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f0516bf5700 1 --2- 172.21.15.133:0/540438978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05100b4980 0x7f051013c250 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f0500006910 tx=0x7f0500008040).stop 2021-01-03T12:59:47.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f0516bf5700 1 -- 172.21.15.133:0/540438978 shutdown_connections 2021-01-03T12:59:47.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f0516bf5700 1 --2- 172.21.15.133:0/540438978 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f04f0055330 0x7f04f00577f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:47.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f0516bf5700 1 --2- 172.21.15.133:0/540438978 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0510146430 0x7f0510148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:47.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f0516bf5700 1 --2- 172.21.15.133:0/540438978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05100b4980 0x7f051013c250 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:47.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f0516bf5700 1 --2- 172.21.15.133:0/540438978 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05100b9b60 0x7f05100b8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:47.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f0516bf5700 1 -- 172.21.15.133:0/540438978 >> 172.21.15.133:0/540438978 conn(0x7f05100b69e0 msgr2=0x7f0510062850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:47.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f0516bf5700 1 -- 172.21.15.133:0/540438978 shutdown_connections 2021-01-03T12:59:47.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.399+0000 7f0516bf5700 1 -- 172.21.15.133:0/540438978 wait complete. 2021-01-03T12:59:47.406 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T12:59:47.406 INFO:teuthology.orchestra.run.smithi133.stdout: "client_recall": { 2021-01-03T12:59:47.407 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0, 2021-01-03T12:59:47.407 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "(0) Success", 2021-01-03T12:59:47.407 INFO:teuthology.orchestra.run.smithi133.stdout: "recalled": 920 2021-01-03T12:59:47.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:47.407 INFO:teuthology.orchestra.run.smithi133.stdout: "flush_journal": { 2021-01-03T12:59:47.408 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0, 2021-01-03T12:59:47.408 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "" 2021-01-03T12:59:47.408 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:47.409 INFO:teuthology.orchestra.run.smithi133.stdout: "trim_cache": { 2021-01-03T12:59:47.409 INFO:teuthology.orchestra.run.smithi133.stdout: "trimmed": 900 2021-01-03T12:59:47.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:47.410 INFO:teuthology.orchestra.run.smithi133.stdout: "cache": { 2021-01-03T12:59:47.410 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": { 2021-01-03T12:59:47.411 INFO:teuthology.orchestra.run.smithi133.stdout: "items": 2511, 2021-01-03T12:59:47.411 INFO:teuthology.orchestra.run.smithi133.stdout: "bytes": 431808 2021-01-03T12:59:47.412 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:47.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:47.412 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 44.473032484000001 2021-01-03T12:59:47.413 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T12:59:47.415 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T12:59:47.415 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T12:59:47.436 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T12:59:47.453 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T12:59:47.471 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T12:59:47.490 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T12:59:47.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:59:47.491 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T12:59:47.492 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:59:47.501 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T12:59:47.502 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T12:59:47.502 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T12:59:47.503 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T12:59:47.503 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:59:47.585 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[11646]: fuse finished with error 0 and tester_r 0 2021-01-03T12:59:47.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:59:47.587 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T12:59:47.587 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:59:47.633 INFO:teuthology.orchestra.run.smithi007.stdout:ext2/ext3 2021-01-03T12:59:47.634 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T12:59:47.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T12:59:47.653 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:59:47.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:59:47.703 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T12:59:47.703 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T12:59:47.710 INFO:teuthology.orchestra.run.smithi036.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T12:59:47.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T12:59:47.712 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-01-03T12:59:47.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T12:59:47.713 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T12:59:47.759 INFO:teuthology.orchestra.run.smithi036.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T12:59:47.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T12:59:47.760 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-01-03T12:59:47.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.879+0000 7f1b73ed6700 1 Processor -- start 2021-01-03T12:59:47.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b73ed6700 1 -- start start 2021-01-03T12:59:47.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b73ed6700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1b6c0b35a0 0x7f1b6c0b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:47.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b73ed6700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1b6c0ac5c0 0x7f1b6c09a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b73ed6700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b6c09ac30 con 0x7f1b6c0b3d80 2021-01-03T12:59:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b73ed6700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6c09aec0 con 0x7f1b6c0ac5c0 2021-01-03T12:59:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b73ed6700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c09b160 con 0x7f1b6c0b35a0 2021-01-03T12:59:47.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b71471700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1b6c0b35a0 0x7f1b6c0b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b72473700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1b6c0ac5c0 0x7f1b6c09a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b71c72700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1b6c0b3d80 0x7f1b6c144830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:33060/0 (socket says 172.21.15.133:33060) 2021-01-03T12:59:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b71c72700 1 -- 172.21.15.133:0/2450545128 learned_addr learned my addr 172.21.15.133:0/2450545128 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:59:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b72473700 1 -- 172.21.15.133:0/2450545128 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1b6c0b35a0 msgr2=0x7f1b6c0b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b72473700 1 --2- 172.21.15.133:0/2450545128 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1b6c0b35a0 0x7f1b6c0b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b72473700 1 -- 172.21.15.133:0/2450545128 >> v1:172.21.15.16:6789/0 conn(0x7f1b6c0b3d80 legacy=0x7f1b6c144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b72473700 1 -- 172.21.15.133:0/2450545128 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6c1440f0 con 0x7f1b6c0ac5c0 2021-01-03T12:59:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b72473700 1 --2- 172.21.15.133:0/2450545128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b6c0ac5c0 0x7f1b6c09a740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f1b6c140b50 tx=0x7f1b640091a0).ready entity=mon.0 client_cookie=28bd661a31ff7e9a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b70c70700 1 -- 172.21.15.133:0/2450545128 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b6400b9b0 con 0x7f1b6c0ac5c0 2021-01-03T12:59:47.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b70c70700 1 -- 172.21.15.133:0/2450545128 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6400bb10 con 0x7f1b6c0ac5c0 2021-01-03T12:59:47.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b70c70700 1 -- 172.21.15.133:0/2450545128 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b6400bc80 con 0x7f1b6c0ac5c0 2021-01-03T12:59:47.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b73ed6700 1 -- 172.21.15.133:0/2450545128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b6c0ac5c0 msgr2=0x7f1b6c09a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:47.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.883+0000 7f1b73ed6700 1 --2- 172.21.15.133:0/2450545128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b6c0ac5c0 0x7f1b6c09a740 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f1b6c140b50 tx=0x7f1b640091a0).stop 2021-01-03T12:59:47.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b73ed6700 1 -- 172.21.15.133:0/2450545128 shutdown_connections 2021-01-03T12:59:47.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b73ed6700 1 --2- 172.21.15.133:0/2450545128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b6c0ac5c0 0x7f1b6c09a740 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:47.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b73ed6700 1 --2- 172.21.15.133:0/2450545128 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1b6c0b35a0 0x7f1b6c0b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:47.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b73ed6700 1 -- 172.21.15.133:0/2450545128 >> 172.21.15.133:0/2450545128 conn(0x7f1b6c05bdf0 msgr2=0x7f1b6c05c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:47.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b73ed6700 1 -- 172.21.15.133:0/2450545128 shutdown_connections 2021-01-03T12:59:47.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b73ed6700 1 -- 172.21.15.133:0/2450545128 wait complete. 2021-01-03T12:59:47.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b73ed6700 1 Processor -- start 2021-01-03T12:59:47.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b73ed6700 1 -- start start 2021-01-03T12:59:47.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b73ed6700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b6c0ac5c0 0x7f1b6c064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:47.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b73ed6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b6c0b35a0 0x7f1b6c147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:47.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b73ed6700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1b6c0b3d80 0x7f1b6c0b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:47.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b73ed6700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c0b5910 con 0x7f1b6c0ac5c0 2021-01-03T12:59:47.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b73ed6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c0b6c50 con 0x7f1b6c0b35a0 2021-01-03T12:59:47.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b73ed6700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6c063070 con 0x7f1b6c0b3d80 2021-01-03T12:59:47.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b71471700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b6c0b35a0 0x7f1b6c147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:47.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b71471700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b6c0b35a0 0x7f1b6c147750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33308/0 (socket says 172.21.15.133:33308) 2021-01-03T12:59:47.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b71471700 1 -- 172.21.15.133:0/3306414632 learned_addr learned my addr 172.21.15.133:0/3306414632 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:47.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b72473700 1 --2- 172.21.15.133:0/3306414632 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1b6c0b3d80 0x7f1b6c0b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:47.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.887+0000 7f1b71c72700 1 --2- 172.21.15.133:0/3306414632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b6c0ac5c0 0x7f1b6c064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:47.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.891+0000 7f1b71471700 1 -- 172.21.15.133:0/3306414632 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1b6c0b3d80 msgr2=0x7f1b6c0b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:47.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.891+0000 7f1b71471700 1 --2- 172.21.15.133:0/3306414632 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1b6c0b3d80 0x7f1b6c0b63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:47.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.891+0000 7f1b71471700 1 -- 172.21.15.133:0/3306414632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b6c0ac5c0 msgr2=0x7f1b6c064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:47.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.891+0000 7f1b71471700 1 --2- 172.21.15.133:0/3306414632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b6c0ac5c0 0x7f1b6c064ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:47.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.891+0000 7f1b71471700 1 -- 172.21.15.133:0/3306414632 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6c0632a0 con 0x7f1b6c0b35a0 2021-01-03T12:59:47.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.891+0000 7f1b71c72700 1 --2- 172.21.15.133:0/3306414632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b6c0ac5c0 0x7f1b6c064ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:59:47.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.891+0000 7f1b71471700 1 --2- 172.21.15.133:0/3306414632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b6c0b35a0 0x7f1b6c147750 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f1b6c0b7d60 tx=0x7f1b68006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:47.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.891+0000 7f1b5affd700 1 -- 172.21.15.133:0/3306414632 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b6800ca10 con 0x7f1b6c0b35a0 2021-01-03T12:59:47.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.891+0000 7f1b5affd700 1 -- 172.21.15.133:0/3306414632 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6800cb70 con 0x7f1b6c0b35a0 2021-01-03T12:59:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.891+0000 7f1b5affd700 1 -- 172.21.15.133:0/3306414632 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b6800ced0 con 0x7f1b6c0b35a0 2021-01-03T12:59:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.891+0000 7f1b73ed6700 1 -- 172.21.15.133:0/3306414632 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6c148030 con 0x7f1b6c0b35a0 2021-01-03T12:59:47.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.891+0000 7f1b73ed6700 1 -- 172.21.15.133:0/3306414632 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b6c0b6890 con 0x7f1b6c0b35a0 2021-01-03T12:59:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.891+0000 7f1b73ed6700 1 -- 172.21.15.133:0/3306414632 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b6c057300 con 0x7f1b6c0b35a0 2021-01-03T12:59:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.891+0000 7f1b5affd700 1 -- 172.21.15.133:0/3306414632 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1b6801c460 con 0x7f1b6c0b35a0 2021-01-03T12:59:47.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.891+0000 7f1b5affd700 1 --2- 172.21.15.133:0/3306414632 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1b4c0553b0 0x7f1b4c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:47.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.891+0000 7f1b5affd700 1 -- 172.21.15.133:0/3306414632 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1b6806e4b0 con 0x7f1b6c0b35a0 2021-01-03T12:59:47.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.891+0000 7f1b71c72700 1 --2- 172.21.15.133:0/3306414632 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1b4c0553b0 0x7f1b4c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:47.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.895+0000 7f1b71c72700 1 --2- 172.21.15.133:0/3306414632 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1b4c0553b0 0x7f1b4c057870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f1b5c00b000 tx=0x7f1b5c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:47.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:47.899+0000 7f1b5affd700 1 -- 172.21.15.133:0/3306414632 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1b680446b0 con 0x7f1b6c0b35a0 2021-01-03T12:59:48.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.039+0000 7f1b73ed6700 1 -- 172.21.15.133:0/3306414632 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1b6c05ce00 con 0x7f1b6c0b35a0 2021-01-03T12:59:48.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.051+0000 7f1b5affd700 1 -- 172.21.15.133:0/3306414632 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1b68047cd0 con 0x7f1b6c0b35a0 2021-01-03T12:59:48.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.051+0000 7f1b73ed6700 1 -- 172.21.15.133:0/3306414632 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1b4c0553b0 msgr2=0x7f1b4c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:48.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.051+0000 7f1b73ed6700 1 --2- 172.21.15.133:0/3306414632 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1b4c0553b0 0x7f1b4c057870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f1b5c00b000 tx=0x7f1b5c009040).stop 2021-01-03T12:59:48.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.051+0000 7f1b73ed6700 1 -- 172.21.15.133:0/3306414632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b6c0b35a0 msgr2=0x7f1b6c147750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:48.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.051+0000 7f1b73ed6700 1 --2- 172.21.15.133:0/3306414632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b6c0b35a0 0x7f1b6c147750 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f1b6c0b7d60 tx=0x7f1b68006dc0).stop 2021-01-03T12:59:48.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.051+0000 7f1b73ed6700 1 -- 172.21.15.133:0/3306414632 shutdown_connections 2021-01-03T12:59:48.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.051+0000 7f1b73ed6700 1 --2- 172.21.15.133:0/3306414632 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1b4c0553b0 0x7f1b4c057870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:48.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.051+0000 7f1b73ed6700 1 --2- 172.21.15.133:0/3306414632 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1b6c0ac5c0 0x7f1b6c064ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:48.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.051+0000 7f1b73ed6700 1 --2- 172.21.15.133:0/3306414632 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1b6c0b3d80 0x7f1b6c0b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:48.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.051+0000 7f1b73ed6700 1 --2- 172.21.15.133:0/3306414632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b6c0b35a0 0x7f1b6c147750 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:48.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.051+0000 7f1b73ed6700 1 -- 172.21.15.133:0/3306414632 >> 172.21.15.133:0/3306414632 conn(0x7f1b6c05bdf0 msgr2=0x7f1b6c140060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:48.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.051+0000 7f1b73ed6700 1 -- 172.21.15.133:0/3306414632 shutdown_connections 2021-01-03T12:59:48.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.055+0000 7f1b73ed6700 1 -- 172.21.15.133:0/3306414632 wait complete. 2021-01-03T12:59:48.067 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2021-01-03T12:59:48.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bea6d700 1 Processor -- start 2021-01-03T12:59:48.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bea6d700 1 -- start start 2021-01-03T12:59:48.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bea6d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f33b80b9b60 0x7f33b80b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:48.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bea6d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f33b80b4980 0x7f33b80b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:48.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bea6d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b80605f0 con 0x7f33b8146430 2021-01-03T12:59:48.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bea6d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b80aed30 con 0x7f33b80b9b60 2021-01-03T12:59:48.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bea6d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b8146fd0 con 0x7f33b80b4980 2021-01-03T12:59:48.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bda6b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f33b80b9b60 0x7f33b80b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:48.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bda6b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f33b80b9b60 0x7f33b80b9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33314/0 (socket says 172.21.15.133:33314) 2021-01-03T12:59:48.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bda6b700 1 -- 172.21.15.133:0/2640560971 learned_addr learned my addr 172.21.15.133:0/2640560971 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:48.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bd26a700 1 --2- 172.21.15.133:0/2640560971 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f33b80b4980 0x7f33b80b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:48.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bda6b700 1 -- 172.21.15.133:0/2640560971 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f33b80b4980 msgr2=0x7f33b80b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:48.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bda6b700 1 --2- 172.21.15.133:0/2640560971 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f33b80b4980 0x7f33b80b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:48.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bda6b700 1 -- 172.21.15.133:0/2640560971 >> v1:172.21.15.16:6789/0 conn(0x7f33b8146430 legacy=0x7f33b81468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:48.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bda6b700 1 -- 172.21.15.133:0/2640560971 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b80600b0 con 0x7f33b80b9b60 2021-01-03T12:59:48.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bd26a700 1 --2- 172.21.15.133:0/2640560971 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f33b80b4980 0x7f33b80b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:59:48.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bda6b700 1 --2- 172.21.15.133:0/2640560971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33b80b9b60 0x7f33b80b9f40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f33b80af260 tx=0x7f33a8009270).ready entity=mon.1 client_cookie=ac28a5601062ab88 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:48.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bca69700 1 -- 172.21.15.133:0/2640560971 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33a800bbc0 con 0x7f33b80b9b60 2021-01-03T12:59:48.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bca69700 1 -- 172.21.15.133:0/2640560971 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a800bd20 con 0x7f33b80b9b60 2021-01-03T12:59:48.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bea6d700 1 -- 172.21.15.133:0/2640560971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33b80b9b60 msgr2=0x7f33b80b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:48.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bca69700 1 -- 172.21.15.133:0/2640560971 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33a8011400 con 0x7f33b80b9b60 2021-01-03T12:59:48.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.175+0000 7f33bea6d700 1 --2- 172.21.15.133:0/2640560971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33b80b9b60 0x7f33b80b9f40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f33b80af260 tx=0x7f33a8009270).stop 2021-01-03T12:59:48.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33bea6d700 1 -- 172.21.15.133:0/2640560971 shutdown_connections 2021-01-03T12:59:48.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33bea6d700 1 --2- 172.21.15.133:0/2640560971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33b80b9b60 0x7f33b80b9f40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:48.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33bea6d700 1 --2- 172.21.15.133:0/2640560971 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f33b80b4980 0x7f33b80b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:48.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33bea6d700 1 -- 172.21.15.133:0/2640560971 >> 172.21.15.133:0/2640560971 conn(0x7f33b80b69e0 msgr2=0x7f33b80b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:48.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33bea6d700 1 -- 172.21.15.133:0/2640560971 shutdown_connections 2021-01-03T12:59:48.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33bea6d700 1 -- 172.21.15.133:0/2640560971 wait complete. 2021-01-03T12:59:48.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33bea6d700 1 Processor -- start 2021-01-03T12:59:48.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33bea6d700 1 -- start start 2021-01-03T12:59:48.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33bea6d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33b80b4980 0x7f33b80b8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:48.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33bea6d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f33b80b9b60 0x7f33b809cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:48.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33bea6d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33b8146430 0x7f33b81481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:48.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33bea6d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b809efe0 con 0x7f33b80b4980 2021-01-03T12:59:48.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33bea6d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b809dbd0 con 0x7f33b8146430 2021-01-03T12:59:48.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33bea6d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b809eb40 con 0x7f33b80b9b60 2021-01-03T12:59:48.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33be26c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33b8146430 0x7f33b81481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:48.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33bda6b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33b80b4980 0x7f33b80b8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:48.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33be26c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33b8146430 0x7f33b81481b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33324/0 (socket says 172.21.15.133:33324) 2021-01-03T12:59:48.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33be26c700 1 -- 172.21.15.133:0/3724709158 learned_addr learned my addr 172.21.15.133:0/3724709158 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:48.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.179+0000 7f33bd26a700 1 --2- 172.21.15.133:0/3724709158 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f33b80b9b60 0x7f33b809cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:48.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.183+0000 7f33be26c700 1 -- 172.21.15.133:0/3724709158 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f33b80b9b60 msgr2=0x7f33b809cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:48.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.183+0000 7f33be26c700 1 --2- 172.21.15.133:0/3724709158 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f33b80b9b60 0x7f33b809cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:48.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.183+0000 7f33be26c700 1 -- 172.21.15.133:0/3724709158 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33b80b4980 msgr2=0x7f33b80b8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:48.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.183+0000 7f33be26c700 1 --2- 172.21.15.133:0/3724709158 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33b80b4980 0x7f33b80b8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:48.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.183+0000 7f33be26c700 1 -- 172.21.15.133:0/3724709158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b809ca50 con 0x7f33b8146430 2021-01-03T12:59:48.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.183+0000 7f33be26c700 1 --2- 172.21.15.133:0/3724709158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33b8146430 0x7f33b81481b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f33b0002ef0 tx=0x7f33b0006cc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:48.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.183+0000 7f33b6ffd700 1 -- 172.21.15.133:0/3724709158 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33b0002320 con 0x7f33b8146430 2021-01-03T12:59:48.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.183+0000 7f33bea6d700 1 -- 172.21.15.133:0/3724709158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b80b1dd0 con 0x7f33b8146430 2021-01-03T12:59:48.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.183+0000 7f33bea6d700 1 -- 172.21.15.133:0/3724709158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b809d490 con 0x7f33b8146430 2021-01-03T12:59:48.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.183+0000 7f33b6ffd700 1 -- 172.21.15.133:0/3724709158 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b0000e90 con 0x7f33b8146430 2021-01-03T12:59:48.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.183+0000 7f33b6ffd700 1 -- 172.21.15.133:0/3724709158 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33b0002670 con 0x7f33b8146430 2021-01-03T12:59:48.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.183+0000 7f33bea6d700 1 -- 172.21.15.133:0/3724709158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b8057300 con 0x7f33b8146430 2021-01-03T12:59:48.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.183+0000 7f33b6ffd700 1 -- 172.21.15.133:0/3724709158 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f33b000f030 con 0x7f33b8146430 2021-01-03T12:59:48.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.183+0000 7f33b6ffd700 1 --2- 172.21.15.133:0/3724709158 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3398055330 0x7f33980577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:48.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.183+0000 7f33bda6b700 1 --2- 172.21.15.133:0/3724709158 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3398055330 0x7f33980577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:48.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.183+0000 7f33b6ffd700 1 -- 172.21.15.133:0/3724709158 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f33b006daf0 con 0x7f33b8146430 2021-01-03T12:59:48.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.187+0000 7f33bda6b700 1 --2- 172.21.15.133:0/3724709158 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3398055330 0x7f33980577f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f33a801a000 tx=0x7f33a8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:48.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.191+0000 7f33b6ffd700 1 -- 172.21.15.133:0/3724709158 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f33b0043c60 con 0x7f33b8146430 2021-01-03T12:59:48.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:48.379+0000 7f33bea6d700 1 -- 172.21.15.133:0/3724709158 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f33b8067a00 con 0x7f33b8146430 2021-01-03T12:59:49.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.207+0000 7f33b6ffd700 1 -- 172.21.15.133:0/3724709158 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v96) v1 ==== 139+0+0 (secure 0 0 0) 0x7f33b0047280 con 0x7f33b8146430 2021-01-03T12:59:49.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.211+0000 7f33bea6d700 1 -- 172.21.15.133:0/3724709158 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3398055330 msgr2=0x7f33980577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:49.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.211+0000 7f33bea6d700 1 --2- 172.21.15.133:0/3724709158 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3398055330 0x7f33980577f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f33a801a000 tx=0x7f33a8016000).stop 2021-01-03T12:59:49.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.211+0000 7f33bea6d700 1 -- 172.21.15.133:0/3724709158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33b8146430 msgr2=0x7f33b81481b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:49.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.211+0000 7f33bea6d700 1 --2- 172.21.15.133:0/3724709158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33b8146430 0x7f33b81481b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f33b0002ef0 tx=0x7f33b0006cc0).stop 2021-01-03T12:59:49.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.211+0000 7f33bea6d700 1 -- 172.21.15.133:0/3724709158 shutdown_connections 2021-01-03T12:59:49.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.211+0000 7f33bea6d700 1 --2- 172.21.15.133:0/3724709158 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3398055330 0x7f33980577f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:49.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.211+0000 7f33bea6d700 1 --2- 172.21.15.133:0/3724709158 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f33b80b4980 0x7f33b80b8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:49.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.211+0000 7f33bea6d700 1 --2- 172.21.15.133:0/3724709158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33b8146430 0x7f33b81481b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:49.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.211+0000 7f33bea6d700 1 --2- 172.21.15.133:0/3724709158 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f33b80b9b60 0x7f33b809cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:49.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.211+0000 7f33bea6d700 1 -- 172.21.15.133:0/3724709158 >> 172.21.15.133:0/3724709158 conn(0x7f33b80b69e0 msgr2=0x7f33b805bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:49.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.211+0000 7f33bea6d700 1 -- 172.21.15.133:0/3724709158 shutdown_connections 2021-01-03T12:59:49.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.211+0000 7f33bea6d700 1 -- 172.21.15.133:0/3724709158 wait complete. 2021-01-03T12:59:49.228 INFO:tasks.cephfs_test_runner:test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-01-03T12:59:49.229 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) 2021-01-03T12:59:49.230 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-01-03T12:59:49.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.347+0000 7fef46e3e700 1 Processor -- start 2021-01-03T12:59:49.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.347+0000 7fef46e3e700 1 -- start start 2021-01-03T12:59:49.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef46e3e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef400b9b60 0x7fef400b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:49.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef46e3e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fef400b4e10 0x7fef40146b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:49.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef46e3e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef40147030 con 0x7fef400b4980 2021-01-03T12:59:49.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef46e3e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef400aed30 con 0x7fef400b4e10 2021-01-03T12:59:49.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef46e3e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef400605f0 con 0x7fef400b9b60 2021-01-03T12:59:49.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef45e3c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef400b9b60 0x7fef400b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:49.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef45e3c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef400b9b60 0x7fef400b9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33328/0 (socket says 172.21.15.133:33328) 2021-01-03T12:59:49.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef45e3c700 1 -- 172.21.15.133:0/1968535759 learned_addr learned my addr 172.21.15.133:0/1968535759 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:49.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef4663d700 1 --2- 172.21.15.133:0/1968535759 >> v2:172.21.15.16:3300/0 conn(0x7fef400b4e10 0x7fef40146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:49.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef45e3c700 1 -- 172.21.15.133:0/1968535759 >> v2:172.21.15.16:3300/0 conn(0x7fef400b4e10 msgr2=0x7fef40146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:49.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef45e3c700 1 --2- 172.21.15.133:0/1968535759 >> v2:172.21.15.16:3300/0 conn(0x7fef400b4e10 0x7fef40146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:49.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef45e3c700 1 -- 172.21.15.133:0/1968535759 >> v1:172.21.15.16:6789/0 conn(0x7fef400b4980 legacy=0x7fef40146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:49.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef45e3c700 1 -- 172.21.15.133:0/1968535759 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef400600b0 con 0x7fef400b9b60 2021-01-03T12:59:49.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef45e3c700 1 --2- 172.21.15.133:0/1968535759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef400b9b60 0x7fef400b9f40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fef34002f30 tx=0x7fef34006e80).ready entity=mon.1 client_cookie=4f41b6cb898a5138 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:49.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef44e3a700 1 -- 172.21.15.133:0/1968535759 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef340097f0 con 0x7fef400b9b60 2021-01-03T12:59:49.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef44e3a700 1 -- 172.21.15.133:0/1968535759 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef34009950 con 0x7fef400b9b60 2021-01-03T12:59:49.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef44e3a700 1 -- 172.21.15.133:0/1968535759 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef34009cb0 con 0x7fef400b9b60 2021-01-03T12:59:49.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef46e3e700 1 -- 172.21.15.133:0/1968535759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef400b9b60 msgr2=0x7fef400b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:49.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef46e3e700 1 --2- 172.21.15.133:0/1968535759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef400b9b60 0x7fef400b9f40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fef34002f30 tx=0x7fef34006e80).stop 2021-01-03T12:59:49.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef46e3e700 1 -- 172.21.15.133:0/1968535759 shutdown_connections 2021-01-03T12:59:49.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef46e3e700 1 --2- 172.21.15.133:0/1968535759 >> v2:172.21.15.16:3300/0 conn(0x7fef400b4e10 0x7fef40146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:49.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef46e3e700 1 --2- 172.21.15.133:0/1968535759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef400b9b60 0x7fef400b9f40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:49.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef46e3e700 1 -- 172.21.15.133:0/1968535759 >> 172.21.15.133:0/1968535759 conn(0x7fef400b69e0 msgr2=0x7fef400b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:49.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef46e3e700 1 -- 172.21.15.133:0/1968535759 shutdown_connections 2021-01-03T12:59:49.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.351+0000 7fef46e3e700 1 -- 172.21.15.133:0/1968535759 wait complete. 2021-01-03T12:59:49.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef46e3e700 1 Processor -- start 2021-01-03T12:59:49.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef46e3e700 1 -- start start 2021-01-03T12:59:49.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef46e3e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef400b4980 0x7fef400b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:49.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef46e3e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef400b4e10 0x7fef40152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:49.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef46e3e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef400b9b60 0x7fef4009d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:49.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef46e3e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef40151990 con 0x7fef400b4e10 2021-01-03T12:59:49.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef46e3e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef40151b80 con 0x7fef400b9b60 2021-01-03T12:59:49.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef46e3e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef40151e20 con 0x7fef400b4980 2021-01-03T12:59:49.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef4663d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef400b9b60 0x7fef4009d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:49.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef45e3c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef400b4980 0x7fef400b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:49.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef4663d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef400b9b60 0x7fef4009d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33338/0 (socket says 172.21.15.133:33338) 2021-01-03T12:59:49.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef4663d700 1 -- 172.21.15.133:0/4124089101 learned_addr learned my addr 172.21.15.133:0/4124089101 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:49.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef45e3c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef400b4980 0x7fef400b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:41636/0 (socket says 172.21.15.133:41636) 2021-01-03T12:59:49.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef4563b700 1 --2- 172.21.15.133:0/4124089101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef400b4e10 0x7fef40152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:49.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef4663d700 1 -- 172.21.15.133:0/4124089101 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef400b4980 msgr2=0x7fef400b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:49.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef4663d700 1 --2- 172.21.15.133:0/4124089101 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef400b4980 0x7fef400b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:49.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef4663d700 1 -- 172.21.15.133:0/4124089101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef400b4e10 msgr2=0x7fef40152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:49.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef4663d700 1 --2- 172.21.15.133:0/4124089101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef400b4e10 0x7fef40152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:49.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef4663d700 1 -- 172.21.15.133:0/4124089101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef401520c0 con 0x7fef400b9b60 2021-01-03T12:59:49.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef4663d700 1 --2- 172.21.15.133:0/4124089101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef400b9b60 0x7fef4009d6b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fef400b15f0 tx=0x7fef380091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:49.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef32ffd700 1 -- 172.21.15.133:0/4124089101 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef3800ee60 con 0x7fef400b9b60 2021-01-03T12:59:49.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef32ffd700 1 -- 172.21.15.133:0/4124089101 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3800cb00 con 0x7fef400b9b60 2021-01-03T12:59:49.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef32ffd700 1 -- 172.21.15.133:0/4124089101 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef3800ce60 con 0x7fef400b9b60 2021-01-03T12:59:49.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef46e3e700 1 -- 172.21.15.133:0/4124089101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4009ca60 con 0x7fef400b9b60 2021-01-03T12:59:49.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.355+0000 7fef46e3e700 1 -- 172.21.15.133:0/4124089101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef400b2380 con 0x7fef400b9b60 2021-01-03T12:59:49.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.359+0000 7fef46e3e700 1 -- 172.21.15.133:0/4124089101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef40057300 con 0x7fef400b9b60 2021-01-03T12:59:49.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.359+0000 7fef32ffd700 1 -- 172.21.15.133:0/4124089101 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fef38022070 con 0x7fef400b9b60 2021-01-03T12:59:49.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.359+0000 7fef32ffd700 1 --2- 172.21.15.133:0/4124089101 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef200554e0 0x7fef200579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:49.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.359+0000 7fef32ffd700 1 -- 172.21.15.133:0/4124089101 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fef3806e630 con 0x7fef400b9b60 2021-01-03T12:59:49.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.359+0000 7fef45e3c700 1 --2- 172.21.15.133:0/4124089101 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef200554e0 0x7fef200579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:49.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.359+0000 7fef45e3c700 1 --2- 172.21.15.133:0/4124089101 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef200554e0 0x7fef200579a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fef3401c000 tx=0x7fef34015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:49.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.367+0000 7fef32ffd700 1 -- 172.21.15.133:0/4124089101 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fef38044890 con 0x7fef400b9b60 2021-01-03T12:59:49.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:49.555+0000 7fef46e3e700 1 -- 172.21.15.133:0/4124089101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7fef40067a00 con 0x7fef400b9b60 2021-01-03T12:59:50.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.211+0000 7fef32ffd700 1 -- 172.21.15.133:0/4124089101 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v97) v1 ==== 147+0+0 (secure 0 0 0) 0x7fef38016070 con 0x7fef400b9b60 2021-01-03T12:59:50.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.211+0000 7fef46e3e700 1 -- 172.21.15.133:0/4124089101 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef200554e0 msgr2=0x7fef200579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:50.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.211+0000 7fef46e3e700 1 --2- 172.21.15.133:0/4124089101 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef200554e0 0x7fef200579a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fef3401c000 tx=0x7fef34015000).stop 2021-01-03T12:59:50.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.211+0000 7fef46e3e700 1 -- 172.21.15.133:0/4124089101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef400b9b60 msgr2=0x7fef4009d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:50.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.211+0000 7fef46e3e700 1 --2- 172.21.15.133:0/4124089101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef400b9b60 0x7fef4009d6b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fef400b15f0 tx=0x7fef380091a0).stop 2021-01-03T12:59:50.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.215+0000 7fef46e3e700 1 -- 172.21.15.133:0/4124089101 shutdown_connections 2021-01-03T12:59:50.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.215+0000 7fef46e3e700 1 --2- 172.21.15.133:0/4124089101 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef200554e0 0x7fef200579a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.215+0000 7fef46e3e700 1 --2- 172.21.15.133:0/4124089101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef400b9b60 0x7fef4009d6b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.215+0000 7fef46e3e700 1 --2- 172.21.15.133:0/4124089101 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef400b4980 0x7fef400b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.215+0000 7fef46e3e700 1 --2- 172.21.15.133:0/4124089101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef400b4e10 0x7fef40152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.215+0000 7fef46e3e700 1 -- 172.21.15.133:0/4124089101 >> 172.21.15.133:0/4124089101 conn(0x7fef400b69e0 msgr2=0x7fef40140ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:50.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.215+0000 7fef46e3e700 1 -- 172.21.15.133:0/4124089101 shutdown_connections 2021-01-03T12:59:50.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.215+0000 7fef46e3e700 1 -- 172.21.15.133:0/4124089101 wait complete. 2021-01-03T12:59:50.232 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-01-03T12:59:50.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.355+0000 7fa4a359e700 1 Processor -- start 2021-01-03T12:59:50.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.355+0000 7fa4a359e700 1 -- start start 2021-01-03T12:59:50.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.355+0000 7fa4a359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa4a4060890 0x7fa4a40abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:50.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.355+0000 7fa4a359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa4a40ae900 0x7fa4a40aed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:50.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.355+0000 7fa4a359e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a40aaa10 con 0x7fa4a40afa80 2021-01-03T12:59:50.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.355+0000 7fa4a359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a40ab280 con 0x7fa4a4060890 2021-01-03T12:59:50.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.355+0000 7fa4a359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a40b1470 con 0x7fa4a40ae900 2021-01-03T12:59:50.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.355+0000 7fa4a259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa4a4060890 0x7fa4a40abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:50.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.355+0000 7fa4a259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa4a4060890 0x7fa4a40abcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33344/0 (socket says 172.21.15.133:33344) 2021-01-03T12:59:50.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.355+0000 7fa4a259c700 1 -- 172.21.15.133:0/3694003999 learned_addr learned my addr 172.21.15.133:0/3694003999 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:50.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.355+0000 7fa4a2d9d700 1 --2- 172.21.15.133:0/3694003999 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa4a40ae900 0x7fa4a40aed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:50.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.355+0000 7fa4a259c700 1 -- 172.21.15.133:0/3694003999 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa4a40ae900 msgr2=0x7fa4a40aed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:50.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.355+0000 7fa4a259c700 1 --2- 172.21.15.133:0/3694003999 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa4a40ae900 0x7fa4a40aed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.355+0000 7fa4a259c700 1 -- 172.21.15.133:0/3694003999 >> v1:172.21.15.16:6789/0 conn(0x7fa4a40afa80 legacy=0x7fa4a40b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:50.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.355+0000 7fa4a259c700 1 -- 172.21.15.133:0/3694003999 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a40b0ab0 con 0x7fa4a4060890 2021-01-03T12:59:50.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.359+0000 7fa4a259c700 1 --2- 172.21.15.133:0/3694003999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4a4060890 0x7fa4a40abcc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fa494002f30 tx=0x7fa494006e80).ready entity=mon.1 client_cookie=eb802bc02973a933 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:50.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.359+0000 7fa4a159a700 1 -- 172.21.15.133:0/3694003999 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4940097f0 con 0x7fa4a4060890 2021-01-03T12:59:50.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.359+0000 7fa4a159a700 1 -- 172.21.15.133:0/3694003999 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa494009950 con 0x7fa4a4060890 2021-01-03T12:59:50.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.359+0000 7fa4a159a700 1 -- 172.21.15.133:0/3694003999 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa494009cb0 con 0x7fa4a4060890 2021-01-03T12:59:50.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.359+0000 7fa4a359e700 1 -- 172.21.15.133:0/3694003999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4a4060890 msgr2=0x7fa4a40abcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:50.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.359+0000 7fa4a359e700 1 --2- 172.21.15.133:0/3694003999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4a4060890 0x7fa4a40abcc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fa494002f30 tx=0x7fa494006e80).stop 2021-01-03T12:59:50.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.359+0000 7fa4a359e700 1 -- 172.21.15.133:0/3694003999 shutdown_connections 2021-01-03T12:59:50.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.359+0000 7fa4a359e700 1 --2- 172.21.15.133:0/3694003999 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa4a40ae900 0x7fa4a40aed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.359+0000 7fa4a359e700 1 --2- 172.21.15.133:0/3694003999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4a4060890 0x7fa4a40abcc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.359+0000 7fa4a359e700 1 -- 172.21.15.133:0/3694003999 >> 172.21.15.133:0/3694003999 conn(0x7fa4a405bdf0 msgr2=0x7fa4a405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:50.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.359+0000 7fa4a359e700 1 -- 172.21.15.133:0/3694003999 shutdown_connections 2021-01-03T12:59:50.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.359+0000 7fa4a359e700 1 -- 172.21.15.133:0/3694003999 wait complete. 2021-01-03T12:59:50.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.359+0000 7fa4a359e700 1 Processor -- start 2021-01-03T12:59:50.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.359+0000 7fa4a359e700 1 -- start start 2021-01-03T12:59:50.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa4a4060890 0x7fa4a4066390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:50.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4a40ae900 0x7fa4a414d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:50.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4a40afa80 0x7fa4a414db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:50.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a359e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a4065ac0 con 0x7fa4a40ae900 2021-01-03T12:59:50.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a4140160 con 0x7fa4a40afa80 2021-01-03T12:59:50.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a40645f0 con 0x7fa4a4060890 2021-01-03T12:59:50.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a2d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4a40afa80 0x7fa4a414db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:50.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a2d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4a40afa80 0x7fa4a414db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33348/0 (socket says 172.21.15.133:33348) 2021-01-03T12:59:50.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a2d9d700 1 -- 172.21.15.133:0/4162754898 learned_addr learned my addr 172.21.15.133:0/4162754898 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:50.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a259c700 1 --2- 172.21.15.133:0/4162754898 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa4a4060890 0x7fa4a4066390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:50.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a1d9b700 1 --2- 172.21.15.133:0/4162754898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4a40ae900 0x7fa4a414d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:50.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a2d9d700 1 -- 172.21.15.133:0/4162754898 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa4a4060890 msgr2=0x7fa4a4066390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:50.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a2d9d700 1 --2- 172.21.15.133:0/4162754898 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa4a4060890 0x7fa4a4066390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a2d9d700 1 -- 172.21.15.133:0/4162754898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4a40ae900 msgr2=0x7fa4a414d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a2d9d700 1 --2- 172.21.15.133:0/4162754898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4a40ae900 0x7fa4a414d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a2d9d700 1 -- 172.21.15.133:0/4162754898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a40b1240 con 0x7fa4a40afa80 2021-01-03T12:59:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a2d9d700 1 --2- 172.21.15.133:0/4162754898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4a40afa80 0x7fa4a414db70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fa49c006dd0 tx=0x7fa49c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4937fe700 1 -- 172.21.15.133:0/4162754898 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa49c00eee0 con 0x7fa4a40afa80 2021-01-03T12:59:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4937fe700 1 -- 172.21.15.133:0/4162754898 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c00cbb0 con 0x7fa4a40afa80 2021-01-03T12:59:50.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a359e700 1 -- 172.21.15.133:0/4162754898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a4064890 con 0x7fa4a40afa80 2021-01-03T12:59:50.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4937fe700 1 -- 172.21.15.133:0/4162754898 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa49c0123f0 con 0x7fa4a40afa80 2021-01-03T12:59:50.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a359e700 1 -- 172.21.15.133:0/4162754898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a40678d0 con 0x7fa4a40afa80 2021-01-03T12:59:50.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.363+0000 7fa4a359e700 1 -- 172.21.15.133:0/4162754898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a4057300 con 0x7fa4a40afa80 2021-01-03T12:59:50.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.367+0000 7fa4937fe700 1 -- 172.21.15.133:0/4162754898 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa49c022070 con 0x7fa4a40afa80 2021-01-03T12:59:50.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.367+0000 7fa4937fe700 1 --2- 172.21.15.133:0/4162754898 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa480055330 0x7fa4800577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:50.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.367+0000 7fa4937fe700 1 -- 172.21.15.133:0/4162754898 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa49c06e690 con 0x7fa4a40afa80 2021-01-03T12:59:50.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.367+0000 7fa4a259c700 1 --2- 172.21.15.133:0/4162754898 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa480055330 0x7fa4800577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:50.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.367+0000 7fa4a259c700 1 --2- 172.21.15.133:0/4162754898 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa480055330 0x7fa4800577f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fa49401a000 tx=0x7fa494015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:50.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.371+0000 7fa4937fe700 1 -- 172.21.15.133:0/4162754898 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa49c044990 con 0x7fa4a40afa80 2021-01-03T12:59:50.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.511+0000 7fa4a359e700 1 -- 172.21.15.133:0/4162754898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7fa4a40604d0 con 0x7fa4a40afa80 2021-01-03T12:59:50.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.523+0000 7fa4937fe700 1 -- 172.21.15.133:0/4162754898 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa49c016020 con 0x7fa4a40afa80 2021-01-03T12:59:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.523+0000 7fa4a359e700 1 -- 172.21.15.133:0/4162754898 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa480055330 msgr2=0x7fa4800577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.523+0000 7fa4a359e700 1 --2- 172.21.15.133:0/4162754898 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa480055330 0x7fa4800577f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fa49401a000 tx=0x7fa494015000).stop 2021-01-03T12:59:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.523+0000 7fa4a359e700 1 -- 172.21.15.133:0/4162754898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4a40afa80 msgr2=0x7fa4a414db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.523+0000 7fa4a359e700 1 --2- 172.21.15.133:0/4162754898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4a40afa80 0x7fa4a414db70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fa49c006dd0 tx=0x7fa49c0091a0).stop 2021-01-03T12:59:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.523+0000 7fa4a359e700 1 -- 172.21.15.133:0/4162754898 shutdown_connections 2021-01-03T12:59:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.523+0000 7fa4a359e700 1 --2- 172.21.15.133:0/4162754898 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa480055330 0x7fa4800577f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.523+0000 7fa4a359e700 1 --2- 172.21.15.133:0/4162754898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa4a40afa80 0x7fa4a414db70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.523+0000 7fa4a359e700 1 --2- 172.21.15.133:0/4162754898 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa4a4060890 0x7fa4a4066390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.523+0000 7fa4a359e700 1 --2- 172.21.15.133:0/4162754898 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa4a40ae900 0x7fa4a414d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.523+0000 7fa4a359e700 1 -- 172.21.15.133:0/4162754898 >> 172.21.15.133:0/4162754898 conn(0x7fa4a405bdf0 msgr2=0x7fa4a405f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:50.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.523+0000 7fa4a359e700 1 -- 172.21.15.133:0/4162754898 shutdown_connections 2021-01-03T12:59:50.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.523+0000 7fa4a359e700 1 -- 172.21.15.133:0/4162754898 wait complete. 2021-01-03T12:59:50.538 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T12:59:50.538 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T12:59:50.557 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T12:59:50.575 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T12:59:50.593 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T12:59:50.611 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T12:59:50.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:59:50.612 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T12:59:50.612 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T12:59:50.619 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-03T12:59:50.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T12:59:50.621 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-01-03T12:59:50.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T12:59:50.622 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T12:59:50.622 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T12:59:50.640 INFO:teuthology.orchestra.run.smithi036.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T12:59:50.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T12:59:50.641 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-01-03T12:59:50.642 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-01-03T12:59:50.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.771+0000 7f08fec33700 1 Processor -- start 2021-01-03T12:59:50.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.771+0000 7f08fec33700 1 -- start start 2021-01-03T12:59:50.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fec33700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f08f80b3870 0x7f08f8141660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:50.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fec33700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08f805f5e0 0x7f08f813def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:50.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fec33700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f80b24f0 con 0x7f08f80b3060 2021-01-03T12:59:50.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fec33700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f80b3440 con 0x7f08f80b3870 2021-01-03T12:59:50.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fec33700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f8140c80 con 0x7f08f805f5e0 2021-01-03T12:59:50.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fe432700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08f805f5e0 0x7f08f813def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:50.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fe432700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08f805f5e0 0x7f08f813def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:41658/0 (socket says 172.21.15.133:41658) 2021-01-03T12:59:50.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fe432700 1 -- 172.21.15.133:0/66444303 learned_addr learned my addr 172.21.15.133:0/66444303 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:50.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fd430700 1 --2- 172.21.15.133:0/66444303 >> v2:172.21.15.16:3300/0 conn(0x7f08f80b3870 0x7f08f8141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:50.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fe432700 1 -- 172.21.15.133:0/66444303 >> v2:172.21.15.16:3300/0 conn(0x7f08f80b3870 msgr2=0x7f08f8141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:50.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fe432700 1 --2- 172.21.15.133:0/66444303 >> v2:172.21.15.16:3300/0 conn(0x7f08f80b3870 0x7f08f8141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fe432700 1 -- 172.21.15.133:0/66444303 >> v1:172.21.15.16:6789/0 conn(0x7f08f80b3060 legacy=0x7f08f80b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:50.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fe432700 1 -- 172.21.15.133:0/66444303 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f8140f20 con 0x7f08f805f5e0 2021-01-03T12:59:50.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fe432700 1 --2- 172.21.15.133:0/66444303 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08f805f5e0 0x7f08f813def0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f08f00032b0 tx=0x7f08f0009270).ready entity=mon.2 client_cookie=8879a4753253c05a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:50.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fcc2f700 1 -- 172.21.15.133:0/66444303 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08f0009e60 con 0x7f08f805f5e0 2021-01-03T12:59:50.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fcc2f700 1 -- 172.21.15.133:0/66444303 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f000bc00 con 0x7f08f805f5e0 2021-01-03T12:59:50.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fcc2f700 1 -- 172.21.15.133:0/66444303 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08f000bd70 con 0x7f08f805f5e0 2021-01-03T12:59:50.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fec33700 1 -- 172.21.15.133:0/66444303 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08f805f5e0 msgr2=0x7f08f813def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:50.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fec33700 1 --2- 172.21.15.133:0/66444303 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08f805f5e0 0x7f08f813def0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f08f00032b0 tx=0x7f08f0009270).stop 2021-01-03T12:59:50.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fec33700 1 -- 172.21.15.133:0/66444303 shutdown_connections 2021-01-03T12:59:50.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fec33700 1 --2- 172.21.15.133:0/66444303 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08f805f5e0 0x7f08f813def0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fec33700 1 --2- 172.21.15.133:0/66444303 >> v2:172.21.15.16:3300/0 conn(0x7f08f80b3870 0x7f08f8141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fec33700 1 -- 172.21.15.133:0/66444303 >> 172.21.15.133:0/66444303 conn(0x7f08f80b7200 msgr2=0x7f08f80b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:50.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fec33700 1 -- 172.21.15.133:0/66444303 shutdown_connections 2021-01-03T12:59:50.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.775+0000 7f08fec33700 1 -- 172.21.15.133:0/66444303 wait complete. 2021-01-03T12:59:50.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fec33700 1 Processor -- start 2021-01-03T12:59:50.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fec33700 1 -- start start 2021-01-03T12:59:50.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fec33700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08f805f5e0 0x7f08f80b6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:50.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fec33700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08f80b3060 0x7f08f8141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:50.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fec33700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08f80b3870 0x7f08f8142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:50.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fec33700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f813f240 con 0x7f08f80b3870 2021-01-03T12:59:50.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fec33700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f80affd0 con 0x7f08f805f5e0 2021-01-03T12:59:50.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fec33700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f80afd30 con 0x7f08f80b3060 2021-01-03T12:59:50.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fdc31700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08f805f5e0 0x7f08f80b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:50.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fd430700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08f80b3060 0x7f08f8141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:50.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fdc31700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08f805f5e0 0x7f08f80b6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33366/0 (socket says 172.21.15.133:33366) 2021-01-03T12:59:50.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fe432700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08f80b3870 0x7f08f8142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:50.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fdc31700 1 -- 172.21.15.133:0/998856431 learned_addr learned my addr 172.21.15.133:0/998856431 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:50.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fdc31700 1 -- 172.21.15.133:0/998856431 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08f80b3060 msgr2=0x7f08f8141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:50.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fdc31700 1 --2- 172.21.15.133:0/998856431 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08f80b3060 0x7f08f8141e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fdc31700 1 -- 172.21.15.133:0/998856431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08f80b3870 msgr2=0x7f08f8142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:50.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fdc31700 1 --2- 172.21.15.133:0/998856431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08f80b3870 0x7f08f8142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:50.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fdc31700 1 -- 172.21.15.133:0/998856431 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f81401c0 con 0x7f08f805f5e0 2021-01-03T12:59:50.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fdc31700 1 --2- 172.21.15.133:0/998856431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08f805f5e0 0x7f08f80b6570 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f08f80b0cf0 tx=0x7f08e8007c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:50.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08e6ffd700 1 -- 172.21.15.133:0/998856431 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08e800e4a0 con 0x7f08f805f5e0 2021-01-03T12:59:50.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08e6ffd700 1 -- 172.21.15.133:0/998856431 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e800e600 con 0x7f08f805f5e0 2021-01-03T12:59:50.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fec33700 1 -- 172.21.15.133:0/998856431 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f8153ec0 con 0x7f08f805f5e0 2021-01-03T12:59:50.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08e6ffd700 1 -- 172.21.15.133:0/998856431 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08e800e960 con 0x7f08f805f5e0 2021-01-03T12:59:50.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.779+0000 7f08fec33700 1 -- 172.21.15.133:0/998856431 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f80b1350 con 0x7f08f805f5e0 2021-01-03T12:59:50.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.783+0000 7f08fec33700 1 -- 172.21.15.133:0/998856431 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f8140350 con 0x7f08f805f5e0 2021-01-03T12:59:50.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.783+0000 7f08e6ffd700 1 -- 172.21.15.133:0/998856431 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f08e8010030 con 0x7f08f805f5e0 2021-01-03T12:59:50.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.783+0000 7f08e6ffd700 1 --2- 172.21.15.133:0/998856431 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f08d8055440 0x7f08d8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:50.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.783+0000 7f08fd430700 1 --2- 172.21.15.133:0/998856431 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f08d8055440 0x7f08d8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:50.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.783+0000 7f08e6ffd700 1 -- 172.21.15.133:0/998856431 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f08e806dee0 con 0x7f08f805f5e0 2021-01-03T12:59:50.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.783+0000 7f08fd430700 1 --2- 172.21.15.133:0/998856431 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f08d8055440 0x7f08d8057900 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f08f400b000 tx=0x7f08f4006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:50.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.787+0000 7f08e6ffd700 1 -- 172.21.15.133:0/998856431 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f08e80440d0 con 0x7f08f805f5e0 2021-01-03T12:59:50.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.931+0000 7f08fec33700 1 -- 172.21.15.133:0/998856431 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f08f8057300 con 0x7f08f805f5e0 2021-01-03T12:59:50.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.931+0000 7f08e6ffd700 1 -- 172.21.15.133:0/998856431 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v34) v1 ==== 81+0+33693 (secure 0 0 0) 0x7f08e80476f0 con 0x7f08f805f5e0 2021-01-03T12:59:50.933 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:59:50.934 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T12:59:50.934 INFO:teuthology.orchestra.run.smithi133.stdout: "epoch": 34, 2021-01-03T12:59:50.934 INFO:teuthology.orchestra.run.smithi133.stdout: "fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", 2021-01-03T12:59:50.934 INFO:teuthology.orchestra.run.smithi133.stdout: "created": "2021-01-03T12:57:43.298835+0000", 2021-01-03T12:59:50.935 INFO:teuthology.orchestra.run.smithi133.stdout: "modified": "2021-01-03T12:58:42.562578+0000", 2021-01-03T12:59:50.935 INFO:teuthology.orchestra.run.smithi133.stdout: "last_up_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T12:59:50.935 INFO:teuthology.orchestra.run.smithi133.stdout: "last_in_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T12:59:50.935 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-01-03T12:59:50.935 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_num": 5799936, 2021-01-03T12:59:50.936 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_set": [ 2021-01-03T12:59:50.936 INFO:teuthology.orchestra.run.smithi133.stdout: "pglog_hardlimit", 2021-01-03T12:59:50.936 INFO:teuthology.orchestra.run.smithi133.stdout: "purged_snapdirs", 2021-01-03T12:59:50.936 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_deletes", 2021-01-03T12:59:50.936 INFO:teuthology.orchestra.run.smithi133.stdout: "sortbitwise" 2021-01-03T12:59:50.937 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T12:59:50.937 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_version": 4, 2021-01-03T12:59:50.937 INFO:teuthology.orchestra.run.smithi133.stdout: "full_ratio": 0.94999998807907104, 2021-01-03T12:59:50.937 INFO:teuthology.orchestra.run.smithi133.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-01-03T12:59:50.937 INFO:teuthology.orchestra.run.smithi133.stdout: "nearfull_ratio": 0.85000002384185791, 2021-01-03T12:59:50.938 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_snapshot": "", 2021-01-03T12:59:50.938 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_max": 6, 2021-01-03T12:59:50.938 INFO:teuthology.orchestra.run.smithi133.stdout: "max_osd": 8, 2021-01-03T12:59:50.938 INFO:teuthology.orchestra.run.smithi133.stdout: "require_min_compat_client": "jewel", 2021-01-03T12:59:50.939 INFO:teuthology.orchestra.run.smithi133.stdout: "min_compat_client": "jewel", 2021-01-03T12:59:50.939 INFO:teuthology.orchestra.run.smithi133.stdout: "require_osd_release": "octopus", 2021-01-03T12:59:50.939 INFO:teuthology.orchestra.run.smithi133.stdout: "pools": [ 2021-01-03T12:59:50.939 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:50.939 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 1, 2021-01-03T12:59:50.940 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "device_health_metrics", 2021-01-03T12:59:50.940 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:47.102954+0000", 2021-01-03T12:59:50.940 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T12:59:50.940 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T12:59:50.940 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T12:59:50.941 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T12:59:50.941 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T12:59:50.941 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T12:59:50.941 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T12:59:50.941 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T12:59:50.942 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 1, 2021-01-03T12:59:50.942 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 1, 2021-01-03T12:59:50.942 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 1, 2021-01-03T12:59:50.942 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 1, 2021-01-03T12:59:50.942 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 1, 2021-01-03T12:59:50.943 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T12:59:50.943 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T12:59:50.943 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T12:59:50.943 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T12:59:50.943 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T12:59:50.944 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T12:59:50.944 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T12:59:50.944 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:50.944 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "16", 2021-01-03T12:59:50.944 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T12:59:50.945 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T12:59:50.945 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T12:59:50.945 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T12:59:50.945 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T12:59:50.946 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T12:59:50.946 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T12:59:50.946 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T12:59:50.946 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T12:59:50.946 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T12:59:50.947 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T12:59:50.947 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T12:59:50.947 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T12:59:50.947 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T12:59:50.947 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T12:59:50.948 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T12:59:50.948 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T12:59:50.948 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T12:59:50.948 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T12:59:50.948 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T12:59:50.949 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T12:59:50.949 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T12:59:50.949 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T12:59:50.949 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T12:59:50.949 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T12:59:50.949 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T12:59:50.950 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:50.950 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T12:59:50.950 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T12:59:50.950 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T12:59:50.951 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T12:59:50.951 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T12:59:50.951 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T12:59:50.951 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T12:59:50.951 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T12:59:50.952 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T12:59:50.952 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T12:59:50.952 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T12:59:50.952 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T12:59:50.953 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 1 2021-01-03T12:59:50.953 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:50.953 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T12:59:50.953 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr_devicehealth": {} 2021-01-03T12:59:50.953 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:50.954 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:50.954 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:50.954 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 2, 2021-01-03T12:59:50.954 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "rbd", 2021-01-03T12:59:50.954 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:55.472799+0000", 2021-01-03T12:59:50.955 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T12:59:50.955 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T12:59:50.955 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T12:59:50.955 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T12:59:50.955 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T12:59:50.955 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T12:59:50.956 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T12:59:50.956 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T12:59:50.956 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T12:59:50.956 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T12:59:50.956 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T12:59:50.957 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T12:59:50.957 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T12:59:50.957 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T12:59:50.957 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T12:59:50.958 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T12:59:50.958 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T12:59:50.958 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T12:59:50.958 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T12:59:50.959 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T12:59:50.959 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:50.959 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "19", 2021-01-03T12:59:50.959 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T12:59:50.959 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T12:59:50.960 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T12:59:50.960 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T12:59:50.960 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T12:59:50.960 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T12:59:50.960 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T12:59:50.961 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T12:59:50.961 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T12:59:50.961 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T12:59:50.961 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T12:59:50.961 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T12:59:50.962 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T12:59:50.962 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T12:59:50.962 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T12:59:50.962 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T12:59:50.962 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T12:59:50.963 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T12:59:50.963 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T12:59:50.963 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T12:59:50.963 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T12:59:50.963 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T12:59:50.964 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T12:59:50.964 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T12:59:50.964 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T12:59:50.964 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T12:59:50.964 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:50.965 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T12:59:50.965 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T12:59:50.965 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T12:59:50.965 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T12:59:50.965 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T12:59:50.966 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T12:59:50.966 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T12:59:50.966 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T12:59:50.966 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T12:59:50.966 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T12:59:50.967 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T12:59:50.967 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T12:59:50.967 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T12:59:50.967 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd": {} 2021-01-03T12:59:50.967 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:50.968 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:50.968 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:50.968 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 5, 2021-01-03T12:59:50.968 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_metadata", 2021-01-03T12:59:50.968 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:58:39.345665+0000", 2021-01-03T12:59:50.969 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T12:59:50.969 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T12:59:50.969 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T12:59:50.969 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T12:59:50.969 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T12:59:50.970 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T12:59:50.970 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T12:59:50.970 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T12:59:50.970 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T12:59:50.971 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T12:59:50.971 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T12:59:50.971 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T12:59:50.971 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T12:59:50.971 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T12:59:50.971 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T12:59:50.972 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T12:59:50.972 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T12:59:50.972 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T12:59:50.972 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T12:59:50.972 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T12:59:50.973 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:50.973 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "33", 2021-01-03T12:59:50.973 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T12:59:50.973 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T12:59:50.973 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T12:59:50.974 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T12:59:50.974 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T12:59:50.974 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T12:59:50.974 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T12:59:50.974 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T12:59:50.975 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T12:59:50.975 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T12:59:50.975 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T12:59:50.975 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T12:59:50.976 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T12:59:50.976 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T12:59:50.976 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T12:59:50.976 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T12:59:50.976 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T12:59:50.977 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T12:59:50.977 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T12:59:50.977 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T12:59:50.977 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T12:59:50.977 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T12:59:50.978 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T12:59:50.978 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T12:59:50.978 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T12:59:50.978 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T12:59:50.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:50.979 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T12:59:50.979 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T12:59:50.979 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T12:59:50.979 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T12:59:50.979 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T12:59:50.980 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T12:59:50.980 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T12:59:50.980 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T12:59:50.980 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T12:59:50.980 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T12:59:50.981 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T12:59:50.981 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T12:59:50.981 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_bias": 4, 2021-01-03T12:59:50.981 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 16, 2021-01-03T12:59:50.981 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_priority": 5 2021-01-03T12:59:50.982 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:50.982 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T12:59:50.982 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T12:59:50.982 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": "cephfs" 2021-01-03T12:59:50.982 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:50.983 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:50.983 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:50.983 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:50.983 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 6, 2021-01-03T12:59:50.983 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_data", 2021-01-03T12:59:50.984 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:58:40.570679+0000", 2021-01-03T12:59:50.984 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T12:59:50.984 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T12:59:50.984 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T12:59:50.984 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T12:59:50.985 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T12:59:50.985 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T12:59:50.985 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T12:59:50.985 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T12:59:50.985 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T12:59:50.986 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T12:59:50.986 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T12:59:50.986 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T12:59:50.986 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T12:59:50.986 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T12:59:50.987 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T12:59:50.987 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T12:59:50.987 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T12:59:50.987 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T12:59:50.987 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T12:59:50.988 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T12:59:50.988 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:50.988 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "34", 2021-01-03T12:59:50.988 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T12:59:50.988 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T12:59:50.989 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T12:59:50.989 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T12:59:50.989 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T12:59:50.989 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T12:59:50.989 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T12:59:50.990 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T12:59:50.990 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T12:59:50.990 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T12:59:50.990 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T12:59:50.991 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T12:59:50.991 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T12:59:50.991 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T12:59:50.991 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T12:59:50.991 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T12:59:50.992 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T12:59:50.992 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T12:59:50.992 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T12:59:50.992 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T12:59:50.992 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T12:59:50.993 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T12:59:50.993 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T12:59:50.993 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T12:59:50.993 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T12:59:50.993 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T12:59:50.994 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:50.994 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T12:59:50.994 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T12:59:50.994 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T12:59:50.994 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T12:59:50.995 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T12:59:50.995 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T12:59:50.995 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T12:59:50.995 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T12:59:50.995 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T12:59:50.996 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T12:59:50.996 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T12:59:50.996 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T12:59:50.996 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T12:59:50.996 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T12:59:50.997 INFO:teuthology.orchestra.run.smithi133.stdout: "data": "cephfs" 2021-01-03T12:59:50.997 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:50.997 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:50.997 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:50.997 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T12:59:50.998 INFO:teuthology.orchestra.run.smithi133.stdout: "osds": [ 2021-01-03T12:59:50.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:50.998 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T12:59:50.998 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a", 2021-01-03T12:59:50.998 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T12:59:50.999 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T12:59:50.999 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T12:59:50.999 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T12:59:50.999 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T12:59:50.999 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T12:59:51.000 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T12:59:51.000 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 32, 2021-01-03T12:59:51.000 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T12:59:51.000 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T12:59:51.001 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T12:59:51.001 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.001 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.001 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.001 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6810", 2021-01-03T12:59:51.002 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T12:59:51.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.002 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.002 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6811", 2021-01-03T12:59:51.003 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T12:59:51.003 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.003 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.003 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.003 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T12:59:51.004 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.004 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.004 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6812", 2021-01-03T12:59:51.004 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T12:59:51.005 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.005 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.005 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.005 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6813", 2021-01-03T12:59:51.005 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T12:59:51.006 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.006 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.006 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T12:59:51.006 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.007 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.007 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.007 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6816", 2021-01-03T12:59:51.007 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T12:59:51.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.008 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.008 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6817", 2021-01-03T12:59:51.008 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T12:59:51.009 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.009 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.009 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.009 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T12:59:51.009 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.010 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.010 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.010 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6814", 2021-01-03T12:59:51.010 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T12:59:51.010 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.011 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.011 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.011 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6815", 2021-01-03T12:59:51.011 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T12:59:51.011 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.012 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.012 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6811/12124", 2021-01-03T12:59:51.012 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6813/12124", 2021-01-03T12:59:51.012 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6817/12124", 2021-01-03T12:59:51.013 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6815/12124", 2021-01-03T12:59:51.013 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T12:59:51.013 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T12:59:51.013 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T12:59:51.013 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.014 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.014 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.014 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T12:59:51.014 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9170d1de-58d4-4dfd-b9de-80dc15ca9e60", 2021-01-03T12:59:51.014 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T12:59:51.015 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T12:59:51.015 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T12:59:51.015 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T12:59:51.015 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T12:59:51.015 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T12:59:51.016 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T12:59:51.016 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 32, 2021-01-03T12:59:51.016 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T12:59:51.016 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T12:59:51.016 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T12:59:51.017 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.017 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.017 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6818", 2021-01-03T12:59:51.017 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T12:59:51.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.018 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.018 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.018 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6819", 2021-01-03T12:59:51.018 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T12:59:51.019 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.019 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.019 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T12:59:51.019 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.020 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.020 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.020 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6820", 2021-01-03T12:59:51.020 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T12:59:51.020 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.021 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.021 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.021 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6821", 2021-01-03T12:59:51.021 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T12:59:51.021 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.022 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.022 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.022 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T12:59:51.022 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.022 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.023 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.023 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6824", 2021-01-03T12:59:51.023 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T12:59:51.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.023 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.024 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.024 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6825", 2021-01-03T12:59:51.024 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T12:59:51.024 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.024 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.025 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T12:59:51.025 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.025 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.025 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.026 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6822", 2021-01-03T12:59:51.026 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T12:59:51.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.026 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.026 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.027 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6823", 2021-01-03T12:59:51.027 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T12:59:51.027 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.027 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.028 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6819/12123", 2021-01-03T12:59:51.028 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6821/12123", 2021-01-03T12:59:51.028 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6825/12123", 2021-01-03T12:59:51.028 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6823/12123", 2021-01-03T12:59:51.028 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T12:59:51.029 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T12:59:51.029 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T12:59:51.029 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.029 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T12:59:51.030 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9fc5adf9-3537-4953-9c65-0c67ecb53776", 2021-01-03T12:59:51.030 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T12:59:51.030 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T12:59:51.030 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T12:59:51.031 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T12:59:51.031 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T12:59:51.031 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T12:59:51.031 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T12:59:51.031 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 31, 2021-01-03T12:59:51.031 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T12:59:51.032 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T12:59:51.032 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T12:59:51.032 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.033 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.033 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6802", 2021-01-03T12:59:51.033 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T12:59:51.033 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.033 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.034 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.034 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6803", 2021-01-03T12:59:51.034 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T12:59:51.034 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.034 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.035 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.035 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T12:59:51.035 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.035 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.036 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6804", 2021-01-03T12:59:51.036 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T12:59:51.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.036 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.037 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6805", 2021-01-03T12:59:51.037 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T12:59:51.037 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.037 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.038 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T12:59:51.038 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.038 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.038 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6808", 2021-01-03T12:59:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T12:59:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.039 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6809", 2021-01-03T12:59:51.040 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T12:59:51.040 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.040 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.040 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T12:59:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6806", 2021-01-03T12:59:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T12:59:51.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6807", 2021-01-03T12:59:51.042 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T12:59:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6803/12122", 2021-01-03T12:59:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6805/12122", 2021-01-03T12:59:51.043 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6809/12122", 2021-01-03T12:59:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6807/12122", 2021-01-03T12:59:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T12:59:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T12:59:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T12:59:51.044 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T12:59:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "0ad45ce5-6635-4089-bbf8-c966d0fe5338", 2021-01-03T12:59:51.045 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T12:59:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T12:59:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T12:59:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T12:59:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T12:59:51.046 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T12:59:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T12:59:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 32, 2021-01-03T12:59:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T12:59:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T12:59:51.047 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T12:59:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6826", 2021-01-03T12:59:51.048 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T12:59:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6827", 2021-01-03T12:59:51.049 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T12:59:51.050 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.050 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.050 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.050 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T12:59:51.050 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6828", 2021-01-03T12:59:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T12:59:51.051 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6829", 2021-01-03T12:59:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T12:59:51.052 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T12:59:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.053 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.054 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.054 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6832", 2021-01-03T12:59:51.054 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T12:59:51.054 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6833", 2021-01-03T12:59:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T12:59:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.055 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.056 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T12:59:51.056 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6830", 2021-01-03T12:59:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T12:59:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.058 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.058 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6831", 2021-01-03T12:59:51.058 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T12:59:51.058 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.058 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.059 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6827/12136", 2021-01-03T12:59:51.059 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6829/12136", 2021-01-03T12:59:51.059 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6833/12136", 2021-01-03T12:59:51.059 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6831/12136", 2021-01-03T12:59:51.060 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T12:59:51.060 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T12:59:51.060 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T12:59:51.060 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.061 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.061 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T12:59:51.061 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "86b8d6d5-271b-4a70-ae7b-a227afb38d7c", 2021-01-03T12:59:51.061 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T12:59:51.061 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T12:59:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T12:59:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T12:59:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T12:59:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T12:59:51.062 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T12:59:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 32, 2021-01-03T12:59:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T12:59:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T12:59:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T12:59:51.063 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6808", 2021-01-03T12:59:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T12:59:51.064 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.065 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.065 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.065 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6809", 2021-01-03T12:59:51.065 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T12:59:51.065 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T12:59:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.066 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6810", 2021-01-03T12:59:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T12:59:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6811", 2021-01-03T12:59:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T12:59:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.068 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T12:59:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.069 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.070 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6814", 2021-01-03T12:59:51.070 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T12:59:51.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.070 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.071 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6815", 2021-01-03T12:59:51.071 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T12:59:51.071 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.071 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.072 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T12:59:51.072 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.072 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.072 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6812", 2021-01-03T12:59:51.073 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T12:59:51.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.073 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.073 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6813", 2021-01-03T12:59:51.074 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T12:59:51.074 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.074 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.074 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6809/12672", 2021-01-03T12:59:51.075 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6811/12672", 2021-01-03T12:59:51.075 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6815/12672", 2021-01-03T12:59:51.075 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6813/12672", 2021-01-03T12:59:51.075 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T12:59:51.075 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T12:59:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T12:59:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.076 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T12:59:51.077 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "173feb9d-f596-4030-85d8-1f4b46a9ffe5", 2021-01-03T12:59:51.077 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T12:59:51.077 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T12:59:51.077 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T12:59:51.077 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T12:59:51.078 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T12:59:51.078 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T12:59:51.078 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T12:59:51.078 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 32, 2021-01-03T12:59:51.078 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T12:59:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T12:59:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T12:59:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.079 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6817", 2021-01-03T12:59:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T12:59:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.080 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.081 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6819", 2021-01-03T12:59:51.081 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T12:59:51.081 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.081 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.082 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T12:59:51.082 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.082 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.082 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6820", 2021-01-03T12:59:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T12:59:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.083 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6822", 2021-01-03T12:59:51.084 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T12:59:51.084 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.084 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T12:59:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.085 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6828", 2021-01-03T12:59:51.086 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T12:59:51.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.086 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.086 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6830", 2021-01-03T12:59:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T12:59:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.087 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T12:59:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6824", 2021-01-03T12:59:51.088 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T12:59:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6826", 2021-01-03T12:59:51.089 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T12:59:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6819/12673", 2021-01-03T12:59:51.090 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6822/12673", 2021-01-03T12:59:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6830/12673", 2021-01-03T12:59:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6826/12673", 2021-01-03T12:59:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T12:59:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T12:59:51.091 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T12:59:51.092 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.092 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T12:59:51.092 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "b487980e-ad4d-43c1-91fa-4845f7af3d4d", 2021-01-03T12:59:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T12:59:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T12:59:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T12:59:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T12:59:51.093 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T12:59:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T12:59:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T12:59:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 31, 2021-01-03T12:59:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T12:59:51.094 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T12:59:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T12:59:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.095 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6800", 2021-01-03T12:59:51.096 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T12:59:51.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.096 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.096 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6801", 2021-01-03T12:59:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T12:59:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.097 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T12:59:51.098 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.098 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.098 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6802", 2021-01-03T12:59:51.098 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T12:59:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6803", 2021-01-03T12:59:51.099 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T12:59:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T12:59:51.100 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6806", 2021-01-03T12:59:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T12:59:51.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.102 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.102 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6807", 2021-01-03T12:59:51.102 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T12:59:51.102 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.103 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.103 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T12:59:51.103 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6804", 2021-01-03T12:59:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T12:59:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6805", 2021-01-03T12:59:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T12:59:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.105 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6801/12662", 2021-01-03T12:59:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6803/12662", 2021-01-03T12:59:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6807/12662", 2021-01-03T12:59:51.106 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6805/12662", 2021-01-03T12:59:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T12:59:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T12:59:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T12:59:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T12:59:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "38ea839a-451f-4c09-a545-4514e049b178", 2021-01-03T12:59:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T12:59:51.108 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T12:59:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T12:59:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T12:59:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T12:59:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T12:59:51.109 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T12:59:51.110 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 32, 2021-01-03T12:59:51.110 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T12:59:51.110 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T12:59:51.110 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T12:59:51.110 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6816", 2021-01-03T12:59:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T12:59:51.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6818", 2021-01-03T12:59:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T12:59:51.112 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.113 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.113 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T12:59:51.113 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6821", 2021-01-03T12:59:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T12:59:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6823", 2021-01-03T12:59:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T12:59:51.115 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T12:59:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.116 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.117 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6829", 2021-01-03T12:59:51.117 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T12:59:51.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6831", 2021-01-03T12:59:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T12:59:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.118 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T12:59:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T12:59:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.119 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T12:59:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6825", 2021-01-03T12:59:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T12:59:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.120 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T12:59:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6827", 2021-01-03T12:59:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T12:59:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6818/12674", 2021-01-03T12:59:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6823/12674", 2021-01-03T12:59:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6831/12674", 2021-01-03T12:59:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6827/12674", 2021-01-03T12:59:51.122 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T12:59:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T12:59:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T12:59:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.123 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T12:59:51.124 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_xinfo": [ 2021-01-03T12:59:51.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.124 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T12:59:51.124 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T12:59:51.124 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T12:59:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T12:59:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T12:59:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T12:59:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.659942+0000", 2021-01-03T12:59:51.125 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T12:59:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T12:59:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T12:59:51.126 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T12:59:51.127 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T12:59:51.127 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T12:59:51.127 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T12:59:51.127 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.750326+0000", 2021-01-03T12:59:51.127 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T12:59:51.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.128 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T12:59:51.128 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T12:59:51.128 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T12:59:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T12:59:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T12:59:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T12:59:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.587742+0000", 2021-01-03T12:59:51.129 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T12:59:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T12:59:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T12:59:51.130 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T12:59:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T12:59:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T12:59:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T12:59:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.855073+0000", 2021-01-03T12:59:51.131 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T12:59:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T12:59:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T12:59:51.132 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T12:59:51.133 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T12:59:51.133 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T12:59:51.133 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T12:59:51.133 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.565030+0000", 2021-01-03T12:59:51.133 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T12:59:51.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.134 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T12:59:51.134 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T12:59:51.134 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T12:59:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T12:59:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T12:59:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T12:59:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.786206+0000", 2021-01-03T12:59:51.135 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T12:59:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T12:59:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T12:59:51.136 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T12:59:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T12:59:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T12:59:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T12:59:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.576185+0000", 2021-01-03T12:59:51.137 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T12:59:51.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:51.138 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T12:59:51.138 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T12:59:51.138 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T12:59:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T12:59:51.139 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T12:59:51.141 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T12:59:51.141 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.823786+0000", 2021-01-03T12:59:51.141 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T12:59:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T12:59:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap": [], 2021-01-03T12:59:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap_items": [], 2021-01-03T12:59:51.142 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_temp": [], 2021-01-03T12:59:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_temp": [], 2021-01-03T12:59:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: "blacklist": {}, 2021-01-03T12:59:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profiles": { 2021-01-03T12:59:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: "default": { 2021-01-03T12:59:51.143 INFO:teuthology.orchestra.run.smithi133.stdout: "crush-failure-domain": "osd", 2021-01-03T12:59:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: "k": "2", 2021-01-03T12:59:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: "m": "1", 2021-01-03T12:59:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: "plugin": "jerasure", 2021-01-03T12:59:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: "ruleset-failure-domain": "osd", 2021-01-03T12:59:51.144 INFO:teuthology.orchestra.run.smithi133.stdout: "technique": "reed_sol_van" 2021-01-03T12:59:51.145 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:51.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:51.145 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps_queue": [], 2021-01-03T12:59:51.145 INFO:teuthology.orchestra.run.smithi133.stdout: "new_removed_snaps": [], 2021-01-03T12:59:51.145 INFO:teuthology.orchestra.run.smithi133.stdout: "new_purged_snaps": [], 2021-01-03T12:59:51.146 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_node_flags": {}, 2021-01-03T12:59:51.146 INFO:teuthology.orchestra.run.smithi133.stdout: "device_class_flags": {} 2021-01-03T12:59:51.146 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T12:59:51.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.935+0000 7f08fec33700 1 -- 172.21.15.133:0/998856431 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f08d8055440 msgr2=0x7f08d8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:51.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.935+0000 7f08fec33700 1 --2- 172.21.15.133:0/998856431 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f08d8055440 0x7f08d8057900 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f08f400b000 tx=0x7f08f4006dc0).stop 2021-01-03T12:59:51.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.935+0000 7f08fec33700 1 -- 172.21.15.133:0/998856431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08f805f5e0 msgr2=0x7f08f80b6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:51.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.935+0000 7f08fec33700 1 --2- 172.21.15.133:0/998856431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08f805f5e0 0x7f08f80b6570 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f08f80b0cf0 tx=0x7f08e8007c20).stop 2021-01-03T12:59:51.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.935+0000 7f08fec33700 1 -- 172.21.15.133:0/998856431 shutdown_connections 2021-01-03T12:59:51.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.935+0000 7f08fec33700 1 --2- 172.21.15.133:0/998856431 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f08d8055440 0x7f08d8057900 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:51.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.935+0000 7f08fec33700 1 --2- 172.21.15.133:0/998856431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08f80b3870 0x7f08f8142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:51.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.935+0000 7f08fec33700 1 --2- 172.21.15.133:0/998856431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08f805f5e0 0x7f08f80b6570 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:51.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.935+0000 7f08fec33700 1 --2- 172.21.15.133:0/998856431 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08f80b3060 0x7f08f8141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:51.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.935+0000 7f08fec33700 1 -- 172.21.15.133:0/998856431 >> 172.21.15.133:0/998856431 conn(0x7f08f80b7200 msgr2=0x7f08f813d060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:51.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.935+0000 7f08fec33700 1 -- 172.21.15.133:0/998856431 shutdown_connections 2021-01-03T12:59:51.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:50.935+0000 7f08fec33700 1 -- 172.21.15.133:0/998856431 wait complete. 2021-01-03T12:59:51.151 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T12:59:51.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f34156c9700 1 Processor -- start 2021-01-03T12:59:51.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f34156c9700 1 -- start start 2021-01-03T12:59:51.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f34156c9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f341005c130 0x7f34100b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:51.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f34156c9700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341005c510 con 0x7f34101479e0 2021-01-03T12:59:51.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f34156c9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341014a930 con 0x7f3410061890 2021-01-03T12:59:51.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f34156c9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341014abd0 con 0x7f341005c130 2021-01-03T12:59:51.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f340ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f341005c130 0x7f34100b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f340f7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3410061890 0x7f34101472d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54402/0 (socket says 172.21.15.133:54402) 2021-01-03T12:59:51.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f340f7fe700 1 -- 172.21.15.133:0/3974677221 learned_addr learned my addr 172.21.15.133:0/3974677221 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:59:51.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f340ffff700 1 -- 172.21.15.133:0/3974677221 >> v1:172.21.15.133:6789/0 conn(0x7f3410061890 legacy=0x7f34101472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:51.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f340ffff700 1 -- 172.21.15.133:0/3974677221 >> v1:172.21.15.16:6789/0 conn(0x7f34101479e0 legacy=0x7f34101445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:51.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f340ffff700 1 -- 172.21.15.133:0/3974677221 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341014ae70 con 0x7f341005c130 2021-01-03T12:59:51.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f340ffff700 1 --2- 172.21.15.133:0/3974677221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f341005c130 0x7f34100b25d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f3400002f30 tx=0x7f3400006dc0).ready entity=mon.1 client_cookie=8324c7343a938318 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:51.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f340effd700 1 -- 172.21.15.133:0/3974677221 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34000097f0 con 0x7f341005c130 2021-01-03T12:59:51.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f340effd700 1 -- 172.21.15.133:0/3974677221 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3400009950 con 0x7f341005c130 2021-01-03T12:59:51.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f340effd700 1 -- 172.21.15.133:0/3974677221 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3400009cb0 con 0x7f341005c130 2021-01-03T12:59:51.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f34156c9700 1 -- 172.21.15.133:0/3974677221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f341005c130 msgr2=0x7f34100b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:51.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.275+0000 7f34156c9700 1 --2- 172.21.15.133:0/3974677221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f341005c130 0x7f34100b25d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f3400002f30 tx=0x7f3400006dc0).stop 2021-01-03T12:59:51.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.279+0000 7f34156c9700 1 -- 172.21.15.133:0/3974677221 shutdown_connections 2021-01-03T12:59:51.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.279+0000 7f34156c9700 1 --2- 172.21.15.133:0/3974677221 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f341005c130 0x7f34100b25d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:51.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.279+0000 7f34156c9700 1 -- 172.21.15.133:0/3974677221 >> 172.21.15.133:0/3974677221 conn(0x7f34100b6110 msgr2=0x7f34100b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:51.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.279+0000 7f34156c9700 1 -- 172.21.15.133:0/3974677221 shutdown_connections 2021-01-03T12:59:51.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.279+0000 7f34156c9700 1 -- 172.21.15.133:0/3974677221 wait complete. 2021-01-03T12:59:51.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.279+0000 7f34156c9700 1 Processor -- start 2021-01-03T12:59:51.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.279+0000 7f34156c9700 1 -- start start 2021-01-03T12:59:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.279+0000 7f34156c9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f341005c130 0x7f341013f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f34156c9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3410061890 0x7f3410146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f34156c9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34101479e0 0x7f3410146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f34156c9700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34100b6810 con 0x7f341005c130 2021-01-03T12:59:51.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f34156c9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3410145160 con 0x7f34101479e0 2021-01-03T12:59:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f34156c9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34101417f0 con 0x7f3410061890 2021-01-03T12:59:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f3414ec8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34101479e0 0x7f3410146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f3414ec8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34101479e0 0x7f3410146500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33380/0 (socket says 172.21.15.133:33380) 2021-01-03T12:59:51.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f340f7fe700 1 --2- 172.21.15.133:0/3471385364 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3410061890 0x7f3410146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f3414ec8700 1 -- 172.21.15.133:0/3471385364 learned_addr learned my addr 172.21.15.133:0/3471385364 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f340ffff700 1 --2- 172.21.15.133:0/3471385364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f341005c130 0x7f341013f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f340f7fe700 1 -- 172.21.15.133:0/3471385364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34101479e0 msgr2=0x7f3410146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f340f7fe700 1 --2- 172.21.15.133:0/3471385364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34101479e0 0x7f3410146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:51.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f340f7fe700 1 -- 172.21.15.133:0/3471385364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f341005c130 msgr2=0x7f341013f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f340f7fe700 1 --2- 172.21.15.133:0/3471385364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f341005c130 0x7f341013f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f340f7fe700 1 -- 172.21.15.133:0/3471385364 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3410145390 con 0x7f3410061890 2021-01-03T12:59:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f340ffff700 1 --2- 172.21.15.133:0/3471385364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f341005c130 0x7f341013f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:59:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f3414ec8700 1 --2- 172.21.15.133:0/3471385364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34101479e0 0x7f3410146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T12:59:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f340f7fe700 1 --2- 172.21.15.133:0/3471385364 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3410061890 0x7f3410146010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f34101478f0 tx=0x7f3404007b40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f340d7fa700 1 -- 172.21.15.133:0/3471385364 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34040072e0 con 0x7f3410061890 2021-01-03T12:59:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f340d7fa700 1 -- 172.21.15.133:0/3471385364 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3404007440 con 0x7f3410061890 2021-01-03T12:59:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f340d7fa700 1 -- 172.21.15.133:0/3471385364 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34040057b0 con 0x7f3410061890 2021-01-03T12:59:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f34156c9700 1 -- 172.21.15.133:0/3471385364 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3410145630 con 0x7f3410061890 2021-01-03T12:59:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f34156c9700 1 -- 172.21.15.133:0/3471385364 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3410145b70 con 0x7f3410061890 2021-01-03T12:59:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.283+0000 7f34156c9700 1 -- 172.21.15.133:0/3471385364 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34100afb30 con 0x7f3410061890 2021-01-03T12:59:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.287+0000 7f340d7fa700 1 -- 172.21.15.133:0/3471385364 <== mon.2 v2:172.21.15.16:3301/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3404010070 con 0x7f3410061890 2021-01-03T12:59:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.287+0000 7f340d7fa700 1 --2- 172.21.15.133:0/3471385364 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f33f0055470 0x7f33f0057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.287+0000 7f340d7fa700 1 -- 172.21.15.133:0/3471385364 <== mon.2 v2:172.21.15.16:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f340406d370 con 0x7f3410061890 2021-01-03T12:59:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.287+0000 7f340ffff700 1 --2- 172.21.15.133:0/3471385364 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f33f0055470 0x7f33f0057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.287+0000 7f340ffff700 1 --2- 172.21.15.133:0/3471385364 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f33f0055470 0x7f33f0057930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f340001b000 tx=0x7f3400015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:51.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.295+0000 7f340d7fa700 1 -- 172.21.15.133:0/3471385364 <== mon.2 v2:172.21.15.16:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3404043670 con 0x7f3410061890 2021-01-03T12:59:51.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.483+0000 7f34156c9700 1 -- 172.21.15.133:0/3471385364 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3410145d00 con 0x7f3410061890 2021-01-03T12:59:51.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.483+0000 7f340d7fa700 1 -- 172.21.15.133:0/3471385364 <== mon.2 v2:172.21.15.16:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+2494 (secure 0 0 0) 0x7f3404018070 con 0x7f3410061890 2021-01-03T12:59:51.483 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:59:51.484 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":10,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4628,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2847550436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2847550436},{"type":"v1","addr":"172.21.15.16:6833","nonce":2847550436}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1321910656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1321910656},{"type":"v1","addr":"172.21.15.133:6835","nonce":1321910656}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T12:58:41.558757+0000","modified":"2021-01-03T12:58:42.561830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4888},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4888":{"gid":4888,"name":"a","rank":0,"incarnation":9,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1532041867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1532041867},{"type":"v1","addr":"172.21.15.133:6837","nonce":1532041867}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-01-03T12:59:51.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.483+0000 7f34156c9700 1 -- 172.21.15.133:0/3471385364 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f33f0055470 msgr2=0x7f33f0057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:51.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.483+0000 7f34156c9700 1 --2- 172.21.15.133:0/3471385364 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f33f0055470 0x7f33f0057930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f340001b000 tx=0x7f3400015000).stop 2021-01-03T12:59:51.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.487+0000 7f34156c9700 1 -- 172.21.15.133:0/3471385364 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3410061890 msgr2=0x7f3410146010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:51.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.487+0000 7f34156c9700 1 --2- 172.21.15.133:0/3471385364 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3410061890 0x7f3410146010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f34101478f0 tx=0x7f3404007b40).stop 2021-01-03T12:59:51.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.487+0000 7f34156c9700 1 -- 172.21.15.133:0/3471385364 shutdown_connections 2021-01-03T12:59:51.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.487+0000 7f34156c9700 1 --2- 172.21.15.133:0/3471385364 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f33f0055470 0x7f33f0057930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:51.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.487+0000 7f34156c9700 1 --2- 172.21.15.133:0/3471385364 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f341005c130 0x7f341013f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.487+0000 7f34156c9700 1 --2- 172.21.15.133:0/3471385364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34101479e0 0x7f3410146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.487+0000 7f34156c9700 1 --2- 172.21.15.133:0/3471385364 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3410061890 0x7f3410146010 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.487+0000 7f34156c9700 1 -- 172.21.15.133:0/3471385364 >> 172.21.15.133:0/3471385364 conn(0x7f34100b6110 msgr2=0x7f34100ab720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.487+0000 7f34156c9700 1 -- 172.21.15.133:0/3471385364 shutdown_connections 2021-01-03T12:59:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.487+0000 7f34156c9700 1 -- 172.21.15.133:0/3471385364 wait complete. 2021-01-03T12:59:51.488 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 10 2021-01-03T12:59:51.497 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-01-03T12:59:51.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e76a5e700 1 Processor -- start 2021-01-03T12:59:51.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e76a5e700 1 -- start start 2021-01-03T12:59:51.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e76a5e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0e700b9f40 0x7f0e70146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:51.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e76a5e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e70146920 0x7f0e7014d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:51.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e76a5e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e700605f0 con 0x7f0e700b9b60 2021-01-03T12:59:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e76a5e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e700aed30 con 0x7f0e70146920 2021-01-03T12:59:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e76a5e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e700600b0 con 0x7f0e700b9f40 2021-01-03T12:59:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e7625d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e70146920 0x7f0e7014d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e7625d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0e70146920 0x7f0e7014d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33386/0 (socket says 172.21.15.133:33386) 2021-01-03T12:59:51.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e7625d700 1 -- 172.21.15.133:0/3003224694 learned_addr learned my addr 172.21.15.133:0/3003224694 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e7525b700 1 --2- 172.21.15.133:0/3003224694 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0e700b9f40 0x7f0e70146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e7625d700 1 -- 172.21.15.133:0/3003224694 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0e700b9f40 msgr2=0x7f0e70146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e7625d700 1 --2- 172.21.15.133:0/3003224694 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0e700b9f40 0x7f0e70146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e7625d700 1 -- 172.21.15.133:0/3003224694 >> v1:172.21.15.16:6789/0 conn(0x7f0e700b9b60 legacy=0x7f0e700b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:51.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e7625d700 1 -- 172.21.15.133:0/3003224694 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e70060350 con 0x7f0e70146920 2021-01-03T12:59:51.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e7525b700 1 --2- 172.21.15.133:0/3003224694 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0e700b9f40 0x7f0e70146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:59:51.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e7625d700 1 --2- 172.21.15.133:0/3003224694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e70146920 0x7f0e7014d500 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f0e700af260 tx=0x7f0e68009270).ready entity=mon.1 client_cookie=7fb95e3346cb60a5 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:51.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e74a5a700 1 -- 172.21.15.133:0/3003224694 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e6800bbc0 con 0x7f0e70146920 2021-01-03T12:59:51.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e74a5a700 1 -- 172.21.15.133:0/3003224694 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6800bd20 con 0x7f0e70146920 2021-01-03T12:59:51.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e76a5e700 1 -- 172.21.15.133:0/3003224694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e70146920 msgr2=0x7f0e7014d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:51.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e74a5a700 1 -- 172.21.15.133:0/3003224694 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e68011400 con 0x7f0e70146920 2021-01-03T12:59:51.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e76a5e700 1 --2- 172.21.15.133:0/3003224694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e70146920 0x7f0e7014d500 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f0e700af260 tx=0x7f0e68009270).stop 2021-01-03T12:59:51.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e76a5e700 1 -- 172.21.15.133:0/3003224694 shutdown_connections 2021-01-03T12:59:51.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e76a5e700 1 --2- 172.21.15.133:0/3003224694 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e70146920 0x7f0e7014d500 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:51.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e76a5e700 1 --2- 172.21.15.133:0/3003224694 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0e700b9f40 0x7f0e70146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:51.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e76a5e700 1 -- 172.21.15.133:0/3003224694 >> 172.21.15.133:0/3003224694 conn(0x7f0e700b69e0 msgr2=0x7f0e700b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:51.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e76a5e700 1 -- 172.21.15.133:0/3003224694 shutdown_connections 2021-01-03T12:59:51.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.611+0000 7f0e76a5e700 1 -- 172.21.15.133:0/3003224694 wait complete. 2021-01-03T12:59:51.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e76a5e700 1 Processor -- start 2021-01-03T12:59:51.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e76a5e700 1 -- start start 2021-01-03T12:59:51.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e76a5e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e700b9b60 0x7f0e70140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:51.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e76a5e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e700b9f40 0x7f0e7009d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:51.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e76a5e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0e70146920 0x7f0e70151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:51.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e76a5e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e70155f00 con 0x7f0e700b9b60 2021-01-03T12:59:51.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e76a5e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e70141cc0 con 0x7f0e700b9f40 2021-01-03T12:59:51.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e76a5e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e70141780 con 0x7f0e70146920 2021-01-03T12:59:51.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e7525b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e700b9f40 0x7f0e7009d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:51.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e7525b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e700b9f40 0x7f0e7009d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33394/0 (socket says 172.21.15.133:33394) 2021-01-03T12:59:51.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e7525b700 1 -- 172.21.15.133:0/2673000422 learned_addr learned my addr 172.21.15.133:0/2673000422 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:51.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e7625d700 1 --2- 172.21.15.133:0/2673000422 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0e70146920 0x7f0e70151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:51.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e75a5c700 1 --2- 172.21.15.133:0/2673000422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e700b9b60 0x7f0e70140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:51.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e7525b700 1 -- 172.21.15.133:0/2673000422 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0e70146920 msgr2=0x7f0e70151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:51.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e7525b700 1 --2- 172.21.15.133:0/2673000422 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0e70146920 0x7f0e70151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:51.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e7525b700 1 -- 172.21.15.133:0/2673000422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e700b9b60 msgr2=0x7f0e70140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:51.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e7525b700 1 --2- 172.21.15.133:0/2673000422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e700b9b60 0x7f0e70140e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:51.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e7525b700 1 -- 172.21.15.133:0/2673000422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e70141a20 con 0x7f0e700b9f40 2021-01-03T12:59:51.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e7525b700 1 --2- 172.21.15.133:0/2673000422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e700b9f40 0x7f0e7009d960 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f0e60007000 tx=0x7f0e60008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:51.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e5effd700 1 -- 172.21.15.133:0/2673000422 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e60010580 con 0x7f0e700b9f40 2021-01-03T12:59:51.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e5effd700 1 -- 172.21.15.133:0/2673000422 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e600106e0 con 0x7f0e700b9f40 2021-01-03T12:59:51.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e76a5e700 1 -- 172.21.15.133:0/2673000422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e70140bc0 con 0x7f0e700b9f40 2021-01-03T12:59:51.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.615+0000 7f0e5effd700 1 -- 172.21.15.133:0/2673000422 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e60010a40 con 0x7f0e700b9f40 2021-01-03T12:59:51.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.619+0000 7f0e76a5e700 1 -- 172.21.15.133:0/2673000422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e70155c40 con 0x7f0e700b9f40 2021-01-03T12:59:51.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.619+0000 7f0e76a5e700 1 -- 172.21.15.133:0/2673000422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e70151b40 con 0x7f0e700b9f40 2021-01-03T12:59:51.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.619+0000 7f0e5effd700 1 -- 172.21.15.133:0/2673000422 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0e60010ba0 con 0x7f0e700b9f40 2021-01-03T12:59:51.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.619+0000 7f0e5effd700 1 --2- 172.21.15.133:0/2673000422 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0e500553f0 0x7f0e500578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:51.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.619+0000 7f0e5effd700 1 -- 172.21.15.133:0/2673000422 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0e6006dfd0 con 0x7f0e700b9f40 2021-01-03T12:59:51.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.619+0000 7f0e75a5c700 1 --2- 172.21.15.133:0/2673000422 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0e500553f0 0x7f0e500578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:51.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.623+0000 7f0e75a5c700 1 --2- 172.21.15.133:0/2673000422 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0e500553f0 0x7f0e500578b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f0e6c00d000 tx=0x7f0e6c007b40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:51.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.627+0000 7f0e5effd700 1 -- 172.21.15.133:0/2673000422 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0e70151b40 con 0x7f0e700b9f40 2021-01-03T12:59:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:51.807+0000 7f0e76a5e700 1 -- 172.21.15.133:0/2673000422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0e70151b40 con 0x7f0e700b9f40 2021-01-03T12:59:52.518 INFO:tasks.ceph.mon.b.smithi016.stderr:2021-01-03T12:59:52.517+0000 7fba5c9c4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-01-03T12:59:52.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.527+0000 7f0e5effd700 1 -- 172.21.15.133:0/2673000422 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v11) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0e70151b40 con 0x7f0e700b9f40 2021-01-03T12:59:52.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.531+0000 7f0e76a5e700 1 -- 172.21.15.133:0/2673000422 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0e500553f0 msgr2=0x7f0e500578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:52.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.531+0000 7f0e76a5e700 1 --2- 172.21.15.133:0/2673000422 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0e500553f0 0x7f0e500578b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f0e6c00d000 tx=0x7f0e6c007b40).stop 2021-01-03T12:59:52.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.531+0000 7f0e76a5e700 1 -- 172.21.15.133:0/2673000422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e700b9f40 msgr2=0x7f0e7009d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:52.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.531+0000 7f0e76a5e700 1 --2- 172.21.15.133:0/2673000422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e700b9f40 0x7f0e7009d960 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f0e60007000 tx=0x7f0e60008040).stop 2021-01-03T12:59:52.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.531+0000 7f0e76a5e700 1 -- 172.21.15.133:0/2673000422 shutdown_connections 2021-01-03T12:59:52.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.531+0000 7f0e76a5e700 1 --2- 172.21.15.133:0/2673000422 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0e500553f0 0x7f0e500578b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:52.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.531+0000 7f0e76a5e700 1 --2- 172.21.15.133:0/2673000422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0e700b9b60 0x7f0e70140e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:52.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.531+0000 7f0e76a5e700 1 --2- 172.21.15.133:0/2673000422 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0e70146920 0x7f0e70151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:52.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.531+0000 7f0e76a5e700 1 --2- 172.21.15.133:0/2673000422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0e700b9f40 0x7f0e7009d960 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:52.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.531+0000 7f0e76a5e700 1 -- 172.21.15.133:0/2673000422 >> 172.21.15.133:0/2673000422 conn(0x7f0e700b69e0 msgr2=0x7f0e70145620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:52.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.531+0000 7f0e76a5e700 1 -- 172.21.15.133:0/2673000422 shutdown_connections 2021-01-03T12:59:52.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.531+0000 7f0e76a5e700 1 -- 172.21.15.133:0/2673000422 wait complete. 2021-01-03T12:59:52.534 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-01-03T12:59:52.546 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T12:59:52.565 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T12:59:52.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.655+0000 7f22cb59e700 1 Processor -- start 2021-01-03T12:59:52.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.655+0000 7f22cb59e700 1 -- start start 2021-01-03T12:59:52.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.655+0000 7f22cb59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f22cc0b0c90 0x7f22cc0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:52.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.655+0000 7f22cb59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f22cc0b5c00 0x7f22cc143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:52.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.655+0000 7f22cb59e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc060da0 con 0x7f22cc0b52c0 2021-01-03T12:59:52.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.655+0000 7f22cb59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc067a90 con 0x7f22cc0b5c00 2021-01-03T12:59:52.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.655+0000 7f22cb59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc0b0ad0 con 0x7f22cc0b0c90 2021-01-03T12:59:52.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.655+0000 7f22c9d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f22cc0b0c90 0x7f22cc0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:52.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.655+0000 7f22c9d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f22cc0b0c90 0x7f22cc0b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33414/0 (socket says 172.21.15.133:33414) 2021-01-03T12:59:52.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.655+0000 7f22c9d9b700 1 -- 172.21.15.133:0/328715797 learned_addr learned my addr 172.21.15.133:0/328715797 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:52.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.655+0000 7f22cad9d700 1 --2- 172.21.15.133:0/328715797 >> v2:172.21.15.16:3300/0 conn(0x7f22cc0b5c00 0x7f22cc143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:52.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.655+0000 7f22c9d9b700 1 -- 172.21.15.133:0/328715797 >> v2:172.21.15.16:3300/0 conn(0x7f22cc0b5c00 msgr2=0x7f22cc143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:52.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.655+0000 7f22c9d9b700 1 --2- 172.21.15.133:0/328715797 >> v2:172.21.15.16:3300/0 conn(0x7f22cc0b5c00 0x7f22cc143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:52.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.655+0000 7f22c9d9b700 1 -- 172.21.15.133:0/328715797 >> v1:172.21.15.16:6789/0 conn(0x7f22cc0b52c0 legacy=0x7f22cc098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:52.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.655+0000 7f22c9d9b700 1 -- 172.21.15.133:0/328715797 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc0b56a0 con 0x7f22cc0b0c90 2021-01-03T12:59:52.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.655+0000 7f22c9d9b700 1 --2- 172.21.15.133:0/328715797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22cc0b0c90 0x7f22cc0b05e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f22bc002f30 tx=0x7f22bc006e80).ready entity=mon.1 client_cookie=e88a00b056420389 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:52.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.655+0000 7f22c959a700 1 -- 172.21.15.133:0/328715797 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22bc0097f0 con 0x7f22cc0b0c90 2021-01-03T12:59:52.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22c959a700 1 -- 172.21.15.133:0/328715797 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc009950 con 0x7f22cc0b0c90 2021-01-03T12:59:52.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22c959a700 1 -- 172.21.15.133:0/328715797 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22bc009cb0 con 0x7f22cc0b0c90 2021-01-03T12:59:52.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 -- 172.21.15.133:0/328715797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22cc0b0c90 msgr2=0x7f22cc0b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:52.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 --2- 172.21.15.133:0/328715797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22cc0b0c90 0x7f22cc0b05e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f22bc002f30 tx=0x7f22bc006e80).stop 2021-01-03T12:59:52.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 -- 172.21.15.133:0/328715797 shutdown_connections 2021-01-03T12:59:52.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 --2- 172.21.15.133:0/328715797 >> v2:172.21.15.16:3300/0 conn(0x7f22cc0b5c00 0x7f22cc143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:52.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 --2- 172.21.15.133:0/328715797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22cc0b0c90 0x7f22cc0b05e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:52.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 -- 172.21.15.133:0/328715797 >> 172.21.15.133:0/328715797 conn(0x7f22cc05bdf0 msgr2=0x7f22cc05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:52.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 -- 172.21.15.133:0/328715797 shutdown_connections 2021-01-03T12:59:52.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 -- 172.21.15.133:0/328715797 wait complete. 2021-01-03T12:59:52.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 Processor -- start 2021-01-03T12:59:52.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 -- start start 2021-01-03T12:59:52.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22cc0b0c90 0x7f22cc159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:52.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22cc0b52c0 0x7f22cc15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:52.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22cc0b5c00 0x7f22cc066080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:52.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc064060 con 0x7f22cc0b0c90 2021-01-03T12:59:52.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0aef70 con 0x7f22cc0b5c00 2021-01-03T12:59:52.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0aea30 con 0x7f22cc0b52c0 2021-01-03T12:59:52.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22cc0b5c00 0x7f22cc066080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:52.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22cc0b5c00 0x7f22cc066080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33420/0 (socket says 172.21.15.133:33420) 2021-01-03T12:59:52.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cad9d700 1 -- 172.21.15.133:0/2034046731 learned_addr learned my addr 172.21.15.133:0/2034046731 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:52.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22ca59c700 1 --2- 172.21.15.133:0/2034046731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22cc0b0c90 0x7f22cc159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:52.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22c9d9b700 1 --2- 172.21.15.133:0/2034046731 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22cc0b52c0 0x7f22cc15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:52.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cad9d700 1 -- 172.21.15.133:0/2034046731 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22cc0b52c0 msgr2=0x7f22cc15a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:52.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cad9d700 1 --2- 172.21.15.133:0/2034046731 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22cc0b52c0 0x7f22cc15a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:52.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cad9d700 1 -- 172.21.15.133:0/2034046731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22cc0b0c90 msgr2=0x7f22cc159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:52.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cad9d700 1 --2- 172.21.15.133:0/2034046731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22cc0b0c90 0x7f22cc159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:52.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cad9d700 1 -- 172.21.15.133:0/2034046731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc0aecd0 con 0x7f22cc0b5c00 2021-01-03T12:59:52.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cad9d700 1 --2- 172.21.15.133:0/2034046731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22cc0b5c00 0x7f22cc066080 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f22b4006a50 tx=0x7f22b4006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:52.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22c37fe700 1 -- 172.21.15.133:0/2034046731 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22b400ca10 con 0x7f22cc0b5c00 2021-01-03T12:59:52.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22c37fe700 1 -- 172.21.15.133:0/2034046731 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b400cb70 con 0x7f22cc0b5c00 2021-01-03T12:59:52.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22c37fe700 1 -- 172.21.15.133:0/2034046731 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22b40123f0 con 0x7f22cc0b5c00 2021-01-03T12:59:52.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 -- 172.21.15.133:0/2034046731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc0644c0 con 0x7f22cc0b5c00 2021-01-03T12:59:52.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.659+0000 7f22cb59e700 1 -- 172.21.15.133:0/2034046731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc064b00 con 0x7f22cc0b5c00 2021-01-03T12:59:52.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.663+0000 7f22cb59e700 1 -- 172.21.15.133:0/2034046731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc0641d0 con 0x7f22cc0b5c00 2021-01-03T12:59:52.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.663+0000 7f22c37fe700 1 -- 172.21.15.133:0/2034046731 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f22b4012550 con 0x7f22cc0b5c00 2021-01-03T12:59:52.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.663+0000 7f22c37fe700 1 --2- 172.21.15.133:0/2034046731 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22b00553b0 0x7f22b0057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:52.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.663+0000 7f22c37fe700 1 -- 172.21.15.133:0/2034046731 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f22b406e4c0 con 0x7f22cc0b5c00 2021-01-03T12:59:52.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.663+0000 7f22ca59c700 1 --2- 172.21.15.133:0/2034046731 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22b00553b0 0x7f22b0057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:52.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.663+0000 7f22ca59c700 1 --2- 172.21.15.133:0/2034046731 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22b00553b0 0x7f22b0057870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f22c400b000 tx=0x7f22c4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:52.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.667+0000 7f22c37fe700 1 -- 172.21.15.133:0/2034046731 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f22b4044670 con 0x7f22cc0b5c00 2021-01-03T12:59:52.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.851+0000 7f22cb59e700 1 -- 172.21.15.133:0/2034046731 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22cc057300 con 0x7f22cc0b5c00 2021-01-03T12:59:52.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.851+0000 7f22c37fe700 1 -- 172.21.15.133:0/2034046731 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2131 (secure 0 0 0) 0x7f22b4047c90 con 0x7f22cc0b5c00 2021-01-03T12:59:52.851 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:59:52.852 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4628,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/2847550436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2847550436},{"type":"v1","addr":"172.21.15.16:6833","nonce":2847550436}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":4885,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1321910656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1321910656},{"type":"v1","addr":"172.21.15.133:6835","nonce":1321910656}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8}],"filesystems":[{"mdsmap":{"epoch":11,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T12:58:41.558757+0000","modified":"2021-01-03T12:59:52.520499+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2021-01-03T12:59:52.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.855+0000 7f22cb59e700 1 -- 172.21.15.133:0/2034046731 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22b00553b0 msgr2=0x7f22b0057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:52.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.855+0000 7f22cb59e700 1 --2- 172.21.15.133:0/2034046731 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22b00553b0 0x7f22b0057870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f22c400b000 tx=0x7f22c4009040).stop 2021-01-03T12:59:52.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.855+0000 7f22cb59e700 1 -- 172.21.15.133:0/2034046731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22cc0b5c00 msgr2=0x7f22cc066080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:52.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.855+0000 7f22cb59e700 1 --2- 172.21.15.133:0/2034046731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22cc0b5c00 0x7f22cc066080 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f22b4006a50 tx=0x7f22b4006dc0).stop 2021-01-03T12:59:52.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.855+0000 7f22cb59e700 1 -- 172.21.15.133:0/2034046731 shutdown_connections 2021-01-03T12:59:52.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.855+0000 7f22cb59e700 1 --2- 172.21.15.133:0/2034046731 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22b00553b0 0x7f22b0057870 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.855+0000 7f22cb59e700 1 --2- 172.21.15.133:0/2034046731 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22cc0b0c90 0x7f22cc159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.855+0000 7f22cb59e700 1 --2- 172.21.15.133:0/2034046731 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22cc0b5c00 0x7f22cc066080 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.855+0000 7f22cb59e700 1 --2- 172.21.15.133:0/2034046731 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22cc0b52c0 0x7f22cc15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.855+0000 7f22cb59e700 1 -- 172.21.15.133:0/2034046731 >> 172.21.15.133:0/2034046731 conn(0x7f22cc05bdf0 msgr2=0x7f22cc144350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.855+0000 7f22cb59e700 1 -- 172.21.15.133:0/2034046731 shutdown_connections 2021-01-03T12:59:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:52.855+0000 7f22cb59e700 1 -- 172.21.15.133:0/2034046731 wait complete. 2021-01-03T12:59:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 11 2021-01-03T12:59:52.865 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-01-03T12:59:53.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.027+0000 7fd22d048700 1 Processor -- start 2021-01-03T12:59:53.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.027+0000 7fd22d048700 1 -- start start 2021-01-03T12:59:53.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.027+0000 7fd22d048700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd2280b52c0 0x7fd2280b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:53.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.027+0000 7fd22d048700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd2280b5c00 0x7fd228143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:53.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.027+0000 7fd22d048700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd228060da0 con 0x7fd2280b0c90 2021-01-03T12:59:53.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.027+0000 7fd22d048700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd228067a90 con 0x7fd2280b5c00 2021-01-03T12:59:53.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.027+0000 7fd22d048700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2280b0ad0 con 0x7fd2280b52c0 2021-01-03T12:59:53.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.027+0000 7fd227fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd2280b52c0 0x7fd2280b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:53.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.027+0000 7fd2277fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd2280b0c90 0x7fd228098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54456/0 (socket says 172.21.15.133:54456) 2021-01-03T12:59:53.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.027+0000 7fd2277fe700 1 -- 172.21.15.133:0/391838828 learned_addr learned my addr 172.21.15.133:0/391838828 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:59:53.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.027+0000 7fd22c847700 1 --2- 172.21.15.133:0/391838828 >> v2:172.21.15.16:3300/0 conn(0x7fd2280b5c00 0x7fd228143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:53.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd227fff700 1 -- 172.21.15.133:0/391838828 >> v2:172.21.15.16:3300/0 conn(0x7fd2280b5c00 msgr2=0x7fd228143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:53.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd227fff700 1 --2- 172.21.15.133:0/391838828 >> v2:172.21.15.16:3300/0 conn(0x7fd2280b5c00 0x7fd228143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:53.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd227fff700 1 -- 172.21.15.133:0/391838828 >> v1:172.21.15.133:6789/0 conn(0x7fd2280b0c90 legacy=0x7fd228098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:53.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd226ffd700 1 -- 172.21.15.133:0/391838828 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706013155 0 0) 0x7fd228060da0 con 0x7fd2280b0c90 2021-01-03T12:59:53.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd227fff700 1 -- 172.21.15.133:0/391838828 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2280b56a0 con 0x7fd2280b52c0 2021-01-03T12:59:53.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd227fff700 1 --2- 172.21.15.133:0/391838828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2280b52c0 0x7fd2280b05e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fd2100032b0 tx=0x7fd2100091a0).ready entity=mon.1 client_cookie=3461d9de36c68ed9 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:53.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd226ffd700 1 -- 172.21.15.133:0/391838828 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd21000b9a0 con 0x7fd2280b52c0 2021-01-03T12:59:53.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd226ffd700 1 -- 172.21.15.133:0/391838828 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21000bb00 con 0x7fd2280b52c0 2021-01-03T12:59:53.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd226ffd700 1 -- 172.21.15.133:0/391838828 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd21000bc70 con 0x7fd2280b52c0 2021-01-03T12:59:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd22d048700 1 -- 172.21.15.133:0/391838828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2280b52c0 msgr2=0x7fd2280b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd22d048700 1 --2- 172.21.15.133:0/391838828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2280b52c0 0x7fd2280b05e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fd2100032b0 tx=0x7fd2100091a0).stop 2021-01-03T12:59:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd22d048700 1 -- 172.21.15.133:0/391838828 shutdown_connections 2021-01-03T12:59:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd22d048700 1 --2- 172.21.15.133:0/391838828 >> v2:172.21.15.16:3300/0 conn(0x7fd2280b5c00 0x7fd228143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:53.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd22d048700 1 --2- 172.21.15.133:0/391838828 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2280b52c0 0x7fd2280b05e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd22d048700 1 -- 172.21.15.133:0/391838828 >> 172.21.15.133:0/391838828 conn(0x7fd22805bdf0 msgr2=0x7fd22805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd22d048700 1 -- 172.21.15.133:0/391838828 shutdown_connections 2021-01-03T12:59:53.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd22d048700 1 -- 172.21.15.133:0/391838828 wait complete. 2021-01-03T12:59:53.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd22d048700 1 Processor -- start 2021-01-03T12:59:53.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.031+0000 7fd22d048700 1 -- start start 2021-01-03T12:59:53.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd22d048700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2280b0c90 0x7fd228148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:53.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd22d048700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2280b52c0 0x7fd228159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:53.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd22d048700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd2280b5c00 0x7fd228159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:53.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd22d048700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280af680 con 0x7fd2280b0c90 2021-01-03T12:59:53.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd22d048700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd228066570 con 0x7fd2280b52c0 2021-01-03T12:59:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd22d048700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd228064890 con 0x7fd2280b5c00 2021-01-03T12:59:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd2277fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2280b52c0 0x7fd228159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd2277fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2280b52c0 0x7fd228159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33432/0 (socket says 172.21.15.133:33432) 2021-01-03T12:59:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd2277fe700 1 -- 172.21.15.133:0/265984933 learned_addr learned my addr 172.21.15.133:0/265984933 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:53.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd22c847700 1 --2- 172.21.15.133:0/265984933 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd2280b5c00 0x7fd228159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:53.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd227fff700 1 --2- 172.21.15.133:0/265984933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2280b0c90 0x7fd228148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:53.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd2277fe700 1 -- 172.21.15.133:0/265984933 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd2280b5c00 msgr2=0x7fd228159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:53.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd2277fe700 1 --2- 172.21.15.133:0/265984933 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd2280b5c00 0x7fd228159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:53.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd2277fe700 1 -- 172.21.15.133:0/265984933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2280b0c90 msgr2=0x7fd228148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:53.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd2277fe700 1 --2- 172.21.15.133:0/265984933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2280b0c90 0x7fd228148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:53.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd2277fe700 1 -- 172.21.15.133:0/265984933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd228063d70 con 0x7fd2280b52c0 2021-01-03T12:59:53.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd227fff700 1 --2- 172.21.15.133:0/265984933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2280b0c90 0x7fd228148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:59:53.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd2277fe700 1 --2- 172.21.15.133:0/265984933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2280b52c0 0x7fd228159310 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fd218000e90 tx=0x7fd218007a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:53.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd2257fa700 1 -- 172.21.15.133:0/265984933 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd218007320 con 0x7fd2280b52c0 2021-01-03T12:59:53.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd2257fa700 1 -- 172.21.15.133:0/265984933 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd218007480 con 0x7fd2280b52c0 2021-01-03T12:59:53.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd22d048700 1 -- 172.21.15.133:0/265984933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd228159cf0 con 0x7fd2280b52c0 2021-01-03T12:59:53.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd2257fa700 1 -- 172.21.15.133:0/265984933 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2180057d0 con 0x7fd2280b52c0 2021-01-03T12:59:53.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd22d048700 1 -- 172.21.15.133:0/265984933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2280661f0 con 0x7fd2280b52c0 2021-01-03T12:59:53.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.035+0000 7fd22d048700 1 -- 172.21.15.133:0/265984933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd228063f00 con 0x7fd2280b52c0 2021-01-03T12:59:53.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.039+0000 7fd2257fa700 1 -- 172.21.15.133:0/265984933 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd218010030 con 0x7fd2280b52c0 2021-01-03T12:59:53.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.039+0000 7fd2257fa700 1 --2- 172.21.15.133:0/265984933 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd20c0553b0 0x7fd20c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:53.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.039+0000 7fd2257fa700 1 -- 172.21.15.133:0/265984933 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd21806de10 con 0x7fd2280b52c0 2021-01-03T12:59:53.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.039+0000 7fd227fff700 1 --2- 172.21.15.133:0/265984933 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd20c0553b0 0x7fd20c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:53.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.039+0000 7fd227fff700 1 --2- 172.21.15.133:0/265984933 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd20c0553b0 0x7fd20c057870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fd210019000 tx=0x7fd210016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:53.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.043+0000 7fd2257fa700 1 -- 172.21.15.133:0/265984933 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd218044020 con 0x7fd2280b52c0 2021-01-03T12:59:53.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:53.227+0000 7fd22d048700 1 -- 172.21.15.133:0/265984933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd228057300 con 0x7fd2280b52c0 2021-01-03T12:59:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.227+0000 7fd2257fa700 1 -- 172.21.15.133:0/265984933 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v12) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd218047640 con 0x7fd2280b52c0 2021-01-03T12:59:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.231+0000 7fd22d048700 1 -- 172.21.15.133:0/265984933 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd20c0553b0 msgr2=0x7fd20c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.231+0000 7fd22d048700 1 --2- 172.21.15.133:0/265984933 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd20c0553b0 0x7fd20c057870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fd210019000 tx=0x7fd210016000).stop 2021-01-03T12:59:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.231+0000 7fd22d048700 1 -- 172.21.15.133:0/265984933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2280b52c0 msgr2=0x7fd228159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:54.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.231+0000 7fd22d048700 1 --2- 172.21.15.133:0/265984933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2280b52c0 0x7fd228159310 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fd218000e90 tx=0x7fd218007a90).stop 2021-01-03T12:59:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.231+0000 7fd22d048700 1 -- 172.21.15.133:0/265984933 shutdown_connections 2021-01-03T12:59:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.231+0000 7fd22d048700 1 --2- 172.21.15.133:0/265984933 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd20c0553b0 0x7fd20c057870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.231+0000 7fd22d048700 1 --2- 172.21.15.133:0/265984933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2280b0c90 0x7fd228148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.231+0000 7fd22d048700 1 --2- 172.21.15.133:0/265984933 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd2280b5c00 0x7fd228159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.231+0000 7fd22d048700 1 --2- 172.21.15.133:0/265984933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2280b52c0 0x7fd228159310 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.235+0000 7fd22d048700 1 -- 172.21.15.133:0/265984933 >> 172.21.15.133:0/265984933 conn(0x7fd22805bdf0 msgr2=0x7fd2280604b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.235+0000 7fd22d048700 1 -- 172.21.15.133:0/265984933 shutdown_connections 2021-01-03T12:59:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.235+0000 7fd22d048700 1 -- 172.21.15.133:0/265984933 wait complete. 2021-01-03T12:59:54.248 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-01-03T12:59:54.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.375+0000 7fd56f326700 1 Processor -- start 2021-01-03T12:59:54.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.375+0000 7fd56f326700 1 -- start start 2021-01-03T12:59:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56f326700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5680b3670 0x7fd5680b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56f326700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5680ac200 con 0x7fd5680b1f30 2021-01-03T12:59:54.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56f326700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5680ac430 con 0x7fd5680b7910 2021-01-03T12:59:54.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56f326700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5680ad720 con 0x7fd5680b3670 2021-01-03T12:59:54.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56db23700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5680b3670 0x7fd5680b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:54.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56e324700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd5680b7910 0x7fd56813e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54470/0 (socket says 172.21.15.133:54470) 2021-01-03T12:59:54.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56db23700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5680b3670 0x7fd5680b7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33440/0 (socket says 172.21.15.133:33440) 2021-01-03T12:59:54.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56e324700 1 -- 172.21.15.133:0/2125510294 learned_addr learned my addr 172.21.15.133:0/2125510294 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:59:54.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56db23700 1 -- 172.21.15.133:0/2125510294 >> v1:172.21.15.133:6789/0 conn(0x7fd5680b7910 legacy=0x7fd56813e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:54.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56db23700 1 -- 172.21.15.133:0/2125510294 >> v1:172.21.15.16:6789/0 conn(0x7fd5680b1f30 legacy=0x7fd5680b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:54.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56d322700 1 -- 172.21.15.133:0/2125510294 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150156641 0 0) 0x7fd5680ac430 con 0x7fd5680b7910 2021-01-03T12:59:54.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56db23700 1 -- 172.21.15.133:0/2125510294 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5680ac6d0 con 0x7fd5680b3670 2021-01-03T12:59:54.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56db23700 1 --2- 172.21.15.133:0/2125510294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5680b3670 0x7fd5680b7cf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fd564002f30 tx=0x7fd564006d60).ready entity=mon.1 client_cookie=5df3de0df320c104 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:54.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56d322700 1 -- 172.21.15.133:0/2125510294 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5640097f0 con 0x7fd5680b3670 2021-01-03T12:59:54.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56d322700 1 -- 172.21.15.133:0/2125510294 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd564009950 con 0x7fd5680b3670 2021-01-03T12:59:54.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56d322700 1 -- 172.21.15.133:0/2125510294 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd564009ac0 con 0x7fd5680b3670 2021-01-03T12:59:54.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56f326700 1 -- 172.21.15.133:0/2125510294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5680b3670 msgr2=0x7fd5680b7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:54.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56f326700 1 --2- 172.21.15.133:0/2125510294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5680b3670 0x7fd5680b7cf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fd564002f30 tx=0x7fd564006d60).stop 2021-01-03T12:59:54.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56f326700 1 -- 172.21.15.133:0/2125510294 shutdown_connections 2021-01-03T12:59:54.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56f326700 1 --2- 172.21.15.133:0/2125510294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5680b3670 0x7fd5680b7cf0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:54.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56f326700 1 -- 172.21.15.133:0/2125510294 >> 172.21.15.133:0/2125510294 conn(0x7fd56805c8c0 msgr2=0x7fd5680b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:54.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56f326700 1 -- 172.21.15.133:0/2125510294 shutdown_connections 2021-01-03T12:59:54.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.379+0000 7fd56f326700 1 -- 172.21.15.133:0/2125510294 wait complete. 2021-01-03T12:59:54.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56f326700 1 Processor -- start 2021-01-03T12:59:54.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56f326700 1 -- start start 2021-01-03T12:59:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56f326700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5680b1f30 0x7fd568153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56f326700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5680b3670 0x7fd5680b6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56f326700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5680b7910 0x7fd5680b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:54.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56f326700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd568154200 con 0x7fd5680b1f30 2021-01-03T12:59:54.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56f326700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5680aea80 con 0x7fd5680b3670 2021-01-03T12:59:54.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56f326700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd568153330 con 0x7fd5680b7910 2021-01-03T12:59:54.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56db23700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5680b3670 0x7fd5680b6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:54.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56db23700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5680b3670 0x7fd5680b6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33446/0 (socket says 172.21.15.133:33446) 2021-01-03T12:59:54.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56db23700 1 -- 172.21.15.133:0/2036362741 learned_addr learned my addr 172.21.15.133:0/2036362741 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:54.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56e324700 1 --2- 172.21.15.133:0/2036362741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5680b1f30 0x7fd568153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:54.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56eb25700 1 --2- 172.21.15.133:0/2036362741 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5680b7910 0x7fd5680b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:54.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56db23700 1 -- 172.21.15.133:0/2036362741 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5680b7910 msgr2=0x7fd5680b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:54.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56db23700 1 --2- 172.21.15.133:0/2036362741 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5680b7910 0x7fd5680b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:54.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56db23700 1 -- 172.21.15.133:0/2036362741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5680b1f30 msgr2=0x7fd568153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:54.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56db23700 1 --2- 172.21.15.133:0/2036362741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5680b1f30 0x7fd568153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:54.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56db23700 1 -- 172.21.15.133:0/2036362741 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5681535d0 con 0x7fd5680b3670 2021-01-03T12:59:54.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56eb25700 1 --2- 172.21.15.133:0/2036362741 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5680b7910 0x7fd5680b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:59:54.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.383+0000 7fd56db23700 1 --2- 172.21.15.133:0/2036362741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5680b3670 0x7fd5680b6500 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fd564002f30 tx=0x7fd564016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:54.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.387+0000 7fd55b7fe700 1 -- 172.21.15.133:0/2036362741 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd564011bd0 con 0x7fd5680b3670 2021-01-03T12:59:54.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.387+0000 7fd55b7fe700 1 -- 172.21.15.133:0/2036362741 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd564011d30 con 0x7fd5680b3670 2021-01-03T12:59:54.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.387+0000 7fd56f326700 1 -- 172.21.15.133:0/2036362741 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd568153870 con 0x7fd5680b3670 2021-01-03T12:59:54.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.387+0000 7fd55b7fe700 1 -- 172.21.15.133:0/2036362741 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd564011ea0 con 0x7fd5680b3670 2021-01-03T12:59:54.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.387+0000 7fd56f326700 1 -- 172.21.15.133:0/2036362741 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5680b6ea0 con 0x7fd5680b3670 2021-01-03T12:59:54.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.387+0000 7fd56f326700 1 -- 172.21.15.133:0/2036362741 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5680b5490 con 0x7fd5680b3670 2021-01-03T12:59:54.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.387+0000 7fd55b7fe700 1 -- 172.21.15.133:0/2036362741 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd56400f070 con 0x7fd5680b3670 2021-01-03T12:59:54.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.387+0000 7fd55b7fe700 1 --2- 172.21.15.133:0/2036362741 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd5480553b0 0x7fd548057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:54.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.387+0000 7fd56e324700 1 --2- 172.21.15.133:0/2036362741 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd5480553b0 0x7fd548057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:54.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.387+0000 7fd55b7fe700 1 -- 172.21.15.133:0/2036362741 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd56406e490 con 0x7fd5680b3670 2021-01-03T12:59:54.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.387+0000 7fd56e324700 1 --2- 172.21.15.133:0/2036362741 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd5480553b0 0x7fd548057870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fd55c00d000 tx=0x7fd55c007bd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.395+0000 7fd55b7fe700 1 -- 172.21.15.133:0/2036362741 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd564044740 con 0x7fd5680b3670 2021-01-03T12:59:54.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:54.535+0000 7fd56f326700 1 -- 172.21.15.133:0/2036362741 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd568153a00 con 0x7fd5680b3670 2021-01-03T12:59:55.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.239+0000 7fd55b7fe700 1 -- 172.21.15.133:0/2036362741 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) v1 ==== 185+0+0 (secure 0 0 0) 0x7fd5640150e0 con 0x7fd5680b3670 2021-01-03T12:59:55.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.239+0000 7fd56f326700 1 -- 172.21.15.133:0/2036362741 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd5480553b0 msgr2=0x7fd548057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:55.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.239+0000 7fd56f326700 1 --2- 172.21.15.133:0/2036362741 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd5480553b0 0x7fd548057870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fd55c00d000 tx=0x7fd55c007bd0).stop 2021-01-03T12:59:55.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.239+0000 7fd56f326700 1 -- 172.21.15.133:0/2036362741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5680b3670 msgr2=0x7fd5680b6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:55.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.239+0000 7fd56f326700 1 --2- 172.21.15.133:0/2036362741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5680b3670 0x7fd5680b6500 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fd564002f30 tx=0x7fd564016000).stop 2021-01-03T12:59:55.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.243+0000 7fd56f326700 1 -- 172.21.15.133:0/2036362741 shutdown_connections 2021-01-03T12:59:55.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.243+0000 7fd56f326700 1 --2- 172.21.15.133:0/2036362741 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd5480553b0 0x7fd548057870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:55.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.243+0000 7fd56f326700 1 --2- 172.21.15.133:0/2036362741 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5680b1f30 0x7fd568153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:55.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.243+0000 7fd56f326700 1 --2- 172.21.15.133:0/2036362741 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5680b7910 0x7fd5680b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:55.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.243+0000 7fd56f326700 1 --2- 172.21.15.133:0/2036362741 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5680b3670 0x7fd5680b6500 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:55.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.243+0000 7fd56f326700 1 -- 172.21.15.133:0/2036362741 >> 172.21.15.133:0/2036362741 conn(0x7fd56805c8c0 msgr2=0x7fd568142be0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:55.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.243+0000 7fd56f326700 1 -- 172.21.15.133:0/2036362741 shutdown_connections 2021-01-03T12:59:55.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.243+0000 7fd56f326700 1 -- 172.21.15.133:0/2036362741 wait complete. 2021-01-03T12:59:55.246 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2021-01-03T12:59:55.259 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-01-03T12:59:55.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f2053fff700 1 Processor -- start 2021-01-03T12:59:55.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f2053fff700 1 -- start start 2021-01-03T12:59:55.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f2053fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20540aab00 0x7f20540b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:55.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f2053fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f205409a1f0 0x7f2054142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:55.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f2053fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2054061050 con 0x7f20540abdb0 2021-01-03T12:59:55.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f2053fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20540aaee0 con 0x7f20540aab00 2021-01-03T12:59:55.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f2053fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20540b5cc0 con 0x7f205409a1f0 2021-01-03T12:59:55.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f20527fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f20540abdb0 0x7f2054146380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54486/0 (socket says 172.21.15.133:54486) 2021-01-03T12:59:55.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f20527fc700 1 -- 172.21.15.133:0/1138187904 learned_addr learned my addr 172.21.15.133:0/1138187904 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:59:55.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f20537fe700 1 --2- 172.21.15.133:0/1138187904 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f205409a1f0 0x7f2054142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:55.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f2052ffd700 1 --2- 172.21.15.133:0/1138187904 >> v2:172.21.15.16:3300/0 conn(0x7f20540aab00 0x7f20540b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:55.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f2051ffb700 1 -- 172.21.15.133:0/1138187904 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269042843 0 0) 0x7f2054061050 con 0x7f20540abdb0 2021-01-03T12:59:55.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f2051ffb700 1 -- 172.21.15.133:0/1138187904 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2038003230 con 0x7f20540abdb0 2021-01-03T12:59:55.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f20537fe700 1 -- 172.21.15.133:0/1138187904 >> v2:172.21.15.16:3300/0 conn(0x7f20540aab00 msgr2=0x7f20540b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:55.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f20537fe700 1 --2- 172.21.15.133:0/1138187904 >> v2:172.21.15.16:3300/0 conn(0x7f20540aab00 0x7f20540b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:55.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f20537fe700 1 -- 172.21.15.133:0/1138187904 >> v1:172.21.15.133:6789/0 conn(0x7f20540abdb0 legacy=0x7f2054146380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:55.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f20537fe700 1 -- 172.21.15.133:0/1138187904 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2054060db0 con 0x7f205409a1f0 2021-01-03T12:59:55.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f20537fe700 1 --2- 172.21.15.133:0/1138187904 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f205409a1f0 0x7f2054142ea0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2048002f30 tx=0x7f2048006dc0).ready entity=mon.2 client_cookie=2fcde76d2ef260d7 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:55.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f2051ffb700 1 -- 172.21.15.133:0/1138187904 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20480096a0 con 0x7f205409a1f0 2021-01-03T12:59:55.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f2051ffb700 1 -- 172.21.15.133:0/1138187904 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2048009800 con 0x7f205409a1f0 2021-01-03T12:59:55.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f2051ffb700 1 -- 172.21.15.133:0/1138187904 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2048009b60 con 0x7f205409a1f0 2021-01-03T12:59:55.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f2053fff700 1 -- 172.21.15.133:0/1138187904 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f205409a1f0 msgr2=0x7f2054142ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:55.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.379+0000 7f2053fff700 1 --2- 172.21.15.133:0/1138187904 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f205409a1f0 0x7f2054142ea0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2048002f30 tx=0x7f2048006dc0).stop 2021-01-03T12:59:55.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2053fff700 1 -- 172.21.15.133:0/1138187904 shutdown_connections 2021-01-03T12:59:55.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2053fff700 1 --2- 172.21.15.133:0/1138187904 >> v2:172.21.15.16:3300/0 conn(0x7f20540aab00 0x7f20540b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:55.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2053fff700 1 --2- 172.21.15.133:0/1138187904 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f205409a1f0 0x7f2054142ea0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:55.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2053fff700 1 -- 172.21.15.133:0/1138187904 >> 172.21.15.133:0/1138187904 conn(0x7f205405bdf0 msgr2=0x7f205405c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:55.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2053fff700 1 -- 172.21.15.133:0/1138187904 shutdown_connections 2021-01-03T12:59:55.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2053fff700 1 -- 172.21.15.133:0/1138187904 wait complete. 2021-01-03T12:59:55.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2053fff700 1 Processor -- start 2021-01-03T12:59:55.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2053fff700 1 -- start start 2021-01-03T12:59:55.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2053fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f205409a1f0 0x7f20540ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:55.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2053fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20540aab00 0x7f20541552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:55.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2053fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20540abdb0 0x7f2054147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:55.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2053fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2054147970 con 0x7f20540abdb0 2021-01-03T12:59:55.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2053fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2054155990 con 0x7f20540aab00 2021-01-03T12:59:55.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2053fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2054155c30 con 0x7f205409a1f0 2021-01-03T12:59:55.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f20527fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20540aab00 0x7f20541552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:55.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f20527fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20540aab00 0x7f20541552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33460/0 (socket says 172.21.15.133:33460) 2021-01-03T12:59:55.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f20527fc700 1 -- 172.21.15.133:0/2978082261 learned_addr learned my addr 172.21.15.133:0/2978082261 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:55.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2052ffd700 1 --2- 172.21.15.133:0/2978082261 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f205409a1f0 0x7f20540ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:55.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f20537fe700 1 --2- 172.21.15.133:0/2978082261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20540abdb0 0x7f2054147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:55.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f20527fc700 1 -- 172.21.15.133:0/2978082261 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f205409a1f0 msgr2=0x7f20540ac680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:55.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f20527fc700 1 --2- 172.21.15.133:0/2978082261 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f205409a1f0 0x7f20540ac680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:55.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f20527fc700 1 -- 172.21.15.133:0/2978082261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20540abdb0 msgr2=0x7f2054147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:55.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f20527fc700 1 --2- 172.21.15.133:0/2978082261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20540abdb0 0x7f2054147480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:55.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f20527fc700 1 -- 172.21.15.133:0/2978082261 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20540ad7d0 con 0x7f20540aab00 2021-01-03T12:59:55.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f20527fc700 1 --2- 172.21.15.133:0/2978082261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20540aab00 0x7f20541552e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f2044001450 tx=0x7f2044007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:55.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2043fff700 1 -- 172.21.15.133:0/2978082261 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2044005960 con 0x7f20540aab00 2021-01-03T12:59:55.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2053fff700 1 -- 172.21.15.133:0/2978082261 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2054149de0 con 0x7f20540aab00 2021-01-03T12:59:55.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2043fff700 1 -- 172.21.15.133:0/2978082261 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2044005ac0 con 0x7f20540aab00 2021-01-03T12:59:55.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2043fff700 1 -- 172.21.15.133:0/2978082261 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2044005e20 con 0x7f20540aab00 2021-01-03T12:59:55.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.383+0000 7f2053fff700 1 -- 172.21.15.133:0/2978082261 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20540adc70 con 0x7f20540aab00 2021-01-03T12:59:55.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.387+0000 7f2043fff700 1 -- 172.21.15.133:0/2978082261 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2044010030 con 0x7f20540aab00 2021-01-03T12:59:55.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.387+0000 7f2053fff700 1 -- 172.21.15.133:0/2978082261 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20540ae260 con 0x7f20540aab00 2021-01-03T12:59:55.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.387+0000 7f2043fff700 1 --2- 172.21.15.133:0/2978082261 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2030055440 0x7f2030057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:55.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.387+0000 7f2043fff700 1 -- 172.21.15.133:0/2978082261 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f204406dd70 con 0x7f20540aab00 2021-01-03T12:59:55.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.387+0000 7f2052ffd700 1 --2- 172.21.15.133:0/2978082261 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2030055440 0x7f2030057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:55.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.387+0000 7f2052ffd700 1 --2- 172.21.15.133:0/2978082261 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2030055440 0x7f2030057900 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f204c00b000 tx=0x7f204c006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:55.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.391+0000 7f2043fff700 1 -- 172.21.15.133:0/2978082261 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f20440441d0 con 0x7f20540aab00 2021-01-03T12:59:55.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:55.527+0000 7f2053fff700 1 -- 172.21.15.133:0/2978082261 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f20540ad610 con 0x7f20540aab00 2021-01-03T12:59:56.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.251+0000 7f2043fff700 1 -- 172.21.15.133:0/2978082261 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) v1 ==== 173+0+0 (secure 0 0 0) 0x7f20440477f0 con 0x7f20540aab00 2021-01-03T12:59:56.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.255+0000 7f2053fff700 1 -- 172.21.15.133:0/2978082261 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2030055440 msgr2=0x7f2030057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:56.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.255+0000 7f2053fff700 1 --2- 172.21.15.133:0/2978082261 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2030055440 0x7f2030057900 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f204c00b000 tx=0x7f204c006dc0).stop 2021-01-03T12:59:56.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.255+0000 7f2053fff700 1 -- 172.21.15.133:0/2978082261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20540aab00 msgr2=0x7f20541552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:56.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.255+0000 7f2053fff700 1 --2- 172.21.15.133:0/2978082261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20540aab00 0x7f20541552e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f2044001450 tx=0x7f2044007dd0).stop 2021-01-03T12:59:56.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.255+0000 7f2053fff700 1 -- 172.21.15.133:0/2978082261 shutdown_connections 2021-01-03T12:59:56.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.255+0000 7f2053fff700 1 --2- 172.21.15.133:0/2978082261 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2030055440 0x7f2030057900 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:56.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.255+0000 7f2053fff700 1 --2- 172.21.15.133:0/2978082261 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20540abdb0 0x7f2054147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:56.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.255+0000 7f2053fff700 1 --2- 172.21.15.133:0/2978082261 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f205409a1f0 0x7f20540ac680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:56.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.255+0000 7f2053fff700 1 --2- 172.21.15.133:0/2978082261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20540aab00 0x7f20541552e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:56.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.255+0000 7f2053fff700 1 -- 172.21.15.133:0/2978082261 >> 172.21.15.133:0/2978082261 conn(0x7f205405bdf0 msgr2=0x7f20541425f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:56.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.255+0000 7f2053fff700 1 -- 172.21.15.133:0/2978082261 shutdown_connections 2021-01-03T12:59:56.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.255+0000 7f2053fff700 1 -- 172.21.15.133:0/2978082261 wait complete. 2021-01-03T12:59:56.258 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2021-01-03T12:59:56.271 INFO:tasks.ceph.mds.a:Restarting daemon 2021-01-03T12:59:56.271 INFO:tasks.ceph.mds.a:Stopping old one... 2021-01-03T12:59:56.271 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-01-03T12:59:56.272 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T12:59:56.272 INFO:tasks.ceph.mds.c:Restarting daemon 2021-01-03T12:59:56.272 INFO:tasks.ceph.mds.c:Stopping old one... 2021-01-03T12:59:56.272 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-01-03T12:59:56.273 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T12:59:56.273 INFO:tasks.ceph.mds.b:Restarting daemon 2021-01-03T12:59:56.273 INFO:tasks.ceph.mds.b:Stopping old one... 2021-01-03T12:59:56.274 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-01-03T12:59:56.274 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T12:59:56.283 INFO:tasks.ceph.mds.b:Stopped 2021-01-03T12:59:56.283 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-01-03T12:59:56.284 INFO:tasks.ceph.mds.a:Stopped 2021-01-03T12:59:56.285 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-01-03T12:59:56.285 INFO:tasks.ceph.mds.c:Stopped 2021-01-03T12:59:56.286 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-01-03T12:59:56.327 INFO:tasks.ceph.mds.b:Started 2021-01-03T12:59:56.327 DEBUG:teuthology.parallel:result is None 2021-01-03T12:59:56.328 INFO:tasks.ceph.mds.a:Started 2021-01-03T12:59:56.328 DEBUG:teuthology.parallel:result is None 2021-01-03T12:59:56.329 INFO:tasks.ceph.mds.c:Started 2021-01-03T12:59:56.329 DEBUG:teuthology.parallel:result is None 2021-01-03T12:59:56.330 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-01-03T12:59:56.391 INFO:tasks.ceph.mds.b.smithi016.stdout:starting mds.b at 2021-01-03T12:59:56.406 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T12:59:56.416 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T12:59:56.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.435+0000 7f799ffff700 1 Processor -- start 2021-01-03T12:59:56.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.435+0000 7f799ffff700 1 -- start start 2021-01-03T12:59:56.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.435+0000 7f799ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79a005f920 0x7f79a00b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:56.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.435+0000 7f799ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79a0066f30 0x7f79a00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:56.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.435+0000 7f799ffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f79a00b1590 0x7f79a00613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:56.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.435+0000 7f799ffff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a00ae700 con 0x7f79a00b1590 2021-01-03T12:59:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.435+0000 7f799ffff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a005fd00 con 0x7f79a0066f30 2021-01-03T12:59:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.435+0000 7f799ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00accd0 con 0x7f79a005f920 2021-01-03T12:59:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799e7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79a0066f30 0x7f79a00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799e7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79a0066f30 0x7f79a00b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33496/0 (socket says 172.21.15.133:33496) 2021-01-03T12:59:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799e7fc700 1 -- 172.21.15.133:0/3945698520 learned_addr learned my addr 172.21.15.133:0/3945698520 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:56.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799f7fe700 1 --2- 172.21.15.133:0/3945698520 >> v2:172.21.15.16:3300/0 conn(0x7f79a00b1590 0x7f79a00613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:56.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799effd700 1 --2- 172.21.15.133:0/3945698520 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79a005f920 0x7f79a00b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:56.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799e7fc700 1 -- 172.21.15.133:0/3945698520 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79a005f920 msgr2=0x7f79a00b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:56.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799e7fc700 1 --2- 172.21.15.133:0/3945698520 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79a005f920 0x7f79a00b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:56.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799e7fc700 1 -- 172.21.15.133:0/3945698520 >> v2:172.21.15.16:3300/0 conn(0x7f79a00b1590 msgr2=0x7f79a00613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:56.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799e7fc700 1 --2- 172.21.15.133:0/3945698520 >> v2:172.21.15.16:3300/0 conn(0x7f79a00b1590 0x7f79a00613e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:56.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799e7fc700 1 -- 172.21.15.133:0/3945698520 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a00acf70 con 0x7f79a0066f30 2021-01-03T12:59:56.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799effd700 1 --2- 172.21.15.133:0/3945698520 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79a005f920 0x7f79a00b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T12:59:56.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799e7fc700 1 --2- 172.21.15.133:0/3945698520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79a0066f30 0x7f79a00b2270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f7994002f30 tx=0x7f7994006e80).ready entity=mon.1 client_cookie=4ee0f337e97d4db2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:56.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799dffb700 1 -- 172.21.15.133:0/3945698520 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79940097f0 con 0x7f79a0066f30 2021-01-03T12:59:56.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799dffb700 1 -- 172.21.15.133:0/3945698520 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7994009950 con 0x7f79a0066f30 2021-01-03T12:59:56.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799dffb700 1 -- 172.21.15.133:0/3945698520 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7994009cb0 con 0x7f79a0066f30 2021-01-03T12:59:56.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799ffff700 1 -- 172.21.15.133:0/3945698520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79a0066f30 msgr2=0x7f79a00b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:56.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799ffff700 1 --2- 172.21.15.133:0/3945698520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79a0066f30 0x7f79a00b2270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f7994002f30 tx=0x7f7994006e80).stop 2021-01-03T12:59:56.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799ffff700 1 -- 172.21.15.133:0/3945698520 shutdown_connections 2021-01-03T12:59:56.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799ffff700 1 --2- 172.21.15.133:0/3945698520 >> v2:172.21.15.16:3300/0 conn(0x7f79a00b1590 0x7f79a00613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:56.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799ffff700 1 --2- 172.21.15.133:0/3945698520 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79a005f920 0x7f79a00b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:56.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799ffff700 1 --2- 172.21.15.133:0/3945698520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79a0066f30 0x7f79a00b2270 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:56.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799ffff700 1 -- 172.21.15.133:0/3945698520 >> 172.21.15.133:0/3945698520 conn(0x7f79a00b6110 msgr2=0x7f79a00b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:56.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799ffff700 1 -- 172.21.15.133:0/3945698520 shutdown_connections 2021-01-03T12:59:56.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799ffff700 1 -- 172.21.15.133:0/3945698520 wait complete. 2021-01-03T12:59:56.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799ffff700 1 Processor -- start 2021-01-03T12:59:56.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799ffff700 1 -- start start 2021-01-03T12:59:56.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79a005f920 0x7f79a00b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:56.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79a0066f30 0x7f79a0065240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:56.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79a00b1590 0x7f79a0151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799ffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a013f8a0 con 0x7f79a0066f30 2021-01-03T12:59:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00ac510 con 0x7f79a00b1590 2021-01-03T12:59:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.439+0000 7f799ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00ac770 con 0x7f79a005f920 2021-01-03T12:59:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f799f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79a00b1590 0x7f79a0151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f799f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79a00b1590 0x7f79a0151d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33504/0 (socket says 172.21.15.133:33504) 2021-01-03T12:59:56.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f799f7fe700 1 -- 172.21.15.133:0/4102963463 learned_addr learned my addr 172.21.15.133:0/4102963463 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:56.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f799effd700 1 --2- 172.21.15.133:0/4102963463 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79a005f920 0x7f79a00b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:56.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f799e7fc700 1 --2- 172.21.15.133:0/4102963463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79a0066f30 0x7f79a0065240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:56.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f799f7fe700 1 -- 172.21.15.133:0/4102963463 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79a005f920 msgr2=0x7f79a00b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:56.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f799f7fe700 1 --2- 172.21.15.133:0/4102963463 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79a005f920 0x7f79a00b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f799f7fe700 1 -- 172.21.15.133:0/4102963463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79a0066f30 msgr2=0x7f79a0065240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f799f7fe700 1 --2- 172.21.15.133:0/4102963463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79a0066f30 0x7f79a0065240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f799f7fe700 1 -- 172.21.15.133:0/4102963463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a013f600 con 0x7f79a00b1590 2021-01-03T12:59:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f799f7fe700 1 --2- 172.21.15.133:0/4102963463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79a00b1590 0x7f79a0151d00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f79a009e7e0 tx=0x7f79980091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f798ffff700 1 -- 172.21.15.133:0/4102963463 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f799800ca00 con 0x7f79a00b1590 2021-01-03T12:59:56.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f798ffff700 1 -- 172.21.15.133:0/4102963463 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799800cb60 con 0x7f79a00b1590 2021-01-03T12:59:56.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f798ffff700 1 -- 172.21.15.133:0/4102963463 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f799800cec0 con 0x7f79a00b1590 2021-01-03T12:59:56.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f799ffff700 1 -- 172.21.15.133:0/4102963463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a00663c0 con 0x7f79a00b1590 2021-01-03T12:59:56.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f799ffff700 1 -- 172.21.15.133:0/4102963463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a009ea80 con 0x7f79a00b1590 2021-01-03T12:59:56.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f799ffff700 1 -- 172.21.15.133:0/4102963463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a0057300 con 0x7f79a00b1590 2021-01-03T12:59:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f798ffff700 1 -- 172.21.15.133:0/4102963463 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7998022070 con 0x7f79a00b1590 2021-01-03T12:59:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f798ffff700 1 --2- 172.21.15.133:0/4102963463 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f797c0553b0 0x7f797c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f798ffff700 1 -- 172.21.15.133:0/4102963463 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f799806e330 con 0x7f79a00b1590 2021-01-03T12:59:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.443+0000 7f799effd700 1 --2- 172.21.15.133:0/4102963463 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f797c0553b0 0x7f797c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.447+0000 7f799effd700 1 --2- 172.21.15.133:0/4102963463 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f797c0553b0 0x7f797c057870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f799000c000 tx=0x7f7990008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:56.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.451+0000 7f798ffff700 1 -- 172.21.15.133:0/4102963463 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7998044870 con 0x7f79a00b1590 2021-01-03T12:59:56.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2021-01-03T12:59:56.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2021-01-03T12:59:56.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:56.607+0000 7f799ffff700 1 -- 172.21.15.133:0/4102963463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f79a0061020 con 0x7f79a00b1590 2021-01-03T12:59:57.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.443+0000 7f798ffff700 1 -- 172.21.15.133:0/4102963463 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v39) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7998016070 con 0x7f79a00b1590 2021-01-03T12:59:57.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.447+0000 7f799ffff700 1 -- 172.21.15.133:0/4102963463 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f797c0553b0 msgr2=0x7f797c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:57.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.447+0000 7f799ffff700 1 --2- 172.21.15.133:0/4102963463 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f797c0553b0 0x7f797c057870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f799000c000 tx=0x7f7990008040).stop 2021-01-03T12:59:57.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.447+0000 7f799ffff700 1 -- 172.21.15.133:0/4102963463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79a00b1590 msgr2=0x7f79a0151d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:57.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.447+0000 7f799ffff700 1 --2- 172.21.15.133:0/4102963463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79a00b1590 0x7f79a0151d00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f79a009e7e0 tx=0x7f79980091a0).stop 2021-01-03T12:59:57.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.447+0000 7f799ffff700 1 -- 172.21.15.133:0/4102963463 shutdown_connections 2021-01-03T12:59:57.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.447+0000 7f799ffff700 1 --2- 172.21.15.133:0/4102963463 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f797c0553b0 0x7f797c057870 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.447+0000 7f799ffff700 1 --2- 172.21.15.133:0/4102963463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79a00b1590 0x7f79a0151d00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.447+0000 7f799ffff700 1 --2- 172.21.15.133:0/4102963463 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79a005f920 0x7f79a00b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.447+0000 7f799ffff700 1 --2- 172.21.15.133:0/4102963463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79a0066f30 0x7f79a0065240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.447+0000 7f799ffff700 1 -- 172.21.15.133:0/4102963463 >> 172.21.15.133:0/4102963463 conn(0x7f79a00b6110 msgr2=0x7f79a00b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:57.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.447+0000 7f799ffff700 1 -- 172.21.15.133:0/4102963463 shutdown_connections 2021-01-03T12:59:57.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.447+0000 7f799ffff700 1 -- 172.21.15.133:0/4102963463 wait complete. 2021-01-03T12:59:57.448 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blacklist entries 2021-01-03T12:59:57.462 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-01-03T12:59:57.463 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-01-03T12:59:57.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.579+0000 7fc931779700 1 Processor -- start 2021-01-03T12:59:57.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.579+0000 7fc931779700 1 -- start start 2021-01-03T12:59:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.579+0000 7fc931779700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc92c0b5330 0x7fc92c0abd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.579+0000 7fc931779700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc92c099ff0 0x7fc92c13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.579+0000 7fc931779700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92c0b5710 con 0x7fc92c0b5ae0 2021-01-03T12:59:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.579+0000 7fc931779700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92c0b10f0 con 0x7fc92c0b5330 2021-01-03T12:59:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.579+0000 7fc931779700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c0ac270 con 0x7fc92c099ff0 2021-01-03T12:59:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.579+0000 7fc92b7fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc92c0b5ae0 0x7fc92c142c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:33268/0 (socket says 172.21.15.133:33268) 2021-01-03T12:59:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.579+0000 7fc92b7fe700 1 -- 172.21.15.133:0/3730011163 learned_addr learned my addr 172.21.15.133:0/3730011163 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T12:59:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.579+0000 7fc930f78700 1 --2- 172.21.15.133:0/3730011163 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc92c099ff0 0x7fc92c13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:57.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.579+0000 7fc92bfff700 1 --2- 172.21.15.133:0/3730011163 >> v2:172.21.15.16:3300/0 conn(0x7fc92c0b5330 0x7fc92c0abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc92affd700 1 -- 172.21.15.133:0/3730011163 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673855910 0 0) 0x7fc92c0b5710 con 0x7fc92c0b5ae0 2021-01-03T12:59:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc92affd700 1 -- 172.21.15.133:0/3730011163 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc90c003230 con 0x7fc92c0b5ae0 2021-01-03T12:59:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc930f78700 1 -- 172.21.15.133:0/3730011163 >> v2:172.21.15.16:3300/0 conn(0x7fc92c0b5330 msgr2=0x7fc92c0abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc930f78700 1 --2- 172.21.15.133:0/3730011163 >> v2:172.21.15.16:3300/0 conn(0x7fc92c0b5330 0x7fc92c0abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc930f78700 1 -- 172.21.15.133:0/3730011163 >> v1:172.21.15.16:6789/0 conn(0x7fc92c0b5ae0 legacy=0x7fc92c142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc930f78700 1 -- 172.21.15.133:0/3730011163 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c0ab280 con 0x7fc92c099ff0 2021-01-03T12:59:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc930f78700 1 --2- 172.21.15.133:0/3730011163 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc92c099ff0 0x7fc92c13fe70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc924002f30 tx=0x7fc924006dc0).ready entity=mon.2 client_cookie=428c1c80ef174980 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc92affd700 1 -- 172.21.15.133:0/3730011163 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9240096a0 con 0x7fc92c099ff0 2021-01-03T12:59:57.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc92affd700 1 -- 172.21.15.133:0/3730011163 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc924009800 con 0x7fc92c099ff0 2021-01-03T12:59:57.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc92affd700 1 -- 172.21.15.133:0/3730011163 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc924009b60 con 0x7fc92c099ff0 2021-01-03T12:59:57.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc931779700 1 -- 172.21.15.133:0/3730011163 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc92c099ff0 msgr2=0x7fc92c13fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:57.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc931779700 1 --2- 172.21.15.133:0/3730011163 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc92c099ff0 0x7fc92c13fe70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc924002f30 tx=0x7fc924006dc0).stop 2021-01-03T12:59:57.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc931779700 1 -- 172.21.15.133:0/3730011163 shutdown_connections 2021-01-03T12:59:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc931779700 1 --2- 172.21.15.133:0/3730011163 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc92c099ff0 0x7fc92c13fe70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc931779700 1 --2- 172.21.15.133:0/3730011163 >> v2:172.21.15.16:3300/0 conn(0x7fc92c0b5330 0x7fc92c0abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc931779700 1 -- 172.21.15.133:0/3730011163 >> 172.21.15.133:0/3730011163 conn(0x7fc92c05bdf0 msgr2=0x7fc92c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc931779700 1 -- 172.21.15.133:0/3730011163 shutdown_connections 2021-01-03T12:59:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc931779700 1 -- 172.21.15.133:0/3730011163 wait complete. 2021-01-03T12:59:57.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc931779700 1 Processor -- start 2021-01-03T12:59:57.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.583+0000 7fc931779700 1 -- start start 2021-01-03T12:59:57.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc931779700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc92c099ff0 0x7fc92c0ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:57.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc931779700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc92c0b5330 0x7fc92c147780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:57.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc931779700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92c0b5ae0 0x7fc92c147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:57.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc931779700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c148160 con 0x7fc92c0b5330 2021-01-03T12:59:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc931779700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c145890 con 0x7fc92c0b5ae0 2021-01-03T12:59:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc931779700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c145f90 con 0x7fc92c099ff0 2021-01-03T12:59:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc930f78700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92c0b5ae0 0x7fc92c147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc930f78700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92c0b5ae0 0x7fc92c147c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33518/0 (socket says 172.21.15.133:33518) 2021-01-03T12:59:57.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc930f78700 1 -- 172.21.15.133:0/640008245 learned_addr learned my addr 172.21.15.133:0/640008245 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc92b7fe700 1 --2- 172.21.15.133:0/640008245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc92c0b5330 0x7fc92c147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc92bfff700 1 --2- 172.21.15.133:0/640008245 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc92c099ff0 0x7fc92c0ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc930f78700 1 -- 172.21.15.133:0/640008245 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc92c099ff0 msgr2=0x7fc92c0ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc930f78700 1 --2- 172.21.15.133:0/640008245 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc92c099ff0 0x7fc92c0ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc930f78700 1 -- 172.21.15.133:0/640008245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc92c0b5330 msgr2=0x7fc92c147780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:57.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc930f78700 1 --2- 172.21.15.133:0/640008245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc92c0b5330 0x7fc92c147780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc930f78700 1 -- 172.21.15.133:0/640008245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c1463b0 con 0x7fc92c0b5ae0 2021-01-03T12:59:57.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc930f78700 1 --2- 172.21.15.133:0/640008245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92c0b5ae0 0x7fc92c147c70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fc92c1482a0 tx=0x7fc924015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:57.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc9297fa700 1 -- 172.21.15.133:0/640008245 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc924011bf0 con 0x7fc92c0b5ae0 2021-01-03T12:59:57.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc9297fa700 1 -- 172.21.15.133:0/640008245 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc924011d50 con 0x7fc92c0b5ae0 2021-01-03T12:59:57.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc931779700 1 -- 172.21.15.133:0/640008245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92c146650 con 0x7fc92c0b5ae0 2021-01-03T12:59:57.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc9297fa700 1 -- 172.21.15.133:0/640008245 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc92401d640 con 0x7fc92c0b5ae0 2021-01-03T12:59:57.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc931779700 1 -- 172.21.15.133:0/640008245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92c145af0 con 0x7fc92c0b5ae0 2021-01-03T12:59:57.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.587+0000 7fc931779700 1 -- 172.21.15.133:0/640008245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92c145cb0 con 0x7fc92c0b5ae0 2021-01-03T12:59:57.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.591+0000 7fc9297fa700 1 -- 172.21.15.133:0/640008245 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc924024030 con 0x7fc92c0b5ae0 2021-01-03T12:59:57.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.591+0000 7fc9297fa700 1 --2- 172.21.15.133:0/640008245 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9100553f0 0x7fc9100578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:57.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.591+0000 7fc9297fa700 1 -- 172.21.15.133:0/640008245 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc92406eea0 con 0x7fc92c0b5ae0 2021-01-03T12:59:57.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.591+0000 7fc92bfff700 1 --2- 172.21.15.133:0/640008245 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9100553f0 0x7fc9100578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:57.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.591+0000 7fc92bfff700 1 --2- 172.21.15.133:0/640008245 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9100553f0 0x7fc9100578b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fc914008000 tx=0x7fc914008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:57.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.595+0000 7fc9297fa700 1 -- 172.21.15.133:0/640008245 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc924045340 con 0x7fc92c0b5ae0 2021-01-03T12:59:57.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.787+0000 7fc931779700 1 -- 172.21.15.133:0/640008245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc92c057300 con 0x7fc92c0b5ae0 2021-01-03T12:59:57.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.787+0000 7fc9297fa700 1 -- 172.21.15.133:0/640008245 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fc924022070 con 0x7fc92c0b5ae0 2021-01-03T12:59:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:59:57.788 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T12:59:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2021-01-03T12:59:57.788 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2021-01-03T12:59:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Fflox9BxAA6coLDFV/FaQ/G/cvtonWgg==", 2021-01-03T12:59:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:59:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T12:59:57.789 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:59:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:59:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:59:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:57.790 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2021-01-03T12:59:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfrnWWFRAA3PHH/FJOvDozCChrb1T8Dg==", 2021-01-03T12:59:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:59:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T12:59:57.791 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:59:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:59:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:59:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:57.792 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:57.793 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:57.793 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2021-01-03T12:59:57.793 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfpPPLDxAAVvg80vLejYKDH485/L1gSQ==", 2021-01-03T12:59:57.793 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:59:57.793 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T12:59:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:59:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:59:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:59:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:57.794 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2021-01-03T12:59:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAnv/FfQ+CcDRAAUkTDLby5scMkNzxa0lVdAQ==", 2021-01-03T12:59:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:59:57.795 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:59:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:59:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:59:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:57.796 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:57.797 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2021-01-03T12:59:57.797 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApv/Ff1iilLhAAbK9hZmL772nNKAEJ4i+pkw==", 2021-01-03T12:59:57.797 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:59:57.797 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:59:57.797 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:59:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:59:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:57.798 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2021-01-03T12:59:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAsv/Ffmoe2FhAA1EbxU5yHncN+pbC/EX6d9A==", 2021-01-03T12:59:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:59:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:59:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:59:57.799 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:59:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2021-01-03T12:59:57.800 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAuv/FfJh/VORAAG9aCOh5s/2Lw+yN9hBFWLw==", 2021-01-03T12:59:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:59:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:59:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:59:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:59:57.801 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2021-01-03T12:59:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyv/Ffus0NJhAALX1TIqQ9EIupaX8KtRu7rQ==", 2021-01-03T12:59:57.802 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:59:57.803 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:59:57.803 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:59:57.803 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:59:57.803 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:57.803 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2021-01-03T12:59:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1v/FfoL6kDBAAggoRy/o0qas/41yLYqDVgA==", 2021-01-03T12:59:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:59:57.804 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:59:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:59:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:59:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:57.805 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:57.806 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2021-01-03T12:59:57.806 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA3v/FfwOPCMBAAGOt8ShPQ/szNbCfaP/uZEQ==", 2021-01-03T12:59:57.806 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:59:57.806 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:59:57.806 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:59:57.807 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:59:57.807 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:57.807 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:57.807 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:57.807 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2021-01-03T12:59:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA6v/Ffoz5xFxAAn3xvUDSeNSWrBJTa1Nsb6w==", 2021-01-03T12:59:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:59:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:59:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:59:57.808 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:59:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2021-01-03T12:59:57.809 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfyGlbGxAALm0NezvPiTAnlwu8iPEuCw==", 2021-01-03T12:59:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:59:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T12:59:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T12:59:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T12:59:57.810 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2021-01-03T12:59:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Ffa2AFHhAAD4Pq5zMJ28SqqEosBA9vnQ==", 2021-01-03T12:59:57.811 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:59:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T12:59:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T12:59:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T12:59:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:57.812 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:57.813 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:57.813 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2021-01-03T12:59:57.813 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjv/FfjxN8JxAAkV2Ia66fh21QYMX5fr1gTw==", 2021-01-03T12:59:57.813 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:59:57.813 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T12:59:57.814 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T12:59:57.814 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T12:59:57.814 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:59:57.814 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:57.814 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2021-01-03T12:59:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAU/DBBAASi+hx05pZEsP+dV9iwbz4g==", 2021-01-03T12:59:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:59:57.815 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T12:59:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T12:59:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:59:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:57.816 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2021-01-03T12:59:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAOFAAhAAPQOSkofyJoEYvcAqKK2+Mg==", 2021-01-03T12:59:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T12:59:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T12:59:57.817 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T12:59:57.818 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T12:59:57.818 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:57.818 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:57.818 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T12:59:57.818 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T12:59:57.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.791+0000 7fc931779700 1 -- 172.21.15.133:0/640008245 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9100553f0 msgr2=0x7fc9100578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:57.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.791+0000 7fc931779700 1 --2- 172.21.15.133:0/640008245 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9100553f0 0x7fc9100578b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fc914008000 tx=0x7fc914008040).stop 2021-01-03T12:59:57.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.791+0000 7fc931779700 1 -- 172.21.15.133:0/640008245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92c0b5ae0 msgr2=0x7fc92c147c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:57.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.791+0000 7fc931779700 1 --2- 172.21.15.133:0/640008245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92c0b5ae0 0x7fc92c147c70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fc92c1482a0 tx=0x7fc924015000).stop 2021-01-03T12:59:57.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.791+0000 7fc931779700 1 -- 172.21.15.133:0/640008245 shutdown_connections 2021-01-03T12:59:57.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.791+0000 7fc931779700 1 --2- 172.21.15.133:0/640008245 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9100553f0 0x7fc9100578b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.791+0000 7fc931779700 1 --2- 172.21.15.133:0/640008245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92c0b5ae0 0x7fc92c147c70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.791+0000 7fc931779700 1 --2- 172.21.15.133:0/640008245 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc92c099ff0 0x7fc92c0ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.791+0000 7fc931779700 1 --2- 172.21.15.133:0/640008245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc92c0b5330 0x7fc92c147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.791+0000 7fc931779700 1 -- 172.21.15.133:0/640008245 >> 172.21.15.133:0/640008245 conn(0x7fc92c05bdf0 msgr2=0x7fc92c0b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:57.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.791+0000 7fc931779700 1 -- 172.21.15.133:0/640008245 shutdown_connections 2021-01-03T12:59:57.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.791+0000 7fc931779700 1 -- 172.21.15.133:0/640008245 wait complete. 2021-01-03T12:59:57.823 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T12:59:57.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.931+0000 7fa0a359e700 1 Processor -- start 2021-01-03T12:59:57.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.931+0000 7fa0a359e700 1 -- start start 2021-01-03T12:59:57.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0a40b1300 0x7fa0a41428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:57.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa0a40b0c30 0x7fa0a40ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:57.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a359e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a40afa40 con 0x7fa0a40b2050 2021-01-03T12:59:57.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a406ad30 con 0x7fa0a40b0c30 2021-01-03T12:59:57.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a40b25d0 con 0x7fa0a40b1300 2021-01-03T12:59:57.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a1d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa0a40b0c30 0x7fa0a40ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:57.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a1d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa0a40b0c30 0x7fa0a40ad4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33524/0 (socket says 172.21.15.133:33524) 2021-01-03T12:59:57.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a1d9b700 1 -- 172.21.15.133:0/3196469908 learned_addr learned my addr 172.21.15.133:0/3196469908 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:57.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a259c700 1 --2- 172.21.15.133:0/3196469908 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0a40b1300 0x7fa0a41428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:57.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a1d9b700 1 -- 172.21.15.133:0/3196469908 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0a40b1300 msgr2=0x7fa0a41428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:57.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a1d9b700 1 --2- 172.21.15.133:0/3196469908 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0a40b1300 0x7fa0a41428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a1d9b700 1 -- 172.21.15.133:0/3196469908 >> v1:172.21.15.16:6789/0 conn(0x7fa0a40b2050 legacy=0x7fa0a406a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:57.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a1d9b700 1 -- 172.21.15.133:0/3196469908 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a40b2870 con 0x7fa0a40b0c30 2021-01-03T12:59:57.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a1d9b700 1 --2- 172.21.15.133:0/3196469908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a40b0c30 0x7fa0a40ad4e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fa08c0032b0 tx=0x7fa08c009270).ready entity=mon.1 client_cookie=3d43ea38f67da19e server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:57.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a159a700 1 -- 172.21.15.133:0/3196469908 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa08c00bdf0 con 0x7fa0a40b0c30 2021-01-03T12:59:57.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a159a700 1 -- 172.21.15.133:0/3196469908 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c010470 con 0x7fa0a40b0c30 2021-01-03T12:59:57.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a159a700 1 -- 172.21.15.133:0/3196469908 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa08c0107d0 con 0x7fa0a40b0c30 2021-01-03T12:59:57.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a359e700 1 -- 172.21.15.133:0/3196469908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a40b0c30 msgr2=0x7fa0a40ad4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:57.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a359e700 1 --2- 172.21.15.133:0/3196469908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a40b0c30 0x7fa0a40ad4e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fa08c0032b0 tx=0x7fa08c009270).stop 2021-01-03T12:59:57.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a359e700 1 -- 172.21.15.133:0/3196469908 shutdown_connections 2021-01-03T12:59:57.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a359e700 1 --2- 172.21.15.133:0/3196469908 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0a40b1300 0x7fa0a41428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a359e700 1 --2- 172.21.15.133:0/3196469908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a40b0c30 0x7fa0a40ad4e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a359e700 1 -- 172.21.15.133:0/3196469908 >> 172.21.15.133:0/3196469908 conn(0x7fa0a406b050 msgr2=0x7fa0a4060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:57.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a359e700 1 -- 172.21.15.133:0/3196469908 shutdown_connections 2021-01-03T12:59:57.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a359e700 1 -- 172.21.15.133:0/3196469908 wait complete. 2021-01-03T12:59:57.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a359e700 1 Processor -- start 2021-01-03T12:59:57.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.935+0000 7fa0a359e700 1 -- start start 2021-01-03T12:59:57.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a40b0c30 0x7fa0a4062f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0a40b1300 0x7fa0a41401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a40b2050 0x7fa0a41406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a359e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a414e8c0 con 0x7fa0a40b0c30 2021-01-03T12:59:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a40663d0 con 0x7fa0a40b2050 2021-01-03T12:59:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4065af0 con 0x7fa0a40b1300 2021-01-03T12:59:57.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a2d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a40b2050 0x7fa0a41406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:57.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a2d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a40b2050 0x7fa0a41406b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33532/0 (socket says 172.21.15.133:33532) 2021-01-03T12:59:57.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a2d9d700 1 -- 172.21.15.133:0/3551517812 learned_addr learned my addr 172.21.15.133:0/3551517812 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:57.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a259c700 1 --2- 172.21.15.133:0/3551517812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a40b0c30 0x7fa0a4062f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:57.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a1d9b700 1 --2- 172.21.15.133:0/3551517812 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0a40b1300 0x7fa0a41401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:57.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a2d9d700 1 -- 172.21.15.133:0/3551517812 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0a40b1300 msgr2=0x7fa0a41401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:57.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a2d9d700 1 --2- 172.21.15.133:0/3551517812 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0a40b1300 0x7fa0a41401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a2d9d700 1 -- 172.21.15.133:0/3551517812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a40b0c30 msgr2=0x7fa0a4062f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:57.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a2d9d700 1 --2- 172.21.15.133:0/3551517812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a40b0c30 0x7fa0a4062f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:57.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a2d9d700 1 -- 172.21.15.133:0/3551517812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a409e7b0 con 0x7fa0a40b2050 2021-01-03T12:59:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a2d9d700 1 --2- 172.21.15.133:0/3551517812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a40b2050 0x7fa0a41406b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fa0a405cea0 tx=0x7fa094007bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa09b7fe700 1 -- 172.21.15.133:0/3551517812 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa094013410 con 0x7fa0a40b2050 2021-01-03T12:59:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa09b7fe700 1 -- 172.21.15.133:0/3551517812 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa094013570 con 0x7fa0a40b2050 2021-01-03T12:59:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa09b7fe700 1 -- 172.21.15.133:0/3551517812 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0940138d0 con 0x7fa0a40b2050 2021-01-03T12:59:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a359e700 1 -- 172.21.15.133:0/3551517812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a4065890 con 0x7fa0a40b2050 2021-01-03T12:59:57.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a359e700 1 -- 172.21.15.133:0/3551517812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a414b4b0 con 0x7fa0a40b2050 2021-01-03T12:59:57.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.939+0000 7fa0a359e700 1 -- 172.21.15.133:0/3551517812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a414e620 con 0x7fa0a40b2050 2021-01-03T12:59:57.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.943+0000 7fa09b7fe700 1 -- 172.21.15.133:0/3551517812 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa094010030 con 0x7fa0a40b2050 2021-01-03T12:59:57.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.943+0000 7fa09b7fe700 1 --2- 172.21.15.133:0/3551517812 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa088055440 0x7fa088057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:57.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.943+0000 7fa09b7fe700 1 -- 172.21.15.133:0/3551517812 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa09406db90 con 0x7fa0a40b2050 2021-01-03T12:59:57.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.943+0000 7fa0a259c700 1 --2- 172.21.15.133:0/3551517812 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa088055440 0x7fa088057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:57.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.943+0000 7fa0a259c700 1 --2- 172.21.15.133:0/3551517812 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa088055440 0x7fa088057900 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fa09c00c000 tx=0x7fa09c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:57.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:57.947+0000 7fa09b7fe700 1 -- 172.21.15.133:0/3551517812 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa0940441c0 con 0x7fa0a40b2050 2021-01-03T12:59:58.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.091+0000 7fa0a359e700 1 -- 172.21.15.133:0/3551517812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0a414e620 con 0x7fa0a40b2050 2021-01-03T12:59:58.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.091+0000 7fa09b7fe700 1 -- 172.21.15.133:0/3551517812 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+13229 (secure 0 0 0) 0x7fa0a414e620 con 0x7fa0a40b2050 2021-01-03T12:59:58.092 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:59:58.092 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":39,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T12:59:57.430152+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T12:59:58.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.095+0000 7fa0a359e700 1 -- 172.21.15.133:0/3551517812 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa088055440 msgr2=0x7fa088057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.095+0000 7fa0a359e700 1 --2- 172.21.15.133:0/3551517812 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa088055440 0x7fa088057900 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fa09c00c000 tx=0x7fa09c008040).stop 2021-01-03T12:59:58.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.095+0000 7fa0a359e700 1 -- 172.21.15.133:0/3551517812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a40b2050 msgr2=0x7fa0a41406b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.095+0000 7fa0a359e700 1 --2- 172.21.15.133:0/3551517812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a40b2050 0x7fa0a41406b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fa0a405cea0 tx=0x7fa094007bf0).stop 2021-01-03T12:59:58.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.095+0000 7fa0a359e700 1 -- 172.21.15.133:0/3551517812 shutdown_connections 2021-01-03T12:59:58.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.095+0000 7fa0a359e700 1 --2- 172.21.15.133:0/3551517812 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa088055440 0x7fa088057900 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.095+0000 7fa0a359e700 1 --2- 172.21.15.133:0/3551517812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0a40b0c30 0x7fa0a4062f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.095+0000 7fa0a359e700 1 --2- 172.21.15.133:0/3551517812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0a40b2050 0x7fa0a41406b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.095+0000 7fa0a359e700 1 --2- 172.21.15.133:0/3551517812 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0a40b1300 0x7fa0a41401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.095+0000 7fa0a359e700 1 -- 172.21.15.133:0/3551517812 >> 172.21.15.133:0/3551517812 conn(0x7fa0a406b050 msgr2=0x7fa0a40b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:58.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.095+0000 7fa0a359e700 1 -- 172.21.15.133:0/3551517812 shutdown_connections 2021-01-03T12:59:58.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.095+0000 7fa0a359e700 1 -- 172.21.15.133:0/3551517812 wait complete. 2021-01-03T12:59:58.106 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-01-03T12:59:58.107 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T12:59:58.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae7c073700 1 Processor -- start 2021-01-03T12:59:58.226 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae7c073700 1 -- start start 2021-01-03T12:59:58.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae7c073700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae74140410 0x7fae74146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae7c073700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fae740b0470 0x7fae7405bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae7c073700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7405cf20 con 0x7fae741407f0 2021-01-03T12:59:58.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae7c073700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae740b02d0 con 0x7fae740b0470 2021-01-03T12:59:58.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae7c073700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae74146390 con 0x7fae74140410 2021-01-03T12:59:58.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae79e0f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae74140410 0x7fae74146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae79e0f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae74140410 0x7fae74146cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33536/0 (socket says 172.21.15.133:33536) 2021-01-03T12:59:58.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae79e0f700 1 -- 172.21.15.133:0/3498146002 learned_addr learned my addr 172.21.15.133:0/3498146002 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:58.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae7a610700 1 --2- 172.21.15.133:0/3498146002 >> v2:172.21.15.16:3300/0 conn(0x7fae740b0470 0x7fae7405bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae79e0f700 1 -- 172.21.15.133:0/3498146002 >> v2:172.21.15.16:3300/0 conn(0x7fae740b0470 msgr2=0x7fae7405bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:58.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae79e0f700 1 --2- 172.21.15.133:0/3498146002 >> v2:172.21.15.16:3300/0 conn(0x7fae740b0470 0x7fae7405bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae79e0f700 1 -- 172.21.15.133:0/3498146002 >> v1:172.21.15.16:6789/0 conn(0x7fae741407f0 legacy=0x7fae74142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae79e0f700 1 -- 172.21.15.133:0/3498146002 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae74146580 con 0x7fae74140410 2021-01-03T12:59:58.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae79e0f700 1 --2- 172.21.15.133:0/3498146002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae74140410 0x7fae74146cc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fae70002f30 tx=0x7fae70006e80).ready entity=mon.1 client_cookie=c933787e7f8ceef0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:58.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae78e0d700 1 -- 172.21.15.133:0/3498146002 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae700097f0 con 0x7fae74140410 2021-01-03T12:59:58.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae78e0d700 1 -- 172.21.15.133:0/3498146002 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae70009950 con 0x7fae74140410 2021-01-03T12:59:58.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae78e0d700 1 -- 172.21.15.133:0/3498146002 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae70009cb0 con 0x7fae74140410 2021-01-03T12:59:58.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae7c073700 1 -- 172.21.15.133:0/3498146002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae74140410 msgr2=0x7fae74146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae7c073700 1 --2- 172.21.15.133:0/3498146002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae74140410 0x7fae74146cc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fae70002f30 tx=0x7fae70006e80).stop 2021-01-03T12:59:58.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae7c073700 1 -- 172.21.15.133:0/3498146002 shutdown_connections 2021-01-03T12:59:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae7c073700 1 --2- 172.21.15.133:0/3498146002 >> v2:172.21.15.16:3300/0 conn(0x7fae740b0470 0x7fae7405bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae7c073700 1 --2- 172.21.15.133:0/3498146002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae74140410 0x7fae74146cc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae7c073700 1 -- 172.21.15.133:0/3498146002 >> 172.21.15.133:0/3498146002 conn(0x7fae740b95d0 msgr2=0x7fae740b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:58.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae7c073700 1 -- 172.21.15.133:0/3498146002 shutdown_connections 2021-01-03T12:59:58.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.227+0000 7fae7c073700 1 -- 172.21.15.133:0/3498146002 wait complete. 2021-01-03T12:59:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7c073700 1 Processor -- start 2021-01-03T12:59:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7c073700 1 -- start start 2021-01-03T12:59:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7c073700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae740b0470 0x7fae7409f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7c073700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae74140410 0x7fae7409c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7c073700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae741407f0 0x7fae74142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7c073700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae74141ab0 con 0x7fae740b0470 2021-01-03T12:59:58.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7c073700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae74152bd0 con 0x7fae741407f0 2021-01-03T12:59:58.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7c073700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae74141ce0 con 0x7fae74140410 2021-01-03T12:59:58.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7a610700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae741407f0 0x7fae74142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7a610700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae741407f0 0x7fae74142420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33546/0 (socket says 172.21.15.133:33546) 2021-01-03T12:59:58.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7a610700 1 -- 172.21.15.133:0/3353926265 learned_addr learned my addr 172.21.15.133:0/3353926265 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:58.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae79e0f700 1 --2- 172.21.15.133:0/3353926265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae740b0470 0x7fae7409f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7960e700 1 --2- 172.21.15.133:0/3353926265 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae74140410 0x7fae7409c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7a610700 1 -- 172.21.15.133:0/3353926265 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae74140410 msgr2=0x7fae7409c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7a610700 1 --2- 172.21.15.133:0/3353926265 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae74140410 0x7fae7409c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7a610700 1 -- 172.21.15.133:0/3353926265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae740b0470 msgr2=0x7fae7409f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7a610700 1 --2- 172.21.15.133:0/3353926265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae740b0470 0x7fae7409f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7a610700 1 -- 172.21.15.133:0/3353926265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae74141f80 con 0x7fae741407f0 2021-01-03T12:59:58.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7a610700 1 --2- 172.21.15.133:0/3353926265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae741407f0 0x7fae74142420 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fae6c006dd0 tx=0x7fae6c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae62ffd700 1 -- 172.21.15.133:0/3353926265 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae6c00eee0 con 0x7fae741407f0 2021-01-03T12:59:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae62ffd700 1 -- 172.21.15.133:0/3353926265 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c00cbb0 con 0x7fae741407f0 2021-01-03T12:59:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7c073700 1 -- 172.21.15.133:0/3353926265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae74152810 con 0x7fae741407f0 2021-01-03T12:59:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae62ffd700 1 -- 172.21.15.133:0/3353926265 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae6c0123f0 con 0x7fae741407f0 2021-01-03T12:59:58.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.231+0000 7fae7c073700 1 -- 172.21.15.133:0/3353926265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae74142910 con 0x7fae741407f0 2021-01-03T12:59:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.235+0000 7fae62ffd700 1 -- 172.21.15.133:0/3353926265 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fae6c022070 con 0x7fae741407f0 2021-01-03T12:59:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.235+0000 7fae7c073700 1 -- 172.21.15.133:0/3353926265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae74142110 con 0x7fae741407f0 2021-01-03T12:59:58.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.235+0000 7fae62ffd700 1 --2- 172.21.15.133:0/3353926265 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae54055330 0x7fae540577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.235+0000 7fae62ffd700 1 -- 172.21.15.133:0/3353926265 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fae6c06e490 con 0x7fae741407f0 2021-01-03T12:59:58.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.235+0000 7fae79e0f700 1 --2- 172.21.15.133:0/3353926265 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae54055330 0x7fae540577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.235+0000 7fae79e0f700 1 --2- 172.21.15.133:0/3353926265 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae54055330 0x7fae540577f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fae7001a000 tx=0x7fae70015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:58.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.239+0000 7fae62ffd700 1 -- 172.21.15.133:0/3353926265 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fae6c044a20 con 0x7fae741407f0 2021-01-03T12:59:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.383+0000 7fae7c073700 1 -- 172.21.15.133:0/3353926265 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fae74057300 con 0x7fae741407f0 2021-01-03T12:59:58.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.383+0000 7fae62ffd700 1 -- 172.21.15.133:0/3353926265 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v39) v1 ==== 110+0+10 (secure 0 0 0) 0x7fae6c016020 con 0x7fae741407f0 2021-01-03T12:59:58.382 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T12:59:58.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.383+0000 7fae7c073700 1 -- 172.21.15.133:0/3353926265 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae54055330 msgr2=0x7fae540577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.383+0000 7fae7c073700 1 --2- 172.21.15.133:0/3353926265 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae54055330 0x7fae540577f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fae7001a000 tx=0x7fae70015000).stop 2021-01-03T12:59:58.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.383+0000 7fae7c073700 1 -- 172.21.15.133:0/3353926265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae741407f0 msgr2=0x7fae74142420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.383+0000 7fae7c073700 1 --2- 172.21.15.133:0/3353926265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae741407f0 0x7fae74142420 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fae6c006dd0 tx=0x7fae6c0091a0).stop 2021-01-03T12:59:58.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.383+0000 7fae7c073700 1 -- 172.21.15.133:0/3353926265 shutdown_connections 2021-01-03T12:59:58.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.383+0000 7fae7c073700 1 --2- 172.21.15.133:0/3353926265 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae54055330 0x7fae540577f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.383+0000 7fae7c073700 1 --2- 172.21.15.133:0/3353926265 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae740b0470 0x7fae7409f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.383+0000 7fae7c073700 1 --2- 172.21.15.133:0/3353926265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae741407f0 0x7fae74142420 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.383+0000 7fae7c073700 1 --2- 172.21.15.133:0/3353926265 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae74140410 0x7fae7409c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.383+0000 7fae7c073700 1 -- 172.21.15.133:0/3353926265 >> 172.21.15.133:0/3353926265 conn(0x7fae740b95d0 msgr2=0x7fae74145180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:58.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.383+0000 7fae7c073700 1 -- 172.21.15.133:0/3353926265 shutdown_connections 2021-01-03T12:59:58.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.383+0000 7fae7c073700 1 -- 172.21.15.133:0/3353926265 wait complete. 2021-01-03T12:59:58.395 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T12:59:58.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfc5aef700 1 Processor -- start 2021-01-03T12:59:58.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfc5aef700 1 -- start start 2021-01-03T12:59:58.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfc5aef700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbfc01405e0 0x7fbfc0142cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfc5aef700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfc00b2800 0x7fbfc0061e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfc5aef700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbfc01469e0 0x7fbfc00b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfc5aef700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc01409c0 con 0x7fbfc01469e0 2021-01-03T12:59:58.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfc5aef700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc0062330 con 0x7fbfc01405e0 2021-01-03T12:59:58.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfc5aef700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc00b36c0 con 0x7fbfc00b2800 2021-01-03T12:59:58.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfbf7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbfc01405e0 0x7fbfc0142cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfbf7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbfc01405e0 0x7fbfc0142cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33550/0 (socket says 172.21.15.133:33550) 2021-01-03T12:59:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfbf7fe700 1 -- 172.21.15.133:0/1931721311 learned_addr learned my addr 172.21.15.133:0/1931721311 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfbffff700 1 --2- 172.21.15.133:0/1931721311 >> v2:172.21.15.16:3300/0 conn(0x7fbfc01469e0 0x7fbfc00b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfbeffd700 1 --2- 172.21.15.133:0/1931721311 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfc00b2800 0x7fbfc0061e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfbf7fe700 1 -- 172.21.15.133:0/1931721311 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfc00b2800 msgr2=0x7fbfc0061e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:58.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfbf7fe700 1 --2- 172.21.15.133:0/1931721311 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfc00b2800 0x7fbfc0061e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfbf7fe700 1 -- 172.21.15.133:0/1931721311 >> v2:172.21.15.16:3300/0 conn(0x7fbfc01469e0 msgr2=0x7fbfc00b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:58.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfbf7fe700 1 --2- 172.21.15.133:0/1931721311 >> v2:172.21.15.16:3300/0 conn(0x7fbfc01469e0 0x7fbfc00b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.511+0000 7fbfbf7fe700 1 -- 172.21.15.133:0/1931721311 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc00b3960 con 0x7fbfc01405e0 2021-01-03T12:59:58.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfbf7fe700 1 --2- 172.21.15.133:0/1931721311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc01405e0 0x7fbfc0142cd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fbfb4002f30 tx=0x7fbfb4006e80).ready entity=mon.1 client_cookie=86ded717847d892e server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:58.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfbe7fc700 1 -- 172.21.15.133:0/1931721311 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfb4009640 con 0x7fbfc01405e0 2021-01-03T12:59:58.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfbe7fc700 1 -- 172.21.15.133:0/1931721311 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb40097a0 con 0x7fbfc01405e0 2021-01-03T12:59:58.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfbe7fc700 1 -- 172.21.15.133:0/1931721311 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfb4009b00 con 0x7fbfc01405e0 2021-01-03T12:59:58.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfc5aef700 1 -- 172.21.15.133:0/1931721311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc01405e0 msgr2=0x7fbfc0142cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfc5aef700 1 --2- 172.21.15.133:0/1931721311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc01405e0 0x7fbfc0142cd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fbfb4002f30 tx=0x7fbfb4006e80).stop 2021-01-03T12:59:58.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfc5aef700 1 -- 172.21.15.133:0/1931721311 shutdown_connections 2021-01-03T12:59:58.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfc5aef700 1 --2- 172.21.15.133:0/1931721311 >> v2:172.21.15.16:3300/0 conn(0x7fbfc01469e0 0x7fbfc00b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfc5aef700 1 --2- 172.21.15.133:0/1931721311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc01405e0 0x7fbfc0142cd0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfc5aef700 1 --2- 172.21.15.133:0/1931721311 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfc00b2800 0x7fbfc0061e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfc5aef700 1 -- 172.21.15.133:0/1931721311 >> 172.21.15.133:0/1931721311 conn(0x7fbfc005bdf0 msgr2=0x7fbfc005c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:58.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfc5aef700 1 -- 172.21.15.133:0/1931721311 shutdown_connections 2021-01-03T12:59:58.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfc5aef700 1 -- 172.21.15.133:0/1931721311 wait complete. 2021-01-03T12:59:58.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfc5aef700 1 Processor -- start 2021-01-03T12:59:58.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfc5aef700 1 -- start start 2021-01-03T12:59:58.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfc5aef700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfc00b2800 0x7fbfc0140e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfc5aef700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfc01405e0 0x7fbfc009aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfc5aef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc01469e0 0x7fbfc0145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfc5aef700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc009c470 con 0x7fbfc01405e0 2021-01-03T12:59:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfc5aef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc009d5b0 con 0x7fbfc01469e0 2021-01-03T12:59:58.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfc5aef700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc009d350 con 0x7fbfc00b2800 2021-01-03T12:59:58.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfbffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc01469e0 0x7fbfc0145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfbffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc01469e0 0x7fbfc0145d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33560/0 (socket says 172.21.15.133:33560) 2021-01-03T12:59:58.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfbffff700 1 -- 172.21.15.133:0/2314893620 learned_addr learned my addr 172.21.15.133:0/2314893620 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:58.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfbeffd700 1 --2- 172.21.15.133:0/2314893620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfc01405e0 0x7fbfc009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.515+0000 7fbfbf7fe700 1 --2- 172.21.15.133:0/2314893620 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfc00b2800 0x7fbfc0140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.519+0000 7fbfbffff700 1 -- 172.21.15.133:0/2314893620 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfc00b2800 msgr2=0x7fbfc0140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.519+0000 7fbfbffff700 1 --2- 172.21.15.133:0/2314893620 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfc00b2800 0x7fbfc0140e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.519+0000 7fbfbffff700 1 -- 172.21.15.133:0/2314893620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfc01405e0 msgr2=0x7fbfc009aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.519+0000 7fbfbffff700 1 --2- 172.21.15.133:0/2314893620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfc01405e0 0x7fbfc009aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.519+0000 7fbfbffff700 1 -- 172.21.15.133:0/2314893620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc009bae0 con 0x7fbfc01469e0 2021-01-03T12:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.519+0000 7fbfbffff700 1 --2- 172.21.15.133:0/2314893620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc01469e0 0x7fbfc0145d20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fbfc013f8e0 tx=0x7fbfb80091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.519+0000 7fbfbcff9700 1 -- 172.21.15.133:0/2314893620 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfb800c980 con 0x7fbfc01469e0 2021-01-03T12:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.519+0000 7fbfbcff9700 1 -- 172.21.15.133:0/2314893620 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb800cae0 con 0x7fbfc01469e0 2021-01-03T12:59:58.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.519+0000 7fbfc5aef700 1 -- 172.21.15.133:0/2314893620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc0146210 con 0x7fbfc01469e0 2021-01-03T12:59:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.519+0000 7fbfbcff9700 1 -- 172.21.15.133:0/2314893620 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfb800ce40 con 0x7fbfc01469e0 2021-01-03T12:59:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.519+0000 7fbfc5aef700 1 -- 172.21.15.133:0/2314893620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc0060fe0 con 0x7fbfc01469e0 2021-01-03T12:59:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.519+0000 7fbfc5aef700 1 -- 172.21.15.133:0/2314893620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc0057300 con 0x7fbfc01469e0 2021-01-03T12:59:58.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.519+0000 7fbfbcff9700 1 -- 172.21.15.133:0/2314893620 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fbfb8022070 con 0x7fbfc01469e0 2021-01-03T12:59:58.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.523+0000 7fbfbcff9700 1 --2- 172.21.15.133:0/2314893620 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfa00553b0 0x7fbfa0057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.523+0000 7fbfbcff9700 1 -- 172.21.15.133:0/2314893620 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fbfb806e280 con 0x7fbfc01469e0 2021-01-03T12:59:58.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.523+0000 7fbfbf7fe700 1 --2- 172.21.15.133:0/2314893620 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfa00553b0 0x7fbfa0057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.523+0000 7fbfbf7fe700 1 --2- 172.21.15.133:0/2314893620 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfa00553b0 0x7fbfa0057870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fbfb401b000 tx=0x7fbfb4015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:58.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.523+0000 7fbfbcff9700 1 -- 172.21.15.133:0/2314893620 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbfb80448b0 con 0x7fbfc01469e0 2021-01-03T12:59:58.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.663+0000 7fbfc5aef700 1 -- 172.21.15.133:0/2314893620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbfc009a240 con 0x7fbfc01469e0 2021-01-03T12:59:58.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.667+0000 7fbfbcff9700 1 -- 172.21.15.133:0/2314893620 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbfb8016070 con 0x7fbfc01469e0 2021-01-03T12:59:58.666 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T12:59:58.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.667+0000 7fbfc5aef700 1 -- 172.21.15.133:0/2314893620 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfa00553b0 msgr2=0x7fbfa0057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.667+0000 7fbfc5aef700 1 --2- 172.21.15.133:0/2314893620 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfa00553b0 0x7fbfa0057870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fbfb401b000 tx=0x7fbfb4015000).stop 2021-01-03T12:59:58.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.667+0000 7fbfc5aef700 1 -- 172.21.15.133:0/2314893620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc01469e0 msgr2=0x7fbfc0145d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.667+0000 7fbfc5aef700 1 --2- 172.21.15.133:0/2314893620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc01469e0 0x7fbfc0145d20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fbfc013f8e0 tx=0x7fbfb80091a0).stop 2021-01-03T12:59:58.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.667+0000 7fbfc5aef700 1 -- 172.21.15.133:0/2314893620 shutdown_connections 2021-01-03T12:59:58.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.667+0000 7fbfc5aef700 1 --2- 172.21.15.133:0/2314893620 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfa00553b0 0x7fbfa0057870 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.667+0000 7fbfc5aef700 1 --2- 172.21.15.133:0/2314893620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfc01469e0 0x7fbfc0145d20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.667+0000 7fbfc5aef700 1 --2- 172.21.15.133:0/2314893620 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfc00b2800 0x7fbfc0140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.667+0000 7fbfc5aef700 1 --2- 172.21.15.133:0/2314893620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfc01405e0 0x7fbfc009aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.667+0000 7fbfc5aef700 1 -- 172.21.15.133:0/2314893620 >> 172.21.15.133:0/2314893620 conn(0x7fbfc005bdf0 msgr2=0x7fbfc00b5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:58.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.667+0000 7fbfc5aef700 1 -- 172.21.15.133:0/2314893620 shutdown_connections 2021-01-03T12:59:58.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.667+0000 7fbfc5aef700 1 -- 172.21.15.133:0/2314893620 wait complete. 2021-01-03T12:59:58.680 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-01-03T12:59:58.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31f4eb700 1 Processor -- start 2021-01-03T12:59:58.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31f4eb700 1 -- start start 2021-01-03T12:59:58.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31f4eb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa3180b2350 0x7fa31814a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31f4eb700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa3180b1b20 0x7fa31814adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31f4eb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3180b1110 con 0x7fa3180a7570 2021-01-03T12:59:58.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31f4eb700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3180a7cb0 con 0x7fa3180b1b20 2021-01-03T12:59:58.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31f4eb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3180b0520 con 0x7fa3180b2350 2021-01-03T12:59:58.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31e4e9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa3180b2350 0x7fa31814a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31e4e9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa3180b2350 0x7fa31814a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33566/0 (socket says 172.21.15.133:33566) 2021-01-03T12:59:58.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31e4e9700 1 -- 172.21.15.133:0/2914903151 learned_addr learned my addr 172.21.15.133:0/2914903151 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:58.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31dce8700 1 --1- 172.21.15.133:0/2914903151 >> v1:172.21.15.133:6789/0 conn(0x7fa3180a7570 0x7fa3180671e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54596/0 (socket says 172.21.15.133:54596) 2021-01-03T12:59:58.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31ecea700 1 --2- 172.21.15.133:0/2914903151 >> v2:172.21.15.16:3300/0 conn(0x7fa3180b1b20 0x7fa31814adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31e4e9700 1 -- 172.21.15.133:0/2914903151 >> v2:172.21.15.16:3300/0 conn(0x7fa3180b1b20 msgr2=0x7fa31814adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:58.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31e4e9700 1 --2- 172.21.15.133:0/2914903151 >> v2:172.21.15.16:3300/0 conn(0x7fa3180b1b20 0x7fa31814adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31e4e9700 1 -- 172.21.15.133:0/2914903151 >> v1:172.21.15.133:6789/0 conn(0x7fa3180a7570 legacy=0x7fa3180671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31e4e9700 1 -- 172.21.15.133:0/2914903151 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3180b0bd0 con 0x7fa3180b2350 2021-01-03T12:59:58.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31ecea700 1 --2- 172.21.15.133:0/2914903151 >> v2:172.21.15.16:3300/0 conn(0x7fa3180b1b20 0x7fa31814adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T12:59:58.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31e4e9700 1 --2- 172.21.15.133:0/2914903151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3180b2350 0x7fa31814a8d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fa30c0032b0 tx=0x7fa30c009270).ready entity=mon.1 client_cookie=44cd06c34dbb0a89 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:58.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31d4e7700 1 -- 172.21.15.133:0/2914903151 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa30c00bc00 con 0x7fa3180b2350 2021-01-03T12:59:58.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31d4e7700 1 -- 172.21.15.133:0/2914903151 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c00bd60 con 0x7fa3180b2350 2021-01-03T12:59:58.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31d4e7700 1 -- 172.21.15.133:0/2914903151 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa30c011400 con 0x7fa3180b2350 2021-01-03T12:59:58.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31f4eb700 1 -- 172.21.15.133:0/2914903151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3180b2350 msgr2=0x7fa31814a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31f4eb700 1 --2- 172.21.15.133:0/2914903151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3180b2350 0x7fa31814a8d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fa30c0032b0 tx=0x7fa30c009270).stop 2021-01-03T12:59:58.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31f4eb700 1 -- 172.21.15.133:0/2914903151 shutdown_connections 2021-01-03T12:59:58.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31f4eb700 1 --2- 172.21.15.133:0/2914903151 >> v2:172.21.15.16:3300/0 conn(0x7fa3180b1b20 0x7fa31814adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31f4eb700 1 --2- 172.21.15.133:0/2914903151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3180b2350 0x7fa31814a8d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31f4eb700 1 -- 172.21.15.133:0/2914903151 >> 172.21.15.133:0/2914903151 conn(0x7fa31806b050 msgr2=0x7fa318060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:58.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31f4eb700 1 -- 172.21.15.133:0/2914903151 shutdown_connections 2021-01-03T12:59:58.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.795+0000 7fa31f4eb700 1 -- 172.21.15.133:0/2914903151 wait complete. 2021-01-03T12:59:58.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31f4eb700 1 Processor -- start 2021-01-03T12:59:58.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31f4eb700 1 -- start start 2021-01-03T12:59:58.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31f4eb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3180a7570 0x7fa3180ab850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31f4eb700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3180b1b20 0x7fa3180abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31f4eb700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3180b2350 0x7fa3181498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31f4eb700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa318144ca0 con 0x7fa3180b1b20 2021-01-03T12:59:58.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31f4eb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa318157030 con 0x7fa3180a7570 2021-01-03T12:59:58.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31f4eb700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa318157260 con 0x7fa3180b2350 2021-01-03T12:59:58.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31e4e9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3180a7570 0x7fa3180ab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31e4e9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3180a7570 0x7fa3180ab850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33572/0 (socket says 172.21.15.133:33572) 2021-01-03T12:59:58.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31e4e9700 1 -- 172.21.15.133:0/2769041298 learned_addr learned my addr 172.21.15.133:0/2769041298 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:58.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31dce8700 1 --2- 172.21.15.133:0/2769041298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3180b1b20 0x7fa3180abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31ecea700 1 --2- 172.21.15.133:0/2769041298 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3180b2350 0x7fa3181498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31e4e9700 1 -- 172.21.15.133:0/2769041298 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3180b2350 msgr2=0x7fa3181498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31e4e9700 1 --2- 172.21.15.133:0/2769041298 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3180b2350 0x7fa3181498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31e4e9700 1 -- 172.21.15.133:0/2769041298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3180b1b20 msgr2=0x7fa3180abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31e4e9700 1 --2- 172.21.15.133:0/2769041298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3180b1b20 0x7fa3180abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31e4e9700 1 -- 172.21.15.133:0/2769041298 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa318157500 con 0x7fa3180a7570 2021-01-03T12:59:58.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31e4e9700 1 --2- 172.21.15.133:0/2769041298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3180a7570 0x7fa3180ab850 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fa3181565e0 tx=0x7fa30c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:58.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa3177fe700 1 -- 172.21.15.133:0/2769041298 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa30c0105b0 con 0x7fa3180a7570 2021-01-03T12:59:58.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa3177fe700 1 -- 172.21.15.133:0/2769041298 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c010710 con 0x7fa3180a7570 2021-01-03T12:59:58.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31f4eb700 1 -- 172.21.15.133:0/2769041298 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31814bd90 con 0x7fa3180a7570 2021-01-03T12:59:58.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa3177fe700 1 -- 172.21.15.133:0/2769041298 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa30c010a70 con 0x7fa3180a7570 2021-01-03T12:59:58.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.799+0000 7fa31f4eb700 1 -- 172.21.15.133:0/2769041298 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31814c600 con 0x7fa3180a7570 2021-01-03T12:59:58.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.803+0000 7fa31f4eb700 1 -- 172.21.15.133:0/2769041298 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31814c3f0 con 0x7fa3180a7570 2021-01-03T12:59:58.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.803+0000 7fa3177fe700 1 -- 172.21.15.133:0/2769041298 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa30c00f070 con 0x7fa3180a7570 2021-01-03T12:59:58.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.803+0000 7fa3177fe700 1 --2- 172.21.15.133:0/2769041298 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa3000553b0 0x7fa300057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:58.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.803+0000 7fa3177fe700 1 -- 172.21.15.133:0/2769041298 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa30c06f390 con 0x7fa3180a7570 2021-01-03T12:59:58.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.803+0000 7fa31dce8700 1 --2- 172.21.15.133:0/2769041298 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa3000553b0 0x7fa300057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:58.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.803+0000 7fa31dce8700 1 --2- 172.21.15.133:0/2769041298 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa3000553b0 0x7fa300057870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fa30400d000 tx=0x7fa304007b10).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:58.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.807+0000 7fa3177fe700 1 -- 172.21.15.133:0/2769041298 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa30c0459c0 con 0x7fa3180a7570 2021-01-03T12:59:58.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.963+0000 7fa31f4eb700 1 -- 172.21.15.133:0/2769041298 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa318057300 con 0x7fa3180a7570 2021-01-03T12:59:58.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.963+0000 7fa3177fe700 1 -- 172.21.15.133:0/2769041298 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v39) v1 ==== 84+0+143 (secure 0 0 0) 0x7fa30c015090 con 0x7fa3180a7570 2021-01-03T12:59:58.962 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T12:59:58.962 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2021-01-03T12:59:58.963 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:58.963 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2021-01-03T12:59:58.963 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2021-01-03T12:59:58.963 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T12:59:58.963 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T12:59:58.964 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2021-01-03T12:59:58.964 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2021-01-03T12:59:58.964 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T12:59:58.964 INFO:teuthology.orchestra.run.smithi133.stdout:] 2021-01-03T12:59:58.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.963+0000 7fa31f4eb700 1 -- 172.21.15.133:0/2769041298 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa3000553b0 msgr2=0x7fa300057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.963+0000 7fa31f4eb700 1 --2- 172.21.15.133:0/2769041298 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa3000553b0 0x7fa300057870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fa30400d000 tx=0x7fa304007b10).stop 2021-01-03T12:59:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.963+0000 7fa31f4eb700 1 -- 172.21.15.133:0/2769041298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3180a7570 msgr2=0x7fa3180ab850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.963+0000 7fa31f4eb700 1 --2- 172.21.15.133:0/2769041298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3180a7570 0x7fa3180ab850 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fa3181565e0 tx=0x7fa30c016000).stop 2021-01-03T12:59:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.963+0000 7fa31f4eb700 1 -- 172.21.15.133:0/2769041298 shutdown_connections 2021-01-03T12:59:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.963+0000 7fa31f4eb700 1 --2- 172.21.15.133:0/2769041298 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa3000553b0 0x7fa300057870 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.963+0000 7fa31f4eb700 1 --2- 172.21.15.133:0/2769041298 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3180b2350 0x7fa3181498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.963+0000 7fa31f4eb700 1 --2- 172.21.15.133:0/2769041298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3180a7570 0x7fa3180ab850 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.963+0000 7fa31f4eb700 1 --2- 172.21.15.133:0/2769041298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3180b1b20 0x7fa3180abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:58.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.963+0000 7fa31f4eb700 1 -- 172.21.15.133:0/2769041298 >> 172.21.15.133:0/2769041298 conn(0x7fa31806b050 msgr2=0x7fa3180b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:58.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.967+0000 7fa31f4eb700 1 -- 172.21.15.133:0/2769041298 shutdown_connections 2021-01-03T12:59:58.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:58.967+0000 7fa31f4eb700 1 -- 172.21.15.133:0/2769041298 wait complete. 2021-01-03T12:59:58.980 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-01-03T12:59:58.980 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-01-03T12:59:59.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.099+0000 7fb456277700 1 Processor -- start 2021-01-03T12:59:59.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.099+0000 7fb456277700 1 -- start start 2021-01-03T12:59:59.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.099+0000 7fb456277700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb45005fdc0 0x7fb45013fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:59.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.099+0000 7fb456277700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4500acfa0 0x7fb4500af180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:59.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.099+0000 7fb456277700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4500af670 0x7fb4500b0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:59.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.099+0000 7fb456277700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb450140370 con 0x7fb45005fdc0 2021-01-03T12:59:59.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.099+0000 7fb456277700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4500601a0 con 0x7fb4500acfa0 2021-01-03T12:59:59.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.099+0000 7fb456277700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4500ad440 con 0x7fb4500af670 2021-01-03T12:59:59.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.099+0000 7fb44f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4500acfa0 0x7fb4500af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:59.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.099+0000 7fb44f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4500acfa0 0x7fb4500af180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33582/0 (socket says 172.21.15.133:33582) 2021-01-03T12:59:59.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.099+0000 7fb44f7fe700 1 -- 172.21.15.133:0/979504155 learned_addr learned my addr 172.21.15.133:0/979504155 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:59.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.099+0000 7fb454814700 1 --2- 172.21.15.133:0/979504155 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4500af670 0x7fb4500b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:59.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.099+0000 7fb44ffff700 1 --2- 172.21.15.133:0/979504155 >> v2:172.21.15.16:3300/0 conn(0x7fb45005fdc0 0x7fb45013fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:59.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb44f7fe700 1 -- 172.21.15.133:0/979504155 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4500af670 msgr2=0x7fb4500b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:59.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb44f7fe700 1 --2- 172.21.15.133:0/979504155 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4500af670 0x7fb4500b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb44f7fe700 1 -- 172.21.15.133:0/979504155 >> v2:172.21.15.16:3300/0 conn(0x7fb45005fdc0 msgr2=0x7fb45013fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T12:59:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb44f7fe700 1 --2- 172.21.15.133:0/979504155 >> v2:172.21.15.16:3300/0 conn(0x7fb45005fdc0 0x7fb45013fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb44f7fe700 1 -- 172.21.15.133:0/979504155 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4500ad6e0 con 0x7fb4500acfa0 2021-01-03T12:59:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb44f7fe700 1 --2- 172.21.15.133:0/979504155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4500acfa0 0x7fb4500af180 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fb4480032b0 tx=0x7fb448009270).ready entity=mon.1 client_cookie=c9ef0592aef4f378 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb44effd700 1 -- 172.21.15.133:0/979504155 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb448009e60 con 0x7fb4500acfa0 2021-01-03T12:59:59.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb44effd700 1 -- 172.21.15.133:0/979504155 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44800bb50 con 0x7fb4500acfa0 2021-01-03T12:59:59.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb44effd700 1 -- 172.21.15.133:0/979504155 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb44800bcc0 con 0x7fb4500acfa0 2021-01-03T12:59:59.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb456277700 1 -- 172.21.15.133:0/979504155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4500acfa0 msgr2=0x7fb4500af180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:59.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb456277700 1 --2- 172.21.15.133:0/979504155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4500acfa0 0x7fb4500af180 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fb4480032b0 tx=0x7fb448009270).stop 2021-01-03T12:59:59.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb456277700 1 -- 172.21.15.133:0/979504155 shutdown_connections 2021-01-03T12:59:59.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb456277700 1 --2- 172.21.15.133:0/979504155 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4500af670 0x7fb4500b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:59.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb456277700 1 --2- 172.21.15.133:0/979504155 >> v2:172.21.15.16:3300/0 conn(0x7fb45005fdc0 0x7fb45013fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:59.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb456277700 1 --2- 172.21.15.133:0/979504155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4500acfa0 0x7fb4500af180 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:59.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb456277700 1 -- 172.21.15.133:0/979504155 >> 172.21.15.133:0/979504155 conn(0x7fb45005c8c0 msgr2=0x7fb4500b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T12:59:59.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb456277700 1 -- 172.21.15.133:0/979504155 shutdown_connections 2021-01-03T12:59:59.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.103+0000 7fb456277700 1 -- 172.21.15.133:0/979504155 wait complete. 2021-01-03T12:59:59.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb456277700 1 Processor -- start 2021-01-03T12:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb456277700 1 -- start start 2021-01-03T12:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb456277700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb45005fdc0 0x7fb45013efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb456277700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4500acfa0 0x7fb4501334a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb456277700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4500af670 0x7fb450133990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb456277700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4501375b0 con 0x7fb4500af670 2021-01-03T12:59:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb456277700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb450138d50 con 0x7fb4500acfa0 2021-01-03T12:59:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb456277700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb450138ff0 con 0x7fb45005fdc0 2021-01-03T12:59:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb44f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4500acfa0 0x7fb4501334a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb454814700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4500af670 0x7fb450133990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb44f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4500acfa0 0x7fb4501334a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33586/0 (socket says 172.21.15.133:33586) 2021-01-03T12:59:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb454814700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4500af670 0x7fb450133990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:60360/0 (socket says 172.21.15.133:60360) 2021-01-03T12:59:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb44f7fe700 1 -- 172.21.15.133:0/780251259 learned_addr learned my addr 172.21.15.133:0/780251259 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T12:59:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb44ffff700 1 --2- 172.21.15.133:0/780251259 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb45005fdc0 0x7fb45013efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb44f7fe700 1 -- 172.21.15.133:0/780251259 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb45005fdc0 msgr2=0x7fb45013efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:59.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb44f7fe700 1 --2- 172.21.15.133:0/780251259 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb45005fdc0 0x7fb45013efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:59.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb44f7fe700 1 -- 172.21.15.133:0/780251259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4500af670 msgr2=0x7fb450133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T12:59:59.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb44f7fe700 1 --2- 172.21.15.133:0/780251259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4500af670 0x7fb450133990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T12:59:59.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb44f7fe700 1 -- 172.21.15.133:0/780251259 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb450139290 con 0x7fb4500acfa0 2021-01-03T12:59:59.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb44f7fe700 1 --2- 172.21.15.133:0/780251259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4500acfa0 0x7fb4501334a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fb4480032b0 tx=0x7fb448016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:59.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb44d7fa700 1 -- 172.21.15.133:0/780251259 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb448022070 con 0x7fb4500acfa0 2021-01-03T12:59:59.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb44d7fa700 1 -- 172.21.15.133:0/780251259 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44801e610 con 0x7fb4500acfa0 2021-01-03T12:59:59.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb456277700 1 -- 172.21.15.133:0/780251259 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb450139730 con 0x7fb4500acfa0 2021-01-03T12:59:59.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb44d7fa700 1 -- 172.21.15.133:0/780251259 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb44801e970 con 0x7fb4500acfa0 2021-01-03T12:59:59.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.107+0000 7fb456277700 1 -- 172.21.15.133:0/780251259 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb450137850 con 0x7fb4500acfa0 2021-01-03T12:59:59.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.111+0000 7fb44d7fa700 1 -- 172.21.15.133:0/780251259 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb44800f070 con 0x7fb4500acfa0 2021-01-03T12:59:59.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.111+0000 7fb456277700 1 -- 172.21.15.133:0/780251259 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb450139420 con 0x7fb4500acfa0 2021-01-03T12:59:59.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.111+0000 7fb44d7fa700 1 --2- 172.21.15.133:0/780251259 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb4340553b0 0x7fb434057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T12:59:59.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.111+0000 7fb44d7fa700 1 -- 172.21.15.133:0/780251259 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb44806ea10 con 0x7fb4500acfa0 2021-01-03T12:59:59.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.111+0000 7fb44ffff700 1 --2- 172.21.15.133:0/780251259 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb4340553b0 0x7fb434057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T12:59:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.111+0000 7fb44ffff700 1 --2- 172.21.15.133:0/780251259 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb4340553b0 0x7fb434057870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fb43800b000 tx=0x7fb438006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T12:59:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.119+0000 7fb44d7fa700 1 -- 172.21.15.133:0/780251259 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb448044fc0 con 0x7fb4500acfa0 2021-01-03T12:59:59.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T12:59:59.259+0000 7fb456277700 1 -- 172.21.15.133:0/780251259 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fb450057300 con 0x7fb4500acfa0 2021-01-03T13:00:00.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.271+0000 7fb44d7fa700 1 -- 172.21.15.133:0/780251259 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v40) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb4480150a0 con 0x7fb4500acfa0 2021-01-03T13:00:00.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.275+0000 7fb456277700 1 -- 172.21.15.133:0/780251259 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb4340553b0 msgr2=0x7fb434057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:00.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.275+0000 7fb456277700 1 --2- 172.21.15.133:0/780251259 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb4340553b0 0x7fb434057870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fb43800b000 tx=0x7fb438006dc0).stop 2021-01-03T13:00:00.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.275+0000 7fb456277700 1 -- 172.21.15.133:0/780251259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4500acfa0 msgr2=0x7fb4501334a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:00.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.275+0000 7fb456277700 1 --2- 172.21.15.133:0/780251259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4500acfa0 0x7fb4501334a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fb4480032b0 tx=0x7fb448016000).stop 2021-01-03T13:00:00.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.275+0000 7fb456277700 1 -- 172.21.15.133:0/780251259 shutdown_connections 2021-01-03T13:00:00.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.275+0000 7fb456277700 1 --2- 172.21.15.133:0/780251259 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb4340553b0 0x7fb434057870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:00.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.275+0000 7fb456277700 1 --2- 172.21.15.133:0/780251259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4500af670 0x7fb450133990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:00.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.275+0000 7fb456277700 1 --2- 172.21.15.133:0/780251259 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb45005fdc0 0x7fb45013efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:00.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.275+0000 7fb456277700 1 --2- 172.21.15.133:0/780251259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4500acfa0 0x7fb4501334a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:00.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.275+0000 7fb456277700 1 -- 172.21.15.133:0/780251259 >> 172.21.15.133:0/780251259 conn(0x7fb45005c8c0 msgr2=0x7fb4500b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:00.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.275+0000 7fb456277700 1 -- 172.21.15.133:0/780251259 shutdown_connections 2021-01-03T13:00:00.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.275+0000 7fb456277700 1 -- 172.21.15.133:0/780251259 wait complete. 2021-01-03T13:00:00.279 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2021-01-03T13:00:00.289 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-01-03T13:00:00.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.403+0000 7f53de9c4700 1 Processor -- start 2021-01-03T13:00:00.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.403+0000 7f53de9c4700 1 -- start start 2021-01-03T13:00:00.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53de9c4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53d80af200 0x7f53d8141620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:00.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53de9c4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f53d805bdf0 0x7f53d8144550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:00.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53de9c4700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d805c270 con 0x7f53d8144a40 2021-01-03T13:00:00.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53de9c4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d80af5e0 con 0x7f53d80af200 2021-01-03T13:00:00.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53de9c4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d805c4c0 con 0x7f53d805bdf0 2021-01-03T13:00:00.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53dd9c2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53d80af200 0x7f53d8141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:00.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53dd9c2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f53d80af200 0x7f53d8141620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33592/0 (socket says 172.21.15.133:33592) 2021-01-03T13:00:00.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53dd9c2700 1 -- 172.21.15.133:0/1781569338 learned_addr learned my addr 172.21.15.133:0/1781569338 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:00.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53dd1c1700 1 --2- 172.21.15.133:0/1781569338 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f53d805bdf0 0x7f53d8144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:00.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53dd9c2700 1 -- 172.21.15.133:0/1781569338 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f53d805bdf0 msgr2=0x7f53d8144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:00.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53dd9c2700 1 --2- 172.21.15.133:0/1781569338 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f53d805bdf0 0x7f53d8144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:00.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53dd9c2700 1 -- 172.21.15.133:0/1781569338 >> v1:172.21.15.16:6789/0 conn(0x7f53d8144a40 legacy=0x7f53d80ab0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:00.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53dc9c0700 1 -- 172.21.15.133:0/1781569338 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619343156 0 0) 0x7f53d805c270 con 0x7f53d8144a40 2021-01-03T13:00:00.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53dd9c2700 1 -- 172.21.15.133:0/1781569338 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d805c760 con 0x7f53d80af200 2021-01-03T13:00:00.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53dd9c2700 1 --2- 172.21.15.133:0/1781569338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d80af200 0x7f53d8141620 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f53d4002f30 tx=0x7f53d4006e80).ready entity=mon.1 client_cookie=44038f7b7b74f890 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:00.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53dc9c0700 1 -- 172.21.15.133:0/1781569338 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53d40097f0 con 0x7f53d80af200 2021-01-03T13:00:00.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53dc9c0700 1 -- 172.21.15.133:0/1781569338 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d4009950 con 0x7f53d80af200 2021-01-03T13:00:00.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53dc9c0700 1 -- 172.21.15.133:0/1781569338 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53d4009cb0 con 0x7f53d80af200 2021-01-03T13:00:00.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53de9c4700 1 -- 172.21.15.133:0/1781569338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d80af200 msgr2=0x7f53d8141620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:00.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53de9c4700 1 --2- 172.21.15.133:0/1781569338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d80af200 0x7f53d8141620 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f53d4002f30 tx=0x7f53d4006e80).stop 2021-01-03T13:00:00.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53de9c4700 1 -- 172.21.15.133:0/1781569338 shutdown_connections 2021-01-03T13:00:00.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53de9c4700 1 --2- 172.21.15.133:0/1781569338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d80af200 0x7f53d8141620 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:00.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53de9c4700 1 --2- 172.21.15.133:0/1781569338 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f53d805bdf0 0x7f53d8144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:00.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53de9c4700 1 -- 172.21.15.133:0/1781569338 >> 172.21.15.133:0/1781569338 conn(0x7f53d806b050 msgr2=0x7f53d8060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:00.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53de9c4700 1 -- 172.21.15.133:0/1781569338 shutdown_connections 2021-01-03T13:00:00.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.407+0000 7f53de9c4700 1 -- 172.21.15.133:0/1781569338 wait complete. 2021-01-03T13:00:00.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.411+0000 7f53de9c4700 1 Processor -- start 2021-01-03T13:00:00.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.411+0000 7f53de9c4700 1 -- start start 2021-01-03T13:00:00.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53de9c4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f53d805bdf0 0x7f53d8063b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:00.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53de9c4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d80af200 0x7f53d8143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:00.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53de9c4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53d8144a40 0x7f53d8065360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:00.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53de9c4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d8062f70 con 0x7f53d8144a40 2021-01-03T13:00:00.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53de9c4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80631a0 con 0x7f53d80af200 2021-01-03T13:00:00.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53de9c4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d8063440 con 0x7f53d805bdf0 2021-01-03T13:00:00.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53dd1c1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d80af200 0x7f53d8143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:00.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53dd9c2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f53d805bdf0 0x7f53d8063b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:00.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53dd1c1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d80af200 0x7f53d8143110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33600/0 (socket says 172.21.15.133:33600) 2021-01-03T13:00:00.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53dd1c1700 1 -- 172.21.15.133:0/2878967069 learned_addr learned my addr 172.21.15.133:0/2878967069 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:00.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53de1c3700 1 --2- 172.21.15.133:0/2878967069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53d8144a40 0x7f53d8065360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:00.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53dd1c1700 1 -- 172.21.15.133:0/2878967069 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f53d805bdf0 msgr2=0x7f53d8063b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53dd1c1700 1 --2- 172.21.15.133:0/2878967069 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f53d805bdf0 0x7f53d8063b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53dd1c1700 1 -- 172.21.15.133:0/2878967069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53d8144a40 msgr2=0x7f53d8065360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53dd1c1700 1 --2- 172.21.15.133:0/2878967069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53d8144a40 0x7f53d8065360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53dd1c1700 1 -- 172.21.15.133:0/2878967069 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d80636e0 con 0x7f53d80af200 2021-01-03T13:00:00.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53dd1c1700 1 --2- 172.21.15.133:0/2878967069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d80af200 0x7f53d8143110 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f53c800c000 tx=0x7f53c8006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:00.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53c6ffd700 1 -- 172.21.15.133:0/2878967069 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c800ca10 con 0x7f53d80af200 2021-01-03T13:00:00.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53c6ffd700 1 -- 172.21.15.133:0/2878967069 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c800cb70 con 0x7f53d80af200 2021-01-03T13:00:00.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53de9c4700 1 -- 172.21.15.133:0/2878967069 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d8064380 con 0x7f53d80af200 2021-01-03T13:00:00.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53c6ffd700 1 -- 172.21.15.133:0/2878967069 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c80123f0 con 0x7f53d80af200 2021-01-03T13:00:00.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53de9c4700 1 -- 172.21.15.133:0/2878967069 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d8065a70 con 0x7f53d80af200 2021-01-03T13:00:00.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.415+0000 7f53de9c4700 1 -- 172.21.15.133:0/2878967069 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d8063870 con 0x7f53d80af200 2021-01-03T13:00:00.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.419+0000 7f53c6ffd700 1 -- 172.21.15.133:0/2878967069 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f53c8012550 con 0x7f53d80af200 2021-01-03T13:00:00.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.419+0000 7f53c6ffd700 1 --2- 172.21.15.133:0/2878967069 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53b8055440 0x7f53b8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:00.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.419+0000 7f53c6ffd700 1 -- 172.21.15.133:0/2878967069 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f53c806e1c0 con 0x7f53d80af200 2021-01-03T13:00:00.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.419+0000 7f53dd9c2700 1 --2- 172.21.15.133:0/2878967069 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53b8055440 0x7f53b8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:00.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.423+0000 7f53dd9c2700 1 --2- 172.21.15.133:0/2878967069 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53b8055440 0x7f53b8057900 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f53d401c000 tx=0x7f53d4015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:00.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.427+0000 7f53c6ffd700 1 -- 172.21.15.133:0/2878967069 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f53c80444b0 con 0x7f53d80af200 2021-01-03T13:00:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:00.567+0000 7f53de9c4700 1 -- 172.21.15.133:0/2878967069 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f53d8057300 con 0x7f53d80af200 2021-01-03T13:00:01.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.423+0000 7f53c6ffd700 1 -- 172.21.15.133:0/2878967069 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v42) v1 ==== 125+0+0 (secure 0 0 0) 0x7f53c8047ad0 con 0x7f53d80af200 2021-01-03T13:00:01.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.427+0000 7f53de9c4700 1 -- 172.21.15.133:0/2878967069 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53b8055440 msgr2=0x7f53b8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:01.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.427+0000 7f53de9c4700 1 --2- 172.21.15.133:0/2878967069 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53b8055440 0x7f53b8057900 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f53d401c000 tx=0x7f53d4015000).stop 2021-01-03T13:00:01.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.427+0000 7f53de9c4700 1 -- 172.21.15.133:0/2878967069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d80af200 msgr2=0x7f53d8143110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:01.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.427+0000 7f53de9c4700 1 --2- 172.21.15.133:0/2878967069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d80af200 0x7f53d8143110 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f53c800c000 tx=0x7f53c8006dc0).stop 2021-01-03T13:00:01.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.427+0000 7f53de9c4700 1 -- 172.21.15.133:0/2878967069 shutdown_connections 2021-01-03T13:00:01.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.427+0000 7f53de9c4700 1 --2- 172.21.15.133:0/2878967069 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53b8055440 0x7f53b8057900 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.427+0000 7f53de9c4700 1 --2- 172.21.15.133:0/2878967069 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f53d8144a40 0x7f53d8065360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.427+0000 7f53de9c4700 1 --2- 172.21.15.133:0/2878967069 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f53d805bdf0 0x7f53d8063b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.427+0000 7f53de9c4700 1 --2- 172.21.15.133:0/2878967069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f53d80af200 0x7f53d8143110 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.427+0000 7f53de9c4700 1 -- 172.21.15.133:0/2878967069 >> 172.21.15.133:0/2878967069 conn(0x7f53d806b050 msgr2=0x7f53d80b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:01.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.431+0000 7f53de9c4700 1 -- 172.21.15.133:0/2878967069 shutdown_connections 2021-01-03T13:00:01.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.431+0000 7f53de9c4700 1 -- 172.21.15.133:0/2878967069 wait complete. 2021-01-03T13:00:01.431 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2021-01-03T13:00:01.444 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-01-03T13:00:01.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.563+0000 7f63eca1d700 1 Processor -- start 2021-01-03T13:00:01.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.563+0000 7f63eca1d700 1 -- start start 2021-01-03T13:00:01.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63eca1d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f63e8067350 0x7f63e805fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:01.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63eca1d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63e80b2750 0x7f63e8144260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:01.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63eca1d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e80afe70 con 0x7f63e8066f70 2021-01-03T13:00:01.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63eca1d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e8060310 con 0x7f63e8067350 2021-01-03T13:00:01.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63eca1d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e80605a0 con 0x7f63e80b2750 2021-01-03T13:00:01.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63e759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63e80b2750 0x7f63e8144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:01.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63e759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63e80b2750 0x7f63e8144260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33614/0 (socket says 172.21.15.133:33614) 2021-01-03T13:00:01.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63e759e700 1 -- 172.21.15.133:0/2909793490 learned_addr learned my addr 172.21.15.133:0/2909793490 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:01.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63e6d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f63e8066f70 0x7f63e80af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54642/0 (socket says 172.21.15.133:54642) 2021-01-03T13:00:01.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63de59c700 1 --2- 172.21.15.133:0/2909793490 >> v2:172.21.15.16:3300/0 conn(0x7f63e8067350 0x7f63e805fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:01.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63e759e700 1 -- 172.21.15.133:0/2909793490 >> v2:172.21.15.16:3300/0 conn(0x7f63e8067350 msgr2=0x7f63e805fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:01.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63e759e700 1 --2- 172.21.15.133:0/2909793490 >> v2:172.21.15.16:3300/0 conn(0x7f63e8067350 0x7f63e805fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63e759e700 1 -- 172.21.15.133:0/2909793490 >> v1:172.21.15.133:6789/0 conn(0x7f63e8066f70 legacy=0x7f63e80af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:01.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63e759e700 1 -- 172.21.15.133:0/2909793490 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e80b0b50 con 0x7f63e80b2750 2021-01-03T13:00:01.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63de59c700 1 --2- 172.21.15.133:0/2909793490 >> v2:172.21.15.16:3300/0 conn(0x7f63e8067350 0x7f63e805fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:01.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63e759e700 1 --2- 172.21.15.133:0/2909793490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e80b2750 0x7f63e8144260 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f63e00032b0 tx=0x7f63e0009270).ready entity=mon.1 client_cookie=1ad8986318975474 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:01.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63e659c700 1 -- 172.21.15.133:0/2909793490 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e000bc00 con 0x7f63e80b2750 2021-01-03T13:00:01.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63e659c700 1 -- 172.21.15.133:0/2909793490 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e000bd60 con 0x7f63e80b2750 2021-01-03T13:00:01.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63e659c700 1 -- 172.21.15.133:0/2909793490 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e0011400 con 0x7f63e80b2750 2021-01-03T13:00:01.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63eca1d700 1 -- 172.21.15.133:0/2909793490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e80b2750 msgr2=0x7f63e8144260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:01.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63eca1d700 1 --2- 172.21.15.133:0/2909793490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e80b2750 0x7f63e8144260 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f63e00032b0 tx=0x7f63e0009270).stop 2021-01-03T13:00:01.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63eca1d700 1 -- 172.21.15.133:0/2909793490 shutdown_connections 2021-01-03T13:00:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63eca1d700 1 --2- 172.21.15.133:0/2909793490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e80b2750 0x7f63e8144260 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63eca1d700 1 --2- 172.21.15.133:0/2909793490 >> v2:172.21.15.16:3300/0 conn(0x7f63e8067350 0x7f63e805fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63eca1d700 1 -- 172.21.15.133:0/2909793490 >> 172.21.15.133:0/2909793490 conn(0x7f63e80b6110 msgr2=0x7f63e80b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63eca1d700 1 -- 172.21.15.133:0/2909793490 shutdown_connections 2021-01-03T13:00:01.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.567+0000 7f63eca1d700 1 -- 172.21.15.133:0/2909793490 wait complete. 2021-01-03T13:00:01.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63eca1d700 1 Processor -- start 2021-01-03T13:00:01.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63eca1d700 1 -- start start 2021-01-03T13:00:01.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63eca1d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63e8066f70 0x7f63e8065780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:01.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63eca1d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63e8067350 0x7f63e814f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:01.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63eca1d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e80b2750 0x7f63e814fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:01.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63eca1d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80651b0 con 0x7f63e8066f70 2021-01-03T13:00:01.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63eca1d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e8064f10 con 0x7f63e80b2750 2021-01-03T13:00:01.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63eca1d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e8063b10 con 0x7f63e8067350 2021-01-03T13:00:01.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63e759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e80b2750 0x7f63e814fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:01.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63e759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e80b2750 0x7f63e814fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33620/0 (socket says 172.21.15.133:33620) 2021-01-03T13:00:01.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63e759e700 1 -- 172.21.15.133:0/1138196432 learned_addr learned my addr 172.21.15.133:0/1138196432 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:01.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63e6d9d700 1 --2- 172.21.15.133:0/1138196432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63e8066f70 0x7f63e8065780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:01.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63de59c700 1 --2- 172.21.15.133:0/1138196432 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63e8067350 0x7f63e814f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:01.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63e759e700 1 -- 172.21.15.133:0/1138196432 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63e8067350 msgr2=0x7f63e814f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:01.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63e759e700 1 --2- 172.21.15.133:0/1138196432 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63e8067350 0x7f63e814f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63e759e700 1 -- 172.21.15.133:0/1138196432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63e8066f70 msgr2=0x7f63e8065780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:01.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63e759e700 1 --2- 172.21.15.133:0/1138196432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63e8066f70 0x7f63e8065780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63e759e700 1 -- 172.21.15.133:0/1138196432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e8063db0 con 0x7f63e80b2750 2021-01-03T13:00:01.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63de59c700 1 --2- 172.21.15.133:0/1138196432 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63e8067350 0x7f63e814f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63e759e700 1 --2- 172.21.15.133:0/1138196432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e80b2750 0x7f63e814fd40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f63e8141730 tx=0x7f63e0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63e4d99700 1 -- 172.21.15.133:0/1138196432 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e001f3f0 con 0x7f63e80b2750 2021-01-03T13:00:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63e4d99700 1 -- 172.21.15.133:0/1138196432 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e001f550 con 0x7f63e80b2750 2021-01-03T13:00:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63eca1d700 1 -- 172.21.15.133:0/1138196432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e809faf0 con 0x7f63e80b2750 2021-01-03T13:00:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63e4d99700 1 -- 172.21.15.133:0/1138196432 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63e001f8b0 con 0x7f63e80b2750 2021-01-03T13:00:01.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.571+0000 7f63eca1d700 1 -- 172.21.15.133:0/1138196432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e80644b0 con 0x7f63e80b2750 2021-01-03T13:00:01.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.575+0000 7f63e4d99700 1 -- 172.21.15.133:0/1138196432 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f63e0026030 con 0x7f63e80b2750 2021-01-03T13:00:01.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.575+0000 7f63eca1d700 1 -- 172.21.15.133:0/1138196432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e8057300 con 0x7f63e80b2750 2021-01-03T13:00:01.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.575+0000 7f63e4d99700 1 --2- 172.21.15.133:0/1138196432 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63cc055330 0x7f63cc0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:01.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.575+0000 7f63e4d99700 1 -- 172.21.15.133:0/1138196432 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f63e006eb80 con 0x7f63e80b2750 2021-01-03T13:00:01.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.575+0000 7f63e6d9d700 1 --2- 172.21.15.133:0/1138196432 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63cc055330 0x7f63cc0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:01.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.575+0000 7f63e6d9d700 1 --2- 172.21.15.133:0/1138196432 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63cc055330 0x7f63cc0577f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f63d800d000 tx=0x7f63d8007b10).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:01.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.583+0000 7f63e4d99700 1 -- 172.21.15.133:0/1138196432 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f63e0044de0 con 0x7f63e80b2750 2021-01-03T13:00:01.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.763+0000 7f63eca1d700 1 -- 172.21.15.133:0/1138196432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f63e8063f40 con 0x7f63e80b2750 2021-01-03T13:00:01.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.779+0000 7f63e4d99700 1 -- 172.21.15.133:0/1138196432 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 7 and data pool 8 v15) v1 ==== 187+0+0 (secure 0 0 0) 0x7f63e00240d0 con 0x7f63e80b2750 2021-01-03T13:00:01.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.783+0000 7f63eca1d700 1 -- 172.21.15.133:0/1138196432 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63cc055330 msgr2=0x7f63cc0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:01.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.783+0000 7f63eca1d700 1 --2- 172.21.15.133:0/1138196432 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63cc055330 0x7f63cc0577f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f63d800d000 tx=0x7f63d8007b10).stop 2021-01-03T13:00:01.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.787+0000 7f63eca1d700 1 -- 172.21.15.133:0/1138196432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e80b2750 msgr2=0x7f63e814fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:01.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.787+0000 7f63eca1d700 1 --2- 172.21.15.133:0/1138196432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e80b2750 0x7f63e814fd40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f63e8141730 tx=0x7f63e0016000).stop 2021-01-03T13:00:01.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.787+0000 7f63eca1d700 1 -- 172.21.15.133:0/1138196432 shutdown_connections 2021-01-03T13:00:01.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.787+0000 7f63eca1d700 1 --2- 172.21.15.133:0/1138196432 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63cc055330 0x7f63cc0577f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.787+0000 7f63eca1d700 1 --2- 172.21.15.133:0/1138196432 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63e8066f70 0x7f63e8065780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.787+0000 7f63eca1d700 1 --2- 172.21.15.133:0/1138196432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63e80b2750 0x7f63e814fd40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.787+0000 7f63eca1d700 1 --2- 172.21.15.133:0/1138196432 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63e8067350 0x7f63e814f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.787+0000 7f63eca1d700 1 -- 172.21.15.133:0/1138196432 >> 172.21.15.133:0/1138196432 conn(0x7f63e80b6110 msgr2=0x7f63e80af760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:01.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.787+0000 7f63eca1d700 1 -- 172.21.15.133:0/1138196432 shutdown_connections 2021-01-03T13:00:01.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.787+0000 7f63eca1d700 1 -- 172.21.15.133:0/1138196432 wait complete. 2021-01-03T13:00:01.789 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 7 and data pool 8 2021-01-03T13:00:01.800 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:00:01.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.899+0000 7f1c29cc7700 1 Processor -- start 2021-01-03T13:00:01.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.899+0000 7f1c29cc7700 1 -- start start 2021-01-03T13:00:01.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c29cc7700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1c2405c840 0x7f1c240af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:01.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c29cc7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c2413f960 0x7f1c24138c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:01.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c29cc7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2405cc20 con 0x7f1c240afa70 2021-01-03T13:00:01.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c29cc7700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c240b18e0 con 0x7f1c2405c840 2021-01-03T13:00:01.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c29cc7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c2413fdb0 con 0x7f1c2413f960 2021-01-03T13:00:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c23fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c2413f960 0x7f1c24138c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c23fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c2413f960 0x7f1c24138c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33638/0 (socket says 172.21.15.133:33638) 2021-01-03T13:00:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c23fff700 1 -- 172.21.15.133:0/3003183247 learned_addr learned my addr 172.21.15.133:0/3003183247 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:01.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c1affd700 1 --1- 172.21.15.133:0/3003183247 >> v1:172.21.15.133:6789/0 conn(0x7f1c240afa70 0x7f1c2413f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54668/0 (socket says 172.21.15.133:54668) 2021-01-03T13:00:01.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c237fe700 1 --2- 172.21.15.133:0/3003183247 >> v2:172.21.15.16:3300/0 conn(0x7f1c2405c840 0x7f1c240af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:01.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c23fff700 1 -- 172.21.15.133:0/3003183247 >> v2:172.21.15.16:3300/0 conn(0x7f1c2405c840 msgr2=0x7f1c240af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:01.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c23fff700 1 --2- 172.21.15.133:0/3003183247 >> v2:172.21.15.16:3300/0 conn(0x7f1c2405c840 0x7f1c240af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c23fff700 1 -- 172.21.15.133:0/3003183247 >> v1:172.21.15.133:6789/0 conn(0x7f1c240afa70 legacy=0x7f1c2413f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:01.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c22ffd700 1 -- 172.21.15.133:0/3003183247 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693520484 0 0) 0x7f1c2405cc20 con 0x7f1c240afa70 2021-01-03T13:00:01.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c23fff700 1 -- 172.21.15.133:0/3003183247 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c240ad2d0 con 0x7f1c2413f960 2021-01-03T13:00:01.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c23fff700 1 --2- 172.21.15.133:0/3003183247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c2413f960 0x7f1c24138c40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f1c240af390 tx=0x7f1c1c009270).ready entity=mon.1 client_cookie=c487a17836d86ec4 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:01.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c22ffd700 1 -- 172.21.15.133:0/3003183247 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c1c009e90 con 0x7f1c2413f960 2021-01-03T13:00:01.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c22ffd700 1 -- 172.21.15.133:0/3003183247 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c00bb80 con 0x7f1c2413f960 2021-01-03T13:00:01.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c22ffd700 1 -- 172.21.15.133:0/3003183247 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c1c00bcf0 con 0x7f1c2413f960 2021-01-03T13:00:01.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c29cc7700 1 -- 172.21.15.133:0/3003183247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c2413f960 msgr2=0x7f1c24138c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:01.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.903+0000 7f1c29cc7700 1 --2- 172.21.15.133:0/3003183247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c2413f960 0x7f1c24138c40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f1c240af390 tx=0x7f1c1c009270).stop 2021-01-03T13:00:01.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.907+0000 7f1c29cc7700 1 -- 172.21.15.133:0/3003183247 shutdown_connections 2021-01-03T13:00:01.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.907+0000 7f1c29cc7700 1 --2- 172.21.15.133:0/3003183247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c2413f960 0x7f1c24138c40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.907+0000 7f1c29cc7700 1 --2- 172.21.15.133:0/3003183247 >> v2:172.21.15.16:3300/0 conn(0x7f1c2405c840 0x7f1c240af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.907+0000 7f1c29cc7700 1 -- 172.21.15.133:0/3003183247 >> 172.21.15.133:0/3003183247 conn(0x7f1c2406aeb0 msgr2=0x7f1c2405bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:01.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.907+0000 7f1c29cc7700 1 -- 172.21.15.133:0/3003183247 shutdown_connections 2021-01-03T13:00:01.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.907+0000 7f1c29cc7700 1 -- 172.21.15.133:0/3003183247 wait complete. 2021-01-03T13:00:01.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.907+0000 7f1c29cc7700 1 Processor -- start 2021-01-03T13:00:01.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.907+0000 7f1c29cc7700 1 -- start start 2021-01-03T13:00:01.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c29cc7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c2405c840 0x7f1c2413f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:01.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c29cc7700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c240afa70 0x7f1c24155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:01.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c29cc7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1c2413f960 0x7f1c24155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:01.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c29cc7700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24137db0 con 0x7f1c240afa70 2021-01-03T13:00:01.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c29cc7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c241415a0 con 0x7f1c2405c840 2021-01-03T13:00:01.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c29cc7700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c24145840 con 0x7f1c2413f960 2021-01-03T13:00:01.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c237fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c2405c840 0x7f1c2413f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:01.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c237fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c2405c840 0x7f1c2413f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33640/0 (socket says 172.21.15.133:33640) 2021-01-03T13:00:01.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c237fe700 1 -- 172.21.15.133:0/1488947252 learned_addr learned my addr 172.21.15.133:0/1488947252 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:01.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c1affd700 1 --2- 172.21.15.133:0/1488947252 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c240afa70 0x7f1c24155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:01.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c23fff700 1 --2- 172.21.15.133:0/1488947252 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1c2413f960 0x7f1c24155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:01.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c237fe700 1 -- 172.21.15.133:0/1488947252 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1c2413f960 msgr2=0x7f1c24155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:01.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c237fe700 1 --2- 172.21.15.133:0/1488947252 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1c2413f960 0x7f1c24155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c237fe700 1 -- 172.21.15.133:0/1488947252 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c240afa70 msgr2=0x7f1c24155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:01.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c237fe700 1 --2- 172.21.15.133:0/1488947252 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c240afa70 0x7f1c24155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:01.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c237fe700 1 -- 172.21.15.133:0/1488947252 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c24145ae0 con 0x7f1c2405c840 2021-01-03T13:00:01.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c1affd700 1 --2- 172.21.15.133:0/1488947252 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c240afa70 0x7f1c24155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:01.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c237fe700 1 --2- 172.21.15.133:0/1488947252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c2405c840 0x7f1c2413f050 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f1c240af520 tx=0x7f1c14006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:01.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c217fa700 1 -- 172.21.15.133:0/1488947252 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c1400ca80 con 0x7f1c2405c840 2021-01-03T13:00:01.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c217fa700 1 -- 172.21.15.133:0/1488947252 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1400cbe0 con 0x7f1c2405c840 2021-01-03T13:00:01.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c29cc7700 1 -- 172.21.15.133:0/1488947252 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c24145d80 con 0x7f1c2405c840 2021-01-03T13:00:01.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c217fa700 1 -- 172.21.15.133:0/1488947252 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c140123f0 con 0x7f1c2405c840 2021-01-03T13:00:01.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c29cc7700 1 -- 172.21.15.133:0/1488947252 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2413f540 con 0x7f1c2405c840 2021-01-03T13:00:01.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c29cc7700 1 -- 172.21.15.133:0/1488947252 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c241520a0 con 0x7f1c2405c840 2021-01-03T13:00:01.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c217fa700 1 -- 172.21.15.133:0/1488947252 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1c14012550 con 0x7f1c2405c840 2021-01-03T13:00:01.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c217fa700 1 --2- 172.21.15.133:0/1488947252 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1c08055330 0x7f1c080577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:01.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c217fa700 1 -- 172.21.15.133:0/1488947252 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1c1406e510 con 0x7f1c2405c840 2021-01-03T13:00:01.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.911+0000 7f1c1affd700 1 --2- 172.21.15.133:0/1488947252 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1c08055330 0x7f1c080577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:01.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.915+0000 7f1c1affd700 1 --2- 172.21.15.133:0/1488947252 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1c08055330 0x7f1c080577f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f1c0c00b000 tx=0x7f1c0c0070e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:01.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:01.919+0000 7f1c217fa700 1 -- 172.21.15.133:0/1488947252 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1c241520a0 con 0x7f1c2405c840 2021-01-03T13:00:02.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.059+0000 7f1c29cc7700 1 -- 172.21.15.133:0/1488947252 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c241520a0 con 0x7f1c2405c840 2021-01-03T13:00:02.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.059+0000 7f1c217fa700 1 -- 172.21.15.133:0/1488947252 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16112 (secure 0 0 0) 0x7f1c241520a0 con 0x7f1c2405c840 2021-01-03T13:00:02.060 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:00:02.060 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":43,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:00:01.768320+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:59:59.319419+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-01-03T13:00:00.624032+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:00:02.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.063+0000 7f1c29cc7700 1 -- 172.21.15.133:0/1488947252 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1c08055330 msgr2=0x7f1c080577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.063+0000 7f1c29cc7700 1 --2- 172.21.15.133:0/1488947252 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1c08055330 0x7f1c080577f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f1c0c00b000 tx=0x7f1c0c0070e0).stop 2021-01-03T13:00:02.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.063+0000 7f1c29cc7700 1 -- 172.21.15.133:0/1488947252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c2405c840 msgr2=0x7f1c2413f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.063+0000 7f1c29cc7700 1 --2- 172.21.15.133:0/1488947252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c2405c840 0x7f1c2413f050 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f1c240af520 tx=0x7f1c14006dc0).stop 2021-01-03T13:00:02.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.063+0000 7f1c29cc7700 1 -- 172.21.15.133:0/1488947252 shutdown_connections 2021-01-03T13:00:02.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.063+0000 7f1c29cc7700 1 --2- 172.21.15.133:0/1488947252 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1c08055330 0x7f1c080577f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.063+0000 7f1c29cc7700 1 --2- 172.21.15.133:0/1488947252 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1c2413f960 0x7f1c24155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.063+0000 7f1c29cc7700 1 --2- 172.21.15.133:0/1488947252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c2405c840 0x7f1c2413f050 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.064 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.063+0000 7f1c29cc7700 1 --2- 172.21.15.133:0/1488947252 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c240afa70 0x7f1c24155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.064 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.063+0000 7f1c29cc7700 1 -- 172.21.15.133:0/1488947252 >> 172.21.15.133:0/1488947252 conn(0x7f1c2406aeb0 msgr2=0x7f1c24067510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:02.064 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.063+0000 7f1c29cc7700 1 -- 172.21.15.133:0/1488947252 shutdown_connections 2021-01-03T13:00:02.064 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.063+0000 7f1c29cc7700 1 -- 172.21.15.133:0/1488947252 wait complete. 2021-01-03T13:00:02.074 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:00:02.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.183+0000 7fc48a41a700 1 Processor -- start 2021-01-03T13:00:02.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.183+0000 7fc48a41a700 1 -- start start 2021-01-03T13:00:02.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc48a41a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840b1300 0x7fc4841428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc48a41a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc4840b0c30 0x7fc4840ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc48a41a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4840afa40 con 0x7fc4840b2050 2021-01-03T13:00:02.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc48a41a700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4840b25d0 con 0x7fc4840b0c30 2021-01-03T13:00:02.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc48a41a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840b2870 con 0x7fc4840b1300 2021-01-03T13:00:02.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc489c19700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc4840b2050 0x7fc4840a8850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54684/0 (socket says 172.21.15.133:54684) 2021-01-03T13:00:02.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc489c19700 1 -- 172.21.15.133:0/2592935292 learned_addr learned my addr 172.21.15.133:0/2592935292 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:00:02.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc489418700 1 --2- 172.21.15.133:0/2592935292 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840b1300 0x7fc4841428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc488c17700 1 --2- 172.21.15.133:0/2592935292 >> v2:172.21.15.16:3300/0 conn(0x7fc4840b0c30 0x7fc4840ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc473fff700 1 -- 172.21.15.133:0/2592935292 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524520747 0 0) 0x7fc4840afa40 con 0x7fc4840b2050 2021-01-03T13:00:02.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc473fff700 1 -- 172.21.15.133:0/2592935292 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc46c003230 con 0x7fc4840b2050 2021-01-03T13:00:02.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc473fff700 1 -- 172.21.15.133:0/2592935292 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3444641464 0 0) 0x7fc46c003230 con 0x7fc4840b2050 2021-01-03T13:00:02.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc473fff700 1 -- 172.21.15.133:0/2592935292 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840b1300 msgr2=0x7fc4841428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:02.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc473fff700 1 --2- 172.21.15.133:0/2592935292 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840b1300 0x7fc4841428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc473fff700 1 -- 172.21.15.133:0/2592935292 >> v2:172.21.15.16:3300/0 conn(0x7fc4840b0c30 msgr2=0x7fc4840ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:02.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc473fff700 1 --2- 172.21.15.133:0/2592935292 >> v2:172.21.15.16:3300/0 conn(0x7fc4840b0c30 0x7fc4840ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc473fff700 1 -- 172.21.15.133:0/2592935292 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4840ad040 con 0x7fc4840b2050 2021-01-03T13:00:02.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc473fff700 1 -- 172.21.15.133:0/2592935292 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fc47c001a50 con 0x7fc4840b2050 2021-01-03T13:00:02.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc488c17700 1 --2- 172.21.15.133:0/2592935292 >> v2:172.21.15.16:3300/0 conn(0x7fc4840b0c30 0x7fc4840ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:00:02.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc473fff700 1 -- 172.21.15.133:0/2592935292 >> v1:172.21.15.133:6789/0 conn(0x7fc4840b2050 legacy=0x7fc4840a8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc473fff700 1 --2- 172.21.15.133:0/2592935292 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840b1300 0x7fc46c003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc473fff700 1 --2- 172.21.15.133:0/2592935292 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc46c003c30 0x7fc46c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc473fff700 1 --2- 172.21.15.133:0/2592935292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc46c0049c0 0x7fc46c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc473fff700 1 -- 172.21.15.133:0/2592935292 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840b25d0 con 0x7fc46c003c30 2021-01-03T13:00:02.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc473fff700 1 -- 172.21.15.133:0/2592935292 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840b2870 con 0x7fc46c0049c0 2021-01-03T13:00:02.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc473fff700 1 -- 172.21.15.133:0/2592935292 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c0041f0 con 0x7fc4840b1300 2021-01-03T13:00:02.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc489c19700 1 --2- 172.21.15.133:0/2592935292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc46c0049c0 0x7fc46c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc488c17700 1 --2- 172.21.15.133:0/2592935292 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc46c003c30 0x7fc46c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc489418700 1 --2- 172.21.15.133:0/2592935292 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840b1300 0x7fc46c003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc489c19700 1 -- 172.21.15.133:0/2592935292 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840b1300 msgr2=0x7fc46c003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:02.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc489c19700 1 --2- 172.21.15.133:0/2592935292 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840b1300 0x7fc46c003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc489c19700 1 -- 172.21.15.133:0/2592935292 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc46c003c30 msgr2=0x7fc46c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:02.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc489c19700 1 --2- 172.21.15.133:0/2592935292 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc46c003c30 0x7fc46c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc489c19700 1 -- 172.21.15.133:0/2592935292 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c003230 con 0x7fc46c0049c0 2021-01-03T13:00:02.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc489418700 1 --2- 172.21.15.133:0/2592935292 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840b1300 0x7fc46c003720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:02.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.187+0000 7fc489c19700 1 --2- 172.21.15.133:0/2592935292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc46c0049c0 0x7fc46c004e40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fc47c001760 tx=0x7fc4840adf10).ready entity=mon.1 client_cookie=5ad425add09c5210 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:02.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.191+0000 7fc473fff700 1 -- 172.21.15.133:0/2592935292 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc47c005b70 con 0x7fc46c0049c0 2021-01-03T13:00:02.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.191+0000 7fc473fff700 1 -- 172.21.15.133:0/2592935292 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c005cd0 con 0x7fc46c0049c0 2021-01-03T13:00:02.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.191+0000 7fc473fff700 1 -- 172.21.15.133:0/2592935292 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc47c0072c0 con 0x7fc46c0049c0 2021-01-03T13:00:02.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.191+0000 7fc48a41a700 1 -- 172.21.15.133:0/2592935292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc46c0049c0 msgr2=0x7fc46c004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.191+0000 7fc48a41a700 1 --2- 172.21.15.133:0/2592935292 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc46c0049c0 0x7fc46c004e40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fc47c001760 tx=0x7fc4840adf10).stop 2021-01-03T13:00:02.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.191+0000 7fc489c19700 1 -- 172.21.15.133:0/2592935292 reap_dead start 2021-01-03T13:00:02.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.191+0000 7fc48a41a700 1 -- 172.21.15.133:0/2592935292 shutdown_connections 2021-01-03T13:00:02.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.191+0000 7fc48a41a700 1 -- 172.21.15.133:0/2592935292 >> 172.21.15.133:0/2592935292 conn(0x7fc48406b050 msgr2=0x7fc484060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:02.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.191+0000 7fc48a41a700 1 -- 172.21.15.133:0/2592935292 shutdown_connections 2021-01-03T13:00:02.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.191+0000 7fc48a41a700 1 -- 172.21.15.133:0/2592935292 wait complete. 2021-01-03T13:00:02.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.191+0000 7fc48a41a700 1 Processor -- start 2021-01-03T13:00:02.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.191+0000 7fc48a41a700 1 -- start start 2021-01-03T13:00:02.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.191+0000 7fc48a41a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b3a70 0x7fc48413c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.191+0000 7fc48a41a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc48413c520 0x7fc48409fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.191+0000 7fc48a41a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840a0280 0x7fc4840a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc48a41a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840656a0 con 0x7fc48413c520 2021-01-03T13:00:02.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc48a41a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840b3e50 con 0x7fc4840b3a70 2021-01-03T13:00:02.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc48a41a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc484065cc0 con 0x7fc4840a0280 2021-01-03T13:00:02.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc489418700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b3a70 0x7fc48413c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc489418700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b3a70 0x7fc48413c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33660/0 (socket says 172.21.15.133:33660) 2021-01-03T13:00:02.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc488c17700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc48413c520 0x7fc48409fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc489418700 1 -- 172.21.15.133:0/925294912 learned_addr learned my addr 172.21.15.133:0/925294912 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:02.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc489c19700 1 --2- 172.21.15.133:0/925294912 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840a0280 0x7fc4840a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc489418700 1 -- 172.21.15.133:0/925294912 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840a0280 msgr2=0x7fc4840a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc489418700 1 --2- 172.21.15.133:0/925294912 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840a0280 0x7fc4840a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc489418700 1 -- 172.21.15.133:0/925294912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc48413c520 msgr2=0x7fc48409fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc489418700 1 --2- 172.21.15.133:0/925294912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc48413c520 0x7fc48409fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc489418700 1 -- 172.21.15.133:0/925294912 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4840658d0 con 0x7fc4840b3a70 2021-01-03T13:00:02.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc489418700 1 --2- 172.21.15.133:0/925294912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b3a70 0x7fc48413c030 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fc4840ac8d0 tx=0x7fc480008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:02.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc4727fc700 1 -- 172.21.15.133:0/925294912 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc48000e8a0 con 0x7fc4840b3a70 2021-01-03T13:00:02.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc4727fc700 1 -- 172.21.15.133:0/925294912 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48000ea00 con 0x7fc4840b3a70 2021-01-03T13:00:02.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc48a41a700 1 -- 172.21.15.133:0/925294912 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4840667e0 con 0x7fc4840b3a70 2021-01-03T13:00:02.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc4727fc700 1 -- 172.21.15.133:0/925294912 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc48000ed60 con 0x7fc4840b3a70 2021-01-03T13:00:02.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc48a41a700 1 -- 172.21.15.133:0/925294912 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48413c9a0 con 0x7fc4840b3a70 2021-01-03T13:00:02.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc48a41a700 1 -- 172.21.15.133:0/925294912 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48409e950 con 0x7fc4840b3a70 2021-01-03T13:00:02.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.195+0000 7fc4727fc700 1 -- 172.21.15.133:0/925294912 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc480024070 con 0x7fc4840b3a70 2021-01-03T13:00:02.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.199+0000 7fc4727fc700 1 --2- 172.21.15.133:0/925294912 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc464055440 0x7fc464057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.199+0000 7fc4727fc700 1 -- 172.21.15.133:0/925294912 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc48006e750 con 0x7fc4840b3a70 2021-01-03T13:00:02.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.199+0000 7fc488c17700 1 --2- 172.21.15.133:0/925294912 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc464055440 0x7fc464057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.199+0000 7fc488c17700 1 --2- 172.21.15.133:0/925294912 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc464055440 0x7fc464057900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fc474008000 tx=0x7fc474008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:02.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.203+0000 7fc4727fc700 1 -- 172.21.15.133:0/925294912 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc4800449f0 con 0x7fc4840b3a70 2021-01-03T13:00:02.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.347+0000 7fc48a41a700 1 -- 172.21.15.133:0/925294912 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc484057300 con 0x7fc4840b3a70 2021-01-03T13:00:02.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.347+0000 7fc4727fc700 1 -- 172.21.15.133:0/925294912 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16112 (secure 0 0 0) 0x7fc480048010 con 0x7fc4840b3a70 2021-01-03T13:00:02.348 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:00:02.348 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":43,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:00:01.768320+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:59:59.319419+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-01-03T13:00:00.624032+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:00:02.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.351+0000 7fc48a41a700 1 -- 172.21.15.133:0/925294912 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc464055440 msgr2=0x7fc464057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.351+0000 7fc48a41a700 1 --2- 172.21.15.133:0/925294912 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc464055440 0x7fc464057900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fc474008000 tx=0x7fc474008040).stop 2021-01-03T13:00:02.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.351+0000 7fc48a41a700 1 -- 172.21.15.133:0/925294912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b3a70 msgr2=0x7fc48413c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.351+0000 7fc48a41a700 1 --2- 172.21.15.133:0/925294912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b3a70 0x7fc48413c030 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fc4840ac8d0 tx=0x7fc480008040).stop 2021-01-03T13:00:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.351+0000 7fc48a41a700 1 -- 172.21.15.133:0/925294912 shutdown_connections 2021-01-03T13:00:02.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.351+0000 7fc48a41a700 1 --2- 172.21.15.133:0/925294912 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc464055440 0x7fc464057900 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.351+0000 7fc48a41a700 1 --2- 172.21.15.133:0/925294912 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840a0280 0x7fc4840a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.351+0000 7fc48a41a700 1 --2- 172.21.15.133:0/925294912 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b3a70 0x7fc48413c030 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.351+0000 7fc48a41a700 1 --2- 172.21.15.133:0/925294912 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc48413c520 0x7fc48409fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.351+0000 7fc48a41a700 1 -- 172.21.15.133:0/925294912 >> 172.21.15.133:0/925294912 conn(0x7fc48406b050 msgr2=0x7fc4841430b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:02.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.351+0000 7fc48a41a700 1 -- 172.21.15.133:0/925294912 shutdown_connections 2021-01-03T13:00:02.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.351+0000 7fc48a41a700 1 -- 172.21.15.133:0/925294912 wait complete. 2021-01-03T13:00:02.361 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-01-03T13:00:02.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.471+0000 7f0bc7fff700 1 Processor -- start 2021-01-03T13:00:02.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.471+0000 7f0bc7fff700 1 -- start start 2021-01-03T13:00:02.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0bc809a090 0x7f0bc8140580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc7fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0bc8060d10 0x7f0bc805fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc7fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc805f5e0 con 0x7f0bc80b5330 2021-01-03T13:00:02.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc7fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc8143730 con 0x7f0bc8060d10 2021-01-03T13:00:02.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc7fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc8140a70 con 0x7f0bc809a090 2021-01-03T13:00:02.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc6ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0bc80b5330 0x7f0bc813fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54700/0 (socket says 172.21.15.133:54700) 2021-01-03T13:00:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc6ffd700 1 -- 172.21.15.133:0/3595395508 learned_addr learned my addr 172.21.15.133:0/3595395508 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:00:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc67fc700 1 --2- 172.21.15.133:0/3595395508 >> v2:172.21.15.133:3300/0 conn(0x7f0bc809a090 0x7f0bc8140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc77fe700 1 --2- 172.21.15.133:0/3595395508 >> v2:172.21.15.16:3300/0 conn(0x7f0bc8060d10 0x7f0bc805fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc5ffb700 1 -- 172.21.15.133:0/3595395508 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698664546 0 0) 0x7f0bc805f5e0 con 0x7f0bc80b5330 2021-01-03T13:00:02.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc5ffb700 1 -- 172.21.15.133:0/3595395508 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ba8003230 con 0x7f0bc80b5330 2021-01-03T13:00:02.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc67fc700 1 -- 172.21.15.133:0/3595395508 >> v2:172.21.15.16:3300/0 conn(0x7f0bc8060d10 msgr2=0x7f0bc805fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:02.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc67fc700 1 --2- 172.21.15.133:0/3595395508 >> v2:172.21.15.16:3300/0 conn(0x7f0bc8060d10 0x7f0bc805fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc67fc700 1 -- 172.21.15.133:0/3595395508 >> v1:172.21.15.133:6789/0 conn(0x7f0bc80b5330 legacy=0x7f0bc813fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc5ffb700 1 -- 172.21.15.133:0/3595395508 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1631679921 0 0) 0x7f0ba8003230 con 0x7f0bc80b5330 2021-01-03T13:00:02.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc67fc700 1 -- 172.21.15.133:0/3595395508 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc80b5710 con 0x7f0bc809a090 2021-01-03T13:00:02.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc67fc700 1 --2- 172.21.15.133:0/3595395508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc809a090 0x7f0bc8140580 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f0bc0001bf0 tx=0x7f0bb0006dc0).ready entity=mon.1 client_cookie=5d55950c4603e173 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:02.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc5ffb700 1 -- 172.21.15.133:0/3595395508 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bc0001a50 con 0x7f0bc809a090 2021-01-03T13:00:02.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc5ffb700 1 -- 172.21.15.133:0/3595395508 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb000d5c0 con 0x7f0bc809a090 2021-01-03T13:00:02.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc5ffb700 1 -- 172.21.15.133:0/3595395508 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb000d730 con 0x7f0bc809a090 2021-01-03T13:00:02.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc7fff700 1 -- 172.21.15.133:0/3595395508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc809a090 msgr2=0x7f0bc8140580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc7fff700 1 --2- 172.21.15.133:0/3595395508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc809a090 0x7f0bc8140580 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f0bc0001bf0 tx=0x7f0bb0006dc0).stop 2021-01-03T13:00:02.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc7fff700 1 -- 172.21.15.133:0/3595395508 shutdown_connections 2021-01-03T13:00:02.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc7fff700 1 --2- 172.21.15.133:0/3595395508 >> v2:172.21.15.16:3300/0 conn(0x7f0bc8060d10 0x7f0bc805fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc7fff700 1 --2- 172.21.15.133:0/3595395508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc809a090 0x7f0bc8140580 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc7fff700 1 -- 172.21.15.133:0/3595395508 >> 172.21.15.133:0/3595395508 conn(0x7f0bc805bdf0 msgr2=0x7f0bc805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:02.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc7fff700 1 -- 172.21.15.133:0/3595395508 shutdown_connections 2021-01-03T13:00:02.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.475+0000 7f0bc7fff700 1 -- 172.21.15.133:0/3595395508 wait complete. 2021-01-03T13:00:02.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.479+0000 7f0bc7fff700 1 Processor -- start 2021-01-03T13:00:02.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.479+0000 7f0bc7fff700 1 -- start start 2021-01-03T13:00:02.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.479+0000 7f0bc7fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bc8060d10 0x7f0bc813e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.479+0000 7f0bc7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc809a090 0x7f0bc81522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.479+0000 7f0bc7fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0bc80b5330 0x7f0bc81527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.479+0000 7f0bc7fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc8151c20 con 0x7f0bc8060d10 2021-01-03T13:00:02.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.479+0000 7f0bc7fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc80ac750 con 0x7f0bc809a090 2021-01-03T13:00:02.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.479+0000 7f0bc7fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc813e8f0 con 0x7f0bc80b5330 2021-01-03T13:00:02.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bc67fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc809a090 0x7f0bc81522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bc67fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc809a090 0x7f0bc81522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33676/0 (socket says 172.21.15.133:33676) 2021-01-03T13:00:02.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bc67fc700 1 -- 172.21.15.133:0/2043712759 learned_addr learned my addr 172.21.15.133:0/2043712759 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:02.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bc6ffd700 1 --2- 172.21.15.133:0/2043712759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bc8060d10 0x7f0bc813e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bc77fe700 1 --2- 172.21.15.133:0/2043712759 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0bc80b5330 0x7f0bc81527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bc67fc700 1 -- 172.21.15.133:0/2043712759 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0bc80b5330 msgr2=0x7f0bc81527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bc67fc700 1 --2- 172.21.15.133:0/2043712759 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0bc80b5330 0x7f0bc81527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bc67fc700 1 -- 172.21.15.133:0/2043712759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bc8060d10 msgr2=0x7f0bc813e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bc67fc700 1 --2- 172.21.15.133:0/2043712759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bc8060d10 0x7f0bc813e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bc67fc700 1 -- 172.21.15.133:0/2043712759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc81552f0 con 0x7f0bc809a090 2021-01-03T13:00:02.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bc77fe700 1 --2- 172.21.15.133:0/2043712759 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0bc80b5330 0x7f0bc81527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:02.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bc67fc700 1 --2- 172.21.15.133:0/2043712759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc809a090 0x7f0bc81522b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f0bc0001bf0 tx=0x7f0bb0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:02.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bbffff700 1 -- 172.21.15.133:0/2043712759 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb00117d0 con 0x7f0bc809a090 2021-01-03T13:00:02.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bbffff700 1 -- 172.21.15.133:0/2043712759 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb0011930 con 0x7f0bc809a090 2021-01-03T13:00:02.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bc7fff700 1 -- 172.21.15.133:0/2043712759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc8151e10 con 0x7f0bc809a090 2021-01-03T13:00:02.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bbffff700 1 -- 172.21.15.133:0/2043712759 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bb0011c90 con 0x7f0bc809a090 2021-01-03T13:00:02.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bc7fff700 1 -- 172.21.15.133:0/2043712759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc80ac950 con 0x7f0bc809a090 2021-01-03T13:00:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bc7fff700 1 -- 172.21.15.133:0/2043712759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc8057300 con 0x7f0bc809a090 2021-01-03T13:00:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bbffff700 1 -- 172.21.15.133:0/2043712759 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0bb0024030 con 0x7f0bc809a090 2021-01-03T13:00:02.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bbffff700 1 --2- 172.21.15.133:0/2043712759 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0bac055440 0x7f0bac057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.483+0000 7f0bbffff700 1 -- 172.21.15.133:0/2043712759 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0bb006ef40 con 0x7f0bc809a090 2021-01-03T13:00:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.487+0000 7f0bc6ffd700 1 --2- 172.21.15.133:0/2043712759 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0bac055440 0x7f0bac057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.487+0000 7f0bc6ffd700 1 --2- 172.21.15.133:0/2043712759 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0bac055440 0x7f0bac057900 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f0bc000d000 tx=0x7f0bc0002190).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:02.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.491+0000 7f0bbffff700 1 -- 172.21.15.133:0/2043712759 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0bb00451a0 con 0x7f0bc809a090 2021-01-03T13:00:02.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.675+0000 7f0bc7fff700 1 -- 172.21.15.133:0/2043712759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0bc806b110 con 0x7f0bc809a090 2021-01-03T13:00:02.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.775+0000 7f0bbffff700 1 -- 172.21.15.133:0/2043712759 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0bb0022070 con 0x7f0bc809a090 2021-01-03T13:00:02.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.779+0000 7f0bc7fff700 1 -- 172.21.15.133:0/2043712759 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0bac055440 msgr2=0x7f0bac057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.779+0000 7f0bc7fff700 1 --2- 172.21.15.133:0/2043712759 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0bac055440 0x7f0bac057900 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f0bc000d000 tx=0x7f0bc0002190).stop 2021-01-03T13:00:02.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.779+0000 7f0bc7fff700 1 -- 172.21.15.133:0/2043712759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc809a090 msgr2=0x7f0bc81522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.779+0000 7f0bc7fff700 1 --2- 172.21.15.133:0/2043712759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc809a090 0x7f0bc81522b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f0bc0001bf0 tx=0x7f0bb0015000).stop 2021-01-03T13:00:02.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.779+0000 7f0bc7fff700 1 -- 172.21.15.133:0/2043712759 shutdown_connections 2021-01-03T13:00:02.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.779+0000 7f0bc7fff700 1 --2- 172.21.15.133:0/2043712759 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0bac055440 0x7f0bac057900 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.779+0000 7f0bc7fff700 1 --2- 172.21.15.133:0/2043712759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0bc8060d10 0x7f0bc813e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.779+0000 7f0bc7fff700 1 --2- 172.21.15.133:0/2043712759 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0bc80b5330 0x7f0bc81527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.779+0000 7f0bc7fff700 1 --2- 172.21.15.133:0/2043712759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0bc809a090 0x7f0bc81522b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.779+0000 7f0bc7fff700 1 -- 172.21.15.133:0/2043712759 >> 172.21.15.133:0/2043712759 conn(0x7f0bc805bdf0 msgr2=0x7f0bc813fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:02.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.779+0000 7f0bc7fff700 1 -- 172.21.15.133:0/2043712759 shutdown_connections 2021-01-03T13:00:02.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.779+0000 7f0bc7fff700 1 -- 172.21.15.133:0/2043712759 wait complete. 2021-01-03T13:00:02.798 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:00:02.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cdbfff700 1 Processor -- start 2021-01-03T13:00:02.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cdbfff700 1 -- start start 2021-01-03T13:00:02.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cdbfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8cdc13d670 0x7f8cdc13fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cdbfff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cdc0af220 con 0x7f8cdc0b2e90 2021-01-03T13:00:02.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cdbfff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cdc0b3270 con 0x7f8cdc0b0ac0 2021-01-03T13:00:02.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cdbfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc1401c0 con 0x7f8cdc13d670 2021-01-03T13:00:02.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cdaffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f8cdc0b2e90 0x7f8cdc143af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:33442/0 (socket says 172.21.15.133:33442) 2021-01-03T13:00:02.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cda7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8cdc0b0ac0 0x7f8cdc13cf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54716/0 (socket says 172.21.15.133:54716) 2021-01-03T13:00:02.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cdaffd700 1 -- 172.21.15.133:0/3269723353 learned_addr learned my addr 172.21.15.133:0/3269723353 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:00:02.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cdb7fe700 1 --2- 172.21.15.133:0/3269723353 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8cdc13d670 0x7f8cdc13fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cd9ffb700 1 -- 172.21.15.133:0/3269723353 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575169237 0 0) 0x7f8cdc0b3270 con 0x7f8cdc0b0ac0 2021-01-03T13:00:02.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cd9ffb700 1 -- 172.21.15.133:0/3269723353 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cc0003230 con 0x7f8cdc0b0ac0 2021-01-03T13:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cd9ffb700 1 -- 172.21.15.133:0/3269723353 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192685849 0 0) 0x7f8cdc0af220 con 0x7f8cdc0b2e90 2021-01-03T13:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cd9ffb700 1 -- 172.21.15.133:0/3269723353 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cdc0b3270 con 0x7f8cdc0b2e90 2021-01-03T13:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cd9ffb700 1 -- 172.21.15.133:0/3269723353 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 446172410 0 0) 0x7f8cc0003230 con 0x7f8cdc0b0ac0 2021-01-03T13:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cd9ffb700 1 -- 172.21.15.133:0/3269723353 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8cdc13d670 msgr2=0x7f8cdc13fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cd9ffb700 1 --2- 172.21.15.133:0/3269723353 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8cdc13d670 0x7f8cdc13fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cd9ffb700 1 -- 172.21.15.133:0/3269723353 >> v1:172.21.15.16:6789/0 conn(0x7f8cdc0b2e90 legacy=0x7f8cdc143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cd9ffb700 1 -- 172.21.15.133:0/3269723353 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc0aef80 con 0x7f8cdc0b0ac0 2021-01-03T13:00:02.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cd9ffb700 1 -- 172.21.15.133:0/3269723353 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f8cd0001710 con 0x7f8cdc0b0ac0 2021-01-03T13:00:02.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cd9ffb700 1 -- 172.21.15.133:0/3269723353 >> v1:172.21.15.133:6789/0 conn(0x7f8cdc0b0ac0 legacy=0x7f8cdc13cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cd9ffb700 1 --2- 172.21.15.133:0/3269723353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cc00038b0 0x7f8cc0003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cd9ffb700 1 --2- 172.21.15.133:0/3269723353 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8cdc13d670 0x7f8cc00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cd9ffb700 1 --2- 172.21.15.133:0/3269723353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cc00049c0 0x7f8cc0004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cd9ffb700 1 -- 172.21.15.133:0/3269723353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc1401c0 con 0x7f8cc00049c0 2021-01-03T13:00:02.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cd9ffb700 1 -- 172.21.15.133:0/3269723353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc0005330 con 0x7f8cc00038b0 2021-01-03T13:00:02.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cd9ffb700 1 -- 172.21.15.133:0/3269723353 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc000b720 con 0x7f8cdc13d670 2021-01-03T13:00:02.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cdaffd700 1 --2- 172.21.15.133:0/3269723353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cc00038b0 0x7f8cc0003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cda7fc700 1 --2- 172.21.15.133:0/3269723353 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8cdc13d670 0x7f8cc00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cdaffd700 1 -- 172.21.15.133:0/3269723353 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8cdc13d670 msgr2=0x7f8cc00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:02.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cdaffd700 1 --2- 172.21.15.133:0/3269723353 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8cdc13d670 0x7f8cc00044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cdaffd700 1 -- 172.21.15.133:0/3269723353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cc00049c0 msgr2=0x7f8cc0004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:02.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cdaffd700 1 --2- 172.21.15.133:0/3269723353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cc00049c0 0x7f8cc0004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-03T13:00:02.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cdaffd700 1 -- 172.21.15.133:0/3269723353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc0003230 con 0x7f8cc00038b0 2021-01-03T13:00:02.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.907+0000 7f8cdaffd700 1 --2- 172.21.15.133:0/3269723353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cc00038b0 0x7f8cc0003cb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f8cc00054a0 tx=0x7f8ccc007c50).ready entity=mon.1 client_cookie=ded944de190f38e5 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:02.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cd9ffb700 1 -- 172.21.15.133:0/3269723353 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ccc0072e0 con 0x7f8cc00038b0 2021-01-03T13:00:02.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cd9ffb700 1 -- 172.21.15.133:0/3269723353 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc007440 con 0x7f8cc00038b0 2021-01-03T13:00:02.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cd9ffb700 1 -- 172.21.15.133:0/3269723353 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ccc00c8a0 con 0x7f8cc00038b0 2021-01-03T13:00:02.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdbfff700 1 -- 172.21.15.133:0/3269723353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cc00038b0 msgr2=0x7f8cc0003cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdbfff700 1 --2- 172.21.15.133:0/3269723353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cc00038b0 0x7f8cc0003cb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f8cc00054a0 tx=0x7f8ccc007c50).stop 2021-01-03T13:00:02.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdb7fe700 1 -- 172.21.15.133:0/3269723353 reap_dead start 2021-01-03T13:00:02.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdbfff700 1 -- 172.21.15.133:0/3269723353 shutdown_connections 2021-01-03T13:00:02.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdbfff700 1 -- 172.21.15.133:0/3269723353 >> 172.21.15.133:0/3269723353 conn(0x7f8cdc06a620 msgr2=0x7f8cdc06aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:02.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdbfff700 1 -- 172.21.15.133:0/3269723353 shutdown_connections 2021-01-03T13:00:02.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdbfff700 1 -- 172.21.15.133:0/3269723353 wait complete. 2021-01-03T13:00:02.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdbfff700 1 Processor -- start 2021-01-03T13:00:02.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdbfff700 1 -- start start 2021-01-03T13:00:02.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cdc135850 0x7f8cdc13ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdbfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cdc13f300 0x7f8cdc0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdbfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8cdc13f780 0x7f8cdc0b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdbfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc0656e0 con 0x7f8cdc13f300 2021-01-03T13:00:02.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdbfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc06b110 con 0x7f8cdc135850 2021-01-03T13:00:02.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdbfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc13ff30 con 0x7f8cdc13f780 2021-01-03T13:00:02.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdaffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cdc135850 0x7f8cdc13ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdaffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cdc135850 0x7f8cdc13ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33694/0 (socket says 172.21.15.133:33694) 2021-01-03T13:00:02.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdaffd700 1 -- 172.21.15.133:0/3456950627 learned_addr learned my addr 172.21.15.133:0/3456950627 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:02.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.911+0000 7f8cdb7fe700 1 --2- 172.21.15.133:0/3456950627 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8cdc13f780 0x7f8cdc0b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.915+0000 7f8cdaffd700 1 -- 172.21.15.133:0/3456950627 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8cdc13f780 msgr2=0x7f8cdc0b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.915+0000 7f8cdaffd700 1 --2- 172.21.15.133:0/3456950627 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8cdc13f780 0x7f8cdc0b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:02.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.915+0000 7f8cdaffd700 1 -- 172.21.15.133:0/3456950627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cdc13f300 msgr2=0x7f8cdc0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:02.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.915+0000 7f8cdaffd700 1 --2- 172.21.15.133:0/3456950627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cdc13f300 0x7f8cdc0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T13:00:02.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.915+0000 7f8cdaffd700 1 -- 172.21.15.133:0/3456950627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc13fce0 con 0x7f8cdc135850 2021-01-03T13:00:02.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.915+0000 7f8cdaffd700 1 --2- 172.21.15.133:0/3456950627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cdc135850 0x7f8cdc13ee10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f8cdc132460 tx=0x7f8ccc013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:02.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.915+0000 7f8ccbfff700 1 -- 172.21.15.133:0/3456950627 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ccc01b070 con 0x7f8cdc135850 2021-01-03T13:00:02.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.915+0000 7f8ccbfff700 1 -- 172.21.15.133:0/3456950627 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc005a60 con 0x7f8cdc135850 2021-01-03T13:00:02.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.915+0000 7f8cdbfff700 1 -- 172.21.15.133:0/3456950627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cdc14cb90 con 0x7f8cdc135850 2021-01-03T13:00:02.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.915+0000 7f8ccbfff700 1 -- 172.21.15.133:0/3456950627 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ccc005dc0 con 0x7f8cdc135850 2021-01-03T13:00:02.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.915+0000 7f8cdbfff700 1 -- 172.21.15.133:0/3456950627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cdc13e8b0 con 0x7f8cdc135850 2021-01-03T13:00:02.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.915+0000 7f8cdbfff700 1 -- 172.21.15.133:0/3456950627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cdc13ea70 con 0x7f8cdc135850 2021-01-03T13:00:02.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.915+0000 7f8ccbfff700 1 -- 172.21.15.133:0/3456950627 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8ccc027070 con 0x7f8cdc135850 2021-01-03T13:00:02.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.915+0000 7f8ccbfff700 1 --2- 172.21.15.133:0/3456950627 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8cb80553b0 0x7f8cb8057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:02.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.915+0000 7f8ccbfff700 1 -- 172.21.15.133:0/3456950627 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8ccc06e720 con 0x7f8cdc135850 2021-01-03T13:00:02.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.915+0000 7f8cda7fc700 1 --2- 172.21.15.133:0/3456950627 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8cb80553b0 0x7f8cb8057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:02.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.919+0000 7f8cda7fc700 1 --2- 172.21.15.133:0/3456950627 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8cb80553b0 0x7f8cb8057870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f8cd000b000 tx=0x7f8cd0001e20).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:02.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:02.923+0000 7f8ccbfff700 1 -- 172.21.15.133:0/3456950627 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8ccc044a20 con 0x7f8cdc135850 2021-01-03T13:00:03.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.107+0000 7f8cdbfff700 1 -- 172.21.15.133:0/3456950627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8cdc057300 con 0x7f8cdc135850 2021-01-03T13:00:03.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.107+0000 7f8ccbfff700 1 -- 172.21.15.133:0/3456950627 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2494 (secure 0 0 0) 0x7f8ccc048040 con 0x7f8cdc135850 2021-01-03T13:00:03.107 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:00:03.107 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5169,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/126912106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":126912106},{"type":"v1","addr":"172.21.15.16:6833","nonce":126912106}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13},{"gid":5212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/1241297212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1241297212},{"type":"v1","addr":"172.21.15.133:6835","nonce":1241297212}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:00:01.768700+0000","modified":"2021-01-03T13:00:02.771604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5218":{"gid":5218,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2379309183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2379309183},{"type":"v1","addr":"172.21.15.133:6837","nonce":2379309183}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-01-03T13:00:03.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.107+0000 7f8cdbfff700 1 -- 172.21.15.133:0/3456950627 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8cb80553b0 msgr2=0x7f8cb8057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:03.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.107+0000 7f8cdbfff700 1 --2- 172.21.15.133:0/3456950627 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8cb80553b0 0x7f8cb8057870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f8cd000b000 tx=0x7f8cd0001e20).stop 2021-01-03T13:00:03.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.107+0000 7f8cdbfff700 1 -- 172.21.15.133:0/3456950627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cdc135850 msgr2=0x7f8cdc13ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:03.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.107+0000 7f8cdbfff700 1 --2- 172.21.15.133:0/3456950627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cdc135850 0x7f8cdc13ee10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f8cdc132460 tx=0x7f8ccc013000).stop 2021-01-03T13:00:03.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.107+0000 7f8cdbfff700 1 -- 172.21.15.133:0/3456950627 shutdown_connections 2021-01-03T13:00:03.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.107+0000 7f8cdbfff700 1 --2- 172.21.15.133:0/3456950627 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8cb80553b0 0x7f8cb8057870 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.107+0000 7f8cdbfff700 1 --2- 172.21.15.133:0/3456950627 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8cdc13f780 0x7f8cdc0b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.107+0000 7f8cdbfff700 1 --2- 172.21.15.133:0/3456950627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8cdc135850 0x7f8cdc13ee10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.107+0000 7f8cdbfff700 1 --2- 172.21.15.133:0/3456950627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8cdc13f300 0x7f8cdc0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T13:00:03.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.107+0000 7f8cdbfff700 1 -- 172.21.15.133:0/3456950627 >> 172.21.15.133:0/3456950627 conn(0x7f8cdc06a620 msgr2=0x7f8cdc0b6120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:03.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.111+0000 7f8cdbfff700 1 -- 172.21.15.133:0/3456950627 shutdown_connections 2021-01-03T13:00:03.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.111+0000 7f8cdbfff700 1 -- 172.21.15.133:0/3456950627 wait complete. 2021-01-03T13:00:03.111 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 16 2021-01-03T13:00:03.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2021-01-03T13:00:03.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2021-01-03T13:00:03.121 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:00:03.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1ccbb700 1 Processor -- start 2021-01-03T13:00:03.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1ccbb700 1 -- start start 2021-01-03T13:00:03.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1ccbb700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd180b5c10 0x7fdd180aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1ccbb700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdd180b0670 0x7fdd1814a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1ccbb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd1814acc0 0x7fdd18144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1ccbb700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd18098550 con 0x7fdd180b0670 2021-01-03T13:00:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1ccbb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd180b5ff0 con 0x7fdd1814acc0 2021-01-03T13:00:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1ccbb700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180b0b10 con 0x7fdd180b5c10 2021-01-03T13:00:03.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd16d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd1814acc0 0x7fdd18144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd16d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdd1814acc0 0x7fdd18144470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33706/0 (socket says 172.21.15.133:33706) 2021-01-03T13:00:03.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd16d9d700 1 -- 172.21.15.133:0/1721977552 learned_addr learned my addr 172.21.15.133:0/1721977552 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:03.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1659c700 1 --2- 172.21.15.133:0/1721977552 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd180b5c10 0x7fdd180aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd15d9b700 1 --2- 172.21.15.133:0/1721977552 >> v2:172.21.15.16:3300/0 conn(0x7fdd180b0670 0x7fdd1814a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd16d9d700 1 -- 172.21.15.133:0/1721977552 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd180b5c10 msgr2=0x7fdd180aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:03.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd16d9d700 1 --2- 172.21.15.133:0/1721977552 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd180b5c10 0x7fdd180aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd16d9d700 1 -- 172.21.15.133:0/1721977552 >> v2:172.21.15.16:3300/0 conn(0x7fdd180b0670 msgr2=0x7fdd1814a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:03.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd16d9d700 1 --2- 172.21.15.133:0/1721977552 >> v2:172.21.15.16:3300/0 conn(0x7fdd180b0670 0x7fdd1814a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd16d9d700 1 -- 172.21.15.133:0/1721977552 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd18098780 con 0x7fdd1814acc0 2021-01-03T13:00:03.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd16d9d700 1 --2- 172.21.15.133:0/1721977552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd1814acc0 0x7fdd18144470 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fdd08002f30 tx=0x7fdd08006e80).ready entity=mon.1 client_cookie=67a67343231a4cee server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:03.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1559a700 1 -- 172.21.15.133:0/1721977552 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd080097f0 con 0x7fdd1814acc0 2021-01-03T13:00:03.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1559a700 1 -- 172.21.15.133:0/1721977552 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd08009950 con 0x7fdd1814acc0 2021-01-03T13:00:03.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1559a700 1 -- 172.21.15.133:0/1721977552 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd08009cb0 con 0x7fdd1814acc0 2021-01-03T13:00:03.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1ccbb700 1 -- 172.21.15.133:0/1721977552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd1814acc0 msgr2=0x7fdd18144470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:03.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1ccbb700 1 --2- 172.21.15.133:0/1721977552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd1814acc0 0x7fdd18144470 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fdd08002f30 tx=0x7fdd08006e80).stop 2021-01-03T13:00:03.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1ccbb700 1 -- 172.21.15.133:0/1721977552 shutdown_connections 2021-01-03T13:00:03.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1ccbb700 1 --2- 172.21.15.133:0/1721977552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd1814acc0 0x7fdd18144470 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1ccbb700 1 --2- 172.21.15.133:0/1721977552 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd180b5c10 0x7fdd180aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1ccbb700 1 --2- 172.21.15.133:0/1721977552 >> v2:172.21.15.16:3300/0 conn(0x7fdd180b0670 0x7fdd1814a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1ccbb700 1 -- 172.21.15.133:0/1721977552 >> 172.21.15.133:0/1721977552 conn(0x7fdd1805c8c0 msgr2=0x7fdd180b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:03.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1ccbb700 1 -- 172.21.15.133:0/1721977552 shutdown_connections 2021-01-03T13:00:03.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.235+0000 7fdd1ccbb700 1 -- 172.21.15.133:0/1721977552 wait complete. 2021-01-03T13:00:03.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.239+0000 7fdd1ccbb700 1 Processor -- start 2021-01-03T13:00:03.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.239+0000 7fdd1ccbb700 1 -- start start 2021-01-03T13:00:03.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.239+0000 7fdd1ccbb700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd180b0670 0x7fdd180ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.239+0000 7fdd1ccbb700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd180b5c10 0x7fdd18155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.239+0000 7fdd1ccbb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd1814acc0 0x7fdd18156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.239+0000 7fdd1ccbb700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180ae840 con 0x7fdd180b0670 2021-01-03T13:00:03.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.239+0000 7fdd1ccbb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180aebc0 con 0x7fdd1814acc0 2021-01-03T13:00:03.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.239+0000 7fdd1ccbb700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180aee60 con 0x7fdd180b5c10 2021-01-03T13:00:03.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.239+0000 7fdd16d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd1814acc0 0x7fdd18156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.239+0000 7fdd16d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd1814acc0 0x7fdd18156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33712/0 (socket says 172.21.15.133:33712) 2021-01-03T13:00:03.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.239+0000 7fdd1659c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd180b0670 0x7fdd180ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.239+0000 7fdd16d9d700 1 -- 172.21.15.133:0/1556407288 learned_addr learned my addr 172.21.15.133:0/1556407288 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:03.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.239+0000 7fdd15d9b700 1 --2- 172.21.15.133:0/1556407288 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd180b5c10 0x7fdd18155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.243+0000 7fdd16d9d700 1 -- 172.21.15.133:0/1556407288 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd180b5c10 msgr2=0x7fdd18155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:03.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.243+0000 7fdd16d9d700 1 --2- 172.21.15.133:0/1556407288 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd180b5c10 0x7fdd18155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.243+0000 7fdd16d9d700 1 -- 172.21.15.133:0/1556407288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd180b0670 msgr2=0x7fdd180ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:03.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.243+0000 7fdd16d9d700 1 --2- 172.21.15.133:0/1556407288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd180b0670 0x7fdd180ad7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.243+0000 7fdd16d9d700 1 -- 172.21.15.133:0/1556407288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd180af100 con 0x7fdd1814acc0 2021-01-03T13:00:03.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.243+0000 7fdd15d9b700 1 --2- 172.21.15.133:0/1556407288 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd180b5c10 0x7fdd18155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:03.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.243+0000 7fdd16d9d700 1 --2- 172.21.15.133:0/1556407288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd1814acc0 0x7fdd18156360 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fdd08002f30 tx=0x7fdd08015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.243+0000 7fdd0f7fe700 1 -- 172.21.15.133:0/1556407288 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd08011c80 con 0x7fdd1814acc0 2021-01-03T13:00:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.243+0000 7fdd0f7fe700 1 -- 172.21.15.133:0/1556407288 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd08011de0 con 0x7fdd1814acc0 2021-01-03T13:00:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.243+0000 7fdd1ccbb700 1 -- 172.21.15.133:0/1556407288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd180af5a0 con 0x7fdd1814acc0 2021-01-03T13:00:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.243+0000 7fdd0f7fe700 1 -- 172.21.15.133:0/1556407288 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd0801e650 con 0x7fdd1814acc0 2021-01-03T13:00:03.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.243+0000 7fdd1ccbb700 1 -- 172.21.15.133:0/1556407288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd18146fe0 con 0x7fdd1814acc0 2021-01-03T13:00:03.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.243+0000 7fdd1ccbb700 1 -- 172.21.15.133:0/1556407288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd18057300 con 0x7fdd1814acc0 2021-01-03T13:00:03.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.243+0000 7fdd0f7fe700 1 -- 172.21.15.133:0/1556407288 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fdd08025030 con 0x7fdd1814acc0 2021-01-03T13:00:03.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.243+0000 7fdd0f7fe700 1 --2- 172.21.15.133:0/1556407288 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdcfc0553b0 0x7fdcfc057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.243+0000 7fdd1659c700 1 --2- 172.21.15.133:0/1556407288 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdcfc0553b0 0x7fdcfc057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.243+0000 7fdd0f7fe700 1 -- 172.21.15.133:0/1556407288 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdd0806f3c0 con 0x7fdd1814acc0 2021-01-03T13:00:03.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.247+0000 7fdd1659c700 1 --2- 172.21.15.133:0/1556407288 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdcfc0553b0 0x7fdcfc057870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fdd1000c000 tx=0x7fdd10008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:03.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.247+0000 7fdd0f7fe700 1 -- 172.21.15.133:0/1556407288 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdd080455b0 con 0x7fdd1814acc0 2021-01-03T13:00:03.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.391+0000 7fdd1ccbb700 1 -- 172.21.15.133:0/1556407288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd180af290 con 0x7fdd1814acc0 2021-01-03T13:00:03.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.391+0000 7fdd0f7fe700 1 -- 172.21.15.133:0/1556407288 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16099 (secure 0 0 0) 0x7fdd08023020 con 0x7fdd1814acc0 2021-01-03T13:00:03.391 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:00:03.392 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":44,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:00:02.772285+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:59:59.319419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-01-03T13:00:00.624032+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:00:03.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.395+0000 7fdd1ccbb700 1 -- 172.21.15.133:0/1556407288 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdcfc0553b0 msgr2=0x7fdcfc057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:03.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.395+0000 7fdd1ccbb700 1 --2- 172.21.15.133:0/1556407288 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdcfc0553b0 0x7fdcfc057870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fdd1000c000 tx=0x7fdd10008040).stop 2021-01-03T13:00:03.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.395+0000 7fdd1ccbb700 1 -- 172.21.15.133:0/1556407288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd1814acc0 msgr2=0x7fdd18156360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:03.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.395+0000 7fdd1ccbb700 1 --2- 172.21.15.133:0/1556407288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd1814acc0 0x7fdd18156360 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fdd08002f30 tx=0x7fdd08015000).stop 2021-01-03T13:00:03.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.395+0000 7fdd1ccbb700 1 -- 172.21.15.133:0/1556407288 shutdown_connections 2021-01-03T13:00:03.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.395+0000 7fdd1ccbb700 1 --2- 172.21.15.133:0/1556407288 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdcfc0553b0 0x7fdcfc057870 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.395+0000 7fdd1ccbb700 1 --2- 172.21.15.133:0/1556407288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd180b0670 0x7fdd180ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.395+0000 7fdd1ccbb700 1 --2- 172.21.15.133:0/1556407288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd1814acc0 0x7fdd18156360 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.395+0000 7fdd1ccbb700 1 --2- 172.21.15.133:0/1556407288 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdd180b5c10 0x7fdd18155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.395+0000 7fdd1ccbb700 1 -- 172.21.15.133:0/1556407288 >> 172.21.15.133:0/1556407288 conn(0x7fdd1805c8c0 msgr2=0x7fdd180b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:03.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.395+0000 7fdd1ccbb700 1 -- 172.21.15.133:0/1556407288 shutdown_connections 2021-01-03T13:00:03.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.395+0000 7fdd1ccbb700 1 -- 172.21.15.133:0/1556407288 wait complete. 2021-01-03T13:00:03.405 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:00:03.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de674d700 1 Processor -- start 2021-01-03T13:00:03.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de674d700 1 -- start start 2021-01-03T13:00:03.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de674d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9de0062450 0x7f9de0067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de674d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de00adff0 con 0x7f9de00b33b0 2021-01-03T13:00:03.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de674d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de005fb80 con 0x7f9de00adc10 2021-01-03T13:00:03.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de674d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de00b1930 con 0x7f9de0062450 2021-01-03T13:00:03.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de5f4c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9de00adc10 0x7f9de00b2ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54748/0 (socket says 172.21.15.133:54748) 2021-01-03T13:00:03.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de5f4c700 1 -- 172.21.15.133:0/2897075575 learned_addr learned my addr 172.21.15.133:0/2897075575 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:00:03.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de574b700 1 --2- 172.21.15.133:0/2897075575 >> v2:172.21.15.16:3300/0 conn(0x7f9de0062450 0x7f9de0067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de4f4a700 1 -- 172.21.15.133:0/2897075575 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1316163281 0 0) 0x7f9de005fb80 con 0x7f9de00adc10 2021-01-03T13:00:03.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de4f4a700 1 -- 172.21.15.133:0/2897075575 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dcc003230 con 0x7f9de00adc10 2021-01-03T13:00:03.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de4f4a700 1 -- 172.21.15.133:0/2897075575 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3633468820 0 0) 0x7f9dcc003230 con 0x7f9de00adc10 2021-01-03T13:00:03.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de4f4a700 1 -- 172.21.15.133:0/2897075575 >> v2:172.21.15.16:3300/0 conn(0x7f9de0062450 msgr2=0x7f9de0067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:03.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de4f4a700 1 --2- 172.21.15.133:0/2897075575 >> v2:172.21.15.16:3300/0 conn(0x7f9de0062450 0x7f9de0067cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de4f4a700 1 -- 172.21.15.133:0/2897075575 >> v1:172.21.15.16:6789/0 conn(0x7f9de00b33b0 legacy=0x7f9de014f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:03.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de4f4a700 1 -- 172.21.15.133:0/2897075575 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de00b3860 con 0x7f9de00adc10 2021-01-03T13:00:03.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de4f4a700 1 -- 172.21.15.133:0/2897075575 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f9ddc0016d0 con 0x7f9de00adc10 2021-01-03T13:00:03.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de4f4a700 1 -- 172.21.15.133:0/2897075575 >> v1:172.21.15.133:6789/0 conn(0x7f9de00adc10 legacy=0x7f9de00b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:03.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de4f4a700 1 --2- 172.21.15.133:0/2897075575 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9dcc003720 0x7f9dcc003b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de4f4a700 1 --2- 172.21.15.133:0/2897075575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9dcc0044d0 0x7f9dcc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.523+0000 7f9de4f4a700 1 --2- 172.21.15.133:0/2897075575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dcc004e40 0x7f9dcc00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de4f4a700 1 -- 172.21.15.133:0/2897075575 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00b1930 con 0x7f9dcc004e40 2021-01-03T13:00:03.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de4f4a700 1 -- 172.21.15.133:0/2897075575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc004270 con 0x7f9dcc0044d0 2021-01-03T13:00:03.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de4f4a700 1 -- 172.21.15.133:0/2897075575 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc04fc20 con 0x7f9dcc003720 2021-01-03T13:00:03.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de574b700 1 --2- 172.21.15.133:0/2897075575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9dcc0044d0 0x7f9dcc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de79af700 1 --2- 172.21.15.133:0/2897075575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dcc004e40 0x7f9dcc00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de5f4c700 1 --2- 172.21.15.133:0/2897075575 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9dcc003720 0x7f9dcc003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de574b700 1 -- 172.21.15.133:0/2897075575 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9dcc003720 msgr2=0x7f9dcc003b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:03.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de574b700 1 --2- 172.21.15.133:0/2897075575 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9dcc003720 0x7f9dcc003b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de574b700 1 -- 172.21.15.133:0/2897075575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dcc004e40 msgr2=0x7f9dcc00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:03.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de574b700 1 --2- 172.21.15.133:0/2897075575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dcc004e40 0x7f9dcc00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de79af700 1 -- 172.21.15.133:0/2897075575 reap_dead start 2021-01-03T13:00:03.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de574b700 1 -- 172.21.15.133:0/2897075575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc003230 con 0x7f9dcc0044d0 2021-01-03T13:00:03.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de574b700 1 --2- 172.21.15.133:0/2897075575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9dcc0044d0 0x7f9dcc004950 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f9dd000c000 tx=0x7f9dd0008040).ready entity=mon.1 client_cookie=2e0c6e59ac1064e7 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:03.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de4f4a700 1 -- 172.21.15.133:0/2897075575 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dd000e970 con 0x7f9dcc0044d0 2021-01-03T13:00:03.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de4f4a700 1 -- 172.21.15.133:0/2897075575 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd000ead0 con 0x7f9dcc0044d0 2021-01-03T13:00:03.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de4f4a700 1 -- 172.21.15.133:0/2897075575 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dd000ee30 con 0x7f9dcc0044d0 2021-01-03T13:00:03.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de674d700 1 -- 172.21.15.133:0/2897075575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9dcc0044d0 msgr2=0x7f9dcc004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:03.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de674d700 1 --2- 172.21.15.133:0/2897075575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9dcc0044d0 0x7f9dcc004950 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f9dd000c000 tx=0x7f9dd0008040).stop 2021-01-03T13:00:03.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de674d700 1 -- 172.21.15.133:0/2897075575 shutdown_connections 2021-01-03T13:00:03.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de674d700 1 --2- 172.21.15.133:0/2897075575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9dcc0044d0 0x7f9dcc004950 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de674d700 1 -- 172.21.15.133:0/2897075575 >> 172.21.15.133:0/2897075575 conn(0x7f9de0060d10 msgr2=0x7f9de0061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:03.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de674d700 1 -- 172.21.15.133:0/2897075575 shutdown_connections 2021-01-03T13:00:03.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de674d700 1 -- 172.21.15.133:0/2897075575 wait complete. 2021-01-03T13:00:03.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de674d700 1 Processor -- start 2021-01-03T13:00:03.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.527+0000 7f9de674d700 1 -- start start 2021-01-03T13:00:03.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de674d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9dcc0044d0 0x7f9de00af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de674d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9de00b0170 0x7f9de012d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de674d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9de012dbc0 0x7f9de00ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de674d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de0074a80 con 0x7f9de00b0170 2021-01-03T13:00:03.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de674d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de0067880 con 0x7f9dcc0044d0 2021-01-03T13:00:03.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de674d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de0143580 con 0x7f9de012dbc0 2021-01-03T13:00:03.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de5f4c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9dcc0044d0 0x7f9de00af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de5f4c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9dcc0044d0 0x7f9de00af440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33728/0 (socket says 172.21.15.133:33728) 2021-01-03T13:00:03.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de5f4c700 1 -- 172.21.15.133:0/3016964902 learned_addr learned my addr 172.21.15.133:0/3016964902 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:03.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de574b700 1 --2- 172.21.15.133:0/3016964902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9de00b0170 0x7f9de012d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de79af700 1 --2- 172.21.15.133:0/3016964902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9de012dbc0 0x7f9de00ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de5f4c700 1 -- 172.21.15.133:0/3016964902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9de012dbc0 msgr2=0x7f9de00ae380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:03.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de5f4c700 1 --2- 172.21.15.133:0/3016964902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9de012dbc0 0x7f9de00ae380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de5f4c700 1 -- 172.21.15.133:0/3016964902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9de00b0170 msgr2=0x7f9de012d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:03.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de5f4c700 1 --2- 172.21.15.133:0/3016964902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9de00b0170 0x7f9de012d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de5f4c700 1 -- 172.21.15.133:0/3016964902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de00675e0 con 0x7f9dcc0044d0 2021-01-03T13:00:03.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de574b700 1 --2- 172.21.15.133:0/3016964902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9de00b0170 0x7f9de012d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:03.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de5f4c700 1 --2- 172.21.15.133:0/3016964902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9dcc0044d0 0x7f9de00af440 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f9ddc00b000 tx=0x7f9de0152c60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:03.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9dd67fc700 1 -- 172.21.15.133:0/3016964902 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ddc00c6b0 con 0x7f9dcc0044d0 2021-01-03T13:00:03.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9dd67fc700 1 -- 172.21.15.133:0/3016964902 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ddc00c810 con 0x7f9dcc0044d0 2021-01-03T13:00:03.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de674d700 1 -- 172.21.15.133:0/3016964902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de00747e0 con 0x7f9dcc0044d0 2021-01-03T13:00:03.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9dd67fc700 1 -- 172.21.15.133:0/3016964902 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ddc00cb70 con 0x7f9dcc0044d0 2021-01-03T13:00:03.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de674d700 1 -- 172.21.15.133:0/3016964902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de0064c60 con 0x7f9dcc0044d0 2021-01-03T13:00:03.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9de674d700 1 -- 172.21.15.133:0/3016964902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de0143900 con 0x7f9dcc0044d0 2021-01-03T13:00:03.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.531+0000 7f9dd67fc700 1 -- 172.21.15.133:0/3016964902 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9ddc01a020 con 0x7f9dcc0044d0 2021-01-03T13:00:03.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.535+0000 7f9dd67fc700 1 --2- 172.21.15.133:0/3016964902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9dc8055440 0x7f9dc8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.535+0000 7f9dd67fc700 1 -- 172.21.15.133:0/3016964902 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9ddc06dbc0 con 0x7f9dcc0044d0 2021-01-03T13:00:03.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.535+0000 7f9de574b700 1 --2- 172.21.15.133:0/3016964902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9dc8055440 0x7f9dc8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.535+0000 7f9de574b700 1 --2- 172.21.15.133:0/3016964902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9dc8055440 0x7f9dc8057900 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f9dd001b000 tx=0x7f9dd0018000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:03.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.539+0000 7f9dd67fc700 1 -- 172.21.15.133:0/3016964902 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9ddc043ec0 con 0x7f9dcc0044d0 2021-01-03T13:00:03.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.727+0000 7f9de674d700 1 -- 172.21.15.133:0/3016964902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9de0143740 con 0x7f9dcc0044d0 2021-01-03T13:00:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.735+0000 7f9dd67fc700 1 -- 172.21.15.133:0/3016964902 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9de0143740 con 0x7f9dcc0044d0 2021-01-03T13:00:03.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.739+0000 7f9de674d700 1 -- 172.21.15.133:0/3016964902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9dc8055440 msgr2=0x7f9dc8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:03.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.739+0000 7f9de674d700 1 --2- 172.21.15.133:0/3016964902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9dc8055440 0x7f9dc8057900 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f9dd001b000 tx=0x7f9dd0018000).stop 2021-01-03T13:00:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.739+0000 7f9de674d700 1 -- 172.21.15.133:0/3016964902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9dcc0044d0 msgr2=0x7f9de00af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.739+0000 7f9de674d700 1 --2- 172.21.15.133:0/3016964902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9dcc0044d0 0x7f9de00af440 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f9ddc00b000 tx=0x7f9de0152c60).stop 2021-01-03T13:00:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.739+0000 7f9de674d700 1 -- 172.21.15.133:0/3016964902 shutdown_connections 2021-01-03T13:00:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.739+0000 7f9de674d700 1 --2- 172.21.15.133:0/3016964902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9dc8055440 0x7f9dc8057900 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.739+0000 7f9de674d700 1 --2- 172.21.15.133:0/3016964902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9de012dbc0 0x7f9de00ae380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.739+0000 7f9de674d700 1 --2- 172.21.15.133:0/3016964902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9dcc0044d0 0x7f9de00af440 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.739+0000 7f9de674d700 1 --2- 172.21.15.133:0/3016964902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9de00b0170 0x7f9de012d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.739+0000 7f9de674d700 1 -- 172.21.15.133:0/3016964902 >> 172.21.15.133:0/3016964902 conn(0x7f9de0060d10 msgr2=0x7f9de0025140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:03.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.739+0000 7f9de674d700 1 -- 172.21.15.133:0/3016964902 shutdown_connections 2021-01-03T13:00:03.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.739+0000 7f9de674d700 1 -- 172.21.15.133:0/3016964902 wait complete. 2021-01-03T13:00:03.741 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2021-01-03T13:00:03.755 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:00:03.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e3359700 1 Processor -- start 2021-01-03T13:00:03.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e3359700 1 -- start start 2021-01-03T13:00:03.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e3359700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49dc0adc10 0x7f49dc067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e3359700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f49dc062450 0x7f49dc0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e3359700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f49dc0b3190 0x7f49dc025140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e3359700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49dc0b1930 con 0x7f49dc062450 2021-01-03T13:00:03.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e3359700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49dc0adff0 con 0x7f49dc0b3190 2021-01-03T13:00:03.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e3359700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc05fb80 con 0x7f49dc0adc10 2021-01-03T13:00:03.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e45bb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f49dc0b3190 0x7f49dc025140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e45bb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f49dc0b3190 0x7f49dc025140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33740/0 (socket says 172.21.15.133:33740) 2021-01-03T13:00:03.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e45bb700 1 -- 172.21.15.133:0/2349338219 learned_addr learned my addr 172.21.15.133:0/2349338219 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:03.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e2357700 1 --2- 172.21.15.133:0/2349338219 >> v2:172.21.15.16:3300/0 conn(0x7f49dc062450 0x7f49dc0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e2b58700 1 --2- 172.21.15.133:0/2349338219 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49dc0adc10 0x7f49dc067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e45bb700 1 -- 172.21.15.133:0/2349338219 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49dc0adc10 msgr2=0x7f49dc067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:03.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e45bb700 1 --2- 172.21.15.133:0/2349338219 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49dc0adc10 0x7f49dc067cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e45bb700 1 -- 172.21.15.133:0/2349338219 >> v2:172.21.15.16:3300/0 conn(0x7f49dc062450 msgr2=0x7f49dc0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:03.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e45bb700 1 --2- 172.21.15.133:0/2349338219 >> v2:172.21.15.16:3300/0 conn(0x7f49dc062450 0x7f49dc0b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e45bb700 1 -- 172.21.15.133:0/2349338219 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc05fed0 con 0x7f49dc0b3190 2021-01-03T13:00:03.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e45bb700 1 --2- 172.21.15.133:0/2349338219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49dc0b3190 0x7f49dc025140 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f49d40032b0 tx=0x7f49d4009270).ready entity=mon.1 client_cookie=28e14f8e9cd797ec server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:03.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e1b56700 1 -- 172.21.15.133:0/2349338219 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49d4009e60 con 0x7f49dc0b3190 2021-01-03T13:00:03.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e1b56700 1 -- 172.21.15.133:0/2349338219 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d400bc00 con 0x7f49dc0b3190 2021-01-03T13:00:03.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e1b56700 1 -- 172.21.15.133:0/2349338219 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49d400bd70 con 0x7f49dc0b3190 2021-01-03T13:00:03.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e3359700 1 -- 172.21.15.133:0/2349338219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49dc0b3190 msgr2=0x7f49dc025140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:03.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.883+0000 7f49e3359700 1 --2- 172.21.15.133:0/2349338219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49dc0b3190 0x7f49dc025140 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f49d40032b0 tx=0x7f49d4009270).stop 2021-01-03T13:00:03.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.887+0000 7f49e3359700 1 -- 172.21.15.133:0/2349338219 shutdown_connections 2021-01-03T13:00:03.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.887+0000 7f49e3359700 1 --2- 172.21.15.133:0/2349338219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49dc0b3190 0x7f49dc025140 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.887+0000 7f49e3359700 1 --2- 172.21.15.133:0/2349338219 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49dc0adc10 0x7f49dc067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.887+0000 7f49e3359700 1 --2- 172.21.15.133:0/2349338219 >> v2:172.21.15.16:3300/0 conn(0x7f49dc062450 0x7f49dc0b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.887+0000 7f49e3359700 1 -- 172.21.15.133:0/2349338219 >> 172.21.15.133:0/2349338219 conn(0x7f49dc060d10 msgr2=0x7f49dc061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:03.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.887+0000 7f49e3359700 1 -- 172.21.15.133:0/2349338219 shutdown_connections 2021-01-03T13:00:03.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.887+0000 7f49e3359700 1 -- 172.21.15.133:0/2349338219 wait complete. 2021-01-03T13:00:03.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.887+0000 7f49e3359700 1 Processor -- start 2021-01-03T13:00:03.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.887+0000 7f49e3359700 1 -- start start 2021-01-03T13:00:03.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.887+0000 7f49e3359700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49dc062450 0x7f49dc144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.887+0000 7f49e3359700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49dc0adc10 0x7f49dc0b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.887+0000 7f49e3359700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49dc0b3190 0x7f49dc0b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.887+0000 7f49e3359700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc132190 con 0x7f49dc0b3190 2021-01-03T13:00:03.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.887+0000 7f49e3359700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc143f30 con 0x7f49dc0adc10 2021-01-03T13:00:03.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.887+0000 7f49e3359700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc131ef0 con 0x7f49dc062450 2021-01-03T13:00:03.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49e2357700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49dc0adc10 0x7f49dc0b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49e2357700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49dc0adc10 0x7f49dc0b4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33744/0 (socket says 172.21.15.133:33744) 2021-01-03T13:00:03.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49e2357700 1 -- 172.21.15.133:0/2906379856 learned_addr learned my addr 172.21.15.133:0/2906379856 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:03.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49e45bb700 1 --2- 172.21.15.133:0/2906379856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49dc0b3190 0x7f49dc0b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49e2b58700 1 --2- 172.21.15.133:0/2906379856 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49dc062450 0x7f49dc144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49e2357700 1 -- 172.21.15.133:0/2906379856 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49dc062450 msgr2=0x7f49dc144630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:03.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49e2357700 1 --2- 172.21.15.133:0/2906379856 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49dc062450 0x7f49dc144630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49e2357700 1 -- 172.21.15.133:0/2906379856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49dc0b3190 msgr2=0x7f49dc0b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:03.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49e2357700 1 --2- 172.21.15.133:0/2906379856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49dc0b3190 0x7f49dc0b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:03.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49e2357700 1 -- 172.21.15.133:0/2906379856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc144190 con 0x7f49dc0adc10 2021-01-03T13:00:03.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49e2357700 1 --2- 172.21.15.133:0/2906379856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49dc0adc10 0x7f49dc0b4440 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f49cc00c000 tx=0x7f49cc006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:03.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49d37fe700 1 -- 172.21.15.133:0/2906379856 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49cc00ca10 con 0x7f49dc0adc10 2021-01-03T13:00:03.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49d37fe700 1 -- 172.21.15.133:0/2906379856 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49cc00cb70 con 0x7f49dc0adc10 2021-01-03T13:00:03.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49d37fe700 1 -- 172.21.15.133:0/2906379856 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49cc00ee80 con 0x7f49dc0adc10 2021-01-03T13:00:03.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49e3359700 1 -- 172.21.15.133:0/2906379856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49dc144b20 con 0x7f49dc0adc10 2021-01-03T13:00:03.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49e3359700 1 -- 172.21.15.133:0/2906379856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49dc1327a0 con 0x7f49dc0adc10 2021-01-03T13:00:03.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49e3359700 1 -- 172.21.15.133:0/2906379856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49dc144320 con 0x7f49dc0adc10 2021-01-03T13:00:03.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.891+0000 7f49d37fe700 1 -- 172.21.15.133:0/2906379856 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f49cc01c460 con 0x7f49dc0adc10 2021-01-03T13:00:03.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.895+0000 7f49d37fe700 1 --2- 172.21.15.133:0/2906379856 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f49c4055440 0x7f49c4057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:03.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.895+0000 7f49d37fe700 1 -- 172.21.15.133:0/2906379856 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f49cc06e340 con 0x7f49dc0adc10 2021-01-03T13:00:03.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.895+0000 7f49e2b58700 1 --2- 172.21.15.133:0/2906379856 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f49c4055440 0x7f49c4057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:03.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.895+0000 7f49e2b58700 1 --2- 172.21.15.133:0/2906379856 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f49c4055440 0x7f49c4057900 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f49d800c000 tx=0x7f49d8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:03.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:03.899+0000 7f49d37fe700 1 -- 172.21.15.133:0/2906379856 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f49cc0445e0 con 0x7f49dc0adc10 2021-01-03T13:00:04.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.091+0000 7f49e3359700 1 -- 172.21.15.133:0/2906379856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f49dc057300 con 0x7f49dc0adc10 2021-01-03T13:00:04.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.099+0000 7f49d37fe700 1 -- 172.21.15.133:0/2906379856 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7f49cc047c00 con 0x7f49dc0adc10 2021-01-03T13:00:04.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.099+0000 7f49e3359700 1 -- 172.21.15.133:0/2906379856 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f49c4055440 msgr2=0x7f49c4057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:04.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.099+0000 7f49e3359700 1 --2- 172.21.15.133:0/2906379856 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f49c4055440 0x7f49c4057900 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f49d800c000 tx=0x7f49d8008040).stop 2021-01-03T13:00:04.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.099+0000 7f49e3359700 1 -- 172.21.15.133:0/2906379856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49dc0adc10 msgr2=0x7f49dc0b4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:04.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.099+0000 7f49e3359700 1 --2- 172.21.15.133:0/2906379856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49dc0adc10 0x7f49dc0b4440 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f49cc00c000 tx=0x7f49cc006dc0).stop 2021-01-03T13:00:04.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.099+0000 7f49e3359700 1 -- 172.21.15.133:0/2906379856 shutdown_connections 2021-01-03T13:00:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.099+0000 7f49e3359700 1 --2- 172.21.15.133:0/2906379856 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f49c4055440 0x7f49c4057900 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.099+0000 7f49e3359700 1 --2- 172.21.15.133:0/2906379856 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49dc0b3190 0x7f49dc0b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.099+0000 7f49e3359700 1 --2- 172.21.15.133:0/2906379856 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49dc062450 0x7f49dc144630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.099+0000 7f49e3359700 1 --2- 172.21.15.133:0/2906379856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49dc0adc10 0x7f49dc0b4440 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.099+0000 7f49e3359700 1 -- 172.21.15.133:0/2906379856 >> 172.21.15.133:0/2906379856 conn(0x7f49dc060d10 msgr2=0x7f49dc0b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.103+0000 7f49e3359700 1 -- 172.21.15.133:0/2906379856 shutdown_connections 2021-01-03T13:00:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.103+0000 7f49e3359700 1 -- 172.21.15.133:0/2906379856 wait complete. 2021-01-03T13:00:04.103 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.1 2021-01-03T13:00:04.113 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:00:04.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.219+0000 7fc48b236700 1 Processor -- start 2021-01-03T13:00:04.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.219+0000 7fc48b236700 1 -- start start 2021-01-03T13:00:04.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.219+0000 7fc48b236700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4840b6d50 0x7fc4840af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:04.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.219+0000 7fc48b236700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc4840afba0 0x7fc48405fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:04.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.219+0000 7fc48b236700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4840b7130 con 0x7fc4840b16d0 2021-01-03T13:00:04.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.219+0000 7fc48b236700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4840b0690 con 0x7fc4840afba0 2021-01-03T13:00:04.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.219+0000 7fc48b236700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4840b0dc0 con 0x7fc4840b6d50 2021-01-03T13:00:04.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.219+0000 7fc488fd2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4840b6d50 0x7fc4840af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:04.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.219+0000 7fc488fd2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4840b6d50 0x7fc4840af6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33750/0 (socket says 172.21.15.133:33750) 2021-01-03T13:00:04.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.219+0000 7fc488fd2700 1 -- 172.21.15.133:0/76755471 learned_addr learned my addr 172.21.15.133:0/76755471 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:04.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.219+0000 7fc4897d3700 1 --2- 172.21.15.133:0/76755471 >> v2:172.21.15.16:3300/0 conn(0x7fc4840afba0 0x7fc48405fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:04.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.219+0000 7fc488fd2700 1 -- 172.21.15.133:0/76755471 >> v2:172.21.15.16:3300/0 conn(0x7fc4840afba0 msgr2=0x7fc48405fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:04.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.219+0000 7fc488fd2700 1 --2- 172.21.15.133:0/76755471 >> v2:172.21.15.16:3300/0 conn(0x7fc4840afba0 0x7fc48405fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:04.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.219+0000 7fc488fd2700 1 -- 172.21.15.133:0/76755471 >> v1:172.21.15.16:6789/0 conn(0x7fc4840b16d0 legacy=0x7fc48405f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:04.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.219+0000 7fc488fd2700 1 -- 172.21.15.133:0/76755471 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4840b1060 con 0x7fc4840b6d50 2021-01-03T13:00:04.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.219+0000 7fc4897d3700 1 --2- 172.21.15.133:0/76755471 >> v2:172.21.15.16:3300/0 conn(0x7fc4840afba0 0x7fc48405fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:00:04.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.219+0000 7fc488fd2700 1 --2- 172.21.15.133:0/76755471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b6d50 0x7fc4840af6b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fc48405f080 tx=0x7fc478006e80).ready entity=mon.1 client_cookie=510b9ceddeaa8087 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:04.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.223+0000 7fc4837fe700 1 -- 172.21.15.133:0/76755471 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4780097b0 con 0x7fc4840b6d50 2021-01-03T13:00:04.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.223+0000 7fc4837fe700 1 -- 172.21.15.133:0/76755471 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc478009910 con 0x7fc4840b6d50 2021-01-03T13:00:04.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.223+0000 7fc4837fe700 1 -- 172.21.15.133:0/76755471 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc478009a80 con 0x7fc4840b6d50 2021-01-03T13:00:04.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.223+0000 7fc48b236700 1 -- 172.21.15.133:0/76755471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b6d50 msgr2=0x7fc4840af6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:04.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.223+0000 7fc48b236700 1 --2- 172.21.15.133:0/76755471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b6d50 0x7fc4840af6b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fc48405f080 tx=0x7fc478006e80).stop 2021-01-03T13:00:04.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.223+0000 7fc48b236700 1 -- 172.21.15.133:0/76755471 shutdown_connections 2021-01-03T13:00:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.223+0000 7fc48b236700 1 --2- 172.21.15.133:0/76755471 >> v2:172.21.15.16:3300/0 conn(0x7fc4840afba0 0x7fc48405fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.223+0000 7fc48b236700 1 --2- 172.21.15.133:0/76755471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b6d50 0x7fc4840af6b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.223+0000 7fc48b236700 1 -- 172.21.15.133:0/76755471 >> 172.21.15.133:0/76755471 conn(0x7fc4840622f0 msgr2=0x7fc4840b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.223+0000 7fc48b236700 1 -- 172.21.15.133:0/76755471 shutdown_connections 2021-01-03T13:00:04.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.223+0000 7fc48b236700 1 -- 172.21.15.133:0/76755471 wait complete. 2021-01-03T13:00:04.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.223+0000 7fc48b236700 1 Processor -- start 2021-01-03T13:00:04.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.223+0000 7fc48b236700 1 -- start start 2021-01-03T13:00:04.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc48b236700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840afba0 0x7fc48413ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:04.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc48b236700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b16d0 0x7fc4841363e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:04.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc48b236700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4840b6d50 0x7fc4841516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:04.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc48b236700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc484146630 con 0x7fc4840b6d50 2021-01-03T13:00:04.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc48b236700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc484132a20 con 0x7fc4840b16d0 2021-01-03T13:00:04.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc48b236700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc484132cc0 con 0x7fc4840afba0 2021-01-03T13:00:04.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc483fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b16d0 0x7fc4841363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:04.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc483fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b16d0 0x7fc4841363e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33760/0 (socket says 172.21.15.133:33760) 2021-01-03T13:00:04.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc488fd2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840afba0 0x7fc48413ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:04.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc4897d3700 1 --2- 172.21.15.133:0/1898323760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4840b6d50 0x7fc4841516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:04.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc483fff700 1 -- 172.21.15.133:0/1898323760 learned_addr learned my addr 172.21.15.133:0/1898323760 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:04.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc483fff700 1 -- 172.21.15.133:0/1898323760 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840afba0 msgr2=0x7fc48413ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc483fff700 1 --2- 172.21.15.133:0/1898323760 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840afba0 0x7fc48413ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc483fff700 1 -- 172.21.15.133:0/1898323760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4840b6d50 msgr2=0x7fc4841516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc483fff700 1 --2- 172.21.15.133:0/1898323760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4840b6d50 0x7fc4841516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:04.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc483fff700 1 -- 172.21.15.133:0/1898323760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48413b750 con 0x7fc4840b16d0 2021-01-03T13:00:04.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc483fff700 1 --2- 172.21.15.133:0/1898323760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b16d0 0x7fc4841363e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fc470001f60 tx=0x7fc470007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:04.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc481ffb700 1 -- 172.21.15.133:0/1898323760 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc47000e4a0 con 0x7fc4840b16d0 2021-01-03T13:00:04.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc481ffb700 1 -- 172.21.15.133:0/1898323760 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47000e600 con 0x7fc4840b16d0 2021-01-03T13:00:04.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc48b236700 1 -- 172.21.15.133:0/1898323760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc484137a20 con 0x7fc4840b16d0 2021-01-03T13:00:04.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc481ffb700 1 -- 172.21.15.133:0/1898323760 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc47000e960 con 0x7fc4840b16d0 2021-01-03T13:00:04.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc48b236700 1 -- 172.21.15.133:0/1898323760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc484151bd0 con 0x7fc4840b16d0 2021-01-03T13:00:04.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.227+0000 7fc48b236700 1 -- 172.21.15.133:0/1898323760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48413b8e0 con 0x7fc4840b16d0 2021-01-03T13:00:04.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.231+0000 7fc481ffb700 1 -- 172.21.15.133:0/1898323760 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc470010030 con 0x7fc4840b16d0 2021-01-03T13:00:04.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.231+0000 7fc481ffb700 1 --2- 172.21.15.133:0/1898323760 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc46c055440 0x7fc46c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:04.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.231+0000 7fc481ffb700 1 -- 172.21.15.133:0/1898323760 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc47006de40 con 0x7fc4840b16d0 2021-01-03T13:00:04.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.231+0000 7fc488fd2700 1 --2- 172.21.15.133:0/1898323760 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc46c055440 0x7fc46c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:04.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.231+0000 7fc488fd2700 1 --2- 172.21.15.133:0/1898323760 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc46c055440 0x7fc46c057900 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fc47801b000 tx=0x7fc478016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:04.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.239+0000 7fc481ffb700 1 -- 172.21.15.133:0/1898323760 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc470044030 con 0x7fc4840b16d0 2021-01-03T13:00:04.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.427+0000 7fc48b236700 1 -- 172.21.15.133:0/1898323760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc484132e80 con 0x7fc4840b16d0 2021-01-03T13:00:04.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.427+0000 7fc481ffb700 1 -- 172.21.15.133:0/1898323760 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2494 (secure 0 0 0) 0x7fc470047650 con 0x7fc4840b16d0 2021-01-03T13:00:04.426 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:00:04.426 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5169,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/126912106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":126912106},{"type":"v1","addr":"172.21.15.16:6833","nonce":126912106}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13},{"gid":5212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/1241297212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1241297212},{"type":"v1","addr":"172.21.15.133:6835","nonce":1241297212}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:00:01.768700+0000","modified":"2021-01-03T13:00:02.771604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5218":{"gid":5218,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2379309183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2379309183},{"type":"v1","addr":"172.21.15.133:6837","nonce":2379309183}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-01-03T13:00:04.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.427+0000 7fc48b236700 1 -- 172.21.15.133:0/1898323760 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc46c055440 msgr2=0x7fc46c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:04.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.427+0000 7fc48b236700 1 --2- 172.21.15.133:0/1898323760 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc46c055440 0x7fc46c057900 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fc47801b000 tx=0x7fc478016000).stop 2021-01-03T13:00:04.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.427+0000 7fc48b236700 1 -- 172.21.15.133:0/1898323760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b16d0 msgr2=0x7fc4841363e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:04.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.427+0000 7fc48b236700 1 --2- 172.21.15.133:0/1898323760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b16d0 0x7fc4841363e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fc470001f60 tx=0x7fc470007c00).stop 2021-01-03T13:00:04.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.427+0000 7fc48b236700 1 -- 172.21.15.133:0/1898323760 shutdown_connections 2021-01-03T13:00:04.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.427+0000 7fc48b236700 1 --2- 172.21.15.133:0/1898323760 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc46c055440 0x7fc46c057900 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:04.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.427+0000 7fc48b236700 1 --2- 172.21.15.133:0/1898323760 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4840b6d50 0x7fc4841516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:04.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.427+0000 7fc48b236700 1 --2- 172.21.15.133:0/1898323760 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4840afba0 0x7fc48413ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:04.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.427+0000 7fc48b236700 1 --2- 172.21.15.133:0/1898323760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840b16d0 0x7fc4841363e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:04.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.427+0000 7fc48b236700 1 -- 172.21.15.133:0/1898323760 >> 172.21.15.133:0/1898323760 conn(0x7fc4840622f0 msgr2=0x7fc4840b62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:04.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.427+0000 7fc48b236700 1 -- 172.21.15.133:0/1898323760 shutdown_connections 2021-01-03T13:00:04.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.427+0000 7fc48b236700 1 -- 172.21.15.133:0/1898323760 wait complete. 2021-01-03T13:00:04.431 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 16 2021-01-03T13:00:04.742 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:00:01.768700+0000', 'modified': '2021-01-03T13:00:02.771604+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5218}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5218': {'gid': 5218, 'name': 'a', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/2379309183', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 2379309183}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 2379309183}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:00:04.742 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:00:04.743 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-01-03T13:00:04.871 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":5218,"want_state":"up:active","state":"up:active","rank_uptime":3.090941221,"mdsmap_epoch":16,"osdmap_epoch":45,"osdmap_epoch_barrier":43,"uptime":8.4444640979999992} 2021-01-03T13:00:04.871 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 5218, "mdsmap_epoch": 16, "osdmap_epoch": 45, "osdmap_epoch_barrier": 43, "rank_uptime": 3.090941221, "state": "up:active", "uptime": 8.444464098, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:00:04.872 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:00:04.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.987+0000 7fbd0664f700 1 Processor -- start 2021-01-03T13:00:04.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.987+0000 7fbd0664f700 1 -- start start 2021-01-03T13:00:04.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.987+0000 7fbd0664f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbd0005ff30 0x7fbd000b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:04.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.987+0000 7fbd0664f700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd0014a570 con 0x7fbd000b5750 2021-01-03T13:00:04.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.987+0000 7fbd0664f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd000604b0 con 0x7fbd000b9b60 2021-01-03T13:00:04.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.987+0000 7fbd0664f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0014a7a0 con 0x7fbd0005ff30 2021-01-03T13:00:04.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.987+0000 7fbd0564d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbd000b9b60 0x7fbd0014aee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54798/0 (socket says 172.21.15.133:54798) 2021-01-03T13:00:04.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbd0564d700 1 -- 172.21.15.133:0/1812506659 learned_addr learned my addr 172.21.15.133:0/1812506659 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:00:04.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbd05e4e700 1 --2- 172.21.15.133:0/1812506659 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbd0005ff30 0x7fbd000b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:04.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbcf7fff700 1 -- 172.21.15.133:0/1812506659 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187388700 0 0) 0x7fbd000604b0 con 0x7fbd000b9b60 2021-01-03T13:00:04.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbcf7fff700 1 -- 172.21.15.133:0/1812506659 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbce4003230 con 0x7fbd000b9b60 2021-01-03T13:00:04.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbcf7fff700 1 -- 172.21.15.133:0/1812506659 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078883973 0 0) 0x7fbd0014a570 con 0x7fbd000b5750 2021-01-03T13:00:04.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbcf7fff700 1 -- 172.21.15.133:0/1812506659 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd000604b0 con 0x7fbd000b5750 2021-01-03T13:00:04.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbd05e4e700 1 -- 172.21.15.133:0/1812506659 >> v1:172.21.15.133:6789/0 conn(0x7fbd000b9b60 legacy=0x7fbd0014aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:04.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbd05e4e700 1 -- 172.21.15.133:0/1812506659 >> v1:172.21.15.16:6789/0 conn(0x7fbd000b5750 legacy=0x7fbd00147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:04.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbd05e4e700 1 -- 172.21.15.133:0/1812506659 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0014aa40 con 0x7fbd0005ff30 2021-01-03T13:00:04.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbd05e4e700 1 --2- 172.21.15.133:0/1812506659 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbd0005ff30 0x7fbd000b9f40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fbcf80032b0 tx=0x7fbcf80091a0).ready entity=mon.2 client_cookie=5c4eda2d8871beef server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:04.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbcf7fff700 1 -- 172.21.15.133:0/1812506659 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcf800b940 con 0x7fbd0005ff30 2021-01-03T13:00:04.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbcf7fff700 1 -- 172.21.15.133:0/1812506659 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf800baa0 con 0x7fbd0005ff30 2021-01-03T13:00:04.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbcf7fff700 1 -- 172.21.15.133:0/1812506659 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcf800bc10 con 0x7fbd0005ff30 2021-01-03T13:00:04.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbd0664f700 1 -- 172.21.15.133:0/1812506659 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbd0005ff30 msgr2=0x7fbd000b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:04.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbd0664f700 1 --2- 172.21.15.133:0/1812506659 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbd0005ff30 0x7fbd000b9f40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fbcf80032b0 tx=0x7fbcf80091a0).stop 2021-01-03T13:00:04.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbd0664f700 1 -- 172.21.15.133:0/1812506659 shutdown_connections 2021-01-03T13:00:04.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbd0664f700 1 --2- 172.21.15.133:0/1812506659 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbd0005ff30 0x7fbd000b9f40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:04.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbd0664f700 1 -- 172.21.15.133:0/1812506659 >> 172.21.15.133:0/1812506659 conn(0x7fbd000b69e0 msgr2=0x7fbd000b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:04.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbd0664f700 1 -- 172.21.15.133:0/1812506659 shutdown_connections 2021-01-03T13:00:04.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.991+0000 7fbd0664f700 1 -- 172.21.15.133:0/1812506659 wait complete. 2021-01-03T13:00:04.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0664f700 1 Processor -- start 2021-01-03T13:00:04.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0664f700 1 -- start start 2021-01-03T13:00:04.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0664f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd0005ff30 0x7fbd000b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:04.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0664f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd000b5750 0x7fbd000b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:04.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0664f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbd000b9b60 0x7fbd00099240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:04.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0664f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0009a430 con 0x7fbd000b5750 2021-01-03T13:00:04.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0664f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd00098ae0 con 0x7fbd0005ff30 2021-01-03T13:00:04.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0664f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0009a190 con 0x7fbd000b9b60 2021-01-03T13:00:04.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0564d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd0005ff30 0x7fbd000b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:04.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0564d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd0005ff30 0x7fbd000b0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33770/0 (socket says 172.21.15.133:33770) 2021-01-03T13:00:04.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0564d700 1 -- 172.21.15.133:0/1166357602 learned_addr learned my addr 172.21.15.133:0/1166357602 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:05.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd04e4c700 1 --2- 172.21.15.133:0/1166357602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd000b5750 0x7fbd000b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd05e4e700 1 --2- 172.21.15.133:0/1166357602 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbd000b9b60 0x7fbd00099240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0564d700 1 -- 172.21.15.133:0/1166357602 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbd000b9b60 msgr2=0x7fbd00099240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0564d700 1 --2- 172.21.15.133:0/1166357602 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbd000b9b60 0x7fbd00099240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0564d700 1 -- 172.21.15.133:0/1166357602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd000b5750 msgr2=0x7fbd000b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0564d700 1 --2- 172.21.15.133:0/1166357602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd000b5750 0x7fbd000b0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0564d700 1 -- 172.21.15.133:0/1166357602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd00098eb0 con 0x7fbd0005ff30 2021-01-03T13:00:05.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0564d700 1 --2- 172.21.15.133:0/1166357602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd0005ff30 0x7fbd000b0860 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fbcfc001110 tx=0x7fbcfc007a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:05.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbcf67fc700 1 -- 172.21.15.133:0/1166357602 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcfc0072e0 con 0x7fbd0005ff30 2021-01-03T13:00:05.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbcf67fc700 1 -- 172.21.15.133:0/1166357602 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcfc007440 con 0x7fbd0005ff30 2021-01-03T13:00:05.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0664f700 1 -- 172.21.15.133:0/1166357602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0009e050 con 0x7fbd0005ff30 2021-01-03T13:00:05.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbcf67fc700 1 -- 172.21.15.133:0/1166357602 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcfc0057d0 con 0x7fbd0005ff30 2021-01-03T13:00:05.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.995+0000 7fbd0664f700 1 -- 172.21.15.133:0/1166357602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd000998d0 con 0x7fbd0005ff30 2021-01-03T13:00:05.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.999+0000 7fbd0664f700 1 -- 172.21.15.133:0/1166357602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd00057300 con 0x7fbd0005ff30 2021-01-03T13:00:05.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.999+0000 7fbcf67fc700 1 -- 172.21.15.133:0/1166357602 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fbcfc010070 con 0x7fbd0005ff30 2021-01-03T13:00:05.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.999+0000 7fbcf67fc700 1 --2- 172.21.15.133:0/1166357602 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbce80554e0 0x7fbce80579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.999+0000 7fbcf67fc700 1 -- 172.21.15.133:0/1166357602 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbcfc06d5b0 con 0x7fbd0005ff30 2021-01-03T13:00:05.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.999+0000 7fbd04e4c700 1 --2- 172.21.15.133:0/1166357602 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbce80554e0 0x7fbce80579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:04.999+0000 7fbd04e4c700 1 --2- 172.21.15.133:0/1166357602 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbce80554e0 0x7fbce80579a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fbcf000d000 tx=0x7fbcf00079d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:05.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.007+0000 7fbcf67fc700 1 -- 172.21.15.133:0/1166357602 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbcfc043810 con 0x7fbd0005ff30 2021-01-03T13:00:05.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.147+0000 7fbd0664f700 1 -- 172.21.15.133:0/1166357602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd00098c20 con 0x7fbd0005ff30 2021-01-03T13:00:05.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.151+0000 7fbcf67fc700 1 -- 172.21.15.133:0/1166357602 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16086 (secure 0 0 0) 0x7fbcfc046e30 con 0x7fbd0005ff30 2021-01-03T13:00:05.149 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:00:05.149 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":45,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:00:03.782001+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:59:59.319419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-01-03T13:00:00.624032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:00:05.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.151+0000 7fbd0664f700 1 -- 172.21.15.133:0/1166357602 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbce80554e0 msgr2=0x7fbce80579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.151+0000 7fbd0664f700 1 --2- 172.21.15.133:0/1166357602 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbce80554e0 0x7fbce80579a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fbcf000d000 tx=0x7fbcf00079d0).stop 2021-01-03T13:00:05.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.151+0000 7fbd0664f700 1 -- 172.21.15.133:0/1166357602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd0005ff30 msgr2=0x7fbd000b0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.151+0000 7fbd0664f700 1 --2- 172.21.15.133:0/1166357602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd0005ff30 0x7fbd000b0860 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fbcfc001110 tx=0x7fbcfc007a90).stop 2021-01-03T13:00:05.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.151+0000 7fbd0664f700 1 -- 172.21.15.133:0/1166357602 shutdown_connections 2021-01-03T13:00:05.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.151+0000 7fbd0664f700 1 --2- 172.21.15.133:0/1166357602 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbce80554e0 0x7fbce80579a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.151+0000 7fbd0664f700 1 --2- 172.21.15.133:0/1166357602 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbd000b9b60 0x7fbd00099240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.151+0000 7fbd0664f700 1 --2- 172.21.15.133:0/1166357602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd0005ff30 0x7fbd000b0860 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.151+0000 7fbd0664f700 1 --2- 172.21.15.133:0/1166357602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbd000b5750 0x7fbd000b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.151+0000 7fbd0664f700 1 -- 172.21.15.133:0/1166357602 >> 172.21.15.133:0/1166357602 conn(0x7fbd000b69e0 msgr2=0x7fbd001497b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.151+0000 7fbd0664f700 1 -- 172.21.15.133:0/1166357602 shutdown_connections 2021-01-03T13:00:05.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.151+0000 7fbd0664f700 1 -- 172.21.15.133:0/1166357602 wait complete. 2021-01-03T13:00:05.163 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T12:59:59.319419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:00:00.624032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:00:05.164 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:00:05.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.275+0000 7f5f51b17700 1 Processor -- start 2021-01-03T13:00:05.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.275+0000 7f5f51b17700 1 -- start start 2021-01-03T13:00:05.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f51b17700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4c061f30 0x7f5f4c062310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f51b17700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5f4c0b20f0 0x7f5f4c0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f51b17700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4c1431d0 con 0x7f5f4c139770 2021-01-03T13:00:05.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f51b17700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4c0aedb0 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f51b17700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c0b1c70 con 0x7f5f4c061f30 2021-01-03T13:00:05.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f4affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5f4c0b20f0 0x7f5f4c0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f4affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5f4c0b20f0 0x7f5f4c0b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33778/0 (socket says 172.21.15.133:33778) 2021-01-03T13:00:05.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f4affd700 1 -- 172.21.15.133:0/3770030761 learned_addr learned my addr 172.21.15.133:0/3770030761 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:05.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f4b7fe700 1 --2- 172.21.15.133:0/3770030761 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4c061f30 0x7f5f4c062310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f4affd700 1 -- 172.21.15.133:0/3770030761 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4c061f30 msgr2=0x7f5f4c062310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:05.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f4affd700 1 --2- 172.21.15.133:0/3770030761 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4c061f30 0x7f5f4c062310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f4affd700 1 -- 172.21.15.133:0/3770030761 >> v1:172.21.15.16:6789/0 conn(0x7f5f4c139770 legacy=0x7f5f4c143630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f4affd700 1 -- 172.21.15.133:0/3770030761 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c0b2bb0 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f4b7fe700 1 --2- 172.21.15.133:0/3770030761 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4c061f30 0x7f5f4c062310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:00:05.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f4affd700 1 --2- 172.21.15.133:0/3770030761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4c0b20f0 0x7f5f4c0b12d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f5f38002f30 tx=0x7f5f38006e80).ready entity=mon.1 client_cookie=c9150c8f65866ebb server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:05.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f4a7fc700 1 -- 172.21.15.133:0/3770030761 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f380097f0 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f4a7fc700 1 -- 172.21.15.133:0/3770030761 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f38009950 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f4a7fc700 1 -- 172.21.15.133:0/3770030761 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f38009cb0 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f51b17700 1 -- 172.21.15.133:0/3770030761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4c0b20f0 msgr2=0x7f5f4c0b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f51b17700 1 --2- 172.21.15.133:0/3770030761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4c0b20f0 0x7f5f4c0b12d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f5f38002f30 tx=0x7f5f38006e80).stop 2021-01-03T13:00:05.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f51b17700 1 -- 172.21.15.133:0/3770030761 shutdown_connections 2021-01-03T13:00:05.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f51b17700 1 --2- 172.21.15.133:0/3770030761 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4c061f30 0x7f5f4c062310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f51b17700 1 --2- 172.21.15.133:0/3770030761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4c0b20f0 0x7f5f4c0b12d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f51b17700 1 -- 172.21.15.133:0/3770030761 >> 172.21.15.133:0/3770030761 conn(0x7f5f4c0b6db0 msgr2=0x7f5f4c061820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:05.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f51b17700 1 -- 172.21.15.133:0/3770030761 shutdown_connections 2021-01-03T13:00:05.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.279+0000 7f5f51b17700 1 -- 172.21.15.133:0/3770030761 wait complete. 2021-01-03T13:00:05.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.283+0000 7f5f51b17700 1 Processor -- start 2021-01-03T13:00:05.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.283+0000 7f5f51b17700 1 -- start start 2021-01-03T13:00:05.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.283+0000 7f5f51b17700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4c061f30 0x7f5f4c05c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.283+0000 7f5f51b17700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4c0b20f0 0x7f5f4c150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.283+0000 7f5f51b17700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4c139770 0x7f5f4c145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.283+0000 7f5f51b17700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c064330 con 0x7f5f4c061f30 2021-01-03T13:00:05.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.283+0000 7f5f51b17700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c064df0 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.283+0000 7f5f51b17700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c05c990 con 0x7f5f4c139770 2021-01-03T13:00:05.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.283+0000 7f5f4affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4c0b20f0 0x7f5f4c150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.283+0000 7f5f4affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4c0b20f0 0x7f5f4c150540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33786/0 (socket says 172.21.15.133:33786) 2021-01-03T13:00:05.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.283+0000 7f5f4affd700 1 -- 172.21.15.133:0/3352982309 learned_addr learned my addr 172.21.15.133:0/3352982309 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:05.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.283+0000 7f5f4b7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4c061f30 0x7f5f4c05c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f4bfff700 1 --2- 172.21.15.133:0/3352982309 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4c139770 0x7f5f4c145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f4affd700 1 -- 172.21.15.133:0/3352982309 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4c139770 msgr2=0x7f5f4c145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f4affd700 1 --2- 172.21.15.133:0/3352982309 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4c139770 0x7f5f4c145760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f4affd700 1 -- 172.21.15.133:0/3352982309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4c061f30 msgr2=0x7f5f4c05c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f4affd700 1 --2- 172.21.15.133:0/3352982309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4c061f30 0x7f5f4c05c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f4affd700 1 -- 172.21.15.133:0/3352982309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c065020 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f4bfff700 1 --2- 172.21.15.133:0/3352982309 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4c139770 0x7f5f4c145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:05.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f4affd700 1 --2- 172.21.15.133:0/3352982309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4c0b20f0 0x7f5f4c150540 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f5f38002f30 tx=0x7f5f38015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:05.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f48ff9700 1 -- 172.21.15.133:0/3352982309 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f3801e460 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f48ff9700 1 -- 172.21.15.133:0/3352982309 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3801e5c0 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f48ff9700 1 -- 172.21.15.133:0/3352982309 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f3801e920 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f51b17700 1 -- 172.21.15.133:0/3352982309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4c0652c0 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f51b17700 1 -- 172.21.15.133:0/3352982309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4c13ab10 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f51b17700 1 -- 172.21.15.133:0/3352982309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f4c057300 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f48ff9700 1 -- 172.21.15.133:0/3352982309 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5f38025030 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f48ff9700 1 --2- 172.21.15.133:0/3352982309 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f28055440 0x7f5f28057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f48ff9700 1 -- 172.21.15.133:0/3352982309 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5f3806f4c0 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.287+0000 7f5f4b7fe700 1 --2- 172.21.15.133:0/3352982309 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f28055440 0x7f5f28057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.291+0000 7f5f4b7fe700 1 --2- 172.21.15.133:0/3352982309 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f28055440 0x7f5f28057900 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f5f3c00d000 tx=0x7f5f3c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:05.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.295+0000 7f5f48ff9700 1 -- 172.21.15.133:0/3352982309 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5f380457c0 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.435+0000 7f5f51b17700 1 -- 172.21.15.133:0/3352982309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5f4c142f10 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.435+0000 7f5f48ff9700 1 -- 172.21.15.133:0/3352982309 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v45) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5f38023020 con 0x7f5f4c0b20f0 2021-01-03T13:00:05.435 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:00:05.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.439+0000 7f5f51b17700 1 -- 172.21.15.133:0/3352982309 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f28055440 msgr2=0x7f5f28057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.439+0000 7f5f51b17700 1 --2- 172.21.15.133:0/3352982309 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f28055440 0x7f5f28057900 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f5f3c00d000 tx=0x7f5f3c008040).stop 2021-01-03T13:00:05.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.439+0000 7f5f51b17700 1 -- 172.21.15.133:0/3352982309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4c0b20f0 msgr2=0x7f5f4c150540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.439+0000 7f5f51b17700 1 --2- 172.21.15.133:0/3352982309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4c0b20f0 0x7f5f4c150540 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f5f38002f30 tx=0x7f5f38015000).stop 2021-01-03T13:00:05.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.439+0000 7f5f51b17700 1 -- 172.21.15.133:0/3352982309 shutdown_connections 2021-01-03T13:00:05.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.439+0000 7f5f51b17700 1 --2- 172.21.15.133:0/3352982309 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f28055440 0x7f5f28057900 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.439+0000 7f5f51b17700 1 --2- 172.21.15.133:0/3352982309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4c061f30 0x7f5f4c05c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.439+0000 7f5f51b17700 1 --2- 172.21.15.133:0/3352982309 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4c139770 0x7f5f4c145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.439+0000 7f5f51b17700 1 --2- 172.21.15.133:0/3352982309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4c0b20f0 0x7f5f4c150540 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.439+0000 7f5f51b17700 1 -- 172.21.15.133:0/3352982309 >> 172.21.15.133:0/3352982309 conn(0x7f5f4c0b6db0 msgr2=0x7f5f4c061820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:05.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.439+0000 7f5f51b17700 1 -- 172.21.15.133:0/3352982309 shutdown_connections 2021-01-03T13:00:05.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.439+0000 7f5f51b17700 1 -- 172.21.15.133:0/3352982309 wait complete. 2021-01-03T13:00:05.454 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:00:05.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d8c5f700 1 Processor -- start 2021-01-03T13:00:05.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d8c5f700 1 -- start start 2021-01-03T13:00:05.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d8c5f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83d40b5920 0x7f83d41469f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d8c5f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f83d405f080 0x7f83d4146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d8c5f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d40acb10 con 0x7f83d40afff0 2021-01-03T13:00:05.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d8c5f700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d41473d0 con 0x7f83d405f080 2021-01-03T13:00:05.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d8c5f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d40b5d00 con 0x7f83d40b5920 2021-01-03T13:00:05.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83d40b5920 0x7f83d41469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d2d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f83d40afff0 0x7f83d40b1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54826/0 (socket says 172.21.15.133:54826) 2021-01-03T13:00:05.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d2d9d700 1 -- 172.21.15.133:0/581627796 learned_addr learned my addr 172.21.15.133:0/581627796 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:00:05.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d1d9b700 1 --2- 172.21.15.133:0/581627796 >> v2:172.21.15.16:3300/0 conn(0x7f83d405f080 0x7f83d4146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d259c700 1 -- 172.21.15.133:0/581627796 >> v2:172.21.15.16:3300/0 conn(0x7f83d405f080 msgr2=0x7f83d4146ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:05.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d259c700 1 --2- 172.21.15.133:0/581627796 >> v2:172.21.15.16:3300/0 conn(0x7f83d405f080 0x7f83d4146ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d259c700 1 -- 172.21.15.133:0/581627796 >> v1:172.21.15.133:6789/0 conn(0x7f83d40afff0 legacy=0x7f83d40b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d259c700 1 -- 172.21.15.133:0/581627796 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d40aef80 con 0x7f83d40b5920 2021-01-03T13:00:05.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d259c700 1 --2- 172.21.15.133:0/581627796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d40b5920 0x7f83d41469f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f83c4002f30 tx=0x7f83c4006dc0).ready entity=mon.1 client_cookie=fda27ce476e4ddda server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:05.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d159a700 1 -- 172.21.15.133:0/581627796 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83c40097f0 con 0x7f83d40b5920 2021-01-03T13:00:05.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d159a700 1 -- 172.21.15.133:0/581627796 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c4009950 con 0x7f83d40b5920 2021-01-03T13:00:05.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d159a700 1 -- 172.21.15.133:0/581627796 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83c4009cb0 con 0x7f83d40b5920 2021-01-03T13:00:05.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d8c5f700 1 -- 172.21.15.133:0/581627796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d40b5920 msgr2=0x7f83d41469f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.571+0000 7f83d8c5f700 1 --2- 172.21.15.133:0/581627796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d40b5920 0x7f83d41469f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f83c4002f30 tx=0x7f83c4006dc0).stop 2021-01-03T13:00:05.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d8c5f700 1 -- 172.21.15.133:0/581627796 shutdown_connections 2021-01-03T13:00:05.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d8c5f700 1 --2- 172.21.15.133:0/581627796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d40b5920 0x7f83d41469f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d8c5f700 1 --2- 172.21.15.133:0/581627796 >> v2:172.21.15.16:3300/0 conn(0x7f83d405f080 0x7f83d4146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d8c5f700 1 -- 172.21.15.133:0/581627796 >> 172.21.15.133:0/581627796 conn(0x7f83d4060330 msgr2=0x7f83d4060710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:05.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d8c5f700 1 -- 172.21.15.133:0/581627796 shutdown_connections 2021-01-03T13:00:05.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d8c5f700 1 -- 172.21.15.133:0/581627796 wait complete. 2021-01-03T13:00:05.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d8c5f700 1 Processor -- start 2021-01-03T13:00:05.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d8c5f700 1 -- start start 2021-01-03T13:00:05.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d8c5f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83d405f080 0x7f83d40a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d8c5f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d40afff0 0x7f83d409eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d8c5f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f83d40b5920 0x7f83d4155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d8c5f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d40a0420 con 0x7f83d405f080 2021-01-03T13:00:05.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d8c5f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d40a1df0 con 0x7f83d40afff0 2021-01-03T13:00:05.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d8c5f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d40ac770 con 0x7f83d40b5920 2021-01-03T13:00:05.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d40afff0 0x7f83d409eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d40afff0 0x7f83d409eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33800/0 (socket says 172.21.15.133:33800) 2021-01-03T13:00:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d1d9b700 1 -- 172.21.15.133:0/1322189683 learned_addr learned my addr 172.21.15.133:0/1322189683 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.575+0000 7f83d259c700 1 --2- 172.21.15.133:0/1322189683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83d405f080 0x7f83d40a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83d2d9d700 1 --2- 172.21.15.133:0/1322189683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f83d40b5920 0x7f83d4155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83d1d9b700 1 -- 172.21.15.133:0/1322189683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f83d40b5920 msgr2=0x7f83d4155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83d1d9b700 1 --2- 172.21.15.133:0/1322189683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f83d40b5920 0x7f83d4155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83d1d9b700 1 -- 172.21.15.133:0/1322189683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83d405f080 msgr2=0x7f83d40a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83d1d9b700 1 --2- 172.21.15.133:0/1322189683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83d405f080 0x7f83d40a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83d1d9b700 1 -- 172.21.15.133:0/1322189683 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d40a2050 con 0x7f83d40afff0 2021-01-03T13:00:05.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83d259c700 1 --2- 172.21.15.133:0/1322189683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83d405f080 0x7f83d40a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:05.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83d1d9b700 1 --2- 172.21.15.133:0/1322189683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d40afff0 0x7f83d409eaf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f83d40ac900 tx=0x7f83c8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:05.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83c37fe700 1 -- 172.21.15.133:0/1322189683 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83c80127e0 con 0x7f83d40afff0 2021-01-03T13:00:05.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83c37fe700 1 -- 172.21.15.133:0/1322189683 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c8012940 con 0x7f83d40afff0 2021-01-03T13:00:05.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83d8c5f700 1 -- 172.21.15.133:0/1322189683 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d40a22f0 con 0x7f83d40afff0 2021-01-03T13:00:05.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83c37fe700 1 -- 172.21.15.133:0/1322189683 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83c8012ca0 con 0x7f83d40afff0 2021-01-03T13:00:05.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83d8c5f700 1 -- 172.21.15.133:0/1322189683 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d40ac430 con 0x7f83d40afff0 2021-01-03T13:00:05.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83d8c5f700 1 -- 172.21.15.133:0/1322189683 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d40a2480 con 0x7f83d40afff0 2021-01-03T13:00:05.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83c37fe700 1 -- 172.21.15.133:0/1322189683 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f83c8013480 con 0x7f83d40afff0 2021-01-03T13:00:05.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83c37fe700 1 --2- 172.21.15.133:0/1322189683 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f83b00553f0 0x7f83b00578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83c37fe700 1 -- 172.21.15.133:0/1322189683 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f83c806e5e0 con 0x7f83d40afff0 2021-01-03T13:00:05.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.579+0000 7f83d259c700 1 --2- 172.21.15.133:0/1322189683 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f83b00553f0 0x7f83b00578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.583+0000 7f83d259c700 1 --2- 172.21.15.133:0/1322189683 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f83b00553f0 0x7f83b00578b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f83c4019000 tx=0x7f83c4015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:05.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.587+0000 7f83c37fe700 1 -- 172.21.15.133:0/1322189683 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f83c8044880 con 0x7f83d40afff0 2021-01-03T13:00:05.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.727+0000 7f83d8c5f700 1 -- 172.21.15.133:0/1322189683 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f83d4057300 con 0x7f83d40afff0 2021-01-03T13:00:05.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.727+0000 7f83c37fe700 1 -- 172.21.15.133:0/1322189683 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v45) v1 ==== 92+0+10 (secure 0 0 0) 0x7f83c8047ea0 con 0x7f83d40afff0 2021-01-03T13:00:05.726 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:00:05.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.727+0000 7f83d8c5f700 1 -- 172.21.15.133:0/1322189683 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f83b00553f0 msgr2=0x7f83b00578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.727+0000 7f83d8c5f700 1 --2- 172.21.15.133:0/1322189683 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f83b00553f0 0x7f83b00578b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f83c4019000 tx=0x7f83c4015000).stop 2021-01-03T13:00:05.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.727+0000 7f83d8c5f700 1 -- 172.21.15.133:0/1322189683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d40afff0 msgr2=0x7f83d409eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.727+0000 7f83d8c5f700 1 --2- 172.21.15.133:0/1322189683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d40afff0 0x7f83d409eaf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f83d40ac900 tx=0x7f83c8008040).stop 2021-01-03T13:00:05.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.727+0000 7f83d8c5f700 1 -- 172.21.15.133:0/1322189683 shutdown_connections 2021-01-03T13:00:05.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.727+0000 7f83d8c5f700 1 --2- 172.21.15.133:0/1322189683 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f83b00553f0 0x7f83b00578b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.727+0000 7f83d8c5f700 1 --2- 172.21.15.133:0/1322189683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83d405f080 0x7f83d40a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.727+0000 7f83d8c5f700 1 --2- 172.21.15.133:0/1322189683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f83d40b5920 0x7f83d4155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.727+0000 7f83d8c5f700 1 --2- 172.21.15.133:0/1322189683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83d40afff0 0x7f83d409eaf0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.727+0000 7f83d8c5f700 1 -- 172.21.15.133:0/1322189683 >> 172.21.15.133:0/1322189683 conn(0x7f83d4060330 msgr2=0x7f83d41467c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:05.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.727+0000 7f83d8c5f700 1 -- 172.21.15.133:0/1322189683 shutdown_connections 2021-01-03T13:00:05.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.727+0000 7f83d8c5f700 1 -- 172.21.15.133:0/1322189683 wait complete. 2021-01-03T13:00:05.739 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:00:05.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.851+0000 7f2960b6a700 1 Processor -- start 2021-01-03T13:00:05.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.851+0000 7f2960b6a700 1 -- start start 2021-01-03T13:00:05.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.851+0000 7f2960b6a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f295c0b9b60 0x7f295c0b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f2960b6a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f295c0b4de0 0x7f295c146b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f2960b6a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f295c147030 con 0x7f295c0b4980 2021-01-03T13:00:05.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f2960b6a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295c0aed30 con 0x7f295c0b4de0 2021-01-03T13:00:05.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f2960b6a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295c0605f0 con 0x7f295c0b9b60 2021-01-03T13:00:05.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f295bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f295c0b4de0 0x7f295c146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f295bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f295c0b4de0 0x7f295c146b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33810/0 (socket says 172.21.15.133:33810) 2021-01-03T13:00:05.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f295bfff700 1 -- 172.21.15.133:0/3379652319 learned_addr learned my addr 172.21.15.133:0/3379652319 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:05.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f295b7fe700 1 --2- 172.21.15.133:0/3379652319 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f295c0b9b60 0x7f295c0b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f295bfff700 1 -- 172.21.15.133:0/3379652319 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f295c0b9b60 msgr2=0x7f295c0b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:05.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f295bfff700 1 --2- 172.21.15.133:0/3379652319 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f295c0b9b60 0x7f295c0b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f295bfff700 1 -- 172.21.15.133:0/3379652319 >> v1:172.21.15.16:6789/0 conn(0x7f295c0b4980 legacy=0x7f295c146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f295bfff700 1 -- 172.21.15.133:0/3379652319 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c0600b0 con 0x7f295c0b4de0 2021-01-03T13:00:05.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f295bfff700 1 --2- 172.21.15.133:0/3379652319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f295c0b4de0 0x7f295c146b40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f29540032b0 tx=0x7f2954009270).ready entity=mon.1 client_cookie=9a9f7e07cf9af076 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:05.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f295a7fc700 1 -- 172.21.15.133:0/3379652319 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2954009e60 con 0x7f295c0b4de0 2021-01-03T13:00:05.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f295a7fc700 1 -- 172.21.15.133:0/3379652319 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295400bc00 con 0x7f295c0b4de0 2021-01-03T13:00:05.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f295a7fc700 1 -- 172.21.15.133:0/3379652319 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f295400bd70 con 0x7f295c0b4de0 2021-01-03T13:00:05.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f2960b6a700 1 -- 172.21.15.133:0/3379652319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f295c0b4de0 msgr2=0x7f295c146b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f2960b6a700 1 --2- 172.21.15.133:0/3379652319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f295c0b4de0 0x7f295c146b40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f29540032b0 tx=0x7f2954009270).stop 2021-01-03T13:00:05.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f2960b6a700 1 -- 172.21.15.133:0/3379652319 shutdown_connections 2021-01-03T13:00:05.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f2960b6a700 1 --2- 172.21.15.133:0/3379652319 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f295c0b9b60 0x7f295c0b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f2960b6a700 1 --2- 172.21.15.133:0/3379652319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f295c0b4de0 0x7f295c146b40 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f2960b6a700 1 -- 172.21.15.133:0/3379652319 >> 172.21.15.133:0/3379652319 conn(0x7f295c0b69e0 msgr2=0x7f295c0b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:05.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f2960b6a700 1 -- 172.21.15.133:0/3379652319 shutdown_connections 2021-01-03T13:00:05.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f2960b6a700 1 -- 172.21.15.133:0/3379652319 wait complete. 2021-01-03T13:00:05.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f2960b6a700 1 Processor -- start 2021-01-03T13:00:05.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.855+0000 7f2960b6a700 1 -- start start 2021-01-03T13:00:05.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f2960b6a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f295c0b4980 0x7f295c0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f2960b6a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f295c0b4de0 0x7f295c148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f2960b6a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f295c0b9b60 0x7f295c1491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f2960b6a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295c1496d0 con 0x7f295c0b9b60 2021-01-03T13:00:05.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f2960b6a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295c1525f0 con 0x7f295c0b4980 2021-01-03T13:00:05.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f2960b6a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295c152850 con 0x7f295c0b4de0 2021-01-03T13:00:05.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f295b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f295c0b4980 0x7f295c0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f295b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f295c0b4980 0x7f295c0b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33812/0 (socket says 172.21.15.133:33812) 2021-01-03T13:00:05.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f295b7fe700 1 -- 172.21.15.133:0/452384275 learned_addr learned my addr 172.21.15.133:0/452384275 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:05.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f295bfff700 1 --2- 172.21.15.133:0/452384275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f295c0b9b60 0x7f295c1491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f295affd700 1 --2- 172.21.15.133:0/452384275 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f295c0b4de0 0x7f295c148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f295b7fe700 1 -- 172.21.15.133:0/452384275 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f295c0b4de0 msgr2=0x7f295c148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f295b7fe700 1 --2- 172.21.15.133:0/452384275 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f295c0b4de0 0x7f295c148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f295b7fe700 1 -- 172.21.15.133:0/452384275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f295c0b9b60 msgr2=0x7f295c1491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:05.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f295b7fe700 1 --2- 172.21.15.133:0/452384275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f295c0b9b60 0x7f295c1491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:05.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f295b7fe700 1 -- 172.21.15.133:0/452384275 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c152af0 con 0x7f295c0b4980 2021-01-03T13:00:05.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f295bfff700 1 --2- 172.21.15.133:0/452384275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f295c0b9b60 0x7f295c1491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:05.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f295b7fe700 1 --2- 172.21.15.133:0/452384275 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f295c0b4980 0x7f295c0b1660 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f295c0b1270 tx=0x7f2950006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:05.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f2958ff9700 1 -- 172.21.15.133:0/452384275 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f295000ca10 con 0x7f295c0b4980 2021-01-03T13:00:05.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f2960b6a700 1 -- 172.21.15.133:0/452384275 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295c1478e0 con 0x7f295c0b4980 2021-01-03T13:00:05.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f2958ff9700 1 -- 172.21.15.133:0/452384275 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295000cb70 con 0x7f295c0b4980 2021-01-03T13:00:05.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f2958ff9700 1 -- 172.21.15.133:0/452384275 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29500123f0 con 0x7f295c0b4980 2021-01-03T13:00:05.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f2960b6a700 1 -- 172.21.15.133:0/452384275 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295c147d80 con 0x7f295c0b4980 2021-01-03T13:00:05.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f2960b6a700 1 -- 172.21.15.133:0/452384275 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f295c057300 con 0x7f295c0b4980 2021-01-03T13:00:05.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f2958ff9700 1 -- 172.21.15.133:0/452384275 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2950012550 con 0x7f295c0b4980 2021-01-03T13:00:05.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.859+0000 7f2958ff9700 1 --2- 172.21.15.133:0/452384275 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f293c055330 0x7f293c0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:05.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.863+0000 7f2958ff9700 1 -- 172.21.15.133:0/452384275 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f295006e490 con 0x7f295c0b4980 2021-01-03T13:00:05.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.863+0000 7f295affd700 1 --2- 172.21.15.133:0/452384275 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f293c055330 0x7f293c0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:05.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.863+0000 7f295affd700 1 --2- 172.21.15.133:0/452384275 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f293c055330 0x7f293c0577f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f294c00b000 tx=0x7f294c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:05.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:05.867+0000 7f2958ff9700 1 -- 172.21.15.133:0/452384275 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2950044690 con 0x7f295c0b4980 2021-01-03T13:00:06.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.015+0000 7f2960b6a700 1 -- 172.21.15.133:0/452384275 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f295c067a00 con 0x7f295c0b4980 2021-01-03T13:00:06.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.015+0000 7f2958ff9700 1 -- 172.21.15.133:0/452384275 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v45) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2950047cb0 con 0x7f295c0b4980 2021-01-03T13:00:06.014 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:00:06.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.015+0000 7f2960b6a700 1 -- 172.21.15.133:0/452384275 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f293c055330 msgr2=0x7f293c0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:06.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.015+0000 7f2960b6a700 1 --2- 172.21.15.133:0/452384275 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f293c055330 0x7f293c0577f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f294c00b000 tx=0x7f294c009040).stop 2021-01-03T13:00:06.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.015+0000 7f2960b6a700 1 -- 172.21.15.133:0/452384275 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f295c0b4980 msgr2=0x7f295c0b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:06.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.015+0000 7f2960b6a700 1 --2- 172.21.15.133:0/452384275 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f295c0b4980 0x7f295c0b1660 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f295c0b1270 tx=0x7f2950006dc0).stop 2021-01-03T13:00:06.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.015+0000 7f2960b6a700 1 -- 172.21.15.133:0/452384275 shutdown_connections 2021-01-03T13:00:06.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.015+0000 7f2960b6a700 1 --2- 172.21.15.133:0/452384275 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f293c055330 0x7f293c0577f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.015+0000 7f2960b6a700 1 --2- 172.21.15.133:0/452384275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f295c0b9b60 0x7f295c1491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.015+0000 7f2960b6a700 1 --2- 172.21.15.133:0/452384275 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f295c0b4980 0x7f295c0b1660 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.015+0000 7f2960b6a700 1 --2- 172.21.15.133:0/452384275 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f295c0b4de0 0x7f295c148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.015+0000 7f2960b6a700 1 -- 172.21.15.133:0/452384275 >> 172.21.15.133:0/452384275 conn(0x7f295c0b69e0 msgr2=0x7f295c145110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:06.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.015+0000 7f2960b6a700 1 -- 172.21.15.133:0/452384275 shutdown_connections 2021-01-03T13:00:06.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.015+0000 7f2960b6a700 1 -- 172.21.15.133:0/452384275 wait complete. 2021-01-03T13:00:06.028 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:00:06.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82ad419700 1 Processor -- start 2021-01-03T13:00:06.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82ad419700 1 -- start start 2021-01-03T13:00:06.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82ad419700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82a80b5ae0 0x7f82a8141630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:06.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82ad419700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f82a8144930 0x7f82a80af310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:06.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82ad419700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a80b5710 con 0x7f82a80b5330 2021-01-03T13:00:06.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82ad419700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a80b16b0 con 0x7f82a8144930 2021-01-03T13:00:06.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82ad419700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a8140a60 con 0x7f82a80b5ae0 2021-01-03T13:00:06.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82a77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82a80b5ae0 0x7f82a8141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:06.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82a77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82a80b5ae0 0x7f82a8141630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33822/0 (socket says 172.21.15.133:33822) 2021-01-03T13:00:06.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82a77fe700 1 -- 172.21.15.133:0/3798593749 learned_addr learned my addr 172.21.15.133:0/3798593749 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:06.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82acc18700 1 --2- 172.21.15.133:0/3798593749 >> v2:172.21.15.16:3300/0 conn(0x7f82a8144930 0x7f82a80af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:06.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82a77fe700 1 -- 172.21.15.133:0/3798593749 >> v2:172.21.15.16:3300/0 conn(0x7f82a8144930 msgr2=0x7f82a80af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:06.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82a77fe700 1 --2- 172.21.15.133:0/3798593749 >> v2:172.21.15.16:3300/0 conn(0x7f82a8144930 0x7f82a80af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82a77fe700 1 -- 172.21.15.133:0/3798593749 >> v1:172.21.15.16:6789/0 conn(0x7f82a80b5330 legacy=0x7f82a80aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:06.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82a77fe700 1 -- 172.21.15.133:0/3798593749 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a8140c50 con 0x7f82a80b5ae0 2021-01-03T13:00:06.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82acc18700 1 --2- 172.21.15.133:0/3798593749 >> v2:172.21.15.16:3300/0 conn(0x7f82a8144930 0x7f82a80af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:06.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82a77fe700 1 --2- 172.21.15.133:0/3798593749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a80b5ae0 0x7f82a8141630 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f8290002f30 tx=0x7f8290006e80).ready entity=mon.1 client_cookie=ff01be299ad44dda server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:06.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82a6ffd700 1 -- 172.21.15.133:0/3798593749 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82900097f0 con 0x7f82a80b5ae0 2021-01-03T13:00:06.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82a6ffd700 1 -- 172.21.15.133:0/3798593749 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8290009950 con 0x7f82a80b5ae0 2021-01-03T13:00:06.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82a6ffd700 1 -- 172.21.15.133:0/3798593749 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8290009cb0 con 0x7f82a80b5ae0 2021-01-03T13:00:06.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82ad419700 1 -- 172.21.15.133:0/3798593749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a80b5ae0 msgr2=0x7f82a8141630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:06.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.143+0000 7f82ad419700 1 --2- 172.21.15.133:0/3798593749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a80b5ae0 0x7f82a8141630 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f8290002f30 tx=0x7f8290006e80).stop 2021-01-03T13:00:06.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.147+0000 7f82ad419700 1 -- 172.21.15.133:0/3798593749 shutdown_connections 2021-01-03T13:00:06.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.147+0000 7f82ad419700 1 --2- 172.21.15.133:0/3798593749 >> v2:172.21.15.16:3300/0 conn(0x7f82a8144930 0x7f82a80af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.147+0000 7f82ad419700 1 --2- 172.21.15.133:0/3798593749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a80b5ae0 0x7f82a8141630 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.147+0000 7f82ad419700 1 -- 172.21.15.133:0/3798593749 >> 172.21.15.133:0/3798593749 conn(0x7f82a805bdf0 msgr2=0x7f82a805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:06.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.147+0000 7f82ad419700 1 -- 172.21.15.133:0/3798593749 shutdown_connections 2021-01-03T13:00:06.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.147+0000 7f82ad419700 1 -- 172.21.15.133:0/3798593749 wait complete. 2021-01-03T13:00:06.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.147+0000 7f82ad419700 1 Processor -- start 2021-01-03T13:00:06.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.147+0000 7f82ad419700 1 -- start start 2021-01-03T13:00:06.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.147+0000 7f82ad419700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a80b5330 0x7f82a81529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:06.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.147+0000 7f82ad419700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82a80b5ae0 0x7f82a813b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:06.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.147+0000 7f82ad419700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82a8144930 0x7f82a8066b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:06.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.147+0000 7f82ad419700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a8152e90 con 0x7f82a8144930 2021-01-03T13:00:06.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.147+0000 7f82ad419700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a80643f0 con 0x7f82a80b5330 2021-01-03T13:00:06.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.147+0000 7f82ad419700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a8064690 con 0x7f82a80b5ae0 2021-01-03T13:00:06.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.147+0000 7f82a7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a80b5330 0x7f82a81529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:06.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.147+0000 7f82a7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a80b5330 0x7f82a81529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33826/0 (socket says 172.21.15.133:33826) 2021-01-03T13:00:06.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.147+0000 7f82a7fff700 1 -- 172.21.15.133:0/3209953076 learned_addr learned my addr 172.21.15.133:0/3209953076 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:06.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82a77fe700 1 --2- 172.21.15.133:0/3209953076 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82a80b5ae0 0x7f82a813b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:06.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82acc18700 1 --2- 172.21.15.133:0/3209953076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82a8144930 0x7f82a8066b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:06.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82a7fff700 1 -- 172.21.15.133:0/3209953076 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82a80b5ae0 msgr2=0x7f82a813b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:06.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82a7fff700 1 --2- 172.21.15.133:0/3209953076 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82a80b5ae0 0x7f82a813b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82a7fff700 1 -- 172.21.15.133:0/3209953076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82a8144930 msgr2=0x7f82a8066b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:06.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82a7fff700 1 --2- 172.21.15.133:0/3209953076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82a8144930 0x7f82a8066b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82a7fff700 1 -- 172.21.15.133:0/3209953076 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a8064930 con 0x7f82a80b5330 2021-01-03T13:00:06.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82acc18700 1 --2- 172.21.15.133:0/3209953076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82a8144930 0x7f82a8066b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:06.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82a7fff700 1 --2- 172.21.15.133:0/3209953076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a80b5330 0x7f82a81529a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f82a8141510 tx=0x7f8298001460).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:06.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82a57fa700 1 -- 172.21.15.133:0/3209953076 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f829800a7b0 con 0x7f82a80b5330 2021-01-03T13:00:06.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82ad419700 1 -- 172.21.15.133:0/3209953076 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a80aa190 con 0x7f82a80b5330 2021-01-03T13:00:06.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82ad419700 1 -- 172.21.15.133:0/3209953076 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a813b760 con 0x7f82a80b5330 2021-01-03T13:00:06.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82a57fa700 1 -- 172.21.15.133:0/3209953076 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829800a910 con 0x7f82a80b5330 2021-01-03T13:00:06.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82a57fa700 1 -- 172.21.15.133:0/3209953076 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f829800ac70 con 0x7f82a80b5330 2021-01-03T13:00:06.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82ad419700 1 -- 172.21.15.133:0/3209953076 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a80641b0 con 0x7f82a80b5330 2021-01-03T13:00:06.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82a57fa700 1 -- 172.21.15.133:0/3209953076 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8298019030 con 0x7f82a80b5330 2021-01-03T13:00:06.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82a57fa700 1 --2- 172.21.15.133:0/3209953076 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f828c055500 0x7f828c0579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:06.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82a57fa700 1 -- 172.21.15.133:0/3209953076 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f829806d8e0 con 0x7f82a80b5330 2021-01-03T13:00:06.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.151+0000 7f82a77fe700 1 --2- 172.21.15.133:0/3209953076 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f828c055500 0x7f828c0579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:06.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.155+0000 7f82a77fe700 1 --2- 172.21.15.133:0/3209953076 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f828c055500 0x7f828c0579c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f829001c000 tx=0x7f8290015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:06.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.159+0000 7f82a57fa700 1 -- 172.21.15.133:0/3209953076 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f82a80641b0 con 0x7f82a80b5330 2021-01-03T13:00:06.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.295+0000 7f82ad419700 1 -- 172.21.15.133:0/3209953076 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f82a80687f0 con 0x7f82a80b5330 2021-01-03T13:00:06.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.295+0000 7f82a57fa700 1 -- 172.21.15.133:0/3209953076 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) v1 ==== 100+0+10 (secure 0 0 0) 0x7f82a80687f0 con 0x7f82a80b5330 2021-01-03T13:00:06.296 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:00:06.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.299+0000 7f82ad419700 1 -- 172.21.15.133:0/3209953076 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f828c055500 msgr2=0x7f828c0579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:06.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.299+0000 7f82ad419700 1 --2- 172.21.15.133:0/3209953076 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f828c055500 0x7f828c0579c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f829001c000 tx=0x7f8290015000).stop 2021-01-03T13:00:06.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.299+0000 7f82ad419700 1 -- 172.21.15.133:0/3209953076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a80b5330 msgr2=0x7f82a81529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:06.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.299+0000 7f82ad419700 1 --2- 172.21.15.133:0/3209953076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a80b5330 0x7f82a81529a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f82a8141510 tx=0x7f8298001460).stop 2021-01-03T13:00:06.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.299+0000 7f82ad419700 1 -- 172.21.15.133:0/3209953076 shutdown_connections 2021-01-03T13:00:06.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.299+0000 7f82ad419700 1 --2- 172.21.15.133:0/3209953076 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f828c055500 0x7f828c0579c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.299+0000 7f82ad419700 1 --2- 172.21.15.133:0/3209953076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82a8144930 0x7f82a8066b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.299+0000 7f82ad419700 1 --2- 172.21.15.133:0/3209953076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a80b5330 0x7f82a81529a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.299+0000 7f82ad419700 1 --2- 172.21.15.133:0/3209953076 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82a80b5ae0 0x7f82a813b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.299+0000 7f82ad419700 1 -- 172.21.15.133:0/3209953076 >> 172.21.15.133:0/3209953076 conn(0x7f82a805bdf0 msgr2=0x7f82a80b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:06.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.299+0000 7f82ad419700 1 -- 172.21.15.133:0/3209953076 shutdown_connections 2021-01-03T13:00:06.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.299+0000 7f82ad419700 1 -- 172.21.15.133:0/3209953076 wait complete. 2021-01-03T13:00:06.310 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:00:06.310 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:00:06.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.415+0000 7f73168a0700 1 Processor -- start 2021-01-03T13:00:06.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.415+0000 7f73168a0700 1 -- start start 2021-01-03T13:00:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f73168a0700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f73100b5c00 0x7f73100b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:06.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f73168a0700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7310060da0 con 0x7f73100b0c90 2021-01-03T13:00:06.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f73168a0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73100b0ad0 con 0x7f73100b52c0 2021-01-03T13:00:06.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f73168a0700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7310067a90 con 0x7f73100b5c00 2021-01-03T13:00:06.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731589e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f73100b52c0 0x7f7310098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54866/0 (socket says 172.21.15.133:54866) 2021-01-03T13:00:06.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731589e700 1 -- 172.21.15.133:0/3200897012 learned_addr learned my addr 172.21.15.133:0/3200897012 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:00:06.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731609f700 1 --2- 172.21.15.133:0/3200897012 >> v2:172.21.15.16:3300/0 conn(0x7f73100b5c00 0x7f73100b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:06.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 -- 172.21.15.133:0/3200897012 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563655498 0 0) 0x7f73040010d0 con 0x7f73100b52c0 2021-01-03T13:00:06.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 -- 172.21.15.133:0/3200897012 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72f4003230 con 0x7f73100b52c0 2021-01-03T13:00:06.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 -- 172.21.15.133:0/3200897012 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3115887512 0 0) 0x7f72f4003230 con 0x7f73100b52c0 2021-01-03T13:00:06.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 -- 172.21.15.133:0/3200897012 >> v2:172.21.15.16:3300/0 conn(0x7f73100b5c00 msgr2=0x7f73100b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:06.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 --2- 172.21.15.133:0/3200897012 >> v2:172.21.15.16:3300/0 conn(0x7f73100b5c00 0x7f73100b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 -- 172.21.15.133:0/3200897012 >> v1:172.21.15.16:6789/0 conn(0x7f73100b0c90 legacy=0x7f7310143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:06.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 -- 172.21.15.133:0/3200897012 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73100b56a0 con 0x7f73100b52c0 2021-01-03T13:00:06.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 -- 172.21.15.133:0/3200897012 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f7304001860 con 0x7f73100b52c0 2021-01-03T13:00:06.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 -- 172.21.15.133:0/3200897012 >> v1:172.21.15.133:6789/0 conn(0x7f73100b52c0 legacy=0x7f7310098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:06.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 --2- 172.21.15.133:0/3200897012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f4003720 0x7f72f4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:06.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 --2- 172.21.15.133:0/3200897012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72f40044d0 0x7f72f4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:06.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 --2- 172.21.15.133:0/3200897012 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f72f4004e40 0x7f72f400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:06.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 -- 172.21.15.133:0/3200897012 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7310067a90 con 0x7f72f4003720 2021-01-03T13:00:06.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 -- 172.21.15.133:0/3200897012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f4004250 con 0x7f72f40044d0 2021-01-03T13:00:06.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 -- 172.21.15.133:0/3200897012 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f400bc10 con 0x7f72f4004e40 2021-01-03T13:00:06.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731509d700 1 --2- 172.21.15.133:0/3200897012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72f40044d0 0x7f72f4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:06.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731609f700 1 --2- 172.21.15.133:0/3200897012 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f72f4004e40 0x7f72f400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:06.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731589e700 1 --2- 172.21.15.133:0/3200897012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f4003720 0x7f72f4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:06.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731509d700 1 -- 172.21.15.133:0/3200897012 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f72f4004e40 msgr2=0x7f72f400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:06.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731509d700 1 --2- 172.21.15.133:0/3200897012 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f72f4004e40 0x7f72f400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731509d700 1 -- 172.21.15.133:0/3200897012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f4003720 msgr2=0x7f72f4003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:06.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731509d700 1 --2- 172.21.15.133:0/3200897012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f4003720 0x7f72f4003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731509d700 1 -- 172.21.15.133:0/3200897012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f4003230 con 0x7f72f40044d0 2021-01-03T13:00:06.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731609f700 1 --2- 172.21.15.133:0/3200897012 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f72f4004e40 0x7f72f400b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:06.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731609f700 1 -- 172.21.15.133:0/3200897012 reap_dead start 2021-01-03T13:00:06.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731509d700 1 --2- 172.21.15.133:0/3200897012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72f40044d0 0x7f72f4004950 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f7310098e10 tx=0x7f730c007ee0).ready entity=mon.1 client_cookie=f0a34f2420b81560 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:06.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 -- 172.21.15.133:0/3200897012 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f730c00ca50 con 0x7f72f40044d0 2021-01-03T13:00:06.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 -- 172.21.15.133:0/3200897012 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c00cbb0 con 0x7f72f40044d0 2021-01-03T13:00:06.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f731489c700 1 -- 172.21.15.133:0/3200897012 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f730c013410 con 0x7f72f40044d0 2021-01-03T13:00:06.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f73168a0700 1 -- 172.21.15.133:0/3200897012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72f40044d0 msgr2=0x7f72f4004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:06.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.419+0000 7f73168a0700 1 --2- 172.21.15.133:0/3200897012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72f40044d0 0x7f72f4004950 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f7310098e10 tx=0x7f730c007ee0).stop 2021-01-03T13:00:06.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.423+0000 7f73168a0700 1 -- 172.21.15.133:0/3200897012 shutdown_connections 2021-01-03T13:00:06.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.423+0000 7f73168a0700 1 --2- 172.21.15.133:0/3200897012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72f40044d0 0x7f72f4004950 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.423+0000 7f73168a0700 1 -- 172.21.15.133:0/3200897012 >> 172.21.15.133:0/3200897012 conn(0x7f731005bdf0 msgr2=0x7f731005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:06.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.423+0000 7f73168a0700 1 -- 172.21.15.133:0/3200897012 shutdown_connections 2021-01-03T13:00:06.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.423+0000 7f73168a0700 1 -- 172.21.15.133:0/3200897012 wait complete. 2021-01-03T13:00:06.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.423+0000 7f73168a0700 1 Processor -- start 2021-01-03T13:00:06.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.423+0000 7f73168a0700 1 -- start start 2021-01-03T13:00:06.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.423+0000 7f73168a0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f40044d0 0x7f7310066820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:06.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.423+0000 7f73168a0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7310156060 0x7f73100aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:06.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.423+0000 7f73168a0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73100aa5e0 0x7f73100aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:06.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.423+0000 7f73168a0700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731014a170 con 0x7f72f40044d0 2021-01-03T13:00:06.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.423+0000 7f73168a0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731015a150 con 0x7f73100aa5e0 2021-01-03T13:00:06.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.423+0000 7f73168a0700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731015a3f0 con 0x7f7310156060 2021-01-03T13:00:06.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.423+0000 7f731609f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73100aa5e0 0x7f73100aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:06.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.423+0000 7f731609f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73100aa5e0 0x7f73100aece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33850/0 (socket says 172.21.15.133:33850) 2021-01-03T13:00:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.423+0000 7f731609f700 1 -- 172.21.15.133:0/1618602655 learned_addr learned my addr 172.21.15.133:0/1618602655 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f731589e700 1 --2- 172.21.15.133:0/1618602655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f40044d0 0x7f7310066820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f731509d700 1 --2- 172.21.15.133:0/1618602655 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7310156060 0x7f73100aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f731609f700 1 -- 172.21.15.133:0/1618602655 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7310156060 msgr2=0x7f73100aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:06.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f731609f700 1 --2- 172.21.15.133:0/1618602655 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7310156060 0x7f73100aa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f731609f700 1 -- 172.21.15.133:0/1618602655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f40044d0 msgr2=0x7f7310066820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:06.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f731609f700 1 --2- 172.21.15.133:0/1618602655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f40044d0 0x7f7310066820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f731609f700 1 -- 172.21.15.133:0/1618602655 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731014a3d0 con 0x7f73100aa5e0 2021-01-03T13:00:06.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f731509d700 1 --2- 172.21.15.133:0/1618602655 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7310156060 0x7f73100aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:06.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f731609f700 1 --2- 172.21.15.133:0/1618602655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73100aa5e0 0x7f73100aece0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f7308008000 tx=0x7f7308008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f73037fe700 1 -- 172.21.15.133:0/1618602655 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7308012800 con 0x7f73100aa5e0 2021-01-03T13:00:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f73037fe700 1 -- 172.21.15.133:0/1618602655 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7308012960 con 0x7f73100aa5e0 2021-01-03T13:00:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f73168a0700 1 -- 172.21.15.133:0/1618602655 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7310149650 con 0x7f73100aa5e0 2021-01-03T13:00:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f73037fe700 1 -- 172.21.15.133:0/1618602655 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7308012cc0 con 0x7f73100aa5e0 2021-01-03T13:00:06.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f73168a0700 1 -- 172.21.15.133:0/1618602655 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731014d560 con 0x7f73100aa5e0 2021-01-03T13:00:06.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f73168a0700 1 -- 172.21.15.133:0/1618602655 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731014a790 con 0x7f73100aa5e0 2021-01-03T13:00:06.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f73037fe700 1 -- 172.21.15.133:0/1618602655 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7308014470 con 0x7f73100aa5e0 2021-01-03T13:00:06.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f73037fe700 1 --2- 172.21.15.133:0/1618602655 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f72ec055440 0x7f72ec057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:06.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f73037fe700 1 -- 172.21.15.133:0/1618602655 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f730806e520 con 0x7f73100aa5e0 2021-01-03T13:00:06.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f731589e700 1 --2- 172.21.15.133:0/1618602655 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f72ec055440 0x7f72ec057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:06.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.427+0000 7f731589e700 1 --2- 172.21.15.133:0/1618602655 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f72ec055440 0x7f72ec057900 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f730400d000 tx=0x7f7304007040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:06.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.435+0000 7f73037fe700 1 -- 172.21.15.133:0/1618602655 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7308044720 con 0x7f73100aa5e0 2021-01-03T13:00:06.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.615+0000 7f73168a0700 1 -- 172.21.15.133:0/1618602655 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7310057300 con 0x7f73100aa5e0 2021-01-03T13:00:06.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.619+0000 7f73037fe700 1 -- 172.21.15.133:0/1618602655 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2494 (secure 0 0 0) 0x7f7308047d40 con 0x7f73100aa5e0 2021-01-03T13:00:06.617 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:00:06.617 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5169,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/126912106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":126912106},{"type":"v1","addr":"172.21.15.16:6833","nonce":126912106}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13},{"gid":5212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/1241297212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1241297212},{"type":"v1","addr":"172.21.15.133:6835","nonce":1241297212}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:00:01.768700+0000","modified":"2021-01-03T13:00:02.771604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5218":{"gid":5218,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2379309183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2379309183},{"type":"v1","addr":"172.21.15.133:6837","nonce":2379309183}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-01-03T13:00:06.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.619+0000 7f73168a0700 1 -- 172.21.15.133:0/1618602655 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f72ec055440 msgr2=0x7f72ec057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:06.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.619+0000 7f73168a0700 1 --2- 172.21.15.133:0/1618602655 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f72ec055440 0x7f72ec057900 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f730400d000 tx=0x7f7304007040).stop 2021-01-03T13:00:06.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.619+0000 7f73168a0700 1 -- 172.21.15.133:0/1618602655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73100aa5e0 msgr2=0x7f73100aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:06.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.619+0000 7f73168a0700 1 --2- 172.21.15.133:0/1618602655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73100aa5e0 0x7f73100aece0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f7308008000 tx=0x7f7308008040).stop 2021-01-03T13:00:06.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.619+0000 7f73168a0700 1 -- 172.21.15.133:0/1618602655 shutdown_connections 2021-01-03T13:00:06.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.619+0000 7f73168a0700 1 --2- 172.21.15.133:0/1618602655 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f72ec055440 0x7f72ec057900 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.619+0000 7f73168a0700 1 --2- 172.21.15.133:0/1618602655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72f40044d0 0x7f7310066820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.619+0000 7f73168a0700 1 --2- 172.21.15.133:0/1618602655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73100aa5e0 0x7f73100aece0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.619+0000 7f73168a0700 1 --2- 172.21.15.133:0/1618602655 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7310156060 0x7f73100aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:06.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.619+0000 7f73168a0700 1 -- 172.21.15.133:0/1618602655 >> 172.21.15.133:0/1618602655 conn(0x7f731005bdf0 msgr2=0x7f73100b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:06.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.619+0000 7f73168a0700 1 -- 172.21.15.133:0/1618602655 shutdown_connections 2021-01-03T13:00:06.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:06.619+0000 7f73168a0700 1 -- 172.21.15.133:0/1618602655 wait complete. 2021-01-03T13:00:06.621 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 16 2021-01-03T13:00:06.932 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:00:01.768700+0000', 'modified': '2021-01-03T13:00:02.771604+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5218}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5218': {'gid': 5218, 'name': 'a', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/2379309183', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 2379309183}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 2379309183}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:00:06.933 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:00:06.934 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-01-03T13:00:06.966 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:00:06.968 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:00:06.970 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:00:06.973 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:00:07.068 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":5218,"want_state":"up:active","state":"up:active","rank_uptime":5.287162543,"mdsmap_epoch":16,"osdmap_epoch":45,"osdmap_epoch_barrier":43,"uptime":10.640694140000001} 2021-01-03T13:00:07.068 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 5218, "mdsmap_epoch": 16, "osdmap_epoch": 45, "osdmap_epoch_barrier": 43, "rank_uptime": 5.287162543, "state": "up:active", "uptime": 10.64069414, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:00:07.068 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:00:07.069 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-01-03T13:00:07.069 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi007.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-01-03T13:00:07.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:07.070 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:00:07.078 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:00:07.134 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:00:07.134 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:00:07.190 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:00:07.191 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:00:07.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:07.192 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:00:07.236 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:00:07.237 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:00:07.281 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:00:07.297 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:00:07.298 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:00:07.351 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:00:07.352 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:00:07.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:07.353 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:00:07.363 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2021-01-03T13:00:07.359+0000 7fdea40d90c0 -1 init, newargv = 0x56548fbc42e0 newargc=9ceph-fuse[11747 2021-01-03T13:00:07.364 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:]: starting ceph client 2021-01-03T13:00:07.376 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[11747]: starting fuse 2021-01-03T13:00:08.469 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:00:08.486 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:00:08.486 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:00:08.540 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:00:08.540 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:00:08.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:08.542 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:00:08.589 INFO:teuthology.orchestra.run.smithi007.stdout:50 2021-01-03T13:00:08.590 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:00:08.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:08.590 DEBUG:teuthology.orchestra.run.smithi007:> sudo python3 -c ' 2021-01-03T13:00:08.591 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2021-01-03T13:00:08.591 DEBUG:teuthology.orchestra.run.smithi007:> import re 2021-01-03T13:00:08.592 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:00:08.592 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2021-01-03T13:00:08.592 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:00:08.593 DEBUG:teuthology.orchestra.run.smithi007:> def find_socket(client_name): 2021-01-03T13:00:08.593 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-01-03T13:00:08.593 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2021-01-03T13:00:08.594 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:00:08.594 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2021-01-03T13:00:08.595 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2021-01-03T13:00:08.595 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2021-01-03T13:00:08.595 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2021-01-03T13:00:08.596 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:00:08.596 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2021-01-03T13:00:08.596 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:00:08.597 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:00:08.597 DEBUG:teuthology.orchestra.run.smithi007:> return f 2021-01-03T13:00:08.598 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:00:08.598 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:00:08.598 DEBUG:teuthology.orchestra.run.smithi007:> print(find_socket("client.0")) 2021-01-03T13:00:08.599 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:00:08.682 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.11747.asok 2021-01-03T13:00:08.687 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.11747.asok 2021-01-03T13:00:08.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:08.688 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.11747.asok status 2021-01-03T13:00:08.786 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2021-01-03T13:00:08.787 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2021-01-03T13:00:08.787 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:00:08.787 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:00:08.787 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2021-01-03T13:00:08.787 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2021-01-03T13:00:08.788 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-01-03T13:00:08.788 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "11747", 2021-01-03T13:00:08.788 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2021-01-03T13:00:08.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:00:08.789 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2021-01-03T13:00:08.789 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2021-01-03T13:00:08.789 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5331, 2021-01-03T13:00:08.789 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2021-01-03T13:00:08.790 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2021-01-03T13:00:08.790 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2021-01-03T13:00:08.790 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 5331 2021-01-03T13:00:08.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:00:08.790 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:00:08.791 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:00:08.791 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:00:08.791 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 4181355485 2021-01-03T13:00:08.791 INFO:teuthology.orchestra.run.smithi007.stdout: } 2021-01-03T13:00:08.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:00:08.792 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:00:08.792 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:00:08.792 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:00:08.792 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 4181355485 2021-01-03T13:00:08.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:00:08.793 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.5331 172.21.15.7:0/4181355485", 2021-01-03T13:00:08.793 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "172.21.15.7:0/4181355485", 2021-01-03T13:00:08.793 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2021-01-03T13:00:08.793 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 16, 2021-01-03T13:00:08.794 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 45, 2021-01-03T13:00:08.794 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:00:08.794 INFO:teuthology.orchestra.run.smithi007.stdout: "blacklisted": false, 2021-01-03T13:00:08.794 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2021-01-03T13:00:08.795 INFO:teuthology.orchestra.run.smithi007.stdout:} 2021-01-03T13:00:08.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:08.797 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:00:08.797 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:00:08.803 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:00:08.804 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:00:08.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:08.805 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:00:08.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:08.865 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:00:08.865 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:00:08.919 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:00:08.921 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:00:08.922 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-01-03T13:00:08.922 DEBUG:teuthology.orchestra.run.smithi007:> import sys 2021-01-03T13:00:08.923 DEBUG:teuthology.orchestra.run.smithi007:> import time 2021-01-03T13:00:08.924 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:00:08.924 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:00:08.925 DEBUG:teuthology.orchestra.run.smithi007:> n = 1000 2021-01-03T13:00:08.926 DEBUG:teuthology.orchestra.run.smithi007:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-01-03T13:00:08.927 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:00:08.927 DEBUG:teuthology.orchestra.run.smithi007:> if not os.path.exists(os.path.dirname(abs_path)): 2021-01-03T13:00:08.928 DEBUG:teuthology.orchestra.run.smithi007:> os.makedirs(os.path.dirname(abs_path)) 2021-01-03T13:00:08.929 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:00:08.930 DEBUG:teuthology.orchestra.run.smithi007:> for i in range(0, n): 2021-01-03T13:00:08.930 DEBUG:teuthology.orchestra.run.smithi007:> fname = "{0}_{1}".format(abs_path, i) 2021-01-03T13:00:08.931 DEBUG:teuthology.orchestra.run.smithi007:> with open(fname, '"'"'w'"'"') as f: 2021-01-03T13:00:08.932 DEBUG:teuthology.orchestra.run.smithi007:> f.write('"'"'content'"'"') 2021-01-03T13:00:08.933 DEBUG:teuthology.orchestra.run.smithi007:> if True: 2021-01-03T13:00:08.933 DEBUG:teuthology.orchestra.run.smithi007:> f.flush() 2021-01-03T13:00:08.934 DEBUG:teuthology.orchestra.run.smithi007:> os.fsync(f.fileno()) 2021-01-03T13:00:08.935 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:00:21.450 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:00:21.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7feff0d59700 1 Processor -- start 2021-01-03T13:00:21.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7feff0d59700 1 -- start start 2021-01-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7feff0d59700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fefec0b52c0 0x7fefec0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7feff0d59700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefec060da0 con 0x7fefec0b0c90 2021-01-03T13:00:21.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7feff0d59700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefec0b0ad0 con 0x7fefec0b5c00 2021-01-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7feff0d59700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefec067a90 con 0x7fefec0b52c0 2021-01-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefebfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fefec0b5c00 0x7fefec143eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54892/0 (socket says 172.21.15.133:54892) 2021-01-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefebfff700 1 -- 172.21.15.133:0/1848494086 learned_addr learned my addr 172.21.15.133:0/1848494086 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefeb7fe700 1 --2- 172.21.15.133:0/1848494086 >> v2:172.21.15.16:3300/0 conn(0x7fefec0b52c0 0x7fefec0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:21.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefea7fc700 1 -- 172.21.15.133:0/1848494086 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706481839 0 0) 0x7fefdc0010d0 con 0x7fefec0b5c00 2021-01-03T13:00:21.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefea7fc700 1 -- 172.21.15.133:0/1848494086 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd0003230 con 0x7fefec0b5c00 2021-01-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefea7fc700 1 -- 172.21.15.133:0/1848494086 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2213971959 0 0) 0x7fefd0003230 con 0x7fefec0b5c00 2021-01-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefea7fc700 1 -- 172.21.15.133:0/1848494086 >> v2:172.21.15.16:3300/0 conn(0x7fefec0b52c0 msgr2=0x7fefec0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:21.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefea7fc700 1 --2- 172.21.15.133:0/1848494086 >> v2:172.21.15.16:3300/0 conn(0x7fefec0b52c0 0x7fefec0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefea7fc700 1 -- 172.21.15.133:0/1848494086 >> v1:172.21.15.16:6789/0 conn(0x7fefec0b0c90 legacy=0x7fefec098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefea7fc700 1 -- 172.21.15.133:0/1848494086 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefec0b56a0 con 0x7fefec0b5c00 2021-01-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefea7fc700 1 -- 172.21.15.133:0/1848494086 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fefdc001860 con 0x7fefec0b5c00 2021-01-03T13:00:21.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefea7fc700 1 -- 172.21.15.133:0/1848494086 >> v1:172.21.15.133:6789/0 conn(0x7fefec0b5c00 legacy=0x7fefec143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefea7fc700 1 --2- 172.21.15.133:0/1848494086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefd0003770 0x7fefd0003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefea7fc700 1 --2- 172.21.15.133:0/1848494086 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefd00044d0 0x7fefd0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefea7fc700 1 --2- 172.21.15.133:0/1848494086 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefd0004e40 0x7fefd000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefea7fc700 1 -- 172.21.15.133:0/1848494086 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefec067a90 con 0x7fefd00044d0 2021-01-03T13:00:21.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefea7fc700 1 -- 172.21.15.133:0/1848494086 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd00052f0 con 0x7fefd0003770 2021-01-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefea7fc700 1 -- 172.21.15.133:0/1848494086 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd000bc10 con 0x7fefd0004e40 2021-01-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefeb7fe700 1 --2- 172.21.15.133:0/1848494086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefd0003770 0x7fefd0003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefebfff700 1 --2- 172.21.15.133:0/1848494086 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefd0004e40 0x7fefd000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:21.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.559+0000 7fefeaffd700 1 --2- 172.21.15.133:0/1848494086 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefd00044d0 0x7fefd0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.563+0000 7fefeb7fe700 1 -- 172.21.15.133:0/1848494086 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefd0004e40 msgr2=0x7fefd000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.563+0000 7fefeb7fe700 1 --2- 172.21.15.133:0/1848494086 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefd0004e40 0x7fefd000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.563+0000 7fefeb7fe700 1 -- 172.21.15.133:0/1848494086 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefd00044d0 msgr2=0x7fefd0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.563+0000 7fefeb7fe700 1 --2- 172.21.15.133:0/1848494086 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefd00044d0 0x7fefd0004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:21.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.563+0000 7fefebfff700 1 -- 172.21.15.133:0/1848494086 reap_dead start 2021-01-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.563+0000 7fefeb7fe700 1 -- 172.21.15.133:0/1848494086 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd0003230 con 0x7fefd0003770 2021-01-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.563+0000 7fefeb7fe700 1 --2- 172.21.15.133:0/1848494086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefd0003770 0x7fefd0003b90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fefd400c000 tx=0x7fefd4008040).ready entity=mon.1 client_cookie=74a6595557ce531d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.563+0000 7fefea7fc700 1 -- 172.21.15.133:0/1848494086 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefd400e9d0 con 0x7fefd0003770 2021-01-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.563+0000 7fefea7fc700 1 -- 172.21.15.133:0/1848494086 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd400eb30 con 0x7fefd0003770 2021-01-03T13:00:21.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.563+0000 7fefea7fc700 1 -- 172.21.15.133:0/1848494086 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefd400ee90 con 0x7fefd0003770 2021-01-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.563+0000 7feff0d59700 1 -- 172.21.15.133:0/1848494086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefd0003770 msgr2=0x7fefd0003b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.563+0000 7feff0d59700 1 --2- 172.21.15.133:0/1848494086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefd0003770 0x7fefd0003b90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7fefd400c000 tx=0x7fefd4008040).stop 2021-01-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.563+0000 7feff0d59700 1 -- 172.21.15.133:0/1848494086 shutdown_connections 2021-01-03T13:00:21.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.563+0000 7feff0d59700 1 --2- 172.21.15.133:0/1848494086 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefd0003770 0x7fefd0003b90 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:21.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.563+0000 7feff0d59700 1 -- 172.21.15.133:0/1848494086 >> 172.21.15.133:0/1848494086 conn(0x7fefec05bdf0 msgr2=0x7fefec05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:21.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.563+0000 7feff0d59700 1 -- 172.21.15.133:0/1848494086 shutdown_connections 2021-01-03T13:00:21.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.563+0000 7feff0d59700 1 -- 172.21.15.133:0/1848494086 wait complete. 2021-01-03T13:00:21.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7feff0d59700 1 Processor -- start 2021-01-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7feff0d59700 1 -- start start 2021-01-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7feff0d59700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefd0003770 0x7fefec063f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7feff0d59700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefec066d20 0x7fefec155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:21.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7feff0d59700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefec156410 0x7fefec1594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7feff0d59700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefec15a330 con 0x7fefec066d20 2021-01-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7feff0d59700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefec14b6b0 con 0x7fefec156410 2021-01-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7feff0d59700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefec14b950 con 0x7fefd0003770 2021-01-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7fefebfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefec156410 0x7fefec1594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:21.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7fefebfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefec156410 0x7fefec1594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33872/0 (socket says 172.21.15.133:33872) 2021-01-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7fefebfff700 1 -- 172.21.15.133:0/200926359 learned_addr learned my addr 172.21.15.133:0/200926359 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7fefeb7fe700 1 --2- 172.21.15.133:0/200926359 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefd0003770 0x7fefec063f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7fefeaffd700 1 --2- 172.21.15.133:0/200926359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefec066d20 0x7fefec155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7fefebfff700 1 -- 172.21.15.133:0/200926359 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefd0003770 msgr2=0x7fefec063f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:21.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7fefebfff700 1 --2- 172.21.15.133:0/200926359 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefd0003770 0x7fefec063f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7fefebfff700 1 -- 172.21.15.133:0/200926359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefec066d20 msgr2=0x7fefec155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7fefebfff700 1 --2- 172.21.15.133:0/200926359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefec066d20 0x7fefec155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7fefebfff700 1 -- 172.21.15.133:0/200926359 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefec14bbf0 con 0x7fefec156410 2021-01-03T13:00:21.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7fefebfff700 1 --2- 172.21.15.133:0/200926359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefec156410 0x7fefec1594f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fefdc000e50 tx=0x7fefdc001180).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7fefe8ff9700 1 -- 172.21.15.133:0/200926359 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefdc00c7b0 con 0x7fefec156410 2021-01-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7fefe8ff9700 1 -- 172.21.15.133:0/200926359 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefdc00c910 con 0x7fefec156410 2021-01-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7feff0d59700 1 -- 172.21.15.133:0/200926359 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefec14c090 con 0x7fefec156410 2021-01-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7fefe8ff9700 1 -- 172.21.15.133:0/200926359 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefdc00cc70 con 0x7fefec156410 2021-01-03T13:00:21.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.567+0000 7feff0d59700 1 -- 172.21.15.133:0/200926359 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefec066940 con 0x7fefec156410 2021-01-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.571+0000 7feff0d59700 1 -- 172.21.15.133:0/200926359 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefec14bd80 con 0x7fefec156410 2021-01-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.571+0000 7fefe8ff9700 1 -- 172.21.15.133:0/200926359 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fefdc014430 con 0x7fefec156410 2021-01-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.571+0000 7fefe8ff9700 1 --2- 172.21.15.133:0/200926359 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fefc40553b0 0x7fefc4057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:21.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.571+0000 7fefe8ff9700 1 -- 172.21.15.133:0/200926359 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fefdc06d9f0 con 0x7fefec156410 2021-01-03T13:00:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.571+0000 7fefeb7fe700 1 --2- 172.21.15.133:0/200926359 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fefc40553b0 0x7fefc4057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.571+0000 7fefeb7fe700 1 --2- 172.21.15.133:0/200926359 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fefc40553b0 0x7fefc4057870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fefd401c000 tx=0x7fefd401a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:21.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.575+0000 7fefe8ff9700 1 -- 172.21.15.133:0/200926359 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fefdc043b80 con 0x7fefec156410 2021-01-03T13:00:21.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.763+0000 7feff0d59700 1 -- 172.21.15.133:0/200926359 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefec0b0ad0 con 0x7fefec156410 2021-01-03T13:00:21.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.763+0000 7fefe8ff9700 1 -- 172.21.15.133:0/200926359 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2494 (secure 0 0 0) 0x7fefec0b0ad0 con 0x7fefec156410 2021-01-03T13:00:21.764 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:00:21.765 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5169,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/126912106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":126912106},{"type":"v1","addr":"172.21.15.16:6833","nonce":126912106}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13},{"gid":5212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/1241297212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1241297212},{"type":"v1","addr":"172.21.15.133:6835","nonce":1241297212}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:00:01.768700+0000","modified":"2021-01-03T13:00:02.771604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5218":{"gid":5218,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2379309183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2379309183},{"type":"v1","addr":"172.21.15.133:6837","nonce":2379309183}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-01-03T13:00:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.767+0000 7feff0d59700 1 -- 172.21.15.133:0/200926359 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fefc40553b0 msgr2=0x7fefc4057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.767+0000 7feff0d59700 1 --2- 172.21.15.133:0/200926359 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fefc40553b0 0x7fefc4057870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fefd401c000 tx=0x7fefd401a000).stop 2021-01-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.767+0000 7feff0d59700 1 -- 172.21.15.133:0/200926359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefec156410 msgr2=0x7fefec1594f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.767+0000 7feff0d59700 1 --2- 172.21.15.133:0/200926359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefec156410 0x7fefec1594f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fefdc000e50 tx=0x7fefdc001180).stop 2021-01-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.767+0000 7feff0d59700 1 -- 172.21.15.133:0/200926359 shutdown_connections 2021-01-03T13:00:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.767+0000 7feff0d59700 1 --2- 172.21.15.133:0/200926359 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fefc40553b0 0x7fefc4057870 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.767+0000 7feff0d59700 1 --2- 172.21.15.133:0/200926359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefec156410 0x7fefec1594f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.767+0000 7feff0d59700 1 --2- 172.21.15.133:0/200926359 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fefd0003770 0x7fefec063f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.767+0000 7feff0d59700 1 --2- 172.21.15.133:0/200926359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fefec066d20 0x7fefec155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.767+0000 7feff0d59700 1 -- 172.21.15.133:0/200926359 >> 172.21.15.133:0/200926359 conn(0x7fefec05bdf0 msgr2=0x7fefec145070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.767+0000 7feff0d59700 1 -- 172.21.15.133:0/200926359 shutdown_connections 2021-01-03T13:00:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:21.767+0000 7feff0d59700 1 -- 172.21.15.133:0/200926359 wait complete. 2021-01-03T13:00:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 16 2021-01-03T13:00:21.785 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-01-03T13:00:21.901 INFO:teuthology.orchestra.run.smithi133.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-01-03T13:00:21.901 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-01-03T13:00:21.902 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:00:22.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6c9a8700 1 Processor -- start 2021-01-03T13:00:22.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6c9a8700 1 -- start start 2021-01-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6c9a8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea6805c130 0x7fea681437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6c9a8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fea680b02d0 0x7fea68146a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6c9a8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea680b0760 con 0x7fea6805cc10 2021-01-03T13:00:22.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6c9a8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6805c510 con 0x7fea680b02d0 2021-01-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6c9a8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea680b5c10 con 0x7fea6805c130 2021-01-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea66d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fea680b02d0 0x7fea68146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea65d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fea6805cc10 0x7fea68146370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54910/0 (socket says 172.21.15.133:54910) 2021-01-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea66d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fea680b02d0 0x7fea68146a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33880/0 (socket says 172.21.15.133:33880) 2021-01-03T13:00:22.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea65d9b700 1 -- 172.21.15.133:0/1113449169 learned_addr learned my addr 172.21.15.133:0/1113449169 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6659c700 1 --2- 172.21.15.133:0/1113449169 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea6805c130 0x7fea681437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea66d9d700 1 -- 172.21.15.133:0/1113449169 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea6805c130 msgr2=0x7fea681437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea66d9d700 1 --2- 172.21.15.133:0/1113449169 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea6805c130 0x7fea681437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea66d9d700 1 -- 172.21.15.133:0/1113449169 >> v1:172.21.15.133:6789/0 conn(0x7fea6805cc10 legacy=0x7fea68146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea66d9d700 1 -- 172.21.15.133:0/1113449169 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea680af8f0 con 0x7fea680b02d0 2021-01-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea66d9d700 1 --2- 172.21.15.133:0/1113449169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea680b02d0 0x7fea68146a80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7fea600032b0 tx=0x7fea600091a0).ready entity=mon.1 client_cookie=6ddd644a0c529454 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6559a700 1 -- 172.21.15.133:0/1113449169 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea6000ba50 con 0x7fea680b02d0 2021-01-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6559a700 1 -- 172.21.15.133:0/1113449169 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6000bbb0 con 0x7fea680b02d0 2021-01-03T13:00:22.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6559a700 1 -- 172.21.15.133:0/1113449169 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea6000bd20 con 0x7fea680b02d0 2021-01-03T13:00:22.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6c9a8700 1 -- 172.21.15.133:0/1113449169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea680b02d0 msgr2=0x7fea68146a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6c9a8700 1 --2- 172.21.15.133:0/1113449169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea680b02d0 0x7fea68146a80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7fea600032b0 tx=0x7fea600091a0).stop 2021-01-03T13:00:22.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6c9a8700 1 -- 172.21.15.133:0/1113449169 shutdown_connections 2021-01-03T13:00:22.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6c9a8700 1 --2- 172.21.15.133:0/1113449169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea680b02d0 0x7fea68146a80 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6c9a8700 1 --2- 172.21.15.133:0/1113449169 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea6805c130 0x7fea681437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6c9a8700 1 -- 172.21.15.133:0/1113449169 >> 172.21.15.133:0/1113449169 conn(0x7fea680b95d0 msgr2=0x7fea680b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6c9a8700 1 -- 172.21.15.133:0/1113449169 shutdown_connections 2021-01-03T13:00:22.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.031+0000 7fea6c9a8700 1 -- 172.21.15.133:0/1113449169 wait complete. 2021-01-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6c9a8700 1 Processor -- start 2021-01-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6c9a8700 1 -- start start 2021-01-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6c9a8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea6805c130 0x7fea680b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6c9a8700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea6805cc10 0x7fea680b8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6c9a8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea680b02d0 0x7fea680b8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6c9a8700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea681423a0 con 0x7fea6805cc10 2021-01-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6c9a8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6809cbb0 con 0x7fea6805c130 2021-01-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6c9a8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6809cde0 con 0x7fea680b02d0 2021-01-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea6805c130 0x7fea680b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea6805c130 0x7fea680b4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33882/0 (socket says 172.21.15.133:33882) 2021-01-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6659c700 1 -- 172.21.15.133:0/573738519 learned_addr learned my addr 172.21.15.133:0/573738519 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea66d9d700 1 --2- 172.21.15.133:0/573738519 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea680b02d0 0x7fea680b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea65d9b700 1 --2- 172.21.15.133:0/573738519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea6805cc10 0x7fea680b8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6659c700 1 -- 172.21.15.133:0/573738519 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea680b02d0 msgr2=0x7fea680b8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6659c700 1 --2- 172.21.15.133:0/573738519 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea680b02d0 0x7fea680b8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6659c700 1 -- 172.21.15.133:0/573738519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea6805cc10 msgr2=0x7fea680b8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6659c700 1 --2- 172.21.15.133:0/573738519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea6805cc10 0x7fea680b8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6659c700 1 -- 172.21.15.133:0/573738519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6809d080 con 0x7fea6805c130 2021-01-03T13:00:22.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea65d9b700 1 --2- 172.21.15.133:0/573738519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea6805cc10 0x7fea680b8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:22.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6659c700 1 --2- 172.21.15.133:0/573738519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea6805c130 0x7fea680b4b10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fea6809f040 tx=0x7fea58008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea577fe700 1 -- 172.21.15.133:0/573738519 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea580127e0 con 0x7fea6805c130 2021-01-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea577fe700 1 -- 172.21.15.133:0/573738519 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea58012940 con 0x7fea6805c130 2021-01-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6c9a8700 1 -- 172.21.15.133:0/573738519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6809d320 con 0x7fea6805c130 2021-01-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea577fe700 1 -- 172.21.15.133:0/573738519 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea58012ca0 con 0x7fea6805c130 2021-01-03T13:00:22.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.035+0000 7fea6c9a8700 1 -- 172.21.15.133:0/573738519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea680b7370 con 0x7fea6805c130 2021-01-03T13:00:22.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.039+0000 7fea6c9a8700 1 -- 172.21.15.133:0/573738519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea680b7f30 con 0x7fea6805c130 2021-01-03T13:00:22.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.039+0000 7fea577fe700 1 -- 172.21.15.133:0/573738519 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fea58013480 con 0x7fea6805c130 2021-01-03T13:00:22.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.039+0000 7fea577fe700 1 --2- 172.21.15.133:0/573738519 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea440553b0 0x7fea44057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.039+0000 7fea577fe700 1 -- 172.21.15.133:0/573738519 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fea5806e700 con 0x7fea6805c130 2021-01-03T13:00:22.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.039+0000 7fea65d9b700 1 --2- 172.21.15.133:0/573738519 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea440553b0 0x7fea44057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.039+0000 7fea65d9b700 1 --2- 172.21.15.133:0/573738519 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea440553b0 0x7fea44057870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fea5c00b000 tx=0x7fea5c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:22.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.047+0000 7fea577fe700 1 -- 172.21.15.133:0/573738519 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fea58044890 con 0x7fea6805c130 2021-01-03T13:00:22.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.231+0000 7fea6c9a8700 1 -- 172.21.15.133:0/573738519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea68057300 con 0x7fea6805c130 2021-01-03T13:00:22.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.231+0000 7fea577fe700 1 -- 172.21.15.133:0/573738519 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2494 (secure 0 0 0) 0x7fea58047eb0 con 0x7fea6805c130 2021-01-03T13:00:22.231 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:00:22.232 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5169,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/126912106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":126912106},{"type":"v1","addr":"172.21.15.16:6833","nonce":126912106}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13},{"gid":5212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/1241297212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1241297212},{"type":"v1","addr":"172.21.15.133:6835","nonce":1241297212}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:00:01.768700+0000","modified":"2021-01-03T13:00:02.771604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5218":{"gid":5218,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2379309183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2379309183},{"type":"v1","addr":"172.21.15.133:6837","nonce":2379309183}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-01-03T13:00:22.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.235+0000 7fea6c9a8700 1 -- 172.21.15.133:0/573738519 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea440553b0 msgr2=0x7fea44057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.235+0000 7fea6c9a8700 1 --2- 172.21.15.133:0/573738519 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea440553b0 0x7fea44057870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fea5c00b000 tx=0x7fea5c009040).stop 2021-01-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.235+0000 7fea6c9a8700 1 -- 172.21.15.133:0/573738519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea6805c130 msgr2=0x7fea680b4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.235+0000 7fea6c9a8700 1 --2- 172.21.15.133:0/573738519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea6805c130 0x7fea680b4b10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fea6809f040 tx=0x7fea58008040).stop 2021-01-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.235+0000 7fea6c9a8700 1 -- 172.21.15.133:0/573738519 shutdown_connections 2021-01-03T13:00:22.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.235+0000 7fea6c9a8700 1 --2- 172.21.15.133:0/573738519 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea440553b0 0x7fea44057870 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.235+0000 7fea6c9a8700 1 --2- 172.21.15.133:0/573738519 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea680b02d0 0x7fea680b8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.235+0000 7fea6c9a8700 1 --2- 172.21.15.133:0/573738519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea6805c130 0x7fea680b4b10 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.235+0000 7fea6c9a8700 1 --2- 172.21.15.133:0/573738519 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea6805cc10 0x7fea680b8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.235+0000 7fea6c9a8700 1 -- 172.21.15.133:0/573738519 >> 172.21.15.133:0/573738519 conn(0x7fea680b95d0 msgr2=0x7fea6813bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:22.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.235+0000 7fea6c9a8700 1 -- 172.21.15.133:0/573738519 shutdown_connections 2021-01-03T13:00:22.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.235+0000 7fea6c9a8700 1 -- 172.21.15.133:0/573738519 wait complete. 2021-01-03T13:00:22.237 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 16 2021-01-03T13:00:22.249 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-01-03T13:00:22.362 INFO:teuthology.orchestra.run.smithi133.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-01-03T13:00:22.362 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-01-03T13:00:22.363 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T13:00:22.380 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:00:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.491+0000 7f9a6302c700 1 Processor -- start 2021-01-03T13:00:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.491+0000 7f9a6302c700 1 -- start start 2021-01-03T13:00:22.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.491+0000 7f9a6302c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9a5c0b52c0 0x7f9a5c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.491+0000 7f9a6302c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9a5c0b0c90 0x7f9a5c098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.491+0000 7f9a6302c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a5c060da0 con 0x7f9a5c0b5c00 2021-01-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.491+0000 7f9a6302c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5c067a90 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.491+0000 7f9a6302c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0b0ad0 con 0x7f9a5c0b0c90 2021-01-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.491+0000 7f9a6282b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9a5c0b5c00 0x7f9a5c14a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54924/0 (socket says 172.21.15.133:54924) 2021-01-03T13:00:22.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.491+0000 7f9a6282b700 1 -- 172.21.15.133:0/2071964286 learned_addr learned my addr 172.21.15.133:0/2071964286 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:00:22.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a6202a700 1 --2- 172.21.15.133:0/2071964286 >> v2:172.21.15.133:3300/0 conn(0x7f9a5c0b52c0 0x7f9a5c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a61829700 1 --2- 172.21.15.133:0/2071964286 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9a5c0b0c90 0x7f9a5c098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a61028700 1 -- 172.21.15.133:0/2071964286 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409141717 0 0) 0x7f9a5c060da0 con 0x7f9a5c0b5c00 2021-01-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a61028700 1 -- 172.21.15.133:0/2071964286 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a44003230 con 0x7f9a5c0b5c00 2021-01-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a61028700 1 -- 172.21.15.133:0/2071964286 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3769907167 0 0) 0x7f9a44003230 con 0x7f9a5c0b5c00 2021-01-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a6202a700 1 -- 172.21.15.133:0/2071964286 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9a5c0b0c90 msgr2=0x7f9a5c098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:22.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a6202a700 1 --2- 172.21.15.133:0/2071964286 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9a5c0b0c90 0x7f9a5c098ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a6202a700 1 -- 172.21.15.133:0/2071964286 >> v1:172.21.15.133:6789/0 conn(0x7f9a5c0b5c00 legacy=0x7f9a5c14a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a6202a700 1 -- 172.21.15.133:0/2071964286 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c0b56a0 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a61829700 1 --2- 172.21.15.133:0/2071964286 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9a5c0b0c90 0x7f9a5c098ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a6202a700 1 --2- 172.21.15.133:0/2071964286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a5c0b52c0 0x7f9a5c0b05e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f9a54001bf0 tx=0x7f9a4c006dc0).ready entity=mon.1 client_cookie=f9f9f8fbacaebf65 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:22.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a61028700 1 -- 172.21.15.133:0/2071964286 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a54001a50 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a61028700 1 -- 172.21.15.133:0/2071964286 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4c00d570 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a61028700 1 -- 172.21.15.133:0/2071964286 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a4c00d6e0 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a6302c700 1 -- 172.21.15.133:0/2071964286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a5c0b52c0 msgr2=0x7f9a5c0b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a6302c700 1 --2- 172.21.15.133:0/2071964286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a5c0b52c0 0x7f9a5c0b05e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f9a54001bf0 tx=0x7f9a4c006dc0).stop 2021-01-03T13:00:22.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a6302c700 1 -- 172.21.15.133:0/2071964286 shutdown_connections 2021-01-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a6302c700 1 --2- 172.21.15.133:0/2071964286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a5c0b52c0 0x7f9a5c0b05e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a6302c700 1 --2- 172.21.15.133:0/2071964286 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9a5c0b0c90 0x7f9a5c098ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a6302c700 1 -- 172.21.15.133:0/2071964286 >> 172.21.15.133:0/2071964286 conn(0x7f9a5c05bdf0 msgr2=0x7f9a5c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a6302c700 1 -- 172.21.15.133:0/2071964286 shutdown_connections 2021-01-03T13:00:22.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a6302c700 1 -- 172.21.15.133:0/2071964286 wait complete. 2021-01-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a6302c700 1 Processor -- start 2021-01-03T13:00:22.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.495+0000 7f9a6302c700 1 -- start start 2021-01-03T13:00:22.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a6302c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a5c0b0c90 0x7f9a5c0b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a6302c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a5c0b52c0 0x7f9a5c0ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a6302c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9a5c0b5c00 0x7f9a5c0ad660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a6302c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0adb50 con 0x7f9a5c0b0c90 2021-01-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a6302c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c066820 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a6302c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5c0ae9b0 con 0x7f9a5c0b5c00 2021-01-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a61829700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a5c0b52c0 0x7f9a5c0ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a61829700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a5c0b52c0 0x7f9a5c0ad170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33896/0 (socket says 172.21.15.133:33896) 2021-01-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a61829700 1 -- 172.21.15.133:0/834128463 learned_addr learned my addr 172.21.15.133:0/834128463 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a6202a700 1 --2- 172.21.15.133:0/834128463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a5c0b0c90 0x7f9a5c0b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a6282b700 1 --2- 172.21.15.133:0/834128463 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9a5c0b5c00 0x7f9a5c0ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a61829700 1 -- 172.21.15.133:0/834128463 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9a5c0b5c00 msgr2=0x7f9a5c0ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a61829700 1 --2- 172.21.15.133:0/834128463 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9a5c0b5c00 0x7f9a5c0ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a61829700 1 -- 172.21.15.133:0/834128463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a5c0b0c90 msgr2=0x7f9a5c0b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a61829700 1 --2- 172.21.15.133:0/834128463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a5c0b0c90 0x7f9a5c0b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a61829700 1 -- 172.21.15.133:0/834128463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c0670a0 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a61829700 1 --2- 172.21.15.133:0/834128463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a5c0b52c0 0x7f9a5c0ad170 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f9a5800c000 tx=0x7f9a58006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a4b7fe700 1 -- 172.21.15.133:0/834128463 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a5800cda0 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a6302c700 1 -- 172.21.15.133:0/834128463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5c067540 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a4b7fe700 1 -- 172.21.15.133:0/834128463 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a580123f0 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a6302c700 1 -- 172.21.15.133:0/834128463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5c066a40 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a4b7fe700 1 -- 172.21.15.133:0/834128463 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a58012750 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a6302c700 1 -- 172.21.15.133:0/834128463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5c067230 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.499+0000 7f9a4b7fe700 1 -- 172.21.15.133:0/834128463 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9a580128b0 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.503+0000 7f9a4b7fe700 1 --2- 172.21.15.133:0/834128463 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9a3c055440 0x7f9a3c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.503+0000 7f9a4b7fe700 1 -- 172.21.15.133:0/834128463 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9a5806e840 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.503+0000 7f9a6202a700 1 --2- 172.21.15.133:0/834128463 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9a3c055440 0x7f9a3c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.503+0000 7f9a6202a700 1 --2- 172.21.15.133:0/834128463 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9a3c055440 0x7f9a3c057900 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f9a4c018000 tx=0x7f9a4c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:22.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.511+0000 7f9a4b7fe700 1 -- 172.21.15.133:0/834128463 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9a580449b0 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.695+0000 7f9a6302c700 1 -- 172.21.15.133:0/834128463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a5c0aeb40 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.695+0000 7f9a4b7fe700 1 -- 172.21.15.133:0/834128463 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2494 (secure 0 0 0) 0x7f9a58047fd0 con 0x7f9a5c0b52c0 2021-01-03T13:00:22.695 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:00:22.695 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5169,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/126912106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":126912106},{"type":"v1","addr":"172.21.15.16:6833","nonce":126912106}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13},{"gid":5212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/1241297212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1241297212},{"type":"v1","addr":"172.21.15.133:6835","nonce":1241297212}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:00:01.768700+0000","modified":"2021-01-03T13:00:02.771604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5218":{"gid":5218,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2379309183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2379309183},{"type":"v1","addr":"172.21.15.133:6837","nonce":2379309183}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-01-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.699+0000 7f9a6302c700 1 -- 172.21.15.133:0/834128463 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9a3c055440 msgr2=0x7f9a3c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.699+0000 7f9a6302c700 1 --2- 172.21.15.133:0/834128463 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9a3c055440 0x7f9a3c057900 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f9a4c018000 tx=0x7f9a4c015000).stop 2021-01-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.699+0000 7f9a6302c700 1 -- 172.21.15.133:0/834128463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a5c0b52c0 msgr2=0x7f9a5c0ad170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.699+0000 7f9a6302c700 1 --2- 172.21.15.133:0/834128463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a5c0b52c0 0x7f9a5c0ad170 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f9a5800c000 tx=0x7f9a58006dc0).stop 2021-01-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.699+0000 7f9a6302c700 1 -- 172.21.15.133:0/834128463 shutdown_connections 2021-01-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.699+0000 7f9a6302c700 1 --2- 172.21.15.133:0/834128463 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9a3c055440 0x7f9a3c057900 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.699+0000 7f9a6302c700 1 --2- 172.21.15.133:0/834128463 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a5c0b0c90 0x7f9a5c0b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.699+0000 7f9a6302c700 1 --2- 172.21.15.133:0/834128463 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9a5c0b5c00 0x7f9a5c0ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.699+0000 7f9a6302c700 1 --2- 172.21.15.133:0/834128463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9a5c0b52c0 0x7f9a5c0ad170 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.699+0000 7f9a6302c700 1 -- 172.21.15.133:0/834128463 >> 172.21.15.133:0/834128463 conn(0x7f9a5c05bdf0 msgr2=0x7f9a5c0b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.699+0000 7f9a6302c700 1 -- 172.21.15.133:0/834128463 shutdown_connections 2021-01-03T13:00:22.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.699+0000 7f9a6302c700 1 -- 172.21.15.133:0/834128463 wait complete. 2021-01-03T13:00:22.700 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 16 2021-01-03T13:00:22.715 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mds.a cache drop 2021-01-03T13:00:22.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.831+0000 7f541a024700 1 Processor -- start 2021-01-03T13:00:22.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.831+0000 7f541a024700 1 -- start start 2021-01-03T13:00:22.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f541a024700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f54140b52c0 0x7f54140b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f541a024700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f54140b0c90 0x7f5414098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f541a024700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f54140b5c00 0x7f541414a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f541a024700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5414067a90 con 0x7f54140b0c90 2021-01-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f541a024700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5414060da0 con 0x7f54140b52c0 2021-01-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f541a024700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54140b0ad0 con 0x7f54140b5c00 2021-01-03T13:00:22.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f5419022700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f54140b52c0 0x7f54140b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f5419022700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f54140b52c0 0x7f54140b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33906/0 (socket says 172.21.15.133:33906) 2021-01-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f5419022700 1 -- 172.21.15.133:0/2891801494 learned_addr learned my addr 172.21.15.133:0/2891801494 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f5418821700 1 --2- 172.21.15.133:0/2891801494 >> v2:172.21.15.16:3300/0 conn(0x7f54140b0c90 0x7f5414098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f5419823700 1 --2- 172.21.15.133:0/2891801494 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f54140b5c00 0x7f541414a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f5419022700 1 -- 172.21.15.133:0/2891801494 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f54140b5c00 msgr2=0x7f541414a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f5419022700 1 --2- 172.21.15.133:0/2891801494 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f54140b5c00 0x7f541414a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f5419022700 1 -- 172.21.15.133:0/2891801494 >> v2:172.21.15.16:3300/0 conn(0x7f54140b0c90 msgr2=0x7f5414098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f5419022700 1 --2- 172.21.15.133:0/2891801494 >> v2:172.21.15.16:3300/0 conn(0x7f54140b0c90 0x7f5414098ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f5419022700 1 -- 172.21.15.133:0/2891801494 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54140b56a0 con 0x7f54140b52c0 2021-01-03T13:00:22.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f5419022700 1 --2- 172.21.15.133:0/2891801494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54140b52c0 0x7f54140b05e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f5410002f30 tx=0x7f5410006e80).ready entity=mon.1 client_cookie=6246c0ba9d14d276 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f540bfff700 1 -- 172.21.15.133:0/2891801494 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5410009640 con 0x7f54140b52c0 2021-01-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f540bfff700 1 -- 172.21.15.133:0/2891801494 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54100097a0 con 0x7f54140b52c0 2021-01-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f540bfff700 1 -- 172.21.15.133:0/2891801494 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5410009b00 con 0x7f54140b52c0 2021-01-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f541a024700 1 -- 172.21.15.133:0/2891801494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54140b52c0 msgr2=0x7f54140b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f541a024700 1 --2- 172.21.15.133:0/2891801494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54140b52c0 0x7f54140b05e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f5410002f30 tx=0x7f5410006e80).stop 2021-01-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f541a024700 1 -- 172.21.15.133:0/2891801494 shutdown_connections 2021-01-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f541a024700 1 --2- 172.21.15.133:0/2891801494 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f54140b5c00 0x7f541414a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f541a024700 1 --2- 172.21.15.133:0/2891801494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54140b52c0 0x7f54140b05e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f541a024700 1 --2- 172.21.15.133:0/2891801494 >> v2:172.21.15.16:3300/0 conn(0x7f54140b0c90 0x7f5414098ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f541a024700 1 -- 172.21.15.133:0/2891801494 >> 172.21.15.133:0/2891801494 conn(0x7f541405bdf0 msgr2=0x7f541405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f541a024700 1 -- 172.21.15.133:0/2891801494 shutdown_connections 2021-01-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.835+0000 7f541a024700 1 -- 172.21.15.133:0/2891801494 wait complete. 2021-01-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f541a024700 1 Processor -- start 2021-01-03T13:00:22.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f541a024700 1 -- start start 2021-01-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f541a024700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54140b0c90 0x7f54140b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f541a024700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f54140b52c0 0x7f5414066a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f541a024700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54140b5c00 0x7f54140637c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f541a024700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54140aede0 con 0x7f54140b5c00 2021-01-03T13:00:22.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f541a024700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54140adec0 con 0x7f54140b0c90 2021-01-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f541a024700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54140ae160 con 0x7f54140b52c0 2021-01-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f5419022700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54140b0c90 0x7f54140b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f5419022700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54140b0c90 0x7f54140b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33910/0 (socket says 172.21.15.133:33910) 2021-01-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f5419022700 1 -- 172.21.15.133:0/566653545 learned_addr learned my addr 172.21.15.133:0/566653545 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:22.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f5418821700 1 --2- 172.21.15.133:0/566653545 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f54140b52c0 0x7f5414066a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f5419823700 1 --2- 172.21.15.133:0/566653545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54140b5c00 0x7f54140637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f5419022700 1 -- 172.21.15.133:0/566653545 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f54140b52c0 msgr2=0x7f5414066a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f5419022700 1 --2- 172.21.15.133:0/566653545 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f54140b52c0 0x7f5414066a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f5419022700 1 -- 172.21.15.133:0/566653545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54140b5c00 msgr2=0x7f54140637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f5419022700 1 --2- 172.21.15.133:0/566653545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54140b5c00 0x7f54140637c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f5419022700 1 -- 172.21.15.133:0/566653545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5414066560 con 0x7f54140b0c90 2021-01-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f5419022700 1 --2- 172.21.15.133:0/566653545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54140b0c90 0x7f54140b3ec0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f5410002f30 tx=0x7f5410015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f540a7fc700 1 -- 172.21.15.133:0/566653545 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5410011b80 con 0x7f54140b0c90 2021-01-03T13:00:22.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f540a7fc700 1 -- 172.21.15.133:0/566653545 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5410011ce0 con 0x7f54140b0c90 2021-01-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f541a024700 1 -- 172.21.15.133:0/566653545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54140ae400 con 0x7f54140b0c90 2021-01-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f540a7fc700 1 -- 172.21.15.133:0/566653545 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f541001d640 con 0x7f54140b0c90 2021-01-03T13:00:22.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.839+0000 7f541a024700 1 -- 172.21.15.133:0/566653545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54140ae8d0 con 0x7f54140b0c90 2021-01-03T13:00:22.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.843+0000 7f540a7fc700 1 -- 172.21.15.133:0/566653545 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f541000f070 con 0x7f54140b0c90 2021-01-03T13:00:22.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.843+0000 7f540a7fc700 1 --2- 172.21.15.133:0/566653545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53fc055440 0x7f53fc057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.843+0000 7f540a7fc700 1 -- 172.21.15.133:0/566653545 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f541006f9c0 con 0x7f54140b0c90 2021-01-03T13:00:22.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.843+0000 7f5418821700 1 --2- 172.21.15.133:0/566653545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53fc055440 0x7f53fc057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.843+0000 7f5418821700 1 --2- 172.21.15.133:0/566653545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53fc055440 0x7f53fc057900 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f540400b000 tx=0x7f5404008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5429c21740 1 Processor -- start 2021-01-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5429c21740 1 -- start start 2021-01-03T13:00:22.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5429c21740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xdf0750 0xe3aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5429c21740 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xc58800 0xe72a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5429c21740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe72f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5429c21740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0xd5ed60 con 0xdf0750 2021-01-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5429c21740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0xc71690 con 0xbeac00 2021-01-03T13:00:22.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5429c21740 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0xd94e00 con 0xc58800 2021-01-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5419823700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe72f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5419823700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe72f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33920/0 (socket says 172.21.15.133:33920) 2021-01-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5419823700 1 -- 172.21.15.133:0/2350148527 learned_addr learned my addr 172.21.15.133:0/2350148527 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5419022700 1 --2- 172.21.15.133:0/2350148527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xdf0750 0xe3aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5418821700 1 --2- 172.21.15.133:0/2350148527 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xc58800 0xe72a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5419823700 1 -- 172.21.15.133:0/2350148527 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xc58800 msgr2=0xe72a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5419823700 1 --2- 172.21.15.133:0/2350148527 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xc58800 0xe72a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5419823700 1 -- 172.21.15.133:0/2350148527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xdf0750 msgr2=0xe3aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:22.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5419823700 1 --2- 172.21.15.133:0/2350148527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xdf0750 0xe3aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5419823700 1 -- 172.21.15.133:0/2350148527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd74d20 con 0xbeac00 2021-01-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5419022700 1 --2- 172.21.15.133:0/2350148527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xdf0750 0xe3aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5419823700 1 --2- 172.21.15.133:0/2350148527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe72f80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0xe3d830 tx=0x7f540c008040).ready entity=mon.1 client_cookie=5f0829222569f38d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f541a024700 1 -- 172.21.15.133:0/2350148527 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540c011ab0 con 0xbeac00 2021-01-03T13:00:22.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f541a024700 1 -- 172.21.15.133:0/2350148527 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540c011c10 con 0xbeac00 2021-01-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f541a024700 1 -- 172.21.15.133:0/2350148527 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540c015480 con 0xbeac00 2021-01-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5429c21740 1 -- 172.21.15.133:0/2350148527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 msgr2=0xe72f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.847+0000 7f5429c21740 1 --2- 172.21.15.133:0/2350148527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe72f80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0xe3d830 tx=0x7f540c008040).stop 2021-01-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5429c21740 1 -- 172.21.15.133:0/2350148527 shutdown_connections 2021-01-03T13:00:22.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5429c21740 1 --2- 172.21.15.133:0/2350148527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xdf0750 0xe3aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5429c21740 1 --2- 172.21.15.133:0/2350148527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe72f80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5429c21740 1 --2- 172.21.15.133:0/2350148527 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xc58800 0xe72a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5429c21740 1 -- 172.21.15.133:0/2350148527 >> 172.21.15.133:0/2350148527 conn(0xe1ff30 msgr2=0xe3bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5429c21740 1 -- 172.21.15.133:0/2350148527 shutdown_connections 2021-01-03T13:00:22.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5429c21740 1 -- 172.21.15.133:0/2350148527 wait complete. 2021-01-03T13:00:22.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5429c21740 1 -- start start 2021-01-03T13:00:22.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5429c21740 1 Processor -- start 2021-01-03T13:00:22.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5429c21740 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xbeac00 0xe69820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5429c21740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xc58800 0xe69d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5429c21740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xdf0750 0xe81890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5429c21740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0xd94f40 con 0xc58800 2021-01-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5429c21740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0xd96510 con 0xdf0750 2021-01-03T13:00:22.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5429c21740 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0xd77790 con 0xbeac00 2021-01-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5429c21740 10 client.0 ll_register_callbacks cb 0xe1fe90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-01-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5419823700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xdf0750 0xe81890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5419823700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xdf0750 0xe81890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33928/0 (socket says 172.21.15.133:33928) 2021-01-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5419823700 1 -- 172.21.15.133:0/3566498959 learned_addr learned my addr 172.21.15.133:0/3566498959 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:22.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5419022700 1 --2- 172.21.15.133:0/3566498959 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xbeac00 0xe69820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5418821700 1 --2- 172.21.15.133:0/3566498959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xc58800 0xe69d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5419823700 1 -- 172.21.15.133:0/3566498959 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xbeac00 msgr2=0xe69820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5419823700 1 --2- 172.21.15.133:0/3566498959 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xbeac00 0xe69820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5419823700 1 -- 172.21.15.133:0/3566498959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xc58800 msgr2=0xe69d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:22.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.851+0000 7f5419823700 1 --2- 172.21.15.133:0/3566498959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xc58800 0xe69d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5419823700 1 -- 172.21.15.133:0/3566498959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xd85ff0 con 0xdf0750 2021-01-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5419823700 1 --2- 172.21.15.133:0/3566498959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xdf0750 0xe81890 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0xe3d830 tx=0x7f540c01c000).ready entity=mon.1 client_cookie=bb13194ed97b8aeb server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f53effff700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2021-01-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f53effff700 1 -- 172.21.15.133:0/3566498959 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540c015e40 con 0xdf0750 2021-01-03T13:00:22.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 1 -- 172.21.15.133:0/3566498959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xc7d8b0 con 0xdf0750 2021-01-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f53effff700 1 -- 172.21.15.133:0/3566498959 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f540c01e3f0 con 0xdf0750 2021-01-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f53effff700 1 -- 172.21.15.133:0/3566498959 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f540c01e5b0 con 0xdf0750 2021-01-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 10 client.5407 fetch_fsmap learned FSMap version 16 2021-01-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 1 -- 172.21.15.133:0/3566498959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0xc08770 con 0xdf0750 2021-01-03T13:00:22.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f53effff700 1 -- 172.21.15.133:0/3566498959 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xc7d8b0 con 0xdf0750 2021-01-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f53effff700 1 -- 172.21.15.133:0/3566498959 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 16) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f540c027410 con 0xdf0750 2021-01-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 10 client.5407 fetch_fsmap finished waiting for FSMap version 16 2021-01-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 10 client.5407 resolve_mds: resolved ID 'a' to GID 5218 2021-01-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 20 client.5407 populate_metadata read hostname 'smithi133' 2021-01-03T13:00:22.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 1 --2- 172.21.15.133:0/3566498959 >> [v2:172.21.15.133:6836/2379309183,v1:172.21.15.133:6837/2379309183] conn(0xe70690 0xe72a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 4 client.5407 mds_command: new command op to 5218 tid=0[{"prefix": "get_command_descriptions"}] 2021-01-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 1 -- 172.21.15.133:0/3566498959 --> [v2:172.21.15.133:6836/2379309183,v1:172.21.15.133:6837/2379309183] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xc4e4b0 con 0xe70690 2021-01-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5419022700 1 --2- 172.21.15.133:0/3566498959 >> [v2:172.21.15.133:6836/2379309183,v1:172.21.15.133:6837/2379309183] conn(0xe70690 0xe72a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5419022700 1 --2- 172.21.15.133:0/3566498959 >> [v2:172.21.15.133:6836/2379309183,v1:172.21.15.133:6837/2379309183] conn(0xe70690 0xe72a20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5079a062803c1d1e server_cookie=6ae312c9984240a1 in_seq=0 out_seq=0 2021-01-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f53effff700 10 client.5407 ms_handle_connect on v2:172.21.15.133:6836/2379309183 2021-01-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f53effff700 1 -- 172.21.15.133:0/3566498959 <== mds.0 v2:172.21.15.133:6836/2379309183 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0xc4e4b0 con 0xe70690 2021-01-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f53effff700 10 client.5407 handle_command_reply: tid=0 2021-01-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 1 client.5407 shutdown 2021-01-03T13:00:22.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 1 -- 172.21.15.133:0/3566498959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xdf0750 msgr2=0xe81890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 1 --2- 172.21.15.133:0/3566498959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xdf0750 0xe81890 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0xe3d830 tx=0x7f540c01c000).stop 2021-01-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 1 -- 172.21.15.133:0/3566498959 shutdown_connections 2021-01-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 1 --2- 172.21.15.133:0/3566498959 >> [v2:172.21.15.133:6836/2379309183,v1:172.21.15.133:6837/2379309183] conn(0xe70690 0xe72a20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 1 --2- 172.21.15.133:0/3566498959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xdf0750 0xe81890 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 1 --2- 172.21.15.133:0/3566498959 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xbeac00 0xe69820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 1 --2- 172.21.15.133:0/3566498959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xc58800 0xe69d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f53effff700 0 client.5407 ms_handle_reset on v2:172.21.15.133:6836/2379309183 2021-01-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 1 -- 172.21.15.133:0/3566498959 >> 172.21.15.133:0/3566498959 conn(0xe1ff30 msgr2=0xe6cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 1 -- 172.21.15.133:0/3566498959 shutdown_connections 2021-01-03T13:00:22.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 1 -- 172.21.15.133:0/3566498959 wait complete. 2021-01-03T13:00:22.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.855+0000 7f5429c21740 20 client.5407 trim_cache size 0 max 16384 2021-01-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.871+0000 7f5429c21740 1 Processor -- start 2021-01-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.871+0000 7f5429c21740 1 -- start start 2021-01-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5429c21740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe38600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5429c21740 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xc58800 0xe3b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5429c21740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xdf0750 0xe3b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5429c21740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0xe3bbd0 con 0xdf0750 2021-01-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5429c21740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0xe36d10 con 0xbeac00 2021-01-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5429c21740 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0xc4e4b0 con 0xc58800 2021-01-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5419022700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe38600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5419022700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe38600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33932/0 (socket says 172.21.15.133:33932) 2021-01-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5419022700 1 -- 172.21.15.133:0/3627885369 learned_addr learned my addr 172.21.15.133:0/3627885369 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5419823700 1 --2- 172.21.15.133:0/3627885369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xdf0750 0xe3b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5418821700 1 --2- 172.21.15.133:0/3627885369 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xc58800 0xe3b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5419022700 1 -- 172.21.15.133:0/3627885369 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xc58800 msgr2=0xe3b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5419022700 1 --2- 172.21.15.133:0/3627885369 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xc58800 0xe3b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5419022700 1 -- 172.21.15.133:0/3627885369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xdf0750 msgr2=0xe3b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5419022700 1 --2- 172.21.15.133:0/3627885369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xdf0750 0xe3b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5419022700 1 -- 172.21.15.133:0/3627885369 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541405fda0 con 0xbeac00 2021-01-03T13:00:22.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5419022700 1 --2- 172.21.15.133:0/3627885369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe38600 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f541001e000 tx=0x7f541001f040).ready entity=mon.1 client_cookie=9e3101dd4e215056 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f53f67fc700 1 -- 172.21.15.133:0/3627885369 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5410036040 con 0xbeac00 2021-01-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f53f67fc700 1 -- 172.21.15.133:0/3627885369 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5410048ad0 con 0xbeac00 2021-01-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f53f67fc700 1 -- 172.21.15.133:0/3627885369 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f541001d7a0 con 0xbeac00 2021-01-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5429c21740 1 -- 172.21.15.133:0/3627885369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 msgr2=0xe38600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:22.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5429c21740 1 --2- 172.21.15.133:0/3627885369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe38600 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f541001e000 tx=0x7f541001f040).stop 2021-01-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5429c21740 1 -- 172.21.15.133:0/3627885369 shutdown_connections 2021-01-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5429c21740 1 --2- 172.21.15.133:0/3627885369 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xdf0750 0xe3b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5429c21740 1 --2- 172.21.15.133:0/3627885369 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe38600 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5429c21740 1 --2- 172.21.15.133:0/3627885369 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xc58800 0xe3b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5429c21740 1 -- 172.21.15.133:0/3627885369 >> 172.21.15.133:0/3627885369 conn(0xe1ff30 msgr2=0xe82250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5429c21740 1 -- 172.21.15.133:0/3627885369 shutdown_connections 2021-01-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5429c21740 1 -- 172.21.15.133:0/3627885369 wait complete. 2021-01-03T13:00:22.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5429c21740 1 -- start start 2021-01-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.875+0000 7f5429c21740 1 Processor -- start 2021-01-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5429c21740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe72640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5429c21740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xc58800 0xe69970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5429c21740 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xdf0750 0xe6b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5429c21740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0xe6da30 con 0xc58800 2021-01-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5429c21740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0xe69540 con 0xbeac00 2021-01-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5429c21740 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0xe3a330 con 0xdf0750 2021-01-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5419022700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe72640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5419022700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe72640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33938/0 (socket says 172.21.15.133:33938) 2021-01-03T13:00:22.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5419022700 1 -- 172.21.15.133:0/1757142989 learned_addr learned my addr 172.21.15.133:0/1757142989 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5429c21740 10 client.0 ll_register_callbacks cb 0xe70b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-01-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5419022700 1 -- 172.21.15.133:0/1757142989 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xdf0750 msgr2=0xe6b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5418821700 1 --2- 172.21.15.133:0/1757142989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xc58800 0xe69970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5419823700 1 --2- 172.21.15.133:0/1757142989 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xdf0750 0xe6b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5419022700 1 --2- 172.21.15.133:0/1757142989 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xdf0750 0xe6b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5419022700 1 -- 172.21.15.133:0/1757142989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xc58800 msgr2=0xe69970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5419022700 1 --2- 172.21.15.133:0/1757142989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xc58800 0xe69970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5419022700 1 -- 172.21.15.133:0/1757142989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xc13e50 con 0xbeac00 2021-01-03T13:00:22.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5418821700 1 --2- 172.21.15.133:0/1757142989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xc58800 0xe69970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5419823700 1 --2- 172.21.15.133:0/1757142989 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xdf0750 0xe6b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f53f57fa700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2021-01-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5419022700 1 --2- 172.21.15.133:0/1757142989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe72640 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f541001e000 tx=0x7f541003a000).ready entity=mon.1 client_cookie=f7c558811b596893 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f53f57fa700 1 -- 172.21.15.133:0/1757142989 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5410036040 con 0xbeac00 2021-01-03T13:00:22.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5429c21740 1 -- 172.21.15.133:0/1757142989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xc9c710 con 0xbeac00 2021-01-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f53f57fa700 1 -- 172.21.15.133:0/1757142989 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f541006f4c0 con 0xbeac00 2021-01-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f53f57fa700 1 -- 172.21.15.133:0/1757142989 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f541006f680 con 0xbeac00 2021-01-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5429c21740 10 client.5413 fetch_fsmap learned FSMap version 16 2021-01-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5429c21740 1 -- 172.21.15.133:0/1757142989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0xd66e40 con 0xbeac00 2021-01-03T13:00:22.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f53f57fa700 1 -- 172.21.15.133:0/1757142989 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xc9c710 con 0xbeac00 2021-01-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f53f57fa700 1 -- 172.21.15.133:0/1757142989 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 16) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f541001a030 con 0xbeac00 2021-01-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5429c21740 10 client.5413 fetch_fsmap finished waiting for FSMap version 16 2021-01-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5429c21740 10 client.5413 resolve_mds: resolved ID 'a' to GID 5218 2021-01-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5429c21740 20 client.5413 populate_metadata read hostname 'smithi133' 2021-01-03T13:00:22.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5429c21740 1 --2- 172.21.15.133:0/1757142989 >> [v2:172.21.15.133:6836/2379309183,v1:172.21.15.133:6837/2379309183] conn(0xe69e60 0xe6b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5429c21740 4 client.5413 mds_command: new command op to 5218 tid=0[{"prefix": "cache drop"}] 2021-01-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5429c21740 1 -- 172.21.15.133:0/1757142989 --> [v2:172.21.15.133:6836/2379309183,v1:172.21.15.133:6837/2379309183] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0xbea150 con 0xe69e60 2021-01-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.879+0000 7f5418821700 1 --2- 172.21.15.133:0/1757142989 >> [v2:172.21.15.133:6836/2379309183,v1:172.21.15.133:6837/2379309183] conn(0xe69e60 0xe6b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.883+0000 7f53f57fa700 10 client.5413 ms_handle_connect on v2:172.21.15.133:6836/2379309183 2021-01-03T13:00:22.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:22.883+0000 7f5418821700 1 --2- 172.21.15.133:0/1757142989 >> [v2:172.21.15.133:6836/2379309183,v1:172.21.15.133:6837/2379309183] conn(0xe69e60 0xe6b840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5aee3451ada27993 server_cookie=6bb3adfd93faba7f in_seq=0 out_seq=0 2021-01-03T13:00:34.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.147+0000 7f53f57fa700 1 -- 172.21.15.133:0/1757142989 <== mds.0 v2:172.21.15.133:6836/2379309183 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+386 (crc 0 0 0) 0xbea150 con 0xe69e60 2021-01-03T13:00:34.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.147+0000 7f53f57fa700 10 client.5413 handle_command_reply: tid=0 2021-01-03T13:00:34.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.147+0000 7f5429c21740 1 client.5413 shutdown 2021-01-03T13:00:34.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.147+0000 7f5429c21740 1 -- 172.21.15.133:0/1757142989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 msgr2=0xe72640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.147+0000 7f5429c21740 1 --2- 172.21.15.133:0/1757142989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe72640 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f541001e000 tx=0x7f541003a000).stop 2021-01-03T13:00:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.147+0000 7f5429c21740 1 -- 172.21.15.133:0/1757142989 shutdown_connections 2021-01-03T13:00:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.147+0000 7f5429c21740 1 --2- 172.21.15.133:0/1757142989 >> [v2:172.21.15.133:6836/2379309183,v1:172.21.15.133:6837/2379309183] conn(0xe69e60 0xe6b840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.147+0000 7f5429c21740 1 --2- 172.21.15.133:0/1757142989 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0xdf0750 0xe6b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.147+0000 7f5429c21740 1 --2- 172.21.15.133:0/1757142989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0xbeac00 0xe72640 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.147+0000 7f5429c21740 1 --2- 172.21.15.133:0/1757142989 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0xc58800 0xe69970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.147+0000 7f5429c21740 1 -- 172.21.15.133:0/1757142989 >> 172.21.15.133:0/1757142989 conn(0xe1ff30 msgr2=0xe84f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:34.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.147+0000 7f53f57fa700 0 client.5413 ms_handle_reset on v2:172.21.15.133:6836/2379309183 2021-01-03T13:00:34.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.147+0000 7f5429c21740 1 -- 172.21.15.133:0/1757142989 shutdown_connections 2021-01-03T13:00:34.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.147+0000 7f5429c21740 1 -- 172.21.15.133:0/1757142989 wait complete. 2021-01-03T13:00:34.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.147+0000 7f5429c21740 20 client.5413 trim_cache size 0 max 16384 2021-01-03T13:00:34.151 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:00:34.151 INFO:teuthology.orchestra.run.smithi133.stdout: "client_recall": { 2021-01-03T13:00:34.151 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0, 2021-01-03T13:00:34.152 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "(0) Success", 2021-01-03T13:00:34.152 INFO:teuthology.orchestra.run.smithi133.stdout: "recalled": 220 2021-01-03T13:00:34.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:00:34.152 INFO:teuthology.orchestra.run.smithi133.stdout: "flush_journal": { 2021-01-03T13:00:34.152 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0, 2021-01-03T13:00:34.153 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "" 2021-01-03T13:00:34.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:00:34.153 INFO:teuthology.orchestra.run.smithi133.stdout: "trim_cache": { 2021-01-03T13:00:34.153 INFO:teuthology.orchestra.run.smithi133.stdout: "trimmed": 0 2021-01-03T13:00:34.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:00:34.154 INFO:teuthology.orchestra.run.smithi133.stdout: "cache": { 2021-01-03T13:00:34.154 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": { 2021-01-03T13:00:34.154 INFO:teuthology.orchestra.run.smithi133.stdout: "items": 19985, 2021-01-03T13:00:34.154 INFO:teuthology.orchestra.run.smithi133.stdout: "bytes": 3099360 2021-01-03T13:00:34.154 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:00:34.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:00:34.155 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 11.265958363999999 2021-01-03T13:00:34.155 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:00:34.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.151+0000 7f541a024700 1 -- 172.21.15.133:0/566653545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53fc055440 msgr2=0x7f53fc057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:34.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.151+0000 7f541a024700 1 --2- 172.21.15.133:0/566653545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53fc055440 0x7f53fc057900 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f540400b000 tx=0x7f5404008040).stop 2021-01-03T13:00:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.151+0000 7f541a024700 1 -- 172.21.15.133:0/566653545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54140b0c90 msgr2=0x7f54140b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.151+0000 7f541a024700 1 --2- 172.21.15.133:0/566653545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54140b0c90 0x7f54140b3ec0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f5410002f30 tx=0x7f5410015000).stop 2021-01-03T13:00:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.151+0000 7f541a024700 1 -- 172.21.15.133:0/566653545 shutdown_connections 2021-01-03T13:00:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.151+0000 7f541a024700 1 --2- 172.21.15.133:0/566653545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53fc055440 0x7f53fc057900 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.151+0000 7f541a024700 1 --2- 172.21.15.133:0/566653545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54140b5c00 0x7f54140637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.151+0000 7f541a024700 1 --2- 172.21.15.133:0/566653545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54140b0c90 0x7f54140b3ec0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.151+0000 7f541a024700 1 --2- 172.21.15.133:0/566653545 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f54140b52c0 0x7f5414066a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.151+0000 7f541a024700 1 -- 172.21.15.133:0/566653545 >> 172.21.15.133:0/566653545 conn(0x7f541405bdf0 msgr2=0x7f54141467c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:34.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.151+0000 7f541a024700 1 -- 172.21.15.133:0/566653545 shutdown_connections 2021-01-03T13:00:34.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.151+0000 7f541a024700 1 -- 172.21.15.133:0/566653545 wait complete. 2021-01-03T13:00:34.159 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-01-03T13:00:34.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:34.161 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:00:34.161 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:00:34.169 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-01-03T13:00:34.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:00:34.170 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-01-03T13:00:34.170 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T13:00:34.171 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:00:34.171 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:00:34.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:34.245 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:00:34.245 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:00:34.293 INFO:teuthology.orchestra.run.smithi007.stdout:ext2/ext3 2021-01-03T13:00:34.294 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:00:34.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:00:34.295 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:00:34.342 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:00:34.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.455+0000 7f2381cd6700 1 Processor -- start 2021-01-03T13:00:34.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.455+0000 7f2381cd6700 1 -- start start 2021-01-03T13:00:34.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.455+0000 7f2381cd6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f237c0af200 0x7f237c05bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:34.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.455+0000 7f2381cd6700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f237c0b0210 0x7f237c141180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:34.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.455+0000 7f2381cd6700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237c0af5e0 con 0x7f237c144bb0 2021-01-03T13:00:34.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.455+0000 7f2381cd6700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c05c620 con 0x7f237c0b0210 2021-01-03T13:00:34.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.455+0000 7f2381cd6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c05c8c0 con 0x7f237c0af200 2021-01-03T13:00:34.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.455+0000 7f2380cd4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f237c0af200 0x7f237c05bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:34.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.455+0000 7f2380cd4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f237c0af200 0x7f237c05bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33948/0 (socket says 172.21.15.133:33948) 2021-01-03T13:00:34.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.455+0000 7f2380cd4700 1 -- 172.21.15.133:0/1478960165 learned_addr learned my addr 172.21.15.133:0/1478960165 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:34.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.455+0000 7f237bfff700 1 --2- 172.21.15.133:0/1478960165 >> v2:172.21.15.16:3300/0 conn(0x7f237c0b0210 0x7f237c141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:34.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.455+0000 7f2380cd4700 1 -- 172.21.15.133:0/1478960165 >> v2:172.21.15.16:3300/0 conn(0x7f237c0b0210 msgr2=0x7f237c141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:34.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.455+0000 7f2380cd4700 1 --2- 172.21.15.133:0/1478960165 >> v2:172.21.15.16:3300/0 conn(0x7f237c0b0210 0x7f237c141180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.455+0000 7f2380cd4700 1 -- 172.21.15.133:0/1478960165 >> v1:172.21.15.16:6789/0 conn(0x7f237c144bb0 legacy=0x7f237c0ab300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:34.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.455+0000 7f2380cd4700 1 -- 172.21.15.133:0/1478960165 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c140a40 con 0x7f237c0af200 2021-01-03T13:00:34.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2380cd4700 1 --2- 172.21.15.133:0/1478960165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f237c0af200 0x7f237c05bdf0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f2370002f30 tx=0x7f2370006e80).ready entity=mon.1 client_cookie=a86756308efc7573 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:34.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f237b7fe700 1 -- 172.21.15.133:0/1478960165 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23700097f0 con 0x7f237c0af200 2021-01-03T13:00:34.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f237b7fe700 1 -- 172.21.15.133:0/1478960165 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2370009950 con 0x7f237c0af200 2021-01-03T13:00:34.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f237b7fe700 1 -- 172.21.15.133:0/1478960165 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2370009cb0 con 0x7f237c0af200 2021-01-03T13:00:34.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2381cd6700 1 -- 172.21.15.133:0/1478960165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f237c0af200 msgr2=0x7f237c05bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:34.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2381cd6700 1 --2- 172.21.15.133:0/1478960165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f237c0af200 0x7f237c05bdf0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f2370002f30 tx=0x7f2370006e80).stop 2021-01-03T13:00:34.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2381cd6700 1 -- 172.21.15.133:0/1478960165 shutdown_connections 2021-01-03T13:00:34.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2381cd6700 1 --2- 172.21.15.133:0/1478960165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f237c0af200 0x7f237c05bdf0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2381cd6700 1 --2- 172.21.15.133:0/1478960165 >> v2:172.21.15.16:3300/0 conn(0x7f237c0b0210 0x7f237c141180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2381cd6700 1 -- 172.21.15.133:0/1478960165 >> 172.21.15.133:0/1478960165 conn(0x7f237c06b050 msgr2=0x7f237c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:34.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2381cd6700 1 -- 172.21.15.133:0/1478960165 shutdown_connections 2021-01-03T13:00:34.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2381cd6700 1 -- 172.21.15.133:0/1478960165 wait complete. 2021-01-03T13:00:34.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2381cd6700 1 Processor -- start 2021-01-03T13:00:34.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2381cd6700 1 -- start start 2021-01-03T13:00:34.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2381cd6700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f237c0af200 0x7f237c1430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:34.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2381cd6700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f237c0b0210 0x7f237c145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:34.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2381cd6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f237c144bb0 0x7f237c145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:34.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2381cd6700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c0ae490 con 0x7f237c0b0210 2021-01-03T13:00:34.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2381cd6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c1461f0 con 0x7f237c144bb0 2021-01-03T13:00:34.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2381cd6700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c146880 con 0x7f237c0af200 2021-01-03T13:00:34.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f23814d5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f237c144bb0 0x7f237c145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:34.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f23814d5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f237c144bb0 0x7f237c145d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33958/0 (socket says 172.21.15.133:33958) 2021-01-03T13:00:34.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f23814d5700 1 -- 172.21.15.133:0/3552721087 learned_addr learned my addr 172.21.15.133:0/3552721087 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:34.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f237bfff700 1 --2- 172.21.15.133:0/3552721087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f237c0b0210 0x7f237c145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:34.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2380cd4700 1 --2- 172.21.15.133:0/3552721087 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f237c0af200 0x7f237c1430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:34.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f23814d5700 1 -- 172.21.15.133:0/3552721087 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f237c0af200 msgr2=0x7f237c1430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:34.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f23814d5700 1 --2- 172.21.15.133:0/3552721087 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f237c0af200 0x7f237c1430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f23814d5700 1 -- 172.21.15.133:0/3552721087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f237c0b0210 msgr2=0x7f237c145810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:34.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f23814d5700 1 --2- 172.21.15.133:0/3552721087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f237c0b0210 0x7f237c145810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f23814d5700 1 -- 172.21.15.133:0/3552721087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c1454c0 con 0x7f237c144bb0 2021-01-03T13:00:34.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f2380cd4700 1 --2- 172.21.15.133:0/3552721087 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f237c0af200 0x7f237c1430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:34.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f237bfff700 1 --2- 172.21.15.133:0/3552721087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f237c0b0210 0x7f237c145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:34.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.459+0000 7f23814d5700 1 --2- 172.21.15.133:0/3552721087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f237c144bb0 0x7f237c145d00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f237c06b750 tx=0x7f2374007f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:34.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.463+0000 7f2379ffb700 1 -- 172.21.15.133:0/3552721087 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2374003080 con 0x7f237c144bb0 2021-01-03T13:00:34.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.463+0000 7f2379ffb700 1 -- 172.21.15.133:0/3552721087 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237400a7b0 con 0x7f237c144bb0 2021-01-03T13:00:34.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.463+0000 7f2379ffb700 1 -- 172.21.15.133:0/3552721087 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f237400ab10 con 0x7f237c144bb0 2021-01-03T13:00:34.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.463+0000 7f2381cd6700 1 -- 172.21.15.133:0/3552721087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237c0ae6c0 con 0x7f237c144bb0 2021-01-03T13:00:34.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.463+0000 7f2381cd6700 1 -- 172.21.15.133:0/3552721087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c0ae090 con 0x7f237c144bb0 2021-01-03T13:00:34.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.463+0000 7f2381cd6700 1 -- 172.21.15.133:0/3552721087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237c057300 con 0x7f237c144bb0 2021-01-03T13:00:34.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.463+0000 7f2379ffb700 1 -- 172.21.15.133:0/3552721087 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2374019030 con 0x7f237c144bb0 2021-01-03T13:00:34.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.463+0000 7f2379ffb700 1 --2- 172.21.15.133:0/3552721087 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f23640554e0 0x7f23640579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:34.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.463+0000 7f2380cd4700 1 --2- 172.21.15.133:0/3552721087 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f23640554e0 0x7f23640579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:34.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.463+0000 7f2379ffb700 1 -- 172.21.15.133:0/3552721087 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f237406d6a0 con 0x7f237c144bb0 2021-01-03T13:00:34.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.463+0000 7f2380cd4700 1 --2- 172.21.15.133:0/3552721087 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f23640554e0 0x7f23640579a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f237001a000 tx=0x7f2370015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:34.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.471+0000 7f2379ffb700 1 -- 172.21.15.133:0/3552721087 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f23740439a0 con 0x7f237c144bb0 2021-01-03T13:00:34.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.603+0000 7f2381cd6700 1 -- 172.21.15.133:0/3552721087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f237c141890 con 0x7f237c144bb0 2021-01-03T13:00:34.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.603+0000 7f2379ffb700 1 -- 172.21.15.133:0/3552721087 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16086 (secure 0 0 0) 0x7f2374046fc0 con 0x7f237c144bb0 2021-01-03T13:00:34.603 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:00:34.603 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":45,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:00:03.782001+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2021-01-03T12:59:59.319419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2021-01-03T13:00:00.624032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:00:34.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.607+0000 7f2381cd6700 1 -- 172.21.15.133:0/3552721087 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f23640554e0 msgr2=0x7f23640579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:34.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.607+0000 7f2381cd6700 1 --2- 172.21.15.133:0/3552721087 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f23640554e0 0x7f23640579a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f237001a000 tx=0x7f2370015000).stop 2021-01-03T13:00:34.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.607+0000 7f2381cd6700 1 -- 172.21.15.133:0/3552721087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f237c144bb0 msgr2=0x7f237c145d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:34.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.607+0000 7f2381cd6700 1 --2- 172.21.15.133:0/3552721087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f237c144bb0 0x7f237c145d00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f237c06b750 tx=0x7f2374007f40).stop 2021-01-03T13:00:34.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.607+0000 7f2381cd6700 1 -- 172.21.15.133:0/3552721087 shutdown_connections 2021-01-03T13:00:34.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.607+0000 7f2381cd6700 1 --2- 172.21.15.133:0/3552721087 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f23640554e0 0x7f23640579a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.607+0000 7f2381cd6700 1 --2- 172.21.15.133:0/3552721087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f237c144bb0 0x7f237c145d00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.607+0000 7f2381cd6700 1 --2- 172.21.15.133:0/3552721087 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f237c0af200 0x7f237c1430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.607+0000 7f2381cd6700 1 --2- 172.21.15.133:0/3552721087 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f237c0b0210 0x7f237c145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.607+0000 7f2381cd6700 1 -- 172.21.15.133:0/3552721087 >> 172.21.15.133:0/3552721087 conn(0x7f237c06b050 msgr2=0x7f237c0b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:34.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.607+0000 7f2381cd6700 1 -- 172.21.15.133:0/3552721087 shutdown_connections 2021-01-03T13:00:34.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.607+0000 7f2381cd6700 1 -- 172.21.15.133:0/3552721087 wait complete. 2021-01-03T13:00:34.615 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T12:59:59.319419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:00:00.624032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:00:34.616 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:00:34.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5942fc2700 1 Processor -- start 2021-01-03T13:00:34.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5942fc2700 1 -- start start 2021-01-03T13:00:34.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5942fc2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f593c0b4c20 0x7f593c05c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:34.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5942fc2700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f593c05fd10 0x7f593c0b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:34.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5942fc2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593c05bf00 con 0x7f593c060510 2021-01-03T13:00:34.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5942fc2700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c05c1a0 con 0x7f593c05fd10 2021-01-03T13:00:34.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5942fc2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c05c440 con 0x7f593c0b4c20 2021-01-03T13:00:34.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5941fc0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f593c0b4c20 0x7f593c05c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:34.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f59417bf700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f593c060510 0x7f593c0b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54996/0 (socket says 172.21.15.133:54996) 2021-01-03T13:00:34.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5941fc0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f593c0b4c20 0x7f593c05c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33962/0 (socket says 172.21.15.133:33962) 2021-01-03T13:00:34.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f59417bf700 1 -- 172.21.15.133:0/2713433362 learned_addr learned my addr 172.21.15.133:0/2713433362 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:00:34.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f59427c1700 1 --2- 172.21.15.133:0/2713433362 >> v2:172.21.15.16:3300/0 conn(0x7f593c05fd10 0x7f593c0b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:34.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5941fc0700 1 -- 172.21.15.133:0/2713433362 >> v2:172.21.15.16:3300/0 conn(0x7f593c05fd10 msgr2=0x7f593c0b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:34.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5941fc0700 1 --2- 172.21.15.133:0/2713433362 >> v2:172.21.15.16:3300/0 conn(0x7f593c05fd10 0x7f593c0b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5941fc0700 1 -- 172.21.15.133:0/2713433362 >> v1:172.21.15.133:6789/0 conn(0x7f593c060510 legacy=0x7f593c0b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:34.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5941fc0700 1 -- 172.21.15.133:0/2713433362 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c0b6ad0 con 0x7f593c0b4c20 2021-01-03T13:00:34.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5940fbe700 1 -- 172.21.15.133:0/2713433362 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136019396 0 0) 0x7f593c05bf00 con 0x7f593c060510 2021-01-03T13:00:34.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5941fc0700 1 --2- 172.21.15.133:0/2713433362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f593c0b4c20 0x7f593c05c8e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f5938002f30 tx=0x7f5938006dc0).ready entity=mon.1 client_cookie=b20f019326277153 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:34.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5940fbe700 1 -- 172.21.15.133:0/2713433362 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59380097f0 con 0x7f593c0b4c20 2021-01-03T13:00:34.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5940fbe700 1 -- 172.21.15.133:0/2713433362 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5938009950 con 0x7f593c0b4c20 2021-01-03T13:00:34.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5940fbe700 1 -- 172.21.15.133:0/2713433362 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5938009cb0 con 0x7f593c0b4c20 2021-01-03T13:00:34.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5942fc2700 1 -- 172.21.15.133:0/2713433362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f593c0b4c20 msgr2=0x7f593c05c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:34.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.731+0000 7f5942fc2700 1 --2- 172.21.15.133:0/2713433362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f593c0b4c20 0x7f593c05c8e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f5938002f30 tx=0x7f5938006dc0).stop 2021-01-03T13:00:34.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.735+0000 7f5942fc2700 1 -- 172.21.15.133:0/2713433362 shutdown_connections 2021-01-03T13:00:34.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.735+0000 7f5942fc2700 1 --2- 172.21.15.133:0/2713433362 >> v2:172.21.15.16:3300/0 conn(0x7f593c05fd10 0x7f593c0b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.735+0000 7f5942fc2700 1 --2- 172.21.15.133:0/2713433362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f593c0b4c20 0x7f593c05c8e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.735+0000 7f5942fc2700 1 -- 172.21.15.133:0/2713433362 >> 172.21.15.133:0/2713433362 conn(0x7f593c0b9f00 msgr2=0x7f593c0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:34.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.735+0000 7f5942fc2700 1 -- 172.21.15.133:0/2713433362 shutdown_connections 2021-01-03T13:00:34.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.735+0000 7f5942fc2700 1 -- 172.21.15.133:0/2713433362 wait complete. 2021-01-03T13:00:34.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.735+0000 7f5942fc2700 1 Processor -- start 2021-01-03T13:00:34.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.735+0000 7f5942fc2700 1 -- start start 2021-01-03T13:00:34.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5942fc2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f593c05fd10 0x7f593c141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:34.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5942fc2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f593c060510 0x7f593c09e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:34.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5942fc2700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f593c0b4c20 0x7f593c148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:34.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5942fc2700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c1438e0 con 0x7f593c0b4c20 2021-01-03T13:00:34.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5942fc2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c1489c0 con 0x7f593c05fd10 2021-01-03T13:00:34.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5942fc2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c1434a0 con 0x7f593c060510 2021-01-03T13:00:34.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5941fc0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f593c05fd10 0x7f593c141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5941fc0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f593c05fd10 0x7f593c141210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33968/0 (socket says 172.21.15.133:33968) 2021-01-03T13:00:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5941fc0700 1 -- 172.21.15.133:0/510138149 learned_addr learned my addr 172.21.15.133:0/510138149 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f59427c1700 1 --2- 172.21.15.133:0/510138149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f593c0b4c20 0x7f593c148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f59417bf700 1 --2- 172.21.15.133:0/510138149 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f593c060510 0x7f593c09e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5941fc0700 1 -- 172.21.15.133:0/510138149 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f593c060510 msgr2=0x7f593c09e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:34.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5941fc0700 1 --2- 172.21.15.133:0/510138149 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f593c060510 0x7f593c09e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5941fc0700 1 -- 172.21.15.133:0/510138149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f593c0b4c20 msgr2=0x7f593c148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:34.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5941fc0700 1 --2- 172.21.15.133:0/510138149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f593c0b4c20 0x7f593c148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5941fc0700 1 -- 172.21.15.133:0/510138149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c149430 con 0x7f593c05fd10 2021-01-03T13:00:34.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f59417bf700 1 --2- 172.21.15.133:0/510138149 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f593c060510 0x7f593c09e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:00:34.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f59427c1700 1 --2- 172.21.15.133:0/510138149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f593c0b4c20 0x7f593c148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:00:34.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5941fc0700 1 --2- 172.21.15.133:0/510138149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f593c05fd10 0x7f593c141210 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f5938002f30 tx=0x7f5938015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:34.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f592affd700 1 -- 172.21.15.133:0/510138149 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5938011d70 con 0x7f593c05fd10 2021-01-03T13:00:34.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f592affd700 1 -- 172.21.15.133:0/510138149 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593801d450 con 0x7f593c05fd10 2021-01-03T13:00:34.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f592affd700 1 -- 172.21.15.133:0/510138149 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f593801d7b0 con 0x7f593c05fd10 2021-01-03T13:00:34.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5942fc2700 1 -- 172.21.15.133:0/510138149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c140aa0 con 0x7f593c05fd10 2021-01-03T13:00:34.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5942fc2700 1 -- 172.21.15.133:0/510138149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593c14a0c0 con 0x7f593c05fd10 2021-01-03T13:00:34.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f5942fc2700 1 -- 172.21.15.133:0/510138149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593c148b80 con 0x7f593c05fd10 2021-01-03T13:00:34.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.739+0000 7f592affd700 1 -- 172.21.15.133:0/510138149 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5938024030 con 0x7f593c05fd10 2021-01-03T13:00:34.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.743+0000 7f592affd700 1 --2- 172.21.15.133:0/510138149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f591c0553b0 0x7f591c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:34.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.743+0000 7f592affd700 1 -- 172.21.15.133:0/510138149 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f593806f380 con 0x7f593c05fd10 2021-01-03T13:00:34.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.743+0000 7f59417bf700 1 --2- 172.21.15.133:0/510138149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f591c0553b0 0x7f591c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:34.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.743+0000 7f59417bf700 1 --2- 172.21.15.133:0/510138149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f591c0553b0 0x7f591c057870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f592c008000 tx=0x7f592c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:34.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.747+0000 7f592affd700 1 -- 172.21.15.133:0/510138149 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f59380455e0 con 0x7f593c05fd10 2021-01-03T13:00:34.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.875+0000 7f5942fc2700 1 -- 172.21.15.133:0/510138149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f593c057300 con 0x7f593c05fd10 2021-01-03T13:00:34.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.879+0000 7f592affd700 1 -- 172.21.15.133:0/510138149 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v45) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5938022020 con 0x7f593c05fd10 2021-01-03T13:00:34.877 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:00:34.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.879+0000 7f5942fc2700 1 -- 172.21.15.133:0/510138149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f591c0553b0 msgr2=0x7f591c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:34.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.879+0000 7f5942fc2700 1 --2- 172.21.15.133:0/510138149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f591c0553b0 0x7f591c057870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f592c008000 tx=0x7f592c009040).stop 2021-01-03T13:00:34.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.879+0000 7f5942fc2700 1 -- 172.21.15.133:0/510138149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f593c05fd10 msgr2=0x7f593c141210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:34.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.879+0000 7f5942fc2700 1 --2- 172.21.15.133:0/510138149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f593c05fd10 0x7f593c141210 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f5938002f30 tx=0x7f5938015000).stop 2021-01-03T13:00:34.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.879+0000 7f5942fc2700 1 -- 172.21.15.133:0/510138149 shutdown_connections 2021-01-03T13:00:34.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.879+0000 7f5942fc2700 1 --2- 172.21.15.133:0/510138149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f591c0553b0 0x7f591c057870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.879+0000 7f5942fc2700 1 --2- 172.21.15.133:0/510138149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f593c0b4c20 0x7f593c148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.879+0000 7f5942fc2700 1 --2- 172.21.15.133:0/510138149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f593c05fd10 0x7f593c141210 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.879+0000 7f5942fc2700 1 --2- 172.21.15.133:0/510138149 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f593c060510 0x7f593c09e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:34.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.879+0000 7f5942fc2700 1 -- 172.21.15.133:0/510138149 >> 172.21.15.133:0/510138149 conn(0x7f593c0b9f00 msgr2=0x7f593c13ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:34.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.879+0000 7f5942fc2700 1 -- 172.21.15.133:0/510138149 shutdown_connections 2021-01-03T13:00:34.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:34.879+0000 7f5942fc2700 1 -- 172.21.15.133:0/510138149 wait complete. 2021-01-03T13:00:34.888 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:00:35.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ea36700 1 Processor -- start 2021-01-03T13:00:35.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ea36700 1 -- start start 2021-01-03T13:00:35.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ea36700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe6580b5260 0x7fe6581470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ea36700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe6581442a0 0x7fe658144750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ea36700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6580b0c10 con 0x7fe6580b5c00 2021-01-03T13:00:35.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ea36700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6580b5640 con 0x7fe6581442a0 2021-01-03T13:00:35.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ea36700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65809a4f0 con 0x7fe6580b5260 2021-01-03T13:00:35.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65e235700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe6581442a0 0x7fe658144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65e235700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe6581442a0 0x7fe658144750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33980/0 (socket says 172.21.15.133:33980) 2021-01-03T13:00:35.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65e235700 1 -- 172.21.15.133:0/505362310 learned_addr learned my addr 172.21.15.133:0/505362310 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:35.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65da34700 1 --2- 172.21.15.133:0/505362310 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe6580b5260 0x7fe6581470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65e235700 1 -- 172.21.15.133:0/505362310 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe6580b5260 msgr2=0x7fe6581470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:35.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65e235700 1 --2- 172.21.15.133:0/505362310 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe6580b5260 0x7fe6581470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65e235700 1 -- 172.21.15.133:0/505362310 >> v1:172.21.15.16:6789/0 conn(0x7fe6580b5c00 legacy=0x7fe6581475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65e235700 1 -- 172.21.15.133:0/505362310 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6580b0e40 con 0x7fe6581442a0 2021-01-03T13:00:35.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65e235700 1 --2- 172.21.15.133:0/505362310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6581442a0 0x7fe658144750 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fe650002f30 tx=0x7fe650006e80).ready entity=mon.1 client_cookie=c072900340d27fc2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:35.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ca32700 1 -- 172.21.15.133:0/505362310 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6500097f0 con 0x7fe6581442a0 2021-01-03T13:00:35.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ca32700 1 -- 172.21.15.133:0/505362310 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe650009950 con 0x7fe6581442a0 2021-01-03T13:00:35.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ca32700 1 -- 172.21.15.133:0/505362310 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe650009cb0 con 0x7fe6581442a0 2021-01-03T13:00:35.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ea36700 1 -- 172.21.15.133:0/505362310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6581442a0 msgr2=0x7fe658144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ea36700 1 --2- 172.21.15.133:0/505362310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6581442a0 0x7fe658144750 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fe650002f30 tx=0x7fe650006e80).stop 2021-01-03T13:00:35.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ea36700 1 -- 172.21.15.133:0/505362310 shutdown_connections 2021-01-03T13:00:35.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ea36700 1 --2- 172.21.15.133:0/505362310 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe6580b5260 0x7fe6581470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ea36700 1 --2- 172.21.15.133:0/505362310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6581442a0 0x7fe658144750 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ea36700 1 -- 172.21.15.133:0/505362310 >> 172.21.15.133:0/505362310 conn(0x7fe65805bdf0 msgr2=0x7fe65805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:35.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ea36700 1 -- 172.21.15.133:0/505362310 shutdown_connections 2021-01-03T13:00:35.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ea36700 1 -- 172.21.15.133:0/505362310 wait complete. 2021-01-03T13:00:35.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ea36700 1 Processor -- start 2021-01-03T13:00:35.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.003+0000 7fe65ea36700 1 -- start start 2021-01-03T13:00:35.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65ea36700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6580b5260 0x7fe658064810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65ea36700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6580b5c00 0x7fe658143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65ea36700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe6581442a0 0x7fe658143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65ea36700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe658147290 con 0x7fe6580b5c00 2021-01-03T13:00:35.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65ea36700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6581464c0 con 0x7fe6580b5260 2021-01-03T13:00:35.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65ea36700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6580668f0 con 0x7fe6581442a0 2021-01-03T13:00:35.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65da34700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6580b5260 0x7fe658064810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65da34700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6580b5260 0x7fe658064810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33984/0 (socket says 172.21.15.133:33984) 2021-01-03T13:00:35.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65da34700 1 -- 172.21.15.133:0/1061504933 learned_addr learned my addr 172.21.15.133:0/1061504933 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:35.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65e235700 1 --2- 172.21.15.133:0/1061504933 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe6581442a0 0x7fe658143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65d233700 1 --2- 172.21.15.133:0/1061504933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6580b5c00 0x7fe658143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65da34700 1 -- 172.21.15.133:0/1061504933 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe6581442a0 msgr2=0x7fe658143780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65da34700 1 --2- 172.21.15.133:0/1061504933 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe6581442a0 0x7fe658143780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65da34700 1 -- 172.21.15.133:0/1061504933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6580b5c00 msgr2=0x7fe658143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65da34700 1 --2- 172.21.15.133:0/1061504933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6580b5c00 0x7fe658143290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65da34700 1 -- 172.21.15.133:0/1061504933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe658066b90 con 0x7fe6580b5260 2021-01-03T13:00:35.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65d233700 1 --2- 172.21.15.133:0/1061504933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6580b5c00 0x7fe658143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:35.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65da34700 1 --2- 172.21.15.133:0/1061504933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6580b5260 0x7fe658064810 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fe64800c000 tx=0x7fe648006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:35.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe656ffd700 1 -- 172.21.15.133:0/1061504933 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe64800ca80 con 0x7fe6580b5260 2021-01-03T13:00:35.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe656ffd700 1 -- 172.21.15.133:0/1061504933 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64800cbe0 con 0x7fe6580b5260 2021-01-03T13:00:35.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe656ffd700 1 -- 172.21.15.133:0/1061504933 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6480123f0 con 0x7fe6580b5260 2021-01-03T13:00:35.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65ea36700 1 -- 172.21.15.133:0/1061504933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6580af3e0 con 0x7fe6580b5260 2021-01-03T13:00:35.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65ea36700 1 -- 172.21.15.133:0/1061504933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6581455f0 con 0x7fe6580b5260 2021-01-03T13:00:35.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe65ea36700 1 -- 172.21.15.133:0/1061504933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6580675d0 con 0x7fe6580b5260 2021-01-03T13:00:35.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe656ffd700 1 -- 172.21.15.133:0/1061504933 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe648012550 con 0x7fe6580b5260 2021-01-03T13:00:35.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe656ffd700 1 --2- 172.21.15.133:0/1061504933 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe63c0554e0 0x7fe63c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.007+0000 7fe656ffd700 1 -- 172.21.15.133:0/1061504933 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe64806e370 con 0x7fe6580b5260 2021-01-03T13:00:35.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.011+0000 7fe65d233700 1 --2- 172.21.15.133:0/1061504933 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe63c0554e0 0x7fe63c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.011+0000 7fe65d233700 1 --2- 172.21.15.133:0/1061504933 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe63c0554e0 0x7fe63c0579a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fe64000b000 tx=0x7fe640009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:35.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.015+0000 7fe656ffd700 1 -- 172.21.15.133:0/1061504933 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe6580675d0 con 0x7fe6580b5260 2021-01-03T13:00:35.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.147+0000 7fe65ea36700 1 -- 172.21.15.133:0/1061504933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe6580675d0 con 0x7fe6580b5260 2021-01-03T13:00:35.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.147+0000 7fe656ffd700 1 -- 172.21.15.133:0/1061504933 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v45) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe6580675d0 con 0x7fe6580b5260 2021-01-03T13:00:35.147 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:00:35.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.151+0000 7fe65ea36700 1 -- 172.21.15.133:0/1061504933 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe63c0554e0 msgr2=0x7fe63c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.151+0000 7fe65ea36700 1 --2- 172.21.15.133:0/1061504933 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe63c0554e0 0x7fe63c0579a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fe64000b000 tx=0x7fe640009040).stop 2021-01-03T13:00:35.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.151+0000 7fe65ea36700 1 -- 172.21.15.133:0/1061504933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6580b5260 msgr2=0x7fe658064810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.151+0000 7fe65ea36700 1 --2- 172.21.15.133:0/1061504933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6580b5260 0x7fe658064810 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fe64800c000 tx=0x7fe648006dc0).stop 2021-01-03T13:00:35.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.151+0000 7fe65ea36700 1 -- 172.21.15.133:0/1061504933 shutdown_connections 2021-01-03T13:00:35.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.151+0000 7fe65ea36700 1 --2- 172.21.15.133:0/1061504933 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe63c0554e0 0x7fe63c0579a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.151+0000 7fe65ea36700 1 --2- 172.21.15.133:0/1061504933 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe6581442a0 0x7fe658143780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.151+0000 7fe65ea36700 1 --2- 172.21.15.133:0/1061504933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe6580b5260 0x7fe658064810 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.151+0000 7fe65ea36700 1 --2- 172.21.15.133:0/1061504933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe6580b5c00 0x7fe658143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.151+0000 7fe65ea36700 1 -- 172.21.15.133:0/1061504933 >> 172.21.15.133:0/1061504933 conn(0x7fe65805bdf0 msgr2=0x7fe6580b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:35.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.151+0000 7fe65ea36700 1 -- 172.21.15.133:0/1061504933 shutdown_connections 2021-01-03T13:00:35.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.151+0000 7fe65ea36700 1 -- 172.21.15.133:0/1061504933 wait complete. 2021-01-03T13:00:35.164 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:00:35.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.275+0000 7f1866093700 1 Processor -- start 2021-01-03T13:00:35.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.275+0000 7f1866093700 1 -- start start 2021-01-03T13:00:35.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.275+0000 7f1866093700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1860060510 0x7f186005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.275+0000 7f1866093700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18600b6cf0 con 0x7f186005fd10 2021-01-03T13:00:35.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.275+0000 7f1866093700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186005bf00 con 0x7f18600b4c20 2021-01-03T13:00:35.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.275+0000 7f1866093700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186005c1a0 con 0x7f1860060510 2021-01-03T13:00:35.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.275+0000 7f1864890700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1860060510 0x7f186005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.275+0000 7f1865091700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f18600b4c20 0x7f18600b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55022/0 (socket says 172.21.15.133:55022) 2021-01-03T13:00:35.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.275+0000 7f1865091700 1 -- 172.21.15.133:0/992630612 learned_addr learned my addr 172.21.15.133:0/992630612 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:00:35.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.279+0000 7f1864890700 1 -- 172.21.15.133:0/992630612 >> v1:172.21.15.133:6789/0 conn(0x7f18600b4c20 legacy=0x7f18600b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.279+0000 7f1864890700 1 -- 172.21.15.133:0/992630612 >> v1:172.21.15.16:6789/0 conn(0x7f186005fd10 legacy=0x7f18600b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.279+0000 7f1864890700 1 -- 172.21.15.133:0/992630612 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186005c440 con 0x7f1860060510 2021-01-03T13:00:35.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.279+0000 7f1864890700 1 --2- 172.21.15.133:0/992630612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1860060510 0x7f186005c8e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f1854002f30 tx=0x7f1854006dc0).ready entity=mon.1 client_cookie=c5e5cea64d300977 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:35.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.279+0000 7f1853fff700 1 -- 172.21.15.133:0/992630612 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18540097f0 con 0x7f1860060510 2021-01-03T13:00:35.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.279+0000 7f1853fff700 1 -- 172.21.15.133:0/992630612 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1854009950 con 0x7f1860060510 2021-01-03T13:00:35.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.279+0000 7f1853fff700 1 -- 172.21.15.133:0/992630612 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1854009cb0 con 0x7f1860060510 2021-01-03T13:00:35.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.279+0000 7f1866093700 1 -- 172.21.15.133:0/992630612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1860060510 msgr2=0x7f186005c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.279+0000 7f1866093700 1 --2- 172.21.15.133:0/992630612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1860060510 0x7f186005c8e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f1854002f30 tx=0x7f1854006dc0).stop 2021-01-03T13:00:35.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.279+0000 7f1866093700 1 -- 172.21.15.133:0/992630612 shutdown_connections 2021-01-03T13:00:35.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.279+0000 7f1866093700 1 --2- 172.21.15.133:0/992630612 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1860060510 0x7f186005c8e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.279+0000 7f1866093700 1 -- 172.21.15.133:0/992630612 >> 172.21.15.133:0/992630612 conn(0x7f18600b9f00 msgr2=0x7f18600b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:35.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.279+0000 7f1866093700 1 -- 172.21.15.133:0/992630612 shutdown_connections 2021-01-03T13:00:35.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.279+0000 7f1866093700 1 -- 172.21.15.133:0/992630612 wait complete. 2021-01-03T13:00:35.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.279+0000 7f1866093700 1 Processor -- start 2021-01-03T13:00:35.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1866093700 1 -- start start 2021-01-03T13:00:35.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1866093700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f186005fd10 0x7f186009edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1866093700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1860060510 0x7f18601551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1866093700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f18600b4c20 0x7f18601556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1866093700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1860142c60 con 0x7f186005fd10 2021-01-03T13:00:35.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1866093700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1860142f00 con 0x7f1860060510 2021-01-03T13:00:35.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1866093700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18601431a0 con 0x7f18600b4c20 2021-01-03T13:00:35.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1864890700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1860060510 0x7f18601551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1864890700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1860060510 0x7f18601551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33998/0 (socket says 172.21.15.133:33998) 2021-01-03T13:00:35.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1864890700 1 -- 172.21.15.133:0/3995299606 learned_addr learned my addr 172.21.15.133:0/3995299606 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:35.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1865091700 1 --2- 172.21.15.133:0/3995299606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f186005fd10 0x7f186009edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1865892700 1 --2- 172.21.15.133:0/3995299606 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f18600b4c20 0x7f18601556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1864890700 1 -- 172.21.15.133:0/3995299606 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f18600b4c20 msgr2=0x7f18601556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1864890700 1 --2- 172.21.15.133:0/3995299606 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f18600b4c20 0x7f18601556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1864890700 1 -- 172.21.15.133:0/3995299606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f186005fd10 msgr2=0x7f186009edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1864890700 1 --2- 172.21.15.133:0/3995299606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f186005fd10 0x7f186009edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1864890700 1 -- 172.21.15.133:0/3995299606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1860143440 con 0x7f1860060510 2021-01-03T13:00:35.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1865091700 1 --2- 172.21.15.133:0/3995299606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f186005fd10 0x7f186009edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:00:35.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1864890700 1 --2- 172.21.15.133:0/3995299606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1860060510 0x7f18601551b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f1854002f30 tx=0x7f1854015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:35.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f18527fc700 1 -- 172.21.15.133:0/3995299606 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f185401d450 con 0x7f1860060510 2021-01-03T13:00:35.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f18527fc700 1 -- 172.21.15.133:0/3995299606 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185401d5b0 con 0x7f1860060510 2021-01-03T13:00:35.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1866093700 1 -- 172.21.15.133:0/3995299606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18601438c0 con 0x7f1860060510 2021-01-03T13:00:35.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f18527fc700 1 -- 172.21.15.133:0/3995299606 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f185401d910 con 0x7f1860060510 2021-01-03T13:00:35.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.283+0000 7f1866093700 1 -- 172.21.15.133:0/3995299606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1860141cc0 con 0x7f1860060510 2021-01-03T13:00:35.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.287+0000 7f1866093700 1 -- 172.21.15.133:0/3995299606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18601435d0 con 0x7f1860060510 2021-01-03T13:00:35.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.287+0000 7f18527fc700 1 -- 172.21.15.133:0/3995299606 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1854024030 con 0x7f1860060510 2021-01-03T13:00:35.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.287+0000 7f18527fc700 1 --2- 172.21.15.133:0/3995299606 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1840055440 0x7f1840057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.287+0000 7f18527fc700 1 -- 172.21.15.133:0/3995299606 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f185406f330 con 0x7f1860060510 2021-01-03T13:00:35.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.287+0000 7f1865091700 1 --2- 172.21.15.133:0/3995299606 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1840055440 0x7f1840057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.287+0000 7f1865091700 1 --2- 172.21.15.133:0/3995299606 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1840055440 0x7f1840057900 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f185c00b000 tx=0x7f185c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:35.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.291+0000 7f18527fc700 1 -- 172.21.15.133:0/3995299606 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1854045630 con 0x7f1860060510 2021-01-03T13:00:35.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.431+0000 7f1866093700 1 -- 172.21.15.133:0/3995299606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1860057300 con 0x7f1860060510 2021-01-03T13:00:35.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.435+0000 7f18527fc700 1 -- 172.21.15.133:0/3995299606 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v45) v1 ==== 104+0+10 (secure 0 0 0) 0x7f18540220a0 con 0x7f1860060510 2021-01-03T13:00:35.433 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:00:35.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.435+0000 7f1866093700 1 -- 172.21.15.133:0/3995299606 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1840055440 msgr2=0x7f1840057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.435+0000 7f1866093700 1 --2- 172.21.15.133:0/3995299606 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1840055440 0x7f1840057900 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f185c00b000 tx=0x7f185c009040).stop 2021-01-03T13:00:35.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.435+0000 7f1866093700 1 -- 172.21.15.133:0/3995299606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1860060510 msgr2=0x7f18601551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.435+0000 7f1866093700 1 --2- 172.21.15.133:0/3995299606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1860060510 0x7f18601551b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f1854002f30 tx=0x7f1854015000).stop 2021-01-03T13:00:35.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.435+0000 7f1866093700 1 -- 172.21.15.133:0/3995299606 shutdown_connections 2021-01-03T13:00:35.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.435+0000 7f1866093700 1 --2- 172.21.15.133:0/3995299606 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1840055440 0x7f1840057900 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.435+0000 7f1866093700 1 --2- 172.21.15.133:0/3995299606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f186005fd10 0x7f186009edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.435+0000 7f1866093700 1 --2- 172.21.15.133:0/3995299606 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f18600b4c20 0x7f18601556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.435+0000 7f1866093700 1 --2- 172.21.15.133:0/3995299606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1860060510 0x7f18601551b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.435+0000 7f1866093700 1 -- 172.21.15.133:0/3995299606 >> 172.21.15.133:0/3995299606 conn(0x7f18600b9f00 msgr2=0x7f18600b7030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:35.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.435+0000 7f1866093700 1 -- 172.21.15.133:0/3995299606 shutdown_connections 2021-01-03T13:00:35.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.435+0000 7f1866093700 1 -- 172.21.15.133:0/3995299606 wait complete. 2021-01-03T13:00:35.450 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:00:35.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbffcf97700 1 Processor -- start 2021-01-03T13:00:35.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbffcf97700 1 -- start start 2021-01-03T13:00:35.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbffcf97700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbff8060890 0x7fbff80abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbffcf97700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbff80afa80 0x7fbff80b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbffcf97700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbff80ae900 0x7fbff80aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbffcf97700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff80ab280 con 0x7fbff8060890 2021-01-03T13:00:35.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbffcf97700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff80aaa10 con 0x7fbff80ae900 2021-01-03T13:00:35.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbffcf97700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff80b1240 con 0x7fbff80afa80 2021-01-03T13:00:35.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbff7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbff80ae900 0x7fbff80aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbff7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbff80ae900 0x7fbff80aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34006/0 (socket says 172.21.15.133:34006) 2021-01-03T13:00:35.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbff7fff700 1 -- 172.21.15.133:0/2737715936 learned_addr learned my addr 172.21.15.133:0/2737715936 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:35.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbff77fe700 1 --2- 172.21.15.133:0/2737715936 >> v2:172.21.15.16:3300/0 conn(0x7fbff8060890 0x7fbff80abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbff6ffd700 1 --2- 172.21.15.133:0/2737715936 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbff80afa80 0x7fbff80b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbff7fff700 1 -- 172.21.15.133:0/2737715936 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbff80afa80 msgr2=0x7fbff80b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:35.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbff7fff700 1 --2- 172.21.15.133:0/2737715936 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbff80afa80 0x7fbff80b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbff7fff700 1 -- 172.21.15.133:0/2737715936 >> v2:172.21.15.16:3300/0 conn(0x7fbff8060890 msgr2=0x7fbff80abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:00:35.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbff7fff700 1 --2- 172.21.15.133:0/2737715936 >> v2:172.21.15.16:3300/0 conn(0x7fbff8060890 0x7fbff80abcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbff7fff700 1 -- 172.21.15.133:0/2737715936 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff80b0ab0 con 0x7fbff80ae900 2021-01-03T13:00:35.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.567+0000 7fbff7fff700 1 --2- 172.21.15.133:0/2737715936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff80ae900 0x7fbff80aed90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fbff0002f30 tx=0x7fbff0006e80).ready entity=mon.1 client_cookie=c5e58807a8f88426 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:35.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.571+0000 7fbff67fc700 1 -- 172.21.15.133:0/2737715936 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbff0009640 con 0x7fbff80ae900 2021-01-03T13:00:35.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.571+0000 7fbff67fc700 1 -- 172.21.15.133:0/2737715936 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff00097a0 con 0x7fbff80ae900 2021-01-03T13:00:35.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.571+0000 7fbff67fc700 1 -- 172.21.15.133:0/2737715936 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbff0009b00 con 0x7fbff80ae900 2021-01-03T13:00:35.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.571+0000 7fbffcf97700 1 -- 172.21.15.133:0/2737715936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff80ae900 msgr2=0x7fbff80aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.571+0000 7fbffcf97700 1 --2- 172.21.15.133:0/2737715936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff80ae900 0x7fbff80aed90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fbff0002f30 tx=0x7fbff0006e80).stop 2021-01-03T13:00:35.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.571+0000 7fbffcf97700 1 -- 172.21.15.133:0/2737715936 shutdown_connections 2021-01-03T13:00:35.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.571+0000 7fbffcf97700 1 --2- 172.21.15.133:0/2737715936 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff80ae900 0x7fbff80aed90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.571+0000 7fbffcf97700 1 --2- 172.21.15.133:0/2737715936 >> v2:172.21.15.16:3300/0 conn(0x7fbff8060890 0x7fbff80abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.571+0000 7fbffcf97700 1 --2- 172.21.15.133:0/2737715936 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbff80afa80 0x7fbff80b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.571+0000 7fbffcf97700 1 -- 172.21.15.133:0/2737715936 >> 172.21.15.133:0/2737715936 conn(0x7fbff805bdf0 msgr2=0x7fbff805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:35.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.571+0000 7fbffcf97700 1 -- 172.21.15.133:0/2737715936 shutdown_connections 2021-01-03T13:00:35.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.571+0000 7fbffcf97700 1 -- 172.21.15.133:0/2737715936 wait complete. 2021-01-03T13:00:35.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.571+0000 7fbffcf97700 1 Processor -- start 2021-01-03T13:00:35.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.571+0000 7fbffcf97700 1 -- start start 2021-01-03T13:00:35.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbffcf97700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff8060890 0x7fbff805f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbffcf97700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbff80ae900 0x7fbff8090150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbffcf97700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbff80afa80 0x7fbff8090640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbffcf97700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff8090b30 con 0x7fbff80ae900 2021-01-03T13:00:35.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbffcf97700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff8066580 con 0x7fbff8060890 2021-01-03T13:00:35.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbffcf97700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff80676a0 con 0x7fbff80afa80 2021-01-03T13:00:35.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbff77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff8060890 0x7fbff805f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbff77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff8060890 0x7fbff805f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34012/0 (socket says 172.21.15.133:34012) 2021-01-03T13:00:35.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbff77fe700 1 -- 172.21.15.133:0/1359230456 learned_addr learned my addr 172.21.15.133:0/1359230456 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:35.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbff7fff700 1 --2- 172.21.15.133:0/1359230456 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbff80afa80 0x7fbff8090640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbff6ffd700 1 --2- 172.21.15.133:0/1359230456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbff80ae900 0x7fbff8090150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbff77fe700 1 -- 172.21.15.133:0/1359230456 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbff80afa80 msgr2=0x7fbff8090640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbff77fe700 1 --2- 172.21.15.133:0/1359230456 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbff80afa80 0x7fbff8090640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbff77fe700 1 -- 172.21.15.133:0/1359230456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbff80ae900 msgr2=0x7fbff8090150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbff77fe700 1 --2- 172.21.15.133:0/1359230456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbff80ae900 0x7fbff8090150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbff77fe700 1 -- 172.21.15.133:0/1359230456 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff8092a20 con 0x7fbff8060890 2021-01-03T13:00:35.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbff77fe700 1 --2- 172.21.15.133:0/1359230456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff8060890 0x7fbff805f920 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fbfe000c000 tx=0x7fbfe0006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:35.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbff4ff9700 1 -- 172.21.15.133:0/1359230456 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfe000ca80 con 0x7fbff8060890 2021-01-03T13:00:35.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbff4ff9700 1 -- 172.21.15.133:0/1359230456 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe000cbe0 con 0x7fbff8060890 2021-01-03T13:00:35.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbffcf97700 1 -- 172.21.15.133:0/1359230456 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff8152c60 con 0x7fbff8060890 2021-01-03T13:00:35.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbff4ff9700 1 -- 172.21.15.133:0/1359230456 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfe00123f0 con 0x7fbff8060890 2021-01-03T13:00:35.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.575+0000 7fbffcf97700 1 -- 172.21.15.133:0/1359230456 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff8066210 con 0x7fbff8060890 2021-01-03T13:00:35.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.579+0000 7fbff4ff9700 1 -- 172.21.15.133:0/1359230456 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fbfe0012550 con 0x7fbff8060890 2021-01-03T13:00:35.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.579+0000 7fbffcf97700 1 -- 172.21.15.133:0/1359230456 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff8066740 con 0x7fbff8060890 2021-01-03T13:00:35.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.579+0000 7fbff4ff9700 1 --2- 172.21.15.133:0/1359230456 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfdc055330 0x7fbfdc0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.579+0000 7fbff4ff9700 1 -- 172.21.15.133:0/1359230456 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbfe006e370 con 0x7fbff8060890 2021-01-03T13:00:35.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.579+0000 7fbff6ffd700 1 --2- 172.21.15.133:0/1359230456 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfdc055330 0x7fbfdc0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.579+0000 7fbff6ffd700 1 --2- 172.21.15.133:0/1359230456 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfdc055330 0x7fbfdc0577f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fbfe800b000 tx=0x7fbfe8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:35.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.583+0000 7fbff4ff9700 1 -- 172.21.15.133:0/1359230456 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbfe0044610 con 0x7fbff8060890 2021-01-03T13:00:35.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.719+0000 7fbffcf97700 1 -- 172.21.15.133:0/1359230456 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbff8067860 con 0x7fbff8060890 2021-01-03T13:00:35.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.723+0000 7fbff4ff9700 1 -- 172.21.15.133:0/1359230456 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbfe0047c30 con 0x7fbff8060890 2021-01-03T13:00:35.721 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:00:35.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.723+0000 7fbffcf97700 1 -- 172.21.15.133:0/1359230456 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfdc055330 msgr2=0x7fbfdc0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.723+0000 7fbffcf97700 1 --2- 172.21.15.133:0/1359230456 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfdc055330 0x7fbfdc0577f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fbfe800b000 tx=0x7fbfe8008040).stop 2021-01-03T13:00:35.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.723+0000 7fbffcf97700 1 -- 172.21.15.133:0/1359230456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff8060890 msgr2=0x7fbff805f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.723+0000 7fbffcf97700 1 --2- 172.21.15.133:0/1359230456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff8060890 0x7fbff805f920 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fbfe000c000 tx=0x7fbfe0006dc0).stop 2021-01-03T13:00:35.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.723+0000 7fbffcf97700 1 -- 172.21.15.133:0/1359230456 shutdown_connections 2021-01-03T13:00:35.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.723+0000 7fbffcf97700 1 --2- 172.21.15.133:0/1359230456 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfdc055330 0x7fbfdc0577f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.723+0000 7fbffcf97700 1 --2- 172.21.15.133:0/1359230456 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbff80afa80 0x7fbff8090640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.723+0000 7fbffcf97700 1 --2- 172.21.15.133:0/1359230456 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbff8060890 0x7fbff805f920 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.723+0000 7fbffcf97700 1 --2- 172.21.15.133:0/1359230456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbff80ae900 0x7fbff8090150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.723+0000 7fbffcf97700 1 -- 172.21.15.133:0/1359230456 >> 172.21.15.133:0/1359230456 conn(0x7fbff805bdf0 msgr2=0x7fbff8099e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:35.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.723+0000 7fbffcf97700 1 -- 172.21.15.133:0/1359230456 shutdown_connections 2021-01-03T13:00:35.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.723+0000 7fbffcf97700 1 -- 172.21.15.133:0/1359230456 wait complete. 2021-01-03T13:00:35.733 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:00:35.734 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:00:35.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.847+0000 7fcc160ba700 1 Processor -- start 2021-01-03T13:00:35.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.847+0000 7fcc160ba700 1 -- start start 2021-01-03T13:00:35.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.847+0000 7fcc160ba700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc101406b0 0x7fcc100676c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.847+0000 7fcc160ba700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc100b2780 con 0x7fcc100b23a0 2021-01-03T13:00:35.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.847+0000 7fcc160ba700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc100a9480 con 0x7fcc100af780 2021-01-03T13:00:35.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.847+0000 7fcc160ba700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc100aef00 con 0x7fcc101406b0 2021-01-03T13:00:35.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.847+0000 7fcc158b9700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcc100af780 0x7fcc100b0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55054/0 (socket says 172.21.15.133:55054) 2021-01-03T13:00:35.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.847+0000 7fcc158b9700 1 -- 172.21.15.133:0/1243709990 learned_addr learned my addr 172.21.15.133:0/1243709990 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:00:35.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.847+0000 7fcc148b7700 1 --2- 172.21.15.133:0/1243709990 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc101406b0 0x7fcc100676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.847+0000 7fcbfffff700 1 -- 172.21.15.133:0/1243709990 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238622089 0 0) 0x7fcc100a9480 con 0x7fcc100af780 2021-01-03T13:00:35.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.847+0000 7fcbfffff700 1 -- 172.21.15.133:0/1243709990 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbf8003230 con 0x7fcc100af780 2021-01-03T13:00:35.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.847+0000 7fcbfffff700 1 -- 172.21.15.133:0/1243709990 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205080365 0 0) 0x7fcc100b2780 con 0x7fcc100b23a0 2021-01-03T13:00:35.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.847+0000 7fcbfffff700 1 -- 172.21.15.133:0/1243709990 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc100a9480 con 0x7fcc100b23a0 2021-01-03T13:00:35.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.847+0000 7fcc148b7700 1 -- 172.21.15.133:0/1243709990 >> v1:172.21.15.133:6789/0 conn(0x7fcc100af780 legacy=0x7fcc100b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.847+0000 7fcc148b7700 1 -- 172.21.15.133:0/1243709990 >> v1:172.21.15.16:6789/0 conn(0x7fcc100b23a0 legacy=0x7fcc10066fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.847+0000 7fcc148b7700 1 -- 172.21.15.133:0/1243709990 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1013fa30 con 0x7fcc101406b0 2021-01-03T13:00:35.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.847+0000 7fcc148b7700 1 --2- 172.21.15.133:0/1243709990 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc101406b0 0x7fcc100676c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fcc00002f30 tx=0x7fcc00006dc0).ready entity=mon.2 client_cookie=8eb362e18b76579a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:35.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcbfffff700 1 -- 172.21.15.133:0/1243709990 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc00009730 con 0x7fcc101406b0 2021-01-03T13:00:35.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcbfffff700 1 -- 172.21.15.133:0/1243709990 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc00009890 con 0x7fcc101406b0 2021-01-03T13:00:35.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcbfffff700 1 -- 172.21.15.133:0/1243709990 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc00009bf0 con 0x7fcc101406b0 2021-01-03T13:00:35.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc160ba700 1 -- 172.21.15.133:0/1243709990 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc101406b0 msgr2=0x7fcc100676c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc160ba700 1 --2- 172.21.15.133:0/1243709990 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc101406b0 0x7fcc100676c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fcc00002f30 tx=0x7fcc00006dc0).stop 2021-01-03T13:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc160ba700 1 -- 172.21.15.133:0/1243709990 shutdown_connections 2021-01-03T13:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc160ba700 1 --2- 172.21.15.133:0/1243709990 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc101406b0 0x7fcc100676c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc160ba700 1 -- 172.21.15.133:0/1243709990 >> 172.21.15.133:0/1243709990 conn(0x7fcc1006b050 msgr2=0x7fcc10060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc160ba700 1 -- 172.21.15.133:0/1243709990 shutdown_connections 2021-01-03T13:00:35.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc160ba700 1 -- 172.21.15.133:0/1243709990 wait complete. 2021-01-03T13:00:35.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc160ba700 1 Processor -- start 2021-01-03T13:00:35.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc160ba700 1 -- start start 2021-01-03T13:00:35.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc160ba700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc100af780 0x7fcc10141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc160ba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc100b23a0 0x7fcc10155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc160ba700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc101406b0 0x7fcc10155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc160ba700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc101443f0 con 0x7fcc101406b0 2021-01-03T13:00:35.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc160ba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc10143b50 con 0x7fcc100b23a0 2021-01-03T13:00:35.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc160ba700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc10144620 con 0x7fcc100af780 2021-01-03T13:00:35.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc148b7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc100b23a0 0x7fcc10155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc148b7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc100b23a0 0x7fcc10155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34026/0 (socket says 172.21.15.133:34026) 2021-01-03T13:00:35.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc148b7700 1 -- 172.21.15.133:0/963537548 learned_addr learned my addr 172.21.15.133:0/963537548 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:00:35.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc158b9700 1 --2- 172.21.15.133:0/963537548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc101406b0 0x7fcc10155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.851+0000 7fcc150b8700 1 --2- 172.21.15.133:0/963537548 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc100af780 0x7fcc10141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.855+0000 7fcc148b7700 1 -- 172.21.15.133:0/963537548 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc100af780 msgr2=0x7fcc10141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.855+0000 7fcc148b7700 1 --2- 172.21.15.133:0/963537548 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc100af780 0x7fcc10141c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.855+0000 7fcc148b7700 1 -- 172.21.15.133:0/963537548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc101406b0 msgr2=0x7fcc10155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:35.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.855+0000 7fcc148b7700 1 --2- 172.21.15.133:0/963537548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc101406b0 0x7fcc10155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:35.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.855+0000 7fcc148b7700 1 -- 172.21.15.133:0/963537548 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc10142fb0 con 0x7fcc100b23a0 2021-01-03T13:00:35.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.855+0000 7fcc148b7700 1 --2- 172.21.15.133:0/963537548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc100b23a0 0x7fcc10155710 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fcc00002f30 tx=0x7fcc00015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:35.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.855+0000 7fcbfe7fc700 1 -- 172.21.15.133:0/963537548 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc00011b80 con 0x7fcc100b23a0 2021-01-03T13:00:35.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.855+0000 7fcbfe7fc700 1 -- 172.21.15.133:0/963537548 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc00011ce0 con 0x7fcc100b23a0 2021-01-03T13:00:35.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.855+0000 7fcc160ba700 1 -- 172.21.15.133:0/963537548 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc10143490 con 0x7fcc100b23a0 2021-01-03T13:00:35.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.855+0000 7fcbfe7fc700 1 -- 172.21.15.133:0/963537548 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc0001d640 con 0x7fcc100b23a0 2021-01-03T13:00:35.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.855+0000 7fcc160ba700 1 -- 172.21.15.133:0/963537548 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc10144020 con 0x7fcc100b23a0 2021-01-03T13:00:35.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.855+0000 7fcc160ba700 1 -- 172.21.15.133:0/963537548 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc101431a0 con 0x7fcc100b23a0 2021-01-03T13:00:35.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.855+0000 7fcbfe7fc700 1 -- 172.21.15.133:0/963537548 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fcc00024030 con 0x7fcc100b23a0 2021-01-03T13:00:35.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.855+0000 7fcbfe7fc700 1 --2- 172.21.15.133:0/963537548 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcbf00554e0 0x7fcbf00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:00:35.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.859+0000 7fcbfe7fc700 1 -- 172.21.15.133:0/963537548 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcc0006eeb0 con 0x7fcc100b23a0 2021-01-03T13:00:35.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.859+0000 7fcc150b8700 1 --2- 172.21.15.133:0/963537548 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcbf00554e0 0x7fcbf00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:00:35.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.859+0000 7fcc150b8700 1 --2- 172.21.15.133:0/963537548 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcbf00554e0 0x7fcbf00579a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fcc0c00d000 tx=0x7fcc0c0079f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:00:35.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:35.863+0000 7fcbfe7fc700 1 -- 172.21.15.133:0/963537548 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcc000451b0 con 0x7fcc100b23a0 2021-01-03T13:00:36.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:36.043+0000 7fcc160ba700 1 -- 172.21.15.133:0/963537548 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc10143c90 con 0x7fcc100b23a0 2021-01-03T13:00:36.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:36.043+0000 7fcbfe7fc700 1 -- 172.21.15.133:0/963537548 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2494 (secure 0 0 0) 0x7fcc00022070 con 0x7fcc100b23a0 2021-01-03T13:00:36.042 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:00:36.043 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5169,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/126912106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":126912106},{"type":"v1","addr":"172.21.15.16:6833","nonce":126912106}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13},{"gid":5212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/1241297212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1241297212},{"type":"v1","addr":"172.21.15.133:6835","nonce":1241297212}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:00:01.768700+0000","modified":"2021-01-03T13:00:02.771604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5218":{"gid":5218,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2379309183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2379309183},{"type":"v1","addr":"172.21.15.133:6837","nonce":2379309183}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-01-03T13:00:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:36.043+0000 7fcc160ba700 1 -- 172.21.15.133:0/963537548 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcbf00554e0 msgr2=0x7fcbf00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:36.043+0000 7fcc160ba700 1 --2- 172.21.15.133:0/963537548 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcbf00554e0 0x7fcbf00579a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fcc0c00d000 tx=0x7fcc0c0079f0).stop 2021-01-03T13:00:36.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:36.043+0000 7fcc160ba700 1 -- 172.21.15.133:0/963537548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc100b23a0 msgr2=0x7fcc10155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:00:36.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:36.043+0000 7fcc160ba700 1 --2- 172.21.15.133:0/963537548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc100b23a0 0x7fcc10155710 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fcc00002f30 tx=0x7fcc00015000).stop 2021-01-03T13:00:36.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:36.047+0000 7fcc160ba700 1 -- 172.21.15.133:0/963537548 shutdown_connections 2021-01-03T13:00:36.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:36.047+0000 7fcc160ba700 1 --2- 172.21.15.133:0/963537548 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcbf00554e0 0x7fcbf00579a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:36.047+0000 7fcc160ba700 1 --2- 172.21.15.133:0/963537548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcc101406b0 0x7fcc10155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:36.047+0000 7fcc160ba700 1 --2- 172.21.15.133:0/963537548 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcc100af780 0x7fcc10141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:36.047+0000 7fcc160ba700 1 --2- 172.21.15.133:0/963537548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcc100b23a0 0x7fcc10155710 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:00:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:36.047+0000 7fcc160ba700 1 -- 172.21.15.133:0/963537548 >> 172.21.15.133:0/963537548 conn(0x7fcc1006b050 msgr2=0x7fcc1013cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:00:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:36.047+0000 7fcc160ba700 1 -- 172.21.15.133:0/963537548 shutdown_connections 2021-01-03T13:00:36.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:00:36.047+0000 7fcc160ba700 1 -- 172.21.15.133:0/963537548 wait complete. 2021-01-03T13:00:36.047 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 16 2021-01-03T13:00:36.361 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:00:01.768700+0000', 'modified': '2021-01-03T13:00:02.771604+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5218}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5218': {'gid': 5218, 'name': 'a', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/2379309183', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 2379309183}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 2379309183}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:00:36.361 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:00:36.362 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-01-03T13:00:36.492 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":5218,"want_state":"up:active","state":"up:active","rank_uptime":34.712593857000002,"mdsmap_epoch":16,"osdmap_epoch":45,"osdmap_epoch_barrier":43,"uptime":40.066128681000002} 2021-01-03T13:00:36.493 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 5218, "mdsmap_epoch": 16, "osdmap_epoch": 45, "osdmap_epoch_barrier": 43, "rank_uptime": 34.712593857, "state": "up:active", "uptime": 40.066128681, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:00:36.493 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:00:36.493 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-01-03T13:00:36.494 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi007.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-01-03T13:00:36.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:36.495 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:00:36.502 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:00:36.558 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:00:36.559 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:00:36.617 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:00:36.618 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:00:36.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:36.620 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:00:36.665 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:00:36.666 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:00:36.709 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:00:36.725 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:00:36.725 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:00:36.780 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:00:36.781 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:00:36.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:36.782 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:00:36.787 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2021-01-03T13:00:36.783+0000 7ff946a6f0c0 -1 init, newargv = 0x55ba68212ff0 newargc=9ceph-fuse[11827]: starting ceph client 2021-01-03T13:00:36.788 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr: 2021-01-03T13:00:36.798 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[11827]: starting fuse 2021-01-03T13:00:37.080 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:00:37.083 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:00:37.086 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:00:37.089 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:00:37.894 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:00:37.908 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:00:37.909 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:00:37.966 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:00:37.967 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:00:37.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:37.968 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:00:38.017 INFO:teuthology.orchestra.run.smithi007.stdout:50 2021-01-03T13:00:38.018 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:00:38.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:38.018 DEBUG:teuthology.orchestra.run.smithi007:> sudo python3 -c ' 2021-01-03T13:00:38.019 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2021-01-03T13:00:38.019 DEBUG:teuthology.orchestra.run.smithi007:> import re 2021-01-03T13:00:38.020 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:00:38.020 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2021-01-03T13:00:38.020 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:00:38.021 DEBUG:teuthology.orchestra.run.smithi007:> def find_socket(client_name): 2021-01-03T13:00:38.021 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-01-03T13:00:38.022 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2021-01-03T13:00:38.022 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:00:38.022 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2021-01-03T13:00:38.023 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2021-01-03T13:00:38.023 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2021-01-03T13:00:38.024 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2021-01-03T13:00:38.024 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:00:38.024 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2021-01-03T13:00:38.025 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:00:38.025 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:00:38.025 DEBUG:teuthology.orchestra.run.smithi007:> return f 2021-01-03T13:00:38.026 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:00:38.026 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:00:38.027 DEBUG:teuthology.orchestra.run.smithi007:> print(find_socket("client.0")) 2021-01-03T13:00:38.027 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:00:38.110 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.11827.asok 2021-01-03T13:00:38.115 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.11827.asok 2021-01-03T13:00:38.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:38.116 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.11827.asok status 2021-01-03T13:00:38.215 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2021-01-03T13:00:38.216 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2021-01-03T13:00:38.216 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:00:38.216 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:00:38.216 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2021-01-03T13:00:38.216 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2021-01-03T13:00:38.217 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-01-03T13:00:38.217 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "11827", 2021-01-03T13:00:38.217 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2021-01-03T13:00:38.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:00:38.217 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2021-01-03T13:00:38.218 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2021-01-03T13:00:38.218 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5461, 2021-01-03T13:00:38.218 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2021-01-03T13:00:38.218 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2021-01-03T13:00:38.218 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2021-01-03T13:00:38.219 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 5461 2021-01-03T13:00:38.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:00:38.219 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:00:38.219 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:00:38.219 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:00:38.220 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3758937037 2021-01-03T13:00:38.220 INFO:teuthology.orchestra.run.smithi007.stdout: } 2021-01-03T13:00:38.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:00:38.220 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:00:38.220 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:00:38.221 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:00:38.221 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3758937037 2021-01-03T13:00:38.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:00:38.221 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.5461 172.21.15.7:0/3758937037", 2021-01-03T13:00:38.221 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "172.21.15.7:0/3758937037", 2021-01-03T13:00:38.222 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2021-01-03T13:00:38.222 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 16, 2021-01-03T13:00:38.222 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 45, 2021-01-03T13:00:38.222 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:00:38.222 INFO:teuthology.orchestra.run.smithi007.stdout: "blacklisted": false, 2021-01-03T13:00:38.223 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2021-01-03T13:00:38.223 INFO:teuthology.orchestra.run.smithi007.stdout:} 2021-01-03T13:00:38.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:38.225 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:00:38.226 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:00:38.231 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:00:38.232 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:00:38.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:00:38.233 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:01:07.124 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:01:07.127 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:01:07.129 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:01:07.132 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:01:21.423 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:01:21.423 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:01:21.441 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:01:21.460 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:01:21.478 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:01:21.496 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:01:21.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:01:21.497 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:01:21.498 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:01:21.505 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:01:21.506 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:01:21.507 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T13:01:21.507 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:01:21.508 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:01:21.587 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[11827]: fuse finished with error 0 and tester_r 0 2021-01-03T13:01:21.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:01:21.589 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:01:21.590 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:01:21.641 INFO:teuthology.orchestra.run.smithi007.stdout:ext2/ext3 2021-01-03T13:01:21.642 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:01:21.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:01:21.643 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:01:21.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:01:21.694 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:01:21.694 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:01:21.701 INFO:teuthology.orchestra.run.smithi036.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:01:21.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:01:21.702 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-01-03T13:01:21.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:01:21.703 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:01:21.750 INFO:teuthology.orchestra.run.smithi036.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:01:21.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:01:21.752 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-01-03T13:01:21.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.879+0000 7fa5874ef700 1 Processor -- start 2021-01-03T13:01:21.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.879+0000 7fa5874ef700 1 -- start start 2021-01-03T13:01:21.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.879+0000 7fa5874ef700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5800b52c0 0x7fa5800b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:21.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.879+0000 7fa5874ef700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5800b0c90 0x7fa580098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:21.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.879+0000 7fa5874ef700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa580060da0 con 0x7fa5800b5c00 2021-01-03T13:01:21.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.879+0000 7fa5874ef700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa580067a90 con 0x7fa5800b52c0 2021-01-03T13:01:21.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.879+0000 7fa5874ef700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5800b0ad0 con 0x7fa5800b0c90 2021-01-03T13:01:21.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.879+0000 7fa5864ed700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5800b52c0 0x7fa5800b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:21.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.879+0000 7fa5864ed700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5800b52c0 0x7fa5800b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34036/0 (socket says 172.21.15.133:34036) 2021-01-03T13:01:21.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.879+0000 7fa5864ed700 1 -- 172.21.15.133:0/1565428144 learned_addr learned my addr 172.21.15.133:0/1565428144 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:21.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.879+0000 7fa585cec700 1 --2- 172.21.15.133:0/1565428144 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5800b0c90 0x7fa580098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:21.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.879+0000 7fa5864ed700 1 -- 172.21.15.133:0/1565428144 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5800b0c90 msgr2=0x7fa580098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.879+0000 7fa5864ed700 1 --2- 172.21.15.133:0/1565428144 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5800b0c90 0x7fa580098ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.879+0000 7fa5864ed700 1 -- 172.21.15.133:0/1565428144 >> v1:172.21.15.16:6789/0 conn(0x7fa5800b5c00 legacy=0x7fa58014a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.879+0000 7fa5854eb700 1 -- 172.21.15.133:0/1565428144 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555236440 0 0) 0x7fa580060da0 con 0x7fa5800b5c00 2021-01-03T13:01:21.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.879+0000 7fa5864ed700 1 -- 172.21.15.133:0/1565428144 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5800b56a0 con 0x7fa5800b52c0 2021-01-03T13:01:21.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5864ed700 1 --2- 172.21.15.133:0/1565428144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800b52c0 0x7fa5800b05e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fa57c002f30 tx=0x7fa57c006e80).ready entity=mon.1 client_cookie=b5ea1c3a6220e033 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:21.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5854eb700 1 -- 172.21.15.133:0/1565428144 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa57c0097f0 con 0x7fa5800b52c0 2021-01-03T13:01:21.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5854eb700 1 -- 172.21.15.133:0/1565428144 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c009950 con 0x7fa5800b52c0 2021-01-03T13:01:21.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5854eb700 1 -- 172.21.15.133:0/1565428144 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa57c009cb0 con 0x7fa5800b52c0 2021-01-03T13:01:21.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5874ef700 1 -- 172.21.15.133:0/1565428144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800b52c0 msgr2=0x7fa5800b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:21.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5874ef700 1 --2- 172.21.15.133:0/1565428144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800b52c0 0x7fa5800b05e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fa57c002f30 tx=0x7fa57c006e80).stop 2021-01-03T13:01:21.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5874ef700 1 -- 172.21.15.133:0/1565428144 shutdown_connections 2021-01-03T13:01:21.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5874ef700 1 --2- 172.21.15.133:0/1565428144 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800b52c0 0x7fa5800b05e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:21.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5874ef700 1 --2- 172.21.15.133:0/1565428144 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5800b0c90 0x7fa580098ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:21.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5874ef700 1 -- 172.21.15.133:0/1565428144 >> 172.21.15.133:0/1565428144 conn(0x7fa58005bdf0 msgr2=0x7fa58005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:21.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5874ef700 1 -- 172.21.15.133:0/1565428144 shutdown_connections 2021-01-03T13:01:21.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5874ef700 1 -- 172.21.15.133:0/1565428144 wait complete. 2021-01-03T13:01:21.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5874ef700 1 Processor -- start 2021-01-03T13:01:21.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5874ef700 1 -- start start 2021-01-03T13:01:21.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5874ef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800b0c90 0x7fa5800b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:21.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5874ef700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5800b52c0 0x7fa5800670c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:21.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5874ef700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5800b5c00 0x7fa580159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:21.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5874ef700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5800675b0 con 0x7fa5800b52c0 2021-01-03T13:01:21.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5874ef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5800aea40 con 0x7fa5800b0c90 2021-01-03T13:01:21.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5874ef700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5800ae7a0 con 0x7fa5800b5c00 2021-01-03T13:01:21.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5864ed700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800b0c90 0x7fa5800b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:21.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5864ed700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800b0c90 0x7fa5800b46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34038/0 (socket says 172.21.15.133:34038) 2021-01-03T13:01:21.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5864ed700 1 -- 172.21.15.133:0/1307994135 learned_addr learned my addr 172.21.15.133:0/1307994135 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:21.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa586cee700 1 --2- 172.21.15.133:0/1307994135 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5800b5c00 0x7fa580159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:21.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa585cec700 1 --2- 172.21.15.133:0/1307994135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5800b52c0 0x7fa5800670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:21.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5864ed700 1 -- 172.21.15.133:0/1307994135 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5800b5c00 msgr2=0x7fa580159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:21.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5864ed700 1 --2- 172.21.15.133:0/1307994135 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5800b5c00 0x7fa580159240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:21.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5864ed700 1 -- 172.21.15.133:0/1307994135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5800b52c0 msgr2=0x7fa5800670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:21.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5864ed700 1 --2- 172.21.15.133:0/1307994135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5800b52c0 0x7fa5800670c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:21.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5864ed700 1 -- 172.21.15.133:0/1307994135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580066980 con 0x7fa5800b0c90 2021-01-03T13:01:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa585cec700 1 --2- 172.21.15.133:0/1307994135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5800b52c0 0x7fa5800670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:01:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.883+0000 7fa5864ed700 1 --2- 172.21.15.133:0/1307994135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800b0c90 0x7fa5800b46b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fa57c002f30 tx=0x7fa57c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.887+0000 7fa5737fe700 1 -- 172.21.15.133:0/1307994135 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa57c011ca0 con 0x7fa5800b0c90 2021-01-03T13:01:21.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.887+0000 7fa5737fe700 1 -- 172.21.15.133:0/1307994135 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57c011e00 con 0x7fa5800b0c90 2021-01-03T13:01:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.887+0000 7fa5737fe700 1 -- 172.21.15.133:0/1307994135 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa57c01e650 con 0x7fa5800b0c90 2021-01-03T13:01:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.887+0000 7fa5874ef700 1 -- 172.21.15.133:0/1307994135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa580066c20 con 0x7fa5800b0c90 2021-01-03T13:01:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.887+0000 7fa5874ef700 1 -- 172.21.15.133:0/1307994135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa580159730 con 0x7fa5800b0c90 2021-01-03T13:01:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.887+0000 7fa5874ef700 1 -- 172.21.15.133:0/1307994135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa580066db0 con 0x7fa5800b0c90 2021-01-03T13:01:21.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.887+0000 7fa5737fe700 1 -- 172.21.15.133:0/1307994135 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa57c025030 con 0x7fa5800b0c90 2021-01-03T13:01:21.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.887+0000 7fa5737fe700 1 --2- 172.21.15.133:0/1307994135 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa560055330 0x7fa5600577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:21.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.887+0000 7fa5737fe700 1 -- 172.21.15.133:0/1307994135 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa57c06f2c0 con 0x7fa5800b0c90 2021-01-03T13:01:21.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.887+0000 7fa585cec700 1 --2- 172.21.15.133:0/1307994135 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa560055330 0x7fa5600577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:21.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.891+0000 7fa585cec700 1 --2- 172.21.15.133:0/1307994135 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa560055330 0x7fa5600577f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fa57400b000 tx=0x7fa574008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:21.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:21.895+0000 7fa5737fe700 1 -- 172.21.15.133:0/1307994135 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa57c0455c0 con 0x7fa5800b0c90 2021-01-03T13:01:22.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.039+0000 7fa5874ef700 1 -- 172.21.15.133:0/1307994135 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa580057300 con 0x7fa5800b0c90 2021-01-03T13:01:22.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.047+0000 7fa5737fe700 1 -- 172.21.15.133:0/1307994135 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa57c048be0 con 0x7fa5800b0c90 2021-01-03T13:01:22.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.047+0000 7fa5874ef700 1 -- 172.21.15.133:0/1307994135 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa560055330 msgr2=0x7fa5600577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:22.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.047+0000 7fa5874ef700 1 --2- 172.21.15.133:0/1307994135 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa560055330 0x7fa5600577f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fa57400b000 tx=0x7fa574008040).stop 2021-01-03T13:01:22.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.047+0000 7fa5874ef700 1 -- 172.21.15.133:0/1307994135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800b0c90 msgr2=0x7fa5800b46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:22.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.047+0000 7fa5874ef700 1 --2- 172.21.15.133:0/1307994135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800b0c90 0x7fa5800b46b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fa57c002f30 tx=0x7fa57c015000).stop 2021-01-03T13:01:22.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.051+0000 7fa5874ef700 1 -- 172.21.15.133:0/1307994135 shutdown_connections 2021-01-03T13:01:22.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.051+0000 7fa5874ef700 1 --2- 172.21.15.133:0/1307994135 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa560055330 0x7fa5600577f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:22.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.051+0000 7fa5874ef700 1 --2- 172.21.15.133:0/1307994135 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5800b5c00 0x7fa580159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:22.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.051+0000 7fa5874ef700 1 --2- 172.21.15.133:0/1307994135 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800b0c90 0x7fa5800b46b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:22.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.051+0000 7fa5874ef700 1 --2- 172.21.15.133:0/1307994135 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5800b52c0 0x7fa5800670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:22.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.051+0000 7fa5874ef700 1 -- 172.21.15.133:0/1307994135 >> 172.21.15.133:0/1307994135 conn(0x7fa58005bdf0 msgr2=0x7fa580143660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:22.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.051+0000 7fa5874ef700 1 -- 172.21.15.133:0/1307994135 shutdown_connections 2021-01-03T13:01:22.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.051+0000 7fa5874ef700 1 -- 172.21.15.133:0/1307994135 wait complete. 2021-01-03T13:01:22.060 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2021-01-03T13:01:22.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.167+0000 7f660b401700 1 Processor -- start 2021-01-03T13:01:22.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.167+0000 7f660b401700 1 -- start start 2021-01-03T13:01:22.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f660b401700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f66040b0c90 0x7f66040b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:22.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f660b401700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6604060da0 con 0x7f66040b5c00 2021-01-03T13:01:22.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f660b401700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66040b0ad0 con 0x7f66040b52c0 2021-01-03T13:01:22.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f660b401700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6604067a90 con 0x7f66040b0c90 2021-01-03T13:01:22.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f660a3ff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f66040b52c0 0x7f6604098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55078/0 (socket says 172.21.15.133:55078) 2021-01-03T13:01:22.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f660a3ff700 1 -- 172.21.15.133:0/3464159279 learned_addr learned my addr 172.21.15.133:0/3464159279 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:22.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f6609bfe700 1 --2- 172.21.15.133:0/3464159279 >> v2:172.21.15.16:3300/0 conn(0x7f66040b0c90 0x7f66040b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:22.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f66093fd700 1 -- 172.21.15.133:0/3464159279 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986278602 0 0) 0x7f66000010d0 con 0x7f66040b52c0 2021-01-03T13:01:22.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f66093fd700 1 -- 172.21.15.133:0/3464159279 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65ec003230 con 0x7f66040b52c0 2021-01-03T13:01:22.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f6609bfe700 1 -- 172.21.15.133:0/3464159279 >> v1:172.21.15.133:6789/0 conn(0x7f66040b52c0 legacy=0x7f6604098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:22.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f6609bfe700 1 -- 172.21.15.133:0/3464159279 >> v1:172.21.15.16:6789/0 conn(0x7f66040b5c00 legacy=0x7f6604143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:22.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f6609bfe700 1 -- 172.21.15.133:0/3464159279 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66040b56a0 con 0x7f66040b0c90 2021-01-03T13:01:22.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f6609bfe700 1 --2- 172.21.15.133:0/3464159279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66040b0c90 0x7f66040b05e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f65f8002f30 tx=0x7f65f8006dc0).ready entity=mon.0 client_cookie=4759b21c86136186 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:22.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f66093fd700 1 -- 172.21.15.133:0/3464159279 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65f8009800 con 0x7f66040b0c90 2021-01-03T13:01:22.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f66093fd700 1 -- 172.21.15.133:0/3464159279 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f8009960 con 0x7f66040b0c90 2021-01-03T13:01:22.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f66093fd700 1 -- 172.21.15.133:0/3464159279 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65f8009cc0 con 0x7f66040b0c90 2021-01-03T13:01:22.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f660b401700 1 -- 172.21.15.133:0/3464159279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66040b0c90 msgr2=0x7f66040b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:22.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f660b401700 1 --2- 172.21.15.133:0/3464159279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66040b0c90 0x7f66040b05e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f65f8002f30 tx=0x7f65f8006dc0).stop 2021-01-03T13:01:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f660b401700 1 -- 172.21.15.133:0/3464159279 shutdown_connections 2021-01-03T13:01:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f660b401700 1 --2- 172.21.15.133:0/3464159279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66040b0c90 0x7f66040b05e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:22.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f660b401700 1 -- 172.21.15.133:0/3464159279 >> 172.21.15.133:0/3464159279 conn(0x7f660405bdf0 msgr2=0x7f660405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:22.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.171+0000 7f660b401700 1 -- 172.21.15.133:0/3464159279 shutdown_connections 2021-01-03T13:01:22.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f660b401700 1 -- 172.21.15.133:0/3464159279 wait complete. 2021-01-03T13:01:22.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f660b401700 1 Processor -- start 2021-01-03T13:01:22.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f660b401700 1 -- start start 2021-01-03T13:01:22.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f660b401700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f66040b0c90 0x7f660413ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:22.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f660b401700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66040b52c0 0x7f660413efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:22.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f660b401700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66040b5c00 0x7f660413deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:22.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f660b401700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660413d430 con 0x7f66040b52c0 2021-01-03T13:01:22.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f660b401700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6604157030 con 0x7f66040b5c00 2021-01-03T13:01:22.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f660b401700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660413d660 con 0x7f66040b0c90 2021-01-03T13:01:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f6609bfe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66040b52c0 0x7f660413efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f660ac00700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66040b5c00 0x7f660413deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f6609bfe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66040b52c0 0x7f660413efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:60824/0 (socket says 172.21.15.133:60824) 2021-01-03T13:01:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f6609bfe700 1 -- 172.21.15.133:0/3886149050 learned_addr learned my addr 172.21.15.133:0/3886149050 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:22.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f660a3ff700 1 --2- 172.21.15.133:0/3886149050 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f66040b0c90 0x7f660413ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:22.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f6609bfe700 1 -- 172.21.15.133:0/3886149050 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f66040b0c90 msgr2=0x7f660413ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:22.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f6609bfe700 1 --2- 172.21.15.133:0/3886149050 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f66040b0c90 0x7f660413ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:22.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f6609bfe700 1 -- 172.21.15.133:0/3886149050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66040b5c00 msgr2=0x7f660413deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:22.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f6609bfe700 1 --2- 172.21.15.133:0/3886149050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66040b5c00 0x7f660413deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:22.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f6609bfe700 1 -- 172.21.15.133:0/3886149050 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6604156d90 con 0x7f66040b52c0 2021-01-03T13:01:22.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f6609bfe700 1 --2- 172.21.15.133:0/3886149050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66040b52c0 0x7f660413efd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f65f8002f30 tx=0x7f65f8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:22.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f65f77fe700 1 -- 172.21.15.133:0/3886149050 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65f8011b80 con 0x7f66040b52c0 2021-01-03T13:01:22.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f65f77fe700 1 -- 172.21.15.133:0/3886149050 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f8011ce0 con 0x7f66040b52c0 2021-01-03T13:01:22.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f660b401700 1 -- 172.21.15.133:0/3886149050 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660413da40 con 0x7f66040b52c0 2021-01-03T13:01:22.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f65f77fe700 1 -- 172.21.15.133:0/3886149050 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65f801d630 con 0x7f66040b52c0 2021-01-03T13:01:22.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.175+0000 7f660b401700 1 -- 172.21.15.133:0/3886149050 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660413e5c0 con 0x7f66040b52c0 2021-01-03T13:01:22.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.179+0000 7f660b401700 1 -- 172.21.15.133:0/3886149050 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660413cb70 con 0x7f66040b52c0 2021-01-03T13:01:22.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.179+0000 7f65f77fe700 1 -- 172.21.15.133:0/3886149050 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f65f8024030 con 0x7f66040b52c0 2021-01-03T13:01:22.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.179+0000 7f65f77fe700 1 --2- 172.21.15.133:0/3886149050 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f65e4055440 0x7f65e4057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:22.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.179+0000 7f65f77fe700 1 -- 172.21.15.133:0/3886149050 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f65f806ec00 con 0x7f66040b52c0 2021-01-03T13:01:22.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.179+0000 7f660a3ff700 1 --2- 172.21.15.133:0/3886149050 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f65e4055440 0x7f65e4057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:22.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.179+0000 7f660a3ff700 1 --2- 172.21.15.133:0/3886149050 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f65e4055440 0x7f65e4057900 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f660000d000 tx=0x7f6600000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:22.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.191+0000 7f65f77fe700 1 -- 172.21.15.133:0/3886149050 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f660413cb70 con 0x7f66040b52c0 2021-01-03T13:01:22.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:22.379+0000 7f660b401700 1 -- 172.21.15.133:0/3886149050 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f660413cb70 con 0x7f66040b52c0 2021-01-03T13:01:23.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.351+0000 7f65f77fe700 1 -- 172.21.15.133:0/3886149050 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v156) v1 ==== 144+0+0 (secure 0 0 0) 0x7f660413cb70 con 0x7f66040b52c0 2021-01-03T13:01:23.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.355+0000 7f660b401700 1 -- 172.21.15.133:0/3886149050 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f65e4055440 msgr2=0x7f65e4057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.355+0000 7f660b401700 1 --2- 172.21.15.133:0/3886149050 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f65e4055440 0x7f65e4057900 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f660000d000 tx=0x7f6600000b80).stop 2021-01-03T13:01:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.355+0000 7f660b401700 1 -- 172.21.15.133:0/3886149050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66040b52c0 msgr2=0x7f660413efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.355+0000 7f660b401700 1 --2- 172.21.15.133:0/3886149050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66040b52c0 0x7f660413efd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f65f8002f30 tx=0x7f65f8015000).stop 2021-01-03T13:01:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.355+0000 7f660b401700 1 -- 172.21.15.133:0/3886149050 shutdown_connections 2021-01-03T13:01:23.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.355+0000 7f660b401700 1 --2- 172.21.15.133:0/3886149050 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f65e4055440 0x7f65e4057900 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.355+0000 7f660b401700 1 --2- 172.21.15.133:0/3886149050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66040b5c00 0x7f660413deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.355+0000 7f660b401700 1 --2- 172.21.15.133:0/3886149050 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f66040b0c90 0x7f660413ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.355+0000 7f660b401700 1 --2- 172.21.15.133:0/3886149050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66040b52c0 0x7f660413efd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.355+0000 7f660b401700 1 -- 172.21.15.133:0/3886149050 >> 172.21.15.133:0/3886149050 conn(0x7f660405bdf0 msgr2=0x7f6604098e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:23.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.355+0000 7f660b401700 1 -- 172.21.15.133:0/3886149050 shutdown_connections 2021-01-03T13:01:23.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.355+0000 7f660b401700 1 -- 172.21.15.133:0/3886149050 wait complete. 2021-01-03T13:01:23.370 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-01-03T13:01:23.371 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-01-03T13:01:23.371 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-01-03T13:01:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.487+0000 7f12c8e33700 1 Processor -- start 2021-01-03T13:01:23.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.487+0000 7f12c8e33700 1 -- start start 2021-01-03T13:01:23.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c8e33700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f12c4099ff0 0x7f12c4140580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c8e33700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c40b5710 con 0x7f12c40b5330 2021-01-03T13:01:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c8e33700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c40ab280 con 0x7f12c40b5ae0 2021-01-03T13:01:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c8e33700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c40b10f0 con 0x7f12c4099ff0 2021-01-03T13:01:23.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c2ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f12c40b5ae0 0x7f12c413fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55090/0 (socket says 172.21.15.133:55090) 2021-01-03T13:01:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c2ffd700 1 -- 172.21.15.133:0/1920157633 learned_addr learned my addr 172.21.15.133:0/1920157633 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:23.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c3fff700 1 --2- 172.21.15.133:0/1920157633 >> v2:172.21.15.16:3300/0 conn(0x7f12c4099ff0 0x7f12c4140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:23.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c27fc700 1 -- 172.21.15.133:0/1920157633 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446378610 0 0) 0x7f12c40ab280 con 0x7f12c40b5ae0 2021-01-03T13:01:23.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c27fc700 1 -- 172.21.15.133:0/1920157633 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12a4003230 con 0x7f12c40b5ae0 2021-01-03T13:01:23.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c3fff700 1 -- 172.21.15.133:0/1920157633 >> v1:172.21.15.133:6789/0 conn(0x7f12c40b5ae0 legacy=0x7f12c413fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c3fff700 1 -- 172.21.15.133:0/1920157633 >> v1:172.21.15.16:6789/0 conn(0x7f12c40b5330 legacy=0x7f12c4142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c3fff700 1 -- 172.21.15.133:0/1920157633 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c4060e20 con 0x7f12c4099ff0 2021-01-03T13:01:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c3fff700 1 --2- 172.21.15.133:0/1920157633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12c4099ff0 0x7f12c4140580 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f12bc0032b0 tx=0x7f12bc0091a0).ready entity=mon.0 client_cookie=6f20052901e73315 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:23.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c27fc700 1 -- 172.21.15.133:0/1920157633 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12bc00b9a0 con 0x7f12c4099ff0 2021-01-03T13:01:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c27fc700 1 -- 172.21.15.133:0/1920157633 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc00bb00 con 0x7f12c4099ff0 2021-01-03T13:01:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c27fc700 1 -- 172.21.15.133:0/1920157633 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12bc00bc70 con 0x7f12c4099ff0 2021-01-03T13:01:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c8e33700 1 -- 172.21.15.133:0/1920157633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12c4099ff0 msgr2=0x7f12c4140580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:23.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c8e33700 1 --2- 172.21.15.133:0/1920157633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12c4099ff0 0x7f12c4140580 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f12bc0032b0 tx=0x7f12bc0091a0).stop 2021-01-03T13:01:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c8e33700 1 -- 172.21.15.133:0/1920157633 shutdown_connections 2021-01-03T13:01:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c8e33700 1 --2- 172.21.15.133:0/1920157633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12c4099ff0 0x7f12c4140580 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c8e33700 1 -- 172.21.15.133:0/1920157633 >> 172.21.15.133:0/1920157633 conn(0x7f12c405bdf0 msgr2=0x7f12c405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c8e33700 1 -- 172.21.15.133:0/1920157633 shutdown_connections 2021-01-03T13:01:23.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.491+0000 7f12c8e33700 1 -- 172.21.15.133:0/1920157633 wait complete. 2021-01-03T13:01:23.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c8e33700 1 Processor -- start 2021-01-03T13:01:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c8e33700 1 -- start start 2021-01-03T13:01:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c8e33700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12c4099ff0 0x7f12c4142ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c8e33700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12c40b5330 0x7f12c4152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:23.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c8e33700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12c40b5ae0 0x7f12c4144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c8e33700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c41466d0 con 0x7f12c40b5330 2021-01-03T13:01:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c8e33700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c41468c0 con 0x7f12c4099ff0 2021-01-03T13:01:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c8e33700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c4151b90 con 0x7f12c40b5ae0 2021-01-03T13:01:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12c4099ff0 0x7f12c4142ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:23.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12c4099ff0 0x7f12c4142ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34064/0 (socket says 172.21.15.133:34064) 2021-01-03T13:01:23.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c37fe700 1 -- 172.21.15.133:0/1318850322 learned_addr learned my addr 172.21.15.133:0/1318850322 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:23.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c2ffd700 1 --2- 172.21.15.133:0/1318850322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12c40b5330 0x7f12c4152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:23.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c3fff700 1 --2- 172.21.15.133:0/1318850322 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12c40b5ae0 0x7f12c4144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:23.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c37fe700 1 -- 172.21.15.133:0/1318850322 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12c40b5ae0 msgr2=0x7f12c4144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:23.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c37fe700 1 --2- 172.21.15.133:0/1318850322 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12c40b5ae0 0x7f12c4144090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:23.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c37fe700 1 -- 172.21.15.133:0/1318850322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12c40b5330 msgr2=0x7f12c4152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:23.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c37fe700 1 --2- 172.21.15.133:0/1318850322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12c40b5330 0x7f12c4152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:23.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c37fe700 1 -- 172.21.15.133:0/1318850322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c4151e30 con 0x7f12c4099ff0 2021-01-03T13:01:23.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.495+0000 7f12c37fe700 1 --2- 172.21.15.133:0/1318850322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12c4099ff0 0x7f12c4142ee0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f12c4061d80 tx=0x7f12ac007c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:23.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.499+0000 7f12c0ff9700 1 -- 172.21.15.133:0/1318850322 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12ac00e4a0 con 0x7f12c4099ff0 2021-01-03T13:01:23.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.499+0000 7f12c0ff9700 1 -- 172.21.15.133:0/1318850322 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac00e600 con 0x7f12c4099ff0 2021-01-03T13:01:23.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.499+0000 7f12c8e33700 1 -- 172.21.15.133:0/1318850322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c41520d0 con 0x7f12c4099ff0 2021-01-03T13:01:23.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.499+0000 7f12c0ff9700 1 -- 172.21.15.133:0/1318850322 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12ac00e960 con 0x7f12c4099ff0 2021-01-03T13:01:23.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.499+0000 7f12c8e33700 1 -- 172.21.15.133:0/1318850322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c4152a60 con 0x7f12c4099ff0 2021-01-03T13:01:23.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.499+0000 7f12c8e33700 1 -- 172.21.15.133:0/1318850322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c40af130 con 0x7f12c4099ff0 2021-01-03T13:01:23.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.499+0000 7f12c0ff9700 1 -- 172.21.15.133:0/1318850322 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f12ac019030 con 0x7f12c4099ff0 2021-01-03T13:01:23.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.499+0000 7f12c0ff9700 1 --2- 172.21.15.133:0/1318850322 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f12a80554e0 0x7f12a80579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:23.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.499+0000 7f12c0ff9700 1 -- 172.21.15.133:0/1318850322 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f12ac06d640 con 0x7f12c4099ff0 2021-01-03T13:01:23.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.499+0000 7f12c2ffd700 1 --2- 172.21.15.133:0/1318850322 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f12a80554e0 0x7f12a80579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:23.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.499+0000 7f12c2ffd700 1 --2- 172.21.15.133:0/1318850322 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f12a80554e0 0x7f12a80579a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f12b400b000 tx=0x7f12b4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:23.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.511+0000 7f12c0ff9700 1 -- 172.21.15.133:0/1318850322 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f12ac0438a0 con 0x7f12c4099ff0 2021-01-03T13:01:23.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:23.699+0000 7f12c8e33700 1 -- 172.21.15.133:0/1318850322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f12c4146a00 con 0x7f12c4099ff0 2021-01-03T13:01:24.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.355+0000 7f12c0ff9700 1 -- 172.21.15.133:0/1318850322 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v157) v1 ==== 155+0+0 (secure 0 0 0) 0x7f12ac046ec0 con 0x7f12c4099ff0 2021-01-03T13:01:24.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.359+0000 7f12c8e33700 1 -- 172.21.15.133:0/1318850322 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f12a80554e0 msgr2=0x7f12a80579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:24.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.359+0000 7f12c8e33700 1 --2- 172.21.15.133:0/1318850322 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f12a80554e0 0x7f12a80579a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f12b400b000 tx=0x7f12b4009040).stop 2021-01-03T13:01:24.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.359+0000 7f12c8e33700 1 -- 172.21.15.133:0/1318850322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12c4099ff0 msgr2=0x7f12c4142ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:24.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.359+0000 7f12c8e33700 1 --2- 172.21.15.133:0/1318850322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12c4099ff0 0x7f12c4142ee0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f12c4061d80 tx=0x7f12ac007c20).stop 2021-01-03T13:01:24.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.359+0000 7f12c8e33700 1 -- 172.21.15.133:0/1318850322 shutdown_connections 2021-01-03T13:01:24.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.359+0000 7f12c8e33700 1 --2- 172.21.15.133:0/1318850322 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f12a80554e0 0x7f12a80579a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.359+0000 7f12c8e33700 1 --2- 172.21.15.133:0/1318850322 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12c40b5ae0 0x7f12c4144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.359+0000 7f12c8e33700 1 --2- 172.21.15.133:0/1318850322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12c4099ff0 0x7f12c4142ee0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.359+0000 7f12c8e33700 1 --2- 172.21.15.133:0/1318850322 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12c40b5330 0x7f12c4152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.359+0000 7f12c8e33700 1 -- 172.21.15.133:0/1318850322 >> 172.21.15.133:0/1318850322 conn(0x7f12c405bdf0 msgr2=0x7f12c40b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:24.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.359+0000 7f12c8e33700 1 -- 172.21.15.133:0/1318850322 shutdown_connections 2021-01-03T13:01:24.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.359+0000 7f12c8e33700 1 -- 172.21.15.133:0/1318850322 wait complete. 2021-01-03T13:01:24.373 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-01-03T13:01:24.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.499+0000 7ff19ce85700 1 Processor -- start 2021-01-03T13:01:24.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.499+0000 7ff19ce85700 1 -- start start 2021-01-03T13:01:24.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff19ce85700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff198066f70 0x7ff19805fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:24.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff19ce85700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff198067350 0x7ff1980af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:24.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff19ce85700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff198060310 con 0x7ff1980afc50 2021-01-03T13:01:24.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff19ce85700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1980605a0 con 0x7ff198067350 2021-01-03T13:01:24.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff19ce85700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1980b0b50 con 0x7ff198066f70 2021-01-03T13:01:24.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff197fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff1980afc50 0x7ff198144260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55106/0 (socket says 172.21.15.133:55106) 2021-01-03T13:01:24.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff197fff700 1 -- 172.21.15.133:0/3099349769 learned_addr learned my addr 172.21.15.133:0/3099349769 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:24.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff1977fe700 1 --2- 172.21.15.133:0/3099349769 >> v2:172.21.15.133:3300/0 conn(0x7ff198066f70 0x7ff19805fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:24.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff196ffd700 1 --2- 172.21.15.133:0/3099349769 >> v2:172.21.15.16:3300/0 conn(0x7ff198067350 0x7ff1980af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:24.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff1967fc700 1 -- 172.21.15.133:0/3099349769 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226153656 0 0) 0x7ff198060310 con 0x7ff1980afc50 2021-01-03T13:01:24.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff1967fc700 1 -- 172.21.15.133:0/3099349769 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff184003230 con 0x7ff1980afc50 2021-01-03T13:01:24.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff1967fc700 1 -- 172.21.15.133:0/3099349769 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2523026142 0 0) 0x7ff184003230 con 0x7ff1980afc50 2021-01-03T13:01:24.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff1977fe700 1 -- 172.21.15.133:0/3099349769 >> v2:172.21.15.16:3300/0 conn(0x7ff198067350 msgr2=0x7ff1980af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:24.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff1977fe700 1 --2- 172.21.15.133:0/3099349769 >> v2:172.21.15.16:3300/0 conn(0x7ff198067350 0x7ff1980af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff1977fe700 1 -- 172.21.15.133:0/3099349769 >> v1:172.21.15.133:6789/0 conn(0x7ff1980afc50 legacy=0x7ff198144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:24.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff1977fe700 1 -- 172.21.15.133:0/3099349769 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1980b0df0 con 0x7ff198066f70 2021-01-03T13:01:24.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff196ffd700 1 --2- 172.21.15.133:0/3099349769 >> v2:172.21.15.16:3300/0 conn(0x7ff198067350 0x7ff1980af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:01:24.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff1977fe700 1 --2- 172.21.15.133:0/3099349769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff198066f70 0x7ff19805fe20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7ff190001870 tx=0x7ff1880091a0).ready entity=mon.1 client_cookie=49a8b7afa0c53962 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:24.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff1967fc700 1 -- 172.21.15.133:0/3099349769 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1900016d0 con 0x7ff198066f70 2021-01-03T13:01:24.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff1967fc700 1 -- 172.21.15.133:0/3099349769 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18800b800 con 0x7ff198066f70 2021-01-03T13:01:24.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff1967fc700 1 -- 172.21.15.133:0/3099349769 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff18800b970 con 0x7ff198066f70 2021-01-03T13:01:24.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff19ce85700 1 -- 172.21.15.133:0/3099349769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff198066f70 msgr2=0x7ff19805fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:24.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff19ce85700 1 --2- 172.21.15.133:0/3099349769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff198066f70 0x7ff19805fe20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7ff190001870 tx=0x7ff1880091a0).stop 2021-01-03T13:01:24.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff19ce85700 1 -- 172.21.15.133:0/3099349769 shutdown_connections 2021-01-03T13:01:24.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff19ce85700 1 --2- 172.21.15.133:0/3099349769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff198066f70 0x7ff19805fe20 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff19ce85700 1 --2- 172.21.15.133:0/3099349769 >> v2:172.21.15.16:3300/0 conn(0x7ff198067350 0x7ff1980af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff19ce85700 1 -- 172.21.15.133:0/3099349769 >> 172.21.15.133:0/3099349769 conn(0x7ff1980b6110 msgr2=0x7ff1980b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:24.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff19ce85700 1 -- 172.21.15.133:0/3099349769 shutdown_connections 2021-01-03T13:01:24.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.503+0000 7ff19ce85700 1 -- 172.21.15.133:0/3099349769 wait complete. 2021-01-03T13:01:24.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff19ce85700 1 Processor -- start 2021-01-03T13:01:24.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff19ce85700 1 -- start start 2021-01-03T13:01:24.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff19ce85700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff198066f70 0x7ff1980b5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:24.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff19ce85700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff198067350 0x7ff19813cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:24.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff19ce85700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff19813d440 0x7ff198153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:24.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff19ce85700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980a2840 con 0x7ff198066f70 2021-01-03T13:01:24.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff19ce85700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980a0900 con 0x7ff198067350 2021-01-03T13:01:24.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff19ce85700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff198066570 con 0x7ff19813d440 2021-01-03T13:01:24.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff196ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff198067350 0x7ff19813cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:24.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff196ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff198067350 0x7ff19813cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34082/0 (socket says 172.21.15.133:34082) 2021-01-03T13:01:24.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff1977fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff198066f70 0x7ff1980b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:24.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff196ffd700 1 -- 172.21.15.133:0/3148784352 learned_addr learned my addr 172.21.15.133:0/3148784352 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:24.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff197fff700 1 --2- 172.21.15.133:0/3148784352 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff19813d440 0x7ff198153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:24.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff196ffd700 1 -- 172.21.15.133:0/3148784352 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff19813d440 msgr2=0x7ff198153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:24.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff196ffd700 1 --2- 172.21.15.133:0/3148784352 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff19813d440 0x7ff198153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff196ffd700 1 -- 172.21.15.133:0/3148784352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff198066f70 msgr2=0x7ff1980b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:24.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff196ffd700 1 --2- 172.21.15.133:0/3148784352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff198066f70 0x7ff1980b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff196ffd700 1 -- 172.21.15.133:0/3148784352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff198066810 con 0x7ff198067350 2021-01-03T13:01:24.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff196ffd700 1 --2- 172.21.15.133:0/3148784352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff198067350 0x7ff19813cf50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7ff1980a18b0 tx=0x7ff18c006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:24.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff194ff9700 1 -- 172.21.15.133:0/3148784352 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff18c00cb40 con 0x7ff198067350 2021-01-03T13:01:24.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff194ff9700 1 -- 172.21.15.133:0/3148784352 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c00cca0 con 0x7ff198067350 2021-01-03T13:01:24.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff194ff9700 1 -- 172.21.15.133:0/3148784352 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff18c0123f0 con 0x7ff198067350 2021-01-03T13:01:24.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff19ce85700 1 -- 172.21.15.133:0/3148784352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff198152fc0 con 0x7ff198067350 2021-01-03T13:01:24.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.507+0000 7ff19ce85700 1 -- 172.21.15.133:0/3148784352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff198141940 con 0x7ff198067350 2021-01-03T13:01:24.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.511+0000 7ff19ce85700 1 -- 172.21.15.133:0/3148784352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff198057300 con 0x7ff198067350 2021-01-03T13:01:24.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.511+0000 7ff194ff9700 1 -- 172.21.15.133:0/3148784352 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff18c012550 con 0x7ff198067350 2021-01-03T13:01:24.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.511+0000 7ff194ff9700 1 --2- 172.21.15.133:0/3148784352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff178055440 0x7ff178057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:24.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.511+0000 7ff194ff9700 1 -- 172.21.15.133:0/3148784352 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff18c06e440 con 0x7ff198067350 2021-01-03T13:01:24.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.511+0000 7ff1977fe700 1 --2- 172.21.15.133:0/3148784352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff178055440 0x7ff178057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:24.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.511+0000 7ff1977fe700 1 --2- 172.21.15.133:0/3148784352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff178055440 0x7ff178057900 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7ff18801b000 tx=0x7ff188016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:24.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.519+0000 7ff194ff9700 1 -- 172.21.15.133:0/3148784352 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff18c0446e0 con 0x7ff198067350 2021-01-03T13:01:24.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.655+0000 7ff19ce85700 1 -- 172.21.15.133:0/3148784352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7ff198153150 con 0x7ff198067350 2021-01-03T13:01:24.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.663+0000 7ff194ff9700 1 -- 172.21.15.133:0/3148784352 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff18c047d00 con 0x7ff198067350 2021-01-03T13:01:24.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.667+0000 7ff19ce85700 1 -- 172.21.15.133:0/3148784352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff178055440 msgr2=0x7ff178057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:24.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.667+0000 7ff19ce85700 1 --2- 172.21.15.133:0/3148784352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff178055440 0x7ff178057900 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7ff18801b000 tx=0x7ff188016000).stop 2021-01-03T13:01:24.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.667+0000 7ff19ce85700 1 -- 172.21.15.133:0/3148784352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff198067350 msgr2=0x7ff19813cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:24.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.667+0000 7ff19ce85700 1 --2- 172.21.15.133:0/3148784352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff198067350 0x7ff19813cf50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7ff1980a18b0 tx=0x7ff18c006dc0).stop 2021-01-03T13:01:24.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.667+0000 7ff19ce85700 1 -- 172.21.15.133:0/3148784352 shutdown_connections 2021-01-03T13:01:24.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.667+0000 7ff19ce85700 1 --2- 172.21.15.133:0/3148784352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff178055440 0x7ff178057900 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.667+0000 7ff19ce85700 1 --2- 172.21.15.133:0/3148784352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff198066f70 0x7ff1980b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.667+0000 7ff19ce85700 1 --2- 172.21.15.133:0/3148784352 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff19813d440 0x7ff198153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.667+0000 7ff19ce85700 1 --2- 172.21.15.133:0/3148784352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff198067350 0x7ff19813cf50 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.667+0000 7ff19ce85700 1 -- 172.21.15.133:0/3148784352 >> 172.21.15.133:0/3148784352 conn(0x7ff1980b6110 msgr2=0x7ff198140c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:24.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.667+0000 7ff19ce85700 1 -- 172.21.15.133:0/3148784352 shutdown_connections 2021-01-03T13:01:24.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.667+0000 7ff19ce85700 1 -- 172.21.15.133:0/3148784352 wait complete. 2021-01-03T13:01:24.677 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:01:24.678 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:01:24.696 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:01:24.716 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:01:24.734 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:01:24.751 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:01:24.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:01:24.752 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:01:24.752 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:01:24.759 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-03T13:01:24.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:01:24.761 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-01-03T13:01:24.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:01:24.762 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:01:24.762 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:01:24.787 INFO:teuthology.orchestra.run.smithi036.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:01:24.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:01:24.788 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-01-03T13:01:24.789 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-01-03T13:01:24.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.911+0000 7fab07fff700 1 Processor -- start 2021-01-03T13:01:24.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.911+0000 7fab07fff700 1 -- start start 2021-01-03T13:01:24.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.911+0000 7fab07fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab080b9b60 0x7fab080b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:24.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.911+0000 7fab07fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fab080b4de0 0x7fab08146b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:24.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab07fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab08147030 con 0x7fab080b4980 2021-01-03T13:01:24.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab07fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab080aed30 con 0x7fab080b4de0 2021-01-03T13:01:24.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab07fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab080605f0 con 0x7fab080b9b60 2021-01-03T13:01:24.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab077fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fab080b4de0 0x7fab08146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:24.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab077fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fab080b4de0 0x7fab08146b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34090/0 (socket says 172.21.15.133:34090) 2021-01-03T13:01:24.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab077fe700 1 -- 172.21.15.133:0/3738495618 learned_addr learned my addr 172.21.15.133:0/3738495618 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:24.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab06ffd700 1 --2- 172.21.15.133:0/3738495618 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab080b9b60 0x7fab080b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:24.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab077fe700 1 -- 172.21.15.133:0/3738495618 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab080b9b60 msgr2=0x7fab080b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:24.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab077fe700 1 --2- 172.21.15.133:0/3738495618 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab080b9b60 0x7fab080b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab077fe700 1 -- 172.21.15.133:0/3738495618 >> v1:172.21.15.16:6789/0 conn(0x7fab080b4980 legacy=0x7fab08146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:24.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab077fe700 1 -- 172.21.15.133:0/3738495618 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab080600b0 con 0x7fab080b4de0 2021-01-03T13:01:24.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab06ffd700 1 --2- 172.21.15.133:0/3738495618 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab080b9b60 0x7fab080b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:01:24.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab077fe700 1 --2- 172.21.15.133:0/3738495618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab080b4de0 0x7fab08146b40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fab000032b0 tx=0x7fab00009270).ready entity=mon.1 client_cookie=6a5ae04ebf0eb787 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:24.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab067fc700 1 -- 172.21.15.133:0/3738495618 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab0000bc00 con 0x7fab080b4de0 2021-01-03T13:01:24.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab067fc700 1 -- 172.21.15.133:0/3738495618 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0000bd60 con 0x7fab080b4de0 2021-01-03T13:01:24.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab067fc700 1 -- 172.21.15.133:0/3738495618 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab00011400 con 0x7fab080b4de0 2021-01-03T13:01:24.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab07fff700 1 -- 172.21.15.133:0/3738495618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab080b4de0 msgr2=0x7fab08146b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:24.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab07fff700 1 --2- 172.21.15.133:0/3738495618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab080b4de0 0x7fab08146b40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fab000032b0 tx=0x7fab00009270).stop 2021-01-03T13:01:24.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab07fff700 1 -- 172.21.15.133:0/3738495618 shutdown_connections 2021-01-03T13:01:24.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab07fff700 1 --2- 172.21.15.133:0/3738495618 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab080b9b60 0x7fab080b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab07fff700 1 --2- 172.21.15.133:0/3738495618 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab080b4de0 0x7fab08146b40 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab07fff700 1 -- 172.21.15.133:0/3738495618 >> 172.21.15.133:0/3738495618 conn(0x7fab080b69e0 msgr2=0x7fab080b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:24.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab07fff700 1 -- 172.21.15.133:0/3738495618 shutdown_connections 2021-01-03T13:01:24.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab07fff700 1 -- 172.21.15.133:0/3738495618 wait complete. 2021-01-03T13:01:24.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab07fff700 1 Processor -- start 2021-01-03T13:01:24.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.915+0000 7fab07fff700 1 -- start start 2021-01-03T13:01:24.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab07fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab080b4980 0x7fab08155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:24.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab07fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab080b4de0 0x7fab08155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:24.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab07fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab080b9b60 0x7fab08141620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:24.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab07fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab08140f20 con 0x7fab080b4980 2021-01-03T13:01:24.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab07fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab08143470 con 0x7fab080b9b60 2021-01-03T13:01:24.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab07fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab08141180 con 0x7fab080b4de0 2021-01-03T13:01:24.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab077fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab080b9b60 0x7fab08141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:24.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab077fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab080b9b60 0x7fab08141620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34096/0 (socket says 172.21.15.133:34096) 2021-01-03T13:01:24.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab077fe700 1 -- 172.21.15.133:0/4120521367 learned_addr learned my addr 172.21.15.133:0/4120521367 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:24.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab06ffd700 1 --2- 172.21.15.133:0/4120521367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab080b4980 0x7fab08155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:24.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7faafe7fc700 1 --2- 172.21.15.133:0/4120521367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab080b4de0 0x7fab08155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:24.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab077fe700 1 -- 172.21.15.133:0/4120521367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab080b4de0 msgr2=0x7fab08155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:24.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab077fe700 1 --2- 172.21.15.133:0/4120521367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab080b4de0 0x7fab08155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab077fe700 1 -- 172.21.15.133:0/4120521367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab080b4980 msgr2=0x7fab08155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:24.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab077fe700 1 --2- 172.21.15.133:0/4120521367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab080b4980 0x7fab08155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:24.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab077fe700 1 -- 172.21.15.133:0/4120521367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab08149d10 con 0x7fab080b9b60 2021-01-03T13:01:24.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab077fe700 1 --2- 172.21.15.133:0/4120521367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab080b9b60 0x7fab08141620 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fab000032b0 tx=0x7fab00016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:24.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab04ff9700 1 -- 172.21.15.133:0/4120521367 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab0001e610 con 0x7fab080b9b60 2021-01-03T13:01:24.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab04ff9700 1 -- 172.21.15.133:0/4120521367 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0001e770 con 0x7fab080b9b60 2021-01-03T13:01:24.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab07fff700 1 -- 172.21.15.133:0/4120521367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab08143710 con 0x7fab080b9b60 2021-01-03T13:01:24.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab04ff9700 1 -- 172.21.15.133:0/4120521367 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab0001ead0 con 0x7fab080b9b60 2021-01-03T13:01:24.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab07fff700 1 -- 172.21.15.133:0/4120521367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab08143050 con 0x7fab080b9b60 2021-01-03T13:01:24.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.919+0000 7fab07fff700 1 -- 172.21.15.133:0/4120521367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab08141340 con 0x7fab080b9b60 2021-01-03T13:01:24.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.923+0000 7fab04ff9700 1 -- 172.21.15.133:0/4120521367 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fab0000f070 con 0x7fab080b9b60 2021-01-03T13:01:24.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.923+0000 7fab04ff9700 1 --2- 172.21.15.133:0/4120521367 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faaec055440 0x7faaec057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:24.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.923+0000 7fab04ff9700 1 -- 172.21.15.133:0/4120521367 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fab0006f7e0 con 0x7fab080b9b60 2021-01-03T13:01:24.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.923+0000 7fab06ffd700 1 --2- 172.21.15.133:0/4120521367 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faaec055440 0x7faaec057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:24.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.923+0000 7fab06ffd700 1 --2- 172.21.15.133:0/4120521367 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faaec055440 0x7faaec057900 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7faaf800c000 tx=0x7faaf8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:24.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:24.927+0000 7fab04ff9700 1 -- 172.21.15.133:0/4120521367 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fab00045950 con 0x7fab080b9b60 2021-01-03T13:01:25.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.071+0000 7fab07fff700 1 -- 172.21.15.133:0/4120521367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fab08057300 con 0x7fab080b9b60 2021-01-03T13:01:25.072 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.075+0000 7fab04ff9700 1 -- 172.21.15.133:0/4120521367 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v45) v1 ==== 81+0+33693 (secure 0 0 0) 0x7fab00048f70 con 0x7fab080b9b60 2021-01-03T13:01:25.073 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:01:25.073 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:01:25.074 INFO:teuthology.orchestra.run.smithi133.stdout: "epoch": 45, 2021-01-03T13:01:25.074 INFO:teuthology.orchestra.run.smithi133.stdout: "fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", 2021-01-03T13:01:25.074 INFO:teuthology.orchestra.run.smithi133.stdout: "created": "2021-01-03T12:57:43.298835+0000", 2021-01-03T13:01:25.074 INFO:teuthology.orchestra.run.smithi133.stdout: "modified": "2021-01-03T13:00:03.782001+0000", 2021-01-03T13:01:25.075 INFO:teuthology.orchestra.run.smithi133.stdout: "last_up_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:01:25.075 INFO:teuthology.orchestra.run.smithi133.stdout: "last_in_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:01:25.075 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-01-03T13:01:25.075 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_num": 5799936, 2021-01-03T13:01:25.076 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_set": [ 2021-01-03T13:01:25.076 INFO:teuthology.orchestra.run.smithi133.stdout: "pglog_hardlimit", 2021-01-03T13:01:25.076 INFO:teuthology.orchestra.run.smithi133.stdout: "purged_snapdirs", 2021-01-03T13:01:25.076 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_deletes", 2021-01-03T13:01:25.077 INFO:teuthology.orchestra.run.smithi133.stdout: "sortbitwise" 2021-01-03T13:01:25.077 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:01:25.077 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_version": 4, 2021-01-03T13:01:25.077 INFO:teuthology.orchestra.run.smithi133.stdout: "full_ratio": 0.94999998807907104, 2021-01-03T13:01:25.077 INFO:teuthology.orchestra.run.smithi133.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-01-03T13:01:25.078 INFO:teuthology.orchestra.run.smithi133.stdout: "nearfull_ratio": 0.85000002384185791, 2021-01-03T13:01:25.078 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_snapshot": "", 2021-01-03T13:01:25.078 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_max": 8, 2021-01-03T13:01:25.078 INFO:teuthology.orchestra.run.smithi133.stdout: "max_osd": 8, 2021-01-03T13:01:25.079 INFO:teuthology.orchestra.run.smithi133.stdout: "require_min_compat_client": "jewel", 2021-01-03T13:01:25.079 INFO:teuthology.orchestra.run.smithi133.stdout: "min_compat_client": "jewel", 2021-01-03T13:01:25.079 INFO:teuthology.orchestra.run.smithi133.stdout: "require_osd_release": "octopus", 2021-01-03T13:01:25.079 INFO:teuthology.orchestra.run.smithi133.stdout: "pools": [ 2021-01-03T13:01:25.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.080 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 1, 2021-01-03T13:01:25.080 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "device_health_metrics", 2021-01-03T13:01:25.080 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:47.102954+0000", 2021-01-03T13:01:25.080 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:01:25.081 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:01:25.081 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:01:25.081 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:01:25.081 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:01:25.082 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:01:25.082 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:01:25.082 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:01:25.082 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 1, 2021-01-03T13:01:25.083 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 1, 2021-01-03T13:01:25.083 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 1, 2021-01-03T13:01:25.083 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 1, 2021-01-03T13:01:25.083 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 1, 2021-01-03T13:01:25.084 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:01:25.084 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:01:25.084 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:01:25.085 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:01:25.085 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:01:25.085 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:01:25.085 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:01:25.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.086 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "16", 2021-01-03T13:01:25.086 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:01:25.086 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:01:25.087 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:01:25.087 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:01:25.087 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:01:25.088 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:01:25.088 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:01:25.088 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:01:25.088 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:01:25.089 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:01:25.089 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:01:25.089 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:01:25.089 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:01:25.090 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:01:25.090 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:01:25.090 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:01:25.090 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:01:25.091 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:01:25.091 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:01:25.091 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:01:25.091 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:01:25.092 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:01:25.092 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:01:25.092 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:01:25.092 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:01:25.093 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:01:25.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.093 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:01:25.093 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:01:25.094 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:01:25.094 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:01:25.094 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:01:25.095 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:01:25.095 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:01:25.095 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:01:25.095 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:01:25.095 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:01:25.096 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:01:25.096 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:01:25.096 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 1 2021-01-03T13:01:25.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.097 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:01:25.097 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr_devicehealth": {} 2021-01-03T13:01:25.097 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.098 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 2, 2021-01-03T13:01:25.098 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "rbd", 2021-01-03T13:01:25.098 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:55.472799+0000", 2021-01-03T13:01:25.099 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:01:25.099 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:01:25.099 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:01:25.099 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:01:25.100 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:01:25.100 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:01:25.100 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:01:25.101 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:01:25.101 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:01:25.101 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:01:25.101 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:01:25.102 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:01:25.102 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:01:25.102 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:01:25.102 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:01:25.103 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:01:25.103 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:01:25.103 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:01:25.103 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:01:25.104 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:01:25.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.104 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "19", 2021-01-03T13:01:25.104 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:01:25.105 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:01:25.105 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:01:25.105 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:01:25.105 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:01:25.106 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:01:25.106 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:01:25.106 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:01:25.107 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:01:25.107 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:01:25.107 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:01:25.108 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:01:25.108 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:01:25.108 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:01:25.108 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:01:25.109 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:01:25.109 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:01:25.109 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:01:25.110 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:01:25.110 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:01:25.110 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:01:25.110 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:01:25.111 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:01:25.111 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:01:25.111 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:01:25.112 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:01:25.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.112 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:01:25.112 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:01:25.113 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:01:25.113 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:01:25.113 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:01:25.113 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:01:25.114 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:01:25.114 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:01:25.114 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:01:25.115 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:01:25.115 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:01:25.115 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:01:25.115 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:01:25.115 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd": {} 2021-01-03T13:01:25.116 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.117 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 7, 2021-01-03T13:01:25.117 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_metadata", 2021-01-03T13:01:25.117 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:59:59.319419+0000", 2021-01-03T13:01:25.117 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:01:25.118 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:01:25.118 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:01:25.118 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:01:25.118 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:01:25.119 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:01:25.119 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:01:25.119 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:01:25.120 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:01:25.120 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:01:25.120 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:01:25.120 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:01:25.121 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:01:25.121 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:01:25.121 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:01:25.121 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:01:25.122 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:01:25.122 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:01:25.122 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:01:25.122 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:01:25.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.123 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "44", 2021-01-03T13:01:25.123 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:01:25.124 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:01:25.124 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:01:25.124 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:01:25.124 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:01:25.125 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:01:25.125 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:01:25.125 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:01:25.125 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:01:25.126 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:01:25.126 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:01:25.126 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:01:25.127 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:01:25.127 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:01:25.127 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:01:25.127 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:01:25.128 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:01:25.128 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:01:25.128 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:01:25.128 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:01:25.129 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:01:25.129 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:01:25.129 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:01:25.130 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:01:25.130 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:01:25.130 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:01:25.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.130 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:01:25.131 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:01:25.131 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:01:25.131 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:01:25.132 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:01:25.132 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:01:25.132 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:01:25.132 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:01:25.133 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:01:25.133 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:01:25.133 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:01:25.133 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:01:25.134 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_bias": 4, 2021-01-03T13:01:25.134 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 16, 2021-01-03T13:01:25.134 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_priority": 5 2021-01-03T13:01:25.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.134 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:01:25.135 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:01:25.135 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": "cephfs" 2021-01-03T13:01:25.135 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.135 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.136 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 8, 2021-01-03T13:01:25.136 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_data", 2021-01-03T13:01:25.136 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:00:00.624032+0000", 2021-01-03T13:01:25.137 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:01:25.137 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:01:25.137 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:01:25.137 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:01:25.138 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:01:25.138 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:01:25.138 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:01:25.138 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:01:25.138 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:01:25.139 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:01:25.139 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:01:25.139 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:01:25.139 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:01:25.140 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:01:25.140 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:01:25.140 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:01:25.140 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:01:25.140 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:01:25.141 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:01:25.141 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:01:25.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.142 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "45", 2021-01-03T13:01:25.142 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:01:25.142 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:01:25.143 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:01:25.143 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:01:25.143 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:01:25.143 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:01:25.144 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:01:25.144 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:01:25.144 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:01:25.145 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:01:25.145 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:01:25.145 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:01:25.145 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:01:25.146 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:01:25.146 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:01:25.146 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:01:25.146 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:01:25.147 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:01:25.147 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:01:25.147 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:01:25.148 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:01:25.148 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:01:25.148 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:01:25.148 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:01:25.149 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:01:25.149 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:01:25.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.149 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:01:25.150 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:01:25.150 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:01:25.150 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:01:25.151 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:01:25.151 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:01:25.151 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:01:25.152 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:01:25.152 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:01:25.152 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:01:25.153 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:01:25.153 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:01:25.153 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:01:25.154 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:01:25.154 INFO:teuthology.orchestra.run.smithi133.stdout: "data": "cephfs" 2021-01-03T13:01:25.154 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.154 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.155 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.155 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:01:25.155 INFO:teuthology.orchestra.run.smithi133.stdout: "osds": [ 2021-01-03T13:01:25.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.156 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:01:25.156 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a", 2021-01-03T13:01:25.156 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:01:25.157 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:01:25.157 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:01:25.157 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:01:25.157 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:01:25.158 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:01:25.158 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:01:25.158 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 42, 2021-01-03T13:01:25.158 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:01:25.159 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:01:25.159 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:01:25.159 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.160 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.160 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6810", 2021-01-03T13:01:25.160 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:01:25.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.161 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.161 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6811", 2021-01-03T13:01:25.161 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:01:25.162 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.162 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.162 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:01:25.163 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.163 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.163 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6812", 2021-01-03T13:01:25.164 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:01:25.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.164 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.165 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6813", 2021-01-03T13:01:25.165 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:01:25.165 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.165 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.166 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:01:25.166 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.166 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.166 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6816", 2021-01-03T13:01:25.167 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:01:25.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.167 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.168 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6817", 2021-01-03T13:01:25.168 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:01:25.168 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.168 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.169 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:01:25.169 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.169 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.169 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6814", 2021-01-03T13:01:25.170 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:01:25.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.170 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.171 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6815", 2021-01-03T13:01:25.171 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:01:25.171 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.171 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.172 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6811/12124", 2021-01-03T13:01:25.172 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6813/12124", 2021-01-03T13:01:25.172 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6817/12124", 2021-01-03T13:01:25.172 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6815/12124", 2021-01-03T13:01:25.172 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:01:25.173 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:01:25.173 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:01:25.173 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.174 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:01:25.174 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9170d1de-58d4-4dfd-b9de-80dc15ca9e60", 2021-01-03T13:01:25.174 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:01:25.174 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:01:25.175 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:01:25.175 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:01:25.175 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:01:25.175 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:01:25.175 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:01:25.176 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 43, 2021-01-03T13:01:25.176 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:01:25.176 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:01:25.176 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:01:25.176 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.177 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.177 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6818", 2021-01-03T13:01:25.177 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:01:25.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.178 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.178 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6819", 2021-01-03T13:01:25.178 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:01:25.179 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.179 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.179 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:01:25.179 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.180 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.180 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6820", 2021-01-03T13:01:25.180 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:01:25.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.181 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.181 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6821", 2021-01-03T13:01:25.181 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:01:25.182 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.182 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.182 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:01:25.182 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.183 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.183 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6824", 2021-01-03T13:01:25.183 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:01:25.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.184 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.184 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6825", 2021-01-03T13:01:25.184 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:01:25.185 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.185 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.185 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:01:25.185 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.186 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.186 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6822", 2021-01-03T13:01:25.186 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:01:25.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.187 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.187 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6823", 2021-01-03T13:01:25.187 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:01:25.188 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.188 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.188 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6819/12123", 2021-01-03T13:01:25.188 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6821/12123", 2021-01-03T13:01:25.189 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6825/12123", 2021-01-03T13:01:25.189 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6823/12123", 2021-01-03T13:01:25.189 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:01:25.189 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:01:25.189 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:01:25.190 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.190 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:01:25.191 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9fc5adf9-3537-4953-9c65-0c67ecb53776", 2021-01-03T13:01:25.191 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:01:25.191 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:01:25.191 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:01:25.191 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:01:25.192 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:01:25.192 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:01:25.192 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:01:25.192 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 31, 2021-01-03T13:01:25.192 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:01:25.193 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:01:25.193 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:01:25.193 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.193 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.194 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6802", 2021-01-03T13:01:25.194 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:01:25.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.195 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.195 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6803", 2021-01-03T13:01:25.195 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:01:25.195 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.195 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.196 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:01:25.196 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.196 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.197 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6804", 2021-01-03T13:01:25.197 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:01:25.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.198 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.198 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6805", 2021-01-03T13:01:25.198 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:01:25.198 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.198 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.199 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:01:25.199 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.200 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.200 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6808", 2021-01-03T13:01:25.200 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:01:25.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.201 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.201 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6809", 2021-01-03T13:01:25.201 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:01:25.201 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.202 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.202 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:01:25.202 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.203 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.203 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6806", 2021-01-03T13:01:25.203 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:01:25.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.204 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.204 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6807", 2021-01-03T13:01:25.204 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:01:25.204 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.205 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.205 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6803/12122", 2021-01-03T13:01:25.205 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6805/12122", 2021-01-03T13:01:25.205 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6809/12122", 2021-01-03T13:01:25.206 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6807/12122", 2021-01-03T13:01:25.206 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:01:25.206 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:01:25.206 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:01:25.207 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.207 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:01:25.207 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "0ad45ce5-6635-4089-bbf8-c966d0fe5338", 2021-01-03T13:01:25.208 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:01:25.208 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:01:25.208 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:01:25.208 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:01:25.208 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:01:25.209 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:01:25.209 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:01:25.209 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 43, 2021-01-03T13:01:25.209 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:01:25.209 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:01:25.210 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:01:25.210 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.210 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.211 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6826", 2021-01-03T13:01:25.211 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:01:25.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.211 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.212 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6827", 2021-01-03T13:01:25.212 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:01:25.212 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.212 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.213 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:01:25.213 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.213 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.214 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6828", 2021-01-03T13:01:25.214 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:01:25.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.214 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.215 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6829", 2021-01-03T13:01:25.215 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:01:25.215 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.215 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.216 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:01:25.216 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.216 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.217 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6832", 2021-01-03T13:01:25.217 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:01:25.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.217 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.218 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6833", 2021-01-03T13:01:25.218 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:01:25.218 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.218 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.219 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:01:25.219 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.219 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.220 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6830", 2021-01-03T13:01:25.220 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:01:25.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.220 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.221 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6831", 2021-01-03T13:01:25.221 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:01:25.221 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.221 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.222 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6827/12136", 2021-01-03T13:01:25.222 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6829/12136", 2021-01-03T13:01:25.222 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6833/12136", 2021-01-03T13:01:25.222 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6831/12136", 2021-01-03T13:01:25.223 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:01:25.223 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:01:25.223 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:01:25.223 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.224 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:01:25.224 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "86b8d6d5-271b-4a70-ae7b-a227afb38d7c", 2021-01-03T13:01:25.224 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:01:25.224 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:01:25.225 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:01:25.225 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:01:25.225 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:01:25.225 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:01:25.225 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:01:25.226 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 42, 2021-01-03T13:01:25.226 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:01:25.226 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:01:25.226 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:01:25.227 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.227 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.227 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6808", 2021-01-03T13:01:25.227 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:01:25.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.228 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.228 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6809", 2021-01-03T13:01:25.228 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:01:25.229 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.229 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.229 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:01:25.229 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.230 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.230 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6810", 2021-01-03T13:01:25.230 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:01:25.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.231 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.231 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6811", 2021-01-03T13:01:25.231 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:01:25.232 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.232 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.232 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:01:25.232 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.233 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.233 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6814", 2021-01-03T13:01:25.233 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:01:25.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.234 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.234 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6815", 2021-01-03T13:01:25.234 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:01:25.235 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.235 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.235 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:01:25.236 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.236 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.236 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6812", 2021-01-03T13:01:25.236 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:01:25.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.237 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.238 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6813", 2021-01-03T13:01:25.238 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:01:25.238 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.238 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.239 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6809/12672", 2021-01-03T13:01:25.239 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6811/12672", 2021-01-03T13:01:25.239 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6815/12672", 2021-01-03T13:01:25.240 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6813/12672", 2021-01-03T13:01:25.240 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:01:25.240 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:01:25.240 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:01:25.240 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.241 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:01:25.241 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "173feb9d-f596-4030-85d8-1f4b46a9ffe5", 2021-01-03T13:01:25.241 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:01:25.242 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:01:25.242 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:01:25.242 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:01:25.242 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:01:25.243 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:01:25.243 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:01:25.243 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 42, 2021-01-03T13:01:25.243 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:01:25.243 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:01:25.244 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:01:25.244 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.244 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.245 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6817", 2021-01-03T13:01:25.245 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:01:25.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.245 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.246 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6819", 2021-01-03T13:01:25.246 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:01:25.246 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.246 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.247 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:01:25.247 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.247 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.248 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6820", 2021-01-03T13:01:25.248 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:01:25.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.248 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.249 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6822", 2021-01-03T13:01:25.249 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:01:25.249 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.249 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.250 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:01:25.250 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.250 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.251 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6828", 2021-01-03T13:01:25.251 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:01:25.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.251 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.252 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6830", 2021-01-03T13:01:25.252 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:01:25.252 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.252 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.253 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:01:25.253 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.253 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.254 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6824", 2021-01-03T13:01:25.254 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:01:25.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.255 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.255 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6826", 2021-01-03T13:01:25.255 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:01:25.255 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.255 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.256 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6819/12673", 2021-01-03T13:01:25.256 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6822/12673", 2021-01-03T13:01:25.256 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6830/12673", 2021-01-03T13:01:25.256 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6826/12673", 2021-01-03T13:01:25.257 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:01:25.257 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:01:25.257 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:01:25.257 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.258 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:01:25.258 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "b487980e-ad4d-43c1-91fa-4845f7af3d4d", 2021-01-03T13:01:25.258 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:01:25.259 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:01:25.259 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:01:25.259 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:01:25.259 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:01:25.259 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:01:25.260 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:01:25.260 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 42, 2021-01-03T13:01:25.260 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:01:25.260 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:01:25.261 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:01:25.261 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.261 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.261 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6800", 2021-01-03T13:01:25.262 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:01:25.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.262 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.262 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6801", 2021-01-03T13:01:25.263 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:01:25.263 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.263 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.264 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:01:25.264 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.264 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.264 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6802", 2021-01-03T13:01:25.265 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:01:25.265 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.265 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.266 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6803", 2021-01-03T13:01:25.266 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:01:25.266 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.266 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.267 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:01:25.267 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.267 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.267 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6806", 2021-01-03T13:01:25.268 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:01:25.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.268 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.269 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6807", 2021-01-03T13:01:25.269 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:01:25.269 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.269 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.270 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:01:25.270 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.270 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.271 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6804", 2021-01-03T13:01:25.271 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:01:25.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.271 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.272 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6805", 2021-01-03T13:01:25.272 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:01:25.272 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.272 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.273 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6801/12662", 2021-01-03T13:01:25.273 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6803/12662", 2021-01-03T13:01:25.273 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6807/12662", 2021-01-03T13:01:25.273 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6805/12662", 2021-01-03T13:01:25.274 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:01:25.274 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:01:25.274 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:01:25.274 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.275 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:01:25.275 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "38ea839a-451f-4c09-a545-4514e049b178", 2021-01-03T13:01:25.275 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:01:25.276 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:01:25.276 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:01:25.276 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:01:25.276 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:01:25.276 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:01:25.277 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:01:25.277 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 40, 2021-01-03T13:01:25.277 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:01:25.277 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:01:25.277 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:01:25.278 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.278 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.278 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6816", 2021-01-03T13:01:25.279 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:01:25.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.279 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.279 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6818", 2021-01-03T13:01:25.280 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:01:25.280 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.280 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.280 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:01:25.281 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.281 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.281 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6821", 2021-01-03T13:01:25.282 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:01:25.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.282 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.282 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.282 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6823", 2021-01-03T13:01:25.283 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:01:25.283 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.283 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.283 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:01:25.284 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.284 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.284 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6829", 2021-01-03T13:01:25.284 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:01:25.285 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.285 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.285 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6831", 2021-01-03T13:01:25.286 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:01:25.286 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.286 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.286 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.286 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:01:25.287 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:01:25.287 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.287 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:01:25.287 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6825", 2021-01-03T13:01:25.287 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:01:25.288 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.288 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.288 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:01:25.288 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6827", 2021-01-03T13:01:25.289 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:01:25.289 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.289 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.289 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.289 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6818/12674", 2021-01-03T13:01:25.290 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6823/12674", 2021-01-03T13:01:25.290 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6831/12674", 2021-01-03T13:01:25.290 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6827/12674", 2021-01-03T13:01:25.290 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:01:25.290 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:01:25.291 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:01:25.291 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:25.291 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.291 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:01:25.292 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_xinfo": [ 2021-01-03T13:01:25.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.292 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:01:25.292 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:01:25.292 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:01:25.293 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:01:25.293 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:01:25.293 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:01:25.293 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.659942+0000", 2021-01-03T13:01:25.293 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:01:25.294 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.294 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.294 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:01:25.294 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:01:25.295 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:01:25.295 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:01:25.295 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:01:25.295 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:01:25.295 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.750326+0000", 2021-01-03T13:01:25.296 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:01:25.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.296 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:01:25.296 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:01:25.297 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:01:25.297 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:01:25.297 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:01:25.297 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:01:25.297 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.587742+0000", 2021-01-03T13:01:25.298 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:01:25.298 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.298 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.298 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:01:25.299 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:01:25.299 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:01:25.299 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:01:25.299 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:01:25.299 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:01:25.300 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.855073+0000", 2021-01-03T13:01:25.300 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:01:25.300 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.300 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:01:25.301 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:01:25.301 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:01:25.301 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:01:25.301 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:01:25.302 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:01:25.302 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.565030+0000", 2021-01-03T13:01:25.302 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:01:25.302 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.302 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.303 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:01:25.303 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:01:25.303 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:01:25.303 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:01:25.303 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:01:25.304 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:01:25.304 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.786206+0000", 2021-01-03T13:01:25.304 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:01:25.304 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.305 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.305 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:01:25.305 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:01:25.305 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:01:25.305 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:01:25.306 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:01:25.306 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:01:25.306 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.576185+0000", 2021-01-03T13:01:25.306 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:01:25.306 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:25.307 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:01:25.307 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:01:25.307 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:01:25.308 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:01:25.308 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:01:25.308 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:01:25.308 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.823786+0000", 2021-01-03T13:01:25.308 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:01:25.309 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.309 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:01:25.309 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap": [], 2021-01-03T13:01:25.309 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap_items": [], 2021-01-03T13:01:25.309 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_temp": [], 2021-01-03T13:01:25.310 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_temp": [], 2021-01-03T13:01:25.310 INFO:teuthology.orchestra.run.smithi133.stdout: "blacklist": {}, 2021-01-03T13:01:25.310 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profiles": { 2021-01-03T13:01:25.310 INFO:teuthology.orchestra.run.smithi133.stdout: "default": { 2021-01-03T13:01:25.311 INFO:teuthology.orchestra.run.smithi133.stdout: "crush-failure-domain": "osd", 2021-01-03T13:01:25.311 INFO:teuthology.orchestra.run.smithi133.stdout: "k": "2", 2021-01-03T13:01:25.311 INFO:teuthology.orchestra.run.smithi133.stdout: "m": "1", 2021-01-03T13:01:25.311 INFO:teuthology.orchestra.run.smithi133.stdout: "plugin": "jerasure", 2021-01-03T13:01:25.311 INFO:teuthology.orchestra.run.smithi133.stdout: "ruleset-failure-domain": "osd", 2021-01-03T13:01:25.312 INFO:teuthology.orchestra.run.smithi133.stdout: "technique": "reed_sol_van" 2021-01-03T13:01:25.312 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:25.312 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:25.312 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps_queue": [], 2021-01-03T13:01:25.312 INFO:teuthology.orchestra.run.smithi133.stdout: "new_removed_snaps": [], 2021-01-03T13:01:25.313 INFO:teuthology.orchestra.run.smithi133.stdout: "new_purged_snaps": [], 2021-01-03T13:01:25.313 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_node_flags": {}, 2021-01-03T13:01:25.313 INFO:teuthology.orchestra.run.smithi133.stdout: "device_class_flags": {} 2021-01-03T13:01:25.313 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:01:25.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.075+0000 7fab07fff700 1 -- 172.21.15.133:0/4120521367 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faaec055440 msgr2=0x7faaec057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:25.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.075+0000 7fab07fff700 1 --2- 172.21.15.133:0/4120521367 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faaec055440 0x7faaec057900 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7faaf800c000 tx=0x7faaf8008040).stop 2021-01-03T13:01:25.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.075+0000 7fab07fff700 1 -- 172.21.15.133:0/4120521367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab080b9b60 msgr2=0x7fab08141620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:25.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.075+0000 7fab07fff700 1 --2- 172.21.15.133:0/4120521367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab080b9b60 0x7fab08141620 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fab000032b0 tx=0x7fab00016000).stop 2021-01-03T13:01:25.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.075+0000 7fab07fff700 1 -- 172.21.15.133:0/4120521367 shutdown_connections 2021-01-03T13:01:25.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.075+0000 7fab07fff700 1 --2- 172.21.15.133:0/4120521367 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faaec055440 0x7faaec057900 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:25.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.075+0000 7fab07fff700 1 --2- 172.21.15.133:0/4120521367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab080b4980 0x7fab08155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:25.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.075+0000 7fab07fff700 1 --2- 172.21.15.133:0/4120521367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab080b9b60 0x7fab08141620 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:25.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.075+0000 7fab07fff700 1 --2- 172.21.15.133:0/4120521367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab080b4de0 0x7fab08155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:25.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.075+0000 7fab07fff700 1 -- 172.21.15.133:0/4120521367 >> 172.21.15.133:0/4120521367 conn(0x7fab080b69e0 msgr2=0x7fab0805c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:25.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.075+0000 7fab07fff700 1 -- 172.21.15.133:0/4120521367 shutdown_connections 2021-01-03T13:01:25.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.075+0000 7fab07fff700 1 -- 172.21.15.133:0/4120521367 wait complete. 2021-01-03T13:01:25.318 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:01:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfbfff700 1 Processor -- start 2021-01-03T13:01:25.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfbfff700 1 -- start start 2021-01-03T13:01:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfbfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1bfc0b2350 0x7f1bfc14a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfbfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1bfc0b1b20 0x7f1bfc14adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:25.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfbfff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bfc0b1110 con 0x7f1bfc0a7570 2021-01-03T13:01:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfbfff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bfc0a7cb0 con 0x7f1bfc0b2350 2021-01-03T13:01:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfbfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0b0520 con 0x7f1bfc0b1b20 2021-01-03T13:01:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfa7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1bfc0a7570 0x7f1bfc0671e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55134/0 (socket says 172.21.15.133:55134) 2021-01-03T13:01:25.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfa7fc700 1 -- 172.21.15.133:0/3467724373 learned_addr learned my addr 172.21.15.133:0/3467724373 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfaffd700 1 --2- 172.21.15.133:0/3467724373 >> v2:172.21.15.16:3300/0 conn(0x7f1bfc0b2350 0x7f1bfc14a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfb7fe700 1 --2- 172.21.15.133:0/3467724373 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1bfc0b1b20 0x7f1bfc14adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bf9ffb700 1 -- 172.21.15.133:0/3467724373 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544721553 0 0) 0x7f1bfc0b1110 con 0x7f1bfc0a7570 2021-01-03T13:01:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bf9ffb700 1 -- 172.21.15.133:0/3467724373 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1be0003230 con 0x7f1bfc0a7570 2021-01-03T13:01:25.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfaffd700 1 -- 172.21.15.133:0/3467724373 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1bfc0b1b20 msgr2=0x7f1bfc14adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:25.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfaffd700 1 --2- 172.21.15.133:0/3467724373 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1bfc0b1b20 0x7f1bfc14adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:25.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfaffd700 1 -- 172.21.15.133:0/3467724373 >> v1:172.21.15.133:6789/0 conn(0x7f1bfc0a7570 legacy=0x7f1bfc0671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:25.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfaffd700 1 -- 172.21.15.133:0/3467724373 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc0b0bd0 con 0x7f1bfc0b2350 2021-01-03T13:01:25.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfaffd700 1 --2- 172.21.15.133:0/3467724373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bfc0b2350 0x7f1bfc14a8d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f1bf40032b0 tx=0x7f1bf40091a0).ready entity=mon.0 client_cookie=f448af454eb7074d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:25.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bf9ffb700 1 -- 172.21.15.133:0/3467724373 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bf400b940 con 0x7f1bfc0b2350 2021-01-03T13:01:25.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bf9ffb700 1 -- 172.21.15.133:0/3467724373 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf400baa0 con 0x7f1bfc0b2350 2021-01-03T13:01:25.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bf9ffb700 1 -- 172.21.15.133:0/3467724373 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bf400bc10 con 0x7f1bfc0b2350 2021-01-03T13:01:25.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfbfff700 1 -- 172.21.15.133:0/3467724373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bfc0b2350 msgr2=0x7f1bfc14a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:25.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.443+0000 7f1bfbfff700 1 --2- 172.21.15.133:0/3467724373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bfc0b2350 0x7f1bfc14a8d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f1bf40032b0 tx=0x7f1bf40091a0).stop 2021-01-03T13:01:25.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfbfff700 1 -- 172.21.15.133:0/3467724373 shutdown_connections 2021-01-03T13:01:25.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfbfff700 1 --2- 172.21.15.133:0/3467724373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bfc0b2350 0x7f1bfc14a8d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:25.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfbfff700 1 --2- 172.21.15.133:0/3467724373 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1bfc0b1b20 0x7f1bfc14adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:25.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfbfff700 1 -- 172.21.15.133:0/3467724373 >> 172.21.15.133:0/3467724373 conn(0x7f1bfc06b050 msgr2=0x7f1bfc060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:25.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfbfff700 1 -- 172.21.15.133:0/3467724373 shutdown_connections 2021-01-03T13:01:25.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfbfff700 1 -- 172.21.15.133:0/3467724373 wait complete. 2021-01-03T13:01:25.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfbfff700 1 Processor -- start 2021-01-03T13:01:25.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfbfff700 1 -- start start 2021-01-03T13:01:25.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfbfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bfc0a7570 0x7f1bfc1597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfbfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1bfc0b1b20 0x7f1bfc159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bfc0b2350 0x7f1bfc156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfbfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc144ae0 con 0x7f1bfc0a7570 2021-01-03T13:01:25.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfbfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc15a1d0 con 0x7f1bfc0b2350 2021-01-03T13:01:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfbfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc148af0 con 0x7f1bfc0b1b20 2021-01-03T13:01:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bfc0b2350 0x7f1bfc156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfa7fc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1bfc0b1b20 0x7f1bfc159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfa7fc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1bfc0b1b20 0x7f1bfc159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:42408/0 (socket says 172.21.15.133:42408) 2021-01-03T13:01:25.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bfc0b2350 0x7f1bfc156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34110/0 (socket says 172.21.15.133:34110) 2021-01-03T13:01:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfa7fc700 1 -- 172.21.15.133:0/261592056 learned_addr learned my addr 172.21.15.133:0/261592056 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfaffd700 1 --2- 172.21.15.133:0/261592056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bfc0a7570 0x7f1bfc1597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfb7fe700 1 -- 172.21.15.133:0/261592056 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1bfc0b1b20 msgr2=0x7f1bfc159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfb7fe700 1 --2- 172.21.15.133:0/261592056 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1bfc0b1b20 0x7f1bfc159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:25.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfb7fe700 1 -- 172.21.15.133:0/261592056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bfc0a7570 msgr2=0x7f1bfc1597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfb7fe700 1 --2- 172.21.15.133:0/261592056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bfc0a7570 0x7f1bfc1597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfb7fe700 1 -- 172.21.15.133:0/261592056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc149320 con 0x7f1bfc0b2350 2021-01-03T13:01:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfb7fe700 1 --2- 172.21.15.133:0/261592056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bfc0b2350 0x7f1bfc156320 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f1bfc144c20 tx=0x7f1bec006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:25.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bebfff700 1 -- 172.21.15.133:0/261592056 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bec00c800 con 0x7f1bfc0b2350 2021-01-03T13:01:25.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bebfff700 1 -- 172.21.15.133:0/261592056 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec00c960 con 0x7f1bfc0b2350 2021-01-03T13:01:25.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.447+0000 7f1bfbfff700 1 -- 172.21.15.133:0/261592056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bfc15a3f0 con 0x7f1bfc0b2350 2021-01-03T13:01:25.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.451+0000 7f1bebfff700 1 -- 172.21.15.133:0/261592056 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bec00ccc0 con 0x7f1bfc0b2350 2021-01-03T13:01:25.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.451+0000 7f1bfbfff700 1 -- 172.21.15.133:0/261592056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc149580 con 0x7f1bfc0b2350 2021-01-03T13:01:25.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.451+0000 7f1bfbfff700 1 -- 172.21.15.133:0/261592056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bfc149740 con 0x7f1bfc0b2350 2021-01-03T13:01:25.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.451+0000 7f1bebfff700 1 -- 172.21.15.133:0/261592056 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1bec01c460 con 0x7f1bfc0b2350 2021-01-03T13:01:25.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.451+0000 7f1bebfff700 1 --2- 172.21.15.133:0/261592056 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bd8055440 0x7f1bd8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:25.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.451+0000 7f1bebfff700 1 -- 172.21.15.133:0/261592056 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1bec06e240 con 0x7f1bfc0b2350 2021-01-03T13:01:25.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.451+0000 7f1bfaffd700 1 --2- 172.21.15.133:0/261592056 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bd8055440 0x7f1bd8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:25.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.451+0000 7f1bfaffd700 1 --2- 172.21.15.133:0/261592056 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bd8055440 0x7f1bd8057900 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f1bf401c000 tx=0x7f1bf4016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:25.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.459+0000 7f1bebfff700 1 -- 172.21.15.133:0/261592056 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1bec0444e0 con 0x7f1bfc0b2350 2021-01-03T13:01:25.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.639+0000 7f1bfbfff700 1 -- 172.21.15.133:0/261592056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bfc057300 con 0x7f1bfc0b2350 2021-01-03T13:01:25.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.643+0000 7f1bebfff700 1 -- 172.21.15.133:0/261592056 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2494 (secure 0 0 0) 0x7f1bec047b00 con 0x7f1bfc0b2350 2021-01-03T13:01:25.640 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:01:25.640 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5169,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/126912106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":126912106},{"type":"v1","addr":"172.21.15.16:6833","nonce":126912106}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13},{"gid":5212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/1241297212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1241297212},{"type":"v1","addr":"172.21.15.133:6835","nonce":1241297212}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:00:01.768700+0000","modified":"2021-01-03T13:00:02.771604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5218},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5218":{"gid":5218,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/2379309183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":2379309183},{"type":"v1","addr":"172.21.15.133:6837","nonce":2379309183}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-01-03T13:01:25.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.643+0000 7f1bfbfff700 1 -- 172.21.15.133:0/261592056 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bd8055440 msgr2=0x7f1bd8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:25.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.643+0000 7f1bfbfff700 1 --2- 172.21.15.133:0/261592056 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bd8055440 0x7f1bd8057900 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f1bf401c000 tx=0x7f1bf4016000).stop 2021-01-03T13:01:25.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.643+0000 7f1bfbfff700 1 -- 172.21.15.133:0/261592056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bfc0b2350 msgr2=0x7f1bfc156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:25.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.643+0000 7f1bfbfff700 1 --2- 172.21.15.133:0/261592056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bfc0b2350 0x7f1bfc156320 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f1bfc144c20 tx=0x7f1bec006dc0).stop 2021-01-03T13:01:25.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.643+0000 7f1bfbfff700 1 -- 172.21.15.133:0/261592056 shutdown_connections 2021-01-03T13:01:25.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.643+0000 7f1bfbfff700 1 --2- 172.21.15.133:0/261592056 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bd8055440 0x7f1bd8057900 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:25.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.643+0000 7f1bfbfff700 1 --2- 172.21.15.133:0/261592056 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bfc0a7570 0x7f1bfc1597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:25.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.643+0000 7f1bfbfff700 1 --2- 172.21.15.133:0/261592056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bfc0b2350 0x7f1bfc156320 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:25.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.643+0000 7f1bfbfff700 1 --2- 172.21.15.133:0/261592056 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1bfc0b1b20 0x7f1bfc159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:25.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.643+0000 7f1bfbfff700 1 -- 172.21.15.133:0/261592056 >> 172.21.15.133:0/261592056 conn(0x7f1bfc06b050 msgr2=0x7f1bfc0b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:25.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.643+0000 7f1bfbfff700 1 -- 172.21.15.133:0/261592056 shutdown_connections 2021-01-03T13:01:25.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.643+0000 7f1bfbfff700 1 -- 172.21.15.133:0/261592056 wait complete. 2021-01-03T13:01:25.644 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 16 2021-01-03T13:01:25.659 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-01-03T13:01:25.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d5347a700 1 Processor -- start 2021-01-03T13:01:25.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d5347a700 1 -- start start 2021-01-03T13:01:25.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d5347a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d4c0b1590 0x7f5d4c0b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:25.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d5347a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c05fd00 con 0x7f5d4c05f920 2021-01-03T13:01:25.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d5347a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c0accd0 con 0x7f5d4c066f30 2021-01-03T13:01:25.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d5347a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4c0b2980 con 0x7f5d4c0b1590 2021-01-03T13:01:25.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d51c77700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5d4c066f30 0x7f5d4c13ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55148/0 (socket says 172.21.15.133:55148) 2021-01-03T13:01:25.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d51c77700 1 -- 172.21.15.133:0/1718155415 learned_addr learned my addr 172.21.15.133:0/1718155415 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:25.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d52c79700 1 --2- 172.21.15.133:0/1718155415 >> v2:172.21.15.133:3300/0 conn(0x7f5d4c0b1590 0x7f5d4c0b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:25.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d51476700 1 -- 172.21.15.133:0/1718155415 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302496120 0 0) 0x7f5d4c0accd0 con 0x7f5d4c066f30 2021-01-03T13:01:25.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d51476700 1 -- 172.21.15.133:0/1718155415 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d30003230 con 0x7f5d4c066f30 2021-01-03T13:01:25.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d51476700 1 -- 172.21.15.133:0/1718155415 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949805824 0 0) 0x7f5d4c05fd00 con 0x7f5d4c05f920 2021-01-03T13:01:25.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d51476700 1 -- 172.21.15.133:0/1718155415 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d4c0accd0 con 0x7f5d4c05f920 2021-01-03T13:01:25.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d52c79700 1 -- 172.21.15.133:0/1718155415 >> v1:172.21.15.133:6789/0 conn(0x7f5d4c066f30 legacy=0x7f5d4c13ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:25.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d52c79700 1 -- 172.21.15.133:0/1718155415 >> v1:172.21.15.16:6789/0 conn(0x7f5d4c05f920 legacy=0x7f5d4c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:25.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d52c79700 1 -- 172.21.15.133:0/1718155415 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c0acf70 con 0x7f5d4c0b1590 2021-01-03T13:01:25.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d52c79700 1 --2- 172.21.15.133:0/1718155415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d4c0b1590 0x7f5d4c0b0ab0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f5d44002f30 tx=0x7f5d44006dc0).ready entity=mon.1 client_cookie=32ff3b565925221d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:25.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d51476700 1 -- 172.21.15.133:0/1718155415 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d44009740 con 0x7f5d4c0b1590 2021-01-03T13:01:25.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d51476700 1 -- 172.21.15.133:0/1718155415 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d440098a0 con 0x7f5d4c0b1590 2021-01-03T13:01:25.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d51476700 1 -- 172.21.15.133:0/1718155415 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d44009c00 con 0x7f5d4c0b1590 2021-01-03T13:01:25.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d5347a700 1 -- 172.21.15.133:0/1718155415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d4c0b1590 msgr2=0x7f5d4c0b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:25.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d5347a700 1 --2- 172.21.15.133:0/1718155415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d4c0b1590 0x7f5d4c0b0ab0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f5d44002f30 tx=0x7f5d44006dc0).stop 2021-01-03T13:01:25.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d5347a700 1 -- 172.21.15.133:0/1718155415 shutdown_connections 2021-01-03T13:01:25.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d5347a700 1 --2- 172.21.15.133:0/1718155415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d4c0b1590 0x7f5d4c0b0ab0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:25.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d5347a700 1 -- 172.21.15.133:0/1718155415 >> 172.21.15.133:0/1718155415 conn(0x7f5d4c0b6110 msgr2=0x7f5d4c0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:25.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d5347a700 1 -- 172.21.15.133:0/1718155415 shutdown_connections 2021-01-03T13:01:25.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.775+0000 7f5d5347a700 1 -- 172.21.15.133:0/1718155415 wait complete. 2021-01-03T13:01:25.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d5347a700 1 Processor -- start 2021-01-03T13:01:25.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d5347a700 1 -- start start 2021-01-03T13:01:25.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d5347a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d4c05f920 0x7f5d4c141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:25.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d5347a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d4c066f30 0x7f5d4c153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:25.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d5347a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d4c0b1590 0x7f5d4c153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:25.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d5347a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0a2ee0 con 0x7f5d4c0b1590 2021-01-03T13:01:25.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d5347a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c153d20 con 0x7f5d4c066f30 2021-01-03T13:01:25.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d5347a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0a0a60 con 0x7f5d4c05f920 2021-01-03T13:01:25.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d51c77700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d4c066f30 0x7f5d4c153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:25.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d51c77700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d4c066f30 0x7f5d4c153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34124/0 (socket says 172.21.15.133:34124) 2021-01-03T13:01:25.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d51c77700 1 -- 172.21.15.133:0/3085701035 learned_addr learned my addr 172.21.15.133:0/3085701035 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:25.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d52c79700 1 --2- 172.21.15.133:0/3085701035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d4c0b1590 0x7f5d4c153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:25.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d52478700 1 --2- 172.21.15.133:0/3085701035 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d4c05f920 0x7f5d4c141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:25.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d51c77700 1 -- 172.21.15.133:0/3085701035 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d4c05f920 msgr2=0x7f5d4c141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:25.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d51c77700 1 --2- 172.21.15.133:0/3085701035 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d4c05f920 0x7f5d4c141ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:25.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d51c77700 1 -- 172.21.15.133:0/3085701035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d4c0b1590 msgr2=0x7f5d4c153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:25.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d51c77700 1 --2- 172.21.15.133:0/3085701035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d4c0b1590 0x7f5d4c153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:25.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d51c77700 1 -- 172.21.15.133:0/3085701035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c0a0d00 con 0x7f5d4c066f30 2021-01-03T13:01:25.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d52478700 1 --2- 172.21.15.133:0/3085701035 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d4c05f920 0x7f5d4c141ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:01:25.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d51c77700 1 --2- 172.21.15.133:0/3085701035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d4c066f30 0x7f5d4c153340 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f5d4c0a3020 tx=0x7f5d38007ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:25.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d4b7fe700 1 -- 172.21.15.133:0/3085701035 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d380072e0 con 0x7f5d4c066f30 2021-01-03T13:01:25.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d4b7fe700 1 -- 172.21.15.133:0/3085701035 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d38007440 con 0x7f5d4c066f30 2021-01-03T13:01:25.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d5347a700 1 -- 172.21.15.133:0/3085701035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4c0a0fa0 con 0x7f5d4c066f30 2021-01-03T13:01:25.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d4b7fe700 1 -- 172.21.15.133:0/3085701035 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d380057d0 con 0x7f5d4c066f30 2021-01-03T13:01:25.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.779+0000 7f5d5347a700 1 -- 172.21.15.133:0/3085701035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4c0ac4d0 con 0x7f5d4c066f30 2021-01-03T13:01:25.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.783+0000 7f5d4b7fe700 1 -- 172.21.15.133:0/3085701035 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5d3801a060 con 0x7f5d4c066f30 2021-01-03T13:01:25.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.783+0000 7f5d5347a700 1 -- 172.21.15.133:0/3085701035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4c0ac7e0 con 0x7f5d4c066f30 2021-01-03T13:01:25.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.783+0000 7f5d4b7fe700 1 --2- 172.21.15.133:0/3085701035 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5d340554e0 0x7f5d340579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:25.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.783+0000 7f5d4b7fe700 1 -- 172.21.15.133:0/3085701035 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5d3806d6e0 con 0x7f5d4c066f30 2021-01-03T13:01:25.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.783+0000 7f5d52478700 1 --2- 172.21.15.133:0/3085701035 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5d340554e0 0x7f5d340579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:25.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.783+0000 7f5d52478700 1 --2- 172.21.15.133:0/3085701035 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5d340554e0 0x7f5d340579a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f5d4000b000 tx=0x7f5d40009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:25.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.787+0000 7f5d4b7fe700 1 -- 172.21.15.133:0/3085701035 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5d380439e0 con 0x7f5d4c066f30 2021-01-03T13:01:25.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:25.971+0000 7f5d5347a700 1 -- 172.21.15.133:0/3085701035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5d4c057300 con 0x7f5d4c066f30 2021-01-03T13:01:26.658 INFO:tasks.ceph.mon.b.smithi016.stderr:2021-01-03T13:01:26.661+0000 7fba5c9c4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-01-03T13:01:26.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.667+0000 7f5d4b7fe700 1 -- 172.21.15.133:0/3085701035 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5d38018070 con 0x7f5d4c066f30 2021-01-03T13:01:26.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.671+0000 7f5d5347a700 1 -- 172.21.15.133:0/3085701035 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5d340554e0 msgr2=0x7f5d340579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.671+0000 7f5d5347a700 1 --2- 172.21.15.133:0/3085701035 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5d340554e0 0x7f5d340579a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f5d4000b000 tx=0x7f5d40009040).stop 2021-01-03T13:01:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.671+0000 7f5d5347a700 1 -- 172.21.15.133:0/3085701035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d4c066f30 msgr2=0x7f5d4c153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:26.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.671+0000 7f5d5347a700 1 --2- 172.21.15.133:0/3085701035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d4c066f30 0x7f5d4c153340 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f5d4c0a3020 tx=0x7f5d38007ac0).stop 2021-01-03T13:01:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.671+0000 7f5d5347a700 1 -- 172.21.15.133:0/3085701035 shutdown_connections 2021-01-03T13:01:26.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.671+0000 7f5d5347a700 1 --2- 172.21.15.133:0/3085701035 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5d340554e0 0x7f5d340579a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.671+0000 7f5d5347a700 1 --2- 172.21.15.133:0/3085701035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d4c0b1590 0x7f5d4c153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.671+0000 7f5d5347a700 1 --2- 172.21.15.133:0/3085701035 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d4c05f920 0x7f5d4c141ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.671+0000 7f5d5347a700 1 --2- 172.21.15.133:0/3085701035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d4c066f30 0x7f5d4c153340 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.671+0000 7f5d5347a700 1 -- 172.21.15.133:0/3085701035 >> 172.21.15.133:0/3085701035 conn(0x7f5d4c0b6110 msgr2=0x7f5d4c0ae000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:26.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.671+0000 7f5d5347a700 1 -- 172.21.15.133:0/3085701035 shutdown_connections 2021-01-03T13:01:26.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.671+0000 7f5d5347a700 1 -- 172.21.15.133:0/3085701035 wait complete. 2021-01-03T13:01:26.673 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-01-03T13:01:26.686 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:01:26.704 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T13:01:26.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.791+0000 7f4de759e700 1 Processor -- start 2021-01-03T13:01:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.791+0000 7f4de759e700 1 -- start start 2021-01-03T13:01:26.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.791+0000 7f4de759e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4de809cca0 0x7f4de8060ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.791+0000 7f4de759e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4de80b36a0 0x7f4de805f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.791+0000 7f4de759e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de809d080 con 0x7f4de805fad0 2021-01-03T13:01:26.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.791+0000 7f4de759e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de8147050 con 0x7f4de809cca0 2021-01-03T13:01:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.791+0000 7f4de759e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80adfa0 con 0x7f4de80b36a0 2021-01-03T13:01:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.791+0000 7f4de659c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4de809cca0 0x7f4de8060ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.791+0000 7f4de5d9b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4de80b36a0 0x7f4de805f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.791+0000 7f4de659c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4de809cca0 0x7f4de8060ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:60912/0 (socket says 172.21.15.133:60912) 2021-01-03T13:01:26.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.791+0000 7f4de659c700 1 -- 172.21.15.133:0/2265075710 learned_addr learned my addr 172.21.15.133:0/2265075710 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.791+0000 7f4de5d9b700 1 -- 172.21.15.133:0/2265075710 >> v2:172.21.15.16:3300/0 conn(0x7f4de809cca0 msgr2=0x7f4de8060ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.791+0000 7f4de5d9b700 1 --2- 172.21.15.133:0/2265075710 >> v2:172.21.15.16:3300/0 conn(0x7f4de809cca0 0x7f4de8060ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.791+0000 7f4de5d9b700 1 -- 172.21.15.133:0/2265075710 >> v1:172.21.15.16:6789/0 conn(0x7f4de805fad0 legacy=0x7f4de81442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:26.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.791+0000 7f4de5d9b700 1 -- 172.21.15.133:0/2265075710 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de805ff60 con 0x7f4de80b36a0 2021-01-03T13:01:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.791+0000 7f4de659c700 1 --2- 172.21.15.133:0/2265075710 >> v2:172.21.15.16:3300/0 conn(0x7f4de809cca0 0x7f4de8060ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:01:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.791+0000 7f4de5d9b700 1 --2- 172.21.15.133:0/2265075710 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4de80b36a0 0x7f4de805f5e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4dd0002f30 tx=0x7f4dd0006dc0).ready entity=mon.2 client_cookie=818bf1760f057e89 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de559a700 1 -- 172.21.15.133:0/2265075710 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dd0009760 con 0x7f4de80b36a0 2021-01-03T13:01:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de559a700 1 -- 172.21.15.133:0/2265075710 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd00098c0 con 0x7f4de80b36a0 2021-01-03T13:01:26.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de559a700 1 -- 172.21.15.133:0/2265075710 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dd0009c20 con 0x7f4de80b36a0 2021-01-03T13:01:26.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de759e700 1 -- 172.21.15.133:0/2265075710 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4de80b36a0 msgr2=0x7f4de805f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:26.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de759e700 1 --2- 172.21.15.133:0/2265075710 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4de80b36a0 0x7f4de805f5e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4dd0002f30 tx=0x7f4dd0006dc0).stop 2021-01-03T13:01:26.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de759e700 1 -- 172.21.15.133:0/2265075710 shutdown_connections 2021-01-03T13:01:26.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de759e700 1 --2- 172.21.15.133:0/2265075710 >> v2:172.21.15.16:3300/0 conn(0x7f4de809cca0 0x7f4de8060ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:26.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de759e700 1 --2- 172.21.15.133:0/2265075710 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4de80b36a0 0x7f4de805f5e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:26.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de759e700 1 -- 172.21.15.133:0/2265075710 >> 172.21.15.133:0/2265075710 conn(0x7f4de80b7200 msgr2=0x7f4de80b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:26.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de759e700 1 -- 172.21.15.133:0/2265075710 shutdown_connections 2021-01-03T13:01:26.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de759e700 1 -- 172.21.15.133:0/2265075710 wait complete. 2021-01-03T13:01:26.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de759e700 1 Processor -- start 2021-01-03T13:01:26.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de759e700 1 -- start start 2021-01-03T13:01:26.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4de805fad0 0x7f4de80ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:26.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de759e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4de809cca0 0x7f4de8155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:26.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de759e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de80b36a0 0x7f4de8145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:26.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de759e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80aebf0 con 0x7f4de80b36a0 2021-01-03T13:01:26.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de815a1f0 con 0x7f4de805fad0 2021-01-03T13:01:26.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.795+0000 7f4de759e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80b6b50 con 0x7f4de809cca0 2021-01-03T13:01:26.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.799+0000 7f4de659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4de805fad0 0x7f4de80ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:26.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.799+0000 7f4de659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4de805fad0 0x7f4de80ae700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34146/0 (socket says 172.21.15.133:34146) 2021-01-03T13:01:26.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.799+0000 7f4de659c700 1 -- 172.21.15.133:0/728072341 learned_addr learned my addr 172.21.15.133:0/728072341 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:26.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.799+0000 7f4de5d9b700 1 --2- 172.21.15.133:0/728072341 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4de809cca0 0x7f4de8155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:26.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.799+0000 7f4de6d9d700 1 --2- 172.21.15.133:0/728072341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de80b36a0 0x7f4de8145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:26.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.799+0000 7f4de659c700 1 -- 172.21.15.133:0/728072341 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4de809cca0 msgr2=0x7f4de8155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:26.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.799+0000 7f4de659c700 1 --2- 172.21.15.133:0/728072341 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4de809cca0 0x7f4de8155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:26.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.799+0000 7f4de659c700 1 -- 172.21.15.133:0/728072341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de80b36a0 msgr2=0x7f4de8145150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:26.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.799+0000 7f4de659c700 1 --2- 172.21.15.133:0/728072341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de80b36a0 0x7f4de8145150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:26.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.799+0000 7f4de659c700 1 -- 172.21.15.133:0/728072341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de80b6df0 con 0x7f4de805fad0 2021-01-03T13:01:26.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.799+0000 7f4de659c700 1 --2- 172.21.15.133:0/728072341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4de805fad0 0x7f4de80ae700 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f4dd800c000 tx=0x7f4dd8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:26.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.799+0000 7f4ddf7fe700 1 -- 172.21.15.133:0/728072341 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dd800c8f0 con 0x7f4de805fad0 2021-01-03T13:01:26.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.799+0000 7f4de759e700 1 -- 172.21.15.133:0/728072341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de8156410 con 0x7f4de805fad0 2021-01-03T13:01:26.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.799+0000 7f4de759e700 1 -- 172.21.15.133:0/728072341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de8145860 con 0x7f4de805fad0 2021-01-03T13:01:26.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.799+0000 7f4ddf7fe700 1 -- 172.21.15.133:0/728072341 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd800ca50 con 0x7f4de805fad0 2021-01-03T13:01:26.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.799+0000 7f4ddf7fe700 1 -- 172.21.15.133:0/728072341 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dd800cdb0 con 0x7f4de805fad0 2021-01-03T13:01:26.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.799+0000 7f4de759e700 1 -- 172.21.15.133:0/728072341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc00033e0 con 0x7f4de805fad0 2021-01-03T13:01:26.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.803+0000 7f4ddf7fe700 1 -- 172.21.15.133:0/728072341 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4dd8022070 con 0x7f4de805fad0 2021-01-03T13:01:26.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.803+0000 7f4ddf7fe700 1 --2- 172.21.15.133:0/728072341 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4dcc055500 0x7f4dcc0579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:26.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.803+0000 7f4ddf7fe700 1 -- 172.21.15.133:0/728072341 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f4dd806e500 con 0x7f4de805fad0 2021-01-03T13:01:26.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.803+0000 7f4de5d9b700 1 --2- 172.21.15.133:0/728072341 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4dcc055500 0x7f4dcc0579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:26.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.803+0000 7f4de5d9b700 1 --2- 172.21.15.133:0/728072341 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4dcc055500 0x7f4dcc0579c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f4dd001a000 tx=0x7f4dd0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:26.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.807+0000 7f4ddf7fe700 1 -- 172.21.15.133:0/728072341 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4dd8044710 con 0x7f4de805fad0 2021-01-03T13:01:26.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.991+0000 7f4de759e700 1 -- 172.21.15.133:0/728072341 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4dc0003820 con 0x7f4de805fad0 2021-01-03T13:01:26.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.991+0000 7f4ddf7fe700 1 -- 172.21.15.133:0/728072341 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+2130 (secure 0 0 0) 0x7f4dd8047d30 con 0x7f4de805fad0 2021-01-03T13:01:26.988 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:01:26.989 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5169,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/126912106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":126912106},{"type":"v1","addr":"172.21.15.16:6833","nonce":126912106}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":13},{"gid":5212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/1241297212","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1241297212},{"type":"v1","addr":"172.21.15.133:6835","nonce":1241297212}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:00:01.768700+0000","modified":"2021-01-03T13:01:26.661932+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2021-01-03T13:01:26.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.991+0000 7f4de759e700 1 -- 172.21.15.133:0/728072341 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4dcc055500 msgr2=0x7f4dcc0579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:26.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.991+0000 7f4de759e700 1 --2- 172.21.15.133:0/728072341 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4dcc055500 0x7f4dcc0579c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f4dd001a000 tx=0x7f4dd0015000).stop 2021-01-03T13:01:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.991+0000 7f4de759e700 1 -- 172.21.15.133:0/728072341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4de805fad0 msgr2=0x7f4de80ae700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.991+0000 7f4de759e700 1 --2- 172.21.15.133:0/728072341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4de805fad0 0x7f4de80ae700 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f4dd800c000 tx=0x7f4dd8008040).stop 2021-01-03T13:01:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.991+0000 7f4de759e700 1 -- 172.21.15.133:0/728072341 shutdown_connections 2021-01-03T13:01:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.991+0000 7f4de759e700 1 --2- 172.21.15.133:0/728072341 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4dcc055500 0x7f4dcc0579c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:26.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.991+0000 7f4de759e700 1 --2- 172.21.15.133:0/728072341 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4de80b36a0 0x7f4de8145150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.991+0000 7f4de759e700 1 --2- 172.21.15.133:0/728072341 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4de805fad0 0x7f4de80ae700 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.991+0000 7f4de759e700 1 --2- 172.21.15.133:0/728072341 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4de809cca0 0x7f4de8155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.991+0000 7f4de759e700 1 -- 172.21.15.133:0/728072341 >> 172.21.15.133:0/728072341 conn(0x7f4de80b7200 msgr2=0x7f4de8143fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.991+0000 7f4de759e700 1 -- 172.21.15.133:0/728072341 shutdown_connections 2021-01-03T13:01:26.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:26.991+0000 7f4de759e700 1 -- 172.21.15.133:0/728072341 wait complete. 2021-01-03T13:01:26.993 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 17 2021-01-03T13:01:27.002 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-01-03T13:01:27.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.163+0000 7fd864be1700 1 Processor -- start 2021-01-03T13:01:27.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.163+0000 7fd864be1700 1 -- start start 2021-01-03T13:01:27.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd864be1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd86005cc10 0x7fd8601437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:27.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd864be1700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd8600b02d0 0x7fd860146a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:27.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd864be1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86005c510 con 0x7fd86005c130 2021-01-03T13:01:27.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd864be1700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8600b0780 con 0x7fd8600b02d0 2021-01-03T13:01:27.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd864be1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8600b5c10 con 0x7fd86005cc10 2021-01-03T13:01:27.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd85e59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd86005c130 0x7fd860146370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55186/0 (socket says 172.21.15.133:55186) 2021-01-03T13:01:27.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd85e59c700 1 -- 172.21.15.133:0/2206723780 learned_addr learned my addr 172.21.15.133:0/2206723780 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:27.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd85ed9d700 1 --2- 172.21.15.133:0/2206723780 >> v2:172.21.15.16:3300/0 conn(0x7fd8600b02d0 0x7fd860146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:27.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd85dd9b700 1 --2- 172.21.15.133:0/2206723780 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd86005cc10 0x7fd8601437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:27.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd85d59a700 1 -- 172.21.15.133:0/2206723780 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980384901 0 0) 0x7fd86005c510 con 0x7fd86005c130 2021-01-03T13:01:27.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd85d59a700 1 -- 172.21.15.133:0/2206723780 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd840003230 con 0x7fd86005c130 2021-01-03T13:01:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd85ed9d700 1 -- 172.21.15.133:0/2206723780 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd86005cc10 msgr2=0x7fd8601437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd85ed9d700 1 --2- 172.21.15.133:0/2206723780 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd86005cc10 0x7fd8601437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd85ed9d700 1 -- 172.21.15.133:0/2206723780 >> v1:172.21.15.133:6789/0 conn(0x7fd86005c130 legacy=0x7fd860146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:27.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd85ed9d700 1 -- 172.21.15.133:0/2206723780 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8600af8f0 con 0x7fd8600b02d0 2021-01-03T13:01:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd85ed9d700 1 --2- 172.21.15.133:0/2206723780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8600b02d0 0x7fd860146a80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fd8580032b0 tx=0x7fd8580091a0).ready entity=mon.0 client_cookie=860ef26de6627134 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd85d59a700 1 -- 172.21.15.133:0/2206723780 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd85800b940 con 0x7fd8600b02d0 2021-01-03T13:01:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd85d59a700 1 -- 172.21.15.133:0/2206723780 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85800baa0 con 0x7fd8600b02d0 2021-01-03T13:01:27.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd864be1700 1 -- 172.21.15.133:0/2206723780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8600b02d0 msgr2=0x7fd860146a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd864be1700 1 --2- 172.21.15.133:0/2206723780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8600b02d0 0x7fd860146a80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fd8580032b0 tx=0x7fd8580091a0).stop 2021-01-03T13:01:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd85d59a700 1 -- 172.21.15.133:0/2206723780 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd85800bc10 con 0x7fd8600b02d0 2021-01-03T13:01:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd864be1700 1 -- 172.21.15.133:0/2206723780 shutdown_connections 2021-01-03T13:01:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd864be1700 1 --2- 172.21.15.133:0/2206723780 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8600b02d0 0x7fd860146a80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:27.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd864be1700 1 --2- 172.21.15.133:0/2206723780 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd86005cc10 0x7fd8601437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:27.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd864be1700 1 -- 172.21.15.133:0/2206723780 >> 172.21.15.133:0/2206723780 conn(0x7fd8600b95d0 msgr2=0x7fd8600b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:27.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd864be1700 1 -- 172.21.15.133:0/2206723780 shutdown_connections 2021-01-03T13:01:27.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.167+0000 7fd864be1700 1 -- 172.21.15.133:0/2206723780 wait complete. 2021-01-03T13:01:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.171+0000 7fd864be1700 1 Processor -- start 2021-01-03T13:01:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.171+0000 7fd864be1700 1 -- start start 2021-01-03T13:01:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.171+0000 7fd864be1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd86005c130 0x7fd86013d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.171+0000 7fd864be1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd86005cc10 0x7fd8600b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.171+0000 7fd864be1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd8600b02d0 0x7fd86009cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.171+0000 7fd864be1700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8600b8c10 con 0x7fd86005cc10 2021-01-03T13:01:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.171+0000 7fd864be1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8600b92f0 con 0x7fd86005c130 2021-01-03T13:01:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.171+0000 7fd864be1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86009f3d0 con 0x7fd8600b02d0 2021-01-03T13:01:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.171+0000 7fd85e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd86005c130 0x7fd86013d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.171+0000 7fd85e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd86005c130 0x7fd86013d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34158/0 (socket says 172.21.15.133:34158) 2021-01-03T13:01:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.171+0000 7fd85e59c700 1 -- 172.21.15.133:0/1448836580 learned_addr learned my addr 172.21.15.133:0/1448836580 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.171+0000 7fd85dd9b700 1 --2- 172.21.15.133:0/1448836580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd86005cc10 0x7fd8600b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.175+0000 7fd85ed9d700 1 --2- 172.21.15.133:0/1448836580 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd8600b02d0 0x7fd86009cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.175+0000 7fd85e59c700 1 -- 172.21.15.133:0/1448836580 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd8600b02d0 msgr2=0x7fd86009cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.175+0000 7fd85e59c700 1 --2- 172.21.15.133:0/1448836580 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd8600b02d0 0x7fd86009cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.175+0000 7fd85e59c700 1 -- 172.21.15.133:0/1448836580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd86005cc10 msgr2=0x7fd8600b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.175+0000 7fd85e59c700 1 --2- 172.21.15.133:0/1448836580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd86005cc10 0x7fd8600b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.175+0000 7fd85e59c700 1 -- 172.21.15.133:0/1448836580 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86009f670 con 0x7fd86005c130 2021-01-03T13:01:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.175+0000 7fd85e59c700 1 --2- 172.21.15.133:0/1448836580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd86005c130 0x7fd86013d4b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fd8480010d0 tx=0x7fd848007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.175+0000 7fd8577fe700 1 -- 172.21.15.133:0/1448836580 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8480072e0 con 0x7fd86005c130 2021-01-03T13:01:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.175+0000 7fd8577fe700 1 -- 172.21.15.133:0/1448836580 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd848007440 con 0x7fd86005c130 2021-01-03T13:01:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.175+0000 7fd8577fe700 1 -- 172.21.15.133:0/1448836580 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8480057d0 con 0x7fd86005c130 2021-01-03T13:01:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.175+0000 7fd864be1700 1 -- 172.21.15.133:0/1448836580 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8600b8e50 con 0x7fd86005c130 2021-01-03T13:01:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.175+0000 7fd864be1700 1 -- 172.21.15.133:0/1448836580 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8600b7690 con 0x7fd86005c130 2021-01-03T13:01:27.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.175+0000 7fd864be1700 1 -- 172.21.15.133:0/1448836580 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86009f800 con 0x7fd86005c130 2021-01-03T13:01:27.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.175+0000 7fd8577fe700 1 -- 172.21.15.133:0/1448836580 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd848010070 con 0x7fd86005c130 2021-01-03T13:01:27.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.179+0000 7fd8577fe700 1 --2- 172.21.15.133:0/1448836580 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd844055330 0x7fd8440577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:27.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.179+0000 7fd85dd9b700 1 --2- 172.21.15.133:0/1448836580 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd844055330 0x7fd8440577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:27.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.179+0000 7fd8577fe700 1 -- 172.21.15.133:0/1448836580 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd84806d6f0 con 0x7fd86005c130 2021-01-03T13:01:27.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.179+0000 7fd85dd9b700 1 --2- 172.21.15.133:0/1448836580 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd844055330 0x7fd8440577f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fd850008000 tx=0x7fd850008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:27.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.183+0000 7fd8577fe700 1 -- 172.21.15.133:0/1448836580 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd8480439a0 con 0x7fd86005c130 2021-01-03T13:01:27.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:27.371+0000 7fd864be1700 1 -- 172.21.15.133:0/1448836580 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd8600b8fe0 con 0x7fd86005c130 2021-01-03T13:01:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.371+0000 7fd8577fe700 1 -- 172.21.15.133:0/1448836580 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd848046fc0 con 0x7fd86005c130 2021-01-03T13:01:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.375+0000 7fd864be1700 1 -- 172.21.15.133:0/1448836580 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd844055330 msgr2=0x7fd8440577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.375+0000 7fd864be1700 1 --2- 172.21.15.133:0/1448836580 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd844055330 0x7fd8440577f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fd850008000 tx=0x7fd850008040).stop 2021-01-03T13:01:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.375+0000 7fd864be1700 1 -- 172.21.15.133:0/1448836580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd86005c130 msgr2=0x7fd86013d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.375+0000 7fd864be1700 1 --2- 172.21.15.133:0/1448836580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd86005c130 0x7fd86013d4b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fd8480010d0 tx=0x7fd848007aa0).stop 2021-01-03T13:01:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.375+0000 7fd864be1700 1 -- 172.21.15.133:0/1448836580 shutdown_connections 2021-01-03T13:01:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.375+0000 7fd864be1700 1 --2- 172.21.15.133:0/1448836580 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd844055330 0x7fd8440577f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.375+0000 7fd864be1700 1 --2- 172.21.15.133:0/1448836580 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd8600b02d0 0x7fd86009cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.375+0000 7fd864be1700 1 --2- 172.21.15.133:0/1448836580 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd86005c130 0x7fd86013d4b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.375+0000 7fd864be1700 1 --2- 172.21.15.133:0/1448836580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd86005cc10 0x7fd8600b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.375+0000 7fd864be1700 1 -- 172.21.15.133:0/1448836580 >> 172.21.15.133:0/1448836580 conn(0x7fd8600b95d0 msgr2=0x7fd860145310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.375+0000 7fd864be1700 1 -- 172.21.15.133:0/1448836580 shutdown_connections 2021-01-03T13:01:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.375+0000 7fd864be1700 1 -- 172.21.15.133:0/1448836580 wait complete. 2021-01-03T13:01:28.392 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-01-03T13:01:28.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.523+0000 7f5b5ffff700 1 Processor -- start 2021-01-03T13:01:28.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.523+0000 7f5b5ffff700 1 -- start start 2021-01-03T13:01:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.523+0000 7f5b5ffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5b600b2440 0x7f5b6013ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:28.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.523+0000 7f5b5ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5b600a9750 0x7f5b600679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.523+0000 7f5b5ffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b600b2820 con 0x7f5b600af780 2021-01-03T13:01:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.523+0000 7f5b5ffff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b600aecd0 con 0x7f5b600b2440 2021-01-03T13:01:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.523+0000 7f5b5ffff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b600b1af0 con 0x7f5b600a9750 2021-01-03T13:01:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.523+0000 7f5b5f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5b600a9750 0x7f5b600679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:28.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.523+0000 7f5b5e7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5b600af780 0x7f5b600672b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55200/0 (socket says 172.21.15.133:55200) 2021-01-03T13:01:28.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.523+0000 7f5b5f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5b600a9750 0x7f5b600679c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34170/0 (socket says 172.21.15.133:34170) 2021-01-03T13:01:28.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.523+0000 7f5b5e7fc700 1 -- 172.21.15.133:0/4181310192 learned_addr learned my addr 172.21.15.133:0/4181310192 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:28.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.523+0000 7f5b5effd700 1 --2- 172.21.15.133:0/4181310192 >> v2:172.21.15.16:3300/0 conn(0x7f5b600b2440 0x7f5b6013ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:28.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.523+0000 7f5b5f7fe700 1 -- 172.21.15.133:0/4181310192 >> v2:172.21.15.16:3300/0 conn(0x7f5b600b2440 msgr2=0x7f5b6013ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:28.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.523+0000 7f5b5f7fe700 1 --2- 172.21.15.133:0/4181310192 >> v2:172.21.15.16:3300/0 conn(0x7f5b600b2440 0x7f5b6013ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.523+0000 7f5b5f7fe700 1 -- 172.21.15.133:0/4181310192 >> v1:172.21.15.133:6789/0 conn(0x7f5b600af780 legacy=0x7f5b600672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.523+0000 7f5b5f7fe700 1 -- 172.21.15.133:0/4181310192 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b600b1d90 con 0x7f5b600a9750 2021-01-03T13:01:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.527+0000 7f5b5f7fe700 1 --2- 172.21.15.133:0/4181310192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b600a9750 0x7f5b600679c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f5b50003300 tx=0x7f5b500091a0).ready entity=mon.1 client_cookie=8ff4b27c5413acb2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.527+0000 7f5b5dffb700 1 -- 172.21.15.133:0/4181310192 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b5000b9a0 con 0x7f5b600a9750 2021-01-03T13:01:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.527+0000 7f5b5dffb700 1 -- 172.21.15.133:0/4181310192 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5000bb00 con 0x7f5b600a9750 2021-01-03T13:01:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.527+0000 7f5b5dffb700 1 -- 172.21.15.133:0/4181310192 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b5000bc70 con 0x7f5b600a9750 2021-01-03T13:01:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.527+0000 7f5b5ffff700 1 -- 172.21.15.133:0/4181310192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b600a9750 msgr2=0x7f5b600679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.527+0000 7f5b5ffff700 1 --2- 172.21.15.133:0/4181310192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b600a9750 0x7f5b600679c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f5b50003300 tx=0x7f5b500091a0).stop 2021-01-03T13:01:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.527+0000 7f5b5ffff700 1 -- 172.21.15.133:0/4181310192 shutdown_connections 2021-01-03T13:01:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.527+0000 7f5b5ffff700 1 --2- 172.21.15.133:0/4181310192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b600a9750 0x7f5b600679c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.527+0000 7f5b5ffff700 1 --2- 172.21.15.133:0/4181310192 >> v2:172.21.15.16:3300/0 conn(0x7f5b600b2440 0x7f5b6013ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.527+0000 7f5b5ffff700 1 -- 172.21.15.133:0/4181310192 >> 172.21.15.133:0/4181310192 conn(0x7f5b6006b050 msgr2=0x7f5b60060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.527+0000 7f5b5ffff700 1 -- 172.21.15.133:0/4181310192 shutdown_connections 2021-01-03T13:01:28.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.527+0000 7f5b5ffff700 1 -- 172.21.15.133:0/4181310192 wait complete. 2021-01-03T13:01:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.527+0000 7f5b5ffff700 1 Processor -- start 2021-01-03T13:01:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.527+0000 7f5b5ffff700 1 -- start start 2021-01-03T13:01:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b600a9750 0x7f5b60127b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5b600af780 0x7f5b60129240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b600b2440 0x7f5b60129730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5ffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6012ac60 con 0x7f5b600a9750 2021-01-03T13:01:28.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b60128de0 con 0x7f5b600b2440 2021-01-03T13:01:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6012a750 con 0x7f5b600af780 2021-01-03T13:01:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b600b2440 0x7f5b60129730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5effd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b600a9750 0x7f5b60127b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b600b2440 0x7f5b60129730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34174/0 (socket says 172.21.15.133:34174) 2021-01-03T13:01:28.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5f7fe700 1 -- 172.21.15.133:0/3771566226 learned_addr learned my addr 172.21.15.133:0/3771566226 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5e7fc700 1 --2- 172.21.15.133:0/3771566226 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5b600af780 0x7f5b60129240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5f7fe700 1 -- 172.21.15.133:0/3771566226 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5b600af780 msgr2=0x7f5b60129240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5f7fe700 1 --2- 172.21.15.133:0/3771566226 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5b600af780 0x7f5b60129240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5f7fe700 1 -- 172.21.15.133:0/3771566226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b600a9750 msgr2=0x7f5b60127b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:28.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5f7fe700 1 --2- 172.21.15.133:0/3771566226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b600a9750 0x7f5b60127b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5f7fe700 1 -- 172.21.15.133:0/3771566226 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b60129c20 con 0x7f5b600b2440 2021-01-03T13:01:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5f7fe700 1 --2- 172.21.15.133:0/3771566226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b600b2440 0x7f5b60129730 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f5b60128d00 tx=0x7f5b50016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b57fff700 1 -- 172.21.15.133:0/3771566226 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b50006e60 con 0x7f5b600b2440 2021-01-03T13:01:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b57fff700 1 -- 172.21.15.133:0/3771566226 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b50011e90 con 0x7f5b600b2440 2021-01-03T13:01:28.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5ffff700 1 -- 172.21.15.133:0/3771566226 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b60132710 con 0x7f5b600b2440 2021-01-03T13:01:28.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b57fff700 1 -- 172.21.15.133:0/3771566226 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b50006b20 con 0x7f5b600b2440 2021-01-03T13:01:28.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.531+0000 7f5b5ffff700 1 -- 172.21.15.133:0/3771566226 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6012a4b0 con 0x7f5b600b2440 2021-01-03T13:01:28.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.535+0000 7f5b5ffff700 1 -- 172.21.15.133:0/3771566226 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b60057300 con 0x7f5b600b2440 2021-01-03T13:01:28.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.535+0000 7f5b57fff700 1 -- 172.21.15.133:0/3771566226 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5b50026030 con 0x7f5b600b2440 2021-01-03T13:01:28.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.535+0000 7f5b57fff700 1 --2- 172.21.15.133:0/3771566226 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5b440554e0 0x7f5b440579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:28.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.535+0000 7f5b57fff700 1 -- 172.21.15.133:0/3771566226 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f5b5006ea40 con 0x7f5b600b2440 2021-01-03T13:01:28.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.535+0000 7f5b5effd700 1 --2- 172.21.15.133:0/3771566226 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5b440554e0 0x7f5b440579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:28.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.535+0000 7f5b5effd700 1 --2- 172.21.15.133:0/3771566226 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5b440554e0 0x7f5b440579a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f5b5800b000 tx=0x7f5b58006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:28.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.539+0000 7f5b57fff700 1 -- 172.21.15.133:0/3771566226 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5b50044cf0 con 0x7f5b600b2440 2021-01-03T13:01:28.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:28.679+0000 7f5b5ffff700 1 -- 172.21.15.133:0/3771566226 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5b60128f70 con 0x7f5b600b2440 2021-01-03T13:01:29.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.383+0000 7f5b57fff700 1 -- 172.21.15.133:0/3771566226 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v47) v1 ==== 185+0+0 (secure 0 0 0) 0x7f5b500150e0 con 0x7f5b600b2440 2021-01-03T13:01:29.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.387+0000 7f5b5ffff700 1 -- 172.21.15.133:0/3771566226 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5b440554e0 msgr2=0x7f5b440579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:29.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.387+0000 7f5b5ffff700 1 --2- 172.21.15.133:0/3771566226 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5b440554e0 0x7f5b440579a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f5b5800b000 tx=0x7f5b58006dc0).stop 2021-01-03T13:01:29.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.387+0000 7f5b5ffff700 1 -- 172.21.15.133:0/3771566226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b600b2440 msgr2=0x7f5b60129730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:29.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.387+0000 7f5b5ffff700 1 --2- 172.21.15.133:0/3771566226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b600b2440 0x7f5b60129730 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f5b60128d00 tx=0x7f5b50016000).stop 2021-01-03T13:01:29.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.387+0000 7f5b5ffff700 1 -- 172.21.15.133:0/3771566226 shutdown_connections 2021-01-03T13:01:29.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.387+0000 7f5b5ffff700 1 --2- 172.21.15.133:0/3771566226 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5b440554e0 0x7f5b440579a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:29.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.387+0000 7f5b5ffff700 1 --2- 172.21.15.133:0/3771566226 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b600a9750 0x7f5b60127b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:29.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.387+0000 7f5b5ffff700 1 --2- 172.21.15.133:0/3771566226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5b600b2440 0x7f5b60129730 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:29.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.387+0000 7f5b5ffff700 1 --2- 172.21.15.133:0/3771566226 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5b600af780 0x7f5b60129240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:29.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.387+0000 7f5b5ffff700 1 -- 172.21.15.133:0/3771566226 >> 172.21.15.133:0/3771566226 conn(0x7f5b6006b050 msgr2=0x7f5b600aa160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:29.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.387+0000 7f5b5ffff700 1 -- 172.21.15.133:0/3771566226 shutdown_connections 2021-01-03T13:01:29.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.387+0000 7f5b5ffff700 1 -- 172.21.15.133:0/3771566226 wait complete. 2021-01-03T13:01:29.388 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2021-01-03T13:01:29.402 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-01-03T13:01:29.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f970bfb4700 1 Processor -- start 2021-01-03T13:01:29.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f970bfb4700 1 -- start start 2021-01-03T13:01:29.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f970bfb4700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f970405c840 0x7f97040af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:29.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f970bfb4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f970413f960 0x7f9704138c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:29.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f970bfb4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970405cc20 con 0x7f97040afa70 2021-01-03T13:01:29.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f970bfb4700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97040b18e0 con 0x7f970405c840 2021-01-03T13:01:29.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f970bfb4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970413fdb0 con 0x7f970413f960 2021-01-03T13:01:29.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f970a551700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f970413f960 0x7f9704138c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:29.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f970954f700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f97040afa70 0x7f970413f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55214/0 (socket says 172.21.15.133:55214) 2021-01-03T13:01:29.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f970954f700 1 -- 172.21.15.133:0/3507223872 learned_addr learned my addr 172.21.15.133:0/3507223872 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f9709d50700 1 --2- 172.21.15.133:0/3507223872 >> v2:172.21.15.16:3300/0 conn(0x7f970405c840 0x7f97040af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f970a551700 1 -- 172.21.15.133:0/3507223872 >> v2:172.21.15.16:3300/0 conn(0x7f970405c840 msgr2=0x7f97040af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f970a551700 1 --2- 172.21.15.133:0/3507223872 >> v2:172.21.15.16:3300/0 conn(0x7f970405c840 0x7f97040af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:29.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f970a551700 1 -- 172.21.15.133:0/3507223872 >> v1:172.21.15.133:6789/0 conn(0x7f97040afa70 legacy=0x7f970413f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f9708d4e700 1 -- 172.21.15.133:0/3507223872 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754698210 0 0) 0x7f970405cc20 con 0x7f97040afa70 2021-01-03T13:01:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f970a551700 1 -- 172.21.15.133:0/3507223872 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97040ad2d0 con 0x7f970413f960 2021-01-03T13:01:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f970a551700 1 --2- 172.21.15.133:0/3507223872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970413f960 0x7f9704138c40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f97040af390 tx=0x7f96fc0091a0).ready entity=mon.1 client_cookie=bf5266e4f87bbea2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f9708d4e700 1 -- 172.21.15.133:0/3507223872 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96fc009e70 con 0x7f970413f960 2021-01-03T13:01:29.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f9708d4e700 1 -- 172.21.15.133:0/3507223872 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96fc00bb80 con 0x7f970413f960 2021-01-03T13:01:29.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f9708d4e700 1 -- 172.21.15.133:0/3507223872 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96fc00bcf0 con 0x7f970413f960 2021-01-03T13:01:29.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f970bfb4700 1 -- 172.21.15.133:0/3507223872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970413f960 msgr2=0x7f9704138c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:29.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.527+0000 7f970bfb4700 1 --2- 172.21.15.133:0/3507223872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970413f960 0x7f9704138c40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f97040af390 tx=0x7f96fc0091a0).stop 2021-01-03T13:01:29.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970bfb4700 1 -- 172.21.15.133:0/3507223872 shutdown_connections 2021-01-03T13:01:29.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970bfb4700 1 --2- 172.21.15.133:0/3507223872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970413f960 0x7f9704138c40 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:29.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970bfb4700 1 --2- 172.21.15.133:0/3507223872 >> v2:172.21.15.16:3300/0 conn(0x7f970405c840 0x7f97040af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:29.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970bfb4700 1 -- 172.21.15.133:0/3507223872 >> 172.21.15.133:0/3507223872 conn(0x7f970406aeb0 msgr2=0x7f970405bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:29.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970bfb4700 1 -- 172.21.15.133:0/3507223872 shutdown_connections 2021-01-03T13:01:29.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970bfb4700 1 -- 172.21.15.133:0/3507223872 wait complete. 2021-01-03T13:01:29.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970bfb4700 1 Processor -- start 2021-01-03T13:01:29.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970bfb4700 1 -- start start 2021-01-03T13:01:29.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970bfb4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970405c840 0x7f970409e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:29.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970bfb4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f97040afa70 0x7f970413c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:29.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970bfb4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f970413f960 0x7f9704139d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:29.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970bfb4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9704152120 con 0x7f970413f960 2021-01-03T13:01:29.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970bfb4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970413bce0 con 0x7f970405c840 2021-01-03T13:01:29.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970bfb4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970413f170 con 0x7f97040afa70 2021-01-03T13:01:29.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f9709d50700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970405c840 0x7f970409e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:29.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f9709d50700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970405c840 0x7f970409e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34188/0 (socket says 172.21.15.133:34188) 2021-01-03T13:01:29.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f9709d50700 1 -- 172.21.15.133:0/1552602373 learned_addr learned my addr 172.21.15.133:0/1552602373 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:29.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970a551700 1 --2- 172.21.15.133:0/1552602373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f970413f960 0x7f9704139d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:29.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970954f700 1 --2- 172.21.15.133:0/1552602373 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f97040afa70 0x7f970413c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:29.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f9709d50700 1 -- 172.21.15.133:0/1552602373 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f97040afa70 msgr2=0x7f970413c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:29.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f9709d50700 1 --2- 172.21.15.133:0/1552602373 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f97040afa70 0x7f970413c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:29.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f9709d50700 1 -- 172.21.15.133:0/1552602373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f970413f960 msgr2=0x7f9704139d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:29.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f9709d50700 1 --2- 172.21.15.133:0/1552602373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f970413f960 0x7f9704139d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:29.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f9709d50700 1 -- 172.21.15.133:0/1552602373 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9704152310 con 0x7f970405c840 2021-01-03T13:01:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f9709d50700 1 --2- 172.21.15.133:0/1552602373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970405c840 0x7f970409e7b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f9704136bb0 tx=0x7f9700008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f96f2ffd700 1 -- 172.21.15.133:0/1552602373 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9700009920 con 0x7f970405c840 2021-01-03T13:01:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f96f2ffd700 1 -- 172.21.15.133:0/1552602373 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9700009a80 con 0x7f970405c840 2021-01-03T13:01:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970bfb4700 1 -- 172.21.15.133:0/1552602373 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97041525b0 con 0x7f970405c840 2021-01-03T13:01:29.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f96f2ffd700 1 -- 172.21.15.133:0/1552602373 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9700009de0 con 0x7f970405c840 2021-01-03T13:01:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.531+0000 7f970bfb4700 1 -- 172.21.15.133:0/1552602373 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9704152f90 con 0x7f970405c840 2021-01-03T13:01:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.535+0000 7f970bfb4700 1 -- 172.21.15.133:0/1552602373 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9704057300 con 0x7f970405c840 2021-01-03T13:01:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.535+0000 7f96f2ffd700 1 -- 172.21.15.133:0/1552602373 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9700013480 con 0x7f970405c840 2021-01-03T13:01:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.535+0000 7f96f2ffd700 1 --2- 172.21.15.133:0/1552602373 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f96e40553b0 0x7f96e4057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:29.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.535+0000 7f96f2ffd700 1 -- 172.21.15.133:0/1552602373 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f970006e540 con 0x7f970405c840 2021-01-03T13:01:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.535+0000 7f970954f700 1 --2- 172.21.15.133:0/1552602373 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f96e40553b0 0x7f96e4057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.535+0000 7f970954f700 1 --2- 172.21.15.133:0/1552602373 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f96e40553b0 0x7f96e4057870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f96f400b000 tx=0x7f96f4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:29.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.539+0000 7f96f2ffd700 1 -- 172.21.15.133:0/1552602373 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9700044940 con 0x7f970405c840 2021-01-03T13:01:29.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:29.691+0000 7f970bfb4700 1 -- 172.21.15.133:0/1552602373 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f97040b5780 con 0x7f970405c840 2021-01-03T13:01:30.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.395+0000 7f96f2ffd700 1 -- 172.21.15.133:0/1552602373 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v48) v1 ==== 173+0+0 (secure 0 0 0) 0x7f9700047f60 con 0x7f970405c840 2021-01-03T13:01:30.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.399+0000 7f970bfb4700 1 -- 172.21.15.133:0/1552602373 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f96e40553b0 msgr2=0x7f96e4057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:30.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.399+0000 7f970bfb4700 1 --2- 172.21.15.133:0/1552602373 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f96e40553b0 0x7f96e4057870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f96f400b000 tx=0x7f96f4009040).stop 2021-01-03T13:01:30.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.399+0000 7f970bfb4700 1 -- 172.21.15.133:0/1552602373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970405c840 msgr2=0x7f970409e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:30.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.399+0000 7f970bfb4700 1 --2- 172.21.15.133:0/1552602373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970405c840 0x7f970409e7b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f9704136bb0 tx=0x7f9700008040).stop 2021-01-03T13:01:30.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.399+0000 7f970bfb4700 1 -- 172.21.15.133:0/1552602373 shutdown_connections 2021-01-03T13:01:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.399+0000 7f970bfb4700 1 --2- 172.21.15.133:0/1552602373 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f96e40553b0 0x7f96e4057870 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.399+0000 7f970bfb4700 1 --2- 172.21.15.133:0/1552602373 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f970413f960 0x7f9704139d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.399+0000 7f970bfb4700 1 --2- 172.21.15.133:0/1552602373 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f970405c840 0x7f970409e7b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.399+0000 7f970bfb4700 1 --2- 172.21.15.133:0/1552602373 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f97040afa70 0x7f970413c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:30.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.399+0000 7f970bfb4700 1 -- 172.21.15.133:0/1552602373 >> 172.21.15.133:0/1552602373 conn(0x7f970406aeb0 msgr2=0x7f97040b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:30.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.399+0000 7f970bfb4700 1 -- 172.21.15.133:0/1552602373 shutdown_connections 2021-01-03T13:01:30.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.399+0000 7f970bfb4700 1 -- 172.21.15.133:0/1552602373 wait complete. 2021-01-03T13:01:30.398 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2021-01-03T13:01:30.415 INFO:tasks.ceph.mds.a:Restarting daemon 2021-01-03T13:01:30.415 INFO:tasks.ceph.mds.a:Stopping old one... 2021-01-03T13:01:30.416 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-01-03T13:01:30.416 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:01:30.416 INFO:tasks.ceph.mds.c:Restarting daemon 2021-01-03T13:01:30.416 INFO:tasks.ceph.mds.c:Stopping old one... 2021-01-03T13:01:30.417 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-01-03T13:01:30.417 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:01:30.417 INFO:tasks.ceph.mds.b:Restarting daemon 2021-01-03T13:01:30.417 INFO:tasks.ceph.mds.b:Stopping old one... 2021-01-03T13:01:30.418 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-01-03T13:01:30.418 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:01:30.428 INFO:tasks.ceph.mds.b:Stopped 2021-01-03T13:01:30.428 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-01-03T13:01:30.429 INFO:tasks.ceph.mds.c:Stopped 2021-01-03T13:01:30.430 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-01-03T13:01:30.430 INFO:tasks.ceph.mds.a:Stopped 2021-01-03T13:01:30.431 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-01-03T13:01:30.472 INFO:tasks.ceph.mds.c:Started 2021-01-03T13:01:30.473 DEBUG:teuthology.parallel:result is None 2021-01-03T13:01:30.474 INFO:tasks.ceph.mds.b:Started 2021-01-03T13:01:30.475 INFO:tasks.ceph.mds.a:Started 2021-01-03T13:01:30.475 DEBUG:teuthology.parallel:result is None 2021-01-03T13:01:30.475 DEBUG:teuthology.parallel:result is None 2021-01-03T13:01:30.476 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-01-03T13:01:30.542 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T13:01:30.553 INFO:tasks.ceph.mds.b.smithi016.stdout:starting mds.b at 2021-01-03T13:01:30.556 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T13:01:30.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.595+0000 7f286ffff700 1 Processor -- start 2021-01-03T13:01:30.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.595+0000 7f286ffff700 1 -- start start 2021-01-03T13:01:30.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.595+0000 7f286ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f287013dff0 0x7f28700acc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:30.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.595+0000 7f286ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2870140a90 0x7f2870140f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:30.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.595+0000 7f286ffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28701443e0 con 0x7f28700b4f80 2021-01-03T13:01:30.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.595+0000 7f286ffff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28700b16b0 con 0x7f287013dff0 2021-01-03T13:01:30.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.595+0000 7f286ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2870144680 con 0x7f2870140a90 2021-01-03T13:01:30.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286effd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f287013dff0 0x7f28700acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:30.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286e7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f28700b4f80 0x7f28700ad140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55250/0 (socket says 172.21.15.133:55250) 2021-01-03T13:01:30.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286e7fc700 1 -- 172.21.15.133:0/3462226316 learned_addr learned my addr 172.21.15.133:0/3462226316 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:30.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286f7fe700 1 --2- 172.21.15.133:0/3462226316 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2870140a90 0x7f2870140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:30.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286effd700 1 -- 172.21.15.133:0/3462226316 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2870140a90 msgr2=0x7f2870140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:30.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286effd700 1 --2- 172.21.15.133:0/3462226316 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2870140a90 0x7f2870140f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:30.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286effd700 1 -- 172.21.15.133:0/3462226316 >> v1:172.21.15.133:6789/0 conn(0x7f28700b4f80 legacy=0x7f28700ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:30.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286effd700 1 -- 172.21.15.133:0/3462226316 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2870144920 con 0x7f287013dff0 2021-01-03T13:01:30.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286dffb700 1 -- 172.21.15.133:0/3462226316 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1574327177 0 0) 0x7f28701443e0 con 0x7f28700b4f80 2021-01-03T13:01:30.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286effd700 1 --2- 172.21.15.133:0/3462226316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287013dff0 0x7f28700acc50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f28600032b0 tx=0x7f28600091a0).ready entity=mon.1 client_cookie=1d58b981e2938555 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:30.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286dffb700 1 -- 172.21.15.133:0/3462226316 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286000ba50 con 0x7f287013dff0 2021-01-03T13:01:30.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286dffb700 1 -- 172.21.15.133:0/3462226316 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286000bbb0 con 0x7f287013dff0 2021-01-03T13:01:30.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286dffb700 1 -- 172.21.15.133:0/3462226316 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286000bd20 con 0x7f287013dff0 2021-01-03T13:01:30.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286ffff700 1 -- 172.21.15.133:0/3462226316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287013dff0 msgr2=0x7f28700acc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:30.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286ffff700 1 --2- 172.21.15.133:0/3462226316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287013dff0 0x7f28700acc50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f28600032b0 tx=0x7f28600091a0).stop 2021-01-03T13:01:30.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286ffff700 1 -- 172.21.15.133:0/3462226316 shutdown_connections 2021-01-03T13:01:30.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286ffff700 1 --2- 172.21.15.133:0/3462226316 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f287013dff0 0x7f28700acc50 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:30.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286ffff700 1 --2- 172.21.15.133:0/3462226316 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2870140a90 0x7f2870140f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:30.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286ffff700 1 -- 172.21.15.133:0/3462226316 >> 172.21.15.133:0/3462226316 conn(0x7f287005bdf0 msgr2=0x7f287005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:30.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286ffff700 1 -- 172.21.15.133:0/3462226316 shutdown_connections 2021-01-03T13:01:30.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286ffff700 1 -- 172.21.15.133:0/3462226316 wait complete. 2021-01-03T13:01:30.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286ffff700 1 Processor -- start 2021-01-03T13:01:30.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.599+0000 7f286ffff700 1 -- start start 2021-01-03T13:01:30.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28700b4f80 0x7f287013ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:30.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f287013dff0 0x7f287014d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:30.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2870140a90 0x7f287014dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:30.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286ffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2870143ed0 con 0x7f28700b4f80 2021-01-03T13:01:30.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28700ad0a0 con 0x7f2870140a90 2021-01-03T13:01:30.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2870144100 con 0x7f287013dff0 2021-01-03T13:01:30.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2870140a90 0x7f287014dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:30.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2870140a90 0x7f287014dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34228/0 (socket says 172.21.15.133:34228) 2021-01-03T13:01:30.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286f7fe700 1 -- 172.21.15.133:0/3307045502 learned_addr learned my addr 172.21.15.133:0/3307045502 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:30.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286effd700 1 --2- 172.21.15.133:0/3307045502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28700b4f80 0x7f287013ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:30.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286e7fc700 1 --2- 172.21.15.133:0/3307045502 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f287013dff0 0x7f287014d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:30.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286f7fe700 1 -- 172.21.15.133:0/3307045502 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f287013dff0 msgr2=0x7f287014d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:30.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286f7fe700 1 --2- 172.21.15.133:0/3307045502 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f287013dff0 0x7f287014d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:30.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286f7fe700 1 -- 172.21.15.133:0/3307045502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28700b4f80 msgr2=0x7f287013ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:30.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286f7fe700 1 --2- 172.21.15.133:0/3307045502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28700b4f80 0x7f287013ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:30.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286f7fe700 1 -- 172.21.15.133:0/3307045502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28700b0760 con 0x7f2870140a90 2021-01-03T13:01:30.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286f7fe700 1 --2- 172.21.15.133:0/3307045502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2870140a90 0x7f287014dec0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f28700af090 tx=0x7f2858008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:30.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f2867fff700 1 -- 172.21.15.133:0/3307045502 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2858011850 con 0x7f2870140a90 2021-01-03T13:01:30.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f2867fff700 1 -- 172.21.15.133:0/3307045502 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28580119b0 con 0x7f2870140a90 2021-01-03T13:01:30.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286ffff700 1 -- 172.21.15.133:0/3307045502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28700ad340 con 0x7f2870140a90 2021-01-03T13:01:30.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f2867fff700 1 -- 172.21.15.133:0/3307045502 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2858011d10 con 0x7f2870140a90 2021-01-03T13:01:30.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f286ffff700 1 -- 172.21.15.133:0/3307045502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28700acd80 con 0x7f2870140a90 2021-01-03T13:01:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f2867fff700 1 -- 172.21.15.133:0/3307045502 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f285801c460 con 0x7f2870140a90 2021-01-03T13:01:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f2867fff700 1 --2- 172.21.15.133:0/3307045502 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2854055440 0x7f2854057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.603+0000 7f2867fff700 1 -- 172.21.15.133:0/3307045502 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f285806e0d0 con 0x7f2870140a90 2021-01-03T13:01:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.607+0000 7f286effd700 1 --2- 172.21.15.133:0/3307045502 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2854055440 0x7f2854057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:30.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.607+0000 7f286ffff700 1 -- 172.21.15.133:0/3307045502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2870057300 con 0x7f2870140a90 2021-01-03T13:01:30.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.607+0000 7f286effd700 1 --2- 172.21.15.133:0/3307045502 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2854055440 0x7f2854057900 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f2860019000 tx=0x7f2860016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:30.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.611+0000 7f2867fff700 1 -- 172.21.15.133:0/3307045502 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2858044650 con 0x7f2870140a90 2021-01-03T13:01:30.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:30.775+0000 7f286ffff700 1 -- 172.21.15.133:0/3307045502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f28700ac110 con 0x7f2870140a90 2021-01-03T13:01:31.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.587+0000 7f2867fff700 1 -- 172.21.15.133:0/3307045502 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v50) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2858047c70 con 0x7f2870140a90 2021-01-03T13:01:31.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.591+0000 7f286ffff700 1 -- 172.21.15.133:0/3307045502 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2854055440 msgr2=0x7f2854057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:31.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.591+0000 7f286ffff700 1 --2- 172.21.15.133:0/3307045502 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2854055440 0x7f2854057900 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f2860019000 tx=0x7f2860016000).stop 2021-01-03T13:01:31.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.591+0000 7f286ffff700 1 -- 172.21.15.133:0/3307045502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2870140a90 msgr2=0x7f287014dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:31.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.591+0000 7f286ffff700 1 --2- 172.21.15.133:0/3307045502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2870140a90 0x7f287014dec0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f28700af090 tx=0x7f2858008040).stop 2021-01-03T13:01:31.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.591+0000 7f286ffff700 1 -- 172.21.15.133:0/3307045502 shutdown_connections 2021-01-03T13:01:31.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.591+0000 7f286ffff700 1 --2- 172.21.15.133:0/3307045502 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2854055440 0x7f2854057900 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:31.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.591+0000 7f286ffff700 1 --2- 172.21.15.133:0/3307045502 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28700b4f80 0x7f287013ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:31.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.591+0000 7f286ffff700 1 --2- 172.21.15.133:0/3307045502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2870140a90 0x7f287014dec0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:31.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.591+0000 7f286ffff700 1 --2- 172.21.15.133:0/3307045502 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f287013dff0 0x7f287014d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:31.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.591+0000 7f286ffff700 1 -- 172.21.15.133:0/3307045502 >> 172.21.15.133:0/3307045502 conn(0x7f287005bdf0 msgr2=0x7f28700b3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:31.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.591+0000 7f286ffff700 1 -- 172.21.15.133:0/3307045502 shutdown_connections 2021-01-03T13:01:31.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.591+0000 7f286ffff700 1 -- 172.21.15.133:0/3307045502 wait complete. 2021-01-03T13:01:31.592 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blacklist entries 2021-01-03T13:01:31.604 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-01-03T13:01:31.604 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-01-03T13:01:31.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.719+0000 7f1eb9804700 1 Processor -- start 2021-01-03T13:01:31.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.719+0000 7f1eb9804700 1 -- start start 2021-01-03T13:01:31.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.719+0000 7f1eb9804700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1eb40b4c20 0x7f1eb405c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:31.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.719+0000 7f1eb9804700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1eb405fd10 0x7f1eb40b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:31.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.719+0000 7f1eb9804700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb405bf00 con 0x7f1eb4060510 2021-01-03T13:01:31.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.719+0000 7f1eb9804700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb405c1a0 con 0x7f1eb40b4c20 2021-01-03T13:01:31.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.719+0000 7f1eb9804700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb405c440 con 0x7f1eb405fd10 2021-01-03T13:01:31.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.719+0000 7f1eb9003700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1eb405fd10 0x7f1eb40b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:31.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.719+0000 7f1eb3fff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1eb4060510 0x7f1eb40b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:33998/0 (socket says 172.21.15.133:33998) 2021-01-03T13:01:31.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.719+0000 7f1eb3fff700 1 -- 172.21.15.133:0/195896754 learned_addr learned my addr 172.21.15.133:0/195896754 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:31.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.719+0000 7f1eb8802700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1eb40b4c20 0x7f1eb405c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:31.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.719+0000 7f1eb9003700 1 -- 172.21.15.133:0/195896754 >> v2:172.21.15.16:3300/0 conn(0x7f1eb40b4c20 msgr2=0x7f1eb405c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:31.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.719+0000 7f1eb9003700 1 --2- 172.21.15.133:0/195896754 >> v2:172.21.15.16:3300/0 conn(0x7f1eb40b4c20 0x7f1eb405c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:31.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.719+0000 7f1eb37fe700 1 -- 172.21.15.133:0/195896754 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969175311 0 0) 0x7f1eb405bf00 con 0x7f1eb4060510 2021-01-03T13:01:31.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.719+0000 7f1eb9003700 1 -- 172.21.15.133:0/195896754 >> v1:172.21.15.16:6789/0 conn(0x7f1eb4060510 legacy=0x7f1eb40b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:31.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9003700 1 -- 172.21.15.133:0/195896754 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb40b6ad0 con 0x7f1eb405fd10 2021-01-03T13:01:31.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9003700 1 --2- 172.21.15.133:0/195896754 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1eb405fd10 0x7f1eb40b65e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1eac0032b0 tx=0x7f1eac0091a0).ready entity=mon.2 client_cookie=a064e4f7fe5787c1 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:31.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb37fe700 1 -- 172.21.15.133:0/195896754 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eac00b9a0 con 0x7f1eb405fd10 2021-01-03T13:01:31.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb37fe700 1 -- 172.21.15.133:0/195896754 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eac00bb00 con 0x7f1eb405fd10 2021-01-03T13:01:31.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb37fe700 1 -- 172.21.15.133:0/195896754 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eac00bc70 con 0x7f1eb405fd10 2021-01-03T13:01:31.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9804700 1 -- 172.21.15.133:0/195896754 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1eb405fd10 msgr2=0x7f1eb40b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:31.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9804700 1 --2- 172.21.15.133:0/195896754 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1eb405fd10 0x7f1eb40b65e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1eac0032b0 tx=0x7f1eac0091a0).stop 2021-01-03T13:01:31.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9804700 1 -- 172.21.15.133:0/195896754 shutdown_connections 2021-01-03T13:01:31.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9804700 1 --2- 172.21.15.133:0/195896754 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1eb405fd10 0x7f1eb40b65e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:31.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9804700 1 --2- 172.21.15.133:0/195896754 >> v2:172.21.15.16:3300/0 conn(0x7f1eb40b4c20 0x7f1eb405c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:31.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9804700 1 -- 172.21.15.133:0/195896754 >> 172.21.15.133:0/195896754 conn(0x7f1eb40b9f00 msgr2=0x7f1eb40b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:31.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9804700 1 -- 172.21.15.133:0/195896754 shutdown_connections 2021-01-03T13:01:31.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9804700 1 -- 172.21.15.133:0/195896754 wait complete. 2021-01-03T13:01:31.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9804700 1 Processor -- start 2021-01-03T13:01:31.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9804700 1 -- start start 2021-01-03T13:01:31.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9804700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1eb405fd10 0x7f1eb409e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:31.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9804700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4060510 0x7f1eb4155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:31.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9804700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1eb40b4c20 0x7f1eb4155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:31.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9804700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb4155d40 con 0x7f1eb4060510 2021-01-03T13:01:31.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9804700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb4091e80 con 0x7f1eb40b4c20 2021-01-03T13:01:31.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.723+0000 7f1eb9804700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb4092120 con 0x7f1eb405fd10 2021-01-03T13:01:31.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.727+0000 7f1eb9003700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1eb40b4c20 0x7f1eb4155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:31.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.727+0000 7f1eb9003700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1eb40b4c20 0x7f1eb4155850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34244/0 (socket says 172.21.15.133:34244) 2021-01-03T13:01:31.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.727+0000 7f1eb9003700 1 -- 172.21.15.133:0/4268875351 learned_addr learned my addr 172.21.15.133:0/4268875351 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:31.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.727+0000 7f1eb3fff700 1 --2- 172.21.15.133:0/4268875351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4060510 0x7f1eb4155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:31.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.727+0000 7f1eb9003700 1 -- 172.21.15.133:0/4268875351 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1eb405fd10 msgr2=0x7f1eb409e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:31.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.727+0000 7f1eb9003700 1 --2- 172.21.15.133:0/4268875351 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1eb405fd10 0x7f1eb409e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T13:01:31.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.727+0000 7f1eb9003700 1 -- 172.21.15.133:0/4268875351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4060510 msgr2=0x7f1eb4155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:31.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.727+0000 7f1eb9003700 1 --2- 172.21.15.133:0/4268875351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4060510 0x7f1eb4155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:31.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.727+0000 7f1eb9003700 1 -- 172.21.15.133:0/4268875351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb4154ec0 con 0x7f1eb40b4c20 2021-01-03T13:01:31.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.727+0000 7f1eb9003700 1 --2- 172.21.15.133:0/4268875351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1eb40b4c20 0x7f1eb4155850 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f1eac0032b0 tx=0x7f1eac016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:31.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.727+0000 7f1eb1ffb700 1 -- 172.21.15.133:0/4268875351 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eac01f3f0 con 0x7f1eb40b4c20 2021-01-03T13:01:31.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.727+0000 7f1eb1ffb700 1 -- 172.21.15.133:0/4268875351 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eac01f550 con 0x7f1eb40b4c20 2021-01-03T13:01:31.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.727+0000 7f1eb9804700 1 -- 172.21.15.133:0/4268875351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb4090450 con 0x7f1eb40b4c20 2021-01-03T13:01:31.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.727+0000 7f1eb1ffb700 1 -- 172.21.15.133:0/4268875351 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eac01f8b0 con 0x7f1eb40b4c20 2021-01-03T13:01:31.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.727+0000 7f1eb9804700 1 -- 172.21.15.133:0/4268875351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb4091970 con 0x7f1eb40b4c20 2021-01-03T13:01:31.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.727+0000 7f1eb9804700 1 -- 172.21.15.133:0/4268875351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb4090080 con 0x7f1eb40b4c20 2021-01-03T13:01:31.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.727+0000 7f1eb1ffb700 1 -- 172.21.15.133:0/4268875351 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1eac026030 con 0x7f1eb40b4c20 2021-01-03T13:01:31.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.731+0000 7f1eb1ffb700 1 --2- 172.21.15.133:0/4268875351 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1e980553b0 0x7f1e98057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:31.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.731+0000 7f1eb1ffb700 1 -- 172.21.15.133:0/4268875351 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1eac06e8c0 con 0x7f1eb40b4c20 2021-01-03T13:01:31.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.731+0000 7f1eb8802700 1 --2- 172.21.15.133:0/4268875351 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1e980553b0 0x7f1e98057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:31.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.731+0000 7f1eb8802700 1 --2- 172.21.15.133:0/4268875351 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1e980553b0 0x7f1e98057870 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f1ea400c000 tx=0x7f1ea4006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:31.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.735+0000 7f1eb1ffb700 1 -- 172.21.15.133:0/4268875351 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1eb4090080 con 0x7f1eb40b4c20 2021-01-03T13:01:31.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.923+0000 7f1eb9804700 1 -- 172.21.15.133:0/4268875351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1eb4090080 con 0x7f1eb40b4c20 2021-01-03T13:01:31.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.923+0000 7f1eb1ffb700 1 -- 172.21.15.133:0/4268875351 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f1eb4090080 con 0x7f1eb40b4c20 2021-01-03T13:01:31.920 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:01:31.920 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:01:31.921 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2021-01-03T13:01:31.921 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:31.921 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2021-01-03T13:01:31.921 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Fflox9BxAA6coLDFV/FaQ/G/cvtonWgg==", 2021-01-03T13:01:31.922 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:01:31.922 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:01:31.922 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:01:31.922 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:01:31.922 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:01:31.923 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:31.923 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:31.923 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:31.923 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2021-01-03T13:01:31.923 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfrnWWFRAA3PHH/FJOvDozCChrb1T8Dg==", 2021-01-03T13:01:31.924 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:01:31.924 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:01:31.924 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:01:31.924 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:01:31.925 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:01:31.925 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:31.925 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:31.925 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:31.925 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2021-01-03T13:01:31.925 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfpPPLDxAAVvg80vLejYKDH485/L1gSQ==", 2021-01-03T13:01:31.926 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:01:31.926 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:01:31.926 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:01:31.926 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:01:31.926 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:01:31.927 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:31.927 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:31.927 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:31.927 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2021-01-03T13:01:31.927 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAnv/FfQ+CcDRAAUkTDLby5scMkNzxa0lVdAQ==", 2021-01-03T13:01:31.928 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:01:31.928 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:01:31.928 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:01:31.928 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:01:31.928 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:31.929 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:31.929 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:31.929 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2021-01-03T13:01:31.929 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApv/Ff1iilLhAAbK9hZmL772nNKAEJ4i+pkw==", 2021-01-03T13:01:31.929 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:01:31.930 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:01:31.930 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:01:31.930 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:01:31.930 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:31.931 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:31.931 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:31.931 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2021-01-03T13:01:31.931 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAsv/Ffmoe2FhAA1EbxU5yHncN+pbC/EX6d9A==", 2021-01-03T13:01:31.931 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:01:31.932 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:01:31.932 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:01:31.932 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:01:31.932 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:31.932 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:31.933 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:31.933 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2021-01-03T13:01:31.933 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAuv/FfJh/VORAAG9aCOh5s/2Lw+yN9hBFWLw==", 2021-01-03T13:01:31.933 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:01:31.933 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:01:31.934 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:01:31.934 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:01:31.934 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:31.934 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:31.934 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:31.934 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2021-01-03T13:01:31.935 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyv/Ffus0NJhAALX1TIqQ9EIupaX8KtRu7rQ==", 2021-01-03T13:01:31.935 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:01:31.935 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:01:31.935 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:01:31.935 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:01:31.936 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:31.936 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:31.936 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:31.936 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2021-01-03T13:01:31.936 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1v/FfoL6kDBAAggoRy/o0qas/41yLYqDVgA==", 2021-01-03T13:01:31.937 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:01:31.937 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:01:31.937 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:01:31.937 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:01:31.937 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:31.938 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:31.938 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:31.938 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2021-01-03T13:01:31.944 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA3v/FfwOPCMBAAGOt8ShPQ/szNbCfaP/uZEQ==", 2021-01-03T13:01:31.944 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:01:31.945 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:01:31.945 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:01:31.945 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:01:31.946 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:31.946 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:31.947 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:31.947 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2021-01-03T13:01:31.947 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA6v/Ffoz5xFxAAn3xvUDSeNSWrBJTa1Nsb6w==", 2021-01-03T13:01:31.948 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:01:31.948 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:01:31.949 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:01:31.949 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:01:31.949 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:31.950 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:31.950 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:31.951 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2021-01-03T13:01:31.951 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfyGlbGxAALm0NezvPiTAnlwu8iPEuCw==", 2021-01-03T13:01:31.951 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:01:31.952 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:01:31.952 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:01:31.952 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:01:31.953 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:31.953 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:31.954 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:31.954 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2021-01-03T13:01:31.954 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Ffa2AFHhAAD4Pq5zMJ28SqqEosBA9vnQ==", 2021-01-03T13:01:31.955 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:01:31.955 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:01:31.955 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:01:31.956 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:01:31.956 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:31.956 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:31.956 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:31.956 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2021-01-03T13:01:31.957 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjv/FfjxN8JxAAkV2Ia66fh21QYMX5fr1gTw==", 2021-01-03T13:01:31.957 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:01:31.957 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:01:31.957 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:01:31.958 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:01:31.958 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:01:31.958 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:31.958 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:31.958 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:31.959 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2021-01-03T13:01:31.959 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAU/DBBAASi+hx05pZEsP+dV9iwbz4g==", 2021-01-03T13:01:31.959 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:01:31.959 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:01:31.959 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:01:31.960 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:01:31.960 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:31.960 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:31.960 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:31.960 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2021-01-03T13:01:31.961 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAOFAAhAAPQOSkofyJoEYvcAqKK2+Mg==", 2021-01-03T13:01:31.961 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:01:31.961 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:01:31.961 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:01:31.961 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:01:31.962 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:31.962 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:31.962 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:01:31.962 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:01:31.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.923+0000 7f1eb9804700 1 -- 172.21.15.133:0/4268875351 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1e980553b0 msgr2=0x7f1e98057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:31.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.923+0000 7f1eb9804700 1 --2- 172.21.15.133:0/4268875351 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1e980553b0 0x7f1e98057870 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f1ea400c000 tx=0x7f1ea4006dc0).stop 2021-01-03T13:01:31.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.923+0000 7f1eb9804700 1 -- 172.21.15.133:0/4268875351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1eb40b4c20 msgr2=0x7f1eb4155850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:31.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.923+0000 7f1eb9804700 1 --2- 172.21.15.133:0/4268875351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1eb40b4c20 0x7f1eb4155850 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f1eac0032b0 tx=0x7f1eac016000).stop 2021-01-03T13:01:31.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.923+0000 7f1eb9804700 1 -- 172.21.15.133:0/4268875351 shutdown_connections 2021-01-03T13:01:31.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.923+0000 7f1eb9804700 1 --2- 172.21.15.133:0/4268875351 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1e980553b0 0x7f1e98057870 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:31.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.923+0000 7f1eb9804700 1 --2- 172.21.15.133:0/4268875351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1eb40b4c20 0x7f1eb4155850 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:31.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.923+0000 7f1eb9804700 1 --2- 172.21.15.133:0/4268875351 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1eb405fd10 0x7f1eb409e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T13:01:31.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.923+0000 7f1eb9804700 1 --2- 172.21.15.133:0/4268875351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1eb4060510 0x7f1eb4155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:31.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.923+0000 7f1eb9804700 1 -- 172.21.15.133:0/4268875351 >> 172.21.15.133:0/4268875351 conn(0x7f1eb40b9f00 msgr2=0x7f1eb40afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:31.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.923+0000 7f1eb9804700 1 -- 172.21.15.133:0/4268875351 shutdown_connections 2021-01-03T13:01:31.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:31.923+0000 7f1eb9804700 1 -- 172.21.15.133:0/4268875351 wait complete. 2021-01-03T13:01:31.967 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:01:32.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9eae86700 1 Processor -- start 2021-01-03T13:01:32.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9eae86700 1 -- start start 2021-01-03T13:01:32.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9eae86700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe9e40b0c90 0x7fe9e40b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9eae86700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e4060da0 con 0x7fe9e40b5c00 2021-01-03T13:01:32.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9eae86700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e40b0ad0 con 0x7fe9e40b52c0 2021-01-03T13:01:32.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9eae86700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e4067a90 con 0x7fe9e40b0c90 2021-01-03T13:01:32.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e9e84700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe9e40b52c0 0x7fe9e4098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55280/0 (socket says 172.21.15.133:55280) 2021-01-03T13:01:32.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e9e84700 1 -- 172.21.15.133:0/2165060781 learned_addr learned my addr 172.21.15.133:0/2165060781 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:32.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e9683700 1 --2- 172.21.15.133:0/2165060781 >> v2:172.21.15.16:3300/0 conn(0x7fe9e40b0c90 0x7fe9e40b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 -- 172.21.15.133:0/2165060781 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600940213 0 0) 0x7fe9dc001450 con 0x7fe9e40b52c0 2021-01-03T13:01:32.083 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 -- 172.21.15.133:0/2165060781 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9cc003230 con 0x7fe9e40b52c0 2021-01-03T13:01:32.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 -- 172.21.15.133:0/2165060781 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2277677897 0 0) 0x7fe9cc003230 con 0x7fe9e40b52c0 2021-01-03T13:01:32.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 -- 172.21.15.133:0/2165060781 >> v2:172.21.15.16:3300/0 conn(0x7fe9e40b0c90 msgr2=0x7fe9e40b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:32.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 --2- 172.21.15.133:0/2165060781 >> v2:172.21.15.16:3300/0 conn(0x7fe9e40b0c90 0x7fe9e40b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 -- 172.21.15.133:0/2165060781 >> v1:172.21.15.16:6789/0 conn(0x7fe9e40b5c00 legacy=0x7fe9e4143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 -- 172.21.15.133:0/2165060781 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e40b56a0 con 0x7fe9e40b52c0 2021-01-03T13:01:32.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 -- 172.21.15.133:0/2165060781 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fe9dc001be0 con 0x7fe9e40b52c0 2021-01-03T13:01:32.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 -- 172.21.15.133:0/2165060781 >> v1:172.21.15.133:6789/0 conn(0x7fe9e40b52c0 legacy=0x7fe9e4098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 --2- 172.21.15.133:0/2165060781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9cc003720 0x7fe9cc003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 --2- 172.21.15.133:0/2165060781 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9cc0044d0 0x7fe9cc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 --2- 172.21.15.133:0/2165060781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9cc004e40 0x7fe9cc00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 -- 172.21.15.133:0/2165060781 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e4067a90 con 0x7fe9cc003720 2021-01-03T13:01:32.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 -- 172.21.15.133:0/2165060781 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc0041c0 con 0x7fe9cc004e40 2021-01-03T13:01:32.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 -- 172.21.15.133:0/2165060781 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9cc00bc10 con 0x7fe9cc0044d0 2021-01-03T13:01:32.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9ea685700 1 --2- 172.21.15.133:0/2165060781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9cc004e40 0x7fe9cc00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e9e84700 1 --2- 172.21.15.133:0/2165060781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9cc003720 0x7fe9cc003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e9683700 1 --2- 172.21.15.133:0/2165060781 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9cc0044d0 0x7fe9cc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9ea685700 1 -- 172.21.15.133:0/2165060781 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9cc0044d0 msgr2=0x7fe9cc004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:32.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9ea685700 1 --2- 172.21.15.133:0/2165060781 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9cc0044d0 0x7fe9cc004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9ea685700 1 -- 172.21.15.133:0/2165060781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9cc003720 msgr2=0x7fe9cc003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:32.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9ea685700 1 --2- 172.21.15.133:0/2165060781 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9cc003720 0x7fe9cc003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9ea685700 1 -- 172.21.15.133:0/2165060781 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc003230 con 0x7fe9cc004e40 2021-01-03T13:01:32.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9ea685700 1 -- 172.21.15.133:0/2165060781 reap_dead start 2021-01-03T13:01:32.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9ea685700 1 --2- 172.21.15.133:0/2165060781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9cc004e40 0x7fe9cc00b720 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fe9e0000fe0 tx=0x7fe9e0007b40).ready entity=mon.1 client_cookie=74911ef274cac969 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:32.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 -- 172.21.15.133:0/2165060781 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e000c870 con 0x7fe9cc004e40 2021-01-03T13:01:32.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 -- 172.21.15.133:0/2165060781 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e000c9d0 con 0x7fe9cc004e40 2021-01-03T13:01:32.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9e8e82700 1 -- 172.21.15.133:0/2165060781 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e000cd30 con 0x7fe9cc004e40 2021-01-03T13:01:32.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9eae86700 1 -- 172.21.15.133:0/2165060781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9cc004e40 msgr2=0x7fe9cc00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.083+0000 7fe9eae86700 1 --2- 172.21.15.133:0/2165060781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9cc004e40 0x7fe9cc00b720 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fe9e0000fe0 tx=0x7fe9e0007b40).stop 2021-01-03T13:01:32.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9eae86700 1 -- 172.21.15.133:0/2165060781 shutdown_connections 2021-01-03T13:01:32.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9eae86700 1 --2- 172.21.15.133:0/2165060781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9cc004e40 0x7fe9cc00b720 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9eae86700 1 -- 172.21.15.133:0/2165060781 >> 172.21.15.133:0/2165060781 conn(0x7fe9e405bdf0 msgr2=0x7fe9e405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:32.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9eae86700 1 -- 172.21.15.133:0/2165060781 shutdown_connections 2021-01-03T13:01:32.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9eae86700 1 -- 172.21.15.133:0/2165060781 wait complete. 2021-01-03T13:01:32.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9eae86700 1 Processor -- start 2021-01-03T13:01:32.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9eae86700 1 -- start start 2021-01-03T13:01:32.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9eae86700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9cc004e40 0x7fe9e4066030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9eae86700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9e40646d0 0x7fe9e41425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9eae86700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9e4142ac0 0x7fe9e4159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9eae86700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e4064270 con 0x7fe9e40646d0 2021-01-03T13:01:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9eae86700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e40aef00 con 0x7fe9e4142ac0 2021-01-03T13:01:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9eae86700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e40ae9c0 con 0x7fe9cc004e40 2021-01-03T13:01:32.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9ea685700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9e4142ac0 0x7fe9e4159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9ea685700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9e4142ac0 0x7fe9e4159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34264/0 (socket says 172.21.15.133:34264) 2021-01-03T13:01:32.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9ea685700 1 -- 172.21.15.133:0/3720556887 learned_addr learned my addr 172.21.15.133:0/3720556887 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:32.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9e9e84700 1 --2- 172.21.15.133:0/3720556887 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9cc004e40 0x7fe9e4066030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9e9683700 1 --2- 172.21.15.133:0/3720556887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9e40646d0 0x7fe9e41425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9ea685700 1 -- 172.21.15.133:0/3720556887 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9cc004e40 msgr2=0x7fe9e4066030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9ea685700 1 --2- 172.21.15.133:0/3720556887 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9cc004e40 0x7fe9e4066030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9ea685700 1 -- 172.21.15.133:0/3720556887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9e40646d0 msgr2=0x7fe9e41425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9ea685700 1 --2- 172.21.15.133:0/3720556887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9e40646d0 0x7fe9e41425d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.087+0000 7fe9ea685700 1 -- 172.21.15.133:0/3720556887 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e40aec60 con 0x7fe9e4142ac0 2021-01-03T13:01:32.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.091+0000 7fe9ea685700 1 --2- 172.21.15.133:0/3720556887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9e4142ac0 0x7fe9e4159730 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fe9e0000fe0 tx=0x7fe9e0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:32.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.091+0000 7fe9d2ffd700 1 -- 172.21.15.133:0/3720556887 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e0007870 con 0x7fe9e4142ac0 2021-01-03T13:01:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.091+0000 7fe9d2ffd700 1 -- 172.21.15.133:0/3720556887 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e0007030 con 0x7fe9e4142ac0 2021-01-03T13:01:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.091+0000 7fe9eae86700 1 -- 172.21.15.133:0/3720556887 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e4142f70 con 0x7fe9e4142ac0 2021-01-03T13:01:32.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.091+0000 7fe9d2ffd700 1 -- 172.21.15.133:0/3720556887 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9e0007390 con 0x7fe9e4142ac0 2021-01-03T13:01:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.091+0000 7fe9eae86700 1 -- 172.21.15.133:0/3720556887 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e40adc80 con 0x7fe9e4142ac0 2021-01-03T13:01:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.091+0000 7fe9eae86700 1 -- 172.21.15.133:0/3720556887 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e4057300 con 0x7fe9e4142ac0 2021-01-03T13:01:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.091+0000 7fe9d2ffd700 1 -- 172.21.15.133:0/3720556887 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe9e0010030 con 0x7fe9e4142ac0 2021-01-03T13:01:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.091+0000 7fe9d2ffd700 1 --2- 172.21.15.133:0/3720556887 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe9c40553b0 0x7fe9c4057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.091+0000 7fe9d2ffd700 1 -- 172.21.15.133:0/3720556887 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe9e006e760 con 0x7fe9e4142ac0 2021-01-03T13:01:32.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.091+0000 7fe9e9e84700 1 --2- 172.21.15.133:0/3720556887 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe9c40553b0 0x7fe9c4057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.091+0000 7fe9e9e84700 1 --2- 172.21.15.133:0/3720556887 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe9c40553b0 0x7fe9c4057870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fe9dc005000 tx=0x7fe9dc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:32.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.095+0000 7fe9d2ffd700 1 -- 172.21.15.133:0/3720556887 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe9e0044d90 con 0x7fe9e4142ac0 2021-01-03T13:01:32.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.235+0000 7fe9eae86700 1 -- 172.21.15.133:0/3720556887 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9e405ce00 con 0x7fe9e4142ac0 2021-01-03T13:01:32.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.235+0000 7fe9d2ffd700 1 -- 172.21.15.133:0/3720556887 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+13229 (secure 0 0 0) 0x7fe9e00483b0 con 0x7fe9e4142ac0 2021-01-03T13:01:32.235 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:01:32.235 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":50,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:01:31.579287+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:01:32.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.239+0000 7fe9eae86700 1 -- 172.21.15.133:0/3720556887 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe9c40553b0 msgr2=0x7fe9c4057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.239+0000 7fe9eae86700 1 --2- 172.21.15.133:0/3720556887 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe9c40553b0 0x7fe9c4057870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fe9dc005000 tx=0x7fe9dc009040).stop 2021-01-03T13:01:32.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.239+0000 7fe9eae86700 1 -- 172.21.15.133:0/3720556887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9e4142ac0 msgr2=0x7fe9e4159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.239+0000 7fe9eae86700 1 --2- 172.21.15.133:0/3720556887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9e4142ac0 0x7fe9e4159730 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fe9e0000fe0 tx=0x7fe9e0016000).stop 2021-01-03T13:01:32.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.239+0000 7fe9eae86700 1 -- 172.21.15.133:0/3720556887 shutdown_connections 2021-01-03T13:01:32.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.239+0000 7fe9eae86700 1 --2- 172.21.15.133:0/3720556887 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe9c40553b0 0x7fe9c4057870 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.239+0000 7fe9eae86700 1 --2- 172.21.15.133:0/3720556887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9e4142ac0 0x7fe9e4159730 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.239+0000 7fe9eae86700 1 --2- 172.21.15.133:0/3720556887 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9cc004e40 0x7fe9e4066030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.239+0000 7fe9eae86700 1 --2- 172.21.15.133:0/3720556887 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9e40646d0 0x7fe9e41425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.239+0000 7fe9eae86700 1 -- 172.21.15.133:0/3720556887 >> 172.21.15.133:0/3720556887 conn(0x7fe9e405bdf0 msgr2=0x7fe9e405f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:32.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.239+0000 7fe9eae86700 1 -- 172.21.15.133:0/3720556887 shutdown_connections 2021-01-03T13:01:32.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.239+0000 7fe9eae86700 1 -- 172.21.15.133:0/3720556887 wait complete. 2021-01-03T13:01:32.248 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-01-03T13:01:32.250 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:01:32.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.363+0000 7fb6d1303700 1 Processor -- start 2021-01-03T13:01:32.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.363+0000 7fb6d1303700 1 -- start start 2021-01-03T13:01:32.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6d1303700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6cc05c840 0x7fb6cc143940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6d1303700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6cc067710 0x7fb6cc13c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6d1303700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6cc05cc20 con 0x7fb6cc146dc0 2021-01-03T13:01:32.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6d1303700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6cc0ad5a0 con 0x7fb6cc067710 2021-01-03T13:01:32.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6d1303700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc0b10b0 con 0x7fb6cc05c840 2021-01-03T13:01:32.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6cb7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6cc067710 0x7fb6cc13c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6cb7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6cc067710 0x7fb6cc13c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34272/0 (socket says 172.21.15.133:34272) 2021-01-03T13:01:32.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6cb7fe700 1 -- 172.21.15.133:0/2700379466 learned_addr learned my addr 172.21.15.133:0/2700379466 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:32.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6caffd700 1 --2- 172.21.15.133:0/2700379466 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6cc05c840 0x7fb6cc143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6cb7fe700 1 -- 172.21.15.133:0/2700379466 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6cc05c840 msgr2=0x7fb6cc143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:32.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6cb7fe700 1 --2- 172.21.15.133:0/2700379466 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6cc05c840 0x7fb6cc143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6cb7fe700 1 -- 172.21.15.133:0/2700379466 >> v1:172.21.15.16:6789/0 conn(0x7fb6cc146dc0 legacy=0x7fb6cc0b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6cb7fe700 1 -- 172.21.15.133:0/2700379466 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc142f60 con 0x7fb6cc067710 2021-01-03T13:01:32.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6caffd700 1 --2- 172.21.15.133:0/2700379466 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6cc05c840 0x7fb6cc143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:01:32.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6cb7fe700 1 --2- 172.21.15.133:0/2700379466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6cc067710 0x7fb6cc13c3e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fb6c40032b0 tx=0x7fb6c4009270).ready entity=mon.1 client_cookie=d3b5c569b693b84b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:32.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6ca7fc700 1 -- 172.21.15.133:0/2700379466 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c4009e60 con 0x7fb6cc067710 2021-01-03T13:01:32.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6ca7fc700 1 -- 172.21.15.133:0/2700379466 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c400bc00 con 0x7fb6cc067710 2021-01-03T13:01:32.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6ca7fc700 1 -- 172.21.15.133:0/2700379466 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6c400bd70 con 0x7fb6cc067710 2021-01-03T13:01:32.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6d1303700 1 -- 172.21.15.133:0/2700379466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6cc067710 msgr2=0x7fb6cc13c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.367+0000 7fb6d1303700 1 --2- 172.21.15.133:0/2700379466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6cc067710 0x7fb6cc13c3e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fb6c40032b0 tx=0x7fb6c4009270).stop 2021-01-03T13:01:32.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.371+0000 7fb6d1303700 1 -- 172.21.15.133:0/2700379466 shutdown_connections 2021-01-03T13:01:32.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.371+0000 7fb6d1303700 1 --2- 172.21.15.133:0/2700379466 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6cc05c840 0x7fb6cc143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.371+0000 7fb6d1303700 1 --2- 172.21.15.133:0/2700379466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6cc067710 0x7fb6cc13c3e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.371+0000 7fb6d1303700 1 -- 172.21.15.133:0/2700379466 >> 172.21.15.133:0/2700379466 conn(0x7fb6cc06aeb0 msgr2=0x7fb6cc05bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:32.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.371+0000 7fb6d1303700 1 -- 172.21.15.133:0/2700379466 shutdown_connections 2021-01-03T13:01:32.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.371+0000 7fb6d1303700 1 -- 172.21.15.133:0/2700379466 wait complete. 2021-01-03T13:01:32.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.371+0000 7fb6d1303700 1 Processor -- start 2021-01-03T13:01:32.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.371+0000 7fb6d1303700 1 -- start start 2021-01-03T13:01:32.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6d1303700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6cc05c840 0x7fb6cc1462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6d1303700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6cc067710 0x7fb6cc151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6d1303700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6cc146dc0 0x7fb6cc152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6d1303700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1405e0 con 0x7fb6cc146dc0 2021-01-03T13:01:32.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6d1303700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc1553c0 con 0x7fb6cc05c840 2021-01-03T13:01:32.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6d1303700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc155660 con 0x7fb6cc067710 2021-01-03T13:01:32.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6caffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6cc05c840 0x7fb6cc1462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6caffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6cc05c840 0x7fb6cc1462c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34274/0 (socket says 172.21.15.133:34274) 2021-01-03T13:01:32.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6caffd700 1 -- 172.21.15.133:0/1980301713 learned_addr learned my addr 172.21.15.133:0/1980301713 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:32.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6c27fc700 1 --2- 172.21.15.133:0/1980301713 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6cc067710 0x7fb6cc151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6cb7fe700 1 --2- 172.21.15.133:0/1980301713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6cc146dc0 0x7fb6cc152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6caffd700 1 -- 172.21.15.133:0/1980301713 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6cc067710 msgr2=0x7fb6cc151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6caffd700 1 --2- 172.21.15.133:0/1980301713 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6cc067710 0x7fb6cc151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6caffd700 1 -- 172.21.15.133:0/1980301713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6cc146dc0 msgr2=0x7fb6cc152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6caffd700 1 --2- 172.21.15.133:0/1980301713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6cc146dc0 0x7fb6cc152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6caffd700 1 -- 172.21.15.133:0/1980301713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc155900 con 0x7fb6cc05c840 2021-01-03T13:01:32.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6c27fc700 1 --2- 172.21.15.133:0/1980301713 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6cc067710 0x7fb6cc151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:01:32.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6caffd700 1 --2- 172.21.15.133:0/1980301713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6cc05c840 0x7fb6cc1462c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fb6cc13f450 tx=0x7fb6bc006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:32.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6c8ff9700 1 -- 172.21.15.133:0/1980301713 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6bc00cda0 con 0x7fb6cc05c840 2021-01-03T13:01:32.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6c8ff9700 1 -- 172.21.15.133:0/1980301713 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc00b570 con 0x7fb6cc05c840 2021-01-03T13:01:32.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6d1303700 1 -- 172.21.15.133:0/1980301713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6cc155ba0 con 0x7fb6cc05c840 2021-01-03T13:01:32.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6c8ff9700 1 -- 172.21.15.133:0/1980301713 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6bc0125e0 con 0x7fb6cc05c840 2021-01-03T13:01:32.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.375+0000 7fb6d1303700 1 -- 172.21.15.133:0/1980301713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6cc12cb30 con 0x7fb6cc05c840 2021-01-03T13:01:32.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.379+0000 7fb6c8ff9700 1 -- 172.21.15.133:0/1980301713 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb6bc012740 con 0x7fb6cc05c840 2021-01-03T13:01:32.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.379+0000 7fb6d1303700 1 -- 172.21.15.133:0/1980301713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6cc057300 con 0x7fb6cc05c840 2021-01-03T13:01:32.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.379+0000 7fb6c8ff9700 1 --2- 172.21.15.133:0/1980301713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6b00554e0 0x7fb6b00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.379+0000 7fb6c8ff9700 1 -- 172.21.15.133:0/1980301713 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb6bc06e3b0 con 0x7fb6cc05c840 2021-01-03T13:01:32.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.379+0000 7fb6c27fc700 1 --2- 172.21.15.133:0/1980301713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6b00554e0 0x7fb6b00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.379+0000 7fb6c27fc700 1 --2- 172.21.15.133:0/1980301713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6b00554e0 0x7fb6b00579a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fb6b400b000 tx=0x7fb6b4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:32.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.387+0000 7fb6c8ff9700 1 -- 172.21.15.133:0/1980301713 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb6bc044940 con 0x7fb6cc05c840 2021-01-03T13:01:32.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.523+0000 7fb6d1303700 1 -- 172.21.15.133:0/1980301713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb6cc05ce00 con 0x7fb6cc05c840 2021-01-03T13:01:32.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.523+0000 7fb6c8ff9700 1 -- 172.21.15.133:0/1980301713 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v50) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb6bc047f60 con 0x7fb6cc05c840 2021-01-03T13:01:32.522 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:01:32.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.523+0000 7fb6d1303700 1 -- 172.21.15.133:0/1980301713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6b00554e0 msgr2=0x7fb6b00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.523+0000 7fb6d1303700 1 --2- 172.21.15.133:0/1980301713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6b00554e0 0x7fb6b00579a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fb6b400b000 tx=0x7fb6b4009040).stop 2021-01-03T13:01:32.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.523+0000 7fb6d1303700 1 -- 172.21.15.133:0/1980301713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6cc05c840 msgr2=0x7fb6cc1462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.523+0000 7fb6d1303700 1 --2- 172.21.15.133:0/1980301713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6cc05c840 0x7fb6cc1462c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fb6cc13f450 tx=0x7fb6bc006dc0).stop 2021-01-03T13:01:32.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.523+0000 7fb6d1303700 1 -- 172.21.15.133:0/1980301713 shutdown_connections 2021-01-03T13:01:32.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.523+0000 7fb6d1303700 1 --2- 172.21.15.133:0/1980301713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6b00554e0 0x7fb6b00579a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.523+0000 7fb6d1303700 1 --2- 172.21.15.133:0/1980301713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6cc146dc0 0x7fb6cc152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.523+0000 7fb6d1303700 1 --2- 172.21.15.133:0/1980301713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6cc05c840 0x7fb6cc1462c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.523+0000 7fb6d1303700 1 --2- 172.21.15.133:0/1980301713 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6cc067710 0x7fb6cc151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.523+0000 7fb6d1303700 1 -- 172.21.15.133:0/1980301713 >> 172.21.15.133:0/1980301713 conn(0x7fb6cc06aeb0 msgr2=0x7fb6cc0b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:32.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.527+0000 7fb6d1303700 1 -- 172.21.15.133:0/1980301713 shutdown_connections 2021-01-03T13:01:32.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.527+0000 7fb6d1303700 1 -- 172.21.15.133:0/1980301713 wait complete. 2021-01-03T13:01:32.540 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:01:32.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5e1d82700 1 Processor -- start 2021-01-03T13:01:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5e1d82700 1 -- start start 2021-01-03T13:01:32.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5e1d82700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5dc140410 0x7fe5dc146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5e1d82700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe5dc0b0470 0x7fe5dc05bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5e1d82700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5dc05cf20 con 0x7fe5dc1407f0 2021-01-03T13:01:32.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5e1d82700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5dc0b02d0 con 0x7fe5dc0b0470 2021-01-03T13:01:32.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5e1d82700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc146390 con 0x7fe5dc140410 2021-01-03T13:01:32.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5db7fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5dc140410 0x7fe5dc146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5dbfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe5dc0b0470 0x7fe5dc05bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5daffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe5dc1407f0 0x7fe5dc142dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:34044/0 (socket says 172.21.15.133:34044) 2021-01-03T13:01:32.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5db7fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5dc140410 0x7fe5dc146cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:42584/0 (socket says 172.21.15.133:42584) 2021-01-03T13:01:32.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5daffd700 1 -- 172.21.15.133:0/524886860 learned_addr learned my addr 172.21.15.133:0/524886860 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:32.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5db7fe700 1 -- 172.21.15.133:0/524886860 >> v2:172.21.15.16:3300/0 conn(0x7fe5dc0b0470 msgr2=0x7fe5dc05bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:32.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5db7fe700 1 --2- 172.21.15.133:0/524886860 >> v2:172.21.15.16:3300/0 conn(0x7fe5dc0b0470 0x7fe5dc05bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5db7fe700 1 -- 172.21.15.133:0/524886860 >> v1:172.21.15.16:6789/0 conn(0x7fe5dc1407f0 legacy=0x7fe5dc142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5db7fe700 1 -- 172.21.15.133:0/524886860 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5dc146580 con 0x7fe5dc140410 2021-01-03T13:01:32.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5db7fe700 1 --2- 172.21.15.133:0/524886860 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5dc140410 0x7fe5dc146cc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe5cc002f30 tx=0x7fe5cc006dc0).ready entity=mon.2 client_cookie=c3aed293064d70b4 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:32.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5da7fc700 1 -- 172.21.15.133:0/524886860 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5cc009760 con 0x7fe5dc140410 2021-01-03T13:01:32.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5da7fc700 1 -- 172.21.15.133:0/524886860 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc0098c0 con 0x7fe5dc140410 2021-01-03T13:01:32.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5da7fc700 1 -- 172.21.15.133:0/524886860 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5cc009c20 con 0x7fe5dc140410 2021-01-03T13:01:32.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5e1d82700 1 -- 172.21.15.133:0/524886860 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5dc140410 msgr2=0x7fe5dc146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.659+0000 7fe5e1d82700 1 --2- 172.21.15.133:0/524886860 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5dc140410 0x7fe5dc146cc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fe5cc002f30 tx=0x7fe5cc006dc0).stop 2021-01-03T13:01:32.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5e1d82700 1 -- 172.21.15.133:0/524886860 shutdown_connections 2021-01-03T13:01:32.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5e1d82700 1 --2- 172.21.15.133:0/524886860 >> v2:172.21.15.16:3300/0 conn(0x7fe5dc0b0470 0x7fe5dc05bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5e1d82700 1 --2- 172.21.15.133:0/524886860 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5dc140410 0x7fe5dc146cc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5e1d82700 1 -- 172.21.15.133:0/524886860 >> 172.21.15.133:0/524886860 conn(0x7fe5dc0b95d0 msgr2=0x7fe5dc0b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:32.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5e1d82700 1 -- 172.21.15.133:0/524886860 shutdown_connections 2021-01-03T13:01:32.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5e1d82700 1 -- 172.21.15.133:0/524886860 wait complete. 2021-01-03T13:01:32.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5e1d82700 1 Processor -- start 2021-01-03T13:01:32.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5e1d82700 1 -- start start 2021-01-03T13:01:32.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5e1d82700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5dc0b0470 0x7fe5dc0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5e1d82700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5dc140410 0x7fe5dc142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5e1d82700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5dc1407f0 0x7fe5dc142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5e1d82700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc141830 con 0x7fe5dc140410 2021-01-03T13:01:32.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5e1d82700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc09f090 con 0x7fe5dc1407f0 2021-01-03T13:01:32.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5e1d82700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc141c60 con 0x7fe5dc0b0470 2021-01-03T13:01:32.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5db7fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5dc0b0470 0x7fe5dc0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5dbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5dc1407f0 0x7fe5dc142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5db7fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5dc0b0470 0x7fe5dc0b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:42592/0 (socket says 172.21.15.133:42592) 2021-01-03T13:01:32.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5db7fe700 1 -- 172.21.15.133:0/3124650251 learned_addr learned my addr 172.21.15.133:0/3124650251 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:32.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5daffd700 1 --2- 172.21.15.133:0/3124650251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5dc140410 0x7fe5dc142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5db7fe700 1 -- 172.21.15.133:0/3124650251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5dc1407f0 msgr2=0x7fe5dc142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.663+0000 7fe5db7fe700 1 --2- 172.21.15.133:0/3124650251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5dc1407f0 0x7fe5dc142a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.667+0000 7fe5db7fe700 1 -- 172.21.15.133:0/3124650251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5dc140410 msgr2=0x7fe5dc142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.667+0000 7fe5db7fe700 1 --2- 172.21.15.133:0/3124650251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5dc140410 0x7fe5dc142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.667+0000 7fe5db7fe700 1 -- 172.21.15.133:0/3124650251 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5dc1458b0 con 0x7fe5dc0b0470 2021-01-03T13:01:32.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.667+0000 7fe5db7fe700 1 --2- 172.21.15.133:0/3124650251 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5dc0b0470 0x7fe5dc0b18e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe5cc002f30 tx=0x7fe5cc015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:32.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.667+0000 7fe5d8ff9700 1 -- 172.21.15.133:0/3124650251 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5cc011b20 con 0x7fe5dc0b0470 2021-01-03T13:01:32.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.667+0000 7fe5d8ff9700 1 -- 172.21.15.133:0/3124650251 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc011c80 con 0x7fe5dc0b0470 2021-01-03T13:01:32.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.667+0000 7fe5e1d82700 1 -- 172.21.15.133:0/3124650251 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5dc141400 con 0x7fe5dc0b0470 2021-01-03T13:01:32.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.667+0000 7fe5d8ff9700 1 -- 172.21.15.133:0/3124650251 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5cc01d440 con 0x7fe5dc0b0470 2021-01-03T13:01:32.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.667+0000 7fe5e1d82700 1 -- 172.21.15.133:0/3124650251 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5dc142f30 con 0x7fe5dc0b0470 2021-01-03T13:01:32.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.667+0000 7fe5e1d82700 1 -- 172.21.15.133:0/3124650251 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5dc140eb0 con 0x7fe5dc0b0470 2021-01-03T13:01:32.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.667+0000 7fe5d8ff9700 1 -- 172.21.15.133:0/3124650251 <== mon.2 v2:172.21.15.16:3301/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe5cc024030 con 0x7fe5dc0b0470 2021-01-03T13:01:32.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.667+0000 7fe5d8ff9700 1 --2- 172.21.15.133:0/3124650251 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5bc0554e0 0x7fe5bc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.667+0000 7fe5daffd700 1 --2- 172.21.15.133:0/3124650251 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5bc0554e0 0x7fe5bc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.667+0000 7fe5d8ff9700 1 -- 172.21.15.133:0/3124650251 <== mon.2 v2:172.21.15.16:3301/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe5cc06ec40 con 0x7fe5dc0b0470 2021-01-03T13:01:32.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.671+0000 7fe5daffd700 1 --2- 172.21.15.133:0/3124650251 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5bc0554e0 0x7fe5bc0579a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fe5d000d000 tx=0x7fe5d0000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:32.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.675+0000 7fe5d8ff9700 1 -- 172.21.15.133:0/3124650251 <== mon.2 v2:172.21.15.16:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe5cc045160 con 0x7fe5dc0b0470 2021-01-03T13:01:32.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.819+0000 7fe5e1d82700 1 -- 172.21.15.133:0/3124650251 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe5dc057300 con 0x7fe5dc0b0470 2021-01-03T13:01:32.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.819+0000 7fe5d8ff9700 1 -- 172.21.15.133:0/3124650251 <== mon.2 v2:172.21.15.16:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe5cc022020 con 0x7fe5dc0b0470 2021-01-03T13:01:32.817 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:01:32.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.823+0000 7fe5e1d82700 1 -- 172.21.15.133:0/3124650251 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5bc0554e0 msgr2=0x7fe5bc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.823+0000 7fe5e1d82700 1 --2- 172.21.15.133:0/3124650251 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5bc0554e0 0x7fe5bc0579a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fe5d000d000 tx=0x7fe5d0000b80).stop 2021-01-03T13:01:32.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.823+0000 7fe5e1d82700 1 -- 172.21.15.133:0/3124650251 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5dc0b0470 msgr2=0x7fe5dc0b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.823+0000 7fe5e1d82700 1 --2- 172.21.15.133:0/3124650251 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5dc0b0470 0x7fe5dc0b18e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe5cc002f30 tx=0x7fe5cc015000).stop 2021-01-03T13:01:32.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.823+0000 7fe5e1d82700 1 -- 172.21.15.133:0/3124650251 shutdown_connections 2021-01-03T13:01:32.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.823+0000 7fe5e1d82700 1 --2- 172.21.15.133:0/3124650251 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5bc0554e0 0x7fe5bc0579a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.823+0000 7fe5e1d82700 1 --2- 172.21.15.133:0/3124650251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5dc1407f0 0x7fe5dc142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.823+0000 7fe5e1d82700 1 --2- 172.21.15.133:0/3124650251 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5dc0b0470 0x7fe5dc0b18e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.823+0000 7fe5e1d82700 1 --2- 172.21.15.133:0/3124650251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5dc140410 0x7fe5dc142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.823+0000 7fe5e1d82700 1 -- 172.21.15.133:0/3124650251 >> 172.21.15.133:0/3124650251 conn(0x7fe5dc0b95d0 msgr2=0x7fe5dc0b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:32.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.823+0000 7fe5e1d82700 1 -- 172.21.15.133:0/3124650251 shutdown_connections 2021-01-03T13:01:32.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.823+0000 7fe5e1d82700 1 -- 172.21.15.133:0/3124650251 wait complete. 2021-01-03T13:01:32.835 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-01-03T13:01:32.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.943+0000 7f53a2fef700 1 Processor -- start 2021-01-03T13:01:32.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.943+0000 7f53a2fef700 1 -- start start 2021-01-03T13:01:32.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.943+0000 7f53a2fef700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f539c0b4c20 0x7f539c05c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.943+0000 7f53a2fef700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f539c060510 0x7f539c0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.943+0000 7f53a2fef700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f539c0b6cf0 con 0x7f539c05fd10 2021-01-03T13:01:32.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.943+0000 7f53a2fef700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539c05bf00 con 0x7f539c0b4c20 2021-01-03T13:01:32.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.943+0000 7f53a2fef700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539c05c1a0 con 0x7f539c060510 2021-01-03T13:01:32.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.943+0000 7f53a17ec700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f539c060510 0x7f539c0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.943+0000 7f53a17ec700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f539c060510 0x7f539c0b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:42600/0 (socket says 172.21.15.133:42600) 2021-01-03T13:01:32.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.943+0000 7f53a17ec700 1 -- 172.21.15.133:0/302687068 learned_addr learned my addr 172.21.15.133:0/302687068 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:32.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.943+0000 7f53a27ee700 1 --1- 172.21.15.133:0/302687068 >> v1:172.21.15.16:6789/0 conn(0x7f539c05fd10 0x7f539c0b65e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:34060/0 (socket says 172.21.15.133:34060) 2021-01-03T13:01:32.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.943+0000 7f53a1fed700 1 --2- 172.21.15.133:0/302687068 >> v2:172.21.15.16:3300/0 conn(0x7f539c0b4c20 0x7f539c05c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.947+0000 7f53a17ec700 1 -- 172.21.15.133:0/302687068 >> v2:172.21.15.16:3300/0 conn(0x7f539c0b4c20 msgr2=0x7f539c05c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:32.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.947+0000 7f53a17ec700 1 --2- 172.21.15.133:0/302687068 >> v2:172.21.15.16:3300/0 conn(0x7f539c0b4c20 0x7f539c05c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.947+0000 7f53a17ec700 1 -- 172.21.15.133:0/302687068 >> v1:172.21.15.16:6789/0 conn(0x7f539c05fd10 legacy=0x7f539c0b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.947+0000 7f53a0feb700 1 -- 172.21.15.133:0/302687068 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428874657 0 0) 0x7f539c0b6cf0 con 0x7f539c05fd10 2021-01-03T13:01:32.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.947+0000 7f53a17ec700 1 -- 172.21.15.133:0/302687068 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c05c440 con 0x7f539c060510 2021-01-03T13:01:32.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.947+0000 7f53a17ec700 1 --2- 172.21.15.133:0/302687068 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f539c060510 0x7f539c0b5000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f538c002f30 tx=0x7f538c006e80).ready entity=mon.2 client_cookie=796657517645b6d4 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:32.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.947+0000 7f53a0feb700 1 -- 172.21.15.133:0/302687068 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f538c0097f0 con 0x7f539c060510 2021-01-03T13:01:32.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.947+0000 7f53a0feb700 1 -- 172.21.15.133:0/302687068 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c009950 con 0x7f539c060510 2021-01-03T13:01:32.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.947+0000 7f53a0feb700 1 -- 172.21.15.133:0/302687068 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f538c009cb0 con 0x7f539c060510 2021-01-03T13:01:32.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.947+0000 7f53a2fef700 1 -- 172.21.15.133:0/302687068 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f539c060510 msgr2=0x7f539c0b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.947+0000 7f53a2fef700 1 --2- 172.21.15.133:0/302687068 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f539c060510 0x7f539c0b5000 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f538c002f30 tx=0x7f538c006e80).stop 2021-01-03T13:01:32.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.947+0000 7f53a2fef700 1 -- 172.21.15.133:0/302687068 shutdown_connections 2021-01-03T13:01:32.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.947+0000 7f53a2fef700 1 --2- 172.21.15.133:0/302687068 >> v2:172.21.15.16:3300/0 conn(0x7f539c0b4c20 0x7f539c05c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.947+0000 7f53a2fef700 1 --2- 172.21.15.133:0/302687068 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f539c060510 0x7f539c0b5000 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.947+0000 7f53a2fef700 1 -- 172.21.15.133:0/302687068 >> 172.21.15.133:0/302687068 conn(0x7f539c0b9f00 msgr2=0x7f539c0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:32.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.947+0000 7f53a2fef700 1 -- 172.21.15.133:0/302687068 shutdown_connections 2021-01-03T13:01:32.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.947+0000 7f53a2fef700 1 -- 172.21.15.133:0/302687068 wait complete. 2021-01-03T13:01:32.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a2fef700 1 Processor -- start 2021-01-03T13:01:32.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a2fef700 1 -- start start 2021-01-03T13:01:32.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a2fef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f539c05fd10 0x7f539c09e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a2fef700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f539c060510 0x7f539c1423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a2fef700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f539c0b4c20 0x7f539c142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a2fef700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c0b3500 con 0x7f539c0b4c20 2021-01-03T13:01:32.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a2fef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c1428d0 con 0x7f539c05fd10 2021-01-03T13:01:32.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a2fef700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539c0b2b20 con 0x7f539c060510 2021-01-03T13:01:32.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a1fed700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f539c05fd10 0x7f539c09e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a1fed700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f539c05fd10 0x7f539c09e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34302/0 (socket says 172.21.15.133:34302) 2021-01-03T13:01:32.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a1fed700 1 -- 172.21.15.133:0/3631560281 learned_addr learned my addr 172.21.15.133:0/3631560281 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:32.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a17ec700 1 --2- 172.21.15.133:0/3631560281 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f539c060510 0x7f539c1423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a27ee700 1 --2- 172.21.15.133:0/3631560281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f539c0b4c20 0x7f539c142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a1fed700 1 -- 172.21.15.133:0/3631560281 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f539c060510 msgr2=0x7f539c1423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a1fed700 1 --2- 172.21.15.133:0/3631560281 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f539c060510 0x7f539c1423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a1fed700 1 -- 172.21.15.133:0/3631560281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f539c0b4c20 msgr2=0x7f539c142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:32.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a1fed700 1 --2- 172.21.15.133:0/3631560281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f539c0b4c20 0x7f539c142c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:32.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a1fed700 1 -- 172.21.15.133:0/3631560281 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c0b2dc0 con 0x7f539c05fd10 2021-01-03T13:01:32.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.951+0000 7f53a1fed700 1 --2- 172.21.15.133:0/3631560281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f539c05fd10 0x7f539c09e4c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f539800c000 tx=0x7f5398006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:32.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.955+0000 7f538affd700 1 -- 172.21.15.133:0/3631560281 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f539800ca10 con 0x7f539c05fd10 2021-01-03T13:01:32.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.955+0000 7f538affd700 1 -- 172.21.15.133:0/3631560281 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539800cb70 con 0x7f539c05fd10 2021-01-03T13:01:32.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.955+0000 7f53a2fef700 1 -- 172.21.15.133:0/3631560281 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539c0b3060 con 0x7f539c05fd10 2021-01-03T13:01:32.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.955+0000 7f538affd700 1 -- 172.21.15.133:0/3631560281 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f539800be50 con 0x7f539c05fd10 2021-01-03T13:01:32.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.955+0000 7f53a2fef700 1 -- 172.21.15.133:0/3631560281 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539c13f5e0 con 0x7f539c05fd10 2021-01-03T13:01:32.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.955+0000 7f53a2fef700 1 -- 172.21.15.133:0/3631560281 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539c0b31f0 con 0x7f539c05fd10 2021-01-03T13:01:32.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.955+0000 7f538affd700 1 -- 172.21.15.133:0/3631560281 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f539801b400 con 0x7f539c05fd10 2021-01-03T13:01:32.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.955+0000 7f538affd700 1 --2- 172.21.15.133:0/3631560281 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f537c055350 0x7f537c057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:32.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.955+0000 7f538affd700 1 -- 172.21.15.133:0/3631560281 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f539806dce0 con 0x7f539c05fd10 2021-01-03T13:01:32.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.955+0000 7f53a17ec700 1 --2- 172.21.15.133:0/3631560281 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f537c055350 0x7f537c057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:32.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.955+0000 7f53a17ec700 1 --2- 172.21.15.133:0/3631560281 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f537c055350 0x7f537c057810 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f538c01c000 tx=0x7f538c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:32.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:32.959+0000 7f538affd700 1 -- 172.21.15.133:0/3631560281 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f53980442b0 con 0x7f539c05fd10 2021-01-03T13:01:33.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.103+0000 7f53a2fef700 1 -- 172.21.15.133:0/3631560281 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f539c057300 con 0x7f539c05fd10 2021-01-03T13:01:33.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.103+0000 7f538affd700 1 -- 172.21.15.133:0/3631560281 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) v1 ==== 84+0+143 (secure 0 0 0) 0x7f53980478d0 con 0x7f539c05fd10 2021-01-03T13:01:33.102 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:01:33.102 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2021-01-03T13:01:33.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:33.102 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2021-01-03T13:01:33.103 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2021-01-03T13:01:33.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:01:33.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:01:33.103 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2021-01-03T13:01:33.103 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2021-01-03T13:01:33.104 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:01:33.104 INFO:teuthology.orchestra.run.smithi133.stdout:] 2021-01-03T13:01:33.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.107+0000 7f53a2fef700 1 -- 172.21.15.133:0/3631560281 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f537c055350 msgr2=0x7f537c057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:33.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.107+0000 7f53a2fef700 1 --2- 172.21.15.133:0/3631560281 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f537c055350 0x7f537c057810 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f538c01c000 tx=0x7f538c015000).stop 2021-01-03T13:01:33.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.107+0000 7f53a2fef700 1 -- 172.21.15.133:0/3631560281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f539c05fd10 msgr2=0x7f539c09e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:33.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.107+0000 7f53a2fef700 1 --2- 172.21.15.133:0/3631560281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f539c05fd10 0x7f539c09e4c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f539800c000 tx=0x7f5398006dc0).stop 2021-01-03T13:01:33.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.107+0000 7f53a2fef700 1 -- 172.21.15.133:0/3631560281 shutdown_connections 2021-01-03T13:01:33.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.107+0000 7f53a2fef700 1 --2- 172.21.15.133:0/3631560281 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f537c055350 0x7f537c057810 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:33.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.107+0000 7f53a2fef700 1 --2- 172.21.15.133:0/3631560281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f539c0b4c20 0x7f539c142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:33.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.107+0000 7f53a2fef700 1 --2- 172.21.15.133:0/3631560281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f539c05fd10 0x7f539c09e4c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:33.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.107+0000 7f53a2fef700 1 --2- 172.21.15.133:0/3631560281 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f539c060510 0x7f539c1423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:33.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.107+0000 7f53a2fef700 1 -- 172.21.15.133:0/3631560281 >> 172.21.15.133:0/3631560281 conn(0x7f539c0b9f00 msgr2=0x7f539c0b3900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:33.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.107+0000 7f53a2fef700 1 -- 172.21.15.133:0/3631560281 shutdown_connections 2021-01-03T13:01:33.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.107+0000 7f53a2fef700 1 -- 172.21.15.133:0/3631560281 wait complete. 2021-01-03T13:01:33.121 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-01-03T13:01:33.122 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-01-03T13:01:33.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.235+0000 7f9bbd33e700 1 Processor -- start 2021-01-03T13:01:33.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.235+0000 7f9bbd33e700 1 -- start start 2021-01-03T13:01:33.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bbd33e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9bb8060510 0x7f9bb805c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:33.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bbd33e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9bb805fd10 0x7f9bb80b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:33.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bbd33e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb805bf00 con 0x7f9bb80b4c20 2021-01-03T13:01:33.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bbd33e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb805c1a0 con 0x7f9bb805fd10 2021-01-03T13:01:33.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bbd33e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb805c440 con 0x7f9bb8060510 2021-01-03T13:01:33.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bb77fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9bb8060510 0x7f9bb805c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:33.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bb77fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9bb8060510 0x7f9bb805c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:42614/0 (socket says 172.21.15.133:42614) 2021-01-03T13:01:33.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bb77fe700 1 -- 172.21.15.133:0/3201130488 learned_addr learned my addr 172.21.15.133:0/3201130488 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:33.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bbcb3d700 1 --2- 172.21.15.133:0/3201130488 >> v2:172.21.15.16:3300/0 conn(0x7f9bb805fd10 0x7f9bb80b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:33.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bb77fe700 1 -- 172.21.15.133:0/3201130488 >> v2:172.21.15.16:3300/0 conn(0x7f9bb805fd10 msgr2=0x7f9bb80b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:33.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bb77fe700 1 --2- 172.21.15.133:0/3201130488 >> v2:172.21.15.16:3300/0 conn(0x7f9bb805fd10 0x7f9bb80b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:33.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bb77fe700 1 -- 172.21.15.133:0/3201130488 >> v1:172.21.15.16:6789/0 conn(0x7f9bb80b4c20 legacy=0x7f9bb80b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:33.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bb77fe700 1 -- 172.21.15.133:0/3201130488 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb80b6ad0 con 0x7f9bb8060510 2021-01-03T13:01:33.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bb77fe700 1 --2- 172.21.15.133:0/3201130488 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9bb8060510 0x7f9bb805c8e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f9ba8002f30 tx=0x7f9ba8006e80).ready entity=mon.2 client_cookie=228d7ce463cf6ca5 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:33.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bb6ffd700 1 -- 172.21.15.133:0/3201130488 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ba80097f0 con 0x7f9bb8060510 2021-01-03T13:01:33.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bb6ffd700 1 -- 172.21.15.133:0/3201130488 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba8009950 con 0x7f9bb8060510 2021-01-03T13:01:33.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bb6ffd700 1 -- 172.21.15.133:0/3201130488 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ba8009cb0 con 0x7f9bb8060510 2021-01-03T13:01:33.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bbd33e700 1 -- 172.21.15.133:0/3201130488 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9bb8060510 msgr2=0x7f9bb805c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:33.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bbd33e700 1 --2- 172.21.15.133:0/3201130488 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9bb8060510 0x7f9bb805c8e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f9ba8002f30 tx=0x7f9ba8006e80).stop 2021-01-03T13:01:33.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bbd33e700 1 -- 172.21.15.133:0/3201130488 shutdown_connections 2021-01-03T13:01:33.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bbd33e700 1 --2- 172.21.15.133:0/3201130488 >> v2:172.21.15.16:3300/0 conn(0x7f9bb805fd10 0x7f9bb80b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:33.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bbd33e700 1 --2- 172.21.15.133:0/3201130488 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9bb8060510 0x7f9bb805c8e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:33.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bbd33e700 1 -- 172.21.15.133:0/3201130488 >> 172.21.15.133:0/3201130488 conn(0x7f9bb80b9f00 msgr2=0x7f9bb80b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:33.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bbd33e700 1 -- 172.21.15.133:0/3201130488 shutdown_connections 2021-01-03T13:01:33.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.239+0000 7f9bbd33e700 1 -- 172.21.15.133:0/3201130488 wait complete. 2021-01-03T13:01:33.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bbd33e700 1 Processor -- start 2021-01-03T13:01:33.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bbd33e700 1 -- start start 2021-01-03T13:01:33.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bbd33e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bb805fd10 0x7f9bb809ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:33.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bbd33e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8060510 0x7f9bb8090750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:33.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bbd33e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9bb80b4c20 0x7f9bb813a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:33.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bbd33e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb8090c40 con 0x7f9bb805fd10 2021-01-03T13:01:33.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bbd33e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80b1c30 con 0x7f9bb8060510 2021-01-03T13:01:33.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bbd33e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80921c0 con 0x7f9bb80b4c20 2021-01-03T13:01:33.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bb77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8060510 0x7f9bb8090750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:33.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bb77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8060510 0x7f9bb8090750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34318/0 (socket says 172.21.15.133:34318) 2021-01-03T13:01:33.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bb77fe700 1 -- 172.21.15.133:0/3235759606 learned_addr learned my addr 172.21.15.133:0/3235759606 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:33.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bbcb3d700 1 --2- 172.21.15.133:0/3235759606 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9bb80b4c20 0x7f9bb813a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:33.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bb7fff700 1 --2- 172.21.15.133:0/3235759606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bb805fd10 0x7f9bb809ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:33.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bb77fe700 1 -- 172.21.15.133:0/3235759606 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9bb80b4c20 msgr2=0x7f9bb813a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:33.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bb77fe700 1 --2- 172.21.15.133:0/3235759606 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9bb80b4c20 0x7f9bb813a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:33.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bb77fe700 1 -- 172.21.15.133:0/3235759606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bb805fd10 msgr2=0x7f9bb809ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:33.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bb77fe700 1 --2- 172.21.15.133:0/3235759606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bb805fd10 0x7f9bb809ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:33.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bb77fe700 1 -- 172.21.15.133:0/3235759606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb8092460 con 0x7f9bb8060510 2021-01-03T13:01:33.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bb77fe700 1 --2- 172.21.15.133:0/3235759606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8060510 0x7f9bb8090750 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f9ba8002f30 tx=0x7f9ba8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:33.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bb57fa700 1 -- 172.21.15.133:0/3235759606 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ba8011c30 con 0x7f9bb8060510 2021-01-03T13:01:33.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bb57fa700 1 -- 172.21.15.133:0/3235759606 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba8011d90 con 0x7f9bb8060510 2021-01-03T13:01:33.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bbd33e700 1 -- 172.21.15.133:0/3235759606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb8092700 con 0x7f9bb8060510 2021-01-03T13:01:33.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bb57fa700 1 -- 172.21.15.133:0/3235759606 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ba801e650 con 0x7f9bb8060510 2021-01-03T13:01:33.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.243+0000 7f9bbd33e700 1 -- 172.21.15.133:0/3235759606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb80b3df0 con 0x7f9bb8060510 2021-01-03T13:01:33.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.247+0000 7f9bbd33e700 1 -- 172.21.15.133:0/3235759606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb8057300 con 0x7f9bb8060510 2021-01-03T13:01:33.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.247+0000 7f9bb57fa700 1 -- 172.21.15.133:0/3235759606 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9ba8025030 con 0x7f9bb8060510 2021-01-03T13:01:33.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.247+0000 7f9bb57fa700 1 --2- 172.21.15.133:0/3235759606 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9b980553b0 0x7f9b98057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:33.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.247+0000 7f9bb7fff700 1 --2- 172.21.15.133:0/3235759606 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9b980553b0 0x7f9b98057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:33.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.247+0000 7f9bb57fa700 1 -- 172.21.15.133:0/3235759606 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9ba806efb0 con 0x7f9bb8060510 2021-01-03T13:01:33.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.247+0000 7f9bb7fff700 1 --2- 172.21.15.133:0/3235759606 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9b980553b0 0x7f9b98057870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f9bac00b000 tx=0x7f9bac009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:33.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.251+0000 7f9bb57fa700 1 -- 172.21.15.133:0/3235759606 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9ba8045550 con 0x7f9bb8060510 2021-01-03T13:01:33.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:33.391+0000 7f9bbd33e700 1 -- 172.21.15.133:0/3235759606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f9bb8067a00 con 0x7f9bb8060510 2021-01-03T13:01:34.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.127+0000 7f9bb57fa700 1 -- 172.21.15.133:0/3235759606 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v51) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9ba8048b30 con 0x7f9bb8060510 2021-01-03T13:01:34.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.131+0000 7f9bbd33e700 1 -- 172.21.15.133:0/3235759606 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9b980553b0 msgr2=0x7f9b98057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:34.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.131+0000 7f9bbd33e700 1 --2- 172.21.15.133:0/3235759606 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9b980553b0 0x7f9b98057870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f9bac00b000 tx=0x7f9bac009040).stop 2021-01-03T13:01:34.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.131+0000 7f9bbd33e700 1 -- 172.21.15.133:0/3235759606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8060510 msgr2=0x7f9bb8090750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:34.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.131+0000 7f9bbd33e700 1 --2- 172.21.15.133:0/3235759606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8060510 0x7f9bb8090750 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f9ba8002f30 tx=0x7f9ba8015000).stop 2021-01-03T13:01:34.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.131+0000 7f9bbd33e700 1 -- 172.21.15.133:0/3235759606 shutdown_connections 2021-01-03T13:01:34.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.131+0000 7f9bbd33e700 1 --2- 172.21.15.133:0/3235759606 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9b980553b0 0x7f9b98057870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.131+0000 7f9bbd33e700 1 --2- 172.21.15.133:0/3235759606 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bb805fd10 0x7f9bb809ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.131+0000 7f9bbd33e700 1 --2- 172.21.15.133:0/3235759606 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9bb80b4c20 0x7f9bb813a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.131+0000 7f9bbd33e700 1 --2- 172.21.15.133:0/3235759606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8060510 0x7f9bb8090750 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.131+0000 7f9bbd33e700 1 -- 172.21.15.133:0/3235759606 >> 172.21.15.133:0/3235759606 conn(0x7f9bb80b9f00 msgr2=0x7f9bb809c720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:34.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.131+0000 7f9bbd33e700 1 -- 172.21.15.133:0/3235759606 shutdown_connections 2021-01-03T13:01:34.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.131+0000 7f9bbd33e700 1 -- 172.21.15.133:0/3235759606 wait complete. 2021-01-03T13:01:34.131 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2021-01-03T13:01:34.144 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-01-03T13:01:34.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.267+0000 7f059209c700 1 Processor -- start 2021-01-03T13:01:34.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.267+0000 7f059209c700 1 -- start start 2021-01-03T13:01:34.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f059209c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f058c0b2990 0x7f058c146300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:34.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f059209c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f058c0b34e0 0x7f058c140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:34.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f059209c700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058c1467f0 con 0x7f058c0b7ab0 2021-01-03T13:01:34.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f059209c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058c0b30f0 con 0x7f058c0b34e0 2021-01-03T13:01:34.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f059209c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058c061480 con 0x7f058c0b2990 2021-01-03T13:01:34.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f0590899700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f058c0b2990 0x7f058c146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:34.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f0590899700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f058c0b2990 0x7f058c146300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34326/0 (socket says 172.21.15.133:34326) 2021-01-03T13:01:34.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f0590899700 1 -- 172.21.15.133:0/2074888082 learned_addr learned my addr 172.21.15.133:0/2074888082 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:34.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f059189b700 1 --2- 172.21.15.133:0/2074888082 >> v2:172.21.15.16:3300/0 conn(0x7f058c0b34e0 0x7f058c140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:34.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f0590899700 1 -- 172.21.15.133:0/2074888082 >> v2:172.21.15.16:3300/0 conn(0x7f058c0b34e0 msgr2=0x7f058c140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:34.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f0590899700 1 --2- 172.21.15.133:0/2074888082 >> v2:172.21.15.16:3300/0 conn(0x7f058c0b34e0 0x7f058c140060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f0590899700 1 -- 172.21.15.133:0/2074888082 >> v1:172.21.15.16:6789/0 conn(0x7f058c0b7ab0 legacy=0x7f058c0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:34.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f0590899700 1 -- 172.21.15.133:0/2074888082 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c061720 con 0x7f058c0b2990 2021-01-03T13:01:34.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f0590899700 1 --2- 172.21.15.133:0/2074888082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c0b2990 0x7f058c146300 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f0580002f30 tx=0x7f0580006e20).ready entity=mon.1 client_cookie=e8dfb35249708cb5 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:34.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f057ffff700 1 -- 172.21.15.133:0/2074888082 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0580009960 con 0x7f058c0b2990 2021-01-03T13:01:34.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f057ffff700 1 -- 172.21.15.133:0/2074888082 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0580009ac0 con 0x7f058c0b2990 2021-01-03T13:01:34.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f057ffff700 1 -- 172.21.15.133:0/2074888082 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0580009e20 con 0x7f058c0b2990 2021-01-03T13:01:34.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f059209c700 1 -- 172.21.15.133:0/2074888082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c0b2990 msgr2=0x7f058c146300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:34.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f059209c700 1 --2- 172.21.15.133:0/2074888082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c0b2990 0x7f058c146300 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f0580002f30 tx=0x7f0580006e20).stop 2021-01-03T13:01:34.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f059209c700 1 -- 172.21.15.133:0/2074888082 shutdown_connections 2021-01-03T13:01:34.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f059209c700 1 --2- 172.21.15.133:0/2074888082 >> v2:172.21.15.16:3300/0 conn(0x7f058c0b34e0 0x7f058c140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f059209c700 1 --2- 172.21.15.133:0/2074888082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c0b2990 0x7f058c146300 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f059209c700 1 -- 172.21.15.133:0/2074888082 >> 172.21.15.133:0/2074888082 conn(0x7f058c05c8c0 msgr2=0x7f058c0b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:34.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f059209c700 1 -- 172.21.15.133:0/2074888082 shutdown_connections 2021-01-03T13:01:34.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.271+0000 7f059209c700 1 -- 172.21.15.133:0/2074888082 wait complete. 2021-01-03T13:01:34.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f059209c700 1 Processor -- start 2021-01-03T13:01:34.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f059209c700 1 -- start start 2021-01-03T13:01:34.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f059209c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c0b2990 0x7f058c0b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:34.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f059209c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f058c0b34e0 0x7f058c0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:34.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f059209c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f058c0b7ab0 0x7f058c151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:34.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f059209c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c13ac40 con 0x7f058c0b34e0 2021-01-03T13:01:34.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f059209c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c13bd90 con 0x7f058c0b2990 2021-01-03T13:01:34.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f059209c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0b7610 con 0x7f058c0b7ab0 2021-01-03T13:01:34.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f059109a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c0b2990 0x7f058c0b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:34.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f059109a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c0b2990 0x7f058c0b5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34330/0 (socket says 172.21.15.133:34330) 2021-01-03T13:01:34.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f059109a700 1 -- 172.21.15.133:0/3068769745 learned_addr learned my addr 172.21.15.133:0/3068769745 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:34.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f0590899700 1 --2- 172.21.15.133:0/3068769745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f058c0b34e0 0x7f058c0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:34.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f059189b700 1 --2- 172.21.15.133:0/3068769745 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f058c0b7ab0 0x7f058c151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:34.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f059109a700 1 -- 172.21.15.133:0/3068769745 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f058c0b7ab0 msgr2=0x7f058c151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:34.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f059109a700 1 --2- 172.21.15.133:0/3068769745 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f058c0b7ab0 0x7f058c151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f059109a700 1 -- 172.21.15.133:0/3068769745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f058c0b34e0 msgr2=0x7f058c0b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:34.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f059109a700 1 --2- 172.21.15.133:0/3068769745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f058c0b34e0 0x7f058c0b7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.275+0000 7f059109a700 1 -- 172.21.15.133:0/3068769745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c148d50 con 0x7f058c0b2990 2021-01-03T13:01:34.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.279+0000 7f059109a700 1 --2- 172.21.15.133:0/3068769745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c0b2990 0x7f058c0b5860 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f058c0b33c0 tx=0x7f0588007c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:34.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.279+0000 7f057e7fc700 1 -- 172.21.15.133:0/3068769745 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0588013410 con 0x7f058c0b2990 2021-01-03T13:01:34.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.279+0000 7f057e7fc700 1 -- 172.21.15.133:0/3068769745 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0588013570 con 0x7f058c0b2990 2021-01-03T13:01:34.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.279+0000 7f059209c700 1 -- 172.21.15.133:0/3068769745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c064970 con 0x7f058c0b2990 2021-01-03T13:01:34.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.279+0000 7f057e7fc700 1 -- 172.21.15.133:0/3068769745 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05880138d0 con 0x7f058c0b2990 2021-01-03T13:01:34.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.279+0000 7f059209c700 1 -- 172.21.15.133:0/3068769745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c13b750 con 0x7f058c0b2990 2021-01-03T13:01:34.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.279+0000 7f059209c700 1 -- 172.21.15.133:0/3068769745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058c13adb0 con 0x7f058c0b2990 2021-01-03T13:01:34.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.279+0000 7f057e7fc700 1 -- 172.21.15.133:0/3068769745 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0588010030 con 0x7f058c0b2990 2021-01-03T13:01:34.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.279+0000 7f057e7fc700 1 --2- 172.21.15.133:0/3068769745 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0574055470 0x7f0574057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:34.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.279+0000 7f057e7fc700 1 -- 172.21.15.133:0/3068769745 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f058806da30 con 0x7f058c0b2990 2021-01-03T13:01:34.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.279+0000 7f0590899700 1 --2- 172.21.15.133:0/3068769745 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0574055470 0x7f0574057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:34.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.279+0000 7f0590899700 1 --2- 172.21.15.133:0/3068769745 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0574055470 0x7f0574057930 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f058001b000 tx=0x7f0580015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:34.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.287+0000 7f057e7fc700 1 -- 172.21.15.133:0/3068769745 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0588043f00 con 0x7f058c0b2990 2021-01-03T13:01:34.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.427+0000 7f059209c700 1 -- 172.21.15.133:0/3068769745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f058c057300 con 0x7f058c0b2990 2021-01-03T13:01:34.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.611+0000 7f057e7fc700 1 -- 172.21.15.133:0/3068769745 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v52) v1 ==== 125+0+0 (secure 0 0 0) 0x7f0588047520 con 0x7f058c0b2990 2021-01-03T13:01:34.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.619+0000 7f059209c700 1 -- 172.21.15.133:0/3068769745 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0574055470 msgr2=0x7f0574057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:34.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.619+0000 7f059209c700 1 --2- 172.21.15.133:0/3068769745 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0574055470 0x7f0574057930 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f058001b000 tx=0x7f0580015000).stop 2021-01-03T13:01:34.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.619+0000 7f059209c700 1 -- 172.21.15.133:0/3068769745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c0b2990 msgr2=0x7f058c0b5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:34.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.619+0000 7f059209c700 1 --2- 172.21.15.133:0/3068769745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c0b2990 0x7f058c0b5860 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f058c0b33c0 tx=0x7f0588007c20).stop 2021-01-03T13:01:34.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.619+0000 7f059209c700 1 -- 172.21.15.133:0/3068769745 shutdown_connections 2021-01-03T13:01:34.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.619+0000 7f059209c700 1 --2- 172.21.15.133:0/3068769745 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0574055470 0x7f0574057930 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.619+0000 7f059209c700 1 --2- 172.21.15.133:0/3068769745 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f058c0b7ab0 0x7f058c151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.619+0000 7f059209c700 1 --2- 172.21.15.133:0/3068769745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f058c0b2990 0x7f058c0b5860 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.619+0000 7f059209c700 1 --2- 172.21.15.133:0/3068769745 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f058c0b34e0 0x7f058c0b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.619+0000 7f059209c700 1 -- 172.21.15.133:0/3068769745 >> 172.21.15.133:0/3068769745 conn(0x7f058c05c8c0 msgr2=0x7f058c146980 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:34.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.619+0000 7f059209c700 1 -- 172.21.15.133:0/3068769745 shutdown_connections 2021-01-03T13:01:34.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.619+0000 7f059209c700 1 -- 172.21.15.133:0/3068769745 wait complete. 2021-01-03T13:01:34.620 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2021-01-03T13:01:34.629 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-01-03T13:01:34.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.743+0000 7f754b010700 1 Processor -- start 2021-01-03T13:01:34.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.743+0000 7f754b010700 1 -- start start 2021-01-03T13:01:34.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754b010700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f75440677a0 0x7f75440ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:34.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754b010700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f754405c670 0x7f75440b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:34.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754b010700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7544146320 0x7f75440a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:34.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754b010700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75440ace10 con 0x7f75440677a0 2021-01-03T13:01:34.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754b010700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7544140ae0 con 0x7f7544146320 2021-01-03T13:01:34.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754b010700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7544067b80 con 0x7f754405c670 2021-01-03T13:01:34.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754a80f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7544146320 0x7f75440a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:34.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754a80f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7544146320 0x7f75440a8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34342/0 (socket says 172.21.15.133:34342) 2021-01-03T13:01:34.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754a80f700 1 -- 172.21.15.133:0/642933562 learned_addr learned my addr 172.21.15.133:0/642933562 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:34.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754a00e700 1 --2- 172.21.15.133:0/642933562 >> v2:172.21.15.16:3300/0 conn(0x7f75440677a0 0x7f75440ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:34.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754980d700 1 --2- 172.21.15.133:0/642933562 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f754405c670 0x7f75440b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:34.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754a80f700 1 -- 172.21.15.133:0/642933562 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f754405c670 msgr2=0x7f75440b1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:34.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754a80f700 1 --2- 172.21.15.133:0/642933562 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f754405c670 0x7f75440b1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754a80f700 1 -- 172.21.15.133:0/642933562 >> v2:172.21.15.16:3300/0 conn(0x7f75440677a0 msgr2=0x7f75440ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:34.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754a80f700 1 --2- 172.21.15.133:0/642933562 >> v2:172.21.15.16:3300/0 conn(0x7f75440677a0 0x7f75440ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754a80f700 1 -- 172.21.15.133:0/642933562 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75440b1560 con 0x7f7544146320 2021-01-03T13:01:34.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754980d700 1 --2- 172.21.15.133:0/642933562 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f754405c670 0x7f75440b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:01:34.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754a80f700 1 --2- 172.21.15.133:0/642933562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7544146320 0x7f75440a8a80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f753c003300 tx=0x7f753c009250).ready entity=mon.1 client_cookie=6dfa3631d410f982 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:34.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754900c700 1 -- 172.21.15.133:0/642933562 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f753c00ba50 con 0x7f7544146320 2021-01-03T13:01:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754900c700 1 -- 172.21.15.133:0/642933562 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c00bbb0 con 0x7f7544146320 2021-01-03T13:01:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754900c700 1 -- 172.21.15.133:0/642933562 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f753c00bd20 con 0x7f7544146320 2021-01-03T13:01:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754b010700 1 -- 172.21.15.133:0/642933562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7544146320 msgr2=0x7f75440a8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:34.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754b010700 1 --2- 172.21.15.133:0/642933562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7544146320 0x7f75440a8a80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f753c003300 tx=0x7f753c009250).stop 2021-01-03T13:01:34.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754b010700 1 -- 172.21.15.133:0/642933562 shutdown_connections 2021-01-03T13:01:34.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754b010700 1 --2- 172.21.15.133:0/642933562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7544146320 0x7f75440a8a80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754b010700 1 --2- 172.21.15.133:0/642933562 >> v2:172.21.15.16:3300/0 conn(0x7f75440677a0 0x7f75440ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754b010700 1 --2- 172.21.15.133:0/642933562 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f754405c670 0x7f75440b1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754b010700 1 -- 172.21.15.133:0/642933562 >> 172.21.15.133:0/642933562 conn(0x7f754406b050 msgr2=0x7f7544060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:34.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754b010700 1 -- 172.21.15.133:0/642933562 shutdown_connections 2021-01-03T13:01:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.747+0000 7f754b010700 1 -- 172.21.15.133:0/642933562 wait complete. 2021-01-03T13:01:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.751+0000 7f754b010700 1 Processor -- start 2021-01-03T13:01:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.751+0000 7f754b010700 1 -- start start 2021-01-03T13:01:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.751+0000 7f754b010700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f754405c670 0x7f754413f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.751+0000 7f754b010700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75440677a0 0x7f75440a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:34.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.751+0000 7f754b010700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7544146320 0x7f7544142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:34.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.751+0000 7f754b010700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754409fdd0 con 0x7f7544146320 2021-01-03T13:01:34.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.751+0000 7f754b010700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7544142870 con 0x7f75440677a0 2021-01-03T13:01:34.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.751+0000 7f754b010700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75441416e0 con 0x7f754405c670 2021-01-03T13:01:34.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f754980d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75440677a0 0x7f75440a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:34.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f754980d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75440677a0 0x7f75440a0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34346/0 (socket says 172.21.15.133:34346) 2021-01-03T13:01:34.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f754980d700 1 -- 172.21.15.133:0/3766256245 learned_addr learned my addr 172.21.15.133:0/3766256245 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:34.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f754a00e700 1 --2- 172.21.15.133:0/3766256245 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f754405c670 0x7f754413f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:34.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f754a80f700 1 --2- 172.21.15.133:0/3766256245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7544146320 0x7f7544142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:34.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f754980d700 1 -- 172.21.15.133:0/3766256245 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f754405c670 msgr2=0x7f754413f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:34.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f754980d700 1 --2- 172.21.15.133:0/3766256245 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f754405c670 0x7f754413f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f754980d700 1 -- 172.21.15.133:0/3766256245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7544146320 msgr2=0x7f7544142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:34.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f754980d700 1 --2- 172.21.15.133:0/3766256245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7544146320 0x7f7544142f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f754980d700 1 -- 172.21.15.133:0/3766256245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7544141980 con 0x7f75440677a0 2021-01-03T13:01:34.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f754980d700 1 --2- 172.21.15.133:0/3766256245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75440677a0 0x7f75440a0460 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f753400a000 tx=0x7f7534008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:34.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f75337fe700 1 -- 172.21.15.133:0/3766256245 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7534009980 con 0x7f75440677a0 2021-01-03T13:01:34.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f75337fe700 1 -- 172.21.15.133:0/3766256245 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7534009ae0 con 0x7f75440677a0 2021-01-03T13:01:34.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f754b010700 1 -- 172.21.15.133:0/3766256245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7544141c20 con 0x7f75440677a0 2021-01-03T13:01:34.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f75337fe700 1 -- 172.21.15.133:0/3766256245 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7534009e40 con 0x7f75440677a0 2021-01-03T13:01:34.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f754b010700 1 -- 172.21.15.133:0/3766256245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7544143430 con 0x7f75440677a0 2021-01-03T13:01:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f75337fe700 1 -- 172.21.15.133:0/3766256245 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7534013480 con 0x7f75440677a0 2021-01-03T13:01:34.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.755+0000 7f754b010700 1 -- 172.21.15.133:0/3766256245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7544057300 con 0x7f75440677a0 2021-01-03T13:01:34.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.759+0000 7f75337fe700 1 --2- 172.21.15.133:0/3766256245 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7524055350 0x7f7524057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:34.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.759+0000 7f75337fe700 1 -- 172.21.15.133:0/3766256245 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f753406e620 con 0x7f75440677a0 2021-01-03T13:01:34.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.759+0000 7f754a00e700 1 --2- 172.21.15.133:0/3766256245 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7524055350 0x7f7524057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:34.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.759+0000 7f754a00e700 1 --2- 172.21.15.133:0/3766256245 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7524055350 0x7f7524057810 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f754000b000 tx=0x7f7540006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:34.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.763+0000 7f75337fe700 1 -- 172.21.15.133:0/3766256245 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7534044890 con 0x7f75440677a0 2021-01-03T13:01:34.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.951+0000 7f754b010700 1 -- 172.21.15.133:0/3766256245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f754405f080 con 0x7f75440677a0 2021-01-03T13:01:34.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.963+0000 7f75337fe700 1 -- 172.21.15.133:0/3766256245 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 9 and data pool 10 v20) v1 ==== 188+0+0 (secure 0 0 0) 0x7f753406ce60 con 0x7f75440677a0 2021-01-03T13:01:34.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.971+0000 7f754b010700 1 -- 172.21.15.133:0/3766256245 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7524055350 msgr2=0x7f7524057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:34.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.971+0000 7f754b010700 1 --2- 172.21.15.133:0/3766256245 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7524055350 0x7f7524057810 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f754000b000 tx=0x7f7540006dc0).stop 2021-01-03T13:01:34.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.971+0000 7f754b010700 1 -- 172.21.15.133:0/3766256245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75440677a0 msgr2=0x7f75440a0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:34.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.971+0000 7f754b010700 1 --2- 172.21.15.133:0/3766256245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75440677a0 0x7f75440a0460 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f753400a000 tx=0x7f7534008040).stop 2021-01-03T13:01:34.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.971+0000 7f754b010700 1 -- 172.21.15.133:0/3766256245 shutdown_connections 2021-01-03T13:01:34.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.971+0000 7f754b010700 1 --2- 172.21.15.133:0/3766256245 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7524055350 0x7f7524057810 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.971+0000 7f754b010700 1 --2- 172.21.15.133:0/3766256245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7544146320 0x7f7544142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.971+0000 7f754b010700 1 --2- 172.21.15.133:0/3766256245 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f754405c670 0x7f754413f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.971+0000 7f754b010700 1 --2- 172.21.15.133:0/3766256245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75440677a0 0x7f75440a0460 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:34.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.971+0000 7f754b010700 1 -- 172.21.15.133:0/3766256245 >> 172.21.15.133:0/3766256245 conn(0x7f754406b050 msgr2=0x7f754413da30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:34.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.971+0000 7f754b010700 1 -- 172.21.15.133:0/3766256245 shutdown_connections 2021-01-03T13:01:34.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:34.971+0000 7f754b010700 1 -- 172.21.15.133:0/3766256245 wait complete. 2021-01-03T13:01:34.971 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 9 and data pool 10 2021-01-03T13:01:34.984 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:01:35.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.087+0000 7f3b19398700 1 Processor -- start 2021-01-03T13:01:35.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.087+0000 7f3b19398700 1 -- start start 2021-01-03T13:01:35.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.087+0000 7f3b19398700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3b1405c840 0x7f3b140af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.087+0000 7f3b19398700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1405cc20 con 0x7f3b140afa70 2021-01-03T13:01:35.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.087+0000 7f3b19398700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b140ad2d0 con 0x7f3b1413f960 2021-01-03T13:01:35.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.087+0000 7f3b19398700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b140b18e0 con 0x7f3b1405c840 2021-01-03T13:01:35.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.087+0000 7f3b137fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3b1413f960 0x7f3b14138c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55398/0 (socket says 172.21.15.133:55398) 2021-01-03T13:01:35.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.087+0000 7f3b137fe700 1 -- 172.21.15.133:0/3475765610 learned_addr learned my addr 172.21.15.133:0/3475765610 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:35.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.087+0000 7f3b12ffd700 1 --2- 172.21.15.133:0/3475765610 >> v2:172.21.15.16:3300/0 conn(0x7f3b1405c840 0x7f3b140af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.087+0000 7f3b127fc700 1 -- 172.21.15.133:0/3475765610 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618381014 0 0) 0x7f3b140ad2d0 con 0x7f3b1413f960 2021-01-03T13:01:35.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.087+0000 7f3b127fc700 1 -- 172.21.15.133:0/3475765610 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3af4003230 con 0x7f3b1413f960 2021-01-03T13:01:35.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b127fc700 1 -- 172.21.15.133:0/3475765610 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 233420667 0 0) 0x7f3af4003230 con 0x7f3b1413f960 2021-01-03T13:01:35.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b127fc700 1 -- 172.21.15.133:0/3475765610 >> v2:172.21.15.16:3300/0 conn(0x7f3b1405c840 msgr2=0x7f3b140af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:35.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b127fc700 1 --2- 172.21.15.133:0/3475765610 >> v2:172.21.15.16:3300/0 conn(0x7f3b1405c840 0x7f3b140af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b127fc700 1 -- 172.21.15.133:0/3475765610 >> v1:172.21.15.16:6789/0 conn(0x7f3b140afa70 legacy=0x7f3b1413f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b127fc700 1 -- 172.21.15.133:0/3475765610 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b140ad570 con 0x7f3b1413f960 2021-01-03T13:01:35.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b127fc700 1 -- 172.21.15.133:0/3475765610 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f3b0c001a50 con 0x7f3b1413f960 2021-01-03T13:01:35.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b127fc700 1 -- 172.21.15.133:0/3475765610 >> v1:172.21.15.133:6789/0 conn(0x7f3b1413f960 legacy=0x7f3b14138c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b127fc700 1 --2- 172.21.15.133:0/3475765610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3af4003750 0x7f3af4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b127fc700 1 --2- 172.21.15.133:0/3475765610 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3af40044d0 0x7f3af4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b127fc700 1 --2- 172.21.15.133:0/3475765610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3af4004e40 0x7f3af400d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b127fc700 1 -- 172.21.15.133:0/3475765610 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af4004280 con 0x7f3af4003750 2021-01-03T13:01:35.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b127fc700 1 -- 172.21.15.133:0/3475765610 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af400de20 con 0x7f3af4004e40 2021-01-03T13:01:35.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b127fc700 1 -- 172.21.15.133:0/3475765610 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af400df60 con 0x7f3af40044d0 2021-01-03T13:01:35.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b137fe700 1 --2- 172.21.15.133:0/3475765610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3af4004e40 0x7f3af400d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b12ffd700 1 --2- 172.21.15.133:0/3475765610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3af4003750 0x7f3af4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b0bfff700 1 --2- 172.21.15.133:0/3475765610 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3af40044d0 0x7f3af4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b137fe700 1 -- 172.21.15.133:0/3475765610 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3af40044d0 msgr2=0x7f3af4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:35.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b137fe700 1 --2- 172.21.15.133:0/3475765610 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3af40044d0 0x7f3af4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b137fe700 1 -- 172.21.15.133:0/3475765610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3af4003750 msgr2=0x7f3af4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:35.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b137fe700 1 --2- 172.21.15.133:0/3475765610 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3af4003750 0x7f3af4003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b137fe700 1 -- 172.21.15.133:0/3475765610 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af4003230 con 0x7f3af4004e40 2021-01-03T13:01:35.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b137fe700 1 -- 172.21.15.133:0/3475765610 reap_dead start 2021-01-03T13:01:35.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b137fe700 1 --2- 172.21.15.133:0/3475765610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3af4004e40 0x7f3af400d930 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f3af4004440 tx=0x7f3b140ad460).ready entity=mon.1 client_cookie=359634a35a5d67a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:35.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b127fc700 1 -- 172.21.15.133:0/3475765610 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b0c005c40 con 0x7f3af4004e40 2021-01-03T13:01:35.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b127fc700 1 -- 172.21.15.133:0/3475765610 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c005da0 con 0x7f3af4004e40 2021-01-03T13:01:35.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b127fc700 1 -- 172.21.15.133:0/3475765610 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b0c0072c0 con 0x7f3af4004e40 2021-01-03T13:01:35.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b19398700 1 -- 172.21.15.133:0/3475765610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3af4004e40 msgr2=0x7f3af400d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b19398700 1 --2- 172.21.15.133:0/3475765610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3af4004e40 0x7f3af400d930 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f3af4004440 tx=0x7f3b140ad460).stop 2021-01-03T13:01:35.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b19398700 1 -- 172.21.15.133:0/3475765610 shutdown_connections 2021-01-03T13:01:35.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b19398700 1 --2- 172.21.15.133:0/3475765610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3af4004e40 0x7f3af400d930 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b19398700 1 -- 172.21.15.133:0/3475765610 >> 172.21.15.133:0/3475765610 conn(0x7f3b1406aeb0 msgr2=0x7f3b1405bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:35.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b19398700 1 -- 172.21.15.133:0/3475765610 shutdown_connections 2021-01-03T13:01:35.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b19398700 1 -- 172.21.15.133:0/3475765610 wait complete. 2021-01-03T13:01:35.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b19398700 1 Processor -- start 2021-01-03T13:01:35.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.091+0000 7f3b19398700 1 -- start start 2021-01-03T13:01:35.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b19398700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3af4004e40 0x7f3b14140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b19398700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b14141640 0x7f3b14142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b19398700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b1413a700 0x7f3b14151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b19398700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14141e90 con 0x7f3b14141640 2021-01-03T13:01:35.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b19398700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b141420c0 con 0x7f3b1413a700 2021-01-03T13:01:35.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b19398700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14142360 con 0x7f3af4004e40 2021-01-03T13:01:35.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b137fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b1413a700 0x7f3b14151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b137fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b1413a700 0x7f3b14151370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34374/0 (socket says 172.21.15.133:34374) 2021-01-03T13:01:35.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b137fe700 1 -- 172.21.15.133:0/658864438 learned_addr learned my addr 172.21.15.133:0/658864438 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:35.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b0bfff700 1 --2- 172.21.15.133:0/658864438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b14141640 0x7f3b14142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b12ffd700 1 --2- 172.21.15.133:0/658864438 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3af4004e40 0x7f3b14140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b137fe700 1 -- 172.21.15.133:0/658864438 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3af4004e40 msgr2=0x7f3b14140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b137fe700 1 --2- 172.21.15.133:0/658864438 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3af4004e40 0x7f3b14140c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b137fe700 1 -- 172.21.15.133:0/658864438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b14141640 msgr2=0x7f3b14142d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b137fe700 1 --2- 172.21.15.133:0/658864438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b14141640 0x7f3b14142d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b137fe700 1 -- 172.21.15.133:0/658864438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b14142600 con 0x7f3b1413a700 2021-01-03T13:01:35.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b137fe700 1 --2- 172.21.15.133:0/658864438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b1413a700 0x7f3b14151370 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f3af4004440 tx=0x7f3b0c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:35.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b10ff9700 1 -- 172.21.15.133:0/658864438 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b0c013640 con 0x7f3b1413a700 2021-01-03T13:01:35.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b10ff9700 1 -- 172.21.15.133:0/658864438 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c001bd0 con 0x7f3b1413a700 2021-01-03T13:01:35.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b19398700 1 -- 172.21.15.133:0/658864438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b141428a0 con 0x7f3b1413a700 2021-01-03T13:01:35.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b10ff9700 1 -- 172.21.15.133:0/658864438 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b0c013990 con 0x7f3b1413a700 2021-01-03T13:01:35.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b19398700 1 -- 172.21.15.133:0/658864438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1413c5f0 con 0x7f3b1413a700 2021-01-03T13:01:35.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b19398700 1 -- 172.21.15.133:0/658864438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1413ad20 con 0x7f3b1413a700 2021-01-03T13:01:35.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b10ff9700 1 -- 172.21.15.133:0/658864438 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3b0c010070 con 0x7f3b1413a700 2021-01-03T13:01:35.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b10ff9700 1 --2- 172.21.15.133:0/658864438 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3af8055470 0x7f3af8057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.095+0000 7f3b10ff9700 1 -- 172.21.15.133:0/658864438 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3b0c06e160 con 0x7f3b1413a700 2021-01-03T13:01:35.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.099+0000 7f3b12ffd700 1 --2- 172.21.15.133:0/658864438 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3af8055470 0x7f3af8057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.099+0000 7f3b12ffd700 1 --2- 172.21.15.133:0/658864438 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3af8055470 0x7f3af8057930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f3b04008000 tx=0x7f3b04008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:35.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.103+0000 7f3b10ff9700 1 -- 172.21.15.133:0/658864438 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3b0c044460 con 0x7f3b1413a700 2021-01-03T13:01:35.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.243+0000 7f3b19398700 1 -- 172.21.15.133:0/658864438 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b14143230 con 0x7f3b1413a700 2021-01-03T13:01:35.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.247+0000 7f3b10ff9700 1 -- 172.21.15.133:0/658864438 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16114 (secure 0 0 0) 0x7f3b0c047a80 con 0x7f3b1413a700 2021-01-03T13:01:35.244 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:01:35.244 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":53,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:01:34.953281+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:01:33.451725+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-01-03T13:01:34.480032+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:01:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.247+0000 7f3b19398700 1 -- 172.21.15.133:0/658864438 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3af8055470 msgr2=0x7f3af8057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.247+0000 7f3b19398700 1 --2- 172.21.15.133:0/658864438 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3af8055470 0x7f3af8057930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f3b04008000 tx=0x7f3b04008040).stop 2021-01-03T13:01:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.247+0000 7f3b19398700 1 -- 172.21.15.133:0/658864438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b1413a700 msgr2=0x7f3b14151370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.247+0000 7f3b19398700 1 --2- 172.21.15.133:0/658864438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b1413a700 0x7f3b14151370 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f3af4004440 tx=0x7f3b0c015000).stop 2021-01-03T13:01:35.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.247+0000 7f3b19398700 1 -- 172.21.15.133:0/658864438 shutdown_connections 2021-01-03T13:01:35.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.247+0000 7f3b19398700 1 --2- 172.21.15.133:0/658864438 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3af8055470 0x7f3af8057930 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.247+0000 7f3b19398700 1 --2- 172.21.15.133:0/658864438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b1413a700 0x7f3b14151370 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.247+0000 7f3b19398700 1 --2- 172.21.15.133:0/658864438 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3af4004e40 0x7f3b14140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.247+0000 7f3b19398700 1 --2- 172.21.15.133:0/658864438 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b14141640 0x7f3b14142d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.247+0000 7f3b19398700 1 -- 172.21.15.133:0/658864438 >> 172.21.15.133:0/658864438 conn(0x7f3b1406aeb0 msgr2=0x7f3b1413f100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:35.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.247+0000 7f3b19398700 1 -- 172.21.15.133:0/658864438 shutdown_connections 2021-01-03T13:01:35.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.247+0000 7f3b19398700 1 -- 172.21.15.133:0/658864438 wait complete. 2021-01-03T13:01:35.259 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:01:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88368e9700 1 Processor -- start 2021-01-03T13:01:35.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88368e9700 1 -- start start 2021-01-03T13:01:35.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88368e9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f88300b1300 0x7f88301428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88368e9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88300b2050 0x7f88300a8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88368e9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88300afa40 con 0x7f88300b0c30 2021-01-03T13:01:35.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88368e9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88300b25d0 con 0x7f88300b2050 2021-01-03T13:01:35.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88368e9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88300b2870 con 0x7f88300b1300 2021-01-03T13:01:35.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88360e8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88300b2050 0x7f88300a8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88350e6700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f88300b0c30 0x7f88300ad4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55416/0 (socket says 172.21.15.133:55416) 2021-01-03T13:01:35.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88350e6700 1 -- 172.21.15.133:0/3218621924 learned_addr learned my addr 172.21.15.133:0/3218621924 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:35.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88360e8700 1 --2- 172.21.15.133:0/3218621924 >> v2:172.21.15.133:3300/0 conn(0x7f88300b2050 0x7f88300a8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34384/0 (socket says 172.21.15.133:34384) 2021-01-03T13:01:35.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88358e7700 1 --2- 172.21.15.133:0/3218621924 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f88300b1300 0x7f88301428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88360e8700 1 -- 172.21.15.133:0/3218621924 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f88300b1300 msgr2=0x7f88301428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:35.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88360e8700 1 --2- 172.21.15.133:0/3218621924 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f88300b1300 0x7f88301428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88360e8700 1 -- 172.21.15.133:0/3218621924 >> v1:172.21.15.133:6789/0 conn(0x7f88300b0c30 legacy=0x7f88300ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88348e5700 1 -- 172.21.15.133:0/3218621924 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442331323 0 0) 0x7f88300afa40 con 0x7f88300b0c30 2021-01-03T13:01:35.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88360e8700 1 -- 172.21.15.133:0/3218621924 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88300ad040 con 0x7f88300b2050 2021-01-03T13:01:35.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88360e8700 1 --2- 172.21.15.133:0/3218621924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88300b2050 0x7f88300a8850 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f8820002f30 tx=0x7f8820006dc0).ready entity=mon.1 client_cookie=6428d105d6c3eb12 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:35.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88348e5700 1 -- 172.21.15.133:0/3218621924 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8820009760 con 0x7f88300b2050 2021-01-03T13:01:35.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88348e5700 1 -- 172.21.15.133:0/3218621924 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88200098c0 con 0x7f88300b2050 2021-01-03T13:01:35.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88348e5700 1 -- 172.21.15.133:0/3218621924 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8820009c20 con 0x7f88300b2050 2021-01-03T13:01:35.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88368e9700 1 -- 172.21.15.133:0/3218621924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88300b2050 msgr2=0x7f88300a8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.371+0000 7f88368e9700 1 --2- 172.21.15.133:0/3218621924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88300b2050 0x7f88300a8850 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f8820002f30 tx=0x7f8820006dc0).stop 2021-01-03T13:01:35.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.375+0000 7f88368e9700 1 -- 172.21.15.133:0/3218621924 shutdown_connections 2021-01-03T13:01:35.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.375+0000 7f88368e9700 1 --2- 172.21.15.133:0/3218621924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88300b2050 0x7f88300a8850 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.375+0000 7f88368e9700 1 --2- 172.21.15.133:0/3218621924 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f88300b1300 0x7f88301428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.375+0000 7f88368e9700 1 -- 172.21.15.133:0/3218621924 >> 172.21.15.133:0/3218621924 conn(0x7f883006b050 msgr2=0x7f8830060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:35.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.375+0000 7f88368e9700 1 -- 172.21.15.133:0/3218621924 shutdown_connections 2021-01-03T13:01:35.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.375+0000 7f88368e9700 1 -- 172.21.15.133:0/3218621924 wait complete. 2021-01-03T13:01:35.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.375+0000 7f88368e9700 1 Processor -- start 2021-01-03T13:01:35.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.375+0000 7f88368e9700 1 -- start start 2021-01-03T13:01:35.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.375+0000 7f88368e9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88300b0c30 0x7f88301431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.375+0000 7f88368e9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f88300b1300 0x7f8830152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.375+0000 7f88368e9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88300b2050 0x7f8830139430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88368e9700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883013b1e0 con 0x7f88300b2050 2021-01-03T13:01:35.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88368e9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8830064e60 con 0x7f88300b0c30 2021-01-03T13:01:35.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88368e9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8830064400 con 0x7f88300b1300 2021-01-03T13:01:35.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88358e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88300b0c30 0x7f88301431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88358e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88300b0c30 0x7f88301431c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34388/0 (socket says 172.21.15.133:34388) 2021-01-03T13:01:35.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88358e7700 1 -- 172.21.15.133:0/1901803931 learned_addr learned my addr 172.21.15.133:0/1901803931 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:35.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88360e8700 1 --2- 172.21.15.133:0/1901803931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88300b2050 0x7f8830139430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88350e6700 1 --2- 172.21.15.133:0/1901803931 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f88300b1300 0x7f8830152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88358e7700 1 -- 172.21.15.133:0/1901803931 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f88300b1300 msgr2=0x7f8830152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88358e7700 1 --2- 172.21.15.133:0/1901803931 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f88300b1300 0x7f8830152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88358e7700 1 -- 172.21.15.133:0/1901803931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88300b2050 msgr2=0x7f8830139430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88358e7700 1 --2- 172.21.15.133:0/1901803931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88300b2050 0x7f8830139430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88358e7700 1 -- 172.21.15.133:0/1901803931 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830065090 con 0x7f88300b0c30 2021-01-03T13:01:35.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88358e7700 1 --2- 172.21.15.133:0/1901803931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88300b0c30 0x7f88301431c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f8830152f30 tx=0x7f88280091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f882effd700 1 -- 172.21.15.133:0/1901803931 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f882800cc70 con 0x7f88300b0c30 2021-01-03T13:01:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f882effd700 1 -- 172.21.15.133:0/1901803931 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882800cdd0 con 0x7f88300b0c30 2021-01-03T13:01:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88368e9700 1 -- 172.21.15.133:0/1901803931 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8830065330 con 0x7f88300b0c30 2021-01-03T13:01:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f882effd700 1 -- 172.21.15.133:0/1901803931 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f882801a660 con 0x7f88300b0c30 2021-01-03T13:01:35.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88368e9700 1 -- 172.21.15.133:0/1901803931 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8830065d30 con 0x7f88300b0c30 2021-01-03T13:01:35.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88368e9700 1 -- 172.21.15.133:0/1901803931 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8830066300 con 0x7f88300b0c30 2021-01-03T13:01:35.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f882effd700 1 -- 172.21.15.133:0/1901803931 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f882801a7c0 con 0x7f88300b0c30 2021-01-03T13:01:35.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f882effd700 1 --2- 172.21.15.133:0/1901803931 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8810055440 0x7f8810057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f882effd700 1 -- 172.21.15.133:0/1901803931 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8828070660 con 0x7f88300b0c30 2021-01-03T13:01:35.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88350e6700 1 --2- 172.21.15.133:0/1901803931 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8810055440 0x7f8810057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.379+0000 7f88350e6700 1 --2- 172.21.15.133:0/1901803931 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8810055440 0x7f8810057900 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f882400d000 tx=0x7f88240079d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:35.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.387+0000 7f882effd700 1 -- 172.21.15.133:0/1901803931 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8828046960 con 0x7f88300b0c30 2021-01-03T13:01:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.527+0000 7f88368e9700 1 -- 172.21.15.133:0/1901803931 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8830057300 con 0x7f88300b0c30 2021-01-03T13:01:35.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.527+0000 7f882effd700 1 -- 172.21.15.133:0/1901803931 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16114 (secure 0 0 0) 0x7f8828049f80 con 0x7f88300b0c30 2021-01-03T13:01:35.527 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:01:35.527 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":53,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:01:34.953281+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:01:33.451725+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-01-03T13:01:34.480032+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:01:35.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.531+0000 7f88368e9700 1 -- 172.21.15.133:0/1901803931 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8810055440 msgr2=0x7f8810057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.531+0000 7f88368e9700 1 --2- 172.21.15.133:0/1901803931 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8810055440 0x7f8810057900 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f882400d000 tx=0x7f88240079d0).stop 2021-01-03T13:01:35.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.531+0000 7f88368e9700 1 -- 172.21.15.133:0/1901803931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88300b0c30 msgr2=0x7f88301431c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.531+0000 7f88368e9700 1 --2- 172.21.15.133:0/1901803931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88300b0c30 0x7f88301431c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f8830152f30 tx=0x7f88280091a0).stop 2021-01-03T13:01:35.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.531+0000 7f88368e9700 1 -- 172.21.15.133:0/1901803931 shutdown_connections 2021-01-03T13:01:35.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.531+0000 7f88368e9700 1 --2- 172.21.15.133:0/1901803931 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8810055440 0x7f8810057900 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.531+0000 7f88368e9700 1 --2- 172.21.15.133:0/1901803931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88300b2050 0x7f8830139430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.531+0000 7f88368e9700 1 --2- 172.21.15.133:0/1901803931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88300b0c30 0x7f88301431c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.531+0000 7f88368e9700 1 --2- 172.21.15.133:0/1901803931 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f88300b1300 0x7f8830152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.531+0000 7f88368e9700 1 -- 172.21.15.133:0/1901803931 >> 172.21.15.133:0/1901803931 conn(0x7f883006b050 msgr2=0x7f883013fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:35.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.531+0000 7f88368e9700 1 -- 172.21.15.133:0/1901803931 shutdown_connections 2021-01-03T13:01:35.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.531+0000 7f88368e9700 1 -- 172.21.15.133:0/1901803931 wait complete. 2021-01-03T13:01:35.542 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-01-03T13:01:35.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.659+0000 7f9c9ffff700 1 Processor -- start 2021-01-03T13:01:35.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.659+0000 7f9c9ffff700 1 -- start start 2021-01-03T13:01:35.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9ffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9ca00b4c20 0x7f9ca005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ca005fd10 0x7f9ca00b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9ffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca005bf00 con 0x7f9ca0060510 2021-01-03T13:01:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9ffff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca005c1a0 con 0x7f9ca00b4c20 2021-01-03T13:01:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9ffff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca005c440 con 0x7f9ca005fd10 2021-01-03T13:01:35.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ca005fd10 0x7f9ca00b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9e7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9ca0060510 0x7f9ca00b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55428/0 (socket says 172.21.15.133:55428) 2021-01-03T13:01:35.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9e7fc700 1 -- 172.21.15.133:0/3134947461 learned_addr learned my addr 172.21.15.133:0/3134947461 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:35.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9effd700 1 --2- 172.21.15.133:0/3134947461 >> v2:172.21.15.16:3300/0 conn(0x7f9ca00b4c20 0x7f9ca005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9f7fe700 1 -- 172.21.15.133:0/3134947461 >> v2:172.21.15.16:3300/0 conn(0x7f9ca00b4c20 msgr2=0x7f9ca005c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:35.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9f7fe700 1 --2- 172.21.15.133:0/3134947461 >> v2:172.21.15.16:3300/0 conn(0x7f9ca00b4c20 0x7f9ca005c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9f7fe700 1 -- 172.21.15.133:0/3134947461 >> v1:172.21.15.133:6789/0 conn(0x7f9ca0060510 legacy=0x7f9ca00b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9f7fe700 1 -- 172.21.15.133:0/3134947461 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca00b6ad0 con 0x7f9ca005fd10 2021-01-03T13:01:35.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9dffb700 1 -- 172.21.15.133:0/3134947461 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511700985 0 0) 0x7f9ca005bf00 con 0x7f9ca0060510 2021-01-03T13:01:35.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9f7fe700 1 --2- 172.21.15.133:0/3134947461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca005fd10 0x7f9ca00b65e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f9c98002f30 tx=0x7f9c98006dc0).ready entity=mon.1 client_cookie=89aaae6922987e1b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:35.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9dffb700 1 -- 172.21.15.133:0/3134947461 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c980097f0 con 0x7f9ca005fd10 2021-01-03T13:01:35.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9dffb700 1 -- 172.21.15.133:0/3134947461 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c98009950 con 0x7f9ca005fd10 2021-01-03T13:01:35.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9dffb700 1 -- 172.21.15.133:0/3134947461 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c98009cb0 con 0x7f9ca005fd10 2021-01-03T13:01:35.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9ffff700 1 -- 172.21.15.133:0/3134947461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca005fd10 msgr2=0x7f9ca00b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9ffff700 1 --2- 172.21.15.133:0/3134947461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca005fd10 0x7f9ca00b65e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f9c98002f30 tx=0x7f9c98006dc0).stop 2021-01-03T13:01:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9ffff700 1 -- 172.21.15.133:0/3134947461 shutdown_connections 2021-01-03T13:01:35.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9ffff700 1 --2- 172.21.15.133:0/3134947461 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca005fd10 0x7f9ca00b65e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9ffff700 1 --2- 172.21.15.133:0/3134947461 >> v2:172.21.15.16:3300/0 conn(0x7f9ca00b4c20 0x7f9ca005c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9ffff700 1 -- 172.21.15.133:0/3134947461 >> 172.21.15.133:0/3134947461 conn(0x7f9ca00b9f00 msgr2=0x7f9ca00b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:35.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9ffff700 1 -- 172.21.15.133:0/3134947461 shutdown_connections 2021-01-03T13:01:35.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9ffff700 1 -- 172.21.15.133:0/3134947461 wait complete. 2021-01-03T13:01:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.663+0000 7f9c9ffff700 1 Processor -- start 2021-01-03T13:01:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9ffff700 1 -- start start 2021-01-03T13:01:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ca005fd10 0x7f9ca0154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca0060510 0x7f9ca009e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ca00b4c20 0x7f9ca0149380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9ffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00b36e0 con 0x7f9ca00b4c20 2021-01-03T13:01:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca0148d40 con 0x7f9ca0060510 2021-01-03T13:01:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca0149cd0 con 0x7f9ca005fd10 2021-01-03T13:01:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca0060510 0x7f9ca009e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca0060510 0x7f9ca009e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34404/0 (socket says 172.21.15.133:34404) 2021-01-03T13:01:35.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9e7fc700 1 -- 172.21.15.133:0/1936153515 learned_addr learned my addr 172.21.15.133:0/1936153515 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:35.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9effd700 1 --2- 172.21.15.133:0/1936153515 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ca005fd10 0x7f9ca0154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9f7fe700 1 --2- 172.21.15.133:0/1936153515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ca00b4c20 0x7f9ca0149380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9e7fc700 1 -- 172.21.15.133:0/1936153515 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ca005fd10 msgr2=0x7f9ca0154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9e7fc700 1 --2- 172.21.15.133:0/1936153515 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ca005fd10 0x7f9ca0154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9e7fc700 1 -- 172.21.15.133:0/1936153515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ca00b4c20 msgr2=0x7f9ca0149380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9e7fc700 1 --2- 172.21.15.133:0/1936153515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ca00b4c20 0x7f9ca0149380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9e7fc700 1 -- 172.21.15.133:0/1936153515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca0148f70 con 0x7f9ca0060510 2021-01-03T13:01:35.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9e7fc700 1 --2- 172.21.15.133:0/1936153515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca0060510 0x7f9ca009e820 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f9ca00b3820 tx=0x7f9c90007db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:35.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c97fff700 1 -- 172.21.15.133:0/1936153515 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c90005b70 con 0x7f9ca0060510 2021-01-03T13:01:35.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c97fff700 1 -- 172.21.15.133:0/1936153515 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c90005cd0 con 0x7f9ca0060510 2021-01-03T13:01:35.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9ffff700 1 -- 172.21.15.133:0/1936153515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca0148a00 con 0x7f9ca0060510 2021-01-03T13:01:35.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c97fff700 1 -- 172.21.15.133:0/1936153515 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c90007300 con 0x7f9ca0060510 2021-01-03T13:01:35.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9ffff700 1 -- 172.21.15.133:0/1936153515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca00b3a50 con 0x7f9ca0060510 2021-01-03T13:01:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.667+0000 7f9c9ffff700 1 -- 172.21.15.133:0/1936153515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca0057300 con 0x7f9ca0060510 2021-01-03T13:01:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.671+0000 7f9c97fff700 1 -- 172.21.15.133:0/1936153515 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9c90010030 con 0x7f9ca0060510 2021-01-03T13:01:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.671+0000 7f9c97fff700 1 --2- 172.21.15.133:0/1936153515 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9c780554e0 0x7f9c780579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.671+0000 7f9c97fff700 1 -- 172.21.15.133:0/1936153515 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9c9006de50 con 0x7f9ca0060510 2021-01-03T13:01:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.671+0000 7f9c9effd700 1 --2- 172.21.15.133:0/1936153515 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9c780554e0 0x7f9c780579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.671+0000 7f9c9effd700 1 --2- 172.21.15.133:0/1936153515 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9c780554e0 0x7f9c780579a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f9c8800c000 tx=0x7f9c88008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.675+0000 7f9c97fff700 1 -- 172.21.15.133:0/1936153515 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9c90044150 con 0x7f9ca0060510 2021-01-03T13:01:35.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.863+0000 7f9c9ffff700 1 -- 172.21.15.133:0/1936153515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9ca0067a00 con 0x7f9ca0060510 2021-01-03T13:01:35.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.971+0000 7f9c97fff700 1 -- 172.21.15.133:0/1936153515 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9c90047770 con 0x7f9ca0060510 2021-01-03T13:01:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.975+0000 7f9c9ffff700 1 -- 172.21.15.133:0/1936153515 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9c780554e0 msgr2=0x7f9c780579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.975+0000 7f9c9ffff700 1 --2- 172.21.15.133:0/1936153515 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9c780554e0 0x7f9c780579a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f9c8800c000 tx=0x7f9c88008040).stop 2021-01-03T13:01:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.975+0000 7f9c9ffff700 1 -- 172.21.15.133:0/1936153515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca0060510 msgr2=0x7f9ca009e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.975+0000 7f9c9ffff700 1 --2- 172.21.15.133:0/1936153515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca0060510 0x7f9ca009e820 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f9ca00b3820 tx=0x7f9c90007db0).stop 2021-01-03T13:01:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.975+0000 7f9c9ffff700 1 -- 172.21.15.133:0/1936153515 shutdown_connections 2021-01-03T13:01:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.975+0000 7f9c9ffff700 1 --2- 172.21.15.133:0/1936153515 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9c780554e0 0x7f9c780579a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.975+0000 7f9c9ffff700 1 --2- 172.21.15.133:0/1936153515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ca00b4c20 0x7f9ca0149380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.975+0000 7f9c9ffff700 1 --2- 172.21.15.133:0/1936153515 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ca005fd10 0x7f9ca0154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.975+0000 7f9c9ffff700 1 --2- 172.21.15.133:0/1936153515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ca0060510 0x7f9ca009e820 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:35.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.975+0000 7f9c9ffff700 1 -- 172.21.15.133:0/1936153515 >> 172.21.15.133:0/1936153515 conn(0x7f9ca00b9f00 msgr2=0x7f9ca00b80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:35.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.975+0000 7f9c9ffff700 1 -- 172.21.15.133:0/1936153515 shutdown_connections 2021-01-03T13:01:35.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:35.975+0000 7f9c9ffff700 1 -- 172.21.15.133:0/1936153515 wait complete. 2021-01-03T13:01:35.990 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:01:36.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.111+0000 7fd40a09f700 1 Processor -- start 2021-01-03T13:01:36.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.111+0000 7fd40a09f700 1 -- start start 2021-01-03T13:01:36.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.111+0000 7fd40a09f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd4040b23a0 0x7fd404066fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.111+0000 7fd40a09f700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4040b2780 con 0x7fd4041406b0 2021-01-03T13:01:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.111+0000 7fd40a09f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4040a9480 con 0x7fd4040af780 2021-01-03T13:01:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.111+0000 7fd40a09f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040aef00 con 0x7fd4040b23a0 2021-01-03T13:01:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.111+0000 7fd40909d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd4040b23a0 0x7fd404066fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:36.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.111+0000 7fd40989e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd4040af780 0x7fd4040b0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55446/0 (socket says 172.21.15.133:55446) 2021-01-03T13:01:36.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.111+0000 7fd40989e700 1 -- 172.21.15.133:0/2295639718 learned_addr learned my addr 172.21.15.133:0/2295639718 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:36.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.111+0000 7fd3f3fff700 1 -- 172.21.15.133:0/2295639718 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128429206 0 0) 0x7fd4040a9480 con 0x7fd4040af780 2021-01-03T13:01:36.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.111+0000 7fd3f3fff700 1 -- 172.21.15.133:0/2295639718 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3ec003230 con 0x7fd4040af780 2021-01-03T13:01:36.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.111+0000 7fd40909d700 1 -- 172.21.15.133:0/2295639718 >> v1:172.21.15.133:6789/0 conn(0x7fd4040af780 legacy=0x7fd4040b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.111+0000 7fd3f3fff700 1 -- 172.21.15.133:0/2295639718 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245383261 0 0) 0x7fd4040b2780 con 0x7fd4041406b0 2021-01-03T13:01:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.111+0000 7fd40909d700 1 -- 172.21.15.133:0/2295639718 >> v1:172.21.15.16:6789/0 conn(0x7fd4041406b0 legacy=0x7fd4040674a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.111+0000 7fd40909d700 1 -- 172.21.15.133:0/2295639718 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40413fa30 con 0x7fd4040b23a0 2021-01-03T13:01:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.111+0000 7fd40909d700 1 --2- 172.21.15.133:0/2295639718 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd4040b23a0 0x7fd404066fb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd400002f30 tx=0x7fd400006dc0).ready entity=mon.2 client_cookie=bd7cb670976b5f39 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:36.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.111+0000 7fd3f3fff700 1 -- 172.21.15.133:0/2295639718 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4000097b0 con 0x7fd4040b23a0 2021-01-03T13:01:36.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd3f3fff700 1 -- 172.21.15.133:0/2295639718 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd400009910 con 0x7fd4040b23a0 2021-01-03T13:01:36.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40a09f700 1 -- 172.21.15.133:0/2295639718 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd4040b23a0 msgr2=0x7fd404066fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd3f3fff700 1 -- 172.21.15.133:0/2295639718 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd400009c70 con 0x7fd4040b23a0 2021-01-03T13:01:36.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40a09f700 1 --2- 172.21.15.133:0/2295639718 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd4040b23a0 0x7fd404066fb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd400002f30 tx=0x7fd400006dc0).stop 2021-01-03T13:01:36.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40a09f700 1 -- 172.21.15.133:0/2295639718 shutdown_connections 2021-01-03T13:01:36.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40a09f700 1 --2- 172.21.15.133:0/2295639718 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd4040b23a0 0x7fd404066fb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40a09f700 1 -- 172.21.15.133:0/2295639718 >> 172.21.15.133:0/2295639718 conn(0x7fd40406b050 msgr2=0x7fd404060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:36.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40a09f700 1 -- 172.21.15.133:0/2295639718 shutdown_connections 2021-01-03T13:01:36.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40a09f700 1 -- 172.21.15.133:0/2295639718 wait complete. 2021-01-03T13:01:36.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40a09f700 1 Processor -- start 2021-01-03T13:01:36.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40a09f700 1 -- start start 2021-01-03T13:01:36.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40a09f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4040af780 0x7fd40405c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:36.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40a09f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4040b23a0 0x7fd4040639c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:36.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40a09f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd4041406b0 0x7fd404063eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:36.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40a09f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4041428c0 con 0x7fd4040af780 2021-01-03T13:01:36.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40a09f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd404142b60 con 0x7fd4040b23a0 2021-01-03T13:01:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40a09f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd404142e00 con 0x7fd4041406b0 2021-01-03T13:01:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40889c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4040b23a0 0x7fd4040639c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40889c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4040b23a0 0x7fd4040639c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34416/0 (socket says 172.21.15.133:34416) 2021-01-03T13:01:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40889c700 1 -- 172.21.15.133:0/969474353 learned_addr learned my addr 172.21.15.133:0/969474353 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:36.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40989e700 1 --2- 172.21.15.133:0/969474353 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd4041406b0 0x7fd404063eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.115+0000 7fd40909d700 1 --2- 172.21.15.133:0/969474353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4040af780 0x7fd40405c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd40889c700 1 -- 172.21.15.133:0/969474353 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd4041406b0 msgr2=0x7fd404063eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd40889c700 1 --2- 172.21.15.133:0/969474353 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd4041406b0 0x7fd404063eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd40889c700 1 -- 172.21.15.133:0/969474353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4040af780 msgr2=0x7fd40405c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd40889c700 1 --2- 172.21.15.133:0/969474353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4040af780 0x7fd40405c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd40889c700 1 -- 172.21.15.133:0/969474353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd404142600 con 0x7fd4040b23a0 2021-01-03T13:01:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd40989e700 1 --2- 172.21.15.133:0/969474353 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd4041406b0 0x7fd404063eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:01:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd40909d700 1 --2- 172.21.15.133:0/969474353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4040af780 0x7fd40405c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:01:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd40889c700 1 --2- 172.21.15.133:0/969474353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4040b23a0 0x7fd4040639c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fd3f4000b80 tx=0x7fd3f4007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd3f27fc700 1 -- 172.21.15.133:0/969474353 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3f400f470 con 0x7fd4040b23a0 2021-01-03T13:01:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd3f27fc700 1 -- 172.21.15.133:0/969474353 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f400f5d0 con 0x7fd4040b23a0 2021-01-03T13:01:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd3f27fc700 1 -- 172.21.15.133:0/969474353 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3f400f930 con 0x7fd4040b23a0 2021-01-03T13:01:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd40a09f700 1 -- 172.21.15.133:0/969474353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4040643a0 con 0x7fd4040b23a0 2021-01-03T13:01:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd40a09f700 1 -- 172.21.15.133:0/969474353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4041420b0 con 0x7fd4040b23a0 2021-01-03T13:01:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd40a09f700 1 -- 172.21.15.133:0/969474353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd404142fc0 con 0x7fd4040b23a0 2021-01-03T13:01:36.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd3f27fc700 1 -- 172.21.15.133:0/969474353 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd3f4019030 con 0x7fd4040b23a0 2021-01-03T13:01:36.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd3f27fc700 1 --2- 172.21.15.133:0/969474353 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd3e40553b0 0x7fd3e4057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:36.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd3f27fc700 1 -- 172.21.15.133:0/969474353 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd3f406d410 con 0x7fd4040b23a0 2021-01-03T13:01:36.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd40909d700 1 --2- 172.21.15.133:0/969474353 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd3e40553b0 0x7fd3e4057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:36.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.119+0000 7fd40909d700 1 --2- 172.21.15.133:0/969474353 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd3e40553b0 0x7fd3e4057870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fd400019000 tx=0x7fd400015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:36.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.127+0000 7fd3f27fc700 1 -- 172.21.15.133:0/969474353 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd3f4043670 con 0x7fd4040b23a0 2021-01-03T13:01:36.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.315+0000 7fd40a09f700 1 -- 172.21.15.133:0/969474353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd404057300 con 0x7fd4040b23a0 2021-01-03T13:01:36.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.315+0000 7fd3f27fc700 1 -- 172.21.15.133:0/969474353 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fd3f4046c90 con 0x7fd4040b23a0 2021-01-03T13:01:36.312 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:01:36.312 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/2812725713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2812725713},{"type":"v1","addr":"172.21.15.16:6833","nonce":2812725713}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1096331942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1096331942},{"type":"v1","addr":"172.21.15.133:6835","nonce":1096331942}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:01:34.953831+0000","modified":"2021-01-03T13:01:35.958148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5563},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5563":{"gid":5563,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/834098016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":834098016},{"type":"v1","addr":"172.21.15.133:6837","nonce":834098016}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-01-03T13:01:36.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.315+0000 7fd40a09f700 1 -- 172.21.15.133:0/969474353 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd3e40553b0 msgr2=0x7fd3e4057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.315+0000 7fd40a09f700 1 --2- 172.21.15.133:0/969474353 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd3e40553b0 0x7fd3e4057870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fd400019000 tx=0x7fd400015000).stop 2021-01-03T13:01:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.315+0000 7fd40a09f700 1 -- 172.21.15.133:0/969474353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4040b23a0 msgr2=0x7fd4040639c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.315+0000 7fd40a09f700 1 --2- 172.21.15.133:0/969474353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4040b23a0 0x7fd4040639c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fd3f4000b80 tx=0x7fd3f4007bd0).stop 2021-01-03T13:01:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.315+0000 7fd40a09f700 1 -- 172.21.15.133:0/969474353 shutdown_connections 2021-01-03T13:01:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.315+0000 7fd40a09f700 1 --2- 172.21.15.133:0/969474353 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd3e40553b0 0x7fd3e4057870 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.315+0000 7fd40a09f700 1 --2- 172.21.15.133:0/969474353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4040af780 0x7fd40405c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.315+0000 7fd40a09f700 1 --2- 172.21.15.133:0/969474353 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd4041406b0 0x7fd404063eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.315+0000 7fd40a09f700 1 --2- 172.21.15.133:0/969474353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4040b23a0 0x7fd4040639c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.315+0000 7fd40a09f700 1 -- 172.21.15.133:0/969474353 >> 172.21.15.133:0/969474353 conn(0x7fd40406b050 msgr2=0x7fd404060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:36.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.315+0000 7fd40a09f700 1 -- 172.21.15.133:0/969474353 shutdown_connections 2021-01-03T13:01:36.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.315+0000 7fd40a09f700 1 -- 172.21.15.133:0/969474353 wait complete. 2021-01-03T13:01:36.316 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 21 2021-01-03T13:01:36.325 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:01:36.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.435+0000 7fda95688700 1 Processor -- start 2021-01-03T13:01:36.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.435+0000 7fda95688700 1 -- start start 2021-01-03T13:01:36.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.435+0000 7fda95688700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fda900b0ac0 0x7fda90060ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:36.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.435+0000 7fda95688700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda900b1210 con 0x7fda90143050 2021-01-03T13:01:36.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.435+0000 7fda95688700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda900afd30 con 0x7fda900606f0 2021-01-03T13:01:36.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.435+0000 7fda95688700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda900afa90 con 0x7fda900b0ac0 2021-01-03T13:01:36.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.435+0000 7fda8ffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fda900606f0 0x7fda900abc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55460/0 (socket says 172.21.15.133:55460) 2021-01-03T13:01:36.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.435+0000 7fda8ffff700 1 -- 172.21.15.133:0/1613494712 learned_addr learned my addr 172.21.15.133:0/1613494712 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:36.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.435+0000 7fda8f7fe700 1 --2- 172.21.15.133:0/1613494712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fda900b0ac0 0x7fda90060ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:36.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.435+0000 7fda8effd700 1 -- 172.21.15.133:0/1613494712 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766885429 0 0) 0x7fda900afd30 con 0x7fda900606f0 2021-01-03T13:01:36.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda8effd700 1 -- 172.21.15.133:0/1613494712 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda7c003230 con 0x7fda900606f0 2021-01-03T13:01:36.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda8effd700 1 -- 172.21.15.133:0/1613494712 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917688265 0 0) 0x7fda900b1210 con 0x7fda90143050 2021-01-03T13:01:36.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda8f7fe700 1 -- 172.21.15.133:0/1613494712 >> v1:172.21.15.133:6789/0 conn(0x7fda900606f0 legacy=0x7fda900abc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda8f7fe700 1 -- 172.21.15.133:0/1613494712 >> v1:172.21.15.16:6789/0 conn(0x7fda90143050 legacy=0x7fda900aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda8f7fe700 1 -- 172.21.15.133:0/1613494712 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda900b1470 con 0x7fda900b0ac0 2021-01-03T13:01:36.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda8f7fe700 1 --2- 172.21.15.133:0/1613494712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fda900b0ac0 0x7fda90060ad0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fda84002f30 tx=0x7fda84006dc0).ready entity=mon.2 client_cookie=8293a2a44ae940e3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:36.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda8effd700 1 -- 172.21.15.133:0/1613494712 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda840097b0 con 0x7fda900b0ac0 2021-01-03T13:01:36.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda8effd700 1 -- 172.21.15.133:0/1613494712 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda84009910 con 0x7fda900b0ac0 2021-01-03T13:01:36.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda95688700 1 -- 172.21.15.133:0/1613494712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fda900b0ac0 msgr2=0x7fda90060ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda8effd700 1 -- 172.21.15.133:0/1613494712 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda84009c70 con 0x7fda900b0ac0 2021-01-03T13:01:36.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda95688700 1 --2- 172.21.15.133:0/1613494712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fda900b0ac0 0x7fda90060ad0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fda84002f30 tx=0x7fda84006dc0).stop 2021-01-03T13:01:36.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda95688700 1 -- 172.21.15.133:0/1613494712 shutdown_connections 2021-01-03T13:01:36.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda95688700 1 --2- 172.21.15.133:0/1613494712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fda900b0ac0 0x7fda90060ad0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda95688700 1 -- 172.21.15.133:0/1613494712 >> 172.21.15.133:0/1613494712 conn(0x7fda9005bdf0 msgr2=0x7fda9005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:36.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda95688700 1 -- 172.21.15.133:0/1613494712 shutdown_connections 2021-01-03T13:01:36.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda95688700 1 -- 172.21.15.133:0/1613494712 wait complete. 2021-01-03T13:01:36.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda95688700 1 Processor -- start 2021-01-03T13:01:36.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda95688700 1 -- start start 2021-01-03T13:01:36.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda95688700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fda900606f0 0x7fda90066f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:36.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda95688700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda900b0ac0 0x7fda900ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:36.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda95688700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda90143050 0x7fda900ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:36.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.439+0000 7fda95688700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900657b0 con 0x7fda90143050 2021-01-03T13:01:36.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda95688700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900b45a0 con 0x7fda900b0ac0 2021-01-03T13:01:36.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda95688700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda90063bd0 con 0x7fda900606f0 2021-01-03T13:01:36.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda8f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda900b0ac0 0x7fda900ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:36.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda8f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda900b0ac0 0x7fda900ad2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34430/0 (socket says 172.21.15.133:34430) 2021-01-03T13:01:36.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda8f7fe700 1 -- 172.21.15.133:0/449965914 learned_addr learned my addr 172.21.15.133:0/449965914 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:36.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda8ffff700 1 --2- 172.21.15.133:0/449965914 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fda900606f0 0x7fda90066f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:36.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda94e87700 1 --2- 172.21.15.133:0/449965914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda90143050 0x7fda900ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:36.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda8f7fe700 1 -- 172.21.15.133:0/449965914 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fda900606f0 msgr2=0x7fda90066f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda8f7fe700 1 --2- 172.21.15.133:0/449965914 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fda900606f0 0x7fda90066f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda8f7fe700 1 -- 172.21.15.133:0/449965914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda90143050 msgr2=0x7fda900ad7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda8f7fe700 1 --2- 172.21.15.133:0/449965914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda90143050 0x7fda900ad7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda8f7fe700 1 -- 172.21.15.133:0/449965914 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda90065310 con 0x7fda900b0ac0 2021-01-03T13:01:36.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda94e87700 1 --2- 172.21.15.133:0/449965914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda90143050 0x7fda900ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:01:36.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda8f7fe700 1 --2- 172.21.15.133:0/449965914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda900b0ac0 0x7fda900ad2f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fda84002f30 tx=0x7fda84015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:36.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda8d7fa700 1 -- 172.21.15.133:0/449965914 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda84011b70 con 0x7fda900b0ac0 2021-01-03T13:01:36.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda8d7fa700 1 -- 172.21.15.133:0/449965914 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda84011cd0 con 0x7fda900b0ac0 2021-01-03T13:01:36.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda95688700 1 -- 172.21.15.133:0/449965914 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda900aaf00 con 0x7fda900b0ac0 2021-01-03T13:01:36.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda8d7fa700 1 -- 172.21.15.133:0/449965914 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda8401d640 con 0x7fda900b0ac0 2021-01-03T13:01:36.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda95688700 1 -- 172.21.15.133:0/449965914 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda900adcd0 con 0x7fda900b0ac0 2021-01-03T13:01:36.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda95688700 1 -- 172.21.15.133:0/449965914 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda90063d90 con 0x7fda900b0ac0 2021-01-03T13:01:36.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.443+0000 7fda8d7fa700 1 -- 172.21.15.133:0/449965914 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fda84024030 con 0x7fda900b0ac0 2021-01-03T13:01:36.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.447+0000 7fda8d7fa700 1 --2- 172.21.15.133:0/449965914 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fda700553f0 0x7fda700578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:36.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.447+0000 7fda8ffff700 1 --2- 172.21.15.133:0/449965914 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fda700553f0 0x7fda700578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:36.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.447+0000 7fda8d7fa700 1 -- 172.21.15.133:0/449965914 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fda8406f270 con 0x7fda900b0ac0 2021-01-03T13:01:36.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.447+0000 7fda8ffff700 1 --2- 172.21.15.133:0/449965914 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fda700553f0 0x7fda700578b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fda8000d000 tx=0x7fda80009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:36.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.455+0000 7fda8d7fa700 1 -- 172.21.15.133:0/449965914 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fda840453e0 con 0x7fda900b0ac0 2021-01-03T13:01:36.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.595+0000 7fda95688700 1 -- 172.21.15.133:0/449965914 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda900654a0 con 0x7fda900b0ac0 2021-01-03T13:01:36.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.599+0000 7fda8d7fa700 1 -- 172.21.15.133:0/449965914 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16101 (secure 0 0 0) 0x7fda84022020 con 0x7fda900b0ac0 2021-01-03T13:01:36.596 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:01:36.596 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":54,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:01:35.957065+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:01:33.451725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-01-03T13:01:34.480032+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:01:36.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.599+0000 7fda95688700 1 -- 172.21.15.133:0/449965914 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fda700553f0 msgr2=0x7fda700578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.599+0000 7fda95688700 1 --2- 172.21.15.133:0/449965914 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fda700553f0 0x7fda700578b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fda8000d000 tx=0x7fda80009040).stop 2021-01-03T13:01:36.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.599+0000 7fda95688700 1 -- 172.21.15.133:0/449965914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda900b0ac0 msgr2=0x7fda900ad2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.599+0000 7fda95688700 1 --2- 172.21.15.133:0/449965914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda900b0ac0 0x7fda900ad2f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fda84002f30 tx=0x7fda84015000).stop 2021-01-03T13:01:36.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.599+0000 7fda95688700 1 -- 172.21.15.133:0/449965914 shutdown_connections 2021-01-03T13:01:36.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.599+0000 7fda95688700 1 --2- 172.21.15.133:0/449965914 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fda700553f0 0x7fda700578b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.599+0000 7fda95688700 1 --2- 172.21.15.133:0/449965914 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda90143050 0x7fda900ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.599+0000 7fda95688700 1 --2- 172.21.15.133:0/449965914 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fda900606f0 0x7fda90066f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.599+0000 7fda95688700 1 --2- 172.21.15.133:0/449965914 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda900b0ac0 0x7fda900ad2f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.599+0000 7fda95688700 1 -- 172.21.15.133:0/449965914 >> 172.21.15.133:0/449965914 conn(0x7fda9005bdf0 msgr2=0x7fda900aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.599+0000 7fda95688700 1 -- 172.21.15.133:0/449965914 shutdown_connections 2021-01-03T13:01:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.599+0000 7fda95688700 1 -- 172.21.15.133:0/449965914 wait complete. 2021-01-03T13:01:36.609 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:01:36.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.723+0000 7f5fef6df700 1 Processor -- start 2021-01-03T13:01:36.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.723+0000 7f5fef6df700 1 -- start start 2021-01-03T13:01:36.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fef6df700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5fe8060b00 0x7f5fe80af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:36.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fef6df700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe809a380 con 0x7f5fe80abff0 2021-01-03T13:01:36.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fef6df700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe8060090 con 0x7f5fe80b5120 2021-01-03T13:01:36.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fef6df700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe8062340 con 0x7f5fe8060b00 2021-01-03T13:01:36.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fedc7c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5fe80b5120 0x7f5fe80ab8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55472/0 (socket says 172.21.15.133:55472) 2021-01-03T13:01:36.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fedc7c700 1 -- 172.21.15.133:0/1554937022 learned_addr learned my addr 172.21.15.133:0/1554937022 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:36.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fed47b700 1 --2- 172.21.15.133:0/1554937022 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5fe8060b00 0x7f5fe80af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:36.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fecc7a700 1 -- 172.21.15.133:0/1554937022 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266606198 0 0) 0x7f5fe8060090 con 0x7f5fe80b5120 2021-01-03T13:01:36.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fecc7a700 1 -- 172.21.15.133:0/1554937022 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fd4003230 con 0x7f5fe80b5120 2021-01-03T13:01:36.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fecc7a700 1 -- 172.21.15.133:0/1554937022 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571426141 0 0) 0x7f5fe809a380 con 0x7f5fe80abff0 2021-01-03T13:01:36.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fecc7a700 1 -- 172.21.15.133:0/1554937022 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fe8060090 con 0x7f5fe80abff0 2021-01-03T13:01:36.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fecc7a700 1 -- 172.21.15.133:0/1554937022 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 170314867 0 0) 0x7f5fd4003230 con 0x7f5fe80b5120 2021-01-03T13:01:36.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fed47b700 1 -- 172.21.15.133:0/1554937022 >> v1:172.21.15.133:6789/0 conn(0x7f5fe80b5120 legacy=0x7f5fe80ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fed47b700 1 -- 172.21.15.133:0/1554937022 >> v1:172.21.15.16:6789/0 conn(0x7f5fe80abff0 legacy=0x7f5fe80afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fed47b700 1 -- 172.21.15.133:0/1554937022 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe8060330 con 0x7f5fe8060b00 2021-01-03T13:01:36.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fed47b700 1 --2- 172.21.15.133:0/1554937022 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5fe8060b00 0x7f5fe80af9f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f5fe806b300 tx=0x7f5fd8006dc0).ready entity=mon.2 client_cookie=1b2075cbf3a9ce72 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:36.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fecc7a700 1 -- 172.21.15.133:0/1554937022 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe40016d0 con 0x7f5fe8060b00 2021-01-03T13:01:36.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fecc7a700 1 -- 172.21.15.133:0/1554937022 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd800d5c0 con 0x7f5fe8060b00 2021-01-03T13:01:36.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fecc7a700 1 -- 172.21.15.133:0/1554937022 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fd800d730 con 0x7f5fe8060b00 2021-01-03T13:01:36.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fef6df700 1 -- 172.21.15.133:0/1554937022 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5fe8060b00 msgr2=0x7f5fe80af9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fef6df700 1 --2- 172.21.15.133:0/1554937022 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5fe8060b00 0x7f5fe80af9f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f5fe806b300 tx=0x7f5fd8006dc0).stop 2021-01-03T13:01:36.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fef6df700 1 -- 172.21.15.133:0/1554937022 shutdown_connections 2021-01-03T13:01:36.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fef6df700 1 --2- 172.21.15.133:0/1554937022 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5fe8060b00 0x7f5fe80af9f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fef6df700 1 -- 172.21.15.133:0/1554937022 >> 172.21.15.133:0/1554937022 conn(0x7f5fe805bdf0 msgr2=0x7f5fe805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:36.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fef6df700 1 -- 172.21.15.133:0/1554937022 shutdown_connections 2021-01-03T13:01:36.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.727+0000 7f5fef6df700 1 -- 172.21.15.133:0/1554937022 wait complete. 2021-01-03T13:01:36.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fef6df700 1 Processor -- start 2021-01-03T13:01:36.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fef6df700 1 -- start start 2021-01-03T13:01:36.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fef6df700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fe8060b00 0x7f5fe80b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:36.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fef6df700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5fe80abff0 0x7f5fe80ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:36.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fef6df700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fe80b5120 0x7f5fe8063540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:36.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fef6df700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe80ada90 con 0x7f5fe8060b00 2021-01-03T13:01:36.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fef6df700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe8130e00 con 0x7f5fe80b5120 2021-01-03T13:01:36.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fef6df700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe8131030 con 0x7f5fe80abff0 2021-01-03T13:01:36.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fee47d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fe80b5120 0x7f5fe8063540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:36.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fee47d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fe80b5120 0x7f5fe8063540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34446/0 (socket says 172.21.15.133:34446) 2021-01-03T13:01:36.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fee47d700 1 -- 172.21.15.133:0/4225525279 learned_addr learned my addr 172.21.15.133:0/4225525279 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:36.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fed47b700 1 --2- 172.21.15.133:0/4225525279 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5fe80abff0 0x7f5fe80ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:36.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fedc7c700 1 --2- 172.21.15.133:0/4225525279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fe8060b00 0x7f5fe80b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:36.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fee47d700 1 -- 172.21.15.133:0/4225525279 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5fe80abff0 msgr2=0x7f5fe80ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fee47d700 1 --2- 172.21.15.133:0/4225525279 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5fe80abff0 0x7f5fe80ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fee47d700 1 -- 172.21.15.133:0/4225525279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fe8060b00 msgr2=0x7f5fe80b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fee47d700 1 --2- 172.21.15.133:0/4225525279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fe8060b00 0x7f5fe80b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fee47d700 1 -- 172.21.15.133:0/4225525279 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe80acef0 con 0x7f5fe80b5120 2021-01-03T13:01:36.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fedc7c700 1 --2- 172.21.15.133:0/4225525279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fe8060b00 0x7f5fe80b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:01:36.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fee47d700 1 --2- 172.21.15.133:0/4225525279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fe80b5120 0x7f5fe8063540 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f5fe0001450 tx=0x7f5fe0007d30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:36.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fde7fc700 1 -- 172.21.15.133:0/4225525279 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe000cea0 con 0x7f5fe80b5120 2021-01-03T13:01:36.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fde7fc700 1 -- 172.21.15.133:0/4225525279 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe000a7b0 con 0x7f5fe80b5120 2021-01-03T13:01:36.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fef6df700 1 -- 172.21.15.133:0/4225525279 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe80ad190 con 0x7f5fe80b5120 2021-01-03T13:01:36.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fde7fc700 1 -- 172.21.15.133:0/4225525279 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe000a920 con 0x7f5fe80b5120 2021-01-03T13:01:36.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.731+0000 7f5fef6df700 1 -- 172.21.15.133:0/4225525279 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe8066cc0 con 0x7f5fe80b5120 2021-01-03T13:01:36.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.735+0000 7f5fef6df700 1 -- 172.21.15.133:0/4225525279 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe8065520 con 0x7f5fe80b5120 2021-01-03T13:01:36.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.735+0000 7f5fde7fc700 1 -- 172.21.15.133:0/4225525279 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5fe0010070 con 0x7f5fe80b5120 2021-01-03T13:01:36.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.735+0000 7f5fde7fc700 1 --2- 172.21.15.133:0/4225525279 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5fd0055320 0x7f5fd00577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:36.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.735+0000 7f5fde7fc700 1 -- 172.21.15.133:0/4225525279 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5fe006dd80 con 0x7f5fe80b5120 2021-01-03T13:01:36.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.735+0000 7f5fedc7c700 1 --2- 172.21.15.133:0/4225525279 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5fd0055320 0x7f5fd00577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:36.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.735+0000 7f5fedc7c700 1 --2- 172.21.15.133:0/4225525279 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5fd0055320 0x7f5fd00577e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f5fe400b000 tx=0x7f5fe4000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:36.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.743+0000 7f5fde7fc700 1 -- 172.21.15.133:0/4225525279 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5fe0043fe0 con 0x7f5fe80b5120 2021-01-03T13:01:36.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.931+0000 7f5fef6df700 1 -- 172.21.15.133:0/4225525279 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5fe8057300 con 0x7f5fe80b5120 2021-01-03T13:01:36.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.939+0000 7f5fde7fc700 1 -- 172.21.15.133:0/4225525279 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5fe006f030 con 0x7f5fe80b5120 2021-01-03T13:01:36.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.943+0000 7f5fef6df700 1 -- 172.21.15.133:0/4225525279 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5fd0055320 msgr2=0x7f5fd00577e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.943+0000 7f5fef6df700 1 --2- 172.21.15.133:0/4225525279 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5fd0055320 0x7f5fd00577e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f5fe400b000 tx=0x7f5fe4000b80).stop 2021-01-03T13:01:36.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.943+0000 7f5fef6df700 1 -- 172.21.15.133:0/4225525279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fe80b5120 msgr2=0x7f5fe8063540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:36.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.943+0000 7f5fef6df700 1 --2- 172.21.15.133:0/4225525279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fe80b5120 0x7f5fe8063540 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f5fe0001450 tx=0x7f5fe0007d30).stop 2021-01-03T13:01:36.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.943+0000 7f5fef6df700 1 -- 172.21.15.133:0/4225525279 shutdown_connections 2021-01-03T13:01:36.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.943+0000 7f5fef6df700 1 --2- 172.21.15.133:0/4225525279 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5fd0055320 0x7f5fd00577e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.943+0000 7f5fef6df700 1 --2- 172.21.15.133:0/4225525279 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5fe8060b00 0x7f5fe80b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.943+0000 7f5fef6df700 1 --2- 172.21.15.133:0/4225525279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5fe80b5120 0x7f5fe8063540 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.943+0000 7f5fef6df700 1 --2- 172.21.15.133:0/4225525279 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5fe80abff0 0x7f5fe80ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:36.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.943+0000 7f5fef6df700 1 -- 172.21.15.133:0/4225525279 >> 172.21.15.133:0/4225525279 conn(0x7f5fe805bdf0 msgr2=0x7f5fe8131460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:36.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.943+0000 7f5fef6df700 1 -- 172.21.15.133:0/4225525279 shutdown_connections 2021-01-03T13:01:36.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:36.943+0000 7f5fef6df700 1 -- 172.21.15.133:0/4225525279 wait complete. 2021-01-03T13:01:36.943 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2021-01-03T13:01:36.953 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:01:37.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcab576d700 1 Processor -- start 2021-01-03T13:01:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcab576d700 1 -- start start 2021-01-03T13:01:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcab576d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcab00b5120 0x7fcab00ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcab576d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcab00abdd0 0x7fcab00b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcab576d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab00ac280 con 0x7fcab0060b00 2021-01-03T13:01:37.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcab576d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab0062340 con 0x7fcab00abdd0 2021-01-03T13:01:37.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcab576d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab009a380 con 0x7fcab00b5120 2021-01-03T13:01:37.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcaaf7fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcab00b5120 0x7fcab00ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:37.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcaaf7fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcab00b5120 0x7fcab00ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:42754/0 (socket says 172.21.15.133:42754) 2021-01-03T13:01:37.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcaaf7fe700 1 -- 172.21.15.133:0/1273495656 learned_addr learned my addr 172.21.15.133:0/1273495656 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:37.083 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcaaffff700 1 --2- 172.21.15.133:0/1273495656 >> v2:172.21.15.16:3300/0 conn(0x7fcab00abdd0 0x7fcab00b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:37.083 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcaae7fc700 1 -- 172.21.15.133:0/1273495656 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006724483 0 0) 0x7fcab00ac280 con 0x7fcab0060b00 2021-01-03T13:01:37.083 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcaae7fc700 1 -- 172.21.15.133:0/1273495656 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca9c003230 con 0x7fcab0060b00 2021-01-03T13:01:37.083 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcaaf7fe700 1 -- 172.21.15.133:0/1273495656 >> v2:172.21.15.16:3300/0 conn(0x7fcab00abdd0 msgr2=0x7fcab00b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:37.083 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcaaf7fe700 1 --2- 172.21.15.133:0/1273495656 >> v2:172.21.15.16:3300/0 conn(0x7fcab00abdd0 0x7fcab00b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:37.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcaaf7fe700 1 -- 172.21.15.133:0/1273495656 >> v1:172.21.15.16:6789/0 conn(0x7fcab0060b00 legacy=0x7fcab00af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:37.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcaaf7fe700 1 -- 172.21.15.133:0/1273495656 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab0060090 con 0x7fcab00b5120 2021-01-03T13:01:37.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcaaf7fe700 1 --2- 172.21.15.133:0/1273495656 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcab00b5120 0x7fcab00ab8e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fcaa00032b0 tx=0x7fcaa0009270).ready entity=mon.2 client_cookie=4bc93f3a63888abf server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:37.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcaae7fc700 1 -- 172.21.15.133:0/1273495656 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaa0009e60 con 0x7fcab00b5120 2021-01-03T13:01:37.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcaae7fc700 1 -- 172.21.15.133:0/1273495656 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa000bb50 con 0x7fcab00b5120 2021-01-03T13:01:37.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcaae7fc700 1 -- 172.21.15.133:0/1273495656 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaa000bcc0 con 0x7fcab00b5120 2021-01-03T13:01:37.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcab576d700 1 -- 172.21.15.133:0/1273495656 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcab00b5120 msgr2=0x7fcab00ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:37.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.079+0000 7fcab576d700 1 --2- 172.21.15.133:0/1273495656 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcab00b5120 0x7fcab00ab8e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fcaa00032b0 tx=0x7fcaa0009270).stop 2021-01-03T13:01:37.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.083+0000 7fcab576d700 1 -- 172.21.15.133:0/1273495656 shutdown_connections 2021-01-03T13:01:37.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.083+0000 7fcab576d700 1 --2- 172.21.15.133:0/1273495656 >> v2:172.21.15.16:3300/0 conn(0x7fcab00abdd0 0x7fcab00b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:37.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.083+0000 7fcab576d700 1 --2- 172.21.15.133:0/1273495656 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcab00b5120 0x7fcab00ab8e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:37.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.083+0000 7fcab576d700 1 -- 172.21.15.133:0/1273495656 >> 172.21.15.133:0/1273495656 conn(0x7fcab005bdf0 msgr2=0x7fcab005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:37.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.083+0000 7fcab576d700 1 -- 172.21.15.133:0/1273495656 shutdown_connections 2021-01-03T13:01:37.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.083+0000 7fcab576d700 1 -- 172.21.15.133:0/1273495656 wait complete. 2021-01-03T13:01:37.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.083+0000 7fcab576d700 1 Processor -- start 2021-01-03T13:01:37.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.083+0000 7fcab576d700 1 -- start start 2021-01-03T13:01:37.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcab576d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcab0060b00 0x7fcab00924c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:37.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcab576d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcab00abdd0 0x7fcab0140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:37.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcab576d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcab00b5120 0x7fcab01411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:37.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcab576d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab0090e70 con 0x7fcab00abdd0 2021-01-03T13:01:37.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcab576d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab00aefd0 con 0x7fcab00b5120 2021-01-03T13:01:37.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcab576d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab00af750 con 0x7fcab0060b00 2021-01-03T13:01:37.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcaaffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcab00b5120 0x7fcab01411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:37.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcaaffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcab00b5120 0x7fcab01411a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34462/0 (socket says 172.21.15.133:34462) 2021-01-03T13:01:37.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcaaffff700 1 -- 172.21.15.133:0/3809952807 learned_addr learned my addr 172.21.15.133:0/3809952807 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:37.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcaaf7fe700 1 --2- 172.21.15.133:0/3809952807 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcab0060b00 0x7fcab00924c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:37.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcaaeffd700 1 --2- 172.21.15.133:0/3809952807 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcab00abdd0 0x7fcab0140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:37.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcaaffff700 1 -- 172.21.15.133:0/3809952807 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcab0060b00 msgr2=0x7fcab00924c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:37.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcaaffff700 1 --2- 172.21.15.133:0/3809952807 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcab0060b00 0x7fcab00924c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:37.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcaaffff700 1 -- 172.21.15.133:0/3809952807 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcab00abdd0 msgr2=0x7fcab0140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:37.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcaaffff700 1 --2- 172.21.15.133:0/3809952807 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcab00abdd0 0x7fcab0140cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:37.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcaaffff700 1 -- 172.21.15.133:0/3809952807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab0090bd0 con 0x7fcab00b5120 2021-01-03T13:01:37.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcaaffff700 1 --2- 172.21.15.133:0/3809952807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcab00b5120 0x7fcab01411a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7fcaa800c000 tx=0x7fcaa8006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:37.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcaa7fff700 1 -- 172.21.15.133:0/3809952807 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaa800ca10 con 0x7fcab00b5120 2021-01-03T13:01:37.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcaa7fff700 1 -- 172.21.15.133:0/3809952807 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa800cb70 con 0x7fcab00b5120 2021-01-03T13:01:37.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcab576d700 1 -- 172.21.15.133:0/3809952807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab00af1e0 con 0x7fcab00b5120 2021-01-03T13:01:37.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcaa7fff700 1 -- 172.21.15.133:0/3809952807 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcaa800be70 con 0x7fcab00b5120 2021-01-03T13:01:37.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.087+0000 7fcab576d700 1 -- 172.21.15.133:0/3809952807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab00aec30 con 0x7fcab00b5120 2021-01-03T13:01:37.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.091+0000 7fcab576d700 1 -- 172.21.15.133:0/3809952807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab00687f0 con 0x7fcab00b5120 2021-01-03T13:01:37.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.091+0000 7fcaa7fff700 1 -- 172.21.15.133:0/3809952807 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fcaa801c460 con 0x7fcab00b5120 2021-01-03T13:01:37.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.091+0000 7fcaa7fff700 1 --2- 172.21.15.133:0/3809952807 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fca94055320 0x7fca940577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:37.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.091+0000 7fcaa7fff700 1 -- 172.21.15.133:0/3809952807 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcaa806e400 con 0x7fcab00b5120 2021-01-03T13:01:37.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.091+0000 7fcaaf7fe700 1 --2- 172.21.15.133:0/3809952807 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fca94055320 0x7fca940577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:37.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.091+0000 7fcaaf7fe700 1 --2- 172.21.15.133:0/3809952807 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fca94055320 0x7fca940577e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fcaa001b000 tx=0x7fcaa0016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:37.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.095+0000 7fcaa7fff700 1 -- 172.21.15.133:0/3809952807 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcab00687f0 con 0x7fcab00b5120 2021-01-03T13:01:37.169 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:01:37.171 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:01:37.174 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:01:37.176 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:01:37.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.287+0000 7fcab576d700 1 -- 172.21.15.133:0/3809952807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fcab00687f0 con 0x7fcab00b5120 2021-01-03T13:01:37.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.295+0000 7fcaa7fff700 1 -- 172.21.15.133:0/3809952807 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7fcab00687f0 con 0x7fcab00b5120 2021-01-03T13:01:37.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.299+0000 7fcab576d700 1 -- 172.21.15.133:0/3809952807 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fca94055320 msgr2=0x7fca940577e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:37.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.299+0000 7fcab576d700 1 --2- 172.21.15.133:0/3809952807 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fca94055320 0x7fca940577e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fcaa001b000 tx=0x7fcaa0016000).stop 2021-01-03T13:01:37.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.299+0000 7fcab576d700 1 -- 172.21.15.133:0/3809952807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcab00b5120 msgr2=0x7fcab01411a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:37.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.299+0000 7fcab576d700 1 --2- 172.21.15.133:0/3809952807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcab00b5120 0x7fcab01411a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7fcaa800c000 tx=0x7fcaa8006dc0).stop 2021-01-03T13:01:37.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.299+0000 7fcab576d700 1 -- 172.21.15.133:0/3809952807 shutdown_connections 2021-01-03T13:01:37.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.299+0000 7fcab576d700 1 --2- 172.21.15.133:0/3809952807 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fca94055320 0x7fca940577e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:37.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.299+0000 7fcab576d700 1 --2- 172.21.15.133:0/3809952807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcab00b5120 0x7fcab01411a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:37.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.299+0000 7fcab576d700 1 --2- 172.21.15.133:0/3809952807 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcab0060b00 0x7fcab00924c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:37.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.299+0000 7fcab576d700 1 --2- 172.21.15.133:0/3809952807 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcab00abdd0 0x7fcab0140cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:37.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.299+0000 7fcab576d700 1 -- 172.21.15.133:0/3809952807 >> 172.21.15.133:0/3809952807 conn(0x7fcab005bdf0 msgr2=0x7fcab0063f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:37.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.299+0000 7fcab576d700 1 -- 172.21.15.133:0/3809952807 shutdown_connections 2021-01-03T13:01:37.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.299+0000 7fcab576d700 1 -- 172.21.15.133:0/3809952807 wait complete. 2021-01-03T13:01:37.299 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.1 2021-01-03T13:01:37.312 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:01:37.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.423+0000 7fceed1e4700 1 Processor -- start 2021-01-03T13:01:37.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.423+0000 7fceed1e4700 1 -- start start 2021-01-03T13:01:37.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.423+0000 7fceed1e4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcee80b9f40 0x7fcee8146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:37.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.423+0000 7fceed1e4700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee80605f0 con 0x7fcee8146920 2021-01-03T13:01:37.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.423+0000 7fceed1e4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee80600b0 con 0x7fcee80b9b60 2021-01-03T13:01:37.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.423+0000 7fceed1e4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee80aed30 con 0x7fcee80b9f40 2021-01-03T13:01:37.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.423+0000 7fcee7fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcee80b9b60 0x7fcee80b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55498/0 (socket says 172.21.15.133:55498) 2021-01-03T13:01:37.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.423+0000 7fcee7fff700 1 -- 172.21.15.133:0/805081579 learned_addr learned my addr 172.21.15.133:0/805081579 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:37.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.423+0000 7fcee77fe700 1 --2- 172.21.15.133:0/805081579 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcee80b9f40 0x7fcee8146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:37.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fcee6ffd700 1 -- 172.21.15.133:0/805081579 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527894095 0 0) 0x7fcee80600b0 con 0x7fcee80b9b60 2021-01-03T13:01:37.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fcee6ffd700 1 -- 172.21.15.133:0/805081579 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcec8003230 con 0x7fcee80b9b60 2021-01-03T13:01:37.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fcee77fe700 1 -- 172.21.15.133:0/805081579 >> v1:172.21.15.133:6789/0 conn(0x7fcee80b9b60 legacy=0x7fcee80b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:37.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fcee77fe700 1 -- 172.21.15.133:0/805081579 >> v1:172.21.15.16:6789/0 conn(0x7fcee8146920 legacy=0x7fcee814d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:37.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fcee6ffd700 1 -- 172.21.15.133:0/805081579 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982471988 0 0) 0x7fcee80605f0 con 0x7fcee8146920 2021-01-03T13:01:37.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fcee77fe700 1 -- 172.21.15.133:0/805081579 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee8060350 con 0x7fcee80b9f40 2021-01-03T13:01:37.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fcee77fe700 1 --2- 172.21.15.133:0/805081579 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcee80b9f40 0x7fcee8146430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fced0002f30 tx=0x7fced0006dc0).ready entity=mon.2 client_cookie=d88a9ef8076e4a4b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:37.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fcee6ffd700 1 -- 172.21.15.133:0/805081579 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fced00097b0 con 0x7fcee80b9f40 2021-01-03T13:01:37.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fcee6ffd700 1 -- 172.21.15.133:0/805081579 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced0009910 con 0x7fcee80b9f40 2021-01-03T13:01:37.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fceed1e4700 1 -- 172.21.15.133:0/805081579 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcee80b9f40 msgr2=0x7fcee8146430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:37.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fceed1e4700 1 --2- 172.21.15.133:0/805081579 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcee80b9f40 0x7fcee8146430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fced0002f30 tx=0x7fced0006dc0).stop 2021-01-03T13:01:37.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fcee6ffd700 1 -- 172.21.15.133:0/805081579 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fced0009c70 con 0x7fcee80b9f40 2021-01-03T13:01:37.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fceed1e4700 1 -- 172.21.15.133:0/805081579 shutdown_connections 2021-01-03T13:01:37.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fceed1e4700 1 --2- 172.21.15.133:0/805081579 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcee80b9f40 0x7fcee8146430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:37.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fceed1e4700 1 -- 172.21.15.133:0/805081579 >> 172.21.15.133:0/805081579 conn(0x7fcee80b69e0 msgr2=0x7fcee80b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:37.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fceed1e4700 1 -- 172.21.15.133:0/805081579 shutdown_connections 2021-01-03T13:01:37.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fceed1e4700 1 -- 172.21.15.133:0/805081579 wait complete. 2021-01-03T13:01:37.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fceed1e4700 1 Processor -- start 2021-01-03T13:01:37.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fceed1e4700 1 -- start start 2021-01-03T13:01:37.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.427+0000 7fceed1e4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee80b9b60 0x7fcee8151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:37.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fceed1e4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcee80b9f40 0x7fcee81480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:37.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fceed1e4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcee8146920 0x7fcee81485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:37.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fceed1e4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee8152320 con 0x7fcee80b9f40 2021-01-03T13:01:37.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fceed1e4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee813c6e0 con 0x7fcee80b9b60 2021-01-03T13:01:37.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fceed1e4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee8152550 con 0x7fcee8146920 2021-01-03T13:01:37.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fcee7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee80b9b60 0x7fcee8151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:37.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fcee7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee80b9b60 0x7fcee8151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34472/0 (socket says 172.21.15.133:34472) 2021-01-03T13:01:37.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fcee7fff700 1 -- 172.21.15.133:0/3022765128 learned_addr learned my addr 172.21.15.133:0/3022765128 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:37.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fcee77fe700 1 --2- 172.21.15.133:0/3022765128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcee80b9f40 0x7fcee81480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:37.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fceec9e3700 1 --2- 172.21.15.133:0/3022765128 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcee8146920 0x7fcee81485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:37.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fcee7fff700 1 -- 172.21.15.133:0/3022765128 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcee8146920 msgr2=0x7fcee81485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:37.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fcee7fff700 1 --2- 172.21.15.133:0/3022765128 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcee8146920 0x7fcee81485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:37.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fcee7fff700 1 -- 172.21.15.133:0/3022765128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcee80b9f40 msgr2=0x7fcee81480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:37.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fcee7fff700 1 --2- 172.21.15.133:0/3022765128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcee80b9f40 0x7fcee81480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:37.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fcee7fff700 1 -- 172.21.15.133:0/3022765128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee81527f0 con 0x7fcee80b9b60 2021-01-03T13:01:37.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fcee7fff700 1 --2- 172.21.15.133:0/3022765128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee80b9b60 0x7fcee8151e30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fcee0001450 tx=0x7fcee0007df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:37.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fcee57fa700 1 -- 172.21.15.133:0/3022765128 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcee0005b70 con 0x7fcee80b9b60 2021-01-03T13:01:37.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fcee57fa700 1 -- 172.21.15.133:0/3022765128 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee0005cd0 con 0x7fcee80b9b60 2021-01-03T13:01:37.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fceed1e4700 1 -- 172.21.15.133:0/3022765128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee8149410 con 0x7fcee80b9b60 2021-01-03T13:01:37.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fcee57fa700 1 -- 172.21.15.133:0/3022765128 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcee0007300 con 0x7fcee80b9b60 2021-01-03T13:01:37.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fceed1e4700 1 -- 172.21.15.133:0/3022765128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee8143ad0 con 0x7fcee80b9b60 2021-01-03T13:01:37.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fceed1e4700 1 -- 172.21.15.133:0/3022765128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee8057300 con 0x7fcee80b9b60 2021-01-03T13:01:37.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.431+0000 7fcee57fa700 1 -- 172.21.15.133:0/3022765128 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fcee0010030 con 0x7fcee80b9b60 2021-01-03T13:01:37.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.435+0000 7fcee57fa700 1 --2- 172.21.15.133:0/3022765128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcecc055500 0x7fcecc0579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:37.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.435+0000 7fcee77fe700 1 --2- 172.21.15.133:0/3022765128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcecc055500 0x7fcecc0579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:37.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.435+0000 7fcee57fa700 1 -- 172.21.15.133:0/3022765128 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcee006e680 con 0x7fcee80b9b60 2021-01-03T13:01:37.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.435+0000 7fcee77fe700 1 --2- 172.21.15.133:0/3022765128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcecc055500 0x7fcecc0579c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fced001a000 tx=0x7fced0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:37.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.439+0000 7fcee57fa700 1 -- 172.21.15.133:0/3022765128 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcee0044870 con 0x7fcee80b9b60 2021-01-03T13:01:37.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.631+0000 7fceed1e4700 1 -- 172.21.15.133:0/3022765128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcee8060940 con 0x7fcee80b9b60 2021-01-03T13:01:37.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.631+0000 7fcee57fa700 1 -- 172.21.15.133:0/3022765128 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fcee0047e90 con 0x7fcee80b9b60 2021-01-03T13:01:37.628 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:01:37.628 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/2812725713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2812725713},{"type":"v1","addr":"172.21.15.16:6833","nonce":2812725713}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1096331942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1096331942},{"type":"v1","addr":"172.21.15.133:6835","nonce":1096331942}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:01:34.953831+0000","modified":"2021-01-03T13:01:35.958148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5563},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5563":{"gid":5563,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/834098016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":834098016},{"type":"v1","addr":"172.21.15.133:6837","nonce":834098016}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-01-03T13:01:37.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.631+0000 7fceed1e4700 1 -- 172.21.15.133:0/3022765128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcecc055500 msgr2=0x7fcecc0579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:37.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.631+0000 7fceed1e4700 1 --2- 172.21.15.133:0/3022765128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcecc055500 0x7fcecc0579c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fced001a000 tx=0x7fced0015000).stop 2021-01-03T13:01:37.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.631+0000 7fceed1e4700 1 -- 172.21.15.133:0/3022765128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee80b9b60 msgr2=0x7fcee8151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:37.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.631+0000 7fceed1e4700 1 --2- 172.21.15.133:0/3022765128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee80b9b60 0x7fcee8151e30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fcee0001450 tx=0x7fcee0007df0).stop 2021-01-03T13:01:37.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.631+0000 7fceed1e4700 1 -- 172.21.15.133:0/3022765128 shutdown_connections 2021-01-03T13:01:37.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.631+0000 7fceed1e4700 1 --2- 172.21.15.133:0/3022765128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcecc055500 0x7fcecc0579c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:37.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.631+0000 7fceed1e4700 1 --2- 172.21.15.133:0/3022765128 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcee8146920 0x7fcee81485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:37.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.631+0000 7fceed1e4700 1 --2- 172.21.15.133:0/3022765128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee80b9b60 0x7fcee8151e30 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:37.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.631+0000 7fceed1e4700 1 --2- 172.21.15.133:0/3022765128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcee80b9f40 0x7fcee81480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:37.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.631+0000 7fceed1e4700 1 -- 172.21.15.133:0/3022765128 >> 172.21.15.133:0/3022765128 conn(0x7fcee80b69e0 msgr2=0x7fcee81461b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:37.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.631+0000 7fceed1e4700 1 -- 172.21.15.133:0/3022765128 shutdown_connections 2021-01-03T13:01:37.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:37.631+0000 7fceed1e4700 1 -- 172.21.15.133:0/3022765128 wait complete. 2021-01-03T13:01:37.633 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 21 2021-01-03T13:01:37.944 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:01:34.953831+0000', 'modified': '2021-01-03T13:01:35.958148+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5563}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5563': {'gid': 5563, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/834098016', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 834098016}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 834098016}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:01:37.944 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:01:37.945 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T13:01:38.076 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":5563,"want_state":"up:active","state":"up:active","rank_uptime":3.1111479480000002,"mdsmap_epoch":21,"osdmap_epoch":55,"osdmap_epoch_barrier":54,"uptime":7.5082097799999996} 2021-01-03T13:01:38.076 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 5563, "mdsmap_epoch": 21, "osdmap_epoch": 55, "osdmap_epoch_barrier": 54, "rank_uptime": 3.111147948, "state": "up:active", "uptime": 7.50820978, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:01:38.077 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:01:38.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d5f140700 1 Processor -- start 2021-01-03T13:01:38.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d5f140700 1 -- start start 2021-01-03T13:01:38.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d5f140700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6d5805c130 0x7f6d581437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:38.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d5f140700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6d5805cc10 0x7f6d580b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:38.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d5f140700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5805c510 con 0x7f6d58146370 2021-01-03T13:01:38.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d5f140700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d580b5c10 con 0x7f6d5805cc10 2021-01-03T13:01:38.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d5f140700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d580af8f0 con 0x7f6d5805c130 2021-01-03T13:01:38.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d5cedc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6d5805c130 0x7f6d581437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:38.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d5d6dd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6d58146370 0x7f6d58146820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55516/0 (socket says 172.21.15.133:55516) 2021-01-03T13:01:38.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d5d6dd700 1 -- 172.21.15.133:0/2469582120 learned_addr learned my addr 172.21.15.133:0/2469582120 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:38.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d57fff700 1 --2- 172.21.15.133:0/2469582120 >> v2:172.21.15.16:3300/0 conn(0x7f6d5805cc10 0x7f6d580b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:38.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d5cedc700 1 -- 172.21.15.133:0/2469582120 >> v2:172.21.15.16:3300/0 conn(0x7f6d5805cc10 msgr2=0x7f6d580b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:38.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d5cedc700 1 --2- 172.21.15.133:0/2469582120 >> v2:172.21.15.16:3300/0 conn(0x7f6d5805cc10 0x7f6d580b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d5cedc700 1 -- 172.21.15.133:0/2469582120 >> v1:172.21.15.133:6789/0 conn(0x7f6d58146370 legacy=0x7f6d58146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d577fe700 1 -- 172.21.15.133:0/2469582120 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1013214798 0 0) 0x7f6d5805c510 con 0x7f6d58146370 2021-01-03T13:01:38.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d5cedc700 1 -- 172.21.15.133:0/2469582120 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d580afb90 con 0x7f6d5805c130 2021-01-03T13:01:38.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d5cedc700 1 --2- 172.21.15.133:0/2469582120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d5805c130 0x7f6d581437e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f6d480032b0 tx=0x7f6d480091a0).ready entity=mon.1 client_cookie=23cb528163fe844d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:38.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d577fe700 1 -- 172.21.15.133:0/2469582120 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d4800ba50 con 0x7f6d5805c130 2021-01-03T13:01:38.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d577fe700 1 -- 172.21.15.133:0/2469582120 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4800bbb0 con 0x7f6d5805c130 2021-01-03T13:01:38.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d577fe700 1 -- 172.21.15.133:0/2469582120 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d4800bd20 con 0x7f6d5805c130 2021-01-03T13:01:38.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d5f140700 1 -- 172.21.15.133:0/2469582120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d5805c130 msgr2=0x7f6d581437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.195+0000 7f6d5f140700 1 --2- 172.21.15.133:0/2469582120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d5805c130 0x7f6d581437e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f6d480032b0 tx=0x7f6d480091a0).stop 2021-01-03T13:01:38.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5f140700 1 -- 172.21.15.133:0/2469582120 shutdown_connections 2021-01-03T13:01:38.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5f140700 1 --2- 172.21.15.133:0/2469582120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d5805c130 0x7f6d581437e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5f140700 1 --2- 172.21.15.133:0/2469582120 >> v2:172.21.15.16:3300/0 conn(0x7f6d5805cc10 0x7f6d580b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5f140700 1 -- 172.21.15.133:0/2469582120 >> 172.21.15.133:0/2469582120 conn(0x7f6d580b95d0 msgr2=0x7f6d580b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:38.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5f140700 1 -- 172.21.15.133:0/2469582120 shutdown_connections 2021-01-03T13:01:38.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5f140700 1 -- 172.21.15.133:0/2469582120 wait complete. 2021-01-03T13:01:38.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5f140700 1 Processor -- start 2021-01-03T13:01:38.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5f140700 1 -- start start 2021-01-03T13:01:38.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5f140700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d5805c130 0x7f6d58145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:38.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5f140700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d5805cc10 0x7f6d581525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:38.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5f140700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6d58146370 0x7f6d581555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:38.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5f140700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d580b3db0 con 0x7f6d5805cc10 2021-01-03T13:01:38.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5f140700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5809f1b0 con 0x7f6d5805c130 2021-01-03T13:01:38.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5f140700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5809f450 con 0x7f6d58146370 2021-01-03T13:01:38.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5cedc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d5805c130 0x7f6d58145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:38.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5cedc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d5805c130 0x7f6d58145700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34486/0 (socket says 172.21.15.133:34486) 2021-01-03T13:01:38.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5cedc700 1 -- 172.21.15.133:0/435675566 learned_addr learned my addr 172.21.15.133:0/435675566 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:38.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d57fff700 1 --2- 172.21.15.133:0/435675566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d5805cc10 0x7f6d581525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:38.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5d6dd700 1 --2- 172.21.15.133:0/435675566 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6d58146370 0x7f6d581555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:38.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5cedc700 1 -- 172.21.15.133:0/435675566 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6d58146370 msgr2=0x7f6d581555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5cedc700 1 --2- 172.21.15.133:0/435675566 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6d58146370 0x7f6d581555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5cedc700 1 -- 172.21.15.133:0/435675566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d5805cc10 msgr2=0x7f6d581525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5cedc700 1 --2- 172.21.15.133:0/435675566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d5805cc10 0x7f6d581525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5cedc700 1 -- 172.21.15.133:0/435675566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5809f6f0 con 0x7f6d5805c130 2021-01-03T13:01:38.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d57fff700 1 --2- 172.21.15.133:0/435675566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d5805cc10 0x7f6d581525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:01:38.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5cedc700 1 --2- 172.21.15.133:0/435675566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d5805c130 0x7f6d58145700 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f6d480032b0 tx=0x7f6d48016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:38.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d55ffb700 1 -- 172.21.15.133:0/435675566 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d4801f5e0 con 0x7f6d5805c130 2021-01-03T13:01:38.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d55ffb700 1 -- 172.21.15.133:0/435675566 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4801f740 con 0x7f6d5805c130 2021-01-03T13:01:38.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5f140700 1 -- 172.21.15.133:0/435675566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d58155150 con 0x7f6d5805c130 2021-01-03T13:01:38.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d55ffb700 1 -- 172.21.15.133:0/435675566 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d4801faa0 con 0x7f6d5805c130 2021-01-03T13:01:38.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.199+0000 7f6d5f140700 1 -- 172.21.15.133:0/435675566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d580b7e20 con 0x7f6d5805c130 2021-01-03T13:01:38.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.203+0000 7f6d5f140700 1 -- 172.21.15.133:0/435675566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d58057300 con 0x7f6d5805c130 2021-01-03T13:01:38.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.203+0000 7f6d55ffb700 1 -- 172.21.15.133:0/435675566 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6d4800f070 con 0x7f6d5805c130 2021-01-03T13:01:38.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.203+0000 7f6d55ffb700 1 --2- 172.21.15.133:0/435675566 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6d38055330 0x7f6d380577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:38.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.203+0000 7f6d55ffb700 1 -- 172.21.15.133:0/435675566 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6d4806f0f0 con 0x7f6d5805c130 2021-01-03T13:01:38.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.203+0000 7f6d57fff700 1 --2- 172.21.15.133:0/435675566 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6d38055330 0x7f6d380577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:38.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.203+0000 7f6d57fff700 1 --2- 172.21.15.133:0/435675566 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6d38055330 0x7f6d380577f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f6d4c00c000 tx=0x7f6d4c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:38.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.215+0000 7f6d55ffb700 1 -- 172.21.15.133:0/435675566 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6d48045350 con 0x7f6d5805c130 2021-01-03T13:01:38.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.351+0000 7f6d5f140700 1 -- 172.21.15.133:0/435675566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d5805d270 con 0x7f6d5805c130 2021-01-03T13:01:38.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.351+0000 7f6d55ffb700 1 -- 172.21.15.133:0/435675566 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16088 (secure 0 0 0) 0x7f6d48030ef0 con 0x7f6d5805c130 2021-01-03T13:01:38.349 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:01:38.350 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":55,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:01:36.969095+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:01:33.451725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-01-03T13:01:34.480032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:01:38.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.351+0000 7f6d5f140700 1 -- 172.21.15.133:0/435675566 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6d38055330 msgr2=0x7f6d380577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.351+0000 7f6d5f140700 1 --2- 172.21.15.133:0/435675566 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6d38055330 0x7f6d380577f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f6d4c00c000 tx=0x7f6d4c008040).stop 2021-01-03T13:01:38.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.355+0000 7f6d5f140700 1 -- 172.21.15.133:0/435675566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d5805c130 msgr2=0x7f6d58145700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.355+0000 7f6d5f140700 1 --2- 172.21.15.133:0/435675566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d5805c130 0x7f6d58145700 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f6d480032b0 tx=0x7f6d48016000).stop 2021-01-03T13:01:38.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.355+0000 7f6d5f140700 1 -- 172.21.15.133:0/435675566 shutdown_connections 2021-01-03T13:01:38.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.355+0000 7f6d5f140700 1 --2- 172.21.15.133:0/435675566 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6d38055330 0x7f6d380577f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.355+0000 7f6d5f140700 1 --2- 172.21.15.133:0/435675566 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6d58146370 0x7f6d581555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.355+0000 7f6d5f140700 1 --2- 172.21.15.133:0/435675566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d5805c130 0x7f6d58145700 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.355+0000 7f6d5f140700 1 --2- 172.21.15.133:0/435675566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d5805cc10 0x7f6d581525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.355+0000 7f6d5f140700 1 -- 172.21.15.133:0/435675566 >> 172.21.15.133:0/435675566 conn(0x7f6d580b95d0 msgr2=0x7f6d581445c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:38.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.355+0000 7f6d5f140700 1 -- 172.21.15.133:0/435675566 shutdown_connections 2021-01-03T13:01:38.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.355+0000 7f6d5f140700 1 -- 172.21.15.133:0/435675566 wait complete. 2021-01-03T13:01:38.363 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:01:33.451725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:01:34.480032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:01:38.364 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:01:38.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.483+0000 7fcac3fff700 1 Processor -- start 2021-01-03T13:01:38.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.483+0000 7fcac3fff700 1 -- start start 2021-01-03T13:01:38.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcac40b3670 0x7fcac40b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:38.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac3fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcac40b1f30 0x7fcac40b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:38.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac3fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac40ac200 con 0x7fcac40b7910 2021-01-03T13:01:38.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac3fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac40ad720 con 0x7fcac40b1f30 2021-01-03T13:01:38.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac3fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac40acc10 con 0x7fcac40b3670 2021-01-03T13:01:38.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac27fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcac40b3670 0x7fcac40b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:38.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac2ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcac40b7910 0x7fcac413e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55526/0 (socket says 172.21.15.133:55526) 2021-01-03T13:01:38.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac27fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcac40b3670 0x7fcac40b7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34496/0 (socket says 172.21.15.133:34496) 2021-01-03T13:01:38.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac2ffd700 1 -- 172.21.15.133:0/2328640009 learned_addr learned my addr 172.21.15.133:0/2328640009 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:38.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac37fe700 1 --2- 172.21.15.133:0/2328640009 >> v2:172.21.15.16:3300/0 conn(0x7fcac40b1f30 0x7fcac40b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:38.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac27fc700 1 -- 172.21.15.133:0/2328640009 >> v2:172.21.15.16:3300/0 conn(0x7fcac40b1f30 msgr2=0x7fcac40b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:38.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac27fc700 1 --2- 172.21.15.133:0/2328640009 >> v2:172.21.15.16:3300/0 conn(0x7fcac40b1f30 0x7fcac40b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac27fc700 1 -- 172.21.15.133:0/2328640009 >> v1:172.21.15.133:6789/0 conn(0x7fcac40b7910 legacy=0x7fcac413e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac1ffb700 1 -- 172.21.15.133:0/2328640009 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056032619 0 0) 0x7fcac40ac200 con 0x7fcac40b7910 2021-01-03T13:01:38.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac27fc700 1 -- 172.21.15.133:0/2328640009 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac40ac430 con 0x7fcac40b3670 2021-01-03T13:01:38.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac27fc700 1 --2- 172.21.15.133:0/2328640009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac40b3670 0x7fcac40b7cf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fcab0002f30 tx=0x7fcab0006d60).ready entity=mon.1 client_cookie=ed21851532cdfc71 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:38.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac1ffb700 1 -- 172.21.15.133:0/2328640009 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcab0009600 con 0x7fcac40b3670 2021-01-03T13:01:38.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac1ffb700 1 -- 172.21.15.133:0/2328640009 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab0009760 con 0x7fcac40b3670 2021-01-03T13:01:38.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac1ffb700 1 -- 172.21.15.133:0/2328640009 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcab00098d0 con 0x7fcac40b3670 2021-01-03T13:01:38.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac3fff700 1 -- 172.21.15.133:0/2328640009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac40b3670 msgr2=0x7fcac40b7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac3fff700 1 --2- 172.21.15.133:0/2328640009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac40b3670 0x7fcac40b7cf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fcab0002f30 tx=0x7fcab0006d60).stop 2021-01-03T13:01:38.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac3fff700 1 -- 172.21.15.133:0/2328640009 shutdown_connections 2021-01-03T13:01:38.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac3fff700 1 --2- 172.21.15.133:0/2328640009 >> v2:172.21.15.16:3300/0 conn(0x7fcac40b1f30 0x7fcac40b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac3fff700 1 --2- 172.21.15.133:0/2328640009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac40b3670 0x7fcac40b7cf0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac3fff700 1 -- 172.21.15.133:0/2328640009 >> 172.21.15.133:0/2328640009 conn(0x7fcac405c8c0 msgr2=0x7fcac40b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:38.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac3fff700 1 -- 172.21.15.133:0/2328640009 shutdown_connections 2021-01-03T13:01:38.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.487+0000 7fcac3fff700 1 -- 172.21.15.133:0/2328640009 wait complete. 2021-01-03T13:01:38.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac3fff700 1 Processor -- start 2021-01-03T13:01:38.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac3fff700 1 -- start start 2021-01-03T13:01:38.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac3fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcac40b1f30 0x7fcac4065600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:38.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac40b3670 0x7fcac40affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:38.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac3fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcac40b7910 0x7fcac40623f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:38.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac3fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac40651d0 con 0x7fcac40b1f30 2021-01-03T13:01:38.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac3fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac4152840 con 0x7fcac40b3670 2021-01-03T13:01:38.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac3fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac41525b0 con 0x7fcac40b7910 2021-01-03T13:01:38.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac40b3670 0x7fcac40affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:38.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac40b3670 0x7fcac40affc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34502/0 (socket says 172.21.15.133:34502) 2021-01-03T13:01:38.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac27fc700 1 -- 172.21.15.133:0/1643854568 learned_addr learned my addr 172.21.15.133:0/1643854568 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:38.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac2ffd700 1 --2- 172.21.15.133:0/1643854568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcac40b1f30 0x7fcac4065600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:38.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac37fe700 1 --2- 172.21.15.133:0/1643854568 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcac40b7910 0x7fcac40623f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:38.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac27fc700 1 -- 172.21.15.133:0/1643854568 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcac40b7910 msgr2=0x7fcac40623f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac27fc700 1 --2- 172.21.15.133:0/1643854568 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcac40b7910 0x7fcac40623f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac27fc700 1 -- 172.21.15.133:0/1643854568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcac40b1f30 msgr2=0x7fcac4065600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac27fc700 1 --2- 172.21.15.133:0/1643854568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcac40b1f30 0x7fcac4065600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac27fc700 1 -- 172.21.15.133:0/1643854568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac4064f30 con 0x7fcac40b3670 2021-01-03T13:01:38.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.491+0000 7fcac2ffd700 1 --2- 172.21.15.133:0/1643854568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcac40b1f30 0x7fcac4065600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:01:38.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.495+0000 7fcac27fc700 1 --2- 172.21.15.133:0/1643854568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac40b3670 0x7fcac40affc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fcac40aee50 tx=0x7fcab0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:38.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.495+0000 7fcabbfff700 1 -- 172.21.15.133:0/1643854568 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcab00098d0 con 0x7fcac40b3670 2021-01-03T13:01:38.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.495+0000 7fcabbfff700 1 -- 172.21.15.133:0/1643854568 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab0011e70 con 0x7fcac40b3670 2021-01-03T13:01:38.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.495+0000 7fcabbfff700 1 -- 172.21.15.133:0/1643854568 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcab0021630 con 0x7fcac40b3670 2021-01-03T13:01:38.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.495+0000 7fcac3fff700 1 -- 172.21.15.133:0/1643854568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac4152aa0 con 0x7fcac40b3670 2021-01-03T13:01:38.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.495+0000 7fcac3fff700 1 -- 172.21.15.133:0/1643854568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac4065d70 con 0x7fcac40b3670 2021-01-03T13:01:38.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.495+0000 7fcac3fff700 1 -- 172.21.15.133:0/1643854568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac4065400 con 0x7fcac40b3670 2021-01-03T13:01:38.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.499+0000 7fcabbfff700 1 -- 172.21.15.133:0/1643854568 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fcab0027020 con 0x7fcac40b3670 2021-01-03T13:01:38.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.499+0000 7fcabbfff700 1 --2- 172.21.15.133:0/1643854568 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaa00553b0 0x7fcaa0057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:38.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.499+0000 7fcabbfff700 1 -- 172.21.15.133:0/1643854568 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcab006f0f0 con 0x7fcac40b3670 2021-01-03T13:01:38.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.499+0000 7fcac2ffd700 1 --2- 172.21.15.133:0/1643854568 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaa00553b0 0x7fcaa0057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:38.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.499+0000 7fcac2ffd700 1 --2- 172.21.15.133:0/1643854568 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaa00553b0 0x7fcaa0057870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fcab400b000 tx=0x7fcab4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:38.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.503+0000 7fcabbfff700 1 -- 172.21.15.133:0/1643854568 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcab00452e0 con 0x7fcac40b3670 2021-01-03T13:01:38.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.647+0000 7fcac3fff700 1 -- 172.21.15.133:0/1643854568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcac4057300 con 0x7fcac40b3670 2021-01-03T13:01:38.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.647+0000 7fcabbfff700 1 -- 172.21.15.133:0/1643854568 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v55) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcab00150b0 con 0x7fcac40b3670 2021-01-03T13:01:38.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.647+0000 7fcac3fff700 1 -- 172.21.15.133:0/1643854568 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaa00553b0 msgr2=0x7fcaa0057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.647+0000 7fcac3fff700 1 --2- 172.21.15.133:0/1643854568 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaa00553b0 0x7fcaa0057870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fcab400b000 tx=0x7fcab4009040).stop 2021-01-03T13:01:38.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.647+0000 7fcac3fff700 1 -- 172.21.15.133:0/1643854568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac40b3670 msgr2=0x7fcac40affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.647+0000 7fcac3fff700 1 --2- 172.21.15.133:0/1643854568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac40b3670 0x7fcac40affc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fcac40aee50 tx=0x7fcab0016000).stop 2021-01-03T13:01:38.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.647+0000 7fcac3fff700 1 -- 172.21.15.133:0/1643854568 shutdown_connections 2021-01-03T13:01:38.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.647+0000 7fcac3fff700 1 --2- 172.21.15.133:0/1643854568 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaa00553b0 0x7fcaa0057870 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.647+0000 7fcac3fff700 1 --2- 172.21.15.133:0/1643854568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcac40b1f30 0x7fcac4065600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.647+0000 7fcac3fff700 1 --2- 172.21.15.133:0/1643854568 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcac40b7910 0x7fcac40623f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.647+0000 7fcac3fff700 1 --2- 172.21.15.133:0/1643854568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcac40b3670 0x7fcac40affc0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.647+0000 7fcac3fff700 1 -- 172.21.15.133:0/1643854568 >> 172.21.15.133:0/1643854568 conn(0x7fcac405c8c0 msgr2=0x7fcac40b5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:38.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.647+0000 7fcac3fff700 1 -- 172.21.15.133:0/1643854568 shutdown_connections 2021-01-03T13:01:38.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.647+0000 7fcac3fff700 1 -- 172.21.15.133:0/1643854568 wait complete. 2021-01-03T13:01:38.698 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:01:38.699 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:01:38.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927b407700 1 Processor -- start 2021-01-03T13:01:38.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927b407700 1 -- start start 2021-01-03T13:01:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927b407700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f92740b5260 0x7f92741470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927b407700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92740b0c10 con 0x7f92741442a0 2021-01-03T13:01:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927b407700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92740b5640 con 0x7f92740b5c00 2021-01-03T13:01:38.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927b407700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9274144e00 con 0x7f92740b5260 2021-01-03T13:01:38.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f9279c04700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f92740b5c00 0x7f92741475a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55544/0 (socket says 172.21.15.133:55544) 2021-01-03T13:01:38.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f9279c04700 1 -- 172.21.15.133:0/2291167826 learned_addr learned my addr 172.21.15.133:0/2291167826 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:38.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927a405700 1 --2- 172.21.15.133:0/2291167826 >> v2:172.21.15.16:3300/0 conn(0x7f92740b5260 0x7f92741470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:38.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f9279403700 1 -- 172.21.15.133:0/2291167826 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476042707 0 0) 0x7f92740b5640 con 0x7f92740b5c00 2021-01-03T13:01:38.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f9279403700 1 -- 172.21.15.133:0/2291167826 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f925c003230 con 0x7f92740b5c00 2021-01-03T13:01:38.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f9279403700 1 -- 172.21.15.133:0/2291167826 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157275830 0 0) 0x7f92740b0c10 con 0x7f92741442a0 2021-01-03T13:01:38.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f9279403700 1 -- 172.21.15.133:0/2291167826 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92740b5640 con 0x7f92741442a0 2021-01-03T13:01:38.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f9279403700 1 -- 172.21.15.133:0/2291167826 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 786894090 0 0) 0x7f925c003230 con 0x7f92740b5c00 2021-01-03T13:01:38.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927a405700 1 -- 172.21.15.133:0/2291167826 >> v1:172.21.15.133:6789/0 conn(0x7f92740b5c00 legacy=0x7f92741475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927a405700 1 -- 172.21.15.133:0/2291167826 >> v1:172.21.15.16:6789/0 conn(0x7f92741442a0 legacy=0x7f92741446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927a405700 1 -- 172.21.15.133:0/2291167826 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927409a4f0 con 0x7f92740b5260 2021-01-03T13:01:38.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927a405700 1 --2- 172.21.15.133:0/2291167826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92740b5260 0x7f92741470b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f9270001110 tx=0x7f9268006dc0).ready entity=mon.0 client_cookie=389e7600f4315caa server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:38.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f9279403700 1 -- 172.21.15.133:0/2291167826 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9270001710 con 0x7f92740b5260 2021-01-03T13:01:38.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f9279403700 1 -- 172.21.15.133:0/2291167826 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926800d610 con 0x7f92740b5260 2021-01-03T13:01:38.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f9279403700 1 -- 172.21.15.133:0/2291167826 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f926800d780 con 0x7f92740b5260 2021-01-03T13:01:38.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927b407700 1 -- 172.21.15.133:0/2291167826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92740b5260 msgr2=0x7f92741470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927b407700 1 --2- 172.21.15.133:0/2291167826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92740b5260 0x7f92741470b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f9270001110 tx=0x7f9268006dc0).stop 2021-01-03T13:01:38.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927b407700 1 -- 172.21.15.133:0/2291167826 shutdown_connections 2021-01-03T13:01:38.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927b407700 1 --2- 172.21.15.133:0/2291167826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92740b5260 0x7f92741470b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927b407700 1 -- 172.21.15.133:0/2291167826 >> 172.21.15.133:0/2291167826 conn(0x7f927405bdf0 msgr2=0x7f927405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:38.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927b407700 1 -- 172.21.15.133:0/2291167826 shutdown_connections 2021-01-03T13:01:38.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.827+0000 7f927b407700 1 -- 172.21.15.133:0/2291167826 wait complete. 2021-01-03T13:01:38.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927b407700 1 Processor -- start 2021-01-03T13:01:38.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927b407700 1 -- start start 2021-01-03T13:01:38.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927b407700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92740b5260 0x7f92741456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:38.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927b407700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92740b5c00 0x7f9274066e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:38.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927b407700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92741442a0 0x7f927414da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:38.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927b407700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9274066670 con 0x7f92741442a0 2021-01-03T13:01:38.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927b407700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92740637e0 con 0x7f92740b5260 2021-01-03T13:01:38.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927b407700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9274064280 con 0x7f92740b5c00 2021-01-03T13:01:38.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927a405700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92740b5260 0x7f92741456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:38.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927a405700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92740b5260 0x7f92741456f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34514/0 (socket says 172.21.15.133:34514) 2021-01-03T13:01:38.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927a405700 1 -- 172.21.15.133:0/168333890 learned_addr learned my addr 172.21.15.133:0/168333890 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:38.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f9279c04700 1 --2- 172.21.15.133:0/168333890 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92740b5c00 0x7f9274066e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:38.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927ac06700 1 --2- 172.21.15.133:0/168333890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92741442a0 0x7f927414da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:38.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927a405700 1 -- 172.21.15.133:0/168333890 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92740b5c00 msgr2=0x7f9274066e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927a405700 1 --2- 172.21.15.133:0/168333890 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92740b5c00 0x7f9274066e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927a405700 1 -- 172.21.15.133:0/168333890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92741442a0 msgr2=0x7f927414da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927a405700 1 --2- 172.21.15.133:0/168333890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92741442a0 0x7f927414da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927a405700 1 -- 172.21.15.133:0/168333890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9274063540 con 0x7f92740b5260 2021-01-03T13:01:38.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.831+0000 7f927a405700 1 --2- 172.21.15.133:0/168333890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92740b5260 0x7f92741456f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f9274066dd0 tx=0x7f9268015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:38.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.835+0000 7f92677fe700 1 -- 172.21.15.133:0/168333890 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9268011790 con 0x7f92740b5260 2021-01-03T13:01:38.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.835+0000 7f92677fe700 1 -- 172.21.15.133:0/168333890 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92680118f0 con 0x7f92740b5260 2021-01-03T13:01:38.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.835+0000 7f92677fe700 1 -- 172.21.15.133:0/168333890 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9268011c90 con 0x7f92740b5260 2021-01-03T13:01:38.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.835+0000 7f927b407700 1 -- 172.21.15.133:0/168333890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9274065870 con 0x7f92740b5260 2021-01-03T13:01:38.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.835+0000 7f927b407700 1 -- 172.21.15.133:0/168333890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9274148450 con 0x7f92740b5260 2021-01-03T13:01:38.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.835+0000 7f927b407700 1 -- 172.21.15.133:0/168333890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9274065560 con 0x7f92740b5260 2021-01-03T13:01:38.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.835+0000 7f92677fe700 1 -- 172.21.15.133:0/168333890 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9268024030 con 0x7f92740b5260 2021-01-03T13:01:38.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.835+0000 7f92677fe700 1 --2- 172.21.15.133:0/168333890 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9254055330 0x7f92540577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:38.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.835+0000 7f92677fe700 1 -- 172.21.15.133:0/168333890 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f926806edc0 con 0x7f92740b5260 2021-01-03T13:01:38.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.835+0000 7f9279c04700 1 --2- 172.21.15.133:0/168333890 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9254055330 0x7f92540577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:38.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.839+0000 7f9279c04700 1 --2- 172.21.15.133:0/168333890 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9254055330 0x7f92540577f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f927000d000 tx=0x7f9270000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:38.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.843+0000 7f92677fe700 1 -- 172.21.15.133:0/168333890 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f92680450c0 con 0x7f92740b5260 2021-01-03T13:01:38.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.983+0000 7f927b407700 1 -- 172.21.15.133:0/168333890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9274065a00 con 0x7f92740b5260 2021-01-03T13:01:38.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.983+0000 7f92677fe700 1 -- 172.21.15.133:0/168333890 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9268022070 con 0x7f92740b5260 2021-01-03T13:01:38.982 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:01:38.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.987+0000 7f927b407700 1 -- 172.21.15.133:0/168333890 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9254055330 msgr2=0x7f92540577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.987+0000 7f927b407700 1 --2- 172.21.15.133:0/168333890 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9254055330 0x7f92540577f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f927000d000 tx=0x7f9270000b80).stop 2021-01-03T13:01:38.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.987+0000 7f927b407700 1 -- 172.21.15.133:0/168333890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92740b5260 msgr2=0x7f92741456f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:38.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.987+0000 7f927b407700 1 --2- 172.21.15.133:0/168333890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92740b5260 0x7f92741456f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f9274066dd0 tx=0x7f9268015000).stop 2021-01-03T13:01:38.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.987+0000 7f927b407700 1 -- 172.21.15.133:0/168333890 shutdown_connections 2021-01-03T13:01:38.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.987+0000 7f927b407700 1 --2- 172.21.15.133:0/168333890 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9254055330 0x7f92540577f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.987+0000 7f927b407700 1 --2- 172.21.15.133:0/168333890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92741442a0 0x7f927414da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.987+0000 7f927b407700 1 --2- 172.21.15.133:0/168333890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92740b5260 0x7f92741456f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.987+0000 7f927b407700 1 --2- 172.21.15.133:0/168333890 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92740b5c00 0x7f9274066e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:38.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.987+0000 7f927b407700 1 -- 172.21.15.133:0/168333890 >> 172.21.15.133:0/168333890 conn(0x7f927405bdf0 msgr2=0x7f92740b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:38.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.987+0000 7f927b407700 1 -- 172.21.15.133:0/168333890 shutdown_connections 2021-01-03T13:01:38.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:38.987+0000 7f927b407700 1 -- 172.21.15.133:0/168333890 wait complete. 2021-01-03T13:01:38.996 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:01:39.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.111+0000 7f1d53fff700 1 Processor -- start 2021-01-03T13:01:39.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.111+0000 7f1d53fff700 1 -- start start 2021-01-03T13:01:39.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.111+0000 7f1d53fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1d5405c130 0x7f1d540b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.111+0000 7f1d53fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1d540b02b0 0x7f1d540b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.111+0000 7f1d53fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1d540622f0 0x7f1d540668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d53fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d541473d0 con 0x7f1d540622f0 2021-01-03T13:01:39.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d53fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d540b0ab0 con 0x7f1d5405c130 2021-01-03T13:01:39.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d53fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5405c510 con 0x7f1d540b02b0 2021-01-03T13:01:39.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d52ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1d5405c130 0x7f1d540b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d52ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1d5405c130 0x7f1d540b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34522/0 (socket says 172.21.15.133:34522) 2021-01-03T13:01:39.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d52ffd700 1 -- 172.21.15.133:0/3581302821 learned_addr learned my addr 172.21.15.133:0/3581302821 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:39.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d527fc700 1 --2- 172.21.15.133:0/3581302821 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1d540b02b0 0x7f1d540b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d537fe700 1 --2- 172.21.15.133:0/3581302821 >> v2:172.21.15.16:3300/0 conn(0x7f1d540622f0 0x7f1d540668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d52ffd700 1 -- 172.21.15.133:0/3581302821 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1d540b02b0 msgr2=0x7f1d540b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:39.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d52ffd700 1 --2- 172.21.15.133:0/3581302821 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1d540b02b0 0x7f1d540b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d52ffd700 1 -- 172.21.15.133:0/3581302821 >> v2:172.21.15.16:3300/0 conn(0x7f1d540622f0 msgr2=0x7f1d540668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:39.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d52ffd700 1 --2- 172.21.15.133:0/3581302821 >> v2:172.21.15.16:3300/0 conn(0x7f1d540622f0 0x7f1d540668a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d52ffd700 1 -- 172.21.15.133:0/3581302821 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d540b15a0 con 0x7f1d5405c130 2021-01-03T13:01:39.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d52ffd700 1 --2- 172.21.15.133:0/3581302821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d5405c130 0x7f1d540b1a00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f1d44002f30 tx=0x7f1d44006e80).ready entity=mon.1 client_cookie=c0dbd3bfbce98a2b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:39.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d51ffb700 1 -- 172.21.15.133:0/3581302821 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d44009640 con 0x7f1d5405c130 2021-01-03T13:01:39.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d51ffb700 1 -- 172.21.15.133:0/3581302821 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d440097a0 con 0x7f1d5405c130 2021-01-03T13:01:39.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d51ffb700 1 -- 172.21.15.133:0/3581302821 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d44009b00 con 0x7f1d5405c130 2021-01-03T13:01:39.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d53fff700 1 -- 172.21.15.133:0/3581302821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d5405c130 msgr2=0x7f1d540b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:39.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d53fff700 1 --2- 172.21.15.133:0/3581302821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d5405c130 0x7f1d540b1a00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f1d44002f30 tx=0x7f1d44006e80).stop 2021-01-03T13:01:39.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d53fff700 1 -- 172.21.15.133:0/3581302821 shutdown_connections 2021-01-03T13:01:39.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d53fff700 1 --2- 172.21.15.133:0/3581302821 >> v2:172.21.15.16:3300/0 conn(0x7f1d540622f0 0x7f1d540668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d53fff700 1 --2- 172.21.15.133:0/3581302821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d5405c130 0x7f1d540b1a00 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d53fff700 1 --2- 172.21.15.133:0/3581302821 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1d540b02b0 0x7f1d540b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d53fff700 1 -- 172.21.15.133:0/3581302821 >> 172.21.15.133:0/3581302821 conn(0x7f1d540b6110 msgr2=0x7f1d540b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:39.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d53fff700 1 -- 172.21.15.133:0/3581302821 shutdown_connections 2021-01-03T13:01:39.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.115+0000 7f1d53fff700 1 -- 172.21.15.133:0/3581302821 wait complete. 2021-01-03T13:01:39.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d53fff700 1 Processor -- start 2021-01-03T13:01:39.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d53fff700 1 -- start start 2021-01-03T13:01:39.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d53fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d5405c130 0x7f1d540af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d53fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d540622f0 0x7f1d54155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d53fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1d540b02b0 0x7f1d54155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d53fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5414f880 con 0x7f1d540622f0 2021-01-03T13:01:39.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d53fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d54155200 con 0x7f1d5405c130 2021-01-03T13:01:39.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d53fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d54156040 con 0x7f1d540b02b0 2021-01-03T13:01:39.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d52ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d5405c130 0x7f1d540af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d52ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d5405c130 0x7f1d540af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34528/0 (socket says 172.21.15.133:34528) 2021-01-03T13:01:39.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d52ffd700 1 -- 172.21.15.133:0/4069146157 learned_addr learned my addr 172.21.15.133:0/4069146157 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:39.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d537fe700 1 --2- 172.21.15.133:0/4069146157 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1d540b02b0 0x7f1d54155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d527fc700 1 --2- 172.21.15.133:0/4069146157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d540622f0 0x7f1d54155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d52ffd700 1 -- 172.21.15.133:0/4069146157 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1d540b02b0 msgr2=0x7f1d54155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:39.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d52ffd700 1 --2- 172.21.15.133:0/4069146157 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1d540b02b0 0x7f1d54155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d52ffd700 1 -- 172.21.15.133:0/4069146157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d540622f0 msgr2=0x7f1d54155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:39.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d52ffd700 1 --2- 172.21.15.133:0/4069146157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d540622f0 0x7f1d54155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d52ffd700 1 -- 172.21.15.133:0/4069146157 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d540641c0 con 0x7f1d5405c130 2021-01-03T13:01:39.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d537fe700 1 --2- 172.21.15.133:0/4069146157 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1d540b02b0 0x7f1d54155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:01:39.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d527fc700 1 --2- 172.21.15.133:0/4069146157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d540622f0 0x7f1d54155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:01:39.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d52ffd700 1 --2- 172.21.15.133:0/4069146157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d5405c130 0x7f1d540af770 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f1d540a2fe0 tx=0x7f1d44015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:39.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d43fff700 1 -- 172.21.15.133:0/4069146157 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d44011ba0 con 0x7f1d5405c130 2021-01-03T13:01:39.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d43fff700 1 -- 172.21.15.133:0/4069146157 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d44011d00 con 0x7f1d5405c130 2021-01-03T13:01:39.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d53fff700 1 -- 172.21.15.133:0/4069146157 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d54064460 con 0x7f1d5405c130 2021-01-03T13:01:39.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d43fff700 1 -- 172.21.15.133:0/4069146157 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d4401d640 con 0x7f1d5405c130 2021-01-03T13:01:39.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.119+0000 7f1d53fff700 1 -- 172.21.15.133:0/4069146157 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d540a4010 con 0x7f1d5405c130 2021-01-03T13:01:39.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.123+0000 7f1d53fff700 1 -- 172.21.15.133:0/4069146157 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d54057300 con 0x7f1d5405c130 2021-01-03T13:01:39.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.123+0000 7f1d43fff700 1 -- 172.21.15.133:0/4069146157 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1d4400f070 con 0x7f1d5405c130 2021-01-03T13:01:39.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.123+0000 7f1d43fff700 1 --2- 172.21.15.133:0/4069146157 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1d30055330 0x7f1d300577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.123+0000 7f1d43fff700 1 -- 172.21.15.133:0/4069146157 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1d4406f900 con 0x7f1d5405c130 2021-01-03T13:01:39.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.123+0000 7f1d527fc700 1 --2- 172.21.15.133:0/4069146157 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1d30055330 0x7f1d300577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.123+0000 7f1d527fc700 1 --2- 172.21.15.133:0/4069146157 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1d30055330 0x7f1d300577f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f1d4800b000 tx=0x7f1d48008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:39.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.127+0000 7f1d43fff700 1 -- 172.21.15.133:0/4069146157 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1d44045c00 con 0x7f1d5405c130 2021-01-03T13:01:39.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.267+0000 7f1d53fff700 1 -- 172.21.15.133:0/4069146157 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d54155390 con 0x7f1d5405c130 2021-01-03T13:01:39.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.267+0000 7f1d43fff700 1 -- 172.21.15.133:0/4069146157 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+10 (secure 0 0 0) 0x7f1d44049220 con 0x7f1d5405c130 2021-01-03T13:01:39.267 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:01:39.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.271+0000 7f1d53fff700 1 -- 172.21.15.133:0/4069146157 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1d30055330 msgr2=0x7f1d300577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:39.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.271+0000 7f1d53fff700 1 --2- 172.21.15.133:0/4069146157 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1d30055330 0x7f1d300577f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f1d4800b000 tx=0x7f1d48008040).stop 2021-01-03T13:01:39.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.271+0000 7f1d53fff700 1 -- 172.21.15.133:0/4069146157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d5405c130 msgr2=0x7f1d540af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:39.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.271+0000 7f1d53fff700 1 --2- 172.21.15.133:0/4069146157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d5405c130 0x7f1d540af770 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f1d540a2fe0 tx=0x7f1d44015000).stop 2021-01-03T13:01:39.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.271+0000 7f1d53fff700 1 -- 172.21.15.133:0/4069146157 shutdown_connections 2021-01-03T13:01:39.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.271+0000 7f1d53fff700 1 --2- 172.21.15.133:0/4069146157 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1d30055330 0x7f1d300577f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.271+0000 7f1d53fff700 1 --2- 172.21.15.133:0/4069146157 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1d540b02b0 0x7f1d54155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.271+0000 7f1d53fff700 1 --2- 172.21.15.133:0/4069146157 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d5405c130 0x7f1d540af770 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.271+0000 7f1d53fff700 1 --2- 172.21.15.133:0/4069146157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1d540622f0 0x7f1d54155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.271+0000 7f1d53fff700 1 -- 172.21.15.133:0/4069146157 >> 172.21.15.133:0/4069146157 conn(0x7f1d540b6110 msgr2=0x7f1d54142870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:39.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.271+0000 7f1d53fff700 1 -- 172.21.15.133:0/4069146157 shutdown_connections 2021-01-03T13:01:39.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.271+0000 7f1d53fff700 1 -- 172.21.15.133:0/4069146157 wait complete. 2021-01-03T13:01:39.280 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:01:39.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fec85e700 1 Processor -- start 2021-01-03T13:01:39.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fec85e700 1 -- start start 2021-01-03T13:01:39.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fec85e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2fe80b7ab0 0x7f2fe8146300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fec85e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2fe80b2990 0x7f2fe80b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fec85e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe81467f0 con 0x7f2fe80b34e0 2021-01-03T13:01:39.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fec85e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe80b30f0 con 0x7f2fe80b2990 2021-01-03T13:01:39.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fec85e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe8061480 con 0x7f2fe80b7ab0 2021-01-03T13:01:39.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fe77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2fe80b7ab0 0x7f2fe8146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fe77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2fe80b7ab0 0x7f2fe8146300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34536/0 (socket says 172.21.15.133:34536) 2021-01-03T13:01:39.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fe77fe700 1 -- 172.21.15.133:0/4197010444 learned_addr learned my addr 172.21.15.133:0/4197010444 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:39.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fe6ffd700 1 --2- 172.21.15.133:0/4197010444 >> v2:172.21.15.16:3300/0 conn(0x7f2fe80b2990 0x7f2fe80b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fe77fe700 1 -- 172.21.15.133:0/4197010444 >> v2:172.21.15.16:3300/0 conn(0x7f2fe80b2990 msgr2=0x7f2fe80b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:39.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fe77fe700 1 --2- 172.21.15.133:0/4197010444 >> v2:172.21.15.16:3300/0 conn(0x7f2fe80b2990 0x7f2fe80b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fe77fe700 1 -- 172.21.15.133:0/4197010444 >> v1:172.21.15.16:6789/0 conn(0x7f2fe80b34e0 legacy=0x7f2fe8140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:39.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fe77fe700 1 -- 172.21.15.133:0/4197010444 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe8061720 con 0x7f2fe80b7ab0 2021-01-03T13:01:39.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fe77fe700 1 --2- 172.21.15.133:0/4197010444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fe80b7ab0 0x7f2fe8146300 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f2fd00032b0 tx=0x7f2fd0009270).ready entity=mon.1 client_cookie=81d975604fee5e7c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:39.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fe67fc700 1 -- 172.21.15.133:0/4197010444 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd0009e60 con 0x7f2fe80b7ab0 2021-01-03T13:01:39.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fe67fc700 1 -- 172.21.15.133:0/4197010444 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd000bc00 con 0x7f2fe80b7ab0 2021-01-03T13:01:39.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fe67fc700 1 -- 172.21.15.133:0/4197010444 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd000bd70 con 0x7f2fe80b7ab0 2021-01-03T13:01:39.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fec85e700 1 -- 172.21.15.133:0/4197010444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fe80b7ab0 msgr2=0x7f2fe8146300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:39.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fec85e700 1 --2- 172.21.15.133:0/4197010444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fe80b7ab0 0x7f2fe8146300 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f2fd00032b0 tx=0x7f2fd0009270).stop 2021-01-03T13:01:39.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fec85e700 1 -- 172.21.15.133:0/4197010444 shutdown_connections 2021-01-03T13:01:39.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fec85e700 1 --2- 172.21.15.133:0/4197010444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fe80b7ab0 0x7f2fe8146300 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fec85e700 1 --2- 172.21.15.133:0/4197010444 >> v2:172.21.15.16:3300/0 conn(0x7f2fe80b2990 0x7f2fe80b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fec85e700 1 -- 172.21.15.133:0/4197010444 >> 172.21.15.133:0/4197010444 conn(0x7f2fe805c8c0 msgr2=0x7f2fe80b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:39.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fec85e700 1 -- 172.21.15.133:0/4197010444 shutdown_connections 2021-01-03T13:01:39.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.399+0000 7f2fec85e700 1 -- 172.21.15.133:0/4197010444 wait complete. 2021-01-03T13:01:39.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fec85e700 1 Processor -- start 2021-01-03T13:01:39.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fec85e700 1 -- start start 2021-01-03T13:01:39.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fec85e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fe80b2990 0x7f2fe80ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fec85e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fe80b34e0 0x7f2fe80b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fec85e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2fe80b7ab0 0x7f2fe80aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fec85e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe80b1560 con 0x7f2fe80b34e0 2021-01-03T13:01:39.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fec85e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe80b0c20 con 0x7f2fe80b2990 2021-01-03T13:01:39.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fec85e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe8149700 con 0x7f2fe80b7ab0 2021-01-03T13:01:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fe77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fe80b2990 0x7f2fe80ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fe77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fe80b2990 0x7f2fe80ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34542/0 (socket says 172.21.15.133:34542) 2021-01-03T13:01:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fe77fe700 1 -- 172.21.15.133:0/3661146747 learned_addr learned my addr 172.21.15.133:0/3661146747 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:39.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fe7fff700 1 --2- 172.21.15.133:0/3661146747 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2fe80b7ab0 0x7f2fe80aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fe6ffd700 1 --2- 172.21.15.133:0/3661146747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fe80b34e0 0x7f2fe80b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fe77fe700 1 -- 172.21.15.133:0/3661146747 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2fe80b7ab0 msgr2=0x7f2fe80aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:39.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fe77fe700 1 --2- 172.21.15.133:0/3661146747 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2fe80b7ab0 0x7f2fe80aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fe77fe700 1 -- 172.21.15.133:0/3661146747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fe80b34e0 msgr2=0x7f2fe80b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:39.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fe77fe700 1 --2- 172.21.15.133:0/3661146747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fe80b34e0 0x7f2fe80b1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fe77fe700 1 -- 172.21.15.133:0/3661146747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe81499a0 con 0x7f2fe80b2990 2021-01-03T13:01:39.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fe77fe700 1 --2- 172.21.15.133:0/3661146747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fe80b2990 0x7f2fe80ae8b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f2fd00032b0 tx=0x7f2fd0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:39.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fe4ff9700 1 -- 172.21.15.133:0/3661146747 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd001f5e0 con 0x7f2fe80b2990 2021-01-03T13:01:39.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fe4ff9700 1 -- 172.21.15.133:0/3661146747 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd001f740 con 0x7f2fe80b2990 2021-01-03T13:01:39.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fec85e700 1 -- 172.21.15.133:0/3661146747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe8149440 con 0x7f2fe80b2990 2021-01-03T13:01:39.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fe4ff9700 1 -- 172.21.15.133:0/3661146747 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fd001faa0 con 0x7f2fe80b2990 2021-01-03T13:01:39.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.403+0000 7f2fec85e700 1 -- 172.21.15.133:0/3661146747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe80b0430 con 0x7f2fe80b2990 2021-01-03T13:01:39.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.407+0000 7f2fec85e700 1 -- 172.21.15.133:0/3661146747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe80b0d60 con 0x7f2fe80b2990 2021-01-03T13:01:39.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.407+0000 7f2fe4ff9700 1 -- 172.21.15.133:0/3661146747 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2fd0026030 con 0x7f2fe80b2990 2021-01-03T13:01:39.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.407+0000 7f2fe4ff9700 1 --2- 172.21.15.133:0/3661146747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2fc0055440 0x7f2fc0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.407+0000 7f2fe6ffd700 1 --2- 172.21.15.133:0/3661146747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2fc0055440 0x7f2fc0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.407+0000 7f2fe4ff9700 1 -- 172.21.15.133:0/3661146747 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2fd006ed60 con 0x7f2fe80b2990 2021-01-03T13:01:39.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.407+0000 7f2fe6ffd700 1 --2- 172.21.15.133:0/3661146747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2fc0055440 0x7f2fc0057900 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f2fd8006000 tx=0x7f2fd8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:39.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.411+0000 7f2fe4ff9700 1 -- 172.21.15.133:0/3661146747 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2fd0045060 con 0x7f2fe80b2990 2021-01-03T13:01:39.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.551+0000 7f2fec85e700 1 -- 172.21.15.133:0/3661146747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2fe8057300 con 0x7f2fe80b2990 2021-01-03T13:01:39.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.551+0000 7f2fe4ff9700 1 -- 172.21.15.133:0/3661146747 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2fd0024020 con 0x7f2fe80b2990 2021-01-03T13:01:39.549 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:01:39.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.555+0000 7f2fec85e700 1 -- 172.21.15.133:0/3661146747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2fc0055440 msgr2=0x7f2fc0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:39.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.555+0000 7f2fec85e700 1 --2- 172.21.15.133:0/3661146747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2fc0055440 0x7f2fc0057900 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f2fd8006000 tx=0x7f2fd8008040).stop 2021-01-03T13:01:39.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.555+0000 7f2fec85e700 1 -- 172.21.15.133:0/3661146747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fe80b2990 msgr2=0x7f2fe80ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:39.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.555+0000 7f2fec85e700 1 --2- 172.21.15.133:0/3661146747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fe80b2990 0x7f2fe80ae8b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f2fd00032b0 tx=0x7f2fd0016000).stop 2021-01-03T13:01:39.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.555+0000 7f2fec85e700 1 -- 172.21.15.133:0/3661146747 shutdown_connections 2021-01-03T13:01:39.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.555+0000 7f2fec85e700 1 --2- 172.21.15.133:0/3661146747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2fc0055440 0x7f2fc0057900 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.555+0000 7f2fec85e700 1 --2- 172.21.15.133:0/3661146747 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2fe80b7ab0 0x7f2fe80aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.555+0000 7f2fec85e700 1 --2- 172.21.15.133:0/3661146747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fe80b2990 0x7f2fe80ae8b0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.555+0000 7f2fec85e700 1 --2- 172.21.15.133:0/3661146747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fe80b34e0 0x7f2fe80b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.555+0000 7f2fec85e700 1 -- 172.21.15.133:0/3661146747 >> 172.21.15.133:0/3661146747 conn(0x7f2fe805c8c0 msgr2=0x7f2fe80b70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:39.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.555+0000 7f2fec85e700 1 -- 172.21.15.133:0/3661146747 shutdown_connections 2021-01-03T13:01:39.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.555+0000 7f2fec85e700 1 -- 172.21.15.133:0/3661146747 wait complete. 2021-01-03T13:01:39.563 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:01:39.564 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:01:39.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c53fff700 1 Processor -- start 2021-01-03T13:01:39.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c53fff700 1 -- start start 2021-01-03T13:01:39.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c53fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c540b52c0 0x7f1c540b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c53fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1c540b5c00 0x7f1c54143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c53fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c54060da0 con 0x7f1c540b0c90 2021-01-03T13:01:39.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c53fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c54067a90 con 0x7f1c540b52c0 2021-01-03T13:01:39.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c53fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c540b0ad0 con 0x7f1c540b5c00 2021-01-03T13:01:39.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c52ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c540b52c0 0x7f1c540b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c52ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c540b52c0 0x7f1c540b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34550/0 (socket says 172.21.15.133:34550) 2021-01-03T13:01:39.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c52ffd700 1 -- 172.21.15.133:0/3410153706 learned_addr learned my addr 172.21.15.133:0/3410153706 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:39.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c527fc700 1 --1- 172.21.15.133:0/3410153706 >> v1:172.21.15.133:6789/0 conn(0x7f1c540b0c90 0x7f1c54098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55584/0 (socket says 172.21.15.133:55584) 2021-01-03T13:01:39.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c537fe700 1 --2- 172.21.15.133:0/3410153706 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1c540b5c00 0x7f1c54143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c52ffd700 1 -- 172.21.15.133:0/3410153706 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1c540b5c00 msgr2=0x7f1c54143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:39.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c52ffd700 1 --2- 172.21.15.133:0/3410153706 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1c540b5c00 0x7f1c54143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c52ffd700 1 -- 172.21.15.133:0/3410153706 >> v1:172.21.15.133:6789/0 conn(0x7f1c540b0c90 legacy=0x7f1c54098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:39.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c52ffd700 1 -- 172.21.15.133:0/3410153706 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c540b56a0 con 0x7f1c540b52c0 2021-01-03T13:01:39.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c52ffd700 1 --2- 172.21.15.133:0/3410153706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c540b52c0 0x7f1c540b05e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f1c440032b0 tx=0x7f1c44009270).ready entity=mon.1 client_cookie=103ce931dcf050c3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:39.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c51ffb700 1 -- 172.21.15.133:0/3410153706 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c4400bc00 con 0x7f1c540b52c0 2021-01-03T13:01:39.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c51ffb700 1 -- 172.21.15.133:0/3410153706 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4400bd60 con 0x7f1c540b52c0 2021-01-03T13:01:39.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c51ffb700 1 -- 172.21.15.133:0/3410153706 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c44011400 con 0x7f1c540b52c0 2021-01-03T13:01:39.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c53fff700 1 -- 172.21.15.133:0/3410153706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c540b52c0 msgr2=0x7f1c540b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:39.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c53fff700 1 --2- 172.21.15.133:0/3410153706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c540b52c0 0x7f1c540b05e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f1c440032b0 tx=0x7f1c44009270).stop 2021-01-03T13:01:39.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c53fff700 1 -- 172.21.15.133:0/3410153706 shutdown_connections 2021-01-03T13:01:39.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c53fff700 1 --2- 172.21.15.133:0/3410153706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c540b52c0 0x7f1c540b05e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c53fff700 1 --2- 172.21.15.133:0/3410153706 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1c540b5c00 0x7f1c54143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c53fff700 1 -- 172.21.15.133:0/3410153706 >> 172.21.15.133:0/3410153706 conn(0x7f1c5405bdf0 msgr2=0x7f1c5405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:39.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c53fff700 1 -- 172.21.15.133:0/3410153706 shutdown_connections 2021-01-03T13:01:39.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.679+0000 7f1c53fff700 1 -- 172.21.15.133:0/3410153706 wait complete. 2021-01-03T13:01:39.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.683+0000 7f1c53fff700 1 Processor -- start 2021-01-03T13:01:39.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.683+0000 7f1c53fff700 1 -- start start 2021-01-03T13:01:39.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c53fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1c540b0c90 0x7f1c540ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c53fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c540b52c0 0x7f1c54141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c53fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c540b5c00 0x7f1c54141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c53fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c54156480 con 0x7f1c540b5c00 2021-01-03T13:01:39.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c53fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c54156720 con 0x7f1c540b52c0 2021-01-03T13:01:39.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c53fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c541569c0 con 0x7f1c540b0c90 2021-01-03T13:01:39.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c527fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c540b52c0 0x7f1c54141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c527fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c540b52c0 0x7f1c54141790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34558/0 (socket says 172.21.15.133:34558) 2021-01-03T13:01:39.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c527fc700 1 -- 172.21.15.133:0/955754938 learned_addr learned my addr 172.21.15.133:0/955754938 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:39.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c52ffd700 1 --2- 172.21.15.133:0/955754938 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1c540b0c90 0x7f1c540ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c537fe700 1 --2- 172.21.15.133:0/955754938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c540b5c00 0x7f1c54141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c527fc700 1 -- 172.21.15.133:0/955754938 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1c540b0c90 msgr2=0x7f1c540ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:39.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c527fc700 1 --2- 172.21.15.133:0/955754938 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1c540b0c90 0x7f1c540ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c527fc700 1 -- 172.21.15.133:0/955754938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c540b5c00 msgr2=0x7f1c54141c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:39.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c527fc700 1 --2- 172.21.15.133:0/955754938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c540b5c00 0x7f1c54141c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c527fc700 1 -- 172.21.15.133:0/955754938 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c54156c60 con 0x7f1c540b52c0 2021-01-03T13:01:39.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c52ffd700 1 --2- 172.21.15.133:0/955754938 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1c540b0c90 0x7f1c540ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:01:39.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c527fc700 1 --2- 172.21.15.133:0/955754938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c540b52c0 0x7f1c54141790 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f1c54061fd0 tx=0x7f1c3c007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:39.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c4bfff700 1 -- 172.21.15.133:0/955754938 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c3c0072e0 con 0x7f1c540b52c0 2021-01-03T13:01:39.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c4bfff700 1 -- 172.21.15.133:0/955754938 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c005520 con 0x7f1c540b52c0 2021-01-03T13:01:39.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c53fff700 1 -- 172.21.15.133:0/955754938 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c54156090 con 0x7f1c540b52c0 2021-01-03T13:01:39.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c4bfff700 1 -- 172.21.15.133:0/955754938 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c3c005880 con 0x7f1c540b52c0 2021-01-03T13:01:39.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c53fff700 1 -- 172.21.15.133:0/955754938 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c54140590 con 0x7f1c540b52c0 2021-01-03T13:01:39.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c53fff700 1 -- 172.21.15.133:0/955754938 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c54156df0 con 0x7f1c540b52c0 2021-01-03T13:01:39.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c4bfff700 1 -- 172.21.15.133:0/955754938 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1c3c01a060 con 0x7f1c540b52c0 2021-01-03T13:01:39.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.687+0000 7f1c4bfff700 1 --2- 172.21.15.133:0/955754938 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1c380553b0 0x7f1c38057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:39.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.691+0000 7f1c4bfff700 1 -- 172.21.15.133:0/955754938 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1c3c06d310 con 0x7f1c540b52c0 2021-01-03T13:01:39.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.691+0000 7f1c52ffd700 1 --2- 172.21.15.133:0/955754938 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1c380553b0 0x7f1c38057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:39.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.691+0000 7f1c52ffd700 1 --2- 172.21.15.133:0/955754938 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1c380553b0 0x7f1c38057870 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f1c44018000 tx=0x7f1c44016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:39.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.695+0000 7f1c4bfff700 1 -- 172.21.15.133:0/955754938 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1c3c043610 con 0x7f1c540b52c0 2021-01-03T13:01:39.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.871+0000 7f1c53fff700 1 -- 172.21.15.133:0/955754938 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c54057300 con 0x7f1c540b52c0 2021-01-03T13:01:39.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.875+0000 7f1c4bfff700 1 -- 172.21.15.133:0/955754938 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f1c3c018020 con 0x7f1c540b52c0 2021-01-03T13:01:39.872 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:01:39.872 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/2812725713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2812725713},{"type":"v1","addr":"172.21.15.16:6833","nonce":2812725713}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1096331942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1096331942},{"type":"v1","addr":"172.21.15.133:6835","nonce":1096331942}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:01:34.953831+0000","modified":"2021-01-03T13:01:35.958148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5563},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5563":{"gid":5563,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/834098016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":834098016},{"type":"v1","addr":"172.21.15.133:6837","nonce":834098016}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-01-03T13:01:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.875+0000 7f1c53fff700 1 -- 172.21.15.133:0/955754938 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1c380553b0 msgr2=0x7f1c38057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.875+0000 7f1c53fff700 1 --2- 172.21.15.133:0/955754938 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1c380553b0 0x7f1c38057870 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f1c44018000 tx=0x7f1c44016000).stop 2021-01-03T13:01:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.875+0000 7f1c53fff700 1 -- 172.21.15.133:0/955754938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c540b52c0 msgr2=0x7f1c54141790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.875+0000 7f1c53fff700 1 --2- 172.21.15.133:0/955754938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c540b52c0 0x7f1c54141790 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f1c54061fd0 tx=0x7f1c3c007bd0).stop 2021-01-03T13:01:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.875+0000 7f1c53fff700 1 -- 172.21.15.133:0/955754938 shutdown_connections 2021-01-03T13:01:39.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.875+0000 7f1c53fff700 1 --2- 172.21.15.133:0/955754938 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1c380553b0 0x7f1c38057870 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.875+0000 7f1c53fff700 1 --2- 172.21.15.133:0/955754938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c540b5c00 0x7f1c54141c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.875+0000 7f1c53fff700 1 --2- 172.21.15.133:0/955754938 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1c540b0c90 0x7f1c540ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.875+0000 7f1c53fff700 1 --2- 172.21.15.133:0/955754938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c540b52c0 0x7f1c54141790 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:39.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.875+0000 7f1c53fff700 1 -- 172.21.15.133:0/955754938 >> 172.21.15.133:0/955754938 conn(0x7f1c5405bdf0 msgr2=0x7f1c54098e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:39.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.875+0000 7f1c53fff700 1 -- 172.21.15.133:0/955754938 shutdown_connections 2021-01-03T13:01:39.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:39.875+0000 7f1c53fff700 1 -- 172.21.15.133:0/955754938 wait complete. 2021-01-03T13:01:39.876 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 21 2021-01-03T13:01:40.191 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:01:34.953831+0000', 'modified': '2021-01-03T13:01:35.958148+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5563}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5563': {'gid': 5563, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/834098016', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 834098016}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 834098016}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:01:40.191 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:01:40.192 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T13:01:40.317 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":5563,"want_state":"up:active","state":"up:active","rank_uptime":5.3531193960000003,"mdsmap_epoch":21,"osdmap_epoch":55,"osdmap_epoch_barrier":54,"uptime":9.7501731379999992} 2021-01-03T13:01:40.318 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 5563, "mdsmap_epoch": 21, "osdmap_epoch": 55, "osdmap_epoch_barrier": 54, "rank_uptime": 5.353119396, "state": "up:active", "uptime": 9.750173138, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:01:40.319 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:01:40.319 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-01-03T13:01:40.319 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi007.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-01-03T13:01:40.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:01:40.322 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:01:40.329 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:01:40.382 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:01:40.383 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:01:40.440 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:01:40.442 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:01:40.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:01:40.443 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:01:40.488 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:01:40.489 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:01:40.532 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:01:40.549 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:01:40.549 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:01:40.605 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:01:40.606 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:01:40.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:01:40.607 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:01:40.610 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2021-01-03T13:01:40.607+0000 7fc385de90c0 -1 init, newargv = 0x55d194eab7f0 newargc=9 2021-01-03T13:01:40.610 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[11919]: starting ceph client 2021-01-03T13:01:40.621 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[11919]: starting fuse 2021-01-03T13:01:41.718 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:01:41.735 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:01:41.735 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:01:41.792 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:01:41.793 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:01:41.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:01:41.794 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:01:41.840 INFO:teuthology.orchestra.run.smithi007.stdout:50 2021-01-03T13:01:41.840 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:01:41.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:01:41.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo python3 -c ' 2021-01-03T13:01:41.842 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2021-01-03T13:01:41.842 DEBUG:teuthology.orchestra.run.smithi007:> import re 2021-01-03T13:01:41.843 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:01:41.843 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2021-01-03T13:01:41.843 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:01:41.844 DEBUG:teuthology.orchestra.run.smithi007:> def find_socket(client_name): 2021-01-03T13:01:41.844 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-01-03T13:01:41.845 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2021-01-03T13:01:41.845 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:01:41.845 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2021-01-03T13:01:41.846 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2021-01-03T13:01:41.846 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2021-01-03T13:01:41.847 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2021-01-03T13:01:41.847 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:01:41.847 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2021-01-03T13:01:41.848 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:01:41.848 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:01:41.848 DEBUG:teuthology.orchestra.run.smithi007:> return f 2021-01-03T13:01:41.849 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:01:41.849 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:01:41.850 DEBUG:teuthology.orchestra.run.smithi007:> print(find_socket("client.0")) 2021-01-03T13:01:41.850 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:01:41.932 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.11919.asok 2021-01-03T13:01:41.938 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.11919.asok 2021-01-03T13:01:41.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:01:41.939 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.11919.asok status 2021-01-03T13:01:42.038 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2021-01-03T13:01:42.039 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2021-01-03T13:01:42.039 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:01:42.039 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:01:42.039 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2021-01-03T13:01:42.039 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2021-01-03T13:01:42.040 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-01-03T13:01:42.040 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "11919", 2021-01-03T13:01:42.040 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2021-01-03T13:01:42.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:01:42.040 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2021-01-03T13:01:42.041 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2021-01-03T13:01:42.041 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5713, 2021-01-03T13:01:42.041 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2021-01-03T13:01:42.041 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2021-01-03T13:01:42.041 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2021-01-03T13:01:42.042 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 5713 2021-01-03T13:01:42.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:01:42.042 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:01:42.042 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:01:42.042 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:01:42.043 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1057807109 2021-01-03T13:01:42.043 INFO:teuthology.orchestra.run.smithi007.stdout: } 2021-01-03T13:01:42.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:01:42.043 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:01:42.043 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:01:42.043 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:01:42.044 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1057807109 2021-01-03T13:01:42.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:01:42.044 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.5713 172.21.15.7:0/1057807109", 2021-01-03T13:01:42.044 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "172.21.15.7:0/1057807109", 2021-01-03T13:01:42.044 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2021-01-03T13:01:42.045 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 21, 2021-01-03T13:01:42.045 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 55, 2021-01-03T13:01:42.045 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:01:42.045 INFO:teuthology.orchestra.run.smithi007.stdout: "blacklisted": false, 2021-01-03T13:01:42.045 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2021-01-03T13:01:42.046 INFO:teuthology.orchestra.run.smithi007.stdout:} 2021-01-03T13:01:42.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:01:42.048 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:01:42.048 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:01:42.055 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:01:42.055 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:01:42.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:01:42.056 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:01:42.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:01:42.114 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:01:42.115 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:01:42.161 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:01:42.161 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:01:42.162 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-01-03T13:01:42.163 DEBUG:teuthology.orchestra.run.smithi007:> import sys 2021-01-03T13:01:42.163 DEBUG:teuthology.orchestra.run.smithi007:> import time 2021-01-03T13:01:42.163 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:01:42.164 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:01:42.164 DEBUG:teuthology.orchestra.run.smithi007:> n = 1000 2021-01-03T13:01:42.165 DEBUG:teuthology.orchestra.run.smithi007:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-01-03T13:01:42.165 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:01:42.165 DEBUG:teuthology.orchestra.run.smithi007:> if not os.path.exists(os.path.dirname(abs_path)): 2021-01-03T13:01:42.166 DEBUG:teuthology.orchestra.run.smithi007:> os.makedirs(os.path.dirname(abs_path)) 2021-01-03T13:01:42.166 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:01:42.166 DEBUG:teuthology.orchestra.run.smithi007:> for i in range(0, n): 2021-01-03T13:01:42.167 DEBUG:teuthology.orchestra.run.smithi007:> fname = "{0}_{1}".format(abs_path, i) 2021-01-03T13:01:42.167 DEBUG:teuthology.orchestra.run.smithi007:> with open(fname, '"'"'w'"'"') as f: 2021-01-03T13:01:42.167 DEBUG:teuthology.orchestra.run.smithi007:> f.write('"'"'content'"'"') 2021-01-03T13:01:42.168 DEBUG:teuthology.orchestra.run.smithi007:> if True: 2021-01-03T13:01:42.168 DEBUG:teuthology.orchestra.run.smithi007:> f.flush() 2021-01-03T13:01:42.169 DEBUG:teuthology.orchestra.run.smithi007:> os.fsync(f.fileno()) 2021-01-03T13:01:42.169 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:01:54.889 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:01:55.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.011+0000 7f64d7e00700 1 Processor -- start 2021-01-03T13:01:55.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.011+0000 7f64d7e00700 1 -- start start 2021-01-03T13:01:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d7e00700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f64d00b5c10 0x7f64d00aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d7e00700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f64d00b0670 0x7f64d014a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d7e00700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d0098550 con 0x7f64d014acc0 2021-01-03T13:01:55.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d7e00700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d00b5ff0 con 0x7f64d00b5c10 2021-01-03T13:01:55.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d7e00700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d00b0b10 con 0x7f64d00b0670 2021-01-03T13:01:55.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d539b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f64d00b0670 0x7f64d014a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d539b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f64d00b0670 0x7f64d014a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34564/0 (socket says 172.21.15.133:34564) 2021-01-03T13:01:55.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d539b700 1 -- 172.21.15.133:0/3765108564 learned_addr learned my addr 172.21.15.133:0/3765108564 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:55.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d5b9c700 1 --2- 172.21.15.133:0/3765108564 >> v2:172.21.15.16:3300/0 conn(0x7f64d00b5c10 0x7f64d00aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d539b700 1 -- 172.21.15.133:0/3765108564 >> v2:172.21.15.16:3300/0 conn(0x7f64d00b5c10 msgr2=0x7f64d00aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:55.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d539b700 1 --2- 172.21.15.133:0/3765108564 >> v2:172.21.15.16:3300/0 conn(0x7f64d00b5c10 0x7f64d00aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d539b700 1 -- 172.21.15.133:0/3765108564 >> v1:172.21.15.16:6789/0 conn(0x7f64d014acc0 legacy=0x7f64d0144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:55.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d539b700 1 -- 172.21.15.133:0/3765108564 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d0098780 con 0x7f64d00b0670 2021-01-03T13:01:55.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d5b9c700 1 --2- 172.21.15.133:0/3765108564 >> v2:172.21.15.16:3300/0 conn(0x7f64d00b5c10 0x7f64d00aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:01:55.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d539b700 1 --2- 172.21.15.133:0/3765108564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d00b0670 0x7f64d014a7d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f64d006b250 tx=0x7f64c8009270).ready entity=mon.1 client_cookie=30b2dc191a551f7a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:55.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d4b9a700 1 -- 172.21.15.133:0/3765108564 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64c800bbc0 con 0x7f64d00b0670 2021-01-03T13:01:55.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d4b9a700 1 -- 172.21.15.133:0/3765108564 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c800bd20 con 0x7f64d00b0670 2021-01-03T13:01:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d4b9a700 1 -- 172.21.15.133:0/3765108564 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64c8011400 con 0x7f64d00b0670 2021-01-03T13:01:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d7e00700 1 -- 172.21.15.133:0/3765108564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d00b0670 msgr2=0x7f64d014a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d7e00700 1 --2- 172.21.15.133:0/3765108564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d00b0670 0x7f64d014a7d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f64d006b250 tx=0x7f64c8009270).stop 2021-01-03T13:01:55.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d7e00700 1 -- 172.21.15.133:0/3765108564 shutdown_connections 2021-01-03T13:01:55.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d7e00700 1 --2- 172.21.15.133:0/3765108564 >> v2:172.21.15.16:3300/0 conn(0x7f64d00b5c10 0x7f64d00aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d7e00700 1 --2- 172.21.15.133:0/3765108564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d00b0670 0x7f64d014a7d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d7e00700 1 -- 172.21.15.133:0/3765108564 >> 172.21.15.133:0/3765108564 conn(0x7f64d005c8c0 msgr2=0x7f64d00b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:55.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d7e00700 1 -- 172.21.15.133:0/3765108564 shutdown_connections 2021-01-03T13:01:55.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d7e00700 1 -- 172.21.15.133:0/3765108564 wait complete. 2021-01-03T13:01:55.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d7e00700 1 Processor -- start 2021-01-03T13:01:55.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.015+0000 7f64d7e00700 1 -- start start 2021-01-03T13:01:55.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d7e00700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d00b0670 0x7f64d0149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d7e00700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64d00b5c10 0x7f64d01433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d7e00700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64d014acc0 0x7f64d01438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d7e00700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00b4720 con 0x7f64d00b5c10 2021-01-03T13:01:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d7e00700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00adf70 con 0x7f64d00b0670 2021-01-03T13:01:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d7e00700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00ae210 con 0x7f64d014acc0 2021-01-03T13:01:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d5b9c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d00b0670 0x7f64d0149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d5b9c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d00b0670 0x7f64d0149890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34570/0 (socket says 172.21.15.133:34570) 2021-01-03T13:01:55.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d5b9c700 1 -- 172.21.15.133:0/2719614201 learned_addr learned my addr 172.21.15.133:0/2719614201 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:55.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d539b700 1 --2- 172.21.15.133:0/2719614201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64d00b5c10 0x7f64d01433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d639d700 1 --2- 172.21.15.133:0/2719614201 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64d014acc0 0x7f64d01438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d5b9c700 1 -- 172.21.15.133:0/2719614201 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64d014acc0 msgr2=0x7f64d01438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:55.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d5b9c700 1 --2- 172.21.15.133:0/2719614201 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64d014acc0 0x7f64d01438c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d5b9c700 1 -- 172.21.15.133:0/2719614201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64d00b5c10 msgr2=0x7f64d01433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:55.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d5b9c700 1 --2- 172.21.15.133:0/2719614201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64d00b5c10 0x7f64d01433d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d5b9c700 1 -- 172.21.15.133:0/2719614201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d00ae4b0 con 0x7f64d00b0670 2021-01-03T13:01:55.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d639d700 1 --2- 172.21.15.133:0/2719614201 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64d014acc0 0x7f64d01438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:01:55.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d5b9c700 1 --2- 172.21.15.133:0/2719614201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d00b0670 0x7f64d0149890 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f64d00adbf0 tx=0x7f64b8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:55.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64ceffd700 1 -- 172.21.15.133:0/2719614201 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64b8007710 con 0x7f64d00b0670 2021-01-03T13:01:55.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d7e00700 1 -- 172.21.15.133:0/2719614201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d00ae750 con 0x7f64d00b0670 2021-01-03T13:01:55.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64ceffd700 1 -- 172.21.15.133:0/2719614201 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b8007870 con 0x7f64d00b0670 2021-01-03T13:01:55.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d7e00700 1 -- 172.21.15.133:0/2719614201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d0143db0 con 0x7f64d00b0670 2021-01-03T13:01:55.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64ceffd700 1 -- 172.21.15.133:0/2719614201 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64b8007bd0 con 0x7f64d00b0670 2021-01-03T13:01:55.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64d7e00700 1 -- 172.21.15.133:0/2719614201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d0057300 con 0x7f64d00b0670 2021-01-03T13:01:55.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64ceffd700 1 -- 172.21.15.133:0/2719614201 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f64b8007d30 con 0x7f64d00b0670 2021-01-03T13:01:55.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64ceffd700 1 --2- 172.21.15.133:0/2719614201 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64b4055330 0x7f64b40577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.019+0000 7f64ceffd700 1 -- 172.21.15.133:0/2719614201 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f64b806e200 con 0x7f64d00b0670 2021-01-03T13:01:55.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.023+0000 7f64d539b700 1 --2- 172.21.15.133:0/2719614201 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64b4055330 0x7f64b40577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.023+0000 7f64d539b700 1 --2- 172.21.15.133:0/2719614201 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64b4055330 0x7f64b40577f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f64c8018000 tx=0x7f64c8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:55.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.031+0000 7f64ceffd700 1 -- 172.21.15.133:0/2719614201 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f64b8044400 con 0x7f64d00b0670 2021-01-03T13:01:55.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.223+0000 7f64d7e00700 1 -- 172.21.15.133:0/2719614201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64d00b56b0 con 0x7f64d00b0670 2021-01-03T13:01:55.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.223+0000 7f64ceffd700 1 -- 172.21.15.133:0/2719614201 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f64b8047a20 con 0x7f64d00b0670 2021-01-03T13:01:55.220 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:01:55.220 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/2812725713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2812725713},{"type":"v1","addr":"172.21.15.16:6833","nonce":2812725713}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1096331942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1096331942},{"type":"v1","addr":"172.21.15.133:6835","nonce":1096331942}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:01:34.953831+0000","modified":"2021-01-03T13:01:35.958148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5563},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5563":{"gid":5563,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/834098016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":834098016},{"type":"v1","addr":"172.21.15.133:6837","nonce":834098016}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-01-03T13:01:55.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.223+0000 7f64d7e00700 1 -- 172.21.15.133:0/2719614201 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64b4055330 msgr2=0x7f64b40577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:55.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.223+0000 7f64d7e00700 1 --2- 172.21.15.133:0/2719614201 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64b4055330 0x7f64b40577f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f64c8018000 tx=0x7f64c8016000).stop 2021-01-03T13:01:55.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.223+0000 7f64d7e00700 1 -- 172.21.15.133:0/2719614201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d00b0670 msgr2=0x7f64d0149890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:55.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.223+0000 7f64d7e00700 1 --2- 172.21.15.133:0/2719614201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d00b0670 0x7f64d0149890 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f64d00adbf0 tx=0x7f64b8008040).stop 2021-01-03T13:01:55.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.223+0000 7f64d7e00700 1 -- 172.21.15.133:0/2719614201 shutdown_connections 2021-01-03T13:01:55.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.223+0000 7f64d7e00700 1 --2- 172.21.15.133:0/2719614201 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64b4055330 0x7f64b40577f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.223+0000 7f64d7e00700 1 --2- 172.21.15.133:0/2719614201 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64d014acc0 0x7f64d01438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.223+0000 7f64d7e00700 1 --2- 172.21.15.133:0/2719614201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64d00b0670 0x7f64d0149890 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.223+0000 7f64d7e00700 1 --2- 172.21.15.133:0/2719614201 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64d00b5c10 0x7f64d01433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.223+0000 7f64d7e00700 1 -- 172.21.15.133:0/2719614201 >> 172.21.15.133:0/2719614201 conn(0x7f64d005c8c0 msgr2=0x7f64d00b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:55.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.223+0000 7f64d7e00700 1 -- 172.21.15.133:0/2719614201 shutdown_connections 2021-01-03T13:01:55.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.223+0000 7f64d7e00700 1 -- 172.21.15.133:0/2719614201 wait complete. 2021-01-03T13:01:55.225 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 21 2021-01-03T13:01:55.233 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_recall_max_caps 20 2021-01-03T13:01:55.342 INFO:teuthology.orchestra.run.smithi133.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-01-03T13:01:55.342 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-01-03T13:01:55.343 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:01:55.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8db77700 1 Processor -- start 2021-01-03T13:01:55.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8db77700 1 -- start start 2021-01-03T13:01:55.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8db77700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d880b9b60 0x7f8d880b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8db77700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d880b4980 0x7f8d880b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8db77700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8d88146430 0x7f8d881468c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8db77700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d880aed30 con 0x7f8d88146430 2021-01-03T13:01:55.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8db77700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d880605f0 con 0x7f8d880b9b60 2021-01-03T13:01:55.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8db77700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d880600b0 con 0x7f8d880b4980 2021-01-03T13:01:55.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8cb75700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d880b9b60 0x7f8d880b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8cb75700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d880b9b60 0x7f8d880b9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34578/0 (socket says 172.21.15.133:34578) 2021-01-03T13:01:55.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8cb75700 1 -- 172.21.15.133:0/3484500823 learned_addr learned my addr 172.21.15.133:0/3484500823 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:55.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8d376700 1 --2- 172.21.15.133:0/3484500823 >> v2:172.21.15.16:3300/0 conn(0x7f8d88146430 0x7f8d881468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d87fff700 1 --2- 172.21.15.133:0/3484500823 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d880b4980 0x7f8d880b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8cb75700 1 -- 172.21.15.133:0/3484500823 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d880b4980 msgr2=0x7f8d880b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:55.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8cb75700 1 --2- 172.21.15.133:0/3484500823 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d880b4980 0x7f8d880b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8cb75700 1 -- 172.21.15.133:0/3484500823 >> v2:172.21.15.16:3300/0 conn(0x7f8d88146430 msgr2=0x7f8d881468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:55.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8cb75700 1 --2- 172.21.15.133:0/3484500823 >> v2:172.21.15.16:3300/0 conn(0x7f8d88146430 0x7f8d881468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8cb75700 1 -- 172.21.15.133:0/3484500823 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d88060350 con 0x7f8d880b9b60 2021-01-03T13:01:55.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.455+0000 7f8d8cb75700 1 --2- 172.21.15.133:0/3484500823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d880b9b60 0x7f8d880b9f40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f8d78002f30 tx=0x7f8d78006e80).ready entity=mon.1 client_cookie=9369ceb5c15f455d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:55.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.459+0000 7f8d877fe700 1 -- 172.21.15.133:0/3484500823 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d78009640 con 0x7f8d880b9b60 2021-01-03T13:01:55.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.459+0000 7f8d877fe700 1 -- 172.21.15.133:0/3484500823 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d780097a0 con 0x7f8d880b9b60 2021-01-03T13:01:55.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.459+0000 7f8d877fe700 1 -- 172.21.15.133:0/3484500823 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d78009b00 con 0x7f8d880b9b60 2021-01-03T13:01:55.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.459+0000 7f8d8db77700 1 -- 172.21.15.133:0/3484500823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d880b9b60 msgr2=0x7f8d880b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.459+0000 7f8d8db77700 1 --2- 172.21.15.133:0/3484500823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d880b9b60 0x7f8d880b9f40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f8d78002f30 tx=0x7f8d78006e80).stop 2021-01-03T13:01:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.459+0000 7f8d8db77700 1 -- 172.21.15.133:0/3484500823 shutdown_connections 2021-01-03T13:01:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.459+0000 7f8d8db77700 1 --2- 172.21.15.133:0/3484500823 >> v2:172.21.15.16:3300/0 conn(0x7f8d88146430 0x7f8d881468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.459+0000 7f8d8db77700 1 --2- 172.21.15.133:0/3484500823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d880b9b60 0x7f8d880b9f40 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.459+0000 7f8d8db77700 1 --2- 172.21.15.133:0/3484500823 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d880b4980 0x7f8d880b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.459+0000 7f8d8db77700 1 -- 172.21.15.133:0/3484500823 >> 172.21.15.133:0/3484500823 conn(0x7f8d880b69e0 msgr2=0x7f8d880b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.459+0000 7f8d8db77700 1 -- 172.21.15.133:0/3484500823 shutdown_connections 2021-01-03T13:01:55.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.459+0000 7f8d8db77700 1 -- 172.21.15.133:0/3484500823 wait complete. 2021-01-03T13:01:55.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d8db77700 1 Processor -- start 2021-01-03T13:01:55.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d8db77700 1 -- start start 2021-01-03T13:01:55.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d8db77700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d880b4980 0x7f8d880b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d8db77700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d880b9b60 0x7f8d881430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d8db77700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d88146430 0x7f8d881435c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d8db77700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d88141a20 con 0x7f8d880b4980 2021-01-03T13:01:55.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d8db77700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8814f910 con 0x7f8d880b9b60 2021-01-03T13:01:55.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d8db77700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d881414e0 con 0x7f8d88146430 2021-01-03T13:01:55.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d87fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d880b9b60 0x7f8d881430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d87fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d880b9b60 0x7f8d881430d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34586/0 (socket says 172.21.15.133:34586) 2021-01-03T13:01:55.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d87fff700 1 -- 172.21.15.133:0/3785017663 learned_addr learned my addr 172.21.15.133:0/3785017663 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:55.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d8cb75700 1 --2- 172.21.15.133:0/3785017663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d880b4980 0x7f8d880b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d8d376700 1 --2- 172.21.15.133:0/3785017663 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d88146430 0x7f8d881435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d87fff700 1 -- 172.21.15.133:0/3785017663 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d88146430 msgr2=0x7f8d881435c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:55.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d87fff700 1 --2- 172.21.15.133:0/3785017663 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d88146430 0x7f8d881435c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d87fff700 1 -- 172.21.15.133:0/3785017663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d880b4980 msgr2=0x7f8d880b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:55.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d87fff700 1 --2- 172.21.15.133:0/3785017663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d880b4980 0x7f8d880b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d87fff700 1 -- 172.21.15.133:0/3785017663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d88141780 con 0x7f8d880b9b60 2021-01-03T13:01:55.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d87fff700 1 --2- 172.21.15.133:0/3785017663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d880b9b60 0x7f8d881430d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f8d7c00c000 tx=0x7f8d7c006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:55.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d85ffb700 1 -- 172.21.15.133:0/3785017663 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d7c00ca80 con 0x7f8d880b9b60 2021-01-03T13:01:55.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d85ffb700 1 -- 172.21.15.133:0/3785017663 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7c00cbe0 con 0x7f8d880b9b60 2021-01-03T13:01:55.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d8db77700 1 -- 172.21.15.133:0/3785017663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d88143ab0 con 0x7f8d880b9b60 2021-01-03T13:01:55.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d85ffb700 1 -- 172.21.15.133:0/3785017663 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d7c0123f0 con 0x7f8d880b9b60 2021-01-03T13:01:55.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.463+0000 7f8d8db77700 1 -- 172.21.15.133:0/3785017663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d88142680 con 0x7f8d880b9b60 2021-01-03T13:01:55.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.467+0000 7f8d8db77700 1 -- 172.21.15.133:0/3785017663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d88057300 con 0x7f8d880b9b60 2021-01-03T13:01:55.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.467+0000 7f8d85ffb700 1 -- 172.21.15.133:0/3785017663 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8d7c012550 con 0x7f8d880b9b60 2021-01-03T13:01:55.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.467+0000 7f8d85ffb700 1 --2- 172.21.15.133:0/3785017663 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d68055330 0x7f8d680577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.467+0000 7f8d85ffb700 1 -- 172.21.15.133:0/3785017663 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8d7c06e460 con 0x7f8d880b9b60 2021-01-03T13:01:55.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.467+0000 7f8d8cb75700 1 --2- 172.21.15.133:0/3785017663 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d68055330 0x7f8d680577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.467+0000 7f8d8cb75700 1 --2- 172.21.15.133:0/3785017663 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d68055330 0x7f8d680577f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f8d78019000 tx=0x7f8d78015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:55.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.475+0000 7f8d85ffb700 1 -- 172.21.15.133:0/3785017663 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8d7c044660 con 0x7f8d880b9b60 2021-01-03T13:01:55.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.675+0000 7f8d8db77700 1 -- 172.21.15.133:0/3785017663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d88145f80 con 0x7f8d880b9b60 2021-01-03T13:01:55.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.675+0000 7f8d85ffb700 1 -- 172.21.15.133:0/3785017663 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f8d7c047c80 con 0x7f8d880b9b60 2021-01-03T13:01:55.675 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:01:55.675 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/2812725713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2812725713},{"type":"v1","addr":"172.21.15.16:6833","nonce":2812725713}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1096331942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1096331942},{"type":"v1","addr":"172.21.15.133:6835","nonce":1096331942}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:01:34.953831+0000","modified":"2021-01-03T13:01:35.958148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5563},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5563":{"gid":5563,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/834098016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":834098016},{"type":"v1","addr":"172.21.15.133:6837","nonce":834098016}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-01-03T13:01:55.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.679+0000 7f8d8db77700 1 -- 172.21.15.133:0/3785017663 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d68055330 msgr2=0x7f8d680577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:55.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.679+0000 7f8d8db77700 1 --2- 172.21.15.133:0/3785017663 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d68055330 0x7f8d680577f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f8d78019000 tx=0x7f8d78015000).stop 2021-01-03T13:01:55.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.679+0000 7f8d8db77700 1 -- 172.21.15.133:0/3785017663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d880b9b60 msgr2=0x7f8d881430d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:55.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.679+0000 7f8d8db77700 1 --2- 172.21.15.133:0/3785017663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d880b9b60 0x7f8d881430d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f8d7c00c000 tx=0x7f8d7c006dc0).stop 2021-01-03T13:01:55.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.679+0000 7f8d8db77700 1 -- 172.21.15.133:0/3785017663 shutdown_connections 2021-01-03T13:01:55.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.679+0000 7f8d8db77700 1 --2- 172.21.15.133:0/3785017663 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d68055330 0x7f8d680577f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.679+0000 7f8d8db77700 1 --2- 172.21.15.133:0/3785017663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d880b4980 0x7f8d880b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.679+0000 7f8d8db77700 1 --2- 172.21.15.133:0/3785017663 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d88146430 0x7f8d881435c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.679+0000 7f8d8db77700 1 --2- 172.21.15.133:0/3785017663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d880b9b60 0x7f8d881430d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.679+0000 7f8d8db77700 1 -- 172.21.15.133:0/3785017663 >> 172.21.15.133:0/3785017663 conn(0x7f8d880b69e0 msgr2=0x7f8d88144ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:55.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.679+0000 7f8d8db77700 1 -- 172.21.15.133:0/3785017663 shutdown_connections 2021-01-03T13:01:55.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.679+0000 7f8d8db77700 1 -- 172.21.15.133:0/3785017663 wait complete. 2021-01-03T13:01:55.680 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 21 2021-01-03T13:01:55.687 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_recall_max_decay_threshold 400 2021-01-03T13:01:55.796 INFO:teuthology.orchestra.run.smithi133.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-01-03T13:01:55.796 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-01-03T13:01:55.797 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T13:01:55.815 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:01:55.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc53d555700 1 Processor -- start 2021-01-03T13:01:55.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc53d555700 1 -- start start 2021-01-03T13:01:55.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc53d555700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc5380b5c00 0x7fc5380b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc53d555700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc538060da0 con 0x7fc5380b52c0 2021-01-03T13:01:55.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc53d555700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5380b0ad0 con 0x7fc5380b0c90 2021-01-03T13:01:55.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc53d555700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc538067a90 con 0x7fc5380b5c00 2021-01-03T13:01:55.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc53cd54700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc5380b5c00 0x7fc5380b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc53cd54700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc5380b5c00 0x7fc5380b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34592/0 (socket says 172.21.15.133:34592) 2021-01-03T13:01:55.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc5377fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc5380b0c90 0x7fc538143eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55624/0 (socket says 172.21.15.133:55624) 2021-01-03T13:01:55.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc53cd54700 1 -- 172.21.15.133:0/292197995 learned_addr learned my addr 172.21.15.133:0/292197995 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:55.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc53cd54700 1 -- 172.21.15.133:0/292197995 >> v1:172.21.15.133:6789/0 conn(0x7fc5380b0c90 legacy=0x7fc538143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:55.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc53cd54700 1 -- 172.21.15.133:0/292197995 >> v1:172.21.15.16:6789/0 conn(0x7fc5380b52c0 legacy=0x7fc538098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:55.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc53cd54700 1 -- 172.21.15.133:0/292197995 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5380b56a0 con 0x7fc5380b5c00 2021-01-03T13:01:55.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc53cd54700 1 --2- 172.21.15.133:0/292197995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5380b5c00 0x7fc5380b05e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fc530001260 tx=0x7fc520006e80).ready entity=mon.1 client_cookie=c4eba12a7f98b044 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:55.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc536ffd700 1 -- 172.21.15.133:0/292197995 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc520009730 con 0x7fc5380b5c00 2021-01-03T13:01:55.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc536ffd700 1 -- 172.21.15.133:0/292197995 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc520009890 con 0x7fc5380b5c00 2021-01-03T13:01:55.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc536ffd700 1 -- 172.21.15.133:0/292197995 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc520009a00 con 0x7fc5380b5c00 2021-01-03T13:01:55.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc53d555700 1 -- 172.21.15.133:0/292197995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5380b5c00 msgr2=0x7fc5380b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:55.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.935+0000 7fc53d555700 1 --2- 172.21.15.133:0/292197995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5380b5c00 0x7fc5380b05e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fc530001260 tx=0x7fc520006e80).stop 2021-01-03T13:01:55.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc53d555700 1 -- 172.21.15.133:0/292197995 shutdown_connections 2021-01-03T13:01:55.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc53d555700 1 --2- 172.21.15.133:0/292197995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5380b5c00 0x7fc5380b05e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc53d555700 1 -- 172.21.15.133:0/292197995 >> 172.21.15.133:0/292197995 conn(0x7fc53805bdf0 msgr2=0x7fc53805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:55.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc53d555700 1 -- 172.21.15.133:0/292197995 shutdown_connections 2021-01-03T13:01:55.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc53d555700 1 -- 172.21.15.133:0/292197995 wait complete. 2021-01-03T13:01:55.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc53d555700 1 Processor -- start 2021-01-03T13:01:55.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc53d555700 1 -- start start 2021-01-03T13:01:55.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc53d555700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5380b0c90 0x7fc53814a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc53d555700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5380b52c0 0x7fc53814b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc53d555700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc5380b5c00 0x7fc5381565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc53d555700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc538156140 con 0x7fc5380b0c90 2021-01-03T13:01:55.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc53d555700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc538149c50 con 0x7fc5380b52c0 2021-01-03T13:01:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc53d555700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53814be50 con 0x7fc5380b5c00 2021-01-03T13:01:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc5377fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5380b52c0 0x7fc53814b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc5377fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5380b52c0 0x7fc53814b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34602/0 (socket says 172.21.15.133:34602) 2021-01-03T13:01:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc5377fe700 1 -- 172.21.15.133:0/1386215874 learned_addr learned my addr 172.21.15.133:0/1386215874 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc53cd54700 1 --2- 172.21.15.133:0/1386215874 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc5380b5c00 0x7fc5381565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc537fff700 1 --2- 172.21.15.133:0/1386215874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5380b0c90 0x7fc53814a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc5377fe700 1 -- 172.21.15.133:0/1386215874 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc5380b5c00 msgr2=0x7fc5381565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:55.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc5377fe700 1 --2- 172.21.15.133:0/1386215874 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc5380b5c00 0x7fc5381565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc5377fe700 1 -- 172.21.15.133:0/1386215874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5380b0c90 msgr2=0x7fc53814a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc5377fe700 1 --2- 172.21.15.133:0/1386215874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5380b0c90 0x7fc53814a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc5377fe700 1 -- 172.21.15.133:0/1386215874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc538149710 con 0x7fc5380b52c0 2021-01-03T13:01:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc537fff700 1 --2- 172.21.15.133:0/1386215874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5380b0c90 0x7fc53814a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:01:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc5377fe700 1 --2- 172.21.15.133:0/1386215874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5380b52c0 0x7fc53814b960 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fc53814bfe0 tx=0x7fc530001a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc5357fa700 1 -- 172.21.15.133:0/1386215874 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc530007320 con 0x7fc5380b52c0 2021-01-03T13:01:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc5357fa700 1 -- 172.21.15.133:0/1386215874 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53000a560 con 0x7fc5380b52c0 2021-01-03T13:01:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc53d555700 1 -- 172.21.15.133:0/1386215874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5381499b0 con 0x7fc5380b52c0 2021-01-03T13:01:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc5357fa700 1 -- 172.21.15.133:0/1386215874 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc53000a8c0 con 0x7fc5380b52c0 2021-01-03T13:01:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.939+0000 7fc53d555700 1 -- 172.21.15.133:0/1386215874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53814d300 con 0x7fc5380b52c0 2021-01-03T13:01:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.943+0000 7fc53d555700 1 -- 172.21.15.133:0/1386215874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5381562b0 con 0x7fc5380b52c0 2021-01-03T13:01:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.943+0000 7fc5357fa700 1 -- 172.21.15.133:0/1386215874 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc530010030 con 0x7fc5380b52c0 2021-01-03T13:01:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.943+0000 7fc5357fa700 1 --2- 172.21.15.133:0/1386215874 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc5100553b0 0x7fc510057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.943+0000 7fc5357fa700 1 -- 172.21.15.133:0/1386215874 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc53006de60 con 0x7fc5380b52c0 2021-01-03T13:01:55.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.943+0000 7fc537fff700 1 --2- 172.21.15.133:0/1386215874 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc5100553b0 0x7fc510057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:55.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.943+0000 7fc537fff700 1 --2- 172.21.15.133:0/1386215874 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc5100553b0 0x7fc510057870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fc52800b000 tx=0x7fc528009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:55.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:55.951+0000 7fc5357fa700 1 -- 172.21.15.133:0/1386215874 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc530044170 con 0x7fc5380b52c0 2021-01-03T13:01:56.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.131+0000 7fc53d555700 1 -- 172.21.15.133:0/1386215874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5380b0ad0 con 0x7fc5380b52c0 2021-01-03T13:01:56.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.131+0000 7fc5357fa700 1 -- 172.21.15.133:0/1386215874 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fc5380b0ad0 con 0x7fc5380b52c0 2021-01-03T13:01:56.131 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:01:56.131 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/2812725713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2812725713},{"type":"v1","addr":"172.21.15.16:6833","nonce":2812725713}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1096331942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1096331942},{"type":"v1","addr":"172.21.15.133:6835","nonce":1096331942}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:01:34.953831+0000","modified":"2021-01-03T13:01:35.958148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5563},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5563":{"gid":5563,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/834098016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":834098016},{"type":"v1","addr":"172.21.15.133:6837","nonce":834098016}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-01-03T13:01:56.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.135+0000 7fc53d555700 1 -- 172.21.15.133:0/1386215874 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc5100553b0 msgr2=0x7fc510057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:56.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.135+0000 7fc53d555700 1 --2- 172.21.15.133:0/1386215874 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc5100553b0 0x7fc510057870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fc52800b000 tx=0x7fc528009040).stop 2021-01-03T13:01:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.135+0000 7fc53d555700 1 -- 172.21.15.133:0/1386215874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5380b52c0 msgr2=0x7fc53814b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.135+0000 7fc53d555700 1 --2- 172.21.15.133:0/1386215874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5380b52c0 0x7fc53814b960 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fc53814bfe0 tx=0x7fc530001a90).stop 2021-01-03T13:01:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.135+0000 7fc53d555700 1 -- 172.21.15.133:0/1386215874 shutdown_connections 2021-01-03T13:01:56.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.135+0000 7fc53d555700 1 --2- 172.21.15.133:0/1386215874 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc5100553b0 0x7fc510057870 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.135+0000 7fc53d555700 1 --2- 172.21.15.133:0/1386215874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc5380b0c90 0x7fc53814a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.135+0000 7fc53d555700 1 --2- 172.21.15.133:0/1386215874 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc5380b5c00 0x7fc5381565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.135+0000 7fc53d555700 1 --2- 172.21.15.133:0/1386215874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc5380b52c0 0x7fc53814b960 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.135+0000 7fc53d555700 1 -- 172.21.15.133:0/1386215874 >> 172.21.15.133:0/1386215874 conn(0x7fc53805bdf0 msgr2=0x7fc5380b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:56.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.135+0000 7fc53d555700 1 -- 172.21.15.133:0/1386215874 shutdown_connections 2021-01-03T13:01:56.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.135+0000 7fc53d555700 1 -- 172.21.15.133:0/1386215874 wait complete. 2021-01-03T13:01:56.135 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 21 2021-01-03T13:01:56.144 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mds.c cache drop 5 2021-01-03T13:01:56.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.263+0000 7fa1a759e700 1 Processor -- start 2021-01-03T13:01:56.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.263+0000 7fa1a759e700 1 -- start start 2021-01-03T13:01:56.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a759e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1a80677a0 0x7fa1a8146c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a759e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a80adbd0 con 0x7fa1a80b0210 2021-01-03T13:01:56.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a8067b80 con 0x7fa1a80a9190 2021-01-03T13:01:56.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a759e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a805c920 con 0x7fa1a80677a0 2021-01-03T13:01:56.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a6d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa1a80a9190 0x7fa1a8142d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55642/0 (socket says 172.21.15.133:55642) 2021-01-03T13:01:56.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a6d9d700 1 -- 172.21.15.133:0/3837379009 learned_addr learned my addr 172.21.15.133:0/3837379009 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:01:56.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a659c700 1 --2- 172.21.15.133:0/3837379009 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1a80677a0 0x7fa1a8146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 -- 172.21.15.133:0/3837379009 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117881203 0 0) 0x7fa1a8067b80 con 0x7fa1a80a9190 2021-01-03T13:01:56.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 -- 172.21.15.133:0/3837379009 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa18c003230 con 0x7fa1a80a9190 2021-01-03T13:01:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 -- 172.21.15.133:0/3837379009 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1150167138 0 0) 0x7fa18c003230 con 0x7fa1a80a9190 2021-01-03T13:01:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 -- 172.21.15.133:0/3837379009 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1a80677a0 msgr2=0x7fa1a8146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:56.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 --2- 172.21.15.133:0/3837379009 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1a80677a0 0x7fa1a8146c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 -- 172.21.15.133:0/3837379009 >> v1:172.21.15.16:6789/0 conn(0x7fa1a80b0210 legacy=0x7fa1a80a8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:56.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 -- 172.21.15.133:0/3837379009 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a80ade00 con 0x7fa1a80a9190 2021-01-03T13:01:56.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 -- 172.21.15.133:0/3837379009 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fa1a0001aa0 con 0x7fa1a80a9190 2021-01-03T13:01:56.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 -- 172.21.15.133:0/3837379009 >> v1:172.21.15.133:6789/0 conn(0x7fa1a80a9190 legacy=0x7fa1a8142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:56.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 --2- 172.21.15.133:0/3837379009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa18c003720 0x7fa18c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 --2- 172.21.15.133:0/3837379009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa18c0044d0 0x7fa18c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 --2- 172.21.15.133:0/3837379009 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1a80677a0 0x7fa18c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 -- 172.21.15.133:0/3837379009 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c005350 con 0x7fa18c0044d0 2021-01-03T13:01:56.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 -- 172.21.15.133:0/3837379009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c0042b0 con 0x7fa18c003720 2021-01-03T13:01:56.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 -- 172.21.15.133:0/3837379009 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c00b720 con 0x7fa1a80677a0 2021-01-03T13:01:56.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a659c700 1 --2- 172.21.15.133:0/3837379009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa18c003720 0x7fa18c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a6d9d700 1 --2- 172.21.15.133:0/3837379009 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1a80677a0 0x7fa18c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a5d9b700 1 --2- 172.21.15.133:0/3837379009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa18c0044d0 0x7fa18c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a659c700 1 -- 172.21.15.133:0/3837379009 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1a80677a0 msgr2=0x7fa18c004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a659c700 1 --2- 172.21.15.133:0/3837379009 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1a80677a0 0x7fa18c004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a659c700 1 -- 172.21.15.133:0/3837379009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa18c0044d0 msgr2=0x7fa18c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a659c700 1 --2- 172.21.15.133:0/3837379009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa18c0044d0 0x7fa18c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a659c700 1 -- 172.21.15.133:0/3837379009 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c003230 con 0x7fa18c003720 2021-01-03T13:01:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a5d9b700 1 --2- 172.21.15.133:0/3837379009 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa18c0044d0 0x7fa18c004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:01:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a659c700 1 --2- 172.21.15.133:0/3837379009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa18c003720 0x7fa18c003b40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fa19800c000 tx=0x7fa198008040).ready entity=mon.1 client_cookie=ad147a2e8273dbab server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 -- 172.21.15.133:0/3837379009 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa19800e970 con 0x7fa18c003720 2021-01-03T13:01:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 -- 172.21.15.133:0/3837379009 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19800ead0 con 0x7fa18c003720 2021-01-03T13:01:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a559a700 1 -- 172.21.15.133:0/3837379009 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa19800ee30 con 0x7fa18c003720 2021-01-03T13:01:56.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a759e700 1 -- 172.21.15.133:0/3837379009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa18c003720 msgr2=0x7fa18c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:56.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a759e700 1 --2- 172.21.15.133:0/3837379009 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa18c003720 0x7fa18c003b40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fa19800c000 tx=0x7fa198008040).stop 2021-01-03T13:01:56.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a6d9d700 1 -- 172.21.15.133:0/3837379009 reap_dead start 2021-01-03T13:01:56.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a759e700 1 -- 172.21.15.133:0/3837379009 shutdown_connections 2021-01-03T13:01:56.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a759e700 1 -- 172.21.15.133:0/3837379009 >> 172.21.15.133:0/3837379009 conn(0x7fa1a806b050 msgr2=0x7fa1a8060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:56.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a759e700 1 -- 172.21.15.133:0/3837379009 shutdown_connections 2021-01-03T13:01:56.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.267+0000 7fa1a759e700 1 -- 172.21.15.133:0/3837379009 wait complete. 2021-01-03T13:01:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a759e700 1 Processor -- start 2021-01-03T13:01:56.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a759e700 1 -- start start 2021-01-03T13:01:56.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a759e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1a8155670 0x7fa1a8149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a759e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1a8155a50 0x7fa1a81472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1a8142680 0x7fa1a8151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a759e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a814a000 con 0x7fa1a8155a50 2021-01-03T13:01:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a8156190 con 0x7fa1a8142680 2021-01-03T13:01:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a759e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a8155f20 con 0x7fa1a8155670 2021-01-03T13:01:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1a8142680 0x7fa1a8151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1a8142680 0x7fa1a8151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34622/0 (socket says 172.21.15.133:34622) 2021-01-03T13:01:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a6d9d700 1 -- 172.21.15.133:0/2985468621 learned_addr learned my addr 172.21.15.133:0/2985468621 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a659c700 1 --2- 172.21.15.133:0/2985468621 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1a8155670 0x7fa1a8149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a5d9b700 1 --2- 172.21.15.133:0/2985468621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1a8155a50 0x7fa1a81472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a6d9d700 1 -- 172.21.15.133:0/2985468621 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1a8155670 msgr2=0x7fa1a8149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a6d9d700 1 --2- 172.21.15.133:0/2985468621 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1a8155670 0x7fa1a8149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a6d9d700 1 -- 172.21.15.133:0/2985468621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1a8155a50 msgr2=0x7fa1a81472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a6d9d700 1 --2- 172.21.15.133:0/2985468621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1a8155a50 0x7fa1a81472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a6d9d700 1 -- 172.21.15.133:0/2985468621 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a8141e70 con 0x7fa1a8142680 2021-01-03T13:01:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a5d9b700 1 --2- 172.21.15.133:0/2985468621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1a8155a50 0x7fa1a81472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:01:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a6d9d700 1 --2- 172.21.15.133:0/2985468621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1a8142680 0x7fa1a8151de0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fa1a0000b20 tx=0x7fa1a0007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa19f7fe700 1 -- 172.21.15.133:0/2985468621 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1a000fc30 con 0x7fa1a8142680 2021-01-03T13:01:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa19f7fe700 1 -- 172.21.15.133:0/2985468621 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a000fd90 con 0x7fa1a8142680 2021-01-03T13:01:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a759e700 1 -- 172.21.15.133:0/2985468621 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a8142110 con 0x7fa1a8142680 2021-01-03T13:01:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa19f7fe700 1 -- 172.21.15.133:0/2985468621 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1a0012540 con 0x7fa1a8142680 2021-01-03T13:01:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.271+0000 7fa1a759e700 1 -- 172.21.15.133:0/2985468621 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a8148d50 con 0x7fa1a8142680 2021-01-03T13:01:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.275+0000 7fa19f7fe700 1 -- 172.21.15.133:0/2985468621 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa1a001b030 con 0x7fa1a8142680 2021-01-03T13:01:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.275+0000 7fa19f7fe700 1 --2- 172.21.15.133:0/2985468621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa180055330 0x7fa1800577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.275+0000 7fa19f7fe700 1 -- 172.21.15.133:0/2985468621 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa1a006dad0 con 0x7fa1a8142680 2021-01-03T13:01:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.275+0000 7fa1a659c700 1 --2- 172.21.15.133:0/2985468621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa180055330 0x7fa1800577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.275+0000 7fa1a659c700 1 --2- 172.21.15.133:0/2985468621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa180055330 0x7fa1800577f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fa19801c000 tx=0x7fa19801a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1bb41e740 1 Processor -- start 2021-01-03T13:01:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1bb41e740 1 -- start start 2021-01-03T13:01:56.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1bb41e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1a49770 0x1a93ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1bb41e740 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x18b1820 0x1acbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1bb41e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1843c20 0x1acbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1bb41e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x19b7d80 con 0x1843c20 2021-01-03T13:01:56.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1bb41e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x18ca6b0 con 0x1a49770 2021-01-03T13:01:56.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1bb41e740 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x19ede20 con 0x18b1820 2021-01-03T13:01:56.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1a659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1a49770 0x1a93ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1a659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1a49770 0x1a93ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34626/0 (socket says 172.21.15.133:34626) 2021-01-03T13:01:56.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1a659c700 1 -- 172.21.15.133:0/1632403288 learned_addr learned my addr 172.21.15.133:0/1632403288 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:56.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1a5d9b700 1 --2- 172.21.15.133:0/1632403288 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x18b1820 0x1acbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1a6d9d700 1 --2- 172.21.15.133:0/1632403288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1843c20 0x1acbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1a659c700 1 -- 172.21.15.133:0/1632403288 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x18b1820 msgr2=0x1acbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:56.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1a659c700 1 --2- 172.21.15.133:0/1632403288 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x18b1820 0x1acbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1a659c700 1 -- 172.21.15.133:0/1632403288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1843c20 msgr2=0x1acbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:56.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1a659c700 1 --2- 172.21.15.133:0/1632403288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1843c20 0x1acbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1a659c700 1 -- 172.21.15.133:0/1632403288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x19cdd40 con 0x1a49770 2021-01-03T13:01:56.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1a6d9d700 1 --2- 172.21.15.133:0/1632403288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1843c20 0x1acbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:01:56.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.279+0000 7fa1a659c700 1 --2- 172.21.15.133:0/1632403288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1a49770 0x1a93ec0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x1a96850 tx=0x7fa198021000).ready entity=mon.1 client_cookie=d32d91045c64a1e8 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:56.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1a759e700 1 -- 172.21.15.133:0/1632403288 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa198021070 con 0x1a49770 2021-01-03T13:01:56.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1a759e700 1 -- 172.21.15.133:0/1632403288 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa198028c80 con 0x1a49770 2021-01-03T13:01:56.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1a759e700 1 -- 172.21.15.133:0/1632403288 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa198026480 con 0x1a49770 2021-01-03T13:01:56.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 1 -- 172.21.15.133:0/1632403288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1a49770 msgr2=0x1a93ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:56.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/1632403288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1a49770 0x1a93ec0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x1a96850 tx=0x7fa198021000).stop 2021-01-03T13:01:56.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 1 -- 172.21.15.133:0/1632403288 shutdown_connections 2021-01-03T13:01:56.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/1632403288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1843c20 0x1acbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/1632403288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1a49770 0x1a93ec0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/1632403288 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x18b1820 0x1acbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 1 -- 172.21.15.133:0/1632403288 >> 172.21.15.133:0/1632403288 conn(0x1a78f50 msgr2=0x1a94d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:56.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 1 -- 172.21.15.133:0/1632403288 shutdown_connections 2021-01-03T13:01:56.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 1 -- 172.21.15.133:0/1632403288 wait complete. 2021-01-03T13:01:56.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 1 -- start start 2021-01-03T13:01:56.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 1 Processor -- start 2021-01-03T13:01:56.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1843c20 0x1ac3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x18b1820 0x1ac3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1a49770 0x1ade100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x19edf60 con 0x1a49770 2021-01-03T13:01:56.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x19ef530 con 0x1843c20 2021-01-03T13:01:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x19d07b0 con 0x18b1820 2021-01-03T13:01:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1bb41e740 10 client.0 ll_register_callbacks cb 0x1a78eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-01-03T13:01:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1a659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1843c20 0x1ac3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1a659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1843c20 0x1ac3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34634/0 (socket says 172.21.15.133:34634) 2021-01-03T13:01:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1a659c700 1 -- 172.21.15.133:0/2297406083 learned_addr learned my addr 172.21.15.133:0/2297406083 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:56.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1a5d9b700 1 --2- 172.21.15.133:0/2297406083 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x18b1820 0x1ac3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1a6d9d700 1 --2- 172.21.15.133:0/2297406083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1a49770 0x1ade100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1a659c700 1 -- 172.21.15.133:0/2297406083 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x18b1820 msgr2=0x1ac3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:56.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1a659c700 1 --2- 172.21.15.133:0/2297406083 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x18b1820 0x1ac3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1a659c700 1 -- 172.21.15.133:0/2297406083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1a49770 msgr2=0x1ade100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:56.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1a659c700 1 --2- 172.21.15.133:0/2297406083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1a49770 0x1ade100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.283+0000 7fa1a659c700 1 -- 172.21.15.133:0/2297406083 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x19df010 con 0x1843c20 2021-01-03T13:01:56.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1a659c700 1 --2- 172.21.15.133:0/2297406083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1843c20 0x1ac3700 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x1a96850 tx=0x7fa19802a040).ready entity=mon.1 client_cookie=2791ad3b7bc23196 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:56.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1957fa700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2021-01-03T13:01:56.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1957fa700 1 -- 172.21.15.133:0/2297406083 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa198021040 con 0x1843c20 2021-01-03T13:01:56.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1957fa700 1 -- 172.21.15.133:0/2297406083 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa198026d50 con 0x1843c20 2021-01-03T13:01:56.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 1 -- 172.21.15.133:0/2297406083 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x18d68d0 con 0x1843c20 2021-01-03T13:01:56.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1957fa700 1 -- 172.21.15.133:0/2297406083 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa198031440 con 0x1843c20 2021-01-03T13:01:56.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 10 client.5746 fetch_fsmap learned FSMap version 21 2021-01-03T13:01:56.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 1 -- 172.21.15.133:0/2297406083 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x1861790 con 0x1843c20 2021-01-03T13:01:56.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1957fa700 1 -- 172.21.15.133:0/2297406083 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x18d68d0 con 0x1843c20 2021-01-03T13:01:56.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1957fa700 1 -- 172.21.15.133:0/2297406083 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 21) v1 ==== 1434+0+0 (secure 0 0 0) 0x7fa198019020 con 0x1843c20 2021-01-03T13:01:56.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 10 client.5746 fetch_fsmap finished waiting for FSMap version 21 2021-01-03T13:01:56.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 10 client.5746 resolve_mds: resolved ID 'c' to GID 5563 2021-01-03T13:01:56.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 20 client.5746 populate_metadata read hostname 'smithi133' 2021-01-03T13:01:56.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/2297406083 >> [v2:172.21.15.133:6836/834098016,v1:172.21.15.133:6837/834098016] conn(0x1adeac0 0x1acba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 4 client.5746 mds_command: new command op to 5563 tid=0[{"prefix": "get_command_descriptions"}] 2021-01-03T13:01:56.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 1 -- 172.21.15.133:0/2297406083 --> [v2:172.21.15.133:6836/834098016,v1:172.21.15.133:6837/834098016] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x18a74d0 con 0x1adeac0 2021-01-03T13:01:56.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1a5d9b700 1 --2- 172.21.15.133:0/2297406083 >> [v2:172.21.15.133:6836/834098016,v1:172.21.15.133:6837/834098016] conn(0x1adeac0 0x1acba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1957fa700 10 client.5746 ms_handle_connect on v2:172.21.15.133:6836/834098016 2021-01-03T13:01:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1a5d9b700 1 --2- 172.21.15.133:0/2297406083 >> [v2:172.21.15.133:6836/834098016,v1:172.21.15.133:6837/834098016] conn(0x1adeac0 0x1acba40 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=504e82ca63a0c702 server_cookie=7595b9359b0faad2 in_seq=0 out_seq=0 2021-01-03T13:01:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1957fa700 1 -- 172.21.15.133:0/2297406083 <== mds.0 v2:172.21.15.133:6836/834098016 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x18a74d0 con 0x1adeac0 2021-01-03T13:01:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1957fa700 10 client.5746 handle_command_reply: tid=0 2021-01-03T13:01:56.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 1 client.5746 shutdown 2021-01-03T13:01:56.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 1 -- 172.21.15.133:0/2297406083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1843c20 msgr2=0x1ac3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:56.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/2297406083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1843c20 0x1ac3700 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x1a96850 tx=0x7fa19802a040).stop 2021-01-03T13:01:56.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 1 -- 172.21.15.133:0/2297406083 shutdown_connections 2021-01-03T13:01:56.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/2297406083 >> [v2:172.21.15.133:6836/834098016,v1:172.21.15.133:6837/834098016] conn(0x1adeac0 0x1acba40 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/2297406083 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1a49770 0x1ade100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/2297406083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1843c20 0x1ac3700 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1957fa700 0 client.5746 ms_handle_reset on v2:172.21.15.133:6836/834098016 2021-01-03T13:01:56.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/2297406083 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x18b1820 0x1ac3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 1 -- 172.21.15.133:0/2297406083 >> 172.21.15.133:0/2297406083 conn(0x1a78f50 msgr2=0x1a924a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:56.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 1 -- 172.21.15.133:0/2297406083 shutdown_connections 2021-01-03T13:01:56.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 1 -- 172.21.15.133:0/2297406083 wait complete. 2021-01-03T13:01:56.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.287+0000 7fa1bb41e740 20 client.5746 trim_cache size 0 max 16384 2021-01-03T13:01:56.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1bb41e740 1 Processor -- start 2021-01-03T13:01:56.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1bb41e740 1 -- start start 2021-01-03T13:01:56.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1bb41e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1843c20 0x1a95f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1bb41e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x18b1820 0x1a77ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1bb41e740 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1a49770 0x1a95200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1bb41e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aeb340 con 0x18b1820 2021-01-03T13:01:56.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1bb41e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x1adeea0 con 0x1843c20 2021-01-03T13:01:56.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1bb41e740 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a93d50 con 0x1a49770 2021-01-03T13:01:56.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1a659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1843c20 0x1a95f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1a659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1843c20 0x1a95f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34640/0 (socket says 172.21.15.133:34640) 2021-01-03T13:01:56.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1a659c700 1 -- 172.21.15.133:0/2772891631 learned_addr learned my addr 172.21.15.133:0/2772891631 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:56.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1a6d9d700 1 --2- 172.21.15.133:0/2772891631 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1a49770 0x1a95200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1a5d9b700 1 --2- 172.21.15.133:0/2772891631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x18b1820 0x1a77ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1a659c700 1 -- 172.21.15.133:0/2772891631 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1a49770 msgr2=0x1a95200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:56.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1a659c700 1 --2- 172.21.15.133:0/2772891631 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1a49770 0x1a95200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1a659c700 1 -- 172.21.15.133:0/2772891631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x18b1820 msgr2=0x1a77ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:56.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1a659c700 1 --2- 172.21.15.133:0/2772891631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x18b1820 0x1a77ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1a659c700 1 -- 172.21.15.133:0/2772891631 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a80aa370 con 0x1843c20 2021-01-03T13:01:56.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1a659c700 1 --2- 172.21.15.133:0/2772891631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1843c20 0x1a95f70 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x1ac7240 tx=0x7fa198033070).ready entity=mon.1 client_cookie=2d69d89dca72298e server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:56.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1977fe700 1 -- 172.21.15.133:0/2772891631 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa198021040 con 0x1843c20 2021-01-03T13:01:56.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1977fe700 1 -- 172.21.15.133:0/2772891631 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa198035070 con 0x1843c20 2021-01-03T13:01:56.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.299+0000 7fa1977fe700 1 -- 172.21.15.133:0/2772891631 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa198031b00 con 0x1843c20 2021-01-03T13:01:56.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.303+0000 7fa1bb41e740 1 -- 172.21.15.133:0/2772891631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1843c20 msgr2=0x1a95f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:01:56.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.303+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/2772891631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1843c20 0x1a95f70 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x1ac7240 tx=0x7fa198033070).stop 2021-01-03T13:01:56.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.303+0000 7fa1bb41e740 1 -- 172.21.15.133:0/2772891631 shutdown_connections 2021-01-03T13:01:56.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.303+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/2772891631 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x1a49770 0x1a95200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.303+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/2772891631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1843c20 0x1a95f70 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.303+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/2772891631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x18b1820 0x1a77ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.303+0000 7fa1bb41e740 1 -- 172.21.15.133:0/2772891631 >> 172.21.15.133:0/2772891631 conn(0x1a78f50 msgr2=0x1ac7340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:01:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.303+0000 7fa1bb41e740 1 -- 172.21.15.133:0/2772891631 shutdown_connections 2021-01-03T13:01:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.303+0000 7fa1bb41e740 1 -- 172.21.15.133:0/2772891631 wait complete. 2021-01-03T13:01:56.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.303+0000 7fa1bb41e740 1 -- start start 2021-01-03T13:01:56.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.303+0000 7fa1bb41e740 1 Processor -- start 2021-01-03T13:01:56.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1bb41e740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1843c20 0x1ac9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1bb41e740 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x18b1820 0x1ac9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1bb41e740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1a49770 0x1b26530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1bb41e740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a93350 con 0x1843c20 2021-01-03T13:01:56.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1bb41e740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x19ba140 con 0x1a49770 2021-01-03T13:01:56.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1bb41e740 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ac85e0 con 0x18b1820 2021-01-03T13:01:56.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1bb41e740 10 client.0 ll_register_callbacks cb 0x7fa190001870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-01-03T13:01:56.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1a6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1a49770 0x1b26530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1a6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1a49770 0x1b26530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34650/0 (socket says 172.21.15.133:34650) 2021-01-03T13:01:56.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1a6d9d700 1 -- 172.21.15.133:0/66044838 learned_addr learned my addr 172.21.15.133:0/66044838 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:01:56.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1a5d9b700 1 --2- 172.21.15.133:0/66044838 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x18b1820 0x1ac9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1a659c700 1 --2- 172.21.15.133:0/66044838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1843c20 0x1ac9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1a6d9d700 1 -- 172.21.15.133:0/66044838 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x18b1820 msgr2=0x1ac9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:56.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1a6d9d700 1 --2- 172.21.15.133:0/66044838 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x18b1820 0x1ac9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1a6d9d700 1 -- 172.21.15.133:0/66044838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1843c20 msgr2=0x1ac9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:01:56.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1a6d9d700 1 --2- 172.21.15.133:0/66044838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1843c20 0x1ac9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:01:56.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1a6d9d700 1 -- 172.21.15.133:0/66044838 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x186ce70 con 0x1a49770 2021-01-03T13:01:56.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1a6d9d700 1 --2- 172.21.15.133:0/66044838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1a49770 0x1b26530 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fa1a0015000 tx=0x7fa1a0015040).ready entity=mon.1 client_cookie=40a6dc0b92d6c6bd server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:01:56.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1967fc700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2021-01-03T13:01:56.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1967fc700 1 -- 172.21.15.133:0/66044838 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1a002f070 con 0x1a49770 2021-01-03T13:01:56.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1967fc700 1 -- 172.21.15.133:0/66044838 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa1a00469f0 con 0x1a49770 2021-01-03T13:01:56.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1bb41e740 1 -- 172.21.15.133:0/66044838 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x18f5730 con 0x1a49770 2021-01-03T13:01:56.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1967fc700 1 -- 172.21.15.133:0/66044838 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1a0044350 con 0x1a49770 2021-01-03T13:01:56.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1bb41e740 10 client.5752 fetch_fsmap learned FSMap version 21 2021-01-03T13:01:56.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1bb41e740 1 -- 172.21.15.133:0/66044838 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x19b9dc0 con 0x1a49770 2021-01-03T13:01:56.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1967fc700 1 -- 172.21.15.133:0/66044838 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x18f5730 con 0x1a49770 2021-01-03T13:01:56.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1967fc700 1 -- 172.21.15.133:0/66044838 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 21) v1 ==== 1434+0+0 (secure 0 0 0) 0x7fa1a0033020 con 0x1a49770 2021-01-03T13:01:56.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1bb41e740 10 client.5752 fetch_fsmap finished waiting for FSMap version 21 2021-01-03T13:01:56.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1bb41e740 10 client.5752 resolve_mds: resolved ID 'c' to GID 5563 2021-01-03T13:01:56.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1bb41e740 20 client.5752 populate_metadata read hostname 'smithi133' 2021-01-03T13:01:56.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/66044838 >> [v2:172.21.15.133:6836/834098016,v1:172.21.15.133:6837/834098016] conn(0x1b26a20 0x1ad0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:01:56.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1bb41e740 4 client.5752 mds_command: new command op to 5563 tid=0[{"prefix": "cache drop", "timeout": 5}] 2021-01-03T13:01:56.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1bb41e740 1 -- 172.21.15.133:0/66044838 --> [v2:172.21.15.133:6836/834098016,v1:172.21.15.133:6837/834098016] -- command(tid 0: {"prefix": "cache drop", "timeout": 5}) v1 -- 0x1843170 con 0x1b26a20 2021-01-03T13:01:56.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1a659c700 1 --2- 172.21.15.133:0/66044838 >> [v2:172.21.15.133:6836/834098016,v1:172.21.15.133:6837/834098016] conn(0x1b26a20 0x1ad0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:01:56.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1a659c700 1 --2- 172.21.15.133:0/66044838 >> [v2:172.21.15.133:6836/834098016,v1:172.21.15.133:6837/834098016] conn(0x1b26a20 0x1ad0400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=383cffe3f89460e4 server_cookie=43ca639c297bf1e in_seq=0 out_seq=0 2021-01-03T13:01:56.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:01:56.307+0000 7fa1967fc700 10 client.5752 ms_handle_connect on v2:172.21.15.133:6836/834098016 2021-01-03T13:02:01.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1967fc700 1 -- 172.21.15.133:0/66044838 <== mds.0 v2:172.21.15.133:6836/834098016 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+404 (crc 0 0 0) 0x1843170 con 0x1b26a20 2021-01-03T13:02:01.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1967fc700 10 client.5752 handle_command_reply: tid=0 2021-01-03T13:02:01.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1bb41e740 1 client.5752 shutdown 2021-01-03T13:02:01.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1bb41e740 1 -- 172.21.15.133:0/66044838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1a49770 msgr2=0x1b26530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:01.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/66044838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1a49770 0x1b26530 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fa1a0015000 tx=0x7fa1a0015040).stop 2021-01-03T13:02:01.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1bb41e740 1 -- 172.21.15.133:0/66044838 shutdown_connections 2021-01-03T13:02:01.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/66044838 >> [v2:172.21.15.133:6836/834098016,v1:172.21.15.133:6837/834098016] conn(0x1b26a20 0x1ad0400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:01.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/66044838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1843c20 0x1ac9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:01.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/66044838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1a49770 0x1b26530 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:01.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1967fc700 0 client.5752 ms_handle_reset on v2:172.21.15.133:6836/834098016 2021-01-03T13:02:01.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1bb41e740 1 --2- 172.21.15.133:0/66044838 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x18b1820 0x1ac9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:01.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1bb41e740 1 -- 172.21.15.133:0/66044838 >> 172.21.15.133:0/66044838 conn(0x1a78f50 msgr2=0x1ac6420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:02:01.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1bb41e740 1 -- 172.21.15.133:0/66044838 shutdown_connections 2021-01-03T13:02:01.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1bb41e740 1 -- 172.21.15.133:0/66044838 wait complete. 2021-01-03T13:02:01.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1bb41e740 20 client.5752 trim_cache size 0 max 16384 2021-01-03T13:02:01.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1a759e700 1 -- 172.21.15.133:0/2985468621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa180055330 msgr2=0x7fa1800577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:01.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1a759e700 1 --2- 172.21.15.133:0/2985468621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa180055330 0x7fa1800577f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fa19801c000 tx=0x7fa19801a000).stop 2021-01-03T13:02:01.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1a759e700 1 -- 172.21.15.133:0/2985468621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1a8142680 msgr2=0x7fa1a8151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:01.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1a759e700 1 --2- 172.21.15.133:0/2985468621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1a8142680 0x7fa1a8151de0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fa1a0000b20 tx=0x7fa1a0007a60).stop 2021-01-03T13:02:01.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1a759e700 1 -- 172.21.15.133:0/2985468621 shutdown_connections 2021-01-03T13:02:01.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1a759e700 1 --2- 172.21.15.133:0/2985468621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa180055330 0x7fa1800577f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:01.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1a759e700 1 --2- 172.21.15.133:0/2985468621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1a8142680 0x7fa1a8151de0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:01.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1a759e700 1 --2- 172.21.15.133:0/2985468621 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1a8155670 0x7fa1a8149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:01.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1a759e700 1 --2- 172.21.15.133:0/2985468621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1a8155a50 0x7fa1a81472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:01.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1a759e700 1 -- 172.21.15.133:0/2985468621 >> 172.21.15.133:0/2985468621 conn(0x7fa1a806b050 msgr2=0x7fa1a81448d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:02:01.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1a759e700 1 -- 172.21.15.133:0/2985468621 shutdown_connections 2021-01-03T13:02:01.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.559+0000 7fa1a759e700 1 -- 172.21.15.133:0/2985468621 wait complete. 2021-01-03T13:02:01.562 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:02:01.563 INFO:teuthology.orchestra.run.smithi133.stdout: "client_recall": { 2021-01-03T13:02:01.563 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": -110, 2021-01-03T13:02:01.563 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "(110) Connection timed out", 2021-01-03T13:02:01.563 INFO:teuthology.orchestra.run.smithi133.stdout: "recalled": 120 2021-01-03T13:02:01.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:02:01.564 INFO:teuthology.orchestra.run.smithi133.stdout: "flush_journal": { 2021-01-03T13:02:01.564 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0, 2021-01-03T13:02:01.564 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "" 2021-01-03T13:02:01.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:02:01.565 INFO:teuthology.orchestra.run.smithi133.stdout: "trim_cache": { 2021-01-03T13:02:01.565 INFO:teuthology.orchestra.run.smithi133.stdout: "trimmed": 0 2021-01-03T13:02:01.565 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:02:01.565 INFO:teuthology.orchestra.run.smithi133.stdout: "cache": { 2021-01-03T13:02:01.565 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": { 2021-01-03T13:02:01.566 INFO:teuthology.orchestra.run.smithi133.stdout: "items": 19906, 2021-01-03T13:02:01.566 INFO:teuthology.orchestra.run.smithi133.stdout: "bytes": 3094304 2021-01-03T13:02:01.566 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:02:01.566 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:02:01.567 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 5.2493066190000004 2021-01-03T13:02:01.567 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:02:01.568 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-01-03T13:02:01.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:02:01.569 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:02:01.569 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:02:01.577 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-01-03T13:02:01.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:02:01.578 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-01-03T13:02:01.579 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T13:02:01.579 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:02:01.579 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:02:01.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:02:01.651 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:02:01.652 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:02:01.700 INFO:teuthology.orchestra.run.smithi007.stdout:ext2/ext3 2021-01-03T13:02:01.701 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:02:01.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:02:01.702 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:02:01.748 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:02:01.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe34bd3700 1 Processor -- start 2021-01-03T13:02:01.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe34bd3700 1 -- start start 2021-01-03T13:02:01.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe34bd3700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efe300b5c10 0x7efe300aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:01.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe34bd3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efe300b0670 0x7efe3014a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:01.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe34bd3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe30098550 con 0x7efe3014acc0 2021-01-03T13:02:01.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe34bd3700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe300b5ff0 con 0x7efe300b5c10 2021-01-03T13:02:01.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe34bd3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe300b0b10 con 0x7efe300b0670 2021-01-03T13:02:01.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe2dd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efe300b0670 0x7efe3014a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:01.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe2dd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efe300b0670 0x7efe3014a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34660/0 (socket says 172.21.15.133:34660) 2021-01-03T13:02:01.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe2dd9b700 1 -- 172.21.15.133:0/587624110 learned_addr learned my addr 172.21.15.133:0/587624110 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:02:01.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe2e59c700 1 --2- 172.21.15.133:0/587624110 >> v2:172.21.15.16:3300/0 conn(0x7efe300b5c10 0x7efe300aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:01.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe2dd9b700 1 -- 172.21.15.133:0/587624110 >> v2:172.21.15.16:3300/0 conn(0x7efe300b5c10 msgr2=0x7efe300aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:02:01.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe2dd9b700 1 --2- 172.21.15.133:0/587624110 >> v2:172.21.15.16:3300/0 conn(0x7efe300b5c10 0x7efe300aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:01.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe2dd9b700 1 -- 172.21.15.133:0/587624110 >> v1:172.21.15.133:6789/0 conn(0x7efe3014acc0 legacy=0x7efe30144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:01.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe2dd9b700 1 -- 172.21.15.133:0/587624110 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe30098780 con 0x7efe300b0670 2021-01-03T13:02:01.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe2e59c700 1 --2- 172.21.15.133:0/587624110 >> v2:172.21.15.16:3300/0 conn(0x7efe300b5c10 0x7efe300aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:02:01.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe2dd9b700 1 --2- 172.21.15.133:0/587624110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe300b0670 0x7efe3014a7d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7efe24002f30 tx=0x7efe24006e80).ready entity=mon.1 client_cookie=6dbe29b1884f9a9f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:01.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe2d59a700 1 -- 172.21.15.133:0/587624110 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe240097f0 con 0x7efe300b0670 2021-01-03T13:02:01.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe2d59a700 1 -- 172.21.15.133:0/587624110 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe24009950 con 0x7efe300b0670 2021-01-03T13:02:01.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe2d59a700 1 -- 172.21.15.133:0/587624110 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe24009ac0 con 0x7efe300b0670 2021-01-03T13:02:01.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe34bd3700 1 -- 172.21.15.133:0/587624110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe300b0670 msgr2=0x7efe3014a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:01.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe34bd3700 1 --2- 172.21.15.133:0/587624110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe300b0670 0x7efe3014a7d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7efe24002f30 tx=0x7efe24006e80).stop 2021-01-03T13:02:01.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe34bd3700 1 -- 172.21.15.133:0/587624110 shutdown_connections 2021-01-03T13:02:01.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe34bd3700 1 --2- 172.21.15.133:0/587624110 >> v2:172.21.15.16:3300/0 conn(0x7efe300b5c10 0x7efe300aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:01.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe34bd3700 1 --2- 172.21.15.133:0/587624110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe300b0670 0x7efe3014a7d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:01.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe34bd3700 1 -- 172.21.15.133:0/587624110 >> 172.21.15.133:0/587624110 conn(0x7efe3005c8c0 msgr2=0x7efe300b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:02:01.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe34bd3700 1 -- 172.21.15.133:0/587624110 shutdown_connections 2021-01-03T13:02:01.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.867+0000 7efe34bd3700 1 -- 172.21.15.133:0/587624110 wait complete. 2021-01-03T13:02:01.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe34bd3700 1 Processor -- start 2021-01-03T13:02:01.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe34bd3700 1 -- start start 2021-01-03T13:02:01.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe34bd3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe300b0670 0x7efe30141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:01.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe34bd3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe300b5c10 0x7efe3014a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:01.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe34bd3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe3014acc0 0x7efe30155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:01.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe34bd3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe301595b0 con 0x7efe300b5c10 2021-01-03T13:02:01.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe34bd3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe30159850 con 0x7efe300b0670 2021-01-03T13:02:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe34bd3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe30159af0 con 0x7efe3014acc0 2021-01-03T13:02:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe2e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe300b0670 0x7efe30141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe2e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe300b0670 0x7efe30141bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34666/0 (socket says 172.21.15.133:34666) 2021-01-03T13:02:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe2e59c700 1 -- 172.21.15.133:0/2455111673 learned_addr learned my addr 172.21.15.133:0/2455111673 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:02:01.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe2ed9d700 1 --2- 172.21.15.133:0/2455111673 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe3014acc0 0x7efe30155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:01.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe2dd9b700 1 --2- 172.21.15.133:0/2455111673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe300b5c10 0x7efe3014a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:01.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe2e59c700 1 -- 172.21.15.133:0/2455111673 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe3014acc0 msgr2=0x7efe30155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:01.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe2e59c700 1 --2- 172.21.15.133:0/2455111673 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe3014acc0 0x7efe30155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:01.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe2e59c700 1 -- 172.21.15.133:0/2455111673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe300b5c10 msgr2=0x7efe3014a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:01.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe2e59c700 1 --2- 172.21.15.133:0/2455111673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe300b5c10 0x7efe3014a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:01.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe2e59c700 1 -- 172.21.15.133:0/2455111673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe30159d90 con 0x7efe300b0670 2021-01-03T13:02:01.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe2ed9d700 1 --2- 172.21.15.133:0/2455111673 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe3014acc0 0x7efe30155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:02:01.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.871+0000 7efe2dd9b700 1 --2- 172.21.15.133:0/2455111673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe300b5c10 0x7efe3014a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:02:01.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.875+0000 7efe2e59c700 1 --2- 172.21.15.133:0/2455111673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe300b0670 0x7efe30141bb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7efe20007000 tx=0x7efe20008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:01.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.875+0000 7efe1f7fe700 1 -- 172.21.15.133:0/2455111673 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe2000a160 con 0x7efe300b0670 2021-01-03T13:02:01.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.875+0000 7efe1f7fe700 1 -- 172.21.15.133:0/2455111673 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe20007750 con 0x7efe300b0670 2021-01-03T13:02:01.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.875+0000 7efe34bd3700 1 -- 172.21.15.133:0/2455111673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3015a230 con 0x7efe300b0670 2021-01-03T13:02:01.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.875+0000 7efe1f7fe700 1 -- 172.21.15.133:0/2455111673 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe20007ab0 con 0x7efe300b0670 2021-01-03T13:02:01.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.875+0000 7efe34bd3700 1 -- 172.21.15.133:0/2455111673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe300b4c00 con 0x7efe300b0670 2021-01-03T13:02:01.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.875+0000 7efe34bd3700 1 -- 172.21.15.133:0/2455111673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe30057300 con 0x7efe300b0670 2021-01-03T13:02:01.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.875+0000 7efe1f7fe700 1 -- 172.21.15.133:0/2455111673 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7efe20007c10 con 0x7efe300b0670 2021-01-03T13:02:01.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.875+0000 7efe1f7fe700 1 --2- 172.21.15.133:0/2455111673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efe0c055330 0x7efe0c0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:01.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.875+0000 7efe1f7fe700 1 -- 172.21.15.133:0/2455111673 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efe2006e070 con 0x7efe300b0670 2021-01-03T13:02:01.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.875+0000 7efe2dd9b700 1 --2- 172.21.15.133:0/2455111673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efe0c055330 0x7efe0c0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:01.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.875+0000 7efe2dd9b700 1 --2- 172.21.15.133:0/2455111673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efe0c055330 0x7efe0c0577f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7efe24019000 tx=0x7efe24016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:01.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:01.879+0000 7efe1f7fe700 1 -- 172.21.15.133:0/2455111673 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7efe20044370 con 0x7efe300b0670 2021-01-03T13:02:02.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.011+0000 7efe34bd3700 1 -- 172.21.15.133:0/2455111673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe3005ce00 con 0x7efe300b0670 2021-01-03T13:02:02.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.011+0000 7efe1f7fe700 1 -- 172.21.15.133:0/2455111673 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16088 (secure 0 0 0) 0x7efe20047990 con 0x7efe300b0670 2021-01-03T13:02:02.009 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:02:02.010 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":55,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:01:36.969095+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:01:33.451725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2021-01-03T13:01:34.480032+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:02:02.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.015+0000 7efe34bd3700 1 -- 172.21.15.133:0/2455111673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efe0c055330 msgr2=0x7efe0c0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.015+0000 7efe34bd3700 1 --2- 172.21.15.133:0/2455111673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efe0c055330 0x7efe0c0577f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7efe24019000 tx=0x7efe24016000).stop 2021-01-03T13:02:02.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.015+0000 7efe34bd3700 1 -- 172.21.15.133:0/2455111673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe300b0670 msgr2=0x7efe30141bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.015+0000 7efe34bd3700 1 --2- 172.21.15.133:0/2455111673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe300b0670 0x7efe30141bb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7efe20007000 tx=0x7efe20008040).stop 2021-01-03T13:02:02.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.015+0000 7efe34bd3700 1 -- 172.21.15.133:0/2455111673 shutdown_connections 2021-01-03T13:02:02.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.015+0000 7efe34bd3700 1 --2- 172.21.15.133:0/2455111673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efe0c055330 0x7efe0c0577f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.015+0000 7efe34bd3700 1 --2- 172.21.15.133:0/2455111673 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe3014acc0 0x7efe30155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.015+0000 7efe34bd3700 1 --2- 172.21.15.133:0/2455111673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe300b0670 0x7efe30141bb0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.015+0000 7efe34bd3700 1 --2- 172.21.15.133:0/2455111673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe300b5c10 0x7efe3014a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.015+0000 7efe34bd3700 1 -- 172.21.15.133:0/2455111673 >> 172.21.15.133:0/2455111673 conn(0x7efe3005c8c0 msgr2=0x7efe30069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:02:02.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.015+0000 7efe34bd3700 1 -- 172.21.15.133:0/2455111673 shutdown_connections 2021-01-03T13:02:02.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.015+0000 7efe34bd3700 1 -- 172.21.15.133:0/2455111673 wait complete. 2021-01-03T13:02:02.023 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:01:33.451725+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:01:34.480032+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:02:02.024 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:02:02.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba02dd8700 1 Processor -- start 2021-01-03T13:02:02.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba02dd8700 1 -- start start 2021-01-03T13:02:02.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba02dd8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9fc0b7c50 0x7fb9fc1440a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba02dd8700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb9fc1470a0 0x7fb9fc147530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba02dd8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9fc0b8030 con 0x7fb9fc060710 2021-01-03T13:02:02.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba02dd8700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc05fa10 con 0x7fb9fc1470a0 2021-01-03T13:02:02.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba02dd8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc05fcb0 con 0x7fb9fc0b7c50 2021-01-03T13:02:02.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba015d5700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb9fc060710 0x7fb9fc144590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55708/0 (socket says 172.21.15.133:55708) 2021-01-03T13:02:02.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba015d5700 1 -- 172.21.15.133:0/2091365222 learned_addr learned my addr 172.21.15.133:0/2091365222 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:02:02.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba01dd6700 1 --2- 172.21.15.133:0/2091365222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9fc0b7c50 0x7fb9fc1440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba025d7700 1 --2- 172.21.15.133:0/2091365222 >> v2:172.21.15.16:3300/0 conn(0x7fb9fc1470a0 0x7fb9fc147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 -- 172.21.15.133:0/2091365222 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375074238 0 0) 0x7fb9fc0b8030 con 0x7fb9fc060710 2021-01-03T13:02:02.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 -- 172.21.15.133:0/2091365222 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9e0003230 con 0x7fb9fc060710 2021-01-03T13:02:02.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 -- 172.21.15.133:0/2091365222 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1165143517 0 0) 0x7fb9e0003230 con 0x7fb9fc060710 2021-01-03T13:02:02.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 -- 172.21.15.133:0/2091365222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9fc0b7c50 msgr2=0x7fb9fc1440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:02:02.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 --2- 172.21.15.133:0/2091365222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9fc0b7c50 0x7fb9fc1440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 -- 172.21.15.133:0/2091365222 >> v2:172.21.15.16:3300/0 conn(0x7fb9fc1470a0 msgr2=0x7fb9fc147530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:02:02.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 --2- 172.21.15.133:0/2091365222 >> v2:172.21.15.16:3300/0 conn(0x7fb9fc1470a0 0x7fb9fc147530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 -- 172.21.15.133:0/2091365222 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc05ff50 con 0x7fb9fc060710 2021-01-03T13:02:02.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 -- 172.21.15.133:0/2091365222 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fb9ec001720 con 0x7fb9fc060710 2021-01-03T13:02:02.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 -- 172.21.15.133:0/2091365222 >> v1:172.21.15.133:6789/0 conn(0x7fb9fc060710 legacy=0x7fb9fc144590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 --2- 172.21.15.133:0/2091365222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9fc0b7c50 0x7fb9e0003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 --2- 172.21.15.133:0/2091365222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e0003c30 0x7fb9e00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 --2- 172.21.15.133:0/2091365222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e00049c0 0x7fb9e0004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 -- 172.21.15.133:0/2091365222 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc05fa10 con 0x7fb9e0003c30 2021-01-03T13:02:02.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 -- 172.21.15.133:0/2091365222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc05fcb0 con 0x7fb9e00049c0 2021-01-03T13:02:02.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 -- 172.21.15.133:0/2091365222 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e00041f0 con 0x7fb9fc0b7c50 2021-01-03T13:02:02.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba025d7700 1 --2- 172.21.15.133:0/2091365222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e00049c0 0x7fb9e0004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba025d7700 1 -- 172.21.15.133:0/2091365222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9fc0b7c50 msgr2=0x7fb9e0003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:02:02.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba01dd6700 1 --2- 172.21.15.133:0/2091365222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9fc0b7c50 0x7fb9e0003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba015d5700 1 --2- 172.21.15.133:0/2091365222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e0003c30 0x7fb9e00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba025d7700 1 --2- 172.21.15.133:0/2091365222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9fc0b7c50 0x7fb9e0003720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba025d7700 1 -- 172.21.15.133:0/2091365222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e0003c30 msgr2=0x7fb9e00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:02:02.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba025d7700 1 --2- 172.21.15.133:0/2091365222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e0003c30 0x7fb9e00044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba025d7700 1 -- 172.21.15.133:0/2091365222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e0003230 con 0x7fb9e00049c0 2021-01-03T13:02:02.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba015d5700 1 --2- 172.21.15.133:0/2091365222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9e0003c30 0x7fb9e00044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:02:02.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba025d7700 1 --2- 172.21.15.133:0/2091365222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e00049c0 0x7fb9e0004e40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fb9f400c000 tx=0x7fb9f40091a0).ready entity=mon.1 client_cookie=1fb927f3eaf7cab9 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:02.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 -- 172.21.15.133:0/2091365222 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9f400ed00 con 0x7fb9e00049c0 2021-01-03T13:02:02.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 -- 172.21.15.133:0/2091365222 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f400ee60 con 0x7fb9e00049c0 2021-01-03T13:02:02.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba00dd4700 1 -- 172.21.15.133:0/2091365222 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9f40125e0 con 0x7fb9e00049c0 2021-01-03T13:02:02.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba02dd8700 1 -- 172.21.15.133:0/2091365222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e00049c0 msgr2=0x7fb9e0004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba02dd8700 1 --2- 172.21.15.133:0/2091365222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9e00049c0 0x7fb9e0004e40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fb9f400c000 tx=0x7fb9f40091a0).stop 2021-01-03T13:02:02.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.143+0000 7fba025d7700 1 -- 172.21.15.133:0/2091365222 reap_dead start 2021-01-03T13:02:02.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba02dd8700 1 -- 172.21.15.133:0/2091365222 shutdown_connections 2021-01-03T13:02:02.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba02dd8700 1 -- 172.21.15.133:0/2091365222 >> 172.21.15.133:0/2091365222 conn(0x7fb9fc05c8c0 msgr2=0x7fb9fc0b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:02:02.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba02dd8700 1 -- 172.21.15.133:0/2091365222 shutdown_connections 2021-01-03T13:02:02.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba02dd8700 1 -- 172.21.15.133:0/2091365222 wait complete. 2021-01-03T13:02:02.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba02dd8700 1 Processor -- start 2021-01-03T13:02:02.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba02dd8700 1 -- start start 2021-01-03T13:02:02.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba02dd8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9fc145280 0x7fb9fc065500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba02dd8700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9fc064970 0x7fb9fc156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba02dd8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9fc064e80 0x7fb9fc1413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba02dd8700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc156510 con 0x7fb9fc064970 2021-01-03T13:02:02.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba02dd8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc145660 con 0x7fb9fc064e80 2021-01-03T13:02:02.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba02dd8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc145c20 con 0x7fb9fc145280 2021-01-03T13:02:02.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba025d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9fc064e80 0x7fb9fc1413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba025d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9fc064e80 0x7fb9fc1413d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34688/0 (socket says 172.21.15.133:34688) 2021-01-03T13:02:02.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba025d7700 1 -- 172.21.15.133:0/1234135123 learned_addr learned my addr 172.21.15.133:0/1234135123 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:02:02.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba015d5700 1 --2- 172.21.15.133:0/1234135123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9fc064970 0x7fb9fc156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba01dd6700 1 --2- 172.21.15.133:0/1234135123 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9fc145280 0x7fb9fc065500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba025d7700 1 -- 172.21.15.133:0/1234135123 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9fc145280 msgr2=0x7fb9fc065500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba025d7700 1 --2- 172.21.15.133:0/1234135123 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9fc145280 0x7fb9fc065500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba025d7700 1 -- 172.21.15.133:0/1234135123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9fc064970 msgr2=0x7fb9fc156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba025d7700 1 --2- 172.21.15.133:0/1234135123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9fc064970 0x7fb9fc156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba025d7700 1 -- 172.21.15.133:0/1234135123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc159c60 con 0x7fb9fc064e80 2021-01-03T13:02:02.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba025d7700 1 --2- 172.21.15.133:0/1234135123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9fc064e80 0x7fb9fc1413d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fb9fc0ad2d0 tx=0x7fb9f401a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:02.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fb9f2ffd700 1 -- 172.21.15.133:0/1234135123 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9f401b610 con 0x7fb9fc064e80 2021-01-03T13:02:02.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fb9f2ffd700 1 -- 172.21.15.133:0/1234135123 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f401b770 con 0x7fb9fc064e80 2021-01-03T13:02:02.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba02dd8700 1 -- 172.21.15.133:0/1234135123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9fc156700 con 0x7fb9fc064e80 2021-01-03T13:02:02.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fb9f2ffd700 1 -- 172.21.15.133:0/1234135123 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9f401bb10 con 0x7fb9fc064e80 2021-01-03T13:02:02.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.147+0000 7fba02dd8700 1 -- 172.21.15.133:0/1234135123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9fc157330 con 0x7fb9fc064e80 2021-01-03T13:02:02.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.151+0000 7fba02dd8700 1 -- 172.21.15.133:0/1234135123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9fc057300 con 0x7fb9fc064e80 2021-01-03T13:02:02.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.151+0000 7fb9f2ffd700 1 -- 172.21.15.133:0/1234135123 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb9f402c070 con 0x7fb9fc064e80 2021-01-03T13:02:02.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.151+0000 7fb9f2ffd700 1 --2- 172.21.15.133:0/1234135123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb9e40554e0 0x7fb9e40579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.151+0000 7fb9f2ffd700 1 -- 172.21.15.133:0/1234135123 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb9f406f880 con 0x7fb9fc064e80 2021-01-03T13:02:02.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.151+0000 7fba01dd6700 1 --2- 172.21.15.133:0/1234135123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb9e40554e0 0x7fb9e40579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.151+0000 7fba01dd6700 1 --2- 172.21.15.133:0/1234135123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb9e40554e0 0x7fb9e40579a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fb9f8008000 tx=0x7fb9f8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:02.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.155+0000 7fb9f2ffd700 1 -- 172.21.15.133:0/1234135123 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb9f4045ae0 con 0x7fb9fc064e80 2021-01-03T13:02:02.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.295+0000 7fba02dd8700 1 -- 172.21.15.133:0/1234135123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb9fc0aded0 con 0x7fb9fc064e80 2021-01-03T13:02:02.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.295+0000 7fb9f2ffd700 1 -- 172.21.15.133:0/1234135123 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v55) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb9f4016030 con 0x7fb9fc064e80 2021-01-03T13:02:02.295 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:02:02.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.299+0000 7fba02dd8700 1 -- 172.21.15.133:0/1234135123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb9e40554e0 msgr2=0x7fb9e40579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.299+0000 7fba02dd8700 1 --2- 172.21.15.133:0/1234135123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb9e40554e0 0x7fb9e40579a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fb9f8008000 tx=0x7fb9f8008040).stop 2021-01-03T13:02:02.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.299+0000 7fba02dd8700 1 -- 172.21.15.133:0/1234135123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9fc064e80 msgr2=0x7fb9fc1413d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.299+0000 7fba02dd8700 1 --2- 172.21.15.133:0/1234135123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9fc064e80 0x7fb9fc1413d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fb9fc0ad2d0 tx=0x7fb9f401a000).stop 2021-01-03T13:02:02.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.299+0000 7fba02dd8700 1 -- 172.21.15.133:0/1234135123 shutdown_connections 2021-01-03T13:02:02.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.299+0000 7fba02dd8700 1 --2- 172.21.15.133:0/1234135123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb9e40554e0 0x7fb9e40579a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.299+0000 7fba02dd8700 1 --2- 172.21.15.133:0/1234135123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb9fc064e80 0x7fb9fc1413d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.299+0000 7fba02dd8700 1 --2- 172.21.15.133:0/1234135123 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb9fc145280 0x7fb9fc065500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.299+0000 7fba02dd8700 1 --2- 172.21.15.133:0/1234135123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9fc064970 0x7fb9fc156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.299+0000 7fba02dd8700 1 -- 172.21.15.133:0/1234135123 >> 172.21.15.133:0/1234135123 conn(0x7fb9fc05c8c0 msgr2=0x7fb9fc146430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:02:02.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.299+0000 7fba02dd8700 1 -- 172.21.15.133:0/1234135123 shutdown_connections 2021-01-03T13:02:02.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.299+0000 7fba02dd8700 1 -- 172.21.15.133:0/1234135123 wait complete. 2021-01-03T13:02:02.311 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:02:02.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92e14fb700 1 Processor -- start 2021-01-03T13:02:02.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92e14fb700 1 -- start start 2021-01-03T13:02:02.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92e14fb700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f92dc0b7c50 0x7f92dc1440a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92e14fb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92dc060710 0x7f92dc144590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92e14fb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92dc0b8030 con 0x7f92dc1470a0 2021-01-03T13:02:02.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92e14fb700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92dc05fa10 con 0x7f92dc0b7c50 2021-01-03T13:02:02.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92e14fb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92dc05fcb0 con 0x7f92dc060710 2021-01-03T13:02:02.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92db7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92dc060710 0x7f92dc144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92e0cfa700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f92dc1470a0 0x7f92dc147510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55726/0 (socket says 172.21.15.133:55726) 2021-01-03T13:02:02.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92e0cfa700 1 -- 172.21.15.133:0/2564688392 learned_addr learned my addr 172.21.15.133:0/2564688392 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:02:02.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92dbfff700 1 --2- 172.21.15.133:0/2564688392 >> v2:172.21.15.16:3300/0 conn(0x7f92dc0b7c50 0x7f92dc1440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92daffd700 1 -- 172.21.15.133:0/2564688392 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245338436 0 0) 0x7f92dc0b8030 con 0x7f92dc1470a0 2021-01-03T13:02:02.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92daffd700 1 -- 172.21.15.133:0/2564688392 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92c8003230 con 0x7f92dc1470a0 2021-01-03T13:02:02.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92db7fe700 1 -- 172.21.15.133:0/2564688392 >> v2:172.21.15.16:3300/0 conn(0x7f92dc0b7c50 msgr2=0x7f92dc1440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:02:02.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92db7fe700 1 --2- 172.21.15.133:0/2564688392 >> v2:172.21.15.16:3300/0 conn(0x7f92dc0b7c50 0x7f92dc1440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92db7fe700 1 -- 172.21.15.133:0/2564688392 >> v1:172.21.15.133:6789/0 conn(0x7f92dc1470a0 legacy=0x7f92dc147510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92db7fe700 1 -- 172.21.15.133:0/2564688392 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc05ff50 con 0x7f92dc060710 2021-01-03T13:02:02.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92db7fe700 1 --2- 172.21.15.133:0/2564688392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92dc060710 0x7f92dc144590 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f92d0002f30 tx=0x7f92d0006d60).ready entity=mon.1 client_cookie=d735aa2eab9cabd4 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:02.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92daffd700 1 -- 172.21.15.133:0/2564688392 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92d0009580 con 0x7f92dc060710 2021-01-03T13:02:02.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92daffd700 1 -- 172.21.15.133:0/2564688392 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d00096e0 con 0x7f92dc060710 2021-01-03T13:02:02.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92e14fb700 1 -- 172.21.15.133:0/2564688392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92dc060710 msgr2=0x7f92dc144590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92daffd700 1 -- 172.21.15.133:0/2564688392 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92d0009850 con 0x7f92dc060710 2021-01-03T13:02:02.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.423+0000 7f92e14fb700 1 --2- 172.21.15.133:0/2564688392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92dc060710 0x7f92dc144590 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f92d0002f30 tx=0x7f92d0006d60).stop 2021-01-03T13:02:02.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.427+0000 7f92e14fb700 1 -- 172.21.15.133:0/2564688392 shutdown_connections 2021-01-03T13:02:02.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.427+0000 7f92e14fb700 1 --2- 172.21.15.133:0/2564688392 >> v2:172.21.15.16:3300/0 conn(0x7f92dc0b7c50 0x7f92dc1440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.427+0000 7f92e14fb700 1 --2- 172.21.15.133:0/2564688392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92dc060710 0x7f92dc144590 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.427+0000 7f92e14fb700 1 -- 172.21.15.133:0/2564688392 >> 172.21.15.133:0/2564688392 conn(0x7f92dc05c8c0 msgr2=0x7f92dc0b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:02:02.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.427+0000 7f92e14fb700 1 -- 172.21.15.133:0/2564688392 shutdown_connections 2021-01-03T13:02:02.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.427+0000 7f92e14fb700 1 -- 172.21.15.133:0/2564688392 wait complete. 2021-01-03T13:02:02.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.427+0000 7f92e14fb700 1 Processor -- start 2021-01-03T13:02:02.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.427+0000 7f92e14fb700 1 -- start start 2021-01-03T13:02:02.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e14fb700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92dc060710 0x7f92dc0625a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e14fb700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92dc0b7c50 0x7f92dc0b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e14fb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92dc1470a0 0x7f92dc159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e14fb700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc0b3380 con 0x7f92dc060710 2021-01-03T13:02:02.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e14fb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc0b3620 con 0x7f92dc1470a0 2021-01-03T13:02:02.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e14fb700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc0b06b0 con 0x7f92dc0b7c50 2021-01-03T13:02:02.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e0cfa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92dc1470a0 0x7f92dc159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e0cfa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92dc1470a0 0x7f92dc159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34702/0 (socket says 172.21.15.133:34702) 2021-01-03T13:02:02.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e0cfa700 1 -- 172.21.15.133:0/2552385616 learned_addr learned my addr 172.21.15.133:0/2552385616 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:02:02.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92db7fe700 1 --2- 172.21.15.133:0/2552385616 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92dc0b7c50 0x7f92dc0b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92dbfff700 1 --2- 172.21.15.133:0/2552385616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92dc060710 0x7f92dc0625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e0cfa700 1 -- 172.21.15.133:0/2552385616 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92dc0b7c50 msgr2=0x7f92dc0b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e0cfa700 1 --2- 172.21.15.133:0/2552385616 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92dc0b7c50 0x7f92dc0b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e0cfa700 1 -- 172.21.15.133:0/2552385616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92dc060710 msgr2=0x7f92dc0625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e0cfa700 1 --2- 172.21.15.133:0/2552385616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92dc060710 0x7f92dc0625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e0cfa700 1 -- 172.21.15.133:0/2552385616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc0b0950 con 0x7f92dc1470a0 2021-01-03T13:02:02.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e0cfa700 1 --2- 172.21.15.133:0/2552385616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92dc1470a0 0x7f92dc159710 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f92d4001450 tx=0x7f92d4007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:02.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92d97fa700 1 -- 172.21.15.133:0/2552385616 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92d4005960 con 0x7f92dc1470a0 2021-01-03T13:02:02.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92d97fa700 1 -- 172.21.15.133:0/2552385616 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d4005ac0 con 0x7f92dc1470a0 2021-01-03T13:02:02.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92d97fa700 1 -- 172.21.15.133:0/2552385616 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92d4005e20 con 0x7f92dc1470a0 2021-01-03T13:02:02.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e14fb700 1 -- 172.21.15.133:0/2552385616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92dc0b12e0 con 0x7f92dc1470a0 2021-01-03T13:02:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e14fb700 1 -- 172.21.15.133:0/2552385616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92dc141570 con 0x7f92dc1470a0 2021-01-03T13:02:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92e14fb700 1 -- 172.21.15.133:0/2552385616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92dc057300 con 0x7f92dc1470a0 2021-01-03T13:02:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.431+0000 7f92d97fa700 1 -- 172.21.15.133:0/2552385616 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f92d4010030 con 0x7f92dc1470a0 2021-01-03T13:02:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.435+0000 7f92d97fa700 1 --2- 172.21.15.133:0/2552385616 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f92bc055440 0x7f92bc057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.435+0000 7f92d97fa700 1 -- 172.21.15.133:0/2552385616 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f92d406dea0 con 0x7f92dc1470a0 2021-01-03T13:02:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.435+0000 7f92dbfff700 1 --2- 172.21.15.133:0/2552385616 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f92bc055440 0x7f92bc057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.435+0000 7f92dbfff700 1 --2- 172.21.15.133:0/2552385616 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f92bc055440 0x7f92bc057900 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f92cc00b000 tx=0x7f92cc006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:02.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.439+0000 7f92d97fa700 1 -- 172.21.15.133:0/2552385616 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f92d40441a0 con 0x7f92dc1470a0 2021-01-03T13:02:02.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.567+0000 7f92e14fb700 1 -- 172.21.15.133:0/2552385616 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f92dc061000 con 0x7f92dc1470a0 2021-01-03T13:02:02.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.567+0000 7f92d97fa700 1 -- 172.21.15.133:0/2552385616 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7f92d40477c0 con 0x7f92dc1470a0 2021-01-03T13:02:02.566 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:02:02.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.571+0000 7f92e14fb700 1 -- 172.21.15.133:0/2552385616 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f92bc055440 msgr2=0x7f92bc057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.571+0000 7f92e14fb700 1 --2- 172.21.15.133:0/2552385616 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f92bc055440 0x7f92bc057900 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f92cc00b000 tx=0x7f92cc006dc0).stop 2021-01-03T13:02:02.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.571+0000 7f92e14fb700 1 -- 172.21.15.133:0/2552385616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92dc1470a0 msgr2=0x7f92dc159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.571+0000 7f92e14fb700 1 --2- 172.21.15.133:0/2552385616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92dc1470a0 0x7f92dc159710 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f92d4001450 tx=0x7f92d4007dd0).stop 2021-01-03T13:02:02.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.571+0000 7f92e14fb700 1 -- 172.21.15.133:0/2552385616 shutdown_connections 2021-01-03T13:02:02.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.571+0000 7f92e14fb700 1 --2- 172.21.15.133:0/2552385616 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f92bc055440 0x7f92bc057900 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.571+0000 7f92e14fb700 1 --2- 172.21.15.133:0/2552385616 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92dc060710 0x7f92dc0625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.571+0000 7f92e14fb700 1 --2- 172.21.15.133:0/2552385616 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92dc1470a0 0x7f92dc159710 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.571+0000 7f92e14fb700 1 --2- 172.21.15.133:0/2552385616 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92dc0b7c50 0x7f92dc0b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.571+0000 7f92e14fb700 1 -- 172.21.15.133:0/2552385616 >> 172.21.15.133:0/2552385616 conn(0x7f92dc05c8c0 msgr2=0x7f92dc14da70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:02:02.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.571+0000 7f92e14fb700 1 -- 172.21.15.133:0/2552385616 shutdown_connections 2021-01-03T13:02:02.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.571+0000 7f92e14fb700 1 -- 172.21.15.133:0/2552385616 wait complete. 2021-01-03T13:02:02.584 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:02:02.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c9e78700 1 Processor -- start 2021-01-03T13:02:02.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c9e78700 1 -- start start 2021-01-03T13:02:02.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c9e78700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9c405c840 0x7fe9c40b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c9e78700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9c413fb40 0x7fe9c413ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c9e78700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe9c41404b0 0x7fe9c40b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c9e78700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c40aa1f0 con 0x7fe9c41404b0 2021-01-03T13:02:02.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c9e78700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9c405cc20 con 0x7fe9c413fb40 2021-01-03T13:02:02.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c9e78700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c4143df0 con 0x7fe9c405c840 2021-01-03T13:02:02.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9c413fb40 0x7fe9c413ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9c413fb40 0x7fe9c413ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34708/0 (socket says 172.21.15.133:34708) 2021-01-03T13:02:02.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c2ffd700 1 -- 172.21.15.133:0/1505904692 learned_addr learned my addr 172.21.15.133:0/1505904692 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:02:02.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c37fe700 1 --2- 172.21.15.133:0/1505904692 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9c405c840 0x7fe9c40b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c3fff700 1 --2- 172.21.15.133:0/1505904692 >> v2:172.21.15.16:3300/0 conn(0x7fe9c41404b0 0x7fe9c40b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c2ffd700 1 -- 172.21.15.133:0/1505904692 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9c405c840 msgr2=0x7fe9c40b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:02:02.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c2ffd700 1 --2- 172.21.15.133:0/1505904692 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9c405c840 0x7fe9c40b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c2ffd700 1 -- 172.21.15.133:0/1505904692 >> v2:172.21.15.16:3300/0 conn(0x7fe9c41404b0 msgr2=0x7fe9c40b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:02:02.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c2ffd700 1 --2- 172.21.15.133:0/1505904692 >> v2:172.21.15.16:3300/0 conn(0x7fe9c41404b0 0x7fe9c40b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c2ffd700 1 -- 172.21.15.133:0/1505904692 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c40a9ab0 con 0x7fe9c413fb40 2021-01-03T13:02:02.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c2ffd700 1 --2- 172.21.15.133:0/1505904692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9c413fb40 0x7fe9c413ffc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7fe9b8002f30 tx=0x7fe9b8006e80).ready entity=mon.1 client_cookie=4773cc0fe8e67c84 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:02.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c27fc700 1 -- 172.21.15.133:0/1505904692 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9b80097f0 con 0x7fe9c413fb40 2021-01-03T13:02:02.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c27fc700 1 -- 172.21.15.133:0/1505904692 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b8009950 con 0x7fe9c413fb40 2021-01-03T13:02:02.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c27fc700 1 -- 172.21.15.133:0/1505904692 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9b8009cb0 con 0x7fe9c413fb40 2021-01-03T13:02:02.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c9e78700 1 -- 172.21.15.133:0/1505904692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9c413fb40 msgr2=0x7fe9c413ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.695+0000 7fe9c9e78700 1 --2- 172.21.15.133:0/1505904692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9c413fb40 0x7fe9c413ffc0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7fe9b8002f30 tx=0x7fe9b8006e80).stop 2021-01-03T13:02:02.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c9e78700 1 -- 172.21.15.133:0/1505904692 shutdown_connections 2021-01-03T13:02:02.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c9e78700 1 --2- 172.21.15.133:0/1505904692 >> v2:172.21.15.16:3300/0 conn(0x7fe9c41404b0 0x7fe9c40b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c9e78700 1 --2- 172.21.15.133:0/1505904692 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9c405c840 0x7fe9c40b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c9e78700 1 --2- 172.21.15.133:0/1505904692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9c413fb40 0x7fe9c413ffc0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c9e78700 1 -- 172.21.15.133:0/1505904692 >> 172.21.15.133:0/1505904692 conn(0x7fe9c406aeb0 msgr2=0x7fe9c405bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:02:02.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c9e78700 1 -- 172.21.15.133:0/1505904692 shutdown_connections 2021-01-03T13:02:02.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c9e78700 1 -- 172.21.15.133:0/1505904692 wait complete. 2021-01-03T13:02:02.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c9e78700 1 Processor -- start 2021-01-03T13:02:02.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c9e78700 1 -- start start 2021-01-03T13:02:02.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c9e78700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9c405c840 0x7fe9c413e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c9e78700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9c413fb40 0x7fe9c41512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c9e78700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9c40b5bc0 0x7fe9c41517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c9e78700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c4151cd0 con 0x7fe9c413fb40 2021-01-03T13:02:02.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c9e78700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c40b5090 con 0x7fe9c40b5bc0 2021-01-03T13:02:02.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c9e78700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c40b5330 con 0x7fe9c405c840 2021-01-03T13:02:02.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9c40b5bc0 0x7fe9c41517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9c40b5bc0 0x7fe9c41517e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34716/0 (socket says 172.21.15.133:34716) 2021-01-03T13:02:02.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c3fff700 1 -- 172.21.15.133:0/3135412763 learned_addr learned my addr 172.21.15.133:0/3135412763 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:02:02.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c37fe700 1 --2- 172.21.15.133:0/3135412763 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9c405c840 0x7fe9c413e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.699+0000 7fe9c2ffd700 1 --2- 172.21.15.133:0/3135412763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9c413fb40 0x7fe9c41512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.703+0000 7fe9c3fff700 1 -- 172.21.15.133:0/3135412763 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9c405c840 msgr2=0x7fe9c413e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.703+0000 7fe9c3fff700 1 --2- 172.21.15.133:0/3135412763 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9c405c840 0x7fe9c413e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.703+0000 7fe9c3fff700 1 -- 172.21.15.133:0/3135412763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9c413fb40 msgr2=0x7fe9c41512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.703+0000 7fe9c3fff700 1 --2- 172.21.15.133:0/3135412763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9c413fb40 0x7fe9c41512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.703+0000 7fe9c3fff700 1 -- 172.21.15.133:0/3135412763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c40b55d0 con 0x7fe9c40b5bc0 2021-01-03T13:02:02.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.703+0000 7fe9c3fff700 1 --2- 172.21.15.133:0/3135412763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9c40b5bc0 0x7fe9c41517e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fe9c4150ec0 tx=0x7fe9bc008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:02.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.703+0000 7fe9c0ff9700 1 -- 172.21.15.133:0/3135412763 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9bc00b9a0 con 0x7fe9c40b5bc0 2021-01-03T13:02:02.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.703+0000 7fe9c9e78700 1 -- 172.21.15.133:0/3135412763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c413e920 con 0x7fe9c40b5bc0 2021-01-03T13:02:02.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.703+0000 7fe9c0ff9700 1 -- 172.21.15.133:0/3135412763 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9bc00bb00 con 0x7fe9c40b5bc0 2021-01-03T13:02:02.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.703+0000 7fe9c0ff9700 1 -- 172.21.15.133:0/3135412763 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9bc00be60 con 0x7fe9c40b5bc0 2021-01-03T13:02:02.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.703+0000 7fe9c9e78700 1 -- 172.21.15.133:0/3135412763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c4063220 con 0x7fe9c40b5bc0 2021-01-03T13:02:02.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.703+0000 7fe9c9e78700 1 -- 172.21.15.133:0/3135412763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9c4057300 con 0x7fe9c40b5bc0 2021-01-03T13:02:02.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.703+0000 7fe9c0ff9700 1 -- 172.21.15.133:0/3135412763 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe9bc01c460 con 0x7fe9c40b5bc0 2021-01-03T13:02:02.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.703+0000 7fe9c0ff9700 1 --2- 172.21.15.133:0/3135412763 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe9a4055440 0x7fe9a4057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.703+0000 7fe9c0ff9700 1 -- 172.21.15.133:0/3135412763 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe9bc06e5e0 con 0x7fe9c40b5bc0 2021-01-03T13:02:02.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.703+0000 7fe9c37fe700 1 --2- 172.21.15.133:0/3135412763 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe9a4055440 0x7fe9a4057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.703+0000 7fe9c37fe700 1 --2- 172.21.15.133:0/3135412763 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe9a4055440 0x7fe9a4057900 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fe9b400c000 tx=0x7fe9b4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:02.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.711+0000 7fe9c0ff9700 1 -- 172.21.15.133:0/3135412763 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe9bc0447e0 con 0x7fe9c40b5bc0 2021-01-03T13:02:02.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.847+0000 7fe9c9e78700 1 -- 172.21.15.133:0/3135412763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe9c405ce00 con 0x7fe9c40b5bc0 2021-01-03T13:02:02.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.847+0000 7fe9c0ff9700 1 -- 172.21.15.133:0/3135412763 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe9bc047e00 con 0x7fe9c40b5bc0 2021-01-03T13:02:02.844 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:02:02.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.847+0000 7fe9c9e78700 1 -- 172.21.15.133:0/3135412763 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe9a4055440 msgr2=0x7fe9a4057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.847+0000 7fe9c9e78700 1 --2- 172.21.15.133:0/3135412763 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe9a4055440 0x7fe9a4057900 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fe9b400c000 tx=0x7fe9b4008040).stop 2021-01-03T13:02:02.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.847+0000 7fe9c9e78700 1 -- 172.21.15.133:0/3135412763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9c40b5bc0 msgr2=0x7fe9c41517e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.847+0000 7fe9c9e78700 1 --2- 172.21.15.133:0/3135412763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9c40b5bc0 0x7fe9c41517e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fe9c4150ec0 tx=0x7fe9bc008040).stop 2021-01-03T13:02:02.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.847+0000 7fe9c9e78700 1 -- 172.21.15.133:0/3135412763 shutdown_connections 2021-01-03T13:02:02.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.847+0000 7fe9c9e78700 1 --2- 172.21.15.133:0/3135412763 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe9a4055440 0x7fe9a4057900 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.847+0000 7fe9c9e78700 1 --2- 172.21.15.133:0/3135412763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9c40b5bc0 0x7fe9c41517e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.847+0000 7fe9c9e78700 1 --2- 172.21.15.133:0/3135412763 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe9c405c840 0x7fe9c413e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.847+0000 7fe9c9e78700 1 --2- 172.21.15.133:0/3135412763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe9c413fb40 0x7fe9c41512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.847+0000 7fe9c9e78700 1 -- 172.21.15.133:0/3135412763 >> 172.21.15.133:0/3135412763 conn(0x7fe9c406aeb0 msgr2=0x7fe9c40ad200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:02:02.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.847+0000 7fe9c9e78700 1 -- 172.21.15.133:0/3135412763 shutdown_connections 2021-01-03T13:02:02.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.847+0000 7fe9c9e78700 1 -- 172.21.15.133:0/3135412763 wait complete. 2021-01-03T13:02:02.857 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:02:02.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.979+0000 7f5d19269700 1 Processor -- start 2021-01-03T13:02:02.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.979+0000 7f5d19269700 1 -- start start 2021-01-03T13:02:02.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.979+0000 7f5d19269700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d14060890 0x7f5d140abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.979+0000 7f5d19269700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d140afa80 0x7f5d140b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.979+0000 7f5d19269700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d140aaa10 con 0x7f5d140ae900 2021-01-03T13:02:02.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.979+0000 7f5d19269700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d140ab280 con 0x7f5d140afa80 2021-01-03T13:02:02.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.979+0000 7f5d19269700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d140b1470 con 0x7f5d14060890 2021-01-03T13:02:02.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.979+0000 7f5d137fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d140afa80 0x7f5d140b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.979+0000 7f5d137fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d140afa80 0x7f5d140b4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34720/0 (socket says 172.21.15.133:34720) 2021-01-03T13:02:02.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.979+0000 7f5d137fe700 1 -- 172.21.15.133:0/2026136152 learned_addr learned my addr 172.21.15.133:0/2026136152 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:02:02.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.979+0000 7f5d13fff700 1 --2- 172.21.15.133:0/2026136152 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d14060890 0x7f5d140abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d137fe700 1 -- 172.21.15.133:0/2026136152 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d14060890 msgr2=0x7f5d140abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:02:02.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d137fe700 1 --2- 172.21.15.133:0/2026136152 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d14060890 0x7f5d140abcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d12ffd700 1 -- 172.21.15.133:0/2026136152 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255403746 0 0) 0x7f5d140aaa10 con 0x7f5d140ae900 2021-01-03T13:02:02.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d137fe700 1 -- 172.21.15.133:0/2026136152 >> v1:172.21.15.16:6789/0 conn(0x7f5d140ae900 legacy=0x7f5d140aed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d137fe700 1 -- 172.21.15.133:0/2026136152 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d140b0ab0 con 0x7f5d140afa80 2021-01-03T13:02:02.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d137fe700 1 --2- 172.21.15.133:0/2026136152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d140afa80 0x7f5d140b4f40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f5d08002f30 tx=0x7f5d08006e80).ready entity=mon.1 client_cookie=1424693bf46075a8 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:02.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d12ffd700 1 -- 172.21.15.133:0/2026136152 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d080097f0 con 0x7f5d140afa80 2021-01-03T13:02:02.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d12ffd700 1 -- 172.21.15.133:0/2026136152 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d08009950 con 0x7f5d140afa80 2021-01-03T13:02:02.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d12ffd700 1 -- 172.21.15.133:0/2026136152 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d08009cb0 con 0x7f5d140afa80 2021-01-03T13:02:02.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d19269700 1 -- 172.21.15.133:0/2026136152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d140afa80 msgr2=0x7f5d140b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d19269700 1 --2- 172.21.15.133:0/2026136152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d140afa80 0x7f5d140b4f40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f5d08002f30 tx=0x7f5d08006e80).stop 2021-01-03T13:02:02.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d19269700 1 -- 172.21.15.133:0/2026136152 shutdown_connections 2021-01-03T13:02:02.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d19269700 1 --2- 172.21.15.133:0/2026136152 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d14060890 0x7f5d140abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d19269700 1 --2- 172.21.15.133:0/2026136152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d140afa80 0x7f5d140b4f40 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d19269700 1 -- 172.21.15.133:0/2026136152 >> 172.21.15.133:0/2026136152 conn(0x7f5d1405bdf0 msgr2=0x7f5d1405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:02:02.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d19269700 1 -- 172.21.15.133:0/2026136152 shutdown_connections 2021-01-03T13:02:02.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d19269700 1 -- 172.21.15.133:0/2026136152 wait complete. 2021-01-03T13:02:02.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d19269700 1 Processor -- start 2021-01-03T13:02:02.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d19269700 1 -- start start 2021-01-03T13:02:02.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d19269700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d14060890 0x7f5d1414ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d19269700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d140ae900 0x7f5d14067420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d19269700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d140afa80 0x7f5d1414d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d19269700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d140b3370 con 0x7f5d140ae900 2021-01-03T13:02:02.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d19269700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d14152fb0 con 0x7f5d14060890 2021-01-03T13:02:02.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d19269700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d14153250 con 0x7f5d140afa80 2021-01-03T13:02:02.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d13fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d14060890 0x7f5d1414ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d13fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d14060890 0x7f5d1414ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34726/0 (socket says 172.21.15.133:34726) 2021-01-03T13:02:02.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d13fff700 1 -- 172.21.15.133:0/3455054199 learned_addr learned my addr 172.21.15.133:0/3455054199 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:02:02.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d18a68700 1 --2- 172.21.15.133:0/3455054199 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d140afa80 0x7f5d1414d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.983+0000 7f5d137fe700 1 --2- 172.21.15.133:0/3455054199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d140ae900 0x7f5d14067420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.987+0000 7f5d13fff700 1 -- 172.21.15.133:0/3455054199 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d140afa80 msgr2=0x7f5d1414d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.987+0000 7f5d13fff700 1 --2- 172.21.15.133:0/3455054199 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d140afa80 0x7f5d1414d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.987+0000 7f5d13fff700 1 -- 172.21.15.133:0/3455054199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d140ae900 msgr2=0x7f5d14067420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.987+0000 7f5d13fff700 1 --2- 172.21.15.133:0/3455054199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d140ae900 0x7f5d14067420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.987+0000 7f5d13fff700 1 -- 172.21.15.133:0/3455054199 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d140b1240 con 0x7f5d14060890 2021-01-03T13:02:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.987+0000 7f5d137fe700 1 --2- 172.21.15.133:0/3455054199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d140ae900 0x7f5d14067420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:02:02.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.987+0000 7f5d13fff700 1 --2- 172.21.15.133:0/3455054199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d14060890 0x7f5d1414ab90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f5d0400c000 tx=0x7f5d04006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:02.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.987+0000 7f5d117fa700 1 -- 172.21.15.133:0/3455054199 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d0400ca10 con 0x7f5d14060890 2021-01-03T13:02:02.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.987+0000 7f5d117fa700 1 -- 172.21.15.133:0/3455054199 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0400cb70 con 0x7f5d14060890 2021-01-03T13:02:02.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.987+0000 7f5d19269700 1 -- 172.21.15.133:0/3455054199 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d141534f0 con 0x7f5d14060890 2021-01-03T13:02:02.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.987+0000 7f5d117fa700 1 -- 172.21.15.133:0/3455054199 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d040123f0 con 0x7f5d14060890 2021-01-03T13:02:02.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.987+0000 7f5d19269700 1 -- 172.21.15.133:0/3455054199 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d140b2800 con 0x7f5d14060890 2021-01-03T13:02:02.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.987+0000 7f5d19269700 1 -- 172.21.15.133:0/3455054199 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d14057300 con 0x7f5d14060890 2021-01-03T13:02:02.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.987+0000 7f5d117fa700 1 -- 172.21.15.133:0/3455054199 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5d04012550 con 0x7f5d14060890 2021-01-03T13:02:02.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.987+0000 7f5d117fa700 1 --2- 172.21.15.133:0/3455054199 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5cf4055330 0x7f5cf40577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:02.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.987+0000 7f5d117fa700 1 -- 172.21.15.133:0/3455054199 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5d0406e3d0 con 0x7f5d14060890 2021-01-03T13:02:02.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.987+0000 7f5d137fe700 1 --2- 172.21.15.133:0/3455054199 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5cf4055330 0x7f5cf40577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:02.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.991+0000 7f5d137fe700 1 --2- 172.21.15.133:0/3455054199 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5cf4055330 0x7f5cf40577f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f5d0801a000 tx=0x7f5d08015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:02.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:02.995+0000 7f5d117fa700 1 -- 172.21.15.133:0/3455054199 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5d04044670 con 0x7f5d14060890 2021-01-03T13:02:03.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.135+0000 7f5d19269700 1 -- 172.21.15.133:0/3455054199 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d140b4ce0 con 0x7f5d14060890 2021-01-03T13:02:03.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.139+0000 7f5d117fa700 1 -- 172.21.15.133:0/3455054199 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5d04047c90 con 0x7f5d14060890 2021-01-03T13:02:03.135 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:02:03.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.139+0000 7f5d19269700 1 -- 172.21.15.133:0/3455054199 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5cf4055330 msgr2=0x7f5cf40577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:03.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.139+0000 7f5d19269700 1 --2- 172.21.15.133:0/3455054199 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5cf4055330 0x7f5cf40577f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f5d0801a000 tx=0x7f5d08015000).stop 2021-01-03T13:02:03.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.139+0000 7f5d19269700 1 -- 172.21.15.133:0/3455054199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d14060890 msgr2=0x7f5d1414ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:03.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.139+0000 7f5d19269700 1 --2- 172.21.15.133:0/3455054199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d14060890 0x7f5d1414ab90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f5d0400c000 tx=0x7f5d04006dc0).stop 2021-01-03T13:02:03.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.139+0000 7f5d19269700 1 -- 172.21.15.133:0/3455054199 shutdown_connections 2021-01-03T13:02:03.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.139+0000 7f5d19269700 1 --2- 172.21.15.133:0/3455054199 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5cf4055330 0x7f5cf40577f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:03.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.139+0000 7f5d19269700 1 --2- 172.21.15.133:0/3455054199 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d140afa80 0x7f5d1414d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:03.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.139+0000 7f5d19269700 1 --2- 172.21.15.133:0/3455054199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d14060890 0x7f5d1414ab90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:03.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.139+0000 7f5d19269700 1 --2- 172.21.15.133:0/3455054199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d140ae900 0x7f5d14067420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:03.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.139+0000 7f5d19269700 1 -- 172.21.15.133:0/3455054199 >> 172.21.15.133:0/3455054199 conn(0x7f5d1405bdf0 msgr2=0x7f5d140b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:02:03.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.139+0000 7f5d19269700 1 -- 172.21.15.133:0/3455054199 shutdown_connections 2021-01-03T13:02:03.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.139+0000 7f5d19269700 1 -- 172.21.15.133:0/3455054199 wait complete. 2021-01-03T13:02:03.153 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:02:03.154 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:02:03.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.263+0000 7f63560ec700 1 Processor -- start 2021-01-03T13:02:03.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.263+0000 7f63560ec700 1 -- start start 2021-01-03T13:02:03.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f63560ec700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f635005c840 0x7f6350140c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:03.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f63560ec700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63500b27a0 0x7f635013ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:03.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f63560ec700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f635005cc20 con 0x7f63500b1b50 2021-01-03T13:02:03.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f63560ec700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63500ab220 con 0x7f635005c840 2021-01-03T13:02:03.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f63560ec700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6350144360 con 0x7f63500b27a0 2021-01-03T13:02:03.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f634ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63500b27a0 0x7f635013ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:03.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f634ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63500b27a0 0x7f635013ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34738/0 (socket says 172.21.15.133:34738) 2021-01-03T13:02:03.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f634ffff700 1 -- 172.21.15.133:0/1498457697 learned_addr learned my addr 172.21.15.133:0/1498457697 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:02:03.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f634f7fe700 1 --2- 172.21.15.133:0/1498457697 >> v2:172.21.15.16:3300/0 conn(0x7f635005c840 0x7f6350140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:03.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f634ffff700 1 -- 172.21.15.133:0/1498457697 >> v2:172.21.15.16:3300/0 conn(0x7f635005c840 msgr2=0x7f6350140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:02:03.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f634ffff700 1 --2- 172.21.15.133:0/1498457697 >> v2:172.21.15.16:3300/0 conn(0x7f635005c840 0x7f6350140c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:03.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f634ffff700 1 -- 172.21.15.133:0/1498457697 >> v1:172.21.15.16:6789/0 conn(0x7f63500b1b50 legacy=0x7f6350141100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:03.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f634ffff700 1 -- 172.21.15.133:0/1498457697 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6350144600 con 0x7f63500b27a0 2021-01-03T13:02:03.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f634ffff700 1 --2- 172.21.15.133:0/1498457697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63500b27a0 0x7f635013ddd0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f63480032b0 tx=0x7f6348009270).ready entity=mon.1 client_cookie=977ed15d2fcdc478 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:03.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f634effd700 1 -- 172.21.15.133:0/1498457697 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6348009e60 con 0x7f63500b27a0 2021-01-03T13:02:03.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f634effd700 1 -- 172.21.15.133:0/1498457697 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634800bc00 con 0x7f63500b27a0 2021-01-03T13:02:03.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f634effd700 1 -- 172.21.15.133:0/1498457697 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f634800bd70 con 0x7f63500b27a0 2021-01-03T13:02:03.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f63560ec700 1 -- 172.21.15.133:0/1498457697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63500b27a0 msgr2=0x7f635013ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:03.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f63560ec700 1 --2- 172.21.15.133:0/1498457697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63500b27a0 0x7f635013ddd0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f63480032b0 tx=0x7f6348009270).stop 2021-01-03T13:02:03.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f63560ec700 1 -- 172.21.15.133:0/1498457697 shutdown_connections 2021-01-03T13:02:03.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f63560ec700 1 --2- 172.21.15.133:0/1498457697 >> v2:172.21.15.16:3300/0 conn(0x7f635005c840 0x7f6350140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:03.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f63560ec700 1 --2- 172.21.15.133:0/1498457697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63500b27a0 0x7f635013ddd0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:03.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f63560ec700 1 -- 172.21.15.133:0/1498457697 >> 172.21.15.133:0/1498457697 conn(0x7f635006aeb0 msgr2=0x7f635005bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:02:03.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.267+0000 7f63560ec700 1 -- 172.21.15.133:0/1498457697 shutdown_connections 2021-01-03T13:02:03.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.271+0000 7f63560ec700 1 -- 172.21.15.133:0/1498457697 wait complete. 2021-01-03T13:02:03.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.271+0000 7f63560ec700 1 Processor -- start 2021-01-03T13:02:03.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.271+0000 7f63560ec700 1 -- start start 2021-01-03T13:02:03.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f63560ec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f635005c840 0x7f6350067850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:03.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f63560ec700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63500b1b50 0x7f635013ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:03.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f63560ec700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63500b27a0 0x7f635013b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:03.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f63560ec700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63501466f0 con 0x7f63500b27a0 2021-01-03T13:02:03.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f63560ec700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63500b51f0 con 0x7f635005c840 2021-01-03T13:02:03.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f63560ec700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63500b5490 con 0x7f63500b1b50 2021-01-03T13:02:03.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f634f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f635005c840 0x7f6350067850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:03.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f634f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f635005c840 0x7f6350067850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34740/0 (socket says 172.21.15.133:34740) 2021-01-03T13:02:03.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f634f7fe700 1 -- 172.21.15.133:0/1391730937 learned_addr learned my addr 172.21.15.133:0/1391730937 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:02:03.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f6346ffd700 1 --2- 172.21.15.133:0/1391730937 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63500b1b50 0x7f635013ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:03.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f634ffff700 1 --2- 172.21.15.133:0/1391730937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63500b27a0 0x7f635013b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:03.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f634f7fe700 1 -- 172.21.15.133:0/1391730937 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63500b1b50 msgr2=0x7f635013ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:03.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f634f7fe700 1 --2- 172.21.15.133:0/1391730937 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63500b1b50 0x7f635013ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:03.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f634f7fe700 1 -- 172.21.15.133:0/1391730937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63500b27a0 msgr2=0x7f635013b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:03.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f634f7fe700 1 --2- 172.21.15.133:0/1391730937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63500b27a0 0x7f635013b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:03.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f634f7fe700 1 -- 172.21.15.133:0/1391730937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63500b4d80 con 0x7f635005c840 2021-01-03T13:02:03.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f634f7fe700 1 --2- 172.21.15.133:0/1391730937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f635005c840 0x7f6350067850 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f634000c000 tx=0x7f6340006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:03.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f634d7fa700 1 -- 172.21.15.133:0/1391730937 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f634000ca10 con 0x7f635005c840 2021-01-03T13:02:03.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f634d7fa700 1 -- 172.21.15.133:0/1391730937 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634000cb70 con 0x7f635005c840 2021-01-03T13:02:03.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f63560ec700 1 -- 172.21.15.133:0/1391730937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6350067e30 con 0x7f635005c840 2021-01-03T13:02:03.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f634d7fa700 1 -- 172.21.15.133:0/1391730937 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63400123f0 con 0x7f635005c840 2021-01-03T13:02:03.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f63560ec700 1 -- 172.21.15.133:0/1391730937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63500ad350 con 0x7f635005c840 2021-01-03T13:02:03.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f63560ec700 1 -- 172.21.15.133:0/1391730937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63500b5650 con 0x7f635005c840 2021-01-03T13:02:03.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.275+0000 7f634d7fa700 1 -- 172.21.15.133:0/1391730937 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6340012550 con 0x7f635005c840 2021-01-03T13:02:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.279+0000 7f634d7fa700 1 --2- 172.21.15.133:0/1391730937 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6334055470 0x7f6334057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:02:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.279+0000 7f6346ffd700 1 --2- 172.21.15.133:0/1391730937 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6334055470 0x7f6334057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:02:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.279+0000 7f634d7fa700 1 -- 172.21.15.133:0/1391730937 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f634006e320 con 0x7f635005c840 2021-01-03T13:02:03.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.279+0000 7f6346ffd700 1 --2- 172.21.15.133:0/1391730937 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6334055470 0x7f6334057930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f633800d000 tx=0x7f6338000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:02:03.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.287+0000 7f634d7fa700 1 -- 172.21.15.133:0/1391730937 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f63400445c0 con 0x7f635005c840 2021-01-03T13:02:03.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.471+0000 7f63560ec700 1 -- 172.21.15.133:0/1391730937 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6350057300 con 0x7f635005c840 2021-01-03T13:02:03.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.471+0000 7f634d7fa700 1 -- 172.21.15.133:0/1391730937 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f6340047be0 con 0x7f635005c840 2021-01-03T13:02:03.470 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:02:03.470 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/2812725713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2812725713},{"type":"v1","addr":"172.21.15.16:6833","nonce":2812725713}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1096331942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1096331942},{"type":"v1","addr":"172.21.15.133:6835","nonce":1096331942}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:01:34.953831+0000","modified":"2021-01-03T13:01:35.958148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5563},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5563":{"gid":5563,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/834098016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":834098016},{"type":"v1","addr":"172.21.15.133:6837","nonce":834098016}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-01-03T13:02:03.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.475+0000 7f63560ec700 1 -- 172.21.15.133:0/1391730937 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6334055470 msgr2=0x7f6334057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:03.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.475+0000 7f63560ec700 1 --2- 172.21.15.133:0/1391730937 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6334055470 0x7f6334057930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f633800d000 tx=0x7f6338000b80).stop 2021-01-03T13:02:03.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.475+0000 7f63560ec700 1 -- 172.21.15.133:0/1391730937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f635005c840 msgr2=0x7f6350067850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:02:03.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.475+0000 7f63560ec700 1 --2- 172.21.15.133:0/1391730937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f635005c840 0x7f6350067850 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f634000c000 tx=0x7f6340006dc0).stop 2021-01-03T13:02:03.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.475+0000 7f63560ec700 1 -- 172.21.15.133:0/1391730937 shutdown_connections 2021-01-03T13:02:03.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.475+0000 7f63560ec700 1 --2- 172.21.15.133:0/1391730937 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6334055470 0x7f6334057930 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:03.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.475+0000 7f63560ec700 1 --2- 172.21.15.133:0/1391730937 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63500b27a0 0x7f635013b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:03.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.475+0000 7f63560ec700 1 --2- 172.21.15.133:0/1391730937 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f635005c840 0x7f6350067850 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:03.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.475+0000 7f63560ec700 1 --2- 172.21.15.133:0/1391730937 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63500b1b50 0x7f635013ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:02:03.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.475+0000 7f63560ec700 1 -- 172.21.15.133:0/1391730937 >> 172.21.15.133:0/1391730937 conn(0x7f635006aeb0 msgr2=0x7f63500ab930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:02:03.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.475+0000 7f63560ec700 1 -- 172.21.15.133:0/1391730937 shutdown_connections 2021-01-03T13:02:03.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:02:03.475+0000 7f63560ec700 1 -- 172.21.15.133:0/1391730937 wait complete. 2021-01-03T13:02:03.476 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 21 2021-01-03T13:02:03.793 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:01:34.953831+0000', 'modified': '2021-01-03T13:01:35.958148+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5563}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5563': {'gid': 5563, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/834098016', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 834098016}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 834098016}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:02:03.794 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:02:03.794 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T13:02:03.921 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":5563,"want_state":"up:active","state":"up:active","rank_uptime":28.956962441999998,"mdsmap_epoch":21,"osdmap_epoch":55,"osdmap_epoch_barrier":54,"uptime":33.354029087999997} 2021-01-03T13:02:03.921 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 5563, "mdsmap_epoch": 21, "osdmap_epoch": 55, "osdmap_epoch_barrier": 54, "rank_uptime": 28.956962442, "state": "up:active", "uptime": 33.354029088, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:02:03.922 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:02:03.922 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-01-03T13:02:03.923 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi007.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-01-03T13:02:03.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:02:03.923 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:02:03.931 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:02:03.991 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:02:03.992 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:02:04.048 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:02:04.049 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:02:04.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:02:04.050 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:02:04.096 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:02:04.096 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:02:04.139 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:02:04.156 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:02:04.156 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:02:04.214 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:02:04.215 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:02:04.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:02:04.216 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:02:04.218 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[11998]: starting ceph client 2021-01-03T13:02:04.218 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2021-01-03T13:02:04.215+0000 7f193183c0c0 -1 init, newargv = 0x559c65e30b20 newargc=9 2021-01-03T13:02:04.229 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[11998]: starting fuse 2021-01-03T13:02:05.325 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:02:05.341 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:02:05.342 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:02:05.396 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:02:05.397 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:02:05.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:02:05.399 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:02:05.444 INFO:teuthology.orchestra.run.smithi007.stdout:50 2021-01-03T13:02:05.444 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:02:05.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:02:05.445 DEBUG:teuthology.orchestra.run.smithi007:> sudo python3 -c ' 2021-01-03T13:02:05.446 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2021-01-03T13:02:05.446 DEBUG:teuthology.orchestra.run.smithi007:> import re 2021-01-03T13:02:05.446 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:02:05.447 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2021-01-03T13:02:05.447 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:02:05.448 DEBUG:teuthology.orchestra.run.smithi007:> def find_socket(client_name): 2021-01-03T13:02:05.448 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-01-03T13:02:05.448 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2021-01-03T13:02:05.449 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:02:05.449 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2021-01-03T13:02:05.450 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2021-01-03T13:02:05.450 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2021-01-03T13:02:05.450 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2021-01-03T13:02:05.451 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:02:05.451 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2021-01-03T13:02:05.451 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:02:05.452 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:02:05.452 DEBUG:teuthology.orchestra.run.smithi007:> return f 2021-01-03T13:02:05.453 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:02:05.453 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:02:05.453 DEBUG:teuthology.orchestra.run.smithi007:> print(find_socket("client.0")) 2021-01-03T13:02:05.454 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:02:05.534 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.11998.asok 2021-01-03T13:02:05.539 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.11998.asok 2021-01-03T13:02:05.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:02:05.540 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.11998.asok status 2021-01-03T13:02:05.638 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2021-01-03T13:02:05.638 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2021-01-03T13:02:05.638 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:02:05.639 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:02:05.639 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2021-01-03T13:02:05.639 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2021-01-03T13:02:05.639 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-01-03T13:02:05.639 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "11998", 2021-01-03T13:02:05.640 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2021-01-03T13:02:05.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:02:05.640 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2021-01-03T13:02:05.640 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2021-01-03T13:02:05.640 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5797, 2021-01-03T13:02:05.641 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2021-01-03T13:02:05.641 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2021-01-03T13:02:05.641 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2021-01-03T13:02:05.641 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 5797 2021-01-03T13:02:05.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:02:05.642 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:02:05.642 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:02:05.642 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:02:05.642 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 17329419 2021-01-03T13:02:05.643 INFO:teuthology.orchestra.run.smithi007.stdout: } 2021-01-03T13:02:05.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:02:05.643 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:02:05.643 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:02:05.643 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:02:05.644 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 17329419 2021-01-03T13:02:05.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:02:05.644 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.5797 172.21.15.7:0/17329419", 2021-01-03T13:02:05.645 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "172.21.15.7:0/17329419", 2021-01-03T13:02:05.645 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2021-01-03T13:02:05.645 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 21, 2021-01-03T13:02:05.645 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 55, 2021-01-03T13:02:05.645 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:02:05.646 INFO:teuthology.orchestra.run.smithi007.stdout: "blacklisted": false, 2021-01-03T13:02:05.646 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2021-01-03T13:02:05.646 INFO:teuthology.orchestra.run.smithi007.stdout:} 2021-01-03T13:02:05.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:02:05.649 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:02:05.649 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:02:05.656 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:02:05.657 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:02:05.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:02:05.657 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:02:07.220 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:02:07.222 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:02:07.225 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:02:07.227 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:02:37.342 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:02:37.345 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:02:37.347 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:02:37.349 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:03:00.565 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:03:00.566 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:03:00.586 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:03:00.607 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:03:00.627 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:03:00.647 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:03:00.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:00.650 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:03:00.651 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:03:00.659 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:03:00.660 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:03:00.660 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T13:03:00.661 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:03:00.661 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:03:00.729 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[11998]: fuse finished with error 0 and tester_r 0 2021-01-03T13:03:00.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:00.731 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:03:00.732 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:03:00.779 INFO:teuthology.orchestra.run.smithi007.stdout:ext2/ext3 2021-01-03T13:03:00.780 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:03:00.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:03:00.889 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:03:00.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:00.936 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:03:00.936 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:03:00.943 INFO:teuthology.orchestra.run.smithi036.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:03:00.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:03:00.944 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-01-03T13:03:00.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:03:00.945 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:03:00.993 INFO:teuthology.orchestra.run.smithi036.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:03:00.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:03:00.994 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-01-03T13:03:01.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.123+0000 7fb381d10700 1 Processor -- start 2021-01-03T13:03:01.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.123+0000 7fb381d10700 1 -- start start 2021-01-03T13:03:01.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.123+0000 7fb381d10700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb37c05f920 0x7fb37c0b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:01.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.123+0000 7fb381d10700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb37c066f30 0x7fb37c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:01.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.123+0000 7fb381d10700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb37c0b1590 0x7fb37c0613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:01.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.123+0000 7fb381d10700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37c0ae700 con 0x7fb37c05f920 2021-01-03T13:03:01.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.123+0000 7fb381d10700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37c05fd00 con 0x7fb37c0b1590 2021-01-03T13:03:01.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.123+0000 7fb381d10700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c0accd0 con 0x7fb37c066f30 2021-01-03T13:03:01.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.123+0000 7fb38150f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb37c0b1590 0x7fb37c0613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:01.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.123+0000 7fb38150f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb37c0b1590 0x7fb37c0613e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34750/0 (socket says 172.21.15.133:34750) 2021-01-03T13:03:01.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.123+0000 7fb38150f700 1 -- 172.21.15.133:0/2731117752 learned_addr learned my addr 172.21.15.133:0/2731117752 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:01.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.123+0000 7fb37bfff700 1 --2- 172.21.15.133:0/2731117752 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb37c066f30 0x7fb37c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:01.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.123+0000 7fb380d0e700 1 --2- 172.21.15.133:0/2731117752 >> v2:172.21.15.16:3300/0 conn(0x7fb37c05f920 0x7fb37c0b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:01.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.123+0000 7fb38150f700 1 -- 172.21.15.133:0/2731117752 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb37c066f30 msgr2=0x7fb37c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:01.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb38150f700 1 --2- 172.21.15.133:0/2731117752 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb37c066f30 0x7fb37c0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb38150f700 1 -- 172.21.15.133:0/2731117752 >> v2:172.21.15.16:3300/0 conn(0x7fb37c05f920 msgr2=0x7fb37c0b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:01.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb38150f700 1 --2- 172.21.15.133:0/2731117752 >> v2:172.21.15.16:3300/0 conn(0x7fb37c05f920 0x7fb37c0b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb38150f700 1 -- 172.21.15.133:0/2731117752 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c0acf70 con 0x7fb37c0b1590 2021-01-03T13:03:01.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb380d0e700 1 --2- 172.21.15.133:0/2731117752 >> v2:172.21.15.16:3300/0 conn(0x7fb37c05f920 0x7fb37c0b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:01.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb37bfff700 1 --2- 172.21.15.133:0/2731117752 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb37c066f30 0x7fb37c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:01.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb38150f700 1 --2- 172.21.15.133:0/2731117752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb37c0b1590 0x7fb37c0613e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fb3740032b0 tx=0x7fb374009270).ready entity=mon.1 client_cookie=c572ecb7e25dae90 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:01.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb37b7fe700 1 -- 172.21.15.133:0/2731117752 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb37400bc00 con 0x7fb37c0b1590 2021-01-03T13:03:01.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb37b7fe700 1 -- 172.21.15.133:0/2731117752 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37400bd60 con 0x7fb37c0b1590 2021-01-03T13:03:01.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb37b7fe700 1 -- 172.21.15.133:0/2731117752 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb374011400 con 0x7fb37c0b1590 2021-01-03T13:03:01.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb381d10700 1 -- 172.21.15.133:0/2731117752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb37c0b1590 msgr2=0x7fb37c0613e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:01.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb381d10700 1 --2- 172.21.15.133:0/2731117752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb37c0b1590 0x7fb37c0613e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fb3740032b0 tx=0x7fb374009270).stop 2021-01-03T13:03:01.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb381d10700 1 -- 172.21.15.133:0/2731117752 shutdown_connections 2021-01-03T13:03:01.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb381d10700 1 --2- 172.21.15.133:0/2731117752 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb37c0b1590 0x7fb37c0613e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb381d10700 1 --2- 172.21.15.133:0/2731117752 >> v2:172.21.15.16:3300/0 conn(0x7fb37c05f920 0x7fb37c0b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb381d10700 1 --2- 172.21.15.133:0/2731117752 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb37c066f30 0x7fb37c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb381d10700 1 -- 172.21.15.133:0/2731117752 >> 172.21.15.133:0/2731117752 conn(0x7fb37c0b6110 msgr2=0x7fb37c0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:01.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb381d10700 1 -- 172.21.15.133:0/2731117752 shutdown_connections 2021-01-03T13:03:01.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb381d10700 1 -- 172.21.15.133:0/2731117752 wait complete. 2021-01-03T13:03:01.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb381d10700 1 Processor -- start 2021-01-03T13:03:01.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.127+0000 7fb381d10700 1 -- start start 2021-01-03T13:03:01.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb381d10700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb37c05f920 0x7fb37c152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:01.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb381d10700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb37c066f30 0x7fb37c13c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:01.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb381d10700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb37c0b1590 0x7fb37c13eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:01.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb381d10700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c13cb10 con 0x7fb37c066f30 2021-01-03T13:03:01.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb381d10700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c13cd40 con 0x7fb37c0b1590 2021-01-03T13:03:01.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb381d10700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c066650 con 0x7fb37c05f920 2021-01-03T13:03:01.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb38150f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb37c0b1590 0x7fb37c13eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:01.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb38150f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb37c0b1590 0x7fb37c13eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34758/0 (socket says 172.21.15.133:34758) 2021-01-03T13:03:01.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb38150f700 1 -- 172.21.15.133:0/947736527 learned_addr learned my addr 172.21.15.133:0/947736527 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:01.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb37bfff700 1 --2- 172.21.15.133:0/947736527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb37c066f30 0x7fb37c13c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:01.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb380d0e700 1 --2- 172.21.15.133:0/947736527 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb37c05f920 0x7fb37c152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:01.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb38150f700 1 -- 172.21.15.133:0/947736527 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb37c05f920 msgr2=0x7fb37c152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:01.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb38150f700 1 --2- 172.21.15.133:0/947736527 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb37c05f920 0x7fb37c152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb38150f700 1 -- 172.21.15.133:0/947736527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb37c066f30 msgr2=0x7fb37c13c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:01.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb38150f700 1 --2- 172.21.15.133:0/947736527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb37c066f30 0x7fb37c13c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb38150f700 1 -- 172.21.15.133:0/947736527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c0668f0 con 0x7fb37c0b1590 2021-01-03T13:03:01.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb38150f700 1 --2- 172.21.15.133:0/947736527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb37c0b1590 0x7fb37c13eb80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fb37c066420 tx=0x7fb374016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:01.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb379ffb700 1 -- 172.21.15.133:0/947736527 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb374011e90 con 0x7fb37c0b1590 2021-01-03T13:03:01.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb379ffb700 1 -- 172.21.15.133:0/947736527 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37401f3f0 con 0x7fb37c0b1590 2021-01-03T13:03:01.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb379ffb700 1 -- 172.21.15.133:0/947736527 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb37401f750 con 0x7fb37c0b1590 2021-01-03T13:03:01.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb381d10700 1 -- 172.21.15.133:0/947736527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37c140ad0 con 0x7fb37c0b1590 2021-01-03T13:03:01.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb381d10700 1 -- 172.21.15.133:0/947736527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37c14e770 con 0x7fb37c0b1590 2021-01-03T13:03:01.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.131+0000 7fb381d10700 1 -- 172.21.15.133:0/947736527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37c057300 con 0x7fb37c0b1590 2021-01-03T13:03:01.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.135+0000 7fb379ffb700 1 -- 172.21.15.133:0/947736527 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb374026030 con 0x7fb37c0b1590 2021-01-03T13:03:01.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.135+0000 7fb379ffb700 1 --2- 172.21.15.133:0/947736527 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb364057650 0x7fb364059b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:01.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.135+0000 7fb379ffb700 1 -- 172.21.15.133:0/947736527 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb37406efb0 con 0x7fb37c0b1590 2021-01-03T13:03:01.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.135+0000 7fb380d0e700 1 --2- 172.21.15.133:0/947736527 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb364057650 0x7fb364059b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:01.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.135+0000 7fb380d0e700 1 --2- 172.21.15.133:0/947736527 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb364057650 0x7fb364059b10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fb37000c000 tx=0x7fb370008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:01.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.139+0000 7fb379ffb700 1 -- 172.21.15.133:0/947736527 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb374048bd0 con 0x7fb37c0b1590 2021-01-03T13:03:01.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.279+0000 7fb381d10700 1 -- 172.21.15.133:0/947736527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb37c061020 con 0x7fb37c0b1590 2021-01-03T13:03:01.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.287+0000 7fb379ffb700 1 -- 172.21.15.133:0/947736527 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb374024020 con 0x7fb37c0b1590 2021-01-03T13:03:01.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.291+0000 7fb381d10700 1 -- 172.21.15.133:0/947736527 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb364057650 msgr2=0x7fb364059b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:01.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.291+0000 7fb381d10700 1 --2- 172.21.15.133:0/947736527 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb364057650 0x7fb364059b10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fb37000c000 tx=0x7fb370008040).stop 2021-01-03T13:03:01.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.291+0000 7fb381d10700 1 -- 172.21.15.133:0/947736527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb37c0b1590 msgr2=0x7fb37c13eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:01.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.291+0000 7fb381d10700 1 --2- 172.21.15.133:0/947736527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb37c0b1590 0x7fb37c13eb80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fb37c066420 tx=0x7fb374016000).stop 2021-01-03T13:03:01.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.291+0000 7fb381d10700 1 -- 172.21.15.133:0/947736527 shutdown_connections 2021-01-03T13:03:01.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.291+0000 7fb381d10700 1 --2- 172.21.15.133:0/947736527 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb364057650 0x7fb364059b10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.291+0000 7fb381d10700 1 --2- 172.21.15.133:0/947736527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb37c0b1590 0x7fb37c13eb80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.291+0000 7fb381d10700 1 --2- 172.21.15.133:0/947736527 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb37c05f920 0x7fb37c152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.291+0000 7fb381d10700 1 --2- 172.21.15.133:0/947736527 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb37c066f30 0x7fb37c13c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.291+0000 7fb381d10700 1 -- 172.21.15.133:0/947736527 >> 172.21.15.133:0/947736527 conn(0x7fb37c0b6110 msgr2=0x7fb37c0ad480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:01.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.291+0000 7fb381d10700 1 -- 172.21.15.133:0/947736527 shutdown_connections 2021-01-03T13:03:01.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.291+0000 7fb381d10700 1 -- 172.21.15.133:0/947736527 wait complete. 2021-01-03T13:03:01.300 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2021-01-03T13:03:01.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.423+0000 7f426d9f4700 1 Processor -- start 2021-01-03T13:03:01.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.423+0000 7f426d9f4700 1 -- start start 2021-01-03T13:03:01.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.423+0000 7f426d9f4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42680b3060 0x7f4268141660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:01.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.423+0000 7f426d9f4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f42680b3870 0x7f42680b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:01.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.423+0000 7f426d9f4700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f426805f5e0 0x7f426813def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:01.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.423+0000 7f426d9f4700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42680b24f0 con 0x7f426805f5e0 2021-01-03T13:03:01.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.423+0000 7f426d9f4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42680b3440 con 0x7f42680b3870 2021-01-03T13:03:01.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.423+0000 7f426d9f4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4268140c80 con 0x7f42680b3060 2021-01-03T13:03:01.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.423+0000 7f4267fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f42680b3870 0x7f42680b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:01.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.423+0000 7f4267fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f42680b3870 0x7f42680b1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34766/0 (socket says 172.21.15.133:34766) 2021-01-03T13:03:01.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.423+0000 7f4267fff700 1 -- 172.21.15.133:0/2618465760 learned_addr learned my addr 172.21.15.133:0/2618465760 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:01.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.423+0000 7f426c9f2700 1 --2- 172.21.15.133:0/2618465760 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42680b3060 0x7f4268141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:01.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.423+0000 7f426d1f3700 1 --2- 172.21.15.133:0/2618465760 >> v2:172.21.15.16:3300/0 conn(0x7f426805f5e0 0x7f426813def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:01.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f4267fff700 1 -- 172.21.15.133:0/2618465760 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42680b3060 msgr2=0x7f4268141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:01.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f4267fff700 1 --2- 172.21.15.133:0/2618465760 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42680b3060 0x7f4268141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f4267fff700 1 -- 172.21.15.133:0/2618465760 >> v2:172.21.15.16:3300/0 conn(0x7f426805f5e0 msgr2=0x7f426813def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:01.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f4267fff700 1 --2- 172.21.15.133:0/2618465760 >> v2:172.21.15.16:3300/0 conn(0x7f426805f5e0 0x7f426813def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f4267fff700 1 -- 172.21.15.133:0/2618465760 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4268140f20 con 0x7f42680b3870 2021-01-03T13:03:01.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f4267fff700 1 --2- 172.21.15.133:0/2618465760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42680b3870 0x7f42680b1cc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f4258002f30 tx=0x7f4258006e80).ready entity=mon.1 client_cookie=3697a3bee0a0cd82 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:01.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f42677fe700 1 -- 172.21.15.133:0/2618465760 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42580097f0 con 0x7f42680b3870 2021-01-03T13:03:01.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f42677fe700 1 -- 172.21.15.133:0/2618465760 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4258009950 con 0x7f42680b3870 2021-01-03T13:03:01.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f42677fe700 1 -- 172.21.15.133:0/2618465760 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4258009cb0 con 0x7f42680b3870 2021-01-03T13:03:01.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f426d9f4700 1 -- 172.21.15.133:0/2618465760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42680b3870 msgr2=0x7f42680b1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:01.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f426d9f4700 1 --2- 172.21.15.133:0/2618465760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42680b3870 0x7f42680b1cc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f4258002f30 tx=0x7f4258006e80).stop 2021-01-03T13:03:01.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f426d9f4700 1 -- 172.21.15.133:0/2618465760 shutdown_connections 2021-01-03T13:03:01.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f426d9f4700 1 --2- 172.21.15.133:0/2618465760 >> v2:172.21.15.16:3300/0 conn(0x7f426805f5e0 0x7f426813def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f426d9f4700 1 --2- 172.21.15.133:0/2618465760 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42680b3060 0x7f4268141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f426d9f4700 1 --2- 172.21.15.133:0/2618465760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42680b3870 0x7f42680b1cc0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f426d9f4700 1 -- 172.21.15.133:0/2618465760 >> 172.21.15.133:0/2618465760 conn(0x7f42680b7200 msgr2=0x7f42680b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:01.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f426d9f4700 1 -- 172.21.15.133:0/2618465760 shutdown_connections 2021-01-03T13:03:01.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f426d9f4700 1 -- 172.21.15.133:0/2618465760 wait complete. 2021-01-03T13:03:01.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f426d9f4700 1 Processor -- start 2021-01-03T13:03:01.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.427+0000 7f426d9f4700 1 -- start start 2021-01-03T13:03:01.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426d9f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f426805f5e0 0x7f426813ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:01.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426d9f4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42680b3060 0x7f42681530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:01.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426d9f4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42680b3870 0x7f4268153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:01.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426d9f4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42680ae570 con 0x7f42680b3870 2021-01-03T13:03:01.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426d9f4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4268065560 con 0x7f426805f5e0 2021-01-03T13:03:01.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426d9f4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4268065800 con 0x7f42680b3060 2021-01-03T13:03:01.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426c9f2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f426805f5e0 0x7f426813ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:01.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426c9f2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f426805f5e0 0x7f426813ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34768/0 (socket says 172.21.15.133:34768) 2021-01-03T13:03:01.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426c9f2700 1 -- 172.21.15.133:0/36405631 learned_addr learned my addr 172.21.15.133:0/36405631 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:01.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f4267fff700 1 --2- 172.21.15.133:0/36405631 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42680b3060 0x7f42681530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:01.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426d1f3700 1 --2- 172.21.15.133:0/36405631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42680b3870 0x7f4268153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:01.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426c9f2700 1 -- 172.21.15.133:0/36405631 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42680b3060 msgr2=0x7f42681530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:01.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426c9f2700 1 --2- 172.21.15.133:0/36405631 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42680b3060 0x7f42681530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426c9f2700 1 -- 172.21.15.133:0/36405631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42680b3870 msgr2=0x7f4268153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:01.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426c9f2700 1 --2- 172.21.15.133:0/36405631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42680b3870 0x7f4268153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:01.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426c9f2700 1 -- 172.21.15.133:0/36405631 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4268065aa0 con 0x7f426805f5e0 2021-01-03T13:03:01.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426c9f2700 1 --2- 172.21.15.133:0/36405631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f426805f5e0 0x7f426813ad10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f4250003070 tx=0x7f4250008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:01.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f4265ffb700 1 -- 172.21.15.133:0/36405631 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4250009980 con 0x7f426805f5e0 2021-01-03T13:03:01.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426d9f4700 1 -- 172.21.15.133:0/36405631 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4268066930 con 0x7f426805f5e0 2021-01-03T13:03:01.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f4265ffb700 1 -- 172.21.15.133:0/36405631 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4250009ae0 con 0x7f426805f5e0 2021-01-03T13:03:01.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f4265ffb700 1 -- 172.21.15.133:0/36405631 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4250009e40 con 0x7f426805f5e0 2021-01-03T13:03:01.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426d9f4700 1 -- 172.21.15.133:0/36405631 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42680661d0 con 0x7f426805f5e0 2021-01-03T13:03:01.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.431+0000 7f426d9f4700 1 -- 172.21.15.133:0/36405631 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4268152ea0 con 0x7f426805f5e0 2021-01-03T13:03:01.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.435+0000 7f4265ffb700 1 -- 172.21.15.133:0/36405631 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4250013480 con 0x7f426805f5e0 2021-01-03T13:03:01.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.435+0000 7f4265ffb700 1 --2- 172.21.15.133:0/36405631 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f42400553b0 0x7f4240057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:01.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.435+0000 7f4265ffb700 1 -- 172.21.15.133:0/36405631 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f425006e820 con 0x7f426805f5e0 2021-01-03T13:03:01.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.435+0000 7f4267fff700 1 --2- 172.21.15.133:0/36405631 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f42400553b0 0x7f4240057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:01.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.435+0000 7f4267fff700 1 --2- 172.21.15.133:0/36405631 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f42400553b0 0x7f4240057870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f425801a000 tx=0x7f4258015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:01.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.439+0000 7f4265ffb700 1 -- 172.21.15.133:0/36405631 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4250044930 con 0x7f426805f5e0 2021-01-03T13:03:01.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:01.631+0000 7f426d9f4700 1 -- 172.21.15.133:0/36405631 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f4268057300 con 0x7f426805f5e0 2021-01-03T13:03:02.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.399+0000 7f4265ffb700 1 -- 172.21.15.133:0/36405631 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v218) v1 ==== 152+0+0 (secure 0 0 0) 0x7f4250047f50 con 0x7f426805f5e0 2021-01-03T13:03:02.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.403+0000 7f426d9f4700 1 -- 172.21.15.133:0/36405631 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f42400553b0 msgr2=0x7f4240057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:02.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.403+0000 7f426d9f4700 1 --2- 172.21.15.133:0/36405631 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f42400553b0 0x7f4240057870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f425801a000 tx=0x7f4258015000).stop 2021-01-03T13:03:02.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.403+0000 7f426d9f4700 1 -- 172.21.15.133:0/36405631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f426805f5e0 msgr2=0x7f426813ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:02.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.403+0000 7f426d9f4700 1 --2- 172.21.15.133:0/36405631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f426805f5e0 0x7f426813ad10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f4250003070 tx=0x7f4250008040).stop 2021-01-03T13:03:02.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.403+0000 7f426d9f4700 1 -- 172.21.15.133:0/36405631 shutdown_connections 2021-01-03T13:03:02.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.403+0000 7f426d9f4700 1 --2- 172.21.15.133:0/36405631 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f42400553b0 0x7f4240057870 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:02.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.403+0000 7f426d9f4700 1 --2- 172.21.15.133:0/36405631 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42680b3870 0x7f4268153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:02.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.403+0000 7f426d9f4700 1 --2- 172.21.15.133:0/36405631 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f426805f5e0 0x7f426813ad10 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:02.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.403+0000 7f426d9f4700 1 --2- 172.21.15.133:0/36405631 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42680b3060 0x7f42681530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:02.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.403+0000 7f426d9f4700 1 -- 172.21.15.133:0/36405631 >> 172.21.15.133:0/36405631 conn(0x7f42680b7200 msgr2=0x7f426813c800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:02.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.403+0000 7f426d9f4700 1 -- 172.21.15.133:0/36405631 shutdown_connections 2021-01-03T13:03:02.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.403+0000 7f426d9f4700 1 -- 172.21.15.133:0/36405631 wait complete. 2021-01-03T13:03:02.416 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-01-03T13:03:02.416 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2021-01-03T13:03:02.417 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-01-03T13:03:02.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.531+0000 7f09f5dd1700 1 Processor -- start 2021-01-03T13:03:02.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.531+0000 7f09f5dd1700 1 -- start start 2021-01-03T13:03:02.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f5dd1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09f00b3060 0x7f09f0141660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:02.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f5dd1700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f00b24f0 con 0x7f09f005f5e0 2021-01-03T13:03:02.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f5dd1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f00b3440 con 0x7f09f00b3870 2021-01-03T13:03:02.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f5dd1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0140c80 con 0x7f09f00b3060 2021-01-03T13:03:02.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09effff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f09f00b3870 0x7f09f00b1cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55810/0 (socket says 172.21.15.133:55810) 2021-01-03T13:03:02.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09effff700 1 -- 172.21.15.133:0/625751366 learned_addr learned my addr 172.21.15.133:0/625751366 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:02.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f4dcf700 1 --2- 172.21.15.133:0/625751366 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09f00b3060 0x7f09f0141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:02.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 -- 172.21.15.133:0/625751366 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227416801 0 0) 0x7f09f00b3440 con 0x7f09f00b3870 2021-01-03T13:03:02.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 -- 172.21.15.133:0/625751366 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09d0003230 con 0x7f09f00b3870 2021-01-03T13:03:02.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 -- 172.21.15.133:0/625751366 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001251268 0 0) 0x7f09f00b24f0 con 0x7f09f005f5e0 2021-01-03T13:03:02.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 -- 172.21.15.133:0/625751366 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09f00b3440 con 0x7f09f005f5e0 2021-01-03T13:03:02.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 -- 172.21.15.133:0/625751366 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 689175619 0 0) 0x7f09d0003230 con 0x7f09f00b3870 2021-01-03T13:03:02.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 -- 172.21.15.133:0/625751366 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09f00b3060 msgr2=0x7f09f0141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:02.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 --2- 172.21.15.133:0/625751366 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09f00b3060 0x7f09f0141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:02.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 -- 172.21.15.133:0/625751366 >> v1:172.21.15.16:6789/0 conn(0x7f09f005f5e0 legacy=0x7f09f013def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:02.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 -- 172.21.15.133:0/625751366 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f0140f20 con 0x7f09f00b3870 2021-01-03T13:03:02.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 -- 172.21.15.133:0/625751366 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f09d80016d0 con 0x7f09f00b3870 2021-01-03T13:03:02.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f4dcf700 1 --2- 172.21.15.133:0/625751366 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09f00b3060 0x7f09f0141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:03:02.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 -- 172.21.15.133:0/625751366 >> v1:172.21.15.133:6789/0 conn(0x7f09f00b3870 legacy=0x7f09f00b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:02.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 --2- 172.21.15.133:0/625751366 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09f00b3060 0x7f09d00038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:02.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 --2- 172.21.15.133:0/625751366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09d0003da0 0x7f09d00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:02.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 --2- 172.21.15.133:0/625751366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09d00049c0 0x7f09d0004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:02.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 -- 172.21.15.133:0/625751366 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0140c80 con 0x7f09d0003da0 2021-01-03T13:03:02.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 -- 172.21.15.133:0/625751366 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d0005330 con 0x7f09d00049c0 2021-01-03T13:03:02.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 -- 172.21.15.133:0/625751366 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d000b750 con 0x7f09f00b3060 2021-01-03T13:03:02.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f55d0700 1 --2- 172.21.15.133:0/625751366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09d00049c0 0x7f09d0004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:02.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f4dcf700 1 --2- 172.21.15.133:0/625751366 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09f00b3060 0x7f09d00038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:02.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09effff700 1 --2- 172.21.15.133:0/625751366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09d0003da0 0x7f09d00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:02.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f55d0700 1 -- 172.21.15.133:0/625751366 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09f00b3060 msgr2=0x7f09d00038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:02.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f55d0700 1 --2- 172.21.15.133:0/625751366 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09f00b3060 0x7f09d00038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:02.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f55d0700 1 -- 172.21.15.133:0/625751366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09d0003da0 msgr2=0x7f09d00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:02.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f55d0700 1 --2- 172.21.15.133:0/625751366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09d0003da0 0x7f09d00044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:02.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f55d0700 1 -- 172.21.15.133:0/625751366 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d0003230 con 0x7f09d00049c0 2021-01-03T13:03:02.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f55d0700 1 --2- 172.21.15.133:0/625751366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09d00049c0 0x7f09d0004e40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f09e8001450 tx=0x7f09e8007ee0).ready entity=mon.1 client_cookie=5bc98cc92b4f337f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:02.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 -- 172.21.15.133:0/625751366 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09e800cb50 con 0x7f09d00049c0 2021-01-03T13:03:02.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 -- 172.21.15.133:0/625751366 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e800ccb0 con 0x7f09d00049c0 2021-01-03T13:03:02.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09ef7fe700 1 -- 172.21.15.133:0/625751366 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09e80125f0 con 0x7f09d00049c0 2021-01-03T13:03:02.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f5dd1700 1 -- 172.21.15.133:0/625751366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09d00049c0 msgr2=0x7f09d0004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:02.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f5dd1700 1 --2- 172.21.15.133:0/625751366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09d00049c0 0x7f09d0004e40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f09e8001450 tx=0x7f09e8007ee0).stop 2021-01-03T13:03:02.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f55d0700 1 -- 172.21.15.133:0/625751366 reap_dead start 2021-01-03T13:03:02.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f5dd1700 1 -- 172.21.15.133:0/625751366 shutdown_connections 2021-01-03T13:03:02.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f5dd1700 1 -- 172.21.15.133:0/625751366 >> 172.21.15.133:0/625751366 conn(0x7f09f00b7200 msgr2=0x7f09f00b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:02.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f5dd1700 1 -- 172.21.15.133:0/625751366 shutdown_connections 2021-01-03T13:03:02.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.535+0000 7f09f5dd1700 1 -- 172.21.15.133:0/625751366 wait complete. 2021-01-03T13:03:02.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.539+0000 7f09f5dd1700 1 Processor -- start 2021-01-03T13:03:02.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.539+0000 7f09f5dd1700 1 -- start start 2021-01-03T13:03:02.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.539+0000 7f09f5dd1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09f0146580 0x7f09f0143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:02.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.539+0000 7f09f5dd1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f0141e80 0x7f09f0143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.539+0000 7f09f5dd1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09f0142e30 0x7f09f0153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.539+0000 7f09f5dd1700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0146960 con 0x7f09f0146580 2021-01-03T13:03:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.539+0000 7f09f5dd1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f01435a0 con 0x7f09f0141e80 2021-01-03T13:03:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.539+0000 7f09f5dd1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0142a50 con 0x7f09f0142e30 2021-01-03T13:03:02.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.539+0000 7f09effff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f0141e80 0x7f09f0143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:02.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.539+0000 7f09effff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f0141e80 0x7f09f0143ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34792/0 (socket says 172.21.15.133:34792) 2021-01-03T13:03:02.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09effff700 1 -- 172.21.15.133:0/2022795713 learned_addr learned my addr 172.21.15.133:0/2022795713 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:02.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09f4dcf700 1 --2- 172.21.15.133:0/2022795713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09f0146580 0x7f09f0143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:02.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09f55d0700 1 --2- 172.21.15.133:0/2022795713 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09f0142e30 0x7f09f0153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:02.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09effff700 1 -- 172.21.15.133:0/2022795713 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09f0142e30 msgr2=0x7f09f0153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:02.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09effff700 1 --2- 172.21.15.133:0/2022795713 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09f0142e30 0x7f09f0153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:02.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09effff700 1 -- 172.21.15.133:0/2022795713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09f0146580 msgr2=0x7f09f0143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:02.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09effff700 1 --2- 172.21.15.133:0/2022795713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09f0146580 0x7f09f0143a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:02.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09effff700 1 -- 172.21.15.133:0/2022795713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f0142510 con 0x7f09f0141e80 2021-01-03T13:03:02.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09effff700 1 --2- 172.21.15.133:0/2022795713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f0141e80 0x7f09f0143ef0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f09d800d000 tx=0x7f09d8007740).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:02.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09edffb700 1 -- 172.21.15.133:0/2022795713 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09d800fa30 con 0x7f09f0141e80 2021-01-03T13:03:02.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09edffb700 1 -- 172.21.15.133:0/2022795713 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d800fb90 con 0x7f09f0141e80 2021-01-03T13:03:02.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09f5dd1700 1 -- 172.21.15.133:0/2022795713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f01427b0 con 0x7f09f0141e80 2021-01-03T13:03:02.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09edffb700 1 -- 172.21.15.133:0/2022795713 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09d8007e70 con 0x7f09f0141e80 2021-01-03T13:03:02.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09f5dd1700 1 -- 172.21.15.133:0/2022795713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f0152f70 con 0x7f09f0141e80 2021-01-03T13:03:02.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09f5dd1700 1 -- 172.21.15.133:0/2022795713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f0143710 con 0x7f09f0141e80 2021-01-03T13:03:02.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09edffb700 1 -- 172.21.15.133:0/2022795713 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f09d801b030 con 0x7f09f0141e80 2021-01-03T13:03:02.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09edffb700 1 --2- 172.21.15.133:0/2022795713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f09d4055440 0x7f09d4057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:02.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09edffb700 1 -- 172.21.15.133:0/2022795713 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f09d806d8d0 con 0x7f09f0141e80 2021-01-03T13:03:02.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09f4dcf700 1 --2- 172.21.15.133:0/2022795713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f09d4055440 0x7f09d4057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:02.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.543+0000 7f09f4dcf700 1 --2- 172.21.15.133:0/2022795713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f09d4055440 0x7f09d4057900 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f09e0008000 tx=0x7f09e0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:02.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.551+0000 7f09edffb700 1 -- 172.21.15.133:0/2022795713 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f09d8043bd0 con 0x7f09f0141e80 2021-01-03T13:03:02.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:02.743+0000 7f09f5dd1700 1 -- 172.21.15.133:0/2022795713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f09f0057300 con 0x7f09f0141e80 2021-01-03T13:03:03.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.407+0000 7f09edffb700 1 -- 172.21.15.133:0/2022795713 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v219) v1 ==== 150+0+0 (secure 0 0 0) 0x7f09d8019030 con 0x7f09f0141e80 2021-01-03T13:03:03.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.411+0000 7f09f5dd1700 1 -- 172.21.15.133:0/2022795713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f09d4055440 msgr2=0x7f09d4057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:03.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.411+0000 7f09f5dd1700 1 --2- 172.21.15.133:0/2022795713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f09d4055440 0x7f09d4057900 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f09e0008000 tx=0x7f09e0008040).stop 2021-01-03T13:03:03.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.411+0000 7f09f5dd1700 1 -- 172.21.15.133:0/2022795713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f0141e80 msgr2=0x7f09f0143ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:03.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.411+0000 7f09f5dd1700 1 --2- 172.21.15.133:0/2022795713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f0141e80 0x7f09f0143ef0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f09d800d000 tx=0x7f09d8007740).stop 2021-01-03T13:03:03.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.411+0000 7f09f5dd1700 1 -- 172.21.15.133:0/2022795713 shutdown_connections 2021-01-03T13:03:03.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.411+0000 7f09f5dd1700 1 --2- 172.21.15.133:0/2022795713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f09d4055440 0x7f09d4057900 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.411+0000 7f09f5dd1700 1 --2- 172.21.15.133:0/2022795713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09f0146580 0x7f09f0143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.411+0000 7f09f5dd1700 1 --2- 172.21.15.133:0/2022795713 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09f0142e30 0x7f09f0153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.411+0000 7f09f5dd1700 1 --2- 172.21.15.133:0/2022795713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f0141e80 0x7f09f0143ef0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.411+0000 7f09f5dd1700 1 -- 172.21.15.133:0/2022795713 >> 172.21.15.133:0/2022795713 conn(0x7f09f00b7200 msgr2=0x7f09f013dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:03.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.411+0000 7f09f5dd1700 1 -- 172.21.15.133:0/2022795713 shutdown_connections 2021-01-03T13:03:03.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.411+0000 7f09f5dd1700 1 -- 172.21.15.133:0/2022795713 wait complete. 2021-01-03T13:03:03.425 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-01-03T13:03:03.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.555+0000 7f602cd0a700 1 Processor -- start 2021-01-03T13:03:03.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.555+0000 7f602cd0a700 1 -- start start 2021-01-03T13:03:03.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f602cd0a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60280b5c00 0x7f60281477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:03.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f602cd0a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f60281442a0 0x7f6028144750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:03.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f602cd0a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60280b0c10 con 0x7f60280b5260 2021-01-03T13:03:03.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f602cd0a700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60280b5640 con 0x7f60281442a0 2021-01-03T13:03:03.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f602cd0a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602809a4f0 con 0x7f60280b5c00 2021-01-03T13:03:03.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f601effd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60280b5c00 0x7f60281477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:03.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f6027fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f60281442a0 0x7f6028144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:03.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f60277fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f60280b5260 0x7f60281470b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:34556/0 (socket says 172.21.15.133:34556) 2021-01-03T13:03:03.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f60277fe700 1 -- 172.21.15.133:0/2400339373 learned_addr learned my addr 172.21.15.133:0/2400339373 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:03.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f601effd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60280b5c00 0x7f60281477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:43100/0 (socket says 172.21.15.133:43100) 2021-01-03T13:03:03.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f601effd700 1 -- 172.21.15.133:0/2400339373 >> v2:172.21.15.16:3300/0 conn(0x7f60281442a0 msgr2=0x7f6028144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:03.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f601effd700 1 --2- 172.21.15.133:0/2400339373 >> v2:172.21.15.16:3300/0 conn(0x7f60281442a0 0x7f6028144750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f601effd700 1 -- 172.21.15.133:0/2400339373 >> v1:172.21.15.16:6789/0 conn(0x7f60280b5260 legacy=0x7f60281470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:03.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f601effd700 1 -- 172.21.15.133:0/2400339373 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60280b0e40 con 0x7f60280b5c00 2021-01-03T13:03:03.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f601effd700 1 --2- 172.21.15.133:0/2400339373 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60280b5c00 0x7f60281477c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f6018002f30 tx=0x7f6018006dc0).ready entity=mon.2 client_cookie=6c0f952ab5d794df server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:03.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f6026ffd700 1 -- 172.21.15.133:0/2400339373 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6018009760 con 0x7f60280b5c00 2021-01-03T13:03:03.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f6026ffd700 1 -- 172.21.15.133:0/2400339373 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60180098c0 con 0x7f60280b5c00 2021-01-03T13:03:03.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f6026ffd700 1 -- 172.21.15.133:0/2400339373 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6018009c20 con 0x7f60280b5c00 2021-01-03T13:03:03.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f602cd0a700 1 -- 172.21.15.133:0/2400339373 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60280b5c00 msgr2=0x7f60281477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:03.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f602cd0a700 1 --2- 172.21.15.133:0/2400339373 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60280b5c00 0x7f60281477c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f6018002f30 tx=0x7f6018006dc0).stop 2021-01-03T13:03:03.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f602cd0a700 1 -- 172.21.15.133:0/2400339373 shutdown_connections 2021-01-03T13:03:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f602cd0a700 1 --2- 172.21.15.133:0/2400339373 >> v2:172.21.15.16:3300/0 conn(0x7f60281442a0 0x7f6028144750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f602cd0a700 1 --2- 172.21.15.133:0/2400339373 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60280b5c00 0x7f60281477c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f602cd0a700 1 -- 172.21.15.133:0/2400339373 >> 172.21.15.133:0/2400339373 conn(0x7f602805bdf0 msgr2=0x7f602805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f602cd0a700 1 -- 172.21.15.133:0/2400339373 shutdown_connections 2021-01-03T13:03:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.559+0000 7f602cd0a700 1 -- 172.21.15.133:0/2400339373 wait complete. 2021-01-03T13:03:03.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f602cd0a700 1 Processor -- start 2021-01-03T13:03:03.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f602cd0a700 1 -- start start 2021-01-03T13:03:03.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f602cd0a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60280b5260 0x7f60281567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:03.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f602cd0a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60280b5c00 0x7f6028159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:03.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f602cd0a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60281442a0 0x7f60281405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:03.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f602cd0a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6028140250 con 0x7f60280b5c00 2021-01-03T13:03:03.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f602cd0a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6028155de0 con 0x7f60280b5260 2021-01-03T13:03:03.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f602cd0a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6028156080 con 0x7f60281442a0 2021-01-03T13:03:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f60277fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60280b5260 0x7f60281567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f60277fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60280b5260 0x7f60281567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34806/0 (socket says 172.21.15.133:34806) 2021-01-03T13:03:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f60277fe700 1 -- 172.21.15.133:0/2246854319 learned_addr learned my addr 172.21.15.133:0/2246854319 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f6027fff700 1 --2- 172.21.15.133:0/2246854319 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60281442a0 0x7f60281405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f601effd700 1 --2- 172.21.15.133:0/2246854319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60280b5c00 0x7f6028159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f60277fe700 1 -- 172.21.15.133:0/2246854319 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60281442a0 msgr2=0x7f60281405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f60277fe700 1 --2- 172.21.15.133:0/2246854319 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60281442a0 0x7f60281405e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f60277fe700 1 -- 172.21.15.133:0/2246854319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60280b5c00 msgr2=0x7f6028159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f60277fe700 1 --2- 172.21.15.133:0/2246854319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60280b5c00 0x7f6028159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f60277fe700 1 -- 172.21.15.133:0/2246854319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6028156320 con 0x7f60280b5260 2021-01-03T13:03:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f601effd700 1 --2- 172.21.15.133:0/2246854319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60280b5c00 0x7f6028159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:03:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f60277fe700 1 --2- 172.21.15.133:0/2246854319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60280b5260 0x7f60281567c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f602805cbf0 tx=0x7f6010007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f60257fa700 1 -- 172.21.15.133:0/2246854319 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60100072e0 con 0x7f60280b5260 2021-01-03T13:03:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f60257fa700 1 -- 172.21.15.133:0/2246854319 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6010007440 con 0x7f60280b5260 2021-01-03T13:03:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f602cd0a700 1 -- 172.21.15.133:0/2246854319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6028156cb0 con 0x7f60280b5260 2021-01-03T13:03:03.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f60257fa700 1 -- 172.21.15.133:0/2246854319 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60100057d0 con 0x7f60280b5260 2021-01-03T13:03:03.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.563+0000 7f602cd0a700 1 -- 172.21.15.133:0/2246854319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60280ac650 con 0x7f60280b5260 2021-01-03T13:03:03.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.567+0000 7f602cd0a700 1 -- 172.21.15.133:0/2246854319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60281403c0 con 0x7f60280b5260 2021-01-03T13:03:03.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.567+0000 7f60257fa700 1 -- 172.21.15.133:0/2246854319 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6010010070 con 0x7f60280b5260 2021-01-03T13:03:03.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.567+0000 7f60257fa700 1 --2- 172.21.15.133:0/2246854319 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f600c055440 0x7f600c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:03.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.567+0000 7f60257fa700 1 -- 172.21.15.133:0/2246854319 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f601006d5c0 con 0x7f60280b5260 2021-01-03T13:03:03.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.567+0000 7f601effd700 1 --2- 172.21.15.133:0/2246854319 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f600c055440 0x7f600c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:03.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.567+0000 7f601effd700 1 --2- 172.21.15.133:0/2246854319 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f600c055440 0x7f600c057900 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f601801a000 tx=0x7f6018015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:03.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.571+0000 7f60257fa700 1 -- 172.21.15.133:0/2246854319 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f60281403c0 con 0x7f60280b5260 2021-01-03T13:03:03.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.711+0000 7f602cd0a700 1 -- 172.21.15.133:0/2246854319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7f60281403c0 con 0x7f60280b5260 2021-01-03T13:03:03.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.719+0000 7f60257fa700 1 -- 172.21.15.133:0/2246854319 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f60281403c0 con 0x7f60280b5260 2021-01-03T13:03:03.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.723+0000 7f602cd0a700 1 -- 172.21.15.133:0/2246854319 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f600c055440 msgr2=0x7f600c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:03.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.723+0000 7f602cd0a700 1 --2- 172.21.15.133:0/2246854319 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f600c055440 0x7f600c057900 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f601801a000 tx=0x7f6018015000).stop 2021-01-03T13:03:03.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.723+0000 7f602cd0a700 1 -- 172.21.15.133:0/2246854319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60280b5260 msgr2=0x7f60281567c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:03.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.723+0000 7f602cd0a700 1 --2- 172.21.15.133:0/2246854319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60280b5260 0x7f60281567c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f602805cbf0 tx=0x7f6010007c10).stop 2021-01-03T13:03:03.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.723+0000 7f602cd0a700 1 -- 172.21.15.133:0/2246854319 shutdown_connections 2021-01-03T13:03:03.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.723+0000 7f602cd0a700 1 --2- 172.21.15.133:0/2246854319 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f600c055440 0x7f600c057900 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.723+0000 7f602cd0a700 1 --2- 172.21.15.133:0/2246854319 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60281442a0 0x7f60281405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.723+0000 7f602cd0a700 1 --2- 172.21.15.133:0/2246854319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60280b5260 0x7f60281567c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.723+0000 7f602cd0a700 1 --2- 172.21.15.133:0/2246854319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60280b5c00 0x7f6028159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.723+0000 7f602cd0a700 1 -- 172.21.15.133:0/2246854319 >> 172.21.15.133:0/2246854319 conn(0x7f602805bdf0 msgr2=0x7f60280b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:03.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.723+0000 7f602cd0a700 1 -- 172.21.15.133:0/2246854319 shutdown_connections 2021-01-03T13:03:03.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.723+0000 7f602cd0a700 1 -- 172.21.15.133:0/2246854319 wait complete. 2021-01-03T13:03:03.732 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:03:03.733 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:03:03.751 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:03:03.769 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:03:03.786 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:03:03.803 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:03:03.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:03.804 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:03:03.804 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:03:03.811 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-03T13:03:03.812 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:03:03.812 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-01-03T13:03:03.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:03.813 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:03:03.814 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:03:03.833 INFO:teuthology.orchestra.run.smithi036.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:03:03.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:03:03.835 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-01-03T13:03:03.835 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-01-03T13:03:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374ffff700 1 Processor -- start 2021-01-03T13:03:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374ffff700 1 -- start start 2021-01-03T13:03:03.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f37500b52c0 0x7f37500b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:03.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f37500b0c90 0x7f3750098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:03.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374ffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3750060da0 con 0x7f37500b5c00 2021-01-03T13:03:03.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374ffff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3750067a90 con 0x7f37500b0c90 2021-01-03T13:03:03.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37500b0ad0 con 0x7f37500b52c0 2021-01-03T13:03:03.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374f7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f37500b5c00 0x7f375014a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55846/0 (socket says 172.21.15.133:55846) 2021-01-03T13:03:03.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374f7fe700 1 -- 172.21.15.133:0/2756058081 learned_addr learned my addr 172.21.15.133:0/2756058081 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:03.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374e7fc700 1 --2- 172.21.15.133:0/2756058081 >> v2:172.21.15.133:3300/0 conn(0x7f37500b0c90 0x7f3750098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:03.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374effd700 1 --2- 172.21.15.133:0/2756058081 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f37500b52c0 0x7f37500b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:03.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374dffb700 1 -- 172.21.15.133:0/2756058081 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925091575 0 0) 0x7f3750060da0 con 0x7f37500b5c00 2021-01-03T13:03:03.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374dffb700 1 -- 172.21.15.133:0/2756058081 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3730003230 con 0x7f37500b5c00 2021-01-03T13:03:03.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374e7fc700 1 -- 172.21.15.133:0/2756058081 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f37500b52c0 msgr2=0x7f37500b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:03.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374e7fc700 1 --2- 172.21.15.133:0/2756058081 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f37500b52c0 0x7f37500b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374e7fc700 1 -- 172.21.15.133:0/2756058081 >> v1:172.21.15.133:6789/0 conn(0x7f37500b5c00 legacy=0x7f375014a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:03.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374e7fc700 1 -- 172.21.15.133:0/2756058081 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37500b56a0 con 0x7f37500b0c90 2021-01-03T13:03:03.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374effd700 1 --2- 172.21.15.133:0/2756058081 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f37500b52c0 0x7f37500b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:03.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.971+0000 7f374e7fc700 1 --2- 172.21.15.133:0/2756058081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37500b0c90 0x7f3750098ec0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f37480032b0 tx=0x7f37480091a0).ready entity=mon.1 client_cookie=405e670c6a063617 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374dffb700 1 -- 172.21.15.133:0/2756058081 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f374800b9a0 con 0x7f37500b0c90 2021-01-03T13:03:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374dffb700 1 -- 172.21.15.133:0/2756058081 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374800bb00 con 0x7f37500b0c90 2021-01-03T13:03:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374ffff700 1 -- 172.21.15.133:0/2756058081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37500b0c90 msgr2=0x7f3750098ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374ffff700 1 --2- 172.21.15.133:0/2756058081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37500b0c90 0x7f3750098ec0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f37480032b0 tx=0x7f37480091a0).stop 2021-01-03T13:03:03.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374dffb700 1 -- 172.21.15.133:0/2756058081 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f374800bc70 con 0x7f37500b0c90 2021-01-03T13:03:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374ffff700 1 -- 172.21.15.133:0/2756058081 shutdown_connections 2021-01-03T13:03:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374ffff700 1 --2- 172.21.15.133:0/2756058081 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f37500b52c0 0x7f37500b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374ffff700 1 --2- 172.21.15.133:0/2756058081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37500b0c90 0x7f3750098ec0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374ffff700 1 -- 172.21.15.133:0/2756058081 >> 172.21.15.133:0/2756058081 conn(0x7f375005bdf0 msgr2=0x7f375005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374ffff700 1 -- 172.21.15.133:0/2756058081 shutdown_connections 2021-01-03T13:03:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374ffff700 1 -- 172.21.15.133:0/2756058081 wait complete. 2021-01-03T13:03:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374ffff700 1 Processor -- start 2021-01-03T13:03:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374ffff700 1 -- start start 2021-01-03T13:03:03.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37500b0c90 0x7f3750155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f37500b52c0 0x7f3750063b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37500b5c00 0x7f3750064080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374ffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37500af070 con 0x7f37500b5c00 2021-01-03T13:03:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37500aea60 con 0x7f37500b0c90 2021-01-03T13:03:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3750156960 con 0x7f37500b52c0 2021-01-03T13:03:03.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37500b0c90 0x7f3750155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:03.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37500b0c90 0x7f3750155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34816/0 (socket says 172.21.15.133:34816) 2021-01-03T13:03:03.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.975+0000 7f374effd700 1 -- 172.21.15.133:0/1511303377 learned_addr learned my addr 172.21.15.133:0/1511303377 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:03.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f374f7fe700 1 --2- 172.21.15.133:0/1511303377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37500b5c00 0x7f3750064080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:03.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f374e7fc700 1 --2- 172.21.15.133:0/1511303377 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f37500b52c0 0x7f3750063b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:03.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f374effd700 1 -- 172.21.15.133:0/1511303377 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f37500b52c0 msgr2=0x7f3750063b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:03.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f374effd700 1 --2- 172.21.15.133:0/1511303377 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f37500b52c0 0x7f3750063b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f374effd700 1 -- 172.21.15.133:0/1511303377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37500b5c00 msgr2=0x7f3750064080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:03.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f374effd700 1 --2- 172.21.15.133:0/1511303377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37500b5c00 0x7f3750064080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:03.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f374effd700 1 -- 172.21.15.133:0/1511303377 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3750156b20 con 0x7f37500b0c90 2021-01-03T13:03:03.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f374f7fe700 1 --2- 172.21.15.133:0/1511303377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37500b5c00 0x7f3750064080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:03.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f374effd700 1 --2- 172.21.15.133:0/1511303377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37500b0c90 0x7f3750155b80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f3738006910 tx=0x7f3738008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:03.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f3747fff700 1 -- 172.21.15.133:0/1511303377 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3738009920 con 0x7f37500b0c90 2021-01-03T13:03:03.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f3747fff700 1 -- 172.21.15.133:0/1511303377 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3738009a80 con 0x7f37500b0c90 2021-01-03T13:03:03.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f374ffff700 1 -- 172.21.15.133:0/1511303377 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37500646c0 con 0x7f37500b0c90 2021-01-03T13:03:03.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f3747fff700 1 -- 172.21.15.133:0/1511303377 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3738009de0 con 0x7f37500b0c90 2021-01-03T13:03:03.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f374ffff700 1 -- 172.21.15.133:0/1511303377 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3750066990 con 0x7f37500b0c90 2021-01-03T13:03:03.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f374ffff700 1 -- 172.21.15.133:0/1511303377 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37500aec20 con 0x7f37500b0c90 2021-01-03T13:03:03.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f3747fff700 1 -- 172.21.15.133:0/1511303377 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3738013480 con 0x7f37500b0c90 2021-01-03T13:03:03.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f3747fff700 1 --2- 172.21.15.133:0/1511303377 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f37340553b0 0x7f3734057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:03.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f3747fff700 1 -- 172.21.15.133:0/1511303377 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f373806e730 con 0x7f37500b0c90 2021-01-03T13:03:03.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.979+0000 7f374e7fc700 1 --2- 172.21.15.133:0/1511303377 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f37340553b0 0x7f3734057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:03.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.983+0000 7f374e7fc700 1 --2- 172.21.15.133:0/1511303377 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f37340553b0 0x7f3734057870 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f3748019000 tx=0x7f3748016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:03.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:03.987+0000 7f3747fff700 1 -- 172.21.15.133:0/1511303377 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f37380449d0 con 0x7f37500b0c90 2021-01-03T13:03:04.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.131+0000 7f374ffff700 1 -- 172.21.15.133:0/1511303377 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3750057300 con 0x7f37500b0c90 2021-01-03T13:03:04.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.131+0000 7f3747fff700 1 -- 172.21.15.133:0/1511303377 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+33695 (secure 0 0 0) 0x7f3738047ff0 con 0x7f37500b0c90 2021-01-03T13:03:04.129 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:04.129 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:03:04.130 INFO:teuthology.orchestra.run.smithi133.stdout: "epoch": 55, 2021-01-03T13:03:04.130 INFO:teuthology.orchestra.run.smithi133.stdout: "fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", 2021-01-03T13:03:04.130 INFO:teuthology.orchestra.run.smithi133.stdout: "created": "2021-01-03T12:57:43.298835+0000", 2021-01-03T13:03:04.130 INFO:teuthology.orchestra.run.smithi133.stdout: "modified": "2021-01-03T13:01:36.969095+0000", 2021-01-03T13:03:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: "last_up_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:03:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: "last_in_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:03:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-01-03T13:03:04.131 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_num": 5799936, 2021-01-03T13:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_set": [ 2021-01-03T13:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: "pglog_hardlimit", 2021-01-03T13:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: "purged_snapdirs", 2021-01-03T13:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_deletes", 2021-01-03T13:03:04.132 INFO:teuthology.orchestra.run.smithi133.stdout: "sortbitwise" 2021-01-03T13:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_version": 4, 2021-01-03T13:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: "full_ratio": 0.94999998807907104, 2021-01-03T13:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-01-03T13:03:04.133 INFO:teuthology.orchestra.run.smithi133.stdout: "nearfull_ratio": 0.85000002384185791, 2021-01-03T13:03:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_snapshot": "", 2021-01-03T13:03:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_max": 10, 2021-01-03T13:03:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: "max_osd": 8, 2021-01-03T13:03:04.134 INFO:teuthology.orchestra.run.smithi133.stdout: "require_min_compat_client": "jewel", 2021-01-03T13:03:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: "min_compat_client": "jewel", 2021-01-03T13:03:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: "require_osd_release": "octopus", 2021-01-03T13:03:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: "pools": [ 2021-01-03T13:03:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.135 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 1, 2021-01-03T13:03:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "device_health_metrics", 2021-01-03T13:03:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:47.102954+0000", 2021-01-03T13:03:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:03:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:03:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:03:04.136 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:03:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:03:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:03:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:03:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:03:04.137 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 1, 2021-01-03T13:03:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 1, 2021-01-03T13:03:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 1, 2021-01-03T13:03:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 1, 2021-01-03T13:03:04.138 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 1, 2021-01-03T13:03:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:03:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:03:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:03:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:03:04.139 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:03:04.140 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:03:04.140 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:03:04.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.140 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "16", 2021-01-03T13:03:04.140 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:03:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:03:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:03:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:03:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:03:04.141 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:03:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:03:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:03:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:03:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:03:04.142 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:03:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:03:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:03:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:03:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:03:04.143 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:03:04.144 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:03:04.144 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:03:04.144 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:03:04.144 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:03:04.144 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:03:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:03:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:03:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:03:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:03:04.145 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:03:04.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.146 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:03:04.146 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:03:04.146 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:03:04.146 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:03:04.147 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:03:04.147 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:03:04.147 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:03:04.147 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:03:04.147 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:03:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:03:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:03:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:03:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 1 2021-01-03T13:03:04.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:03:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr_devicehealth": {} 2021-01-03T13:03:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 2, 2021-01-03T13:03:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "rbd", 2021-01-03T13:03:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:55.472799+0000", 2021-01-03T13:03:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:03:04.150 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:03:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:03:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:03:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:03:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:03:04.151 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:03:04.152 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:03:04.152 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:03:04.152 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:03:04.152 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:03:04.152 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:03:04.153 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:03:04.153 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:03:04.153 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:03:04.153 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:03:04.153 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:03:04.154 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:03:04.154 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:03:04.154 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:03:04.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.154 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "19", 2021-01-03T13:03:04.155 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:03:04.155 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:03:04.155 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:03:04.155 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:03:04.156 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:03:04.156 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:03:04.156 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:03:04.156 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:03:04.156 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:03:04.157 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:03:04.157 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:03:04.157 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:03:04.157 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:03:04.157 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:03:04.157 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:03:04.158 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:03:04.158 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:03:04.158 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:03:04.158 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:03:04.158 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:03:04.159 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:03:04.159 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:03:04.159 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:03:04.159 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:03:04.159 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:03:04.160 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:03:04.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.160 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:03:04.160 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:03:04.160 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:03:04.161 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:03:04.161 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:03:04.161 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:03:04.161 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:03:04.162 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:03:04.162 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:03:04.162 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:03:04.162 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:03:04.162 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:03:04.163 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:03:04.163 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd": {} 2021-01-03T13:03:04.163 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.164 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 9, 2021-01-03T13:03:04.164 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_metadata", 2021-01-03T13:03:04.164 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:01:33.451725+0000", 2021-01-03T13:03:04.164 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:03:04.164 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:03:04.165 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:03:04.165 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:03:04.165 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:03:04.165 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:03:04.165 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:03:04.166 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:03:04.166 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:03:04.166 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:03:04.166 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:03:04.166 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:03:04.167 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:03:04.167 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:03:04.167 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:03:04.167 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:03:04.167 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:03:04.168 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:03:04.168 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:03:04.168 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:03:04.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.169 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "54", 2021-01-03T13:03:04.169 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:03:04.169 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:03:04.169 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:03:04.169 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:03:04.170 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:03:04.170 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:03:04.170 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:03:04.170 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:03:04.170 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:03:04.171 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:03:04.171 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:03:04.171 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:03:04.171 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:03:04.171 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:03:04.172 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:03:04.172 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:03:04.172 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:03:04.172 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:03:04.172 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:03:04.173 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:03:04.173 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:03:04.173 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:03:04.173 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:03:04.173 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:03:04.174 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:03:04.174 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:03:04.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.174 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:03:04.174 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:03:04.175 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:03:04.175 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:03:04.175 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:03:04.175 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:03:04.175 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:03:04.176 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:03:04.176 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:03:04.176 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:03:04.176 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:03:04.176 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:03:04.177 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_bias": 4, 2021-01-03T13:03:04.177 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 16, 2021-01-03T13:03:04.177 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_priority": 5 2021-01-03T13:03:04.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.177 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:03:04.178 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:03:04.178 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": "cephfs" 2021-01-03T13:03:04.178 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.178 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.179 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 10, 2021-01-03T13:03:04.179 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_data", 2021-01-03T13:03:04.179 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:01:34.480032+0000", 2021-01-03T13:03:04.180 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:03:04.180 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:03:04.180 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:03:04.180 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:03:04.180 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:03:04.181 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:03:04.181 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:03:04.181 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:03:04.181 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:03:04.181 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:03:04.182 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:03:04.182 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:03:04.182 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:03:04.182 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:03:04.182 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:03:04.183 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:03:04.183 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:03:04.183 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:03:04.183 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:03:04.183 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:03:04.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.184 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "55", 2021-01-03T13:03:04.184 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:03:04.184 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:03:04.184 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:03:04.185 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:03:04.185 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:03:04.185 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:03:04.185 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:03:04.185 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:03:04.186 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:03:04.186 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:03:04.186 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:03:04.186 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:03:04.187 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:03:04.187 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:03:04.187 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:03:04.187 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:03:04.187 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:03:04.188 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:03:04.188 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:03:04.188 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:03:04.188 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:03:04.188 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:03:04.189 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:03:04.189 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:03:04.189 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:03:04.189 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:03:04.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.190 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:03:04.190 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:03:04.190 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:03:04.190 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:03:04.191 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:03:04.191 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:03:04.191 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:03:04.191 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:03:04.191 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:03:04.192 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:03:04.192 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:03:04.192 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:03:04.192 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:03:04.192 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:03:04.193 INFO:teuthology.orchestra.run.smithi133.stdout: "data": "cephfs" 2021-01-03T13:03:04.193 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.193 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.193 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.193 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:03:04.194 INFO:teuthology.orchestra.run.smithi133.stdout: "osds": [ 2021-01-03T13:03:04.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.194 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:03:04.194 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a", 2021-01-03T13:03:04.194 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:03:04.195 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:03:04.195 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:03:04.195 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:03:04.195 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:03:04.196 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:03:04.196 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:03:04.196 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 52, 2021-01-03T13:03:04.196 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:03:04.196 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:03:04.197 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:03:04.197 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.197 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.197 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6810", 2021-01-03T13:03:04.198 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:03:04.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.198 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.199 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6811", 2021-01-03T13:03:04.199 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:03:04.199 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.199 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.200 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:03:04.200 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.200 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.200 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6812", 2021-01-03T13:03:04.201 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:03:04.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.201 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.201 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6813", 2021-01-03T13:03:04.201 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:03:04.202 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.202 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.202 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:03:04.203 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.203 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.203 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6816", 2021-01-03T13:03:04.203 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:03:04.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.204 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.204 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6817", 2021-01-03T13:03:04.204 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:03:04.205 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.205 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.205 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:03:04.205 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.206 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.206 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6814", 2021-01-03T13:03:04.206 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:03:04.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.207 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.207 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6815", 2021-01-03T13:03:04.207 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:03:04.207 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.208 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.208 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6811/12124", 2021-01-03T13:03:04.208 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6813/12124", 2021-01-03T13:03:04.208 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6817/12124", 2021-01-03T13:03:04.209 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6815/12124", 2021-01-03T13:03:04.209 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:03:04.209 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:03:04.209 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:03:04.209 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.210 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:03:04.210 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9170d1de-58d4-4dfd-b9de-80dc15ca9e60", 2021-01-03T13:03:04.210 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:03:04.211 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:03:04.211 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:03:04.211 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:03:04.211 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:03:04.212 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:03:04.212 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:03:04.212 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 52, 2021-01-03T13:03:04.212 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:03:04.212 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:03:04.213 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:03:04.213 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.213 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.213 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6818", 2021-01-03T13:03:04.214 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:03:04.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.214 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.214 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6819", 2021-01-03T13:03:04.215 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:03:04.215 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.215 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.215 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:03:04.216 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.216 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.216 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6820", 2021-01-03T13:03:04.216 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:03:04.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.217 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.217 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6821", 2021-01-03T13:03:04.217 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:03:04.218 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.218 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.218 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:03:04.218 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.219 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.219 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6824", 2021-01-03T13:03:04.219 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:03:04.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.220 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.220 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6825", 2021-01-03T13:03:04.220 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:03:04.220 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.221 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.221 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:03:04.221 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.222 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.222 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6822", 2021-01-03T13:03:04.222 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:03:04.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.223 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.223 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6823", 2021-01-03T13:03:04.223 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:03:04.223 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.224 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.224 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6819/12123", 2021-01-03T13:03:04.224 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6821/12123", 2021-01-03T13:03:04.224 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6825/12123", 2021-01-03T13:03:04.225 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6823/12123", 2021-01-03T13:03:04.225 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:03:04.225 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:03:04.225 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:03:04.225 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.226 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:03:04.226 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9fc5adf9-3537-4953-9c65-0c67ecb53776", 2021-01-03T13:03:04.226 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:03:04.227 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:03:04.227 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:03:04.227 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:03:04.227 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:03:04.227 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:03:04.228 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:03:04.228 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 52, 2021-01-03T13:03:04.228 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:03:04.228 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:03:04.228 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:03:04.229 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.229 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.229 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6802", 2021-01-03T13:03:04.230 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:03:04.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.230 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.230 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6803", 2021-01-03T13:03:04.231 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:03:04.231 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.231 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.231 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:03:04.232 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.232 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.232 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6804", 2021-01-03T13:03:04.232 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:03:04.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.233 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.233 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6805", 2021-01-03T13:03:04.233 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:03:04.234 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.234 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.234 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:03:04.234 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.235 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.235 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6808", 2021-01-03T13:03:04.235 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:03:04.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.236 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.236 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6809", 2021-01-03T13:03:04.236 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:03:04.236 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.237 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.237 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:03:04.237 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.238 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.238 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6806", 2021-01-03T13:03:04.238 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:03:04.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.239 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.239 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6807", 2021-01-03T13:03:04.239 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:03:04.239 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.239 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.240 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6803/12122", 2021-01-03T13:03:04.240 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6805/12122", 2021-01-03T13:03:04.240 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6809/12122", 2021-01-03T13:03:04.240 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6807/12122", 2021-01-03T13:03:04.241 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:03:04.241 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:03:04.241 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:03:04.241 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.242 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:03:04.242 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "0ad45ce5-6635-4089-bbf8-c966d0fe5338", 2021-01-03T13:03:04.242 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:03:04.242 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:03:04.243 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:03:04.243 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:03:04.243 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:03:04.243 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:03:04.243 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:03:04.244 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 51, 2021-01-03T13:03:04.244 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:03:04.244 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:03:04.244 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:03:04.244 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.245 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.245 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6826", 2021-01-03T13:03:04.245 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:03:04.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.246 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.246 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6827", 2021-01-03T13:03:04.246 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:03:04.246 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.247 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.247 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:03:04.247 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.248 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.248 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6828", 2021-01-03T13:03:04.248 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:03:04.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.249 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.249 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6829", 2021-01-03T13:03:04.249 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:03:04.249 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.250 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.250 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:03:04.250 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.251 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.251 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6832", 2021-01-03T13:03:04.251 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:03:04.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.251 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.251 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.252 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6833", 2021-01-03T13:03:04.252 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:03:04.252 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.252 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.253 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:03:04.253 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.253 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.254 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6830", 2021-01-03T13:03:04.254 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:03:04.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.254 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.255 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6831", 2021-01-03T13:03:04.255 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:03:04.255 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.255 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.256 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6827/12136", 2021-01-03T13:03:04.256 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6829/12136", 2021-01-03T13:03:04.256 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6833/12136", 2021-01-03T13:03:04.256 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6831/12136", 2021-01-03T13:03:04.257 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:03:04.257 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:03:04.257 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:03:04.257 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.258 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:03:04.258 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "86b8d6d5-271b-4a70-ae7b-a227afb38d7c", 2021-01-03T13:03:04.258 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:03:04.258 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:03:04.259 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:03:04.259 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:03:04.259 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:03:04.259 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:03:04.259 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:03:04.260 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 52, 2021-01-03T13:03:04.260 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:03:04.260 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:03:04.260 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:03:04.260 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.261 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.261 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6808", 2021-01-03T13:03:04.261 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:03:04.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.262 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.262 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6809", 2021-01-03T13:03:04.262 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:03:04.262 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.263 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.263 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:03:04.263 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.264 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.264 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6810", 2021-01-03T13:03:04.264 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:03:04.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.265 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.265 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6811", 2021-01-03T13:03:04.265 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:03:04.265 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.266 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.266 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:03:04.266 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.267 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.267 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6814", 2021-01-03T13:03:04.267 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:03:04.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.267 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.268 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.268 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6815", 2021-01-03T13:03:04.268 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:03:04.268 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.268 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.269 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:03:04.269 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.269 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.270 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6812", 2021-01-03T13:03:04.270 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:03:04.270 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.270 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.271 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.271 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6813", 2021-01-03T13:03:04.271 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:03:04.271 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.271 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.272 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6809/12672", 2021-01-03T13:03:04.272 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6811/12672", 2021-01-03T13:03:04.272 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6815/12672", 2021-01-03T13:03:04.272 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6813/12672", 2021-01-03T13:03:04.273 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:03:04.273 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:03:04.273 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:03:04.273 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.274 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:03:04.274 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "173feb9d-f596-4030-85d8-1f4b46a9ffe5", 2021-01-03T13:03:04.274 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:03:04.274 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:03:04.275 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:03:04.275 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:03:04.275 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:03:04.275 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:03:04.275 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:03:04.276 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 52, 2021-01-03T13:03:04.276 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:03:04.276 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:03:04.276 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:03:04.276 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.277 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.277 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6817", 2021-01-03T13:03:04.277 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:03:04.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.278 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.278 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6819", 2021-01-03T13:03:04.278 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:03:04.278 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.279 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.279 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:03:04.279 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.279 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.280 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.280 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6820", 2021-01-03T13:03:04.280 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:03:04.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.281 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.281 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6822", 2021-01-03T13:03:04.281 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:03:04.281 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.282 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.282 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:03:04.282 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.283 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.283 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6828", 2021-01-03T13:03:04.283 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:03:04.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.284 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.284 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6830", 2021-01-03T13:03:04.284 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:03:04.285 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.285 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.285 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.285 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:03:04.285 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.286 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.286 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.286 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6824", 2021-01-03T13:03:04.286 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:03:04.286 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.287 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.287 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.287 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6826", 2021-01-03T13:03:04.287 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:03:04.288 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.288 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.288 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.288 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6819/12673", 2021-01-03T13:03:04.288 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6822/12673", 2021-01-03T13:03:04.289 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6830/12673", 2021-01-03T13:03:04.289 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6826/12673", 2021-01-03T13:03:04.289 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:03:04.289 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:03:04.290 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:03:04.290 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.290 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.291 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:03:04.291 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "b487980e-ad4d-43c1-91fa-4845f7af3d4d", 2021-01-03T13:03:04.291 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:03:04.291 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:03:04.291 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:03:04.292 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:03:04.292 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:03:04.292 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:03:04.292 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:03:04.292 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 53, 2021-01-03T13:03:04.293 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:03:04.293 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:03:04.293 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:03:04.293 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.293 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.294 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.294 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6800", 2021-01-03T13:03:04.294 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:03:04.294 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.295 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.295 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.295 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6801", 2021-01-03T13:03:04.295 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:03:04.296 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.296 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.296 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:03:04.296 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.297 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.297 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.297 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6802", 2021-01-03T13:03:04.297 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:03:04.297 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.298 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.298 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.298 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6803", 2021-01-03T13:03:04.298 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:03:04.299 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.299 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.299 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.299 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:03:04.299 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.300 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.300 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6806", 2021-01-03T13:03:04.300 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:03:04.300 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.301 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.301 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.301 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6807", 2021-01-03T13:03:04.301 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:03:04.301 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.302 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.302 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.302 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:03:04.302 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.302 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.303 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.303 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6804", 2021-01-03T13:03:04.303 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:03:04.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.304 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.304 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6805", 2021-01-03T13:03:04.304 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:03:04.304 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.305 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.305 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6801/12662", 2021-01-03T13:03:04.305 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6803/12662", 2021-01-03T13:03:04.305 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6807/12662", 2021-01-03T13:03:04.306 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6805/12662", 2021-01-03T13:03:04.306 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:03:04.306 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:03:04.306 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:03:04.306 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.307 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:03:04.307 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "38ea839a-451f-4c09-a545-4514e049b178", 2021-01-03T13:03:04.307 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:03:04.308 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:03:04.308 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:03:04.308 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:03:04.308 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:03:04.308 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:03:04.309 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:03:04.309 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 51, 2021-01-03T13:03:04.309 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:03:04.309 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:03:04.309 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:03:04.310 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.310 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.310 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.310 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6816", 2021-01-03T13:03:04.310 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:03:04.311 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.311 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.311 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.311 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6818", 2021-01-03T13:03:04.311 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:03:04.312 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.312 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.312 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.312 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:03:04.312 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.313 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.313 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.313 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6821", 2021-01-03T13:03:04.313 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:03:04.313 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.314 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.314 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.314 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6823", 2021-01-03T13:03:04.314 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:03:04.314 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.315 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.315 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.315 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:03:04.315 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.315 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.316 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.316 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6829", 2021-01-03T13:03:04.316 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:03:04.316 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.316 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.317 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.317 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6831", 2021-01-03T13:03:04.317 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:03:04.317 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.318 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.318 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.319 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:03:04.319 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:04.320 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.320 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:04.320 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6825", 2021-01-03T13:03:04.320 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:03:04.321 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.321 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.321 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:04.321 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6827", 2021-01-03T13:03:04.322 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:03:04.322 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.322 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.323 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6818/12674", 2021-01-03T13:03:04.323 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6823/12674", 2021-01-03T13:03:04.323 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6831/12674", 2021-01-03T13:03:04.323 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6827/12674", 2021-01-03T13:03:04.323 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:03:04.324 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:03:04.324 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:03:04.324 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:04.324 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.324 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:03:04.325 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_xinfo": [ 2021-01-03T13:03:04.325 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.325 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:03:04.325 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:03:04.325 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:03:04.326 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:03:04.326 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:03:04.326 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:03:04.326 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.659942+0000", 2021-01-03T13:03:04.326 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:03:04.327 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.327 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.327 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:03:04.327 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:03:04.327 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:03:04.328 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:03:04.328 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:03:04.328 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:03:04.328 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.750326+0000", 2021-01-03T13:03:04.329 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:03:04.329 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.329 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.329 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:03:04.329 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:03:04.330 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:03:04.330 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:03:04.330 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:03:04.330 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:03:04.331 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.587742+0000", 2021-01-03T13:03:04.331 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:03:04.331 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.331 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.331 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:03:04.332 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:03:04.332 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:03:04.332 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:03:04.332 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:03:04.332 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:03:04.333 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.855073+0000", 2021-01-03T13:03:04.333 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:03:04.333 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.333 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.333 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:03:04.334 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:03:04.334 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:03:04.334 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:03:04.334 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:03:04.334 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:03:04.335 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.565030+0000", 2021-01-03T13:03:04.335 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:03:04.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.335 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.335 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:03:04.336 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:03:04.336 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:03:04.336 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:03:04.336 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:03:04.336 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:03:04.337 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.786206+0000", 2021-01-03T13:03:04.337 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:03:04.337 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.337 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.337 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:03:04.337 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:03:04.338 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:03:04.338 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:03:04.338 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:03:04.338 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:03:04.339 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.576185+0000", 2021-01-03T13:03:04.339 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:03:04.339 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.339 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:04.339 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:03:04.340 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:03:04.340 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:03:04.340 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:03:04.340 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:03:04.340 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:03:04.340 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.823786+0000", 2021-01-03T13:03:04.341 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:03:04.341 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.341 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:03:04.341 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap": [], 2021-01-03T13:03:04.341 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap_items": [], 2021-01-03T13:03:04.342 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_temp": [], 2021-01-03T13:03:04.342 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_temp": [], 2021-01-03T13:03:04.342 INFO:teuthology.orchestra.run.smithi133.stdout: "blacklist": {}, 2021-01-03T13:03:04.342 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profiles": { 2021-01-03T13:03:04.343 INFO:teuthology.orchestra.run.smithi133.stdout: "default": { 2021-01-03T13:03:04.343 INFO:teuthology.orchestra.run.smithi133.stdout: "crush-failure-domain": "osd", 2021-01-03T13:03:04.343 INFO:teuthology.orchestra.run.smithi133.stdout: "k": "2", 2021-01-03T13:03:04.343 INFO:teuthology.orchestra.run.smithi133.stdout: "m": "1", 2021-01-03T13:03:04.343 INFO:teuthology.orchestra.run.smithi133.stdout: "plugin": "jerasure", 2021-01-03T13:03:04.344 INFO:teuthology.orchestra.run.smithi133.stdout: "ruleset-failure-domain": "osd", 2021-01-03T13:03:04.344 INFO:teuthology.orchestra.run.smithi133.stdout: "technique": "reed_sol_van" 2021-01-03T13:03:04.344 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:04.344 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:04.344 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps_queue": [], 2021-01-03T13:03:04.344 INFO:teuthology.orchestra.run.smithi133.stdout: "new_removed_snaps": [], 2021-01-03T13:03:04.345 INFO:teuthology.orchestra.run.smithi133.stdout: "new_purged_snaps": [], 2021-01-03T13:03:04.345 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_node_flags": {}, 2021-01-03T13:03:04.345 INFO:teuthology.orchestra.run.smithi133.stdout: "device_class_flags": {} 2021-01-03T13:03:04.345 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:03:04.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.135+0000 7f374ffff700 1 -- 172.21.15.133:0/1511303377 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f37340553b0 msgr2=0x7f3734057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:04.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.135+0000 7f374ffff700 1 --2- 172.21.15.133:0/1511303377 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f37340553b0 0x7f3734057870 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f3748019000 tx=0x7f3748016000).stop 2021-01-03T13:03:04.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.135+0000 7f374ffff700 1 -- 172.21.15.133:0/1511303377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37500b0c90 msgr2=0x7f3750155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:04.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.135+0000 7f374ffff700 1 --2- 172.21.15.133:0/1511303377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37500b0c90 0x7f3750155b80 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f3738006910 tx=0x7f3738008040).stop 2021-01-03T13:03:04.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.135+0000 7f374ffff700 1 -- 172.21.15.133:0/1511303377 shutdown_connections 2021-01-03T13:03:04.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.135+0000 7f374ffff700 1 --2- 172.21.15.133:0/1511303377 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f37340553b0 0x7f3734057870 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:04.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.135+0000 7f374ffff700 1 --2- 172.21.15.133:0/1511303377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37500b5c00 0x7f3750064080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:04.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.135+0000 7f374ffff700 1 --2- 172.21.15.133:0/1511303377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37500b0c90 0x7f3750155b80 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:04.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.135+0000 7f374ffff700 1 --2- 172.21.15.133:0/1511303377 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f37500b52c0 0x7f3750063b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:04.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.135+0000 7f374ffff700 1 -- 172.21.15.133:0/1511303377 >> 172.21.15.133:0/1511303377 conn(0x7f375005bdf0 msgr2=0x7f37501466e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:04.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.135+0000 7f374ffff700 1 -- 172.21.15.133:0/1511303377 shutdown_connections 2021-01-03T13:03:04.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.135+0000 7f374ffff700 1 -- 172.21.15.133:0/1511303377 wait complete. 2021-01-03T13:03:04.350 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:03:04.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc825ab6700 1 Processor -- start 2021-01-03T13:03:04.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc825ab6700 1 -- start start 2021-01-03T13:03:04.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc825ab6700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc82005cc10 0x7fc8201437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:04.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc825ab6700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc8200b02d0 0x7fc820146a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:04.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc825ab6700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82005c510 con 0x7fc82005c130 2021-01-03T13:03:04.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc825ab6700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8200b0780 con 0x7fc8200b02d0 2021-01-03T13:03:04.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc825ab6700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8200b5c10 con 0x7fc82005cc10 2021-01-03T13:03:04.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc81effd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc82005cc10 0x7fc8201437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:04.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc81effd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc82005cc10 0x7fc8201437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:43126/0 (socket says 172.21.15.133:43126) 2021-01-03T13:03:04.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc81effd700 1 -- 172.21.15.133:0/4172952015 learned_addr learned my addr 172.21.15.133:0/4172952015 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:04.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc81ffff700 1 --2- 172.21.15.133:0/4172952015 >> v2:172.21.15.16:3300/0 conn(0x7fc8200b02d0 0x7fc820146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:04.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc81effd700 1 -- 172.21.15.133:0/4172952015 >> v2:172.21.15.16:3300/0 conn(0x7fc8200b02d0 msgr2=0x7fc820146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:04.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc81effd700 1 --2- 172.21.15.133:0/4172952015 >> v2:172.21.15.16:3300/0 conn(0x7fc8200b02d0 0x7fc820146a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:04.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc81effd700 1 -- 172.21.15.133:0/4172952015 >> v1:172.21.15.16:6789/0 conn(0x7fc82005c130 legacy=0x7fc820146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:04.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc81effd700 1 -- 172.21.15.133:0/4172952015 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8200af8f0 con 0x7fc82005cc10 2021-01-03T13:03:04.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc81effd700 1 --2- 172.21.15.133:0/4172952015 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc82005cc10 0x7fc8201437e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fc810002f30 tx=0x7fc810006e80).ready entity=mon.2 client_cookie=fac1a16d119743db server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:04.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc81e7fc700 1 -- 172.21.15.133:0/4172952015 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8100097f0 con 0x7fc82005cc10 2021-01-03T13:03:04.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc81e7fc700 1 -- 172.21.15.133:0/4172952015 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc810009950 con 0x7fc82005cc10 2021-01-03T13:03:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc81e7fc700 1 -- 172.21.15.133:0/4172952015 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc810009cb0 con 0x7fc82005cc10 2021-01-03T13:03:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc825ab6700 1 -- 172.21.15.133:0/4172952015 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc82005cc10 msgr2=0x7fc8201437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc825ab6700 1 --2- 172.21.15.133:0/4172952015 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc82005cc10 0x7fc8201437e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fc810002f30 tx=0x7fc810006e80).stop 2021-01-03T13:03:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc825ab6700 1 -- 172.21.15.133:0/4172952015 shutdown_connections 2021-01-03T13:03:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc825ab6700 1 --2- 172.21.15.133:0/4172952015 >> v2:172.21.15.16:3300/0 conn(0x7fc8200b02d0 0x7fc820146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.475+0000 7fc825ab6700 1 --2- 172.21.15.133:0/4172952015 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc82005cc10 0x7fc8201437e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:04.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc825ab6700 1 -- 172.21.15.133:0/4172952015 >> 172.21.15.133:0/4172952015 conn(0x7fc8200b95d0 msgr2=0x7fc8200b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:04.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc825ab6700 1 -- 172.21.15.133:0/4172952015 shutdown_connections 2021-01-03T13:03:04.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc825ab6700 1 -- 172.21.15.133:0/4172952015 wait complete. 2021-01-03T13:03:04.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc825ab6700 1 Processor -- start 2021-01-03T13:03:04.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc825ab6700 1 -- start start 2021-01-03T13:03:04.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc825ab6700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc82005c130 0x7fc82009f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:04.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc825ab6700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc82005cc10 0x7fc82013c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:04.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc825ab6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8200b02d0 0x7fc82013cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:04.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc825ab6700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8200b3da0 con 0x7fc82005cc10 2021-01-03T13:03:04.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc825ab6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82009eb20 con 0x7fc8200b02d0 2021-01-03T13:03:04.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc825ab6700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82009e880 con 0x7fc82005c130 2021-01-03T13:03:04.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc81ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8200b02d0 0x7fc82013cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:04.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc81ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8200b02d0 0x7fc82013cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34832/0 (socket says 172.21.15.133:34832) 2021-01-03T13:03:04.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc81ffff700 1 -- 172.21.15.133:0/2763367412 learned_addr learned my addr 172.21.15.133:0/2763367412 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:04.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc81f7fe700 1 --2- 172.21.15.133:0/2763367412 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc82005c130 0x7fc82009f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:04.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc81effd700 1 --2- 172.21.15.133:0/2763367412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc82005cc10 0x7fc82013c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:04.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc81ffff700 1 -- 172.21.15.133:0/2763367412 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc82005c130 msgr2=0x7fc82009f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:04.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc81ffff700 1 --2- 172.21.15.133:0/2763367412 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc82005c130 0x7fc82009f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:04.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc81ffff700 1 -- 172.21.15.133:0/2763367412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc82005cc10 msgr2=0x7fc82013c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:04.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc81ffff700 1 --2- 172.21.15.133:0/2763367412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc82005cc10 0x7fc82013c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:04.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc81ffff700 1 -- 172.21.15.133:0/2763367412 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8200b7fe0 con 0x7fc8200b02d0 2021-01-03T13:03:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.479+0000 7fc81ffff700 1 --2- 172.21.15.133:0/2763367412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8200b02d0 0x7fc82013cc20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fc818006dd0 tx=0x7fc8180091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.483+0000 7fc81cff9700 1 -- 172.21.15.133:0/2763367412 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc81800c8d0 con 0x7fc8200b02d0 2021-01-03T13:03:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.483+0000 7fc81cff9700 1 -- 172.21.15.133:0/2763367412 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81800ca30 con 0x7fc8200b02d0 2021-01-03T13:03:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.483+0000 7fc825ab6700 1 -- 172.21.15.133:0/2763367412 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8200b8280 con 0x7fc8200b02d0 2021-01-03T13:03:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.483+0000 7fc81cff9700 1 -- 172.21.15.133:0/2763367412 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc81800cd90 con 0x7fc8200b02d0 2021-01-03T13:03:04.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.483+0000 7fc825ab6700 1 -- 172.21.15.133:0/2763367412 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82013d110 con 0x7fc8200b02d0 2021-01-03T13:03:04.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.483+0000 7fc825ab6700 1 -- 172.21.15.133:0/2763367412 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8200b8640 con 0x7fc8200b02d0 2021-01-03T13:03:04.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.483+0000 7fc81cff9700 1 -- 172.21.15.133:0/2763367412 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc818022070 con 0x7fc8200b02d0 2021-01-03T13:03:04.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.483+0000 7fc81cff9700 1 --2- 172.21.15.133:0/2763367412 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc7fc055440 0x7fc7fc057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:04.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.483+0000 7fc81cff9700 1 -- 172.21.15.133:0/2763367412 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc81806e680 con 0x7fc8200b02d0 2021-01-03T13:03:04.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.483+0000 7fc81f7fe700 1 --2- 172.21.15.133:0/2763367412 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc7fc055440 0x7fc7fc057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:04.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.483+0000 7fc81f7fe700 1 --2- 172.21.15.133:0/2763367412 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc7fc055440 0x7fc7fc057900 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fc80c00d000 tx=0x7fc80c000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:04.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.491+0000 7fc81cff9700 1 -- 172.21.15.133:0/2763367412 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc818044810 con 0x7fc8200b02d0 2021-01-03T13:03:04.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.679+0000 7fc825ab6700 1 -- 172.21.15.133:0/2763367412 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8200b8410 con 0x7fc8200b02d0 2021-01-03T13:03:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.679+0000 7fc81cff9700 1 -- 172.21.15.133:0/2763367412 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fc818016020 con 0x7fc8200b02d0 2021-01-03T13:03:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.683+0000 7fc825ab6700 1 -- 172.21.15.133:0/2763367412 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc7fc055440 msgr2=0x7fc7fc057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:04.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.683+0000 7fc825ab6700 1 --2- 172.21.15.133:0/2763367412 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc7fc055440 0x7fc7fc057900 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fc80c00d000 tx=0x7fc80c000b80).stop 2021-01-03T13:03:04.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.683+0000 7fc825ab6700 1 -- 172.21.15.133:0/2763367412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8200b02d0 msgr2=0x7fc82013cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:04.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.683+0000 7fc825ab6700 1 --2- 172.21.15.133:0/2763367412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8200b02d0 0x7fc82013cc20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fc818006dd0 tx=0x7fc8180091a0).stop 2021-01-03T13:03:04.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.683+0000 7fc825ab6700 1 -- 172.21.15.133:0/2763367412 shutdown_connections 2021-01-03T13:03:04.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.683+0000 7fc825ab6700 1 --2- 172.21.15.133:0/2763367412 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc7fc055440 0x7fc7fc057900 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:04.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.683+0000 7fc825ab6700 1 --2- 172.21.15.133:0/2763367412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8200b02d0 0x7fc82013cc20 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:04.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.683+0000 7fc825ab6700 1 --2- 172.21.15.133:0/2763367412 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc82005c130 0x7fc82009f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:04.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.683+0000 7fc825ab6700 1 --2- 172.21.15.133:0/2763367412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc82005cc10 0x7fc82013c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:04.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.683+0000 7fc825ab6700 1 -- 172.21.15.133:0/2763367412 >> 172.21.15.133:0/2763367412 conn(0x7fc8200b95d0 msgr2=0x7fc820144400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:04.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.683+0000 7fc825ab6700 1 -- 172.21.15.133:0/2763367412 shutdown_connections 2021-01-03T13:03:04.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.683+0000 7fc825ab6700 1 -- 172.21.15.133:0/2763367412 wait complete. 2021-01-03T13:03:04.681 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:04.681 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":21,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/2812725713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2812725713},{"type":"v1","addr":"172.21.15.16:6833","nonce":2812725713}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1096331942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1096331942},{"type":"v1","addr":"172.21.15.133:6835","nonce":1096331942}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:01:34.953831+0000","modified":"2021-01-03T13:01:35.958148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5563},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5563":{"gid":5563,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/834098016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":834098016},{"type":"v1","addr":"172.21.15.133:6837","nonce":834098016}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-01-03T13:03:04.681 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 21 2021-01-03T13:03:04.689 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-01-03T13:03:04.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd95e227700 1 Processor -- start 2021-01-03T13:03:04.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd95e227700 1 -- start start 2021-01-03T13:03:04.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd95e227700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd9580b9f40 0x7fd958146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:04.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd95e227700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9580605f0 con 0x7fd958146920 2021-01-03T13:03:04.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd95e227700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9580600b0 con 0x7fd9580b9b60 2021-01-03T13:03:04.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd95e227700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9580aed30 con 0x7fd9580b9f40 2021-01-03T13:03:04.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd95d225700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd9580b9b60 0x7fd9580b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55870/0 (socket says 172.21.15.133:55870) 2021-01-03T13:03:04.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd95d225700 1 -- 172.21.15.133:0/1513150979 learned_addr learned my addr 172.21.15.133:0/1513150979 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:04.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd95ca24700 1 --2- 172.21.15.133:0/1513150979 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd9580b9f40 0x7fd958146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:04.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd94ffff700 1 -- 172.21.15.133:0/1513150979 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993942742 0 0) 0x7fd9580600b0 con 0x7fd9580b9b60 2021-01-03T13:03:04.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd94ffff700 1 -- 172.21.15.133:0/1513150979 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd93c003230 con 0x7fd9580b9b60 2021-01-03T13:03:04.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd94ffff700 1 -- 172.21.15.133:0/1513150979 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3727354492 0 0) 0x7fd93c003230 con 0x7fd9580b9b60 2021-01-03T13:03:04.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd94ffff700 1 -- 172.21.15.133:0/1513150979 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd9580b9f40 msgr2=0x7fd958146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:04.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd94ffff700 1 --2- 172.21.15.133:0/1513150979 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd9580b9f40 0x7fd958146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd94ffff700 1 -- 172.21.15.133:0/1513150979 >> v1:172.21.15.16:6789/0 conn(0x7fd958146920 legacy=0x7fd95814d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd94ffff700 1 -- 172.21.15.133:0/1513150979 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd958060350 con 0x7fd9580b9b60 2021-01-03T13:03:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd94ffff700 1 -- 172.21.15.133:0/1513150979 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fd950001a50 con 0x7fd9580b9b60 2021-01-03T13:03:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd94ffff700 1 -- 172.21.15.133:0/1513150979 >> v1:172.21.15.133:6789/0 conn(0x7fd9580b9b60 legacy=0x7fd9580b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd94ffff700 1 --2- 172.21.15.133:0/1513150979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd93c003720 0x7fd93c003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:04.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd94ffff700 1 --2- 172.21.15.133:0/1513150979 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd93c004010 0x7fd93c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:04.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd94ffff700 1 --2- 172.21.15.133:0/1513150979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd93c004a80 0x7fd93c004f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:04.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd94ffff700 1 -- 172.21.15.133:0/1513150979 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9580aed30 con 0x7fd93c004a80 2021-01-03T13:03:04.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd95d225700 1 --2- 172.21.15.133:0/1513150979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd93c003720 0x7fd93c003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd94ffff700 1 -- 172.21.15.133:0/1513150979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c00b7d0 con 0x7fd93c003720 2021-01-03T13:03:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd94ffff700 1 -- 172.21.15.133:0/1513150979 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c00b990 con 0x7fd93c004010 2021-01-03T13:03:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd95ca24700 1 --2- 172.21.15.133:0/1513150979 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd9580b9f40 0x7fd958146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:03:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd95d225700 1 -- 172.21.15.133:0/1513150979 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd93c004010 msgr2=0x7fd93c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd95d225700 1 --2- 172.21.15.133:0/1513150979 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd93c004010 0x7fd93c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-03T13:03:04.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd95d225700 1 -- 172.21.15.133:0/1513150979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd93c004a80 msgr2=0x7fd93c004f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:04.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd95d225700 1 --2- 172.21.15.133:0/1513150979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd93c004a80 0x7fd93c004f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-03T13:03:04.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd95d225700 1 -- 172.21.15.133:0/1513150979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c003230 con 0x7fd93c003720 2021-01-03T13:03:04.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.807+0000 7fd95d225700 1 --2- 172.21.15.133:0/1513150979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd93c003720 0x7fd93c003b00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fd950001760 tx=0x7fd9581409c0).ready entity=mon.1 client_cookie=ecb260bc3313ef45 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:04.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd94ffff700 1 -- 172.21.15.133:0/1513150979 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd950005b70 con 0x7fd93c003720 2021-01-03T13:03:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd94ffff700 1 -- 172.21.15.133:0/1513150979 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd950005cd0 con 0x7fd93c003720 2021-01-03T13:03:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd94ffff700 1 -- 172.21.15.133:0/1513150979 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd950008360 con 0x7fd93c003720 2021-01-03T13:03:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95e227700 1 -- 172.21.15.133:0/1513150979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd93c003720 msgr2=0x7fd93c003b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95e227700 1 --2- 172.21.15.133:0/1513150979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd93c003720 0x7fd93c003b00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fd950001760 tx=0x7fd9581409c0).stop 2021-01-03T13:03:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95da26700 1 -- 172.21.15.133:0/1513150979 reap_dead start 2021-01-03T13:03:04.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95e227700 1 -- 172.21.15.133:0/1513150979 shutdown_connections 2021-01-03T13:03:04.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95e227700 1 -- 172.21.15.133:0/1513150979 >> 172.21.15.133:0/1513150979 conn(0x7fd9580b69e0 msgr2=0x7fd9580b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:04.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95e227700 1 -- 172.21.15.133:0/1513150979 shutdown_connections 2021-01-03T13:03:04.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95e227700 1 -- 172.21.15.133:0/1513150979 wait complete. 2021-01-03T13:03:04.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95e227700 1 Processor -- start 2021-01-03T13:03:04.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95e227700 1 -- start start 2021-01-03T13:03:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95e227700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9580b1650 0x7fd9581521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95e227700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9581413f0 0x7fd9580b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95e227700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd9581425a0 0x7fd9580b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:04.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95e227700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd958142130 con 0x7fd9580b1650 2021-01-03T13:03:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95e227700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd958152750 con 0x7fd9581413f0 2021-01-03T13:03:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95e227700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd958141bf0 con 0x7fd9581425a0 2021-01-03T13:03:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95ca24700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9581413f0 0x7fd9580b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95ca24700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9581413f0 0x7fd9580b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34852/0 (socket says 172.21.15.133:34852) 2021-01-03T13:03:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95ca24700 1 -- 172.21.15.133:0/1514762839 learned_addr learned my addr 172.21.15.133:0/1514762839 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95d225700 1 --2- 172.21.15.133:0/1514762839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9580b1650 0x7fd9581521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95da26700 1 --2- 172.21.15.133:0/1514762839 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd9581425a0 0x7fd9580b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95ca24700 1 -- 172.21.15.133:0/1514762839 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd9581425a0 msgr2=0x7fd9580b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95ca24700 1 --2- 172.21.15.133:0/1514762839 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd9581425a0 0x7fd9580b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:04.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95ca24700 1 -- 172.21.15.133:0/1514762839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9580b1650 msgr2=0x7fd9581521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:04.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95ca24700 1 --2- 172.21.15.133:0/1514762839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9580b1650 0x7fd9581521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:04.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95ca24700 1 -- 172.21.15.133:0/1514762839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd958141e90 con 0x7fd9581413f0 2021-01-03T13:03:04.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.811+0000 7fd95d225700 1 --2- 172.21.15.133:0/1514762839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9580b1650 0x7fd9581521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:04.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.815+0000 7fd95ca24700 1 --2- 172.21.15.133:0/1514762839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9581413f0 0x7fd9580b1a30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fd94800c000 tx=0x7fd948006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:04.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.815+0000 7fd94e7fc700 1 -- 172.21.15.133:0/1514762839 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd948016070 con 0x7fd9581413f0 2021-01-03T13:03:04.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.815+0000 7fd94e7fc700 1 -- 172.21.15.133:0/1514762839 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94800ca10 con 0x7fd9581413f0 2021-01-03T13:03:04.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.815+0000 7fd95e227700 1 -- 172.21.15.133:0/1514762839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9580b1f20 con 0x7fd9581413f0 2021-01-03T13:03:04.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.815+0000 7fd94e7fc700 1 -- 172.21.15.133:0/1514762839 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd94800cd70 con 0x7fd9581413f0 2021-01-03T13:03:04.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.815+0000 7fd95e227700 1 -- 172.21.15.133:0/1514762839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd958142a30 con 0x7fd9581413f0 2021-01-03T13:03:04.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.815+0000 7fd95e227700 1 -- 172.21.15.133:0/1514762839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9581410e0 con 0x7fd9581413f0 2021-01-03T13:03:04.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.815+0000 7fd94e7fc700 1 -- 172.21.15.133:0/1514762839 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd94801b410 con 0x7fd9581413f0 2021-01-03T13:03:04.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.815+0000 7fd94e7fc700 1 --2- 172.21.15.133:0/1514762839 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd9400554e0 0x7fd9400579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:04.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.819+0000 7fd94e7fc700 1 -- 172.21.15.133:0/1514762839 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd94806e180 con 0x7fd9581413f0 2021-01-03T13:03:04.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.819+0000 7fd95d225700 1 --2- 172.21.15.133:0/1514762839 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd9400554e0 0x7fd9400579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:04.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.819+0000 7fd95d225700 1 --2- 172.21.15.133:0/1514762839 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd9400554e0 0x7fd9400579a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fd95001a000 tx=0x7fd950016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:04.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:04.827+0000 7fd94e7fc700 1 -- 172.21.15.133:0/1514762839 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd948044420 con 0x7fd9581413f0 2021-01-03T13:03:05.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.007+0000 7fd95e227700 1 -- 172.21.15.133:0/1514762839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd958057300 con 0x7fd9581413f0 2021-01-03T13:03:05.401 INFO:tasks.ceph.mon.b.smithi016.stderr:2021-01-03T13:03:05.401+0000 7fba5c9c4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-01-03T13:03:05.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.415+0000 7fd94e7fc700 1 -- 172.21.15.133:0/1514762839 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd948047a40 con 0x7fd9581413f0 2021-01-03T13:03:05.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.415+0000 7fd95e227700 1 -- 172.21.15.133:0/1514762839 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd9400554e0 msgr2=0x7fd9400579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:05.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.415+0000 7fd95e227700 1 --2- 172.21.15.133:0/1514762839 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd9400554e0 0x7fd9400579a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fd95001a000 tx=0x7fd950016000).stop 2021-01-03T13:03:05.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.415+0000 7fd95e227700 1 -- 172.21.15.133:0/1514762839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9581413f0 msgr2=0x7fd9580b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:05.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.415+0000 7fd95e227700 1 --2- 172.21.15.133:0/1514762839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9581413f0 0x7fd9580b1a30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fd94800c000 tx=0x7fd948006dc0).stop 2021-01-03T13:03:05.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.415+0000 7fd95e227700 1 -- 172.21.15.133:0/1514762839 shutdown_connections 2021-01-03T13:03:05.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.415+0000 7fd95e227700 1 --2- 172.21.15.133:0/1514762839 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd9400554e0 0x7fd9400579a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:05.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.415+0000 7fd95e227700 1 --2- 172.21.15.133:0/1514762839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9580b1650 0x7fd9581521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:05.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.415+0000 7fd95e227700 1 --2- 172.21.15.133:0/1514762839 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd9581425a0 0x7fd9580b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:05.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.415+0000 7fd95e227700 1 --2- 172.21.15.133:0/1514762839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9581413f0 0x7fd9580b1a30 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:05.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.415+0000 7fd95e227700 1 -- 172.21.15.133:0/1514762839 >> 172.21.15.133:0/1514762839 conn(0x7fd9580b69e0 msgr2=0x7fd958144d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:05.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.419+0000 7fd95e227700 1 -- 172.21.15.133:0/1514762839 shutdown_connections 2021-01-03T13:03:05.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.419+0000 7fd95e227700 1 -- 172.21.15.133:0/1514762839 wait complete. 2021-01-03T13:03:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-01-03T13:03:05.430 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:03:05.451 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T13:03:05.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.543+0000 7f57fffff700 1 Processor -- start 2021-01-03T13:03:05.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.543+0000 7f57fffff700 1 -- start start 2021-01-03T13:03:05.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.543+0000 7f57fffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f58000b0c90 0x7f58000b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:05.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.543+0000 7f57fffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58000b5c00 0x7f5800143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:05.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.543+0000 7f57fffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5800060da0 con 0x7f58000b52c0 2021-01-03T13:03:05.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.543+0000 7f57fffff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5800067a90 con 0x7f58000b0c90 2021-01-03T13:03:05.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.543+0000 7f57fffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58000b0ad0 con 0x7f58000b5c00 2021-01-03T13:03:05.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.543+0000 7f57feffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f58000b52c0 0x7f5800098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55908/0 (socket says 172.21.15.133:55908) 2021-01-03T13:03:05.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.543+0000 7f57feffd700 1 -- 172.21.15.133:0/2508618245 learned_addr learned my addr 172.21.15.133:0/2508618245 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:05.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.543+0000 7f57fe7fc700 1 --2- 172.21.15.133:0/2508618245 >> v2:172.21.15.133:3300/0 conn(0x7f58000b0c90 0x7f58000b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:05.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.543+0000 7f57ff7fe700 1 --2- 172.21.15.133:0/2508618245 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58000b5c00 0x7f5800143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:05.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.543+0000 7f57fdffb700 1 -- 172.21.15.133:0/2508618245 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390751474 0 0) 0x7f5800060da0 con 0x7f58000b52c0 2021-01-03T13:03:05.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.543+0000 7f57fdffb700 1 -- 172.21.15.133:0/2508618245 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57e0003230 con 0x7f58000b52c0 2021-01-03T13:03:05.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.543+0000 7f57fe7fc700 1 -- 172.21.15.133:0/2508618245 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58000b5c00 msgr2=0x7f5800143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:05.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.543+0000 7f57fe7fc700 1 --2- 172.21.15.133:0/2508618245 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58000b5c00 0x7f5800143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:05.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.543+0000 7f57fe7fc700 1 -- 172.21.15.133:0/2508618245 >> v1:172.21.15.133:6789/0 conn(0x7f58000b52c0 legacy=0x7f5800098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:05.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.543+0000 7f57fe7fc700 1 -- 172.21.15.133:0/2508618245 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58000b56a0 con 0x7f58000b0c90 2021-01-03T13:03:05.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fe7fc700 1 --2- 172.21.15.133:0/2508618245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58000b0c90 0x7f58000b05e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f57f0002f30 tx=0x7f57f0006dc0).ready entity=mon.1 client_cookie=427d759deb74e2d3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:05.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fdffb700 1 -- 172.21.15.133:0/2508618245 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57f00096a0 con 0x7f58000b0c90 2021-01-03T13:03:05.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fdffb700 1 -- 172.21.15.133:0/2508618245 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f0009800 con 0x7f58000b0c90 2021-01-03T13:03:05.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fdffb700 1 -- 172.21.15.133:0/2508618245 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57f0009b60 con 0x7f58000b0c90 2021-01-03T13:03:05.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 -- 172.21.15.133:0/2508618245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58000b0c90 msgr2=0x7f58000b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 --2- 172.21.15.133:0/2508618245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58000b0c90 0x7f58000b05e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f57f0002f30 tx=0x7f57f0006dc0).stop 2021-01-03T13:03:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 -- 172.21.15.133:0/2508618245 shutdown_connections 2021-01-03T13:03:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 --2- 172.21.15.133:0/2508618245 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58000b5c00 0x7f5800143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 --2- 172.21.15.133:0/2508618245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58000b0c90 0x7f58000b05e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:05.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 -- 172.21.15.133:0/2508618245 >> 172.21.15.133:0/2508618245 conn(0x7f580005bdf0 msgr2=0x7f580005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:05.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 -- 172.21.15.133:0/2508618245 shutdown_connections 2021-01-03T13:03:05.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 -- 172.21.15.133:0/2508618245 wait complete. 2021-01-03T13:03:05.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 Processor -- start 2021-01-03T13:03:05.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 -- start start 2021-01-03T13:03:05.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58000b0c90 0x7f58000b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:05.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58000b52c0 0x7f5800155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:05.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58000b5c00 0x7f5800066ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5800065db0 con 0x7f58000b52c0 2021-01-03T13:03:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5800066050 con 0x7f58000b0c90 2021-01-03T13:03:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58000662f0 con 0x7f58000b5c00 2021-01-03T13:03:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57feffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58000b0c90 0x7f58000b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:05.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57feffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58000b0c90 0x7f58000b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34882/0 (socket says 172.21.15.133:34882) 2021-01-03T13:03:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57feffd700 1 -- 172.21.15.133:0/1501282823 learned_addr learned my addr 172.21.15.133:0/1501282823 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fe7fc700 1 --2- 172.21.15.133:0/1501282823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58000b52c0 0x7f5800155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57ff7fe700 1 --2- 172.21.15.133:0/1501282823 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58000b5c00 0x7f5800066ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57feffd700 1 -- 172.21.15.133:0/1501282823 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58000b5c00 msgr2=0x7f5800066ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57feffd700 1 --2- 172.21.15.133:0/1501282823 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58000b5c00 0x7f5800066ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:05.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57feffd700 1 -- 172.21.15.133:0/1501282823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58000b52c0 msgr2=0x7f5800155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:05.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57feffd700 1 --2- 172.21.15.133:0/1501282823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58000b52c0 0x7f5800155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:05.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57feffd700 1 -- 172.21.15.133:0/1501282823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5800066640 con 0x7f58000b0c90 2021-01-03T13:03:05.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fe7fc700 1 --2- 172.21.15.133:0/1501282823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58000b52c0 0x7f5800155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:03:05.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57feffd700 1 --2- 172.21.15.133:0/1501282823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58000b0c90 0x7f58000b3ec0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f57f8001450 tx=0x7f57f8007e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:05.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57f7fff700 1 -- 172.21.15.133:0/1501282823 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57f8005b70 con 0x7f58000b0c90 2021-01-03T13:03:05.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57f7fff700 1 -- 172.21.15.133:0/1501282823 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f8005cd0 con 0x7f58000b0c90 2021-01-03T13:03:05.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57f7fff700 1 -- 172.21.15.133:0/1501282823 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57f8007300 con 0x7f58000b0c90 2021-01-03T13:03:05.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 -- 172.21.15.133:0/1501282823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58000ae810 con 0x7f58000b0c90 2021-01-03T13:03:05.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.547+0000 7f57fffff700 1 -- 172.21.15.133:0/1501282823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58000adc00 con 0x7f58000b0c90 2021-01-03T13:03:05.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.551+0000 7f57fffff700 1 -- 172.21.15.133:0/1501282823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5800057300 con 0x7f58000b0c90 2021-01-03T13:03:05.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.551+0000 7f57f7fff700 1 -- 172.21.15.133:0/1501282823 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f57f8010030 con 0x7f58000b0c90 2021-01-03T13:03:05.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.551+0000 7f57f7fff700 1 --2- 172.21.15.133:0/1501282823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57e40553b0 0x7f57e4057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:05.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.551+0000 7f57f7fff700 1 -- 172.21.15.133:0/1501282823 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f57f806e7c0 con 0x7f58000b0c90 2021-01-03T13:03:05.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.551+0000 7f57fe7fc700 1 --2- 172.21.15.133:0/1501282823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57e40553b0 0x7f57e4057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:05.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.551+0000 7f57fe7fc700 1 --2- 172.21.15.133:0/1501282823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57e40553b0 0x7f57e4057870 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f57f0016000 tx=0x7f57f0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:05.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.559+0000 7f57f7fff700 1 -- 172.21.15.133:0/1501282823 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f57f8044a10 con 0x7f58000b0c90 2021-01-03T13:03:05.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.739+0000 7f57fffff700 1 -- 172.21.15.133:0/1501282823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f580005ce00 con 0x7f58000b0c90 2021-01-03T13:03:05.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.739+0000 7f57f7fff700 1 -- 172.21.15.133:0/1501282823 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+2134 (secure 0 0 0) 0x7f57f8048030 con 0x7f58000b0c90 2021-01-03T13:03:05.736 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:05.736 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5087,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/2812725713","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2812725713},{"type":"v1","addr":"172.21.15.16:6833","nonce":2812725713}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5548,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1096331942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1096331942},{"type":"v1","addr":"172.21.15.133:6835","nonce":1096331942}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:01:34.953831+0000","modified":"2021-01-03T13:03:05.406510+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":56,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2021-01-03T13:03:05.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.739+0000 7f57fffff700 1 -- 172.21.15.133:0/1501282823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57e40553b0 msgr2=0x7f57e4057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:05.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.739+0000 7f57fffff700 1 --2- 172.21.15.133:0/1501282823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57e40553b0 0x7f57e4057870 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f57f0016000 tx=0x7f57f0015000).stop 2021-01-03T13:03:05.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.739+0000 7f57fffff700 1 -- 172.21.15.133:0/1501282823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58000b0c90 msgr2=0x7f58000b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:05.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.739+0000 7f57fffff700 1 --2- 172.21.15.133:0/1501282823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58000b0c90 0x7f58000b3ec0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f57f8001450 tx=0x7f57f8007e20).stop 2021-01-03T13:03:05.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.743+0000 7f57fffff700 1 -- 172.21.15.133:0/1501282823 shutdown_connections 2021-01-03T13:03:05.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.743+0000 7f57fffff700 1 --2- 172.21.15.133:0/1501282823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57e40553b0 0x7f57e4057870 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:05.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.743+0000 7f57fffff700 1 --2- 172.21.15.133:0/1501282823 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58000b5c00 0x7f5800066ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:05.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.743+0000 7f57fffff700 1 --2- 172.21.15.133:0/1501282823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58000b0c90 0x7f58000b3ec0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:05.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.743+0000 7f57fffff700 1 --2- 172.21.15.133:0/1501282823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58000b52c0 0x7f5800155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:05.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.743+0000 7f57fffff700 1 -- 172.21.15.133:0/1501282823 >> 172.21.15.133:0/1501282823 conn(0x7f580005bdf0 msgr2=0x7f58001459c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:05.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.743+0000 7f57fffff700 1 -- 172.21.15.133:0/1501282823 shutdown_connections 2021-01-03T13:03:05.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.743+0000 7f57fffff700 1 -- 172.21.15.133:0/1501282823 wait complete. 2021-01-03T13:03:05.742 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 22 2021-01-03T13:03:05.751 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-01-03T13:03:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.915+0000 7f29c4904700 1 Processor -- start 2021-01-03T13:03:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.915+0000 7f29c4904700 1 -- start start 2021-01-03T13:03:05.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.915+0000 7f29c4904700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f29c01406b0 0x7f29c00676c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:05.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.915+0000 7f29c4904700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c00b2780 con 0x7f29c00af780 2021-01-03T13:03:05.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.915+0000 7f29c4904700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c00a9480 con 0x7f29c00b23a0 2021-01-03T13:03:05.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.915+0000 7f29c4904700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c00aef00 con 0x7f29c01406b0 2021-01-03T13:03:05.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.915+0000 7f29bf7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f29c00b23a0 0x7f29c0066fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55922/0 (socket says 172.21.15.133:55922) 2021-01-03T13:03:05.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.915+0000 7f29bf7fe700 1 -- 172.21.15.133:0/1238395607 learned_addr learned my addr 172.21.15.133:0/1238395607 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:05.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.915+0000 7f29beffd700 1 --2- 172.21.15.133:0/1238395607 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f29c01406b0 0x7f29c00676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.915+0000 7f29be7fc700 1 -- 172.21.15.133:0/1238395607 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402965419 0 0) 0x7f29c00a9480 con 0x7f29c00b23a0 2021-01-03T13:03:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.915+0000 7f29be7fc700 1 -- 172.21.15.133:0/1238395607 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29ac003230 con 0x7f29c00b23a0 2021-01-03T13:03:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.915+0000 7f29be7fc700 1 -- 172.21.15.133:0/1238395607 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184621095 0 0) 0x7f29c00b2780 con 0x7f29c00af780 2021-01-03T13:03:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.915+0000 7f29be7fc700 1 -- 172.21.15.133:0/1238395607 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29c00a9480 con 0x7f29c00af780 2021-01-03T13:03:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.919+0000 7f29beffd700 1 -- 172.21.15.133:0/1238395607 >> v1:172.21.15.133:6789/0 conn(0x7f29c00b23a0 legacy=0x7f29c0066fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.919+0000 7f29beffd700 1 -- 172.21.15.133:0/1238395607 >> v1:172.21.15.16:6789/0 conn(0x7f29c00af780 legacy=0x7f29c00b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.919+0000 7f29beffd700 1 -- 172.21.15.133:0/1238395607 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c013fa30 con 0x7f29c01406b0 2021-01-03T13:03:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.919+0000 7f29beffd700 1 --2- 172.21.15.133:0/1238395607 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f29c01406b0 0x7f29c00676c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f29b4002f30 tx=0x7f29b4006dc0).ready entity=mon.2 client_cookie=a25e1da79863fca8 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.919+0000 7f29be7fc700 1 -- 172.21.15.133:0/1238395607 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29b4009730 con 0x7f29c01406b0 2021-01-03T13:03:05.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.919+0000 7f29be7fc700 1 -- 172.21.15.133:0/1238395607 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b4009890 con 0x7f29c01406b0 2021-01-03T13:03:05.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.919+0000 7f29be7fc700 1 -- 172.21.15.133:0/1238395607 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29b4009bf0 con 0x7f29c01406b0 2021-01-03T13:03:05.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.919+0000 7f29c4904700 1 -- 172.21.15.133:0/1238395607 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f29c01406b0 msgr2=0x7f29c00676c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:05.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.919+0000 7f29c4904700 1 --2- 172.21.15.133:0/1238395607 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f29c01406b0 0x7f29c00676c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f29b4002f30 tx=0x7f29b4006dc0).stop 2021-01-03T13:03:05.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.919+0000 7f29c4904700 1 -- 172.21.15.133:0/1238395607 shutdown_connections 2021-01-03T13:03:05.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.919+0000 7f29c4904700 1 --2- 172.21.15.133:0/1238395607 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f29c01406b0 0x7f29c00676c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:05.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.919+0000 7f29c4904700 1 -- 172.21.15.133:0/1238395607 >> 172.21.15.133:0/1238395607 conn(0x7f29c006b050 msgr2=0x7f29c0060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:05.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.919+0000 7f29c4904700 1 -- 172.21.15.133:0/1238395607 shutdown_connections 2021-01-03T13:03:05.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.919+0000 7f29c4904700 1 -- 172.21.15.133:0/1238395607 wait complete. 2021-01-03T13:03:05.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29c4904700 1 Processor -- start 2021-01-03T13:03:05.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29c4904700 1 -- start start 2021-01-03T13:03:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29c4904700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29c00af780 0x7f29c00b1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29c4904700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c00b23a0 0x7f29c0152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29c4904700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f29c01406b0 0x7f29c0144400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29c4904700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c0140c30 con 0x7f29c00af780 2021-01-03T13:03:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29c4904700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c0152280 con 0x7f29c00b23a0 2021-01-03T13:03:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29c4904700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c0140e60 con 0x7f29c01406b0 2021-01-03T13:03:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29beffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c00b23a0 0x7f29c0152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29beffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c00b23a0 0x7f29c0152980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34896/0 (socket says 172.21.15.133:34896) 2021-01-03T13:03:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29beffd700 1 -- 172.21.15.133:0/3981696972 learned_addr learned my addr 172.21.15.133:0/3981696972 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29bf7fe700 1 --2- 172.21.15.133:0/3981696972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29c00af780 0x7f29c00b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29bffff700 1 --2- 172.21.15.133:0/3981696972 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f29c01406b0 0x7f29c0144400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29beffd700 1 -- 172.21.15.133:0/3981696972 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f29c01406b0 msgr2=0x7f29c0144400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29beffd700 1 --2- 172.21.15.133:0/3981696972 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f29c01406b0 0x7f29c0144400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:05.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29beffd700 1 -- 172.21.15.133:0/3981696972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29c00af780 msgr2=0x7f29c00b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:05.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29beffd700 1 --2- 172.21.15.133:0/3981696972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29c00af780 0x7f29c00b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:05.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29beffd700 1 -- 172.21.15.133:0/3981696972 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c01524e0 con 0x7f29c00b23a0 2021-01-03T13:03:05.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29bffff700 1 --2- 172.21.15.133:0/3981696972 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f29c01406b0 0x7f29c0144400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:03:05.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29beffd700 1 --2- 172.21.15.133:0/3981696972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c00b23a0 0x7f29c0152980 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f29b4002f30 tx=0x7f29b4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29bcff9700 1 -- 172.21.15.133:0/3981696972 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29b4011c20 con 0x7f29c00b23a0 2021-01-03T13:03:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29bcff9700 1 -- 172.21.15.133:0/3981696972 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b4011d80 con 0x7f29c00b23a0 2021-01-03T13:03:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29c4904700 1 -- 172.21.15.133:0/3981696972 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c00b1980 con 0x7f29c00b23a0 2021-01-03T13:03:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29bcff9700 1 -- 172.21.15.133:0/3981696972 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29b401d640 con 0x7f29c00b23a0 2021-01-03T13:03:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.923+0000 7f29c4904700 1 -- 172.21.15.133:0/3981696972 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c01456c0 con 0x7f29c00b23a0 2021-01-03T13:03:05.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.927+0000 7f29bcff9700 1 -- 172.21.15.133:0/3981696972 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f29b4024030 con 0x7f29c00b23a0 2021-01-03T13:03:05.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.927+0000 7f29c4904700 1 -- 172.21.15.133:0/3981696972 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c0064240 con 0x7f29c00b23a0 2021-01-03T13:03:05.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.927+0000 7f29bcff9700 1 --2- 172.21.15.133:0/3981696972 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f29a0055470 0x7f29a0057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:05.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.927+0000 7f29bcff9700 1 -- 172.21.15.133:0/3981696972 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f29b406f030 con 0x7f29c00b23a0 2021-01-03T13:03:05.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.927+0000 7f29bf7fe700 1 --2- 172.21.15.133:0/3981696972 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f29a0055470 0x7f29a0057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:05.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.927+0000 7f29bf7fe700 1 --2- 172.21.15.133:0/3981696972 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f29a0055470 0x7f29a0057930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f29b000b000 tx=0x7f29b0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:05.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:05.935+0000 7f29bcff9700 1 -- 172.21.15.133:0/3981696972 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f29b40452e0 con 0x7f29c00b23a0 2021-01-03T13:03:06.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.119+0000 7f29c4904700 1 -- 172.21.15.133:0/3981696972 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f29c0057300 con 0x7f29c00b23a0 2021-01-03T13:03:06.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.431+0000 7f29bcff9700 1 -- 172.21.15.133:0/3981696972 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f29b4022020 con 0x7f29c00b23a0 2021-01-03T13:03:06.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.435+0000 7f29c4904700 1 -- 172.21.15.133:0/3981696972 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f29a0055470 msgr2=0x7f29a0057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:06.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.435+0000 7f29c4904700 1 --2- 172.21.15.133:0/3981696972 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f29a0055470 0x7f29a0057930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f29b000b000 tx=0x7f29b0009040).stop 2021-01-03T13:03:06.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.435+0000 7f29c4904700 1 -- 172.21.15.133:0/3981696972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c00b23a0 msgr2=0x7f29c0152980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:06.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.435+0000 7f29c4904700 1 --2- 172.21.15.133:0/3981696972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c00b23a0 0x7f29c0152980 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f29b4002f30 tx=0x7f29b4015000).stop 2021-01-03T13:03:06.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.435+0000 7f29c4904700 1 -- 172.21.15.133:0/3981696972 shutdown_connections 2021-01-03T13:03:06.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.435+0000 7f29c4904700 1 --2- 172.21.15.133:0/3981696972 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f29a0055470 0x7f29a0057930 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:06.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.435+0000 7f29c4904700 1 --2- 172.21.15.133:0/3981696972 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29c00af780 0x7f29c00b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:06.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.435+0000 7f29c4904700 1 --2- 172.21.15.133:0/3981696972 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f29c01406b0 0x7f29c0144400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:06.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.435+0000 7f29c4904700 1 --2- 172.21.15.133:0/3981696972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29c00b23a0 0x7f29c0152980 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:06.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.435+0000 7f29c4904700 1 -- 172.21.15.133:0/3981696972 >> 172.21.15.133:0/3981696972 conn(0x7f29c006b050 msgr2=0x7f29c00b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:06.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.435+0000 7f29c4904700 1 -- 172.21.15.133:0/3981696972 shutdown_connections 2021-01-03T13:03:06.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.435+0000 7f29c4904700 1 -- 172.21.15.133:0/3981696972 wait complete. 2021-01-03T13:03:06.450 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-01-03T13:03:06.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.575+0000 7feae7fff700 1 Processor -- start 2021-01-03T13:03:06.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.575+0000 7feae7fff700 1 -- start start 2021-01-03T13:03:06.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.575+0000 7feae7fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feae805fd10 0x7feae805c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:06.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.575+0000 7feae7fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae80b6cf0 con 0x7feae8060510 2021-01-03T13:03:06.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.575+0000 7feae7fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae805bf00 con 0x7feae80b4c20 2021-01-03T13:03:06.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.575+0000 7feae7fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae805c1a0 con 0x7feae805fd10 2021-01-03T13:03:06.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.575+0000 7feae6ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feae80b4c20 0x7feae80b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55938/0 (socket says 172.21.15.133:55938) 2021-01-03T13:03:06.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.575+0000 7feae6ffd700 1 -- 172.21.15.133:0/2643354683 learned_addr learned my addr 172.21.15.133:0/2643354683 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:06.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.575+0000 7feae77fe700 1 --2- 172.21.15.133:0/2643354683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feae805fd10 0x7feae805c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:06.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae5ffb700 1 -- 172.21.15.133:0/2643354683 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490680327 0 0) 0x7feae805bf00 con 0x7feae80b4c20 2021-01-03T13:03:06.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae5ffb700 1 -- 172.21.15.133:0/2643354683 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feac8003230 con 0x7feae80b4c20 2021-01-03T13:03:06.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae5ffb700 1 -- 172.21.15.133:0/2643354683 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820340503 0 0) 0x7feae80b6cf0 con 0x7feae8060510 2021-01-03T13:03:06.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae5ffb700 1 -- 172.21.15.133:0/2643354683 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feae805bf00 con 0x7feae8060510 2021-01-03T13:03:06.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae77fe700 1 -- 172.21.15.133:0/2643354683 >> v1:172.21.15.133:6789/0 conn(0x7feae80b4c20 legacy=0x7feae80b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:06.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae77fe700 1 -- 172.21.15.133:0/2643354683 >> v1:172.21.15.16:6789/0 conn(0x7feae8060510 legacy=0x7feae80b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:06.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae77fe700 1 -- 172.21.15.133:0/2643354683 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae805c440 con 0x7feae805fd10 2021-01-03T13:03:06.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae77fe700 1 --2- 172.21.15.133:0/2643354683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feae805fd10 0x7feae805c8e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7feae00032b0 tx=0x7feae00091a0).ready entity=mon.2 client_cookie=bda030694916cab2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:06.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae5ffb700 1 -- 172.21.15.133:0/2643354683 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae000b940 con 0x7feae805fd10 2021-01-03T13:03:06.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae5ffb700 1 -- 172.21.15.133:0/2643354683 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae000baa0 con 0x7feae805fd10 2021-01-03T13:03:06.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae5ffb700 1 -- 172.21.15.133:0/2643354683 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae000bc10 con 0x7feae805fd10 2021-01-03T13:03:06.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae7fff700 1 -- 172.21.15.133:0/2643354683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feae805fd10 msgr2=0x7feae805c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:06.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae7fff700 1 --2- 172.21.15.133:0/2643354683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feae805fd10 0x7feae805c8e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7feae00032b0 tx=0x7feae00091a0).stop 2021-01-03T13:03:06.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae7fff700 1 -- 172.21.15.133:0/2643354683 shutdown_connections 2021-01-03T13:03:06.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae7fff700 1 --2- 172.21.15.133:0/2643354683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feae805fd10 0x7feae805c8e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:06.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae7fff700 1 -- 172.21.15.133:0/2643354683 >> 172.21.15.133:0/2643354683 conn(0x7feae80b9f00 msgr2=0x7feae80b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:06.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae7fff700 1 -- 172.21.15.133:0/2643354683 shutdown_connections 2021-01-03T13:03:06.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.579+0000 7feae7fff700 1 -- 172.21.15.133:0/2643354683 wait complete. 2021-01-03T13:03:06.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae7fff700 1 Processor -- start 2021-01-03T13:03:06.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae7fff700 1 -- start start 2021-01-03T13:03:06.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae7fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feae805fd10 0x7feae809e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae7fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feae8060510 0x7feae8149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae80b4c20 0x7feae8149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae7fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae8147480 con 0x7feae805fd10 2021-01-03T13:03:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae7fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae8141f50 con 0x7feae80b4c20 2021-01-03T13:03:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae7fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae81476b0 con 0x7feae8060510 2021-01-03T13:03:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae80b4c20 0x7feae8149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae80b4c20 0x7feae8149620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34916/0 (socket says 172.21.15.133:34916) 2021-01-03T13:03:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae77fe700 1 -- 172.21.15.133:0/1411216641 learned_addr learned my addr 172.21.15.133:0/1411216641 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae6ffd700 1 --2- 172.21.15.133:0/1411216641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feae805fd10 0x7feae809e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae67fc700 1 --2- 172.21.15.133:0/1411216641 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feae8060510 0x7feae8149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae77fe700 1 -- 172.21.15.133:0/1411216641 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feae8060510 msgr2=0x7feae8149130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae77fe700 1 --2- 172.21.15.133:0/1411216641 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feae8060510 0x7feae8149130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae77fe700 1 -- 172.21.15.133:0/1411216641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feae805fd10 msgr2=0x7feae809e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae77fe700 1 --2- 172.21.15.133:0/1411216641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feae805fd10 0x7feae809e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:06.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae77fe700 1 -- 172.21.15.133:0/1411216641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae8147b50 con 0x7feae80b4c20 2021-01-03T13:03:06.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae6ffd700 1 --2- 172.21.15.133:0/1411216641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feae805fd10 0x7feae809e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:06.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae77fe700 1 --2- 172.21.15.133:0/1411216641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae80b4c20 0x7feae8149620 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7feae00032b0 tx=0x7feae0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:06.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feadffff700 1 -- 172.21.15.133:0/1411216641 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae0011dc0 con 0x7feae80b4c20 2021-01-03T13:03:06.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feadffff700 1 -- 172.21.15.133:0/1411216641 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae001f3f0 con 0x7feae80b4c20 2021-01-03T13:03:06.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae7fff700 1 -- 172.21.15.133:0/1411216641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae8149b10 con 0x7feae80b4c20 2021-01-03T13:03:06.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feadffff700 1 -- 172.21.15.133:0/1411216641 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae001f750 con 0x7feae80b4c20 2021-01-03T13:03:06.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.583+0000 7feae7fff700 1 -- 172.21.15.133:0/1411216641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae8141bd0 con 0x7feae80b4c20 2021-01-03T13:03:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.587+0000 7feae7fff700 1 -- 172.21.15.133:0/1411216641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae8057300 con 0x7feae80b4c20 2021-01-03T13:03:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.587+0000 7feadffff700 1 -- 172.21.15.133:0/1411216641 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7feae0026030 con 0x7feae80b4c20 2021-01-03T13:03:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.587+0000 7feadffff700 1 --2- 172.21.15.133:0/1411216641 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feacc0554e0 0x7feacc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:06.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.587+0000 7feadffff700 1 -- 172.21.15.133:0/1411216641 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6159+0+0 (secure 0 0 0) 0x7feae006eba0 con 0x7feae80b4c20 2021-01-03T13:03:06.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.587+0000 7feae6ffd700 1 --2- 172.21.15.133:0/1411216641 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feacc0554e0 0x7feacc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:06.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.587+0000 7feae6ffd700 1 --2- 172.21.15.133:0/1411216641 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feacc0554e0 0x7feacc0579a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fead800b000 tx=0x7fead8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:06.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.599+0000 7feadffff700 1 -- 172.21.15.133:0/1411216641 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7feae0044e50 con 0x7feae80b4c20 2021-01-03T13:03:06.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:06.735+0000 7feae7fff700 1 -- 172.21.15.133:0/1411216641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feae8067a00 con 0x7feae80b4c20 2021-01-03T13:03:07.384 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:03:07.387 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:03:07.389 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:03:07.391 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:03:07.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.439+0000 7feadffff700 1 -- 172.21.15.133:0/1411216641 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) v1 ==== 185+0+0 (secure 0 0 0) 0x7feae00240e0 con 0x7feae80b4c20 2021-01-03T13:03:07.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.443+0000 7feae7fff700 1 -- 172.21.15.133:0/1411216641 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feacc0554e0 msgr2=0x7feacc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:07.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.443+0000 7feae7fff700 1 --2- 172.21.15.133:0/1411216641 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feacc0554e0 0x7feacc0579a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fead800b000 tx=0x7fead8009040).stop 2021-01-03T13:03:07.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.443+0000 7feae7fff700 1 -- 172.21.15.133:0/1411216641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae80b4c20 msgr2=0x7feae8149620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:07.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.443+0000 7feae7fff700 1 --2- 172.21.15.133:0/1411216641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae80b4c20 0x7feae8149620 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7feae00032b0 tx=0x7feae0016000).stop 2021-01-03T13:03:07.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.443+0000 7feae7fff700 1 -- 172.21.15.133:0/1411216641 shutdown_connections 2021-01-03T13:03:07.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.443+0000 7feae7fff700 1 --2- 172.21.15.133:0/1411216641 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feacc0554e0 0x7feacc0579a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:07.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.443+0000 7feae7fff700 1 --2- 172.21.15.133:0/1411216641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feae805fd10 0x7feae809e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:07.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.443+0000 7feae7fff700 1 --2- 172.21.15.133:0/1411216641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feae80b4c20 0x7feae8149620 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:07.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.443+0000 7feae7fff700 1 --2- 172.21.15.133:0/1411216641 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feae8060510 0x7feae8149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:07.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.443+0000 7feae7fff700 1 -- 172.21.15.133:0/1411216641 >> 172.21.15.133:0/1411216641 conn(0x7feae80b9f00 msgr2=0x7feae80b82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:07.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.443+0000 7feae7fff700 1 -- 172.21.15.133:0/1411216641 shutdown_connections 2021-01-03T13:03:07.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.443+0000 7feae7fff700 1 -- 172.21.15.133:0/1411216641 wait complete. 2021-01-03T13:03:07.442 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2021-01-03T13:03:07.454 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-01-03T13:03:07.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.623+0000 7fad6ba2a700 1 Processor -- start 2021-01-03T13:03:07.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.623+0000 7fad6ba2a700 1 -- start start 2021-01-03T13:03:07.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad6ba2a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad6405c840 0x7fad640b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:07.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad6ba2a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad6413c890 0x7fad6413cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:07.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad6ba2a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad64140700 con 0x7fad6413fb40 2021-01-03T13:03:07.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad6ba2a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad640aa1f0 con 0x7fad6405c840 2021-01-03T13:03:07.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad6ba2a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6405cc20 con 0x7fad6413c890 2021-01-03T13:03:07.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad697c6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad6405c840 0x7fad640b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:07.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad697c6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad6405c840 0x7fad640b16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34920/0 (socket says 172.21.15.133:34920) 2021-01-03T13:03:07.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad68fc5700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fad6413fb40 0x7fad6413fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55954/0 (socket says 172.21.15.133:55954) 2021-01-03T13:03:07.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad697c6700 1 -- 172.21.15.133:0/2365916798 learned_addr learned my addr 172.21.15.133:0/2365916798 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:07.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad69fc7700 1 --2- 172.21.15.133:0/2365916798 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad6413c890 0x7fad6413cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:07.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad697c6700 1 -- 172.21.15.133:0/2365916798 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad6413c890 msgr2=0x7fad6413cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:07.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad697c6700 1 --2- 172.21.15.133:0/2365916798 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad6413c890 0x7fad6413cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:07.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad697c6700 1 -- 172.21.15.133:0/2365916798 >> v1:172.21.15.133:6789/0 conn(0x7fad6413fb40 legacy=0x7fad6413fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:07.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad53fff700 1 -- 172.21.15.133:0/2365916798 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255461684 0 0) 0x7fad540010d0 con 0x7fad6413fb40 2021-01-03T13:03:07.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad697c6700 1 -- 172.21.15.133:0/2365916798 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad64143df0 con 0x7fad6405c840 2021-01-03T13:03:07.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad697c6700 1 --2- 172.21.15.133:0/2365916798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad6405c840 0x7fad640b16b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fad60002f30 tx=0x7fad60006e80).ready entity=mon.1 client_cookie=a6d711b0c83b26d8 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:07.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad53fff700 1 -- 172.21.15.133:0/2365916798 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad600097f0 con 0x7fad6405c840 2021-01-03T13:03:07.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad53fff700 1 -- 172.21.15.133:0/2365916798 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad60009950 con 0x7fad6405c840 2021-01-03T13:03:07.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad53fff700 1 -- 172.21.15.133:0/2365916798 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad60009cb0 con 0x7fad6405c840 2021-01-03T13:03:07.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad6ba2a700 1 -- 172.21.15.133:0/2365916798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad6405c840 msgr2=0x7fad640b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:07.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad6ba2a700 1 --2- 172.21.15.133:0/2365916798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad6405c840 0x7fad640b16b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fad60002f30 tx=0x7fad60006e80).stop 2021-01-03T13:03:07.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad6ba2a700 1 -- 172.21.15.133:0/2365916798 shutdown_connections 2021-01-03T13:03:07.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad6ba2a700 1 --2- 172.21.15.133:0/2365916798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad6405c840 0x7fad640b16b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:07.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad6ba2a700 1 --2- 172.21.15.133:0/2365916798 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad6413c890 0x7fad6413cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:07.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad6ba2a700 1 -- 172.21.15.133:0/2365916798 >> 172.21.15.133:0/2365916798 conn(0x7fad6406aeb0 msgr2=0x7fad6405bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:07.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.627+0000 7fad6ba2a700 1 -- 172.21.15.133:0/2365916798 shutdown_connections 2021-01-03T13:03:07.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.631+0000 7fad6ba2a700 1 -- 172.21.15.133:0/2365916798 wait complete. 2021-01-03T13:03:07.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.631+0000 7fad6ba2a700 1 Processor -- start 2021-01-03T13:03:07.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.631+0000 7fad6ba2a700 1 -- start start 2021-01-03T13:03:07.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad6ba2a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad6405c840 0x7fad64142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:07.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad6ba2a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad6413c890 0x7fad6413b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:07.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad6ba2a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad6413fb40 0x7fad64138690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:07.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad6ba2a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad64141ba0 con 0x7fad6413c890 2021-01-03T13:03:07.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad6ba2a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad64141120 con 0x7fad6405c840 2021-01-03T13:03:07.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad6ba2a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad64141700 con 0x7fad6413fb40 2021-01-03T13:03:07.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad697c6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad6405c840 0x7fad64142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:07.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad697c6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad6405c840 0x7fad64142cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34926/0 (socket says 172.21.15.133:34926) 2021-01-03T13:03:07.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad697c6700 1 -- 172.21.15.133:0/2470023008 learned_addr learned my addr 172.21.15.133:0/2470023008 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:07.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad69fc7700 1 --2- 172.21.15.133:0/2470023008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad6413fb40 0x7fad64138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:07.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad68fc5700 1 --2- 172.21.15.133:0/2470023008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad6413c890 0x7fad6413b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:07.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad697c6700 1 -- 172.21.15.133:0/2470023008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad6413fb40 msgr2=0x7fad64138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:07.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad697c6700 1 --2- 172.21.15.133:0/2470023008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad6413fb40 0x7fad64138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:07.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad697c6700 1 -- 172.21.15.133:0/2470023008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad6413c890 msgr2=0x7fad6413b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:07.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad697c6700 1 --2- 172.21.15.133:0/2470023008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad6413c890 0x7fad6413b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:07.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad697c6700 1 -- 172.21.15.133:0/2470023008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad640abdf0 con 0x7fad6405c840 2021-01-03T13:03:07.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad697c6700 1 --2- 172.21.15.133:0/2470023008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad6405c840 0x7fad64142cf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fad60002f30 tx=0x7fad60015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:07.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad527fc700 1 -- 172.21.15.133:0/2470023008 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad60011b40 con 0x7fad6405c840 2021-01-03T13:03:07.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad527fc700 1 -- 172.21.15.133:0/2470023008 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad60011ca0 con 0x7fad6405c840 2021-01-03T13:03:07.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad6ba2a700 1 -- 172.21.15.133:0/2470023008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad64142860 con 0x7fad6405c840 2021-01-03T13:03:07.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad527fc700 1 -- 172.21.15.133:0/2470023008 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad6001e460 con 0x7fad6405c840 2021-01-03T13:03:07.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad6ba2a700 1 -- 172.21.15.133:0/2470023008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad64138b80 con 0x7fad6405c840 2021-01-03T13:03:07.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.635+0000 7fad6ba2a700 1 -- 172.21.15.133:0/2470023008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad64139110 con 0x7fad6405c840 2021-01-03T13:03:07.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.639+0000 7fad527fc700 1 -- 172.21.15.133:0/2470023008 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fad60025030 con 0x7fad6405c840 2021-01-03T13:03:07.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.639+0000 7fad527fc700 1 --2- 172.21.15.133:0/2470023008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fad440553b0 0x7fad44057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:07.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.639+0000 7fad527fc700 1 -- 172.21.15.133:0/2470023008 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fad6006f090 con 0x7fad6405c840 2021-01-03T13:03:07.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.639+0000 7fad68fc5700 1 --2- 172.21.15.133:0/2470023008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fad440553b0 0x7fad44057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:07.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.639+0000 7fad68fc5700 1 --2- 172.21.15.133:0/2470023008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fad440553b0 0x7fad44057870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fad5400d000 tx=0x7fad54007b90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:07.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.643+0000 7fad527fc700 1 -- 172.21.15.133:0/2470023008 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fad64139110 con 0x7fad6405c840 2021-01-03T13:03:07.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:07.791+0000 7fad6ba2a700 1 -- 172.21.15.133:0/2470023008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fad64139110 con 0x7fad6405c840 2021-01-03T13:03:08.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.443+0000 7fad527fc700 1 -- 172.21.15.133:0/2470023008 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) v1 ==== 173+0+0 (secure 0 0 0) 0x7fad64139110 con 0x7fad6405c840 2021-01-03T13:03:08.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.447+0000 7fad6ba2a700 1 -- 172.21.15.133:0/2470023008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fad440553b0 msgr2=0x7fad44057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:08.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.447+0000 7fad6ba2a700 1 --2- 172.21.15.133:0/2470023008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fad440553b0 0x7fad44057870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fad5400d000 tx=0x7fad54007b90).stop 2021-01-03T13:03:08.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.447+0000 7fad6ba2a700 1 -- 172.21.15.133:0/2470023008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad6405c840 msgr2=0x7fad64142cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:08.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.447+0000 7fad6ba2a700 1 --2- 172.21.15.133:0/2470023008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad6405c840 0x7fad64142cf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fad60002f30 tx=0x7fad60015000).stop 2021-01-03T13:03:08.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.447+0000 7fad6ba2a700 1 -- 172.21.15.133:0/2470023008 shutdown_connections 2021-01-03T13:03:08.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.447+0000 7fad6ba2a700 1 --2- 172.21.15.133:0/2470023008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fad440553b0 0x7fad44057870 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:08.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.447+0000 7fad6ba2a700 1 --2- 172.21.15.133:0/2470023008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fad6413fb40 0x7fad64138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:08.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.447+0000 7fad6ba2a700 1 --2- 172.21.15.133:0/2470023008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad6405c840 0x7fad64142cf0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:08.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.447+0000 7fad6ba2a700 1 --2- 172.21.15.133:0/2470023008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad6413c890 0x7fad6413b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:08.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.447+0000 7fad6ba2a700 1 -- 172.21.15.133:0/2470023008 >> 172.21.15.133:0/2470023008 conn(0x7fad6406aeb0 msgr2=0x7fad6413d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:08.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.447+0000 7fad6ba2a700 1 -- 172.21.15.133:0/2470023008 shutdown_connections 2021-01-03T13:03:08.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.447+0000 7fad6ba2a700 1 -- 172.21.15.133:0/2470023008 wait complete. 2021-01-03T13:03:08.447 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2021-01-03T13:03:08.461 INFO:tasks.ceph.mds.a:Restarting daemon 2021-01-03T13:03:08.461 INFO:tasks.ceph.mds.a:Stopping old one... 2021-01-03T13:03:08.461 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-01-03T13:03:08.462 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:03:08.462 INFO:tasks.ceph.mds.c:Restarting daemon 2021-01-03T13:03:08.462 INFO:tasks.ceph.mds.c:Stopping old one... 2021-01-03T13:03:08.463 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-01-03T13:03:08.463 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:03:08.463 INFO:tasks.ceph.mds.b:Restarting daemon 2021-01-03T13:03:08.464 INFO:tasks.ceph.mds.b:Stopping old one... 2021-01-03T13:03:08.464 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-01-03T13:03:08.464 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:03:08.472 INFO:tasks.ceph.mds.a:Stopped 2021-01-03T13:03:08.472 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-01-03T13:03:08.473 INFO:tasks.ceph.mds.b:Stopped 2021-01-03T13:03:08.473 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-01-03T13:03:08.476 INFO:tasks.ceph.mds.c:Stopped 2021-01-03T13:03:08.476 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-01-03T13:03:08.515 INFO:tasks.ceph.mds.b:Started 2021-01-03T13:03:08.516 DEBUG:teuthology.parallel:result is None 2021-01-03T13:03:08.518 INFO:tasks.ceph.mds.a:Started 2021-01-03T13:03:08.518 DEBUG:teuthology.parallel:result is None 2021-01-03T13:03:08.519 INFO:tasks.ceph.mds.c:Started 2021-01-03T13:03:08.520 DEBUG:teuthology.parallel:result is None 2021-01-03T13:03:08.520 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-01-03T13:03:08.584 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T13:03:08.588 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T13:03:08.600 INFO:tasks.ceph.mds.b.smithi016.stdout:starting mds.b at 2021-01-03T13:03:08.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f32951700 1 Processor -- start 2021-01-03T13:03:08.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f32951700 1 -- start start 2021-01-03T13:03:08.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f32951700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9f2c066f30 0x7f9f2c0b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:08.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f32951700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2c05fd00 con 0x7f9f2c0b1590 2021-01-03T13:03:08.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f32951700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2c0accd0 con 0x7f9f2c05f920 2021-01-03T13:03:08.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f32951700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f2c0b2980 con 0x7f9f2c066f30 2021-01-03T13:03:08.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f3194f700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9f2c05f920 0x7f9f2c0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:55996/0 (socket says 172.21.15.133:55996) 2021-01-03T13:03:08.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f3194f700 1 -- 172.21.15.133:0/3146962142 learned_addr learned my addr 172.21.15.133:0/3146962142 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:08.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f3114e700 1 --2- 172.21.15.133:0/3146962142 >> v2:172.21.15.16:3300/0 conn(0x7f9f2c066f30 0x7f9f2c0b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:08.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f3094d700 1 -- 172.21.15.133:0/3146962142 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975405554 0 0) 0x7f9f2c0accd0 con 0x7f9f2c05f920 2021-01-03T13:03:08.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f3094d700 1 -- 172.21.15.133:0/3146962142 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f14003230 con 0x7f9f2c05f920 2021-01-03T13:03:08.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f3094d700 1 -- 172.21.15.133:0/3146962142 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171534063 0 0) 0x7f9f2c05fd00 con 0x7f9f2c0b1590 2021-01-03T13:03:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f3094d700 1 -- 172.21.15.133:0/3146962142 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f2c0accd0 con 0x7f9f2c0b1590 2021-01-03T13:03:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f3114e700 1 -- 172.21.15.133:0/3146962142 >> v1:172.21.15.133:6789/0 conn(0x7f9f2c05f920 legacy=0x7f9f2c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f3114e700 1 -- 172.21.15.133:0/3146962142 >> v1:172.21.15.16:6789/0 conn(0x7f9f2c0b1590 legacy=0x7f9f2c13ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f3114e700 1 -- 172.21.15.133:0/3146962142 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c0acf70 con 0x7f9f2c066f30 2021-01-03T13:03:08.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f3114e700 1 --2- 172.21.15.133:0/3146962142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f2c066f30 0x7f9f2c0b0ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f9f1c002f30 tx=0x7f9f1c006dc0).ready entity=mon.0 client_cookie=b11f8ea0591e1ec5 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:08.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f3094d700 1 -- 172.21.15.133:0/3146962142 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f1c009740 con 0x7f9f2c066f30 2021-01-03T13:03:08.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f3094d700 1 -- 172.21.15.133:0/3146962142 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1c0098a0 con 0x7f9f2c066f30 2021-01-03T13:03:08.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f3094d700 1 -- 172.21.15.133:0/3146962142 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f1c009c00 con 0x7f9f2c066f30 2021-01-03T13:03:08.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f32951700 1 -- 172.21.15.133:0/3146962142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f2c066f30 msgr2=0x7f9f2c0b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:08.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f32951700 1 --2- 172.21.15.133:0/3146962142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f2c066f30 0x7f9f2c0b0ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f9f1c002f30 tx=0x7f9f1c006dc0).stop 2021-01-03T13:03:08.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f32951700 1 -- 172.21.15.133:0/3146962142 shutdown_connections 2021-01-03T13:03:08.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f32951700 1 --2- 172.21.15.133:0/3146962142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f2c066f30 0x7f9f2c0b0ab0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:08.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f32951700 1 -- 172.21.15.133:0/3146962142 >> 172.21.15.133:0/3146962142 conn(0x7f9f2c0b6110 msgr2=0x7f9f2c0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:08.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f32951700 1 -- 172.21.15.133:0/3146962142 shutdown_connections 2021-01-03T13:03:08.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.635+0000 7f9f32951700 1 -- 172.21.15.133:0/3146962142 wait complete. 2021-01-03T13:03:08.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32951700 1 Processor -- start 2021-01-03T13:03:08.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32951700 1 -- start start 2021-01-03T13:03:08.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32951700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f2c05f920 0x7f9f2c13af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:08.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32951700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9f2c066f30 0x7f9f2c144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:08.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32951700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f2c0b1590 0x7f9f2c145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:08.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32951700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c064b60 con 0x7f9f2c05f920 2021-01-03T13:03:08.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32951700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c14f460 con 0x7f9f2c0b1590 2021-01-03T13:03:08.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32951700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0648a0 con 0x7f9f2c066f30 2021-01-03T13:03:08.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32150700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f2c0b1590 0x7f9f2c145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:08.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f3114e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9f2c066f30 0x7f9f2c144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:08.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32150700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f2c0b1590 0x7f9f2c145470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34974/0 (socket says 172.21.15.133:34974) 2021-01-03T13:03:08.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f3114e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9f2c066f30 0x7f9f2c144f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:43272/0 (socket says 172.21.15.133:43272) 2021-01-03T13:03:08.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f3114e700 1 -- 172.21.15.133:0/4192413479 learned_addr learned my addr 172.21.15.133:0/4192413479 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:08.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f3194f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f2c05f920 0x7f9f2c13af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:08.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32150700 1 -- 172.21.15.133:0/4192413479 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9f2c066f30 msgr2=0x7f9f2c144f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:08.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32150700 1 --2- 172.21.15.133:0/4192413479 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9f2c066f30 0x7f9f2c144f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:08.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32150700 1 -- 172.21.15.133:0/4192413479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f2c05f920 msgr2=0x7f9f2c13af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:08.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32150700 1 --2- 172.21.15.133:0/4192413479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f2c05f920 0x7f9f2c13af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:08.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32150700 1 -- 172.21.15.133:0/4192413479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c145960 con 0x7f9f2c0b1590 2021-01-03T13:03:08.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f3194f700 1 --2- 172.21.15.133:0/4192413479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f2c05f920 0x7f9f2c13af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:03:08.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f3114e700 1 --2- 172.21.15.133:0/4192413479 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9f2c066f30 0x7f9f2c144f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:03:08.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32150700 1 --2- 172.21.15.133:0/4192413479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f2c0b1590 0x7f9f2c145470 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f9f24001450 tx=0x7f9f24007d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:08.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f1affd700 1 -- 172.21.15.133:0/4192413479 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f24010510 con 0x7f9f2c0b1590 2021-01-03T13:03:08.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f1affd700 1 -- 172.21.15.133:0/4192413479 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f24010670 con 0x7f9f2c0b1590 2021-01-03T13:03:08.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32951700 1 -- 172.21.15.133:0/4192413479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2c063f20 con 0x7f9f2c0b1590 2021-01-03T13:03:08.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f1affd700 1 -- 172.21.15.133:0/4192413479 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f240107e0 con 0x7f9f2c0b1590 2021-01-03T13:03:08.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.639+0000 7f9f32951700 1 -- 172.21.15.133:0/4192413479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2c0644c0 con 0x7f9f2c0b1590 2021-01-03T13:03:08.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.643+0000 7f9f32951700 1 -- 172.21.15.133:0/4192413479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2c064d60 con 0x7f9f2c0b1590 2021-01-03T13:03:08.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.643+0000 7f9f1affd700 1 -- 172.21.15.133:0/4192413479 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9f24010070 con 0x7f9f2c0b1590 2021-01-03T13:03:08.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.643+0000 7f9f1affd700 1 --2- 172.21.15.133:0/4192413479 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9f0c0553b0 0x7f9f0c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:08.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.643+0000 7f9f1affd700 1 -- 172.21.15.133:0/4192413479 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f9f2406d870 con 0x7f9f2c0b1590 2021-01-03T13:03:08.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.643+0000 7f9f3194f700 1 --2- 172.21.15.133:0/4192413479 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9f0c0553b0 0x7f9f0c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:08.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.643+0000 7f9f3194f700 1 --2- 172.21.15.133:0/4192413479 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9f0c0553b0 0x7f9f0c057870 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f9f2800d000 tx=0x7f9f28009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:08.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.651+0000 7f9f1affd700 1 -- 172.21.15.133:0/4192413479 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9f24043cc0 con 0x7f9f2c0b1590 2021-01-03T13:03:08.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:08.803+0000 7f9f32951700 1 -- 172.21.15.133:0/4192413479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f9f2c14f2a0 con 0x7f9f2c0b1590 2021-01-03T13:03:09.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.635+0000 7f9f1affd700 1 -- 172.21.15.133:0/4192413479 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v61) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9f240472e0 con 0x7f9f2c0b1590 2021-01-03T13:03:09.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.635+0000 7f9f32951700 1 -- 172.21.15.133:0/4192413479 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9f0c0553b0 msgr2=0x7f9f0c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:09.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.635+0000 7f9f32951700 1 --2- 172.21.15.133:0/4192413479 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9f0c0553b0 0x7f9f0c057870 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f9f2800d000 tx=0x7f9f28009040).stop 2021-01-03T13:03:09.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.635+0000 7f9f32951700 1 -- 172.21.15.133:0/4192413479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f2c0b1590 msgr2=0x7f9f2c145470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:09.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.635+0000 7f9f32951700 1 --2- 172.21.15.133:0/4192413479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f2c0b1590 0x7f9f2c145470 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f9f24001450 tx=0x7f9f24007d10).stop 2021-01-03T13:03:09.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.639+0000 7f9f32951700 1 -- 172.21.15.133:0/4192413479 shutdown_connections 2021-01-03T13:03:09.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.639+0000 7f9f32951700 1 --2- 172.21.15.133:0/4192413479 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9f0c0553b0 0x7f9f0c057870 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:09.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.639+0000 7f9f32951700 1 --2- 172.21.15.133:0/4192413479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f2c05f920 0x7f9f2c13af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:09.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.639+0000 7f9f32951700 1 --2- 172.21.15.133:0/4192413479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f2c0b1590 0x7f9f2c145470 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:09.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.639+0000 7f9f32951700 1 --2- 172.21.15.133:0/4192413479 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9f2c066f30 0x7f9f2c144f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:09.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.639+0000 7f9f32951700 1 -- 172.21.15.133:0/4192413479 >> 172.21.15.133:0/4192413479 conn(0x7f9f2c0b6110 msgr2=0x7f9f2c0ad7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:09.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.639+0000 7f9f32951700 1 -- 172.21.15.133:0/4192413479 shutdown_connections 2021-01-03T13:03:09.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.639+0000 7f9f32951700 1 -- 172.21.15.133:0/4192413479 wait complete. 2021-01-03T13:03:09.637 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blacklist entries 2021-01-03T13:03:09.648 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-01-03T13:03:09.648 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-01-03T13:03:09.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.755+0000 7f9ae0a95700 1 Processor -- start 2021-01-03T13:03:09.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.755+0000 7f9ae0a95700 1 -- start start 2021-01-03T13:03:09.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ae0a95700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9adc0b5c10 0x7f9adc0aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:09.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ae0a95700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9adc0b0670 0x7f9adc14a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:09.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ae0a95700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9adc14acc0 0x7f9adc144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:09.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ae0a95700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9adc098550 con 0x7f9adc14acc0 2021-01-03T13:03:09.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ae0a95700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9adc0b5ff0 con 0x7f9adc0b0670 2021-01-03T13:03:09.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ae0a95700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc0b0b10 con 0x7f9adc0b5c10 2021-01-03T13:03:09.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ad9d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9adc0b0670 0x7f9adc14a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:09.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ad9d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9adc0b0670 0x7f9adc14a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34982/0 (socket says 172.21.15.133:34982) 2021-01-03T13:03:09.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ad9d9b700 1 -- 172.21.15.133:0/292838233 learned_addr learned my addr 172.21.15.133:0/292838233 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:09.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9adad9d700 1 --2- 172.21.15.133:0/292838233 >> v2:172.21.15.16:3300/0 conn(0x7f9adc14acc0 0x7f9adc144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:09.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ada59c700 1 --2- 172.21.15.133:0/292838233 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9adc0b5c10 0x7f9adc0aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:09.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ad9d9b700 1 -- 172.21.15.133:0/292838233 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9adc0b5c10 msgr2=0x7f9adc0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:09.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ad9d9b700 1 --2- 172.21.15.133:0/292838233 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9adc0b5c10 0x7f9adc0aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:09.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ad9d9b700 1 -- 172.21.15.133:0/292838233 >> v2:172.21.15.16:3300/0 conn(0x7f9adc14acc0 msgr2=0x7f9adc144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:09.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ad9d9b700 1 --2- 172.21.15.133:0/292838233 >> v2:172.21.15.16:3300/0 conn(0x7f9adc14acc0 0x7f9adc144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:09.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ad9d9b700 1 -- 172.21.15.133:0/292838233 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9adc098780 con 0x7f9adc0b0670 2021-01-03T13:03:09.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ada59c700 1 --2- 172.21.15.133:0/292838233 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9adc0b5c10 0x7f9adc0aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:09.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ad9d9b700 1 --2- 172.21.15.133:0/292838233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9adc0b0670 0x7f9adc14a7d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f9acc0032b0 tx=0x7f9acc009270).ready entity=mon.1 client_cookie=6edf9e9bfacf6711 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:09.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ad959a700 1 -- 172.21.15.133:0/292838233 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9acc009e60 con 0x7f9adc0b0670 2021-01-03T13:03:09.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ad959a700 1 -- 172.21.15.133:0/292838233 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9acc00bc00 con 0x7f9adc0b0670 2021-01-03T13:03:09.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ae0a95700 1 -- 172.21.15.133:0/292838233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9adc0b0670 msgr2=0x7f9adc14a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:09.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ae0a95700 1 --2- 172.21.15.133:0/292838233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9adc0b0670 0x7f9adc14a7d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f9acc0032b0 tx=0x7f9acc009270).stop 2021-01-03T13:03:09.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ad959a700 1 -- 172.21.15.133:0/292838233 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9acc00bd70 con 0x7f9adc0b0670 2021-01-03T13:03:09.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ae0a95700 1 -- 172.21.15.133:0/292838233 shutdown_connections 2021-01-03T13:03:09.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ae0a95700 1 --2- 172.21.15.133:0/292838233 >> v2:172.21.15.16:3300/0 conn(0x7f9adc14acc0 0x7f9adc144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:09.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ae0a95700 1 --2- 172.21.15.133:0/292838233 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9adc0b5c10 0x7f9adc0aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:09.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ae0a95700 1 --2- 172.21.15.133:0/292838233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9adc0b0670 0x7f9adc14a7d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:09.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ae0a95700 1 -- 172.21.15.133:0/292838233 >> 172.21.15.133:0/292838233 conn(0x7f9adc05c8c0 msgr2=0x7f9adc0b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:09.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ae0a95700 1 -- 172.21.15.133:0/292838233 shutdown_connections 2021-01-03T13:03:09.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.759+0000 7f9ae0a95700 1 -- 172.21.15.133:0/292838233 wait complete. 2021-01-03T13:03:09.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9ae0a95700 1 Processor -- start 2021-01-03T13:03:09.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9ae0a95700 1 -- start start 2021-01-03T13:03:09.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9ae0a95700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9adc0b0670 0x7f9adc099d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:09.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9ae0a95700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9adc0b5c10 0x7f9adc1463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:09.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9ae0a95700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9adc14acc0 0x7f9adc1468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:09.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9ae0a95700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc159850 con 0x7f9adc0b5c10 2021-01-03T13:03:09.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9ae0a95700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc159af0 con 0x7f9adc14acc0 2021-01-03T13:03:09.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9ae0a95700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc159d90 con 0x7f9adc0b0670 2021-01-03T13:03:09.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9adad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9adc14acc0 0x7f9adc1468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:09.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9adad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9adc14acc0 0x7f9adc1468b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34992/0 (socket says 172.21.15.133:34992) 2021-01-03T13:03:09.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9adad9d700 1 -- 172.21.15.133:0/1854045647 learned_addr learned my addr 172.21.15.133:0/1854045647 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:09.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9ada59c700 1 --2- 172.21.15.133:0/1854045647 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9adc0b0670 0x7f9adc099d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:09.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9ad9d9b700 1 --2- 172.21.15.133:0/1854045647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9adc0b5c10 0x7f9adc1463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:09.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9adad9d700 1 -- 172.21.15.133:0/1854045647 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9adc0b0670 msgr2=0x7f9adc099d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:09.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9adad9d700 1 --2- 172.21.15.133:0/1854045647 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9adc0b0670 0x7f9adc099d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:09.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9adad9d700 1 -- 172.21.15.133:0/1854045647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9adc0b5c10 msgr2=0x7f9adc1463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:09.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9adad9d700 1 --2- 172.21.15.133:0/1854045647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9adc0b5c10 0x7f9adc1463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:09.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9adad9d700 1 -- 172.21.15.133:0/1854045647 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9adc15a030 con 0x7f9adc14acc0 2021-01-03T13:03:09.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9adad9d700 1 --2- 172.21.15.133:0/1854045647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9adc14acc0 0x7f9adc1468b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f9ad4006a50 tx=0x7f9ad4006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:09.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9ad37fe700 1 -- 172.21.15.133:0/1854045647 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ad400c7e0 con 0x7f9adc14acc0 2021-01-03T13:03:09.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9ad37fe700 1 -- 172.21.15.133:0/1854045647 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad400c940 con 0x7f9adc14acc0 2021-01-03T13:03:09.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9ae0a95700 1 -- 172.21.15.133:0/1854045647 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9adc0b35c0 con 0x7f9adc14acc0 2021-01-03T13:03:09.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9ad37fe700 1 -- 172.21.15.133:0/1854045647 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ad400cca0 con 0x7f9adc14acc0 2021-01-03T13:03:09.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.763+0000 7f9ae0a95700 1 -- 172.21.15.133:0/1854045647 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9adc159560 con 0x7f9adc14acc0 2021-01-03T13:03:09.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.767+0000 7f9ae0a95700 1 -- 172.21.15.133:0/1854045647 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9adc15a1c0 con 0x7f9adc14acc0 2021-01-03T13:03:09.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.767+0000 7f9ad37fe700 1 -- 172.21.15.133:0/1854045647 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9ad401c460 con 0x7f9adc14acc0 2021-01-03T13:03:09.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.767+0000 7f9ad37fe700 1 --2- 172.21.15.133:0/1854045647 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9ac0055440 0x7f9ac0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:09.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.767+0000 7f9ad37fe700 1 -- 172.21.15.133:0/1854045647 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9ad406df10 con 0x7f9adc14acc0 2021-01-03T13:03:09.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.767+0000 7f9ada59c700 1 --2- 172.21.15.133:0/1854045647 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9ac0055440 0x7f9ac0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:09.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.767+0000 7f9ada59c700 1 --2- 172.21.15.133:0/1854045647 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9ac0055440 0x7f9ac0057900 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f9ac400c000 tx=0x7f9ac4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:09.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.775+0000 7f9ad37fe700 1 -- 172.21.15.133:0/1854045647 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9ad40444e0 con 0x7f9adc14acc0 2021-01-03T13:03:09.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.963+0000 7f9ae0a95700 1 -- 172.21.15.133:0/1854045647 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9adc057300 con 0x7f9adc14acc0 2021-01-03T13:03:09.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.963+0000 7f9ad37fe700 1 -- 172.21.15.133:0/1854045647 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f9ad4047b00 con 0x7f9adc14acc0 2021-01-03T13:03:09.959 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:09.959 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:03:09.959 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2021-01-03T13:03:09.959 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:09.960 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2021-01-03T13:03:09.960 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Fflox9BxAA6coLDFV/FaQ/G/cvtonWgg==", 2021-01-03T13:03:09.960 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:09.960 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:03:09.960 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:09.961 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:09.961 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:09.961 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:09.961 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:09.961 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:09.962 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2021-01-03T13:03:09.962 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfrnWWFRAA3PHH/FJOvDozCChrb1T8Dg==", 2021-01-03T13:03:09.962 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:09.962 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:03:09.962 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:09.963 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:09.963 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:09.963 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:09.963 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:09.963 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:09.964 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2021-01-03T13:03:09.964 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfpPPLDxAAVvg80vLejYKDH485/L1gSQ==", 2021-01-03T13:03:09.964 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:09.964 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:03:09.964 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:09.965 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:09.965 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:09.965 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:09.965 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:09.966 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:09.966 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2021-01-03T13:03:09.966 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAnv/FfQ+CcDRAAUkTDLby5scMkNzxa0lVdAQ==", 2021-01-03T13:03:09.966 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:09.967 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:09.967 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:09.967 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:09.967 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:09.967 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:09.968 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:09.968 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2021-01-03T13:03:09.968 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApv/Ff1iilLhAAbK9hZmL772nNKAEJ4i+pkw==", 2021-01-03T13:03:09.968 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:09.968 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:09.969 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:09.969 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:09.969 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:09.969 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:09.969 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:09.970 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2021-01-03T13:03:09.970 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAsv/Ffmoe2FhAA1EbxU5yHncN+pbC/EX6d9A==", 2021-01-03T13:03:09.970 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:09.970 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:09.970 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:09.971 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:09.971 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:09.971 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:09.971 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:09.971 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2021-01-03T13:03:09.972 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAuv/FfJh/VORAAG9aCOh5s/2Lw+yN9hBFWLw==", 2021-01-03T13:03:09.972 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:09.972 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:09.972 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:09.972 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:09.973 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:09.973 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:09.973 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:09.973 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2021-01-03T13:03:09.973 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyv/Ffus0NJhAALX1TIqQ9EIupaX8KtRu7rQ==", 2021-01-03T13:03:09.973 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:09.974 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:09.974 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:09.974 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:09.974 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:09.975 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:09.975 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:09.975 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2021-01-03T13:03:09.975 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1v/FfoL6kDBAAggoRy/o0qas/41yLYqDVgA==", 2021-01-03T13:03:09.975 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:09.975 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:09.976 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:09.976 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:09.976 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:09.976 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:09.976 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:09.977 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2021-01-03T13:03:09.977 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA3v/FfwOPCMBAAGOt8ShPQ/szNbCfaP/uZEQ==", 2021-01-03T13:03:09.977 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:09.977 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:09.977 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:09.978 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:09.978 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:09.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:09.978 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:09.978 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2021-01-03T13:03:09.979 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA6v/Ffoz5xFxAAn3xvUDSeNSWrBJTa1Nsb6w==", 2021-01-03T13:03:09.979 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:09.979 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:09.979 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:09.979 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:09.980 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:09.980 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:09.980 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:09.980 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2021-01-03T13:03:09.980 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfyGlbGxAALm0NezvPiTAnlwu8iPEuCw==", 2021-01-03T13:03:09.981 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:09.981 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:03:09.981 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:03:09.981 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:03:09.981 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:09.982 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:09.982 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:09.982 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2021-01-03T13:03:09.982 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Ffa2AFHhAAD4Pq5zMJ28SqqEosBA9vnQ==", 2021-01-03T13:03:09.983 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:09.983 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:03:09.983 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:03:09.983 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:03:09.983 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:09.983 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:09.984 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:09.984 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2021-01-03T13:03:09.984 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjv/FfjxN8JxAAkV2Ia66fh21QYMX5fr1gTw==", 2021-01-03T13:03:09.984 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:09.984 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:03:09.985 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:09.985 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:09.985 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:09.985 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:09.985 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:09.986 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:09.986 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2021-01-03T13:03:09.986 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAU/DBBAASi+hx05pZEsP+dV9iwbz4g==", 2021-01-03T13:03:09.986 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:09.986 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:03:09.987 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:03:09.987 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:09.987 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:09.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:09.987 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:09.988 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2021-01-03T13:03:09.988 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAOFAAhAAPQOSkofyJoEYvcAqKK2+Mg==", 2021-01-03T13:03:09.988 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:09.988 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:03:09.988 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:03:09.989 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:09.989 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:09.989 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:09.989 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:09.989 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:03:09.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.963+0000 7f9ae0a95700 1 -- 172.21.15.133:0/1854045647 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9ac0055440 msgr2=0x7f9ac0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:09.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.963+0000 7f9ae0a95700 1 --2- 172.21.15.133:0/1854045647 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9ac0055440 0x7f9ac0057900 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f9ac400c000 tx=0x7f9ac4008040).stop 2021-01-03T13:03:09.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.963+0000 7f9ae0a95700 1 -- 172.21.15.133:0/1854045647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9adc14acc0 msgr2=0x7f9adc1468b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.963+0000 7f9ae0a95700 1 --2- 172.21.15.133:0/1854045647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9adc14acc0 0x7f9adc1468b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f9ad4006a50 tx=0x7f9ad4006dc0).stop 2021-01-03T13:03:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.963+0000 7f9ae0a95700 1 -- 172.21.15.133:0/1854045647 shutdown_connections 2021-01-03T13:03:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.963+0000 7f9ae0a95700 1 --2- 172.21.15.133:0/1854045647 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9ac0055440 0x7f9ac0057900 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.963+0000 7f9ae0a95700 1 --2- 172.21.15.133:0/1854045647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9adc14acc0 0x7f9adc1468b0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:09.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.963+0000 7f9ae0a95700 1 --2- 172.21.15.133:0/1854045647 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9adc0b0670 0x7f9adc099d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:09.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.963+0000 7f9ae0a95700 1 --2- 172.21.15.133:0/1854045647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9adc0b5c10 0x7f9adc1463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:09.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.963+0000 7f9ae0a95700 1 -- 172.21.15.133:0/1854045647 >> 172.21.15.133:0/1854045647 conn(0x7f9adc05c8c0 msgr2=0x7f9adc0b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:09.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.963+0000 7f9ae0a95700 1 -- 172.21.15.133:0/1854045647 shutdown_connections 2021-01-03T13:03:09.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:09.963+0000 7f9ae0a95700 1 -- 172.21.15.133:0/1854045647 wait complete. 2021-01-03T13:03:09.994 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:03:10.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebf59e700 1 Processor -- start 2021-01-03T13:03:10.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebf59e700 1 -- start start 2021-01-03T13:03:10.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebf59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ec005fd10 0x7f4ec005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:10.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebf59e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec00b6cf0 con 0x7f4ec00b4c20 2021-01-03T13:03:10.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebf59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec005bf00 con 0x7f4ec0060510 2021-01-03T13:03:10.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebf59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec005c1a0 con 0x7f4ec005fd10 2021-01-03T13:03:10.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebdd9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4ec0060510 0x7f4ec00b65e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56028/0 (socket says 172.21.15.133:56028) 2021-01-03T13:03:10.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebdd9b700 1 -- 172.21.15.133:0/384855212 learned_addr learned my addr 172.21.15.133:0/384855212 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:10.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ec005fd10 0x7f4ec005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:10.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebd59a700 1 -- 172.21.15.133:0/384855212 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124615723 0 0) 0x7f4ec005bf00 con 0x7f4ec0060510 2021-01-03T13:03:10.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebd59a700 1 -- 172.21.15.133:0/384855212 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ea0003230 con 0x7f4ec0060510 2021-01-03T13:03:10.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebd59a700 1 -- 172.21.15.133:0/384855212 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048473621 0 0) 0x7f4ec00b6cf0 con 0x7f4ec00b4c20 2021-01-03T13:03:10.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebed9d700 1 -- 172.21.15.133:0/384855212 >> v1:172.21.15.133:6789/0 conn(0x7f4ec0060510 legacy=0x7f4ec00b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebed9d700 1 -- 172.21.15.133:0/384855212 >> v1:172.21.15.16:6789/0 conn(0x7f4ec00b4c20 legacy=0x7f4ec00b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebed9d700 1 -- 172.21.15.133:0/384855212 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec005c440 con 0x7f4ec005fd10 2021-01-03T13:03:10.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebed9d700 1 --2- 172.21.15.133:0/384855212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ec005fd10 0x7f4ec005c8e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f4eb0001bf0 tx=0x7f4eb8006dc0).ready entity=mon.1 client_cookie=7d8ac972cf35dd43 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:10.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebd59a700 1 -- 172.21.15.133:0/384855212 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4eb0001a50 con 0x7f4ec005fd10 2021-01-03T13:03:10.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebd59a700 1 -- 172.21.15.133:0/384855212 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb8009670 con 0x7f4ec005fd10 2021-01-03T13:03:10.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebd59a700 1 -- 172.21.15.133:0/384855212 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4eb80097e0 con 0x7f4ec005fd10 2021-01-03T13:03:10.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebf59e700 1 -- 172.21.15.133:0/384855212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ec005fd10 msgr2=0x7f4ec005c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.107+0000 7f4ebf59e700 1 --2- 172.21.15.133:0/384855212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ec005fd10 0x7f4ec005c8e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f4eb0001bf0 tx=0x7f4eb8006dc0).stop 2021-01-03T13:03:10.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.111+0000 7f4ebf59e700 1 -- 172.21.15.133:0/384855212 shutdown_connections 2021-01-03T13:03:10.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.111+0000 7f4ebf59e700 1 --2- 172.21.15.133:0/384855212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ec005fd10 0x7f4ec005c8e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.111+0000 7f4ebf59e700 1 -- 172.21.15.133:0/384855212 >> 172.21.15.133:0/384855212 conn(0x7f4ec00b9f00 msgr2=0x7f4ec00b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:10.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.111+0000 7f4ebf59e700 1 -- 172.21.15.133:0/384855212 shutdown_connections 2021-01-03T13:03:10.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.111+0000 7f4ebf59e700 1 -- 172.21.15.133:0/384855212 wait complete. 2021-01-03T13:03:10.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.111+0000 7f4ebf59e700 1 Processor -- start 2021-01-03T13:03:10.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.111+0000 7f4ebf59e700 1 -- start start 2021-01-03T13:03:10.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebf59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ec005fd10 0x7f4ec009e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:10.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebf59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ec0060510 0x7f4ec0154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:10.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebf59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ec00b4c20 0x7f4ec0155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:10.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebf59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec0155780 con 0x7f4ec00b4c20 2021-01-03T13:03:10.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebf59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec0143320 con 0x7f4ec005fd10 2021-01-03T13:03:10.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebf59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec01463b0 con 0x7f4ec0060510 2021-01-03T13:03:10.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebe59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ec005fd10 0x7f4ec009e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:10.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebe59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ec005fd10 0x7f4ec009e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35002/0 (socket says 172.21.15.133:35002) 2021-01-03T13:03:10.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebe59c700 1 -- 172.21.15.133:0/4044191272 learned_addr learned my addr 172.21.15.133:0/4044191272 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:10.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebed9d700 1 --2- 172.21.15.133:0/4044191272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ec00b4c20 0x7f4ec0155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:10.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebdd9b700 1 --2- 172.21.15.133:0/4044191272 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ec0060510 0x7f4ec0154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:10.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebe59c700 1 -- 172.21.15.133:0/4044191272 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ec0060510 msgr2=0x7f4ec0154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebe59c700 1 --2- 172.21.15.133:0/4044191272 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ec0060510 0x7f4ec0154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebe59c700 1 -- 172.21.15.133:0/4044191272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ec00b4c20 msgr2=0x7f4ec0155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebe59c700 1 --2- 172.21.15.133:0/4044191272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ec00b4c20 0x7f4ec0155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebe59c700 1 -- 172.21.15.133:0/4044191272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec0146650 con 0x7f4ec005fd10 2021-01-03T13:03:10.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebed9d700 1 --2- 172.21.15.133:0/4044191272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ec00b4c20 0x7f4ec0155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:03:10.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebdd9b700 1 --2- 172.21.15.133:0/4044191272 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ec0060510 0x7f4ec0154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:03:10.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebe59c700 1 --2- 172.21.15.133:0/4044191272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ec005fd10 0x7f4ec009e6e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f4ea8000b80 tx=0x7f4ea8007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:10.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4eb77fe700 1 -- 172.21.15.133:0/4044191272 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ea800e4a0 con 0x7f4ec005fd10 2021-01-03T13:03:10.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4eb77fe700 1 -- 172.21.15.133:0/4044191272 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea800e600 con 0x7f4ec005fd10 2021-01-03T13:03:10.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4eb77fe700 1 -- 172.21.15.133:0/4044191272 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ea800e960 con 0x7f4ec005fd10 2021-01-03T13:03:10.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebf59e700 1 -- 172.21.15.133:0/4044191272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec01468f0 con 0x7f4ec005fd10 2021-01-03T13:03:10.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebf59e700 1 -- 172.21.15.133:0/4044191272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec009f2a0 con 0x7f4ec005fd10 2021-01-03T13:03:10.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4ebf59e700 1 -- 172.21.15.133:0/4044191272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec0142450 con 0x7f4ec005fd10 2021-01-03T13:03:10.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.115+0000 7f4eb77fe700 1 -- 172.21.15.133:0/4044191272 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4ea8010030 con 0x7f4ec005fd10 2021-01-03T13:03:10.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.119+0000 7f4eb77fe700 1 --2- 172.21.15.133:0/4044191272 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4ea40554e0 0x7f4ea40579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:10.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.119+0000 7f4ebdd9b700 1 --2- 172.21.15.133:0/4044191272 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4ea40554e0 0x7f4ea40579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:10.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.119+0000 7f4eb77fe700 1 -- 172.21.15.133:0/4044191272 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f4ea806d680 con 0x7f4ec005fd10 2021-01-03T13:03:10.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.119+0000 7f4ebdd9b700 1 --2- 172.21.15.133:0/4044191272 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4ea40554e0 0x7f4ea40579a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f4eb0008000 tx=0x7f4eb0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:10.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.127+0000 7f4eb77fe700 1 -- 172.21.15.133:0/4044191272 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4ea8043cb0 con 0x7f4ec005fd10 2021-01-03T13:03:10.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.271+0000 7f4ebf59e700 1 -- 172.21.15.133:0/4044191272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ec0057300 con 0x7f4ec005fd10 2021-01-03T13:03:10.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.271+0000 7f4eb77fe700 1 -- 172.21.15.133:0/4044191272 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+13230 (secure 0 0 0) 0x7f4ea80472d0 con 0x7f4ec005fd10 2021-01-03T13:03:10.269 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:10.269 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":61,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:03:09.622549+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:03:10.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.275+0000 7f4ebf59e700 1 -- 172.21.15.133:0/4044191272 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4ea40554e0 msgr2=0x7f4ea40579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.275+0000 7f4ebf59e700 1 --2- 172.21.15.133:0/4044191272 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4ea40554e0 0x7f4ea40579a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f4eb0008000 tx=0x7f4eb0009040).stop 2021-01-03T13:03:10.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.275+0000 7f4ebf59e700 1 -- 172.21.15.133:0/4044191272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ec005fd10 msgr2=0x7f4ec009e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.275+0000 7f4ebf59e700 1 --2- 172.21.15.133:0/4044191272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ec005fd10 0x7f4ec009e6e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f4ea8000b80 tx=0x7f4ea8007c00).stop 2021-01-03T13:03:10.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.275+0000 7f4ebf59e700 1 -- 172.21.15.133:0/4044191272 shutdown_connections 2021-01-03T13:03:10.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.275+0000 7f4ebf59e700 1 --2- 172.21.15.133:0/4044191272 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4ea40554e0 0x7f4ea40579a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.275+0000 7f4ebf59e700 1 --2- 172.21.15.133:0/4044191272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ec00b4c20 0x7f4ec0155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.275+0000 7f4ebf59e700 1 --2- 172.21.15.133:0/4044191272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ec005fd10 0x7f4ec009e6e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.275+0000 7f4ebf59e700 1 --2- 172.21.15.133:0/4044191272 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ec0060510 0x7f4ec0154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.275+0000 7f4ebf59e700 1 -- 172.21.15.133:0/4044191272 >> 172.21.15.133:0/4044191272 conn(0x7f4ec00b9f00 msgr2=0x7f4ec00b5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:10.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.275+0000 7f4ebf59e700 1 -- 172.21.15.133:0/4044191272 shutdown_connections 2021-01-03T13:03:10.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.275+0000 7f4ebf59e700 1 -- 172.21.15.133:0/4044191272 wait complete. 2021-01-03T13:03:10.283 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-01-03T13:03:10.283 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:03:10.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.403+0000 7f247e9cb700 1 Processor -- start 2021-01-03T13:03:10.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.403+0000 7f247e9cb700 1 -- start start 2021-01-03T13:03:10.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247e9cb700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2478141620 0x7f247805bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:10.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247e9cb700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24780af5e0 con 0x7f24780af200 2021-01-03T13:03:10.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247e9cb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247805c4c0 con 0x7f2478144c60 2021-01-03T13:03:10.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247e9cb700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247805c2e0 con 0x7f2478141620 2021-01-03T13:03:10.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247d1c8700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2478144c60 0x7f24780ab0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56044/0 (socket says 172.21.15.133:56044) 2021-01-03T13:03:10.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247d1c8700 1 -- 172.21.15.133:0/369774037 learned_addr learned my addr 172.21.15.133:0/369774037 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:10.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247e1ca700 1 --2- 172.21.15.133:0/369774037 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2478141620 0x7f247805bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:10.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247c9c7700 1 -- 172.21.15.133:0/369774037 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241215334 0 0) 0x7f247805c4c0 con 0x7f2478144c60 2021-01-03T13:03:10.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247c9c7700 1 -- 172.21.15.133:0/369774037 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2464003230 con 0x7f2478144c60 2021-01-03T13:03:10.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247c9c7700 1 -- 172.21.15.133:0/369774037 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890496296 0 0) 0x7f24780af5e0 con 0x7f24780af200 2021-01-03T13:03:10.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247c9c7700 1 -- 172.21.15.133:0/369774037 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f247805c4c0 con 0x7f24780af200 2021-01-03T13:03:10.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247e1ca700 1 -- 172.21.15.133:0/369774037 >> v1:172.21.15.133:6789/0 conn(0x7f2478144c60 legacy=0x7f24780ab0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247e1ca700 1 -- 172.21.15.133:0/369774037 >> v1:172.21.15.16:6789/0 conn(0x7f24780af200 legacy=0x7f2478144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247e1ca700 1 -- 172.21.15.133:0/369774037 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247805c760 con 0x7f2478141620 2021-01-03T13:03:10.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247e1ca700 1 --2- 172.21.15.133:0/369774037 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2478141620 0x7f247805bdf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2470002f80 tx=0x7f2470006db0).ready entity=mon.2 client_cookie=f5f7311a17984df3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:10.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247c9c7700 1 -- 172.21.15.133:0/369774037 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2470000ea0 con 0x7f2478141620 2021-01-03T13:03:10.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247c9c7700 1 -- 172.21.15.133:0/369774037 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2470009730 con 0x7f2478141620 2021-01-03T13:03:10.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247c9c7700 1 -- 172.21.15.133:0/369774037 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2470009a90 con 0x7f2478141620 2021-01-03T13:03:10.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247e9cb700 1 -- 172.21.15.133:0/369774037 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2478141620 msgr2=0x7f247805bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.407+0000 7f247e9cb700 1 --2- 172.21.15.133:0/369774037 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2478141620 0x7f247805bdf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f2470002f80 tx=0x7f2470006db0).stop 2021-01-03T13:03:10.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.411+0000 7f247e9cb700 1 -- 172.21.15.133:0/369774037 shutdown_connections 2021-01-03T13:03:10.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.411+0000 7f247e9cb700 1 --2- 172.21.15.133:0/369774037 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2478141620 0x7f247805bdf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.411+0000 7f247e9cb700 1 -- 172.21.15.133:0/369774037 >> 172.21.15.133:0/369774037 conn(0x7f247806b050 msgr2=0x7f2478060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:10.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.411+0000 7f247e9cb700 1 -- 172.21.15.133:0/369774037 shutdown_connections 2021-01-03T13:03:10.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.411+0000 7f247e9cb700 1 -- 172.21.15.133:0/369774037 wait complete. 2021-01-03T13:03:10.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.411+0000 7f247e9cb700 1 Processor -- start 2021-01-03T13:03:10.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.411+0000 7f247e9cb700 1 -- start start 2021-01-03T13:03:10.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e9cb700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24780af200 0x7f2478146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e9cb700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2478141620 0x7f2478064de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e9cb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2478144c60 0x7f24780652d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e9cb700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24780b5520 con 0x7f2478141620 2021-01-03T13:03:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e9cb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24780b6000 con 0x7f2478144c60 2021-01-03T13:03:10.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e9cb700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24780b62a0 con 0x7f24780af200 2021-01-03T13:03:10.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e1ca700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2478144c60 0x7f24780652d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:10.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e1ca700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2478144c60 0x7f24780652d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35020/0 (socket says 172.21.15.133:35020) 2021-01-03T13:03:10.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e1ca700 1 -- 172.21.15.133:0/3888426998 learned_addr learned my addr 172.21.15.133:0/3888426998 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:10.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247d1c8700 1 --2- 172.21.15.133:0/3888426998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2478141620 0x7f2478064de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:10.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247d9c9700 1 --2- 172.21.15.133:0/3888426998 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24780af200 0x7f2478146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:10.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e1ca700 1 -- 172.21.15.133:0/3888426998 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24780af200 msgr2=0x7f2478146810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e1ca700 1 --2- 172.21.15.133:0/3888426998 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24780af200 0x7f2478146810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e1ca700 1 -- 172.21.15.133:0/3888426998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2478141620 msgr2=0x7f2478064de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e1ca700 1 --2- 172.21.15.133:0/3888426998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2478141620 0x7f2478064de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e1ca700 1 -- 172.21.15.133:0/3888426998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24780b6540 con 0x7f2478144c60 2021-01-03T13:03:10.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247d9c9700 1 --2- 172.21.15.133:0/3888426998 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24780af200 0x7f2478146810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:10.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247d1c8700 1 --2- 172.21.15.133:0/3888426998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2478141620 0x7f2478064de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:10.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e1ca700 1 --2- 172.21.15.133:0/3888426998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2478144c60 0x7f24780652d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f2470002f80 tx=0x7f2470015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f2476ffd700 1 -- 172.21.15.133:0/3888426998 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2470011c60 con 0x7f2478144c60 2021-01-03T13:03:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f2476ffd700 1 -- 172.21.15.133:0/3888426998 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2470011dc0 con 0x7f2478144c60 2021-01-03T13:03:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f2476ffd700 1 -- 172.21.15.133:0/3888426998 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2470006220 con 0x7f2478144c60 2021-01-03T13:03:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e9cb700 1 -- 172.21.15.133:0/3888426998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2478063a10 con 0x7f2478144c60 2021-01-03T13:03:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e9cb700 1 -- 172.21.15.133:0/3888426998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24780b5010 con 0x7f2478144c60 2021-01-03T13:03:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.415+0000 7f247e9cb700 1 -- 172.21.15.133:0/3888426998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2478057300 con 0x7f2478144c60 2021-01-03T13:03:10.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.419+0000 7f2476ffd700 1 -- 172.21.15.133:0/3888426998 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f247000f070 con 0x7f2478144c60 2021-01-03T13:03:10.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.419+0000 7f2476ffd700 1 --2- 172.21.15.133:0/3888426998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2458055440 0x7f2458057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:10.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.419+0000 7f2476ffd700 1 -- 172.21.15.133:0/3888426998 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f247006e770 con 0x7f2478144c60 2021-01-03T13:03:10.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.419+0000 7f247d9c9700 1 --2- 172.21.15.133:0/3888426998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2458055440 0x7f2458057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:10.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.419+0000 7f247d9c9700 1 --2- 172.21.15.133:0/3888426998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2458055440 0x7f2458057900 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f246800b000 tx=0x7f2468009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.423+0000 7f2476ffd700 1 -- 172.21.15.133:0/3888426998 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2470044da0 con 0x7f2478144c60 2021-01-03T13:03:10.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.563+0000 7f247e9cb700 1 -- 172.21.15.133:0/3888426998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f247805f080 con 0x7f2478144c60 2021-01-03T13:03:10.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.567+0000 7f2476ffd700 1 -- 172.21.15.133:0/3888426998 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v61) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2470022020 con 0x7f2478144c60 2021-01-03T13:03:10.562 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:03:10.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.567+0000 7f247e9cb700 1 -- 172.21.15.133:0/3888426998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2458055440 msgr2=0x7f2458057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.567+0000 7f247e9cb700 1 --2- 172.21.15.133:0/3888426998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2458055440 0x7f2458057900 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f246800b000 tx=0x7f2468009040).stop 2021-01-03T13:03:10.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.567+0000 7f247e9cb700 1 -- 172.21.15.133:0/3888426998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2478144c60 msgr2=0x7f24780652d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.567+0000 7f247e9cb700 1 --2- 172.21.15.133:0/3888426998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2478144c60 0x7f24780652d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f2470002f80 tx=0x7f2470015000).stop 2021-01-03T13:03:10.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.567+0000 7f247e9cb700 1 -- 172.21.15.133:0/3888426998 shutdown_connections 2021-01-03T13:03:10.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.567+0000 7f247e9cb700 1 --2- 172.21.15.133:0/3888426998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2458055440 0x7f2458057900 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.567+0000 7f247e9cb700 1 --2- 172.21.15.133:0/3888426998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2478144c60 0x7f24780652d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.567+0000 7f247e9cb700 1 --2- 172.21.15.133:0/3888426998 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24780af200 0x7f2478146810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.567+0000 7f247e9cb700 1 --2- 172.21.15.133:0/3888426998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2478141620 0x7f2478064de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.567+0000 7f247e9cb700 1 -- 172.21.15.133:0/3888426998 >> 172.21.15.133:0/3888426998 conn(0x7f247806b050 msgr2=0x7f2478141e40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:10.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.567+0000 7f247e9cb700 1 -- 172.21.15.133:0/3888426998 shutdown_connections 2021-01-03T13:03:10.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.567+0000 7f247e9cb700 1 -- 172.21.15.133:0/3888426998 wait complete. 2021-01-03T13:03:10.575 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:03:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.699+0000 7fef8941d700 1 Processor -- start 2021-01-03T13:03:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.699+0000 7fef8941d700 1 -- start start 2021-01-03T13:03:10.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef8941d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef840b02b0 0x7fef840668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:10.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef8941d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8405c510 con 0x7fef8405c130 2021-01-03T13:03:10.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef8941d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef840b15a0 con 0x7fef840622f0 2021-01-03T13:03:10.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef8941d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef841473d0 con 0x7fef840b02b0 2021-01-03T13:03:10.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef88c1c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fef840622f0 0x7fef84066d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56060/0 (socket says 172.21.15.133:56060) 2021-01-03T13:03:10.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef88c1c700 1 -- 172.21.15.133:0/3213270329 learned_addr learned my addr 172.21.15.133:0/3213270329 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:10.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef7b7fe700 1 --2- 172.21.15.133:0/3213270329 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef840b02b0 0x7fef840668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:10.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef837fe700 1 -- 172.21.15.133:0/3213270329 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691917764 0 0) 0x7fef840b15a0 con 0x7fef840622f0 2021-01-03T13:03:10.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef837fe700 1 -- 172.21.15.133:0/3213270329 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef64003230 con 0x7fef840622f0 2021-01-03T13:03:10.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef837fe700 1 -- 172.21.15.133:0/3213270329 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226988736 0 0) 0x7fef8405c510 con 0x7fef8405c130 2021-01-03T13:03:10.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef837fe700 1 -- 172.21.15.133:0/3213270329 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef840b15a0 con 0x7fef8405c130 2021-01-03T13:03:10.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef7b7fe700 1 -- 172.21.15.133:0/3213270329 >> v1:172.21.15.133:6789/0 conn(0x7fef840622f0 legacy=0x7fef84066d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef7b7fe700 1 -- 172.21.15.133:0/3213270329 >> v1:172.21.15.16:6789/0 conn(0x7fef8405c130 legacy=0x7fef840b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef7b7fe700 1 -- 172.21.15.133:0/3213270329 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef84061920 con 0x7fef840b02b0 2021-01-03T13:03:10.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef7b7fe700 1 --2- 172.21.15.133:0/3213270329 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef840b02b0 0x7fef840668a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fef6c002f30 tx=0x7fef6c006dc0).ready entity=mon.2 client_cookie=d77bd6ea28c98ccf server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:10.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef837fe700 1 -- 172.21.15.133:0/3213270329 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef6c009730 con 0x7fef840b02b0 2021-01-03T13:03:10.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef837fe700 1 -- 172.21.15.133:0/3213270329 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c009890 con 0x7fef840b02b0 2021-01-03T13:03:10.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef837fe700 1 -- 172.21.15.133:0/3213270329 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef6c009bf0 con 0x7fef840b02b0 2021-01-03T13:03:10.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef8941d700 1 -- 172.21.15.133:0/3213270329 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef840b02b0 msgr2=0x7fef840668a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef8941d700 1 --2- 172.21.15.133:0/3213270329 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef840b02b0 0x7fef840668a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fef6c002f30 tx=0x7fef6c006dc0).stop 2021-01-03T13:03:10.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef8941d700 1 -- 172.21.15.133:0/3213270329 shutdown_connections 2021-01-03T13:03:10.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef8941d700 1 --2- 172.21.15.133:0/3213270329 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef840b02b0 0x7fef840668a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef8941d700 1 -- 172.21.15.133:0/3213270329 >> 172.21.15.133:0/3213270329 conn(0x7fef840b6110 msgr2=0x7fef840b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:10.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef8941d700 1 -- 172.21.15.133:0/3213270329 shutdown_connections 2021-01-03T13:03:10.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.703+0000 7fef8941d700 1 -- 172.21.15.133:0/3213270329 wait complete. 2021-01-03T13:03:10.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.707+0000 7fef8941d700 1 Processor -- start 2021-01-03T13:03:10.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.707+0000 7fef8941d700 1 -- start start 2021-01-03T13:03:10.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.707+0000 7fef8941d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef8405c130 0x7fef840640b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:10.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.707+0000 7fef8941d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef840622f0 0x7fef84141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:10.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.707+0000 7fef8941d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef840b02b0 0x7fef8413e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:10.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.707+0000 7fef8941d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef84155490 con 0x7fef840622f0 2021-01-03T13:03:10.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.707+0000 7fef8941d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef84155730 con 0x7fef840b02b0 2021-01-03T13:03:10.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.707+0000 7fef8941d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef841559d0 con 0x7fef8405c130 2021-01-03T13:03:10.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef88c1c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef840b02b0 0x7fef8413e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:10.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef7b7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef840622f0 0x7fef84141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:10.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef88c1c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef840b02b0 0x7fef8413e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35034/0 (socket says 172.21.15.133:35034) 2021-01-03T13:03:10.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef7b7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef840622f0 0x7fef84141a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:33572/0 (socket says 172.21.15.133:33572) 2021-01-03T13:03:10.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef88c1c700 1 -- 172.21.15.133:0/475375858 learned_addr learned my addr 172.21.15.133:0/475375858 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:10.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef83fff700 1 --2- 172.21.15.133:0/475375858 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef8405c130 0x7fef840640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:10.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef7b7fe700 1 -- 172.21.15.133:0/475375858 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef8405c130 msgr2=0x7fef840640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef7b7fe700 1 --2- 172.21.15.133:0/475375858 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef8405c130 0x7fef840640b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef7b7fe700 1 -- 172.21.15.133:0/475375858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef840b02b0 msgr2=0x7fef8413e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef7b7fe700 1 --2- 172.21.15.133:0/475375858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef840b02b0 0x7fef8413e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef7b7fe700 1 -- 172.21.15.133:0/475375858 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef84155c70 con 0x7fef840622f0 2021-01-03T13:03:10.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef7b7fe700 1 --2- 172.21.15.133:0/475375858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef840622f0 0x7fef84141a70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fef6c002f30 tx=0x7fef6c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:10.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef81ffb700 1 -- 172.21.15.133:0/475375858 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef6c011ac0 con 0x7fef840622f0 2021-01-03T13:03:10.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef81ffb700 1 -- 172.21.15.133:0/475375858 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c011c20 con 0x7fef840622f0 2021-01-03T13:03:10.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef8941d700 1 -- 172.21.15.133:0/475375858 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef840acb90 con 0x7fef840622f0 2021-01-03T13:03:10.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef81ffb700 1 -- 172.21.15.133:0/475375858 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef6c01d450 con 0x7fef840622f0 2021-01-03T13:03:10.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef8941d700 1 -- 172.21.15.133:0/475375858 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef84155190 con 0x7fef840622f0 2021-01-03T13:03:10.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef8941d700 1 -- 172.21.15.133:0/475375858 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef84155e00 con 0x7fef840622f0 2021-01-03T13:03:10.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.711+0000 7fef81ffb700 1 -- 172.21.15.133:0/475375858 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fef6c024030 con 0x7fef840622f0 2021-01-03T13:03:10.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.715+0000 7fef81ffb700 1 --2- 172.21.15.133:0/475375858 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef680553b0 0x7fef68057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:10.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.715+0000 7fef81ffb700 1 -- 172.21.15.133:0/475375858 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fef6c06ecd0 con 0x7fef840622f0 2021-01-03T13:03:10.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.715+0000 7fef83fff700 1 --2- 172.21.15.133:0/475375858 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef680553b0 0x7fef68057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:10.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.715+0000 7fef83fff700 1 --2- 172.21.15.133:0/475375858 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef680553b0 0x7fef68057870 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fef7400d000 tx=0x7fef740079f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:10.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.723+0000 7fef81ffb700 1 -- 172.21.15.133:0/475375858 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fef6c074020 con 0x7fef840622f0 2021-01-03T13:03:10.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.863+0000 7fef8941d700 1 -- 172.21.15.133:0/475375858 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fef84057300 con 0x7fef840622f0 2021-01-03T13:03:10.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.863+0000 7fef81ffb700 1 -- 172.21.15.133:0/475375858 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v61) v1 ==== 92+0+10 (secure 0 0 0) 0x7fef6c0220a0 con 0x7fef840622f0 2021-01-03T13:03:10.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.863+0000 7fef8941d700 1 -- 172.21.15.133:0/475375858 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef680553b0 msgr2=0x7fef68057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.863+0000 7fef8941d700 1 --2- 172.21.15.133:0/475375858 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef680553b0 0x7fef68057870 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fef7400d000 tx=0x7fef740079f0).stop 2021-01-03T13:03:10.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.863+0000 7fef8941d700 1 -- 172.21.15.133:0/475375858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef840622f0 msgr2=0x7fef84141a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:10.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.863+0000 7fef8941d700 1 --2- 172.21.15.133:0/475375858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef840622f0 0x7fef84141a70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fef6c002f30 tx=0x7fef6c015000).stop 2021-01-03T13:03:10.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.863+0000 7fef8941d700 1 -- 172.21.15.133:0/475375858 shutdown_connections 2021-01-03T13:03:10.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.863+0000 7fef8941d700 1 --2- 172.21.15.133:0/475375858 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef680553b0 0x7fef68057870 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.863+0000 7fef8941d700 1 --2- 172.21.15.133:0/475375858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef840b02b0 0x7fef8413e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.867+0000 7fef8941d700 1 --2- 172.21.15.133:0/475375858 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef8405c130 0x7fef840640b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.867+0000 7fef8941d700 1 --2- 172.21.15.133:0/475375858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef840622f0 0x7fef84141a70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:10.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.867+0000 7fef8941d700 1 -- 172.21.15.133:0/475375858 >> 172.21.15.133:0/475375858 conn(0x7fef840b6110 msgr2=0x7fef840b5310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:10.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.867+0000 7fef8941d700 1 -- 172.21.15.133:0/475375858 shutdown_connections 2021-01-03T13:03:10.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:10.867+0000 7fef8941d700 1 -- 172.21.15.133:0/475375858 wait complete. 2021-01-03T13:03:10.921 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:03:10.921 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-01-03T13:03:11.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb359e700 1 Processor -- start 2021-01-03T13:03:11.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb359e700 1 -- start start 2021-01-03T13:03:11.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3cb405c130 0x7f3cb40b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:11.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb359e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3cb40622f0 0x7f3cb40b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:11.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb359e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb405c510 con 0x7f3cb40b02b0 2021-01-03T13:03:11.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb359e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb41473d0 con 0x7f3cb40622f0 2021-01-03T13:03:11.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb40b0ab0 con 0x7f3cb405c130 2021-01-03T13:03:11.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3cb405c130 0x7f3cb40b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:11.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3cb405c130 0x7f3cb40b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35038/0 (socket says 172.21.15.133:35038) 2021-01-03T13:03:11.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb259c700 1 -- 172.21.15.133:0/1777640259 learned_addr learned my addr 172.21.15.133:0/1777640259 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:11.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb2d9d700 1 --2- 172.21.15.133:0/1777640259 >> v2:172.21.15.16:3300/0 conn(0x7f3cb40622f0 0x7f3cb40b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:11.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb259c700 1 -- 172.21.15.133:0/1777640259 >> v2:172.21.15.16:3300/0 conn(0x7f3cb40622f0 msgr2=0x7f3cb40b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:11.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb259c700 1 --2- 172.21.15.133:0/1777640259 >> v2:172.21.15.16:3300/0 conn(0x7f3cb40622f0 0x7f3cb40b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:11.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb259c700 1 -- 172.21.15.133:0/1777640259 >> v1:172.21.15.16:6789/0 conn(0x7f3cb40b02b0 legacy=0x7f3cb40668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:11.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb259c700 1 -- 172.21.15.133:0/1777640259 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb40b15a0 con 0x7f3cb405c130 2021-01-03T13:03:11.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb2d9d700 1 --2- 172.21.15.133:0/1777640259 >> v2:172.21.15.16:3300/0 conn(0x7f3cb40622f0 0x7f3cb40b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:03:11.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb259c700 1 --2- 172.21.15.133:0/1777640259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cb405c130 0x7f3cb40b1a00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f3cb40b6cd0 tx=0x7f3ca4009270).ready entity=mon.1 client_cookie=28ff795f14f55fd0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:11.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb159a700 1 -- 172.21.15.133:0/1777640259 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ca400bbc0 con 0x7f3cb405c130 2021-01-03T13:03:11.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb159a700 1 -- 172.21.15.133:0/1777640259 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca400bd20 con 0x7f3cb405c130 2021-01-03T13:03:11.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb359e700 1 -- 172.21.15.133:0/1777640259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cb405c130 msgr2=0x7f3cb40b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:11.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb159a700 1 -- 172.21.15.133:0/1777640259 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ca4011400 con 0x7f3cb405c130 2021-01-03T13:03:11.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.035+0000 7f3cb359e700 1 --2- 172.21.15.133:0/1777640259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cb405c130 0x7f3cb40b1a00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f3cb40b6cd0 tx=0x7f3ca4009270).stop 2021-01-03T13:03:11.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb359e700 1 -- 172.21.15.133:0/1777640259 shutdown_connections 2021-01-03T13:03:11.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb359e700 1 --2- 172.21.15.133:0/1777640259 >> v2:172.21.15.16:3300/0 conn(0x7f3cb40622f0 0x7f3cb40b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:11.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb359e700 1 --2- 172.21.15.133:0/1777640259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cb405c130 0x7f3cb40b1a00 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:11.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb359e700 1 -- 172.21.15.133:0/1777640259 >> 172.21.15.133:0/1777640259 conn(0x7f3cb40b6110 msgr2=0x7f3cb40b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:11.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb359e700 1 -- 172.21.15.133:0/1777640259 shutdown_connections 2021-01-03T13:03:11.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb359e700 1 -- 172.21.15.133:0/1777640259 wait complete. 2021-01-03T13:03:11.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb359e700 1 Processor -- start 2021-01-03T13:03:11.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb359e700 1 -- start start 2021-01-03T13:03:11.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cb405c130 0x7f3cb4155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:11.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cb40622f0 0x7f3cb41440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:11.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3cb40b02b0 0x7f3cb4065660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:11.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb359e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb4155ab0 con 0x7f3cb405c130 2021-01-03T13:03:11.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb4155d50 con 0x7f3cb40622f0 2021-01-03T13:03:11.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb4155ff0 con 0x7f3cb40b02b0 2021-01-03T13:03:11.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cb40622f0 0x7f3cb41440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:11.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb259c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cb405c130 0x7f3cb4155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:11.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cb40622f0 0x7f3cb41440b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35046/0 (socket says 172.21.15.133:35046) 2021-01-03T13:03:11.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb1d9b700 1 -- 172.21.15.133:0/503765177 learned_addr learned my addr 172.21.15.133:0/503765177 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:11.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb2d9d700 1 --2- 172.21.15.133:0/503765177 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3cb40b02b0 0x7f3cb4065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:11.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb1d9b700 1 -- 172.21.15.133:0/503765177 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3cb40b02b0 msgr2=0x7f3cb4065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:11.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb1d9b700 1 --2- 172.21.15.133:0/503765177 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3cb40b02b0 0x7f3cb4065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:11.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb1d9b700 1 -- 172.21.15.133:0/503765177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cb405c130 msgr2=0x7f3cb4155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:11.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb1d9b700 1 --2- 172.21.15.133:0/503765177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cb405c130 0x7f3cb4155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:11.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb1d9b700 1 -- 172.21.15.133:0/503765177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb40651c0 con 0x7f3cb40622f0 2021-01-03T13:03:11.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.039+0000 7f3cb1d9b700 1 --2- 172.21.15.133:0/503765177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cb40622f0 0x7f3cb41440b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f3ca8002ef0 tx=0x7f3ca8006d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:11.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.043+0000 7f3ca37fe700 1 -- 172.21.15.133:0/503765177 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ca8002320 con 0x7f3cb40622f0 2021-01-03T13:03:11.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.043+0000 7f3ca37fe700 1 -- 172.21.15.133:0/503765177 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca8000e90 con 0x7f3cb40622f0 2021-01-03T13:03:11.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.043+0000 7f3cb359e700 1 -- 172.21.15.133:0/503765177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb4145aa0 con 0x7f3cb40622f0 2021-01-03T13:03:11.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.043+0000 7f3ca37fe700 1 -- 172.21.15.133:0/503765177 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ca8002670 con 0x7f3cb40622f0 2021-01-03T13:03:11.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.043+0000 7f3cb359e700 1 -- 172.21.15.133:0/503765177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb4065b50 con 0x7f3cb40622f0 2021-01-03T13:03:11.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.043+0000 7f3cb359e700 1 -- 172.21.15.133:0/503765177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb4065350 con 0x7f3cb40622f0 2021-01-03T13:03:11.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.043+0000 7f3ca37fe700 1 -- 172.21.15.133:0/503765177 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3ca800f030 con 0x7f3cb40622f0 2021-01-03T13:03:11.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.043+0000 7f3ca37fe700 1 --2- 172.21.15.133:0/503765177 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3c900553b0 0x7f3c90057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:11.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.043+0000 7f3ca37fe700 1 -- 172.21.15.133:0/503765177 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3ca806d700 con 0x7f3cb40622f0 2021-01-03T13:03:11.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.043+0000 7f3cb259c700 1 --2- 172.21.15.133:0/503765177 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3c900553b0 0x7f3c90057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:11.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.043+0000 7f3cb259c700 1 --2- 172.21.15.133:0/503765177 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3c900553b0 0x7f3c90057870 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f3ca401a000 tx=0x7f3ca4016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:11.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.055+0000 7f3ca37fe700 1 -- 172.21.15.133:0/503765177 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3ca8043d30 con 0x7f3cb40622f0 2021-01-03T13:03:11.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.195+0000 7f3cb359e700 1 -- 172.21.15.133:0/503765177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3cb4057300 con 0x7f3cb40622f0 2021-01-03T13:03:11.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.195+0000 7f3ca37fe700 1 -- 172.21.15.133:0/503765177 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) v1 ==== 84+0+143 (secure 0 0 0) 0x7f3ca8047350 con 0x7f3cb40622f0 2021-01-03T13:03:11.193 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:11.193 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2021-01-03T13:03:11.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:11.194 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2021-01-03T13:03:11.194 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2021-01-03T13:03:11.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:11.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:11.195 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2021-01-03T13:03:11.195 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2021-01-03T13:03:11.195 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:11.196 INFO:teuthology.orchestra.run.smithi133.stdout:] 2021-01-03T13:03:11.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.199+0000 7f3cb359e700 1 -- 172.21.15.133:0/503765177 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3c900553b0 msgr2=0x7f3c90057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:11.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.199+0000 7f3cb359e700 1 --2- 172.21.15.133:0/503765177 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3c900553b0 0x7f3c90057870 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f3ca401a000 tx=0x7f3ca4016000).stop 2021-01-03T13:03:11.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.199+0000 7f3cb359e700 1 -- 172.21.15.133:0/503765177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cb40622f0 msgr2=0x7f3cb41440b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:11.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.199+0000 7f3cb359e700 1 --2- 172.21.15.133:0/503765177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cb40622f0 0x7f3cb41440b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f3ca8002ef0 tx=0x7f3ca8006d10).stop 2021-01-03T13:03:11.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.199+0000 7f3cb359e700 1 -- 172.21.15.133:0/503765177 shutdown_connections 2021-01-03T13:03:11.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.199+0000 7f3cb359e700 1 --2- 172.21.15.133:0/503765177 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3c900553b0 0x7f3c90057870 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:11.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.199+0000 7f3cb359e700 1 --2- 172.21.15.133:0/503765177 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3cb405c130 0x7f3cb4155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:11.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.199+0000 7f3cb359e700 1 --2- 172.21.15.133:0/503765177 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3cb40b02b0 0x7f3cb4065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:11.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.199+0000 7f3cb359e700 1 --2- 172.21.15.133:0/503765177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cb40622f0 0x7f3cb41440b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:11.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.199+0000 7f3cb359e700 1 -- 172.21.15.133:0/503765177 >> 172.21.15.133:0/503765177 conn(0x7f3cb40b6110 msgr2=0x7f3cb40b55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:11.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.199+0000 7f3cb359e700 1 -- 172.21.15.133:0/503765177 shutdown_connections 2021-01-03T13:03:11.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.199+0000 7f3cb359e700 1 -- 172.21.15.133:0/503765177 wait complete. 2021-01-03T13:03:11.211 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-01-03T13:03:11.212 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-01-03T13:03:11.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.335+0000 7fbaa9809700 1 Processor -- start 2021-01-03T13:03:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.335+0000 7fbaa9809700 1 -- start start 2021-01-03T13:03:11.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa9809700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbaa40b6a10 0x7fbaa40b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:11.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa9809700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbaa414b370 0x7fbaa4144390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:11.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa9809700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbaa40601f0 0x7fbaa4147120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:11.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa9809700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa414a6f0 con 0x7fbaa414b370 2021-01-03T13:03:11.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa9809700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa414a990 con 0x7fbaa40b6a10 2021-01-03T13:03:11.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa9809700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa414ac30 con 0x7fbaa40601f0 2021-01-03T13:03:11.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbaa40b6a10 0x7fbaa40b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:11.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa27fc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbaa414b370 0x7fbaa4144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:11.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbaa40b6a10 0x7fbaa40b6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35056/0 (socket says 172.21.15.133:35056) 2021-01-03T13:03:11.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa2ffd700 1 -- 172.21.15.133:0/2083434438 learned_addr learned my addr 172.21.15.133:0/2083434438 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:11.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa37fe700 1 --2- 172.21.15.133:0/2083434438 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbaa40601f0 0x7fbaa4147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa2ffd700 1 -- 172.21.15.133:0/2083434438 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbaa40601f0 msgr2=0x7fbaa4147120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa2ffd700 1 --2- 172.21.15.133:0/2083434438 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbaa40601f0 0x7fbaa4147120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa2ffd700 1 -- 172.21.15.133:0/2083434438 >> v2:172.21.15.16:3300/0 conn(0x7fbaa414b370 msgr2=0x7fbaa4144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa2ffd700 1 --2- 172.21.15.133:0/2083434438 >> v2:172.21.15.16:3300/0 conn(0x7fbaa414b370 0x7fbaa4144390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa2ffd700 1 -- 172.21.15.133:0/2083434438 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa414aed0 con 0x7fbaa40b6a10 2021-01-03T13:03:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa2ffd700 1 --2- 172.21.15.133:0/2083434438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaa40b6a10 0x7fbaa40b6df0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fba9c0032b0 tx=0x7fba9c009270).ready entity=mon.1 client_cookie=5ac71cf0a15f1461 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa1ffb700 1 -- 172.21.15.133:0/2083434438 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba9c009e60 con 0x7fbaa40b6a10 2021-01-03T13:03:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa1ffb700 1 -- 172.21.15.133:0/2083434438 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c00bb50 con 0x7fbaa40b6a10 2021-01-03T13:03:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa1ffb700 1 -- 172.21.15.133:0/2083434438 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba9c00bcc0 con 0x7fbaa40b6a10 2021-01-03T13:03:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa9809700 1 -- 172.21.15.133:0/2083434438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaa40b6a10 msgr2=0x7fbaa40b6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa9809700 1 --2- 172.21.15.133:0/2083434438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaa40b6a10 0x7fbaa40b6df0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fba9c0032b0 tx=0x7fba9c009270).stop 2021-01-03T13:03:11.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa9809700 1 -- 172.21.15.133:0/2083434438 shutdown_connections 2021-01-03T13:03:11.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa9809700 1 --2- 172.21.15.133:0/2083434438 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbaa40601f0 0x7fbaa4147120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:11.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa9809700 1 --2- 172.21.15.133:0/2083434438 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaa40b6a10 0x7fbaa40b6df0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:11.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa9809700 1 --2- 172.21.15.133:0/2083434438 >> v2:172.21.15.16:3300/0 conn(0x7fbaa414b370 0x7fbaa4144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:11.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa9809700 1 -- 172.21.15.133:0/2083434438 >> 172.21.15.133:0/2083434438 conn(0x7fbaa40622f0 msgr2=0x7fbaa40b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:11.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa9809700 1 -- 172.21.15.133:0/2083434438 shutdown_connections 2021-01-03T13:03:11.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.339+0000 7fbaa9809700 1 -- 172.21.15.133:0/2083434438 wait complete. 2021-01-03T13:03:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa9809700 1 Processor -- start 2021-01-03T13:03:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa9809700 1 -- start start 2021-01-03T13:03:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa9809700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaa40601f0 0x7fbaa40b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa9809700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbaa40b6a10 0x7fbaa4156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:11.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa9809700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbaa414b370 0x7fbaa4156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:11.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa9809700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4148aa0 con 0x7fbaa40b6a10 2021-01-03T13:03:11.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa9809700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa41424e0 con 0x7fbaa40601f0 2021-01-03T13:03:11.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa9809700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4156c10 con 0x7fbaa414b370 2021-01-03T13:03:11.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaa40601f0 0x7fbaa40b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:11.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaa40601f0 0x7fbaa40b0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35058/0 (socket says 172.21.15.133:35058) 2021-01-03T13:03:11.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa2ffd700 1 -- 172.21.15.133:0/614196082 learned_addr learned my addr 172.21.15.133:0/614196082 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:11.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa27fc700 1 --2- 172.21.15.133:0/614196082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbaa40b6a10 0x7fbaa4156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:11.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa37fe700 1 --2- 172.21.15.133:0/614196082 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbaa414b370 0x7fbaa4156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:11.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa2ffd700 1 -- 172.21.15.133:0/614196082 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbaa414b370 msgr2=0x7fbaa4156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:11.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa2ffd700 1 --2- 172.21.15.133:0/614196082 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbaa414b370 0x7fbaa4156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:11.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa2ffd700 1 -- 172.21.15.133:0/614196082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbaa40b6a10 msgr2=0x7fbaa4156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa2ffd700 1 --2- 172.21.15.133:0/614196082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbaa40b6a10 0x7fbaa4156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa2ffd700 1 -- 172.21.15.133:0/614196082 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa415a330 con 0x7fbaa40601f0 2021-01-03T13:03:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa37fe700 1 --2- 172.21.15.133:0/614196082 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbaa414b370 0x7fbaa4156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:03:11.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa2ffd700 1 --2- 172.21.15.133:0/614196082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaa40601f0 0x7fbaa40b0110 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fbaa4148be0 tx=0x7fba9c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fba9bfff700 1 -- 172.21.15.133:0/614196082 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba9c01f670 con 0x7fbaa40601f0 2021-01-03T13:03:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fba9bfff700 1 -- 172.21.15.133:0/614196082 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c01f7d0 con 0x7fbaa40601f0 2021-01-03T13:03:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fba9bfff700 1 -- 172.21.15.133:0/614196082 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba9c01fb30 con 0x7fbaa40601f0 2021-01-03T13:03:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa9809700 1 -- 172.21.15.133:0/614196082 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa4149e80 con 0x7fbaa40601f0 2021-01-03T13:03:11.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.343+0000 7fbaa9809700 1 -- 172.21.15.133:0/614196082 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa414a320 con 0x7fbaa40601f0 2021-01-03T13:03:11.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.347+0000 7fbaa9809700 1 -- 172.21.15.133:0/614196082 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa4148860 con 0x7fbaa40601f0 2021-01-03T13:03:11.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.347+0000 7fba9bfff700 1 -- 172.21.15.133:0/614196082 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fba9c026030 con 0x7fbaa40601f0 2021-01-03T13:03:11.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.347+0000 7fba9bfff700 1 --2- 172.21.15.133:0/614196082 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fba7c0553b0 0x7fba7c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:11.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.347+0000 7fba9bfff700 1 -- 172.21.15.133:0/614196082 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fba9c06f2b0 con 0x7fbaa40601f0 2021-01-03T13:03:11.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.347+0000 7fbaa27fc700 1 --2- 172.21.15.133:0/614196082 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fba7c0553b0 0x7fba7c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:11.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.347+0000 7fbaa27fc700 1 --2- 172.21.15.133:0/614196082 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fba7c0553b0 0x7fba7c057870 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fba9400b000 tx=0x7fba94008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:11.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.351+0000 7fba9bfff700 1 -- 172.21.15.133:0/614196082 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbaa4148860 con 0x7fbaa40601f0 2021-01-03T13:03:11.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:11.499+0000 7fbaa9809700 1 -- 172.21.15.133:0/614196082 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fbaa4148860 con 0x7fbaa40601f0 2021-01-03T13:03:12.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.487+0000 7fba9bfff700 1 -- 172.21.15.133:0/614196082 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v62) v1 ==== 133+0+0 (secure 0 0 0) 0x7fbaa4148860 con 0x7fbaa40601f0 2021-01-03T13:03:12.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.491+0000 7fbaa9809700 1 -- 172.21.15.133:0/614196082 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fba7c0553b0 msgr2=0x7fba7c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:12.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.491+0000 7fbaa9809700 1 --2- 172.21.15.133:0/614196082 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fba7c0553b0 0x7fba7c057870 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fba9400b000 tx=0x7fba94008040).stop 2021-01-03T13:03:12.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.491+0000 7fbaa9809700 1 -- 172.21.15.133:0/614196082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaa40601f0 msgr2=0x7fbaa40b0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:12.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.491+0000 7fbaa9809700 1 --2- 172.21.15.133:0/614196082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaa40601f0 0x7fbaa40b0110 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fbaa4148be0 tx=0x7fba9c016000).stop 2021-01-03T13:03:12.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.491+0000 7fbaa9809700 1 -- 172.21.15.133:0/614196082 shutdown_connections 2021-01-03T13:03:12.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.491+0000 7fbaa9809700 1 --2- 172.21.15.133:0/614196082 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fba7c0553b0 0x7fba7c057870 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:12.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.491+0000 7fbaa9809700 1 --2- 172.21.15.133:0/614196082 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbaa414b370 0x7fbaa4156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:12.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.491+0000 7fbaa9809700 1 --2- 172.21.15.133:0/614196082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbaa40601f0 0x7fbaa40b0110 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:12.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.491+0000 7fbaa9809700 1 --2- 172.21.15.133:0/614196082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbaa40b6a10 0x7fbaa4156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:12.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.491+0000 7fbaa9809700 1 -- 172.21.15.133:0/614196082 >> 172.21.15.133:0/614196082 conn(0x7fbaa40622f0 msgr2=0x7fbaa40b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:12.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.491+0000 7fbaa9809700 1 -- 172.21.15.133:0/614196082 shutdown_connections 2021-01-03T13:03:12.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.491+0000 7fbaa9809700 1 -- 172.21.15.133:0/614196082 wait complete. 2021-01-03T13:03:12.492 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2021-01-03T13:03:12.505 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-01-03T13:03:12.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f6737fff700 1 Processor -- start 2021-01-03T13:03:12.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f6737fff700 1 -- start start 2021-01-03T13:03:12.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f6737fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6738060510 0x7f673805c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:12.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f6737fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67380b6cf0 con 0x7f67380b4c20 2021-01-03T13:03:12.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f6737fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673805bf00 con 0x7f673805fd10 2021-01-03T13:03:12.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f6737fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673805c1a0 con 0x7f6738060510 2021-01-03T13:03:12.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f67377fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f673805fd10 0x7f67380b65e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56102/0 (socket says 172.21.15.133:56102) 2021-01-03T13:03:12.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f67377fe700 1 -- 172.21.15.133:0/1588108145 learned_addr learned my addr 172.21.15.133:0/1588108145 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:12.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f672ffff700 1 --2- 172.21.15.133:0/1588108145 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6738060510 0x7f673805c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:12.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f67367fc700 1 -- 172.21.15.133:0/1588108145 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438585312 0 0) 0x7f673805bf00 con 0x7f673805fd10 2021-01-03T13:03:12.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f67367fc700 1 -- 172.21.15.133:0/1588108145 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6718003230 con 0x7f673805fd10 2021-01-03T13:03:12.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f67367fc700 1 -- 172.21.15.133:0/1588108145 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241151974 0 0) 0x7f67380b6cf0 con 0x7f67380b4c20 2021-01-03T13:03:12.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f67367fc700 1 -- 172.21.15.133:0/1588108145 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f673805bf00 con 0x7f67380b4c20 2021-01-03T13:03:12.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f672ffff700 1 -- 172.21.15.133:0/1588108145 >> v1:172.21.15.133:6789/0 conn(0x7f673805fd10 legacy=0x7f67380b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:12.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f672ffff700 1 -- 172.21.15.133:0/1588108145 >> v1:172.21.15.16:6789/0 conn(0x7f67380b4c20 legacy=0x7f67380b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:12.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f672ffff700 1 -- 172.21.15.133:0/1588108145 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673805c440 con 0x7f6738060510 2021-01-03T13:03:12.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f672ffff700 1 --2- 172.21.15.133:0/1588108145 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6738060510 0x7f673805c8e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f6720002f30 tx=0x7f6720006dc0).ready entity=mon.2 client_cookie=f10d94bda10dc0ac server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:12.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f67367fc700 1 -- 172.21.15.133:0/1588108145 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6720009730 con 0x7f6738060510 2021-01-03T13:03:12.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f67367fc700 1 -- 172.21.15.133:0/1588108145 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6720009890 con 0x7f6738060510 2021-01-03T13:03:12.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f67367fc700 1 -- 172.21.15.133:0/1588108145 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6720009bf0 con 0x7f6738060510 2021-01-03T13:03:12.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f6737fff700 1 -- 172.21.15.133:0/1588108145 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6738060510 msgr2=0x7f673805c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:12.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f6737fff700 1 --2- 172.21.15.133:0/1588108145 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6738060510 0x7f673805c8e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f6720002f30 tx=0x7f6720006dc0).stop 2021-01-03T13:03:12.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f6737fff700 1 -- 172.21.15.133:0/1588108145 shutdown_connections 2021-01-03T13:03:12.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f6737fff700 1 --2- 172.21.15.133:0/1588108145 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6738060510 0x7f673805c8e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:12.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f6737fff700 1 -- 172.21.15.133:0/1588108145 >> 172.21.15.133:0/1588108145 conn(0x7f67380b9f00 msgr2=0x7f67380b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:12.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f6737fff700 1 -- 172.21.15.133:0/1588108145 shutdown_connections 2021-01-03T13:03:12.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.631+0000 7f6737fff700 1 -- 172.21.15.133:0/1588108145 wait complete. 2021-01-03T13:03:12.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f6737fff700 1 Processor -- start 2021-01-03T13:03:12.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f6737fff700 1 -- start start 2021-01-03T13:03:12.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f6737fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f673805fd10 0x7f673809ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:12.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f6737fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6738060510 0x7f6738144070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:12.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f6737fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67380b4c20 0x7f6738144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:12.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f6737fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6738151920 con 0x7f67380b4c20 2021-01-03T13:03:12.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f6737fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67381451c0 con 0x7f6738060510 2021-01-03T13:03:12.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f6737fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6738144f20 con 0x7f673805fd10 2021-01-03T13:03:12.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f672ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6738060510 0x7f6738144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:12.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f672ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6738060510 0x7f6738144070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35074/0 (socket says 172.21.15.133:35074) 2021-01-03T13:03:12.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f672ffff700 1 -- 172.21.15.133:0/2254105387 learned_addr learned my addr 172.21.15.133:0/2254105387 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:12.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f6736ffd700 1 --2- 172.21.15.133:0/2254105387 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f673805fd10 0x7f673809ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:12.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f67377fe700 1 --2- 172.21.15.133:0/2254105387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67380b4c20 0x7f6738144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:12.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f672ffff700 1 -- 172.21.15.133:0/2254105387 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f673805fd10 msgr2=0x7f673809ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:12.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f672ffff700 1 --2- 172.21.15.133:0/2254105387 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f673805fd10 0x7f673809ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:12.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f672ffff700 1 -- 172.21.15.133:0/2254105387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67380b4c20 msgr2=0x7f6738144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:12.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f672ffff700 1 --2- 172.21.15.133:0/2254105387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67380b4c20 0x7f6738144560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:12.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f672ffff700 1 -- 172.21.15.133:0/2254105387 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6738142950 con 0x7f6738060510 2021-01-03T13:03:12.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f672ffff700 1 --2- 172.21.15.133:0/2254105387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6738060510 0x7f6738144070 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f6720002f30 tx=0x7f6720015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:12.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f6734ff9700 1 -- 172.21.15.133:0/2254105387 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67200119a0 con 0x7f6738060510 2021-01-03T13:03:12.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f6737fff700 1 -- 172.21.15.133:0/2254105387 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6738142bf0 con 0x7f6738060510 2021-01-03T13:03:12.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f6734ff9700 1 -- 172.21.15.133:0/2254105387 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6720011b00 con 0x7f6738060510 2021-01-03T13:03:12.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f6734ff9700 1 -- 172.21.15.133:0/2254105387 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6720011e60 con 0x7f6738060510 2021-01-03T13:03:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f6737fff700 1 -- 172.21.15.133:0/2254105387 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6738142570 con 0x7f6738060510 2021-01-03T13:03:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f6737fff700 1 -- 172.21.15.133:0/2254105387 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6738142d80 con 0x7f6738060510 2021-01-03T13:03:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f6734ff9700 1 -- 172.21.15.133:0/2254105387 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f672000f070 con 0x7f6738060510 2021-01-03T13:03:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.635+0000 7f6734ff9700 1 --2- 172.21.15.133:0/2254105387 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f671c055440 0x7f671c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:12.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.639+0000 7f6734ff9700 1 -- 172.21.15.133:0/2254105387 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f672006eb30 con 0x7f6738060510 2021-01-03T13:03:12.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.639+0000 7f6736ffd700 1 --2- 172.21.15.133:0/2254105387 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f671c055440 0x7f671c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:12.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.639+0000 7f6736ffd700 1 --2- 172.21.15.133:0/2254105387 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f671c055440 0x7f671c057900 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f672800d000 tx=0x7f67280079f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:12.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.643+0000 7f6734ff9700 1 -- 172.21.15.133:0/2254105387 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6720044f60 con 0x7f6738060510 2021-01-03T13:03:12.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:12.775+0000 7f6737fff700 1 -- 172.21.15.133:0/2254105387 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f6738057300 con 0x7f6738060510 2021-01-03T13:03:13.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.631+0000 7f6734ff9700 1 -- 172.21.15.133:0/2254105387 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v64) v1 ==== 125+0+0 (secure 0 0 0) 0x7f6720022070 con 0x7f6738060510 2021-01-03T13:03:13.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.631+0000 7f6737fff700 1 -- 172.21.15.133:0/2254105387 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f671c055440 msgr2=0x7f671c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:13.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.635+0000 7f6737fff700 1 --2- 172.21.15.133:0/2254105387 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f671c055440 0x7f671c057900 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f672800d000 tx=0x7f67280079f0).stop 2021-01-03T13:03:13.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.635+0000 7f6737fff700 1 -- 172.21.15.133:0/2254105387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6738060510 msgr2=0x7f6738144070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:13.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.635+0000 7f6737fff700 1 --2- 172.21.15.133:0/2254105387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6738060510 0x7f6738144070 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f6720002f30 tx=0x7f6720015000).stop 2021-01-03T13:03:13.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.635+0000 7f6737fff700 1 -- 172.21.15.133:0/2254105387 shutdown_connections 2021-01-03T13:03:13.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.635+0000 7f6737fff700 1 --2- 172.21.15.133:0/2254105387 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f671c055440 0x7f671c057900 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:13.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.635+0000 7f6737fff700 1 --2- 172.21.15.133:0/2254105387 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67380b4c20 0x7f6738144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:13.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.635+0000 7f6737fff700 1 --2- 172.21.15.133:0/2254105387 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f673805fd10 0x7f673809ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:13.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.635+0000 7f6737fff700 1 --2- 172.21.15.133:0/2254105387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6738060510 0x7f6738144070 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:13.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.635+0000 7f6737fff700 1 -- 172.21.15.133:0/2254105387 >> 172.21.15.133:0/2254105387 conn(0x7f67380b9f00 msgr2=0x7f67380ae430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:13.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.635+0000 7f6737fff700 1 -- 172.21.15.133:0/2254105387 shutdown_connections 2021-01-03T13:03:13.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.635+0000 7f6737fff700 1 -- 172.21.15.133:0/2254105387 wait complete. 2021-01-03T13:03:13.633 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2021-01-03T13:03:13.646 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-01-03T13:03:13.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.771+0000 7fd55ffff700 1 Processor -- start 2021-01-03T13:03:13.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.771+0000 7fd55ffff700 1 -- start start 2021-01-03T13:03:13.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.771+0000 7fd55ffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd5600b4c20 0x7fd56005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:13.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd560060510 0x7fd5600b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:13.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd56005fd10 0x7fd5600b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:13.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55ffff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56005bf00 con 0x7fd5600b4c20 2021-01-03T13:03:13.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55ffff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56005c1a0 con 0x7fd56005fd10 2021-01-03T13:03:13.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56005c440 con 0x7fd560060510 2021-01-03T13:03:13.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd56005fd10 0x7fd5600b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:13.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd56005fd10 0x7fd5600b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35084/0 (socket says 172.21.15.133:35084) 2021-01-03T13:03:13.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55e7fc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd560060510 0x7fd5600b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:13.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55f7fe700 1 -- 172.21.15.133:0/3594388744 learned_addr learned my addr 172.21.15.133:0/3594388744 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:13.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55effd700 1 --2- 172.21.15.133:0/3594388744 >> v2:172.21.15.16:3300/0 conn(0x7fd5600b4c20 0x7fd56005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:13.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55f7fe700 1 -- 172.21.15.133:0/3594388744 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd560060510 msgr2=0x7fd5600b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:13.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55f7fe700 1 --2- 172.21.15.133:0/3594388744 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd560060510 0x7fd5600b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:13.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55f7fe700 1 -- 172.21.15.133:0/3594388744 >> v2:172.21.15.16:3300/0 conn(0x7fd5600b4c20 msgr2=0x7fd56005c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:13.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55f7fe700 1 --2- 172.21.15.133:0/3594388744 >> v2:172.21.15.16:3300/0 conn(0x7fd5600b4c20 0x7fd56005c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:13.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55f7fe700 1 -- 172.21.15.133:0/3594388744 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5600b54f0 con 0x7fd56005fd10 2021-01-03T13:03:13.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55f7fe700 1 --2- 172.21.15.133:0/3594388744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd56005fd10 0x7fd5600b65e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fd5580032b0 tx=0x7fd558009270).ready entity=mon.1 client_cookie=47b36e778b666530 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:13.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55dffb700 1 -- 172.21.15.133:0/3594388744 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd558009e60 con 0x7fd56005fd10 2021-01-03T13:03:13.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55dffb700 1 -- 172.21.15.133:0/3594388744 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55800bb50 con 0x7fd56005fd10 2021-01-03T13:03:13.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55dffb700 1 -- 172.21.15.133:0/3594388744 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd55800bcc0 con 0x7fd56005fd10 2021-01-03T13:03:13.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55ffff700 1 -- 172.21.15.133:0/3594388744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd56005fd10 msgr2=0x7fd5600b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:13.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55ffff700 1 --2- 172.21.15.133:0/3594388744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd56005fd10 0x7fd5600b65e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fd5580032b0 tx=0x7fd558009270).stop 2021-01-03T13:03:13.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55ffff700 1 -- 172.21.15.133:0/3594388744 shutdown_connections 2021-01-03T13:03:13.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55ffff700 1 --2- 172.21.15.133:0/3594388744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd56005fd10 0x7fd5600b65e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:13.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55ffff700 1 --2- 172.21.15.133:0/3594388744 >> v2:172.21.15.16:3300/0 conn(0x7fd5600b4c20 0x7fd56005c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:13.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55ffff700 1 --2- 172.21.15.133:0/3594388744 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd560060510 0x7fd5600b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:13.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55ffff700 1 -- 172.21.15.133:0/3594388744 >> 172.21.15.133:0/3594388744 conn(0x7fd5600b9f00 msgr2=0x7fd5600b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:13.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55ffff700 1 -- 172.21.15.133:0/3594388744 shutdown_connections 2021-01-03T13:03:13.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.775+0000 7fd55ffff700 1 -- 172.21.15.133:0/3594388744 wait complete. 2021-01-03T13:03:13.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55ffff700 1 Processor -- start 2021-01-03T13:03:13.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55ffff700 1 -- start start 2021-01-03T13:03:13.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd56005fd10 0x7fd56009e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:13.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd560060510 0x7fd56013a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:13.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5600b4c20 0x7fd56013add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:13.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55ffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd560140aa0 con 0x7fd5600b4c20 2021-01-03T13:03:13.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd560140d00 con 0x7fd560060510 2021-01-03T13:03:13.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5601486d0 con 0x7fd56005fd10 2021-01-03T13:03:13.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd560060510 0x7fd56013a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:13.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd560060510 0x7fd56013a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35088/0 (socket says 172.21.15.133:35088) 2021-01-03T13:03:13.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55e7fc700 1 -- 172.21.15.133:0/3683113878 learned_addr learned my addr 172.21.15.133:0/3683113878 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:13.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55f7fe700 1 --2- 172.21.15.133:0/3683113878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5600b4c20 0x7fd56013add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:13.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55effd700 1 --2- 172.21.15.133:0/3683113878 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd56005fd10 0x7fd56009e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:13.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55e7fc700 1 -- 172.21.15.133:0/3683113878 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd56005fd10 msgr2=0x7fd56009e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:13.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55e7fc700 1 --2- 172.21.15.133:0/3683113878 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd56005fd10 0x7fd56009e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:13.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55e7fc700 1 -- 172.21.15.133:0/3683113878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5600b4c20 msgr2=0x7fd56013add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:13.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55e7fc700 1 --2- 172.21.15.133:0/3683113878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5600b4c20 0x7fd56013add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:13.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55e7fc700 1 -- 172.21.15.133:0/3683113878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd560148970 con 0x7fd560060510 2021-01-03T13:03:13.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55e7fc700 1 --2- 172.21.15.133:0/3683113878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd560060510 0x7fd56013a8e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fd55000c000 tx=0x7fd550006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:13.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd557fff700 1 -- 172.21.15.133:0/3683113878 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd55000ca10 con 0x7fd560060510 2021-01-03T13:03:13.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd557fff700 1 -- 172.21.15.133:0/3683113878 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55000cb70 con 0x7fd560060510 2021-01-03T13:03:13.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55ffff700 1 -- 172.21.15.133:0/3683113878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5601434e0 con 0x7fd560060510 2021-01-03T13:03:13.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd557fff700 1 -- 172.21.15.133:0/3683113878 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5500123f0 con 0x7fd560060510 2021-01-03T13:03:13.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.779+0000 7fd55ffff700 1 -- 172.21.15.133:0/3683113878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5601414b0 con 0x7fd560060510 2021-01-03T13:03:13.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.783+0000 7fd55ffff700 1 -- 172.21.15.133:0/3683113878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd560141760 con 0x7fd560060510 2021-01-03T13:03:13.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.783+0000 7fd557fff700 1 -- 172.21.15.133:0/3683113878 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd550012550 con 0x7fd560060510 2021-01-03T13:03:13.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.783+0000 7fd557fff700 1 --2- 172.21.15.133:0/3683113878 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd5440553b0 0x7fd544057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:13.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.783+0000 7fd557fff700 1 -- 172.21.15.133:0/3683113878 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fd55006e3a0 con 0x7fd560060510 2021-01-03T13:03:13.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.783+0000 7fd55effd700 1 --2- 172.21.15.133:0/3683113878 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd5440553b0 0x7fd544057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:13.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.783+0000 7fd55effd700 1 --2- 172.21.15.133:0/3683113878 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd5440553b0 0x7fd544057870 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fd54800b000 tx=0x7fd548006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:13.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.791+0000 7fd557fff700 1 -- 172.21.15.133:0/3683113878 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd5500445a0 con 0x7fd560060510 2021-01-03T13:03:13.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.971+0000 7fd55ffff700 1 -- 172.21.15.133:0/3683113878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fd560148b00 con 0x7fd560060510 2021-01-03T13:03:13.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.991+0000 7fd557fff700 1 -- 172.21.15.133:0/3683113878 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 11 and data pool 12 v26) v1 ==== 189+0+0 (secure 0 0 0) 0x7fd550047bc0 con 0x7fd560060510 2021-01-03T13:03:13.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.991+0000 7fd55ffff700 1 -- 172.21.15.133:0/3683113878 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd5440553b0 msgr2=0x7fd544057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:13.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.991+0000 7fd55ffff700 1 --2- 172.21.15.133:0/3683113878 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd5440553b0 0x7fd544057870 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fd54800b000 tx=0x7fd548006dc0).stop 2021-01-03T13:03:13.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.991+0000 7fd55ffff700 1 -- 172.21.15.133:0/3683113878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd560060510 msgr2=0x7fd56013a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:13.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.991+0000 7fd55ffff700 1 --2- 172.21.15.133:0/3683113878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd560060510 0x7fd56013a8e0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fd55000c000 tx=0x7fd550006dc0).stop 2021-01-03T13:03:13.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.995+0000 7fd55ffff700 1 -- 172.21.15.133:0/3683113878 shutdown_connections 2021-01-03T13:03:13.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.995+0000 7fd55ffff700 1 --2- 172.21.15.133:0/3683113878 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd5440553b0 0x7fd544057870 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:13.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.995+0000 7fd55ffff700 1 --2- 172.21.15.133:0/3683113878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5600b4c20 0x7fd56013add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:13.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.995+0000 7fd55ffff700 1 --2- 172.21.15.133:0/3683113878 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd56005fd10 0x7fd56009e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:13.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.995+0000 7fd55ffff700 1 --2- 172.21.15.133:0/3683113878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd560060510 0x7fd56013a8e0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:13.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.995+0000 7fd55ffff700 1 -- 172.21.15.133:0/3683113878 >> 172.21.15.133:0/3683113878 conn(0x7fd5600b9f00 msgr2=0x7fd56013d640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:13.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.995+0000 7fd55ffff700 1 -- 172.21.15.133:0/3683113878 shutdown_connections 2021-01-03T13:03:13.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:13.995+0000 7fd55ffff700 1 -- 172.21.15.133:0/3683113878 wait complete. 2021-01-03T13:03:13.992 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 11 and data pool 12 2021-01-03T13:03:14.005 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:03:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.107+0000 7fbb27fff700 1 Processor -- start 2021-01-03T13:03:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.107+0000 7fbb27fff700 1 -- start start 2021-01-03T13:03:14.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.107+0000 7fbb27fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbb280b4c20 0x7fbb2805c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.107+0000 7fbb27fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbb2805fd10 0x7fbb280b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.107+0000 7fbb27fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2805bf00 con 0x7fbb28060510 2021-01-03T13:03:14.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.107+0000 7fbb27fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2805c1a0 con 0x7fbb280b4c20 2021-01-03T13:03:14.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.107+0000 7fbb27fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2805c440 con 0x7fbb2805fd10 2021-01-03T13:03:14.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.107+0000 7fbb277fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbb2805fd10 0x7fbb280b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.107+0000 7fbb26ffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbb280b4c20 0x7fbb2805c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.107+0000 7fbb277fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbb2805fd10 0x7fbb280b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:43410/0 (socket says 172.21.15.133:43410) 2021-01-03T13:03:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.107+0000 7fbb277fe700 1 -- 172.21.15.133:0/2089170667 learned_addr learned my addr 172.21.15.133:0/2089170667 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb277fe700 1 -- 172.21.15.133:0/2089170667 >> v2:172.21.15.16:3300/0 conn(0x7fbb280b4c20 msgr2=0x7fbb2805c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb277fe700 1 --2- 172.21.15.133:0/2089170667 >> v2:172.21.15.16:3300/0 conn(0x7fbb280b4c20 0x7fbb2805c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb277fe700 1 -- 172.21.15.133:0/2089170667 >> v1:172.21.15.16:6789/0 conn(0x7fbb28060510 legacy=0x7fbb280b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb277fe700 1 -- 172.21.15.133:0/2089170667 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb280b6ad0 con 0x7fbb2805fd10 2021-01-03T13:03:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb26ffd700 1 --2- 172.21.15.133:0/2089170667 >> v2:172.21.15.16:3300/0 conn(0x7fbb280b4c20 0x7fbb2805c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:03:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb277fe700 1 --2- 172.21.15.133:0/2089170667 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbb2805fd10 0x7fbb280b65e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fbb200032b0 tx=0x7fbb20009270).ready entity=mon.2 client_cookie=60a808be6d0d6c4f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb25ffb700 1 -- 172.21.15.133:0/2089170667 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb20009e60 con 0x7fbb2805fd10 2021-01-03T13:03:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb25ffb700 1 -- 172.21.15.133:0/2089170667 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2000bc00 con 0x7fbb2805fd10 2021-01-03T13:03:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb27fff700 1 -- 172.21.15.133:0/2089170667 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbb2805fd10 msgr2=0x7fbb280b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb27fff700 1 --2- 172.21.15.133:0/2089170667 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbb2805fd10 0x7fbb280b65e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fbb200032b0 tx=0x7fbb20009270).stop 2021-01-03T13:03:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb25ffb700 1 -- 172.21.15.133:0/2089170667 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb2000bd70 con 0x7fbb2805fd10 2021-01-03T13:03:14.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb27fff700 1 -- 172.21.15.133:0/2089170667 shutdown_connections 2021-01-03T13:03:14.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb27fff700 1 --2- 172.21.15.133:0/2089170667 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbb2805fd10 0x7fbb280b65e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb27fff700 1 --2- 172.21.15.133:0/2089170667 >> v2:172.21.15.16:3300/0 conn(0x7fbb280b4c20 0x7fbb2805c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb27fff700 1 -- 172.21.15.133:0/2089170667 >> 172.21.15.133:0/2089170667 conn(0x7fbb280b9f00 msgr2=0x7fbb280b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:14.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb27fff700 1 -- 172.21.15.133:0/2089170667 shutdown_connections 2021-01-03T13:03:14.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb27fff700 1 -- 172.21.15.133:0/2089170667 wait complete. 2021-01-03T13:03:14.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb27fff700 1 Processor -- start 2021-01-03T13:03:14.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.111+0000 7fbb27fff700 1 -- start start 2021-01-03T13:03:14.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb27fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbb2805fd10 0x7fbb28155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb27fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb28060510 0x7fbb280b8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb27fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb280b4c20 0x7fbb28140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb27fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb281561c0 con 0x7fbb280b4c20 2021-01-03T13:03:14.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb27fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb280b1e60 con 0x7fbb28060510 2021-01-03T13:03:14.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb27fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb280b2d00 con 0x7fbb2805fd10 2021-01-03T13:03:14.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb267fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb28060510 0x7fbb280b8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb267fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb28060510 0x7fbb280b8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35112/0 (socket says 172.21.15.133:35112) 2021-01-03T13:03:14.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb267fc700 1 -- 172.21.15.133:0/961507521 learned_addr learned my addr 172.21.15.133:0/961507521 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:14.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb277fe700 1 --2- 172.21.15.133:0/961507521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb280b4c20 0x7fbb28140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb26ffd700 1 --2- 172.21.15.133:0/961507521 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbb2805fd10 0x7fbb28155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb267fc700 1 -- 172.21.15.133:0/961507521 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbb2805fd10 msgr2=0x7fbb28155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb267fc700 1 --2- 172.21.15.133:0/961507521 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbb2805fd10 0x7fbb28155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb267fc700 1 -- 172.21.15.133:0/961507521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb280b4c20 msgr2=0x7fbb28140b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb267fc700 1 --2- 172.21.15.133:0/961507521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb280b4c20 0x7fbb28140b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb267fc700 1 -- 172.21.15.133:0/961507521 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb280b2050 con 0x7fbb28060510 2021-01-03T13:03:14.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb267fc700 1 --2- 172.21.15.133:0/961507521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb28060510 0x7fbb280b8050 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fbb28061cb0 tx=0x7fbb18007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:14.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb1ffff700 1 -- 172.21.15.133:0/961507521 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb18007240 con 0x7fbb28060510 2021-01-03T13:03:14.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb27fff700 1 -- 172.21.15.133:0/961507521 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb280b22f0 con 0x7fbb28060510 2021-01-03T13:03:14.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb1ffff700 1 -- 172.21.15.133:0/961507521 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb180073a0 con 0x7fbb28060510 2021-01-03T13:03:14.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb1ffff700 1 -- 172.21.15.133:0/961507521 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb180066d0 con 0x7fbb28060510 2021-01-03T13:03:14.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb27fff700 1 -- 172.21.15.133:0/961507521 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb280b2980 con 0x7fbb28060510 2021-01-03T13:03:14.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.115+0000 7fbb27fff700 1 -- 172.21.15.133:0/961507521 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb280b2480 con 0x7fbb28060510 2021-01-03T13:03:14.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.119+0000 7fbb1ffff700 1 -- 172.21.15.133:0/961507521 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fbb18010070 con 0x7fbb28060510 2021-01-03T13:03:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.119+0000 7fbb1ffff700 1 --2- 172.21.15.133:0/961507521 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbb0c0553b0 0x7fbb0c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.119+0000 7fbb1ffff700 1 -- 172.21.15.133:0/961507521 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbb1806d680 con 0x7fbb28060510 2021-01-03T13:03:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.119+0000 7fbb26ffd700 1 --2- 172.21.15.133:0/961507521 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbb0c0553b0 0x7fbb0c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.119+0000 7fbb26ffd700 1 --2- 172.21.15.133:0/961507521 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbb0c0553b0 0x7fbb0c057870 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fbb1000b000 tx=0x7fbb10006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:14.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.127+0000 7fbb1ffff700 1 -- 172.21.15.133:0/961507521 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbb180438e0 con 0x7fbb28060510 2021-01-03T13:03:14.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.267+0000 7fbb27fff700 1 -- 172.21.15.133:0/961507521 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb28057300 con 0x7fbb28060510 2021-01-03T13:03:14.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.267+0000 7fbb1ffff700 1 -- 172.21.15.133:0/961507521 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16115 (secure 0 0 0) 0x7fbb18018020 con 0x7fbb28060510 2021-01-03T13:03:14.265 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:14.265 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":65,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:03:13.978610+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:03:11.555772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-01-03T13:03:12.829370+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:03:14.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.271+0000 7fbb27fff700 1 -- 172.21.15.133:0/961507521 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbb0c0553b0 msgr2=0x7fbb0c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.271+0000 7fbb27fff700 1 --2- 172.21.15.133:0/961507521 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbb0c0553b0 0x7fbb0c057870 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fbb1000b000 tx=0x7fbb10006dc0).stop 2021-01-03T13:03:14.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.271+0000 7fbb27fff700 1 -- 172.21.15.133:0/961507521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb28060510 msgr2=0x7fbb280b8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.271+0000 7fbb27fff700 1 --2- 172.21.15.133:0/961507521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb28060510 0x7fbb280b8050 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fbb28061cb0 tx=0x7fbb18007be0).stop 2021-01-03T13:03:14.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.271+0000 7fbb27fff700 1 -- 172.21.15.133:0/961507521 shutdown_connections 2021-01-03T13:03:14.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.271+0000 7fbb27fff700 1 --2- 172.21.15.133:0/961507521 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbb0c0553b0 0x7fbb0c057870 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.271+0000 7fbb27fff700 1 --2- 172.21.15.133:0/961507521 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb280b4c20 0x7fbb28140b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.271+0000 7fbb27fff700 1 --2- 172.21.15.133:0/961507521 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbb2805fd10 0x7fbb28155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.271+0000 7fbb27fff700 1 --2- 172.21.15.133:0/961507521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb28060510 0x7fbb280b8050 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.271+0000 7fbb27fff700 1 -- 172.21.15.133:0/961507521 >> 172.21.15.133:0/961507521 conn(0x7fbb280b9f00 msgr2=0x7fbb280afa40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:14.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.271+0000 7fbb27fff700 1 -- 172.21.15.133:0/961507521 shutdown_connections 2021-01-03T13:03:14.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.271+0000 7fbb27fff700 1 -- 172.21.15.133:0/961507521 wait complete. 2021-01-03T13:03:14.280 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:03:14.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.387+0000 7f9df9435700 1 Processor -- start 2021-01-03T13:03:14.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.387+0000 7f9df9435700 1 -- start start 2021-01-03T13:03:14.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df9435700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9df40afdc0 0x7f9df413c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df9435700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df40b7130 con 0x7f9df40b16d0 2021-01-03T13:03:14.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df9435700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df40b0690 con 0x7f9df40b6d50 2021-01-03T13:03:14.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df9435700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df40b0dc0 con 0x7f9df40afdc0 2021-01-03T13:03:14.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df2ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9df40b6d50 0x7f9df40af6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56152/0 (socket says 172.21.15.133:56152) 2021-01-03T13:03:14.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df2ffd700 1 -- 172.21.15.133:0/3112249541 learned_addr learned my addr 172.21.15.133:0/3112249541 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:14.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df27fc700 1 --2- 172.21.15.133:0/3112249541 >> v2:172.21.15.16:3300/0 conn(0x7f9df40afdc0 0x7f9df413c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df1ffb700 1 -- 172.21.15.133:0/3112249541 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625595660 0 0) 0x7f9df40b0690 con 0x7f9df40b6d50 2021-01-03T13:03:14.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df1ffb700 1 -- 172.21.15.133:0/3112249541 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dd8003230 con 0x7f9df40b6d50 2021-01-03T13:03:14.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df27fc700 1 -- 172.21.15.133:0/3112249541 >> v1:172.21.15.133:6789/0 conn(0x7f9df40b6d50 legacy=0x7f9df40af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df27fc700 1 -- 172.21.15.133:0/3112249541 >> v1:172.21.15.16:6789/0 conn(0x7f9df40b16d0 legacy=0x7f9df413ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df27fc700 1 -- 172.21.15.133:0/3112249541 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df40b1060 con 0x7f9df40afdc0 2021-01-03T13:03:14.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df27fc700 1 --2- 172.21.15.133:0/3112249541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9df40afdc0 0x7f9df413c7c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f9de40032b0 tx=0x7f9de40091a0).ready entity=mon.0 client_cookie=53bbc519ca24a401 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:14.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df1ffb700 1 -- 172.21.15.133:0/3112249541 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9de400b9a0 con 0x7f9df40afdc0 2021-01-03T13:03:14.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df1ffb700 1 -- 172.21.15.133:0/3112249541 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de400bb00 con 0x7f9df40afdc0 2021-01-03T13:03:14.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df9435700 1 -- 172.21.15.133:0/3112249541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9df40afdc0 msgr2=0x7f9df413c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df9435700 1 --2- 172.21.15.133:0/3112249541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9df40afdc0 0x7f9df413c7c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f9de40032b0 tx=0x7f9de40091a0).stop 2021-01-03T13:03:14.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df1ffb700 1 -- 172.21.15.133:0/3112249541 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9de400bc70 con 0x7f9df40afdc0 2021-01-03T13:03:14.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df9435700 1 -- 172.21.15.133:0/3112249541 shutdown_connections 2021-01-03T13:03:14.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df9435700 1 --2- 172.21.15.133:0/3112249541 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9df40afdc0 0x7f9df413c7c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df9435700 1 -- 172.21.15.133:0/3112249541 >> 172.21.15.133:0/3112249541 conn(0x7f9df40622f0 msgr2=0x7f9df40b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:14.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df9435700 1 -- 172.21.15.133:0/3112249541 shutdown_connections 2021-01-03T13:03:14.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.391+0000 7f9df9435700 1 -- 172.21.15.133:0/3112249541 wait complete. 2021-01-03T13:03:14.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df9435700 1 Processor -- start 2021-01-03T13:03:14.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df9435700 1 -- start start 2021-01-03T13:03:14.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df9435700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9df40afdc0 0x7f9df4137410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df9435700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9df40b16d0 0x7f9df4134b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df9435700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9df40b6d50 0x7f9df4135070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df9435700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df413ec40 con 0x7f9df40b6d50 2021-01-03T13:03:14.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df9435700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df4139560 con 0x7f9df40afdc0 2021-01-03T13:03:14.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df9435700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df413ee70 con 0x7f9df40b16d0 2021-01-03T13:03:14.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9df40afdc0 0x7f9df4137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df37fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9df40b6d50 0x7f9df4135070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df37fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9df40b6d50 0x7f9df4135070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:33664/0 (socket says 172.21.15.133:33664) 2021-01-03T13:03:14.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9df40afdc0 0x7f9df4137410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35124/0 (socket says 172.21.15.133:35124) 2021-01-03T13:03:14.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df37fe700 1 -- 172.21.15.133:0/1337014845 learned_addr learned my addr 172.21.15.133:0/1337014845 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:14.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df27fc700 1 --2- 172.21.15.133:0/1337014845 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9df40b16d0 0x7f9df4134b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df37fe700 1 -- 172.21.15.133:0/1337014845 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9df40b16d0 msgr2=0x7f9df4134b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df37fe700 1 --2- 172.21.15.133:0/1337014845 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9df40b16d0 0x7f9df4134b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df37fe700 1 -- 172.21.15.133:0/1337014845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9df40afdc0 msgr2=0x7f9df4137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df37fe700 1 --2- 172.21.15.133:0/1337014845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9df40afdc0 0x7f9df4137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df37fe700 1 -- 172.21.15.133:0/1337014845 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df413f110 con 0x7f9df40b6d50 2021-01-03T13:03:14.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df37fe700 1 --2- 172.21.15.133:0/1337014845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9df40b6d50 0x7f9df4135070 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f9df413fa50 tx=0x7f9dec007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:14.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9de3fff700 1 -- 172.21.15.133:0/1337014845 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dec013410 con 0x7f9df40b6d50 2021-01-03T13:03:14.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df9435700 1 -- 172.21.15.133:0/1337014845 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df40b5660 con 0x7f9df40b6d50 2021-01-03T13:03:14.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9de3fff700 1 -- 172.21.15.133:0/1337014845 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec013570 con 0x7f9df40b6d50 2021-01-03T13:03:14.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9de3fff700 1 -- 172.21.15.133:0/1337014845 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dec0138d0 con 0x7f9df40b6d50 2021-01-03T13:03:14.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df9435700 1 -- 172.21.15.133:0/1337014845 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df40b5cf0 con 0x7f9df40b6d50 2021-01-03T13:03:14.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.395+0000 7f9df9435700 1 -- 172.21.15.133:0/1337014845 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df41396d0 con 0x7f9df40b6d50 2021-01-03T13:03:14.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.399+0000 7f9de3fff700 1 -- 172.21.15.133:0/1337014845 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9dec010030 con 0x7f9df40b6d50 2021-01-03T13:03:14.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.399+0000 7f9de3fff700 1 --2- 172.21.15.133:0/1337014845 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9dd0055330 0x7f9dd00577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.399+0000 7f9de3fff700 1 -- 172.21.15.133:0/1337014845 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9dec001e40 con 0x7f9df40b6d50 2021-01-03T13:03:14.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.399+0000 7f9df2ffd700 1 --2- 172.21.15.133:0/1337014845 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9dd0055330 0x7f9dd00577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.399+0000 7f9df2ffd700 1 --2- 172.21.15.133:0/1337014845 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9dd0055330 0x7f9dd00577f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f9de800d000 tx=0x7f9de8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:14.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.407+0000 7f9de3fff700 1 -- 172.21.15.133:0/1337014845 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9dec0440f0 con 0x7f9df40b6d50 2021-01-03T13:03:14.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.547+0000 7f9df9435700 1 -- 172.21.15.133:0/1337014845 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9df41396d0 con 0x7f9df40b6d50 2021-01-03T13:03:14.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.551+0000 7f9de3fff700 1 -- 172.21.15.133:0/1337014845 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16115 (secure 0 0 0) 0x7f9df41396d0 con 0x7f9df40b6d50 2021-01-03T13:03:14.547 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:14.547 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":65,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:03:13.978610+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:03:11.555772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-01-03T13:03:12.829370+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:03:14.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.551+0000 7f9df9435700 1 -- 172.21.15.133:0/1337014845 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9dd0055330 msgr2=0x7f9dd00577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.551+0000 7f9df9435700 1 --2- 172.21.15.133:0/1337014845 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9dd0055330 0x7f9dd00577f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f9de800d000 tx=0x7f9de8009040).stop 2021-01-03T13:03:14.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.551+0000 7f9df9435700 1 -- 172.21.15.133:0/1337014845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9df40b6d50 msgr2=0x7f9df4135070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.551+0000 7f9df9435700 1 --2- 172.21.15.133:0/1337014845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9df40b6d50 0x7f9df4135070 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f9df413fa50 tx=0x7f9dec007b90).stop 2021-01-03T13:03:14.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.551+0000 7f9df9435700 1 -- 172.21.15.133:0/1337014845 shutdown_connections 2021-01-03T13:03:14.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.551+0000 7f9df9435700 1 --2- 172.21.15.133:0/1337014845 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9dd0055330 0x7f9dd00577f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.551+0000 7f9df9435700 1 --2- 172.21.15.133:0/1337014845 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9df40b6d50 0x7f9df4135070 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.551+0000 7f9df9435700 1 --2- 172.21.15.133:0/1337014845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9df40afdc0 0x7f9df4137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.551+0000 7f9df9435700 1 --2- 172.21.15.133:0/1337014845 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9df40b16d0 0x7f9df4134b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.551+0000 7f9df9435700 1 -- 172.21.15.133:0/1337014845 >> 172.21.15.133:0/1337014845 conn(0x7f9df40622f0 msgr2=0x7f9df4139ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:14.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.551+0000 7f9df9435700 1 -- 172.21.15.133:0/1337014845 shutdown_connections 2021-01-03T13:03:14.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.551+0000 7f9df9435700 1 -- 172.21.15.133:0/1337014845 wait complete. 2021-01-03T13:03:14.560 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-01-03T13:03:14.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f3041aef700 1 Processor -- start 2021-01-03T13:03:14.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f3041aef700 1 -- start start 2021-01-03T13:03:14.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f3041aef700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f303c061f30 0x7f303c062310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f3041aef700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f303c060920 0x7f303c13cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f3041aef700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f303c13d060 0x7f303c143100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f3041aef700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303c0b04d0 con 0x7f303c060920 2021-01-03T13:03:14.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f3041aef700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303c0b28c0 con 0x7f303c061f30 2021-01-03T13:03:14.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f3041aef700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c1466d0 con 0x7f303c13d060 2021-01-03T13:03:14.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f303b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f303c061f30 0x7f303c062310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f303b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f303c061f30 0x7f303c062310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35130/0 (socket says 172.21.15.133:35130) 2021-01-03T13:03:14.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f303b7fe700 1 -- 172.21.15.133:0/1944425946 learned_addr learned my addr 172.21.15.133:0/1944425946 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:14.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f303affd700 1 --2- 172.21.15.133:0/1944425946 >> v2:172.21.15.16:3300/0 conn(0x7f303c060920 0x7f303c13cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f303bfff700 1 --2- 172.21.15.133:0/1944425946 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f303c13d060 0x7f303c143100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f303b7fe700 1 -- 172.21.15.133:0/1944425946 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f303c13d060 msgr2=0x7f303c143100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:14.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f303b7fe700 1 --2- 172.21.15.133:0/1944425946 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f303c13d060 0x7f303c143100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f303b7fe700 1 -- 172.21.15.133:0/1944425946 >> v2:172.21.15.16:3300/0 conn(0x7f303c060920 msgr2=0x7f303c13cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:14.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f303b7fe700 1 --2- 172.21.15.133:0/1944425946 >> v2:172.21.15.16:3300/0 conn(0x7f303c060920 0x7f303c13cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f303b7fe700 1 -- 172.21.15.133:0/1944425946 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0b2620 con 0x7f303c061f30 2021-01-03T13:03:14.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f303b7fe700 1 --2- 172.21.15.133:0/1944425946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f303c061f30 0x7f303c062310 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f302c002f30 tx=0x7f302c006e80).ready entity=mon.1 client_cookie=e582734098b30fb3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:14.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f303a7fc700 1 -- 172.21.15.133:0/1944425946 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302c009640 con 0x7f303c061f30 2021-01-03T13:03:14.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f303a7fc700 1 -- 172.21.15.133:0/1944425946 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c0097a0 con 0x7f303c061f30 2021-01-03T13:03:14.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f303a7fc700 1 -- 172.21.15.133:0/1944425946 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302c009b00 con 0x7f303c061f30 2021-01-03T13:03:14.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f3041aef700 1 -- 172.21.15.133:0/1944425946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f303c061f30 msgr2=0x7f303c062310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.687+0000 7f3041aef700 1 --2- 172.21.15.133:0/1944425946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f303c061f30 0x7f303c062310 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f302c002f30 tx=0x7f302c006e80).stop 2021-01-03T13:03:14.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3041aef700 1 -- 172.21.15.133:0/1944425946 shutdown_connections 2021-01-03T13:03:14.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3041aef700 1 --2- 172.21.15.133:0/1944425946 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f303c13d060 0x7f303c143100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3041aef700 1 --2- 172.21.15.133:0/1944425946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f303c061f30 0x7f303c062310 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3041aef700 1 --2- 172.21.15.133:0/1944425946 >> v2:172.21.15.16:3300/0 conn(0x7f303c060920 0x7f303c13cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3041aef700 1 -- 172.21.15.133:0/1944425946 >> 172.21.15.133:0/1944425946 conn(0x7f303c0b6db0 msgr2=0x7f303c061820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:14.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3041aef700 1 -- 172.21.15.133:0/1944425946 shutdown_connections 2021-01-03T13:03:14.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3041aef700 1 -- 172.21.15.133:0/1944425946 wait complete. 2021-01-03T13:03:14.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3041aef700 1 Processor -- start 2021-01-03T13:03:14.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3041aef700 1 -- start start 2021-01-03T13:03:14.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3041aef700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f303c060920 0x7f303c149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3041aef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f303c061f30 0x7f303c152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3041aef700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f303c13d060 0x7f303c152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3041aef700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c135420 con 0x7f303c13d060 2021-01-03T13:03:14.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3041aef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c136d40 con 0x7f303c061f30 2021-01-03T13:03:14.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3041aef700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c135a20 con 0x7f303c060920 2021-01-03T13:03:14.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f303affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f303c061f30 0x7f303c152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f303affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f303c061f30 0x7f303c152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35138/0 (socket says 172.21.15.133:35138) 2021-01-03T13:03:14.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f303affd700 1 -- 172.21.15.133:0/3936848140 learned_addr learned my addr 172.21.15.133:0/3936848140 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:14.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f303b7fe700 1 --2- 172.21.15.133:0/3936848140 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f303c060920 0x7f303c149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f303bfff700 1 --2- 172.21.15.133:0/3936848140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f303c13d060 0x7f303c152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f303affd700 1 -- 172.21.15.133:0/3936848140 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f303c060920 msgr2=0x7f303c149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f303affd700 1 --2- 172.21.15.133:0/3936848140 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f303c060920 0x7f303c149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f303affd700 1 -- 172.21.15.133:0/3936848140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f303c13d060 msgr2=0x7f303c152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f303affd700 1 --2- 172.21.15.133:0/3936848140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f303c13d060 0x7f303c152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f303affd700 1 -- 172.21.15.133:0/3936848140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c135cc0 con 0x7f303c061f30 2021-01-03T13:03:14.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f303affd700 1 --2- 172.21.15.133:0/3936848140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f303c061f30 0x7f303c152380 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f302400c000 tx=0x7f3024006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:14.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3038ff9700 1 -- 172.21.15.133:0/3936848140 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302400ca10 con 0x7f303c061f30 2021-01-03T13:03:14.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3038ff9700 1 -- 172.21.15.133:0/3936848140 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302400cb70 con 0x7f303c061f30 2021-01-03T13:03:14.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3041aef700 1 -- 172.21.15.133:0/3936848140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303c135f60 con 0x7f303c061f30 2021-01-03T13:03:14.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3038ff9700 1 -- 172.21.15.133:0/3936848140 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30240123f0 con 0x7f303c061f30 2021-01-03T13:03:14.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.691+0000 7f3041aef700 1 -- 172.21.15.133:0/3936848140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303c152d60 con 0x7f303c061f30 2021-01-03T13:03:14.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.695+0000 7f3041aef700 1 -- 172.21.15.133:0/3936848140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303c144ed0 con 0x7f303c061f30 2021-01-03T13:03:14.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.695+0000 7f3038ff9700 1 -- 172.21.15.133:0/3936848140 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3024012550 con 0x7f303c061f30 2021-01-03T13:03:14.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.695+0000 7f3038ff9700 1 --2- 172.21.15.133:0/3936848140 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30200553f0 0x7f30200578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:14.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.695+0000 7f303b7fe700 1 --2- 172.21.15.133:0/3936848140 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30200553f0 0x7f30200578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:14.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.695+0000 7f3038ff9700 1 -- 172.21.15.133:0/3936848140 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f302406e220 con 0x7f303c061f30 2021-01-03T13:03:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.695+0000 7f303b7fe700 1 --2- 172.21.15.133:0/3936848140 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30200553f0 0x7f30200578b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f302c01b000 tx=0x7f302c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.703+0000 7f3038ff9700 1 -- 172.21.15.133:0/3936848140 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f30240444c0 con 0x7f303c061f30 2021-01-03T13:03:14.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.883+0000 7f3041aef700 1 -- 172.21.15.133:0/3936848140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f303c057300 con 0x7f303c061f30 2021-01-03T13:03:14.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.999+0000 7f3038ff9700 1 -- 172.21.15.133:0/3936848140 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3024047ae0 con 0x7f303c061f30 2021-01-03T13:03:14.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.999+0000 7f3041aef700 1 -- 172.21.15.133:0/3936848140 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30200553f0 msgr2=0x7f30200578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.999+0000 7f3041aef700 1 --2- 172.21.15.133:0/3936848140 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30200553f0 0x7f30200578b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f302c01b000 tx=0x7f302c015000).stop 2021-01-03T13:03:14.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.999+0000 7f3041aef700 1 -- 172.21.15.133:0/3936848140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f303c061f30 msgr2=0x7f303c152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:14.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.999+0000 7f3041aef700 1 --2- 172.21.15.133:0/3936848140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f303c061f30 0x7f303c152380 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f302400c000 tx=0x7f3024006dc0).stop 2021-01-03T13:03:14.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.999+0000 7f3041aef700 1 -- 172.21.15.133:0/3936848140 shutdown_connections 2021-01-03T13:03:14.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.999+0000 7f3041aef700 1 --2- 172.21.15.133:0/3936848140 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30200553f0 0x7f30200578b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.999+0000 7f3041aef700 1 --2- 172.21.15.133:0/3936848140 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f303c13d060 0x7f303c152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.999+0000 7f3041aef700 1 --2- 172.21.15.133:0/3936848140 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f303c060920 0x7f303c149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.999+0000 7f3041aef700 1 --2- 172.21.15.133:0/3936848140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f303c061f30 0x7f303c152380 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:14.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.999+0000 7f3041aef700 1 -- 172.21.15.133:0/3936848140 >> 172.21.15.133:0/3936848140 conn(0x7f303c0b6db0 msgr2=0x7f303c0b2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:14.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.999+0000 7f3041aef700 1 -- 172.21.15.133:0/3936848140 shutdown_connections 2021-01-03T13:03:14.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:14.999+0000 7f3041aef700 1 -- 172.21.15.133:0/3936848140 wait complete. 2021-01-03T13:03:15.009 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:03:15.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20b5598700 1 Processor -- start 2021-01-03T13:03:15.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20b5598700 1 -- start start 2021-01-03T13:03:15.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20b5598700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20b00a7570 0x7f20b00671e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20b5598700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f20b00b1b20 0x7f20b00676d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20b5598700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b00b1110 con 0x7f20b00b2350 2021-01-03T13:03:15.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20b5598700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b00a7cb0 con 0x7f20b00a7570 2021-01-03T13:03:15.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20b5598700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00b0520 con 0x7f20b00b1b20 2021-01-03T13:03:15.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20b4d97700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f20b00b1b20 0x7f20b00676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20af7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20b00a7570 0x7f20b00671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20b4d97700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f20b00b1b20 0x7f20b00676d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:43450/0 (socket says 172.21.15.133:43450) 2021-01-03T13:03:15.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20af7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20b00a7570 0x7f20b00671e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:33686/0 (socket says 172.21.15.133:33686) 2021-01-03T13:03:15.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20b4d97700 1 -- 172.21.15.133:0/914268141 learned_addr learned my addr 172.21.15.133:0/914268141 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:15.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20affff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f20b00b2350 0x7f20b014a8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:34904/0 (socket says 172.21.15.133:34904) 2021-01-03T13:03:15.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20af7fe700 1 -- 172.21.15.133:0/914268141 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f20b00b1b20 msgr2=0x7f20b00676d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:15.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20af7fe700 1 --2- 172.21.15.133:0/914268141 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f20b00b1b20 0x7f20b00676d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20af7fe700 1 -- 172.21.15.133:0/914268141 >> v1:172.21.15.16:6789/0 conn(0x7f20b00b2350 legacy=0x7f20b014a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:15.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20af7fe700 1 -- 172.21.15.133:0/914268141 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b00b0bd0 con 0x7f20b00a7570 2021-01-03T13:03:15.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20aeffd700 1 -- 172.21.15.133:0/914268141 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269917590 0 0) 0x7f20b00b1110 con 0x7f20b00b2350 2021-01-03T13:03:15.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.119+0000 7f20af7fe700 1 --2- 172.21.15.133:0/914268141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20b00a7570 0x7f20b00671e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f20a0002f30 tx=0x7f20a0006dc0).ready entity=mon.0 client_cookie=4e88aa09a2855a66 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:15.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.123+0000 7f20aeffd700 1 -- 172.21.15.133:0/914268141 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a0009760 con 0x7f20b00a7570 2021-01-03T13:03:15.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.123+0000 7f20aeffd700 1 -- 172.21.15.133:0/914268141 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a00098c0 con 0x7f20b00a7570 2021-01-03T13:03:15.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.123+0000 7f20aeffd700 1 -- 172.21.15.133:0/914268141 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a0009c20 con 0x7f20b00a7570 2021-01-03T13:03:15.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.123+0000 7f20b5598700 1 -- 172.21.15.133:0/914268141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20b00a7570 msgr2=0x7f20b00671e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:15.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.123+0000 7f20b5598700 1 --2- 172.21.15.133:0/914268141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20b00a7570 0x7f20b00671e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f20a0002f30 tx=0x7f20a0006dc0).stop 2021-01-03T13:03:15.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.123+0000 7f20b5598700 1 -- 172.21.15.133:0/914268141 shutdown_connections 2021-01-03T13:03:15.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.123+0000 7f20b5598700 1 --2- 172.21.15.133:0/914268141 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f20b00b1b20 0x7f20b00676d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.123+0000 7f20b5598700 1 --2- 172.21.15.133:0/914268141 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20b00a7570 0x7f20b00671e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.123+0000 7f20b5598700 1 -- 172.21.15.133:0/914268141 >> 172.21.15.133:0/914268141 conn(0x7f20b006b050 msgr2=0x7f20b0060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.123+0000 7f20b5598700 1 -- 172.21.15.133:0/914268141 shutdown_connections 2021-01-03T13:03:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.123+0000 7f20b5598700 1 -- 172.21.15.133:0/914268141 wait complete. 2021-01-03T13:03:15.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.123+0000 7f20b5598700 1 Processor -- start 2021-01-03T13:03:15.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.123+0000 7f20b5598700 1 -- start start 2021-01-03T13:03:15.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20b5598700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f20b00a7570 0x7f20b0148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20b5598700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20b00b1b20 0x7f20b014cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20b5598700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20b00b2350 0x7f20b014d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20b5598700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b014d900 con 0x7f20b00b2350 2021-01-03T13:03:15.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20b5598700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0144a30 con 0x7f20b00b1b20 2021-01-03T13:03:15.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20b5598700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00b2990 con 0x7f20b00a7570 2021-01-03T13:03:15.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20af7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20b00b1b20 0x7f20b014cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20af7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20b00b1b20 0x7f20b014cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35152/0 (socket says 172.21.15.133:35152) 2021-01-03T13:03:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20af7fe700 1 -- 172.21.15.133:0/923610993 learned_addr learned my addr 172.21.15.133:0/923610993 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20affff700 1 --2- 172.21.15.133:0/923610993 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f20b00a7570 0x7f20b0148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20b4d97700 1 --2- 172.21.15.133:0/923610993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20b00b2350 0x7f20b014d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20af7fe700 1 -- 172.21.15.133:0/923610993 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f20b00a7570 msgr2=0x7f20b0148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20af7fe700 1 --2- 172.21.15.133:0/923610993 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f20b00a7570 0x7f20b0148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20af7fe700 1 -- 172.21.15.133:0/923610993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20b00b2350 msgr2=0x7f20b014d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20af7fe700 1 --2- 172.21.15.133:0/923610993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20b00b2350 0x7f20b014d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20af7fe700 1 -- 172.21.15.133:0/923610993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b00aac20 con 0x7f20b00b1b20 2021-01-03T13:03:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20b4d97700 1 --2- 172.21.15.133:0/923610993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20b00b2350 0x7f20b014d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:15.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20affff700 1 --2- 172.21.15.133:0/923610993 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f20b00a7570 0x7f20b0148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:15.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20af7fe700 1 --2- 172.21.15.133:0/923610993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20b00b1b20 0x7f20b014cf20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f20a0002f30 tx=0x7f20a0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:15.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20ad7fa700 1 -- 172.21.15.133:0/923610993 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a0011b80 con 0x7f20b00b1b20 2021-01-03T13:03:15.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20ad7fa700 1 -- 172.21.15.133:0/923610993 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a0011ce0 con 0x7f20b00b1b20 2021-01-03T13:03:15.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20ad7fa700 1 -- 172.21.15.133:0/923610993 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20a001d630 con 0x7f20b00b1b20 2021-01-03T13:03:15.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20b5598700 1 -- 172.21.15.133:0/923610993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b014dcf0 con 0x7f20b00b1b20 2021-01-03T13:03:15.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20b5598700 1 -- 172.21.15.133:0/923610993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b014b670 con 0x7f20b00b1b20 2021-01-03T13:03:15.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.127+0000 7f20b5598700 1 -- 172.21.15.133:0/923610993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b0057300 con 0x7f20b00b1b20 2021-01-03T13:03:15.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.131+0000 7f20ad7fa700 1 -- 172.21.15.133:0/923610993 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f20a0017070 con 0x7f20b00b1b20 2021-01-03T13:03:15.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.131+0000 7f20ad7fa700 1 --2- 172.21.15.133:0/923610993 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2094055470 0x7f2094057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.131+0000 7f20ad7fa700 1 -- 172.21.15.133:0/923610993 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f20a006ebf0 con 0x7f20b00b1b20 2021-01-03T13:03:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.131+0000 7f20affff700 1 --2- 172.21.15.133:0/923610993 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2094055470 0x7f2094057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.131+0000 7f20affff700 1 --2- 172.21.15.133:0/923610993 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2094055470 0x7f2094057930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f209800b000 tx=0x7f20980070e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:15.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.139+0000 7f20ad7fa700 1 -- 172.21.15.133:0/923610993 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f20a0044e50 con 0x7f20b00b1b20 2021-01-03T13:03:15.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.323+0000 7f20b5598700 1 -- 172.21.15.133:0/923610993 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20b00b4800 con 0x7f20b00b1b20 2021-01-03T13:03:15.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.323+0000 7f20ad7fa700 1 -- 172.21.15.133:0/923610993 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2499 (secure 0 0 0) 0x7f20a0022020 con 0x7f20b00b1b20 2021-01-03T13:03:15.321 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:15.321 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3007157007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3007157007},{"type":"v1","addr":"172.21.15.133:6837","nonce":3007157007}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24},{"gid":5826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/1513472080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1513472080},{"type":"v1","addr":"172.21.15.16:6833","nonce":1513472080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:03:13.979157+0000","modified":"2021-01-03T13:03:14.982718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5881":{"gid":5881,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/1530122021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1530122021},{"type":"v1","addr":"172.21.15.133:6835","nonce":1530122021}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-01-03T13:03:15.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.327+0000 7f20b5598700 1 -- 172.21.15.133:0/923610993 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2094055470 msgr2=0x7f2094057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.327+0000 7f20b5598700 1 --2- 172.21.15.133:0/923610993 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2094055470 0x7f2094057930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f209800b000 tx=0x7f20980070e0).stop 2021-01-03T13:03:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.327+0000 7f20b5598700 1 -- 172.21.15.133:0/923610993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20b00b1b20 msgr2=0x7f20b014cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.327+0000 7f20b5598700 1 --2- 172.21.15.133:0/923610993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20b00b1b20 0x7f20b014cf20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f20a0002f30 tx=0x7f20a0015000).stop 2021-01-03T13:03:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.327+0000 7f20b5598700 1 -- 172.21.15.133:0/923610993 shutdown_connections 2021-01-03T13:03:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.327+0000 7f20b5598700 1 --2- 172.21.15.133:0/923610993 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2094055470 0x7f2094057930 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.327+0000 7f20b5598700 1 --2- 172.21.15.133:0/923610993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20b00b2350 0x7f20b014d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.327+0000 7f20b5598700 1 --2- 172.21.15.133:0/923610993 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f20b00a7570 0x7f20b0148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.327+0000 7f20b5598700 1 --2- 172.21.15.133:0/923610993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20b00b1b20 0x7f20b014cf20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.327+0000 7f20b5598700 1 -- 172.21.15.133:0/923610993 >> 172.21.15.133:0/923610993 conn(0x7f20b006b050 msgr2=0x7f20b00ad2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.327+0000 7f20b5598700 1 -- 172.21.15.133:0/923610993 shutdown_connections 2021-01-03T13:03:15.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.327+0000 7f20b5598700 1 -- 172.21.15.133:0/923610993 wait complete. 2021-01-03T13:03:15.325 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 27 2021-01-03T13:03:15.334 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:03:15.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.443+0000 7f8ad97e8700 1 Processor -- start 2021-01-03T13:03:15.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.443+0000 7f8ad97e8700 1 -- start start 2021-01-03T13:03:15.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.443+0000 7f8ad97e8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ad40b9b60 0x7f8ad40b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.443+0000 7f8ad97e8700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8ad40b4e10 0x7f8ad4146b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.443+0000 7f8ad97e8700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad4147030 con 0x7f8ad40b4980 2021-01-03T13:03:15.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.443+0000 7f8ad97e8700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad40aed30 con 0x7f8ad40b4e10 2021-01-03T13:03:15.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.443+0000 7f8ad97e8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad40605f0 con 0x7f8ad40b9b60 2021-01-03T13:03:15.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.443+0000 7f8ad3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ad40b9b60 0x7f8ad40b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.443+0000 7f8ad3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ad40b9b60 0x7f8ad40b9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35158/0 (socket says 172.21.15.133:35158) 2021-01-03T13:03:15.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.443+0000 7f8ad3fff700 1 -- 172.21.15.133:0/1098831372 learned_addr learned my addr 172.21.15.133:0/1098831372 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:15.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.443+0000 7f8ad8fe7700 1 --2- 172.21.15.133:0/1098831372 >> v2:172.21.15.16:3300/0 conn(0x7f8ad40b4e10 0x7f8ad4146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad3fff700 1 -- 172.21.15.133:0/1098831372 >> v2:172.21.15.16:3300/0 conn(0x7f8ad40b4e10 msgr2=0x7f8ad4146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:15.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad3fff700 1 --2- 172.21.15.133:0/1098831372 >> v2:172.21.15.16:3300/0 conn(0x7f8ad40b4e10 0x7f8ad4146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad3fff700 1 -- 172.21.15.133:0/1098831372 >> v1:172.21.15.16:6789/0 conn(0x7f8ad40b4980 legacy=0x7f8ad4146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:15.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad3fff700 1 -- 172.21.15.133:0/1098831372 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad40600b0 con 0x7f8ad40b9b60 2021-01-03T13:03:15.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad3fff700 1 --2- 172.21.15.133:0/1098831372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad40b9b60 0x7f8ad40b9f40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f8ac4002f30 tx=0x7f8ac4006e80).ready entity=mon.1 client_cookie=983c016d3615d9da server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:15.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad2ffd700 1 -- 172.21.15.133:0/1098831372 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ac40097f0 con 0x7f8ad40b9b60 2021-01-03T13:03:15.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad2ffd700 1 -- 172.21.15.133:0/1098831372 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac4009950 con 0x7f8ad40b9b60 2021-01-03T13:03:15.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad2ffd700 1 -- 172.21.15.133:0/1098831372 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ac4009cb0 con 0x7f8ad40b9b60 2021-01-03T13:03:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad97e8700 1 -- 172.21.15.133:0/1098831372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad40b9b60 msgr2=0x7f8ad40b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad97e8700 1 --2- 172.21.15.133:0/1098831372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad40b9b60 0x7f8ad40b9f40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f8ac4002f30 tx=0x7f8ac4006e80).stop 2021-01-03T13:03:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad97e8700 1 -- 172.21.15.133:0/1098831372 shutdown_connections 2021-01-03T13:03:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad97e8700 1 --2- 172.21.15.133:0/1098831372 >> v2:172.21.15.16:3300/0 conn(0x7f8ad40b4e10 0x7f8ad4146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad97e8700 1 --2- 172.21.15.133:0/1098831372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad40b9b60 0x7f8ad40b9f40 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad97e8700 1 -- 172.21.15.133:0/1098831372 >> 172.21.15.133:0/1098831372 conn(0x7f8ad40b69e0 msgr2=0x7f8ad40b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:15.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad97e8700 1 -- 172.21.15.133:0/1098831372 shutdown_connections 2021-01-03T13:03:15.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad97e8700 1 -- 172.21.15.133:0/1098831372 wait complete. 2021-01-03T13:03:15.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad97e8700 1 Processor -- start 2021-01-03T13:03:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.447+0000 7f8ad97e8700 1 -- start start 2021-01-03T13:03:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad97e8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8ad40b4980 0x7f8ad409f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad97e8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad40b4e10 0x7f8ad40b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad97e8700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad40b9b60 0x7f8ad40b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad97e8700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad40b15d0 con 0x7f8ad40b9b60 2021-01-03T13:03:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad97e8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad40b0d70 con 0x7f8ad40b4e10 2021-01-03T13:03:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad97e8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad41485c0 con 0x7f8ad40b4980 2021-01-03T13:03:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad40b4e10 0x7f8ad40b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad40b4e10 0x7f8ad40b1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35166/0 (socket says 172.21.15.133:35166) 2021-01-03T13:03:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad37fe700 1 -- 172.21.15.133:0/118543736 learned_addr learned my addr 172.21.15.133:0/118543736 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:15.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad3fff700 1 --2- 172.21.15.133:0/118543736 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8ad40b4980 0x7f8ad409f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad8fe7700 1 --2- 172.21.15.133:0/118543736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad40b9b60 0x7f8ad40b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad37fe700 1 -- 172.21.15.133:0/118543736 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8ad40b4980 msgr2=0x7f8ad409f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:15.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad37fe700 1 --2- 172.21.15.133:0/118543736 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8ad40b4980 0x7f8ad409f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad37fe700 1 -- 172.21.15.133:0/118543736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad40b9b60 msgr2=0x7f8ad40b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:15.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad37fe700 1 --2- 172.21.15.133:0/118543736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad40b9b60 0x7f8ad40b22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad37fe700 1 -- 172.21.15.133:0/118543736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad409de60 con 0x7f8ad40b4e10 2021-01-03T13:03:15.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad3fff700 1 --2- 172.21.15.133:0/118543736 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8ad40b4980 0x7f8ad409f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:15.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad8fe7700 1 --2- 172.21.15.133:0/118543736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad40b9b60 0x7f8ad40b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:15.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad37fe700 1 --2- 172.21.15.133:0/118543736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad40b4e10 0x7f8ad40b1de0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f8ad41498e0 tx=0x7f8abc007c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:15.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad17fa700 1 -- 172.21.15.133:0/118543736 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8abc00e4a0 con 0x7f8ad40b4e10 2021-01-03T13:03:15.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad17fa700 1 -- 172.21.15.133:0/118543736 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8abc00e600 con 0x7f8ad40b4e10 2021-01-03T13:03:15.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad97e8700 1 -- 172.21.15.133:0/118543736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad41487f0 con 0x7f8ad40b4e10 2021-01-03T13:03:15.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad17fa700 1 -- 172.21.15.133:0/118543736 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8abc00e960 con 0x7f8ad40b4e10 2021-01-03T13:03:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad97e8700 1 -- 172.21.15.133:0/118543736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad409e100 con 0x7f8ad40b4e10 2021-01-03T13:03:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.451+0000 7f8ad97e8700 1 -- 172.21.15.133:0/118543736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad409daf0 con 0x7f8ad40b4e10 2021-01-03T13:03:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.455+0000 7f8ad17fa700 1 -- 172.21.15.133:0/118543736 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8abc010030 con 0x7f8ad40b4e10 2021-01-03T13:03:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.455+0000 7f8ad17fa700 1 --2- 172.21.15.133:0/118543736 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ab8055330 0x7f8ab80577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.455+0000 7f8ad17fa700 1 -- 172.21.15.133:0/118543736 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8abc06de90 con 0x7f8ad40b4e10 2021-01-03T13:03:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.455+0000 7f8ad3fff700 1 --2- 172.21.15.133:0/118543736 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ab8055330 0x7f8ab80577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.455+0000 7f8ad3fff700 1 --2- 172.21.15.133:0/118543736 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ab8055330 0x7f8ab80577f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f8ac401a000 tx=0x7f8ac4015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:15.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.463+0000 7f8ad17fa700 1 -- 172.21.15.133:0/118543736 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8abc044190 con 0x7f8ad40b4e10 2021-01-03T13:03:15.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.599+0000 7f8ad97e8700 1 -- 172.21.15.133:0/118543736 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ad4148980 con 0x7f8ad40b4e10 2021-01-03T13:03:15.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.599+0000 7f8ad17fa700 1 -- 172.21.15.133:0/118543736 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16102 (secure 0 0 0) 0x7f8abc0477b0 con 0x7f8ad40b4e10 2021-01-03T13:03:15.596 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:15.597 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":66,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:03:14.981641+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:03:11.555772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-01-03T13:03:12.829370+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:03:15.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.603+0000 7f8ad97e8700 1 -- 172.21.15.133:0/118543736 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ab8055330 msgr2=0x7f8ab80577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:15.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.603+0000 7f8ad97e8700 1 --2- 172.21.15.133:0/118543736 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ab8055330 0x7f8ab80577f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f8ac401a000 tx=0x7f8ac4015000).stop 2021-01-03T13:03:15.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.603+0000 7f8ad97e8700 1 -- 172.21.15.133:0/118543736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad40b4e10 msgr2=0x7f8ad40b1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:15.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.603+0000 7f8ad97e8700 1 --2- 172.21.15.133:0/118543736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad40b4e10 0x7f8ad40b1de0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f8ad41498e0 tx=0x7f8abc007c20).stop 2021-01-03T13:03:15.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.603+0000 7f8ad97e8700 1 -- 172.21.15.133:0/118543736 shutdown_connections 2021-01-03T13:03:15.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.603+0000 7f8ad97e8700 1 --2- 172.21.15.133:0/118543736 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ab8055330 0x7f8ab80577f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.603+0000 7f8ad97e8700 1 --2- 172.21.15.133:0/118543736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8ad40b9b60 0x7f8ad40b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.603+0000 7f8ad97e8700 1 --2- 172.21.15.133:0/118543736 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8ad40b4980 0x7f8ad409f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.603+0000 7f8ad97e8700 1 --2- 172.21.15.133:0/118543736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ad40b4e10 0x7f8ad40b1de0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.603+0000 7f8ad97e8700 1 -- 172.21.15.133:0/118543736 >> 172.21.15.133:0/118543736 conn(0x7f8ad40b69e0 msgr2=0x7f8ad4142070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:15.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.603+0000 7f8ad97e8700 1 -- 172.21.15.133:0/118543736 shutdown_connections 2021-01-03T13:03:15.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.603+0000 7f8ad97e8700 1 -- 172.21.15.133:0/118543736 wait complete. 2021-01-03T13:03:15.611 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:03:15.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.739+0000 7fc445181700 1 Processor -- start 2021-01-03T13:03:15.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.739+0000 7fc445181700 1 -- start start 2021-01-03T13:03:15.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.739+0000 7fc445181700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4400adc10 0x7fc440067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.739+0000 7fc445181700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc440062450 0x7fc4400b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.739+0000 7fc445181700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4400b3190 0x7fc440025140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.739+0000 7fc445181700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4400b1930 con 0x7fc440062450 2021-01-03T13:03:15.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.739+0000 7fc445181700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4400adff0 con 0x7fc4400adc10 2021-01-03T13:03:15.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.739+0000 7fc445181700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44005fb80 con 0x7fc4400b3190 2021-01-03T13:03:15.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.739+0000 7fc444980700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4400adc10 0x7fc440067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.739+0000 7fc444980700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4400adc10 0x7fc440067cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35172/0 (socket says 172.21.15.133:35172) 2021-01-03T13:03:15.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc444980700 1 -- 172.21.15.133:0/1925970212 learned_addr learned my addr 172.21.15.133:0/1925970212 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:15.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc43ffff700 1 --2- 172.21.15.133:0/1925970212 >> v2:172.21.15.16:3300/0 conn(0x7fc440062450 0x7fc4400b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc4463e3700 1 --2- 172.21.15.133:0/1925970212 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4400b3190 0x7fc440025140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc444980700 1 -- 172.21.15.133:0/1925970212 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4400b3190 msgr2=0x7fc440025140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc444980700 1 --2- 172.21.15.133:0/1925970212 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4400b3190 0x7fc440025140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc444980700 1 -- 172.21.15.133:0/1925970212 >> v2:172.21.15.16:3300/0 conn(0x7fc440062450 msgr2=0x7fc4400b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc444980700 1 --2- 172.21.15.133:0/1925970212 >> v2:172.21.15.16:3300/0 conn(0x7fc440062450 0x7fc4400b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc444980700 1 -- 172.21.15.133:0/1925970212 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44005fed0 con 0x7fc4400adc10 2021-01-03T13:03:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc444980700 1 --2- 172.21.15.133:0/1925970212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4400adc10 0x7fc440067cb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fc430002f30 tx=0x7fc430006e80).ready entity=mon.1 client_cookie=78fc4559906a9cb7 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:15.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc43f7fe700 1 -- 172.21.15.133:0/1925970212 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4300097f0 con 0x7fc4400adc10 2021-01-03T13:03:15.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc43f7fe700 1 -- 172.21.15.133:0/1925970212 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc430009950 con 0x7fc4400adc10 2021-01-03T13:03:15.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc43f7fe700 1 -- 172.21.15.133:0/1925970212 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc430009cb0 con 0x7fc4400adc10 2021-01-03T13:03:15.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc445181700 1 -- 172.21.15.133:0/1925970212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4400adc10 msgr2=0x7fc440067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:15.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc445181700 1 --2- 172.21.15.133:0/1925970212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4400adc10 0x7fc440067cb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fc430002f30 tx=0x7fc430006e80).stop 2021-01-03T13:03:15.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc445181700 1 -- 172.21.15.133:0/1925970212 shutdown_connections 2021-01-03T13:03:15.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc445181700 1 --2- 172.21.15.133:0/1925970212 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4400b3190 0x7fc440025140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc445181700 1 --2- 172.21.15.133:0/1925970212 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4400adc10 0x7fc440067cb0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc445181700 1 --2- 172.21.15.133:0/1925970212 >> v2:172.21.15.16:3300/0 conn(0x7fc440062450 0x7fc4400b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc445181700 1 -- 172.21.15.133:0/1925970212 >> 172.21.15.133:0/1925970212 conn(0x7fc440060d10 msgr2=0x7fc440061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc445181700 1 -- 172.21.15.133:0/1925970212 shutdown_connections 2021-01-03T13:03:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.743+0000 7fc445181700 1 -- 172.21.15.133:0/1925970212 wait complete. 2021-01-03T13:03:15.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc445181700 1 Processor -- start 2021-01-03T13:03:15.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc445181700 1 -- start start 2021-01-03T13:03:15.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc445181700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc440062450 0x7fc440128580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc445181700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4400adc10 0x7fc440154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc445181700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4400b3190 0x7fc4400ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc445181700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44012c4b0 con 0x7fc440062450 2021-01-03T13:03:15.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc445181700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc440066fe0 con 0x7fc4400adc10 2021-01-03T13:03:15.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc445181700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc440067280 con 0x7fc4400b3190 2021-01-03T13:03:15.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc43ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4400adc10 0x7fc440154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc43ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4400adc10 0x7fc440154020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35180/0 (socket says 172.21.15.133:35180) 2021-01-03T13:03:15.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc43ffff700 1 -- 172.21.15.133:0/616454932 learned_addr learned my addr 172.21.15.133:0/616454932 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:15.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc4463e3700 1 --2- 172.21.15.133:0/616454932 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4400b3190 0x7fc4400ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc444980700 1 --2- 172.21.15.133:0/616454932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc440062450 0x7fc440128580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc43ffff700 1 -- 172.21.15.133:0/616454932 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4400b3190 msgr2=0x7fc4400ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:15.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc43ffff700 1 --2- 172.21.15.133:0/616454932 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4400b3190 0x7fc4400ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc43ffff700 1 -- 172.21.15.133:0/616454932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc440062450 msgr2=0x7fc440128580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:15.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc43ffff700 1 --2- 172.21.15.133:0/616454932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc440062450 0x7fc440128580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc43ffff700 1 -- 172.21.15.133:0/616454932 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4401280e0 con 0x7fc4400adc10 2021-01-03T13:03:15.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc43ffff700 1 --2- 172.21.15.133:0/616454932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4400adc10 0x7fc440154020 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fc434003070 tx=0x7fc434008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:15.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc43d7fa700 1 -- 172.21.15.133:0/616454932 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc434009790 con 0x7fc4400adc10 2021-01-03T13:03:15.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc43d7fa700 1 -- 172.21.15.133:0/616454932 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4340098f0 con 0x7fc4400adc10 2021-01-03T13:03:15.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc43d7fa700 1 -- 172.21.15.133:0/616454932 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc434009c50 con 0x7fc4400adc10 2021-01-03T13:03:15.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc445181700 1 -- 172.21.15.133:0/616454932 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc440066c60 con 0x7fc4400adc10 2021-01-03T13:03:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.747+0000 7fc445181700 1 -- 172.21.15.133:0/616454932 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4400aee80 con 0x7fc4400adc10 2021-01-03T13:03:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.751+0000 7fc445181700 1 -- 172.21.15.133:0/616454932 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc440057300 con 0x7fc4400adc10 2021-01-03T13:03:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.751+0000 7fc43d7fa700 1 -- 172.21.15.133:0/616454932 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc434013480 con 0x7fc4400adc10 2021-01-03T13:03:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.751+0000 7fc43d7fa700 1 --2- 172.21.15.133:0/616454932 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc420055440 0x7fc420057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.751+0000 7fc444980700 1 --2- 172.21.15.133:0/616454932 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc420055440 0x7fc420057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:15.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.751+0000 7fc43d7fa700 1 -- 172.21.15.133:0/616454932 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc43406e310 con 0x7fc4400adc10 2021-01-03T13:03:15.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.751+0000 7fc444980700 1 --2- 172.21.15.133:0/616454932 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc420055440 0x7fc420057900 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fc43001c000 tx=0x7fc430015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:15.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.759+0000 7fc43d7fa700 1 -- 172.21.15.133:0/616454932 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc4340445b0 con 0x7fc4400adc10 2021-01-03T13:03:15.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.939+0000 7fc445181700 1 -- 172.21.15.133:0/616454932 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fc440068660 con 0x7fc4400adc10 2021-01-03T13:03:15.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.947+0000 7fc43d7fa700 1 -- 172.21.15.133:0/616454932 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7fc434009db0 con 0x7fc4400adc10 2021-01-03T13:03:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.951+0000 7fc445181700 1 -- 172.21.15.133:0/616454932 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc420055440 msgr2=0x7fc420057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:15.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.951+0000 7fc445181700 1 --2- 172.21.15.133:0/616454932 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc420055440 0x7fc420057900 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fc43001c000 tx=0x7fc430015000).stop 2021-01-03T13:03:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.951+0000 7fc445181700 1 -- 172.21.15.133:0/616454932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4400adc10 msgr2=0x7fc440154020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.951+0000 7fc445181700 1 --2- 172.21.15.133:0/616454932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4400adc10 0x7fc440154020 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fc434003070 tx=0x7fc434008040).stop 2021-01-03T13:03:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.951+0000 7fc445181700 1 -- 172.21.15.133:0/616454932 shutdown_connections 2021-01-03T13:03:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.951+0000 7fc445181700 1 --2- 172.21.15.133:0/616454932 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc420055440 0x7fc420057900 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.951+0000 7fc445181700 1 --2- 172.21.15.133:0/616454932 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc440062450 0x7fc440128580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.951+0000 7fc445181700 1 --2- 172.21.15.133:0/616454932 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4400b3190 0x7fc4400ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.951+0000 7fc445181700 1 --2- 172.21.15.133:0/616454932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4400adc10 0x7fc440154020 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.951+0000 7fc445181700 1 -- 172.21.15.133:0/616454932 >> 172.21.15.133:0/616454932 conn(0x7fc440060d10 msgr2=0x7fc4400b0350 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.951+0000 7fc445181700 1 -- 172.21.15.133:0/616454932 shutdown_connections 2021-01-03T13:03:15.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:15.951+0000 7fc445181700 1 -- 172.21.15.133:0/616454932 wait complete. 2021-01-03T13:03:15.950 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2021-01-03T13:03:15.963 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:03:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.083+0000 7fae80843700 1 Processor -- start 2021-01-03T13:03:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.083+0000 7fae80843700 1 -- start start 2021-01-03T13:03:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae80843700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae7c0adc10 0x7fae7c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae80843700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fae7c062450 0x7fae7c0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae80843700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7c0adff0 con 0x7fae7c0b3190 2021-01-03T13:03:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae80843700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c0b1930 con 0x7fae7c062450 2021-01-03T13:03:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae80843700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c05fb80 con 0x7fae7c0adc10 2021-01-03T13:03:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae7bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae7c0adc10 0x7fae7c067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae81aa5700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fae7c0b3190 0x7fae7c025140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56222/0 (socket says 172.21.15.133:56222) 2021-01-03T13:03:16.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae81aa5700 1 -- 172.21.15.133:0/1466223839 learned_addr learned my addr 172.21.15.133:0/1466223839 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:16.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae7b7fe700 1 --2- 172.21.15.133:0/1466223839 >> v2:172.21.15.16:3300/0 conn(0x7fae7c062450 0x7fae7c0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:16.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae7bfff700 1 -- 172.21.15.133:0/1466223839 >> v2:172.21.15.16:3300/0 conn(0x7fae7c062450 msgr2=0x7fae7c0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:16.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae7bfff700 1 --2- 172.21.15.133:0/1466223839 >> v2:172.21.15.16:3300/0 conn(0x7fae7c062450 0x7fae7c0b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae7bfff700 1 -- 172.21.15.133:0/1466223839 >> v1:172.21.15.133:6789/0 conn(0x7fae7c0b3190 legacy=0x7fae7c025140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:16.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae7bfff700 1 -- 172.21.15.133:0/1466223839 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c05fed0 con 0x7fae7c0adc10 2021-01-03T13:03:16.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae7bfff700 1 --2- 172.21.15.133:0/1466223839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae7c0adc10 0x7fae7c067cb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fae640032b0 tx=0x7fae640091a0).ready entity=mon.1 client_cookie=fbeb67f748438896 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:16.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae7affd700 1 -- 172.21.15.133:0/1466223839 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae6400b9a0 con 0x7fae7c0adc10 2021-01-03T13:03:16.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae7affd700 1 -- 172.21.15.133:0/1466223839 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6400bb00 con 0x7fae7c0adc10 2021-01-03T13:03:16.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae7affd700 1 -- 172.21.15.133:0/1466223839 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae6400bc70 con 0x7fae7c0adc10 2021-01-03T13:03:16.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae80843700 1 -- 172.21.15.133:0/1466223839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae7c0adc10 msgr2=0x7fae7c067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:16.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae80843700 1 --2- 172.21.15.133:0/1466223839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae7c0adc10 0x7fae7c067cb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fae640032b0 tx=0x7fae640091a0).stop 2021-01-03T13:03:16.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae80843700 1 -- 172.21.15.133:0/1466223839 shutdown_connections 2021-01-03T13:03:16.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae80843700 1 --2- 172.21.15.133:0/1466223839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae7c0adc10 0x7fae7c067cb0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae80843700 1 --2- 172.21.15.133:0/1466223839 >> v2:172.21.15.16:3300/0 conn(0x7fae7c062450 0x7fae7c0b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae80843700 1 -- 172.21.15.133:0/1466223839 >> 172.21.15.133:0/1466223839 conn(0x7fae7c060d10 msgr2=0x7fae7c061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:16.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae80843700 1 -- 172.21.15.133:0/1466223839 shutdown_connections 2021-01-03T13:03:16.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.087+0000 7fae80843700 1 -- 172.21.15.133:0/1466223839 wait complete. 2021-01-03T13:03:16.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.091+0000 7fae80843700 1 Processor -- start 2021-01-03T13:03:16.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.091+0000 7fae80843700 1 -- start start 2021-01-03T13:03:16.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.091+0000 7fae80843700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae7c062450 0x7fae7c12dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:16.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.091+0000 7fae80843700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae7c0adc10 0x7fae7c071880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:16.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.091+0000 7fae80843700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae7c0b3190 0x7fae7c071d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:16.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.091+0000 7fae80843700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c12ec70 con 0x7fae7c062450 2021-01-03T13:03:16.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.091+0000 7fae80843700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c070360 con 0x7fae7c0adc10 2021-01-03T13:03:16.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.091+0000 7fae80843700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c071100 con 0x7fae7c0b3190 2021-01-03T13:03:16.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.091+0000 7fae7b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae7c0adc10 0x7fae7c071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:16.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.091+0000 7fae7b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae7c0adc10 0x7fae7c071880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35194/0 (socket says 172.21.15.133:35194) 2021-01-03T13:03:16.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.091+0000 7fae7b7fe700 1 -- 172.21.15.133:0/3152632684 learned_addr learned my addr 172.21.15.133:0/3152632684 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:16.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.091+0000 7fae7bfff700 1 --2- 172.21.15.133:0/3152632684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae7c062450 0x7fae7c12dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:16.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.091+0000 7fae81aa5700 1 --2- 172.21.15.133:0/3152632684 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae7c0b3190 0x7fae7c071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:16.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.091+0000 7fae7b7fe700 1 -- 172.21.15.133:0/3152632684 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae7c0b3190 msgr2=0x7fae7c071d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:16.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.091+0000 7fae7b7fe700 1 --2- 172.21.15.133:0/3152632684 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae7c0b3190 0x7fae7c071d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.095+0000 7fae7b7fe700 1 -- 172.21.15.133:0/3152632684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae7c062450 msgr2=0x7fae7c12dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:16.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.095+0000 7fae7b7fe700 1 --2- 172.21.15.133:0/3152632684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae7c062450 0x7fae7c12dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.095+0000 7fae7b7fe700 1 -- 172.21.15.133:0/3152632684 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c074480 con 0x7fae7c0adc10 2021-01-03T13:03:16.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.095+0000 7fae81aa5700 1 --2- 172.21.15.133:0/3152632684 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae7c0b3190 0x7fae7c071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:16.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.095+0000 7fae7b7fe700 1 --2- 172.21.15.133:0/3152632684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae7c0adc10 0x7fae7c071880 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fae6c00c000 tx=0x7fae6c006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:16.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.095+0000 7fae78ff9700 1 -- 172.21.15.133:0/3152632684 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae6c00ca10 con 0x7fae7c0adc10 2021-01-03T13:03:16.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.095+0000 7fae78ff9700 1 -- 172.21.15.133:0/3152632684 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c00cb70 con 0x7fae7c0adc10 2021-01-03T13:03:16.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.095+0000 7fae80843700 1 -- 172.21.15.133:0/3152632684 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c0713a0 con 0x7fae7c0adc10 2021-01-03T13:03:16.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.095+0000 7fae78ff9700 1 -- 172.21.15.133:0/3152632684 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae6c0123f0 con 0x7fae7c0adc10 2021-01-03T13:03:16.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.095+0000 7fae80843700 1 -- 172.21.15.133:0/3152632684 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c12e620 con 0x7fae7c0adc10 2021-01-03T13:03:16.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.095+0000 7fae80843700 1 -- 172.21.15.133:0/3152632684 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c057300 con 0x7fae7c0adc10 2021-01-03T13:03:16.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.095+0000 7fae78ff9700 1 -- 172.21.15.133:0/3152632684 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fae6c012550 con 0x7fae7c0adc10 2021-01-03T13:03:16.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.095+0000 7fae78ff9700 1 --2- 172.21.15.133:0/3152632684 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae60055320 0x7fae600577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:16.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.095+0000 7fae78ff9700 1 -- 172.21.15.133:0/3152632684 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fae6c06e3e0 con 0x7fae7c0adc10 2021-01-03T13:03:16.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.095+0000 7fae7bfff700 1 --2- 172.21.15.133:0/3152632684 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae60055320 0x7fae600577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:16.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.099+0000 7fae7bfff700 1 --2- 172.21.15.133:0/3152632684 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae60055320 0x7fae600577e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fae6401b000 tx=0x7fae64016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:16.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.103+0000 7fae78ff9700 1 -- 172.21.15.133:0/3152632684 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fae6c044680 con 0x7fae7c0adc10 2021-01-03T13:03:16.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.295+0000 7fae80843700 1 -- 172.21.15.133:0/3152632684 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fae7c068660 con 0x7fae7c0adc10 2021-01-03T13:03:16.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.303+0000 7fae78ff9700 1 -- 172.21.15.133:0/3152632684 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7fae6c047ca0 con 0x7fae7c0adc10 2021-01-03T13:03:16.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.303+0000 7fae80843700 1 -- 172.21.15.133:0/3152632684 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae60055320 msgr2=0x7fae600577e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:16.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.303+0000 7fae80843700 1 --2- 172.21.15.133:0/3152632684 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae60055320 0x7fae600577e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fae6401b000 tx=0x7fae64016000).stop 2021-01-03T13:03:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.303+0000 7fae80843700 1 -- 172.21.15.133:0/3152632684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae7c0adc10 msgr2=0x7fae7c071880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.303+0000 7fae80843700 1 --2- 172.21.15.133:0/3152632684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae7c0adc10 0x7fae7c071880 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fae6c00c000 tx=0x7fae6c006dc0).stop 2021-01-03T13:03:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.303+0000 7fae80843700 1 -- 172.21.15.133:0/3152632684 shutdown_connections 2021-01-03T13:03:16.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.303+0000 7fae80843700 1 --2- 172.21.15.133:0/3152632684 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae60055320 0x7fae600577e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.303+0000 7fae80843700 1 --2- 172.21.15.133:0/3152632684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae7c062450 0x7fae7c12dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.303+0000 7fae80843700 1 --2- 172.21.15.133:0/3152632684 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae7c0b3190 0x7fae7c071d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.303+0000 7fae80843700 1 --2- 172.21.15.133:0/3152632684 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae7c0adc10 0x7fae7c071880 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.303+0000 7fae80843700 1 -- 172.21.15.133:0/3152632684 >> 172.21.15.133:0/3152632684 conn(0x7fae7c060d10 msgr2=0x7fae7c0ae380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:16.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.303+0000 7fae80843700 1 -- 172.21.15.133:0/3152632684 shutdown_connections 2021-01-03T13:03:16.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.303+0000 7fae80843700 1 -- 172.21.15.133:0/3152632684 wait complete. 2021-01-03T13:03:16.303 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.1 2021-01-03T13:03:16.314 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:03:16.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d70a0f700 1 Processor -- start 2021-01-03T13:03:16.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d70a0f700 1 -- start start 2021-01-03T13:03:16.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d70a0f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d6c09cca0 0x7f5d6c060ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:16.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d70a0f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5d6c0b36a0 0x7f5d6c05f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:16.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d70a0f700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d6c09d080 con 0x7f5d6c05fad0 2021-01-03T13:03:16.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d70a0f700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6c147050 con 0x7f5d6c0b36a0 2021-01-03T13:03:16.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d70a0f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6c0adfa0 con 0x7f5d6c09cca0 2021-01-03T13:03:16.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d6ad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d6c09cca0 0x7f5d6c060ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:16.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d6ad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d6c09cca0 0x7f5d6c060ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35200/0 (socket says 172.21.15.133:35200) 2021-01-03T13:03:16.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d6ad9d700 1 -- 172.21.15.133:0/2581054700 learned_addr learned my addr 172.21.15.133:0/2581054700 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:16.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d6a59c700 1 --2- 172.21.15.133:0/2581054700 >> v2:172.21.15.16:3300/0 conn(0x7f5d6c0b36a0 0x7f5d6c05f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:16.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d6ad9d700 1 -- 172.21.15.133:0/2581054700 >> v2:172.21.15.16:3300/0 conn(0x7f5d6c0b36a0 msgr2=0x7f5d6c05f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:16.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d6ad9d700 1 --2- 172.21.15.133:0/2581054700 >> v2:172.21.15.16:3300/0 conn(0x7f5d6c0b36a0 0x7f5d6c05f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d6ad9d700 1 -- 172.21.15.133:0/2581054700 >> v1:172.21.15.16:6789/0 conn(0x7f5d6c05fad0 legacy=0x7f5d6c1442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:16.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d6ad9d700 1 -- 172.21.15.133:0/2581054700 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c147240 con 0x7f5d6c09cca0 2021-01-03T13:03:16.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d6ad9d700 1 --2- 172.21.15.133:0/2581054700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d6c09cca0 0x7f5d6c060ae0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f5d6c0ae530 tx=0x7f5d5c009270).ready entity=mon.1 client_cookie=f442f982610db3e9 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:16.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d69d9b700 1 -- 172.21.15.133:0/2581054700 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d5c00bbc0 con 0x7f5d6c09cca0 2021-01-03T13:03:16.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d69d9b700 1 -- 172.21.15.133:0/2581054700 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c00bd20 con 0x7f5d6c09cca0 2021-01-03T13:03:16.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d69d9b700 1 -- 172.21.15.133:0/2581054700 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d5c00be90 con 0x7f5d6c09cca0 2021-01-03T13:03:16.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d70a0f700 1 -- 172.21.15.133:0/2581054700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d6c09cca0 msgr2=0x7f5d6c060ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:16.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d70a0f700 1 --2- 172.21.15.133:0/2581054700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d6c09cca0 0x7f5d6c060ae0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f5d6c0ae530 tx=0x7f5d5c009270).stop 2021-01-03T13:03:16.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d70a0f700 1 -- 172.21.15.133:0/2581054700 shutdown_connections 2021-01-03T13:03:16.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d70a0f700 1 --2- 172.21.15.133:0/2581054700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d6c09cca0 0x7f5d6c060ae0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d70a0f700 1 --2- 172.21.15.133:0/2581054700 >> v2:172.21.15.16:3300/0 conn(0x7f5d6c0b36a0 0x7f5d6c05f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d70a0f700 1 -- 172.21.15.133:0/2581054700 >> 172.21.15.133:0/2581054700 conn(0x7f5d6c0b7200 msgr2=0x7f5d6c0b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:16.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.423+0000 7f5d70a0f700 1 -- 172.21.15.133:0/2581054700 shutdown_connections 2021-01-03T13:03:16.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.427+0000 7f5d70a0f700 1 -- 172.21.15.133:0/2581054700 wait complete. 2021-01-03T13:03:16.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.427+0000 7f5d70a0f700 1 Processor -- start 2021-01-03T13:03:16.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.427+0000 7f5d70a0f700 1 -- start start 2021-01-03T13:03:16.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.427+0000 7f5d70a0f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d6c05fad0 0x7f5d6c064cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:16.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.427+0000 7f5d70a0f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d6c09cca0 0x7f5d6c156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:16.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.427+0000 7f5d70a0f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d6c0b36a0 0x7f5d6c0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:16.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.427+0000 7f5d70a0f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c0b6fb0 con 0x7f5d6c0b36a0 2021-01-03T13:03:16.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.427+0000 7f5d70a0f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c141230 con 0x7f5d6c09cca0 2021-01-03T13:03:16.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.427+0000 7f5d70a0f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c1413d0 con 0x7f5d6c05fad0 2021-01-03T13:03:16.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.427+0000 7f5d6a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d6c09cca0 0x7f5d6c156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:16.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.427+0000 7f5d6a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d6c09cca0 0x7f5d6c156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35208/0 (socket says 172.21.15.133:35208) 2021-01-03T13:03:16.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.427+0000 7f5d6a59c700 1 -- 172.21.15.133:0/1948342290 learned_addr learned my addr 172.21.15.133:0/1948342290 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:16.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.427+0000 7f5d6ad9d700 1 --2- 172.21.15.133:0/1948342290 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d6c05fad0 0x7f5d6c064cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:16.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.427+0000 7f5d6b59e700 1 --2- 172.21.15.133:0/1948342290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d6c0b36a0 0x7f5d6c0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:16.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.427+0000 7f5d6a59c700 1 -- 172.21.15.133:0/1948342290 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d6c05fad0 msgr2=0x7f5d6c064cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:16.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.427+0000 7f5d6a59c700 1 --2- 172.21.15.133:0/1948342290 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d6c05fad0 0x7f5d6c064cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.431+0000 7f5d6a59c700 1 -- 172.21.15.133:0/1948342290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d6c0b36a0 msgr2=0x7f5d6c0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:16.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.431+0000 7f5d6a59c700 1 --2- 172.21.15.133:0/1948342290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d6c0b36a0 0x7f5d6c0b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.431+0000 7f5d6a59c700 1 -- 172.21.15.133:0/1948342290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c141670 con 0x7f5d6c09cca0 2021-01-03T13:03:16.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.431+0000 7f5d6a59c700 1 --2- 172.21.15.133:0/1948342290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d6c09cca0 0x7f5d6c156ac0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f5d60007000 tx=0x7f5d60008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:16.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.431+0000 7f5d5bfff700 1 -- 172.21.15.133:0/1948342290 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d6000e510 con 0x7f5d6c09cca0 2021-01-03T13:03:16.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.431+0000 7f5d5bfff700 1 -- 172.21.15.133:0/1948342290 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6000c030 con 0x7f5d6c09cca0 2021-01-03T13:03:16.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.431+0000 7f5d70a0f700 1 -- 172.21.15.133:0/1948342290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6c1560e0 con 0x7f5d6c09cca0 2021-01-03T13:03:16.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.431+0000 7f5d5bfff700 1 -- 172.21.15.133:0/1948342290 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d6000e860 con 0x7f5d6c09cca0 2021-01-03T13:03:16.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.431+0000 7f5d70a0f700 1 -- 172.21.15.133:0/1948342290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6c156620 con 0x7f5d6c09cca0 2021-01-03T13:03:16.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.431+0000 7f5d70a0f700 1 -- 172.21.15.133:0/1948342290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6c1567e0 con 0x7f5d6c09cca0 2021-01-03T13:03:16.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.431+0000 7f5d5bfff700 1 -- 172.21.15.133:0/1948342290 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5d60019030 con 0x7f5d6c09cca0 2021-01-03T13:03:16.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.431+0000 7f5d5bfff700 1 --2- 172.21.15.133:0/1948342290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5d48055440 0x7f5d48057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:16.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.431+0000 7f5d5bfff700 1 -- 172.21.15.133:0/1948342290 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5d6006d4f0 con 0x7f5d6c09cca0 2021-01-03T13:03:16.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.431+0000 7f5d6ad9d700 1 --2- 172.21.15.133:0/1948342290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5d48055440 0x7f5d48057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:16.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.435+0000 7f5d6ad9d700 1 --2- 172.21.15.133:0/1948342290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5d48055440 0x7f5d48057900 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f5d5c01a000 tx=0x7f5d5c016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:16.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.439+0000 7f5d5bfff700 1 -- 172.21.15.133:0/1948342290 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5d60043840 con 0x7f5d6c09cca0 2021-01-03T13:03:16.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.627+0000 7f5d70a0f700 1 -- 172.21.15.133:0/1948342290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d6c057300 con 0x7f5d6c09cca0 2021-01-03T13:03:16.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.631+0000 7f5d5bfff700 1 -- 172.21.15.133:0/1948342290 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2499 (secure 0 0 0) 0x7f5d60046e60 con 0x7f5d6c09cca0 2021-01-03T13:03:16.625 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:16.626 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3007157007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3007157007},{"type":"v1","addr":"172.21.15.133:6837","nonce":3007157007}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24},{"gid":5826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/1513472080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1513472080},{"type":"v1","addr":"172.21.15.16:6833","nonce":1513472080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:03:13.979157+0000","modified":"2021-01-03T13:03:14.982718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5881":{"gid":5881,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/1530122021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1530122021},{"type":"v1","addr":"172.21.15.133:6835","nonce":1530122021}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-01-03T13:03:16.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.631+0000 7f5d70a0f700 1 -- 172.21.15.133:0/1948342290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5d48055440 msgr2=0x7f5d48057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:16.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.631+0000 7f5d70a0f700 1 --2- 172.21.15.133:0/1948342290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5d48055440 0x7f5d48057900 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f5d5c01a000 tx=0x7f5d5c016000).stop 2021-01-03T13:03:16.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.631+0000 7f5d70a0f700 1 -- 172.21.15.133:0/1948342290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d6c09cca0 msgr2=0x7f5d6c156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:16.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.631+0000 7f5d70a0f700 1 --2- 172.21.15.133:0/1948342290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d6c09cca0 0x7f5d6c156ac0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f5d60007000 tx=0x7f5d60008040).stop 2021-01-03T13:03:16.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.631+0000 7f5d70a0f700 1 -- 172.21.15.133:0/1948342290 shutdown_connections 2021-01-03T13:03:16.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.631+0000 7f5d70a0f700 1 --2- 172.21.15.133:0/1948342290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5d48055440 0x7f5d48057900 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.631+0000 7f5d70a0f700 1 --2- 172.21.15.133:0/1948342290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5d6c0b36a0 0x7f5d6c0b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.631+0000 7f5d70a0f700 1 --2- 172.21.15.133:0/1948342290 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5d6c05fad0 0x7f5d6c064cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.631+0000 7f5d70a0f700 1 --2- 172.21.15.133:0/1948342290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d6c09cca0 0x7f5d6c156ac0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:16.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.631+0000 7f5d70a0f700 1 -- 172.21.15.133:0/1948342290 >> 172.21.15.133:0/1948342290 conn(0x7f5d6c0b7200 msgr2=0x7f5d6c145260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:16.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.631+0000 7f5d70a0f700 1 -- 172.21.15.133:0/1948342290 shutdown_connections 2021-01-03T13:03:16.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:16.631+0000 7f5d70a0f700 1 -- 172.21.15.133:0/1948342290 wait complete. 2021-01-03T13:03:16.630 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 27 2021-01-03T13:03:16.941 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:03:13.979157+0000', 'modified': '2021-01-03T13:03:14.982718+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5881}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5881': {'gid': 5881, 'name': 'a', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6835/1530122021', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 1530122021}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 1530122021}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:03:16.941 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:03:16.942 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-01-03T13:03:17.071 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":5881,"want_state":"up:active","state":"up:active","rank_uptime":3.0831449389999999,"mdsmap_epoch":27,"osdmap_epoch":67,"osdmap_epoch_barrier":66,"uptime":8.4760778099999996} 2021-01-03T13:03:17.072 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 5881, "mdsmap_epoch": 27, "osdmap_epoch": 67, "osdmap_epoch_barrier": 66, "rank_uptime": 3.083144939, "state": "up:active", "uptime": 8.47607781, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:03:17.072 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:03:17.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1dc22700 1 Processor -- start 2021-01-03T13:03:17.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1dc22700 1 -- start start 2021-01-03T13:03:17.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1dc22700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5f180b5330 0x7f5f180abd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1dc22700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f180b5ae0 0x7f5f18142c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1dc22700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5f18099ff0 0x7f5f1813fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1dc22700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f180b10f0 con 0x7f5f18099ff0 2021-01-03T13:03:17.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1dc22700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f180b5710 con 0x7f5f180b5330 2021-01-03T13:03:17.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1dc22700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180ac270 con 0x7f5f180b5ae0 2021-01-03T13:03:17.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1cc20700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5f180b5330 0x7f5f180abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1cc20700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5f180b5330 0x7f5f180abd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35214/0 (socket says 172.21.15.133:35214) 2021-01-03T13:03:17.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1cc20700 1 -- 172.21.15.133:0/158230594 learned_addr learned my addr 172.21.15.133:0/158230594 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:17.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1d421700 1 --2- 172.21.15.133:0/158230594 >> v2:172.21.15.16:3300/0 conn(0x7f5f18099ff0 0x7f5f1813fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f17fff700 1 --2- 172.21.15.133:0/158230594 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f180b5ae0 0x7f5f18142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1cc20700 1 -- 172.21.15.133:0/158230594 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f180b5ae0 msgr2=0x7f5f18142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:17.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1cc20700 1 --2- 172.21.15.133:0/158230594 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f180b5ae0 0x7f5f18142c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1cc20700 1 -- 172.21.15.133:0/158230594 >> v2:172.21.15.16:3300/0 conn(0x7f5f18099ff0 msgr2=0x7f5f1813fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:17.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1cc20700 1 --2- 172.21.15.133:0/158230594 >> v2:172.21.15.16:3300/0 conn(0x7f5f18099ff0 0x7f5f1813fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1cc20700 1 -- 172.21.15.133:0/158230594 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f180ab280 con 0x7f5f180b5330 2021-01-03T13:03:17.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1cc20700 1 --2- 172.21.15.133:0/158230594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f180b5330 0x7f5f180abd80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f5f000032b0 tx=0x7f5f00009270).ready entity=mon.1 client_cookie=9e61c4c74ff7662c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:17.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f177fe700 1 -- 172.21.15.133:0/158230594 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f00009e60 con 0x7f5f180b5330 2021-01-03T13:03:17.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f177fe700 1 -- 172.21.15.133:0/158230594 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0000bb50 con 0x7f5f180b5330 2021-01-03T13:03:17.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1dc22700 1 -- 172.21.15.133:0/158230594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f180b5330 msgr2=0x7f5f180abd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:17.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f177fe700 1 -- 172.21.15.133:0/158230594 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f0000bcc0 con 0x7f5f180b5330 2021-01-03T13:03:17.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.195+0000 7f5f1dc22700 1 --2- 172.21.15.133:0/158230594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f180b5330 0x7f5f180abd80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f5f000032b0 tx=0x7f5f00009270).stop 2021-01-03T13:03:17.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1dc22700 1 -- 172.21.15.133:0/158230594 shutdown_connections 2021-01-03T13:03:17.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1dc22700 1 --2- 172.21.15.133:0/158230594 >> v2:172.21.15.16:3300/0 conn(0x7f5f18099ff0 0x7f5f1813fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1dc22700 1 --2- 172.21.15.133:0/158230594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f180b5330 0x7f5f180abd80 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1dc22700 1 --2- 172.21.15.133:0/158230594 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f180b5ae0 0x7f5f18142c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1dc22700 1 -- 172.21.15.133:0/158230594 >> 172.21.15.133:0/158230594 conn(0x7f5f1805bdf0 msgr2=0x7f5f1805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:17.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1dc22700 1 -- 172.21.15.133:0/158230594 shutdown_connections 2021-01-03T13:03:17.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1dc22700 1 -- 172.21.15.133:0/158230594 wait complete. 2021-01-03T13:03:17.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1dc22700 1 Processor -- start 2021-01-03T13:03:17.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1dc22700 1 -- start start 2021-01-03T13:03:17.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1dc22700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f18099ff0 0x7f5f181559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1dc22700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f180b5330 0x7f5f18145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1dc22700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f180b5ae0 0x7f5f18143080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1dc22700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18140c90 con 0x7f5f180b5330 2021-01-03T13:03:17.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1dc22700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18155e90 con 0x7f5f180b5ae0 2021-01-03T13:03:17.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1dc22700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f181422f0 con 0x7f5f18099ff0 2021-01-03T13:03:17.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1d421700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f180b5ae0 0x7f5f18143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1d421700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f180b5ae0 0x7f5f18143080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35224/0 (socket says 172.21.15.133:35224) 2021-01-03T13:03:17.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1d421700 1 -- 172.21.15.133:0/2443003823 learned_addr learned my addr 172.21.15.133:0/2443003823 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:17.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1cc20700 1 --2- 172.21.15.133:0/2443003823 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f18099ff0 0x7f5f181559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f17fff700 1 --2- 172.21.15.133:0/2443003823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f180b5330 0x7f5f18145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1d421700 1 -- 172.21.15.133:0/2443003823 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f18099ff0 msgr2=0x7f5f181559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:17.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1d421700 1 --2- 172.21.15.133:0/2443003823 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f18099ff0 0x7f5f181559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1d421700 1 -- 172.21.15.133:0/2443003823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f180b5330 msgr2=0x7f5f18145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:17.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1d421700 1 --2- 172.21.15.133:0/2443003823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f180b5330 0x7f5f18145740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1d421700 1 -- 172.21.15.133:0/2443003823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f18142590 con 0x7f5f180b5ae0 2021-01-03T13:03:17.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1cc20700 1 --2- 172.21.15.133:0/2443003823 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f18099ff0 0x7f5f181559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:03:17.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1d421700 1 --2- 172.21.15.133:0/2443003823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f180b5ae0 0x7f5f18143080 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f5f10006a50 tx=0x7f5f10006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:17.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f15ffb700 1 -- 172.21.15.133:0/2443003823 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f1000ca10 con 0x7f5f180b5ae0 2021-01-03T13:03:17.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f15ffb700 1 -- 172.21.15.133:0/2443003823 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1000cb70 con 0x7f5f180b5ae0 2021-01-03T13:03:17.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f1dc22700 1 -- 172.21.15.133:0/2443003823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f18142830 con 0x7f5f180b5ae0 2021-01-03T13:03:17.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.199+0000 7f5f15ffb700 1 -- 172.21.15.133:0/2443003823 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f100123f0 con 0x7f5f180b5ae0 2021-01-03T13:03:17.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.203+0000 7f5f1dc22700 1 -- 172.21.15.133:0/2443003823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f18141b30 con 0x7f5f180b5ae0 2021-01-03T13:03:17.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.203+0000 7f5f1dc22700 1 -- 172.21.15.133:0/2443003823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f18057300 con 0x7f5f180b5ae0 2021-01-03T13:03:17.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.203+0000 7f5f15ffb700 1 -- 172.21.15.133:0/2443003823 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5f10012550 con 0x7f5f180b5ae0 2021-01-03T13:03:17.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.203+0000 7f5f15ffb700 1 --2- 172.21.15.133:0/2443003823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5efc055440 0x7f5efc057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.203+0000 7f5f15ffb700 1 -- 172.21.15.133:0/2443003823 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5f1006e380 con 0x7f5f180b5ae0 2021-01-03T13:03:17.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.203+0000 7f5f1cc20700 1 --2- 172.21.15.133:0/2443003823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5efc055440 0x7f5efc057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.203+0000 7f5f1cc20700 1 --2- 172.21.15.133:0/2443003823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5efc055440 0x7f5efc057900 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f5f0001a000 tx=0x7f5f00016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:17.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.211+0000 7f5f15ffb700 1 -- 172.21.15.133:0/2443003823 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5f10044620 con 0x7f5f180b5ae0 2021-01-03T13:03:17.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.351+0000 7f5f1dc22700 1 -- 172.21.15.133:0/2443003823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f1805ce00 con 0x7f5f180b5ae0 2021-01-03T13:03:17.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.351+0000 7f5f15ffb700 1 -- 172.21.15.133:0/2443003823 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f5f10047c40 con 0x7f5f180b5ae0 2021-01-03T13:03:17.349 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:17.349 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":67,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:03:15.994063+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:03:11.555772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2021-01-03T13:03:12.829370+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:03:17.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.355+0000 7f5f1dc22700 1 -- 172.21.15.133:0/2443003823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5efc055440 msgr2=0x7f5efc057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:17.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.355+0000 7f5f1dc22700 1 --2- 172.21.15.133:0/2443003823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5efc055440 0x7f5efc057900 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f5f0001a000 tx=0x7f5f00016000).stop 2021-01-03T13:03:17.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.355+0000 7f5f1dc22700 1 -- 172.21.15.133:0/2443003823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f180b5ae0 msgr2=0x7f5f18143080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:17.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.355+0000 7f5f1dc22700 1 --2- 172.21.15.133:0/2443003823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f180b5ae0 0x7f5f18143080 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f5f10006a50 tx=0x7f5f10006dc0).stop 2021-01-03T13:03:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.355+0000 7f5f1dc22700 1 -- 172.21.15.133:0/2443003823 shutdown_connections 2021-01-03T13:03:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.355+0000 7f5f1dc22700 1 --2- 172.21.15.133:0/2443003823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5efc055440 0x7f5efc057900 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.355+0000 7f5f1dc22700 1 --2- 172.21.15.133:0/2443003823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f180b5ae0 0x7f5f18143080 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.355+0000 7f5f1dc22700 1 --2- 172.21.15.133:0/2443003823 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f18099ff0 0x7f5f181559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.355+0000 7f5f1dc22700 1 --2- 172.21.15.133:0/2443003823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f180b5330 0x7f5f18145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.355+0000 7f5f1dc22700 1 -- 172.21.15.133:0/2443003823 >> 172.21.15.133:0/2443003823 conn(0x7f5f1805bdf0 msgr2=0x7f5f1813f290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.355+0000 7f5f1dc22700 1 -- 172.21.15.133:0/2443003823 shutdown_connections 2021-01-03T13:03:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.355+0000 7f5f1dc22700 1 -- 172.21.15.133:0/2443003823 wait complete. 2021-01-03T13:03:17.363 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:03:11.555772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:03:12.829370+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:03:17.363 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:03:17.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.475+0000 7f0c0756d700 1 Processor -- start 2021-01-03T13:03:17.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.475+0000 7f0c0756d700 1 -- start start 2021-01-03T13:03:17.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c0756d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0c001407f0 0x7f0c00142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c0756d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c000b0470 0x7f0c0005bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c0756d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c0005cf20 con 0x7f0c00140410 2021-01-03T13:03:17.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c0756d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c000b02d0 con 0x7f0c001407f0 2021-01-03T13:03:17.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c0756d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c00146390 con 0x7f0c000b0470 2021-01-03T13:03:17.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c05b0a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c000b0470 0x7f0c0005bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c05b0a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c000b0470 0x7f0c0005bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35230/0 (socket says 172.21.15.133:35230) 2021-01-03T13:03:17.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c05b0a700 1 -- 172.21.15.133:0/1387120812 learned_addr learned my addr 172.21.15.133:0/1387120812 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:17.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c04b08700 1 --2- 172.21.15.133:0/1387120812 >> v2:172.21.15.16:3300/0 conn(0x7f0c001407f0 0x7f0c00142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c05b0a700 1 -- 172.21.15.133:0/1387120812 >> v2:172.21.15.16:3300/0 conn(0x7f0c001407f0 msgr2=0x7f0c00142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:17.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c05b0a700 1 --2- 172.21.15.133:0/1387120812 >> v2:172.21.15.16:3300/0 conn(0x7f0c001407f0 0x7f0c00142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c05b0a700 1 -- 172.21.15.133:0/1387120812 >> v1:172.21.15.16:6789/0 conn(0x7f0c00140410 legacy=0x7f0c00146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:17.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c05b0a700 1 -- 172.21.15.133:0/1387120812 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c00146580 con 0x7f0c000b0470 2021-01-03T13:03:17.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c05b0a700 1 --2- 172.21.15.133:0/1387120812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c000b0470 0x7f0c0005bdf0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f0bf80032b0 tx=0x7f0bf8009270).ready entity=mon.1 client_cookie=e014377d9e40fac3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:17.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0bf3fff700 1 -- 172.21.15.133:0/1387120812 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bf8009e60 con 0x7f0c000b0470 2021-01-03T13:03:17.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0bf3fff700 1 -- 172.21.15.133:0/1387120812 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf800bc00 con 0x7f0c000b0470 2021-01-03T13:03:17.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0bf3fff700 1 -- 172.21.15.133:0/1387120812 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bf800bd70 con 0x7f0c000b0470 2021-01-03T13:03:17.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c0756d700 1 -- 172.21.15.133:0/1387120812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c000b0470 msgr2=0x7f0c0005bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:17.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c0756d700 1 --2- 172.21.15.133:0/1387120812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c000b0470 0x7f0c0005bdf0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f0bf80032b0 tx=0x7f0bf8009270).stop 2021-01-03T13:03:17.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c0756d700 1 -- 172.21.15.133:0/1387120812 shutdown_connections 2021-01-03T13:03:17.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c0756d700 1 --2- 172.21.15.133:0/1387120812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c000b0470 0x7f0c0005bdf0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c0756d700 1 --2- 172.21.15.133:0/1387120812 >> v2:172.21.15.16:3300/0 conn(0x7f0c001407f0 0x7f0c00142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c0756d700 1 -- 172.21.15.133:0/1387120812 >> 172.21.15.133:0/1387120812 conn(0x7f0c000b95d0 msgr2=0x7f0c000b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:17.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c0756d700 1 -- 172.21.15.133:0/1387120812 shutdown_connections 2021-01-03T13:03:17.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.479+0000 7f0c0756d700 1 -- 172.21.15.133:0/1387120812 wait complete. 2021-01-03T13:03:17.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c0756d700 1 Processor -- start 2021-01-03T13:03:17.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c0756d700 1 -- start start 2021-01-03T13:03:17.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c0756d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0c000b0470 0x7f0c0013fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c0756d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c00140410 0x7f0c00155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c0756d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c001407f0 0x7f0c00155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c0756d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0009ee60 con 0x7f0c001407f0 2021-01-03T13:03:17.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c0756d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0009f100 con 0x7f0c00140410 2021-01-03T13:03:17.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c0756d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c00142a40 con 0x7f0c000b0470 2021-01-03T13:03:17.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c04b08700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c00140410 0x7f0c00155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c04b08700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c00140410 0x7f0c00155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35236/0 (socket says 172.21.15.133:35236) 2021-01-03T13:03:17.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c04b08700 1 -- 172.21.15.133:0/3357559478 learned_addr learned my addr 172.21.15.133:0/3357559478 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:17.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c05309700 1 --2- 172.21.15.133:0/3357559478 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0c000b0470 0x7f0c0013fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c05b0a700 1 --2- 172.21.15.133:0/3357559478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c001407f0 0x7f0c00155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c04b08700 1 -- 172.21.15.133:0/3357559478 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0c000b0470 msgr2=0x7f0c0013fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:17.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c04b08700 1 --2- 172.21.15.133:0/3357559478 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0c000b0470 0x7f0c0013fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c04b08700 1 -- 172.21.15.133:0/3357559478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c001407f0 msgr2=0x7f0c00155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:17.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c04b08700 1 --2- 172.21.15.133:0/3357559478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c001407f0 0x7f0c00155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.483+0000 7f0c04b08700 1 -- 172.21.15.133:0/3357559478 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0009f3a0 con 0x7f0c00140410 2021-01-03T13:03:17.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.487+0000 7f0c04b08700 1 --2- 172.21.15.133:0/3357559478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c00140410 0x7f0c00155470 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f0bf400c000 tx=0x7f0bf4006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:17.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.487+0000 7f0bf27fc700 1 -- 172.21.15.133:0/3357559478 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bf400ca10 con 0x7f0c00140410 2021-01-03T13:03:17.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.487+0000 7f0bf27fc700 1 -- 172.21.15.133:0/3357559478 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf400cb70 con 0x7f0c00140410 2021-01-03T13:03:17.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.487+0000 7f0c0756d700 1 -- 172.21.15.133:0/3357559478 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c000b3bf0 con 0x7f0c00140410 2021-01-03T13:03:17.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.487+0000 7f0bf27fc700 1 -- 172.21.15.133:0/3357559478 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bf400be50 con 0x7f0c00140410 2021-01-03T13:03:17.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.487+0000 7f0c0756d700 1 -- 172.21.15.133:0/3357559478 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c000b82e0 con 0x7f0c00140410 2021-01-03T13:03:17.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.487+0000 7f0c0756d700 1 -- 172.21.15.133:0/3357559478 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c00057300 con 0x7f0c00140410 2021-01-03T13:03:17.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.487+0000 7f0bf27fc700 1 -- 172.21.15.133:0/3357559478 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0bf401b410 con 0x7f0c00140410 2021-01-03T13:03:17.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.487+0000 7f0bf27fc700 1 --2- 172.21.15.133:0/3357559478 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0be0055440 0x7f0be0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.487+0000 7f0bf27fc700 1 -- 172.21.15.133:0/3357559478 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0bf406dfd0 con 0x7f0c00140410 2021-01-03T13:03:17.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.487+0000 7f0c05309700 1 --2- 172.21.15.133:0/3357559478 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0be0055440 0x7f0be0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.491+0000 7f0c05309700 1 --2- 172.21.15.133:0/3357559478 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0be0055440 0x7f0be0057900 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f0bfc00d000 tx=0x7f0bfc000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:17.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.495+0000 7f0bf27fc700 1 -- 172.21.15.133:0/3357559478 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0bf4044270 con 0x7f0c00140410 2021-01-03T13:03:17.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.635+0000 7f0c0756d700 1 -- 172.21.15.133:0/3357559478 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0c0005d270 con 0x7f0c00140410 2021-01-03T13:03:17.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.635+0000 7f0bf27fc700 1 -- 172.21.15.133:0/3357559478 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v67) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0bf4047890 con 0x7f0c00140410 2021-01-03T13:03:17.633 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:03:17.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.639+0000 7f0c0756d700 1 -- 172.21.15.133:0/3357559478 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0be0055440 msgr2=0x7f0be0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:17.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.639+0000 7f0c0756d700 1 --2- 172.21.15.133:0/3357559478 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0be0055440 0x7f0be0057900 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f0bfc00d000 tx=0x7f0bfc000b80).stop 2021-01-03T13:03:17.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.639+0000 7f0c0756d700 1 -- 172.21.15.133:0/3357559478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c00140410 msgr2=0x7f0c00155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:17.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.639+0000 7f0c0756d700 1 --2- 172.21.15.133:0/3357559478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c00140410 0x7f0c00155470 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f0bf400c000 tx=0x7f0bf4006dc0).stop 2021-01-03T13:03:17.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.639+0000 7f0c0756d700 1 -- 172.21.15.133:0/3357559478 shutdown_connections 2021-01-03T13:03:17.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.639+0000 7f0c0756d700 1 --2- 172.21.15.133:0/3357559478 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0be0055440 0x7f0be0057900 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.639+0000 7f0c0756d700 1 --2- 172.21.15.133:0/3357559478 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0c001407f0 0x7f0c00155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.639+0000 7f0c0756d700 1 --2- 172.21.15.133:0/3357559478 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0c000b0470 0x7f0c0013fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.639+0000 7f0c0756d700 1 --2- 172.21.15.133:0/3357559478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c00140410 0x7f0c00155470 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.639+0000 7f0c0756d700 1 -- 172.21.15.133:0/3357559478 >> 172.21.15.133:0/3357559478 conn(0x7f0c000b95d0 msgr2=0x7f0c000b71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:17.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.639+0000 7f0c0756d700 1 -- 172.21.15.133:0/3357559478 shutdown_connections 2021-01-03T13:03:17.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.639+0000 7f0c0756d700 1 -- 172.21.15.133:0/3357559478 wait complete. 2021-01-03T13:03:17.650 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:03:17.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.767+0000 7f178732d700 1 Processor -- start 2021-01-03T13:03:17.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.767+0000 7f178732d700 1 -- start start 2021-01-03T13:03:17.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178732d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17800ace10 0x7f17800ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178732d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f17800b2e80 0x7f17800b7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178732d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17800ad6e0 con 0x7f17800b7660 2021-01-03T13:03:17.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178732d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17800adad0 con 0x7f17800ace10 2021-01-03T13:03:17.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178732d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17800add70 con 0x7f17800b2e80 2021-01-03T13:03:17.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178632b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17800ace10 0x7f17800ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178632b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17800ace10 0x7f17800ad1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35244/0 (socket says 172.21.15.133:35244) 2021-01-03T13:03:17.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178632b700 1 -- 172.21.15.133:0/2137729445 learned_addr learned my addr 172.21.15.133:0/2137729445 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:17.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f1785b2a700 1 --2- 172.21.15.133:0/2137729445 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f17800b2e80 0x7f17800b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178632b700 1 -- 172.21.15.133:0/2137729445 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f17800b2e80 msgr2=0x7f17800b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:17.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178632b700 1 --2- 172.21.15.133:0/2137729445 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f17800b2e80 0x7f17800b7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178632b700 1 -- 172.21.15.133:0/2137729445 >> v1:172.21.15.16:6789/0 conn(0x7f17800b7660 legacy=0x7f1780144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:17.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178632b700 1 -- 172.21.15.133:0/2137729445 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17800ae010 con 0x7f17800ace10 2021-01-03T13:03:17.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178632b700 1 --2- 172.21.15.133:0/2137729445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17800ace10 0x7f17800ad1f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f1770002f30 tx=0x7f1770006e80).ready entity=mon.1 client_cookie=c02eab3def214de5 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:17.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f1785329700 1 -- 172.21.15.133:0/2137729445 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17700097f0 con 0x7f17800ace10 2021-01-03T13:03:17.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f1785329700 1 -- 172.21.15.133:0/2137729445 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1770009950 con 0x7f17800ace10 2021-01-03T13:03:17.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f1785329700 1 -- 172.21.15.133:0/2137729445 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1770009cb0 con 0x7f17800ace10 2021-01-03T13:03:17.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178732d700 1 -- 172.21.15.133:0/2137729445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17800ace10 msgr2=0x7f17800ad1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:17.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178732d700 1 --2- 172.21.15.133:0/2137729445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17800ace10 0x7f17800ad1f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f1770002f30 tx=0x7f1770006e80).stop 2021-01-03T13:03:17.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178732d700 1 -- 172.21.15.133:0/2137729445 shutdown_connections 2021-01-03T13:03:17.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178732d700 1 --2- 172.21.15.133:0/2137729445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17800ace10 0x7f17800ad1f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178732d700 1 --2- 172.21.15.133:0/2137729445 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f17800b2e80 0x7f17800b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178732d700 1 -- 172.21.15.133:0/2137729445 >> 172.21.15.133:0/2137729445 conn(0x7f178005bdf0 msgr2=0x7f178005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:17.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178732d700 1 -- 172.21.15.133:0/2137729445 shutdown_connections 2021-01-03T13:03:17.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.771+0000 7f178732d700 1 -- 172.21.15.133:0/2137729445 wait complete. 2021-01-03T13:03:17.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f178732d700 1 Processor -- start 2021-01-03T13:03:17.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f178732d700 1 -- start start 2021-01-03T13:03:17.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f178732d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f17800ace10 0x7f17801417c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f178732d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17800b2e80 0x7f1780066c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f178732d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1780140090 0x7f178008fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f178732d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1780062f00 con 0x7f1780140090 2021-01-03T13:03:17.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f178732d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1780067390 con 0x7f17800b2e80 2021-01-03T13:03:17.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f178732d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1780156120 con 0x7f17800ace10 2021-01-03T13:03:17.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f1785b2a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17800b2e80 0x7f1780066c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f1785b2a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17800b2e80 0x7f1780066c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35250/0 (socket says 172.21.15.133:35250) 2021-01-03T13:03:17.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f1785b2a700 1 -- 172.21.15.133:0/3267187277 learned_addr learned my addr 172.21.15.133:0/3267187277 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:17.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f1786b2c700 1 --2- 172.21.15.133:0/3267187277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1780140090 0x7f178008fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f178632b700 1 --2- 172.21.15.133:0/3267187277 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f17800ace10 0x7f17801417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f1785b2a700 1 -- 172.21.15.133:0/3267187277 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f17800ace10 msgr2=0x7f17801417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:17.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f1785b2a700 1 --2- 172.21.15.133:0/3267187277 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f17800ace10 0x7f17801417c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f1785b2a700 1 -- 172.21.15.133:0/3267187277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1780140090 msgr2=0x7f178008fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f1785b2a700 1 --2- 172.21.15.133:0/3267187277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1780140090 0x7f178008fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f1785b2a700 1 -- 172.21.15.133:0/3267187277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1780156380 con 0x7f17800b2e80 2021-01-03T13:03:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f1785b2a700 1 --2- 172.21.15.133:0/3267187277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17800b2e80 0x7f1780066c10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f177c006a50 tx=0x7f177c006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:17.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f176f7fe700 1 -- 172.21.15.133:0/3267187277 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f177c00ca10 con 0x7f17800b2e80 2021-01-03T13:03:17.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f176f7fe700 1 -- 172.21.15.133:0/3267187277 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c00cb70 con 0x7f17800b2e80 2021-01-03T13:03:17.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f178732d700 1 -- 172.21.15.133:0/3267187277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17800627c0 con 0x7f17800b2e80 2021-01-03T13:03:17.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f176f7fe700 1 -- 172.21.15.133:0/3267187277 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f177c0123f0 con 0x7f17800b2e80 2021-01-03T13:03:17.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.775+0000 7f178732d700 1 -- 172.21.15.133:0/3267187277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1780090230 con 0x7f17800b2e80 2021-01-03T13:03:17.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.779+0000 7f176f7fe700 1 -- 172.21.15.133:0/3267187277 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f177c012550 con 0x7f17800b2e80 2021-01-03T13:03:17.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.779+0000 7f178732d700 1 -- 172.21.15.133:0/3267187277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1780057300 con 0x7f17800b2e80 2021-01-03T13:03:17.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.779+0000 7f176f7fe700 1 --2- 172.21.15.133:0/3267187277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1760055330 0x7f17600577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:17.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.779+0000 7f176f7fe700 1 -- 172.21.15.133:0/3267187277 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f177c06e430 con 0x7f17800b2e80 2021-01-03T13:03:17.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.779+0000 7f178632b700 1 --2- 172.21.15.133:0/3267187277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1760055330 0x7f17600577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:17.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.779+0000 7f178632b700 1 --2- 172.21.15.133:0/3267187277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1760055330 0x7f17600577f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f177001a000 tx=0x7f1770015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.787+0000 7f176f7fe700 1 -- 172.21.15.133:0/3267187277 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f177c0446d0 con 0x7f17800b2e80 2021-01-03T13:03:17.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.931+0000 7f178732d700 1 -- 172.21.15.133:0/3267187277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1780061020 con 0x7f17800b2e80 2021-01-03T13:03:17.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.931+0000 7f176f7fe700 1 -- 172.21.15.133:0/3267187277 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v67) v1 ==== 92+0+10 (secure 0 0 0) 0x7f177c047cf0 con 0x7f17800b2e80 2021-01-03T13:03:17.928 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:03:17.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.935+0000 7f178732d700 1 -- 172.21.15.133:0/3267187277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1760055330 msgr2=0x7f17600577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:17.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.935+0000 7f178732d700 1 --2- 172.21.15.133:0/3267187277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1760055330 0x7f17600577f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f177001a000 tx=0x7f1770015000).stop 2021-01-03T13:03:17.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.935+0000 7f178732d700 1 -- 172.21.15.133:0/3267187277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17800b2e80 msgr2=0x7f1780066c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:17.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.935+0000 7f178732d700 1 --2- 172.21.15.133:0/3267187277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17800b2e80 0x7f1780066c10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f177c006a50 tx=0x7f177c006dc0).stop 2021-01-03T13:03:17.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.935+0000 7f178732d700 1 -- 172.21.15.133:0/3267187277 shutdown_connections 2021-01-03T13:03:17.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.935+0000 7f178732d700 1 --2- 172.21.15.133:0/3267187277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1760055330 0x7f17600577f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.935+0000 7f178732d700 1 --2- 172.21.15.133:0/3267187277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1780140090 0x7f178008fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.935+0000 7f178732d700 1 --2- 172.21.15.133:0/3267187277 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f17800ace10 0x7f17801417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.935+0000 7f178732d700 1 --2- 172.21.15.133:0/3267187277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17800b2e80 0x7f1780066c10 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:17.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.935+0000 7f178732d700 1 -- 172.21.15.133:0/3267187277 >> 172.21.15.133:0/3267187277 conn(0x7f178005bdf0 msgr2=0x7f17800b6320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:17.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.935+0000 7f178732d700 1 -- 172.21.15.133:0/3267187277 shutdown_connections 2021-01-03T13:03:17.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:17.935+0000 7f178732d700 1 -- 172.21.15.133:0/3267187277 wait complete. 2021-01-03T13:03:17.941 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:03:18.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7b59e700 1 Processor -- start 2021-01-03T13:03:18.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7b59e700 1 -- start start 2021-01-03T13:03:18.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7b59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbc7c0b5260 0x7fbc7c1470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7b59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbc7c0b5c00 0x7fbc7c1475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7b59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7c0b0c10 con 0x7fbc7c1442a0 2021-01-03T13:03:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7b59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7c0b5640 con 0x7fbc7c0b5260 2021-01-03T13:03:18.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7b59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c09a4f0 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7ad9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbc7c1442a0 0x7fbc7c144750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56290/0 (socket says 172.21.15.133:56290) 2021-01-03T13:03:18.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7ad9d700 1 -- 172.21.15.133:0/4154158424 learned_addr learned my addr 172.21.15.133:0/4154158424 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:18.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc71d9b700 1 --2- 172.21.15.133:0/4154158424 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbc7c0b5c00 0x7fbc7c1475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7a59c700 1 --2- 172.21.15.133:0/4154158424 >> v2:172.21.15.16:3300/0 conn(0x7fbc7c0b5260 0x7fbc7c1470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc79d9b700 1 -- 172.21.15.133:0/4154158424 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564865378 0 0) 0x7fbc7c0b0c10 con 0x7fbc7c1442a0 2021-01-03T13:03:18.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc79d9b700 1 -- 172.21.15.133:0/4154158424 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc5c003230 con 0x7fbc7c1442a0 2021-01-03T13:03:18.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc71d9b700 1 -- 172.21.15.133:0/4154158424 >> v2:172.21.15.16:3300/0 conn(0x7fbc7c0b5260 msgr2=0x7fbc7c1470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:18.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc71d9b700 1 --2- 172.21.15.133:0/4154158424 >> v2:172.21.15.16:3300/0 conn(0x7fbc7c0b5260 0x7fbc7c1470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc71d9b700 1 -- 172.21.15.133:0/4154158424 >> v1:172.21.15.133:6789/0 conn(0x7fbc7c1442a0 legacy=0x7fbc7c144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:18.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc71d9b700 1 -- 172.21.15.133:0/4154158424 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c0b0e40 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc71d9b700 1 --2- 172.21.15.133:0/4154158424 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbc7c0b5c00 0x7fbc7c1475a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fbc64002f30 tx=0x7fbc64006dc0).ready entity=mon.2 client_cookie=9e0296537fae9c42 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:18.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc79d9b700 1 -- 172.21.15.133:0/4154158424 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc640096a0 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc79d9b700 1 -- 172.21.15.133:0/4154158424 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc64009800 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc79d9b700 1 -- 172.21.15.133:0/4154158424 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc64009b60 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7b59e700 1 -- 172.21.15.133:0/4154158424 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbc7c0b5c00 msgr2=0x7fbc7c1475a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:18.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7b59e700 1 --2- 172.21.15.133:0/4154158424 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbc7c0b5c00 0x7fbc7c1475a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fbc64002f30 tx=0x7fbc64006dc0).stop 2021-01-03T13:03:18.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7b59e700 1 -- 172.21.15.133:0/4154158424 shutdown_connections 2021-01-03T13:03:18.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7b59e700 1 --2- 172.21.15.133:0/4154158424 >> v2:172.21.15.16:3300/0 conn(0x7fbc7c0b5260 0x7fbc7c1470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7b59e700 1 --2- 172.21.15.133:0/4154158424 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbc7c0b5c00 0x7fbc7c1475a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7b59e700 1 -- 172.21.15.133:0/4154158424 >> 172.21.15.133:0/4154158424 conn(0x7fbc7c05bdf0 msgr2=0x7fbc7c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:18.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7b59e700 1 -- 172.21.15.133:0/4154158424 shutdown_connections 2021-01-03T13:03:18.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.059+0000 7fbc7b59e700 1 -- 172.21.15.133:0/4154158424 wait complete. 2021-01-03T13:03:18.064 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc7b59e700 1 Processor -- start 2021-01-03T13:03:18.064 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc7b59e700 1 -- start start 2021-01-03T13:03:18.064 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc7b59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc7c0b5260 0x7fbc7c0b3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.064 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc7b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7c0b5c00 0x7fbc7c064c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.065 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc7b59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbc7c1442a0 0x7fbc7c065130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.065 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc7b59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c1475a0 con 0x7fbc7c0b5260 2021-01-03T13:03:18.065 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc7b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c065a30 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.065 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc7b59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0642b0 con 0x7fbc7c1442a0 2021-01-03T13:03:18.066 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc71d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7c0b5c00 0x7fbc7c064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.066 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc71d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7c0b5c00 0x7fbc7c064c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35262/0 (socket says 172.21.15.133:35262) 2021-01-03T13:03:18.066 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc71d9b700 1 -- 172.21.15.133:0/271644220 learned_addr learned my addr 172.21.15.133:0/271644220 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:18.066 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc7a59c700 1 --2- 172.21.15.133:0/271644220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc7c0b5260 0x7fbc7c0b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.066 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc7ad9d700 1 --2- 172.21.15.133:0/271644220 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbc7c1442a0 0x7fbc7c065130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc71d9b700 1 -- 172.21.15.133:0/271644220 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbc7c1442a0 msgr2=0x7fbc7c065130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:18.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc71d9b700 1 --2- 172.21.15.133:0/271644220 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbc7c1442a0 0x7fbc7c065130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc71d9b700 1 -- 172.21.15.133:0/271644220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc7c0b5260 msgr2=0x7fbc7c0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:18.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc71d9b700 1 --2- 172.21.15.133:0/271644220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc7c0b5260 0x7fbc7c0b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc71d9b700 1 -- 172.21.15.133:0/271644220 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c063d70 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc7ad9d700 1 --2- 172.21.15.133:0/271644220 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbc7c1442a0 0x7fbc7c065130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:03:18.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc71d9b700 1 --2- 172.21.15.133:0/271644220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7c0b5c00 0x7fbc7c064c40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fbc7c064440 tx=0x7fbc64015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:18.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc73fff700 1 -- 172.21.15.133:0/271644220 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc64011ca0 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc73fff700 1 -- 172.21.15.133:0/271644220 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc64011e00 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc73fff700 1 -- 172.21.15.133:0/271644220 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc6401d640 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc7b59e700 1 -- 172.21.15.133:0/271644220 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7c064010 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.063+0000 7fbc7b59e700 1 -- 172.21.15.133:0/271644220 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7c147fd0 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.067+0000 7fbc7b59e700 1 -- 172.21.15.133:0/271644220 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7c057300 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.067+0000 7fbc73fff700 1 -- 172.21.15.133:0/271644220 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fbc64024030 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.067+0000 7fbc73fff700 1 --2- 172.21.15.133:0/271644220 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbc60055440 0x7fbc60057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.067+0000 7fbc73fff700 1 -- 172.21.15.133:0/271644220 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbc6406f120 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.067+0000 7fbc7a59c700 1 --2- 172.21.15.133:0/271644220 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbc60055440 0x7fbc60057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.071 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.067+0000 7fbc7a59c700 1 --2- 172.21.15.133:0/271644220 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbc60055440 0x7fbc60057900 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fbc6c00b000 tx=0x7fbc6c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:18.071 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.075+0000 7fbc73fff700 1 -- 172.21.15.133:0/271644220 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbc64045420 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.215+0000 7fbc7b59e700 1 -- 172.21.15.133:0/271644220 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc7c05ce00 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.219+0000 7fbc73fff700 1 -- 172.21.15.133:0/271644220 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) v1 ==== 104+0+10 (secure 0 0 0) 0x7fbc640220a0 con 0x7fbc7c0b5c00 2021-01-03T13:03:18.214 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:03:18.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.219+0000 7fbc7b59e700 1 -- 172.21.15.133:0/271644220 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbc60055440 msgr2=0x7fbc60057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:18.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.219+0000 7fbc7b59e700 1 --2- 172.21.15.133:0/271644220 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbc60055440 0x7fbc60057900 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fbc6c00b000 tx=0x7fbc6c008040).stop 2021-01-03T13:03:18.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.219+0000 7fbc7b59e700 1 -- 172.21.15.133:0/271644220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7c0b5c00 msgr2=0x7fbc7c064c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:18.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.219+0000 7fbc7b59e700 1 --2- 172.21.15.133:0/271644220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7c0b5c00 0x7fbc7c064c40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fbc7c064440 tx=0x7fbc64015000).stop 2021-01-03T13:03:18.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.219+0000 7fbc7b59e700 1 -- 172.21.15.133:0/271644220 shutdown_connections 2021-01-03T13:03:18.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.219+0000 7fbc7b59e700 1 --2- 172.21.15.133:0/271644220 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbc60055440 0x7fbc60057900 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.219+0000 7fbc7b59e700 1 --2- 172.21.15.133:0/271644220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbc7c0b5260 0x7fbc7c0b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.219+0000 7fbc7b59e700 1 --2- 172.21.15.133:0/271644220 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbc7c1442a0 0x7fbc7c065130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.219+0000 7fbc7b59e700 1 --2- 172.21.15.133:0/271644220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc7c0b5c00 0x7fbc7c064c40 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.219+0000 7fbc7b59e700 1 -- 172.21.15.133:0/271644220 >> 172.21.15.133:0/271644220 conn(0x7fbc7c05bdf0 msgr2=0x7fbc7c0b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:18.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.223+0000 7fbc7b59e700 1 -- 172.21.15.133:0/271644220 shutdown_connections 2021-01-03T13:03:18.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.223+0000 7fbc7b59e700 1 -- 172.21.15.133:0/271644220 wait complete. 2021-01-03T13:03:18.233 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:03:18.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb75461700 1 Processor -- start 2021-01-03T13:03:18.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb75461700 1 -- start start 2021-01-03T13:03:18.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb75461700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb700b4c20 0x7feb7005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb75461700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feb7005fd10 0x7feb700b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb75461700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7005bf00 con 0x7feb70060510 2021-01-03T13:03:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb75461700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb7005c1a0 con 0x7feb7005fd10 2021-01-03T13:03:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb75461700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb7005c440 con 0x7feb700b4c20 2021-01-03T13:03:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb6ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb700b4c20 0x7feb7005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb6ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb700b4c20 0x7feb7005c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35270/0 (socket says 172.21.15.133:35270) 2021-01-03T13:03:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb6ffff700 1 -- 172.21.15.133:0/3024097901 learned_addr learned my addr 172.21.15.133:0/3024097901 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:18.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb74c60700 1 --2- 172.21.15.133:0/3024097901 >> v2:172.21.15.16:3300/0 conn(0x7feb7005fd10 0x7feb700b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb6ffff700 1 -- 172.21.15.133:0/3024097901 >> v2:172.21.15.16:3300/0 conn(0x7feb7005fd10 msgr2=0x7feb700b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:18.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb6ffff700 1 --2- 172.21.15.133:0/3024097901 >> v2:172.21.15.16:3300/0 conn(0x7feb7005fd10 0x7feb700b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb6ffff700 1 -- 172.21.15.133:0/3024097901 >> v1:172.21.15.16:6789/0 conn(0x7feb70060510 legacy=0x7feb700b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:18.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb6ffff700 1 -- 172.21.15.133:0/3024097901 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb700b6ad0 con 0x7feb700b4c20 2021-01-03T13:03:18.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb6ffff700 1 --2- 172.21.15.133:0/3024097901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb700b4c20 0x7feb7005c8e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7feb7005c7c0 tx=0x7feb60006e80).ready entity=mon.1 client_cookie=f6f6df8d37c5d6dd server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:18.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb6effd700 1 -- 172.21.15.133:0/3024097901 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb600097b0 con 0x7feb700b4c20 2021-01-03T13:03:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb6effd700 1 -- 172.21.15.133:0/3024097901 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb60009910 con 0x7feb700b4c20 2021-01-03T13:03:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb6effd700 1 -- 172.21.15.133:0/3024097901 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb60009a80 con 0x7feb700b4c20 2021-01-03T13:03:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb75461700 1 -- 172.21.15.133:0/3024097901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb700b4c20 msgr2=0x7feb7005c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:18.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb75461700 1 --2- 172.21.15.133:0/3024097901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb700b4c20 0x7feb7005c8e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7feb7005c7c0 tx=0x7feb60006e80).stop 2021-01-03T13:03:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb75461700 1 -- 172.21.15.133:0/3024097901 shutdown_connections 2021-01-03T13:03:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb75461700 1 --2- 172.21.15.133:0/3024097901 >> v2:172.21.15.16:3300/0 conn(0x7feb7005fd10 0x7feb700b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb75461700 1 --2- 172.21.15.133:0/3024097901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb700b4c20 0x7feb7005c8e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb75461700 1 -- 172.21.15.133:0/3024097901 >> 172.21.15.133:0/3024097901 conn(0x7feb700b9f00 msgr2=0x7feb700b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb75461700 1 -- 172.21.15.133:0/3024097901 shutdown_connections 2021-01-03T13:03:18.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.351+0000 7feb75461700 1 -- 172.21.15.133:0/3024097901 wait complete. 2021-01-03T13:03:18.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb75461700 1 Processor -- start 2021-01-03T13:03:18.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb75461700 1 -- start start 2021-01-03T13:03:18.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb75461700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb7005fd10 0x7feb7013a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb75461700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb70060510 0x7feb701486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb75461700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb700b4c20 0x7feb70148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb75461700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb700b8c20 con 0x7feb700b4c20 2021-01-03T13:03:18.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb75461700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb70147480 con 0x7feb7005fd10 2021-01-03T13:03:18.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb75461700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb70147f80 con 0x7feb70060510 2021-01-03T13:03:18.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb6ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb7005fd10 0x7feb7013a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb6ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb7005fd10 0x7feb7013a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35276/0 (socket says 172.21.15.133:35276) 2021-01-03T13:03:18.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb6ffff700 1 -- 172.21.15.133:0/2399966987 learned_addr learned my addr 172.21.15.133:0/2399966987 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:18.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb74c60700 1 --2- 172.21.15.133:0/2399966987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb700b4c20 0x7feb70148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb6f7fe700 1 --2- 172.21.15.133:0/2399966987 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb70060510 0x7feb701486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb6ffff700 1 -- 172.21.15.133:0/2399966987 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb70060510 msgr2=0x7feb701486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:18.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb6ffff700 1 --2- 172.21.15.133:0/2399966987 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb70060510 0x7feb701486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb6ffff700 1 -- 172.21.15.133:0/2399966987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb700b4c20 msgr2=0x7feb70148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:18.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb6ffff700 1 --2- 172.21.15.133:0/2399966987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb700b4c20 0x7feb70148be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb6ffff700 1 -- 172.21.15.133:0/2399966987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7009f4a0 con 0x7feb7005fd10 2021-01-03T13:03:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb6f7fe700 1 --2- 172.21.15.133:0/2399966987 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb70060510 0x7feb701486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.355+0000 7feb6ffff700 1 --2- 172.21.15.133:0/2399966987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb7005fd10 0x7feb7013a720 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7feb7005c7c0 tx=0x7feb60016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.359+0000 7feb6d7fa700 1 -- 172.21.15.133:0/2399966987 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb60011e20 con 0x7feb7005fd10 2021-01-03T13:03:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.359+0000 7feb6d7fa700 1 -- 172.21.15.133:0/2399966987 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb60020400 con 0x7feb7005fd10 2021-01-03T13:03:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.359+0000 7feb75461700 1 -- 172.21.15.133:0/2399966987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb701490d0 con 0x7feb7005fd10 2021-01-03T13:03:18.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.359+0000 7feb6d7fa700 1 -- 172.21.15.133:0/2399966987 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb60020760 con 0x7feb7005fd10 2021-01-03T13:03:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.359+0000 7feb75461700 1 -- 172.21.15.133:0/2399966987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7009d630 con 0x7feb7005fd10 2021-01-03T13:03:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.359+0000 7feb6d7fa700 1 -- 172.21.15.133:0/2399966987 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7feb6001e070 con 0x7feb7005fd10 2021-01-03T13:03:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.359+0000 7feb6d7fa700 1 --2- 172.21.15.133:0/2399966987 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb50055440 0x7feb50057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.359+0000 7feb6d7fa700 1 -- 172.21.15.133:0/2399966987 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feb6006e790 con 0x7feb7005fd10 2021-01-03T13:03:18.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.359+0000 7feb75461700 1 -- 172.21.15.133:0/2399966987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb70147de0 con 0x7feb7005fd10 2021-01-03T13:03:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.359+0000 7feb6f7fe700 1 --2- 172.21.15.133:0/2399966987 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb50055440 0x7feb50057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.359+0000 7feb6f7fe700 1 --2- 172.21.15.133:0/2399966987 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb50055440 0x7feb50057900 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7feb6400b000 tx=0x7feb64009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:18.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.367+0000 7feb6d7fa700 1 -- 172.21.15.133:0/2399966987 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7feb70147de0 con 0x7feb7005fd10 2021-01-03T13:03:18.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.511+0000 7feb75461700 1 -- 172.21.15.133:0/2399966987 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feb70147de0 con 0x7feb7005fd10 2021-01-03T13:03:18.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.519+0000 7feb6d7fa700 1 -- 172.21.15.133:0/2399966987 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) v1 ==== 100+0+10 (secure 0 0 0) 0x7feb70147de0 con 0x7feb7005fd10 2021-01-03T13:03:18.515 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:03:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.523+0000 7feb75461700 1 -- 172.21.15.133:0/2399966987 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb50055440 msgr2=0x7feb50057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.523+0000 7feb75461700 1 --2- 172.21.15.133:0/2399966987 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb50055440 0x7feb50057900 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7feb6400b000 tx=0x7feb64009040).stop 2021-01-03T13:03:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.523+0000 7feb75461700 1 -- 172.21.15.133:0/2399966987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb7005fd10 msgr2=0x7feb7013a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:18.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.523+0000 7feb75461700 1 --2- 172.21.15.133:0/2399966987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb7005fd10 0x7feb7013a720 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7feb7005c7c0 tx=0x7feb60016000).stop 2021-01-03T13:03:18.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.523+0000 7feb75461700 1 -- 172.21.15.133:0/2399966987 shutdown_connections 2021-01-03T13:03:18.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.523+0000 7feb75461700 1 --2- 172.21.15.133:0/2399966987 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb50055440 0x7feb50057900 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.523+0000 7feb75461700 1 --2- 172.21.15.133:0/2399966987 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb700b4c20 0x7feb70148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.523+0000 7feb75461700 1 --2- 172.21.15.133:0/2399966987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb7005fd10 0x7feb7013a720 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.523+0000 7feb75461700 1 --2- 172.21.15.133:0/2399966987 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb70060510 0x7feb701486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.523+0000 7feb75461700 1 -- 172.21.15.133:0/2399966987 >> 172.21.15.133:0/2399966987 conn(0x7feb700b9f00 msgr2=0x7feb7013ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:18.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.523+0000 7feb75461700 1 -- 172.21.15.133:0/2399966987 shutdown_connections 2021-01-03T13:03:18.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.523+0000 7feb75461700 1 -- 172.21.15.133:0/2399966987 wait complete. 2021-01-03T13:03:18.533 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:03:18.534 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:03:18.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a031c9700 1 Processor -- start 2021-01-03T13:03:18.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a031c9700 1 -- start start 2021-01-03T13:03:18.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a031c9700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f89fc0b52c0 0x7f89fc0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a031c9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f89fc0b0c90 0x7f89fc098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a031c9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89fc060da0 con 0x7f89fc0b5c00 2021-01-03T13:03:18.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a031c9700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89fc067a90 con 0x7f89fc0b52c0 2021-01-03T13:03:18.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a031c9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89fc0b0ad0 con 0x7f89fc0b0c90 2021-01-03T13:03:18.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a019c6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f89fc0b0c90 0x7f89fc098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a019c6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f89fc0b0c90 0x7f89fc098ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35284/0 (socket says 172.21.15.133:35284) 2021-01-03T13:03:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a019c6700 1 -- 172.21.15.133:0/856304952 learned_addr learned my addr 172.21.15.133:0/856304952 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a021c7700 1 --2- 172.21.15.133:0/856304952 >> v2:172.21.15.16:3300/0 conn(0x7f89fc0b52c0 0x7f89fc0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a019c6700 1 -- 172.21.15.133:0/856304952 >> v2:172.21.15.16:3300/0 conn(0x7f89fc0b52c0 msgr2=0x7f89fc0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a019c6700 1 --2- 172.21.15.133:0/856304952 >> v2:172.21.15.16:3300/0 conn(0x7f89fc0b52c0 0x7f89fc0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a019c6700 1 -- 172.21.15.133:0/856304952 >> v1:172.21.15.133:6789/0 conn(0x7f89fc0b5c00 legacy=0x7f89fc14a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:18.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a019c6700 1 -- 172.21.15.133:0/856304952 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc0b56a0 con 0x7f89fc0b0c90 2021-01-03T13:03:18.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a021c7700 1 --2- 172.21.15.133:0/856304952 >> v2:172.21.15.16:3300/0 conn(0x7f89fc0b52c0 0x7f89fc0b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:18.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a019c6700 1 --2- 172.21.15.133:0/856304952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89fc0b0c90 0x7f89fc098ec0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f89f0002f30 tx=0x7f89f0006e80).ready entity=mon.1 client_cookie=f4ae4a70ea7d24c8 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:18.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a011c5700 1 -- 172.21.15.133:0/856304952 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89f00097f0 con 0x7f89fc0b0c90 2021-01-03T13:03:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a011c5700 1 -- 172.21.15.133:0/856304952 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f0009950 con 0x7f89fc0b0c90 2021-01-03T13:03:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a011c5700 1 -- 172.21.15.133:0/856304952 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89f0009cb0 con 0x7f89fc0b0c90 2021-01-03T13:03:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a031c9700 1 -- 172.21.15.133:0/856304952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89fc0b0c90 msgr2=0x7f89fc098ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:18.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a031c9700 1 --2- 172.21.15.133:0/856304952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89fc0b0c90 0x7f89fc098ec0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f89f0002f30 tx=0x7f89f0006e80).stop 2021-01-03T13:03:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a031c9700 1 -- 172.21.15.133:0/856304952 shutdown_connections 2021-01-03T13:03:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a031c9700 1 --2- 172.21.15.133:0/856304952 >> v2:172.21.15.16:3300/0 conn(0x7f89fc0b52c0 0x7f89fc0b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a031c9700 1 --2- 172.21.15.133:0/856304952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89fc0b0c90 0x7f89fc098ec0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a031c9700 1 -- 172.21.15.133:0/856304952 >> 172.21.15.133:0/856304952 conn(0x7f89fc05bdf0 msgr2=0x7f89fc05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:18.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a031c9700 1 -- 172.21.15.133:0/856304952 shutdown_connections 2021-01-03T13:03:18.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.651+0000 7f8a031c9700 1 -- 172.21.15.133:0/856304952 wait complete. 2021-01-03T13:03:18.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a031c9700 1 Processor -- start 2021-01-03T13:03:18.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a031c9700 1 -- start start 2021-01-03T13:03:18.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a031c9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f89fc0b0c90 0x7f89fc067100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a031c9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89fc0b52c0 0x7f89fc1442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a031c9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89fc0b5c00 0x7f89fc144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a031c9700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc063540 con 0x7f89fc0b52c0 2021-01-03T13:03:18.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a031c9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc063ae0 con 0x7f89fc0b5c00 2021-01-03T13:03:18.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a031c9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc064450 con 0x7f89fc0b0c90 2021-01-03T13:03:18.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a029c8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89fc0b5c00 0x7f89fc144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a029c8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89fc0b5c00 0x7f89fc144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35292/0 (socket says 172.21.15.133:35292) 2021-01-03T13:03:18.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a029c8700 1 -- 172.21.15.133:0/3477915334 learned_addr learned my addr 172.21.15.133:0/3477915334 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:18.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a021c7700 1 --2- 172.21.15.133:0/3477915334 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f89fc0b0c90 0x7f89fc067100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a019c6700 1 --2- 172.21.15.133:0/3477915334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89fc0b52c0 0x7f89fc1442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a029c8700 1 -- 172.21.15.133:0/3477915334 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f89fc0b0c90 msgr2=0x7f89fc067100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:18.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a029c8700 1 --2- 172.21.15.133:0/3477915334 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f89fc0b0c90 0x7f89fc067100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a029c8700 1 -- 172.21.15.133:0/3477915334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89fc0b52c0 msgr2=0x7f89fc1442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:18.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a029c8700 1 --2- 172.21.15.133:0/3477915334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89fc0b52c0 0x7f89fc1442a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a029c8700 1 -- 172.21.15.133:0/3477915334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc063770 con 0x7f89fc0b5c00 2021-01-03T13:03:18.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a021c7700 1 --2- 172.21.15.133:0/3477915334 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f89fc0b0c90 0x7f89fc067100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:18.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a029c8700 1 --2- 172.21.15.133:0/3477915334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89fc0b5c00 0x7f89fc144790 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f89fc066d10 tx=0x7f89f4007bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:18.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f89fb7fe700 1 -- 172.21.15.133:0/3477915334 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89f4013410 con 0x7f89fc0b5c00 2021-01-03T13:03:18.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f89fb7fe700 1 -- 172.21.15.133:0/3477915334 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f4013570 con 0x7f89fc0b5c00 2021-01-03T13:03:18.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a031c9700 1 -- 172.21.15.133:0/3477915334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89fc0646b0 con 0x7f89fc0b5c00 2021-01-03T13:03:18.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a031c9700 1 -- 172.21.15.133:0/3477915334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89fc144c80 con 0x7f89fc0b5c00 2021-01-03T13:03:18.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f89fb7fe700 1 -- 172.21.15.133:0/3477915334 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89f40138d0 con 0x7f89fc0b5c00 2021-01-03T13:03:18.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.655+0000 7f8a031c9700 1 -- 172.21.15.133:0/3477915334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89fc057300 con 0x7f89fc0b5c00 2021-01-03T13:03:18.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.659+0000 7f89fb7fe700 1 -- 172.21.15.133:0/3477915334 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f89f4010030 con 0x7f89fc0b5c00 2021-01-03T13:03:18.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.659+0000 7f89fb7fe700 1 --2- 172.21.15.133:0/3477915334 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f89dc055440 0x7f89dc057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:18.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.659+0000 7f89fb7fe700 1 -- 172.21.15.133:0/3477915334 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f89f406dea0 con 0x7f89fc0b5c00 2021-01-03T13:03:18.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.659+0000 7f8a021c7700 1 --2- 172.21.15.133:0/3477915334 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f89dc055440 0x7f89dc057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:18.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.659+0000 7f8a021c7700 1 --2- 172.21.15.133:0/3477915334 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f89dc055440 0x7f89dc057900 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f89ec00d000 tx=0x7f89ec008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:18.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.663+0000 7f89fb7fe700 1 -- 172.21.15.133:0/3477915334 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f89f4044010 con 0x7f89fc0b5c00 2021-01-03T13:03:18.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.851+0000 7f8a031c9700 1 -- 172.21.15.133:0/3477915334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89fc0677b0 con 0x7f89fc0b5c00 2021-01-03T13:03:18.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.851+0000 7f89fb7fe700 1 -- 172.21.15.133:0/3477915334 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2499 (secure 0 0 0) 0x7f89f4047630 con 0x7f89fc0b5c00 2021-01-03T13:03:18.846 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:18.847 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3007157007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3007157007},{"type":"v1","addr":"172.21.15.133:6837","nonce":3007157007}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24},{"gid":5826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/1513472080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1513472080},{"type":"v1","addr":"172.21.15.16:6833","nonce":1513472080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:03:13.979157+0000","modified":"2021-01-03T13:03:14.982718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5881":{"gid":5881,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/1530122021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1530122021},{"type":"v1","addr":"172.21.15.133:6835","nonce":1530122021}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-01-03T13:03:18.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.851+0000 7f8a031c9700 1 -- 172.21.15.133:0/3477915334 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f89dc055440 msgr2=0x7f89dc057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:18.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.851+0000 7f8a031c9700 1 --2- 172.21.15.133:0/3477915334 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f89dc055440 0x7f89dc057900 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f89ec00d000 tx=0x7f89ec008040).stop 2021-01-03T13:03:18.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.851+0000 7f8a031c9700 1 -- 172.21.15.133:0/3477915334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89fc0b5c00 msgr2=0x7f89fc144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:18.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.851+0000 7f8a031c9700 1 --2- 172.21.15.133:0/3477915334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89fc0b5c00 0x7f89fc144790 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f89fc066d10 tx=0x7f89f4007bf0).stop 2021-01-03T13:03:18.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.851+0000 7f8a031c9700 1 -- 172.21.15.133:0/3477915334 shutdown_connections 2021-01-03T13:03:18.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.851+0000 7f8a031c9700 1 --2- 172.21.15.133:0/3477915334 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f89dc055440 0x7f89dc057900 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.851+0000 7f8a031c9700 1 --2- 172.21.15.133:0/3477915334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89fc0b5c00 0x7f89fc144790 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.851+0000 7f8a031c9700 1 --2- 172.21.15.133:0/3477915334 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f89fc0b0c90 0x7f89fc067100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.851+0000 7f8a031c9700 1 --2- 172.21.15.133:0/3477915334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89fc0b52c0 0x7f89fc1442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:18.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.851+0000 7f8a031c9700 1 -- 172.21.15.133:0/3477915334 >> 172.21.15.133:0/3477915334 conn(0x7f89fc05bdf0 msgr2=0x7f89fc0602e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:18.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.851+0000 7f8a031c9700 1 -- 172.21.15.133:0/3477915334 shutdown_connections 2021-01-03T13:03:18.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:18.851+0000 7f8a031c9700 1 -- 172.21.15.133:0/3477915334 wait complete. 2021-01-03T13:03:18.851 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 27 2021-01-03T13:03:19.162 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:03:13.979157+0000', 'modified': '2021-01-03T13:03:14.982718+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5881}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5881': {'gid': 5881, 'name': 'a', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6835/1530122021', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 1530122021}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 1530122021}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:03:19.162 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:03:19.163 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-01-03T13:03:19.288 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":5881,"want_state":"up:active","state":"up:active","rank_uptime":5.2999551589999996,"mdsmap_epoch":27,"osdmap_epoch":67,"osdmap_epoch_barrier":66,"uptime":10.692896598999999} 2021-01-03T13:03:19.289 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 5881, "mdsmap_epoch": 27, "osdmap_epoch": 67, "osdmap_epoch_barrier": 66, "rank_uptime": 5.299955159, "state": "up:active", "uptime": 10.692896599, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:03:19.290 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:03:19.290 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-01-03T13:03:19.290 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi007.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-01-03T13:03:19.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:19.291 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:03:19.299 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:03:19.360 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:03:19.360 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:03:19.415 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:03:19.417 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:03:19.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:19.418 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:03:19.467 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:03:19.467 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:03:19.510 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:03:19.527 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:03:19.527 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:03:19.581 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:03:19.582 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:03:19.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:19.583 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:03:19.588 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2021-01-03T13:03:19.587+0000 7fc24a8690c0 -1 init, newargv = 0x56395aad1a70 newargc=9ceph-fuse[ 2021-01-03T13:03:19.588 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:12088]: starting ceph client 2021-01-03T13:03:19.598 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12088]: starting fuse 2021-01-03T13:03:20.694 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:03:20.710 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:03:20.710 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:03:20.767 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:03:20.768 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:03:20.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:20.769 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:03:20.815 INFO:teuthology.orchestra.run.smithi007.stdout:50 2021-01-03T13:03:20.815 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:03:20.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:20.816 DEBUG:teuthology.orchestra.run.smithi007:> sudo python3 -c ' 2021-01-03T13:03:20.816 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2021-01-03T13:03:20.817 DEBUG:teuthology.orchestra.run.smithi007:> import re 2021-01-03T13:03:20.817 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:03:20.818 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2021-01-03T13:03:20.818 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:03:20.818 DEBUG:teuthology.orchestra.run.smithi007:> def find_socket(client_name): 2021-01-03T13:03:20.819 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-01-03T13:03:20.819 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2021-01-03T13:03:20.819 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:03:20.820 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2021-01-03T13:03:20.820 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2021-01-03T13:03:20.821 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2021-01-03T13:03:20.821 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2021-01-03T13:03:20.822 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:03:20.822 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2021-01-03T13:03:20.823 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:03:20.823 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:03:20.824 DEBUG:teuthology.orchestra.run.smithi007:> return f 2021-01-03T13:03:20.824 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:03:20.824 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:03:20.825 DEBUG:teuthology.orchestra.run.smithi007:> print(find_socket("client.0")) 2021-01-03T13:03:20.825 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:03:20.905 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.12088.asok 2021-01-03T13:03:20.910 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12088.asok 2021-01-03T13:03:20.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:20.911 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12088.asok status 2021-01-03T13:03:21.009 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2021-01-03T13:03:21.009 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2021-01-03T13:03:21.009 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:03:21.010 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:03:21.010 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2021-01-03T13:03:21.010 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2021-01-03T13:03:21.010 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-01-03T13:03:21.010 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "12088", 2021-01-03T13:03:21.011 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2021-01-03T13:03:21.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:03:21.011 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2021-01-03T13:03:21.011 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2021-01-03T13:03:21.011 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 5438, 2021-01-03T13:03:21.012 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2021-01-03T13:03:21.012 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2021-01-03T13:03:21.012 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2021-01-03T13:03:21.012 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 5438 2021-01-03T13:03:21.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:03:21.013 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:03:21.013 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:03:21.013 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:03:21.013 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1372248364 2021-01-03T13:03:21.014 INFO:teuthology.orchestra.run.smithi007.stdout: } 2021-01-03T13:03:21.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:03:21.014 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:03:21.014 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:03:21.014 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:03:21.015 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1372248364 2021-01-03T13:03:21.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:03:21.015 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.5438 172.21.15.7:0/1372248364", 2021-01-03T13:03:21.015 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "172.21.15.7:0/1372248364", 2021-01-03T13:03:21.015 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2021-01-03T13:03:21.016 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 27, 2021-01-03T13:03:21.016 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 67, 2021-01-03T13:03:21.016 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:03:21.016 INFO:teuthology.orchestra.run.smithi007.stdout: "blacklisted": false, 2021-01-03T13:03:21.016 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2021-01-03T13:03:21.017 INFO:teuthology.orchestra.run.smithi007.stdout:} 2021-01-03T13:03:21.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:21.019 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:03:21.019 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:03:21.025 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:03:21.026 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:03:21.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:21.027 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:03:21.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:21.086 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:03:21.087 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:03:21.135 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:03:21.136 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:03:21.137 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-01-03T13:03:21.137 DEBUG:teuthology.orchestra.run.smithi007:> import sys 2021-01-03T13:03:21.138 DEBUG:teuthology.orchestra.run.smithi007:> import time 2021-01-03T13:03:21.138 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:03:21.138 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:03:21.139 DEBUG:teuthology.orchestra.run.smithi007:> n = 1000 2021-01-03T13:03:21.139 DEBUG:teuthology.orchestra.run.smithi007:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2021-01-03T13:03:21.140 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:03:21.140 DEBUG:teuthology.orchestra.run.smithi007:> if not os.path.exists(os.path.dirname(abs_path)): 2021-01-03T13:03:21.140 DEBUG:teuthology.orchestra.run.smithi007:> os.makedirs(os.path.dirname(abs_path)) 2021-01-03T13:03:21.141 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:03:21.141 DEBUG:teuthology.orchestra.run.smithi007:> for i in range(0, n): 2021-01-03T13:03:21.141 DEBUG:teuthology.orchestra.run.smithi007:> fname = "{0}_{1}".format(abs_path, i) 2021-01-03T13:03:21.142 DEBUG:teuthology.orchestra.run.smithi007:> with open(fname, '"'"'w'"'"') as f: 2021-01-03T13:03:21.142 DEBUG:teuthology.orchestra.run.smithi007:> f.write('"'"'content'"'"') 2021-01-03T13:03:21.143 DEBUG:teuthology.orchestra.run.smithi007:> if True: 2021-01-03T13:03:21.143 DEBUG:teuthology.orchestra.run.smithi007:> f.flush() 2021-01-03T13:03:21.143 DEBUG:teuthology.orchestra.run.smithi007:> os.fsync(f.fileno()) 2021-01-03T13:03:21.144 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:03:34.665 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:03:34.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.776+0000 7f4d7bfff700 1 Processor -- start 2021-01-03T13:03:34.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.776+0000 7f4d7bfff700 1 -- start start 2021-01-03T13:03:34.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.776+0000 7f4d7bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4d7c05c130 0x7f4d7c0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:34.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.776+0000 7f4d7bfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4d7c061890 0x7f4d7c1472d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:34.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.776+0000 7f4d7bfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4d7c1477c0 0x7f4d7c1445e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:34.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.776+0000 7f4d7bfff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7c05c510 con 0x7f4d7c1477c0 2021-01-03T13:03:34.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.776+0000 7f4d7bfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7c14a930 con 0x7f4d7c05c130 2021-01-03T13:03:34.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.776+0000 7f4d7bfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c14abd0 con 0x7f4d7c061890 2021-01-03T13:03:34.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4d7c05c130 0x7f4d7c0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:34.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7b7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4d7c1477c0 0x7f4d7c1445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:34.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4d7c05c130 0x7f4d7c0b25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35300/0 (socket says 172.21.15.133:35300) 2021-01-03T13:03:34.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7affd700 1 -- 172.21.15.133:0/1338810425 learned_addr learned my addr 172.21.15.133:0/1338810425 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:34.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7a7fc700 1 --2- 172.21.15.133:0/1338810425 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4d7c061890 0x7f4d7c1472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:34.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7affd700 1 -- 172.21.15.133:0/1338810425 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4d7c061890 msgr2=0x7f4d7c1472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:34.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7affd700 1 --2- 172.21.15.133:0/1338810425 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4d7c061890 0x7f4d7c1472d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:34.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7affd700 1 -- 172.21.15.133:0/1338810425 >> v2:172.21.15.16:3300/0 conn(0x7f4d7c1477c0 msgr2=0x7f4d7c1445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:34.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7affd700 1 --2- 172.21.15.133:0/1338810425 >> v2:172.21.15.16:3300/0 conn(0x7f4d7c1477c0 0x7f4d7c1445e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:34.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7affd700 1 -- 172.21.15.133:0/1338810425 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c14ae70 con 0x7f4d7c05c130 2021-01-03T13:03:34.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7affd700 1 --2- 172.21.15.133:0/1338810425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c05c130 0x7f4d7c0b25d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f4d64002f30 tx=0x7f4d64006e80).ready entity=mon.1 client_cookie=a544b9bbf0eb9b0f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:34.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d79ffb700 1 -- 172.21.15.133:0/1338810425 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d64009640 con 0x7f4d7c05c130 2021-01-03T13:03:34.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d79ffb700 1 -- 172.21.15.133:0/1338810425 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d640097a0 con 0x7f4d7c05c130 2021-01-03T13:03:34.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d79ffb700 1 -- 172.21.15.133:0/1338810425 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d64009b00 con 0x7f4d7c05c130 2021-01-03T13:03:34.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7bfff700 1 -- 172.21.15.133:0/1338810425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c05c130 msgr2=0x7f4d7c0b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:34.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7bfff700 1 --2- 172.21.15.133:0/1338810425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c05c130 0x7f4d7c0b25d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f4d64002f30 tx=0x7f4d64006e80).stop 2021-01-03T13:03:34.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7bfff700 1 -- 172.21.15.133:0/1338810425 shutdown_connections 2021-01-03T13:03:34.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7bfff700 1 --2- 172.21.15.133:0/1338810425 >> v2:172.21.15.16:3300/0 conn(0x7f4d7c1477c0 0x7f4d7c1445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:34.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7bfff700 1 --2- 172.21.15.133:0/1338810425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c05c130 0x7f4d7c0b25d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:34.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7bfff700 1 --2- 172.21.15.133:0/1338810425 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4d7c061890 0x7f4d7c1472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:34.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7bfff700 1 -- 172.21.15.133:0/1338810425 >> 172.21.15.133:0/1338810425 conn(0x7f4d7c0b6110 msgr2=0x7f4d7c0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:34.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7bfff700 1 -- 172.21.15.133:0/1338810425 shutdown_connections 2021-01-03T13:03:34.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.780+0000 7f4d7bfff700 1 -- 172.21.15.133:0/1338810425 wait complete. 2021-01-03T13:03:34.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7bfff700 1 Processor -- start 2021-01-03T13:03:34.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7bfff700 1 -- start start 2021-01-03T13:03:34.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7bfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4d7c05c130 0x7f4d7c142760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:34.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c061890 0x7f4d7c159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:34.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d7c1477c0 0x7f4d7c159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:34.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7bfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c159e60 con 0x7f4d7c1477c0 2021-01-03T13:03:34.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7bfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0aed40 con 0x7f4d7c061890 2021-01-03T13:03:34.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7bfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c148a60 con 0x7f4d7c05c130 2021-01-03T13:03:34.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c061890 0x7f4d7c159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:34.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7a7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c061890 0x7f4d7c159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35306/0 (socket says 172.21.15.133:35306) 2021-01-03T13:03:34.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7a7fc700 1 -- 172.21.15.133:0/2686409945 learned_addr learned my addr 172.21.15.133:0/2686409945 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:34.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7affd700 1 --2- 172.21.15.133:0/2686409945 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4d7c05c130 0x7f4d7c142760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:34.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7b7fe700 1 --2- 172.21.15.133:0/2686409945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d7c1477c0 0x7f4d7c159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:34.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7a7fc700 1 -- 172.21.15.133:0/2686409945 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4d7c05c130 msgr2=0x7f4d7c142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:34.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7a7fc700 1 --2- 172.21.15.133:0/2686409945 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4d7c05c130 0x7f4d7c142760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:34.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7a7fc700 1 -- 172.21.15.133:0/2686409945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d7c1477c0 msgr2=0x7f4d7c159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:34.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7a7fc700 1 --2- 172.21.15.133:0/2686409945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d7c1477c0 0x7f4d7c159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:34.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7a7fc700 1 -- 172.21.15.133:0/2686409945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c0aef70 con 0x7f4d7c061890 2021-01-03T13:03:34.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7b7fe700 1 --2- 172.21.15.133:0/2686409945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d7c1477c0 0x7f4d7c159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:03:34.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7a7fc700 1 --2- 172.21.15.133:0/2686409945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c061890 0x7f4d7c159480 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f4d6c00c000 tx=0x7f4d6c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:34.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d73fff700 1 -- 172.21.15.133:0/2686409945 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d6c00cbb0 con 0x7f4d7c061890 2021-01-03T13:03:34.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7bfff700 1 -- 172.21.15.133:0/2686409945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7c0af210 con 0x7f4d7c061890 2021-01-03T13:03:34.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d73fff700 1 -- 172.21.15.133:0/2686409945 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6c00cd10 con 0x7f4d7c061890 2021-01-03T13:03:34.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d73fff700 1 -- 172.21.15.133:0/2686409945 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d6c0125e0 con 0x7f4d7c061890 2021-01-03T13:03:34.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7bfff700 1 -- 172.21.15.133:0/2686409945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7c147160 con 0x7f4d7c061890 2021-01-03T13:03:34.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.784+0000 7f4d7bfff700 1 -- 172.21.15.133:0/2686409945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7c057300 con 0x7f4d7c061890 2021-01-03T13:03:34.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.788+0000 7f4d73fff700 1 -- 172.21.15.133:0/2686409945 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4d6c022070 con 0x7f4d7c061890 2021-01-03T13:03:34.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.788+0000 7f4d73fff700 1 --2- 172.21.15.133:0/2686409945 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4d600554e0 0x7f4d600579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:34.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.788+0000 7f4d73fff700 1 -- 172.21.15.133:0/2686409945 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4d6c06e860 con 0x7f4d7c061890 2021-01-03T13:03:34.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.788+0000 7f4d7affd700 1 --2- 172.21.15.133:0/2686409945 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4d600554e0 0x7f4d600579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:34.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.788+0000 7f4d7affd700 1 --2- 172.21.15.133:0/2686409945 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4d600554e0 0x7f4d600579a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f4d64019000 tx=0x7f4d64015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:34.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.792+0000 7f4d73fff700 1 -- 172.21.15.133:0/2686409945 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4d6c044a50 con 0x7f4d7c061890 2021-01-03T13:03:34.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.980+0000 7f4d7bfff700 1 -- 172.21.15.133:0/2686409945 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d7c0af3a0 con 0x7f4d7c061890 2021-01-03T13:03:34.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.980+0000 7f4d73fff700 1 -- 172.21.15.133:0/2686409945 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2499 (secure 0 0 0) 0x7f4d6c048070 con 0x7f4d7c061890 2021-01-03T13:03:34.982 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:34.982 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3007157007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3007157007},{"type":"v1","addr":"172.21.15.133:6837","nonce":3007157007}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24},{"gid":5826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/1513472080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1513472080},{"type":"v1","addr":"172.21.15.16:6833","nonce":1513472080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:03:13.979157+0000","modified":"2021-01-03T13:03:14.982718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5881":{"gid":5881,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/1530122021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1530122021},{"type":"v1","addr":"172.21.15.133:6835","nonce":1530122021}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-01-03T13:03:34.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.984+0000 7f4d7bfff700 1 -- 172.21.15.133:0/2686409945 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4d600554e0 msgr2=0x7f4d600579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:34.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.984+0000 7f4d7bfff700 1 --2- 172.21.15.133:0/2686409945 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4d600554e0 0x7f4d600579a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f4d64019000 tx=0x7f4d64015000).stop 2021-01-03T13:03:34.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.984+0000 7f4d7bfff700 1 -- 172.21.15.133:0/2686409945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c061890 msgr2=0x7f4d7c159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:34.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.984+0000 7f4d7bfff700 1 --2- 172.21.15.133:0/2686409945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c061890 0x7f4d7c159480 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f4d6c00c000 tx=0x7f4d6c0091a0).stop 2021-01-03T13:03:34.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.984+0000 7f4d7bfff700 1 -- 172.21.15.133:0/2686409945 shutdown_connections 2021-01-03T13:03:34.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.984+0000 7f4d7bfff700 1 --2- 172.21.15.133:0/2686409945 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4d600554e0 0x7f4d600579a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:34.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.984+0000 7f4d7bfff700 1 --2- 172.21.15.133:0/2686409945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d7c1477c0 0x7f4d7c159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:34.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.984+0000 7f4d7bfff700 1 --2- 172.21.15.133:0/2686409945 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4d7c05c130 0x7f4d7c142760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:34.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.984+0000 7f4d7bfff700 1 --2- 172.21.15.133:0/2686409945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d7c061890 0x7f4d7c159480 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:34.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.984+0000 7f4d7bfff700 1 -- 172.21.15.133:0/2686409945 >> 172.21.15.133:0/2686409945 conn(0x7f4d7c0b6110 msgr2=0x7f4d7c0ab720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:34.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.984+0000 7f4d7bfff700 1 -- 172.21.15.133:0/2686409945 shutdown_connections 2021-01-03T13:03:34.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:34.984+0000 7f4d7bfff700 1 -- 172.21.15.133:0/2686409945 wait complete. 2021-01-03T13:03:34.987 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 27 2021-01-03T13:03:34.999 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2021-01-03T13:03:35.124 INFO:teuthology.orchestra.run.smithi133.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2021-01-03T13:03:35.124 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2021-01-03T13:03:35.124 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:03:35.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4672606700 1 Processor -- start 2021-01-03T13:03:35.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4672606700 1 -- start start 2021-01-03T13:03:35.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4672606700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f466c0b0210 0x7f466c141180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:35.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4672606700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466c0af5e0 con 0x7f466c0af200 2021-01-03T13:03:35.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4672606700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466c05c620 con 0x7f466c144bb0 2021-01-03T13:03:35.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4672606700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f466c05c8c0 con 0x7f466c0b0210 2021-01-03T13:03:35.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4671e05700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f466c144bb0 0x7f466c0ab300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56348/0 (socket says 172.21.15.133:56348) 2021-01-03T13:03:35.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4671e05700 1 -- 172.21.15.133:0/590090862 learned_addr learned my addr 172.21.15.133:0/590090862 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:35.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4670e03700 1 --2- 172.21.15.133:0/590090862 >> v2:172.21.15.16:3300/0 conn(0x7f466c0b0210 0x7f466c141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:35.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 -- 172.21.15.133:0/590090862 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328930897 0 0) 0x7f466c05c620 con 0x7f466c144bb0 2021-01-03T13:03:35.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 -- 172.21.15.133:0/590090862 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4650003230 con 0x7f466c144bb0 2021-01-03T13:03:35.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 -- 172.21.15.133:0/590090862 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424859394 0 0) 0x7f466c0af5e0 con 0x7f466c0af200 2021-01-03T13:03:35.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 -- 172.21.15.133:0/590090862 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f466c05c620 con 0x7f466c0af200 2021-01-03T13:03:35.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 -- 172.21.15.133:0/590090862 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 210446374 0 0) 0x7f4650003230 con 0x7f466c144bb0 2021-01-03T13:03:35.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 -- 172.21.15.133:0/590090862 >> v2:172.21.15.16:3300/0 conn(0x7f466c0b0210 msgr2=0x7f466c141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:35.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 --2- 172.21.15.133:0/590090862 >> v2:172.21.15.16:3300/0 conn(0x7f466c0b0210 0x7f466c141180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:35.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 -- 172.21.15.133:0/590090862 >> v1:172.21.15.16:6789/0 conn(0x7f466c0af200 legacy=0x7f466c05bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:35.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 -- 172.21.15.133:0/590090862 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c140a40 con 0x7f466c144bb0 2021-01-03T13:03:35.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 -- 172.21.15.133:0/590090862 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f46680016d0 con 0x7f466c144bb0 2021-01-03T13:03:35.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 -- 172.21.15.133:0/590090862 >> v1:172.21.15.133:6789/0 conn(0x7f466c144bb0 legacy=0x7f466c0ab300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:35.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 --2- 172.21.15.133:0/590090862 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f46500038b0 0x7f4650003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:35.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 --2- 172.21.15.133:0/590090862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46500044d0 0x7f4650004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:35.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 --2- 172.21.15.133:0/590090862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4650004e40 0x7f465000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:35.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 -- 172.21.15.133:0/590090862 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c05c8c0 con 0x7f4650004e40 2021-01-03T13:03:35.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 -- 172.21.15.133:0/590090862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46500053a0 con 0x7f46500044d0 2021-01-03T13:03:35.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 -- 172.21.15.133:0/590090862 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465000bc90 con 0x7f46500038b0 2021-01-03T13:03:35.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4671e05700 1 --2- 172.21.15.133:0/590090862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4650004e40 0x7f465000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:35.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4670e03700 1 --2- 172.21.15.133:0/590090862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46500044d0 0x7f4650004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:35.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4671604700 1 --2- 172.21.15.133:0/590090862 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f46500038b0 0x7f4650003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:35.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4670e03700 1 -- 172.21.15.133:0/590090862 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f46500038b0 msgr2=0x7f4650003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:35.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4670e03700 1 --2- 172.21.15.133:0/590090862 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f46500038b0 0x7f4650003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:35.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4670e03700 1 -- 172.21.15.133:0/590090862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4650004e40 msgr2=0x7f465000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4670e03700 1 --2- 172.21.15.133:0/590090862 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4650004e40 0x7f465000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4671e05700 1 -- 172.21.15.133:0/590090862 reap_dead start 2021-01-03T13:03:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4670e03700 1 -- 172.21.15.133:0/590090862 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4650003230 con 0x7f46500044d0 2021-01-03T13:03:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4670e03700 1 --2- 172.21.15.133:0/590090862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46500044d0 0x7f4650004950 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f465c00c000 tx=0x7f465c008040).ready entity=mon.1 client_cookie=563ecebb121530 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:35.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 -- 172.21.15.133:0/590090862 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f465c00e8a0 con 0x7f46500044d0 2021-01-03T13:03:35.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 -- 172.21.15.133:0/590090862 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c00ea00 con 0x7f46500044d0 2021-01-03T13:03:35.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4672606700 1 -- 172.21.15.133:0/590090862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46500044d0 msgr2=0x7f4650004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:35.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4663fff700 1 -- 172.21.15.133:0/590090862 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f465c00ed60 con 0x7f46500044d0 2021-01-03T13:03:35.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.236+0000 7f4672606700 1 --2- 172.21.15.133:0/590090862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46500044d0 0x7f4650004950 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f465c00c000 tx=0x7f465c008040).stop 2021-01-03T13:03:35.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4672606700 1 -- 172.21.15.133:0/590090862 shutdown_connections 2021-01-03T13:03:35.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4672606700 1 --2- 172.21.15.133:0/590090862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f46500044d0 0x7f4650004950 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:35.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4672606700 1 -- 172.21.15.133:0/590090862 >> 172.21.15.133:0/590090862 conn(0x7f466c06b050 msgr2=0x7f466c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:35.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4672606700 1 -- 172.21.15.133:0/590090862 shutdown_connections 2021-01-03T13:03:35.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4672606700 1 -- 172.21.15.133:0/590090862 wait complete. 2021-01-03T13:03:35.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4672606700 1 Processor -- start 2021-01-03T13:03:35.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4672606700 1 -- start start 2021-01-03T13:03:35.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4672606700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46500044d0 0x7f466c142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:35.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4672606700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c066b90 0x7f466c13dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:35.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4672606700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f466c0ae450 0x7f466c13dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:35.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4672606700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c065740 con 0x7f46500044d0 2021-01-03T13:03:35.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4672606700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c14fba0 con 0x7f466c066b90 2021-01-03T13:03:35.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4672606700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466c065f50 con 0x7f466c0ae450 2021-01-03T13:03:35.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4670e03700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c066b90 0x7f466c13dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:35.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4670e03700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c066b90 0x7f466c13dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35326/0 (socket says 172.21.15.133:35326) 2021-01-03T13:03:35.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4670e03700 1 -- 172.21.15.133:0/1372325646 learned_addr learned my addr 172.21.15.133:0/1372325646 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:35.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4671604700 1 --2- 172.21.15.133:0/1372325646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46500044d0 0x7f466c142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:35.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4671e05700 1 --2- 172.21.15.133:0/1372325646 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f466c0ae450 0x7f466c13dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:35.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4670e03700 1 -- 172.21.15.133:0/1372325646 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f466c0ae450 msgr2=0x7f466c13dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:35.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4670e03700 1 --2- 172.21.15.133:0/1372325646 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f466c0ae450 0x7f466c13dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:35.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4670e03700 1 -- 172.21.15.133:0/1372325646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46500044d0 msgr2=0x7f466c142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:35.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4670e03700 1 --2- 172.21.15.133:0/1372325646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46500044d0 0x7f466c142f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:35.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4670e03700 1 -- 172.21.15.133:0/1372325646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c0661b0 con 0x7f466c066b90 2021-01-03T13:03:35.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4671e05700 1 --2- 172.21.15.133:0/1372325646 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f466c0ae450 0x7f466c13dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:35.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4670e03700 1 --2- 172.21.15.133:0/1372325646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c066b90 0x7f466c13dab0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f465c00c000 tx=0x7f465c01a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:35.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f46627fc700 1 -- 172.21.15.133:0/1372325646 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f465c0123f0 con 0x7f466c066b90 2021-01-03T13:03:35.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f46627fc700 1 -- 172.21.15.133:0/1372325646 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c012550 con 0x7f466c066b90 2021-01-03T13:03:35.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4672606700 1 -- 172.21.15.133:0/1372325646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466c066450 con 0x7f466c066b90 2021-01-03T13:03:35.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f46627fc700 1 -- 172.21.15.133:0/1372325646 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f465c0128b0 con 0x7f466c066b90 2021-01-03T13:03:35.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.240+0000 7f4672606700 1 -- 172.21.15.133:0/1372325646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466c13e490 con 0x7f466c066b90 2021-01-03T13:03:35.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.244+0000 7f4672606700 1 -- 172.21.15.133:0/1372325646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466c057300 con 0x7f466c066b90 2021-01-03T13:03:35.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.244+0000 7f46627fc700 1 -- 172.21.15.133:0/1372325646 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f465c012a10 con 0x7f466c066b90 2021-01-03T13:03:35.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.244+0000 7f46627fc700 1 --2- 172.21.15.133:0/1372325646 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f46540553b0 0x7f4654057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:35.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.244+0000 7f46627fc700 1 -- 172.21.15.133:0/1372325646 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f465c06f610 con 0x7f466c066b90 2021-01-03T13:03:35.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.244+0000 7f4671604700 1 --2- 172.21.15.133:0/1372325646 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f46540553b0 0x7f4654057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:35.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.244+0000 7f4671604700 1 --2- 172.21.15.133:0/1372325646 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f46540553b0 0x7f4654057870 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f4664003000 tx=0x7f4664007ee0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:35.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.248+0000 7f46627fc700 1 -- 172.21.15.133:0/1372325646 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f465c045870 con 0x7f466c066b90 2021-01-03T13:03:35.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.432+0000 7f4672606700 1 -- 172.21.15.133:0/1372325646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f466c05f080 con 0x7f466c066b90 2021-01-03T13:03:35.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.432+0000 7f46627fc700 1 -- 172.21.15.133:0/1372325646 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2499 (secure 0 0 0) 0x7f465c016020 con 0x7f466c066b90 2021-01-03T13:03:35.433 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:35.434 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3007157007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3007157007},{"type":"v1","addr":"172.21.15.133:6837","nonce":3007157007}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24},{"gid":5826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/1513472080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1513472080},{"type":"v1","addr":"172.21.15.16:6833","nonce":1513472080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:03:13.979157+0000","modified":"2021-01-03T13:03:14.982718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5881":{"gid":5881,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/1530122021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1530122021},{"type":"v1","addr":"172.21.15.133:6835","nonce":1530122021}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-01-03T13:03:35.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.432+0000 7f4672606700 1 -- 172.21.15.133:0/1372325646 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f46540553b0 msgr2=0x7f4654057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:35.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.432+0000 7f4672606700 1 --2- 172.21.15.133:0/1372325646 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f46540553b0 0x7f4654057870 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f4664003000 tx=0x7f4664007ee0).stop 2021-01-03T13:03:35.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.432+0000 7f4672606700 1 -- 172.21.15.133:0/1372325646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c066b90 msgr2=0x7f466c13dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:35.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.432+0000 7f4672606700 1 --2- 172.21.15.133:0/1372325646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c066b90 0x7f466c13dab0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f465c00c000 tx=0x7f465c01a000).stop 2021-01-03T13:03:35.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.432+0000 7f4672606700 1 -- 172.21.15.133:0/1372325646 shutdown_connections 2021-01-03T13:03:35.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.432+0000 7f4672606700 1 --2- 172.21.15.133:0/1372325646 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f46540553b0 0x7f4654057870 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:35.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.432+0000 7f4672606700 1 --2- 172.21.15.133:0/1372325646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46500044d0 0x7f466c142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:35.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.432+0000 7f4672606700 1 --2- 172.21.15.133:0/1372325646 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f466c0ae450 0x7f466c13dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:35.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.432+0000 7f4672606700 1 --2- 172.21.15.133:0/1372325646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f466c066b90 0x7f466c13dab0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:35.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.432+0000 7f4672606700 1 -- 172.21.15.133:0/1372325646 >> 172.21.15.133:0/1372325646 conn(0x7f466c06b050 msgr2=0x7f466c0b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:35.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.436+0000 7f4672606700 1 -- 172.21.15.133:0/1372325646 shutdown_connections 2021-01-03T13:03:35.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.436+0000 7f4672606700 1 -- 172.21.15.133:0/1372325646 wait complete. 2021-01-03T13:03:35.439 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 27 2021-01-03T13:03:35.447 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2021-01-03T13:03:35.565 INFO:teuthology.orchestra.run.smithi133.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2021-01-03T13:03:35.565 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2021-01-03T13:03:35.566 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:03:35.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f8fac700 1 Processor -- start 2021-01-03T13:03:35.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f8fac700 1 -- start start 2021-01-03T13:03:35.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f8fac700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa6f414b890 0x7fa6f414dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:35.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f8fac700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f40b7130 con 0x7fa6f40b6d50 2021-01-03T13:03:35.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f8fac700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f40ae600 con 0x7fa6f4142e90 2021-01-03T13:03:35.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f8fac700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f40ae8a0 con 0x7fa6f414b890 2021-01-03T13:03:35.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f1d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa6f4142e90 0x7fa6f4143320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56366/0 (socket says 172.21.15.133:56366) 2021-01-03T13:03:35.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f1d9b700 1 -- 172.21.15.133:0/3928159578 learned_addr learned my addr 172.21.15.133:0/3928159578 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:35.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f2d9d700 1 --2- 172.21.15.133:0/3928159578 >> v2:172.21.15.133:3300/0 conn(0x7fa6f414b890 0x7fa6f414dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:35.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f2d9d700 1 -- 172.21.15.133:0/3928159578 >> v1:172.21.15.133:6789/0 conn(0x7fa6f4142e90 legacy=0x7fa6f4143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:35.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f2d9d700 1 -- 172.21.15.133:0/3928159578 >> v1:172.21.15.16:6789/0 conn(0x7fa6f40b6d50 legacy=0x7fa6f4146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:35.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f159a700 1 -- 172.21.15.133:0/3928159578 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663864288 0 0) 0x7fa6f40ae600 con 0x7fa6f4142e90 2021-01-03T13:03:35.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f2d9d700 1 -- 172.21.15.133:0/3928159578 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f40aeb40 con 0x7fa6f414b890 2021-01-03T13:03:35.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f2d9d700 1 --2- 172.21.15.133:0/3928159578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f414b890 0x7fa6f414dc80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fa6ec0032b0 tx=0x7fa6ec0091a0).ready entity=mon.1 client_cookie=2b4af1d05d68477a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:35.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f159a700 1 -- 172.21.15.133:0/3928159578 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6ec00ba50 con 0x7fa6f414b890 2021-01-03T13:03:35.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f159a700 1 -- 172.21.15.133:0/3928159578 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec00bbb0 con 0x7fa6f414b890 2021-01-03T13:03:35.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f159a700 1 -- 172.21.15.133:0/3928159578 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6ec00bd20 con 0x7fa6f414b890 2021-01-03T13:03:35.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f8fac700 1 -- 172.21.15.133:0/3928159578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f414b890 msgr2=0x7fa6f414dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:35.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.676+0000 7fa6f8fac700 1 --2- 172.21.15.133:0/3928159578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f414b890 0x7fa6f414dc80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fa6ec0032b0 tx=0x7fa6ec0091a0).stop 2021-01-03T13:03:35.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f8fac700 1 -- 172.21.15.133:0/3928159578 shutdown_connections 2021-01-03T13:03:35.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f8fac700 1 --2- 172.21.15.133:0/3928159578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f414b890 0x7fa6f414dc80 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:35.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f8fac700 1 -- 172.21.15.133:0/3928159578 >> 172.21.15.133:0/3928159578 conn(0x7fa6f40622f0 msgr2=0x7fa6f40b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:35.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f8fac700 1 -- 172.21.15.133:0/3928159578 shutdown_connections 2021-01-03T13:03:35.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f8fac700 1 -- 172.21.15.133:0/3928159578 wait complete. 2021-01-03T13:03:35.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f8fac700 1 Processor -- start 2021-01-03T13:03:35.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f8fac700 1 -- start start 2021-01-03T13:03:35.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f8fac700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa6f40b6d50 0x7fa6f4138de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f8fac700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f4142e90 0x7fa6f4148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f8fac700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6f414b890 0x7fa6f40b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f8fac700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4144c30 con 0x7fa6f414b890 2021-01-03T13:03:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f8fac700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4147660 con 0x7fa6f4142e90 2021-01-03T13:03:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f8fac700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4147b30 con 0x7fa6f40b6d50 2021-01-03T13:03:35.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f4142e90 0x7fa6f4148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:35.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f4142e90 0x7fa6f4148eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35340/0 (socket says 172.21.15.133:35340) 2021-01-03T13:03:35.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f1d9b700 1 -- 172.21.15.133:0/1172041748 learned_addr learned my addr 172.21.15.133:0/1172041748 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:35.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f2d9d700 1 --2- 172.21.15.133:0/1172041748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6f414b890 0x7fa6f40b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:35.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f259c700 1 --2- 172.21.15.133:0/1172041748 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa6f40b6d50 0x7fa6f4138de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:35.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f1d9b700 1 -- 172.21.15.133:0/1172041748 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa6f40b6d50 msgr2=0x7fa6f4138de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:35.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f1d9b700 1 --2- 172.21.15.133:0/1172041748 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa6f40b6d50 0x7fa6f4138de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:35.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f1d9b700 1 -- 172.21.15.133:0/1172041748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6f414b890 msgr2=0x7fa6f40b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:35.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f1d9b700 1 --2- 172.21.15.133:0/1172041748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6f414b890 0x7fa6f40b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:35.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f1d9b700 1 -- 172.21.15.133:0/1172041748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f40afbe0 con 0x7fa6f4142e90 2021-01-03T13:03:35.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f2d9d700 1 --2- 172.21.15.133:0/1172041748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6f414b890 0x7fa6f40b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:35.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f1d9b700 1 --2- 172.21.15.133:0/1172041748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f4142e90 0x7fa6f4148eb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fa6dc000b80 tx=0x7fa6dc007a30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:35.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6eb7fe700 1 -- 172.21.15.133:0/1172041748 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6dc007320 con 0x7fa6f4142e90 2021-01-03T13:03:35.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6eb7fe700 1 -- 172.21.15.133:0/1172041748 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc007480 con 0x7fa6f4142e90 2021-01-03T13:03:35.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6f8fac700 1 -- 172.21.15.133:0/1172041748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f4144e60 con 0x7fa6f4142e90 2021-01-03T13:03:35.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.680+0000 7fa6eb7fe700 1 -- 172.21.15.133:0/1172041748 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6dc0057d0 con 0x7fa6f4142e90 2021-01-03T13:03:35.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.684+0000 7fa6f8fac700 1 -- 172.21.15.133:0/1172041748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f41392d0 con 0x7fa6f4142e90 2021-01-03T13:03:35.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.684+0000 7fa6f8fac700 1 -- 172.21.15.133:0/1172041748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f4144ff0 con 0x7fa6f4142e90 2021-01-03T13:03:35.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.684+0000 7fa6eb7fe700 1 -- 172.21.15.133:0/1172041748 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa6dc010030 con 0x7fa6f4142e90 2021-01-03T13:03:35.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.684+0000 7fa6eb7fe700 1 --2- 172.21.15.133:0/1172041748 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa6d8055440 0x7fa6d8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:35.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.684+0000 7fa6eb7fe700 1 -- 172.21.15.133:0/1172041748 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa6dc06dc20 con 0x7fa6f4142e90 2021-01-03T13:03:35.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.684+0000 7fa6f259c700 1 --2- 172.21.15.133:0/1172041748 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa6d8055440 0x7fa6d8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:35.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.684+0000 7fa6f259c700 1 --2- 172.21.15.133:0/1172041748 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa6d8055440 0x7fa6d8057900 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fa6e400b000 tx=0x7fa6e4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:35.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.688+0000 7fa6eb7fe700 1 -- 172.21.15.133:0/1172041748 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa6dc043f20 con 0x7fa6f4142e90 2021-01-03T13:03:35.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.872+0000 7fa6f8fac700 1 -- 172.21.15.133:0/1172041748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6f4057300 con 0x7fa6f4142e90 2021-01-03T13:03:35.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.872+0000 7fa6eb7fe700 1 -- 172.21.15.133:0/1172041748 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2499 (secure 0 0 0) 0x7fa6dc047540 con 0x7fa6f4142e90 2021-01-03T13:03:35.874 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:35.875 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3007157007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3007157007},{"type":"v1","addr":"172.21.15.133:6837","nonce":3007157007}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24},{"gid":5826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/1513472080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1513472080},{"type":"v1","addr":"172.21.15.16:6833","nonce":1513472080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:03:13.979157+0000","modified":"2021-01-03T13:03:14.982718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5881":{"gid":5881,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/1530122021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1530122021},{"type":"v1","addr":"172.21.15.133:6835","nonce":1530122021}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-01-03T13:03:35.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.876+0000 7fa6f8fac700 1 -- 172.21.15.133:0/1172041748 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa6d8055440 msgr2=0x7fa6d8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:35.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.876+0000 7fa6f8fac700 1 --2- 172.21.15.133:0/1172041748 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa6d8055440 0x7fa6d8057900 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fa6e400b000 tx=0x7fa6e4009040).stop 2021-01-03T13:03:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.876+0000 7fa6f8fac700 1 -- 172.21.15.133:0/1172041748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f4142e90 msgr2=0x7fa6f4148eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.876+0000 7fa6f8fac700 1 --2- 172.21.15.133:0/1172041748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f4142e90 0x7fa6f4148eb0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fa6dc000b80 tx=0x7fa6dc007a30).stop 2021-01-03T13:03:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.876+0000 7fa6f8fac700 1 -- 172.21.15.133:0/1172041748 shutdown_connections 2021-01-03T13:03:35.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.876+0000 7fa6f8fac700 1 --2- 172.21.15.133:0/1172041748 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa6d8055440 0x7fa6d8057900 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.876+0000 7fa6f8fac700 1 --2- 172.21.15.133:0/1172041748 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6f414b890 0x7fa6f40b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.876+0000 7fa6f8fac700 1 --2- 172.21.15.133:0/1172041748 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa6f40b6d50 0x7fa6f4138de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.876+0000 7fa6f8fac700 1 --2- 172.21.15.133:0/1172041748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6f4142e90 0x7fa6f4148eb0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.876+0000 7fa6f8fac700 1 -- 172.21.15.133:0/1172041748 >> 172.21.15.133:0/1172041748 conn(0x7fa6f40622f0 msgr2=0x7fa6f413d140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:35.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.876+0000 7fa6f8fac700 1 -- 172.21.15.133:0/1172041748 shutdown_connections 2021-01-03T13:03:35.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:35.876+0000 7fa6f8fac700 1 -- 172.21.15.133:0/1172041748 wait complete. 2021-01-03T13:03:35.879 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 27 2021-01-03T13:03:35.888 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mds.a cache drop 10 2021-01-03T13:03:36.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.000+0000 7feaa759e700 1 Processor -- start 2021-01-03T13:03:36.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.000+0000 7feaa759e700 1 -- start start 2021-01-03T13:03:36.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.000+0000 7feaa759e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feaa81449b0 0x7feaa81477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.000+0000 7feaa759e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa80b0c10 con 0x7feaa80b5c00 2021-01-03T13:03:36.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.000+0000 7feaa759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa80b5640 con 0x7feaa80b5260 2021-01-03T13:03:36.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.000+0000 7feaa759e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa8144e00 con 0x7feaa81449b0 2021-01-03T13:03:36.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.000+0000 7feaa659c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feaa80b5260 0x7feaa81470b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56378/0 (socket says 172.21.15.133:56378) 2021-01-03T13:03:36.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa659c700 1 -- 172.21.15.133:0/3745784663 learned_addr learned my addr 172.21.15.133:0/3745784663 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:36.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa6d9d700 1 --2- 172.21.15.133:0/3745784663 >> v2:172.21.15.16:3300/0 conn(0x7feaa81449b0 0x7feaa81477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa559a700 1 -- 172.21.15.133:0/3745784663 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962981450 0 0) 0x7feaa80b5640 con 0x7feaa80b5260 2021-01-03T13:03:36.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa559a700 1 -- 172.21.15.133:0/3745784663 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea8c003230 con 0x7feaa80b5260 2021-01-03T13:03:36.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa6d9d700 1 -- 172.21.15.133:0/3745784663 >> v1:172.21.15.133:6789/0 conn(0x7feaa80b5260 legacy=0x7feaa81470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:36.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa6d9d700 1 -- 172.21.15.133:0/3745784663 >> v1:172.21.15.16:6789/0 conn(0x7feaa80b5c00 legacy=0x7feaa81442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:36.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa6d9d700 1 -- 172.21.15.133:0/3745784663 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa809a4f0 con 0x7feaa81449b0 2021-01-03T13:03:36.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa6d9d700 1 --2- 172.21.15.133:0/3745784663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaa81449b0 0x7feaa81477c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7feaa00032b0 tx=0x7feaa00091a0).ready entity=mon.0 client_cookie=836c9aed90aea381 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:36.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa559a700 1 -- 172.21.15.133:0/3745784663 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feaa000b9a0 con 0x7feaa81449b0 2021-01-03T13:03:36.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa559a700 1 -- 172.21.15.133:0/3745784663 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa000bb00 con 0x7feaa81449b0 2021-01-03T13:03:36.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa559a700 1 -- 172.21.15.133:0/3745784663 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feaa000bc70 con 0x7feaa81449b0 2021-01-03T13:03:36.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa759e700 1 -- 172.21.15.133:0/3745784663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaa81449b0 msgr2=0x7feaa81477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:36.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa759e700 1 --2- 172.21.15.133:0/3745784663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaa81449b0 0x7feaa81477c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7feaa00032b0 tx=0x7feaa00091a0).stop 2021-01-03T13:03:36.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa759e700 1 -- 172.21.15.133:0/3745784663 shutdown_connections 2021-01-03T13:03:36.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa759e700 1 --2- 172.21.15.133:0/3745784663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaa81449b0 0x7feaa81477c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa759e700 1 -- 172.21.15.133:0/3745784663 >> 172.21.15.133:0/3745784663 conn(0x7feaa805bdf0 msgr2=0x7feaa805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:36.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa759e700 1 -- 172.21.15.133:0/3745784663 shutdown_connections 2021-01-03T13:03:36.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa759e700 1 -- 172.21.15.133:0/3745784663 wait complete. 2021-01-03T13:03:36.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa759e700 1 Processor -- start 2021-01-03T13:03:36.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.004+0000 7feaa759e700 1 -- start start 2021-01-03T13:03:36.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa759e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feaa80b5260 0x7feaa80b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa759e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaa80b5c00 0x7feaa80ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaa81449b0 0x7feaa80aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa759e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa80adec0 con 0x7feaa80b5c00 2021-01-03T13:03:36.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa80651e0 con 0x7feaa81449b0 2021-01-03T13:03:36.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa759e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa8065480 con 0x7feaa80b5260 2021-01-03T13:03:36.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaa81449b0 0x7feaa80aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaa81449b0 0x7feaa80aebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35356/0 (socket says 172.21.15.133:35356) 2021-01-03T13:03:36.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa6d9d700 1 -- 172.21.15.133:0/294006985 learned_addr learned my addr 172.21.15.133:0/294006985 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:36.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa659c700 1 --2- 172.21.15.133:0/294006985 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feaa80b5260 0x7feaa80b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa5d9b700 1 --2- 172.21.15.133:0/294006985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaa80b5c00 0x7feaa80ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa6d9d700 1 -- 172.21.15.133:0/294006985 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feaa80b5260 msgr2=0x7feaa80b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:36.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa6d9d700 1 --2- 172.21.15.133:0/294006985 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feaa80b5260 0x7feaa80b4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa6d9d700 1 -- 172.21.15.133:0/294006985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaa80b5c00 msgr2=0x7feaa80ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:36.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa6d9d700 1 --2- 172.21.15.133:0/294006985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaa80b5c00 0x7feaa80ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa6d9d700 1 -- 172.21.15.133:0/294006985 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa80ad690 con 0x7feaa81449b0 2021-01-03T13:03:36.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa659c700 1 --2- 172.21.15.133:0/294006985 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feaa80b5260 0x7feaa80b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:36.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa6d9d700 1 --2- 172.21.15.133:0/294006985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaa81449b0 0x7feaa80aebe0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7feaa00032b0 tx=0x7feaa0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:36.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7fea9f7fe700 1 -- 172.21.15.133:0/294006985 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feaa000bc70 con 0x7feaa81449b0 2021-01-03T13:03:36.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa759e700 1 -- 172.21.15.133:0/294006985 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa80ada90 con 0x7feaa81449b0 2021-01-03T13:03:36.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7fea9f7fe700 1 -- 172.21.15.133:0/294006985 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa00107a0 con 0x7feaa81449b0 2021-01-03T13:03:36.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7fea9f7fe700 1 -- 172.21.15.133:0/294006985 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feaa0010b00 con 0x7feaa81449b0 2021-01-03T13:03:36.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.008+0000 7feaa759e700 1 -- 172.21.15.133:0/294006985 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa8065b40 con 0x7feaa81449b0 2021-01-03T13:03:36.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.012+0000 7fea9f7fe700 1 -- 172.21.15.133:0/294006985 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7feaa001e070 con 0x7feaa81449b0 2021-01-03T13:03:36.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.012+0000 7fea9f7fe700 1 --2- 172.21.15.133:0/294006985 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea80055440 0x7fea80057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.012+0000 7fea9f7fe700 1 -- 172.21.15.133:0/294006985 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feaa006efe0 con 0x7feaa81449b0 2021-01-03T13:03:36.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.012+0000 7feaa659c700 1 --2- 172.21.15.133:0/294006985 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea80055440 0x7fea80057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.012+0000 7feaa659c700 1 --2- 172.21.15.133:0/294006985 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea80055440 0x7fea80057900 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fea9000b000 tx=0x7fea90009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:36.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.012+0000 7feabb4d1740 1 Processor -- start 2021-01-03T13:03:36.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.012+0000 7feabb4d1740 1 -- start start 2021-01-03T13:03:36.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feabb4d1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x21a0770 0x21eaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feabb4d1740 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x2008820 0x2222ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feabb4d1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1f9ac20 0x2222fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feabb4d1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x210ed80 con 0x1f9ac20 2021-01-03T13:03:36.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feabb4d1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x20216b0 con 0x21a0770 2021-01-03T13:03:36.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feabb4d1740 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x2144e20 con 0x2008820 2021-01-03T13:03:36.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feaa659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x21a0770 0x21eaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feaa659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x21a0770 0x21eaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35360/0 (socket says 172.21.15.133:35360) 2021-01-03T13:03:36.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feaa659c700 1 -- 172.21.15.133:0/2581292701 learned_addr learned my addr 172.21.15.133:0/2581292701 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:36.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feaa5d9b700 1 --2- 172.21.15.133:0/2581292701 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x2008820 0x2222ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feaa6d9d700 1 --2- 172.21.15.133:0/2581292701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1f9ac20 0x2222fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feaa659c700 1 -- 172.21.15.133:0/2581292701 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x2008820 msgr2=0x2222ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:36.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feaa659c700 1 --2- 172.21.15.133:0/2581292701 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x2008820 0x2222ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feaa659c700 1 -- 172.21.15.133:0/2581292701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1f9ac20 msgr2=0x2222fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:36.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feaa659c700 1 --2- 172.21.15.133:0/2581292701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1f9ac20 0x2222fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feaa659c700 1 -- 172.21.15.133:0/2581292701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2124d40 con 0x21a0770 2021-01-03T13:03:36.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feaa6d9d700 1 --2- 172.21.15.133:0/2581292701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1f9ac20 0x2222fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:36.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feaa659c700 1 --2- 172.21.15.133:0/2581292701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x21a0770 0x21eaec0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x21ed850 tx=0x7fea90007000).ready entity=mon.1 client_cookie=db1281f6cbde679a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feaa759e700 1 -- 172.21.15.133:0/2581292701 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea90018a60 con 0x21a0770 2021-01-03T13:03:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feaa759e700 1 -- 172.21.15.133:0/2581292701 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea90018bc0 con 0x21a0770 2021-01-03T13:03:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feaa759e700 1 -- 172.21.15.133:0/2581292701 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea90016470 con 0x21a0770 2021-01-03T13:03:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feabb4d1740 1 -- 172.21.15.133:0/2581292701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x21a0770 msgr2=0x21eaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feabb4d1740 1 --2- 172.21.15.133:0/2581292701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x21a0770 0x21eaec0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x21ed850 tx=0x7fea90007000).stop 2021-01-03T13:03:36.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feabb4d1740 1 -- 172.21.15.133:0/2581292701 shutdown_connections 2021-01-03T13:03:36.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feabb4d1740 1 --2- 172.21.15.133:0/2581292701 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1f9ac20 0x2222fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feabb4d1740 1 --2- 172.21.15.133:0/2581292701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x21a0770 0x21eaec0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feabb4d1740 1 --2- 172.21.15.133:0/2581292701 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x2008820 0x2222ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feabb4d1740 1 -- 172.21.15.133:0/2581292701 >> 172.21.15.133:0/2581292701 conn(0x21cff50 msgr2=0x21ebd60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:36.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feabb4d1740 1 -- 172.21.15.133:0/2581292701 shutdown_connections 2021-01-03T13:03:36.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.016+0000 7feabb4d1740 1 -- 172.21.15.133:0/2581292701 wait complete. 2021-01-03T13:03:36.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 1 -- start start 2021-01-03T13:03:36.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 1 Processor -- start 2021-01-03T13:03:36.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1f9ac20 0x2222e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2008820 0x21eeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x21a0770 0x2235640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x2144f60 con 0x1f9ac20 2021-01-03T13:03:36.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x2146530 con 0x2008820 2021-01-03T13:03:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x21277b0 con 0x21a0770 2021-01-03T13:03:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 10 client.0 ll_register_callbacks cb 0x21cfeb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-01-03T13:03:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feaa5d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2008820 0x21eeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feaa5d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2008820 0x21eeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35368/0 (socket says 172.21.15.133:35368) 2021-01-03T13:03:36.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feaa5d9b700 1 -- 172.21.15.133:0/2043392332 learned_addr learned my addr 172.21.15.133:0/2043392332 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feaa659c700 1 --2- 172.21.15.133:0/2043392332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1f9ac20 0x2222e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feaa6d9d700 1 --2- 172.21.15.133:0/2043392332 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x21a0770 0x2235640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feaa5d9b700 1 -- 172.21.15.133:0/2043392332 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x21a0770 msgr2=0x2235640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feaa5d9b700 1 --2- 172.21.15.133:0/2043392332 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x21a0770 0x2235640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feaa5d9b700 1 -- 172.21.15.133:0/2043392332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1f9ac20 msgr2=0x2222e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feaa5d9b700 1 --2- 172.21.15.133:0/2043392332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1f9ac20 0x2222e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feaa5d9b700 1 -- 172.21.15.133:0/2043392332 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2136010 con 0x2008820 2021-01-03T13:03:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feaa5d9b700 1 --2- 172.21.15.133:0/2043392332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2008820 0x21eeb10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fea98003000 tx=0x7fea98007b60).ready entity=mon.1 client_cookie=8ae67d8d98e20d6c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7fea957fa700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2021-01-03T13:03:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7fea957fa700 1 -- 172.21.15.133:0/2043392332 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea980145b0 con 0x2008820 2021-01-03T13:03:36.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7fea957fa700 1 -- 172.21.15.133:0/2043392332 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fea98014710 con 0x2008820 2021-01-03T13:03:36.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 1 -- 172.21.15.133:0/2043392332 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x202d8d0 con 0x2008820 2021-01-03T13:03:36.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7fea957fa700 1 -- 172.21.15.133:0/2043392332 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea980148d0 con 0x2008820 2021-01-03T13:03:36.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 10 client.6073 fetch_fsmap learned FSMap version 27 2021-01-03T13:03:36.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 1 -- 172.21.15.133:0/2043392332 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x1fb8790 con 0x2008820 2021-01-03T13:03:36.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7fea957fa700 1 -- 172.21.15.133:0/2043392332 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x202d8d0 con 0x2008820 2021-01-03T13:03:36.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7fea957fa700 1 -- 172.21.15.133:0/2043392332 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 27) v1 ==== 1434+0+0 (secure 0 0 0) 0x7fea98013040 con 0x2008820 2021-01-03T13:03:36.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 10 client.6073 fetch_fsmap finished waiting for FSMap version 27 2021-01-03T13:03:36.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 10 client.6073 resolve_mds: resolved ID 'a' to GID 5881 2021-01-03T13:03:36.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 20 client.6073 populate_metadata read hostname 'smithi133' 2021-01-03T13:03:36.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 1 --2- 172.21.15.133:0/2043392332 >> [v2:172.21.15.133:6834/1530122021,v1:172.21.15.133:6835/1530122021] conn(0x221af90 0x2231cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 4 client.6073 mds_command: new command op to 5881 tid=0[{"prefix": "get_command_descriptions"}] 2021-01-03T13:03:36.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feabb4d1740 1 -- 172.21.15.133:0/2043392332 --> [v2:172.21.15.133:6834/1530122021,v1:172.21.15.133:6835/1530122021] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1ffe4d0 con 0x221af90 2021-01-03T13:03:36.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feaa659c700 1 --2- 172.21.15.133:0/2043392332 >> [v2:172.21.15.133:6834/1530122021,v1:172.21.15.133:6835/1530122021] conn(0x221af90 0x2231cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7fea957fa700 10 client.6073 ms_handle_connect on v2:172.21.15.133:6834/1530122021 2021-01-03T13:03:36.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.020+0000 7feaa659c700 1 --2- 172.21.15.133:0/2043392332 >> [v2:172.21.15.133:6834/1530122021,v1:172.21.15.133:6835/1530122021] conn(0x221af90 0x2231cc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=461343929d26ce53 server_cookie=c115409130323375 in_seq=0 out_seq=0 2021-01-03T13:03:36.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.024+0000 7fea957fa700 1 -- 172.21.15.133:0/2043392332 <== mds.0 v2:172.21.15.133:6834/1530122021 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x1ffe4d0 con 0x221af90 2021-01-03T13:03:36.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.024+0000 7fea957fa700 10 client.6073 handle_command_reply: tid=0 2021-01-03T13:03:36.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.024+0000 7feabb4d1740 1 client.6073 shutdown 2021-01-03T13:03:36.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.024+0000 7feabb4d1740 1 -- 172.21.15.133:0/2043392332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2008820 msgr2=0x21eeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:36.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.024+0000 7feabb4d1740 1 --2- 172.21.15.133:0/2043392332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2008820 0x21eeb10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fea98003000 tx=0x7fea98007b60).stop 2021-01-03T13:03:36.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.024+0000 7feabb4d1740 1 -- 172.21.15.133:0/2043392332 shutdown_connections 2021-01-03T13:03:36.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.024+0000 7feabb4d1740 1 --2- 172.21.15.133:0/2043392332 >> [v2:172.21.15.133:6834/1530122021,v1:172.21.15.133:6835/1530122021] conn(0x221af90 0x2231cc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.024+0000 7feabb4d1740 1 --2- 172.21.15.133:0/2043392332 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1f9ac20 0x2222e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.024+0000 7fea957fa700 0 client.6073 ms_handle_reset on v2:172.21.15.133:6834/1530122021 2021-01-03T13:03:36.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.024+0000 7feabb4d1740 1 --2- 172.21.15.133:0/2043392332 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x21a0770 0x2235640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.024+0000 7feabb4d1740 1 --2- 172.21.15.133:0/2043392332 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x2008820 0x21eeb10 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.024+0000 7feabb4d1740 1 -- 172.21.15.133:0/2043392332 >> 172.21.15.133:0/2043392332 conn(0x21cff50 msgr2=0x221e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:36.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.024+0000 7feabb4d1740 1 -- 172.21.15.133:0/2043392332 shutdown_connections 2021-01-03T13:03:36.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.024+0000 7feabb4d1740 1 -- 172.21.15.133:0/2043392332 wait complete. 2021-01-03T13:03:36.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.024+0000 7feabb4d1740 20 client.6073 trim_cache size 0 max 16384 2021-01-03T13:03:36.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feabb4d1740 1 Processor -- start 2021-01-03T13:03:36.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feabb4d1740 1 -- start start 2021-01-03T13:03:36.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feabb4d1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1f9ac20 0x2221320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feabb4d1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x2008820 0x21ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feabb4d1740 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x21a0770 0x22233f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feabb4d1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x21ef3b0 con 0x2008820 2021-01-03T13:03:36.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feabb4d1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x21e9920 con 0x1f9ac20 2021-01-03T13:03:36.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feabb4d1740 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x21e7c40 con 0x21a0770 2021-01-03T13:03:36.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feaa659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1f9ac20 0x2221320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feaa659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1f9ac20 0x2221320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35374/0 (socket says 172.21.15.133:35374) 2021-01-03T13:03:36.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feaa659c700 1 -- 172.21.15.133:0/3990214403 learned_addr learned my addr 172.21.15.133:0/3990214403 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:36.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feaa6d9d700 1 --2- 172.21.15.133:0/3990214403 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x21a0770 0x22233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feaa5d9b700 1 --2- 172.21.15.133:0/3990214403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x2008820 0x21ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feaa659c700 1 -- 172.21.15.133:0/3990214403 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x21a0770 msgr2=0x22233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:36.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feaa659c700 1 --2- 172.21.15.133:0/3990214403 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x21a0770 0x22233f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feaa659c700 1 -- 172.21.15.133:0/3990214403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x2008820 msgr2=0x21ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:36.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feaa659c700 1 --2- 172.21.15.133:0/3990214403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x2008820 0x21ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feaa659c700 1 -- 172.21.15.133:0/3990214403 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa80aa8b0 con 0x1f9ac20 2021-01-03T13:03:36.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feaa659c700 1 --2- 172.21.15.133:0/3990214403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1f9ac20 0x2221320 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x2136ad0 tx=0x7fea90016000).ready entity=mon.1 client_cookie=896c38759a2ecaf8 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:36.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7fea977fe700 1 -- 172.21.15.133:0/3990214403 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea90028070 con 0x1f9ac20 2021-01-03T13:03:36.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7fea977fe700 1 -- 172.21.15.133:0/3990214403 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea90029040 con 0x1f9ac20 2021-01-03T13:03:36.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7fea977fe700 1 -- 172.21.15.133:0/3990214403 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea900187f0 con 0x1f9ac20 2021-01-03T13:03:36.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feabb4d1740 1 -- 172.21.15.133:0/3990214403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1f9ac20 msgr2=0x2221320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:36.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feabb4d1740 1 --2- 172.21.15.133:0/3990214403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1f9ac20 0x2221320 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x2136ad0 tx=0x7fea90016000).stop 2021-01-03T13:03:36.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feabb4d1740 1 -- 172.21.15.133:0/3990214403 shutdown_connections 2021-01-03T13:03:36.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feabb4d1740 1 --2- 172.21.15.133:0/3990214403 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x21a0770 0x22233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feabb4d1740 1 --2- 172.21.15.133:0/3990214403 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x1f9ac20 0x2221320 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feabb4d1740 1 --2- 172.21.15.133:0/3990214403 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x2008820 0x21ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feabb4d1740 1 -- 172.21.15.133:0/3990214403 >> 172.21.15.133:0/3990214403 conn(0x21cff50 msgr2=0x21ec3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:36.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feabb4d1740 1 -- 172.21.15.133:0/3990214403 shutdown_connections 2021-01-03T13:03:36.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.044+0000 7feabb4d1740 1 -- 172.21.15.133:0/3990214403 wait complete. 2021-01-03T13:03:36.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 1 -- start start 2021-01-03T13:03:36.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 1 Processor -- start 2021-01-03T13:03:36.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1f9ac20 0x21175d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x2008820 0x2221a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x21a0770 0x221b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x221fcd0 con 0x1f9ac20 2021-01-03T13:03:36.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x2241da0 con 0x21a0770 2021-01-03T13:03:36.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x221c710 con 0x2008820 2021-01-03T13:03:36.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 10 client.0 ll_register_callbacks cb 0x2222340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2021-01-03T13:03:36.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feaa6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x21a0770 0x221b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feaa6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x21a0770 0x221b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35384/0 (socket says 172.21.15.133:35384) 2021-01-03T13:03:36.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feaa6d9d700 1 -- 172.21.15.133:0/2254909247 learned_addr learned my addr 172.21.15.133:0/2254909247 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:36.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feaa659c700 1 --2- 172.21.15.133:0/2254909247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1f9ac20 0x21175d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feaa5d9b700 1 --2- 172.21.15.133:0/2254909247 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x2008820 0x2221a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feaa6d9d700 1 -- 172.21.15.133:0/2254909247 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x2008820 msgr2=0x2221a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:36.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feaa6d9d700 1 --2- 172.21.15.133:0/2254909247 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x2008820 0x2221a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feaa6d9d700 1 -- 172.21.15.133:0/2254909247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1f9ac20 msgr2=0x21175d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:36.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feaa6d9d700 1 --2- 172.21.15.133:0/2254909247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1f9ac20 0x21175d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:36.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feaa6d9d700 1 -- 172.21.15.133:0/2254909247 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1fc3e70 con 0x21a0770 2021-01-03T13:03:36.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feaa5d9b700 1 --2- 172.21.15.133:0/2254909247 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x2008820 0x2221a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:03:36.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feaa6d9d700 1 --2- 172.21.15.133:0/2254909247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x21a0770 0x221b370 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7feaa002a000 tx=0x7feaa0022040).ready entity=mon.1 client_cookie=b4034d9db9af0f83 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:36.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7fea967fc700 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2021-01-03T13:03:36.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7fea967fc700 1 -- 172.21.15.133:0/2254909247 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feaa0038070 con 0x21a0770 2021-01-03T13:03:36.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7fea967fc700 1 -- 172.21.15.133:0/2254909247 <== mon.1 v2:172.21.15.133:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feaa0044f80 con 0x21a0770 2021-01-03T13:03:36.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 1 -- 172.21.15.133:0/2254909247 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x21e8040 con 0x21a0770 2021-01-03T13:03:36.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7fea967fc700 1 -- 172.21.15.133:0/2254909247 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaa0047db0 con 0x21a0770 2021-01-03T13:03:36.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 10 client.6079 fetch_fsmap learned FSMap version 27 2021-01-03T13:03:36.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 1 -- 172.21.15.133:0/2254909247 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x2116ea0 con 0x21a0770 2021-01-03T13:03:36.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7fea967fc700 1 -- 172.21.15.133:0/2254909247 <== mon.1 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x21e8040 con 0x21a0770 2021-01-03T13:03:36.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7fea967fc700 1 -- 172.21.15.133:0/2254909247 <== mon.1 v2:172.21.15.133:3300/0 5 ==== fsmap(e 27) v1 ==== 1434+0+0 (secure 0 0 0) 0x7feaa0031030 con 0x21a0770 2021-01-03T13:03:36.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 10 client.6079 fetch_fsmap finished waiting for FSMap version 27 2021-01-03T13:03:36.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 10 client.6079 resolve_mds: resolved ID 'a' to GID 5881 2021-01-03T13:03:36.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 20 client.6079 populate_metadata read hostname 'smithi133' 2021-01-03T13:03:36.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 1 --2- 172.21.15.133:0/2254909247 >> [v2:172.21.15.133:6834/1530122021,v1:172.21.15.133:6835/1530122021] conn(0x221af90 0x221b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:36.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 4 client.6079 mds_command: new command op to 5881 tid=0[{"prefix": "cache drop", "timeout": 10}] 2021-01-03T13:03:36.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feabb4d1740 1 -- 172.21.15.133:0/2254909247 --> [v2:172.21.15.133:6834/1530122021,v1:172.21.15.133:6835/1530122021] -- command(tid 0: {"prefix": "cache drop", "timeout": 10}) v1 -- 0x204c730 con 0x221af90 2021-01-03T13:03:36.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feaa659c700 1 --2- 172.21.15.133:0/2254909247 >> [v2:172.21.15.133:6834/1530122021,v1:172.21.15.133:6835/1530122021] conn(0x221af90 0x221b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:36.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7fea967fc700 10 client.6079 ms_handle_connect on v2:172.21.15.133:6834/1530122021 2021-01-03T13:03:36.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:36.048+0000 7feaa659c700 1 --2- 172.21.15.133:0/2254909247 >> [v2:172.21.15.133:6834/1530122021,v1:172.21.15.133:6835/1530122021] conn(0x221af90 0x221b860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f176ce4c97ec916e server_cookie=2f8788b4982295ba in_seq=0 out_seq=0 2021-01-03T13:03:37.511 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:03:37.513 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:03:37.516 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:03:37.518 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:03:46.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7fea967fc700 1 -- 172.21.15.133:0/2254909247 <== mds.0 v2:172.21.15.133:6834/1530122021 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+406 (crc 0 0 0) 0x204c730 con 0x221af90 2021-01-03T13:03:46.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7fea967fc700 10 client.6079 handle_command_reply: tid=0 2021-01-03T13:03:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feabb4d1740 1 client.6079 shutdown 2021-01-03T13:03:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feabb4d1740 1 -- 172.21.15.133:0/2254909247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x21a0770 msgr2=0x221b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feabb4d1740 1 --2- 172.21.15.133:0/2254909247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x21a0770 0x221b370 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7feaa002a000 tx=0x7feaa0022040).stop 2021-01-03T13:03:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feabb4d1740 1 -- 172.21.15.133:0/2254909247 shutdown_connections 2021-01-03T13:03:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feabb4d1740 1 --2- 172.21.15.133:0/2254909247 >> [v2:172.21.15.133:6834/1530122021,v1:172.21.15.133:6835/1530122021] conn(0x221af90 0x221b860 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feabb4d1740 1 --2- 172.21.15.133:0/2254909247 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x1f9ac20 0x21175d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feabb4d1740 1 --2- 172.21.15.133:0/2254909247 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x21a0770 0x221b370 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feabb4d1740 1 --2- 172.21.15.133:0/2254909247 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x2008820 0x2221a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feabb4d1740 1 -- 172.21.15.133:0/2254909247 >> 172.21.15.133:0/2254909247 conn(0x21cff50 msgr2=0x21ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7fea967fc700 0 client.6079 ms_handle_reset on v2:172.21.15.133:6834/1530122021 2021-01-03T13:03:46.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feabb4d1740 1 -- 172.21.15.133:0/2254909247 shutdown_connections 2021-01-03T13:03:46.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feabb4d1740 1 -- 172.21.15.133:0/2254909247 wait complete. 2021-01-03T13:03:46.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feabb4d1740 20 client.6079 trim_cache size 0 max 16384 2021-01-03T13:03:46.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feaa759e700 1 -- 172.21.15.133:0/294006985 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea80055440 msgr2=0x7fea80057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:46.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feaa759e700 1 --2- 172.21.15.133:0/294006985 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea80055440 0x7fea80057900 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fea9000b000 tx=0x7fea90009040).stop 2021-01-03T13:03:46.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feaa759e700 1 -- 172.21.15.133:0/294006985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaa81449b0 msgr2=0x7feaa80aebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:46.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feaa759e700 1 --2- 172.21.15.133:0/294006985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaa81449b0 0x7feaa80aebe0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7feaa00032b0 tx=0x7feaa0016000).stop 2021-01-03T13:03:46.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feaa759e700 1 -- 172.21.15.133:0/294006985 shutdown_connections 2021-01-03T13:03:46.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feaa759e700 1 --2- 172.21.15.133:0/294006985 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea80055440 0x7fea80057900 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:46.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feaa759e700 1 --2- 172.21.15.133:0/294006985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaa81449b0 0x7feaa80aebe0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:46.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feaa759e700 1 --2- 172.21.15.133:0/294006985 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feaa80b5260 0x7feaa80b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:46.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feaa759e700 1 --2- 172.21.15.133:0/294006985 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaa80b5c00 0x7feaa80ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:46.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.367+0000 7feaa759e700 1 -- 172.21.15.133:0/294006985 >> 172.21.15.133:0/294006985 conn(0x7feaa805bdf0 msgr2=0x7feaa8147470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:46.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.371+0000 7feaa759e700 1 -- 172.21.15.133:0/294006985 shutdown_connections 2021-01-03T13:03:46.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.371+0000 7feaa759e700 1 -- 172.21.15.133:0/294006985 wait complete. 2021-01-03T13:03:46.378 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:03:46.378 INFO:teuthology.orchestra.run.smithi133.stdout: "client_recall": { 2021-01-03T13:03:46.378 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": -110, 2021-01-03T13:03:46.378 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "(110) Connection timed out", 2021-01-03T13:03:46.379 INFO:teuthology.orchestra.run.smithi133.stdout: "recalled": 240 2021-01-03T13:03:46.379 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:46.379 INFO:teuthology.orchestra.run.smithi133.stdout: "flush_journal": { 2021-01-03T13:03:46.379 INFO:teuthology.orchestra.run.smithi133.stdout: "return_code": 0, 2021-01-03T13:03:46.379 INFO:teuthology.orchestra.run.smithi133.stdout: "message": "" 2021-01-03T13:03:46.380 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:46.380 INFO:teuthology.orchestra.run.smithi133.stdout: "trim_cache": { 2021-01-03T13:03:46.380 INFO:teuthology.orchestra.run.smithi133.stdout: "trimmed": 220 2021-01-03T13:03:46.380 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:46.380 INFO:teuthology.orchestra.run.smithi133.stdout: "cache": { 2021-01-03T13:03:46.381 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": { 2021-01-03T13:03:46.381 INFO:teuthology.orchestra.run.smithi133.stdout: "items": 15450, 2021-01-03T13:03:46.381 INFO:teuthology.orchestra.run.smithi133.stdout: "bytes": 2428480 2021-01-03T13:03:46.381 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:46.381 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:46.381 INFO:teuthology.orchestra.run.smithi133.stdout: "duration": 10.317589785999999 2021-01-03T13:03:46.382 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:03:46.383 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:03:46.383 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:03:46.401 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:03:46.416 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:03:46.435 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:03:46.454 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:03:46.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:46.455 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:03:46.456 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:03:46.464 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:03:46.465 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:03:46.465 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T13:03:46.465 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:03:46.466 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:03:46.547 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12088]: fuse finished with error 0 and tester_r 0 2021-01-03T13:03:46.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:46.549 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:03:46.550 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:03:46.599 INFO:teuthology.orchestra.run.smithi007.stdout:ext2/ext3 2021-01-03T13:03:46.600 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:03:46.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:03:46.716 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:03:46.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:46.765 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:03:46.766 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:03:46.772 INFO:teuthology.orchestra.run.smithi036.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:03:46.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:03:46.774 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-01-03T13:03:46.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:03:46.775 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:03:46.821 INFO:teuthology.orchestra.run.smithi036.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:03:46.822 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:03:46.823 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-01-03T13:03:46.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69de784700 1 Processor -- start 2021-01-03T13:03:46.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69de784700 1 -- start start 2021-01-03T13:03:46.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69de784700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69d8066f70 0x7f69d805fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:46.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69de784700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f69d8067350 0x7f69d80af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:46.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69de784700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d8060310 con 0x7f69d80afc50 2021-01-03T13:03:46.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69de784700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d80605a0 con 0x7f69d8066f70 2021-01-03T13:03:46.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69de784700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d80b0b50 con 0x7f69d8067350 2021-01-03T13:03:46.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69dd782700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69d8066f70 0x7f69d805fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:46.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69dd782700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69d8066f70 0x7f69d805fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35390/0 (socket says 172.21.15.133:35390) 2021-01-03T13:03:46.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69dd782700 1 -- 172.21.15.133:0/2627385492 learned_addr learned my addr 172.21.15.133:0/2627385492 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:46.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69dcf81700 1 --2- 172.21.15.133:0/2627385492 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f69d8067350 0x7f69d80af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:46.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69dd782700 1 -- 172.21.15.133:0/2627385492 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f69d8067350 msgr2=0x7f69d80af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:46.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69dd782700 1 --2- 172.21.15.133:0/2627385492 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f69d8067350 0x7f69d80af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:46.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69dd782700 1 -- 172.21.15.133:0/2627385492 >> v1:172.21.15.16:6789/0 conn(0x7f69d80afc50 legacy=0x7f69d8144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:46.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69dd782700 1 -- 172.21.15.133:0/2627385492 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d80b0df0 con 0x7f69d8066f70 2021-01-03T13:03:46.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69dd782700 1 --2- 172.21.15.133:0/2627385492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d8066f70 0x7f69d805fe20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f69d40032b0 tx=0x7f69d4009270).ready entity=mon.1 client_cookie=a7e0cf42910daa1d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:46.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69cffff700 1 -- 172.21.15.133:0/2627385492 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d400bc00 con 0x7f69d8066f70 2021-01-03T13:03:46.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69cffff700 1 -- 172.21.15.133:0/2627385492 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d400bd60 con 0x7f69d8066f70 2021-01-03T13:03:46.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69cffff700 1 -- 172.21.15.133:0/2627385492 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d4011400 con 0x7f69d8066f70 2021-01-03T13:03:46.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69de784700 1 -- 172.21.15.133:0/2627385492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d8066f70 msgr2=0x7f69d805fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:46.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.939+0000 7f69de784700 1 --2- 172.21.15.133:0/2627385492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d8066f70 0x7f69d805fe20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f69d40032b0 tx=0x7f69d4009270).stop 2021-01-03T13:03:46.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69de784700 1 -- 172.21.15.133:0/2627385492 shutdown_connections 2021-01-03T13:03:46.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69de784700 1 --2- 172.21.15.133:0/2627385492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d8066f70 0x7f69d805fe20 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:46.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69de784700 1 --2- 172.21.15.133:0/2627385492 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f69d8067350 0x7f69d80af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:46.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69de784700 1 -- 172.21.15.133:0/2627385492 >> 172.21.15.133:0/2627385492 conn(0x7f69d80b6110 msgr2=0x7f69d80b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:46.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69de784700 1 -- 172.21.15.133:0/2627385492 shutdown_connections 2021-01-03T13:03:46.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69de784700 1 -- 172.21.15.133:0/2627385492 wait complete. 2021-01-03T13:03:46.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69de784700 1 Processor -- start 2021-01-03T13:03:46.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69de784700 1 -- start start 2021-01-03T13:03:46.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69de784700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f69d8066f70 0x7f69d80b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:46.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69de784700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69d8067350 0x7f69d8153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:46.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69de784700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d814f9b0 0x7f69d8153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:46.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69de784700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d813f640 con 0x7f69d8067350 2021-01-03T13:03:46.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69de784700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d813f8e0 con 0x7f69d814f9b0 2021-01-03T13:03:46.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69de784700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d81530e0 con 0x7f69d8066f70 2021-01-03T13:03:46.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69ddf83700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d814f9b0 0x7f69d8153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:46.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69ddf83700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d814f9b0 0x7f69d8153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35400/0 (socket says 172.21.15.133:35400) 2021-01-03T13:03:46.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69ddf83700 1 -- 172.21.15.133:0/1569620948 learned_addr learned my addr 172.21.15.133:0/1569620948 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:46.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69dd782700 1 --2- 172.21.15.133:0/1569620948 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f69d8066f70 0x7f69d80b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:46.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69dcf81700 1 --2- 172.21.15.133:0/1569620948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69d8067350 0x7f69d8153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:46.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69ddf83700 1 -- 172.21.15.133:0/1569620948 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f69d8066f70 msgr2=0x7f69d80b56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:46.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69ddf83700 1 --2- 172.21.15.133:0/1569620948 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f69d8066f70 0x7f69d80b56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:46.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69ddf83700 1 -- 172.21.15.133:0/1569620948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69d8067350 msgr2=0x7f69d8153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:46.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69ddf83700 1 --2- 172.21.15.133:0/1569620948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69d8067350 0x7f69d8153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:46.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69ddf83700 1 -- 172.21.15.133:0/1569620948 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d809fc30 con 0x7f69d814f9b0 2021-01-03T13:03:46.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.943+0000 7f69ddf83700 1 --2- 172.21.15.133:0/1569620948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d814f9b0 0x7f69d8153a70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f69d80b6e10 tx=0x7f69d0007b70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:46.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.947+0000 7f69ce7fc700 1 -- 172.21.15.133:0/1569620948 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d000f470 con 0x7f69d814f9b0 2021-01-03T13:03:46.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.947+0000 7f69ce7fc700 1 -- 172.21.15.133:0/1569620948 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d000f5d0 con 0x7f69d814f9b0 2021-01-03T13:03:46.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.947+0000 7f69ce7fc700 1 -- 172.21.15.133:0/1569620948 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d000f930 con 0x7f69d814f9b0 2021-01-03T13:03:46.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.947+0000 7f69de784700 1 -- 172.21.15.133:0/1569620948 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d8066700 con 0x7f69d814f9b0 2021-01-03T13:03:46.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.947+0000 7f69de784700 1 -- 172.21.15.133:0/1569620948 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d813ebf0 con 0x7f69d814f9b0 2021-01-03T13:03:46.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.947+0000 7f69ce7fc700 1 -- 172.21.15.133:0/1569620948 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f69d0019030 con 0x7f69d814f9b0 2021-01-03T13:03:46.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.947+0000 7f69de784700 1 -- 172.21.15.133:0/1569620948 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d813fae0 con 0x7f69d814f9b0 2021-01-03T13:03:46.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.947+0000 7f69ce7fc700 1 --2- 172.21.15.133:0/1569620948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f69c00554e0 0x7f69c00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:46.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.947+0000 7f69ce7fc700 1 -- 172.21.15.133:0/1569620948 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f69d006d180 con 0x7f69d814f9b0 2021-01-03T13:03:46.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.947+0000 7f69dd782700 1 --2- 172.21.15.133:0/1569620948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f69c00554e0 0x7f69c00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:46.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.947+0000 7f69dd782700 1 --2- 172.21.15.133:0/1569620948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f69c00554e0 0x7f69c00579a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f69d401a000 tx=0x7f69d4016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:46.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:46.955+0000 7f69ce7fc700 1 -- 172.21.15.133:0/1569620948 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f69d0043420 con 0x7f69d814f9b0 2021-01-03T13:03:47.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.091+0000 7f69de784700 1 -- 172.21.15.133:0/1569620948 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f69d81532a0 con 0x7f69d814f9b0 2021-01-03T13:03:47.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.099+0000 7f69ce7fc700 1 -- 172.21.15.133:0/1569620948 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f69d0007c90 con 0x7f69d814f9b0 2021-01-03T13:03:47.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.103+0000 7f69de784700 1 -- 172.21.15.133:0/1569620948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f69c00554e0 msgr2=0x7f69c00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:47.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.103+0000 7f69de784700 1 --2- 172.21.15.133:0/1569620948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f69c00554e0 0x7f69c00579a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f69d401a000 tx=0x7f69d4016000).stop 2021-01-03T13:03:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.103+0000 7f69de784700 1 -- 172.21.15.133:0/1569620948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d814f9b0 msgr2=0x7f69d8153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.103+0000 7f69de784700 1 --2- 172.21.15.133:0/1569620948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d814f9b0 0x7f69d8153a70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f69d80b6e10 tx=0x7f69d0007b70).stop 2021-01-03T13:03:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.103+0000 7f69de784700 1 -- 172.21.15.133:0/1569620948 shutdown_connections 2021-01-03T13:03:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.103+0000 7f69de784700 1 --2- 172.21.15.133:0/1569620948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f69c00554e0 0x7f69c00579a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:47.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.103+0000 7f69de784700 1 --2- 172.21.15.133:0/1569620948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69d814f9b0 0x7f69d8153a70 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:47.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.103+0000 7f69de784700 1 --2- 172.21.15.133:0/1569620948 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f69d8066f70 0x7f69d80b56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:47.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.103+0000 7f69de784700 1 --2- 172.21.15.133:0/1569620948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69d8067350 0x7f69d8153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:47.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.103+0000 7f69de784700 1 -- 172.21.15.133:0/1569620948 >> 172.21.15.133:0/1569620948 conn(0x7f69d80b6110 msgr2=0x7f69d80b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:47.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.103+0000 7f69de784700 1 -- 172.21.15.133:0/1569620948 shutdown_connections 2021-01-03T13:03:47.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.103+0000 7f69de784700 1 -- 172.21.15.133:0/1569620948 wait complete. 2021-01-03T13:03:47.119 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2021-01-03T13:03:47.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.219+0000 7f8faee9b700 1 Processor -- start 2021-01-03T13:03:47.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.219+0000 7f8faee9b700 1 -- start start 2021-01-03T13:03:47.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8faee9b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8fa80af440 0x7f8fa80afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:47.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8faee9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8fa813f960 0x7f8fa8138c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:47.226 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8faee9b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa805cc20 con 0x7f8fa805c840 2021-01-03T13:03:47.226 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8faee9b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa80b18e0 con 0x7f8fa813f960 2021-01-03T13:03:47.226 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8faee9b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa813fdb0 con 0x7f8fa80af440 2021-01-03T13:03:47.226 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8facc37700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8fa805c840 0x7f8fa813f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56436/0 (socket says 172.21.15.133:56436) 2021-01-03T13:03:47.226 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8facc37700 1 -- 172.21.15.133:0/4216882347 learned_addr learned my addr 172.21.15.133:0/4216882347 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:47.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8fad438700 1 --2- 172.21.15.133:0/4216882347 >> v2:172.21.15.133:3300/0 conn(0x7f8fa813f960 0x7f8fa8138c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:47.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8fa7fff700 1 --2- 172.21.15.133:0/4216882347 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8fa80af440 0x7f8fa80afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:47.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8fa77fe700 1 -- 172.21.15.133:0/4216882347 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187109437 0 0) 0x7f8fa805cc20 con 0x7f8fa805c840 2021-01-03T13:03:47.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8fa77fe700 1 -- 172.21.15.133:0/4216882347 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f94003230 con 0x7f8fa805c840 2021-01-03T13:03:47.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8fad438700 1 -- 172.21.15.133:0/4216882347 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8fa80af440 msgr2=0x7f8fa80afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:47.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8fad438700 1 --2- 172.21.15.133:0/4216882347 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8fa80af440 0x7f8fa80afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:47.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8fad438700 1 -- 172.21.15.133:0/4216882347 >> v1:172.21.15.133:6789/0 conn(0x7f8fa805c840 legacy=0x7f8fa813f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:47.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8fad438700 1 -- 172.21.15.133:0/4216882347 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa80ad2d0 con 0x7f8fa813f960 2021-01-03T13:03:47.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8fad438700 1 --2- 172.21.15.133:0/4216882347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fa813f960 0x7f8fa8138c40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f8f98002f30 tx=0x7f8f98006dc0).ready entity=mon.1 client_cookie=48a740ed96939e46 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:47.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8fa77fe700 1 -- 172.21.15.133:0/4216882347 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f980096a0 con 0x7f8fa813f960 2021-01-03T13:03:47.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8fa77fe700 1 -- 172.21.15.133:0/4216882347 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f98009800 con 0x7f8fa813f960 2021-01-03T13:03:47.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8fa77fe700 1 -- 172.21.15.133:0/4216882347 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f98009b60 con 0x7f8fa813f960 2021-01-03T13:03:47.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8faee9b700 1 -- 172.21.15.133:0/4216882347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fa813f960 msgr2=0x7f8fa8138c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:47.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8faee9b700 1 --2- 172.21.15.133:0/4216882347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fa813f960 0x7f8fa8138c40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f8f98002f30 tx=0x7f8f98006dc0).stop 2021-01-03T13:03:47.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8faee9b700 1 -- 172.21.15.133:0/4216882347 shutdown_connections 2021-01-03T13:03:47.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8faee9b700 1 --2- 172.21.15.133:0/4216882347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fa813f960 0x7f8fa8138c40 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:47.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8faee9b700 1 --2- 172.21.15.133:0/4216882347 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8fa80af440 0x7f8fa80afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:47.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8faee9b700 1 -- 172.21.15.133:0/4216882347 >> 172.21.15.133:0/4216882347 conn(0x7f8fa806aeb0 msgr2=0x7f8fa805bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:47.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8faee9b700 1 -- 172.21.15.133:0/4216882347 shutdown_connections 2021-01-03T13:03:47.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8faee9b700 1 -- 172.21.15.133:0/4216882347 wait complete. 2021-01-03T13:03:47.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8faee9b700 1 Processor -- start 2021-01-03T13:03:47.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.223+0000 7f8faee9b700 1 -- start start 2021-01-03T13:03:47.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8faee9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fa805c840 0x7f8fa8140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:47.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8faee9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fa80af440 0x7f8fa812d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:47.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8faee9b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8fa813f960 0x7f8fa812da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:47.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8faee9b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8139b90 con 0x7f8fa805c840 2021-01-03T13:03:47.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8faee9b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa813c8b0 con 0x7f8fa80af440 2021-01-03T13:03:47.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8faee9b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa813b710 con 0x7f8fa813f960 2021-01-03T13:03:47.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8fa7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fa80af440 0x7f8fa812d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:47.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8fa7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fa80af440 0x7f8fa812d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35412/0 (socket says 172.21.15.133:35412) 2021-01-03T13:03:47.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8fa7fff700 1 -- 172.21.15.133:0/2425374646 learned_addr learned my addr 172.21.15.133:0/2425374646 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:47.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8fad438700 1 --2- 172.21.15.133:0/2425374646 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8fa813f960 0x7f8fa812da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:47.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8facc37700 1 --2- 172.21.15.133:0/2425374646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fa805c840 0x7f8fa8140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:47.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8fa7fff700 1 -- 172.21.15.133:0/2425374646 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8fa813f960 msgr2=0x7f8fa812da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:47.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8fa7fff700 1 --2- 172.21.15.133:0/2425374646 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8fa813f960 0x7f8fa812da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:47.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8fa7fff700 1 -- 172.21.15.133:0/2425374646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fa805c840 msgr2=0x7f8fa8140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:47.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8fa7fff700 1 --2- 172.21.15.133:0/2425374646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fa805c840 0x7f8fa8140990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:47.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8fa7fff700 1 -- 172.21.15.133:0/2425374646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa813b9b0 con 0x7f8fa80af440 2021-01-03T13:03:47.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8fa7fff700 1 --2- 172.21.15.133:0/2425374646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fa80af440 0x7f8fa812d570 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f8f9c00c000 tx=0x7f8f9c006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:47.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8fa5ffb700 1 -- 172.21.15.133:0/2425374646 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f9c00ca10 con 0x7f8fa80af440 2021-01-03T13:03:47.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8fa5ffb700 1 -- 172.21.15.133:0/2425374646 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c00cb70 con 0x7f8fa80af440 2021-01-03T13:03:47.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8fa5ffb700 1 -- 172.21.15.133:0/2425374646 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f9c0123f0 con 0x7f8fa80af440 2021-01-03T13:03:47.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8faee9b700 1 -- 172.21.15.133:0/2425374646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa81435c0 con 0x7f8fa80af440 2021-01-03T13:03:47.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8faee9b700 1 -- 172.21.15.133:0/2425374646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa813c530 con 0x7f8fa80af440 2021-01-03T13:03:47.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.227+0000 7f8faee9b700 1 -- 172.21.15.133:0/2425374646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa813bb40 con 0x7f8fa80af440 2021-01-03T13:03:47.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.231+0000 7f8fa5ffb700 1 -- 172.21.15.133:0/2425374646 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8f9c012550 con 0x7f8fa80af440 2021-01-03T13:03:47.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.231+0000 7f8fa5ffb700 1 --2- 172.21.15.133:0/2425374646 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8f88055330 0x7f8f880577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:47.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.231+0000 7f8fa5ffb700 1 -- 172.21.15.133:0/2425374646 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8f9c06e2b0 con 0x7f8fa80af440 2021-01-03T13:03:47.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.231+0000 7f8facc37700 1 --2- 172.21.15.133:0/2425374646 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8f88055330 0x7f8f880577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:47.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.231+0000 7f8facc37700 1 --2- 172.21.15.133:0/2425374646 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8f88055330 0x7f8f880577f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f8fa000d000 tx=0x7f8fa0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:47.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.235+0000 7f8fa5ffb700 1 -- 172.21.15.133:0/2425374646 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8f9c044550 con 0x7f8fa80af440 2021-01-03T13:03:47.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:47.423+0000 7f8faee9b700 1 -- 172.21.15.133:0/2425374646 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f8fa8057300 con 0x7f8fa80af440 2021-01-03T13:03:48.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.263+0000 7f8fa5ffb700 1 -- 172.21.15.133:0/2425374646 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v251) v1 ==== 147+0+0 (secure 0 0 0) 0x7f8f9c047b70 con 0x7f8fa80af440 2021-01-03T13:03:48.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.267+0000 7f8faee9b700 1 -- 172.21.15.133:0/2425374646 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8f88055330 msgr2=0x7f8f880577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:48.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.267+0000 7f8faee9b700 1 --2- 172.21.15.133:0/2425374646 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8f88055330 0x7f8f880577f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f8fa000d000 tx=0x7f8fa0009040).stop 2021-01-03T13:03:48.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.267+0000 7f8faee9b700 1 -- 172.21.15.133:0/2425374646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fa80af440 msgr2=0x7f8fa812d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:48.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.267+0000 7f8faee9b700 1 --2- 172.21.15.133:0/2425374646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fa80af440 0x7f8fa812d570 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f8f9c00c000 tx=0x7f8f9c006dc0).stop 2021-01-03T13:03:48.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.267+0000 7f8faee9b700 1 -- 172.21.15.133:0/2425374646 shutdown_connections 2021-01-03T13:03:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.267+0000 7f8faee9b700 1 --2- 172.21.15.133:0/2425374646 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8f88055330 0x7f8f880577f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.267+0000 7f8faee9b700 1 --2- 172.21.15.133:0/2425374646 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fa805c840 0x7f8fa8140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.267+0000 7f8faee9b700 1 --2- 172.21.15.133:0/2425374646 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8fa813f960 0x7f8fa812da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.267+0000 7f8faee9b700 1 --2- 172.21.15.133:0/2425374646 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8fa80af440 0x7f8fa812d570 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:48.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.267+0000 7f8faee9b700 1 -- 172.21.15.133:0/2425374646 >> 172.21.15.133:0/2425374646 conn(0x7f8fa806aeb0 msgr2=0x7f8fa806a670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:48.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.267+0000 7f8faee9b700 1 -- 172.21.15.133:0/2425374646 shutdown_connections 2021-01-03T13:03:48.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.267+0000 7f8faee9b700 1 -- 172.21.15.133:0/2425374646 wait complete. 2021-01-03T13:03:48.288 INFO:tasks.cephfs_test_runner:test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2021-01-03T13:03:48.288 INFO:tasks.cephfs_test_runner:Starting test: test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) 2021-01-03T13:03:48.289 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-01-03T13:03:48.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.399+0000 7f1018a44700 1 Processor -- start 2021-01-03T13:03:48.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.399+0000 7f1018a44700 1 -- start start 2021-01-03T13:03:48.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.399+0000 7f1018a44700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f10140b52c0 0x7f10140b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:48.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.399+0000 7f1018a44700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f10140b0c90 0x7f1014098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:48.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.399+0000 7f1018a44700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1014060da0 con 0x7f10140b5c00 2021-01-03T13:03:48.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.399+0000 7f1018a44700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1014067a90 con 0x7f10140b0c90 2021-01-03T13:03:48.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.399+0000 7f1018a44700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10140b0ad0 con 0x7f10140b52c0 2021-01-03T13:03:48.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f101359e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f10140b5c00 0x7f101414a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56450/0 (socket says 172.21.15.133:56450) 2021-01-03T13:03:48.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f101359e700 1 -- 172.21.15.133:0/567790120 learned_addr learned my addr 172.21.15.133:0/567790120 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:48.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1012d9d700 1 --2- 172.21.15.133:0/567790120 >> v2:172.21.15.133:3300/0 conn(0x7f10140b52c0 0x7f10140b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:48.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f101259c700 1 --2- 172.21.15.133:0/567790120 >> v2:172.21.15.16:3300/0 conn(0x7f10140b0c90 0x7f1014098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:48.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 -- 172.21.15.133:0/567790120 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291983808 0 0) 0x7f1014060da0 con 0x7f10140b5c00 2021-01-03T13:03:48.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 -- 172.21.15.133:0/567790120 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ff8003230 con 0x7f10140b5c00 2021-01-03T13:03:48.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 -- 172.21.15.133:0/567790120 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 77961719 0 0) 0x7f0ff8003230 con 0x7f10140b5c00 2021-01-03T13:03:48.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 -- 172.21.15.133:0/567790120 >> v2:172.21.15.133:3300/0 conn(0x7f10140b52c0 msgr2=0x7f10140b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:48.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 --2- 172.21.15.133:0/567790120 >> v2:172.21.15.133:3300/0 conn(0x7f10140b52c0 0x7f10140b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:48.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 -- 172.21.15.133:0/567790120 >> v2:172.21.15.16:3300/0 conn(0x7f10140b0c90 msgr2=0x7f1014098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:48.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 --2- 172.21.15.133:0/567790120 >> v2:172.21.15.16:3300/0 conn(0x7f10140b0c90 0x7f1014098ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:48.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 -- 172.21.15.133:0/567790120 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140b56a0 con 0x7f10140b5c00 2021-01-03T13:03:48.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 -- 172.21.15.133:0/567790120 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f100c0016d0 con 0x7f10140b5c00 2021-01-03T13:03:48.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 -- 172.21.15.133:0/567790120 >> v1:172.21.15.133:6789/0 conn(0x7f10140b5c00 legacy=0x7f101414a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:48.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 --2- 172.21.15.133:0/567790120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ff8003720 0x7f0ff8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:48.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 --2- 172.21.15.133:0/567790120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ff80044d0 0x7f0ff8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:48.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 --2- 172.21.15.133:0/567790120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ff8004e40 0x7f0ff800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:48.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 -- 172.21.15.133:0/567790120 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1014067a90 con 0x7f0ff8003720 2021-01-03T13:03:48.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 -- 172.21.15.133:0/567790120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140b0ad0 con 0x7f0ff80044d0 2021-01-03T13:03:48.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 -- 172.21.15.133:0/567790120 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8004250 con 0x7f0ff8004e40 2021-01-03T13:03:48.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f101259c700 1 --2- 172.21.15.133:0/567790120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ff80044d0 0x7f0ff8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:48.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1012d9d700 1 --2- 172.21.15.133:0/567790120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ff8003720 0x7f0ff8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:48.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f101359e700 1 --2- 172.21.15.133:0/567790120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ff8004e40 0x7f0ff800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:48.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f101259c700 1 -- 172.21.15.133:0/567790120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ff8004e40 msgr2=0x7f0ff800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:48.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f101259c700 1 --2- 172.21.15.133:0/567790120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ff8004e40 0x7f0ff800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:48.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f101259c700 1 -- 172.21.15.133:0/567790120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ff8003720 msgr2=0x7f0ff8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:48.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f101259c700 1 --2- 172.21.15.133:0/567790120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ff8003720 0x7f0ff8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:48.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f101259c700 1 -- 172.21.15.133:0/567790120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff8003230 con 0x7f0ff80044d0 2021-01-03T13:03:48.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f101359e700 1 -- 172.21.15.133:0/567790120 reap_dead start 2021-01-03T13:03:48.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f101259c700 1 --2- 172.21.15.133:0/567790120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ff80044d0 0x7f0ff8004950 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f0ffc00c000 tx=0x7f0ffc008040).ready entity=mon.1 client_cookie=a8f1d8bf97d56057 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:48.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 -- 172.21.15.133:0/567790120 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ffc00e9d0 con 0x7f0ff80044d0 2021-01-03T13:03:48.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 -- 172.21.15.133:0/567790120 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc00eb30 con 0x7f0ff80044d0 2021-01-03T13:03:48.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1011d9b700 1 -- 172.21.15.133:0/567790120 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ffc00ee90 con 0x7f0ff80044d0 2021-01-03T13:03:48.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1018a44700 1 -- 172.21.15.133:0/567790120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ff80044d0 msgr2=0x7f0ff8004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:48.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1018a44700 1 --2- 172.21.15.133:0/567790120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ff80044d0 0x7f0ff8004950 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f0ffc00c000 tx=0x7f0ffc008040).stop 2021-01-03T13:03:48.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1018a44700 1 -- 172.21.15.133:0/567790120 shutdown_connections 2021-01-03T13:03:48.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1018a44700 1 --2- 172.21.15.133:0/567790120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ff80044d0 0x7f0ff8004950 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:48.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1018a44700 1 -- 172.21.15.133:0/567790120 >> 172.21.15.133:0/567790120 conn(0x7f101405bdf0 msgr2=0x7f101405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:48.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1018a44700 1 -- 172.21.15.133:0/567790120 shutdown_connections 2021-01-03T13:03:48.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.403+0000 7f1018a44700 1 -- 172.21.15.133:0/567790120 wait complete. 2021-01-03T13:03:48.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f1018a44700 1 Processor -- start 2021-01-03T13:03:48.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f1018a44700 1 -- start start 2021-01-03T13:03:48.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f1018a44700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ff80044d0 0x7f1014099000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:48.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f1018a44700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10140aeeb0 0x7f1014155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:48.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f1018a44700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10140ae460 0x7f1014156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:48.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f1018a44700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140af350 con 0x7f10140ae460 2021-01-03T13:03:48.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f1018a44700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1014065d60 con 0x7f10140aeeb0 2021-01-03T13:03:48.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f1018a44700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1014066000 con 0x7f0ff80044d0 2021-01-03T13:03:48.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f101259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10140aeeb0 0x7f1014155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:48.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f1012d9d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ff80044d0 0x7f1014099000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:48.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f101259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10140aeeb0 0x7f1014155f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35432/0 (socket says 172.21.15.133:35432) 2021-01-03T13:03:48.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f101259c700 1 -- 172.21.15.133:0/3999420886 learned_addr learned my addr 172.21.15.133:0/3999420886 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:48.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f101359e700 1 --2- 172.21.15.133:0/3999420886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10140ae460 0x7f1014156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:48.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f101259c700 1 -- 172.21.15.133:0/3999420886 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ff80044d0 msgr2=0x7f1014099000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:48.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f101259c700 1 --2- 172.21.15.133:0/3999420886 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ff80044d0 0x7f1014099000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:48.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f101259c700 1 -- 172.21.15.133:0/3999420886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10140ae460 msgr2=0x7f1014156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:48.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f101259c700 1 --2- 172.21.15.133:0/3999420886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10140ae460 0x7f1014156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:48.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.407+0000 7f101259c700 1 -- 172.21.15.133:0/3999420886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140662a0 con 0x7f10140aeeb0 2021-01-03T13:03:48.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.411+0000 7f101259c700 1 --2- 172.21.15.133:0/3999420886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10140aeeb0 0x7f1014155f60 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f0ffc00c000 tx=0x7f0ffc01a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:48.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.411+0000 7f100bfff700 1 -- 172.21.15.133:0/3999420886 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ffc012e30 con 0x7f10140aeeb0 2021-01-03T13:03:48.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.411+0000 7f100bfff700 1 -- 172.21.15.133:0/3999420886 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc01c430 con 0x7f10140aeeb0 2021-01-03T13:03:48.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.411+0000 7f1018a44700 1 -- 172.21.15.133:0/3999420886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1014156940 con 0x7f10140aeeb0 2021-01-03T13:03:48.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.411+0000 7f100bfff700 1 -- 172.21.15.133:0/3999420886 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ffc01c790 con 0x7f10140aeeb0 2021-01-03T13:03:48.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.411+0000 7f1018a44700 1 -- 172.21.15.133:0/3999420886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1014066740 con 0x7f10140aeeb0 2021-01-03T13:03:48.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.411+0000 7f1018a44700 1 -- 172.21.15.133:0/3999420886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1014066430 con 0x7f10140aeeb0 2021-01-03T13:03:48.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.411+0000 7f100bfff700 1 -- 172.21.15.133:0/3999420886 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0ffc01c8f0 con 0x7f10140aeeb0 2021-01-03T13:03:48.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.411+0000 7f100bfff700 1 --2- 172.21.15.133:0/3999420886 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0fec0553b0 0x7f0fec057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:48.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.411+0000 7f100bfff700 1 -- 172.21.15.133:0/3999420886 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0ffc06fac0 con 0x7f10140aeeb0 2021-01-03T13:03:48.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.411+0000 7f1012d9d700 1 --2- 172.21.15.133:0/3999420886 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0fec0553b0 0x7f0fec057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:48.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.411+0000 7f1012d9d700 1 --2- 172.21.15.133:0/3999420886 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0fec0553b0 0x7f0fec057870 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f100400b000 tx=0x7f10040091a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:48.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.415+0000 7f100bfff700 1 -- 172.21.15.133:0/3999420886 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0ffc045dc0 con 0x7f10140aeeb0 2021-01-03T13:03:48.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:48.603+0000 7f1018a44700 1 -- 172.21.15.133:0/3999420886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7f1014057300 con 0x7f10140aeeb0 2021-01-03T13:03:49.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.275+0000 7f100bfff700 1 -- 172.21.15.133:0/3999420886 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v252) v1 ==== 142+0+0 (secure 0 0 0) 0x7f0ffc016070 con 0x7f10140aeeb0 2021-01-03T13:03:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.279+0000 7f1018a44700 1 -- 172.21.15.133:0/3999420886 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0fec0553b0 msgr2=0x7f0fec057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.279+0000 7f1018a44700 1 --2- 172.21.15.133:0/3999420886 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0fec0553b0 0x7f0fec057870 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f100400b000 tx=0x7f10040091a0).stop 2021-01-03T13:03:49.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.279+0000 7f1018a44700 1 -- 172.21.15.133:0/3999420886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10140aeeb0 msgr2=0x7f1014155f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.279+0000 7f1018a44700 1 --2- 172.21.15.133:0/3999420886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10140aeeb0 0x7f1014155f60 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f0ffc00c000 tx=0x7f0ffc01a000).stop 2021-01-03T13:03:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.279+0000 7f1018a44700 1 -- 172.21.15.133:0/3999420886 shutdown_connections 2021-01-03T13:03:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.279+0000 7f1018a44700 1 --2- 172.21.15.133:0/3999420886 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0fec0553b0 0x7f0fec057870 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.279+0000 7f1018a44700 1 --2- 172.21.15.133:0/3999420886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10140ae460 0x7f1014156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:49.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.279+0000 7f1018a44700 1 --2- 172.21.15.133:0/3999420886 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0ff80044d0 0x7f1014099000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.279+0000 7f1018a44700 1 --2- 172.21.15.133:0/3999420886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10140aeeb0 0x7f1014155f60 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.279+0000 7f1018a44700 1 -- 172.21.15.133:0/3999420886 >> 172.21.15.133:0/3999420886 conn(0x7f101405bdf0 msgr2=0x7f10140b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.279+0000 7f1018a44700 1 -- 172.21.15.133:0/3999420886 shutdown_connections 2021-01-03T13:03:49.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.283+0000 7f1018a44700 1 -- 172.21.15.133:0/3999420886 wait complete. 2021-01-03T13:03:49.297 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-01-03T13:03:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.423+0000 7fde57fff700 1 Processor -- start 2021-01-03T13:03:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.423+0000 7fde57fff700 1 -- start start 2021-01-03T13:03:49.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde57fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fde580af060 0x7fde5805bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:49.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde57fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fde580679c0 0x7fde58140c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:49.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde57fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde580aa350 con 0x7fde5805c690 2021-01-03T13:03:49.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde57fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde580aa5f0 con 0x7fde580af060 2021-01-03T13:03:49.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde57fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde580aa890 con 0x7fde580679c0 2021-01-03T13:03:49.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde577fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fde580679c0 0x7fde58140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:49.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde567fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fde5805c690 0x7fde580672b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56472/0 (socket says 172.21.15.133:56472) 2021-01-03T13:03:49.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde567fc700 1 -- 172.21.15.133:0/4100820567 learned_addr learned my addr 172.21.15.133:0/4100820567 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:49.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde56ffd700 1 --2- 172.21.15.133:0/4100820567 >> v2:172.21.15.16:3300/0 conn(0x7fde580af060 0x7fde5805bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:49.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde577fe700 1 -- 172.21.15.133:0/4100820567 >> v2:172.21.15.16:3300/0 conn(0x7fde580af060 msgr2=0x7fde5805bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:49.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde577fe700 1 --2- 172.21.15.133:0/4100820567 >> v2:172.21.15.16:3300/0 conn(0x7fde580af060 0x7fde5805bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:49.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde577fe700 1 -- 172.21.15.133:0/4100820567 >> v1:172.21.15.133:6789/0 conn(0x7fde5805c690 legacy=0x7fde580672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:49.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde55ffb700 1 -- 172.21.15.133:0/4100820567 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526105396 0 0) 0x7fde580aa350 con 0x7fde5805c690 2021-01-03T13:03:49.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde577fe700 1 -- 172.21.15.133:0/4100820567 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde580aab30 con 0x7fde580679c0 2021-01-03T13:03:49.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde577fe700 1 --2- 172.21.15.133:0/4100820567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde580679c0 0x7fde58140c80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fde50002f80 tx=0x7fde50006db0).ready entity=mon.1 client_cookie=9b5bde1eeb3a7cdd server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:49.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde55ffb700 1 -- 172.21.15.133:0/4100820567 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde50000ea0 con 0x7fde580679c0 2021-01-03T13:03:49.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde55ffb700 1 -- 172.21.15.133:0/4100820567 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde500097b0 con 0x7fde580679c0 2021-01-03T13:03:49.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde55ffb700 1 -- 172.21.15.133:0/4100820567 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde50009b10 con 0x7fde580679c0 2021-01-03T13:03:49.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde57fff700 1 -- 172.21.15.133:0/4100820567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde580679c0 msgr2=0x7fde58140c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:49.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde57fff700 1 --2- 172.21.15.133:0/4100820567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde580679c0 0x7fde58140c80 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fde50002f80 tx=0x7fde50006db0).stop 2021-01-03T13:03:49.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde57fff700 1 -- 172.21.15.133:0/4100820567 shutdown_connections 2021-01-03T13:03:49.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde57fff700 1 --2- 172.21.15.133:0/4100820567 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde580679c0 0x7fde58140c80 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:49.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde57fff700 1 --2- 172.21.15.133:0/4100820567 >> v2:172.21.15.16:3300/0 conn(0x7fde580af060 0x7fde5805bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:49.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde57fff700 1 -- 172.21.15.133:0/4100820567 >> 172.21.15.133:0/4100820567 conn(0x7fde5806b050 msgr2=0x7fde58060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:49.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde57fff700 1 -- 172.21.15.133:0/4100820567 shutdown_connections 2021-01-03T13:03:49.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.427+0000 7fde57fff700 1 -- 172.21.15.133:0/4100820567 wait complete. 2021-01-03T13:03:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde57fff700 1 Processor -- start 2021-01-03T13:03:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde57fff700 1 -- start start 2021-01-03T13:03:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde57fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fde5805c690 0x7fde58145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde57fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde580679c0 0x7fde581451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde57fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde580af060 0x7fde58153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde57fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde581466d0 con 0x7fde580af060 2021-01-03T13:03:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde57fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580b50a0 con 0x7fde580679c0 2021-01-03T13:03:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde57fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580b5340 con 0x7fde5805c690 2021-01-03T13:03:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde567fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde580679c0 0x7fde581451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde56ffd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fde5805c690 0x7fde58145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde567fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde580679c0 0x7fde581451e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35448/0 (socket says 172.21.15.133:35448) 2021-01-03T13:03:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde577fe700 1 --2- 172.21.15.133:0/3130975352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde580af060 0x7fde58153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde567fc700 1 -- 172.21.15.133:0/3130975352 learned_addr learned my addr 172.21.15.133:0/3130975352 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde567fc700 1 -- 172.21.15.133:0/3130975352 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fde5805c690 msgr2=0x7fde58145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde567fc700 1 --2- 172.21.15.133:0/3130975352 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fde5805c690 0x7fde58145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde567fc700 1 -- 172.21.15.133:0/3130975352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde580af060 msgr2=0x7fde58153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde567fc700 1 --2- 172.21.15.133:0/3130975352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde580af060 0x7fde58153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde567fc700 1 -- 172.21.15.133:0/3130975352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde580b4760 con 0x7fde580679c0 2021-01-03T13:03:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde567fc700 1 --2- 172.21.15.133:0/3130975352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde580679c0 0x7fde581451e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fde40000e90 tx=0x7fde40007a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.431+0000 7fde4ffff700 1 -- 172.21.15.133:0/3130975352 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde400072e0 con 0x7fde580679c0 2021-01-03T13:03:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.435+0000 7fde4ffff700 1 -- 172.21.15.133:0/3130975352 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde40007440 con 0x7fde580679c0 2021-01-03T13:03:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.435+0000 7fde4ffff700 1 -- 172.21.15.133:0/3130975352 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde400057d0 con 0x7fde580679c0 2021-01-03T13:03:49.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.435+0000 7fde57fff700 1 -- 172.21.15.133:0/3130975352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde58147e20 con 0x7fde580679c0 2021-01-03T13:03:49.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.435+0000 7fde57fff700 1 -- 172.21.15.133:0/3130975352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde581462a0 con 0x7fde580679c0 2021-01-03T13:03:49.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.435+0000 7fde57fff700 1 -- 172.21.15.133:0/3130975352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde580b5500 con 0x7fde580679c0 2021-01-03T13:03:49.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.435+0000 7fde4ffff700 1 -- 172.21.15.133:0/3130975352 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fde40010070 con 0x7fde580679c0 2021-01-03T13:03:49.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.435+0000 7fde4ffff700 1 --2- 172.21.15.133:0/3130975352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fde3c055440 0x7fde3c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:49.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.435+0000 7fde4ffff700 1 -- 172.21.15.133:0/3130975352 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fde4006d670 con 0x7fde580679c0 2021-01-03T13:03:49.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.435+0000 7fde56ffd700 1 --2- 172.21.15.133:0/3130975352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fde3c055440 0x7fde3c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:49.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.435+0000 7fde56ffd700 1 --2- 172.21.15.133:0/3130975352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fde3c055440 0x7fde3c057900 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fde4800b000 tx=0x7fde480091a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:49.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.443+0000 7fde4ffff700 1 -- 172.21.15.133:0/3130975352 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fde400438a0 con 0x7fde580679c0 2021-01-03T13:03:49.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.587+0000 7fde57fff700 1 -- 172.21.15.133:0/3130975352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7fde58057300 con 0x7fde580679c0 2021-01-03T13:03:49.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.599+0000 7fde4ffff700 1 -- 172.21.15.133:0/3130975352 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fde40046ec0 con 0x7fde580679c0 2021-01-03T13:03:49.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.599+0000 7fde57fff700 1 -- 172.21.15.133:0/3130975352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fde3c055440 msgr2=0x7fde3c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:49.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.599+0000 7fde57fff700 1 --2- 172.21.15.133:0/3130975352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fde3c055440 0x7fde3c057900 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fde4800b000 tx=0x7fde480091a0).stop 2021-01-03T13:03:49.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.599+0000 7fde57fff700 1 -- 172.21.15.133:0/3130975352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde580679c0 msgr2=0x7fde581451e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:49.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.599+0000 7fde57fff700 1 --2- 172.21.15.133:0/3130975352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde580679c0 0x7fde581451e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fde40000e90 tx=0x7fde40007a90).stop 2021-01-03T13:03:49.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.599+0000 7fde57fff700 1 -- 172.21.15.133:0/3130975352 shutdown_connections 2021-01-03T13:03:49.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.599+0000 7fde57fff700 1 --2- 172.21.15.133:0/3130975352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fde3c055440 0x7fde3c057900 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:49.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.599+0000 7fde57fff700 1 --2- 172.21.15.133:0/3130975352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde580af060 0x7fde58153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:49.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.599+0000 7fde57fff700 1 --2- 172.21.15.133:0/3130975352 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fde5805c690 0x7fde58145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:49.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.599+0000 7fde57fff700 1 --2- 172.21.15.133:0/3130975352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde580679c0 0x7fde581451e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:49.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.599+0000 7fde57fff700 1 -- 172.21.15.133:0/3130975352 >> 172.21.15.133:0/3130975352 conn(0x7fde5806b050 msgr2=0x7fde580b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:49.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.599+0000 7fde57fff700 1 -- 172.21.15.133:0/3130975352 shutdown_connections 2021-01-03T13:03:49.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.599+0000 7fde57fff700 1 -- 172.21.15.133:0/3130975352 wait complete. 2021-01-03T13:03:49.613 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:03:49.613 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:03:49.632 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:03:49.649 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:03:49.666 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:03:49.684 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:03:49.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:49.684 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:03:49.685 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:03:49.692 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-03T13:03:49.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:03:49.693 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-01-03T13:03:49.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:03:49.694 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:03:49.694 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:03:49.714 INFO:teuthology.orchestra.run.smithi036.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:03:49.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:03:49.715 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-01-03T13:03:49.716 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-01-03T13:03:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.847+0000 7fe6522df700 1 Processor -- start 2021-01-03T13:03:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.847+0000 7fe6522df700 1 -- start start 2021-01-03T13:03:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.847+0000 7fe6522df700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe64c05cc10 0x7fe64c1437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.847+0000 7fe6522df700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64c05c510 con 0x7fe64c0b02d0 2021-01-03T13:03:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.847+0000 7fe6522df700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64c147190 con 0x7fe64c05c130 2021-01-03T13:03:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.847+0000 7fe6522df700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe64c0b0780 con 0x7fe64c05cc10 2021-01-03T13:03:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.847+0000 7fe64b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe64c05cc10 0x7fe64c1437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.847+0000 7fe64b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe64c05cc10 0x7fe64c1437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35452/0 (socket says 172.21.15.133:35452) 2021-01-03T13:03:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.847+0000 7fe64b7fe700 1 -- 172.21.15.133:0/1665647588 learned_addr learned my addr 172.21.15.133:0/1665647588 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.847+0000 7fe64b7fe700 1 -- 172.21.15.133:0/1665647588 >> v1:172.21.15.133:6789/0 conn(0x7fe64c05c130 legacy=0x7fe64c146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.847+0000 7fe64b7fe700 1 -- 172.21.15.133:0/1665647588 >> v1:172.21.15.16:6789/0 conn(0x7fe64c0b02d0 legacy=0x7fe64c146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.847+0000 7fe64b7fe700 1 -- 172.21.15.133:0/1665647588 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c0b5c10 con 0x7fe64c05cc10 2021-01-03T13:03:49.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.847+0000 7fe64b7fe700 1 --2- 172.21.15.133:0/1665647588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe64c05cc10 0x7fe64c1437e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7fe63c002f30 tx=0x7fe63c006e80).ready entity=mon.1 client_cookie=e96c53ef6847934d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:49.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.847+0000 7fe64affd700 1 -- 172.21.15.133:0/1665647588 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63c0097f0 con 0x7fe64c05cc10 2021-01-03T13:03:49.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.847+0000 7fe64affd700 1 -- 172.21.15.133:0/1665647588 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c009950 con 0x7fe64c05cc10 2021-01-03T13:03:49.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.851+0000 7fe64affd700 1 -- 172.21.15.133:0/1665647588 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63c009cb0 con 0x7fe64c05cc10 2021-01-03T13:03:49.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.851+0000 7fe6522df700 1 -- 172.21.15.133:0/1665647588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe64c05cc10 msgr2=0x7fe64c1437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:49.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.851+0000 7fe6522df700 1 --2- 172.21.15.133:0/1665647588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe64c05cc10 0x7fe64c1437e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7fe63c002f30 tx=0x7fe63c006e80).stop 2021-01-03T13:03:49.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.851+0000 7fe6522df700 1 -- 172.21.15.133:0/1665647588 shutdown_connections 2021-01-03T13:03:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.851+0000 7fe6522df700 1 --2- 172.21.15.133:0/1665647588 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe64c05cc10 0x7fe64c1437e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.851+0000 7fe6522df700 1 -- 172.21.15.133:0/1665647588 >> 172.21.15.133:0/1665647588 conn(0x7fe64c0b95d0 msgr2=0x7fe64c0b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.851+0000 7fe6522df700 1 -- 172.21.15.133:0/1665647588 shutdown_connections 2021-01-03T13:03:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.851+0000 7fe6522df700 1 -- 172.21.15.133:0/1665647588 wait complete. 2021-01-03T13:03:49.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.851+0000 7fe6522df700 1 Processor -- start 2021-01-03T13:03:49.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.851+0000 7fe6522df700 1 -- start start 2021-01-03T13:03:49.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe6522df700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe64c05c130 0x7fe64c0b7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:49.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe6522df700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe64c05cc10 0x7fe64c09ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:49.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe6522df700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe64c0b02d0 0x7fe64c1400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:49.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe6522df700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c09e580 con 0x7fe64c0b02d0 2021-01-03T13:03:49.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe6522df700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c156560 con 0x7fe64c05cc10 2021-01-03T13:03:49.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe6522df700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c09e7b0 con 0x7fe64c05c130 2021-01-03T13:03:49.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe64b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe64c05cc10 0x7fe64c09ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:49.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe64b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe64c05cc10 0x7fe64c09ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35460/0 (socket says 172.21.15.133:35460) 2021-01-03T13:03:49.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe64b7fe700 1 -- 172.21.15.133:0/2420866894 learned_addr learned my addr 172.21.15.133:0/2420866894 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:49.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe65087c700 1 --2- 172.21.15.133:0/2420866894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe64c0b02d0 0x7fe64c1400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:49.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe64bfff700 1 --2- 172.21.15.133:0/2420866894 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe64c05c130 0x7fe64c0b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:49.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe64b7fe700 1 -- 172.21.15.133:0/2420866894 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe64c05c130 msgr2=0x7fe64c0b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:49.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe64b7fe700 1 --2- 172.21.15.133:0/2420866894 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe64c05c130 0x7fe64c0b7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:49.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe64b7fe700 1 -- 172.21.15.133:0/2420866894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe64c0b02d0 msgr2=0x7fe64c1400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:49.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe64b7fe700 1 --2- 172.21.15.133:0/2420866894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe64c0b02d0 0x7fe64c1400d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:49.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe64b7fe700 1 -- 172.21.15.133:0/2420866894 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c09ea50 con 0x7fe64c05cc10 2021-01-03T13:03:49.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe65087c700 1 --2- 172.21.15.133:0/2420866894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe64c0b02d0 0x7fe64c1400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:49.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe64b7fe700 1 --2- 172.21.15.133:0/2420866894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe64c05cc10 0x7fe64c09ee90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fe63c002f30 tx=0x7fe63c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:49.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe6497fa700 1 -- 172.21.15.133:0/2420866894 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63c01e460 con 0x7fe64c05cc10 2021-01-03T13:03:49.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe6497fa700 1 -- 172.21.15.133:0/2420866894 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c01e5c0 con 0x7fe64c05cc10 2021-01-03T13:03:49.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe6522df700 1 -- 172.21.15.133:0/2420866894 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64c09d9c0 con 0x7fe64c05cc10 2021-01-03T13:03:49.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe6497fa700 1 -- 172.21.15.133:0/2420866894 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63c01e920 con 0x7fe64c05cc10 2021-01-03T13:03:49.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.855+0000 7fe6522df700 1 -- 172.21.15.133:0/2420866894 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64c1405c0 con 0x7fe64c05cc10 2021-01-03T13:03:49.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.859+0000 7fe6522df700 1 -- 172.21.15.133:0/2420866894 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe64c09c350 con 0x7fe64c05cc10 2021-01-03T13:03:49.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.859+0000 7fe6497fa700 1 -- 172.21.15.133:0/2420866894 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe63c025030 con 0x7fe64c05cc10 2021-01-03T13:03:49.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.859+0000 7fe6497fa700 1 --2- 172.21.15.133:0/2420866894 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe630055350 0x7fe630057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:49.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.859+0000 7fe6497fa700 1 -- 172.21.15.133:0/2420866894 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe63c06f660 con 0x7fe64c05cc10 2021-01-03T13:03:49.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.859+0000 7fe64bfff700 1 --2- 172.21.15.133:0/2420866894 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe630055350 0x7fe630057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:49.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.859+0000 7fe64bfff700 1 --2- 172.21.15.133:0/2420866894 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe630055350 0x7fe630057810 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fe63400b000 tx=0x7fe634009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:49.863+0000 7fe6497fa700 1 -- 172.21.15.133:0/2420866894 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe64c09c350 con 0x7fe64c05cc10 2021-01-03T13:03:50.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.007+0000 7fe6522df700 1 -- 172.21.15.133:0/2420866894 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe64c09c350 con 0x7fe64c05cc10 2021-01-03T13:03:50.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.007+0000 7fe6497fa700 1 -- 172.21.15.133:0/2420866894 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v67) v1 ==== 81+0+33696 (secure 0 0 0) 0x7fe64c09c350 con 0x7fe64c05cc10 2021-01-03T13:03:50.007 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:50.008 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:03:50.008 INFO:teuthology.orchestra.run.smithi133.stdout: "epoch": 67, 2021-01-03T13:03:50.008 INFO:teuthology.orchestra.run.smithi133.stdout: "fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", 2021-01-03T13:03:50.008 INFO:teuthology.orchestra.run.smithi133.stdout: "created": "2021-01-03T12:57:43.298835+0000", 2021-01-03T13:03:50.008 INFO:teuthology.orchestra.run.smithi133.stdout: "modified": "2021-01-03T13:03:15.994063+0000", 2021-01-03T13:03:50.009 INFO:teuthology.orchestra.run.smithi133.stdout: "last_up_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:03:50.009 INFO:teuthology.orchestra.run.smithi133.stdout: "last_in_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:03:50.009 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-01-03T13:03:50.009 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_num": 5799936, 2021-01-03T13:03:50.009 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_set": [ 2021-01-03T13:03:50.010 INFO:teuthology.orchestra.run.smithi133.stdout: "pglog_hardlimit", 2021-01-03T13:03:50.010 INFO:teuthology.orchestra.run.smithi133.stdout: "purged_snapdirs", 2021-01-03T13:03:50.010 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_deletes", 2021-01-03T13:03:50.010 INFO:teuthology.orchestra.run.smithi133.stdout: "sortbitwise" 2021-01-03T13:03:50.011 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:03:50.011 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_version": 4, 2021-01-03T13:03:50.011 INFO:teuthology.orchestra.run.smithi133.stdout: "full_ratio": 0.94999998807907104, 2021-01-03T13:03:50.011 INFO:teuthology.orchestra.run.smithi133.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-01-03T13:03:50.011 INFO:teuthology.orchestra.run.smithi133.stdout: "nearfull_ratio": 0.85000002384185791, 2021-01-03T13:03:50.012 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_snapshot": "", 2021-01-03T13:03:50.012 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_max": 12, 2021-01-03T13:03:50.012 INFO:teuthology.orchestra.run.smithi133.stdout: "max_osd": 8, 2021-01-03T13:03:50.012 INFO:teuthology.orchestra.run.smithi133.stdout: "require_min_compat_client": "jewel", 2021-01-03T13:03:50.012 INFO:teuthology.orchestra.run.smithi133.stdout: "min_compat_client": "jewel", 2021-01-03T13:03:50.013 INFO:teuthology.orchestra.run.smithi133.stdout: "require_osd_release": "octopus", 2021-01-03T13:03:50.013 INFO:teuthology.orchestra.run.smithi133.stdout: "pools": [ 2021-01-03T13:03:50.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.013 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 1, 2021-01-03T13:03:50.013 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "device_health_metrics", 2021-01-03T13:03:50.014 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:47.102954+0000", 2021-01-03T13:03:50.014 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:03:50.014 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:03:50.014 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:03:50.014 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:03:50.015 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:03:50.015 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:03:50.015 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:03:50.015 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:03:50.015 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 1, 2021-01-03T13:03:50.016 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 1, 2021-01-03T13:03:50.016 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 1, 2021-01-03T13:03:50.016 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 1, 2021-01-03T13:03:50.016 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 1, 2021-01-03T13:03:50.016 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:03:50.017 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:03:50.017 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:03:50.017 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:03:50.017 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:03:50.017 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:03:50.018 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:03:50.018 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.018 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "16", 2021-01-03T13:03:50.018 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:03:50.018 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:03:50.019 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:03:50.019 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:03:50.019 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:03:50.019 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:03:50.019 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:03:50.020 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:03:50.020 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:03:50.020 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:03:50.020 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:03:50.020 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:03:50.021 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:03:50.021 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:03:50.021 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:03:50.021 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:03:50.021 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:03:50.022 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:03:50.022 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:03:50.022 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:03:50.022 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:03:50.022 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:03:50.023 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:03:50.023 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:03:50.023 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:03:50.023 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:03:50.023 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.024 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:03:50.024 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:03:50.024 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:03:50.024 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:03:50.024 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:03:50.025 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:03:50.025 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:03:50.025 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:03:50.025 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:03:50.025 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:03:50.026 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:03:50.026 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:03:50.026 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 1 2021-01-03T13:03:50.026 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.026 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:03:50.027 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr_devicehealth": {} 2021-01-03T13:03:50.027 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.027 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.027 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.027 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 2, 2021-01-03T13:03:50.028 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "rbd", 2021-01-03T13:03:50.028 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:55.472799+0000", 2021-01-03T13:03:50.028 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:03:50.028 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:03:50.028 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:03:50.029 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:03:50.029 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:03:50.029 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:03:50.029 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:03:50.029 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:03:50.030 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:03:50.030 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:03:50.030 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:03:50.030 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:03:50.030 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:03:50.031 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:03:50.031 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:03:50.031 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:03:50.031 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:03:50.031 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:03:50.032 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:03:50.032 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:03:50.032 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.032 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "19", 2021-01-03T13:03:50.032 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:03:50.033 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:03:50.033 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:03:50.033 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:03:50.033 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:03:50.033 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:03:50.034 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:03:50.034 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:03:50.034 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:03:50.034 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:03:50.035 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:03:50.035 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:03:50.035 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:03:50.035 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:03:50.035 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:03:50.036 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:03:50.036 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:03:50.036 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:03:50.036 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:03:50.036 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:03:50.037 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:03:50.037 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:03:50.037 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:03:50.037 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:03:50.037 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:03:50.038 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:03:50.038 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.038 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:03:50.038 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:03:50.038 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:03:50.039 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:03:50.039 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:03:50.039 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:03:50.039 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:03:50.039 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:03:50.040 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:03:50.040 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:03:50.040 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:03:50.040 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:03:50.040 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:03:50.041 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd": {} 2021-01-03T13:03:50.041 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.041 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.041 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 11, 2021-01-03T13:03:50.042 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_metadata", 2021-01-03T13:03:50.042 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:03:11.555772+0000", 2021-01-03T13:03:50.042 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:03:50.042 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:03:50.042 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:03:50.043 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:03:50.043 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:03:50.043 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:03:50.043 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:03:50.043 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:03:50.044 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:03:50.044 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:03:50.044 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:03:50.044 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:03:50.044 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:03:50.045 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:03:50.045 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:03:50.045 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:03:50.045 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:03:50.045 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:03:50.045 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:03:50.046 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:03:50.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.046 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "66", 2021-01-03T13:03:50.046 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:03:50.047 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:03:50.047 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:03:50.047 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:03:50.047 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:03:50.048 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:03:50.048 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:03:50.048 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:03:50.048 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:03:50.049 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:03:50.049 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:03:50.049 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:03:50.049 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:03:50.049 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:03:50.050 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:03:50.050 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:03:50.050 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:03:50.050 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:03:50.050 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:03:50.051 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:03:50.051 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:03:50.051 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:03:50.051 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:03:50.051 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:03:50.052 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:03:50.052 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:03:50.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.052 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:03:50.052 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:03:50.052 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:03:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:03:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:03:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:03:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:03:50.053 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:03:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:03:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:03:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:03:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:03:50.054 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_bias": 4, 2021-01-03T13:03:50.055 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 16, 2021-01-03T13:03:50.055 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_priority": 5 2021-01-03T13:03:50.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.055 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:03:50.055 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:03:50.056 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": "cephfs" 2021-01-03T13:03:50.056 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.056 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.056 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.057 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 12, 2021-01-03T13:03:50.057 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_data", 2021-01-03T13:03:50.057 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:03:12.829370+0000", 2021-01-03T13:03:50.057 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:03:50.057 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:03:50.058 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:03:50.058 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:03:50.058 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:03:50.058 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:03:50.058 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:03:50.059 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:03:50.059 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:03:50.059 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:03:50.059 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:03:50.059 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:03:50.060 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:03:50.060 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:03:50.060 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:03:50.060 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:03:50.060 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:03:50.061 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:03:50.061 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:03:50.061 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:03:50.061 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.061 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "67", 2021-01-03T13:03:50.061 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:03:50.062 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:03:50.062 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:03:50.062 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:03:50.062 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:03:50.062 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:03:50.063 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:03:50.063 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:03:50.063 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:03:50.063 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:03:50.063 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:03:50.064 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:03:50.064 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:03:50.064 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:03:50.064 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:03:50.064 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:03:50.065 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:03:50.065 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:03:50.065 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:03:50.065 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:03:50.065 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:03:50.066 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:03:50.066 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:03:50.066 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:03:50.066 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:03:50.066 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:03:50.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.067 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:03:50.067 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:03:50.067 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:03:50.067 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:03:50.068 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:03:50.068 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:03:50.068 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:03:50.068 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:03:50.068 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:03:50.069 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:03:50.069 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:03:50.069 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:03:50.069 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:03:50.069 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:03:50.070 INFO:teuthology.orchestra.run.smithi133.stdout: "data": "cephfs" 2021-01-03T13:03:50.070 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.070 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.070 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.070 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:03:50.071 INFO:teuthology.orchestra.run.smithi133.stdout: "osds": [ 2021-01-03T13:03:50.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.071 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:03:50.071 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a", 2021-01-03T13:03:50.071 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:03:50.072 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:03:50.072 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:03:50.072 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:03:50.072 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:03:50.072 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:03:50.073 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:03:50.073 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 65, 2021-01-03T13:03:50.073 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:03:50.073 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:03:50.073 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:03:50.074 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.074 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.074 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.074 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6810", 2021-01-03T13:03:50.074 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:03:50.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.075 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.075 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6811", 2021-01-03T13:03:50.075 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:03:50.076 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.076 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.076 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:03:50.076 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.077 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.077 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.077 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6812", 2021-01-03T13:03:50.077 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:03:50.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.078 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.078 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6813", 2021-01-03T13:03:50.078 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:03:50.078 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.079 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.079 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:03:50.079 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.080 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.080 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6816", 2021-01-03T13:03:50.080 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:03:50.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.081 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.081 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6817", 2021-01-03T13:03:50.081 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:03:50.081 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.081 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.082 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.082 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:03:50.082 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.082 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.083 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6814", 2021-01-03T13:03:50.083 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:03:50.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.083 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.083 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6815", 2021-01-03T13:03:50.084 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:03:50.084 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.084 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.084 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6811/12124", 2021-01-03T13:03:50.085 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6813/12124", 2021-01-03T13:03:50.085 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6817/12124", 2021-01-03T13:03:50.085 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6815/12124", 2021-01-03T13:03:50.085 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:03:50.085 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:03:50.086 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:03:50.086 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.086 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:03:50.087 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9170d1de-58d4-4dfd-b9de-80dc15ca9e60", 2021-01-03T13:03:50.087 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:03:50.087 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:03:50.087 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:03:50.087 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:03:50.088 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:03:50.088 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:03:50.088 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:03:50.088 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 65, 2021-01-03T13:03:50.089 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:03:50.089 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:03:50.089 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:03:50.089 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.090 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.090 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6818", 2021-01-03T13:03:50.090 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:03:50.090 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.091 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.091 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6819", 2021-01-03T13:03:50.091 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:03:50.091 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.092 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.092 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:03:50.092 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.093 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.093 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6820", 2021-01-03T13:03:50.093 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:03:50.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.094 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.094 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6821", 2021-01-03T13:03:50.094 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:03:50.094 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.094 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.095 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:03:50.095 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.095 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.095 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.096 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6824", 2021-01-03T13:03:50.096 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:03:50.096 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.096 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.097 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6825", 2021-01-03T13:03:50.097 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:03:50.097 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.097 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.098 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:03:50.098 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.098 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.098 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.098 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6822", 2021-01-03T13:03:50.099 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:03:50.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.099 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.099 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6823", 2021-01-03T13:03:50.099 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:03:50.100 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.100 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.100 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6819/12123", 2021-01-03T13:03:50.100 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6821/12123", 2021-01-03T13:03:50.101 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6825/12123", 2021-01-03T13:03:50.101 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6823/12123", 2021-01-03T13:03:50.101 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:03:50.101 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:03:50.101 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:03:50.102 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.102 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:03:50.102 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9fc5adf9-3537-4953-9c65-0c67ecb53776", 2021-01-03T13:03:50.103 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:03:50.103 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:03:50.103 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:03:50.103 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:03:50.103 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:03:50.104 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:03:50.104 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:03:50.104 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 62, 2021-01-03T13:03:50.104 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:03:50.104 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:03:50.105 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:03:50.105 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.105 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.105 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6802", 2021-01-03T13:03:50.106 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:03:50.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.106 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.106 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6803", 2021-01-03T13:03:50.107 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:03:50.107 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.107 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.107 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:03:50.108 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.108 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.108 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6804", 2021-01-03T13:03:50.108 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:03:50.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.109 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.109 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6805", 2021-01-03T13:03:50.109 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:03:50.110 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.110 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.110 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:03:50.110 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.111 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.111 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.111 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6808", 2021-01-03T13:03:50.111 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:03:50.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.112 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.112 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6809", 2021-01-03T13:03:50.112 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:03:50.112 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.112 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.113 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.113 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:03:50.113 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.113 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.114 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6806", 2021-01-03T13:03:50.114 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:03:50.114 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.114 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.114 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.115 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6807", 2021-01-03T13:03:50.115 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:03:50.115 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.115 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.115 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.116 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6803/12122", 2021-01-03T13:03:50.116 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6805/12122", 2021-01-03T13:03:50.116 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6809/12122", 2021-01-03T13:03:50.116 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6807/12122", 2021-01-03T13:03:50.116 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:03:50.117 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:03:50.117 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:03:50.117 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.118 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:03:50.118 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "0ad45ce5-6635-4089-bbf8-c966d0fe5338", 2021-01-03T13:03:50.118 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:03:50.118 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:03:50.118 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:03:50.119 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:03:50.119 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:03:50.119 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:03:50.119 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:03:50.119 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 51, 2021-01-03T13:03:50.120 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:03:50.120 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:03:50.120 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:03:50.120 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.121 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.121 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6826", 2021-01-03T13:03:50.121 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:03:50.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.122 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.122 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6827", 2021-01-03T13:03:50.122 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:03:50.122 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.122 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.123 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:03:50.123 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.123 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.124 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6828", 2021-01-03T13:03:50.124 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:03:50.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.124 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.125 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6829", 2021-01-03T13:03:50.125 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:03:50.125 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.125 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.126 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:03:50.126 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.126 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.126 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6832", 2021-01-03T13:03:50.127 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:03:50.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.127 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.127 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6833", 2021-01-03T13:03:50.128 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:03:50.128 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.128 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.128 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:03:50.129 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.129 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.129 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6830", 2021-01-03T13:03:50.129 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:03:50.130 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.130 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.130 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6831", 2021-01-03T13:03:50.130 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:03:50.131 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.131 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.131 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6827/12136", 2021-01-03T13:03:50.131 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6829/12136", 2021-01-03T13:03:50.132 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6833/12136", 2021-01-03T13:03:50.132 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6831/12136", 2021-01-03T13:03:50.132 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:03:50.132 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:03:50.132 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:03:50.133 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.133 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.133 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:03:50.133 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "86b8d6d5-271b-4a70-ae7b-a227afb38d7c", 2021-01-03T13:03:50.134 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:03:50.134 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:03:50.134 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:03:50.134 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:03:50.134 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:03:50.135 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:03:50.135 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:03:50.135 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 64, 2021-01-03T13:03:50.135 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:03:50.135 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:03:50.136 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:03:50.136 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.136 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.136 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6808", 2021-01-03T13:03:50.137 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:03:50.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.137 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.138 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6809", 2021-01-03T13:03:50.138 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:03:50.138 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.138 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.139 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:03:50.139 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.139 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.139 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6810", 2021-01-03T13:03:50.140 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:03:50.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.140 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.140 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6811", 2021-01-03T13:03:50.141 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:03:50.141 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.141 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.141 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:03:50.142 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.142 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.142 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6814", 2021-01-03T13:03:50.142 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:03:50.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.143 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.143 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6815", 2021-01-03T13:03:50.143 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:03:50.144 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.144 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.144 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:03:50.144 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.145 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.145 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6812", 2021-01-03T13:03:50.145 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:03:50.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.146 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.146 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6813", 2021-01-03T13:03:50.146 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:03:50.146 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.147 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.147 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6809/12672", 2021-01-03T13:03:50.147 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6811/12672", 2021-01-03T13:03:50.147 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6815/12672", 2021-01-03T13:03:50.148 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6813/12672", 2021-01-03T13:03:50.148 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:03:50.148 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:03:50.148 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:03:50.148 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.149 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:03:50.149 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "173feb9d-f596-4030-85d8-1f4b46a9ffe5", 2021-01-03T13:03:50.149 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:03:50.150 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:03:50.150 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:03:50.150 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:03:50.150 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:03:50.151 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:03:50.151 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:03:50.151 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 62, 2021-01-03T13:03:50.151 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:03:50.151 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:03:50.152 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:03:50.152 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.152 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.152 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6817", 2021-01-03T13:03:50.153 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:03:50.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.153 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.153 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6819", 2021-01-03T13:03:50.154 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:03:50.154 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.154 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.154 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:03:50.155 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.155 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.155 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6820", 2021-01-03T13:03:50.155 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:03:50.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.156 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.156 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6822", 2021-01-03T13:03:50.156 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:03:50.157 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.157 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.157 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:03:50.157 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.158 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.158 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6828", 2021-01-03T13:03:50.158 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:03:50.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.159 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.159 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6830", 2021-01-03T13:03:50.159 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:03:50.160 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.160 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.160 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:03:50.160 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.161 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.161 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6824", 2021-01-03T13:03:50.161 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:03:50.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.162 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.162 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6826", 2021-01-03T13:03:50.162 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:03:50.162 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.163 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.163 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6819/12673", 2021-01-03T13:03:50.163 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6822/12673", 2021-01-03T13:03:50.163 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6830/12673", 2021-01-03T13:03:50.164 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6826/12673", 2021-01-03T13:03:50.164 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:03:50.164 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:03:50.164 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:03:50.165 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.165 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:03:50.165 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "b487980e-ad4d-43c1-91fa-4845f7af3d4d", 2021-01-03T13:03:50.166 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:03:50.166 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:03:50.166 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:03:50.166 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:03:50.166 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:03:50.167 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:03:50.167 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:03:50.167 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 64, 2021-01-03T13:03:50.167 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:03:50.167 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:03:50.168 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:03:50.168 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.168 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.168 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.168 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6800", 2021-01-03T13:03:50.169 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:03:50.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.169 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.169 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6801", 2021-01-03T13:03:50.169 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:03:50.170 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.170 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.170 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:03:50.170 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.171 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.171 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6802", 2021-01-03T13:03:50.171 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:03:50.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.172 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.172 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6803", 2021-01-03T13:03:50.172 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:03:50.172 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.173 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.173 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:03:50.173 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.174 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.174 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6806", 2021-01-03T13:03:50.174 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:03:50.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6807", 2021-01-03T13:03:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:03:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.175 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:03:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.176 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6804", 2021-01-03T13:03:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:03:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.177 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6805", 2021-01-03T13:03:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:03:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6801/12662", 2021-01-03T13:03:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6803/12662", 2021-01-03T13:03:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6807/12662", 2021-01-03T13:03:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6805/12662", 2021-01-03T13:03:50.179 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:03:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:03:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:03:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:03:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "38ea839a-451f-4c09-a545-4514e049b178", 2021-01-03T13:03:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:03:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:03:50.181 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:03:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:03:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:03:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:03:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:03:50.182 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 62, 2021-01-03T13:03:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:03:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:03:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:03:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6816", 2021-01-03T13:03:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:03:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6818", 2021-01-03T13:03:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:03:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.185 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:03:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6821", 2021-01-03T13:03:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:03:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6823", 2021-01-03T13:03:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:03:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.188 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:03:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.189 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6829", 2021-01-03T13:03:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:03:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.190 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6831", 2021-01-03T13:03:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:03:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:03:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:03:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:03:50.192 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6825", 2021-01-03T13:03:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:03:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:03:50.193 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6827", 2021-01-03T13:03:50.194 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:03:50.194 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.194 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.194 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6818/12674", 2021-01-03T13:03:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6823/12674", 2021-01-03T13:03:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6831/12674", 2021-01-03T13:03:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6827/12674", 2021-01-03T13:03:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:03:50.195 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:03:50.196 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:03:50.196 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:50.196 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.196 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:03:50.196 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_xinfo": [ 2021-01-03T13:03:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:03:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:03:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:03:50.197 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:03:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:03:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:03:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.659942+0000", 2021-01-03T13:03:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:03:50.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:03:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:03:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:03:50.199 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:03:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:03:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:03:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.750326+0000", 2021-01-03T13:03:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:03:50.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:03:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:03:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:03:50.201 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:03:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:03:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:03:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.587742+0000", 2021-01-03T13:03:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:03:50.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.203 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:03:50.203 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:03:50.203 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:03:50.203 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:03:50.204 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:03:50.204 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:03:50.204 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.855073+0000", 2021-01-03T13:03:50.204 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:03:50.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:03:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:03:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:03:50.205 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:03:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:03:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:03:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.565030+0000", 2021-01-03T13:03:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:03:50.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:03:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:03:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:03:50.207 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:03:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:03:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:03:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.786206+0000", 2021-01-03T13:03:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:03:50.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:03:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:03:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:03:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:03:50.209 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:03:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:03:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.576185+0000", 2021-01-03T13:03:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:03:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:03:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:03:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:03:50.211 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:03:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:03:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:03:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.823786+0000", 2021-01-03T13:03:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:03:50.212 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:03:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap": [], 2021-01-03T13:03:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap_items": [], 2021-01-03T13:03:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_temp": [], 2021-01-03T13:03:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_temp": [], 2021-01-03T13:03:50.213 INFO:teuthology.orchestra.run.smithi133.stdout: "blacklist": {}, 2021-01-03T13:03:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profiles": { 2021-01-03T13:03:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: "default": { 2021-01-03T13:03:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: "crush-failure-domain": "osd", 2021-01-03T13:03:50.214 INFO:teuthology.orchestra.run.smithi133.stdout: "k": "2", 2021-01-03T13:03:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: "m": "1", 2021-01-03T13:03:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: "plugin": "jerasure", 2021-01-03T13:03:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: "ruleset-failure-domain": "osd", 2021-01-03T13:03:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: "technique": "reed_sol_van" 2021-01-03T13:03:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:50.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps_queue": [], 2021-01-03T13:03:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: "new_removed_snaps": [], 2021-01-03T13:03:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: "new_purged_snaps": [], 2021-01-03T13:03:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_node_flags": {}, 2021-01-03T13:03:50.216 INFO:teuthology.orchestra.run.smithi133.stdout: "device_class_flags": {} 2021-01-03T13:03:50.216 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:03:50.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.011+0000 7fe6522df700 1 -- 172.21.15.133:0/2420866894 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe630055350 msgr2=0x7fe630057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:50.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.011+0000 7fe6522df700 1 --2- 172.21.15.133:0/2420866894 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe630055350 0x7fe630057810 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fe63400b000 tx=0x7fe634009040).stop 2021-01-03T13:03:50.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.011+0000 7fe6522df700 1 -- 172.21.15.133:0/2420866894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe64c05cc10 msgr2=0x7fe64c09ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:50.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.011+0000 7fe6522df700 1 --2- 172.21.15.133:0/2420866894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe64c05cc10 0x7fe64c09ee90 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fe63c002f30 tx=0x7fe63c015000).stop 2021-01-03T13:03:50.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.011+0000 7fe6522df700 1 -- 172.21.15.133:0/2420866894 shutdown_connections 2021-01-03T13:03:50.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.011+0000 7fe6522df700 1 --2- 172.21.15.133:0/2420866894 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe630055350 0x7fe630057810 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.011+0000 7fe6522df700 1 --2- 172.21.15.133:0/2420866894 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe64c0b02d0 0x7fe64c1400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.011+0000 7fe6522df700 1 --2- 172.21.15.133:0/2420866894 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe64c05c130 0x7fe64c0b7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.011+0000 7fe6522df700 1 --2- 172.21.15.133:0/2420866894 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe64c05cc10 0x7fe64c09ee90 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.011+0000 7fe6522df700 1 -- 172.21.15.133:0/2420866894 >> 172.21.15.133:0/2420866894 conn(0x7fe64c0b95d0 msgr2=0x7fe64c143fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:50.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.011+0000 7fe6522df700 1 -- 172.21.15.133:0/2420866894 shutdown_connections 2021-01-03T13:03:50.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.011+0000 7fe6522df700 1 -- 172.21.15.133:0/2420866894 wait complete. 2021-01-03T13:03:50.221 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:03:50.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8b7205700 1 Processor -- start 2021-01-03T13:03:50.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8b7205700 1 -- start start 2021-01-03T13:03:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8b7205700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb8b013ae90 0x7fb8b0062310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8b7205700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb8b0060df0 0x7fb8b0144510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8b7205700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b0140bc0 con 0x7fb8b0061f30 2021-01-03T13:03:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8b7205700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b0141c10 con 0x7fb8b013ae90 2021-01-03T13:03:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8b7205700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b005ff90 con 0x7fb8b0060df0 2021-01-03T13:03:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8b4fa1700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb8b0061f30 0x7fb8b013a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56498/0 (socket says 172.21.15.133:56498) 2021-01-03T13:03:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8b4fa1700 1 -- 172.21.15.133:0/3199890547 learned_addr learned my addr 172.21.15.133:0/3199890547 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8b57a2700 1 --2- 172.21.15.133:0/3199890547 >> v2:172.21.15.133:3300/0 conn(0x7fb8b0060df0 0x7fb8b0144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8affff700 1 --2- 172.21.15.133:0/3199890547 >> v2:172.21.15.16:3300/0 conn(0x7fb8b013ae90 0x7fb8b0062310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8af7fe700 1 -- 172.21.15.133:0/3199890547 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246888528 0 0) 0x7fb8b0140bc0 con 0x7fb8b0061f30 2021-01-03T13:03:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8af7fe700 1 -- 172.21.15.133:0/3199890547 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb894003230 con 0x7fb8b0061f30 2021-01-03T13:03:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8b57a2700 1 -- 172.21.15.133:0/3199890547 >> v2:172.21.15.16:3300/0 conn(0x7fb8b013ae90 msgr2=0x7fb8b0062310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8b57a2700 1 --2- 172.21.15.133:0/3199890547 >> v2:172.21.15.16:3300/0 conn(0x7fb8b013ae90 0x7fb8b0062310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8b57a2700 1 -- 172.21.15.133:0/3199890547 >> v1:172.21.15.133:6789/0 conn(0x7fb8b0061f30 legacy=0x7fb8b013a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8b57a2700 1 -- 172.21.15.133:0/3199890547 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b00b11f0 con 0x7fb8b0060df0 2021-01-03T13:03:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8affff700 1 --2- 172.21.15.133:0/3199890547 >> v2:172.21.15.16:3300/0 conn(0x7fb8b013ae90 0x7fb8b0062310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.339+0000 7fb8b57a2700 1 --2- 172.21.15.133:0/3199890547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8b0060df0 0x7fb8b0144510 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fb8b00b2500 tx=0x7fb8a00091a0).ready entity=mon.1 client_cookie=8de5f4adb0afdfbf server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8af7fe700 1 -- 172.21.15.133:0/3199890547 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8a000b960 con 0x7fb8b0060df0 2021-01-03T13:03:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8af7fe700 1 -- 172.21.15.133:0/3199890547 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a000bac0 con 0x7fb8b0060df0 2021-01-03T13:03:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8af7fe700 1 -- 172.21.15.133:0/3199890547 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8a000bc30 con 0x7fb8b0060df0 2021-01-03T13:03:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8b7205700 1 -- 172.21.15.133:0/3199890547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8b0060df0 msgr2=0x7fb8b0144510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8b7205700 1 --2- 172.21.15.133:0/3199890547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8b0060df0 0x7fb8b0144510 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fb8b00b2500 tx=0x7fb8a00091a0).stop 2021-01-03T13:03:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8b7205700 1 -- 172.21.15.133:0/3199890547 shutdown_connections 2021-01-03T13:03:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8b7205700 1 --2- 172.21.15.133:0/3199890547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8b0060df0 0x7fb8b0144510 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8b7205700 1 --2- 172.21.15.133:0/3199890547 >> v2:172.21.15.16:3300/0 conn(0x7fb8b013ae90 0x7fb8b0062310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8b7205700 1 -- 172.21.15.133:0/3199890547 >> 172.21.15.133:0/3199890547 conn(0x7fb8b00b6db0 msgr2=0x7fb8b0061820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8b7205700 1 -- 172.21.15.133:0/3199890547 shutdown_connections 2021-01-03T13:03:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8b7205700 1 -- 172.21.15.133:0/3199890547 wait complete. 2021-01-03T13:03:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8b7205700 1 Processor -- start 2021-01-03T13:03:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8b7205700 1 -- start start 2021-01-03T13:03:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8b7205700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb8b0060df0 0x7fb8b00ad760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8b7205700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8b0061f30 0x7fb8b0147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8b7205700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8b013ae90 0x7fb8b0138210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8b7205700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00aef50 con 0x7fb8b013ae90 2021-01-03T13:03:50.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8b7205700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b01432b0 con 0x7fb8b0061f30 2021-01-03T13:03:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.343+0000 7fb8b7205700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00ae1e0 con 0x7fb8b0060df0 2021-01-03T13:03:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8affff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8b0061f30 0x7fb8b0147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8affff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8b0061f30 0x7fb8b0147630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35474/0 (socket says 172.21.15.133:35474) 2021-01-03T13:03:50.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8affff700 1 -- 172.21.15.133:0/1572720021 learned_addr learned my addr 172.21.15.133:0/1572720021 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8b57a2700 1 --2- 172.21.15.133:0/1572720021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8b013ae90 0x7fb8b0138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8b4fa1700 1 --2- 172.21.15.133:0/1572720021 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb8b0060df0 0x7fb8b00ad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8affff700 1 -- 172.21.15.133:0/1572720021 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb8b0060df0 msgr2=0x7fb8b00ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8affff700 1 --2- 172.21.15.133:0/1572720021 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb8b0060df0 0x7fb8b00ad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8affff700 1 -- 172.21.15.133:0/1572720021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8b013ae90 msgr2=0x7fb8b0138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:50.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8affff700 1 --2- 172.21.15.133:0/1572720021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8b013ae90 0x7fb8b0138210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8affff700 1 -- 172.21.15.133:0/1572720021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b01428f0 con 0x7fb8b0061f30 2021-01-03T13:03:50.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8affff700 1 --2- 172.21.15.133:0/1572720021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8b0061f30 0x7fb8b0147630 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7fb8a800a000 tx=0x7fb8a8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:50.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8adffb700 1 -- 172.21.15.133:0/1572720021 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8a8009980 con 0x7fb8b0061f30 2021-01-03T13:03:50.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8adffb700 1 -- 172.21.15.133:0/1572720021 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a8009ae0 con 0x7fb8b0061f30 2021-01-03T13:03:50.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8b7205700 1 -- 172.21.15.133:0/1572720021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b0142510 con 0x7fb8b0061f30 2021-01-03T13:03:50.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8adffb700 1 -- 172.21.15.133:0/1572720021 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8a8009e40 con 0x7fb8b0061f30 2021-01-03T13:03:50.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8b7205700 1 -- 172.21.15.133:0/1572720021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b00adc50 con 0x7fb8b0061f30 2021-01-03T13:03:50.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8b7205700 1 -- 172.21.15.133:0/1572720021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b0057300 con 0x7fb8b0061f30 2021-01-03T13:03:50.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8adffb700 1 -- 172.21.15.133:0/1572720021 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb8a8013480 con 0x7fb8b0061f30 2021-01-03T13:03:50.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.347+0000 7fb8adffb700 1 --2- 172.21.15.133:0/1572720021 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb8880553b0 0x7fb888057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:50.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.351+0000 7fb8adffb700 1 -- 172.21.15.133:0/1572720021 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb8a806e6f0 con 0x7fb8b0061f30 2021-01-03T13:03:50.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.351+0000 7fb8b4fa1700 1 --2- 172.21.15.133:0/1572720021 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb8880553b0 0x7fb888057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:50.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.351+0000 7fb8b4fa1700 1 --2- 172.21.15.133:0/1572720021 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb8880553b0 0x7fb888057870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fb89800b000 tx=0x7fb898009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:50.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.359+0000 7fb8adffb700 1 -- 172.21.15.133:0/1572720021 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb8a80448f0 con 0x7fb8b0061f30 2021-01-03T13:03:50.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.539+0000 7fb8b7205700 1 -- 172.21.15.133:0/1572720021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8b005cf00 con 0x7fb8b0061f30 2021-01-03T13:03:50.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.539+0000 7fb8adffb700 1 -- 172.21.15.133:0/1572720021 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+2499 (secure 0 0 0) 0x7fb8a8047f10 con 0x7fb8b0061f30 2021-01-03T13:03:50.540 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:50.540 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":27,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3007157007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3007157007},{"type":"v1","addr":"172.21.15.133:6837","nonce":3007157007}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24},{"gid":5826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/1513472080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1513472080},{"type":"v1","addr":"172.21.15.16:6833","nonce":1513472080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:03:13.979157+0000","modified":"2021-01-03T13:03:14.982718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5881":{"gid":5881,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/1530122021","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1530122021},{"type":"v1","addr":"172.21.15.133:6835","nonce":1530122021}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-01-03T13:03:50.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.543+0000 7fb8b7205700 1 -- 172.21.15.133:0/1572720021 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb8880553b0 msgr2=0x7fb888057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:50.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.543+0000 7fb8b7205700 1 --2- 172.21.15.133:0/1572720021 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb8880553b0 0x7fb888057870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fb89800b000 tx=0x7fb898009040).stop 2021-01-03T13:03:50.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.543+0000 7fb8b7205700 1 -- 172.21.15.133:0/1572720021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8b0061f30 msgr2=0x7fb8b0147630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:50.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.543+0000 7fb8b7205700 1 --2- 172.21.15.133:0/1572720021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8b0061f30 0x7fb8b0147630 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7fb8a800a000 tx=0x7fb8a8008040).stop 2021-01-03T13:03:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.543+0000 7fb8b7205700 1 -- 172.21.15.133:0/1572720021 shutdown_connections 2021-01-03T13:03:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.543+0000 7fb8b7205700 1 --2- 172.21.15.133:0/1572720021 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb8880553b0 0x7fb888057870 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.543+0000 7fb8b7205700 1 --2- 172.21.15.133:0/1572720021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb8b013ae90 0x7fb8b0138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.543+0000 7fb8b7205700 1 --2- 172.21.15.133:0/1572720021 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb8b0060df0 0x7fb8b00ad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.543+0000 7fb8b7205700 1 --2- 172.21.15.133:0/1572720021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb8b0061f30 0x7fb8b0147630 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.543+0000 7fb8b7205700 1 -- 172.21.15.133:0/1572720021 >> 172.21.15.133:0/1572720021 conn(0x7fb8b00b6db0 msgr2=0x7fb8b00b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:50.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.543+0000 7fb8b7205700 1 -- 172.21.15.133:0/1572720021 shutdown_connections 2021-01-03T13:03:50.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.543+0000 7fb8b7205700 1 -- 172.21.15.133:0/1572720021 wait complete. 2021-01-03T13:03:50.544 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 27 2021-01-03T13:03:50.553 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-01-03T13:03:50.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.663+0000 7f64e471b700 1 Processor -- start 2021-01-03T13:03:50.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e471b700 1 -- start start 2021-01-03T13:03:50.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e471b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64dc0b5c10 0x7f64dc0aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:50.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e471b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f64dc14aee0 0x7f64dc144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:50.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e471b700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64dc098550 con 0x7f64dc0b0670 2021-01-03T13:03:50.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e471b700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64dc0b5ff0 con 0x7f64dc14aee0 2021-01-03T13:03:50.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e471b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc0b0b10 con 0x7f64dc0b5c10 2021-01-03T13:03:50.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e2cb8700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f64dc14aee0 0x7f64dc144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:50.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e24b7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64dc0b5c10 0x7f64dc0aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:50.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e2cb8700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f64dc14aee0 0x7f64dc144470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:34024/0 (socket says 172.21.15.133:34024) 2021-01-03T13:03:50.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e2cb8700 1 -- 172.21.15.133:0/1199412496 learned_addr learned my addr 172.21.15.133:0/1199412496 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e2cb8700 1 -- 172.21.15.133:0/1199412496 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64dc0b5c10 msgr2=0x7f64dc0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e2cb8700 1 --2- 172.21.15.133:0/1199412496 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64dc0b5c10 0x7f64dc0aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e2cb8700 1 -- 172.21.15.133:0/1199412496 >> v1:172.21.15.16:6789/0 conn(0x7f64dc0b0670 legacy=0x7f64dc14a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e2cb8700 1 -- 172.21.15.133:0/1199412496 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc098780 con 0x7f64dc14aee0 2021-01-03T13:03:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e14b5700 1 -- 172.21.15.133:0/1199412496 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076897604 0 0) 0x7f64dc098550 con 0x7f64dc0b0670 2021-01-03T13:03:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e2cb8700 1 --2- 172.21.15.133:0/1199412496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64dc14aee0 0x7f64dc144470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f64d40032b0 tx=0x7f64d4009270).ready entity=mon.0 client_cookie=8814f0530d0a481f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e14b5700 1 -- 172.21.15.133:0/1199412496 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64d4009e60 con 0x7f64dc14aee0 2021-01-03T13:03:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e14b5700 1 -- 172.21.15.133:0/1199412496 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d400bc00 con 0x7f64dc14aee0 2021-01-03T13:03:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e14b5700 1 -- 172.21.15.133:0/1199412496 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64d400bd70 con 0x7f64dc14aee0 2021-01-03T13:03:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e471b700 1 -- 172.21.15.133:0/1199412496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64dc14aee0 msgr2=0x7f64dc144470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.667+0000 7f64e471b700 1 --2- 172.21.15.133:0/1199412496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64dc14aee0 0x7f64dc144470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f64d40032b0 tx=0x7f64d4009270).stop 2021-01-03T13:03:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e471b700 1 -- 172.21.15.133:0/1199412496 shutdown_connections 2021-01-03T13:03:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e471b700 1 --2- 172.21.15.133:0/1199412496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64dc14aee0 0x7f64dc144470 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e471b700 1 --2- 172.21.15.133:0/1199412496 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64dc0b5c10 0x7f64dc0aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e471b700 1 -- 172.21.15.133:0/1199412496 >> 172.21.15.133:0/1199412496 conn(0x7f64dc05c8c0 msgr2=0x7f64dc0b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e471b700 1 -- 172.21.15.133:0/1199412496 shutdown_connections 2021-01-03T13:03:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e471b700 1 -- 172.21.15.133:0/1199412496 wait complete. 2021-01-03T13:03:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e471b700 1 Processor -- start 2021-01-03T13:03:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e471b700 1 -- start start 2021-01-03T13:03:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e471b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64dc0b0670 0x7f64dc0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e471b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64dc0b5c10 0x7f64dc1475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e471b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64dc14aee0 0x7f64dc147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e471b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc147f90 con 0x7f64dc0b5c10 2021-01-03T13:03:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e471b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc1466b0 con 0x7f64dc14aee0 2021-01-03T13:03:50.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e471b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc1468e0 con 0x7f64dc0b0670 2021-01-03T13:03:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e2cb8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64dc14aee0 0x7f64dc147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e2cb8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64dc14aee0 0x7f64dc147aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35490/0 (socket says 172.21.15.133:35490) 2021-01-03T13:03:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e2cb8700 1 -- 172.21.15.133:0/4142014462 learned_addr learned my addr 172.21.15.133:0/4142014462 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e1cb6700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64dc0b5c10 0x7f64dc1475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e24b7700 1 --2- 172.21.15.133:0/4142014462 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64dc0b0670 0x7f64dc0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e2cb8700 1 -- 172.21.15.133:0/4142014462 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64dc0b0670 msgr2=0x7f64dc0b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e2cb8700 1 --2- 172.21.15.133:0/4142014462 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64dc0b0670 0x7f64dc0b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e2cb8700 1 -- 172.21.15.133:0/4142014462 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64dc0b5c10 msgr2=0x7f64dc1475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e2cb8700 1 --2- 172.21.15.133:0/4142014462 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64dc0b5c10 0x7f64dc1475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.671+0000 7f64e2cb8700 1 -- 172.21.15.133:0/4142014462 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64dc146b80 con 0x7f64dc14aee0 2021-01-03T13:03:50.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.675+0000 7f64e2cb8700 1 --2- 172.21.15.133:0/4142014462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64dc14aee0 0x7f64dc147aa0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f64dc1480d0 tx=0x7f64d4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:50.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.675+0000 7f64d37fe700 1 -- 172.21.15.133:0/4142014462 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64d401f3f0 con 0x7f64dc14aee0 2021-01-03T13:03:50.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.675+0000 7f64e471b700 1 -- 172.21.15.133:0/4142014462 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64dc146e20 con 0x7f64dc14aee0 2021-01-03T13:03:50.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.675+0000 7f64d37fe700 1 -- 172.21.15.133:0/4142014462 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d401f550 con 0x7f64dc14aee0 2021-01-03T13:03:50.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.675+0000 7f64d37fe700 1 -- 172.21.15.133:0/4142014462 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64d401f8b0 con 0x7f64dc14aee0 2021-01-03T13:03:50.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.675+0000 7f64e471b700 1 -- 172.21.15.133:0/4142014462 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc0adff0 con 0x7f64dc14aee0 2021-01-03T13:03:50.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.675+0000 7f64e471b700 1 -- 172.21.15.133:0/4142014462 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64dc057300 con 0x7f64dc14aee0 2021-01-03T13:03:50.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.675+0000 7f64d37fe700 1 -- 172.21.15.133:0/4142014462 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f64d4026030 con 0x7f64dc14aee0 2021-01-03T13:03:50.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.675+0000 7f64d37fe700 1 --2- 172.21.15.133:0/4142014462 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64bc0554e0 0x7f64bc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:50.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.675+0000 7f64d37fe700 1 -- 172.21.15.133:0/4142014462 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f64d406efd0 con 0x7f64dc14aee0 2021-01-03T13:03:50.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.675+0000 7f64e24b7700 1 --2- 172.21.15.133:0/4142014462 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64bc0554e0 0x7f64bc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:50.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.675+0000 7f64e24b7700 1 --2- 172.21.15.133:0/4142014462 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64bc0554e0 0x7f64bc0579a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f64d800b000 tx=0x7f64d8006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:50.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.683+0000 7f64d37fe700 1 -- 172.21.15.133:0/4142014462 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f64d4048d00 con 0x7f64dc14aee0 2021-01-03T13:03:50.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:50.863+0000 7f64e471b700 1 -- 172.21.15.133:0/4142014462 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f64dc1483e0 con 0x7f64dc14aee0 2021-01-03T13:03:51.275 INFO:tasks.ceph.mon.b.smithi016.stderr:2021-01-03T13:03:51.274+0000 7fba5c9c4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-01-03T13:03:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.291+0000 7f64d37fe700 1 -- 172.21.15.133:0/4142014462 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7f64d4024090 con 0x7f64dc14aee0 2021-01-03T13:03:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.291+0000 7f64e471b700 1 -- 172.21.15.133:0/4142014462 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64bc0554e0 msgr2=0x7f64bc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:51.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.291+0000 7f64e471b700 1 --2- 172.21.15.133:0/4142014462 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64bc0554e0 0x7f64bc0579a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f64d800b000 tx=0x7f64d8006dc0).stop 2021-01-03T13:03:51.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.291+0000 7f64e471b700 1 -- 172.21.15.133:0/4142014462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64dc14aee0 msgr2=0x7f64dc147aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:51.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.291+0000 7f64e471b700 1 --2- 172.21.15.133:0/4142014462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64dc14aee0 0x7f64dc147aa0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f64dc1480d0 tx=0x7f64d4016000).stop 2021-01-03T13:03:51.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.291+0000 7f64e471b700 1 -- 172.21.15.133:0/4142014462 shutdown_connections 2021-01-03T13:03:51.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.291+0000 7f64e471b700 1 --2- 172.21.15.133:0/4142014462 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64bc0554e0 0x7f64bc0579a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:51.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.291+0000 7f64e471b700 1 --2- 172.21.15.133:0/4142014462 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64dc14aee0 0x7f64dc147aa0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:51.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.291+0000 7f64e471b700 1 --2- 172.21.15.133:0/4142014462 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64dc0b0670 0x7f64dc0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:51.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.291+0000 7f64e471b700 1 --2- 172.21.15.133:0/4142014462 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64dc0b5c10 0x7f64dc1475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:51.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.291+0000 7f64e471b700 1 -- 172.21.15.133:0/4142014462 >> 172.21.15.133:0/4142014462 conn(0x7f64dc05c8c0 msgr2=0x7f64dc0b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:51.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.291+0000 7f64e471b700 1 -- 172.21.15.133:0/4142014462 shutdown_connections 2021-01-03T13:03:51.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.291+0000 7f64e471b700 1 -- 172.21.15.133:0/4142014462 wait complete. 2021-01-03T13:03:51.295 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-01-03T13:03:51.307 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:03:51.332 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T13:03:51.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.419+0000 7f8f193b9700 1 Processor -- start 2021-01-03T13:03:51.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.419+0000 7f8f193b9700 1 -- start start 2021-01-03T13:03:51.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f193b9700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8f140b0210 0x7f8f14141180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:51.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f193b9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8f14144bb0 0x7f8f140ab300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:51.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f193b9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f140af5e0 con 0x7f8f140af200 2021-01-03T13:03:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f193b9700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1405c620 con 0x7f8f140b0210 2021-01-03T13:03:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f193b9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1405c8c0 con 0x7f8f14144bb0 2021-01-03T13:03:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f13fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8f140af200 0x7f8f1405bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56544/0 (socket says 172.21.15.133:56544) 2021-01-03T13:03:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f13fff700 1 -- 172.21.15.133:0/867854015 learned_addr learned my addr 172.21.15.133:0/867854015 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f18bb8700 1 --2- 172.21.15.133:0/867854015 >> v2:172.21.15.133:3300/0 conn(0x7f8f14144bb0 0x7f8f140ab300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:51.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f137fe700 1 --2- 172.21.15.133:0/867854015 >> v2:172.21.15.16:3300/0 conn(0x7f8f140b0210 0x7f8f14141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:51.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f12ffd700 1 -- 172.21.15.133:0/867854015 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977022154 0 0) 0x7f8f140af5e0 con 0x7f8f140af200 2021-01-03T13:03:51.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f12ffd700 1 -- 172.21.15.133:0/867854015 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f00003230 con 0x7f8f140af200 2021-01-03T13:03:51.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f18bb8700 1 -- 172.21.15.133:0/867854015 >> v2:172.21.15.16:3300/0 conn(0x7f8f140b0210 msgr2=0x7f8f14141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:51.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f18bb8700 1 --2- 172.21.15.133:0/867854015 >> v2:172.21.15.16:3300/0 conn(0x7f8f140b0210 0x7f8f14141180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:51.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f18bb8700 1 -- 172.21.15.133:0/867854015 >> v1:172.21.15.133:6789/0 conn(0x7f8f140af200 legacy=0x7f8f1405bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:51.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f18bb8700 1 -- 172.21.15.133:0/867854015 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f14140a40 con 0x7f8f14144bb0 2021-01-03T13:03:51.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f18bb8700 1 --2- 172.21.15.133:0/867854015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f14144bb0 0x7f8f140ab300 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f8f0c0032b0 tx=0x7f8f0c0091a0).ready entity=mon.1 client_cookie=4d47b9650a9b9c10 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:51.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f12ffd700 1 -- 172.21.15.133:0/867854015 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f0c00b940 con 0x7f8f14144bb0 2021-01-03T13:03:51.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f12ffd700 1 -- 172.21.15.133:0/867854015 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c00baa0 con 0x7f8f14144bb0 2021-01-03T13:03:51.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f12ffd700 1 -- 172.21.15.133:0/867854015 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f0c00bc10 con 0x7f8f14144bb0 2021-01-03T13:03:51.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f193b9700 1 -- 172.21.15.133:0/867854015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f14144bb0 msgr2=0x7f8f140ab300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:51.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f193b9700 1 --2- 172.21.15.133:0/867854015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f14144bb0 0x7f8f140ab300 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f8f0c0032b0 tx=0x7f8f0c0091a0).stop 2021-01-03T13:03:51.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f193b9700 1 -- 172.21.15.133:0/867854015 shutdown_connections 2021-01-03T13:03:51.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f193b9700 1 --2- 172.21.15.133:0/867854015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f14144bb0 0x7f8f140ab300 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:51.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f193b9700 1 --2- 172.21.15.133:0/867854015 >> v2:172.21.15.16:3300/0 conn(0x7f8f140b0210 0x7f8f14141180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:51.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f193b9700 1 -- 172.21.15.133:0/867854015 >> 172.21.15.133:0/867854015 conn(0x7f8f1406b050 msgr2=0x7f8f14060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:51.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f193b9700 1 -- 172.21.15.133:0/867854015 shutdown_connections 2021-01-03T13:03:51.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.423+0000 7f8f193b9700 1 -- 172.21.15.133:0/867854015 wait complete. 2021-01-03T13:03:51.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f193b9700 1 Processor -- start 2021-01-03T13:03:51.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f193b9700 1 -- start start 2021-01-03T13:03:51.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f193b9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140af200 0x7f8f1409ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:51.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f193b9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f140b0210 0x7f8f14143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:51.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f193b9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f14144bb0 0x7f8f14064350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:51.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f193b9700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f14064840 con 0x7f8f140b0210 2021-01-03T13:03:51.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f193b9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f14064a60 con 0x7f8f140af200 2021-01-03T13:03:51.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f193b9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f14064d00 con 0x7f8f14144bb0 2021-01-03T13:03:51.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f13fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140af200 0x7f8f1409ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:51.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f13fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140af200 0x7f8f1409ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35518/0 (socket says 172.21.15.133:35518) 2021-01-03T13:03:51.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f13fff700 1 -- 172.21.15.133:0/94175081 learned_addr learned my addr 172.21.15.133:0/94175081 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:51.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f137fe700 1 --2- 172.21.15.133:0/94175081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f140b0210 0x7f8f14143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:51.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f18bb8700 1 --2- 172.21.15.133:0/94175081 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f14144bb0 0x7f8f14064350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:51.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f13fff700 1 -- 172.21.15.133:0/94175081 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f14144bb0 msgr2=0x7f8f14064350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:51.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f13fff700 1 --2- 172.21.15.133:0/94175081 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f14144bb0 0x7f8f14064350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:51.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f13fff700 1 -- 172.21.15.133:0/94175081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f140b0210 msgr2=0x7f8f14143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:51.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f13fff700 1 --2- 172.21.15.133:0/94175081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f140b0210 0x7f8f14143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:51.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f13fff700 1 -- 172.21.15.133:0/94175081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1409f890 con 0x7f8f140af200 2021-01-03T13:03:51.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f137fe700 1 --2- 172.21.15.133:0/94175081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f140b0210 0x7f8f14143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:51.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f18bb8700 1 --2- 172.21.15.133:0/94175081 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f14144bb0 0x7f8f14064350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:03:51.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f13fff700 1 --2- 172.21.15.133:0/94175081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140af200 0x7f8f1409ffd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f8f1409f5b0 tx=0x7f8f04007a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:51.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f117fa700 1 -- 172.21.15.133:0/94175081 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f040072e0 con 0x7f8f140af200 2021-01-03T13:03:51.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f117fa700 1 -- 172.21.15.133:0/94175081 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f04007440 con 0x7f8f140af200 2021-01-03T13:03:51.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f117fa700 1 -- 172.21.15.133:0/94175081 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f040057d0 con 0x7f8f140af200 2021-01-03T13:03:51.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f193b9700 1 -- 172.21.15.133:0/94175081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1409fb30 con 0x7f8f140af200 2021-01-03T13:03:51.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.427+0000 7f8f193b9700 1 -- 172.21.15.133:0/94175081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f140a8c60 con 0x7f8f140af200 2021-01-03T13:03:51.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.431+0000 7f8f193b9700 1 -- 172.21.15.133:0/94175081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f14057300 con 0x7f8f140af200 2021-01-03T13:03:51.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.431+0000 7f8f117fa700 1 -- 172.21.15.133:0/94175081 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8f04010070 con 0x7f8f140af200 2021-01-03T13:03:51.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.431+0000 7f8f117fa700 1 --2- 172.21.15.133:0/94175081 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ef4055440 0x7f8ef4057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:51.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.431+0000 7f8f117fa700 1 -- 172.21.15.133:0/94175081 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8f0406d740 con 0x7f8f140af200 2021-01-03T13:03:51.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.431+0000 7f8f137fe700 1 --2- 172.21.15.133:0/94175081 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ef4055440 0x7f8ef4057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:51.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.431+0000 7f8f137fe700 1 --2- 172.21.15.133:0/94175081 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ef4055440 0x7f8ef4057900 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f8f0800b000 tx=0x7f8f08008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:51.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.439+0000 7f8f117fa700 1 -- 172.21.15.133:0/94175081 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8f04043950 con 0x7f8f140af200 2021-01-03T13:03:51.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.623+0000 7f8f193b9700 1 -- 172.21.15.133:0/94175081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f1409fcc0 con 0x7f8f140af200 2021-01-03T13:03:51.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.623+0000 7f8f117fa700 1 -- 172.21.15.133:0/94175081 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+2135 (secure 0 0 0) 0x7f8f04018070 con 0x7f8f140af200 2021-01-03T13:03:51.623 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:51.623 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":28,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/3007157007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3007157007},{"type":"v1","addr":"172.21.15.133:6837","nonce":3007157007}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":24},{"gid":5826,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/1513472080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1513472080},{"type":"v1","addr":"172.21.15.16:6833","nonce":1513472080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:03:13.979157+0000","modified":"2021-01-03T13:03:51.278822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":68,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2021-01-03T13:03:51.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.623+0000 7f8f193b9700 1 -- 172.21.15.133:0/94175081 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ef4055440 msgr2=0x7f8ef4057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:51.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.623+0000 7f8f193b9700 1 --2- 172.21.15.133:0/94175081 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ef4055440 0x7f8ef4057900 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f8f0800b000 tx=0x7f8f08008040).stop 2021-01-03T13:03:51.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.623+0000 7f8f193b9700 1 -- 172.21.15.133:0/94175081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140af200 msgr2=0x7f8f1409ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:51.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.623+0000 7f8f193b9700 1 --2- 172.21.15.133:0/94175081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140af200 0x7f8f1409ffd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f8f1409f5b0 tx=0x7f8f04007a70).stop 2021-01-03T13:03:51.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.627+0000 7f8f193b9700 1 -- 172.21.15.133:0/94175081 shutdown_connections 2021-01-03T13:03:51.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.627+0000 7f8f193b9700 1 --2- 172.21.15.133:0/94175081 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ef4055440 0x7f8ef4057900 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:51.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.627+0000 7f8f193b9700 1 --2- 172.21.15.133:0/94175081 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f14144bb0 0x7f8f14064350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:51.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.627+0000 7f8f193b9700 1 --2- 172.21.15.133:0/94175081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140af200 0x7f8f1409ffd0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:51.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.627+0000 7f8f193b9700 1 --2- 172.21.15.133:0/94175081 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f140b0210 0x7f8f14143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:51.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.627+0000 7f8f193b9700 1 -- 172.21.15.133:0/94175081 >> 172.21.15.133:0/94175081 conn(0x7f8f1406b050 msgr2=0x7f8f14140e90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:51.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.627+0000 7f8f193b9700 1 -- 172.21.15.133:0/94175081 shutdown_connections 2021-01-03T13:03:51.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.627+0000 7f8f193b9700 1 -- 172.21.15.133:0/94175081 wait complete. 2021-01-03T13:03:51.627 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 28 2021-01-03T13:03:51.640 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-01-03T13:03:51.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.803+0000 7f639a8e7700 1 Processor -- start 2021-01-03T13:03:51.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.803+0000 7f639a8e7700 1 -- start start 2021-01-03T13:03:51.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.803+0000 7f639a8e7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63940b9b60 0x7f63940b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:51.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.803+0000 7f639a8e7700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63940605f0 con 0x7f63940b4980 2021-01-03T13:03:51.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.803+0000 7f639a8e7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63940600b0 con 0x7f63940b4de0 2021-01-03T13:03:51.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.803+0000 7f639a8e7700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63940aed30 con 0x7f63940b9b60 2021-01-03T13:03:51.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.803+0000 7f639a0e6700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f63940b4de0 0x7f639414d500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56560/0 (socket says 172.21.15.133:56560) 2021-01-03T13:03:51.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.803+0000 7f639a0e6700 1 -- 172.21.15.133:0/2885123111 learned_addr learned my addr 172.21.15.133:0/2885123111 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:51.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.803+0000 7f63998e5700 1 --2- 172.21.15.133:0/2885123111 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63940b9b60 0x7f63940b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:51.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.803+0000 7f63988e3700 1 -- 172.21.15.133:0/2885123111 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360117142 0 0) 0x7f63940600b0 con 0x7f63940b4de0 2021-01-03T13:03:51.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.803+0000 7f63988e3700 1 -- 172.21.15.133:0/2885123111 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f637c003230 con 0x7f63940b4de0 2021-01-03T13:03:51.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.803+0000 7f63988e3700 1 -- 172.21.15.133:0/2885123111 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718560301 0 0) 0x7f63940605f0 con 0x7f63940b4980 2021-01-03T13:03:51.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.803+0000 7f63988e3700 1 -- 172.21.15.133:0/2885123111 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63940600b0 con 0x7f63940b4980 2021-01-03T13:03:51.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.803+0000 7f63998e5700 1 -- 172.21.15.133:0/2885123111 >> v1:172.21.15.133:6789/0 conn(0x7f63940b4de0 legacy=0x7f639414d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:51.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.803+0000 7f63998e5700 1 -- 172.21.15.133:0/2885123111 >> v1:172.21.15.16:6789/0 conn(0x7f63940b4980 legacy=0x7f6394146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.803+0000 7f63998e5700 1 -- 172.21.15.133:0/2885123111 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6394060350 con 0x7f63940b9b60 2021-01-03T13:03:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f63998e5700 1 --2- 172.21.15.133:0/2885123111 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63940b9b60 0x7f63940b9f40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f6390002f30 tx=0x7f6390006dc0).ready entity=mon.2 client_cookie=613f77e996b6d1fe server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f63988e3700 1 -- 172.21.15.133:0/2885123111 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6390009730 con 0x7f63940b9b60 2021-01-03T13:03:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f63988e3700 1 -- 172.21.15.133:0/2885123111 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6390009890 con 0x7f63940b9b60 2021-01-03T13:03:51.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f63988e3700 1 -- 172.21.15.133:0/2885123111 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6390009bf0 con 0x7f63940b9b60 2021-01-03T13:03:51.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f639a8e7700 1 -- 172.21.15.133:0/2885123111 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63940b9b60 msgr2=0x7f63940b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:51.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f639a8e7700 1 --2- 172.21.15.133:0/2885123111 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63940b9b60 0x7f63940b9f40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f6390002f30 tx=0x7f6390006dc0).stop 2021-01-03T13:03:51.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f639a8e7700 1 -- 172.21.15.133:0/2885123111 shutdown_connections 2021-01-03T13:03:51.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f639a8e7700 1 --2- 172.21.15.133:0/2885123111 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63940b9b60 0x7f63940b9f40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:51.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f639a8e7700 1 -- 172.21.15.133:0/2885123111 >> 172.21.15.133:0/2885123111 conn(0x7f63940b69e0 msgr2=0x7f63940b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:51.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f639a8e7700 1 -- 172.21.15.133:0/2885123111 shutdown_connections 2021-01-03T13:03:51.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f639a8e7700 1 -- 172.21.15.133:0/2885123111 wait complete. 2021-01-03T13:03:51.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f639a8e7700 1 Processor -- start 2021-01-03T13:03:51.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f639a8e7700 1 -- start start 2021-01-03T13:03:51.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f639a8e7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63940b4980 0x7f639413e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:51.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f639a8e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63940b4de0 0x7f6394151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:51.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f639a8e7700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63940b9b60 0x7f6394152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f639a8e7700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6394151860 con 0x7f63940b9b60 2021-01-03T13:03:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f639a8e7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6394154db0 con 0x7f63940b4de0 2021-01-03T13:03:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f639a8e7700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63940b02f0 con 0x7f63940b4980 2021-01-03T13:03:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f63990e4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63940b4de0 0x7f6394151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:51.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f63990e4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63940b4de0 0x7f6394151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35534/0 (socket says 172.21.15.133:35534) 2021-01-03T13:03:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f63990e4700 1 -- 172.21.15.133:0/807322379 learned_addr learned my addr 172.21.15.133:0/807322379 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f639a0e6700 1 --2- 172.21.15.133:0/807322379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63940b9b60 0x7f6394152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.807+0000 7f63998e5700 1 --2- 172.21.15.133:0/807322379 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63940b4980 0x7f639413e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:51.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f63990e4700 1 -- 172.21.15.133:0/807322379 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63940b4980 msgr2=0x7f639413e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f63990e4700 1 --2- 172.21.15.133:0/807322379 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63940b4980 0x7f639413e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f63990e4700 1 -- 172.21.15.133:0/807322379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63940b9b60 msgr2=0x7f6394152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f63990e4700 1 --2- 172.21.15.133:0/807322379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63940b9b60 0x7f6394152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f63990e4700 1 -- 172.21.15.133:0/807322379 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63940b0520 con 0x7f63940b4de0 2021-01-03T13:03:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f63998e5700 1 --2- 172.21.15.133:0/807322379 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63940b4980 0x7f639413e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:51.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f63990e4700 1 --2- 172.21.15.133:0/807322379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63940b4de0 0x7f6394151c50 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f63840010d0 tx=0x7f6384007ab0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f6382ffd700 1 -- 172.21.15.133:0/807322379 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f638400e4a0 con 0x7f63940b4de0 2021-01-03T13:03:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f6382ffd700 1 -- 172.21.15.133:0/807322379 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638400e600 con 0x7f63940b4de0 2021-01-03T13:03:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f6382ffd700 1 -- 172.21.15.133:0/807322379 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f638400e960 con 0x7f63940b4de0 2021-01-03T13:03:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f639a8e7700 1 -- 172.21.15.133:0/807322379 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63940b07c0 con 0x7f63940b4de0 2021-01-03T13:03:51.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f639a8e7700 1 -- 172.21.15.133:0/807322379 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63941451a0 con 0x7f63940b4de0 2021-01-03T13:03:51.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f6382ffd700 1 -- 172.21.15.133:0/807322379 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6384010070 con 0x7f63940b4de0 2021-01-03T13:03:51.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f639a8e7700 1 -- 172.21.15.133:0/807322379 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6394057300 con 0x7f63940b4de0 2021-01-03T13:03:51.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f6382ffd700 1 --2- 172.21.15.133:0/807322379 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63740553b0 0x7f6374057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:51.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f6382ffd700 1 -- 172.21.15.133:0/807322379 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f638406d370 con 0x7f63940b4de0 2021-01-03T13:03:51.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f63998e5700 1 --2- 172.21.15.133:0/807322379 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63740553b0 0x7f6374057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:51.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.811+0000 7f63998e5700 1 --2- 172.21.15.133:0/807322379 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63740553b0 0x7f6374057870 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f6390019000 tx=0x7f6390015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:51.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:51.819+0000 7f6382ffd700 1 -- 172.21.15.133:0/807322379 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6384043490 con 0x7f63940b4de0 2021-01-03T13:03:52.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.007+0000 7f639a8e7700 1 -- 172.21.15.133:0/807322379 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f63940b0950 con 0x7f63940b4de0 2021-01-03T13:03:52.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.295+0000 7f6382ffd700 1 -- 172.21.15.133:0/807322379 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6384046ab0 con 0x7f63940b4de0 2021-01-03T13:03:52.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.299+0000 7f639a8e7700 1 -- 172.21.15.133:0/807322379 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63740553b0 msgr2=0x7f6374057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:52.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.299+0000 7f639a8e7700 1 --2- 172.21.15.133:0/807322379 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63740553b0 0x7f6374057870 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f6390019000 tx=0x7f6390015000).stop 2021-01-03T13:03:52.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.299+0000 7f639a8e7700 1 -- 172.21.15.133:0/807322379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63940b4de0 msgr2=0x7f6394151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:52.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.299+0000 7f639a8e7700 1 --2- 172.21.15.133:0/807322379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63940b4de0 0x7f6394151c50 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f63840010d0 tx=0x7f6384007ab0).stop 2021-01-03T13:03:52.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.299+0000 7f639a8e7700 1 -- 172.21.15.133:0/807322379 shutdown_connections 2021-01-03T13:03:52.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.299+0000 7f639a8e7700 1 --2- 172.21.15.133:0/807322379 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63740553b0 0x7f6374057870 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:52.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.299+0000 7f639a8e7700 1 --2- 172.21.15.133:0/807322379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63940b9b60 0x7f6394152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:52.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.299+0000 7f639a8e7700 1 --2- 172.21.15.133:0/807322379 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63940b4980 0x7f639413e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:52.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.299+0000 7f639a8e7700 1 --2- 172.21.15.133:0/807322379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63940b4de0 0x7f6394151c50 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:52.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.299+0000 7f639a8e7700 1 -- 172.21.15.133:0/807322379 >> 172.21.15.133:0/807322379 conn(0x7f63940b69e0 msgr2=0x7f6394061f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:52.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.299+0000 7f639a8e7700 1 -- 172.21.15.133:0/807322379 shutdown_connections 2021-01-03T13:03:52.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.299+0000 7f639a8e7700 1 -- 172.21.15.133:0/807322379 wait complete. 2021-01-03T13:03:52.315 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-01-03T13:03:52.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.431+0000 7f4d10b3a700 1 Processor -- start 2021-01-03T13:03:52.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.431+0000 7f4d10b3a700 1 -- start start 2021-01-03T13:03:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.431+0000 7f4d10b3a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4d0c067350 0x7f4d0c05fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d10b3a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4d0c0b2750 0x7f4d0c144260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d10b3a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0c0afe70 con 0x7f4d0c066f70 2021-01-03T13:03:52.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d10b3a700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0c060310 con 0x7f4d0c0b2750 2021-01-03T13:03:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d10b3a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0c0605a0 con 0x7f4d0c067350 2021-01-03T13:03:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d03fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4d0c067350 0x7f4d0c05fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d0b7fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f4d0c066f70 0x7f4d0c0af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:35302/0 (socket says 172.21.15.133:35302) 2021-01-03T13:03:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d0b7fe700 1 -- 172.21.15.133:0/1461996401 learned_addr learned my addr 172.21.15.133:0/1461996401 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:52.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d0bfff700 1 --2- 172.21.15.133:0/1461996401 >> v2:172.21.15.16:3300/0 conn(0x7f4d0c0b2750 0x7f4d0c144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:52.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d0affd700 1 -- 172.21.15.133:0/1461996401 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3976106729 0 0) 0x7f4d0c0afe70 con 0x7f4d0c066f70 2021-01-03T13:03:52.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d0affd700 1 -- 172.21.15.133:0/1461996401 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cec003230 con 0x7f4d0c066f70 2021-01-03T13:03:52.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d03fff700 1 -- 172.21.15.133:0/1461996401 >> v2:172.21.15.16:3300/0 conn(0x7f4d0c0b2750 msgr2=0x7f4d0c144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:52.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d03fff700 1 --2- 172.21.15.133:0/1461996401 >> v2:172.21.15.16:3300/0 conn(0x7f4d0c0b2750 0x7f4d0c144260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:52.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d03fff700 1 -- 172.21.15.133:0/1461996401 >> v1:172.21.15.16:6789/0 conn(0x7f4d0c066f70 legacy=0x7f4d0c0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:52.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d03fff700 1 -- 172.21.15.133:0/1461996401 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c0b0b50 con 0x7f4d0c067350 2021-01-03T13:03:52.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d03fff700 1 --2- 172.21.15.133:0/1461996401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d0c067350 0x7f4d0c05fe20 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f4cf4002f30 tx=0x7f4cf4006dc0).ready entity=mon.1 client_cookie=c47ca7e215f4875d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d0affd700 1 -- 172.21.15.133:0/1461996401 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf40096f0 con 0x7f4d0c067350 2021-01-03T13:03:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d0affd700 1 -- 172.21.15.133:0/1461996401 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf4009850 con 0x7f4d0c067350 2021-01-03T13:03:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d0affd700 1 -- 172.21.15.133:0/1461996401 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf4009bb0 con 0x7f4d0c067350 2021-01-03T13:03:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d10b3a700 1 -- 172.21.15.133:0/1461996401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d0c067350 msgr2=0x7f4d0c05fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:52.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d10b3a700 1 --2- 172.21.15.133:0/1461996401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d0c067350 0x7f4d0c05fe20 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f4cf4002f30 tx=0x7f4cf4006dc0).stop 2021-01-03T13:03:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d10b3a700 1 -- 172.21.15.133:0/1461996401 shutdown_connections 2021-01-03T13:03:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d10b3a700 1 --2- 172.21.15.133:0/1461996401 >> v2:172.21.15.16:3300/0 conn(0x7f4d0c0b2750 0x7f4d0c144260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d10b3a700 1 --2- 172.21.15.133:0/1461996401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d0c067350 0x7f4d0c05fe20 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d10b3a700 1 -- 172.21.15.133:0/1461996401 >> 172.21.15.133:0/1461996401 conn(0x7f4d0c0b6110 msgr2=0x7f4d0c0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:52.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d10b3a700 1 -- 172.21.15.133:0/1461996401 shutdown_connections 2021-01-03T13:03:52.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.435+0000 7f4d10b3a700 1 -- 172.21.15.133:0/1461996401 wait complete. 2021-01-03T13:03:52.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.439+0000 7f4d10b3a700 1 Processor -- start 2021-01-03T13:03:52.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.439+0000 7f4d10b3a700 1 -- start start 2021-01-03T13:03:52.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.439+0000 7f4d10b3a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4d0c066f70 0x7f4d0c147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:52.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.439+0000 7f4d10b3a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d0c067350 0x7f4d0c140000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:52.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.439+0000 7f4d10b3a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d0c0b2750 0x7f4d0c13cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.439+0000 7f4d10b3a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c09f400 con 0x7f4d0c0b2750 2021-01-03T13:03:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.439+0000 7f4d10b3a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c063df0 con 0x7f4d0c067350 2021-01-03T13:03:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.439+0000 7f4d10b3a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c064090 con 0x7f4d0c066f70 2021-01-03T13:03:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.439+0000 7f4d03fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d0c067350 0x7f4d0c140000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:52.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.439+0000 7f4d0bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d0c0b2750 0x7f4d0c13cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.439+0000 7f4d0b7fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4d0c066f70 0x7f4d0c147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.439+0000 7f4d03fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d0c067350 0x7f4d0c140000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35550/0 (socket says 172.21.15.133:35550) 2021-01-03T13:03:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.439+0000 7f4d0bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d0c0b2750 0x7f4d0c13cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:34088/0 (socket says 172.21.15.133:34088) 2021-01-03T13:03:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.439+0000 7f4d03fff700 1 -- 172.21.15.133:0/2393098564 learned_addr learned my addr 172.21.15.133:0/2393098564 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:52.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.443+0000 7f4d03fff700 1 -- 172.21.15.133:0/2393098564 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4d0c066f70 msgr2=0x7f4d0c147aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.443+0000 7f4d03fff700 1 --2- 172.21.15.133:0/2393098564 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4d0c066f70 0x7f4d0c147aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.443+0000 7f4d03fff700 1 -- 172.21.15.133:0/2393098564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d0c0b2750 msgr2=0x7f4d0c13cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.443+0000 7f4d03fff700 1 --2- 172.21.15.133:0/2393098564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d0c0b2750 0x7f4d0c13cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.443+0000 7f4d03fff700 1 -- 172.21.15.133:0/2393098564 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c13fb60 con 0x7f4d0c067350 2021-01-03T13:03:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.443+0000 7f4d0bfff700 1 --2- 172.21.15.133:0/2393098564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d0c0b2750 0x7f4d0c13cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:03:52.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.443+0000 7f4d03fff700 1 --2- 172.21.15.133:0/2393098564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d0c067350 0x7f4d0c140000 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f4cf4002f30 tx=0x7f4cf4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.443+0000 7f4d097fa700 1 -- 172.21.15.133:0/2393098564 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf4011b00 con 0x7f4d0c067350 2021-01-03T13:03:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.443+0000 7f4d097fa700 1 -- 172.21.15.133:0/2393098564 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf4011c60 con 0x7f4d0c067350 2021-01-03T13:03:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.443+0000 7f4d10b3a700 1 -- 172.21.15.133:0/2393098564 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0c152e10 con 0x7f4d0c067350 2021-01-03T13:03:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.443+0000 7f4d097fa700 1 -- 172.21.15.133:0/2393098564 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cf401c3b0 con 0x7f4d0c067350 2021-01-03T13:03:52.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.443+0000 7f4d10b3a700 1 -- 172.21.15.133:0/2393098564 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0c153120 con 0x7f4d0c067350 2021-01-03T13:03:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.443+0000 7f4d10b3a700 1 -- 172.21.15.133:0/2393098564 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0c140830 con 0x7f4d0c067350 2021-01-03T13:03:52.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.443+0000 7f4d097fa700 1 -- 172.21.15.133:0/2393098564 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4cf400f070 con 0x7f4d0c067350 2021-01-03T13:03:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.443+0000 7f4d097fa700 1 --2- 172.21.15.133:0/2393098564 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4cf00553b0 0x7f4cf0057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.443+0000 7f4d0b7fe700 1 --2- 172.21.15.133:0/2393098564 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4cf00553b0 0x7f4cf0057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.443+0000 7f4d097fa700 1 -- 172.21.15.133:0/2393098564 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f4cf406ee40 con 0x7f4d0c067350 2021-01-03T13:03:52.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.447+0000 7f4d0b7fe700 1 --2- 172.21.15.133:0/2393098564 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4cf00553b0 0x7f4cf0057870 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f4cfc00d000 tx=0x7f4cfc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:52.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.451+0000 7f4d097fa700 1 -- 172.21.15.133:0/2393098564 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4d0c140830 con 0x7f4d0c067350 2021-01-03T13:03:52.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:52.591+0000 7f4d10b3a700 1 -- 172.21.15.133:0/2393098564 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4d0c140830 con 0x7f4d0c067350 2021-01-03T13:03:53.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.307+0000 7f4d097fa700 1 -- 172.21.15.133:0/2393098564 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v69) v1 ==== 185+0+0 (secure 0 0 0) 0x7f4d0c140830 con 0x7f4d0c067350 2021-01-03T13:03:53.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.311+0000 7f4d10b3a700 1 -- 172.21.15.133:0/2393098564 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4cf00553b0 msgr2=0x7f4cf0057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:53.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.311+0000 7f4d10b3a700 1 --2- 172.21.15.133:0/2393098564 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4cf00553b0 0x7f4cf0057870 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f4cfc00d000 tx=0x7f4cfc009040).stop 2021-01-03T13:03:53.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.311+0000 7f4d10b3a700 1 -- 172.21.15.133:0/2393098564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d0c067350 msgr2=0x7f4d0c140000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:53.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.311+0000 7f4d10b3a700 1 --2- 172.21.15.133:0/2393098564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d0c067350 0x7f4d0c140000 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f4cf4002f30 tx=0x7f4cf4015000).stop 2021-01-03T13:03:53.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.311+0000 7f4d10b3a700 1 -- 172.21.15.133:0/2393098564 shutdown_connections 2021-01-03T13:03:53.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.311+0000 7f4d10b3a700 1 --2- 172.21.15.133:0/2393098564 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4cf00553b0 0x7f4cf0057870 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:53.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.311+0000 7f4d10b3a700 1 --2- 172.21.15.133:0/2393098564 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4d0c0b2750 0x7f4d0c13cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:53.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.311+0000 7f4d10b3a700 1 --2- 172.21.15.133:0/2393098564 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4d0c066f70 0x7f4d0c147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:53.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.311+0000 7f4d10b3a700 1 --2- 172.21.15.133:0/2393098564 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d0c067350 0x7f4d0c140000 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:53.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.311+0000 7f4d10b3a700 1 -- 172.21.15.133:0/2393098564 >> 172.21.15.133:0/2393098564 conn(0x7f4d0c0b6110 msgr2=0x7f4d0c0af760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:53.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.311+0000 7f4d10b3a700 1 -- 172.21.15.133:0/2393098564 shutdown_connections 2021-01-03T13:03:53.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.311+0000 7f4d10b3a700 1 -- 172.21.15.133:0/2393098564 wait complete. 2021-01-03T13:03:53.314 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2021-01-03T13:03:53.328 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-01-03T13:03:53.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.451+0000 7f64afe3c700 1 Processor -- start 2021-01-03T13:03:53.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.451+0000 7f64afe3c700 1 -- start start 2021-01-03T13:03:53.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.451+0000 7f64afe3c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64a81407f0 0x7f64a8142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:53.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.451+0000 7f64afe3c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f64a80b0470 0x7f64a805bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:53.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.451+0000 7f64afe3c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a805cf20 con 0x7f64a8140410 2021-01-03T13:03:53.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.451+0000 7f64afe3c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a80b02d0 con 0x7f64a80b0470 2021-01-03T13:03:53.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.451+0000 7f64afe3c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a8146390 con 0x7f64a81407f0 2021-01-03T13:03:53.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64ae3d9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f64a80b0470 0x7f64a805bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:53.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64adbd8700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f64a8140410 0x7f64a8146cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56588/0 (socket says 172.21.15.133:56588) 2021-01-03T13:03:53.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64adbd8700 1 -- 172.21.15.133:0/2190850811 learned_addr learned my addr 172.21.15.133:0/2190850811 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:53.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64ad3d7700 1 --2- 172.21.15.133:0/2190850811 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64a81407f0 0x7f64a8142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:53.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64ae3d9700 1 -- 172.21.15.133:0/2190850811 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64a81407f0 msgr2=0x7f64a8142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:53.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64ae3d9700 1 --2- 172.21.15.133:0/2190850811 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64a81407f0 0x7f64a8142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:53.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64ae3d9700 1 -- 172.21.15.133:0/2190850811 >> v1:172.21.15.133:6789/0 conn(0x7f64a8140410 legacy=0x7f64a8146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:53.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64acbd6700 1 -- 172.21.15.133:0/2190850811 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826835016 0 0) 0x7f64a805cf20 con 0x7f64a8140410 2021-01-03T13:03:53.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64ae3d9700 1 -- 172.21.15.133:0/2190850811 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a8146580 con 0x7f64a80b0470 2021-01-03T13:03:53.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64ae3d9700 1 --2- 172.21.15.133:0/2190850811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64a80b0470 0x7f64a805bdf0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f64a00032b0 tx=0x7f64a00091a0).ready entity=mon.1 client_cookie=9670884792466106 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:53.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64acbd6700 1 -- 172.21.15.133:0/2190850811 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a000ba50 con 0x7f64a80b0470 2021-01-03T13:03:53.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64acbd6700 1 -- 172.21.15.133:0/2190850811 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a000bbb0 con 0x7f64a80b0470 2021-01-03T13:03:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64acbd6700 1 -- 172.21.15.133:0/2190850811 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a000bd20 con 0x7f64a80b0470 2021-01-03T13:03:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64afe3c700 1 -- 172.21.15.133:0/2190850811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64a80b0470 msgr2=0x7f64a805bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64afe3c700 1 --2- 172.21.15.133:0/2190850811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64a80b0470 0x7f64a805bdf0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f64a00032b0 tx=0x7f64a00091a0).stop 2021-01-03T13:03:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64afe3c700 1 -- 172.21.15.133:0/2190850811 shutdown_connections 2021-01-03T13:03:53.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64afe3c700 1 --2- 172.21.15.133:0/2190850811 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64a80b0470 0x7f64a805bdf0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64afe3c700 1 --2- 172.21.15.133:0/2190850811 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64a81407f0 0x7f64a8142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64afe3c700 1 -- 172.21.15.133:0/2190850811 >> 172.21.15.133:0/2190850811 conn(0x7f64a80b95d0 msgr2=0x7f64a80b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64afe3c700 1 -- 172.21.15.133:0/2190850811 shutdown_connections 2021-01-03T13:03:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64afe3c700 1 -- 172.21.15.133:0/2190850811 wait complete. 2021-01-03T13:03:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64afe3c700 1 Processor -- start 2021-01-03T13:03:53.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64afe3c700 1 -- start start 2021-01-03T13:03:53.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64afe3c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64a80b0470 0x7f64a809e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:53.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.455+0000 7f64afe3c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64a8140410 0x7f64a809e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:53.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64afe3c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64a81407f0 0x7f64a8154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:53.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64afe3c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a8143650 con 0x7f64a80b0470 2021-01-03T13:03:53.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64afe3c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a8143050 con 0x7f64a81407f0 2021-01-03T13:03:53.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64afe3c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a8155280 con 0x7f64a8140410 2021-01-03T13:03:53.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64ae3d9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64a81407f0 0x7f64a8154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:53.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64ae3d9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64a81407f0 0x7f64a8154420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35564/0 (socket says 172.21.15.133:35564) 2021-01-03T13:03:53.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64ae3d9700 1 -- 172.21.15.133:0/4213528390 learned_addr learned my addr 172.21.15.133:0/4213528390 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:53.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64ad3d7700 1 --2- 172.21.15.133:0/4213528390 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64a8140410 0x7f64a809e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:53.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64adbd8700 1 --2- 172.21.15.133:0/4213528390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64a80b0470 0x7f64a809e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:53.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64ae3d9700 1 -- 172.21.15.133:0/4213528390 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64a8140410 msgr2=0x7f64a809e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:53.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64ae3d9700 1 --2- 172.21.15.133:0/4213528390 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64a8140410 0x7f64a809e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:53.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64ae3d9700 1 -- 172.21.15.133:0/4213528390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64a80b0470 msgr2=0x7f64a809e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:53.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64ae3d9700 1 --2- 172.21.15.133:0/4213528390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64a80b0470 0x7f64a809e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:53.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64ae3d9700 1 -- 172.21.15.133:0/4213528390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a80aee90 con 0x7f64a81407f0 2021-01-03T13:03:53.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64ad3d7700 1 --2- 172.21.15.133:0/4213528390 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64a8140410 0x7f64a809e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:03:53.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64adbd8700 1 --2- 172.21.15.133:0/4213528390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64a80b0470 0x7f64a809e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:03:53.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64ae3d9700 1 --2- 172.21.15.133:0/4213528390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64a81407f0 0x7f64a8154420 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f64a00032b0 tx=0x7f64a0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:53.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f6496ffd700 1 -- 172.21.15.133:0/4213528390 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a001f5e0 con 0x7f64a81407f0 2021-01-03T13:03:53.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f6496ffd700 1 -- 172.21.15.133:0/4213528390 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a001f740 con 0x7f64a81407f0 2021-01-03T13:03:53.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64afe3c700 1 -- 172.21.15.133:0/4213528390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a809f4f0 con 0x7f64a81407f0 2021-01-03T13:03:53.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f6496ffd700 1 -- 172.21.15.133:0/4213528390 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a001faa0 con 0x7f64a81407f0 2021-01-03T13:03:53.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64afe3c700 1 -- 172.21.15.133:0/4213528390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a8154ab0 con 0x7f64a81407f0 2021-01-03T13:03:53.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f64afe3c700 1 -- 172.21.15.133:0/4213528390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a8143210 con 0x7f64a81407f0 2021-01-03T13:03:53.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.459+0000 7f6496ffd700 1 -- 172.21.15.133:0/4213528390 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f64a0026030 con 0x7f64a81407f0 2021-01-03T13:03:53.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.463+0000 7f6496ffd700 1 --2- 172.21.15.133:0/4213528390 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6488055440 0x7f6488057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:53.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.463+0000 7f6496ffd700 1 -- 172.21.15.133:0/4213528390 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f64a006f2c0 con 0x7f64a81407f0 2021-01-03T13:03:53.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.463+0000 7f64adbd8700 1 --2- 172.21.15.133:0/4213528390 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6488055440 0x7f6488057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:53.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.463+0000 7f64adbd8700 1 --2- 172.21.15.133:0/4213528390 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6488055440 0x7f6488057900 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f6498008000 tx=0x7f6498009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:53.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.467+0000 7f6496ffd700 1 -- 172.21.15.133:0/4213528390 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f64a0045610 con 0x7f64a81407f0 2021-01-03T13:03:53.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:53.611+0000 7f64afe3c700 1 -- 172.21.15.133:0/4213528390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f64a81550a0 con 0x7f64a81407f0 2021-01-03T13:03:54.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.307+0000 7f6496ffd700 1 -- 172.21.15.133:0/4213528390 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v70) v1 ==== 173+0+0 (secure 0 0 0) 0x7f64a00150d0 con 0x7f64a81407f0 2021-01-03T13:03:54.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.319+0000 7f64afe3c700 1 -- 172.21.15.133:0/4213528390 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6488055440 msgr2=0x7f6488057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:54.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.319+0000 7f64afe3c700 1 --2- 172.21.15.133:0/4213528390 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6488055440 0x7f6488057900 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f6498008000 tx=0x7f6498009040).stop 2021-01-03T13:03:54.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.319+0000 7f64afe3c700 1 -- 172.21.15.133:0/4213528390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64a81407f0 msgr2=0x7f64a8154420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:54.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.319+0000 7f64afe3c700 1 --2- 172.21.15.133:0/4213528390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64a81407f0 0x7f64a8154420 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f64a00032b0 tx=0x7f64a0016000).stop 2021-01-03T13:03:54.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.319+0000 7f64afe3c700 1 -- 172.21.15.133:0/4213528390 shutdown_connections 2021-01-03T13:03:54.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.319+0000 7f64afe3c700 1 --2- 172.21.15.133:0/4213528390 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6488055440 0x7f6488057900 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:54.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.319+0000 7f64afe3c700 1 --2- 172.21.15.133:0/4213528390 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64a80b0470 0x7f64a809e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:54.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.319+0000 7f64afe3c700 1 --2- 172.21.15.133:0/4213528390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64a81407f0 0x7f64a8154420 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:54.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.319+0000 7f64afe3c700 1 --2- 172.21.15.133:0/4213528390 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f64a8140410 0x7f64a809e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:54.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.319+0000 7f64afe3c700 1 -- 172.21.15.133:0/4213528390 >> 172.21.15.133:0/4213528390 conn(0x7f64a80b95d0 msgr2=0x7f64a8144d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:54.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.319+0000 7f64afe3c700 1 -- 172.21.15.133:0/4213528390 shutdown_connections 2021-01-03T13:03:54.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.319+0000 7f64afe3c700 1 -- 172.21.15.133:0/4213528390 wait complete. 2021-01-03T13:03:54.320 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2021-01-03T13:03:54.335 INFO:tasks.ceph.mds.a:Restarting daemon 2021-01-03T13:03:54.336 INFO:tasks.ceph.mds.a:Stopping old one... 2021-01-03T13:03:54.336 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-01-03T13:03:54.336 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:03:54.337 INFO:tasks.ceph.mds.c:Restarting daemon 2021-01-03T13:03:54.337 INFO:tasks.ceph.mds.c:Stopping old one... 2021-01-03T13:03:54.337 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-01-03T13:03:54.337 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:03:54.338 INFO:tasks.ceph.mds.b:Restarting daemon 2021-01-03T13:03:54.338 INFO:tasks.ceph.mds.b:Stopping old one... 2021-01-03T13:03:54.338 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-01-03T13:03:54.338 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:03:54.347 INFO:tasks.ceph.mds.a:Stopped 2021-01-03T13:03:54.347 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-01-03T13:03:54.348 INFO:tasks.ceph.mds.c:Stopped 2021-01-03T13:03:54.349 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-01-03T13:03:54.350 INFO:tasks.ceph.mds.b:Stopped 2021-01-03T13:03:54.350 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-01-03T13:03:54.393 INFO:tasks.ceph.mds.a:Started 2021-01-03T13:03:54.394 DEBUG:teuthology.parallel:result is None 2021-01-03T13:03:54.395 INFO:tasks.ceph.mds.c:Started 2021-01-03T13:03:54.395 DEBUG:teuthology.parallel:result is None 2021-01-03T13:03:54.398 INFO:tasks.ceph.mds.b:Started 2021-01-03T13:03:54.398 DEBUG:teuthology.parallel:result is None 2021-01-03T13:03:54.398 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-01-03T13:03:54.467 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T13:03:54.467 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T13:03:54.487 INFO:tasks.ceph.mds.b.smithi016.stdout:starting mds.b at 2021-01-03T13:03:54.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f835569c700 1 Processor -- start 2021-01-03T13:03:54.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f835569c700 1 -- start start 2021-01-03T13:03:54.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f835569c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83500b0840 0x7f8350143860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:54.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f835569c700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f835005cad0 con 0x7f83500677a0 2021-01-03T13:03:54.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f835569c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8350067b80 con 0x7f835005c630 2021-01-03T13:03:54.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f835569c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83500ad090 con 0x7f83500b0840 2021-01-03T13:03:54.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f8354e9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83500b0840 0x7f8350143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:54.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f834f7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f835005c630 0x7f83500a8d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56628/0 (socket says 172.21.15.133:56628) 2021-01-03T13:03:54.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f834f7fe700 1 -- 172.21.15.133:0/1097827953 learned_addr learned my addr 172.21.15.133:0/1097827953 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:54.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f8354e9b700 1 -- 172.21.15.133:0/1097827953 >> v1:172.21.15.133:6789/0 conn(0x7f835005c630 legacy=0x7f83500a8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:54.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f8354e9b700 1 -- 172.21.15.133:0/1097827953 >> v1:172.21.15.16:6789/0 conn(0x7f83500677a0 legacy=0x7f83500b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:54.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f8354e9b700 1 -- 172.21.15.133:0/1097827953 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8350142e80 con 0x7f83500b0840 2021-01-03T13:03:54.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f8354e9b700 1 --2- 172.21.15.133:0/1097827953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500b0840 0x7f8350143860 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f8340002f30 tx=0x7f8340006dc0).ready entity=mon.1 client_cookie=7c7ac549ce73ad52 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:54.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f834effd700 1 -- 172.21.15.133:0/1097827953 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83400097f0 con 0x7f83500b0840 2021-01-03T13:03:54.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f834effd700 1 -- 172.21.15.133:0/1097827953 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8340009950 con 0x7f83500b0840 2021-01-03T13:03:54.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f834effd700 1 -- 172.21.15.133:0/1097827953 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8340009cb0 con 0x7f83500b0840 2021-01-03T13:03:54.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f835569c700 1 -- 172.21.15.133:0/1097827953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500b0840 msgr2=0x7f8350143860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f835569c700 1 --2- 172.21.15.133:0/1097827953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500b0840 0x7f8350143860 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7f8340002f30 tx=0x7f8340006dc0).stop 2021-01-03T13:03:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f835569c700 1 -- 172.21.15.133:0/1097827953 shutdown_connections 2021-01-03T13:03:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f835569c700 1 --2- 172.21.15.133:0/1097827953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500b0840 0x7f8350143860 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f835569c700 1 -- 172.21.15.133:0/1097827953 >> 172.21.15.133:0/1097827953 conn(0x7f835006b050 msgr2=0x7f8350060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:54.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f835569c700 1 -- 172.21.15.133:0/1097827953 shutdown_connections 2021-01-03T13:03:54.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.523+0000 7f835569c700 1 -- 172.21.15.133:0/1097827953 wait complete. 2021-01-03T13:03:54.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f835569c700 1 Processor -- start 2021-01-03T13:03:54.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f835569c700 1 -- start start 2021-01-03T13:03:54.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f835569c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f835005c630 0x7f835013dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:54.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f835569c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500677a0 0x7f83500ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:54.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f835569c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83500b0840 0x7f83500aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:54.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f835569c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83500aa630 con 0x7f83500b0840 2021-01-03T13:03:54.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f835569c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83500aaf40 con 0x7f83500677a0 2021-01-03T13:03:54.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f835569c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83500a9930 con 0x7f835005c630 2021-01-03T13:03:54.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f834f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500677a0 0x7f83500ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:54.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f834ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f835005c630 0x7f835013dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:54.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f834f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500677a0 0x7f83500ab570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35602/0 (socket says 172.21.15.133:35602) 2021-01-03T13:03:54.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f834f7fe700 1 -- 172.21.15.133:0/3356096658 learned_addr learned my addr 172.21.15.133:0/3356096658 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:54.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f8354e9b700 1 --2- 172.21.15.133:0/3356096658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83500b0840 0x7f83500aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:54.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f834ffff700 1 -- 172.21.15.133:0/3356096658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500677a0 msgr2=0x7f83500ab570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:54.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f834ffff700 1 --2- 172.21.15.133:0/3356096658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500677a0 0x7f83500ab570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:54.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f834ffff700 1 -- 172.21.15.133:0/3356096658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83500b0840 msgr2=0x7f83500aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:54.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f834ffff700 1 --2- 172.21.15.133:0/3356096658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83500b0840 0x7f83500aba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:54.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f834ffff700 1 -- 172.21.15.133:0/3356096658 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83500abf50 con 0x7f835005c630 2021-01-03T13:03:54.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f834f7fe700 1 --2- 172.21.15.133:0/3356096658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500677a0 0x7f83500ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:03:54.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f834ffff700 1 --2- 172.21.15.133:0/3356096658 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f835005c630 0x7f835013dca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f83500aa770 tx=0x7f8348007ee0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:54.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f834d7fa700 1 -- 172.21.15.133:0/3356096658 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f834800a560 con 0x7f835005c630 2021-01-03T13:03:54.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f834d7fa700 1 -- 172.21.15.133:0/3356096658 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834800a6c0 con 0x7f835005c630 2021-01-03T13:03:54.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f835569c700 1 -- 172.21.15.133:0/3356096658 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83500a9680 con 0x7f835005c630 2021-01-03T13:03:54.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f834d7fa700 1 -- 172.21.15.133:0/3356096658 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f834800a830 con 0x7f835005c630 2021-01-03T13:03:54.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.527+0000 7f835569c700 1 -- 172.21.15.133:0/3356096658 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83500aa0f0 con 0x7f835005c630 2021-01-03T13:03:54.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.531+0000 7f835569c700 1 -- 172.21.15.133:0/3356096658 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8350057300 con 0x7f835005c630 2021-01-03T13:03:54.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.531+0000 7f834d7fa700 1 -- 172.21.15.133:0/3356096658 <== mon.2 v2:172.21.15.16:3301/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8348019030 con 0x7f835005c630 2021-01-03T13:03:54.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.531+0000 7f834d7fa700 1 --2- 172.21.15.133:0/3356096658 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8334055500 0x7f83340579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:54.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.531+0000 7f834d7fa700 1 -- 172.21.15.133:0/3356096658 <== mon.2 v2:172.21.15.16:3301/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f834806d3f0 con 0x7f835005c630 2021-01-03T13:03:54.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.531+0000 7f834f7fe700 1 --2- 172.21.15.133:0/3356096658 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8334055500 0x7f83340579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:54.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.531+0000 7f834f7fe700 1 --2- 172.21.15.133:0/3356096658 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8334055500 0x7f83340579c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f833800d000 tx=0x7f8338009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:54.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.539+0000 7f834d7fa700 1 -- 172.21.15.133:0/3356096658 <== mon.2 v2:172.21.15.16:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8348043840 con 0x7f835005c630 2021-01-03T13:03:54.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:54.691+0000 7f835569c700 1 -- 172.21.15.133:0/3356096658 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f83500afc30 con 0x7f835005c630 2021-01-03T13:03:55.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.511+0000 7f834d7fa700 1 -- 172.21.15.133:0/3356096658 <== mon.2 v2:172.21.15.16:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v73) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8348046e60 con 0x7f835005c630 2021-01-03T13:03:55.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.515+0000 7f835569c700 1 -- 172.21.15.133:0/3356096658 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8334055500 msgr2=0x7f83340579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:55.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.515+0000 7f835569c700 1 --2- 172.21.15.133:0/3356096658 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8334055500 0x7f83340579c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f833800d000 tx=0x7f8338009040).stop 2021-01-03T13:03:55.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.515+0000 7f835569c700 1 -- 172.21.15.133:0/3356096658 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f835005c630 msgr2=0x7f835013dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:55.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.515+0000 7f835569c700 1 --2- 172.21.15.133:0/3356096658 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f835005c630 0x7f835013dca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f83500aa770 tx=0x7f8348007ee0).stop 2021-01-03T13:03:55.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.515+0000 7f835569c700 1 -- 172.21.15.133:0/3356096658 shutdown_connections 2021-01-03T13:03:55.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.515+0000 7f835569c700 1 --2- 172.21.15.133:0/3356096658 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8334055500 0x7f83340579c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:55.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.515+0000 7f835569c700 1 --2- 172.21.15.133:0/3356096658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f83500b0840 0x7f83500aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:55.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.515+0000 7f835569c700 1 --2- 172.21.15.133:0/3356096658 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f835005c630 0x7f835013dca0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:55.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.515+0000 7f835569c700 1 --2- 172.21.15.133:0/3356096658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83500677a0 0x7f83500ab570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:55.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.515+0000 7f835569c700 1 -- 172.21.15.133:0/3356096658 >> 172.21.15.133:0/3356096658 conn(0x7f835006b050 msgr2=0x7f83500ae480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:55.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.515+0000 7f835569c700 1 -- 172.21.15.133:0/3356096658 shutdown_connections 2021-01-03T13:03:55.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.515+0000 7f835569c700 1 -- 172.21.15.133:0/3356096658 wait complete. 2021-01-03T13:03:55.517 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blacklist entries 2021-01-03T13:03:55.529 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-01-03T13:03:55.530 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-01-03T13:03:55.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.643+0000 7f5691e23700 1 Processor -- start 2021-01-03T13:03:55.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.643+0000 7f5691e23700 1 -- start start 2021-01-03T13:03:55.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.643+0000 7f5691e23700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f568c0b3830 0x7f568c14e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:55.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.643+0000 7f5691e23700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568c142d30 con 0x7f568c0b2f00 2021-01-03T13:03:55.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.643+0000 7f5691e23700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568c142fd0 con 0x7f568c0b20c0 2021-01-03T13:03:55.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.643+0000 7f5691e23700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568c143270 con 0x7f568c0b3830 2021-01-03T13:03:55.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.643+0000 7f568bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f568c0b20c0 0x7f568c140060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56646/0 (socket says 172.21.15.133:56646) 2021-01-03T13:03:55.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.643+0000 7f568bfff700 1 -- 172.21.15.133:0/745021636 learned_addr learned my addr 172.21.15.133:0/745021636 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:55.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.643+0000 7f5691622700 1 --2- 172.21.15.133:0/745021636 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f568c0b3830 0x7f568c14e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:55.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.643+0000 7f568b7fe700 1 -- 172.21.15.133:0/745021636 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935721215 0 0) 0x7f568c142fd0 con 0x7f568c0b20c0 2021-01-03T13:03:55.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.643+0000 7f568b7fe700 1 -- 172.21.15.133:0/745021636 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5678003230 con 0x7f568c0b20c0 2021-01-03T13:03:55.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.643+0000 7f568b7fe700 1 -- 172.21.15.133:0/745021636 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063180090 0 0) 0x7f568c142d30 con 0x7f568c0b2f00 2021-01-03T13:03:55.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.643+0000 7f568b7fe700 1 -- 172.21.15.133:0/745021636 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f568c142fd0 con 0x7f568c0b2f00 2021-01-03T13:03:55.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.643+0000 7f5691622700 1 -- 172.21.15.133:0/745021636 >> v1:172.21.15.133:6789/0 conn(0x7f568c0b20c0 legacy=0x7f568c140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:55.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.643+0000 7f5691622700 1 -- 172.21.15.133:0/745021636 >> v1:172.21.15.16:6789/0 conn(0x7f568c0b2f00 legacy=0x7f568c05f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:55.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.643+0000 7f5691622700 1 -- 172.21.15.133:0/745021636 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c143510 con 0x7f568c0b3830 2021-01-03T13:03:55.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.647+0000 7f5691622700 1 --2- 172.21.15.133:0/745021636 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f568c0b3830 0x7f568c14e5d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f5684002f30 tx=0x7f5684006dc0).ready entity=mon.2 client_cookie=11e799853081c376 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:55.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.647+0000 7f568b7fe700 1 -- 172.21.15.133:0/745021636 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5684009730 con 0x7f568c0b3830 2021-01-03T13:03:55.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.647+0000 7f568b7fe700 1 -- 172.21.15.133:0/745021636 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5684009890 con 0x7f568c0b3830 2021-01-03T13:03:55.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.647+0000 7f568b7fe700 1 -- 172.21.15.133:0/745021636 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5684009bf0 con 0x7f568c0b3830 2021-01-03T13:03:55.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.647+0000 7f5691e23700 1 -- 172.21.15.133:0/745021636 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f568c0b3830 msgr2=0x7f568c14e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:55.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.647+0000 7f5691e23700 1 --2- 172.21.15.133:0/745021636 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f568c0b3830 0x7f568c14e5d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f5684002f30 tx=0x7f5684006dc0).stop 2021-01-03T13:03:55.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.647+0000 7f5691e23700 1 -- 172.21.15.133:0/745021636 shutdown_connections 2021-01-03T13:03:55.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.647+0000 7f5691e23700 1 --2- 172.21.15.133:0/745021636 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f568c0b3830 0x7f568c14e5d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:55.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.647+0000 7f5691e23700 1 -- 172.21.15.133:0/745021636 >> 172.21.15.133:0/745021636 conn(0x7f568c0b7200 msgr2=0x7f568c0b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:55.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.647+0000 7f5691e23700 1 -- 172.21.15.133:0/745021636 shutdown_connections 2021-01-03T13:03:55.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.647+0000 7f5691e23700 1 -- 172.21.15.133:0/745021636 wait complete. 2021-01-03T13:03:55.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f5691e23700 1 Processor -- start 2021-01-03T13:03:55.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f5691e23700 1 -- start start 2021-01-03T13:03:55.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f5691e23700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f568c0b20c0 0x7f568c147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:55.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f5691e23700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c0b2f00 0x7f568c0603c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:55.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f5691e23700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f568c0b3830 0x7f568c13d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:55.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f5691e23700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c147b50 con 0x7f568c0b20c0 2021-01-03T13:03:55.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f5691e23700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c147df0 con 0x7f568c0b2f00 2021-01-03T13:03:55.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f5691e23700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568c067430 con 0x7f568c0b3830 2021-01-03T13:03:55.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f568bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c0b2f00 0x7f568c0603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:55.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f568bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c0b2f00 0x7f568c0603c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35620/0 (socket says 172.21.15.133:35620) 2021-01-03T13:03:55.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f568bfff700 1 -- 172.21.15.133:0/1623492374 learned_addr learned my addr 172.21.15.133:0/1623492374 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:55.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f5691622700 1 --2- 172.21.15.133:0/1623492374 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f568c0b3830 0x7f568c13d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:55.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f5690e21700 1 --2- 172.21.15.133:0/1623492374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f568c0b20c0 0x7f568c147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:55.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f568bfff700 1 -- 172.21.15.133:0/1623492374 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f568c0b3830 msgr2=0x7f568c13d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:55.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f568bfff700 1 --2- 172.21.15.133:0/1623492374 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f568c0b3830 0x7f568c13d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:55.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f568bfff700 1 -- 172.21.15.133:0/1623492374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f568c0b20c0 msgr2=0x7f568c147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:55.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f568bfff700 1 --2- 172.21.15.133:0/1623492374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f568c0b20c0 0x7f568c147590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:55.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f568bfff700 1 -- 172.21.15.133:0/1623492374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c0676d0 con 0x7f568c0b2f00 2021-01-03T13:03:55.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f568bfff700 1 --2- 172.21.15.133:0/1623492374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c0b2f00 0x7f568c0603c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f56800010d0 tx=0x7f5680007ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:55.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f5689ffb700 1 -- 172.21.15.133:0/1623492374 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56800072e0 con 0x7f568c0b2f00 2021-01-03T13:03:55.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f5689ffb700 1 -- 172.21.15.133:0/1623492374 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5680007440 con 0x7f568c0b2f00 2021-01-03T13:03:55.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f5691e23700 1 -- 172.21.15.133:0/1623492374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568c065c80 con 0x7f568c0b2f00 2021-01-03T13:03:55.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f5689ffb700 1 -- 172.21.15.133:0/1623492374 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56800057d0 con 0x7f568c0b2f00 2021-01-03T13:03:55.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.651+0000 7f5691e23700 1 -- 172.21.15.133:0/1623492374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568c0b1440 con 0x7f568c0b2f00 2021-01-03T13:03:55.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.655+0000 7f5691e23700 1 -- 172.21.15.133:0/1623492374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f568c067860 con 0x7f568c0b2f00 2021-01-03T13:03:55.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.655+0000 7f5689ffb700 1 -- 172.21.15.133:0/1623492374 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f568001a060 con 0x7f568c0b2f00 2021-01-03T13:03:55.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.655+0000 7f5689ffb700 1 --2- 172.21.15.133:0/1623492374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f566c055500 0x7f566c0579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:55.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.655+0000 7f5689ffb700 1 -- 172.21.15.133:0/1623492374 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f568006d340 con 0x7f568c0b2f00 2021-01-03T13:03:55.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.655+0000 7f5690e21700 1 --2- 172.21.15.133:0/1623492374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f566c055500 0x7f566c0579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:55.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.655+0000 7f5690e21700 1 --2- 172.21.15.133:0/1623492374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f566c055500 0x7f566c0579c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f567c00d000 tx=0x7f567c007d70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:55.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.663+0000 7f5689ffb700 1 -- 172.21.15.133:0/1623492374 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5680043910 con 0x7f568c0b2f00 2021-01-03T13:03:55.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.851+0000 7f5691e23700 1 -- 172.21.15.133:0/1623492374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f568c057300 con 0x7f568c0b2f00 2021-01-03T13:03:55.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.851+0000 7f5689ffb700 1 -- 172.21.15.133:0/1623492374 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f5680018020 con 0x7f568c0b2f00 2021-01-03T13:03:55.852 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:55.852 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:03:55.852 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2021-01-03T13:03:55.853 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:55.853 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2021-01-03T13:03:55.853 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Fflox9BxAA6coLDFV/FaQ/G/cvtonWgg==", 2021-01-03T13:03:55.853 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:55.854 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:03:55.854 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:55.854 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:55.854 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:55.855 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:55.855 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:55.855 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:55.855 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2021-01-03T13:03:55.856 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfrnWWFRAA3PHH/FJOvDozCChrb1T8Dg==", 2021-01-03T13:03:55.856 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:55.856 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:03:55.856 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:55.856 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:55.857 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:55.857 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:55.857 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:55.857 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:55.857 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2021-01-03T13:03:55.858 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfpPPLDxAAVvg80vLejYKDH485/L1gSQ==", 2021-01-03T13:03:55.858 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:55.858 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:03:55.859 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:55.859 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:55.859 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:55.859 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:55.860 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:55.860 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:55.860 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2021-01-03T13:03:55.860 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAnv/FfQ+CcDRAAUkTDLby5scMkNzxa0lVdAQ==", 2021-01-03T13:03:55.861 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:55.861 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:55.861 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:55.861 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:55.862 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:55.865 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:55.865 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:55.866 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2021-01-03T13:03:55.866 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApv/Ff1iilLhAAbK9hZmL772nNKAEJ4i+pkw==", 2021-01-03T13:03:55.866 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:55.866 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:55.867 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:55.867 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:55.867 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:55.867 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:55.868 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:55.868 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2021-01-03T13:03:55.868 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAsv/Ffmoe2FhAA1EbxU5yHncN+pbC/EX6d9A==", 2021-01-03T13:03:55.868 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:55.869 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:55.869 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:55.869 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:55.869 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:55.869 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:55.870 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:55.870 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2021-01-03T13:03:55.870 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAuv/FfJh/VORAAG9aCOh5s/2Lw+yN9hBFWLw==", 2021-01-03T13:03:55.870 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:55.871 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:55.871 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:55.871 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:55.871 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:55.871 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:55.872 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:55.872 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2021-01-03T13:03:55.872 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyv/Ffus0NJhAALX1TIqQ9EIupaX8KtRu7rQ==", 2021-01-03T13:03:55.872 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:55.873 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:55.873 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:55.873 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:55.873 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:55.874 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:55.874 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:55.874 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2021-01-03T13:03:55.874 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1v/FfoL6kDBAAggoRy/o0qas/41yLYqDVgA==", 2021-01-03T13:03:55.875 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:55.875 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:55.875 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:55.876 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:55.876 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:55.876 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:55.877 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:55.877 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2021-01-03T13:03:55.877 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA3v/FfwOPCMBAAGOt8ShPQ/szNbCfaP/uZEQ==", 2021-01-03T13:03:55.878 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:55.878 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:55.878 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:55.878 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:55.879 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:55.879 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:55.879 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:55.879 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2021-01-03T13:03:55.880 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA6v/Ffoz5xFxAAn3xvUDSeNSWrBJTa1Nsb6w==", 2021-01-03T13:03:55.880 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:55.880 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:55.881 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:55.881 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:55.881 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:55.881 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:55.882 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:55.882 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2021-01-03T13:03:55.882 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfyGlbGxAALm0NezvPiTAnlwu8iPEuCw==", 2021-01-03T13:03:55.883 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:55.883 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:03:55.883 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:03:55.884 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:03:55.884 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:55.884 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:55.884 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:55.885 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2021-01-03T13:03:55.885 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Ffa2AFHhAAD4Pq5zMJ28SqqEosBA9vnQ==", 2021-01-03T13:03:55.885 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:55.886 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:03:55.886 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:03:55.886 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:03:55.887 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:55.887 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:55.887 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:55.887 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2021-01-03T13:03:55.888 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjv/FfjxN8JxAAkV2Ia66fh21QYMX5fr1gTw==", 2021-01-03T13:03:55.888 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:55.888 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:03:55.888 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:03:55.889 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:03:55.889 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:55.889 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:55.889 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:55.890 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:55.890 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2021-01-03T13:03:55.890 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAU/DBBAASi+hx05pZEsP+dV9iwbz4g==", 2021-01-03T13:03:55.891 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:55.891 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:03:55.891 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:03:55.892 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:55.892 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:55.892 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:55.893 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:55.893 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2021-01-03T13:03:55.893 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAOFAAhAAPQOSkofyJoEYvcAqKK2+Mg==", 2021-01-03T13:03:55.893 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:03:55.894 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:03:55.894 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:03:55.894 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:03:55.894 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:55.895 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:55.895 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:03:55.895 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:03:55.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.855+0000 7f5691e23700 1 -- 172.21.15.133:0/1623492374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f566c055500 msgr2=0x7f566c0579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:55.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.855+0000 7f5691e23700 1 --2- 172.21.15.133:0/1623492374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f566c055500 0x7f566c0579c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f567c00d000 tx=0x7f567c007d70).stop 2021-01-03T13:03:55.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.855+0000 7f5691e23700 1 -- 172.21.15.133:0/1623492374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c0b2f00 msgr2=0x7f568c0603c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:55.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.855+0000 7f5691e23700 1 --2- 172.21.15.133:0/1623492374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c0b2f00 0x7f568c0603c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f56800010d0 tx=0x7f5680007ac0).stop 2021-01-03T13:03:55.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.855+0000 7f5691e23700 1 -- 172.21.15.133:0/1623492374 shutdown_connections 2021-01-03T13:03:55.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.855+0000 7f5691e23700 1 --2- 172.21.15.133:0/1623492374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f566c055500 0x7f566c0579c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:55.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.855+0000 7f5691e23700 1 --2- 172.21.15.133:0/1623492374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f568c0b20c0 0x7f568c147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.855+0000 7f5691e23700 1 --2- 172.21.15.133:0/1623492374 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f568c0b3830 0x7f568c13d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.855+0000 7f5691e23700 1 --2- 172.21.15.133:0/1623492374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c0b2f00 0x7f568c0603c0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.855+0000 7f5691e23700 1 -- 172.21.15.133:0/1623492374 >> 172.21.15.133:0/1623492374 conn(0x7f568c0b7200 msgr2=0x7f568c13eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.855+0000 7f5691e23700 1 -- 172.21.15.133:0/1623492374 shutdown_connections 2021-01-03T13:03:55.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:55.855+0000 7f5691e23700 1 -- 172.21.15.133:0/1623492374 wait complete. 2021-01-03T13:03:55.900 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:03:56.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.011+0000 7f70ab564700 1 Processor -- start 2021-01-03T13:03:56.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.011+0000 7f70ab564700 1 -- start start 2021-01-03T13:03:56.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.011+0000 7f70ab564700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70a40b9f40 0x7f70a4146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.011+0000 7f70ab564700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f70a4146920 0x7f70a414d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.011+0000 7f70ab564700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a40605f0 con 0x7f70a40b9b60 2021-01-03T13:03:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.011+0000 7f70ab564700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a40aed30 con 0x7f70a4146920 2021-01-03T13:03:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.011+0000 7f70ab564700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a40600b0 con 0x7f70a40b9f40 2021-01-03T13:03:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.011+0000 7f70a9d61700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70a40b9f40 0x7f70a4146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.011+0000 7f70a9d61700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70a40b9f40 0x7f70a4146430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:43930/0 (socket says 172.21.15.133:43930) 2021-01-03T13:03:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.011+0000 7f70aad63700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f70a4146920 0x7f70a414d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.011+0000 7f70a9d61700 1 -- 172.21.15.133:0/643734245 learned_addr learned my addr 172.21.15.133:0/643734245 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:56.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70a9d61700 1 -- 172.21.15.133:0/643734245 >> v2:172.21.15.16:3300/0 conn(0x7f70a4146920 msgr2=0x7f70a414d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:56.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70a9d61700 1 --2- 172.21.15.133:0/643734245 >> v2:172.21.15.16:3300/0 conn(0x7f70a4146920 0x7f70a414d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70a9d61700 1 -- 172.21.15.133:0/643734245 >> v1:172.21.15.16:6789/0 conn(0x7f70a40b9b60 legacy=0x7f70a40b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70a9d61700 1 -- 172.21.15.133:0/643734245 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a4060350 con 0x7f70a40b9f40 2021-01-03T13:03:56.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70a9d61700 1 --2- 172.21.15.133:0/643734245 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70a40b9f40 0x7f70a4146430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f70a00032b0 tx=0x7f70a0009270).ready entity=mon.2 client_cookie=5be72241d75b1f3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:56.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70a9560700 1 -- 172.21.15.133:0/643734245 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70a0009e60 con 0x7f70a40b9f40 2021-01-03T13:03:56.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70a9560700 1 -- 172.21.15.133:0/643734245 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a000bc00 con 0x7f70a40b9f40 2021-01-03T13:03:56.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70a9560700 1 -- 172.21.15.133:0/643734245 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70a000bd70 con 0x7f70a40b9f40 2021-01-03T13:03:56.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70ab564700 1 -- 172.21.15.133:0/643734245 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70a40b9f40 msgr2=0x7f70a4146430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70ab564700 1 --2- 172.21.15.133:0/643734245 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70a40b9f40 0x7f70a4146430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f70a00032b0 tx=0x7f70a0009270).stop 2021-01-03T13:03:56.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70ab564700 1 -- 172.21.15.133:0/643734245 shutdown_connections 2021-01-03T13:03:56.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70ab564700 1 --2- 172.21.15.133:0/643734245 >> v2:172.21.15.16:3300/0 conn(0x7f70a4146920 0x7f70a414d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70ab564700 1 --2- 172.21.15.133:0/643734245 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70a40b9f40 0x7f70a4146430 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70ab564700 1 -- 172.21.15.133:0/643734245 >> 172.21.15.133:0/643734245 conn(0x7f70a40b69e0 msgr2=0x7f70a40b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:56.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70ab564700 1 -- 172.21.15.133:0/643734245 shutdown_connections 2021-01-03T13:03:56.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70ab564700 1 -- 172.21.15.133:0/643734245 wait complete. 2021-01-03T13:03:56.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70ab564700 1 Processor -- start 2021-01-03T13:03:56.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.015+0000 7f70ab564700 1 -- start start 2021-01-03T13:03:56.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70ab564700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70a40b9b60 0x7f70a4141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70ab564700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70a40b9f40 0x7f70a4151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70ab564700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70a4146920 0x7f70a40b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70ab564700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a4141100 con 0x7f70a40b9b60 2021-01-03T13:03:56.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70ab564700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a40b3480 con 0x7f70a4146920 2021-01-03T13:03:56.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70ab564700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a40b1ff0 con 0x7f70a40b9f40 2021-01-03T13:03:56.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70aad63700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70a4146920 0x7f70a40b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70aad63700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70a4146920 0x7f70a40b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35636/0 (socket says 172.21.15.133:35636) 2021-01-03T13:03:56.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70a9d61700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70a40b9f40 0x7f70a4151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70aa562700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70a40b9b60 0x7f70a4141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70aad63700 1 -- 172.21.15.133:0/1719605180 learned_addr learned my addr 172.21.15.133:0/1719605180 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:56.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70aad63700 1 -- 172.21.15.133:0/1719605180 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70a40b9f40 msgr2=0x7f70a4151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70aad63700 1 --2- 172.21.15.133:0/1719605180 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70a40b9f40 0x7f70a4151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70aad63700 1 -- 172.21.15.133:0/1719605180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70a40b9b60 msgr2=0x7f70a4141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70aad63700 1 --2- 172.21.15.133:0/1719605180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70a40b9b60 0x7f70a4141ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70aad63700 1 -- 172.21.15.133:0/1719605180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a40b3220 con 0x7f70a4146920 2021-01-03T13:03:56.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70aad63700 1 --2- 172.21.15.133:0/1719605180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70a4146920 0x7f70a40b24b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f709c006a50 tx=0x7f709c006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:56.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70937fe700 1 -- 172.21.15.133:0/1719605180 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f709c00c7e0 con 0x7f70a4146920 2021-01-03T13:03:56.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70937fe700 1 -- 172.21.15.133:0/1719605180 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c00c940 con 0x7f70a4146920 2021-01-03T13:03:56.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70937fe700 1 -- 172.21.15.133:0/1719605180 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f709c00cca0 con 0x7f70a4146920 2021-01-03T13:03:56.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70ab564700 1 -- 172.21.15.133:0/1719605180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a4141a20 con 0x7f70a4146920 2021-01-03T13:03:56.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70ab564700 1 -- 172.21.15.133:0/1719605180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a41423b0 con 0x7f70a4146920 2021-01-03T13:03:56.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70ab564700 1 -- 172.21.15.133:0/1719605180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a4057300 con 0x7f70a4146920 2021-01-03T13:03:56.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.019+0000 7f70937fe700 1 -- 172.21.15.133:0/1719605180 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f709c01c460 con 0x7f70a4146920 2021-01-03T13:03:56.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.023+0000 7f70937fe700 1 --2- 172.21.15.133:0/1719605180 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7084055330 0x7f70840577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.023+0000 7f70937fe700 1 -- 172.21.15.133:0/1719605180 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f709c06dfe0 con 0x7f70a4146920 2021-01-03T13:03:56.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.023+0000 7f70aa562700 1 --2- 172.21.15.133:0/1719605180 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7084055330 0x7f70840577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.023+0000 7f70aa562700 1 --2- 172.21.15.133:0/1719605180 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7084055330 0x7f70840577f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f709400d000 tx=0x7f7094000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:56.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.031+0000 7f70937fe700 1 -- 172.21.15.133:0/1719605180 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f709c0444e0 con 0x7f70a4146920 2021-01-03T13:03:56.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.175+0000 7f70ab564700 1 -- 172.21.15.133:0/1719605180 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70a4141bb0 con 0x7f70a4146920 2021-01-03T13:03:56.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.175+0000 7f70937fe700 1 -- 172.21.15.133:0/1719605180 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+13230 (secure 0 0 0) 0x7f709c047b00 con 0x7f70a4146920 2021-01-03T13:03:56.174 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:56.174 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":73,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:03:55.505205+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:03:56.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.175+0000 7f70ab564700 1 -- 172.21.15.133:0/1719605180 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7084055330 msgr2=0x7f70840577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.175+0000 7f70ab564700 1 --2- 172.21.15.133:0/1719605180 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7084055330 0x7f70840577f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f709400d000 tx=0x7f7094000b80).stop 2021-01-03T13:03:56.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.175+0000 7f70ab564700 1 -- 172.21.15.133:0/1719605180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70a4146920 msgr2=0x7f70a40b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.175+0000 7f70ab564700 1 --2- 172.21.15.133:0/1719605180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70a4146920 0x7f70a40b24b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f709c006a50 tx=0x7f709c006dc0).stop 2021-01-03T13:03:56.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.175+0000 7f70ab564700 1 -- 172.21.15.133:0/1719605180 shutdown_connections 2021-01-03T13:03:56.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.175+0000 7f70ab564700 1 --2- 172.21.15.133:0/1719605180 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7084055330 0x7f70840577f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.175+0000 7f70ab564700 1 --2- 172.21.15.133:0/1719605180 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70a40b9b60 0x7f70a4141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.175+0000 7f70ab564700 1 --2- 172.21.15.133:0/1719605180 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70a4146920 0x7f70a40b24b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.175+0000 7f70ab564700 1 --2- 172.21.15.133:0/1719605180 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70a40b9f40 0x7f70a4151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.175+0000 7f70ab564700 1 -- 172.21.15.133:0/1719605180 >> 172.21.15.133:0/1719605180 conn(0x7f70a40b69e0 msgr2=0x7f70a40b8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:56.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.175+0000 7f70ab564700 1 -- 172.21.15.133:0/1719605180 shutdown_connections 2021-01-03T13:03:56.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.175+0000 7f70ab564700 1 -- 172.21.15.133:0/1719605180 wait complete. 2021-01-03T13:03:56.188 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-01-03T13:03:56.188 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:03:56.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.311+0000 7f0cb359e700 1 Processor -- start 2021-01-03T13:03:56.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.311+0000 7f0cb359e700 1 -- start start 2021-01-03T13:03:56.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.311+0000 7f0cb359e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0cb4060510 0x7f0cb405c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.311+0000 7f0cb359e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb40b6cf0 con 0x7f0cb40b4c20 2021-01-03T13:03:56.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.311+0000 7f0cb359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb405bf00 con 0x7f0cb405fd10 2021-01-03T13:03:56.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.311+0000 7f0cb359e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb405c1a0 con 0x7f0cb4060510 2021-01-03T13:03:56.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.311+0000 7f0cb2d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0cb405fd10 0x7f0cb40b65e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56676/0 (socket says 172.21.15.133:56676) 2021-01-03T13:03:56.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.311+0000 7f0cb2d9d700 1 -- 172.21.15.133:0/872152346 learned_addr learned my addr 172.21.15.133:0/872152346 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:56.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.311+0000 7f0cb1d9b700 1 --2- 172.21.15.133:0/872152346 >> v2:172.21.15.16:3300/0 conn(0x7f0cb4060510 0x7f0cb405c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.311+0000 7f0cb159a700 1 -- 172.21.15.133:0/872152346 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251982811 0 0) 0x7f0cb405bf00 con 0x7f0cb405fd10 2021-01-03T13:03:56.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.311+0000 7f0cb159a700 1 -- 172.21.15.133:0/872152346 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c98003230 con 0x7f0cb405fd10 2021-01-03T13:03:56.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.311+0000 7f0cb1d9b700 1 -- 172.21.15.133:0/872152346 >> v1:172.21.15.133:6789/0 conn(0x7f0cb405fd10 legacy=0x7f0cb40b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.311+0000 7f0cb1d9b700 1 -- 172.21.15.133:0/872152346 >> v1:172.21.15.16:6789/0 conn(0x7f0cb40b4c20 legacy=0x7f0cb40b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.311+0000 7f0cb1d9b700 1 -- 172.21.15.133:0/872152346 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb405c440 con 0x7f0cb4060510 2021-01-03T13:03:56.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.311+0000 7f0cb1d9b700 1 --2- 172.21.15.133:0/872152346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb4060510 0x7f0cb405c8e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f0ca8002f30 tx=0x7f0ca8006dc0).ready entity=mon.0 client_cookie=b06848e05b72b489 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.315+0000 7f0cb159a700 1 -- 172.21.15.133:0/872152346 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ca8009800 con 0x7f0cb4060510 2021-01-03T13:03:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.315+0000 7f0cb159a700 1 -- 172.21.15.133:0/872152346 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca8009960 con 0x7f0cb4060510 2021-01-03T13:03:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.315+0000 7f0cb159a700 1 -- 172.21.15.133:0/872152346 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ca8009cc0 con 0x7f0cb4060510 2021-01-03T13:03:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.315+0000 7f0cb359e700 1 -- 172.21.15.133:0/872152346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb4060510 msgr2=0x7f0cb405c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.315+0000 7f0cb359e700 1 --2- 172.21.15.133:0/872152346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb4060510 0x7f0cb405c8e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f0ca8002f30 tx=0x7f0ca8006dc0).stop 2021-01-03T13:03:56.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.315+0000 7f0cb359e700 1 -- 172.21.15.133:0/872152346 shutdown_connections 2021-01-03T13:03:56.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.315+0000 7f0cb359e700 1 --2- 172.21.15.133:0/872152346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb4060510 0x7f0cb405c8e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.315+0000 7f0cb359e700 1 -- 172.21.15.133:0/872152346 >> 172.21.15.133:0/872152346 conn(0x7f0cb40b9f00 msgr2=0x7f0cb40b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:56.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.315+0000 7f0cb359e700 1 -- 172.21.15.133:0/872152346 shutdown_connections 2021-01-03T13:03:56.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.315+0000 7f0cb359e700 1 -- 172.21.15.133:0/872152346 wait complete. 2021-01-03T13:03:56.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.315+0000 7f0cb359e700 1 Processor -- start 2021-01-03T13:03:56.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.315+0000 7f0cb359e700 1 -- start start 2021-01-03T13:03:56.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cb405fd10 0x7f0cb409e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb4060510 0x7f0cb40b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb40b4c20 0x7f0cb413a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb359e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40b23c0 con 0x7f0cb40b4c20 2021-01-03T13:03:56.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40b3700 con 0x7f0cb4060510 2021-01-03T13:03:56.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40b39a0 con 0x7f0cb405fd10 2021-01-03T13:03:56.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb4060510 0x7f0cb40b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb4060510 0x7f0cb40b1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35650/0 (socket says 172.21.15.133:35650) 2021-01-03T13:03:56.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb1d9b700 1 -- 172.21.15.133:0/3536645257 learned_addr learned my addr 172.21.15.133:0/3536645257 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:56.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb2d9d700 1 --2- 172.21.15.133:0/3536645257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb40b4c20 0x7f0cb413a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb259c700 1 --2- 172.21.15.133:0/3536645257 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cb405fd10 0x7f0cb409e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb1d9b700 1 -- 172.21.15.133:0/3536645257 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cb405fd10 msgr2=0x7f0cb409e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb1d9b700 1 --2- 172.21.15.133:0/3536645257 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cb405fd10 0x7f0cb409e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb1d9b700 1 -- 172.21.15.133:0/3536645257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb40b4c20 msgr2=0x7f0cb413a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb1d9b700 1 --2- 172.21.15.133:0/3536645257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb40b4c20 0x7f0cb413a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb1d9b700 1 -- 172.21.15.133:0/3536645257 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb40b29f0 con 0x7f0cb4060510 2021-01-03T13:03:56.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb2d9d700 1 --2- 172.21.15.133:0/3536645257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb40b4c20 0x7f0cb413a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:56.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb259c700 1 --2- 172.21.15.133:0/3536645257 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cb405fd10 0x7f0cb409e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:56.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb1d9b700 1 --2- 172.21.15.133:0/3536645257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb4060510 0x7f0cb40b1ed0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f0ca8002f30 tx=0x7f0ca8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:56.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0ca37fe700 1 -- 172.21.15.133:0/3536645257 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ca8011cc0 con 0x7f0cb4060510 2021-01-03T13:03:56.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb359e700 1 -- 172.21.15.133:0/3536645257 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb40b2c40 con 0x7f0cb4060510 2021-01-03T13:03:56.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0ca37fe700 1 -- 172.21.15.133:0/3536645257 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca8011e20 con 0x7f0cb4060510 2021-01-03T13:03:56.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0ca37fe700 1 -- 172.21.15.133:0/3536645257 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ca801d630 con 0x7f0cb4060510 2021-01-03T13:03:56.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb359e700 1 -- 172.21.15.133:0/3536645257 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb413ad00 con 0x7f0cb4060510 2021-01-03T13:03:56.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0cb359e700 1 -- 172.21.15.133:0/3536645257 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb40b07a0 con 0x7f0cb4060510 2021-01-03T13:03:56.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.319+0000 7f0ca37fe700 1 -- 172.21.15.133:0/3536645257 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0ca8017070 con 0x7f0cb4060510 2021-01-03T13:03:56.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.323+0000 7f0ca37fe700 1 --2- 172.21.15.133:0/3536645257 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0c90055440 0x7f0c90057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.323+0000 7f0ca37fe700 1 -- 172.21.15.133:0/3536645257 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0ca806e8f0 con 0x7f0cb4060510 2021-01-03T13:03:56.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.323+0000 7f0cb259c700 1 --2- 172.21.15.133:0/3536645257 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0c90055440 0x7f0c90057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.323+0000 7f0cb259c700 1 --2- 172.21.15.133:0/3536645257 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0c90055440 0x7f0c90057900 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f0ca400b000 tx=0x7f0ca4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:56.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.327+0000 7f0ca37fe700 1 -- 172.21.15.133:0/3536645257 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0ca8044e80 con 0x7f0cb4060510 2021-01-03T13:03:56.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.466+0000 7f0cb359e700 1 -- 172.21.15.133:0/3536645257 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0cb4057300 con 0x7f0cb4060510 2021-01-03T13:03:56.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.466+0000 7f0ca37fe700 1 -- 172.21.15.133:0/3536645257 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v73) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0ca8022020 con 0x7f0cb4060510 2021-01-03T13:03:56.466 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:03:56.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.470+0000 7f0cb359e700 1 -- 172.21.15.133:0/3536645257 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0c90055440 msgr2=0x7f0c90057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.470+0000 7f0cb359e700 1 --2- 172.21.15.133:0/3536645257 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0c90055440 0x7f0c90057900 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f0ca400b000 tx=0x7f0ca4009040).stop 2021-01-03T13:03:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.470+0000 7f0cb359e700 1 -- 172.21.15.133:0/3536645257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb4060510 msgr2=0x7f0cb40b1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.470+0000 7f0cb359e700 1 --2- 172.21.15.133:0/3536645257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb4060510 0x7f0cb40b1ed0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f0ca8002f30 tx=0x7f0ca8015000).stop 2021-01-03T13:03:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.470+0000 7f0cb359e700 1 -- 172.21.15.133:0/3536645257 shutdown_connections 2021-01-03T13:03:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.470+0000 7f0cb359e700 1 --2- 172.21.15.133:0/3536645257 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0c90055440 0x7f0c90057900 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.470+0000 7f0cb359e700 1 --2- 172.21.15.133:0/3536645257 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cb40b4c20 0x7f0cb413a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.470+0000 7f0cb359e700 1 --2- 172.21.15.133:0/3536645257 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cb405fd10 0x7f0cb409e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.470+0000 7f0cb359e700 1 --2- 172.21.15.133:0/3536645257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb4060510 0x7f0cb40b1ed0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.470+0000 7f0cb359e700 1 -- 172.21.15.133:0/3536645257 >> 172.21.15.133:0/3536645257 conn(0x7f0cb40b9f00 msgr2=0x7f0cb406a620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.470+0000 7f0cb359e700 1 -- 172.21.15.133:0/3536645257 shutdown_connections 2021-01-03T13:03:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.470+0000 7f0cb359e700 1 -- 172.21.15.133:0/3536645257 wait complete. 2021-01-03T13:03:56.487 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:03:56.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.598+0000 7f1ada910700 1 Processor -- start 2021-01-03T13:03:56.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.598+0000 7f1ada910700 1 -- start start 2021-01-03T13:03:56.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ada910700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ad40b5260 0x7f1ad41470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ada910700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1ad40b5c00 0x7f1ad41475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ada910700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad40b0c10 con 0x7f1ad41442a0 2021-01-03T13:03:56.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ada910700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad40b5640 con 0x7f1ad40b5c00 2021-01-03T13:03:56.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ada910700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad409a4f0 con 0x7f1ad40b5260 2021-01-03T13:03:56.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ad990e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ad40b5260 0x7f1ad41470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ad910d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1ad40b5c00 0x7f1ad41475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ada10f700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1ad41442a0 0x7f1ad4144750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:35416/0 (socket says 172.21.15.133:35416) 2021-01-03T13:03:56.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ada10f700 1 -- 172.21.15.133:0/4265018455 learned_addr learned my addr 172.21.15.133:0/4265018455 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:56.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ad890c700 1 -- 172.21.15.133:0/4265018455 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731128557 0 0) 0x7f1ad40b0c10 con 0x7f1ad41442a0 2021-01-03T13:03:56.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ad890c700 1 -- 172.21.15.133:0/4265018455 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1abc003230 con 0x7f1ad41442a0 2021-01-03T13:03:56.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ad990e700 1 -- 172.21.15.133:0/4265018455 >> v2:172.21.15.16:3300/0 conn(0x7f1ad40b5c00 msgr2=0x7f1ad41475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:56.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ad990e700 1 --2- 172.21.15.133:0/4265018455 >> v2:172.21.15.16:3300/0 conn(0x7f1ad40b5c00 0x7f1ad41475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ad990e700 1 -- 172.21.15.133:0/4265018455 >> v1:172.21.15.16:6789/0 conn(0x7f1ad41442a0 legacy=0x7f1ad4144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ad990e700 1 -- 172.21.15.133:0/4265018455 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad40b0e40 con 0x7f1ad40b5260 2021-01-03T13:03:56.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ad990e700 1 --2- 172.21.15.133:0/4265018455 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ad40b5260 0x7f1ad41470b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f1ad0002f30 tx=0x7f1ad0006dc0).ready entity=mon.2 client_cookie=657c18cb5690bc05 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:56.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ad890c700 1 -- 172.21.15.133:0/4265018455 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ad00096a0 con 0x7f1ad40b5260 2021-01-03T13:03:56.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ad890c700 1 -- 172.21.15.133:0/4265018455 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad0009800 con 0x7f1ad40b5260 2021-01-03T13:03:56.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ad890c700 1 -- 172.21.15.133:0/4265018455 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ad0009b60 con 0x7f1ad40b5260 2021-01-03T13:03:56.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ada910700 1 -- 172.21.15.133:0/4265018455 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ad40b5260 msgr2=0x7f1ad41470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ada910700 1 --2- 172.21.15.133:0/4265018455 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ad40b5260 0x7f1ad41470b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f1ad0002f30 tx=0x7f1ad0006dc0).stop 2021-01-03T13:03:56.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ada910700 1 -- 172.21.15.133:0/4265018455 shutdown_connections 2021-01-03T13:03:56.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ada910700 1 --2- 172.21.15.133:0/4265018455 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ad40b5260 0x7f1ad41470b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ada910700 1 --2- 172.21.15.133:0/4265018455 >> v2:172.21.15.16:3300/0 conn(0x7f1ad40b5c00 0x7f1ad41475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ada910700 1 -- 172.21.15.133:0/4265018455 >> 172.21.15.133:0/4265018455 conn(0x7f1ad405bdf0 msgr2=0x7f1ad405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:56.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ada910700 1 -- 172.21.15.133:0/4265018455 shutdown_connections 2021-01-03T13:03:56.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.602+0000 7f1ada910700 1 -- 172.21.15.133:0/4265018455 wait complete. 2021-01-03T13:03:56.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.606+0000 7f1ada910700 1 Processor -- start 2021-01-03T13:03:56.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.606+0000 7f1ada910700 1 -- start start 2021-01-03T13:03:56.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.606+0000 7f1ada910700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ad40b5260 0x7f1ad40668c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.606+0000 7f1ada910700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad40b5c00 0x7f1ad4067210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.606+0000 7f1ada910700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ad41442a0 0x7f1ad41453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.606+0000 7f1ada910700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad4156bf0 con 0x7f1ad40b5260 2021-01-03T13:03:56.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.606+0000 7f1ada910700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad4155f70 con 0x7f1ad40b5c00 2021-01-03T13:03:56.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.606+0000 7f1ada910700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad4156210 con 0x7f1ad41442a0 2021-01-03T13:03:56.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.606+0000 7f1ad910d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad40b5c00 0x7f1ad4067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ad910d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad40b5c00 0x7f1ad4067210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35662/0 (socket says 172.21.15.133:35662) 2021-01-03T13:03:56.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ad910d700 1 -- 172.21.15.133:0/1650024804 learned_addr learned my addr 172.21.15.133:0/1650024804 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:56.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ad990e700 1 --2- 172.21.15.133:0/1650024804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ad40b5260 0x7f1ad40668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ada10f700 1 --2- 172.21.15.133:0/1650024804 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ad41442a0 0x7f1ad41453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ad910d700 1 -- 172.21.15.133:0/1650024804 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ad41442a0 msgr2=0x7f1ad41453f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ad910d700 1 --2- 172.21.15.133:0/1650024804 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ad41442a0 0x7f1ad41453f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ad910d700 1 -- 172.21.15.133:0/1650024804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ad40b5260 msgr2=0x7f1ad40668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ad910d700 1 --2- 172.21.15.133:0/1650024804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ad40b5260 0x7f1ad40668c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ad910d700 1 -- 172.21.15.133:0/1650024804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad41564b0 con 0x7f1ad40b5c00 2021-01-03T13:03:56.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ada10f700 1 --2- 172.21.15.133:0/1650024804 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ad41442a0 0x7f1ad41453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:56.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ad990e700 1 --2- 172.21.15.133:0/1650024804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ad40b5260 0x7f1ad40668c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:56.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ad910d700 1 --2- 172.21.15.133:0/1650024804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad40b5c00 0x7f1ad4067210 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f1ad4156d30 tx=0x7f1ac4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:56.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ac2ffd700 1 -- 172.21.15.133:0/1650024804 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac400c8f0 con 0x7f1ad40b5c00 2021-01-03T13:03:56.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ac2ffd700 1 -- 172.21.15.133:0/1650024804 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac400ca50 con 0x7f1ad40b5c00 2021-01-03T13:03:56.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ada910700 1 -- 172.21.15.133:0/1650024804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad4156750 con 0x7f1ad40b5c00 2021-01-03T13:03:56.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ac2ffd700 1 -- 172.21.15.133:0/1650024804 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac400cdb0 con 0x7f1ad40b5c00 2021-01-03T13:03:56.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ada910700 1 -- 172.21.15.133:0/1650024804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad4155bf0 con 0x7f1ad40b5c00 2021-01-03T13:03:56.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ac2ffd700 1 -- 172.21.15.133:0/1650024804 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1ac4022070 con 0x7f1ad40b5c00 2021-01-03T13:03:56.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ada910700 1 -- 172.21.15.133:0/1650024804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad41568e0 con 0x7f1ad40b5c00 2021-01-03T13:03:56.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ac2ffd700 1 --2- 172.21.15.133:0/1650024804 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1ab4055470 0x7f1ab4057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ac2ffd700 1 -- 172.21.15.133:0/1650024804 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1ac406e1c0 con 0x7f1ad40b5c00 2021-01-03T13:03:56.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.610+0000 7f1ad990e700 1 --2- 172.21.15.133:0/1650024804 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1ab4055470 0x7f1ab4057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.614+0000 7f1ad990e700 1 --2- 172.21.15.133:0/1650024804 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1ab4055470 0x7f1ab4057930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f1ad0019000 tx=0x7f1ad0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:56.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.618+0000 7f1ac2ffd700 1 -- 172.21.15.133:0/1650024804 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1ac4044660 con 0x7f1ad40b5c00 2021-01-03T13:03:56.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.758+0000 7f1ada910700 1 -- 172.21.15.133:0/1650024804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1ad4057300 con 0x7f1ad40b5c00 2021-01-03T13:03:56.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.758+0000 7f1ac2ffd700 1 -- 172.21.15.133:0/1650024804 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v73) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1ac4047c80 con 0x7f1ad40b5c00 2021-01-03T13:03:56.761 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:03:56.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.762+0000 7f1ada910700 1 -- 172.21.15.133:0/1650024804 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1ab4055470 msgr2=0x7f1ab4057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.762+0000 7f1ada910700 1 --2- 172.21.15.133:0/1650024804 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1ab4055470 0x7f1ab4057930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f1ad0019000 tx=0x7f1ad0015000).stop 2021-01-03T13:03:56.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.762+0000 7f1ada910700 1 -- 172.21.15.133:0/1650024804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad40b5c00 msgr2=0x7f1ad4067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.762+0000 7f1ada910700 1 --2- 172.21.15.133:0/1650024804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad40b5c00 0x7f1ad4067210 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f1ad4156d30 tx=0x7f1ac4008040).stop 2021-01-03T13:03:56.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.762+0000 7f1ada910700 1 -- 172.21.15.133:0/1650024804 shutdown_connections 2021-01-03T13:03:56.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.762+0000 7f1ada910700 1 --2- 172.21.15.133:0/1650024804 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1ab4055470 0x7f1ab4057930 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.762+0000 7f1ada910700 1 --2- 172.21.15.133:0/1650024804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ad40b5260 0x7f1ad40668c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.762+0000 7f1ada910700 1 --2- 172.21.15.133:0/1650024804 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ad41442a0 0x7f1ad41453f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.762+0000 7f1ada910700 1 --2- 172.21.15.133:0/1650024804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ad40b5c00 0x7f1ad4067210 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.762+0000 7f1ada910700 1 -- 172.21.15.133:0/1650024804 >> 172.21.15.133:0/1650024804 conn(0x7f1ad405bdf0 msgr2=0x7f1ad40b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:56.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.762+0000 7f1ada910700 1 -- 172.21.15.133:0/1650024804 shutdown_connections 2021-01-03T13:03:56.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.762+0000 7f1ada910700 1 -- 172.21.15.133:0/1650024804 wait complete. 2021-01-03T13:03:56.774 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-01-03T13:03:56.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.886+0000 7f128b355700 1 Processor -- start 2021-01-03T13:03:56.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.886+0000 7f128b355700 1 -- start start 2021-01-03T13:03:56.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.886+0000 7f128b355700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f12840b02b0 0x7f12840668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.886+0000 7f128b355700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f12840622f0 0x7f1284066d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.886+0000 7f128b355700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128405c510 con 0x7f128405c130 2021-01-03T13:03:56.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.886+0000 7f128b355700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12841473d0 con 0x7f12840622f0 2021-01-03T13:03:56.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.886+0000 7f128b355700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12840b0ab0 con 0x7f12840b02b0 2021-01-03T13:03:56.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.886+0000 7f1289b52700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f12840b02b0 0x7f12840668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.886+0000 7f128a353700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f128405c130 0x7f12840b1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56702/0 (socket says 172.21.15.133:56702) 2021-01-03T13:03:56.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.886+0000 7f128a353700 1 -- 172.21.15.133:0/4042433265 learned_addr learned my addr 172.21.15.133:0/4042433265 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:56.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f128ab54700 1 --2- 172.21.15.133:0/4042433265 >> v2:172.21.15.16:3300/0 conn(0x7f12840622f0 0x7f1284066d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f1289351700 1 -- 172.21.15.133:0/4042433265 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658282474 0 0) 0x7f128405c510 con 0x7f128405c130 2021-01-03T13:03:56.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f1289351700 1 -- 172.21.15.133:0/4042433265 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f126c003230 con 0x7f128405c130 2021-01-03T13:03:56.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f1289b52700 1 -- 172.21.15.133:0/4042433265 >> v2:172.21.15.16:3300/0 conn(0x7f12840622f0 msgr2=0x7f1284066d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:56.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f1289b52700 1 --2- 172.21.15.133:0/4042433265 >> v2:172.21.15.16:3300/0 conn(0x7f12840622f0 0x7f1284066d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f1289b52700 1 -- 172.21.15.133:0/4042433265 >> v1:172.21.15.133:6789/0 conn(0x7f128405c130 legacy=0x7f12840b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f1289351700 1 -- 172.21.15.133:0/4042433265 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 907579181 0 0) 0x7f126c003230 con 0x7f128405c130 2021-01-03T13:03:56.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f1289b52700 1 -- 172.21.15.133:0/4042433265 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12840b15a0 con 0x7f12840b02b0 2021-01-03T13:03:56.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f1289b52700 1 --2- 172.21.15.133:0/4042433265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12840b02b0 0x7f12840668a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f1280001870 tx=0x7f1274006dc0).ready entity=mon.1 client_cookie=79bc37cf80f91598 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:56.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f1289351700 1 -- 172.21.15.133:0/4042433265 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12800016d0 con 0x7f12840b02b0 2021-01-03T13:03:56.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f1289351700 1 -- 172.21.15.133:0/4042433265 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127400d5c0 con 0x7f12840b02b0 2021-01-03T13:03:56.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f1289351700 1 -- 172.21.15.133:0/4042433265 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f127400d730 con 0x7f12840b02b0 2021-01-03T13:03:56.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f128b355700 1 -- 172.21.15.133:0/4042433265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12840b02b0 msgr2=0x7f12840668a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f128b355700 1 --2- 172.21.15.133:0/4042433265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12840b02b0 0x7f12840668a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f1280001870 tx=0x7f1274006dc0).stop 2021-01-03T13:03:56.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f128b355700 1 -- 172.21.15.133:0/4042433265 shutdown_connections 2021-01-03T13:03:56.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f128b355700 1 --2- 172.21.15.133:0/4042433265 >> v2:172.21.15.16:3300/0 conn(0x7f12840622f0 0x7f1284066d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f128b355700 1 --2- 172.21.15.133:0/4042433265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12840b02b0 0x7f12840668a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f128b355700 1 -- 172.21.15.133:0/4042433265 >> 172.21.15.133:0/4042433265 conn(0x7f12840b6110 msgr2=0x7f12840b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:56.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f128b355700 1 -- 172.21.15.133:0/4042433265 shutdown_connections 2021-01-03T13:03:56.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f128b355700 1 -- 172.21.15.133:0/4042433265 wait complete. 2021-01-03T13:03:56.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f128b355700 1 Processor -- start 2021-01-03T13:03:56.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.890+0000 7f128b355700 1 -- start start 2021-01-03T13:03:56.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128b355700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f128405c130 0x7f12840acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128b355700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12840622f0 0x7f12840646a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128b355700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12840b02b0 0x7f12841553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128b355700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1284064e20 con 0x7f12840622f0 2021-01-03T13:03:56.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128b355700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1284063990 con 0x7f128405c130 2021-01-03T13:03:56.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128b355700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1284064b90 con 0x7f12840b02b0 2021-01-03T13:03:56.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128a353700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f128405c130 0x7f12840acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128a353700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f128405c130 0x7f12840acbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35674/0 (socket says 172.21.15.133:35674) 2021-01-03T13:03:56.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128a353700 1 -- 172.21.15.133:0/2878887796 learned_addr learned my addr 172.21.15.133:0/2878887796 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:56.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f1289b52700 1 --2- 172.21.15.133:0/2878887796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12840622f0 0x7f12840646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128ab54700 1 --2- 172.21.15.133:0/2878887796 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12840b02b0 0x7f12841553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128a353700 1 -- 172.21.15.133:0/2878887796 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12840b02b0 msgr2=0x7f12841553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128a353700 1 --2- 172.21.15.133:0/2878887796 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12840b02b0 0x7f12841553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128a353700 1 -- 172.21.15.133:0/2878887796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12840622f0 msgr2=0x7f12840646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:56.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128a353700 1 --2- 172.21.15.133:0/2878887796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12840622f0 0x7f12840646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:56.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128a353700 1 -- 172.21.15.133:0/2878887796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1284065880 con 0x7f128405c130 2021-01-03T13:03:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128a353700 1 --2- 172.21.15.133:0/2878887796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f128405c130 0x7f12840acbb0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f12800018b0 tx=0x7f1280001770).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f12737fe700 1 -- 172.21.15.133:0/2878887796 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1280007170 con 0x7f128405c130 2021-01-03T13:03:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f12737fe700 1 -- 172.21.15.133:0/2878887796 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12800072d0 con 0x7f128405c130 2021-01-03T13:03:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128b355700 1 -- 172.21.15.133:0/2878887796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1284065b20 con 0x7f128405c130 2021-01-03T13:03:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f12737fe700 1 -- 172.21.15.133:0/2878887796 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12800048f0 con 0x7f128405c130 2021-01-03T13:03:56.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128b355700 1 -- 172.21.15.133:0/2878887796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12840642a0 con 0x7f128405c130 2021-01-03T13:03:56.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f128b355700 1 -- 172.21.15.133:0/2878887796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1284066180 con 0x7f128405c130 2021-01-03T13:03:56.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.894+0000 7f12737fe700 1 -- 172.21.15.133:0/2878887796 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f128001b070 con 0x7f128405c130 2021-01-03T13:03:56.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.898+0000 7f12737fe700 1 --2- 172.21.15.133:0/2878887796 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1264055440 0x7f1264057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:56.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.898+0000 7f12737fe700 1 -- 172.21.15.133:0/2878887796 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f128006d330 con 0x7f128405c130 2021-01-03T13:03:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.898+0000 7f1289b52700 1 --2- 172.21.15.133:0/2878887796 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1264055440 0x7f1264057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.898+0000 7f1289b52700 1 --2- 172.21.15.133:0/2878887796 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1264055440 0x7f1264057900 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f127401a000 tx=0x7f1274015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:56.902+0000 7f12737fe700 1 -- 172.21.15.133:0/2878887796 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f12800438c0 con 0x7f128405c130 2021-01-03T13:03:57.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.042+0000 7f128b355700 1 -- 172.21.15.133:0/2878887796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1284065fc0 con 0x7f128405c130 2021-01-03T13:03:57.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.042+0000 7f12737fe700 1 -- 172.21.15.133:0/2878887796 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) v1 ==== 84+0+143 (secure 0 0 0) 0x7f1284065fc0 con 0x7f128405c130 2021-01-03T13:03:57.044 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:03:57.044 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2021-01-03T13:03:57.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:57.045 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2021-01-03T13:03:57.045 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2021-01-03T13:03:57.045 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:03:57.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:03:57.045 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2021-01-03T13:03:57.046 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2021-01-03T13:03:57.046 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:03:57.046 INFO:teuthology.orchestra.run.smithi133.stdout:] 2021-01-03T13:03:57.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.046+0000 7f128b355700 1 -- 172.21.15.133:0/2878887796 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1264055440 msgr2=0x7f1264057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:57.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.046+0000 7f128b355700 1 --2- 172.21.15.133:0/2878887796 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1264055440 0x7f1264057900 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f127401a000 tx=0x7f1274015000).stop 2021-01-03T13:03:57.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.046+0000 7f128b355700 1 -- 172.21.15.133:0/2878887796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f128405c130 msgr2=0x7f12840acbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:57.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.046+0000 7f128b355700 1 --2- 172.21.15.133:0/2878887796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f128405c130 0x7f12840acbb0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f12800018b0 tx=0x7f1280001770).stop 2021-01-03T13:03:57.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.046+0000 7f128b355700 1 -- 172.21.15.133:0/2878887796 shutdown_connections 2021-01-03T13:03:57.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.046+0000 7f128b355700 1 --2- 172.21.15.133:0/2878887796 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1264055440 0x7f1264057900 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:57.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.046+0000 7f128b355700 1 --2- 172.21.15.133:0/2878887796 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12840b02b0 0x7f12841553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:57.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.046+0000 7f128b355700 1 --2- 172.21.15.133:0/2878887796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f128405c130 0x7f12840acbb0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:57.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.046+0000 7f128b355700 1 --2- 172.21.15.133:0/2878887796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12840622f0 0x7f12840646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:57.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.046+0000 7f128b355700 1 -- 172.21.15.133:0/2878887796 >> 172.21.15.133:0/2878887796 conn(0x7f12840b6110 msgr2=0x7f12840af510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:57.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.046+0000 7f128b355700 1 -- 172.21.15.133:0/2878887796 shutdown_connections 2021-01-03T13:03:57.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.046+0000 7f128b355700 1 -- 172.21.15.133:0/2878887796 wait complete. 2021-01-03T13:03:57.057 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-01-03T13:03:57.057 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-01-03T13:03:57.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.174+0000 7ff866586700 1 Processor -- start 2021-01-03T13:03:57.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.174+0000 7ff866586700 1 -- start start 2021-01-03T13:03:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.174+0000 7ff866586700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8600b3240 0x7ff8600b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.174+0000 7ff866586700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8600b3850 0x7ff8601444d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.174+0000 7ff866586700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff860140c00 con 0x7ff8600b3f50 2021-01-03T13:03:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.174+0000 7ff866586700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8600ade70 con 0x7ff8600b3240 2021-01-03T13:03:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.174+0000 7ff866586700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86009ab30 con 0x7ff8600b3850 2021-01-03T13:03:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff864b23700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8600b3850 0x7ff8601444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff85f7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff8600b3240 0x7ff8600b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff864b23700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8600b3850 0x7ff8601444d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:43988/0 (socket says 172.21.15.133:43988) 2021-01-03T13:03:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff864b23700 1 -- 172.21.15.133:0/3561247601 learned_addr learned my addr 172.21.15.133:0/3561247601 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:57.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff85ffff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff8600b3f50 0x7ff860141330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:35442/0 (socket says 172.21.15.133:35442) 2021-01-03T13:03:57.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff85f7fe700 1 -- 172.21.15.133:0/3561247601 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8600b3850 msgr2=0x7ff8601444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:57.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff85f7fe700 1 --2- 172.21.15.133:0/3561247601 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8600b3850 0x7ff8601444d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:57.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff85f7fe700 1 -- 172.21.15.133:0/3561247601 >> v1:172.21.15.16:6789/0 conn(0x7ff8600b3f50 legacy=0x7ff860141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:57.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff85f7fe700 1 -- 172.21.15.133:0/3561247601 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86009add0 con 0x7ff8600b3240 2021-01-03T13:03:57.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff85effd700 1 -- 172.21.15.133:0/3561247601 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547898750 0 0) 0x7ff860140c00 con 0x7ff8600b3f50 2021-01-03T13:03:57.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff85f7fe700 1 --2- 172.21.15.133:0/3561247601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600b3240 0x7ff8600b4330 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7ff848002f30 tx=0x7ff848006dc0).ready entity=mon.0 client_cookie=2320b7ece593d731 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:57.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff85effd700 1 -- 172.21.15.133:0/3561247601 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff848009760 con 0x7ff8600b3240 2021-01-03T13:03:57.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff85effd700 1 -- 172.21.15.133:0/3561247601 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8480098c0 con 0x7ff8600b3240 2021-01-03T13:03:57.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff85effd700 1 -- 172.21.15.133:0/3561247601 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff848009c20 con 0x7ff8600b3240 2021-01-03T13:03:57.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff866586700 1 -- 172.21.15.133:0/3561247601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600b3240 msgr2=0x7ff8600b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:57.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff866586700 1 --2- 172.21.15.133:0/3561247601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600b3240 0x7ff8600b4330 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7ff848002f30 tx=0x7ff848006dc0).stop 2021-01-03T13:03:57.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff866586700 1 -- 172.21.15.133:0/3561247601 shutdown_connections 2021-01-03T13:03:57.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff866586700 1 --2- 172.21.15.133:0/3561247601 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8600b3850 0x7ff8601444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:57.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff866586700 1 --2- 172.21.15.133:0/3561247601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600b3240 0x7ff8600b4330 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:57.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff866586700 1 -- 172.21.15.133:0/3561247601 >> 172.21.15.133:0/3561247601 conn(0x7ff86005bdf0 msgr2=0x7ff86005c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:57.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff866586700 1 -- 172.21.15.133:0/3561247601 shutdown_connections 2021-01-03T13:03:57.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.178+0000 7ff866586700 1 -- 172.21.15.133:0/3561247601 wait complete. 2021-01-03T13:03:57.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff866586700 1 Processor -- start 2021-01-03T13:03:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff866586700 1 -- start start 2021-01-03T13:03:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff866586700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8600b3240 0x7ff8600b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff866586700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8600b3850 0x7ff86009c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff866586700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600b3f50 0x7ff860154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff866586700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600af410 con 0x7ff8600b3f50 2021-01-03T13:03:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff866586700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600b16a0 con 0x7ff8600b3850 2021-01-03T13:03:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff866586700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600b1940 con 0x7ff8600b3240 2021-01-03T13:03:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff85f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8600b3850 0x7ff86009c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:57.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff85f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8600b3850 0x7ff86009c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35692/0 (socket says 172.21.15.133:35692) 2021-01-03T13:03:57.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff85f7fe700 1 -- 172.21.15.133:0/4182166093 learned_addr learned my addr 172.21.15.133:0/4182166093 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:57.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff864b23700 1 --2- 172.21.15.133:0/4182166093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600b3f50 0x7ff860154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:57.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff85ffff700 1 --2- 172.21.15.133:0/4182166093 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8600b3240 0x7ff8600b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:57.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff85f7fe700 1 -- 172.21.15.133:0/4182166093 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8600b3240 msgr2=0x7ff8600b7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff85f7fe700 1 --2- 172.21.15.133:0/4182166093 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8600b3240 0x7ff8600b7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff85f7fe700 1 -- 172.21.15.133:0/4182166093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600b3f50 msgr2=0x7ff860154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff85f7fe700 1 --2- 172.21.15.133:0/4182166093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600b3f50 0x7ff860154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff85f7fe700 1 -- 172.21.15.133:0/4182166093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8600b08c0 con 0x7ff8600b3850 2021-01-03T13:03:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff864b23700 1 --2- 172.21.15.133:0/4182166093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600b3f50 0x7ff860154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:03:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff85f7fe700 1 --2- 172.21.15.133:0/4182166093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8600b3850 0x7ff86009c780 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7ff848002f30 tx=0x7ff848015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff85d7fa700 1 -- 172.21.15.133:0/4182166093 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff848011950 con 0x7ff8600b3850 2021-01-03T13:03:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff866586700 1 -- 172.21.15.133:0/4182166093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8601553b0 con 0x7ff8600b3850 2021-01-03T13:03:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff85d7fa700 1 -- 172.21.15.133:0/4182166093 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff848011ab0 con 0x7ff8600b3850 2021-01-03T13:03:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff85d7fa700 1 -- 172.21.15.133:0/4182166093 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff848011e10 con 0x7ff8600b3850 2021-01-03T13:03:57.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.182+0000 7ff866586700 1 -- 172.21.15.133:0/4182166093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8600b7cd0 con 0x7ff8600b3850 2021-01-03T13:03:57.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.186+0000 7ff866586700 1 -- 172.21.15.133:0/4182166093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8600b0a50 con 0x7ff8600b3850 2021-01-03T13:03:57.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.186+0000 7ff85d7fa700 1 -- 172.21.15.133:0/4182166093 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff848024030 con 0x7ff8600b3850 2021-01-03T13:03:57.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.186+0000 7ff85d7fa700 1 --2- 172.21.15.133:0/4182166093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff844055440 0x7ff844057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:57.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.186+0000 7ff85d7fa700 1 -- 172.21.15.133:0/4182166093 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff84806eb70 con 0x7ff8600b3850 2021-01-03T13:03:57.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.186+0000 7ff85ffff700 1 --2- 172.21.15.133:0/4182166093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff844055440 0x7ff844057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:57.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.186+0000 7ff85ffff700 1 --2- 172.21.15.133:0/4182166093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff844055440 0x7ff844057900 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7ff85000d000 tx=0x7ff850007b90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:57.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.194+0000 7ff85d7fa700 1 -- 172.21.15.133:0/4182166093 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff848045100 con 0x7ff8600b3850 2021-01-03T13:03:57.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:57.334+0000 7ff866586700 1 -- 172.21.15.133:0/4182166093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7ff8600b1b00 con 0x7ff8600b3850 2021-01-03T13:03:58.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.342+0000 7ff85d7fa700 1 -- 172.21.15.133:0/4182166093 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v74) v1 ==== 133+0+0 (secure 0 0 0) 0x7ff848022020 con 0x7ff8600b3850 2021-01-03T13:03:58.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.346+0000 7ff866586700 1 -- 172.21.15.133:0/4182166093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff844055440 msgr2=0x7ff844057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:58.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.346+0000 7ff866586700 1 --2- 172.21.15.133:0/4182166093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff844055440 0x7ff844057900 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7ff85000d000 tx=0x7ff850007b90).stop 2021-01-03T13:03:58.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.346+0000 7ff866586700 1 -- 172.21.15.133:0/4182166093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8600b3850 msgr2=0x7ff86009c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:58.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.346+0000 7ff866586700 1 --2- 172.21.15.133:0/4182166093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8600b3850 0x7ff86009c780 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7ff848002f30 tx=0x7ff848015000).stop 2021-01-03T13:03:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.346+0000 7ff866586700 1 -- 172.21.15.133:0/4182166093 shutdown_connections 2021-01-03T13:03:58.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.346+0000 7ff866586700 1 --2- 172.21.15.133:0/4182166093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff844055440 0x7ff844057900 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:58.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.346+0000 7ff866586700 1 --2- 172.21.15.133:0/4182166093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8600b3f50 0x7ff860154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:58.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.346+0000 7ff866586700 1 --2- 172.21.15.133:0/4182166093 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8600b3240 0x7ff8600b7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:58.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.346+0000 7ff866586700 1 --2- 172.21.15.133:0/4182166093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8600b3850 0x7ff86009c780 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:58.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.346+0000 7ff866586700 1 -- 172.21.15.133:0/4182166093 >> 172.21.15.133:0/4182166093 conn(0x7ff86005bdf0 msgr2=0x7ff860062d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:58.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.346+0000 7ff866586700 1 -- 172.21.15.133:0/4182166093 shutdown_connections 2021-01-03T13:03:58.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.346+0000 7ff866586700 1 -- 172.21.15.133:0/4182166093 wait complete. 2021-01-03T13:03:58.350 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2021-01-03T13:03:58.362 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-01-03T13:03:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.482+0000 7f4995b1c700 1 Processor -- start 2021-01-03T13:03:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.482+0000 7f4995b1c700 1 -- start start 2021-01-03T13:03:58.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4995b1c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49900b2460 0x7f49900a9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:58.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4995b1c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f49900b0a60 0x7f49900ad490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:58.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4995b1c700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49900b16a0 con 0x7f49900ad980 2021-01-03T13:03:58.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4995b1c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49900b2840 con 0x7f49900b0a60 2021-01-03T13:03:58.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4995b1c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49900aeae0 con 0x7f49900b2460 2021-01-03T13:03:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4994b1a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49900b2460 0x7f49900a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f498ffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f49900b0a60 0x7f49900ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4994b1a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49900b2460 0x7f49900a9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:43998/0 (socket says 172.21.15.133:43998) 2021-01-03T13:03:58.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4994b1a700 1 -- 172.21.15.133:0/2641820506 learned_addr learned my addr 172.21.15.133:0/2641820506 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:58.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f499531b700 1 --1- 172.21.15.133:0/2641820506 >> v1:172.21.15.16:6789/0 conn(0x7f49900ad980 0x7f49900a8850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:35458/0 (socket says 172.21.15.133:35458) 2021-01-03T13:03:58.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f498f7fe700 1 -- 172.21.15.133:0/2641820506 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307220433 0 0) 0x7f49900b16a0 con 0x7f49900ad980 2021-01-03T13:03:58.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f498f7fe700 1 -- 172.21.15.133:0/2641820506 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f497c003230 con 0x7f49900ad980 2021-01-03T13:03:58.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4994b1a700 1 -- 172.21.15.133:0/2641820506 >> v2:172.21.15.16:3300/0 conn(0x7f49900b0a60 msgr2=0x7f49900ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:58.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4994b1a700 1 --2- 172.21.15.133:0/2641820506 >> v2:172.21.15.16:3300/0 conn(0x7f49900b0a60 0x7f49900ad490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:58.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4994b1a700 1 -- 172.21.15.133:0/2641820506 >> v1:172.21.15.16:6789/0 conn(0x7f49900ad980 legacy=0x7f49900a8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:58.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4994b1a700 1 -- 172.21.15.133:0/2641820506 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49900b1160 con 0x7f49900b2460 2021-01-03T13:03:58.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f498ffff700 1 --2- 172.21.15.133:0/2641820506 >> v2:172.21.15.16:3300/0 conn(0x7f49900b0a60 0x7f49900ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:03:58.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4994b1a700 1 --2- 172.21.15.133:0/2641820506 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49900b2460 0x7f49900a9750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f49800032b0 tx=0x7f4980009270).ready entity=mon.2 client_cookie=5408fceb6406fb5f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:58.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f498f7fe700 1 -- 172.21.15.133:0/2641820506 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4980009e60 con 0x7f49900b2460 2021-01-03T13:03:58.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f498f7fe700 1 -- 172.21.15.133:0/2641820506 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498000bb50 con 0x7f49900b2460 2021-01-03T13:03:58.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f498f7fe700 1 -- 172.21.15.133:0/2641820506 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f498000bcc0 con 0x7f49900b2460 2021-01-03T13:03:58.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4995b1c700 1 -- 172.21.15.133:0/2641820506 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49900b2460 msgr2=0x7f49900a9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:58.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4995b1c700 1 --2- 172.21.15.133:0/2641820506 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49900b2460 0x7f49900a9750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f49800032b0 tx=0x7f4980009270).stop 2021-01-03T13:03:58.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4995b1c700 1 -- 172.21.15.133:0/2641820506 shutdown_connections 2021-01-03T13:03:58.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4995b1c700 1 --2- 172.21.15.133:0/2641820506 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49900b2460 0x7f49900a9750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:58.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.486+0000 7f4995b1c700 1 --2- 172.21.15.133:0/2641820506 >> v2:172.21.15.16:3300/0 conn(0x7f49900b0a60 0x7f49900ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:58.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.490+0000 7f4995b1c700 1 -- 172.21.15.133:0/2641820506 >> 172.21.15.133:0/2641820506 conn(0x7f499006b050 msgr2=0x7f4990060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:58.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.490+0000 7f4995b1c700 1 -- 172.21.15.133:0/2641820506 shutdown_connections 2021-01-03T13:03:58.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.490+0000 7f4995b1c700 1 -- 172.21.15.133:0/2641820506 wait complete. 2021-01-03T13:03:58.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.490+0000 7f4995b1c700 1 Processor -- start 2021-01-03T13:03:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.490+0000 7f4995b1c700 1 -- start start 2021-01-03T13:03:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.490+0000 7f4995b1c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49900ad980 0x7f49901413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.490+0000 7f4995b1c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49900b0a60 0x7f499014fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:58.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.490+0000 7f4995b1c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49900b2460 0x7f499014ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:58.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.490+0000 7f4995b1c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49901432c0 con 0x7f49900b2460 2021-01-03T13:03:58.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.490+0000 7f4995b1c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499014a720 con 0x7f49900b0a60 2021-01-03T13:03:58.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.490+0000 7f4995b1c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4990143020 con 0x7f49900ad980 2021-01-03T13:03:58.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.490+0000 7f498ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49900b0a60 0x7f499014fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:58.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.490+0000 7f498ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49900b0a60 0x7f499014fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35704/0 (socket says 172.21.15.133:35704) 2021-01-03T13:03:58.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.490+0000 7f498ffff700 1 -- 172.21.15.133:0/753250820 learned_addr learned my addr 172.21.15.133:0/753250820 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:58.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f4994b1a700 1 --2- 172.21.15.133:0/753250820 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49900ad980 0x7f49901413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:58.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f499531b700 1 --2- 172.21.15.133:0/753250820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49900b2460 0x7f499014ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:58.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f498ffff700 1 -- 172.21.15.133:0/753250820 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49900ad980 msgr2=0x7f49901413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:58.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f498ffff700 1 --2- 172.21.15.133:0/753250820 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49900ad980 0x7f49901413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:58.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f498ffff700 1 -- 172.21.15.133:0/753250820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49900b2460 msgr2=0x7f499014ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:58.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f498ffff700 1 --2- 172.21.15.133:0/753250820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49900b2460 0x7f499014ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:58.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f498ffff700 1 -- 172.21.15.133:0/753250820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49901452b0 con 0x7f49900b0a60 2021-01-03T13:03:58.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f4994b1a700 1 --2- 172.21.15.133:0/753250820 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49900ad980 0x7f49901413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:03:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f498ffff700 1 --2- 172.21.15.133:0/753250820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49900b0a60 0x7f499014fad0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f498400c000 tx=0x7f4984006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f498dffb700 1 -- 172.21.15.133:0/753250820 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f498400cbf0 con 0x7f49900b0a60 2021-01-03T13:03:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f498dffb700 1 -- 172.21.15.133:0/753250820 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498400cd50 con 0x7f49900b0a60 2021-01-03T13:03:58.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f4995b1c700 1 -- 172.21.15.133:0/753250820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4990145550 con 0x7f49900b0a60 2021-01-03T13:03:58.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f498dffb700 1 -- 172.21.15.133:0/753250820 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49840125e0 con 0x7f49900b0a60 2021-01-03T13:03:58.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f4995b1c700 1 -- 172.21.15.133:0/753250820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49901418e0 con 0x7f49900b0a60 2021-01-03T13:03:58.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f498dffb700 1 -- 172.21.15.133:0/753250820 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4984012740 con 0x7f49900b0a60 2021-01-03T13:03:58.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f4995b1c700 1 -- 172.21.15.133:0/753250820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49901456e0 con 0x7f49900b0a60 2021-01-03T13:03:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f498dffb700 1 --2- 172.21.15.133:0/753250820 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f49700553b0 0x7f4970057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f498dffb700 1 -- 172.21.15.133:0/753250820 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f498406e480 con 0x7f49900b0a60 2021-01-03T13:03:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f4994b1a700 1 --2- 172.21.15.133:0/753250820 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f49700553b0 0x7f4970057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:58.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.494+0000 7f4994b1a700 1 --2- 172.21.15.133:0/753250820 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f49700553b0 0x7f4970057870 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f4980019000 tx=0x7f4980016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:58.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.502+0000 7f498dffb700 1 -- 172.21.15.133:0/753250820 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4984044880 con 0x7f49900b0a60 2021-01-03T13:03:58.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:58.650+0000 7f4995b1c700 1 -- 172.21.15.133:0/753250820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f4990057300 con 0x7f49900b0a60 2021-01-03T13:03:59.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.566+0000 7f498dffb700 1 -- 172.21.15.133:0/753250820 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v76) v1 ==== 125+0+0 (secure 0 0 0) 0x7f4984047ea0 con 0x7f49900b0a60 2021-01-03T13:03:59.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.570+0000 7f4995b1c700 1 -- 172.21.15.133:0/753250820 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f49700553b0 msgr2=0x7f4970057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:59.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.570+0000 7f4995b1c700 1 --2- 172.21.15.133:0/753250820 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f49700553b0 0x7f4970057870 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f4980019000 tx=0x7f4980016000).stop 2021-01-03T13:03:59.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.570+0000 7f4995b1c700 1 -- 172.21.15.133:0/753250820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49900b0a60 msgr2=0x7f499014fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:59.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.570+0000 7f4995b1c700 1 --2- 172.21.15.133:0/753250820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49900b0a60 0x7f499014fad0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f498400c000 tx=0x7f4984006dc0).stop 2021-01-03T13:03:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.570+0000 7f4995b1c700 1 -- 172.21.15.133:0/753250820 shutdown_connections 2021-01-03T13:03:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.570+0000 7f4995b1c700 1 --2- 172.21.15.133:0/753250820 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f49700553b0 0x7f4970057870 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.570+0000 7f4995b1c700 1 --2- 172.21.15.133:0/753250820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49900b2460 0x7f499014ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.570+0000 7f4995b1c700 1 --2- 172.21.15.133:0/753250820 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49900ad980 0x7f49901413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.570+0000 7f4995b1c700 1 --2- 172.21.15.133:0/753250820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49900b0a60 0x7f499014fad0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.570+0000 7f4995b1c700 1 -- 172.21.15.133:0/753250820 >> 172.21.15.133:0/753250820 conn(0x7f499006b050 msgr2=0x7f49900b4190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.570+0000 7f4995b1c700 1 -- 172.21.15.133:0/753250820 shutdown_connections 2021-01-03T13:03:59.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.574+0000 7f4995b1c700 1 -- 172.21.15.133:0/753250820 wait complete. 2021-01-03T13:03:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2021-01-03T13:03:59.586 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-01-03T13:03:59.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.706+0000 7f560f59e700 1 Processor -- start 2021-01-03T13:03:59.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.706+0000 7f560f59e700 1 -- start start 2021-01-03T13:03:59.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560f59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f56101406f0 0x7f5610067320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:59.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560f59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f56100af780 0x7f5610067810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:59.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560f59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56100b2820 con 0x7f56100b2440 2021-01-03T13:03:59.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560f59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56100ac630 con 0x7f56100af780 2021-01-03T13:03:59.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560f59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56100b1af0 con 0x7f56101406f0 2021-01-03T13:03:59.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560dd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f56101406f0 0x7f5610067320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560e59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f56100b2440 0x7f561013ffe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56742/0 (socket says 172.21.15.133:56742) 2021-01-03T13:03:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560e59c700 1 -- 172.21.15.133:0/638166187 learned_addr learned my addr 172.21.15.133:0/638166187 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:03:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560ed9d700 1 --2- 172.21.15.133:0/638166187 >> v2:172.21.15.16:3300/0 conn(0x7f56100af780 0x7f5610067810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560dd9b700 1 -- 172.21.15.133:0/638166187 >> v2:172.21.15.16:3300/0 conn(0x7f56100af780 msgr2=0x7f5610067810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:03:59.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560dd9b700 1 --2- 172.21.15.133:0/638166187 >> v2:172.21.15.16:3300/0 conn(0x7f56100af780 0x7f5610067810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560dd9b700 1 -- 172.21.15.133:0/638166187 >> v1:172.21.15.133:6789/0 conn(0x7f56100b2440 legacy=0x7f561013ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560d59a700 1 -- 172.21.15.133:0/638166187 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911206928 0 0) 0x7f56100b2820 con 0x7f56100b2440 2021-01-03T13:03:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560dd9b700 1 -- 172.21.15.133:0/638166187 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56100b1d90 con 0x7f56101406f0 2021-01-03T13:03:59.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560dd9b700 1 --2- 172.21.15.133:0/638166187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56101406f0 0x7f5610067320 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f5604002f30 tx=0x7f5604006dc0).ready entity=mon.1 client_cookie=c21d821a361e411e server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:59.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560d59a700 1 -- 172.21.15.133:0/638166187 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56040097f0 con 0x7f56101406f0 2021-01-03T13:03:59.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560d59a700 1 -- 172.21.15.133:0/638166187 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5604009950 con 0x7f56101406f0 2021-01-03T13:03:59.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560d59a700 1 -- 172.21.15.133:0/638166187 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5604009cb0 con 0x7f56101406f0 2021-01-03T13:03:59.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560f59e700 1 -- 172.21.15.133:0/638166187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56101406f0 msgr2=0x7f5610067320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:59.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560f59e700 1 --2- 172.21.15.133:0/638166187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56101406f0 0x7f5610067320 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7f5604002f30 tx=0x7f5604006dc0).stop 2021-01-03T13:03:59.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560f59e700 1 -- 172.21.15.133:0/638166187 shutdown_connections 2021-01-03T13:03:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560f59e700 1 --2- 172.21.15.133:0/638166187 >> v2:172.21.15.16:3300/0 conn(0x7f56100af780 0x7f5610067810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560f59e700 1 --2- 172.21.15.133:0/638166187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56101406f0 0x7f5610067320 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560f59e700 1 -- 172.21.15.133:0/638166187 >> 172.21.15.133:0/638166187 conn(0x7f561006b050 msgr2=0x7f5610060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560f59e700 1 -- 172.21.15.133:0/638166187 shutdown_connections 2021-01-03T13:03:59.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.710+0000 7f560f59e700 1 -- 172.21.15.133:0/638166187 wait complete. 2021-01-03T13:03:59.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.714+0000 7f560f59e700 1 Processor -- start 2021-01-03T13:03:59.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.714+0000 7f560f59e700 1 -- start start 2021-01-03T13:03:59.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.714+0000 7f560f59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56100af780 0x7f561013eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:59.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.714+0000 7f560f59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f56100b2440 0x7f5610151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.714+0000 7f560f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56101406f0 0x7f5610155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.714+0000 7f560f59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5610152cd0 con 0x7f56100af780 2021-01-03T13:03:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.714+0000 7f560f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5610142ac0 con 0x7f56101406f0 2021-01-03T13:03:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.714+0000 7f560f59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5610142820 con 0x7f56100b2440 2021-01-03T13:03:59.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.714+0000 7f560ed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56101406f0 0x7f5610155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.714+0000 7f560ed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56101406f0 0x7f5610155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35720/0 (socket says 172.21.15.133:35720) 2021-01-03T13:03:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.714+0000 7f560ed9d700 1 -- 172.21.15.133:0/3883678853 learned_addr learned my addr 172.21.15.133:0/3883678853 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:03:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f560dd9b700 1 --2- 172.21.15.133:0/3883678853 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f56100b2440 0x7f5610151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.714+0000 7f560e59c700 1 --2- 172.21.15.133:0/3883678853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56100af780 0x7f561013eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:59.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f560ed9d700 1 -- 172.21.15.133:0/3883678853 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f56100b2440 msgr2=0x7f5610151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:59.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f560ed9d700 1 --2- 172.21.15.133:0/3883678853 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f56100b2440 0x7f5610151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:59.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f560ed9d700 1 -- 172.21.15.133:0/3883678853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56100af780 msgr2=0x7f561013eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:59.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f560ed9d700 1 --2- 172.21.15.133:0/3883678853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56100af780 0x7f561013eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:59.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f560ed9d700 1 -- 172.21.15.133:0/3883678853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56101552f0 con 0x7f56101406f0 2021-01-03T13:03:59.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f560ed9d700 1 --2- 172.21.15.133:0/3883678853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56101406f0 0x7f5610155a30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f5610067cb0 tx=0x7f5608008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f55ff7fe700 1 -- 172.21.15.133:0/3883678853 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f560800ba70 con 0x7f56101406f0 2021-01-03T13:03:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f55ff7fe700 1 -- 172.21.15.133:0/3883678853 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560800bbd0 con 0x7f56101406f0 2021-01-03T13:03:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f560f59e700 1 -- 172.21.15.133:0/3883678853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5610155590 con 0x7f56101406f0 2021-01-03T13:03:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f55ff7fe700 1 -- 172.21.15.133:0/3883678853 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5608012420 con 0x7f56101406f0 2021-01-03T13:03:59.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f560f59e700 1 -- 172.21.15.133:0/3883678853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5610064120 con 0x7f56101406f0 2021-01-03T13:03:59.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f55ff7fe700 1 -- 172.21.15.133:0/3883678853 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5608012580 con 0x7f56101406f0 2021-01-03T13:03:59.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f560f59e700 1 -- 172.21.15.133:0/3883678853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5610155720 con 0x7f56101406f0 2021-01-03T13:03:59.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f55ff7fe700 1 --2- 172.21.15.133:0/3883678853 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55ec0553b0 0x7f55ec057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:03:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f55ff7fe700 1 -- 172.21.15.133:0/3883678853 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f560806e760 con 0x7f56101406f0 2021-01-03T13:03:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f560e59c700 1 --2- 172.21.15.133:0/3883678853 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55ec0553b0 0x7f55ec057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:03:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.718+0000 7f560e59c700 1 --2- 172.21.15.133:0/3883678853 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55ec0553b0 0x7f55ec057870 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f560000b000 tx=0x7f5600009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:03:59.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.726+0000 7f55ff7fe700 1 -- 172.21.15.133:0/3883678853 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f56080449d0 con 0x7f56101406f0 2021-01-03T13:03:59.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.910+0000 7f560f59e700 1 -- 172.21.15.133:0/3883678853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f5610057300 con 0x7f56101406f0 2021-01-03T13:03:59.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.922+0000 7f55ff7fe700 1 -- 172.21.15.133:0/3883678853 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 13 and data pool 14 v32) v1 ==== 189+0+0 (secure 0 0 0) 0x7f5608047ff0 con 0x7f56101406f0 2021-01-03T13:03:59.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.926+0000 7f560f59e700 1 -- 172.21.15.133:0/3883678853 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55ec0553b0 msgr2=0x7f55ec057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:59.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.926+0000 7f560f59e700 1 --2- 172.21.15.133:0/3883678853 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55ec0553b0 0x7f55ec057870 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f560000b000 tx=0x7f5600009040).stop 2021-01-03T13:03:59.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.926+0000 7f560f59e700 1 -- 172.21.15.133:0/3883678853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56101406f0 msgr2=0x7f5610155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:03:59.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.926+0000 7f560f59e700 1 --2- 172.21.15.133:0/3883678853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56101406f0 0x7f5610155a30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f5610067cb0 tx=0x7f5608008040).stop 2021-01-03T13:03:59.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.926+0000 7f560f59e700 1 -- 172.21.15.133:0/3883678853 shutdown_connections 2021-01-03T13:03:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.926+0000 7f560f59e700 1 --2- 172.21.15.133:0/3883678853 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55ec0553b0 0x7f55ec057870 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.926+0000 7f560f59e700 1 --2- 172.21.15.133:0/3883678853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56100af780 0x7f561013eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.926+0000 7f560f59e700 1 --2- 172.21.15.133:0/3883678853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56101406f0 0x7f5610155a30 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.926+0000 7f560f59e700 1 --2- 172.21.15.133:0/3883678853 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f56100b2440 0x7f5610151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:03:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.926+0000 7f560f59e700 1 -- 172.21.15.133:0/3883678853 >> 172.21.15.133:0/3883678853 conn(0x7f561006b050 msgr2=0x7f56100b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:03:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.926+0000 7f560f59e700 1 -- 172.21.15.133:0/3883678853 shutdown_connections 2021-01-03T13:03:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:03:59.926+0000 7f560f59e700 1 -- 172.21.15.133:0/3883678853 wait complete. 2021-01-03T13:03:59.936 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 13 and data pool 14 2021-01-03T13:03:59.942 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:04:00.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb7c938700 1 Processor -- start 2021-01-03T13:04:00.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb7c938700 1 -- start start 2021-01-03T13:04:00.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb7c938700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb780ace10 0x7fcb780b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb7c938700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcb780ad1f0 0x7fcb780b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb7c938700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb780b5470 0x7fcb78140a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb7c938700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb78144050 con 0x7fcb780ad1f0 2021-01-03T13:04:00.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb7c938700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb78144f00 con 0x7fcb780ace10 2021-01-03T13:04:00.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb7c938700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb78144280 con 0x7fcb780b5470 2021-01-03T13:04:00.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb76d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb780ace10 0x7fcb780b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb76d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb780ace10 0x7fcb780b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35736/0 (socket says 172.21.15.133:35736) 2021-01-03T13:04:00.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb7659c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcb780ad1f0 0x7fcb780b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb7759e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb780b5470 0x7fcb78140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb76d9d700 1 -- 172.21.15.133:0/4157434485 learned_addr learned my addr 172.21.15.133:0/4157434485 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb76d9d700 1 -- 172.21.15.133:0/4157434485 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb780b5470 msgr2=0x7fcb78140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb76d9d700 1 --2- 172.21.15.133:0/4157434485 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb780b5470 0x7fcb78140a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb76d9d700 1 -- 172.21.15.133:0/4157434485 >> v2:172.21.15.16:3300/0 conn(0x7fcb780ad1f0 msgr2=0x7fcb780b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:00.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb76d9d700 1 --2- 172.21.15.133:0/4157434485 >> v2:172.21.15.16:3300/0 conn(0x7fcb780ad1f0 0x7fcb780b4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb76d9d700 1 -- 172.21.15.133:0/4157434485 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb78144520 con 0x7fcb780ace10 2021-01-03T13:04:00.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb7659c700 1 --2- 172.21.15.133:0/4157434485 >> v2:172.21.15.16:3300/0 conn(0x7fcb780ad1f0 0x7fcb780b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:04:00.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.042+0000 7fcb7759e700 1 --2- 172.21.15.133:0/4157434485 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb780b5470 0x7fcb78140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:04:00.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb76d9d700 1 --2- 172.21.15.133:0/4157434485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb780ace10 0x7fcb780b5ae0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fcb60002f30 tx=0x7fcb60006e80).ready entity=mon.1 client_cookie=fa3fa4b0e7b000fe server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:00.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb75d9b700 1 -- 172.21.15.133:0/4157434485 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb60009640 con 0x7fcb780ace10 2021-01-03T13:04:00.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb75d9b700 1 -- 172.21.15.133:0/4157434485 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb600097a0 con 0x7fcb780ace10 2021-01-03T13:04:00.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb75d9b700 1 -- 172.21.15.133:0/4157434485 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb60009b00 con 0x7fcb780ace10 2021-01-03T13:04:00.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7c938700 1 -- 172.21.15.133:0/4157434485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb780ace10 msgr2=0x7fcb780b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:00.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7c938700 1 --2- 172.21.15.133:0/4157434485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb780ace10 0x7fcb780b5ae0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fcb60002f30 tx=0x7fcb60006e80).stop 2021-01-03T13:04:00.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7c938700 1 -- 172.21.15.133:0/4157434485 shutdown_connections 2021-01-03T13:04:00.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7c938700 1 --2- 172.21.15.133:0/4157434485 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb780b5470 0x7fcb78140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7c938700 1 --2- 172.21.15.133:0/4157434485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb780ace10 0x7fcb780b5ae0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7c938700 1 --2- 172.21.15.133:0/4157434485 >> v2:172.21.15.16:3300/0 conn(0x7fcb780ad1f0 0x7fcb780b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7c938700 1 -- 172.21.15.133:0/4157434485 >> 172.21.15.133:0/4157434485 conn(0x7fcb7805bdf0 msgr2=0x7fcb7805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:00.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7c938700 1 -- 172.21.15.133:0/4157434485 shutdown_connections 2021-01-03T13:04:00.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7c938700 1 -- 172.21.15.133:0/4157434485 wait complete. 2021-01-03T13:04:00.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7c938700 1 Processor -- start 2021-01-03T13:04:00.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7c938700 1 -- start start 2021-01-03T13:04:00.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7c938700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb780ace10 0x7fcb78140de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7c938700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb780ad1f0 0x7fcb78153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7c938700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb780b5470 0x7fcb78153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7c938700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb780b1600 con 0x7fcb780b5470 2021-01-03T13:04:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7c938700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb780b0250 con 0x7fcb780ace10 2021-01-03T13:04:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7c938700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb780b0980 con 0x7fcb780ad1f0 2021-01-03T13:04:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb76d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb780ace10 0x7fcb78140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb76d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb780ace10 0x7fcb78140de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35740/0 (socket says 172.21.15.133:35740) 2021-01-03T13:04:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb76d9d700 1 -- 172.21.15.133:0/652890690 learned_addr learned my addr 172.21.15.133:0/652890690 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:00.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7659c700 1 --2- 172.21.15.133:0/652890690 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb780ad1f0 0x7fcb78153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7759e700 1 --2- 172.21.15.133:0/652890690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb780b5470 0x7fcb78153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb76d9d700 1 -- 172.21.15.133:0/652890690 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb780ad1f0 msgr2=0x7fcb78153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:00.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb76d9d700 1 --2- 172.21.15.133:0/652890690 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb780ad1f0 0x7fcb78153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb76d9d700 1 -- 172.21.15.133:0/652890690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb780b5470 msgr2=0x7fcb78153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb76d9d700 1 --2- 172.21.15.133:0/652890690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb780b5470 0x7fcb78153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb76d9d700 1 -- 172.21.15.133:0/652890690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb780b0c20 con 0x7fcb780ace10 2021-01-03T13:04:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.046+0000 7fcb7659c700 1 --2- 172.21.15.133:0/652890690 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb780ad1f0 0x7fcb78153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:04:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.050+0000 7fcb76d9d700 1 --2- 172.21.15.133:0/652890690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb780ace10 0x7fcb78140de0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fcb780b1740 tx=0x7fcb60015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:00.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.050+0000 7fcb6ffff700 1 -- 172.21.15.133:0/652890690 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb60011a70 con 0x7fcb780ace10 2021-01-03T13:04:00.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.050+0000 7fcb6ffff700 1 -- 172.21.15.133:0/652890690 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb60011bd0 con 0x7fcb780ace10 2021-01-03T13:04:00.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.050+0000 7fcb7c938700 1 -- 172.21.15.133:0/652890690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb780b0ec0 con 0x7fcb780ace10 2021-01-03T13:04:00.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.050+0000 7fcb7c938700 1 -- 172.21.15.133:0/652890690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb78153cf0 con 0x7fcb780ace10 2021-01-03T13:04:00.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.050+0000 7fcb6ffff700 1 -- 172.21.15.133:0/652890690 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb6001d450 con 0x7fcb780ace10 2021-01-03T13:04:00.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.050+0000 7fcb7c938700 1 -- 172.21.15.133:0/652890690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb500033e0 con 0x7fcb780ace10 2021-01-03T13:04:00.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.050+0000 7fcb6ffff700 1 -- 172.21.15.133:0/652890690 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fcb6000f070 con 0x7fcb780ace10 2021-01-03T13:04:00.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.050+0000 7fcb6ffff700 1 --2- 172.21.15.133:0/652890690 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb5c059910 0x7fcb5c05bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.050+0000 7fcb6ffff700 1 -- 172.21.15.133:0/652890690 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcb6006f5d0 con 0x7fcb780ace10 2021-01-03T13:04:00.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.050+0000 7fcb7659c700 1 --2- 172.21.15.133:0/652890690 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb5c059910 0x7fcb5c05bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.054+0000 7fcb7659c700 1 --2- 172.21.15.133:0/652890690 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb5c059910 0x7fcb5c05bdd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fcb6800b000 tx=0x7fcb68008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:00.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.058+0000 7fcb6ffff700 1 -- 172.21.15.133:0/652890690 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcb600458d0 con 0x7fcb780ace10 2021-01-03T13:04:00.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.198+0000 7fcb7c938700 1 -- 172.21.15.133:0/652890690 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb50002270 con 0x7fcb780ace10 2021-01-03T13:04:00.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.198+0000 7fcb6ffff700 1 -- 172.21.15.133:0/652890690 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16102 (secure 0 0 0) 0x7fcb60048ef0 con 0x7fcb780ace10 2021-01-03T13:04:00.200 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:04:00.200 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":77,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:03:59.913615+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:03:57.389227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-01-03T13:03:58.706858+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:04:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.202+0000 7fcb7c938700 1 -- 172.21.15.133:0/652890690 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb5c059910 msgr2=0x7fcb5c05bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.202+0000 7fcb7c938700 1 --2- 172.21.15.133:0/652890690 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb5c059910 0x7fcb5c05bdd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fcb6800b000 tx=0x7fcb68008040).stop 2021-01-03T13:04:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.202+0000 7fcb7c938700 1 -- 172.21.15.133:0/652890690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb780ace10 msgr2=0x7fcb78140de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.202+0000 7fcb7c938700 1 --2- 172.21.15.133:0/652890690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb780ace10 0x7fcb78140de0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fcb780b1740 tx=0x7fcb60015000).stop 2021-01-03T13:04:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.202+0000 7fcb7c938700 1 -- 172.21.15.133:0/652890690 shutdown_connections 2021-01-03T13:04:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.202+0000 7fcb7c938700 1 --2- 172.21.15.133:0/652890690 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb5c059910 0x7fcb5c05bdd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.202+0000 7fcb7c938700 1 --2- 172.21.15.133:0/652890690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb780b5470 0x7fcb78153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.202+0000 7fcb7c938700 1 --2- 172.21.15.133:0/652890690 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb780ace10 0x7fcb78140de0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.202+0000 7fcb7c938700 1 --2- 172.21.15.133:0/652890690 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb780ad1f0 0x7fcb78153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.202+0000 7fcb7c938700 1 -- 172.21.15.133:0/652890690 >> 172.21.15.133:0/652890690 conn(0x7fcb7805bdf0 msgr2=0x7fcb781436c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:00.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.202+0000 7fcb7c938700 1 -- 172.21.15.133:0/652890690 shutdown_connections 2021-01-03T13:04:00.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.202+0000 7fcb7c938700 1 -- 172.21.15.133:0/652890690 wait complete. 2021-01-03T13:04:00.213 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:04:00.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe4225d3700 1 Processor -- start 2021-01-03T13:04:00.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe4225d3700 1 -- start start 2021-01-03T13:04:00.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe4225d3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe41c067350 0x7fe41c05fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe4225d3700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe41c0b2750 0x7fe41c144260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe4225d3700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41c0afe70 con 0x7fe41c066f70 2021-01-03T13:04:00.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe4225d3700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c060310 con 0x7fe41c0b2750 2021-01-03T13:04:00.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe4225d3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c0605a0 con 0x7fe41c067350 2021-01-03T13:04:00.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe420dd0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe41c067350 0x7fe41c05fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe420dd0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe41c067350 0x7fe41c05fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35750/0 (socket says 172.21.15.133:35750) 2021-01-03T13:04:00.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe420dd0700 1 -- 172.21.15.133:0/611054700 learned_addr learned my addr 172.21.15.133:0/611054700 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:00.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe421dd2700 1 --2- 172.21.15.133:0/611054700 >> v2:172.21.15.16:3300/0 conn(0x7fe41c0b2750 0x7fe41c144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe420dd0700 1 -- 172.21.15.133:0/611054700 >> v2:172.21.15.16:3300/0 conn(0x7fe41c0b2750 msgr2=0x7fe41c144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:00.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe420dd0700 1 --2- 172.21.15.133:0/611054700 >> v2:172.21.15.16:3300/0 conn(0x7fe41c0b2750 0x7fe41c144260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe420dd0700 1 -- 172.21.15.133:0/611054700 >> v1:172.21.15.16:6789/0 conn(0x7fe41c066f70 legacy=0x7fe41c0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:00.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe420dd0700 1 -- 172.21.15.133:0/611054700 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c0b0b50 con 0x7fe41c067350 2021-01-03T13:04:00.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe420dd0700 1 --2- 172.21.15.133:0/611054700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c067350 0x7fe41c05fe20 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fe40c002f30 tx=0x7fe40c006e80).ready entity=mon.1 client_cookie=e6950f8dee0fe7b4 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:00.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe40bfff700 1 -- 172.21.15.133:0/611054700 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe40c0097f0 con 0x7fe41c067350 2021-01-03T13:04:00.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe40bfff700 1 -- 172.21.15.133:0/611054700 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c009950 con 0x7fe41c067350 2021-01-03T13:04:00.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe40bfff700 1 -- 172.21.15.133:0/611054700 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe40c009cb0 con 0x7fe41c067350 2021-01-03T13:04:00.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe4225d3700 1 -- 172.21.15.133:0/611054700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c067350 msgr2=0x7fe41c05fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:00.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.318+0000 7fe4225d3700 1 --2- 172.21.15.133:0/611054700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c067350 0x7fe41c05fe20 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fe40c002f30 tx=0x7fe40c006e80).stop 2021-01-03T13:04:00.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.322+0000 7fe4225d3700 1 -- 172.21.15.133:0/611054700 shutdown_connections 2021-01-03T13:04:00.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.322+0000 7fe4225d3700 1 --2- 172.21.15.133:0/611054700 >> v2:172.21.15.16:3300/0 conn(0x7fe41c0b2750 0x7fe41c144260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.322+0000 7fe4225d3700 1 --2- 172.21.15.133:0/611054700 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c067350 0x7fe41c05fe20 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.322+0000 7fe4225d3700 1 -- 172.21.15.133:0/611054700 >> 172.21.15.133:0/611054700 conn(0x7fe41c0b6110 msgr2=0x7fe41c0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:00.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.322+0000 7fe4225d3700 1 -- 172.21.15.133:0/611054700 shutdown_connections 2021-01-03T13:04:00.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.322+0000 7fe4225d3700 1 -- 172.21.15.133:0/611054700 wait complete. 2021-01-03T13:04:00.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.322+0000 7fe4225d3700 1 Processor -- start 2021-01-03T13:04:00.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.322+0000 7fe4225d3700 1 -- start start 2021-01-03T13:04:00.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe4225d3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe41c066f70 0x7fe41c0659f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe4225d3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c067350 0x7fe41c065220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe4225d3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe41c0b2750 0x7fe41c13cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe4225d3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0647c0 con 0x7fe41c0b2750 2021-01-03T13:04:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe4225d3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c1418f0 con 0x7fe41c067350 2021-01-03T13:04:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe4225d3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0660d0 con 0x7fe41c066f70 2021-01-03T13:04:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe420dd0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c067350 0x7fe41c065220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe420dd0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c067350 0x7fe41c065220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35756/0 (socket says 172.21.15.133:35756) 2021-01-03T13:04:00.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe420dd0700 1 -- 172.21.15.133:0/4115085803 learned_addr learned my addr 172.21.15.133:0/4115085803 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:00.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe421dd2700 1 --2- 172.21.15.133:0/4115085803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe41c0b2750 0x7fe41c13cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe4215d1700 1 --2- 172.21.15.133:0/4115085803 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe41c066f70 0x7fe41c0659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe420dd0700 1 -- 172.21.15.133:0/4115085803 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe41c066f70 msgr2=0x7fe41c0659f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:00.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe420dd0700 1 --2- 172.21.15.133:0/4115085803 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe41c066f70 0x7fe41c0659f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe420dd0700 1 -- 172.21.15.133:0/4115085803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe41c0b2750 msgr2=0x7fe41c13cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:00.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe420dd0700 1 --2- 172.21.15.133:0/4115085803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe41c0b2750 0x7fe41c13cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe420dd0700 1 -- 172.21.15.133:0/4115085803 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c064a30 con 0x7fe41c067350 2021-01-03T13:04:00.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe420dd0700 1 --2- 172.21.15.133:0/4115085803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c067350 0x7fe41c065220 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fe41c09ed90 tx=0x7fe40c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:00.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe40a7fc700 1 -- 172.21.15.133:0/4115085803 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe40c011c50 con 0x7fe41c067350 2021-01-03T13:04:00.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe40a7fc700 1 -- 172.21.15.133:0/4115085803 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c011db0 con 0x7fe41c067350 2021-01-03T13:04:00.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe4225d3700 1 -- 172.21.15.133:0/4115085803 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c0644b0 con 0x7fe41c067350 2021-01-03T13:04:00.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe40a7fc700 1 -- 172.21.15.133:0/4115085803 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe40c01e650 con 0x7fe41c067350 2021-01-03T13:04:00.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.326+0000 7fe4225d3700 1 -- 172.21.15.133:0/4115085803 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41c09f920 con 0x7fe41c067350 2021-01-03T13:04:00.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.330+0000 7fe4225d3700 1 -- 172.21.15.133:0/4115085803 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41c057300 con 0x7fe41c067350 2021-01-03T13:04:00.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.330+0000 7fe40a7fc700 1 -- 172.21.15.133:0/4115085803 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe40c025030 con 0x7fe41c067350 2021-01-03T13:04:00.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.330+0000 7fe40a7fc700 1 --2- 172.21.15.133:0/4115085803 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3fc0554e0 0x7fe3fc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.330+0000 7fe40a7fc700 1 -- 172.21.15.133:0/4115085803 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe40c06f200 con 0x7fe41c067350 2021-01-03T13:04:00.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.330+0000 7fe4215d1700 1 --2- 172.21.15.133:0/4115085803 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3fc0554e0 0x7fe3fc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.330+0000 7fe4215d1700 1 --2- 172.21.15.133:0/4115085803 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3fc0554e0 0x7fe3fc0579a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fe41800d000 tx=0x7fe418007b60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:00.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.334+0000 7fe40a7fc700 1 -- 172.21.15.133:0/4115085803 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe40c0453f0 con 0x7fe41c067350 2021-01-03T13:04:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.474+0000 7fe4225d3700 1 -- 172.21.15.133:0/4115085803 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe41c061020 con 0x7fe41c067350 2021-01-03T13:04:00.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.478+0000 7fe40a7fc700 1 -- 172.21.15.133:0/4115085803 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16102 (secure 0 0 0) 0x7fe40c023090 con 0x7fe41c067350 2021-01-03T13:04:00.479 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:04:00.479 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":77,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:03:59.913615+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:03:57.389227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-01-03T13:03:58.706858+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:04:00.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.482+0000 7fe4225d3700 1 -- 172.21.15.133:0/4115085803 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3fc0554e0 msgr2=0x7fe3fc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:00.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.482+0000 7fe4225d3700 1 --2- 172.21.15.133:0/4115085803 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3fc0554e0 0x7fe3fc0579a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fe41800d000 tx=0x7fe418007b60).stop 2021-01-03T13:04:00.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.482+0000 7fe4225d3700 1 -- 172.21.15.133:0/4115085803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c067350 msgr2=0x7fe41c065220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:00.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.482+0000 7fe4225d3700 1 --2- 172.21.15.133:0/4115085803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c067350 0x7fe41c065220 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fe41c09ed90 tx=0x7fe40c015000).stop 2021-01-03T13:04:00.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.482+0000 7fe4225d3700 1 -- 172.21.15.133:0/4115085803 shutdown_connections 2021-01-03T13:04:00.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.482+0000 7fe4225d3700 1 --2- 172.21.15.133:0/4115085803 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe3fc0554e0 0x7fe3fc0579a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.482+0000 7fe4225d3700 1 --2- 172.21.15.133:0/4115085803 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe41c0b2750 0x7fe41c13cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.482+0000 7fe4225d3700 1 --2- 172.21.15.133:0/4115085803 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe41c066f70 0x7fe41c0659f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.482+0000 7fe4225d3700 1 --2- 172.21.15.133:0/4115085803 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c067350 0x7fe41c065220 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.482+0000 7fe4225d3700 1 -- 172.21.15.133:0/4115085803 >> 172.21.15.133:0/4115085803 conn(0x7fe41c0b6110 msgr2=0x7fe41c0b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:00.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.482+0000 7fe4225d3700 1 -- 172.21.15.133:0/4115085803 shutdown_connections 2021-01-03T13:04:00.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.482+0000 7fe4225d3700 1 -- 172.21.15.133:0/4115085803 wait complete. 2021-01-03T13:04:00.497 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-01-03T13:04:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.622+0000 7f6fccce9700 1 Processor -- start 2021-01-03T13:04:00.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.622+0000 7f6fccce9700 1 -- start start 2021-01-03T13:04:00.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fccce9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6fc8140410 0x7f6fc8146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fccce9700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6fc81407f0 0x7f6fc8142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fccce9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc805c500 con 0x7f6fc80b0470 2021-01-03T13:04:00.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fccce9700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc80b02d0 con 0x7f6fc81407f0 2021-01-03T13:04:00.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fccce9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc8146390 con 0x7f6fc8140410 2021-01-03T13:04:00.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fc6d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6fc80b0470 0x7f6fc805bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56798/0 (socket says 172.21.15.133:56798) 2021-01-03T13:04:00.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fc6d9d700 1 -- 172.21.15.133:0/3498439642 learned_addr learned my addr 172.21.15.133:0/3498439642 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:00.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fc659c700 1 --2- 172.21.15.133:0/3498439642 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6fc8140410 0x7f6fc8146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fbffff700 1 --2- 172.21.15.133:0/3498439642 >> v2:172.21.15.16:3300/0 conn(0x7f6fc81407f0 0x7f6fc8142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fc5d9b700 1 -- 172.21.15.133:0/3498439642 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166565290 0 0) 0x7f6fc805c500 con 0x7f6fc80b0470 2021-01-03T13:04:00.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fc5d9b700 1 -- 172.21.15.133:0/3498439642 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fa8003230 con 0x7f6fc80b0470 2021-01-03T13:04:00.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fc659c700 1 -- 172.21.15.133:0/3498439642 >> v2:172.21.15.16:3300/0 conn(0x7f6fc81407f0 msgr2=0x7f6fc8142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:00.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fc659c700 1 --2- 172.21.15.133:0/3498439642 >> v2:172.21.15.16:3300/0 conn(0x7f6fc81407f0 0x7f6fc8142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fc659c700 1 -- 172.21.15.133:0/3498439642 >> v1:172.21.15.133:6789/0 conn(0x7f6fc80b0470 legacy=0x7f6fc805bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:00.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fc659c700 1 -- 172.21.15.133:0/3498439642 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc805cf20 con 0x7f6fc8140410 2021-01-03T13:04:00.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fc659c700 1 --2- 172.21.15.133:0/3498439642 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6fc8140410 0x7f6fc8146cc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f6fb8002f30 tx=0x7f6fb8006dc0).ready entity=mon.2 client_cookie=c2b3758b1d097362 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:00.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fc5d9b700 1 -- 172.21.15.133:0/3498439642 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fb80096a0 con 0x7f6fc8140410 2021-01-03T13:04:00.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fc5d9b700 1 -- 172.21.15.133:0/3498439642 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb8009800 con 0x7f6fc8140410 2021-01-03T13:04:00.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fc5d9b700 1 -- 172.21.15.133:0/3498439642 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fb8009b60 con 0x7f6fc8140410 2021-01-03T13:04:00.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fccce9700 1 -- 172.21.15.133:0/3498439642 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6fc8140410 msgr2=0x7f6fc8146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:00.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fccce9700 1 --2- 172.21.15.133:0/3498439642 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6fc8140410 0x7f6fc8146cc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f6fb8002f30 tx=0x7f6fb8006dc0).stop 2021-01-03T13:04:00.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fccce9700 1 -- 172.21.15.133:0/3498439642 shutdown_connections 2021-01-03T13:04:00.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fccce9700 1 --2- 172.21.15.133:0/3498439642 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6fc8140410 0x7f6fc8146cc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fccce9700 1 --2- 172.21.15.133:0/3498439642 >> v2:172.21.15.16:3300/0 conn(0x7f6fc81407f0 0x7f6fc8142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fccce9700 1 -- 172.21.15.133:0/3498439642 >> 172.21.15.133:0/3498439642 conn(0x7f6fc80b95d0 msgr2=0x7f6fc80b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:00.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fccce9700 1 -- 172.21.15.133:0/3498439642 shutdown_connections 2021-01-03T13:04:00.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.626+0000 7f6fccce9700 1 -- 172.21.15.133:0/3498439642 wait complete. 2021-01-03T13:04:00.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fccce9700 1 Processor -- start 2021-01-03T13:04:00.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fccce9700 1 -- start start 2021-01-03T13:04:00.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fccce9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fc80b0470 0x7f6fc80b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fccce9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fc8140410 0x7f6fc81427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fccce9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6fc81407f0 0x7f6fc8142cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fccce9700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc80b3df0 con 0x7f6fc80b0470 2021-01-03T13:04:00.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fccce9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc8156050 con 0x7f6fc8140410 2021-01-03T13:04:00.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fccce9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc8141100 con 0x7f6fc81407f0 2021-01-03T13:04:00.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fbffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fc8140410 0x7f6fc81427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fbffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fc8140410 0x7f6fc81427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35770/0 (socket says 172.21.15.133:35770) 2021-01-03T13:04:00.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fbffff700 1 -- 172.21.15.133:0/777552412 learned_addr learned my addr 172.21.15.133:0/777552412 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:00.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fc659c700 1 --2- 172.21.15.133:0/777552412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fc80b0470 0x7f6fc80b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fc6d9d700 1 --2- 172.21.15.133:0/777552412 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6fc81407f0 0x7f6fc8142cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fbffff700 1 -- 172.21.15.133:0/777552412 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6fc81407f0 msgr2=0x7f6fc8142cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:00.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fbffff700 1 --2- 172.21.15.133:0/777552412 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6fc81407f0 0x7f6fc8142cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fbffff700 1 -- 172.21.15.133:0/777552412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fc80b0470 msgr2=0x7f6fc80b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:00.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fbffff700 1 --2- 172.21.15.133:0/777552412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fc80b0470 0x7f6fc80b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fbffff700 1 -- 172.21.15.133:0/777552412 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc81431c0 con 0x7f6fc8140410 2021-01-03T13:04:00.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fbffff700 1 --2- 172.21.15.133:0/777552412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fc8140410 0x7f6fc81427e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f6fb000c000 tx=0x7f6fb0006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:00.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fbf7fe700 1 -- 172.21.15.133:0/777552412 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fb000ca10 con 0x7f6fc8140410 2021-01-03T13:04:00.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fccce9700 1 -- 172.21.15.133:0/777552412 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc81415a0 con 0x7f6fc8140410 2021-01-03T13:04:00.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fbf7fe700 1 -- 172.21.15.133:0/777552412 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb000cb70 con 0x7f6fc8140410 2021-01-03T13:04:00.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fbf7fe700 1 -- 172.21.15.133:0/777552412 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fb000be30 con 0x7f6fc8140410 2021-01-03T13:04:00.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.630+0000 7f6fccce9700 1 -- 172.21.15.133:0/777552412 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc8141990 con 0x7f6fc8140410 2021-01-03T13:04:00.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.634+0000 7f6fccce9700 1 -- 172.21.15.133:0/777552412 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc80b23c0 con 0x7f6fc8140410 2021-01-03T13:04:00.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.634+0000 7f6fbf7fe700 1 -- 172.21.15.133:0/777552412 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6fb001c460 con 0x7f6fc8140410 2021-01-03T13:04:00.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.634+0000 7f6fbf7fe700 1 --2- 172.21.15.133:0/777552412 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6fac0553b0 0x7f6fac057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:00.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.634+0000 7f6fbf7fe700 1 -- 172.21.15.133:0/777552412 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6fb006e330 con 0x7f6fc8140410 2021-01-03T13:04:00.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.634+0000 7f6fc659c700 1 --2- 172.21.15.133:0/777552412 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6fac0553b0 0x7f6fac057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:00.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.634+0000 7f6fc659c700 1 --2- 172.21.15.133:0/777552412 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6fac0553b0 0x7f6fac057870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f6fb801b000 tx=0x7f6fb8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:00.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.642+0000 7f6fbf7fe700 1 -- 172.21.15.133:0/777552412 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6fb0044530 con 0x7f6fc8140410 2021-01-03T13:04:00.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.826+0000 7f6fccce9700 1 -- 172.21.15.133:0/777552412 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6fc81412c0 con 0x7f6fc8140410 2021-01-03T13:04:00.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.922+0000 7f6fbf7fe700 1 -- 172.21.15.133:0/777552412 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6fb0047b50 con 0x7f6fc8140410 2021-01-03T13:04:00.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.922+0000 7f6fccce9700 1 -- 172.21.15.133:0/777552412 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6fac0553b0 msgr2=0x7f6fac057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:00.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.922+0000 7f6fccce9700 1 --2- 172.21.15.133:0/777552412 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6fac0553b0 0x7f6fac057870 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f6fb801b000 tx=0x7f6fb8015000).stop 2021-01-03T13:04:00.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.922+0000 7f6fccce9700 1 -- 172.21.15.133:0/777552412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fc8140410 msgr2=0x7f6fc81427e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:00.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.922+0000 7f6fccce9700 1 --2- 172.21.15.133:0/777552412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fc8140410 0x7f6fc81427e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f6fb000c000 tx=0x7f6fb0006dc0).stop 2021-01-03T13:04:00.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.922+0000 7f6fccce9700 1 -- 172.21.15.133:0/777552412 shutdown_connections 2021-01-03T13:04:00.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.922+0000 7f6fccce9700 1 --2- 172.21.15.133:0/777552412 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6fac0553b0 0x7f6fac057870 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.922+0000 7f6fccce9700 1 --2- 172.21.15.133:0/777552412 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6fc80b0470 0x7f6fc80b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.922+0000 7f6fccce9700 1 --2- 172.21.15.133:0/777552412 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6fc81407f0 0x7f6fc8142cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.926+0000 7f6fccce9700 1 --2- 172.21.15.133:0/777552412 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fc8140410 0x7f6fc81427e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:00.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.926+0000 7f6fccce9700 1 -- 172.21.15.133:0/777552412 >> 172.21.15.133:0/777552412 conn(0x7f6fc80b95d0 msgr2=0x7f6fc81450d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:00.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.926+0000 7f6fccce9700 1 -- 172.21.15.133:0/777552412 shutdown_connections 2021-01-03T13:04:00.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:00.926+0000 7f6fccce9700 1 -- 172.21.15.133:0/777552412 wait complete. 2021-01-03T13:04:00.939 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:04:01.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.042+0000 7f38312a6700 1 Processor -- start 2021-01-03T13:04:01.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.042+0000 7f38312a6700 1 -- start start 2021-01-03T13:04:01.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.042+0000 7f38312a6700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f382c060510 0x7f382c05c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:01.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.042+0000 7f38312a6700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f382c05fd10 0x7f382c0b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:01.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.042+0000 7f38312a6700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382c05bf00 con 0x7f382c0b4c20 2021-01-03T13:04:01.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.042+0000 7f38312a6700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382c05c1a0 con 0x7f382c05fd10 2021-01-03T13:04:01.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.042+0000 7f38312a6700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c05c440 con 0x7f382c060510 2021-01-03T13:04:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.042+0000 7f382b7fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f382c060510 0x7f382c05c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.042+0000 7f3830aa5700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f382c05fd10 0x7f382c0b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.042+0000 7f382b7fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f382c060510 0x7f382c05c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:44080/0 (socket says 172.21.15.133:44080) 2021-01-03T13:04:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.042+0000 7f382b7fe700 1 -- 172.21.15.133:0/2198251411 learned_addr learned my addr 172.21.15.133:0/2198251411 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:01.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.042+0000 7f382bfff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f382c0b4c20 0x7f382c0b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:35536/0 (socket says 172.21.15.133:35536) 2021-01-03T13:04:01.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f382b7fe700 1 -- 172.21.15.133:0/2198251411 >> v2:172.21.15.16:3300/0 conn(0x7f382c05fd10 msgr2=0x7f382c0b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:01.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f382b7fe700 1 --2- 172.21.15.133:0/2198251411 >> v2:172.21.15.16:3300/0 conn(0x7f382c05fd10 0x7f382c0b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f382b7fe700 1 -- 172.21.15.133:0/2198251411 >> v1:172.21.15.16:6789/0 conn(0x7f382c0b4c20 legacy=0x7f382c0b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f382b7fe700 1 -- 172.21.15.133:0/2198251411 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c0b6ad0 con 0x7f382c060510 2021-01-03T13:04:01.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f382b7fe700 1 --2- 172.21.15.133:0/2198251411 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f382c060510 0x7f382c05c8e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f381c002f30 tx=0x7f381c006e80).ready entity=mon.2 client_cookie=9a3a57986fe610 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:01.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f382affd700 1 -- 172.21.15.133:0/2198251411 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f381c0097f0 con 0x7f382c060510 2021-01-03T13:04:01.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f382affd700 1 -- 172.21.15.133:0/2198251411 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c009950 con 0x7f382c060510 2021-01-03T13:04:01.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f382affd700 1 -- 172.21.15.133:0/2198251411 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f381c009cb0 con 0x7f382c060510 2021-01-03T13:04:01.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f38312a6700 1 -- 172.21.15.133:0/2198251411 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f382c060510 msgr2=0x7f382c05c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f38312a6700 1 --2- 172.21.15.133:0/2198251411 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f382c060510 0x7f382c05c8e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f381c002f30 tx=0x7f381c006e80).stop 2021-01-03T13:04:01.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f38312a6700 1 -- 172.21.15.133:0/2198251411 shutdown_connections 2021-01-03T13:04:01.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f38312a6700 1 --2- 172.21.15.133:0/2198251411 >> v2:172.21.15.16:3300/0 conn(0x7f382c05fd10 0x7f382c0b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f38312a6700 1 --2- 172.21.15.133:0/2198251411 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f382c060510 0x7f382c05c8e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f38312a6700 1 -- 172.21.15.133:0/2198251411 >> 172.21.15.133:0/2198251411 conn(0x7f382c0b9f00 msgr2=0x7f382c0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:01.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f38312a6700 1 -- 172.21.15.133:0/2198251411 shutdown_connections 2021-01-03T13:04:01.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f38312a6700 1 -- 172.21.15.133:0/2198251411 wait complete. 2021-01-03T13:04:01.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f38312a6700 1 Processor -- start 2021-01-03T13:04:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.046+0000 7f38312a6700 1 -- start start 2021-01-03T13:04:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f38312a6700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f382c05fd10 0x7f382c0af800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f38312a6700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f382c060510 0x7f382c146040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f38312a6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f382c0b4c20 0x7f382c146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f38312a6700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c152940 con 0x7f382c05fd10 2021-01-03T13:04:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f38312a6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c140d50 con 0x7f382c0b4c20 2021-01-03T13:04:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f38312a6700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c140ff0 con 0x7f382c060510 2021-01-03T13:04:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f3830aa5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f382c0b4c20 0x7f382c146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f3830aa5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f382c0b4c20 0x7f382c146530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35786/0 (socket says 172.21.15.133:35786) 2021-01-03T13:04:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f3830aa5700 1 -- 172.21.15.133:0/2926339175 learned_addr learned my addr 172.21.15.133:0/2926339175 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f382bfff700 1 --2- 172.21.15.133:0/2926339175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f382c05fd10 0x7f382c0af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f382b7fe700 1 --2- 172.21.15.133:0/2926339175 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f382c060510 0x7f382c146040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f3830aa5700 1 -- 172.21.15.133:0/2926339175 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f382c060510 msgr2=0x7f382c146040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f3830aa5700 1 --2- 172.21.15.133:0/2926339175 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f382c060510 0x7f382c146040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f3830aa5700 1 -- 172.21.15.133:0/2926339175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f382c05fd10 msgr2=0x7f382c0af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f3830aa5700 1 --2- 172.21.15.133:0/2926339175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f382c05fd10 0x7f382c0af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f3830aa5700 1 -- 172.21.15.133:0/2926339175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c141290 con 0x7f382c0b4c20 2021-01-03T13:04:01.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f382b7fe700 1 --2- 172.21.15.133:0/2926339175 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f382c060510 0x7f382c146040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:04:01.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f3830aa5700 1 --2- 172.21.15.133:0/2926339175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f382c0b4c20 0x7f382c146530 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f3824006dd0 tx=0x7f38240091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:01.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f38297fa700 1 -- 172.21.15.133:0/2926339175 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f382400ca00 con 0x7f382c0b4c20 2021-01-03T13:04:01.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f38297fa700 1 -- 172.21.15.133:0/2926339175 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382400cb60 con 0x7f382c0b4c20 2021-01-03T13:04:01.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f38312a6700 1 -- 172.21.15.133:0/2926339175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382c145cd0 con 0x7f382c0b4c20 2021-01-03T13:04:01.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f38297fa700 1 -- 172.21.15.133:0/2926339175 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38240123f0 con 0x7f382c0b4c20 2021-01-03T13:04:01.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f38312a6700 1 -- 172.21.15.133:0/2926339175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382c1418d0 con 0x7f382c0b4c20 2021-01-03T13:04:01.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f38312a6700 1 -- 172.21.15.133:0/2926339175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c057300 con 0x7f382c0b4c20 2021-01-03T13:04:01.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.050+0000 7f38297fa700 1 -- 172.21.15.133:0/2926339175 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3824022070 con 0x7f382c0b4c20 2021-01-03T13:04:01.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.054+0000 7f38297fa700 1 --2- 172.21.15.133:0/2926339175 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f380c0554e0 0x7f380c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:01.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.054+0000 7f382bfff700 1 --2- 172.21.15.133:0/2926339175 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f380c0554e0 0x7f380c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:01.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.054+0000 7f38297fa700 1 -- 172.21.15.133:0/2926339175 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f382406e7a0 con 0x7f382c0b4c20 2021-01-03T13:04:01.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.054+0000 7f382bfff700 1 --2- 172.21.15.133:0/2926339175 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f380c0554e0 0x7f380c0579a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f382000d000 tx=0x7f3820000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:01.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.058+0000 7f38297fa700 1 -- 172.21.15.133:0/2926339175 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3824044990 con 0x7f382c0b4c20 2021-01-03T13:04:01.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.238+0000 7f38312a6700 1 -- 172.21.15.133:0/2926339175 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f382c067a00 con 0x7f382c0b4c20 2021-01-03T13:04:01.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.242+0000 7f38297fa700 1 -- 172.21.15.133:0/2926339175 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2496 (secure 0 0 0) 0x7f3824016020 con 0x7f382c0b4c20 2021-01-03T13:04:01.241 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:04:01.242 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/524155035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":524155035},{"type":"v1","addr":"172.21.15.16:6833","nonce":524155035}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":31},{"gid":6175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1381538323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1381538323},{"type":"v1","addr":"172.21.15.133:6835","nonce":1381538323}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:03:59.914082+0000","modified":"2021-01-03T13:04:00.917279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6178},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6178":{"gid":6178,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1189475847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1189475847},{"type":"v1","addr":"172.21.15.133:6837","nonce":1189475847}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-01-03T13:04:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.242+0000 7f38312a6700 1 -- 172.21.15.133:0/2926339175 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f380c0554e0 msgr2=0x7f380c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.242+0000 7f38312a6700 1 --2- 172.21.15.133:0/2926339175 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f380c0554e0 0x7f380c0579a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f382000d000 tx=0x7f3820000b80).stop 2021-01-03T13:04:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.242+0000 7f38312a6700 1 -- 172.21.15.133:0/2926339175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f382c0b4c20 msgr2=0x7f382c146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.242+0000 7f38312a6700 1 --2- 172.21.15.133:0/2926339175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f382c0b4c20 0x7f382c146530 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f3824006dd0 tx=0x7f38240091a0).stop 2021-01-03T13:04:01.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.242+0000 7f38312a6700 1 -- 172.21.15.133:0/2926339175 shutdown_connections 2021-01-03T13:04:01.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.242+0000 7f38312a6700 1 --2- 172.21.15.133:0/2926339175 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f380c0554e0 0x7f380c0579a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.242+0000 7f38312a6700 1 --2- 172.21.15.133:0/2926339175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f382c05fd10 0x7f382c0af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.242+0000 7f38312a6700 1 --2- 172.21.15.133:0/2926339175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f382c0b4c20 0x7f382c146530 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.242+0000 7f38312a6700 1 --2- 172.21.15.133:0/2926339175 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f382c060510 0x7f382c146040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.242+0000 7f38312a6700 1 -- 172.21.15.133:0/2926339175 >> 172.21.15.133:0/2926339175 conn(0x7f382c0b9f00 msgr2=0x7f382c0b7030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:01.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.242+0000 7f38312a6700 1 -- 172.21.15.133:0/2926339175 shutdown_connections 2021-01-03T13:04:01.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.242+0000 7f38312a6700 1 -- 172.21.15.133:0/2926339175 wait complete. 2021-01-03T13:04:01.246 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 33 2021-01-03T13:04:01.255 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:04:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.362+0000 7f3032705700 1 Processor -- start 2021-01-03T13:04:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.362+0000 7f3032705700 1 -- start start 2021-01-03T13:04:01.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3032705700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f302c146b40 0x7f302c14e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:01.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3032705700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302c0605f0 con 0x7f302c0b9b60 2021-01-03T13:04:01.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3032705700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302c0600b0 con 0x7f302c0b9f40 2021-01-03T13:04:01.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3032705700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f302c0aed30 con 0x7f302c146b40 2021-01-03T13:04:01.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3030f02700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f302c0b9f40 0x7f302c146430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56824/0 (socket says 172.21.15.133:56824) 2021-01-03T13:04:01.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3030f02700 1 -- 172.21.15.133:0/1615883244 learned_addr learned my addr 172.21.15.133:0/1615883244 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:01.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3031f04700 1 --2- 172.21.15.133:0/1615883244 >> v2:172.21.15.16:3300/0 conn(0x7f302c146b40 0x7f302c14e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:01.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f301ffff700 1 -- 172.21.15.133:0/1615883244 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714847148 0 0) 0x7f302c0600b0 con 0x7f302c0b9f40 2021-01-03T13:04:01.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f301ffff700 1 -- 172.21.15.133:0/1615883244 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3010003230 con 0x7f302c0b9f40 2021-01-03T13:04:01.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3031f04700 1 -- 172.21.15.133:0/1615883244 >> v1:172.21.15.133:6789/0 conn(0x7f302c0b9f40 legacy=0x7f302c146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3031f04700 1 -- 172.21.15.133:0/1615883244 >> v1:172.21.15.16:6789/0 conn(0x7f302c0b9b60 legacy=0x7f302c0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f301ffff700 1 -- 172.21.15.133:0/1615883244 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312353272 0 0) 0x7f302c0605f0 con 0x7f302c0b9b60 2021-01-03T13:04:01.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3031f04700 1 -- 172.21.15.133:0/1615883244 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c060350 con 0x7f302c146b40 2021-01-03T13:04:01.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3031f04700 1 --2- 172.21.15.133:0/1615883244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f302c146b40 0x7f302c14e510 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f30240032b0 tx=0x7f30240091a0).ready entity=mon.0 client_cookie=df0655e0b5ca6b4c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:01.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f301ffff700 1 -- 172.21.15.133:0/1615883244 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302400b9a0 con 0x7f302c146b40 2021-01-03T13:04:01.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f301ffff700 1 -- 172.21.15.133:0/1615883244 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302400bb00 con 0x7f302c146b40 2021-01-03T13:04:01.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f301ffff700 1 -- 172.21.15.133:0/1615883244 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302400bc70 con 0x7f302c146b40 2021-01-03T13:04:01.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3032705700 1 -- 172.21.15.133:0/1615883244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f302c146b40 msgr2=0x7f302c14e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3032705700 1 --2- 172.21.15.133:0/1615883244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f302c146b40 0x7f302c14e510 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f30240032b0 tx=0x7f30240091a0).stop 2021-01-03T13:04:01.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3032705700 1 -- 172.21.15.133:0/1615883244 shutdown_connections 2021-01-03T13:04:01.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3032705700 1 --2- 172.21.15.133:0/1615883244 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f302c146b40 0x7f302c14e510 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3032705700 1 -- 172.21.15.133:0/1615883244 >> 172.21.15.133:0/1615883244 conn(0x7f302c0b69e0 msgr2=0x7f302c0b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:01.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3032705700 1 -- 172.21.15.133:0/1615883244 shutdown_connections 2021-01-03T13:04:01.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.366+0000 7f3032705700 1 -- 172.21.15.133:0/1615883244 wait complete. 2021-01-03T13:04:01.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.370+0000 7f3032705700 1 Processor -- start 2021-01-03T13:04:01.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.370+0000 7f3032705700 1 -- start start 2021-01-03T13:04:01.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3032705700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f302c0b9b60 0x7f302c0b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:01.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3032705700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f302c0b9f40 0x7f302c09d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:01.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3032705700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f302c146b40 0x7f302c13f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:01.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3032705700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302c0b1370 con 0x7f302c146b40 2021-01-03T13:04:01.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3032705700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302c0b1610 con 0x7f302c0b9b60 2021-01-03T13:04:01.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3032705700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302c0b18b0 con 0x7f302c0b9f40 2021-01-03T13:04:01.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3031703700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f302c0b9b60 0x7f302c0b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:01.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3031703700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f302c0b9b60 0x7f302c0b8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35796/0 (socket says 172.21.15.133:35796) 2021-01-03T13:04:01.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3031703700 1 -- 172.21.15.133:0/55951737 learned_addr learned my addr 172.21.15.133:0/55951737 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:01.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3030f02700 1 --2- 172.21.15.133:0/55951737 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f302c0b9f40 0x7f302c09d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:01.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3031f04700 1 --2- 172.21.15.133:0/55951737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f302c146b40 0x7f302c13f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:01.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3031703700 1 -- 172.21.15.133:0/55951737 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f302c0b9f40 msgr2=0x7f302c09d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3031703700 1 --2- 172.21.15.133:0/55951737 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f302c0b9f40 0x7f302c09d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3031703700 1 -- 172.21.15.133:0/55951737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f302c146b40 msgr2=0x7f302c13f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3031703700 1 --2- 172.21.15.133:0/55951737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f302c146b40 0x7f302c13f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3031703700 1 -- 172.21.15.133:0/55951737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c0b1b50 con 0x7f302c0b9b60 2021-01-03T13:04:01.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3031703700 1 --2- 172.21.15.133:0/55951737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f302c0b9b60 0x7f302c0b8d20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f3020000e90 tx=0x7f3020007a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:01.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f301effd700 1 -- 172.21.15.133:0/55951737 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302000f470 con 0x7f302c0b9b60 2021-01-03T13:04:01.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f301effd700 1 -- 172.21.15.133:0/55951737 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302000f5d0 con 0x7f302c0b9b60 2021-01-03T13:04:01.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f301effd700 1 -- 172.21.15.133:0/55951737 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302000f930 con 0x7f302c0b9b60 2021-01-03T13:04:01.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3032705700 1 -- 172.21.15.133:0/55951737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302c0b0510 con 0x7f302c0b9b60 2021-01-03T13:04:01.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3032705700 1 -- 172.21.15.133:0/55951737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302c13fca0 con 0x7f302c0b9b60 2021-01-03T13:04:01.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.374+0000 7f3032705700 1 -- 172.21.15.133:0/55951737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302c057300 con 0x7f302c0b9b60 2021-01-03T13:04:01.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.378+0000 7f301effd700 1 -- 172.21.15.133:0/55951737 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3020019030 con 0x7f302c0b9b60 2021-01-03T13:04:01.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.378+0000 7f301effd700 1 --2- 172.21.15.133:0/55951737 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3008055330 0x7f30080577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:01.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.378+0000 7f301effd700 1 -- 172.21.15.133:0/55951737 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f302006d470 con 0x7f302c0b9b60 2021-01-03T13:04:01.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.378+0000 7f3030f02700 1 --2- 172.21.15.133:0/55951737 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3008055330 0x7f30080577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:01.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.378+0000 7f3030f02700 1 --2- 172.21.15.133:0/55951737 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3008055330 0x7f30080577f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f302800d000 tx=0x7f3028009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:01.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.382+0000 7f301effd700 1 -- 172.21.15.133:0/55951737 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3020043670 con 0x7f302c0b9b60 2021-01-03T13:04:01.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.518+0000 7f3032705700 1 -- 172.21.15.133:0/55951737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f302c0b1ce0 con 0x7f302c0b9b60 2021-01-03T13:04:01.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.522+0000 7f301effd700 1 -- 172.21.15.133:0/55951737 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16102 (secure 0 0 0) 0x7f3020046c90 con 0x7f302c0b9b60 2021-01-03T13:04:01.522 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:04:01.523 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":78,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:04:00.918010+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:03:57.389227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-01-03T13:03:58.706858+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:04:01.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.522+0000 7f3032705700 1 -- 172.21.15.133:0/55951737 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3008055330 msgr2=0x7f30080577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.522+0000 7f3032705700 1 --2- 172.21.15.133:0/55951737 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3008055330 0x7f30080577f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f302800d000 tx=0x7f3028009040).stop 2021-01-03T13:04:01.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.522+0000 7f3032705700 1 -- 172.21.15.133:0/55951737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f302c0b9b60 msgr2=0x7f302c0b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.522+0000 7f3032705700 1 --2- 172.21.15.133:0/55951737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f302c0b9b60 0x7f302c0b8d20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f3020000e90 tx=0x7f3020007a90).stop 2021-01-03T13:04:01.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.522+0000 7f3032705700 1 -- 172.21.15.133:0/55951737 shutdown_connections 2021-01-03T13:04:01.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.522+0000 7f3032705700 1 --2- 172.21.15.133:0/55951737 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3008055330 0x7f30080577f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.522+0000 7f3032705700 1 --2- 172.21.15.133:0/55951737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f302c146b40 0x7f302c13f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.522+0000 7f3032705700 1 --2- 172.21.15.133:0/55951737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f302c0b9b60 0x7f302c0b8d20 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.522+0000 7f3032705700 1 --2- 172.21.15.133:0/55951737 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f302c0b9f40 0x7f302c09d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.522+0000 7f3032705700 1 -- 172.21.15.133:0/55951737 >> 172.21.15.133:0/55951737 conn(0x7f302c0b69e0 msgr2=0x7f302c0afa10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:01.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.522+0000 7f3032705700 1 -- 172.21.15.133:0/55951737 shutdown_connections 2021-01-03T13:04:01.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.522+0000 7f3032705700 1 -- 172.21.15.133:0/55951737 wait complete. 2021-01-03T13:04:01.537 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:04:01.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.658+0000 7fcee62bb700 1 Processor -- start 2021-01-03T13:04:01.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.658+0000 7fcee62bb700 1 -- start start 2021-01-03T13:04:01.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.658+0000 7fcee62bb700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcee0062450 0x7fcee0067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:01.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.658+0000 7fcee62bb700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee00adff0 con 0x7fcee00adc10 2021-01-03T13:04:01.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.658+0000 7fcee62bb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee005fb80 con 0x7fcee00b33b0 2021-01-03T13:04:01.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.658+0000 7fcee62bb700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee00b1930 con 0x7fcee0062450 2021-01-03T13:04:01.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.658+0000 7fcee751d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcee00b33b0 0x7fcee014f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56840/0 (socket says 172.21.15.133:56840) 2021-01-03T13:04:01.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.658+0000 7fcee751d700 1 -- 172.21.15.133:0/2011054874 learned_addr learned my addr 172.21.15.133:0/2011054874 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:01.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.658+0000 7fcee52b9700 1 --2- 172.21.15.133:0/2011054874 >> v2:172.21.15.16:3300/0 conn(0x7fcee0062450 0x7fcee0067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:01.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.658+0000 7fcee4ab8700 1 -- 172.21.15.133:0/2011054874 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746430653 0 0) 0x7fcee005fb80 con 0x7fcee00b33b0 2021-01-03T13:04:01.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.658+0000 7fcee4ab8700 1 -- 172.21.15.133:0/2011054874 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcecc003230 con 0x7fcee00b33b0 2021-01-03T13:04:01.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.658+0000 7fcee52b9700 1 -- 172.21.15.133:0/2011054874 >> v1:172.21.15.133:6789/0 conn(0x7fcee00b33b0 legacy=0x7fcee014f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.658+0000 7fcee52b9700 1 -- 172.21.15.133:0/2011054874 >> v1:172.21.15.16:6789/0 conn(0x7fcee00adc10 legacy=0x7fcee00b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.658+0000 7fcee52b9700 1 -- 172.21.15.133:0/2011054874 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee00b3860 con 0x7fcee0062450 2021-01-03T13:04:01.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.658+0000 7fcee4ab8700 1 -- 172.21.15.133:0/2011054874 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527846143 0 0) 0x7fcee00adff0 con 0x7fcee00adc10 2021-01-03T13:04:01.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.658+0000 7fcee52b9700 1 --2- 172.21.15.133:0/2011054874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcee0062450 0x7fcee0067cb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fced0002f30 tx=0x7fced0006dc0).ready entity=mon.0 client_cookie=f14f22e23fbdc6a2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:01.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.662+0000 7fcee4ab8700 1 -- 172.21.15.133:0/2011054874 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fced0009800 con 0x7fcee0062450 2021-01-03T13:04:01.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.662+0000 7fcee4ab8700 1 -- 172.21.15.133:0/2011054874 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced0009960 con 0x7fcee0062450 2021-01-03T13:04:01.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.662+0000 7fcee4ab8700 1 -- 172.21.15.133:0/2011054874 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fced0009cc0 con 0x7fcee0062450 2021-01-03T13:04:01.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.662+0000 7fcee62bb700 1 -- 172.21.15.133:0/2011054874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcee0062450 msgr2=0x7fcee0067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.662+0000 7fcee62bb700 1 --2- 172.21.15.133:0/2011054874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcee0062450 0x7fcee0067cb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fced0002f30 tx=0x7fced0006dc0).stop 2021-01-03T13:04:01.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.662+0000 7fcee62bb700 1 -- 172.21.15.133:0/2011054874 shutdown_connections 2021-01-03T13:04:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.662+0000 7fcee62bb700 1 --2- 172.21.15.133:0/2011054874 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcee0062450 0x7fcee0067cb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.662+0000 7fcee62bb700 1 -- 172.21.15.133:0/2011054874 >> 172.21.15.133:0/2011054874 conn(0x7fcee0060d10 msgr2=0x7fcee0061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.662+0000 7fcee62bb700 1 -- 172.21.15.133:0/2011054874 shutdown_connections 2021-01-03T13:04:01.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.662+0000 7fcee62bb700 1 -- 172.21.15.133:0/2011054874 wait complete. 2021-01-03T13:04:01.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee62bb700 1 Processor -- start 2021-01-03T13:04:01.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee62bb700 1 -- start start 2021-01-03T13:04:01.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee62bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee0062450 0x7fcee00b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:01.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee62bb700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcee00adc10 0x7fcee0120380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:01.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee62bb700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcee00b33b0 0x7fcee0120d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:01.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee62bb700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee0128d10 con 0x7fcee00adc10 2021-01-03T13:04:01.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee62bb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee01280c0 con 0x7fcee0062450 2021-01-03T13:04:01.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee62bb700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee0128a70 con 0x7fcee00b33b0 2021-01-03T13:04:01.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee5aba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee0062450 0x7fcee00b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:01.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee5aba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee0062450 0x7fcee00b6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35810/0 (socket says 172.21.15.133:35810) 2021-01-03T13:04:01.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee5aba700 1 -- 172.21.15.133:0/3145223304 learned_addr learned my addr 172.21.15.133:0/3145223304 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:01.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee52b9700 1 --2- 172.21.15.133:0/3145223304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcee00adc10 0x7fcee0120380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:01.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee751d700 1 --2- 172.21.15.133:0/3145223304 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcee00b33b0 0x7fcee0120d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:01.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee5aba700 1 -- 172.21.15.133:0/3145223304 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcee00b33b0 msgr2=0x7fcee0120d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee5aba700 1 --2- 172.21.15.133:0/3145223304 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcee00b33b0 0x7fcee0120d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee5aba700 1 -- 172.21.15.133:0/3145223304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcee00adc10 msgr2=0x7fcee0120380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee5aba700 1 --2- 172.21.15.133:0/3145223304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcee00adc10 0x7fcee0120380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee5aba700 1 -- 172.21.15.133:0/3145223304 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee0064bd0 con 0x7fcee0062450 2021-01-03T13:04:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee5aba700 1 --2- 172.21.15.133:0/3145223304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee0062450 0x7fcee00b6a50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fcedc000e90 tx=0x7fcedc007ab0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fced67fc700 1 -- 172.21.15.133:0/3145223304 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcedc011680 con 0x7fcee0062450 2021-01-03T13:04:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fced67fc700 1 -- 172.21.15.133:0/3145223304 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc0117e0 con 0x7fcee0062450 2021-01-03T13:04:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee62bb700 1 -- 172.21.15.133:0/3145223304 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee0064e70 con 0x7fcee0062450 2021-01-03T13:04:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fced67fc700 1 -- 172.21.15.133:0/3145223304 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcedc011b40 con 0x7fcee0062450 2021-01-03T13:04:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.666+0000 7fcee62bb700 1 -- 172.21.15.133:0/3145223304 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee00b7170 con 0x7fcee0062450 2021-01-03T13:04:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.670+0000 7fced67fc700 1 -- 172.21.15.133:0/3145223304 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fcedc011ca0 con 0x7fcee0062450 2021-01-03T13:04:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.670+0000 7fcee62bb700 1 -- 172.21.15.133:0/3145223304 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee0065000 con 0x7fcee0062450 2021-01-03T13:04:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.670+0000 7fced67fc700 1 --2- 172.21.15.133:0/3145223304 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcec8055320 0x7fcec80577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.670+0000 7fcee52b9700 1 --2- 172.21.15.133:0/3145223304 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcec8055320 0x7fcec80577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.670+0000 7fced67fc700 1 -- 172.21.15.133:0/3145223304 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcedc06fb50 con 0x7fcee0062450 2021-01-03T13:04:01.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.670+0000 7fcee52b9700 1 --2- 172.21.15.133:0/3145223304 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcec8055320 0x7fcec80577e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fced001a000 tx=0x7fced0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:01.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.678+0000 7fced67fc700 1 -- 172.21.15.133:0/3145223304 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcedc045ce0 con 0x7fcee0062450 2021-01-03T13:04:01.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.870+0000 7fcee62bb700 1 -- 172.21.15.133:0/3145223304 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fcee0057300 con 0x7fcee0062450 2021-01-03T13:04:01.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.882+0000 7fced67fc700 1 -- 172.21.15.133:0/3145223304 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v19) v1 ==== 184+0+0 (secure 0 0 0) 0x7fcedc015070 con 0x7fcee0062450 2021-01-03T13:04:01.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.882+0000 7fcee62bb700 1 -- 172.21.15.133:0/3145223304 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcec8055320 msgr2=0x7fcec80577e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.882+0000 7fcee62bb700 1 --2- 172.21.15.133:0/3145223304 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcec8055320 0x7fcec80577e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fced001a000 tx=0x7fced0015000).stop 2021-01-03T13:04:01.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.882+0000 7fcee62bb700 1 -- 172.21.15.133:0/3145223304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee0062450 msgr2=0x7fcee00b6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:01.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.882+0000 7fcee62bb700 1 --2- 172.21.15.133:0/3145223304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee0062450 0x7fcee00b6a50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fcedc000e90 tx=0x7fcedc007ab0).stop 2021-01-03T13:04:01.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.882+0000 7fcee62bb700 1 -- 172.21.15.133:0/3145223304 shutdown_connections 2021-01-03T13:04:01.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.882+0000 7fcee62bb700 1 --2- 172.21.15.133:0/3145223304 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcec8055320 0x7fcec80577e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.882+0000 7fcee62bb700 1 --2- 172.21.15.133:0/3145223304 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcee00b33b0 0x7fcee0120d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.882+0000 7fcee62bb700 1 --2- 172.21.15.133:0/3145223304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee0062450 0x7fcee00b6a50 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.882+0000 7fcee62bb700 1 --2- 172.21.15.133:0/3145223304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcee00adc10 0x7fcee0120380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:01.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.882+0000 7fcee62bb700 1 -- 172.21.15.133:0/3145223304 >> 172.21.15.133:0/3145223304 conn(0x7fcee0060d10 msgr2=0x7fcee00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:01.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.882+0000 7fcee62bb700 1 -- 172.21.15.133:0/3145223304 shutdown_connections 2021-01-03T13:04:01.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:01.882+0000 7fcee62bb700 1 -- 172.21.15.133:0/3145223304 wait complete. 2021-01-03T13:04:01.887 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2021-01-03T13:04:01.898 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:04:02.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77af59e700 1 Processor -- start 2021-01-03T13:04:02.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77af59e700 1 -- start start 2021-01-03T13:04:02.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77af59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f77b0062450 0x7f77b0067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:02.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77af59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f77b00b33b0 0x7f77b014f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:02.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77af59e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b00adff0 con 0x7f77b00adc10 2021-01-03T13:04:02.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77af59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b00b1930 con 0x7f77b0062450 2021-01-03T13:04:02.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77af59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b005fb80 con 0x7f77b00b33b0 2021-01-03T13:04:02.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77b4e37700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f77b00b33b0 0x7f77b014f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:02.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77b4e37700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f77b00b33b0 0x7f77b014f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35822/0 (socket says 172.21.15.133:35822) 2021-01-03T13:04:02.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77b4e37700 1 -- 172.21.15.133:0/1832414425 learned_addr learned my addr 172.21.15.133:0/1832414425 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:02.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77ae59c700 1 --2- 172.21.15.133:0/1832414425 >> v2:172.21.15.16:3300/0 conn(0x7f77b0062450 0x7f77b0067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:02.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77b4e37700 1 -- 172.21.15.133:0/1832414425 >> v2:172.21.15.16:3300/0 conn(0x7f77b0062450 msgr2=0x7f77b0067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:02.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77b4e37700 1 --2- 172.21.15.133:0/1832414425 >> v2:172.21.15.16:3300/0 conn(0x7f77b0062450 0x7f77b0067cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77b4e37700 1 -- 172.21.15.133:0/1832414425 >> v1:172.21.15.16:6789/0 conn(0x7f77b00adc10 legacy=0x7f77b00b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:02.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77b4e37700 1 -- 172.21.15.133:0/1832414425 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b00b3860 con 0x7f77b00b33b0 2021-01-03T13:04:02.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77b4e37700 1 --2- 172.21.15.133:0/1832414425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b00b33b0 0x7f77b014f870 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f77a80032b0 tx=0x7f77a8009270).ready entity=mon.1 client_cookie=4fa8511728278df4 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:02.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77add9b700 1 -- 172.21.15.133:0/1832414425 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77a800bc00 con 0x7f77b00b33b0 2021-01-03T13:04:02.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77add9b700 1 -- 172.21.15.133:0/1832414425 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a800bd60 con 0x7f77b00b33b0 2021-01-03T13:04:02.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77add9b700 1 -- 172.21.15.133:0/1832414425 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77a8011400 con 0x7f77b00b33b0 2021-01-03T13:04:02.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77af59e700 1 -- 172.21.15.133:0/1832414425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b00b33b0 msgr2=0x7f77b014f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:02.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.022+0000 7f77af59e700 1 --2- 172.21.15.133:0/1832414425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b00b33b0 0x7f77b014f870 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f77a80032b0 tx=0x7f77a8009270).stop 2021-01-03T13:04:02.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.026+0000 7f77af59e700 1 -- 172.21.15.133:0/1832414425 shutdown_connections 2021-01-03T13:04:02.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.026+0000 7f77af59e700 1 --2- 172.21.15.133:0/1832414425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b00b33b0 0x7f77b014f870 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.026+0000 7f77af59e700 1 --2- 172.21.15.133:0/1832414425 >> v2:172.21.15.16:3300/0 conn(0x7f77b0062450 0x7f77b0067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.026+0000 7f77af59e700 1 -- 172.21.15.133:0/1832414425 >> 172.21.15.133:0/1832414425 conn(0x7f77b0060d10 msgr2=0x7f77b0061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:02.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.026+0000 7f77af59e700 1 -- 172.21.15.133:0/1832414425 shutdown_connections 2021-01-03T13:04:02.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.026+0000 7f77af59e700 1 -- 172.21.15.133:0/1832414425 wait complete. 2021-01-03T13:04:02.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.026+0000 7f77af59e700 1 Processor -- start 2021-01-03T13:04:02.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.026+0000 7f77af59e700 1 -- start start 2021-01-03T13:04:02.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77af59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77b0062450 0x7f77b014f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:02.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77af59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b00adc10 0x7f77b011eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77af59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77b00b33b0 0x7f77b011f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77af59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b0150500 con 0x7f77b0062450 2021-01-03T13:04:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77af59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00662f0 con 0x7f77b00adc10 2021-01-03T13:04:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77af59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b01514e0 con 0x7f77b00b33b0 2021-01-03T13:04:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77ae59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b00adc10 0x7f77b011eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:02.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77ae59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b00adc10 0x7f77b011eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35826/0 (socket says 172.21.15.133:35826) 2021-01-03T13:04:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77ae59c700 1 -- 172.21.15.133:0/1043120663 learned_addr learned my addr 172.21.15.133:0/1043120663 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77aed9d700 1 --2- 172.21.15.133:0/1043120663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77b0062450 0x7f77b014f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77b4e37700 1 --2- 172.21.15.133:0/1043120663 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77b00b33b0 0x7f77b011f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:02.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77ae59c700 1 -- 172.21.15.133:0/1043120663 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77b00b33b0 msgr2=0x7f77b011f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:02.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77ae59c700 1 --2- 172.21.15.133:0/1043120663 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77b00b33b0 0x7f77b011f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77ae59c700 1 -- 172.21.15.133:0/1043120663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77b0062450 msgr2=0x7f77b014f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:02.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77ae59c700 1 --2- 172.21.15.133:0/1043120663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77b0062450 0x7f77b014f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77ae59c700 1 -- 172.21.15.133:0/1043120663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b0066550 con 0x7f77b00adc10 2021-01-03T13:04:02.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77aed9d700 1 --2- 172.21.15.133:0/1043120663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77b0062450 0x7f77b014f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:04:02.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77ae59c700 1 --2- 172.21.15.133:0/1043120663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b00adc10 0x7f77b011eca0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f77a400a000 tx=0x7f77a4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:02.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f779f7fe700 1 -- 172.21.15.133:0/1043120663 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77a4009980 con 0x7f77b00adc10 2021-01-03T13:04:02.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f779f7fe700 1 -- 172.21.15.133:0/1043120663 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a4009ae0 con 0x7f77b00adc10 2021-01-03T13:04:02.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77af59e700 1 -- 172.21.15.133:0/1043120663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b014fde0 con 0x7f77b00adc10 2021-01-03T13:04:02.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f779f7fe700 1 -- 172.21.15.133:0/1043120663 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77a4009e40 con 0x7f77b00adc10 2021-01-03T13:04:02.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77af59e700 1 -- 172.21.15.133:0/1043120663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b011f680 con 0x7f77b00adc10 2021-01-03T13:04:02.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.030+0000 7f77af59e700 1 -- 172.21.15.133:0/1043120663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b0057300 con 0x7f77b00adc10 2021-01-03T13:04:02.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.034+0000 7f779f7fe700 1 -- 172.21.15.133:0/1043120663 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f77a4013480 con 0x7f77b00adc10 2021-01-03T13:04:02.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.034+0000 7f779f7fe700 1 --2- 172.21.15.133:0/1043120663 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77940553b0 0x7f7794057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:02.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.034+0000 7f779f7fe700 1 -- 172.21.15.133:0/1043120663 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f77a406e6e0 con 0x7f77b00adc10 2021-01-03T13:04:02.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.034+0000 7f77aed9d700 1 --2- 172.21.15.133:0/1043120663 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77940553b0 0x7f7794057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.034+0000 7f77aed9d700 1 --2- 172.21.15.133:0/1043120663 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77940553b0 0x7f7794057870 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f77a000d000 tx=0x7f77a0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:02.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.038+0000 7f779f7fe700 1 -- 172.21.15.133:0/1043120663 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f77a4044870 con 0x7f77b00adc10 2021-01-03T13:04:02.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.234+0000 7f77af59e700 1 -- 172.21.15.133:0/1043120663 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f77b0066ef0 con 0x7f77b00adc10 2021-01-03T13:04:02.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.242+0000 7f779f7fe700 1 -- 172.21.15.133:0/1043120663 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7f77a4047e90 con 0x7f77b00adc10 2021-01-03T13:04:02.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.246+0000 7f77af59e700 1 -- 172.21.15.133:0/1043120663 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77940553b0 msgr2=0x7f7794057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:02.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.246+0000 7f77af59e700 1 --2- 172.21.15.133:0/1043120663 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77940553b0 0x7f7794057870 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f77a000d000 tx=0x7f77a0009040).stop 2021-01-03T13:04:02.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.246+0000 7f77af59e700 1 -- 172.21.15.133:0/1043120663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b00adc10 msgr2=0x7f77b011eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:02.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.246+0000 7f77af59e700 1 --2- 172.21.15.133:0/1043120663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b00adc10 0x7f77b011eca0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f77a400a000 tx=0x7f77a4008040).stop 2021-01-03T13:04:02.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.246+0000 7f77af59e700 1 -- 172.21.15.133:0/1043120663 shutdown_connections 2021-01-03T13:04:02.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.246+0000 7f77af59e700 1 --2- 172.21.15.133:0/1043120663 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77940553b0 0x7f7794057870 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.246+0000 7f77af59e700 1 --2- 172.21.15.133:0/1043120663 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77b0062450 0x7f77b014f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.246+0000 7f77af59e700 1 --2- 172.21.15.133:0/1043120663 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77b00b33b0 0x7f77b011f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.246+0000 7f77af59e700 1 --2- 172.21.15.133:0/1043120663 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77b00adc10 0x7f77b011eca0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.246+0000 7f77af59e700 1 -- 172.21.15.133:0/1043120663 >> 172.21.15.133:0/1043120663 conn(0x7f77b0060d10 msgr2=0x7f77b00ae380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:02.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.246+0000 7f77af59e700 1 -- 172.21.15.133:0/1043120663 shutdown_connections 2021-01-03T13:04:02.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.246+0000 7f77af59e700 1 -- 172.21.15.133:0/1043120663 wait complete. 2021-01-03T13:04:02.248 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.1 2021-01-03T13:04:02.260 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:04:02.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.374+0000 7f577aac8700 1 Processor -- start 2021-01-03T13:04:02.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.374+0000 7f577aac8700 1 -- start start 2021-01-03T13:04:02.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.374+0000 7f577aac8700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f57740606f0 0x7f5774060ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:02.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.374+0000 7f577aac8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5774143050 0x7f57740aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:02.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.374+0000 7f577aac8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57740b1210 con 0x7f57740b0ac0 2021-01-03T13:04:02.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.374+0000 7f577aac8700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57740afd30 con 0x7f57740606f0 2021-01-03T13:04:02.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.374+0000 7f577aac8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57740afa90 con 0x7f5774143050 2021-01-03T13:04:02.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.374+0000 7f57792c5700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f57740b0ac0 0x7f57740abc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56864/0 (socket says 172.21.15.133:56864) 2021-01-03T13:04:02.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.374+0000 7f57792c5700 1 -- 172.21.15.133:0/36944599 learned_addr learned my addr 172.21.15.133:0/36944599 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:02.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.374+0000 7f577a2c7700 1 --2- 172.21.15.133:0/36944599 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5774143050 0x7f57740aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:02.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.374+0000 7f5779ac6700 1 --2- 172.21.15.133:0/36944599 >> v2:172.21.15.16:3300/0 conn(0x7f57740606f0 0x7f5774060ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:02.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.374+0000 7f5778ac4700 1 -- 172.21.15.133:0/36944599 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883173272 0 0) 0x7f57740b1210 con 0x7f57740b0ac0 2021-01-03T13:04:02.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.374+0000 7f5778ac4700 1 -- 172.21.15.133:0/36944599 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f575c003230 con 0x7f57740b0ac0 2021-01-03T13:04:02.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f577a2c7700 1 -- 172.21.15.133:0/36944599 >> v2:172.21.15.16:3300/0 conn(0x7f57740606f0 msgr2=0x7f5774060ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:02.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f577a2c7700 1 --2- 172.21.15.133:0/36944599 >> v2:172.21.15.16:3300/0 conn(0x7f57740606f0 0x7f5774060ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f577a2c7700 1 -- 172.21.15.133:0/36944599 >> v1:172.21.15.133:6789/0 conn(0x7f57740b0ac0 legacy=0x7f57740abc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:02.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f577a2c7700 1 -- 172.21.15.133:0/36944599 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57740b1470 con 0x7f5774143050 2021-01-03T13:04:02.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f5779ac6700 1 --2- 172.21.15.133:0/36944599 >> v2:172.21.15.16:3300/0 conn(0x7f57740606f0 0x7f5774060ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:04:02.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f577a2c7700 1 --2- 172.21.15.133:0/36944599 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5774143050 0x7f57740aa0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f576c0032b0 tx=0x7f576c0091a0).ready entity=mon.2 client_cookie=cb739d1378cfc351 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:02.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f5778ac4700 1 -- 172.21.15.133:0/36944599 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f576c00b940 con 0x7f5774143050 2021-01-03T13:04:02.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f5778ac4700 1 -- 172.21.15.133:0/36944599 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c00baa0 con 0x7f5774143050 2021-01-03T13:04:02.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f5778ac4700 1 -- 172.21.15.133:0/36944599 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f576c00bc10 con 0x7f5774143050 2021-01-03T13:04:02.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f577aac8700 1 -- 172.21.15.133:0/36944599 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5774143050 msgr2=0x7f57740aa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:02.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f577aac8700 1 --2- 172.21.15.133:0/36944599 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5774143050 0x7f57740aa0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f576c0032b0 tx=0x7f576c0091a0).stop 2021-01-03T13:04:02.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f577aac8700 1 -- 172.21.15.133:0/36944599 shutdown_connections 2021-01-03T13:04:02.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f577aac8700 1 --2- 172.21.15.133:0/36944599 >> v2:172.21.15.16:3300/0 conn(0x7f57740606f0 0x7f5774060ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f577aac8700 1 --2- 172.21.15.133:0/36944599 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5774143050 0x7f57740aa0f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f577aac8700 1 -- 172.21.15.133:0/36944599 >> 172.21.15.133:0/36944599 conn(0x7f577405bdf0 msgr2=0x7f577405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:02.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f577aac8700 1 -- 172.21.15.133:0/36944599 shutdown_connections 2021-01-03T13:04:02.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f577aac8700 1 -- 172.21.15.133:0/36944599 wait complete. 2021-01-03T13:04:02.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.378+0000 7f577aac8700 1 Processor -- start 2021-01-03T13:04:02.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577aac8700 1 -- start start 2021-01-03T13:04:02.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577aac8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57740606f0 0x7f57740b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:02.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577aac8700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57740b0ac0 0x7f57740b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:02.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577aac8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5774143050 0x7f5774144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:02.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577aac8700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5774152c90 con 0x7f57740b0ac0 2021-01-03T13:04:02.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577aac8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57740b3510 con 0x7f5774143050 2021-01-03T13:04:02.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577aac8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57740b2d00 con 0x7f57740606f0 2021-01-03T13:04:02.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577a2c7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5774143050 0x7f5774144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:02.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577a2c7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5774143050 0x7f5774144330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35842/0 (socket says 172.21.15.133:35842) 2021-01-03T13:04:02.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577a2c7700 1 -- 172.21.15.133:0/256733097 learned_addr learned my addr 172.21.15.133:0/256733097 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:02.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f5779ac6700 1 --2- 172.21.15.133:0/256733097 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57740606f0 0x7f57740b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:02.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f57792c5700 1 --2- 172.21.15.133:0/256733097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57740b0ac0 0x7f57740b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:02.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577a2c7700 1 -- 172.21.15.133:0/256733097 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57740606f0 msgr2=0x7f57740b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:02.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577a2c7700 1 --2- 172.21.15.133:0/256733097 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57740606f0 0x7f57740b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577a2c7700 1 -- 172.21.15.133:0/256733097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57740b0ac0 msgr2=0x7f57740b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:02.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577a2c7700 1 --2- 172.21.15.133:0/256733097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57740b0ac0 0x7f57740b4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577a2c7700 1 -- 172.21.15.133:0/256733097 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57740b2fa0 con 0x7f5774143050 2021-01-03T13:04:02.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577a2c7700 1 --2- 172.21.15.133:0/256733097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5774143050 0x7f5774144330 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f5774151da0 tx=0x7f576c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:02.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f5762ffd700 1 -- 172.21.15.133:0/256733097 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f576c0203f0 con 0x7f5774143050 2021-01-03T13:04:02.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f5762ffd700 1 -- 172.21.15.133:0/256733097 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c020550 con 0x7f5774143050 2021-01-03T13:04:02.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577aac8700 1 -- 172.21.15.133:0/256733097 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5774146310 con 0x7f5774143050 2021-01-03T13:04:02.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f5762ffd700 1 -- 172.21.15.133:0/256733097 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f576c0208b0 con 0x7f5774143050 2021-01-03T13:04:02.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.382+0000 7f577aac8700 1 -- 172.21.15.133:0/256733097 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57740b3b60 con 0x7f5774143050 2021-01-03T13:04:02.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.386+0000 7f577aac8700 1 -- 172.21.15.133:0/256733097 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57740b3680 con 0x7f5774143050 2021-01-03T13:04:02.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.386+0000 7f5762ffd700 1 -- 172.21.15.133:0/256733097 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f576c01e070 con 0x7f5774143050 2021-01-03T13:04:02.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.386+0000 7f5762ffd700 1 --2- 172.21.15.133:0/256733097 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57540554e0 0x7f57540579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:02.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.386+0000 7f5762ffd700 1 -- 172.21.15.133:0/256733097 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f576c06eae0 con 0x7f5774143050 2021-01-03T13:04:02.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.386+0000 7f5779ac6700 1 --2- 172.21.15.133:0/256733097 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57540554e0 0x7f57540579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:02.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.386+0000 7f5779ac6700 1 --2- 172.21.15.133:0/256733097 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57540554e0 0x7f57540579a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f577000b000 tx=0x7f5770008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:02.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.394+0000 7f5762ffd700 1 -- 172.21.15.133:0/256733097 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f57740b3680 con 0x7f5774143050 2021-01-03T13:04:02.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.582+0000 7f577aac8700 1 -- 172.21.15.133:0/256733097 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57740b3650 con 0x7f5774143050 2021-01-03T13:04:02.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.582+0000 7f5762ffd700 1 -- 172.21.15.133:0/256733097 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2496 (secure 0 0 0) 0x7f576c01b090 con 0x7f5774143050 2021-01-03T13:04:02.584 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:04:02.584 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/524155035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":524155035},{"type":"v1","addr":"172.21.15.16:6833","nonce":524155035}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":31},{"gid":6175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1381538323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1381538323},{"type":"v1","addr":"172.21.15.133:6835","nonce":1381538323}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:03:59.914082+0000","modified":"2021-01-03T13:04:00.917279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6178},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6178":{"gid":6178,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1189475847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1189475847},{"type":"v1","addr":"172.21.15.133:6837","nonce":1189475847}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-01-03T13:04:02.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.586+0000 7f577aac8700 1 -- 172.21.15.133:0/256733097 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57540554e0 msgr2=0x7f57540579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:02.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.586+0000 7f577aac8700 1 --2- 172.21.15.133:0/256733097 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57540554e0 0x7f57540579a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f577000b000 tx=0x7f5770008040).stop 2021-01-03T13:04:02.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.586+0000 7f577aac8700 1 -- 172.21.15.133:0/256733097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5774143050 msgr2=0x7f5774144330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:02.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.586+0000 7f577aac8700 1 --2- 172.21.15.133:0/256733097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5774143050 0x7f5774144330 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f5774151da0 tx=0x7f576c016000).stop 2021-01-03T13:04:02.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.586+0000 7f577aac8700 1 -- 172.21.15.133:0/256733097 shutdown_connections 2021-01-03T13:04:02.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.586+0000 7f577aac8700 1 --2- 172.21.15.133:0/256733097 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57540554e0 0x7f57540579a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.586+0000 7f577aac8700 1 --2- 172.21.15.133:0/256733097 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5774143050 0x7f5774144330 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.586+0000 7f577aac8700 1 --2- 172.21.15.133:0/256733097 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57740606f0 0x7f57740b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.586+0000 7f577aac8700 1 --2- 172.21.15.133:0/256733097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57740b0ac0 0x7f57740b4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:02.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.586+0000 7f577aac8700 1 -- 172.21.15.133:0/256733097 >> 172.21.15.133:0/256733097 conn(0x7f577405bdf0 msgr2=0x7f5774141960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:02.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.586+0000 7f577aac8700 1 -- 172.21.15.133:0/256733097 shutdown_connections 2021-01-03T13:04:02.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:02.586+0000 7f577aac8700 1 -- 172.21.15.133:0/256733097 wait complete. 2021-01-03T13:04:02.591 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 33 2021-01-03T13:04:02.900 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:03:59.914082+0000', 'modified': '2021-01-03T13:04:00.917279+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6178}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6178': {'gid': 6178, 'name': 'c', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/1189475847', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 1189475847}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 1189475847}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:04:02.901 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:04:02.901 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T13:04:03.030 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":6178,"want_state":"up:active","state":"up:active","rank_uptime":3.104086218,"mdsmap_epoch":33,"osdmap_epoch":79,"osdmap_epoch_barrier":77,"uptime":8.5467999799999994} 2021-01-03T13:04:03.031 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 6178, "mdsmap_epoch": 33, "osdmap_epoch": 79, "osdmap_epoch_barrier": 77, "rank_uptime": 3.104086218, "state": "up:active", "uptime": 8.54679998, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:04:03.032 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:04:03.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.138+0000 7f872d644700 1 Processor -- start 2021-01-03T13:04:03.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.138+0000 7f872d644700 1 -- start start 2021-01-03T13:04:03.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.138+0000 7f872d644700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f87280b0c90 0x7f87280b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.138+0000 7f872d644700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87280b5c00 0x7f8728143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.138+0000 7f872d644700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8728060da0 con 0x7f87280b52c0 2021-01-03T13:04:03.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.138+0000 7f872d644700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8728067a90 con 0x7f87280b0c90 2021-01-03T13:04:03.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.138+0000 7f872d644700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87280b0ad0 con 0x7f87280b5c00 2021-01-03T13:04:03.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.138+0000 7f8727fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f87280b52c0 0x7f8728098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56880/0 (socket says 172.21.15.133:56880) 2021-01-03T13:04:03.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.138+0000 7f8727fff700 1 -- 172.21.15.133:0/1509259072 learned_addr learned my addr 172.21.15.133:0/1509259072 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:03.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.138+0000 7f871ffff700 1 --2- 172.21.15.133:0/1509259072 >> v2:172.21.15.16:3300/0 conn(0x7f87280b0c90 0x7f87280b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.138+0000 7f872ce43700 1 --2- 172.21.15.133:0/1509259072 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87280b5c00 0x7f8728143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 -- 172.21.15.133:0/1509259072 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671358205 0 0) 0x7f8728060da0 con 0x7f87280b52c0 2021-01-03T13:04:03.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 -- 172.21.15.133:0/1509259072 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8708003230 con 0x7f87280b52c0 2021-01-03T13:04:03.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 -- 172.21.15.133:0/1509259072 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1230740765 0 0) 0x7f8708003230 con 0x7f87280b52c0 2021-01-03T13:04:03.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 -- 172.21.15.133:0/1509259072 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87280b5c00 msgr2=0x7f8728143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:03.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 --2- 172.21.15.133:0/1509259072 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87280b5c00 0x7f8728143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 -- 172.21.15.133:0/1509259072 >> v2:172.21.15.16:3300/0 conn(0x7f87280b0c90 msgr2=0x7f87280b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:03.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 --2- 172.21.15.133:0/1509259072 >> v2:172.21.15.16:3300/0 conn(0x7f87280b0c90 0x7f87280b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 -- 172.21.15.133:0/1509259072 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87280b56a0 con 0x7f87280b52c0 2021-01-03T13:04:03.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 -- 172.21.15.133:0/1509259072 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f87180016d0 con 0x7f87280b52c0 2021-01-03T13:04:03.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 -- 172.21.15.133:0/1509259072 >> v1:172.21.15.133:6789/0 conn(0x7f87280b52c0 legacy=0x7f8728098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 --2- 172.21.15.133:0/1509259072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8708003720 0x7f8708003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 --2- 172.21.15.133:0/1509259072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87080044d0 0x7f8708004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 --2- 172.21.15.133:0/1509259072 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87280b5c00 0x7f8708004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 -- 172.21.15.133:0/1509259072 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8728067a90 con 0x7f87080044d0 2021-01-03T13:04:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 -- 172.21.15.133:0/1509259072 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87280b0ad0 con 0x7f8708003720 2021-01-03T13:04:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 -- 172.21.15.133:0/1509259072 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8708004260 con 0x7f87280b5c00 2021-01-03T13:04:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f8727fff700 1 --2- 172.21.15.133:0/1509259072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8708003720 0x7f8708003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f872ce43700 1 --2- 172.21.15.133:0/1509259072 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87280b5c00 0x7f8708004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f871ffff700 1 --2- 172.21.15.133:0/1509259072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87080044d0 0x7f8708004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f8727fff700 1 -- 172.21.15.133:0/1509259072 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87280b5c00 msgr2=0x7f8708004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:03.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f8727fff700 1 --2- 172.21.15.133:0/1509259072 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87280b5c00 0x7f8708004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f8727fff700 1 -- 172.21.15.133:0/1509259072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87080044d0 msgr2=0x7f8708004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:03.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f8727fff700 1 --2- 172.21.15.133:0/1509259072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87080044d0 0x7f8708004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f8727fff700 1 -- 172.21.15.133:0/1509259072 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8708003230 con 0x7f8708003720 2021-01-03T13:04:03.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f871ffff700 1 --2- 172.21.15.133:0/1509259072 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87080044d0 0x7f8708004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:04:03.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f8727fff700 1 --2- 172.21.15.133:0/1509259072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8708003720 0x7f8708003b40 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f87180013e0 tx=0x7f87280b0070).ready entity=mon.1 client_cookie=65ef943c901d7fcb server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:03.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 -- 172.21.15.133:0/1509259072 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f871800ce00 con 0x7f8708003720 2021-01-03T13:04:03.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 -- 172.21.15.133:0/1509259072 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87180072e0 con 0x7f8708003720 2021-01-03T13:04:03.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f87277fe700 1 -- 172.21.15.133:0/1509259072 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87180055e0 con 0x7f8708003720 2021-01-03T13:04:03.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f872d644700 1 -- 172.21.15.133:0/1509259072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8708003720 msgr2=0x7f8708003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f872d644700 1 --2- 172.21.15.133:0/1509259072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8708003720 0x7f8708003b40 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f87180013e0 tx=0x7f87280b0070).stop 2021-01-03T13:04:03.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f872ce43700 1 -- 172.21.15.133:0/1509259072 reap_dead start 2021-01-03T13:04:03.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f872d644700 1 -- 172.21.15.133:0/1509259072 shutdown_connections 2021-01-03T13:04:03.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f872d644700 1 -- 172.21.15.133:0/1509259072 >> 172.21.15.133:0/1509259072 conn(0x7f872805bdf0 msgr2=0x7f872805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f872d644700 1 -- 172.21.15.133:0/1509259072 shutdown_connections 2021-01-03T13:04:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.142+0000 7f872d644700 1 -- 172.21.15.133:0/1509259072 wait complete. 2021-01-03T13:04:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f872d644700 1 Processor -- start 2021-01-03T13:04:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f872d644700 1 -- start start 2021-01-03T13:04:03.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f872d644700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87280af1a0 0x7f87280af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f872d644700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87281561b0 0x7f8728156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f872d644700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8728156b20 0x7f8728159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f872d644700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87280aa9b0 con 0x7f8728156b20 2021-01-03T13:04:03.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f872d644700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87280ab5a0 con 0x7f87281561b0 2021-01-03T13:04:03.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f872d644700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87280ab060 con 0x7f87280af1a0 2021-01-03T13:04:03.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f871ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87281561b0 0x7f8728156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f871ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87281561b0 0x7f8728156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35862/0 (socket says 172.21.15.133:35862) 2021-01-03T13:04:03.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f871ffff700 1 -- 172.21.15.133:0/724100654 learned_addr learned my addr 172.21.15.133:0/724100654 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:03.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f872ce43700 1 --2- 172.21.15.133:0/724100654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8728156b20 0x7f8728159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f8727fff700 1 --2- 172.21.15.133:0/724100654 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87280af1a0 0x7f87280af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f871ffff700 1 -- 172.21.15.133:0/724100654 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87280af1a0 msgr2=0x7f87280af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f871ffff700 1 --2- 172.21.15.133:0/724100654 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87280af1a0 0x7f87280af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f871ffff700 1 -- 172.21.15.133:0/724100654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8728156b20 msgr2=0x7f8728159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f871ffff700 1 --2- 172.21.15.133:0/724100654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8728156b20 0x7f8728159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f871ffff700 1 -- 172.21.15.133:0/724100654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87280ab300 con 0x7f87281561b0 2021-01-03T13:04:03.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f8727fff700 1 --2- 172.21.15.133:0/724100654 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87280af1a0 0x7f87280af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:04:03.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f872ce43700 1 --2- 172.21.15.133:0/724100654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8728156b20 0x7f8728159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:04:03.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f871ffff700 1 --2- 172.21.15.133:0/724100654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87281561b0 0x7f8728156630 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f8728067730 tx=0x7f8710008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:03.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f8725ffb700 1 -- 172.21.15.133:0/724100654 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f871000ea20 con 0x7f87281561b0 2021-01-03T13:04:03.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f8725ffb700 1 -- 172.21.15.133:0/724100654 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871000eb80 con 0x7f87281561b0 2021-01-03T13:04:03.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f872d644700 1 -- 172.21.15.133:0/724100654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87280aebb0 con 0x7f87281561b0 2021-01-03T13:04:03.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f8725ffb700 1 -- 172.21.15.133:0/724100654 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f871000eee0 con 0x7f87281561b0 2021-01-03T13:04:03.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f872d644700 1 -- 172.21.15.133:0/724100654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87280aa630 con 0x7f87281561b0 2021-01-03T13:04:03.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.146+0000 7f872d644700 1 -- 172.21.15.133:0/724100654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8728057300 con 0x7f87281561b0 2021-01-03T13:04:03.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.150+0000 7f8725ffb700 1 -- 172.21.15.133:0/724100654 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8710024070 con 0x7f87281561b0 2021-01-03T13:04:03.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.150+0000 7f8725ffb700 1 --2- 172.21.15.133:0/724100654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f870c055350 0x7f870c057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.150+0000 7f8725ffb700 1 -- 172.21.15.133:0/724100654 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f871006ea10 con 0x7f87281561b0 2021-01-03T13:04:03.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.150+0000 7f8727fff700 1 --2- 172.21.15.133:0/724100654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f870c055350 0x7f870c057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.150+0000 7f8727fff700 1 --2- 172.21.15.133:0/724100654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f870c055350 0x7f870c057810 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f8718016000 tx=0x7f8718013000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:03.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.158+0000 7f8725ffb700 1 -- 172.21.15.133:0/724100654 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8710044c00 con 0x7f87281561b0 2021-01-03T13:04:03.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.298+0000 7f872d644700 1 -- 172.21.15.133:0/724100654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f872805ce00 con 0x7f87281561b0 2021-01-03T13:04:03.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.302+0000 7f8725ffb700 1 -- 172.21.15.133:0/724100654 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f8710048220 con 0x7f87281561b0 2021-01-03T13:04:03.301 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:04:03.302 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":79,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:04:01.927555+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:03:57.389227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-01-03T13:03:58.706858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:04:03.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.302+0000 7f872d644700 1 -- 172.21.15.133:0/724100654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f870c055350 msgr2=0x7f870c057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.302+0000 7f872d644700 1 --2- 172.21.15.133:0/724100654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f870c055350 0x7f870c057810 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f8718016000 tx=0x7f8718013000).stop 2021-01-03T13:04:03.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.302+0000 7f872d644700 1 -- 172.21.15.133:0/724100654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87281561b0 msgr2=0x7f8728156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.302+0000 7f872d644700 1 --2- 172.21.15.133:0/724100654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87281561b0 0x7f8728156630 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f8728067730 tx=0x7f8710008040).stop 2021-01-03T13:04:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.302+0000 7f872d644700 1 -- 172.21.15.133:0/724100654 shutdown_connections 2021-01-03T13:04:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.302+0000 7f872d644700 1 --2- 172.21.15.133:0/724100654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f870c055350 0x7f870c057810 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.302+0000 7f872d644700 1 --2- 172.21.15.133:0/724100654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8728156b20 0x7f8728159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.302+0000 7f872d644700 1 --2- 172.21.15.133:0/724100654 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87280af1a0 0x7f87280af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.302+0000 7f872d644700 1 --2- 172.21.15.133:0/724100654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87281561b0 0x7f8728156630 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.302+0000 7f872d644700 1 -- 172.21.15.133:0/724100654 >> 172.21.15.133:0/724100654 conn(0x7f872805bdf0 msgr2=0x7f87280b4690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:03.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.302+0000 7f872d644700 1 -- 172.21.15.133:0/724100654 shutdown_connections 2021-01-03T13:04:03.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.302+0000 7f872d644700 1 -- 172.21.15.133:0/724100654 wait complete. 2021-01-03T13:04:03.315 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:03:57.389227+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:03:58.706858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:04:03.316 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:04:03.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.434+0000 7f03517a8700 1 Processor -- start 2021-01-03T13:04:03.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.434+0000 7f03517a8700 1 -- start start 2021-01-03T13:04:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f03517a8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f034c0b3670 0x7f034c0b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f03517a8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f034c0b1f30 0x7f034c0b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f03517a8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f034c0ac200 con 0x7f034c0b7910 2021-01-03T13:04:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f03517a8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034c0ad720 con 0x7f034c0b1f30 2021-01-03T13:04:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f03517a8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c0acc10 con 0x7f034c0b3670 2021-01-03T13:04:03.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f0350fa7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f034c0b1f30 0x7f034c0b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f034bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f034c0b7910 0x7f034c13e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56898/0 (socket says 172.21.15.133:56898) 2021-01-03T13:04:03.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f0350fa7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f034c0b1f30 0x7f034c0b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35870/0 (socket says 172.21.15.133:35870) 2021-01-03T13:04:03.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f034bfff700 1 -- 172.21.15.133:0/1708922069 learned_addr learned my addr 172.21.15.133:0/1708922069 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:03.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f034b7fe700 1 --2- 172.21.15.133:0/1708922069 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f034c0b3670 0x7f034c0b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f0350fa7700 1 -- 172.21.15.133:0/1708922069 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f034c0b3670 msgr2=0x7f034c0b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f0350fa7700 1 --2- 172.21.15.133:0/1708922069 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f034c0b3670 0x7f034c0b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f0350fa7700 1 -- 172.21.15.133:0/1708922069 >> v1:172.21.15.133:6789/0 conn(0x7f034c0b7910 legacy=0x7f034c13e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f034affd700 1 -- 172.21.15.133:0/1708922069 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512253929 0 0) 0x7f034c0ac200 con 0x7f034c0b7910 2021-01-03T13:04:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f0350fa7700 1 -- 172.21.15.133:0/1708922069 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c0ac430 con 0x7f034c0b1f30 2021-01-03T13:04:03.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f0350fa7700 1 --2- 172.21.15.133:0/1708922069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f034c0b1f30 0x7f034c0b2ab0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f034c140b00 tx=0x7f03440091a0).ready entity=mon.1 client_cookie=abbe45a502a64e0d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:03.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f034affd700 1 -- 172.21.15.133:0/1708922069 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0344009e70 con 0x7f034c0b1f30 2021-01-03T13:04:03.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f034affd700 1 -- 172.21.15.133:0/1708922069 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034400bbc0 con 0x7f034c0b1f30 2021-01-03T13:04:03.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f034affd700 1 -- 172.21.15.133:0/1708922069 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f034400bd30 con 0x7f034c0b1f30 2021-01-03T13:04:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f03517a8700 1 -- 172.21.15.133:0/1708922069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f034c0b1f30 msgr2=0x7f034c0b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f03517a8700 1 --2- 172.21.15.133:0/1708922069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f034c0b1f30 0x7f034c0b2ab0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f034c140b00 tx=0x7f03440091a0).stop 2021-01-03T13:04:03.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f03517a8700 1 -- 172.21.15.133:0/1708922069 shutdown_connections 2021-01-03T13:04:03.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f03517a8700 1 --2- 172.21.15.133:0/1708922069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f034c0b1f30 0x7f034c0b2ab0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f03517a8700 1 --2- 172.21.15.133:0/1708922069 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f034c0b3670 0x7f034c0b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f03517a8700 1 -- 172.21.15.133:0/1708922069 >> 172.21.15.133:0/1708922069 conn(0x7f034c05c8c0 msgr2=0x7f034c0b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f03517a8700 1 -- 172.21.15.133:0/1708922069 shutdown_connections 2021-01-03T13:04:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f03517a8700 1 -- 172.21.15.133:0/1708922069 wait complete. 2021-01-03T13:04:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f03517a8700 1 Processor -- start 2021-01-03T13:04:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.438+0000 7f03517a8700 1 -- start start 2021-01-03T13:04:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f03517a8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f034c0b1f30 0x7f034c065cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f03517a8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f034c0b3670 0x7f034c145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f03517a8700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f034c0b7910 0x7f034c153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f03517a8700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c065340 con 0x7f034c0b7910 2021-01-03T13:04:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f03517a8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c145900 con 0x7f034c0b1f30 2021-01-03T13:04:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f03517a8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c065570 con 0x7f034c0b3670 2021-01-03T13:04:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f034bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f034c0b1f30 0x7f034c065cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f034bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f034c0b1f30 0x7f034c065cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35872/0 (socket says 172.21.15.133:35872) 2021-01-03T13:04:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f034bfff700 1 -- 172.21.15.133:0/89629881 learned_addr learned my addr 172.21.15.133:0/89629881 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f0350fa7700 1 --2- 172.21.15.133:0/89629881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f034c0b7910 0x7f034c153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f034b7fe700 1 --2- 172.21.15.133:0/89629881 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f034c0b3670 0x7f034c145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f034bfff700 1 -- 172.21.15.133:0/89629881 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f034c0b3670 msgr2=0x7f034c145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f034bfff700 1 --2- 172.21.15.133:0/89629881 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f034c0b3670 0x7f034c145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f034bfff700 1 -- 172.21.15.133:0/89629881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f034c0b7910 msgr2=0x7f034c153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f034bfff700 1 --2- 172.21.15.133:0/89629881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f034c0b7910 0x7f034c153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f034bfff700 1 -- 172.21.15.133:0/89629881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c065810 con 0x7f034c0b1f30 2021-01-03T13:04:03.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f034bfff700 1 --2- 172.21.15.133:0/89629881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f034c0b1f30 0x7f034c065cb0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f033c000b80 tx=0x7f033c007c60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:03.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f03497fa700 1 -- 172.21.15.133:0/89629881 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033c0072e0 con 0x7f034c0b1f30 2021-01-03T13:04:03.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f03497fa700 1 -- 172.21.15.133:0/89629881 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c007440 con 0x7f034c0b1f30 2021-01-03T13:04:03.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f03517a8700 1 -- 172.21.15.133:0/89629881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034c066910 con 0x7f034c0b1f30 2021-01-03T13:04:03.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f03497fa700 1 -- 172.21.15.133:0/89629881 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033c0057d0 con 0x7f034c0b1f30 2021-01-03T13:04:03.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f03517a8700 1 -- 172.21.15.133:0/89629881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034c1465b0 con 0x7f034c0b1f30 2021-01-03T13:04:03.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f03517a8700 1 -- 172.21.15.133:0/89629881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034c057300 con 0x7f034c0b1f30 2021-01-03T13:04:03.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.442+0000 7f03497fa700 1 -- 172.21.15.133:0/89629881 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f033c01a060 con 0x7f034c0b1f30 2021-01-03T13:04:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.446+0000 7f03497fa700 1 --2- 172.21.15.133:0/89629881 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f032c0553b0 0x7f032c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.446+0000 7f03497fa700 1 -- 172.21.15.133:0/89629881 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f033c06d5e0 con 0x7f034c0b1f30 2021-01-03T13:04:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.450+0000 7f034b7fe700 1 --2- 172.21.15.133:0/89629881 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f032c0553b0 0x7f032c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.450+0000 7f034b7fe700 1 --2- 172.21.15.133:0/89629881 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f032c0553b0 0x7f032c057870 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f034000c000 tx=0x7f0340008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.450+0000 7f03497fa700 1 -- 172.21.15.133:0/89629881 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f033c0438e0 con 0x7f034c0b1f30 2021-01-03T13:04:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.594+0000 7f03517a8700 1 -- 172.21.15.133:0/89629881 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f034c09d0b0 con 0x7f034c0b1f30 2021-01-03T13:04:03.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.594+0000 7f03497fa700 1 -- 172.21.15.133:0/89629881 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v79) v1 ==== 110+0+10 (secure 0 0 0) 0x7f033c018070 con 0x7f034c0b1f30 2021-01-03T13:04:03.595 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:04:03.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.594+0000 7f03517a8700 1 -- 172.21.15.133:0/89629881 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f032c0553b0 msgr2=0x7f032c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.594+0000 7f03517a8700 1 --2- 172.21.15.133:0/89629881 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f032c0553b0 0x7f032c057870 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f034000c000 tx=0x7f0340008040).stop 2021-01-03T13:04:03.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.594+0000 7f03517a8700 1 -- 172.21.15.133:0/89629881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f034c0b1f30 msgr2=0x7f034c065cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.594+0000 7f03517a8700 1 --2- 172.21.15.133:0/89629881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f034c0b1f30 0x7f034c065cb0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f033c000b80 tx=0x7f033c007c60).stop 2021-01-03T13:04:03.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.594+0000 7f03517a8700 1 -- 172.21.15.133:0/89629881 shutdown_connections 2021-01-03T13:04:03.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.594+0000 7f03517a8700 1 --2- 172.21.15.133:0/89629881 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f032c0553b0 0x7f032c057870 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.594+0000 7f03517a8700 1 --2- 172.21.15.133:0/89629881 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f034c0b7910 0x7f034c153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.594+0000 7f03517a8700 1 --2- 172.21.15.133:0/89629881 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f034c0b1f30 0x7f034c065cb0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.594+0000 7f03517a8700 1 --2- 172.21.15.133:0/89629881 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f034c0b3670 0x7f034c145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.594+0000 7f03517a8700 1 -- 172.21.15.133:0/89629881 >> 172.21.15.133:0/89629881 conn(0x7f034c05c8c0 msgr2=0x7f034c05f970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:03.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.594+0000 7f03517a8700 1 -- 172.21.15.133:0/89629881 shutdown_connections 2021-01-03T13:04:03.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.594+0000 7f03517a8700 1 -- 172.21.15.133:0/89629881 wait complete. 2021-01-03T13:04:03.607 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:04:03.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.722+0000 7fe59e610700 1 Processor -- start 2021-01-03T13:04:03.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.722+0000 7fe59e610700 1 -- start start 2021-01-03T13:04:03.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.722+0000 7fe59e610700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5980b2460 0x7fe5980a9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.722+0000 7fe59e610700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5980b16a0 con 0x7fe5980a8850 2021-01-03T13:04:03.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.722+0000 7fe59e610700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5980b2840 con 0x7fe5980b0a60 2021-01-03T13:04:03.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.722+0000 7fe59e610700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5980aeae0 con 0x7fe5980b2460 2021-01-03T13:04:03.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.722+0000 7fe59ce0d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe5980b0a60 0x7fe5980ad490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56914/0 (socket says 172.21.15.133:56914) 2021-01-03T13:04:03.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.722+0000 7fe59ce0d700 1 -- 172.21.15.133:0/86800569 learned_addr learned my addr 172.21.15.133:0/86800569 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:03.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.722+0000 7fe59d60e700 1 --2- 172.21.15.133:0/86800569 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5980b2460 0x7fe5980a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.722+0000 7fe58bfff700 1 -- 172.21.15.133:0/86800569 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449292948 0 0) 0x7fe5980b2840 con 0x7fe5980b0a60 2021-01-03T13:04:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.722+0000 7fe58bfff700 1 -- 172.21.15.133:0/86800569 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe57c003230 con 0x7fe5980b0a60 2021-01-03T13:04:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.722+0000 7fe58bfff700 1 -- 172.21.15.133:0/86800569 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833533325 0 0) 0x7fe5980b16a0 con 0x7fe5980a8850 2021-01-03T13:04:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.722+0000 7fe58bfff700 1 -- 172.21.15.133:0/86800569 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5980b2840 con 0x7fe5980a8850 2021-01-03T13:04:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59d60e700 1 -- 172.21.15.133:0/86800569 >> v1:172.21.15.133:6789/0 conn(0x7fe5980b0a60 legacy=0x7fe5980ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59d60e700 1 -- 172.21.15.133:0/86800569 >> v1:172.21.15.16:6789/0 conn(0x7fe5980a8850 legacy=0x7fe5980a8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59d60e700 1 -- 172.21.15.133:0/86800569 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5980b1160 con 0x7fe5980b2460 2021-01-03T13:04:03.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59d60e700 1 --2- 172.21.15.133:0/86800569 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5980b2460 0x7fe5980a9750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fe594002f30 tx=0x7fe594006dc0).ready entity=mon.2 client_cookie=12b5becb692b9e2b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:03.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe58bfff700 1 -- 172.21.15.133:0/86800569 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe594014070 con 0x7fe5980b2460 2021-01-03T13:04:03.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe58bfff700 1 -- 172.21.15.133:0/86800569 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe594009920 con 0x7fe5980b2460 2021-01-03T13:04:03.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe58bfff700 1 -- 172.21.15.133:0/86800569 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe594009c80 con 0x7fe5980b2460 2021-01-03T13:04:03.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59e610700 1 -- 172.21.15.133:0/86800569 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5980b2460 msgr2=0x7fe5980a9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59e610700 1 --2- 172.21.15.133:0/86800569 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5980b2460 0x7fe5980a9750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fe594002f30 tx=0x7fe594006dc0).stop 2021-01-03T13:04:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59e610700 1 -- 172.21.15.133:0/86800569 shutdown_connections 2021-01-03T13:04:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59e610700 1 --2- 172.21.15.133:0/86800569 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5980b2460 0x7fe5980a9750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59e610700 1 -- 172.21.15.133:0/86800569 >> 172.21.15.133:0/86800569 conn(0x7fe59806b050 msgr2=0x7fe598060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59e610700 1 -- 172.21.15.133:0/86800569 shutdown_connections 2021-01-03T13:04:03.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59e610700 1 -- 172.21.15.133:0/86800569 wait complete. 2021-01-03T13:04:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59e610700 1 Processor -- start 2021-01-03T13:04:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59e610700 1 -- start start 2021-01-03T13:04:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59e610700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5980a8850 0x7fe5980b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59e610700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5980b0a60 0x7fe59809e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59e610700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5980b2460 0x7fe59809eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59e610700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5980a0120 con 0x7fe5980b0a60 2021-01-03T13:04:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59e610700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe598153200 con 0x7fe5980b2460 2021-01-03T13:04:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59e610700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5981534a0 con 0x7fe5980a8850 2021-01-03T13:04:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59de0f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5980b2460 0x7fe59809eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59de0f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5980b2460 0x7fe59809eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35890/0 (socket says 172.21.15.133:35890) 2021-01-03T13:04:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59de0f700 1 -- 172.21.15.133:0/799562451 learned_addr learned my addr 172.21.15.133:0/799562451 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59ce0d700 1 --2- 172.21.15.133:0/799562451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5980b0a60 0x7fe59809e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.726+0000 7fe59d60e700 1 --2- 172.21.15.133:0/799562451 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5980a8850 0x7fe5980b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.730+0000 7fe59de0f700 1 -- 172.21.15.133:0/799562451 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5980a8850 msgr2=0x7fe5980b5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.730+0000 7fe59de0f700 1 --2- 172.21.15.133:0/799562451 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5980a8850 0x7fe5980b5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.730+0000 7fe59de0f700 1 -- 172.21.15.133:0/799562451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5980b0a60 msgr2=0x7fe59809e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.730+0000 7fe59de0f700 1 --2- 172.21.15.133:0/799562451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5980b0a60 0x7fe59809e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.730+0000 7fe59de0f700 1 -- 172.21.15.133:0/799562451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe598153740 con 0x7fe5980b2460 2021-01-03T13:04:03.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.730+0000 7fe59de0f700 1 --2- 172.21.15.133:0/799562451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5980b2460 0x7fe59809eca0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fe5980a13b0 tx=0x7fe590007db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:03.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.730+0000 7fe58a7fc700 1 -- 172.21.15.133:0/799562451 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe590002240 con 0x7fe5980b2460 2021-01-03T13:04:03.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.730+0000 7fe58a7fc700 1 -- 172.21.15.133:0/799562451 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5900023a0 con 0x7fe5980b2460 2021-01-03T13:04:03.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.730+0000 7fe59e610700 1 -- 172.21.15.133:0/799562451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5981539e0 con 0x7fe5980b2460 2021-01-03T13:04:03.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.730+0000 7fe58a7fc700 1 -- 172.21.15.133:0/799562451 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe590001850 con 0x7fe5980b2460 2021-01-03T13:04:03.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.730+0000 7fe59e610700 1 -- 172.21.15.133:0/799562451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59809f190 con 0x7fe5980b2460 2021-01-03T13:04:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.730+0000 7fe59e610700 1 -- 172.21.15.133:0/799562451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe598066160 con 0x7fe5980b2460 2021-01-03T13:04:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.730+0000 7fe58a7fc700 1 -- 172.21.15.133:0/799562451 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe590010070 con 0x7fe5980b2460 2021-01-03T13:04:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.730+0000 7fe58a7fc700 1 --2- 172.21.15.133:0/799562451 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe580055440 0x7fe580057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:03.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.730+0000 7fe58a7fc700 1 -- 172.21.15.133:0/799562451 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe59006d560 con 0x7fe5980b2460 2021-01-03T13:04:03.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.730+0000 7fe59d60e700 1 --2- 172.21.15.133:0/799562451 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe580055440 0x7fe580057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:03.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.730+0000 7fe59d60e700 1 --2- 172.21.15.133:0/799562451 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe580055440 0x7fe580057900 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fe594019000 tx=0x7fe594016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:03.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.738+0000 7fe58a7fc700 1 -- 172.21.15.133:0/799562451 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe5900437c0 con 0x7fe5980b2460 2021-01-03T13:04:03.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.874+0000 7fe59e610700 1 -- 172.21.15.133:0/799562451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe598057300 con 0x7fe5980b2460 2021-01-03T13:04:03.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.874+0000 7fe58a7fc700 1 -- 172.21.15.133:0/799562451 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v79) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe590046de0 con 0x7fe5980b2460 2021-01-03T13:04:03.876 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:04:03.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.878+0000 7fe59e610700 1 -- 172.21.15.133:0/799562451 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe580055440 msgr2=0x7fe580057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.878+0000 7fe59e610700 1 --2- 172.21.15.133:0/799562451 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe580055440 0x7fe580057900 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fe594019000 tx=0x7fe594016000).stop 2021-01-03T13:04:03.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.878+0000 7fe59e610700 1 -- 172.21.15.133:0/799562451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5980b2460 msgr2=0x7fe59809eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:03.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.878+0000 7fe59e610700 1 --2- 172.21.15.133:0/799562451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5980b2460 0x7fe59809eca0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fe5980a13b0 tx=0x7fe590007db0).stop 2021-01-03T13:04:03.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.878+0000 7fe59e610700 1 -- 172.21.15.133:0/799562451 shutdown_connections 2021-01-03T13:04:03.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.878+0000 7fe59e610700 1 --2- 172.21.15.133:0/799562451 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe580055440 0x7fe580057900 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.878+0000 7fe59e610700 1 --2- 172.21.15.133:0/799562451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5980b2460 0x7fe59809eca0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.878+0000 7fe59e610700 1 --2- 172.21.15.133:0/799562451 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5980a8850 0x7fe5980b5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.878+0000 7fe59e610700 1 --2- 172.21.15.133:0/799562451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe5980b0a60 0x7fe59809e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:03.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.878+0000 7fe59e610700 1 -- 172.21.15.133:0/799562451 >> 172.21.15.133:0/799562451 conn(0x7fe59806b050 msgr2=0x7fe598067050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:03.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.878+0000 7fe59e610700 1 -- 172.21.15.133:0/799562451 shutdown_connections 2021-01-03T13:04:03.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:03.878+0000 7fe59e610700 1 -- 172.21.15.133:0/799562451 wait complete. 2021-01-03T13:04:03.889 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:04:04.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.010+0000 7f78fde35700 1 Processor -- start 2021-01-03T13:04:04.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.010+0000 7f78fde35700 1 -- start start 2021-01-03T13:04:04.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78fde35700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f78f80af780 0x7f78f80679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:04.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78fde35700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f80b2820 con 0x7f78f80b2440 2021-01-03T13:04:04.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78fde35700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f80b1af0 con 0x7f78f81406f0 2021-01-03T13:04:04.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78fde35700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80aecd0 con 0x7f78f80af780 2021-01-03T13:04:04.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78f7fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f78f81406f0 0x7f78f80672b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56928/0 (socket says 172.21.15.133:56928) 2021-01-03T13:04:04.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78f7fff700 1 -- 172.21.15.133:0/3588578789 learned_addr learned my addr 172.21.15.133:0/3588578789 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:04.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78fd634700 1 --2- 172.21.15.133:0/3588578789 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f78f80af780 0x7f78f80679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:04.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78f77fe700 1 -- 172.21.15.133:0/3588578789 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635215070 0 0) 0x7f78f80b1af0 con 0x7f78f81406f0 2021-01-03T13:04:04.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78f77fe700 1 -- 172.21.15.133:0/3588578789 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78e4003230 con 0x7f78f81406f0 2021-01-03T13:04:04.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78f77fe700 1 -- 172.21.15.133:0/3588578789 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457949848 0 0) 0x7f78f80b2820 con 0x7f78f80b2440 2021-01-03T13:04:04.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78f77fe700 1 -- 172.21.15.133:0/3588578789 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78f80b1af0 con 0x7f78f80b2440 2021-01-03T13:04:04.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78fd634700 1 -- 172.21.15.133:0/3588578789 >> v1:172.21.15.133:6789/0 conn(0x7f78f81406f0 legacy=0x7f78f80672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78f77fe700 1 -- 172.21.15.133:0/3588578789 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3213696642 0 0) 0x7f78e4003230 con 0x7f78f81406f0 2021-01-03T13:04:04.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78fd634700 1 -- 172.21.15.133:0/3588578789 >> v1:172.21.15.16:6789/0 conn(0x7f78f80b2440 legacy=0x7f78f813ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78fd634700 1 -- 172.21.15.133:0/3588578789 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f80b1d90 con 0x7f78f80af780 2021-01-03T13:04:04.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78fd634700 1 --2- 172.21.15.133:0/3588578789 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f78f80af780 0x7f78f80679c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f78ec0010d0 tx=0x7f78f00091a0).ready entity=mon.2 client_cookie=5fa9ea2799f4a42 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:04.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78f77fe700 1 -- 172.21.15.133:0/3588578789 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78ec0016d0 con 0x7f78f80af780 2021-01-03T13:04:04.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78f77fe700 1 -- 172.21.15.133:0/3588578789 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f000b880 con 0x7f78f80af780 2021-01-03T13:04:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78f77fe700 1 -- 172.21.15.133:0/3588578789 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78f000b9f0 con 0x7f78f80af780 2021-01-03T13:04:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78fde35700 1 -- 172.21.15.133:0/3588578789 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f78f80af780 msgr2=0x7f78f80679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78fde35700 1 --2- 172.21.15.133:0/3588578789 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f78f80af780 0x7f78f80679c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f78ec0010d0 tx=0x7f78f00091a0).stop 2021-01-03T13:04:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78fde35700 1 -- 172.21.15.133:0/3588578789 shutdown_connections 2021-01-03T13:04:04.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78fde35700 1 --2- 172.21.15.133:0/3588578789 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f78f80af780 0x7f78f80679c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78fde35700 1 -- 172.21.15.133:0/3588578789 >> 172.21.15.133:0/3588578789 conn(0x7f78f806b050 msgr2=0x7f78f8060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:04.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78fde35700 1 -- 172.21.15.133:0/3588578789 shutdown_connections 2021-01-03T13:04:04.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.014+0000 7f78fde35700 1 -- 172.21.15.133:0/3588578789 wait complete. 2021-01-03T13:04:04.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78fde35700 1 Processor -- start 2021-01-03T13:04:04.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78fde35700 1 -- start start 2021-01-03T13:04:04.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78fde35700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f78f80af780 0x7f78f813a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:04.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78fde35700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f80b2440 0x7f78f8140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:04.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78fde35700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78f81406f0 0x7f78f8150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:04.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78fde35700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f81414c0 con 0x7f78f81406f0 2021-01-03T13:04:04.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78fde35700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f81541a0 con 0x7f78f80b2440 2021-01-03T13:04:04.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78fde35700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f814fe40 con 0x7f78f80af780 2021-01-03T13:04:04.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78f7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f80b2440 0x7f78f8140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:04.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78f7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f80b2440 0x7f78f8140fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35902/0 (socket says 172.21.15.133:35902) 2021-01-03T13:04:04.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78f7fff700 1 -- 172.21.15.133:0/3855527517 learned_addr learned my addr 172.21.15.133:0/3855527517 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78fd634700 1 --2- 172.21.15.133:0/3855527517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78f81406f0 0x7f78f8150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78fce33700 1 --2- 172.21.15.133:0/3855527517 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f78f80af780 0x7f78f813a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78f7fff700 1 -- 172.21.15.133:0/3855527517 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f78f80af780 msgr2=0x7f78f813a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78f7fff700 1 --2- 172.21.15.133:0/3855527517 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f78f80af780 0x7f78f813a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78f7fff700 1 -- 172.21.15.133:0/3855527517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78f81406f0 msgr2=0x7f78f8150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78f7fff700 1 --2- 172.21.15.133:0/3855527517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78f81406f0 0x7f78f8150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78f7fff700 1 -- 172.21.15.133:0/3855527517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f81500e0 con 0x7f78f80b2440 2021-01-03T13:04:04.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78f7fff700 1 --2- 172.21.15.133:0/3855527517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f80b2440 0x7f78f8140fd0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f78ec000fa0 tx=0x7f78ec0019d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:04.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78f5ffb700 1 -- 172.21.15.133:0/3855527517 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78ec007110 con 0x7f78f80b2440 2021-01-03T13:04:04.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78f5ffb700 1 -- 172.21.15.133:0/3855527517 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec007270 con 0x7f78f80b2440 2021-01-03T13:04:04.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78fde35700 1 -- 172.21.15.133:0/3855527517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f8150380 con 0x7f78f80b2440 2021-01-03T13:04:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78f5ffb700 1 -- 172.21.15.133:0/3855527517 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78ec0055e0 con 0x7f78f80b2440 2021-01-03T13:04:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.018+0000 7f78fde35700 1 -- 172.21.15.133:0/3855527517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f8153e20 con 0x7f78f80b2440 2021-01-03T13:04:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.022+0000 7f78fde35700 1 -- 172.21.15.133:0/3855527517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f8150510 con 0x7f78f80b2440 2021-01-03T13:04:04.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.022+0000 7f78f5ffb700 1 -- 172.21.15.133:0/3855527517 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f78ec010030 con 0x7f78f80b2440 2021-01-03T13:04:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.022+0000 7f78f5ffb700 1 --2- 172.21.15.133:0/3855527517 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f78d8055440 0x7f78d8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.022+0000 7f78f5ffb700 1 -- 172.21.15.133:0/3855527517 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f78ec06de30 con 0x7f78f80b2440 2021-01-03T13:04:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.022+0000 7f78fce33700 1 --2- 172.21.15.133:0/3855527517 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f78d8055440 0x7f78d8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:04.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.022+0000 7f78fce33700 1 --2- 172.21.15.133:0/3855527517 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f78d8055440 0x7f78d8057900 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f78e800d000 tx=0x7f78e80079f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:04.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.026+0000 7f78f5ffb700 1 -- 172.21.15.133:0/3855527517 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f78ec044130 con 0x7f78f80b2440 2021-01-03T13:04:04.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.170+0000 7f78fde35700 1 -- 172.21.15.133:0/3855527517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78f8057300 con 0x7f78f80b2440 2021-01-03T13:04:04.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.170+0000 7f78f5ffb700 1 -- 172.21.15.133:0/3855527517 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+10 (secure 0 0 0) 0x7f78ec047750 con 0x7f78f80b2440 2021-01-03T13:04:04.171 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:04:04.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.170+0000 7f78fde35700 1 -- 172.21.15.133:0/3855527517 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f78d8055440 msgr2=0x7f78d8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.170+0000 7f78fde35700 1 --2- 172.21.15.133:0/3855527517 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f78d8055440 0x7f78d8057900 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f78e800d000 tx=0x7f78e80079f0).stop 2021-01-03T13:04:04.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.170+0000 7f78fde35700 1 -- 172.21.15.133:0/3855527517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f80b2440 msgr2=0x7f78f8140fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.170+0000 7f78fde35700 1 --2- 172.21.15.133:0/3855527517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f80b2440 0x7f78f8140fd0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f78ec000fa0 tx=0x7f78ec0019d0).stop 2021-01-03T13:04:04.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.170+0000 7f78fde35700 1 -- 172.21.15.133:0/3855527517 shutdown_connections 2021-01-03T13:04:04.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.170+0000 7f78fde35700 1 --2- 172.21.15.133:0/3855527517 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f78d8055440 0x7f78d8057900 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.170+0000 7f78fde35700 1 --2- 172.21.15.133:0/3855527517 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f78f81406f0 0x7f78f8150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.170+0000 7f78fde35700 1 --2- 172.21.15.133:0/3855527517 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f78f80af780 0x7f78f813a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.170+0000 7f78fde35700 1 --2- 172.21.15.133:0/3855527517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78f80b2440 0x7f78f8140fd0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.170+0000 7f78fde35700 1 -- 172.21.15.133:0/3855527517 >> 172.21.15.133:0/3855527517 conn(0x7f78f806b050 msgr2=0x7f78f813f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:04.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.170+0000 7f78fde35700 1 -- 172.21.15.133:0/3855527517 shutdown_connections 2021-01-03T13:04:04.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.170+0000 7f78fde35700 1 -- 172.21.15.133:0/3855527517 wait complete. 2021-01-03T13:04:04.184 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:04:04.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.298+0000 7fbced36a700 1 Processor -- start 2021-01-03T13:04:04.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.298+0000 7fbced36a700 1 -- start start 2021-01-03T13:04:04.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.298+0000 7fbced36a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbce80b5c00 0x7fbce81477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:04.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.298+0000 7fbced36a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbce81442a0 0x7fbce8144750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:04.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.298+0000 7fbced36a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce80b0c10 con 0x7fbce80b5260 2021-01-03T13:04:04.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.298+0000 7fbced36a700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce80b5640 con 0x7fbce81442a0 2021-01-03T13:04:04.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.298+0000 7fbced36a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce809a4f0 con 0x7fbce80b5c00 2021-01-03T13:04:04.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbce77fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbce80b5c00 0x7fbce81477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:04.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbcecb69700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbce81442a0 0x7fbce8144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:04.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbce7fff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fbce80b5260 0x7fbce81470b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:35668/0 (socket says 172.21.15.133:35668) 2021-01-03T13:04:04.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbce7fff700 1 -- 172.21.15.133:0/2673914459 learned_addr learned my addr 172.21.15.133:0/2673914459 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:04.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbce6ffd700 1 -- 172.21.15.133:0/2673914459 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224793649 0 0) 0x7fbce80b0c10 con 0x7fbce80b5260 2021-01-03T13:04:04.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbce6ffd700 1 -- 172.21.15.133:0/2673914459 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcd4003230 con 0x7fbce80b5260 2021-01-03T13:04:04.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbce77fe700 1 -- 172.21.15.133:0/2673914459 >> v2:172.21.15.16:3300/0 conn(0x7fbce81442a0 msgr2=0x7fbce8144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:04.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbce77fe700 1 --2- 172.21.15.133:0/2673914459 >> v2:172.21.15.16:3300/0 conn(0x7fbce81442a0 0x7fbce8144750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbce77fe700 1 -- 172.21.15.133:0/2673914459 >> v1:172.21.15.16:6789/0 conn(0x7fbce80b5260 legacy=0x7fbce81470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbce77fe700 1 -- 172.21.15.133:0/2673914459 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce80b0e40 con 0x7fbce80b5c00 2021-01-03T13:04:04.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbce77fe700 1 --2- 172.21.15.133:0/2673914459 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbce80b5c00 0x7fbce81477c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fbcd80032b0 tx=0x7fbcd80091a0).ready entity=mon.2 client_cookie=9fb99ef2a800baa0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:04.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbce6ffd700 1 -- 172.21.15.133:0/2673914459 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd800b940 con 0x7fbce80b5c00 2021-01-03T13:04:04.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbce6ffd700 1 -- 172.21.15.133:0/2673914459 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd800baa0 con 0x7fbce80b5c00 2021-01-03T13:04:04.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbce6ffd700 1 -- 172.21.15.133:0/2673914459 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd800bc10 con 0x7fbce80b5c00 2021-01-03T13:04:04.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbced36a700 1 -- 172.21.15.133:0/2673914459 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbce80b5c00 msgr2=0x7fbce81477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbced36a700 1 --2- 172.21.15.133:0/2673914459 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbce80b5c00 0x7fbce81477c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fbcd80032b0 tx=0x7fbcd80091a0).stop 2021-01-03T13:04:04.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbced36a700 1 -- 172.21.15.133:0/2673914459 shutdown_connections 2021-01-03T13:04:04.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbced36a700 1 --2- 172.21.15.133:0/2673914459 >> v2:172.21.15.16:3300/0 conn(0x7fbce81442a0 0x7fbce8144750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbced36a700 1 --2- 172.21.15.133:0/2673914459 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbce80b5c00 0x7fbce81477c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbced36a700 1 -- 172.21.15.133:0/2673914459 >> 172.21.15.133:0/2673914459 conn(0x7fbce805bdf0 msgr2=0x7fbce805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:04.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbced36a700 1 -- 172.21.15.133:0/2673914459 shutdown_connections 2021-01-03T13:04:04.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.302+0000 7fbced36a700 1 -- 172.21.15.133:0/2673914459 wait complete. 2021-01-03T13:04:04.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbced36a700 1 Processor -- start 2021-01-03T13:04:04.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbced36a700 1 -- start start 2021-01-03T13:04:04.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbced36a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbce80b5260 0x7fbce8155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:04.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbced36a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbce80b5c00 0x7fbce8063bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:04.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbced36a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbce81442a0 0x7fbce8065230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:04.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbced36a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce8064b30 con 0x7fbce80b5260 2021-01-03T13:04:04.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbced36a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce80667e0 con 0x7fbce80b5c00 2021-01-03T13:04:04.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbced36a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce8066a80 con 0x7fbce81442a0 2021-01-03T13:04:04.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbce77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbce80b5c00 0x7fbce8063bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:04.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbce77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbce80b5c00 0x7fbce8063bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35916/0 (socket says 172.21.15.133:35916) 2021-01-03T13:04:04.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbce77fe700 1 -- 172.21.15.133:0/3824713554 learned_addr learned my addr 172.21.15.133:0/3824713554 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:04.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbce7fff700 1 --2- 172.21.15.133:0/3824713554 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbce80b5260 0x7fbce8155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:04.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbcecb69700 1 --2- 172.21.15.133:0/3824713554 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbce81442a0 0x7fbce8065230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:04.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbce77fe700 1 -- 172.21.15.133:0/3824713554 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbce81442a0 msgr2=0x7fbce8065230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbce77fe700 1 --2- 172.21.15.133:0/3824713554 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbce81442a0 0x7fbce8065230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbce77fe700 1 -- 172.21.15.133:0/3824713554 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbce80b5260 msgr2=0x7fbce8155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbce77fe700 1 --2- 172.21.15.133:0/3824713554 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbce80b5260 0x7fbce8155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbce77fe700 1 -- 172.21.15.133:0/3824713554 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce8064d90 con 0x7fbce80b5c00 2021-01-03T13:04:04.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbcecb69700 1 --2- 172.21.15.133:0/3824713554 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbce81442a0 0x7fbce8065230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:04:04.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbce77fe700 1 --2- 172.21.15.133:0/3824713554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbce80b5c00 0x7fbce8063bf0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7fbcd80032b0 tx=0x7fbcd8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbce57fa700 1 -- 172.21.15.133:0/3824713554 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd8011e80 con 0x7fbce80b5c00 2021-01-03T13:04:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbce57fa700 1 -- 172.21.15.133:0/3824713554 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd801f3f0 con 0x7fbce80b5c00 2021-01-03T13:04:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbced36a700 1 -- 172.21.15.133:0/3824713554 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce80664d0 con 0x7fbce80b5c00 2021-01-03T13:04:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbce57fa700 1 -- 172.21.15.133:0/3824713554 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd801f750 con 0x7fbce80b5c00 2021-01-03T13:04:04.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.306+0000 7fbced36a700 1 -- 172.21.15.133:0/3824713554 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce8067790 con 0x7fbce80b5c00 2021-01-03T13:04:04.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.310+0000 7fbced36a700 1 -- 172.21.15.133:0/3824713554 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce8057300 con 0x7fbce80b5c00 2021-01-03T13:04:04.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.310+0000 7fbce57fa700 1 -- 172.21.15.133:0/3824713554 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fbcd800f070 con 0x7fbce80b5c00 2021-01-03T13:04:04.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.310+0000 7fbce57fa700 1 --2- 172.21.15.133:0/3824713554 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbcc80553b0 0x7fbcc8057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:04.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.310+0000 7fbce57fa700 1 -- 172.21.15.133:0/3824713554 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbcd806e8f0 con 0x7fbce80b5c00 2021-01-03T13:04:04.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.310+0000 7fbce7fff700 1 --2- 172.21.15.133:0/3824713554 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbcc80553b0 0x7fbcc8057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:04.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.310+0000 7fbce7fff700 1 --2- 172.21.15.133:0/3824713554 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbcc80553b0 0x7fbcc8057870 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fbcdc00d000 tx=0x7fbcdc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:04.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.314+0000 7fbce57fa700 1 -- 172.21.15.133:0/3824713554 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbcd8044a60 con 0x7fbce80b5c00 2021-01-03T13:04:04.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.458+0000 7fbced36a700 1 -- 172.21.15.133:0/3824713554 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbce8067790 con 0x7fbce80b5c00 2021-01-03T13:04:04.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.458+0000 7fbce57fa700 1 -- 172.21.15.133:0/3824713554 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbce8067790 con 0x7fbce80b5c00 2021-01-03T13:04:04.461 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:04:04.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.462+0000 7fbced36a700 1 -- 172.21.15.133:0/3824713554 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbcc80553b0 msgr2=0x7fbcc8057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.462+0000 7fbced36a700 1 --2- 172.21.15.133:0/3824713554 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbcc80553b0 0x7fbcc8057870 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fbcdc00d000 tx=0x7fbcdc009040).stop 2021-01-03T13:04:04.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.462+0000 7fbced36a700 1 -- 172.21.15.133:0/3824713554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbce80b5c00 msgr2=0x7fbce8063bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.462+0000 7fbced36a700 1 --2- 172.21.15.133:0/3824713554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbce80b5c00 0x7fbce8063bf0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7fbcd80032b0 tx=0x7fbcd8016000).stop 2021-01-03T13:04:04.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.462+0000 7fbced36a700 1 -- 172.21.15.133:0/3824713554 shutdown_connections 2021-01-03T13:04:04.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.462+0000 7fbced36a700 1 --2- 172.21.15.133:0/3824713554 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbcc80553b0 0x7fbcc8057870 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.462+0000 7fbced36a700 1 --2- 172.21.15.133:0/3824713554 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbce80b5260 0x7fbce8155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.462+0000 7fbced36a700 1 --2- 172.21.15.133:0/3824713554 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbce81442a0 0x7fbce8065230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.462+0000 7fbced36a700 1 --2- 172.21.15.133:0/3824713554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbce80b5c00 0x7fbce8063bf0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.462+0000 7fbced36a700 1 -- 172.21.15.133:0/3824713554 >> 172.21.15.133:0/3824713554 conn(0x7fbce805bdf0 msgr2=0x7fbce805c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:04.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.462+0000 7fbced36a700 1 -- 172.21.15.133:0/3824713554 shutdown_connections 2021-01-03T13:04:04.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.462+0000 7fbced36a700 1 -- 172.21.15.133:0/3824713554 wait complete. 2021-01-03T13:04:04.473 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:04:04.474 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:04:04.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.582+0000 7f79e1bdf700 1 Processor -- start 2021-01-03T13:04:04.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.582+0000 7f79e1bdf700 1 -- start start 2021-01-03T13:04:04.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.582+0000 7f79e1bdf700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79dc060510 0x7f79dc05c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:04.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.582+0000 7f79e1bdf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79dc05fd10 0x7f79dc0b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:04.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.582+0000 7f79e1bdf700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc05bf00 con 0x7f79dc0b4c20 2021-01-03T13:04:04.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.582+0000 7f79e1bdf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79dc05c1a0 con 0x7f79dc05fd10 2021-01-03T13:04:04.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.582+0000 7f79e1bdf700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc05c440 con 0x7f79dc060510 2021-01-03T13:04:04.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.582+0000 7f79e13de700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79dc05fd10 0x7f79dc0b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:04.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.582+0000 7f79e13de700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f79dc05fd10 0x7f79dc0b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35926/0 (socket says 172.21.15.133:35926) 2021-01-03T13:04:04.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.582+0000 7f79e13de700 1 -- 172.21.15.133:0/3654338065 learned_addr learned my addr 172.21.15.133:0/3654338065 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:04.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.582+0000 7f79dbfff700 1 --2- 172.21.15.133:0/3654338065 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79dc060510 0x7f79dc05c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:04.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.582+0000 7f79e13de700 1 -- 172.21.15.133:0/3654338065 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79dc060510 msgr2=0x7f79dc05c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:04.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.582+0000 7f79e13de700 1 --2- 172.21.15.133:0/3654338065 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79dc060510 0x7f79dc05c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.582+0000 7f79e13de700 1 -- 172.21.15.133:0/3654338065 >> v1:172.21.15.16:6789/0 conn(0x7f79dc0b4c20 legacy=0x7f79dc0b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.582+0000 7f79e13de700 1 -- 172.21.15.133:0/3654338065 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc0b6ad0 con 0x7f79dc05fd10 2021-01-03T13:04:04.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e13de700 1 --2- 172.21.15.133:0/3654338065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79dc05fd10 0x7f79dc0b65e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f79d4002f30 tx=0x7f79d4006e80).ready entity=mon.1 client_cookie=3241ef75c49950f6 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:04.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79db7fe700 1 -- 172.21.15.133:0/3654338065 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d40097f0 con 0x7f79dc05fd10 2021-01-03T13:04:04.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79db7fe700 1 -- 172.21.15.133:0/3654338065 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d4009950 con 0x7f79dc05fd10 2021-01-03T13:04:04.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79db7fe700 1 -- 172.21.15.133:0/3654338065 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d4009cb0 con 0x7f79dc05fd10 2021-01-03T13:04:04.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e1bdf700 1 -- 172.21.15.133:0/3654338065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79dc05fd10 msgr2=0x7f79dc0b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e1bdf700 1 --2- 172.21.15.133:0/3654338065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79dc05fd10 0x7f79dc0b65e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f79d4002f30 tx=0x7f79d4006e80).stop 2021-01-03T13:04:04.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e1bdf700 1 -- 172.21.15.133:0/3654338065 shutdown_connections 2021-01-03T13:04:04.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e1bdf700 1 --2- 172.21.15.133:0/3654338065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79dc05fd10 0x7f79dc0b65e0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e1bdf700 1 --2- 172.21.15.133:0/3654338065 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79dc060510 0x7f79dc05c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e1bdf700 1 -- 172.21.15.133:0/3654338065 >> 172.21.15.133:0/3654338065 conn(0x7f79dc0b9f00 msgr2=0x7f79dc0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:04.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e1bdf700 1 -- 172.21.15.133:0/3654338065 shutdown_connections 2021-01-03T13:04:04.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e1bdf700 1 -- 172.21.15.133:0/3654338065 wait complete. 2021-01-03T13:04:04.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e1bdf700 1 Processor -- start 2021-01-03T13:04:04.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e1bdf700 1 -- start start 2021-01-03T13:04:04.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e1bdf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79dc05fd10 0x7f79dc13a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:04.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e1bdf700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79dc060510 0x7f79dc13a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:04.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e1bdf700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79dc0b4c20 0x7f79dc141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:04.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e1bdf700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc152610 con 0x7f79dc0b4c20 2021-01-03T13:04:04.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e1bdf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc13b7b0 con 0x7f79dc05fd10 2021-01-03T13:04:04.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e1bdf700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc13d3d0 con 0x7f79dc060510 2021-01-03T13:04:04.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e0bdd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79dc05fd10 0x7f79dc13a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:04.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e0bdd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79dc05fd10 0x7f79dc13a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35928/0 (socket says 172.21.15.133:35928) 2021-01-03T13:04:04.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e0bdd700 1 -- 172.21.15.133:0/3093995 learned_addr learned my addr 172.21.15.133:0/3093995 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:04.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79dbfff700 1 --2- 172.21.15.133:0/3093995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79dc060510 0x7f79dc13a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:04.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.586+0000 7f79e13de700 1 --2- 172.21.15.133:0/3093995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79dc0b4c20 0x7f79dc141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:04.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79e0bdd700 1 -- 172.21.15.133:0/3093995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79dc060510 msgr2=0x7f79dc13a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79e0bdd700 1 --2- 172.21.15.133:0/3093995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79dc060510 0x7f79dc13a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79e0bdd700 1 -- 172.21.15.133:0/3093995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79dc0b4c20 msgr2=0x7f79dc141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79e0bdd700 1 --2- 172.21.15.133:0/3093995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79dc0b4c20 0x7f79dc141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79e0bdd700 1 -- 172.21.15.133:0/3093995 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc152830 con 0x7f79dc05fd10 2021-01-03T13:04:04.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79dbfff700 1 --2- 172.21.15.133:0/3093995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79dc060510 0x7f79dc13a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:04:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79e13de700 1 --2- 172.21.15.133:0/3093995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79dc0b4c20 0x7f79dc141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:04:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79e0bdd700 1 --2- 172.21.15.133:0/3093995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79dc05fd10 0x7f79dc13a210 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f79dc152750 tx=0x7f79cc007f50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79d9ffb700 1 -- 172.21.15.133:0/3093995 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79cc003070 con 0x7f79dc05fd10 2021-01-03T13:04:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79d9ffb700 1 -- 172.21.15.133:0/3093995 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc006a70 con 0x7f79dc05fd10 2021-01-03T13:04:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79d9ffb700 1 -- 172.21.15.133:0/3093995 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79cc006dd0 con 0x7f79dc05fd10 2021-01-03T13:04:04.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79e1bdf700 1 -- 172.21.15.133:0/3093995 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79dc152ad0 con 0x7f79dc05fd10 2021-01-03T13:04:04.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79e1bdf700 1 -- 172.21.15.133:0/3093995 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc09ef10 con 0x7f79dc05fd10 2021-01-03T13:04:04.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79e1bdf700 1 -- 172.21.15.133:0/3093995 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79dc13b8f0 con 0x7f79dc05fd10 2021-01-03T13:04:04.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79d9ffb700 1 -- 172.21.15.133:0/3093995 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f79cc010030 con 0x7f79dc05fd10 2021-01-03T13:04:04.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79d9ffb700 1 --2- 172.21.15.133:0/3093995 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f79bc0553b0 0x7f79bc057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:04.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79d9ffb700 1 -- 172.21.15.133:0/3093995 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f79cc06ddf0 con 0x7f79dc05fd10 2021-01-03T13:04:04.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.590+0000 7f79dbfff700 1 --2- 172.21.15.133:0/3093995 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f79bc0553b0 0x7f79bc057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:04.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.594+0000 7f79dbfff700 1 --2- 172.21.15.133:0/3093995 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f79bc0553b0 0x7f79bc057870 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f79d0008000 tx=0x7f79d0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:04.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.602+0000 7f79d9ffb700 1 -- 172.21.15.133:0/3093995 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f79cc044090 con 0x7f79dc05fd10 2021-01-03T13:04:04.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.778+0000 7f79e1bdf700 1 -- 172.21.15.133:0/3093995 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79dc09f220 con 0x7f79dc05fd10 2021-01-03T13:04:04.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.782+0000 7f79d9ffb700 1 -- 172.21.15.133:0/3093995 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2496 (secure 0 0 0) 0x7f79cc0476b0 con 0x7f79dc05fd10 2021-01-03T13:04:04.782 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:04:04.782 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/524155035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":524155035},{"type":"v1","addr":"172.21.15.16:6833","nonce":524155035}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":31},{"gid":6175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1381538323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1381538323},{"type":"v1","addr":"172.21.15.133:6835","nonce":1381538323}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:03:59.914082+0000","modified":"2021-01-03T13:04:00.917279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6178},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6178":{"gid":6178,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1189475847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1189475847},{"type":"v1","addr":"172.21.15.133:6837","nonce":1189475847}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-01-03T13:04:04.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.782+0000 7f79e1bdf700 1 -- 172.21.15.133:0/3093995 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f79bc0553b0 msgr2=0x7f79bc057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.782+0000 7f79e1bdf700 1 --2- 172.21.15.133:0/3093995 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f79bc0553b0 0x7f79bc057870 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f79d0008000 tx=0x7f79d0008040).stop 2021-01-03T13:04:04.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.782+0000 7f79e1bdf700 1 -- 172.21.15.133:0/3093995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79dc05fd10 msgr2=0x7f79dc13a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:04.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.782+0000 7f79e1bdf700 1 --2- 172.21.15.133:0/3093995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79dc05fd10 0x7f79dc13a210 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f79dc152750 tx=0x7f79cc007f50).stop 2021-01-03T13:04:04.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.782+0000 7f79e1bdf700 1 -- 172.21.15.133:0/3093995 shutdown_connections 2021-01-03T13:04:04.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.782+0000 7f79e1bdf700 1 --2- 172.21.15.133:0/3093995 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f79bc0553b0 0x7f79bc057870 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.782+0000 7f79e1bdf700 1 --2- 172.21.15.133:0/3093995 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79dc0b4c20 0x7f79dc141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.782+0000 7f79e1bdf700 1 --2- 172.21.15.133:0/3093995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79dc05fd10 0x7f79dc13a210 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.782+0000 7f79e1bdf700 1 --2- 172.21.15.133:0/3093995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f79dc060510 0x7f79dc13a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:04.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.782+0000 7f79e1bdf700 1 -- 172.21.15.133:0/3093995 >> 172.21.15.133:0/3093995 conn(0x7f79dc0b9f00 msgr2=0x7f79dc09c690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:04.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.782+0000 7f79e1bdf700 1 -- 172.21.15.133:0/3093995 shutdown_connections 2021-01-03T13:04:04.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:04.782+0000 7f79e1bdf700 1 -- 172.21.15.133:0/3093995 wait complete. 2021-01-03T13:04:04.786 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 33 2021-01-03T13:04:05.101 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:03:59.914082+0000', 'modified': '2021-01-03T13:04:00.917279+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6178}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6178': {'gid': 6178, 'name': 'c', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/1189475847', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 1189475847}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 1189475847}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:04:05.101 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:04:05.102 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T13:04:05.230 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":6178,"want_state":"up:active","state":"up:active","rank_uptime":5.3043010859999997,"mdsmap_epoch":33,"osdmap_epoch":79,"osdmap_epoch_barrier":77,"uptime":10.747014991} 2021-01-03T13:04:05.231 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 6178, "mdsmap_epoch": 33, "osdmap_epoch": 79, "osdmap_epoch_barrier": 77, "rank_uptime": 5.304301086, "state": "up:active", "uptime": 10.747014991, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:04:05.232 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:04:05.232 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-01-03T13:04:05.233 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi007.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-01-03T13:04:05.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:05.234 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:05.242 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:04:05.299 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:04:05.299 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:04:05.354 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:04:05.355 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:04:05.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:05.356 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:04:05.405 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:04:05.406 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:05.449 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:04:05.465 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:04:05.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:04:05.522 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:04:05.523 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:04:05.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:05.524 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:04:05.528 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2021-01-03T13:04:05.527+0000 7fd3d57130c0 -1 init, newargv = 0x555b4e7be7a0 newargc=9 2021-01-03T13:04:05.529 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12186]: starting ceph client 2021-01-03T13:04:05.540 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12186]: starting fuse 2021-01-03T13:04:06.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:04:06.652 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:04:06.653 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:04:06.710 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:04:06.711 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:04:06.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:06.712 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:04:06.757 INFO:teuthology.orchestra.run.smithi007.stdout:50 2021-01-03T13:04:06.758 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:04:06.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:06.759 DEBUG:teuthology.orchestra.run.smithi007:> sudo python3 -c ' 2021-01-03T13:04:06.759 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2021-01-03T13:04:06.760 DEBUG:teuthology.orchestra.run.smithi007:> import re 2021-01-03T13:04:06.760 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:04:06.760 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2021-01-03T13:04:06.761 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:04:06.761 DEBUG:teuthology.orchestra.run.smithi007:> def find_socket(client_name): 2021-01-03T13:04:06.761 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-01-03T13:04:06.762 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2021-01-03T13:04:06.762 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:04:06.763 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2021-01-03T13:04:06.763 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2021-01-03T13:04:06.763 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2021-01-03T13:04:06.764 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2021-01-03T13:04:06.764 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:04:06.765 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2021-01-03T13:04:06.765 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:04:06.765 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:04:06.766 DEBUG:teuthology.orchestra.run.smithi007:> return f 2021-01-03T13:04:06.766 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:04:06.766 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:04:06.767 DEBUG:teuthology.orchestra.run.smithi007:> print(find_socket("client.0")) 2021-01-03T13:04:06.767 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:04:06.850 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.12186.asok 2021-01-03T13:04:06.855 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12186.asok 2021-01-03T13:04:06.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:06.856 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12186.asok status 2021-01-03T13:04:06.955 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2021-01-03T13:04:06.956 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2021-01-03T13:04:06.956 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:04:06.956 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:04:06.956 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2021-01-03T13:04:06.957 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2021-01-03T13:04:06.957 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-01-03T13:04:06.957 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "12186", 2021-01-03T13:04:06.957 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2021-01-03T13:04:06.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:04:06.958 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2021-01-03T13:04:06.958 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2021-01-03T13:04:06.958 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 6267, 2021-01-03T13:04:06.958 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2021-01-03T13:04:06.959 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2021-01-03T13:04:06.959 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2021-01-03T13:04:06.959 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 6267 2021-01-03T13:04:06.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:04:06.959 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:04:06.960 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:04:06.960 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:04:06.960 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2138852502 2021-01-03T13:04:06.960 INFO:teuthology.orchestra.run.smithi007.stdout: } 2021-01-03T13:04:06.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:04:06.961 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:04:06.961 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:04:06.961 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:04:06.961 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2138852502 2021-01-03T13:04:06.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:04:06.962 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.6267 172.21.15.7:0/2138852502", 2021-01-03T13:04:06.962 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "172.21.15.7:0/2138852502", 2021-01-03T13:04:06.962 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2021-01-03T13:04:06.962 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 33, 2021-01-03T13:04:06.962 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 79, 2021-01-03T13:04:06.963 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:04:06.963 INFO:teuthology.orchestra.run.smithi007.stdout: "blacklisted": false, 2021-01-03T13:04:06.963 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2021-01-03T13:04:06.963 INFO:teuthology.orchestra.run.smithi007.stdout:} 2021-01-03T13:04:06.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:06.965 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:04:06.965 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:06.973 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:04:06.974 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:04:06.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:06.975 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:07.033 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:04:07.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.150+0000 7fa9630e3700 1 Processor -- start 2021-01-03T13:04:07.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.150+0000 7fa9630e3700 1 -- start start 2021-01-03T13:04:07.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.150+0000 7fa9630e3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa95c05c840 0x7fa95c0af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.150+0000 7fa9630e3700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa95c05cc20 con 0x7fa95c13f960 2021-01-03T13:04:07.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.150+0000 7fa9630e3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa95c0ad2d0 con 0x7fa95c0afa70 2021-01-03T13:04:07.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.150+0000 7fa9630e3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c0b18e0 con 0x7fa95c05c840 2021-01-03T13:04:07.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.150+0000 7fa95bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa95c0afa70 0x7fa95c13f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:56970/0 (socket says 172.21.15.133:56970) 2021-01-03T13:04:07.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.150+0000 7fa95bfff700 1 -- 172.21.15.133:0/1240030296 learned_addr learned my addr 172.21.15.133:0/1240030296 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:07.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.150+0000 7fa960e7f700 1 --2- 172.21.15.133:0/1240030296 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa95c05c840 0x7fa95c0af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.150+0000 7fa95b7fe700 1 -- 172.21.15.133:0/1240030296 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160732104 0 0) 0x7fa95c0ad2d0 con 0x7fa95c0afa70 2021-01-03T13:04:07.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.150+0000 7fa95b7fe700 1 -- 172.21.15.133:0/1240030296 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa93c003230 con 0x7fa95c0afa70 2021-01-03T13:04:07.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.150+0000 7fa95b7fe700 1 -- 172.21.15.133:0/1240030296 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829969945 0 0) 0x7fa95c05cc20 con 0x7fa95c13f960 2021-01-03T13:04:07.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.150+0000 7fa95b7fe700 1 -- 172.21.15.133:0/1240030296 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa95c0ad2d0 con 0x7fa95c13f960 2021-01-03T13:04:07.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.150+0000 7fa960e7f700 1 -- 172.21.15.133:0/1240030296 >> v1:172.21.15.133:6789/0 conn(0x7fa95c0afa70 legacy=0x7fa95c13f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.150+0000 7fa960e7f700 1 -- 172.21.15.133:0/1240030296 >> v1:172.21.15.16:6789/0 conn(0x7fa95c13f960 legacy=0x7fa95c138c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.150+0000 7fa960e7f700 1 -- 172.21.15.133:0/1240030296 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95c0ad570 con 0x7fa95c05c840 2021-01-03T13:04:07.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.150+0000 7fa960e7f700 1 --2- 172.21.15.133:0/1240030296 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa95c05c840 0x7fa95c0af440 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fa94c0032b0 tx=0x7fa94c00a360).ready entity=mon.2 client_cookie=1cc39ae2e8cd4dc6 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:07.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.154+0000 7fa95b7fe700 1 -- 172.21.15.133:0/1240030296 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa94c00ce50 con 0x7fa95c05c840 2021-01-03T13:04:07.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.154+0000 7fa95b7fe700 1 -- 172.21.15.133:0/1240030296 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c010410 con 0x7fa95c05c840 2021-01-03T13:04:07.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.154+0000 7fa95b7fe700 1 -- 172.21.15.133:0/1240030296 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa94c010770 con 0x7fa95c05c840 2021-01-03T13:04:07.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.154+0000 7fa9630e3700 1 -- 172.21.15.133:0/1240030296 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa95c05c840 msgr2=0x7fa95c0af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.154+0000 7fa9630e3700 1 --2- 172.21.15.133:0/1240030296 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa95c05c840 0x7fa95c0af440 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fa94c0032b0 tx=0x7fa94c00a360).stop 2021-01-03T13:04:07.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.154+0000 7fa9630e3700 1 -- 172.21.15.133:0/1240030296 shutdown_connections 2021-01-03T13:04:07.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.154+0000 7fa9630e3700 1 --2- 172.21.15.133:0/1240030296 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa95c05c840 0x7fa95c0af440 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.154+0000 7fa9630e3700 1 -- 172.21.15.133:0/1240030296 >> 172.21.15.133:0/1240030296 conn(0x7fa95c06aeb0 msgr2=0x7fa95c05bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:07.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.154+0000 7fa9630e3700 1 -- 172.21.15.133:0/1240030296 shutdown_connections 2021-01-03T13:04:07.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.154+0000 7fa9630e3700 1 -- 172.21.15.133:0/1240030296 wait complete. 2021-01-03T13:04:07.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.154+0000 7fa9630e3700 1 Processor -- start 2021-01-03T13:04:07.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.154+0000 7fa9630e3700 1 -- start start 2021-01-03T13:04:07.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa9630e3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa95c05c840 0x7fa95c14fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa9630e3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa95c0afa70 0x7fa95c13c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa9630e3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa95c13f960 0x7fa95c0657a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa9630e3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c142590 con 0x7fa95c0afa70 2021-01-03T13:04:07.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa9630e3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c064050 con 0x7fa95c05c840 2021-01-03T13:04:07.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa9630e3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95c063b30 con 0x7fa95c13f960 2021-01-03T13:04:07.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa960e7f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa95c05c840 0x7fa95c14fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa960e7f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa95c05c840 0x7fa95c14fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35942/0 (socket says 172.21.15.133:35942) 2021-01-03T13:04:07.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa960e7f700 1 -- 172.21.15.133:0/2306110660 learned_addr learned my addr 172.21.15.133:0/2306110660 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:07.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa95bfff700 1 --2- 172.21.15.133:0/2306110660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa95c0afa70 0x7fa95c13c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa961680700 1 --2- 172.21.15.133:0/2306110660 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa95c13f960 0x7fa95c0657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa960e7f700 1 -- 172.21.15.133:0/2306110660 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa95c13f960 msgr2=0x7fa95c0657a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa960e7f700 1 --2- 172.21.15.133:0/2306110660 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa95c13f960 0x7fa95c0657a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa960e7f700 1 -- 172.21.15.133:0/2306110660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa95c0afa70 msgr2=0x7fa95c13c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa960e7f700 1 --2- 172.21.15.133:0/2306110660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa95c0afa70 0x7fa95c13c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa960e7f700 1 -- 172.21.15.133:0/2306110660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95c063db0 con 0x7fa95c05c840 2021-01-03T13:04:07.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa960e7f700 1 --2- 172.21.15.133:0/2306110660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa95c05c840 0x7fa95c14fd70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7fa94c0032b0 tx=0x7fa95c0ad460).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:07.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa959ffb700 1 -- 172.21.15.133:0/2306110660 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa94c01a850 con 0x7fa95c05c840 2021-01-03T13:04:07.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa959ffb700 1 -- 172.21.15.133:0/2306110660 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c01a9b0 con 0x7fa95c05c840 2021-01-03T13:04:07.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa9630e3700 1 -- 172.21.15.133:0/2306110660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa95c1422f0 con 0x7fa95c05c840 2021-01-03T13:04:07.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa959ffb700 1 -- 172.21.15.133:0/2306110660 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa94c01ad10 con 0x7fa95c05c840 2021-01-03T13:04:07.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.158+0000 7fa9630e3700 1 -- 172.21.15.133:0/2306110660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa95c141de0 con 0x7fa95c05c840 2021-01-03T13:04:07.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.162+0000 7fa9630e3700 1 -- 172.21.15.133:0/2306110660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa95c057300 con 0x7fa95c05c840 2021-01-03T13:04:07.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.162+0000 7fa959ffb700 1 -- 172.21.15.133:0/2306110660 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa94c02a070 con 0x7fa95c05c840 2021-01-03T13:04:07.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.162+0000 7fa959ffb700 1 --2- 172.21.15.133:0/2306110660 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa940055440 0x7fa940057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.162+0000 7fa959ffb700 1 -- 172.21.15.133:0/2306110660 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa94c06fe00 con 0x7fa95c05c840 2021-01-03T13:04:07.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.162+0000 7fa95bfff700 1 --2- 172.21.15.133:0/2306110660 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa940055440 0x7fa940057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.162+0000 7fa95bfff700 1 --2- 172.21.15.133:0/2306110660 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa940055440 0x7fa940057900 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fa94400b000 tx=0x7fa944009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:07.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.170+0000 7fa959ffb700 1 -- 172.21.15.133:0/2306110660 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa94c045ff0 con 0x7fa95c05c840 2021-01-03T13:04:07.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.310+0000 7fa9630e3700 1 -- 172.21.15.133:0/2306110660 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa95c05ce00 con 0x7fa95c05c840 2021-01-03T13:04:07.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.310+0000 7fa959ffb700 1 -- 172.21.15.133:0/2306110660 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fa94c049610 con 0x7fa95c05c840 2021-01-03T13:04:07.313 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:04:07.314 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":79,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:04:01.927555+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:03:57.389227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-01-03T13:03:58.706858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:04:07.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.314+0000 7fa9630e3700 1 -- 172.21.15.133:0/2306110660 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa940055440 msgr2=0x7fa940057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.314+0000 7fa9630e3700 1 --2- 172.21.15.133:0/2306110660 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa940055440 0x7fa940057900 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fa94400b000 tx=0x7fa944009040).stop 2021-01-03T13:04:07.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.314+0000 7fa9630e3700 1 -- 172.21.15.133:0/2306110660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa95c05c840 msgr2=0x7fa95c14fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.314+0000 7fa9630e3700 1 --2- 172.21.15.133:0/2306110660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa95c05c840 0x7fa95c14fd70 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7fa94c0032b0 tx=0x7fa95c0ad460).stop 2021-01-03T13:04:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.314+0000 7fa9630e3700 1 -- 172.21.15.133:0/2306110660 shutdown_connections 2021-01-03T13:04:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.314+0000 7fa9630e3700 1 --2- 172.21.15.133:0/2306110660 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa940055440 0x7fa940057900 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.314+0000 7fa9630e3700 1 --2- 172.21.15.133:0/2306110660 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa95c13f960 0x7fa95c0657a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.314+0000 7fa9630e3700 1 --2- 172.21.15.133:0/2306110660 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa95c05c840 0x7fa95c14fd70 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.314+0000 7fa9630e3700 1 --2- 172.21.15.133:0/2306110660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa95c0afa70 0x7fa95c13c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.314+0000 7fa9630e3700 1 -- 172.21.15.133:0/2306110660 >> 172.21.15.133:0/2306110660 conn(0x7fa95c06aeb0 msgr2=0x7fa95c138140 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:07.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.314+0000 7fa9630e3700 1 -- 172.21.15.133:0/2306110660 shutdown_connections 2021-01-03T13:04:07.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.314+0000 7fa9630e3700 1 -- 172.21.15.133:0/2306110660 wait complete. 2021-01-03T13:04:07.331 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:03:57.389227+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:03:58.706858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:04:07.332 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:04:07.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10eea73700 1 Processor -- start 2021-01-03T13:04:07.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10eea73700 1 -- start start 2021-01-03T13:04:07.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10eea73700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f10e80b5330 0x7f10e8141630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10eea73700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f10e80b5ae0 0x7f10e8144930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10eea73700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f10e80aec00 0x7f10e80af090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10eea73700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e80b16b0 con 0x7f10e80b5330 2021-01-03T13:04:07.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10eea73700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e8140a60 con 0x7f10e80aec00 2021-01-03T13:04:07.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10eea73700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e80b5710 con 0x7f10e80b5ae0 2021-01-03T13:04:07.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10ee272700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f10e80aec00 0x7f10e80af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10ee272700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f10e80aec00 0x7f10e80af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35954/0 (socket says 172.21.15.133:35954) 2021-01-03T13:04:07.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10ee272700 1 -- 172.21.15.133:0/3365544188 learned_addr learned my addr 172.21.15.133:0/3365544188 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:07.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10eda71700 1 --2- 172.21.15.133:0/3365544188 >> v2:172.21.15.16:3300/0 conn(0x7f10e80b5330 0x7f10e8141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10ee272700 1 -- 172.21.15.133:0/3365544188 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f10e80b5ae0 msgr2=0x7f10e8144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:07.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10ed270700 1 --2- 172.21.15.133:0/3365544188 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f10e80b5ae0 0x7f10e8144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10ee272700 1 --2- 172.21.15.133:0/3365544188 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f10e80b5ae0 0x7f10e8144930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10ee272700 1 -- 172.21.15.133:0/3365544188 >> v2:172.21.15.16:3300/0 conn(0x7f10e80b5330 msgr2=0x7f10e8141630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:07.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10ee272700 1 --2- 172.21.15.133:0/3365544188 >> v2:172.21.15.16:3300/0 conn(0x7f10e80b5330 0x7f10e8141630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10ee272700 1 -- 172.21.15.133:0/3365544188 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e8140c50 con 0x7f10e80aec00 2021-01-03T13:04:07.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10eda71700 1 --2- 172.21.15.133:0/3365544188 >> v2:172.21.15.16:3300/0 conn(0x7f10e80b5330 0x7f10e8141630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:04:07.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10ed270700 1 --2- 172.21.15.133:0/3365544188 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f10e80b5ae0 0x7f10e8144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:04:07.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10ee272700 1 --2- 172.21.15.133:0/3365544188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10e80aec00 0x7f10e80af090 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f10e00032b0 tx=0x7f10e0009270).ready entity=mon.1 client_cookie=ae5d4886a3168a6c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:07.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10eca6f700 1 -- 172.21.15.133:0/3365544188 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10e000bc00 con 0x7f10e80aec00 2021-01-03T13:04:07.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10eca6f700 1 -- 172.21.15.133:0/3365544188 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e000bd60 con 0x7f10e80aec00 2021-01-03T13:04:07.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10eca6f700 1 -- 172.21.15.133:0/3365544188 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10e0011400 con 0x7f10e80aec00 2021-01-03T13:04:07.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10eea73700 1 -- 172.21.15.133:0/3365544188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10e80aec00 msgr2=0x7f10e80af090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.454+0000 7f10eea73700 1 --2- 172.21.15.133:0/3365544188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10e80aec00 0x7f10e80af090 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f10e00032b0 tx=0x7f10e0009270).stop 2021-01-03T13:04:07.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.458+0000 7f10eea73700 1 -- 172.21.15.133:0/3365544188 shutdown_connections 2021-01-03T13:04:07.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.458+0000 7f10eea73700 1 --2- 172.21.15.133:0/3365544188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10e80aec00 0x7f10e80af090 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.458+0000 7f10eea73700 1 --2- 172.21.15.133:0/3365544188 >> v2:172.21.15.16:3300/0 conn(0x7f10e80b5330 0x7f10e8141630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.458+0000 7f10eea73700 1 --2- 172.21.15.133:0/3365544188 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f10e80b5ae0 0x7f10e8144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.458+0000 7f10eea73700 1 -- 172.21.15.133:0/3365544188 >> 172.21.15.133:0/3365544188 conn(0x7f10e805bdf0 msgr2=0x7f10e805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:07.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.458+0000 7f10eea73700 1 -- 172.21.15.133:0/3365544188 shutdown_connections 2021-01-03T13:04:07.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.458+0000 7f10eea73700 1 -- 172.21.15.133:0/3365544188 wait complete. 2021-01-03T13:04:07.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.458+0000 7f10eea73700 1 Processor -- start 2021-01-03T13:04:07.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.458+0000 7f10eea73700 1 -- start start 2021-01-03T13:04:07.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.458+0000 7f10eea73700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10e80aec00 0x7f10e80b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.458+0000 7f10eea73700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10e80b5330 0x7f10e81464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.458+0000 7f10eea73700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f10e80b5ae0 0x7f10e813cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.458+0000 7f10eea73700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e813c590 con 0x7f10e80aec00 2021-01-03T13:04:07.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.458+0000 7f10eea73700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e81469c0 con 0x7f10e80b5330 2021-01-03T13:04:07.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.458+0000 7f10eea73700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e8147680 con 0x7f10e80b5ae0 2021-01-03T13:04:07.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10ed270700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10e80b5330 0x7f10e81464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10ed270700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10e80b5330 0x7f10e81464d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35956/0 (socket says 172.21.15.133:35956) 2021-01-03T13:04:07.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10ed270700 1 -- 172.21.15.133:0/3104566282 learned_addr learned my addr 172.21.15.133:0/3104566282 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:07.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10eda71700 1 --2- 172.21.15.133:0/3104566282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10e80aec00 0x7f10e80b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10ee272700 1 --2- 172.21.15.133:0/3104566282 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f10e80b5ae0 0x7f10e813cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10ed270700 1 -- 172.21.15.133:0/3104566282 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f10e80b5ae0 msgr2=0x7f10e813cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10ed270700 1 --2- 172.21.15.133:0/3104566282 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f10e80b5ae0 0x7f10e813cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10ed270700 1 -- 172.21.15.133:0/3104566282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10e80aec00 msgr2=0x7f10e80b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10ed270700 1 --2- 172.21.15.133:0/3104566282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10e80aec00 0x7f10e80b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10ed270700 1 -- 172.21.15.133:0/3104566282 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e8147920 con 0x7f10e80b5330 2021-01-03T13:04:07.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10ee272700 1 --2- 172.21.15.133:0/3104566282 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f10e80b5ae0 0x7f10e813cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:04:07.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10ed270700 1 --2- 172.21.15.133:0/3104566282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10e80b5330 0x7f10e81464d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f10d8007000 tx=0x7f10d8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:07.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10d6ffd700 1 -- 172.21.15.133:0/3104566282 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10d8010580 con 0x7f10e80b5330 2021-01-03T13:04:07.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10d6ffd700 1 -- 172.21.15.133:0/3104566282 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d80106e0 con 0x7f10e80b5330 2021-01-03T13:04:07.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10eea73700 1 -- 172.21.15.133:0/3104566282 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e8147bc0 con 0x7f10e80b5330 2021-01-03T13:04:07.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10d6ffd700 1 -- 172.21.15.133:0/3104566282 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10d8010a40 con 0x7f10e80b5330 2021-01-03T13:04:07.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10eea73700 1 -- 172.21.15.133:0/3104566282 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e8147f10 con 0x7f10e80b5330 2021-01-03T13:04:07.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10eea73700 1 -- 172.21.15.133:0/3104566282 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e80687f0 con 0x7f10e80b5330 2021-01-03T13:04:07.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10d6ffd700 1 -- 172.21.15.133:0/3104566282 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f10d8010ba0 con 0x7f10e80b5330 2021-01-03T13:04:07.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10d6ffd700 1 --2- 172.21.15.133:0/3104566282 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f10c80553b0 0x7f10c8057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10d6ffd700 1 -- 172.21.15.133:0/3104566282 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f10d806e050 con 0x7f10e80b5330 2021-01-03T13:04:07.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.462+0000 7f10eda71700 1 --2- 172.21.15.133:0/3104566282 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f10c80553b0 0x7f10c8057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.466+0000 7f10eda71700 1 --2- 172.21.15.133:0/3104566282 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f10c80553b0 0x7f10c8057870 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f10e400d000 tx=0x7f10e4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:07.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.470+0000 7f10d6ffd700 1 -- 172.21.15.133:0/3104566282 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f10e80687f0 con 0x7f10e80b5330 2021-01-03T13:04:07.576 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:04:07.578 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:04:07.581 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:04:07.583 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:04:07.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.610+0000 7f10eea73700 1 -- 172.21.15.133:0/3104566282 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f10e80687f0 con 0x7f10e80b5330 2021-01-03T13:04:07.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.610+0000 7f10d6ffd700 1 -- 172.21.15.133:0/3104566282 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v79) v1 ==== 110+0+10 (secure 0 0 0) 0x7f10e80687f0 con 0x7f10e80b5330 2021-01-03T13:04:07.612 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:04:07.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.614+0000 7f10eea73700 1 -- 172.21.15.133:0/3104566282 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f10c80553b0 msgr2=0x7f10c8057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.614+0000 7f10eea73700 1 --2- 172.21.15.133:0/3104566282 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f10c80553b0 0x7f10c8057870 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f10e400d000 tx=0x7f10e4008040).stop 2021-01-03T13:04:07.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.614+0000 7f10eea73700 1 -- 172.21.15.133:0/3104566282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10e80b5330 msgr2=0x7f10e81464d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.614+0000 7f10eea73700 1 --2- 172.21.15.133:0/3104566282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10e80b5330 0x7f10e81464d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f10d8007000 tx=0x7f10d8008040).stop 2021-01-03T13:04:07.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.614+0000 7f10eea73700 1 -- 172.21.15.133:0/3104566282 shutdown_connections 2021-01-03T13:04:07.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.614+0000 7f10eea73700 1 --2- 172.21.15.133:0/3104566282 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f10c80553b0 0x7f10c8057870 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.614+0000 7f10eea73700 1 --2- 172.21.15.133:0/3104566282 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f10e80aec00 0x7f10e80b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.614+0000 7f10eea73700 1 --2- 172.21.15.133:0/3104566282 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f10e80b5ae0 0x7f10e813cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.614+0000 7f10eea73700 1 --2- 172.21.15.133:0/3104566282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f10e80b5330 0x7f10e81464d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.614+0000 7f10eea73700 1 -- 172.21.15.133:0/3104566282 >> 172.21.15.133:0/3104566282 conn(0x7f10e805bdf0 msgr2=0x7f10e813e900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:07.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.614+0000 7f10eea73700 1 -- 172.21.15.133:0/3104566282 shutdown_connections 2021-01-03T13:04:07.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.614+0000 7f10eea73700 1 -- 172.21.15.133:0/3104566282 wait complete. 2021-01-03T13:04:07.625 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:04:07.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.786+0000 7f281575b700 1 Processor -- start 2021-01-03T13:04:07.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.786+0000 7f281575b700 1 -- start start 2021-01-03T13:04:07.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.786+0000 7f281575b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f28100b6bb0 0x7f281013a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.786+0000 7f281575b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f28100b29b0 0x7f28100b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.786+0000 7f281575b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28100600c0 con 0x7f281005f5e0 2021-01-03T13:04:07.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.786+0000 7f281575b700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28100b1f00 con 0x7f28100b6bb0 2021-01-03T13:04:07.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.786+0000 7f281575b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2810060360 con 0x7f28100b29b0 2021-01-03T13:04:07.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.786+0000 7f280e7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f28100b29b0 0x7f28100b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.786+0000 7f280f7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f281005f5e0 0x7f28100af970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57000/0 (socket says 172.21.15.133:57000) 2021-01-03T13:04:07.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.786+0000 7f280f7fe700 1 -- 172.21.15.133:0/1723351598 learned_addr learned my addr 172.21.15.133:0/1723351598 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:07.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.786+0000 7f280effd700 1 --2- 172.21.15.133:0/1723351598 >> v2:172.21.15.16:3300/0 conn(0x7f28100b6bb0 0x7f281013a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.786+0000 7f280dffb700 1 -- 172.21.15.133:0/1723351598 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41145920 0 0) 0x7f28100600c0 con 0x7f281005f5e0 2021-01-03T13:04:07.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.786+0000 7f280dffb700 1 -- 172.21.15.133:0/1723351598 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f4003230 con 0x7f281005f5e0 2021-01-03T13:04:07.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.786+0000 7f280e7fc700 1 -- 172.21.15.133:0/1723351598 >> v2:172.21.15.16:3300/0 conn(0x7f28100b6bb0 msgr2=0x7f281013a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:07.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.786+0000 7f280e7fc700 1 --2- 172.21.15.133:0/1723351598 >> v2:172.21.15.16:3300/0 conn(0x7f28100b6bb0 0x7f281013a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.786+0000 7f280e7fc700 1 -- 172.21.15.133:0/1723351598 >> v1:172.21.15.133:6789/0 conn(0x7f281005f5e0 legacy=0x7f28100af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.786+0000 7f280e7fc700 1 -- 172.21.15.133:0/1723351598 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2810060a60 con 0x7f28100b29b0 2021-01-03T13:04:07.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.790+0000 7f280e7fc700 1 --2- 172.21.15.133:0/1723351598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28100b29b0 0x7f28100b0ca0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f2804002f30 tx=0x7f2804006dc0).ready entity=mon.1 client_cookie=4b54d6c3306d313c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:07.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.790+0000 7f280dffb700 1 -- 172.21.15.133:0/1723351598 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28040096f0 con 0x7f28100b29b0 2021-01-03T13:04:07.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.790+0000 7f280dffb700 1 -- 172.21.15.133:0/1723351598 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2804009850 con 0x7f28100b29b0 2021-01-03T13:04:07.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.790+0000 7f280dffb700 1 -- 172.21.15.133:0/1723351598 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2804009bb0 con 0x7f28100b29b0 2021-01-03T13:04:07.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.790+0000 7f281575b700 1 -- 172.21.15.133:0/1723351598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28100b29b0 msgr2=0x7f28100b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.790+0000 7f281575b700 1 --2- 172.21.15.133:0/1723351598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28100b29b0 0x7f28100b0ca0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f2804002f30 tx=0x7f2804006dc0).stop 2021-01-03T13:04:07.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.790+0000 7f281575b700 1 -- 172.21.15.133:0/1723351598 shutdown_connections 2021-01-03T13:04:07.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.790+0000 7f281575b700 1 --2- 172.21.15.133:0/1723351598 >> v2:172.21.15.16:3300/0 conn(0x7f28100b6bb0 0x7f281013a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.790+0000 7f281575b700 1 --2- 172.21.15.133:0/1723351598 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28100b29b0 0x7f28100b0ca0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.790+0000 7f281575b700 1 -- 172.21.15.133:0/1723351598 >> 172.21.15.133:0/1723351598 conn(0x7f28100622f0 msgr2=0x7f28100b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:07.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.790+0000 7f281575b700 1 -- 172.21.15.133:0/1723351598 shutdown_connections 2021-01-03T13:04:07.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.790+0000 7f281575b700 1 -- 172.21.15.133:0/1723351598 wait complete. 2021-01-03T13:04:07.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.790+0000 7f281575b700 1 Processor -- start 2021-01-03T13:04:07.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.790+0000 7f281575b700 1 -- start start 2021-01-03T13:04:07.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f281575b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f281005f5e0 0x7f281010fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f281575b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28100b6bb0 0x7f2810065460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f281575b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2810112180 0x7f2810111740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f281575b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28101106c0 con 0x7f28100b6bb0 2021-01-03T13:04:07.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f281575b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28101101e0 con 0x7f281005f5e0 2021-01-03T13:04:07.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f281575b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2810150880 con 0x7f2810112180 2021-01-03T13:04:07.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f280effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f281005f5e0 0x7f281010fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f280effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f281005f5e0 0x7f281010fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35970/0 (socket says 172.21.15.133:35970) 2021-01-03T13:04:07.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f280effd700 1 -- 172.21.15.133:0/1631451465 learned_addr learned my addr 172.21.15.133:0/1631451465 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:07.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f280e7fc700 1 --2- 172.21.15.133:0/1631451465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28100b6bb0 0x7f2810065460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f280f7fe700 1 --2- 172.21.15.133:0/1631451465 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2810112180 0x7f2810111740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f280effd700 1 -- 172.21.15.133:0/1631451465 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2810112180 msgr2=0x7f2810111740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f280effd700 1 --2- 172.21.15.133:0/1631451465 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2810112180 0x7f2810111740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f280effd700 1 -- 172.21.15.133:0/1631451465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28100b6bb0 msgr2=0x7f2810065460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f280effd700 1 --2- 172.21.15.133:0/1631451465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28100b6bb0 0x7f2810065460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f280effd700 1 -- 172.21.15.133:0/1631451465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28101108f0 con 0x7f281005f5e0 2021-01-03T13:04:07.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f280effd700 1 --2- 172.21.15.133:0/1631451465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f281005f5e0 0x7f281010fcf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f280000c000 tx=0x7f2800006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:07.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f27fffff700 1 -- 172.21.15.133:0/1631451465 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f280000ca10 con 0x7f281005f5e0 2021-01-03T13:04:07.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f27fffff700 1 -- 172.21.15.133:0/1631451465 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280000cb70 con 0x7f281005f5e0 2021-01-03T13:04:07.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f281575b700 1 -- 172.21.15.133:0/1631451465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2810110b90 con 0x7f281005f5e0 2021-01-03T13:04:07.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f27fffff700 1 -- 172.21.15.133:0/1631451465 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f280000be50 con 0x7f281005f5e0 2021-01-03T13:04:07.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f281575b700 1 -- 172.21.15.133:0/1631451465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28101504c0 con 0x7f281005f5e0 2021-01-03T13:04:07.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.794+0000 7f281575b700 1 -- 172.21.15.133:0/1631451465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2810111f70 con 0x7f281005f5e0 2021-01-03T13:04:07.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.798+0000 7f27fffff700 1 -- 172.21.15.133:0/1631451465 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f280001c460 con 0x7f281005f5e0 2021-01-03T13:04:07.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.798+0000 7f27fffff700 1 --2- 172.21.15.133:0/1631451465 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27ec0553b0 0x7f27ec057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:07.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.798+0000 7f27fffff700 1 -- 172.21.15.133:0/1631451465 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f280006e360 con 0x7f281005f5e0 2021-01-03T13:04:07.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.798+0000 7f280e7fc700 1 --2- 172.21.15.133:0/1631451465 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27ec0553b0 0x7f27ec057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:07.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.798+0000 7f280e7fc700 1 --2- 172.21.15.133:0/1631451465 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27ec0553b0 0x7f27ec057870 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f280401b000 tx=0x7f2804015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:07.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.802+0000 7f27fffff700 1 -- 172.21.15.133:0/1631451465 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2810111f70 con 0x7f281005f5e0 2021-01-03T13:04:07.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.942+0000 7f281575b700 1 -- 172.21.15.133:0/1631451465 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2810111f70 con 0x7f281005f5e0 2021-01-03T13:04:07.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.946+0000 7f27fffff700 1 -- 172.21.15.133:0/1631451465 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v79) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2810111f70 con 0x7f281005f5e0 2021-01-03T13:04:07.946 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:04:07.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.946+0000 7f281575b700 1 -- 172.21.15.133:0/1631451465 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27ec0553b0 msgr2=0x7f27ec057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.946+0000 7f281575b700 1 --2- 172.21.15.133:0/1631451465 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27ec0553b0 0x7f27ec057870 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f280401b000 tx=0x7f2804015000).stop 2021-01-03T13:04:07.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.946+0000 7f281575b700 1 -- 172.21.15.133:0/1631451465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f281005f5e0 msgr2=0x7f281010fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:07.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.946+0000 7f281575b700 1 --2- 172.21.15.133:0/1631451465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f281005f5e0 0x7f281010fcf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f280000c000 tx=0x7f2800006dc0).stop 2021-01-03T13:04:07.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.946+0000 7f281575b700 1 -- 172.21.15.133:0/1631451465 shutdown_connections 2021-01-03T13:04:07.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.946+0000 7f281575b700 1 --2- 172.21.15.133:0/1631451465 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27ec0553b0 0x7f27ec057870 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.946+0000 7f281575b700 1 --2- 172.21.15.133:0/1631451465 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2810112180 0x7f2810111740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.946+0000 7f281575b700 1 --2- 172.21.15.133:0/1631451465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f281005f5e0 0x7f281010fcf0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.946+0000 7f281575b700 1 --2- 172.21.15.133:0/1631451465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28100b6bb0 0x7f2810065460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:07.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.946+0000 7f281575b700 1 -- 172.21.15.133:0/1631451465 >> 172.21.15.133:0/1631451465 conn(0x7f28100622f0 msgr2=0x7f28100b5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:07.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.946+0000 7f281575b700 1 -- 172.21.15.133:0/1631451465 shutdown_connections 2021-01-03T13:04:07.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:07.946+0000 7f281575b700 1 -- 172.21.15.133:0/1631451465 wait complete. 2021-01-03T13:04:07.959 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:04:08.074 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.074+0000 7f125ffff700 1 Processor -- start 2021-01-03T13:04:08.075 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.074+0000 7f125ffff700 1 -- start start 2021-01-03T13:04:08.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.074+0000 7f125ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f12600677a0 0x7f12600ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.074+0000 7f125ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12600b1a50 0x7f12600a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.074+0000 7f125ffff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1260140ae0 con 0x7f126005c670 2021-01-03T13:04:08.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.074+0000 7f125ffff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12600ace10 con 0x7f12600677a0 2021-01-03T13:04:08.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.074+0000 7f125ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1260067b80 con 0x7f12600b1a50 2021-01-03T13:04:08.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.074+0000 7f125effd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f12600677a0 0x7f12600ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.074+0000 7f125effd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f12600677a0 0x7f12600ae3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35978/0 (socket says 172.21.15.133:35978) 2021-01-03T13:04:08.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.074+0000 7f125effd700 1 -- 172.21.15.133:0/627238576 learned_addr learned my addr 172.21.15.133:0/627238576 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:08.078 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.074+0000 7f125f7fe700 1 --2- 172.21.15.133:0/627238576 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12600b1a50 0x7f12600a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.079 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.074+0000 7f125effd700 1 -- 172.21.15.133:0/627238576 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12600b1a50 msgr2=0x7f12600a8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:08.079 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.074+0000 7f125effd700 1 --2- 172.21.15.133:0/627238576 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12600b1a50 0x7f12600a8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.074+0000 7f125effd700 1 -- 172.21.15.133:0/627238576 >> v1:172.21.15.16:6789/0 conn(0x7f126005c670 legacy=0x7f1260146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.074+0000 7f125effd700 1 -- 172.21.15.133:0/627238576 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12600b1560 con 0x7f12600677a0 2021-01-03T13:04:08.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.074+0000 7f125effd700 1 --2- 172.21.15.133:0/627238576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12600677a0 0x7f12600ae3b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f1250002f30 tx=0x7f1250006e80).ready entity=mon.1 client_cookie=8f6425d3b2508843 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:08.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.078+0000 7f125dffb700 1 -- 172.21.15.133:0/627238576 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12500097f0 con 0x7f12600677a0 2021-01-03T13:04:08.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.078+0000 7f125dffb700 1 -- 172.21.15.133:0/627238576 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1250009950 con 0x7f12600677a0 2021-01-03T13:04:08.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.078+0000 7f125dffb700 1 -- 172.21.15.133:0/627238576 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1250009cb0 con 0x7f12600677a0 2021-01-03T13:04:08.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.078+0000 7f125ffff700 1 -- 172.21.15.133:0/627238576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12600677a0 msgr2=0x7f12600ae3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.078+0000 7f125ffff700 1 --2- 172.21.15.133:0/627238576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12600677a0 0x7f12600ae3b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f1250002f30 tx=0x7f1250006e80).stop 2021-01-03T13:04:08.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.078+0000 7f125ffff700 1 -- 172.21.15.133:0/627238576 shutdown_connections 2021-01-03T13:04:08.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.078+0000 7f125ffff700 1 --2- 172.21.15.133:0/627238576 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12600b1a50 0x7f12600a8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.078+0000 7f125ffff700 1 --2- 172.21.15.133:0/627238576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12600677a0 0x7f12600ae3b0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.078+0000 7f125ffff700 1 -- 172.21.15.133:0/627238576 >> 172.21.15.133:0/627238576 conn(0x7f126006b050 msgr2=0x7f1260060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:08.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.078+0000 7f125ffff700 1 -- 172.21.15.133:0/627238576 shutdown_connections 2021-01-03T13:04:08.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.078+0000 7f125ffff700 1 -- 172.21.15.133:0/627238576 wait complete. 2021-01-03T13:04:08.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.078+0000 7f125ffff700 1 Processor -- start 2021-01-03T13:04:08.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.078+0000 7f125ffff700 1 -- start start 2021-01-03T13:04:08.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f126005c670 0x7f1260151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12600677a0 0x7f12601462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12600b1a50 0x7f12600aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125ffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1260142a30 con 0x7f12600677a0 2021-01-03T13:04:08.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12600ab5a0 con 0x7f12600b1a50 2021-01-03T13:04:08.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12600ab310 con 0x7f126005c670 2021-01-03T13:04:08.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12600b1a50 0x7f12600aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12600b1a50 0x7f12600aae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35988/0 (socket says 172.21.15.133:35988) 2021-01-03T13:04:08.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125f7fe700 1 -- 172.21.15.133:0/3818230018 learned_addr learned my addr 172.21.15.133:0/3818230018 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:08.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125effd700 1 --2- 172.21.15.133:0/3818230018 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f126005c670 0x7f1260151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125e7fc700 1 --2- 172.21.15.133:0/3818230018 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12600677a0 0x7f12601462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125f7fe700 1 -- 172.21.15.133:0/3818230018 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f126005c670 msgr2=0x7f1260151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125f7fe700 1 --2- 172.21.15.133:0/3818230018 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f126005c670 0x7f1260151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125f7fe700 1 -- 172.21.15.133:0/3818230018 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12600677a0 msgr2=0x7f12601462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125f7fe700 1 --2- 172.21.15.133:0/3818230018 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12600677a0 0x7f12601462d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125f7fe700 1 -- 172.21.15.133:0/3818230018 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1260140d80 con 0x7f12600b1a50 2021-01-03T13:04:08.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125f7fe700 1 --2- 172.21.15.133:0/3818230018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12600b1a50 0x7f12600aae20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f12580032c0 tx=0x7f1258008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:08.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f124ffff700 1 -- 172.21.15.133:0/3818230018 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1258009980 con 0x7f12600b1a50 2021-01-03T13:04:08.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f124ffff700 1 -- 172.21.15.133:0/3818230018 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1258009ae0 con 0x7f12600b1a50 2021-01-03T13:04:08.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f124ffff700 1 -- 172.21.15.133:0/3818230018 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1258009e40 con 0x7f12600b1a50 2021-01-03T13:04:08.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125ffff700 1 -- 172.21.15.133:0/3818230018 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1260141020 con 0x7f12600b1a50 2021-01-03T13:04:08.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.082+0000 7f125ffff700 1 -- 172.21.15.133:0/3818230018 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12600ab9c0 con 0x7f12600b1a50 2021-01-03T13:04:08.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.086+0000 7f124ffff700 1 -- 172.21.15.133:0/3818230018 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1258013480 con 0x7f12600b1a50 2021-01-03T13:04:08.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.086+0000 7f125ffff700 1 -- 172.21.15.133:0/3818230018 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1260057300 con 0x7f12600b1a50 2021-01-03T13:04:08.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.086+0000 7f124ffff700 1 --2- 172.21.15.133:0/3818230018 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f123c0553f0 0x7f123c0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.086+0000 7f125effd700 1 --2- 172.21.15.133:0/3818230018 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f123c0553f0 0x7f123c0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.086+0000 7f124ffff700 1 -- 172.21.15.133:0/3818230018 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f125806e8d0 con 0x7f12600b1a50 2021-01-03T13:04:08.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.086+0000 7f125effd700 1 --2- 172.21.15.133:0/3818230018 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f123c0553f0 0x7f123c0578b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f125001c000 tx=0x7f1250015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:08.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.094+0000 7f124ffff700 1 -- 172.21.15.133:0/3818230018 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1258044a60 con 0x7f12600b1a50 2021-01-03T13:04:08.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.234+0000 7f125ffff700 1 -- 172.21.15.133:0/3818230018 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f126005f080 con 0x7f12600b1a50 2021-01-03T13:04:08.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.238+0000 7f124ffff700 1 -- 172.21.15.133:0/3818230018 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+10 (secure 0 0 0) 0x7f1258048080 con 0x7f12600b1a50 2021-01-03T13:04:08.238 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:04:08.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.238+0000 7f125ffff700 1 -- 172.21.15.133:0/3818230018 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f123c0553f0 msgr2=0x7f123c0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.238+0000 7f125ffff700 1 --2- 172.21.15.133:0/3818230018 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f123c0553f0 0x7f123c0578b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f125001c000 tx=0x7f1250015000).stop 2021-01-03T13:04:08.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.238+0000 7f125ffff700 1 -- 172.21.15.133:0/3818230018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12600b1a50 msgr2=0x7f12600aae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.238+0000 7f125ffff700 1 --2- 172.21.15.133:0/3818230018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12600b1a50 0x7f12600aae20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f12580032c0 tx=0x7f1258008040).stop 2021-01-03T13:04:08.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.238+0000 7f125ffff700 1 -- 172.21.15.133:0/3818230018 shutdown_connections 2021-01-03T13:04:08.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.238+0000 7f125ffff700 1 --2- 172.21.15.133:0/3818230018 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f123c0553f0 0x7f123c0578b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.238+0000 7f125ffff700 1 --2- 172.21.15.133:0/3818230018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12600b1a50 0x7f12600aae20 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.238+0000 7f125ffff700 1 --2- 172.21.15.133:0/3818230018 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f126005c670 0x7f1260151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.238+0000 7f125ffff700 1 --2- 172.21.15.133:0/3818230018 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12600677a0 0x7f12601462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.238+0000 7f125ffff700 1 -- 172.21.15.133:0/3818230018 >> 172.21.15.133:0/3818230018 conn(0x7f126006b050 msgr2=0x7f12600b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:08.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.238+0000 7f125ffff700 1 -- 172.21.15.133:0/3818230018 shutdown_connections 2021-01-03T13:04:08.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.238+0000 7f125ffff700 1 -- 172.21.15.133:0/3818230018 wait complete. 2021-01-03T13:04:08.257 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:04:08.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e17fff700 1 Processor -- start 2021-01-03T13:04:08.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e17fff700 1 -- start start 2021-01-03T13:04:08.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e17fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e180b5c00 0x7f2e181477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e17fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e180b0c10 con 0x7f2e181442a0 2021-01-03T13:04:08.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e17fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e180b5640 con 0x7f2e180b5260 2021-01-03T13:04:08.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e17fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1809a4f0 con 0x7f2e180b5c00 2021-01-03T13:04:08.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e16ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2e180b5260 0x7f2e181470b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57028/0 (socket says 172.21.15.133:57028) 2021-01-03T13:04:08.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e16ffd700 1 -- 172.21.15.133:0/414408099 learned_addr learned my addr 172.21.15.133:0/414408099 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:08.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e167fc700 1 --2- 172.21.15.133:0/414408099 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e180b5c00 0x7f2e181477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e15ffb700 1 -- 172.21.15.133:0/414408099 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884558597 0 0) 0x7f2e180b5640 con 0x7f2e180b5260 2021-01-03T13:04:08.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e15ffb700 1 -- 172.21.15.133:0/414408099 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2df8003230 con 0x7f2e180b5260 2021-01-03T13:04:08.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e15ffb700 1 -- 172.21.15.133:0/414408099 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4250909638 0 0) 0x7f2df8003230 con 0x7f2e180b5260 2021-01-03T13:04:08.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e15ffb700 1 -- 172.21.15.133:0/414408099 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e180b5c00 msgr2=0x7f2e181477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:08.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e15ffb700 1 --2- 172.21.15.133:0/414408099 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e180b5c00 0x7f2e181477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e15ffb700 1 -- 172.21.15.133:0/414408099 >> v1:172.21.15.16:6789/0 conn(0x7f2e181442a0 legacy=0x7f2e18144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e15ffb700 1 -- 172.21.15.133:0/414408099 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e180b0e40 con 0x7f2e180b5260 2021-01-03T13:04:08.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e15ffb700 1 -- 172.21.15.133:0/414408099 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f2e00001a50 con 0x7f2e180b5260 2021-01-03T13:04:08.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e15ffb700 1 -- 172.21.15.133:0/414408099 >> v1:172.21.15.133:6789/0 conn(0x7f2e180b5260 legacy=0x7f2e181470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e15ffb700 1 --2- 172.21.15.133:0/414408099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2df8003720 0x7f2df8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e15ffb700 1 --2- 172.21.15.133:0/414408099 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e180b5c00 0x7f2df80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e15ffb700 1 --2- 172.21.15.133:0/414408099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2df80049c0 0x7f2df8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e15ffb700 1 -- 172.21.15.133:0/414408099 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1809a4f0 con 0x7f2df80049c0 2021-01-03T13:04:08.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e15ffb700 1 -- 172.21.15.133:0/414408099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80041c0 con 0x7f2df8003720 2021-01-03T13:04:08.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e15ffb700 1 -- 172.21.15.133:0/414408099 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df800b720 con 0x7f2e180b5c00 2021-01-03T13:04:08.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.374+0000 7f2e16ffd700 1 --2- 172.21.15.133:0/414408099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2df8003720 0x7f2df8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e167fc700 1 --2- 172.21.15.133:0/414408099 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e180b5c00 0x7f2df80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e177fe700 1 --2- 172.21.15.133:0/414408099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2df80049c0 0x7f2df8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e16ffd700 1 -- 172.21.15.133:0/414408099 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e180b5c00 msgr2=0x7f2df80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:08.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e16ffd700 1 --2- 172.21.15.133:0/414408099 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e180b5c00 0x7f2df80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e16ffd700 1 -- 172.21.15.133:0/414408099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2df80049c0 msgr2=0x7f2df8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:08.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e16ffd700 1 --2- 172.21.15.133:0/414408099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2df80049c0 0x7f2df8004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e16ffd700 1 -- 172.21.15.133:0/414408099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df8003230 con 0x7f2df8003720 2021-01-03T13:04:08.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e16ffd700 1 --2- 172.21.15.133:0/414408099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2df8003720 0x7f2df8003b40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f2e00001760 tx=0x7f2e18060d00).ready entity=mon.1 client_cookie=ec6703be8cb55531 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:08.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e15ffb700 1 -- 172.21.15.133:0/414408099 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e00005b70 con 0x7f2df8003720 2021-01-03T13:04:08.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e15ffb700 1 -- 172.21.15.133:0/414408099 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e00005cd0 con 0x7f2df8003720 2021-01-03T13:04:08.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e15ffb700 1 -- 172.21.15.133:0/414408099 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e000072c0 con 0x7f2df8003720 2021-01-03T13:04:08.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e17fff700 1 -- 172.21.15.133:0/414408099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2df8003720 msgr2=0x7f2df8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e17fff700 1 --2- 172.21.15.133:0/414408099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2df8003720 0x7f2df8003b40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f2e00001760 tx=0x7f2e18060d00).stop 2021-01-03T13:04:08.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e177fe700 1 -- 172.21.15.133:0/414408099 reap_dead start 2021-01-03T13:04:08.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e17fff700 1 -- 172.21.15.133:0/414408099 shutdown_connections 2021-01-03T13:04:08.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e17fff700 1 -- 172.21.15.133:0/414408099 >> 172.21.15.133:0/414408099 conn(0x7f2e1805bdf0 msgr2=0x7f2e1805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:08.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e17fff700 1 -- 172.21.15.133:0/414408099 shutdown_connections 2021-01-03T13:04:08.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e17fff700 1 -- 172.21.15.133:0/414408099 wait complete. 2021-01-03T13:04:08.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e17fff700 1 Processor -- start 2021-01-03T13:04:08.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e17fff700 1 -- start start 2021-01-03T13:04:08.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e17fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e18066a80 0x7f2e18066e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e17fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e18142ea0 0x7f2e18143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e17fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e18063f60 0x7f2e180643e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e17fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180ae630 con 0x7f2e18142ea0 2021-01-03T13:04:08.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e17fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e18159f60 con 0x7f2e18066a80 2021-01-03T13:04:08.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e17fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e180af290 con 0x7f2e18063f60 2021-01-03T13:04:08.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e16ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e18066a80 0x7f2e18066e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e16ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e18066a80 0x7f2e18066e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36004/0 (socket says 172.21.15.133:36004) 2021-01-03T13:04:08.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e16ffd700 1 -- 172.21.15.133:0/3407308629 learned_addr learned my addr 172.21.15.133:0/3407308629 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:08.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e167fc700 1 --2- 172.21.15.133:0/3407308629 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e18142ea0 0x7f2e18143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.378+0000 7f2e177fe700 1 --2- 172.21.15.133:0/3407308629 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e18063f60 0x7f2e180643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.382+0000 7f2e16ffd700 1 -- 172.21.15.133:0/3407308629 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e18063f60 msgr2=0x7f2e180643e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.382+0000 7f2e16ffd700 1 --2- 172.21.15.133:0/3407308629 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e18063f60 0x7f2e180643e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.382+0000 7f2e16ffd700 1 -- 172.21.15.133:0/3407308629 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e18142ea0 msgr2=0x7f2e18143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.382+0000 7f2e16ffd700 1 --2- 172.21.15.133:0/3407308629 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e18142ea0 0x7f2e18143320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.382+0000 7f2e16ffd700 1 -- 172.21.15.133:0/3407308629 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e18159cd0 con 0x7f2e18066a80 2021-01-03T13:04:08.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.382+0000 7f2e16ffd700 1 --2- 172.21.15.133:0/3407308629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e18066a80 0x7f2e18066e60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f2e18063e40 tx=0x7f2e00015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:08.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.382+0000 7f2e0ffff700 1 -- 172.21.15.133:0/3407308629 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e00007700 con 0x7f2e18066a80 2021-01-03T13:04:08.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.382+0000 7f2e0ffff700 1 -- 172.21.15.133:0/3407308629 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e00007860 con 0x7f2e18066a80 2021-01-03T13:04:08.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.382+0000 7f2e0ffff700 1 -- 172.21.15.133:0/3407308629 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e00013640 con 0x7f2e18066a80 2021-01-03T13:04:08.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.382+0000 7f2e17fff700 1 -- 172.21.15.133:0/3407308629 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e180aeff0 con 0x7f2e18066a80 2021-01-03T13:04:08.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.382+0000 7f2e17fff700 1 -- 172.21.15.133:0/3407308629 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e18143810 con 0x7f2e18066a80 2021-01-03T13:04:08.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.382+0000 7f2e17fff700 1 -- 172.21.15.133:0/3407308629 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e180aecf0 con 0x7f2e18066a80 2021-01-03T13:04:08.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.382+0000 7f2e0ffff700 1 -- 172.21.15.133:0/3407308629 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2e00025020 con 0x7f2e18066a80 2021-01-03T13:04:08.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.382+0000 7f2e0ffff700 1 --2- 172.21.15.133:0/3407308629 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2dfc055330 0x7f2dfc0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.382+0000 7f2e0ffff700 1 -- 172.21.15.133:0/3407308629 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2e0006ef80 con 0x7f2e18066a80 2021-01-03T13:04:08.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.382+0000 7f2e167fc700 1 --2- 172.21.15.133:0/3407308629 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2dfc055330 0x7f2dfc0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.382+0000 7f2e167fc700 1 --2- 172.21.15.133:0/3407308629 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2dfc055330 0x7f2dfc0577f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f2e08008000 tx=0x7f2e08008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:08.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.390+0000 7f2e0ffff700 1 -- 172.21.15.133:0/3407308629 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2e00045280 con 0x7f2e18066a80 2021-01-03T13:04:08.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.530+0000 7f2e17fff700 1 -- 172.21.15.133:0/3407308629 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e18057300 con 0x7f2e18066a80 2021-01-03T13:04:08.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.534+0000 7f2e0ffff700 1 -- 172.21.15.133:0/3407308629 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2e000488a0 con 0x7f2e18066a80 2021-01-03T13:04:08.533 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:04:08.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.534+0000 7f2e17fff700 1 -- 172.21.15.133:0/3407308629 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2dfc055330 msgr2=0x7f2dfc0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.534+0000 7f2e17fff700 1 --2- 172.21.15.133:0/3407308629 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2dfc055330 0x7f2dfc0577f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f2e08008000 tx=0x7f2e08008040).stop 2021-01-03T13:04:08.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.534+0000 7f2e17fff700 1 -- 172.21.15.133:0/3407308629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e18066a80 msgr2=0x7f2e18066e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.534+0000 7f2e17fff700 1 --2- 172.21.15.133:0/3407308629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e18066a80 0x7f2e18066e60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f2e18063e40 tx=0x7f2e00015000).stop 2021-01-03T13:04:08.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.534+0000 7f2e17fff700 1 -- 172.21.15.133:0/3407308629 shutdown_connections 2021-01-03T13:04:08.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.534+0000 7f2e17fff700 1 --2- 172.21.15.133:0/3407308629 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2dfc055330 0x7f2dfc0577f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.534+0000 7f2e17fff700 1 --2- 172.21.15.133:0/3407308629 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e18063f60 0x7f2e180643e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.534+0000 7f2e17fff700 1 --2- 172.21.15.133:0/3407308629 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e18066a80 0x7f2e18066e60 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.534+0000 7f2e17fff700 1 --2- 172.21.15.133:0/3407308629 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e18142ea0 0x7f2e18143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.534+0000 7f2e17fff700 1 -- 172.21.15.133:0/3407308629 >> 172.21.15.133:0/3407308629 conn(0x7f2e1805bdf0 msgr2=0x7f2e1805fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:08.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.534+0000 7f2e17fff700 1 -- 172.21.15.133:0/3407308629 shutdown_connections 2021-01-03T13:04:08.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.534+0000 7f2e17fff700 1 -- 172.21.15.133:0/3407308629 wait complete. 2021-01-03T13:04:08.546 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:04:08.547 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:04:08.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c359e700 1 Processor -- start 2021-01-03T13:04:08.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c359e700 1 -- start start 2021-01-03T13:04:08.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f02c40b0c90 0x7f02c40b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c359e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c4060da0 con 0x7f02c40b52c0 2021-01-03T13:04:08.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c40b0ad0 con 0x7f02c40b5c00 2021-01-03T13:04:08.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c4067a90 con 0x7f02c40b0c90 2021-01-03T13:04:08.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c1d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f02c40b0c90 0x7f02c40b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c2d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f02c40b5c00 0x7f02c4143eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57048/0 (socket says 172.21.15.133:57048) 2021-01-03T13:04:08.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c2d9d700 1 -- 172.21.15.133:0/3081546436 learned_addr learned my addr 172.21.15.133:0/3081546436 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:08.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c1d9b700 1 -- 172.21.15.133:0/3081546436 >> v1:172.21.15.133:6789/0 conn(0x7f02c40b5c00 legacy=0x7f02c4143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c1d9b700 1 -- 172.21.15.133:0/3081546436 >> v1:172.21.15.16:6789/0 conn(0x7f02c40b52c0 legacy=0x7f02c4098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c1d9b700 1 -- 172.21.15.133:0/3081546436 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c40b56a0 con 0x7f02c40b0c90 2021-01-03T13:04:08.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c1d9b700 1 --2- 172.21.15.133:0/3081546436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c40b0c90 0x7f02c40b05e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f02b40032b0 tx=0x7f02b40091a0).ready entity=mon.1 client_cookie=95d2ca40ac701f04 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:08.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c159a700 1 -- 172.21.15.133:0/3081546436 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02b400ba50 con 0x7f02c40b0c90 2021-01-03T13:04:08.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c159a700 1 -- 172.21.15.133:0/3081546436 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b400bbb0 con 0x7f02c40b0c90 2021-01-03T13:04:08.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c359e700 1 -- 172.21.15.133:0/3081546436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c40b0c90 msgr2=0x7f02c40b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c159a700 1 -- 172.21.15.133:0/3081546436 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02b400bd20 con 0x7f02c40b0c90 2021-01-03T13:04:08.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c359e700 1 --2- 172.21.15.133:0/3081546436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c40b0c90 0x7f02c40b05e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f02b40032b0 tx=0x7f02b40091a0).stop 2021-01-03T13:04:08.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c359e700 1 -- 172.21.15.133:0/3081546436 shutdown_connections 2021-01-03T13:04:08.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c359e700 1 --2- 172.21.15.133:0/3081546436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c40b0c90 0x7f02c40b05e0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c359e700 1 -- 172.21.15.133:0/3081546436 >> 172.21.15.133:0/3081546436 conn(0x7f02c405bdf0 msgr2=0x7f02c405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:08.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c359e700 1 -- 172.21.15.133:0/3081546436 shutdown_connections 2021-01-03T13:04:08.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.654+0000 7f02c359e700 1 -- 172.21.15.133:0/3081546436 wait complete. 2021-01-03T13:04:08.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c359e700 1 Processor -- start 2021-01-03T13:04:08.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c359e700 1 -- start start 2021-01-03T13:04:08.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02c40b0c90 0x7f02c40671b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c40b52c0 0x7f02c414cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02c40b5c00 0x7f02c414d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c359e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c414d4f0 con 0x7f02c40b5c00 2021-01-03T13:04:08.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c4156ef0 con 0x7f02c40b52c0 2021-01-03T13:04:08.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c4063e10 con 0x7f02c40b0c90 2021-01-03T13:04:08.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c40b52c0 0x7f02c414cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c40b52c0 0x7f02c414cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36022/0 (socket says 172.21.15.133:36022) 2021-01-03T13:04:08.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c1d9b700 1 -- 172.21.15.133:0/785808025 learned_addr learned my addr 172.21.15.133:0/785808025 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:08.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c259c700 1 --2- 172.21.15.133:0/785808025 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02c40b0c90 0x7f02c40671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c2d9d700 1 --2- 172.21.15.133:0/785808025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02c40b5c00 0x7f02c414d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c1d9b700 1 -- 172.21.15.133:0/785808025 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02c40b0c90 msgr2=0x7f02c40671b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c1d9b700 1 --2- 172.21.15.133:0/785808025 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02c40b0c90 0x7f02c40671b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c1d9b700 1 -- 172.21.15.133:0/785808025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02c40b5c00 msgr2=0x7f02c414d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c1d9b700 1 --2- 172.21.15.133:0/785808025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02c40b5c00 0x7f02c414d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c1d9b700 1 -- 172.21.15.133:0/785808025 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c40642b0 con 0x7f02c40b52c0 2021-01-03T13:04:08.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c2d9d700 1 --2- 172.21.15.133:0/785808025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02c40b5c00 0x7f02c414d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:04:08.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c1d9b700 1 --2- 172.21.15.133:0/785808025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c40b52c0 0x7f02c414cb10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f02b40032b0 tx=0x7f02b4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:08.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02b37fe700 1 -- 172.21.15.133:0/785808025 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02b4010660 con 0x7f02c40b52c0 2021-01-03T13:04:08.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02b37fe700 1 -- 172.21.15.133:0/785808025 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b40107c0 con 0x7f02c40b52c0 2021-01-03T13:04:08.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c359e700 1 -- 172.21.15.133:0/785808025 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c4156bb0 con 0x7f02c40b52c0 2021-01-03T13:04:08.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02b37fe700 1 -- 172.21.15.133:0/785808025 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02b4010b20 con 0x7f02c40b52c0 2021-01-03T13:04:08.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.658+0000 7f02c359e700 1 -- 172.21.15.133:0/785808025 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c40649b0 con 0x7f02c40b52c0 2021-01-03T13:04:08.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.662+0000 7f02c359e700 1 -- 172.21.15.133:0/785808025 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c4063fd0 con 0x7f02c40b52c0 2021-01-03T13:04:08.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.662+0000 7f02b37fe700 1 -- 172.21.15.133:0/785808025 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f02b4026030 con 0x7f02c40b52c0 2021-01-03T13:04:08.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.662+0000 7f02b37fe700 1 --2- 172.21.15.133:0/785808025 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f02a0055440 0x7f02a0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:08.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.662+0000 7f02b37fe700 1 -- 172.21.15.133:0/785808025 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f02b406eff0 con 0x7f02c40b52c0 2021-01-03T13:04:08.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.662+0000 7f02c259c700 1 --2- 172.21.15.133:0/785808025 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f02a0055440 0x7f02a0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:08.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.662+0000 7f02c259c700 1 --2- 172.21.15.133:0/785808025 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f02a0055440 0x7f02a0057900 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f02bc00d000 tx=0x7f02bc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:08.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.670+0000 7f02b37fe700 1 -- 172.21.15.133:0/785808025 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f02b406adf0 con 0x7f02c40b52c0 2021-01-03T13:04:08.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.866+0000 7f02c359e700 1 -- 172.21.15.133:0/785808025 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02c4057300 con 0x7f02c40b52c0 2021-01-03T13:04:08.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.866+0000 7f02b37fe700 1 -- 172.21.15.133:0/785808025 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2496 (secure 0 0 0) 0x7f02b4024090 con 0x7f02c40b52c0 2021-01-03T13:04:08.868 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:04:08.868 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/524155035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":524155035},{"type":"v1","addr":"172.21.15.16:6833","nonce":524155035}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":31},{"gid":6175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1381538323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1381538323},{"type":"v1","addr":"172.21.15.133:6835","nonce":1381538323}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:03:59.914082+0000","modified":"2021-01-03T13:04:00.917279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6178},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6178":{"gid":6178,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1189475847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1189475847},{"type":"v1","addr":"172.21.15.133:6837","nonce":1189475847}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-01-03T13:04:08.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.870+0000 7f02c359e700 1 -- 172.21.15.133:0/785808025 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f02a0055440 msgr2=0x7f02a0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.870+0000 7f02c359e700 1 --2- 172.21.15.133:0/785808025 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f02a0055440 0x7f02a0057900 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f02bc00d000 tx=0x7f02bc009040).stop 2021-01-03T13:04:08.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.870+0000 7f02c359e700 1 -- 172.21.15.133:0/785808025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c40b52c0 msgr2=0x7f02c414cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:08.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.870+0000 7f02c359e700 1 --2- 172.21.15.133:0/785808025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c40b52c0 0x7f02c414cb10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f02b40032b0 tx=0x7f02b4016000).stop 2021-01-03T13:04:08.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.870+0000 7f02c359e700 1 -- 172.21.15.133:0/785808025 shutdown_connections 2021-01-03T13:04:08.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.870+0000 7f02c359e700 1 --2- 172.21.15.133:0/785808025 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f02a0055440 0x7f02a0057900 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.870+0000 7f02c359e700 1 --2- 172.21.15.133:0/785808025 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02c40b5c00 0x7f02c414d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.870+0000 7f02c359e700 1 --2- 172.21.15.133:0/785808025 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02c40b0c90 0x7f02c40671b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.870+0000 7f02c359e700 1 --2- 172.21.15.133:0/785808025 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02c40b52c0 0x7f02c414cb10 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:08.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.870+0000 7f02c359e700 1 -- 172.21.15.133:0/785808025 >> 172.21.15.133:0/785808025 conn(0x7f02c405bdf0 msgr2=0x7f02c40603d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:08.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.870+0000 7f02c359e700 1 -- 172.21.15.133:0/785808025 shutdown_connections 2021-01-03T13:04:08.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:08.870+0000 7f02c359e700 1 -- 172.21.15.133:0/785808025 wait complete. 2021-01-03T13:04:08.873 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 33 2021-01-03T13:04:09.190 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:03:59.914082+0000', 'modified': '2021-01-03T13:04:00.917279+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6178}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6178': {'gid': 6178, 'name': 'c', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/1189475847', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 1189475847}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 1189475847}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:04:09.190 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:04:09.191 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T13:04:09.320 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":6178,"want_state":"up:active","state":"up:active","rank_uptime":9.3941019380000004,"mdsmap_epoch":33,"osdmap_epoch":79,"osdmap_epoch_barrier":77,"uptime":14.836816170000001} 2021-01-03T13:04:09.321 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 6178, "mdsmap_epoch": 33, "osdmap_epoch": 79, "osdmap_epoch_barrier": 77, "rank_uptime": 9.394101938, "state": "up:active", "uptime": 14.83681617, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:04:09.321 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:04:09.322 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-01-03T13:04:09.322 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi036.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-01-03T13:04:09.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:09.323 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:04:09.331 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:04:09.389 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:04:09.389 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:04:09.447 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:04:09.448 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:04:09.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:09.449 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:04:09.495 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:04:09.495 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:04:09.538 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:04:09.554 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:04:09.555 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:04:09.611 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:04:09.612 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:04:09.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:09.613 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:04:09.616 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:2021-01-03T13:04:09.613+0000 7fde02f950c0 -1 init, newargv = 0x5557d817cbe0 newargc=9 2021-01-03T13:04:09.616 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[11783]: starting ceph client 2021-01-03T13:04:09.627 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[11783]: starting fuse 2021-01-03T13:04:10.723 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:04:10.739 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:04:10.740 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:04:10.795 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:04:10.797 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:04:10.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:10.798 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:04:10.847 INFO:teuthology.orchestra.run.smithi036.stdout:50 2021-01-03T13:04:10.847 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:04:10.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:10.848 DEBUG:teuthology.orchestra.run.smithi036:> sudo python3 -c ' 2021-01-03T13:04:10.849 DEBUG:teuthology.orchestra.run.smithi036:> import glob 2021-01-03T13:04:10.849 DEBUG:teuthology.orchestra.run.smithi036:> import re 2021-01-03T13:04:10.849 DEBUG:teuthology.orchestra.run.smithi036:> import os 2021-01-03T13:04:10.850 DEBUG:teuthology.orchestra.run.smithi036:> import subprocess 2021-01-03T13:04:10.850 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:04:10.851 DEBUG:teuthology.orchestra.run.smithi036:> def find_socket(client_name): 2021-01-03T13:04:10.851 DEBUG:teuthology.orchestra.run.smithi036:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-01-03T13:04:10.852 DEBUG:teuthology.orchestra.run.smithi036:> files = glob.glob(asok_path) 2021-01-03T13:04:10.852 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:04:10.852 DEBUG:teuthology.orchestra.run.smithi036:> # Given a non-glob path, it better be there 2021-01-03T13:04:10.853 DEBUG:teuthology.orchestra.run.smithi036:> if "*" not in asok_path: 2021-01-03T13:04:10.853 DEBUG:teuthology.orchestra.run.smithi036:> assert(len(files) == 1) 2021-01-03T13:04:10.854 DEBUG:teuthology.orchestra.run.smithi036:> return files[0] 2021-01-03T13:04:10.854 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:04:10.855 DEBUG:teuthology.orchestra.run.smithi036:> for f in files: 2021-01-03T13:04:10.855 DEBUG:teuthology.orchestra.run.smithi036:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:04:10.855 DEBUG:teuthology.orchestra.run.smithi036:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:04:10.856 DEBUG:teuthology.orchestra.run.smithi036:> return f 2021-01-03T13:04:10.856 DEBUG:teuthology.orchestra.run.smithi036:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:04:10.857 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:04:10.857 DEBUG:teuthology.orchestra.run.smithi036:> print(find_socket("client.1")) 2021-01-03T13:04:10.857 DEBUG:teuthology.orchestra.run.smithi036:> ' 2021-01-03T13:04:10.937 INFO:teuthology.orchestra.run.smithi036.stdout:/var/run/ceph/ceph-client.1.11783.asok 2021-01-03T13:04:10.942 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.11783.asok 2021-01-03T13:04:10.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:10.943 DEBUG:teuthology.orchestra.run.smithi036:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.11783.asok status 2021-01-03T13:04:11.046 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2021-01-03T13:04:11.046 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": { 2021-01-03T13:04:11.047 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:04:11.047 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:04:11.047 INFO:teuthology.orchestra.run.smithi036.stdout: "entity_id": "1", 2021-01-03T13:04:11.047 INFO:teuthology.orchestra.run.smithi036.stdout: "hostname": "smithi036", 2021-01-03T13:04:11.048 INFO:teuthology.orchestra.run.smithi036.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-01-03T13:04:11.048 INFO:teuthology.orchestra.run.smithi036.stdout: "pid": "11783", 2021-01-03T13:04:11.048 INFO:teuthology.orchestra.run.smithi036.stdout: "root": "/" 2021-01-03T13:04:11.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:04:11.049 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_count": 0, 2021-01-03T13:04:11.049 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_pinned_count": 0, 2021-01-03T13:04:11.049 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 6370, 2021-01-03T13:04:11.049 INFO:teuthology.orchestra.run.smithi036.stdout: "inst": { 2021-01-03T13:04:11.049 INFO:teuthology.orchestra.run.smithi036.stdout: "name": { 2021-01-03T13:04:11.050 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "client", 2021-01-03T13:04:11.050 INFO:teuthology.orchestra.run.smithi036.stdout: "num": 6370 2021-01-03T13:04:11.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:04:11.050 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:04:11.051 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:04:11.051 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:04:11.051 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 1205786384 2021-01-03T13:04:11.051 INFO:teuthology.orchestra.run.smithi036.stdout: } 2021-01-03T13:04:11.052 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:04:11.052 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:04:11.052 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:04:11.052 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:04:11.052 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 1205786384 2021-01-03T13:04:11.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:04:11.053 INFO:teuthology.orchestra.run.smithi036.stdout: "inst_str": "client.6370 172.21.15.36:0/1205786384", 2021-01-03T13:04:11.053 INFO:teuthology.orchestra.run.smithi036.stdout: "addr_str": "172.21.15.36:0/1205786384", 2021-01-03T13:04:11.053 INFO:teuthology.orchestra.run.smithi036.stdout: "inode_count": 1, 2021-01-03T13:04:11.053 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_epoch": 33, 2021-01-03T13:04:11.054 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch": 79, 2021-01-03T13:04:11.054 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:04:11.054 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklisted": false, 2021-01-03T13:04:11.054 INFO:teuthology.orchestra.run.smithi036.stdout: "fs_name": "cephfs" 2021-01-03T13:04:11.054 INFO:teuthology.orchestra.run.smithi036.stdout:} 2021-01-03T13:04:11.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:11.056 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:04:11.056 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:04:11.064 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:04:11.065 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:04:11.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:11.066 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:04:11.124 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:04:11.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191f3a4700 1 Processor -- start 2021-01-03T13:04:11.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191f3a4700 1 -- start start 2021-01-03T13:04:11.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191f3a4700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1918066f70 0x7f191805fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:11.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191f3a4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1918067350 0x7f19180af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:11.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191f3a4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19180afc50 0x7f1918144260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:11.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191f3a4700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1918060310 con 0x7f1918066f70 2021-01-03T13:04:11.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191f3a4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19180605a0 con 0x7f19180afc50 2021-01-03T13:04:11.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191f3a4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19180b0b50 con 0x7f1918067350 2021-01-03T13:04:11.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191eba3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19180afc50 0x7f1918144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:11.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191eba3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19180afc50 0x7f1918144260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36030/0 (socket says 172.21.15.133:36030) 2021-01-03T13:04:11.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191eba3700 1 -- 172.21.15.133:0/2571148511 learned_addr learned my addr 172.21.15.133:0/2571148511 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:11.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191dba1700 1 --2- 172.21.15.133:0/2571148511 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1918067350 0x7f19180af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:11.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191e3a2700 1 --2- 172.21.15.133:0/2571148511 >> v2:172.21.15.16:3300/0 conn(0x7f1918066f70 0x7f191805fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:11.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191eba3700 1 -- 172.21.15.133:0/2571148511 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1918067350 msgr2=0x7f19180af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:11.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191eba3700 1 --2- 172.21.15.133:0/2571148511 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1918067350 0x7f19180af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191eba3700 1 -- 172.21.15.133:0/2571148511 >> v2:172.21.15.16:3300/0 conn(0x7f1918066f70 msgr2=0x7f191805fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:11.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191eba3700 1 --2- 172.21.15.133:0/2571148511 >> v2:172.21.15.16:3300/0 conn(0x7f1918066f70 0x7f191805fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191eba3700 1 -- 172.21.15.133:0/2571148511 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19180b0df0 con 0x7f19180afc50 2021-01-03T13:04:11.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191eba3700 1 --2- 172.21.15.133:0/2571148511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19180afc50 0x7f1918144260 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f19100032b0 tx=0x7f1910009270).ready entity=mon.1 client_cookie=f09f36bd070c5296 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:11.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191d3a0700 1 -- 172.21.15.133:0/2571148511 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1910009e60 con 0x7f19180afc50 2021-01-03T13:04:11.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191d3a0700 1 -- 172.21.15.133:0/2571148511 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191000bb50 con 0x7f19180afc50 2021-01-03T13:04:11.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191d3a0700 1 -- 172.21.15.133:0/2571148511 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f191000bcc0 con 0x7f19180afc50 2021-01-03T13:04:11.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191f3a4700 1 -- 172.21.15.133:0/2571148511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19180afc50 msgr2=0x7f1918144260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:11.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.250+0000 7f191f3a4700 1 --2- 172.21.15.133:0/2571148511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19180afc50 0x7f1918144260 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f19100032b0 tx=0x7f1910009270).stop 2021-01-03T13:04:11.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.254+0000 7f191f3a4700 1 -- 172.21.15.133:0/2571148511 shutdown_connections 2021-01-03T13:04:11.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.254+0000 7f191f3a4700 1 --2- 172.21.15.133:0/2571148511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19180afc50 0x7f1918144260 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.254+0000 7f191f3a4700 1 --2- 172.21.15.133:0/2571148511 >> v2:172.21.15.16:3300/0 conn(0x7f1918066f70 0x7f191805fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.254+0000 7f191f3a4700 1 --2- 172.21.15.133:0/2571148511 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1918067350 0x7f19180af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.254+0000 7f191f3a4700 1 -- 172.21.15.133:0/2571148511 >> 172.21.15.133:0/2571148511 conn(0x7f19180b6110 msgr2=0x7f19180b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:11.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.254+0000 7f191f3a4700 1 -- 172.21.15.133:0/2571148511 shutdown_connections 2021-01-03T13:04:11.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.254+0000 7f191f3a4700 1 -- 172.21.15.133:0/2571148511 wait complete. 2021-01-03T13:04:11.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.254+0000 7f191f3a4700 1 Processor -- start 2021-01-03T13:04:11.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.254+0000 7f191f3a4700 1 -- start start 2021-01-03T13:04:11.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.254+0000 7f191f3a4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1918066f70 0x7f19181406f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:11.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.254+0000 7f191f3a4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1918067350 0x7f1918066710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:11.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191f3a4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1918151cb0 0x7f191814a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:11.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191f3a4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19180662b0 con 0x7f1918151cb0 2021-01-03T13:04:11.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191f3a4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1918065c70 con 0x7f1918066f70 2021-01-03T13:04:11.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191f3a4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19181452e0 con 0x7f1918067350 2021-01-03T13:04:11.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191e3a2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1918066f70 0x7f19181406f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:11.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191e3a2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1918066f70 0x7f19181406f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36034/0 (socket says 172.21.15.133:36034) 2021-01-03T13:04:11.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191e3a2700 1 -- 172.21.15.133:0/3718056777 learned_addr learned my addr 172.21.15.133:0/3718056777 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:11.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191dba1700 1 --2- 172.21.15.133:0/3718056777 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1918067350 0x7f1918066710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:11.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191eba3700 1 --2- 172.21.15.133:0/3718056777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1918151cb0 0x7f191814a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:11.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191e3a2700 1 -- 172.21.15.133:0/3718056777 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1918067350 msgr2=0x7f1918066710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:11.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191e3a2700 1 --2- 172.21.15.133:0/3718056777 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1918067350 0x7f1918066710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191e3a2700 1 -- 172.21.15.133:0/3718056777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1918151cb0 msgr2=0x7f191814a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:11.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191e3a2700 1 --2- 172.21.15.133:0/3718056777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1918151cb0 0x7f191814a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191e3a2700 1 -- 172.21.15.133:0/3718056777 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1918145580 con 0x7f1918066f70 2021-01-03T13:04:11.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191e3a2700 1 --2- 172.21.15.133:0/3718056777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1918066f70 0x7f19181406f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f191400c000 tx=0x7f1914006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:11.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f19077fe700 1 -- 172.21.15.133:0/3718056777 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f191400ca10 con 0x7f1918066f70 2021-01-03T13:04:11.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f19077fe700 1 -- 172.21.15.133:0/3718056777 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191400cb70 con 0x7f1918066f70 2021-01-03T13:04:11.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191f3a4700 1 -- 172.21.15.133:0/3718056777 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191814f930 con 0x7f1918066f70 2021-01-03T13:04:11.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f19077fe700 1 -- 172.21.15.133:0/3718056777 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19140123f0 con 0x7f1918066f70 2021-01-03T13:04:11.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191f3a4700 1 -- 172.21.15.133:0/3718056777 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1918140ee0 con 0x7f1918066f70 2021-01-03T13:04:11.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f191f3a4700 1 -- 172.21.15.133:0/3718056777 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1918057300 con 0x7f1918066f70 2021-01-03T13:04:11.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.258+0000 7f19077fe700 1 -- 172.21.15.133:0/3718056777 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1914012550 con 0x7f1918066f70 2021-01-03T13:04:11.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.262+0000 7f19077fe700 1 --2- 172.21.15.133:0/3718056777 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18f8055330 0x7f18f80577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:11.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.262+0000 7f19077fe700 1 -- 172.21.15.133:0/3718056777 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f191406e300 con 0x7f1918066f70 2021-01-03T13:04:11.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.262+0000 7f191dba1700 1 --2- 172.21.15.133:0/3718056777 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18f8055330 0x7f18f80577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:11.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.262+0000 7f191dba1700 1 --2- 172.21.15.133:0/3718056777 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18f8055330 0x7f18f80577f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f190800b000 tx=0x7f1908006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:11.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.266+0000 7f19077fe700 1 -- 172.21.15.133:0/3718056777 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f19140445a0 con 0x7f1918066f70 2021-01-03T13:04:11.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.450+0000 7f191f3a4700 1 -- 172.21.15.133:0/3718056777 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1918062300 con 0x7f1918066f70 2021-01-03T13:04:11.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.454+0000 7f19077fe700 1 -- 172.21.15.133:0/3718056777 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2496 (secure 0 0 0) 0x7f1914047bc0 con 0x7f1918066f70 2021-01-03T13:04:11.454 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:04:11.454 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/524155035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":524155035},{"type":"v1","addr":"172.21.15.16:6833","nonce":524155035}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":31},{"gid":6175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1381538323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1381538323},{"type":"v1","addr":"172.21.15.133:6835","nonce":1381538323}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:03:59.914082+0000","modified":"2021-01-03T13:04:00.917279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6178},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6178":{"gid":6178,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1189475847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1189475847},{"type":"v1","addr":"172.21.15.133:6837","nonce":1189475847}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-01-03T13:04:11.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.454+0000 7f191f3a4700 1 -- 172.21.15.133:0/3718056777 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18f8055330 msgr2=0x7f18f80577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:11.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.454+0000 7f191f3a4700 1 --2- 172.21.15.133:0/3718056777 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18f8055330 0x7f18f80577f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f190800b000 tx=0x7f1908006dc0).stop 2021-01-03T13:04:11.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.454+0000 7f191f3a4700 1 -- 172.21.15.133:0/3718056777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1918066f70 msgr2=0x7f19181406f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:11.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.454+0000 7f191f3a4700 1 --2- 172.21.15.133:0/3718056777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1918066f70 0x7f19181406f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f191400c000 tx=0x7f1914006dc0).stop 2021-01-03T13:04:11.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.454+0000 7f191f3a4700 1 -- 172.21.15.133:0/3718056777 shutdown_connections 2021-01-03T13:04:11.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.454+0000 7f191f3a4700 1 --2- 172.21.15.133:0/3718056777 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18f8055330 0x7f18f80577f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.454+0000 7f191f3a4700 1 --2- 172.21.15.133:0/3718056777 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1918151cb0 0x7f191814a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.454+0000 7f191f3a4700 1 --2- 172.21.15.133:0/3718056777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1918066f70 0x7f19181406f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.454+0000 7f191f3a4700 1 --2- 172.21.15.133:0/3718056777 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1918067350 0x7f1918066710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.454+0000 7f191f3a4700 1 -- 172.21.15.133:0/3718056777 >> 172.21.15.133:0/3718056777 conn(0x7f19180b6110 msgr2=0x7f19180af490 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:11.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.454+0000 7f191f3a4700 1 -- 172.21.15.133:0/3718056777 shutdown_connections 2021-01-03T13:04:11.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.454+0000 7f191f3a4700 1 -- 172.21.15.133:0/3718056777 wait complete. 2021-01-03T13:04:11.459 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 33 2021-01-03T13:04:11.468 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:04:11.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c253d4700 1 Processor -- start 2021-01-03T13:04:11.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c253d4700 1 -- start start 2021-01-03T13:04:11.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c253d4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6c200b0670 0x7f6c200aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:11.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c253d4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6c2014aee0 0x7f6c20144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:11.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c253d4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c20098550 con 0x7f6c200b5c10 2021-01-03T13:04:11.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c253d4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c200b5ff0 con 0x7f6c200b0670 2021-01-03T13:04:11.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c253d4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200b0b10 con 0x7f6c2014aee0 2021-01-03T13:04:11.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c1e7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6c200b0670 0x7f6c200aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:11.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c1e7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6c200b0670 0x7f6c200aae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36040/0 (socket says 172.21.15.133:36040) 2021-01-03T13:04:11.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c1effd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6c200b5c10 0x7f6c2014a7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57076/0 (socket says 172.21.15.133:57076) 2021-01-03T13:04:11.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c1e7fc700 1 -- 172.21.15.133:0/147360954 learned_addr learned my addr 172.21.15.133:0/147360954 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:11.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c1f7fe700 1 --2- 172.21.15.133:0/147360954 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6c2014aee0 0x7f6c20144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:11.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c1e7fc700 1 -- 172.21.15.133:0/147360954 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6c2014aee0 msgr2=0x7f6c20144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:11.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c1e7fc700 1 --2- 172.21.15.133:0/147360954 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6c2014aee0 0x7f6c20144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c1e7fc700 1 -- 172.21.15.133:0/147360954 >> v1:172.21.15.133:6789/0 conn(0x7f6c200b5c10 legacy=0x7f6c2014a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:11.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c1e7fc700 1 -- 172.21.15.133:0/147360954 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c20098780 con 0x7f6c200b0670 2021-01-03T13:04:11.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c1e7fc700 1 --2- 172.21.15.133:0/147360954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c200b0670 0x7f6c200aae70 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f6c08002f30 tx=0x7f6c08006e80).ready entity=mon.1 client_cookie=324c526e983f1655 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:11.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c1dffb700 1 -- 172.21.15.133:0/147360954 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c080097f0 con 0x7f6c200b0670 2021-01-03T13:04:11.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c1dffb700 1 -- 172.21.15.133:0/147360954 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c08009950 con 0x7f6c200b0670 2021-01-03T13:04:11.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c1dffb700 1 -- 172.21.15.133:0/147360954 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c08009ac0 con 0x7f6c200b0670 2021-01-03T13:04:11.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c253d4700 1 -- 172.21.15.133:0/147360954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c200b0670 msgr2=0x7f6c200aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:11.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c253d4700 1 --2- 172.21.15.133:0/147360954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c200b0670 0x7f6c200aae70 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f6c08002f30 tx=0x7f6c08006e80).stop 2021-01-03T13:04:11.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c253d4700 1 -- 172.21.15.133:0/147360954 shutdown_connections 2021-01-03T13:04:11.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c253d4700 1 --2- 172.21.15.133:0/147360954 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6c2014aee0 0x7f6c20144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c253d4700 1 --2- 172.21.15.133:0/147360954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c200b0670 0x7f6c200aae70 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c253d4700 1 -- 172.21.15.133:0/147360954 >> 172.21.15.133:0/147360954 conn(0x7f6c2005c8c0 msgr2=0x7f6c200b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c253d4700 1 -- 172.21.15.133:0/147360954 shutdown_connections 2021-01-03T13:04:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c253d4700 1 -- 172.21.15.133:0/147360954 wait complete. 2021-01-03T13:04:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c253d4700 1 Processor -- start 2021-01-03T13:04:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.578+0000 7f6c253d4700 1 -- start start 2021-01-03T13:04:11.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c253d4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c200b0670 0x7f6c2014d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:11.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c253d4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c200b5c10 0x7f6c200ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:11.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c253d4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6c2014aee0 0x7f6c2014dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:11.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c253d4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c20144e40 con 0x7f6c200b0670 2021-01-03T13:04:11.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c253d4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c201483c0 con 0x7f6c200b5c10 2021-01-03T13:04:11.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c253d4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c20145070 con 0x7f6c2014aee0 2021-01-03T13:04:11.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c1e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c200b5c10 0x7f6c200ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:11.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c1e7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c200b5c10 0x7f6c200ae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36048/0 (socket says 172.21.15.133:36048) 2021-01-03T13:04:11.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c1e7fc700 1 -- 172.21.15.133:0/1320545306 learned_addr learned my addr 172.21.15.133:0/1320545306 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:11.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c1effd700 1 --2- 172.21.15.133:0/1320545306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c200b0670 0x7f6c2014d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c1f7fe700 1 --2- 172.21.15.133:0/1320545306 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6c2014aee0 0x7f6c2014dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c1e7fc700 1 -- 172.21.15.133:0/1320545306 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6c2014aee0 msgr2=0x7f6c2014dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c1e7fc700 1 --2- 172.21.15.133:0/1320545306 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6c2014aee0 0x7f6c2014dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c1e7fc700 1 -- 172.21.15.133:0/1320545306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c200b0670 msgr2=0x7f6c2014d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c1e7fc700 1 --2- 172.21.15.133:0/1320545306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c200b0670 0x7f6c2014d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c1e7fc700 1 -- 172.21.15.133:0/1320545306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c20145310 con 0x7f6c200b5c10 2021-01-03T13:04:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c1e7fc700 1 --2- 172.21.15.133:0/1320545306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c200b5c10 0x7f6c200ae880 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f6c08002f30 tx=0x7f6c08016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c17fff700 1 -- 172.21.15.133:0/1320545306 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c08021440 con 0x7f6c200b5c10 2021-01-03T13:04:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c17fff700 1 -- 172.21.15.133:0/1320545306 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c080215a0 con 0x7f6c200b5c10 2021-01-03T13:04:11.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c253d4700 1 -- 172.21.15.133:0/1320545306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c201455b0 con 0x7f6c200b5c10 2021-01-03T13:04:11.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c17fff700 1 -- 172.21.15.133:0/1320545306 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c08021900 con 0x7f6c200b5c10 2021-01-03T13:04:11.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c253d4700 1 -- 172.21.15.133:0/1320545306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2014ccc0 con 0x7f6c200b5c10 2021-01-03T13:04:11.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.582+0000 7f6c253d4700 1 -- 172.21.15.133:0/1320545306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c20057300 con 0x7f6c200b5c10 2021-01-03T13:04:11.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.586+0000 7f6c17fff700 1 -- 172.21.15.133:0/1320545306 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6c08029070 con 0x7f6c200b5c10 2021-01-03T13:04:11.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.586+0000 7f6c17fff700 1 --2- 172.21.15.133:0/1320545306 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6bf8055440 0x7f6bf8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:11.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.586+0000 7f6c17fff700 1 -- 172.21.15.133:0/1320545306 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6c0806ee70 con 0x7f6c200b5c10 2021-01-03T13:04:11.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.586+0000 7f6c1effd700 1 --2- 172.21.15.133:0/1320545306 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6bf8055440 0x7f6bf8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:11.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.586+0000 7f6c1effd700 1 --2- 172.21.15.133:0/1320545306 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6bf8055440 0x7f6bf8057900 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f6c1000b000 tx=0x7f6c10007d10).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:11.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.590+0000 7f6c17fff700 1 -- 172.21.15.133:0/1320545306 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6c08044fe0 con 0x7f6c200b5c10 2021-01-03T13:04:11.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.798+0000 7f6c253d4700 1 -- 172.21.15.133:0/1320545306 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c2014acc0 con 0x7f6c200b5c10 2021-01-03T13:04:11.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.798+0000 7f6c17fff700 1 -- 172.21.15.133:0/1320545306 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2496 (secure 0 0 0) 0x7f6c08015020 con 0x7f6c200b5c10 2021-01-03T13:04:11.801 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:04:11.802 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/524155035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":524155035},{"type":"v1","addr":"172.21.15.16:6833","nonce":524155035}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":31},{"gid":6175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1381538323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1381538323},{"type":"v1","addr":"172.21.15.133:6835","nonce":1381538323}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:03:59.914082+0000","modified":"2021-01-03T13:04:00.917279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6178},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6178":{"gid":6178,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1189475847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1189475847},{"type":"v1","addr":"172.21.15.133:6837","nonce":1189475847}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-01-03T13:04:11.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.802+0000 7f6c253d4700 1 -- 172.21.15.133:0/1320545306 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6bf8055440 msgr2=0x7f6bf8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:11.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.802+0000 7f6c253d4700 1 --2- 172.21.15.133:0/1320545306 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6bf8055440 0x7f6bf8057900 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f6c1000b000 tx=0x7f6c10007d10).stop 2021-01-03T13:04:11.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.802+0000 7f6c253d4700 1 -- 172.21.15.133:0/1320545306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c200b5c10 msgr2=0x7f6c200ae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:11.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.802+0000 7f6c253d4700 1 --2- 172.21.15.133:0/1320545306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c200b5c10 0x7f6c200ae880 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f6c08002f30 tx=0x7f6c08016000).stop 2021-01-03T13:04:11.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.802+0000 7f6c253d4700 1 -- 172.21.15.133:0/1320545306 shutdown_connections 2021-01-03T13:04:11.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.802+0000 7f6c253d4700 1 --2- 172.21.15.133:0/1320545306 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6bf8055440 0x7f6bf8057900 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.802+0000 7f6c253d4700 1 --2- 172.21.15.133:0/1320545306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c200b0670 0x7f6c2014d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.802+0000 7f6c253d4700 1 --2- 172.21.15.133:0/1320545306 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6c2014aee0 0x7f6c2014dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.802+0000 7f6c253d4700 1 --2- 172.21.15.133:0/1320545306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c200b5c10 0x7f6c200ae880 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:11.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.802+0000 7f6c253d4700 1 -- 172.21.15.133:0/1320545306 >> 172.21.15.133:0/1320545306 conn(0x7f6c2005c8c0 msgr2=0x7f6c200b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:11.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.802+0000 7f6c253d4700 1 -- 172.21.15.133:0/1320545306 shutdown_connections 2021-01-03T13:04:11.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:11.802+0000 7f6c253d4700 1 -- 172.21.15.133:0/1320545306 wait complete. 2021-01-03T13:04:11.806 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 33 2021-01-03T13:04:11.815 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_cap_revoke_eviction_timeout 30.0 2021-01-03T13:04:11.933 INFO:teuthology.orchestra.run.smithi133.stdout:{"success":"mds_cap_revoke_eviction_timeout = '30.000000' "} 2021-01-03T13:04:11.933 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_cap_revoke_eviction_timeout = '30.000000' " } 2021-01-03T13:04:11.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:11.934 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:04:11.935 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:11.943 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:04:11.944 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:04:11.945 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-01-03T13:04:11.946 DEBUG:teuthology.orchestra.run.smithi007:> import time 2021-01-03T13:04:11.947 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:04:11.947 DEBUG:teuthology.orchestra.run.smithi007:> with open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'w'"'"') as f: 2021-01-03T13:04:11.947 DEBUG:teuthology.orchestra.run.smithi007:> f.write('"'"'content'"'"') 2021-01-03T13:04:11.948 DEBUG:teuthology.orchestra.run.smithi007:> f.flush() 2021-01-03T13:04:11.948 DEBUG:teuthology.orchestra.run.smithi007:> f.write('"'"'content2'"'"') 2021-01-03T13:04:11.948 DEBUG:teuthology.orchestra.run.smithi007:> while True: 2021-01-03T13:04:11.949 DEBUG:teuthology.orchestra.run.smithi007:> time.sleep(1) 2021-01-03T13:04:11.949 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:04:11.990 DEBUG:teuthology.orchestra.run.smithi007:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-01-03T13:04:12.012 INFO:teuthology.orchestra.run.smithi007.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/background_file': No such file or directory 2021-01-03T13:04:12.013 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-01-03T13:04:13.014 DEBUG:teuthology.orchestra.run.smithi007:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2021-01-03T13:04:13.030 INFO:teuthology.orchestra.run.smithi007.stdout:/home/ubuntu/cephtest/mnt.0/background_file 2021-01-03T13:04:13.031 DEBUG:tasks.cephfs.mount:File background_file became visible from 0 after 1s 2021-01-03T13:04:13.031 DEBUG:teuthology.orchestra.run.smithi036:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file 2021-01-03T13:04:13.073 INFO:teuthology.orchestra.run.smithi036.stdout:/home/ubuntu/cephtest/mnt.1/background_file 2021-01-03T13:04:13.075 DEBUG:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2021-01-03T13:04:13.075 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T13:04:13.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:13.092 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:04:13.093 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:04:13.124 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:04:13.125 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:04:13.126 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-01-03T13:04:13.126 DEBUG:teuthology.orchestra.run.smithi036:> import os 2021-01-03T13:04:13.126 DEBUG:teuthology.orchestra.run.smithi036:> import time 2021-01-03T13:04:13.127 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:04:13.127 DEBUG:teuthology.orchestra.run.smithi036:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0o644) 2021-01-03T13:04:13.127 DEBUG:teuthology.orchestra.run.smithi036:> try: 2021-01-03T13:04:13.128 DEBUG:teuthology.orchestra.run.smithi036:> while True: 2021-01-03T13:04:13.128 DEBUG:teuthology.orchestra.run.smithi036:> os.write(fd, b'"'"'content'"'"') 2021-01-03T13:04:13.128 DEBUG:teuthology.orchestra.run.smithi036:> time.sleep(1) 2021-01-03T13:04:13.129 DEBUG:teuthology.orchestra.run.smithi036:> if not False: 2021-01-03T13:04:13.129 DEBUG:teuthology.orchestra.run.smithi036:> break 2021-01-03T13:04:13.129 DEBUG:teuthology.orchestra.run.smithi036:> except IOError as e: 2021-01-03T13:04:13.130 DEBUG:teuthology.orchestra.run.smithi036:> pass 2021-01-03T13:04:13.130 DEBUG:teuthology.orchestra.run.smithi036:> os.close(fd) 2021-01-03T13:04:13.131 DEBUG:teuthology.orchestra.run.smithi036:> ' 2021-01-03T13:04:37.753 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:04:37.757 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:04:37.760 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:04:37.763 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:04:50.696 INFO:tasks.cephfs.test_misc:cap_waiter waited 37.52523732185364s 2021-01-03T13:04:50.697 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist ls --format=json 2021-01-03T13:04:50.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.815+0000 7fa5cd377700 1 Processor -- start 2021-01-03T13:04:50.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.815+0000 7fa5cd377700 1 -- start start 2021-01-03T13:04:50.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5cd377700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5c8066f70 0x7fa5c805fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:50.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5cd377700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5c80b2750 0x7fa5c8144260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:50.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5cd377700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c80afe70 con 0x7fa5c8067350 2021-01-03T13:04:50.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5cd377700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c8060310 con 0x7fa5c8066f70 2021-01-03T13:04:50.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5cd377700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80605a0 con 0x7fa5c80b2750 2021-01-03T13:04:50.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5c7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5c8066f70 0x7fa5c805fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:50.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5c7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5c8066f70 0x7fa5c805fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36056/0 (socket says 172.21.15.133:36056) 2021-01-03T13:04:50.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5c7fff700 1 -- 172.21.15.133:0/754176176 learned_addr learned my addr 172.21.15.133:0/754176176 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:50.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5ccb76700 1 --2- 172.21.15.133:0/754176176 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5c80b2750 0x7fa5c8144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:50.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5c7fff700 1 -- 172.21.15.133:0/754176176 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5c80b2750 msgr2=0x7fa5c8144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:50.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5c7fff700 1 --2- 172.21.15.133:0/754176176 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5c80b2750 0x7fa5c8144260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:50.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5c7fff700 1 -- 172.21.15.133:0/754176176 >> v1:172.21.15.16:6789/0 conn(0x7fa5c8067350 legacy=0x7fa5c80af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:50.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5c7fff700 1 -- 172.21.15.133:0/754176176 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c80b0b50 con 0x7fa5c8066f70 2021-01-03T13:04:50.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5c6ffd700 1 -- 172.21.15.133:0/754176176 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065971709 0 0) 0x7fa5c80afe70 con 0x7fa5c8067350 2021-01-03T13:04:50.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5c7fff700 1 --2- 172.21.15.133:0/754176176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c8066f70 0x7fa5c805fe20 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7fa5b8002f30 tx=0x7fa5b8006e80).ready entity=mon.1 client_cookie=404de0a9707ab468 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:50.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5c6ffd700 1 -- 172.21.15.133:0/754176176 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5b80097f0 con 0x7fa5c8066f70 2021-01-03T13:04:50.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5c6ffd700 1 -- 172.21.15.133:0/754176176 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b8009950 con 0x7fa5c8066f70 2021-01-03T13:04:50.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5c6ffd700 1 -- 172.21.15.133:0/754176176 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5b8009cb0 con 0x7fa5c8066f70 2021-01-03T13:04:50.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5cd377700 1 -- 172.21.15.133:0/754176176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c8066f70 msgr2=0x7fa5c805fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:50.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5cd377700 1 --2- 172.21.15.133:0/754176176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c8066f70 0x7fa5c805fe20 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7fa5b8002f30 tx=0x7fa5b8006e80).stop 2021-01-03T13:04:50.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5cd377700 1 -- 172.21.15.133:0/754176176 shutdown_connections 2021-01-03T13:04:50.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5cd377700 1 --2- 172.21.15.133:0/754176176 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5c80b2750 0x7fa5c8144260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:50.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5cd377700 1 --2- 172.21.15.133:0/754176176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c8066f70 0x7fa5c805fe20 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:50.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5cd377700 1 -- 172.21.15.133:0/754176176 >> 172.21.15.133:0/754176176 conn(0x7fa5c80b6110 msgr2=0x7fa5c80b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:50.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5cd377700 1 -- 172.21.15.133:0/754176176 shutdown_connections 2021-01-03T13:04:50.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.819+0000 7fa5cd377700 1 -- 172.21.15.133:0/754176176 wait complete. 2021-01-03T13:04:50.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5cd377700 1 Processor -- start 2021-01-03T13:04:50.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5cd377700 1 -- start start 2021-01-03T13:04:50.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5cd377700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c8066f70 0x7fa5c80af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:50.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5cd377700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5c8067350 0x7fa5c8156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:50.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5cd377700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5c80b2750 0x7fa5c8156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:50.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5cd377700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80ae880 con 0x7fa5c80b2750 2021-01-03T13:04:50.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5cd377700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c8153be0 con 0x7fa5c8066f70 2021-01-03T13:04:50.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5cd377700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c80aca70 con 0x7fa5c8067350 2021-01-03T13:04:50.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5c7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c8066f70 0x7fa5c80af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:50.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5c7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c8066f70 0x7fa5c80af0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36062/0 (socket says 172.21.15.133:36062) 2021-01-03T13:04:50.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5c7fff700 1 -- 172.21.15.133:0/4181338454 learned_addr learned my addr 172.21.15.133:0/4181338454 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:50.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5c77fe700 1 --2- 172.21.15.133:0/4181338454 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5c8067350 0x7fa5c8156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:50.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5ccb76700 1 --2- 172.21.15.133:0/4181338454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5c80b2750 0x7fa5c8156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:50.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5c7fff700 1 -- 172.21.15.133:0/4181338454 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5c8067350 msgr2=0x7fa5c8156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:50.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5c7fff700 1 --2- 172.21.15.133:0/4181338454 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5c8067350 0x7fa5c8156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:50.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5c7fff700 1 -- 172.21.15.133:0/4181338454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5c80b2750 msgr2=0x7fa5c8156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:50.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5c7fff700 1 --2- 172.21.15.133:0/4181338454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5c80b2750 0x7fa5c8156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:50.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5c7fff700 1 -- 172.21.15.133:0/4181338454 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c80ac3d0 con 0x7fa5c8066f70 2021-01-03T13:04:50.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.823+0000 7fa5c7fff700 1 --2- 172.21.15.133:0/4181338454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c8066f70 0x7fa5c80af0d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fa5c8066450 tx=0x7fa5b8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:50.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.827+0000 7fa5c57fa700 1 -- 172.21.15.133:0/4181338454 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5b8011b00 con 0x7fa5c8066f70 2021-01-03T13:04:50.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.827+0000 7fa5c57fa700 1 -- 172.21.15.133:0/4181338454 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b8011c60 con 0x7fa5c8066f70 2021-01-03T13:04:50.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.827+0000 7fa5cd377700 1 -- 172.21.15.133:0/4181338454 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c80aeab0 con 0x7fa5c8066f70 2021-01-03T13:04:50.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.827+0000 7fa5c57fa700 1 -- 172.21.15.133:0/4181338454 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5b801e460 con 0x7fa5c8066f70 2021-01-03T13:04:50.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.827+0000 7fa5cd377700 1 -- 172.21.15.133:0/4181338454 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c80ab740 con 0x7fa5c8066f70 2021-01-03T13:04:50.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.827+0000 7fa5cd377700 1 -- 172.21.15.133:0/4181338454 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c8057300 con 0x7fa5c8066f70 2021-01-03T13:04:50.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.827+0000 7fa5c57fa700 1 -- 172.21.15.133:0/4181338454 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa5b8025030 con 0x7fa5c8066f70 2021-01-03T13:04:50.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.827+0000 7fa5c57fa700 1 --2- 172.21.15.133:0/4181338454 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa5a8055330 0x7fa5a80577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:50.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.827+0000 7fa5c77fe700 1 --2- 172.21.15.133:0/4181338454 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa5a8055330 0x7fa5a80577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:50.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.827+0000 7fa5c57fa700 1 -- 172.21.15.133:0/4181338454 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fa5b806f730 con 0x7fa5c8066f70 2021-01-03T13:04:50.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.827+0000 7fa5c77fe700 1 --2- 172.21.15.133:0/4181338454 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa5a8055330 0x7fa5a80577f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fa5bc00d000 tx=0x7fa5bc0079d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:50.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.835+0000 7fa5c57fa700 1 -- 172.21.15.133:0/4181338454 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa5b80458f0 con 0x7fa5c8066f70 2021-01-03T13:04:50.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.991+0000 7fa5cd377700 1 -- 172.21.15.133:0/4181338454 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blacklist ls", "format": "json"} v 0) v1 -- 0x7fa5c8061020 con 0x7fa5c8066f70 2021-01-03T13:04:50.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.991+0000 7fa5c57fa700 1 -- 172.21.15.133:0/4181338454 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls", "format": "json"}]=0 listed 1 entries v80) v1 ==== 98+0+79 (secure 0 0 0) 0x7fa5b8023070 con 0x7fa5c8066f70 2021-01-03T13:04:50.994 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:04:50.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.995+0000 7fa5cd377700 1 -- 172.21.15.133:0/4181338454 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa5a8055330 msgr2=0x7fa5a80577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:50.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.995+0000 7fa5cd377700 1 --2- 172.21.15.133:0/4181338454 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa5a8055330 0x7fa5a80577f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fa5bc00d000 tx=0x7fa5bc0079d0).stop 2021-01-03T13:04:50.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.995+0000 7fa5cd377700 1 -- 172.21.15.133:0/4181338454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c8066f70 msgr2=0x7fa5c80af0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:50.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.995+0000 7fa5cd377700 1 --2- 172.21.15.133:0/4181338454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c8066f70 0x7fa5c80af0d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fa5c8066450 tx=0x7fa5b8015000).stop 2021-01-03T13:04:50.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.995+0000 7fa5cd377700 1 -- 172.21.15.133:0/4181338454 shutdown_connections 2021-01-03T13:04:50.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.995+0000 7fa5cd377700 1 --2- 172.21.15.133:0/4181338454 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa5a8055330 0x7fa5a80577f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:50.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.995+0000 7fa5cd377700 1 --2- 172.21.15.133:0/4181338454 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa5c80b2750 0x7fa5c8156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:50.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.995+0000 7fa5cd377700 1 --2- 172.21.15.133:0/4181338454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5c8066f70 0x7fa5c80af0d0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:50.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.995+0000 7fa5cd377700 1 --2- 172.21.15.133:0/4181338454 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa5c8067350 0x7fa5c8156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:50.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.995+0000 7fa5cd377700 1 -- 172.21.15.133:0/4181338454 >> 172.21.15.133:0/4181338454 conn(0x7fa5c80b6110 msgr2=0x7fa5c80b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:50.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.995+0000 7fa5cd377700 1 -- 172.21.15.133:0/4181338454 shutdown_connections 2021-01-03T13:04:50.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:50.995+0000 7fa5cd377700 1 -- 172.21.15.133:0/4181338454 wait complete. 2021-01-03T13:04:50.999 INFO:teuthology.orchestra.run.smithi133.stderr:listed 1 entries 2021-01-03T13:04:51.006 INFO:teuthology.orchestra.run.smithi133.stdout:[{"addr":"172.21.15.7:0/2138852502","until":"2021-01-03T14:04:44.488855+0000"}] 2021-01-03T13:04:51.021 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2021-01-03T13:04:51.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:51.022 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:04:51.022 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:51.071 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2021-01-03T13:04:51.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:04:51.073 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2021-01-03T13:04:51.074 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T13:04:51.074 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:04:51.075 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:51.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:51.144 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:04:51.145 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:51.191 INFO:teuthology.orchestra.run.smithi007.stdout:ext2/ext3 2021-01-03T13:04:51.192 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:04:51.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:04:51.193 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:51.240 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:04:51.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.355+0000 7f5abd0f3700 1 Processor -- start 2021-01-03T13:04:51.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.355+0000 7f5abd0f3700 1 -- start start 2021-01-03T13:04:51.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.355+0000 7f5abd0f3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ab80b2e90 0x7f5ab813fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.355+0000 7f5abd0f3700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5ab80b0ac0 0x7f5ab80ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.355+0000 7f5abd0f3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab80af220 con 0x7f5ab8143af0 2021-01-03T13:04:51.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.355+0000 7f5abd0f3700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab81401c0 con 0x7f5ab80b0ac0 2021-01-03T13:04:51.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.355+0000 7f5abd0f3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80b3270 con 0x7f5ab80b2e90 2021-01-03T13:04:51.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.355+0000 7f5ab77fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5ab80b0ac0 0x7f5ab80ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.355+0000 7f5ab77fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5ab80b0ac0 0x7f5ab80ae800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:34612/0 (socket says 172.21.15.133:34612) 2021-01-03T13:04:51.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.355+0000 7f5ab77fe700 1 -- 172.21.15.133:0/2516694050 learned_addr learned my addr 172.21.15.133:0/2516694050 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:51.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.355+0000 7f5ab7fff700 1 --2- 172.21.15.133:0/2516694050 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ab80b2e90 0x7f5ab813fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.355+0000 7f5ab77fe700 1 -- 172.21.15.133:0/2516694050 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ab80b2e90 msgr2=0x7f5ab813fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:51.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.355+0000 7f5ab77fe700 1 --2- 172.21.15.133:0/2516694050 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ab80b2e90 0x7f5ab813fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.355+0000 7f5ab77fe700 1 -- 172.21.15.133:0/2516694050 >> v1:172.21.15.133:6789/0 conn(0x7f5ab8143af0 legacy=0x7f5ab813cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:51.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.355+0000 7f5ab77fe700 1 -- 172.21.15.133:0/2516694050 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab80aecf0 con 0x7f5ab80b0ac0 2021-01-03T13:04:51.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.355+0000 7f5ab77fe700 1 --2- 172.21.15.133:0/2516694050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab80b0ac0 0x7f5ab80ae800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f5aa00032b0 tx=0x7f5aa0009270).ready entity=mon.0 client_cookie=29dfc6399d22399 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:51.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5ab6ffd700 1 -- 172.21.15.133:0/2516694050 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aa0009e60 con 0x7f5ab80b0ac0 2021-01-03T13:04:51.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5ab6ffd700 1 -- 172.21.15.133:0/2516694050 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa000bc00 con 0x7f5ab80b0ac0 2021-01-03T13:04:51.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5ab6ffd700 1 -- 172.21.15.133:0/2516694050 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aa000bd70 con 0x7f5ab80b0ac0 2021-01-03T13:04:51.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5abd0f3700 1 -- 172.21.15.133:0/2516694050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab80b0ac0 msgr2=0x7f5ab80ae800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:51.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5abd0f3700 1 --2- 172.21.15.133:0/2516694050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab80b0ac0 0x7f5ab80ae800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f5aa00032b0 tx=0x7f5aa0009270).stop 2021-01-03T13:04:51.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5abd0f3700 1 -- 172.21.15.133:0/2516694050 shutdown_connections 2021-01-03T13:04:51.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5abd0f3700 1 --2- 172.21.15.133:0/2516694050 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ab80b2e90 0x7f5ab813fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5abd0f3700 1 --2- 172.21.15.133:0/2516694050 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab80b0ac0 0x7f5ab80ae800 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5abd0f3700 1 -- 172.21.15.133:0/2516694050 >> 172.21.15.133:0/2516694050 conn(0x7f5ab806a620 msgr2=0x7f5ab806aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:51.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5abd0f3700 1 -- 172.21.15.133:0/2516694050 shutdown_connections 2021-01-03T13:04:51.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5abd0f3700 1 -- 172.21.15.133:0/2516694050 wait complete. 2021-01-03T13:04:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5abd0f3700 1 Processor -- start 2021-01-03T13:04:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5abd0f3700 1 -- start start 2021-01-03T13:04:51.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5abd0f3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ab80b0ac0 0x7f5ab81344e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5abd0f3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ab80b2e90 0x7f5ab81331b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5abd0f3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab8143af0 0x7f5ab81336a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5abd0f3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab81349d0 con 0x7f5ab8143af0 2021-01-03T13:04:51.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5abd0f3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab8133b90 con 0x7f5ab80b2e90 2021-01-03T13:04:51.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5abd0f3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80b5c20 con 0x7f5ab80b0ac0 2021-01-03T13:04:51.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.359+0000 7f5ab77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ab80b2e90 0x7f5ab81331b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5ab77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ab80b2e90 0x7f5ab81331b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36078/0 (socket says 172.21.15.133:36078) 2021-01-03T13:04:51.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5ab77fe700 1 -- 172.21.15.133:0/2014551313 learned_addr learned my addr 172.21.15.133:0/2014551313 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:51.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5ab7fff700 1 --2- 172.21.15.133:0/2014551313 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ab80b0ac0 0x7f5ab81344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5abc8f2700 1 --2- 172.21.15.133:0/2014551313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab8143af0 0x7f5ab81336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5ab77fe700 1 -- 172.21.15.133:0/2014551313 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ab80b0ac0 msgr2=0x7f5ab81344e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:51.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5ab77fe700 1 --2- 172.21.15.133:0/2014551313 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ab80b0ac0 0x7f5ab81344e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5ab77fe700 1 -- 172.21.15.133:0/2014551313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab8143af0 msgr2=0x7f5ab81336a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:51.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5ab77fe700 1 --2- 172.21.15.133:0/2014551313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab8143af0 0x7f5ab81336a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5ab77fe700 1 -- 172.21.15.133:0/2014551313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab80b5e50 con 0x7f5ab80b2e90 2021-01-03T13:04:51.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5ab77fe700 1 --2- 172.21.15.133:0/2014551313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ab80b2e90 0x7f5ab81331b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f5ab80b53b0 tx=0x7f5aa0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:51.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5ab57fa700 1 -- 172.21.15.133:0/2014551313 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aa0022070 con 0x7f5ab80b2e90 2021-01-03T13:04:51.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5ab57fa700 1 -- 172.21.15.133:0/2014551313 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa001e610 con 0x7f5ab80b2e90 2021-01-03T13:04:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5abd0f3700 1 -- 172.21.15.133:0/2014551313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab80b5490 con 0x7f5ab80b2e90 2021-01-03T13:04:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5ab57fa700 1 -- 172.21.15.133:0/2014551313 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aa001e970 con 0x7f5ab80b2e90 2021-01-03T13:04:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5abd0f3700 1 -- 172.21.15.133:0/2014551313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab8067570 con 0x7f5ab80b2e90 2021-01-03T13:04:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5ab57fa700 1 -- 172.21.15.133:0/2014551313 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5aa000f070 con 0x7f5ab80b2e90 2021-01-03T13:04:51.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5abd0f3700 1 -- 172.21.15.133:0/2014551313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab80b5690 con 0x7f5ab80b2e90 2021-01-03T13:04:51.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5ab57fa700 1 --2- 172.21.15.133:0/2014551313 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5a9c055440 0x7f5a9c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5ab57fa700 1 -- 172.21.15.133:0/2014551313 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f5aa006f5a0 con 0x7f5ab80b2e90 2021-01-03T13:04:51.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5ab7fff700 1 --2- 172.21.15.133:0/2014551313 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5a9c055440 0x7f5a9c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.363+0000 7f5ab7fff700 1 --2- 172.21.15.133:0/2014551313 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5a9c055440 0x7f5a9c057900 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f5aa800b000 tx=0x7f5aa8006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:51.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.367+0000 7f5ab57fa700 1 -- 172.21.15.133:0/2014551313 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5aa00457e0 con 0x7f5ab80b2e90 2021-01-03T13:04:51.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.507+0000 7f5abd0f3700 1 -- 172.21.15.133:0/2014551313 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ab8057300 con 0x7f5ab80b2e90 2021-01-03T13:04:51.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.507+0000 7f5ab57fa700 1 -- 172.21.15.133:0/2014551313 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16149 (secure 0 0 0) 0x7f5aa0048dc0 con 0x7f5ab80b2e90 2021-01-03T13:04:51.511 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:04:51.511 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":80,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:04:45.311139+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:03:57.389227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2021-01-03T13:03:58.706858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.7:0/2138852502":"2021-01-03T14:04:44.488855+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:04:51.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.511+0000 7f5abd0f3700 1 -- 172.21.15.133:0/2014551313 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5a9c055440 msgr2=0x7f5a9c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:51.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.511+0000 7f5abd0f3700 1 --2- 172.21.15.133:0/2014551313 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5a9c055440 0x7f5a9c057900 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f5aa800b000 tx=0x7f5aa8006dc0).stop 2021-01-03T13:04:51.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.511+0000 7f5abd0f3700 1 -- 172.21.15.133:0/2014551313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ab80b2e90 msgr2=0x7f5ab81331b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:51.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.511+0000 7f5abd0f3700 1 --2- 172.21.15.133:0/2014551313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ab80b2e90 0x7f5ab81331b0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f5ab80b53b0 tx=0x7f5aa0016000).stop 2021-01-03T13:04:51.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.511+0000 7f5abd0f3700 1 -- 172.21.15.133:0/2014551313 shutdown_connections 2021-01-03T13:04:51.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.511+0000 7f5abd0f3700 1 --2- 172.21.15.133:0/2014551313 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5a9c055440 0x7f5a9c057900 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.511+0000 7f5abd0f3700 1 --2- 172.21.15.133:0/2014551313 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ab8143af0 0x7f5ab81336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.511+0000 7f5abd0f3700 1 --2- 172.21.15.133:0/2014551313 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ab80b0ac0 0x7f5ab81344e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.511+0000 7f5abd0f3700 1 --2- 172.21.15.133:0/2014551313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ab80b2e90 0x7f5ab81331b0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.511+0000 7f5abd0f3700 1 -- 172.21.15.133:0/2014551313 >> 172.21.15.133:0/2014551313 conn(0x7f5ab806a620 msgr2=0x7f5ab805c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.511+0000 7f5abd0f3700 1 -- 172.21.15.133:0/2014551313 shutdown_connections 2021-01-03T13:04:51.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.511+0000 7f5abd0f3700 1 -- 172.21.15.133:0/2014551313 wait complete. 2021-01-03T13:04:51.524 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:03:57.389227+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:03:58.706858+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:04:51.525 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:04:51.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.639+0000 7f038451b700 1 Processor -- start 2021-01-03T13:04:51.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.639+0000 7f038451b700 1 -- start start 2021-01-03T13:04:51.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f038451b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f037c143d40 0x7f037c062310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f038451b700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037c1431d0 con 0x7f037c061f30 2021-01-03T13:04:51.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f038451b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f037c0b1c70 con 0x7f037c0b20f0 2021-01-03T13:04:51.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f038451b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0aedb0 con 0x7f037c143d40 2021-01-03T13:04:51.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f0381ab6700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f037c0b20f0 0x7f037c143630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57116/0 (socket says 172.21.15.133:57116) 2021-01-03T13:04:51.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f0381ab6700 1 -- 172.21.15.133:0/3206518913 learned_addr learned my addr 172.21.15.133:0/3206518913 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:51.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f0382ab8700 1 --2- 172.21.15.133:0/3206518913 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f037c143d40 0x7f037c062310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 -- 172.21.15.133:0/3206518913 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958538668 0 0) 0x7f037c0b1c70 con 0x7f037c0b20f0 2021-01-03T13:04:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 -- 172.21.15.133:0/3206518913 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0364003230 con 0x7f037c0b20f0 2021-01-03T13:04:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 -- 172.21.15.133:0/3206518913 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003586483 0 0) 0x7f037c1431d0 con 0x7f037c061f30 2021-01-03T13:04:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 -- 172.21.15.133:0/3206518913 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f037c0b1c70 con 0x7f037c061f30 2021-01-03T13:04:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 -- 172.21.15.133:0/3206518913 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1600117688 0 0) 0x7f0364003230 con 0x7f037c0b20f0 2021-01-03T13:04:51.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 -- 172.21.15.133:0/3206518913 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f037c143d40 msgr2=0x7f037c062310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:51.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 --2- 172.21.15.133:0/3206518913 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f037c143d40 0x7f037c062310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 -- 172.21.15.133:0/3206518913 >> v1:172.21.15.16:6789/0 conn(0x7f037c061f30 legacy=0x7f037c139770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:51.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 -- 172.21.15.133:0/3206518913 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c0b2bb0 con 0x7f037c0b20f0 2021-01-03T13:04:51.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 -- 172.21.15.133:0/3206518913 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f03700016d0 con 0x7f037c0b20f0 2021-01-03T13:04:51.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 -- 172.21.15.133:0/3206518913 >> v1:172.21.15.133:6789/0 conn(0x7f037c0b20f0 legacy=0x7f037c143630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:51.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 --2- 172.21.15.133:0/3206518913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03640038b0 0x7f0364003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 --2- 172.21.15.133:0/3206518913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03640044d0 0x7f0364004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 --2- 172.21.15.133:0/3206518913 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f037c143d40 0x7f0364004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 -- 172.21.15.133:0/3206518913 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0364005330 con 0x7f03640038b0 2021-01-03T13:04:51.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 -- 172.21.15.133:0/3206518913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036400b720 con 0x7f03640044d0 2021-01-03T13:04:51.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 -- 172.21.15.133:0/3206518913 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036400b860 con 0x7f037c143d40 2021-01-03T13:04:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f0381ab6700 1 --2- 172.21.15.133:0/3206518913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03640044d0 0x7f0364004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f0382ab8700 1 --2- 172.21.15.133:0/3206518913 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f037c143d40 0x7f0364004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03822b7700 1 --2- 172.21.15.133:0/3206518913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03640038b0 0x7f0364003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f0381ab6700 1 -- 172.21.15.133:0/3206518913 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f037c143d40 msgr2=0x7f0364004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:51.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f0381ab6700 1 --2- 172.21.15.133:0/3206518913 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f037c143d40 0x7f0364004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f0381ab6700 1 -- 172.21.15.133:0/3206518913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03640038b0 msgr2=0x7f0364003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:51.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f0381ab6700 1 --2- 172.21.15.133:0/3206518913 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03640038b0 0x7f0364003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f0381ab6700 1 -- 172.21.15.133:0/3206518913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0364003230 con 0x7f03640044d0 2021-01-03T13:04:51.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f0381ab6700 1 --2- 172.21.15.133:0/3206518913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03640044d0 0x7f0364004950 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f03700014a0 tx=0x7f037c0af790).ready entity=mon.1 client_cookie=6db2aba5a37d071b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:51.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 -- 172.21.15.133:0/3206518913 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f037000ce30 con 0x7f03640044d0 2021-01-03T13:04:51.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 -- 172.21.15.133:0/3206518913 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03700070d0 con 0x7f03640044d0 2021-01-03T13:04:51.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f038451b700 1 -- 172.21.15.133:0/3206518913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03640044d0 msgr2=0x7f0364004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:51.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f03812b5700 1 -- 172.21.15.133:0/3206518913 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0370007430 con 0x7f03640044d0 2021-01-03T13:04:51.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f038451b700 1 --2- 172.21.15.133:0/3206518913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03640044d0 0x7f0364004950 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f03700014a0 tx=0x7f037c0af790).stop 2021-01-03T13:04:51.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.643+0000 7f0382ab8700 1 -- 172.21.15.133:0/3206518913 reap_dead start 2021-01-03T13:04:51.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f038451b700 1 -- 172.21.15.133:0/3206518913 shutdown_connections 2021-01-03T13:04:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f038451b700 1 -- 172.21.15.133:0/3206518913 >> 172.21.15.133:0/3206518913 conn(0x7f037c0b6db0 msgr2=0x7f037c061820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f038451b700 1 -- 172.21.15.133:0/3206518913 shutdown_connections 2021-01-03T13:04:51.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f038451b700 1 -- 172.21.15.133:0/3206518913 wait complete. 2021-01-03T13:04:51.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f038451b700 1 Processor -- start 2021-01-03T13:04:51.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f038451b700 1 -- start start 2021-01-03T13:04:51.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f038451b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f037c13f2d0 0x7f037c13e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f038451b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f037c13eaa0 0x7f037c154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f038451b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f037c1554a0 0x7f037c155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f038451b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c141f80 con 0x7f037c13eaa0 2021-01-03T13:04:51.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f038451b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c136f80 con 0x7f037c13f2d0 2021-01-03T13:04:51.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f038451b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c155e40 con 0x7f037c1554a0 2021-01-03T13:04:51.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f03822b7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f037c13f2d0 0x7f037c13e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f03822b7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f037c13f2d0 0x7f037c13e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36100/0 (socket says 172.21.15.133:36100) 2021-01-03T13:04:51.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f03822b7700 1 -- 172.21.15.133:0/3920831626 learned_addr learned my addr 172.21.15.133:0/3920831626 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:51.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f0381ab6700 1 --2- 172.21.15.133:0/3920831626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f037c13eaa0 0x7f037c154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f0382ab8700 1 --2- 172.21.15.133:0/3920831626 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f037c1554a0 0x7f037c155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f03822b7700 1 -- 172.21.15.133:0/3920831626 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f037c1554a0 msgr2=0x7f037c155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:51.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f03822b7700 1 --2- 172.21.15.133:0/3920831626 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f037c1554a0 0x7f037c155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f03822b7700 1 -- 172.21.15.133:0/3920831626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f037c13eaa0 msgr2=0x7f037c154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:51.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f03822b7700 1 --2- 172.21.15.133:0/3920831626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f037c13eaa0 0x7f037c154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f03822b7700 1 -- 172.21.15.133:0/3920831626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c142de0 con 0x7f037c13f2d0 2021-01-03T13:04:51.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f0381ab6700 1 --2- 172.21.15.133:0/3920831626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f037c13eaa0 0x7f037c154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:04:51.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f03822b7700 1 --2- 172.21.15.133:0/3920831626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f037c13f2d0 0x7f037c13e060 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f037c155f80 tx=0x7f0378007b60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:51.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f036f7fe700 1 -- 172.21.15.133:0/3920831626 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f037800fe20 con 0x7f037c13f2d0 2021-01-03T13:04:51.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f036f7fe700 1 -- 172.21.15.133:0/3920831626 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0378014450 con 0x7f037c13f2d0 2021-01-03T13:04:51.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f038451b700 1 -- 172.21.15.133:0/3920831626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037c144380 con 0x7f037c13f2d0 2021-01-03T13:04:51.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f036f7fe700 1 -- 172.21.15.133:0/3920831626 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03780147b0 con 0x7f037c13f2d0 2021-01-03T13:04:51.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.647+0000 7f038451b700 1 -- 172.21.15.133:0/3920831626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037c13e550 con 0x7f037c13f2d0 2021-01-03T13:04:51.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.651+0000 7f038451b700 1 -- 172.21.15.133:0/3920831626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037c13f850 con 0x7f037c13f2d0 2021-01-03T13:04:51.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.651+0000 7f036f7fe700 1 -- 172.21.15.133:0/3920831626 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f03780133b0 con 0x7f037c13f2d0 2021-01-03T13:04:51.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.651+0000 7f036f7fe700 1 --2- 172.21.15.133:0/3920831626 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f035c055440 0x7f035c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.651+0000 7f036f7fe700 1 -- 172.21.15.133:0/3920831626 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f037806e120 con 0x7f037c13f2d0 2021-01-03T13:04:51.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.651+0000 7f0381ab6700 1 --2- 172.21.15.133:0/3920831626 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f035c055440 0x7f035c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.651+0000 7f0381ab6700 1 --2- 172.21.15.133:0/3920831626 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f035c055440 0x7f035c057900 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f0370018000 tx=0x7f0370015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:51.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.655+0000 7f036f7fe700 1 -- 172.21.15.133:0/3920831626 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0378044390 con 0x7f037c13f2d0 2021-01-03T13:04:51.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.799+0000 7f038451b700 1 -- 172.21.15.133:0/3920831626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f037c144820 con 0x7f037c13f2d0 2021-01-03T13:04:51.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.799+0000 7f036f7fe700 1 -- 172.21.15.133:0/3920831626 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v80) v1 ==== 110+0+10 (secure 0 0 0) 0x7f03780479b0 con 0x7f037c13f2d0 2021-01-03T13:04:51.802 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:04:51.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.799+0000 7f038451b700 1 -- 172.21.15.133:0/3920831626 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f035c055440 msgr2=0x7f035c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:51.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.799+0000 7f038451b700 1 --2- 172.21.15.133:0/3920831626 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f035c055440 0x7f035c057900 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f0370018000 tx=0x7f0370015000).stop 2021-01-03T13:04:51.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.799+0000 7f038451b700 1 -- 172.21.15.133:0/3920831626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f037c13f2d0 msgr2=0x7f037c13e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:51.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.799+0000 7f038451b700 1 --2- 172.21.15.133:0/3920831626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f037c13f2d0 0x7f037c13e060 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f037c155f80 tx=0x7f0378007b60).stop 2021-01-03T13:04:51.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.799+0000 7f038451b700 1 -- 172.21.15.133:0/3920831626 shutdown_connections 2021-01-03T13:04:51.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.799+0000 7f038451b700 1 --2- 172.21.15.133:0/3920831626 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f035c055440 0x7f035c057900 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.799+0000 7f038451b700 1 --2- 172.21.15.133:0/3920831626 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f037c1554a0 0x7f037c155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.799+0000 7f038451b700 1 --2- 172.21.15.133:0/3920831626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f037c13f2d0 0x7f037c13e060 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.799+0000 7f038451b700 1 --2- 172.21.15.133:0/3920831626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f037c13eaa0 0x7f037c154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.799+0000 7f038451b700 1 -- 172.21.15.133:0/3920831626 >> 172.21.15.133:0/3920831626 conn(0x7f037c0b6db0 msgr2=0x7f037c0adbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:51.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.799+0000 7f038451b700 1 -- 172.21.15.133:0/3920831626 shutdown_connections 2021-01-03T13:04:51.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.799+0000 7f038451b700 1 -- 172.21.15.133:0/3920831626 wait complete. 2021-01-03T13:04:51.815 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:04:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.923+0000 7fac17088700 1 Processor -- start 2021-01-03T13:04:51.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.923+0000 7fac17088700 1 -- start start 2021-01-03T13:04:51.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac17088700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fac100b4c20 0x7fac1005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac17088700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fac10060510 0x7fac100b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac17088700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac100b6cf0 con 0x7fac1005fd10 2021-01-03T13:04:51.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac17088700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1005bf00 con 0x7fac100b4c20 2021-01-03T13:04:51.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac17088700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1005c1a0 con 0x7fac10060510 2021-01-03T13:04:51.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac15885700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fac10060510 0x7fac100b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac15885700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fac10060510 0x7fac100b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36104/0 (socket says 172.21.15.133:36104) 2021-01-03T13:04:51.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac15885700 1 -- 172.21.15.133:0/427601577 learned_addr learned my addr 172.21.15.133:0/427601577 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:51.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac16887700 1 --1- 172.21.15.133:0/427601577 >> v1:172.21.15.133:6789/0 conn(0x7fac1005fd10 0x7fac100b65e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57140/0 (socket says 172.21.15.133:57140) 2021-01-03T13:04:51.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac16086700 1 --2- 172.21.15.133:0/427601577 >> v2:172.21.15.16:3300/0 conn(0x7fac100b4c20 0x7fac1005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac15885700 1 -- 172.21.15.133:0/427601577 >> v2:172.21.15.16:3300/0 conn(0x7fac100b4c20 msgr2=0x7fac1005c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:51.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac15885700 1 --2- 172.21.15.133:0/427601577 >> v2:172.21.15.16:3300/0 conn(0x7fac100b4c20 0x7fac1005c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac15885700 1 -- 172.21.15.133:0/427601577 >> v1:172.21.15.133:6789/0 conn(0x7fac1005fd10 legacy=0x7fac100b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:51.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac15885700 1 -- 172.21.15.133:0/427601577 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1005c440 con 0x7fac10060510 2021-01-03T13:04:51.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac15885700 1 --2- 172.21.15.133:0/427601577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac10060510 0x7fac100b5000 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fac00002f30 tx=0x7fac00006e80).ready entity=mon.1 client_cookie=d4a3690c1600ec12 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:51.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac15084700 1 -- 172.21.15.133:0/427601577 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac000097f0 con 0x7fac10060510 2021-01-03T13:04:51.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac15084700 1 -- 172.21.15.133:0/427601577 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac00009950 con 0x7fac10060510 2021-01-03T13:04:51.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac15084700 1 -- 172.21.15.133:0/427601577 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac00009ac0 con 0x7fac10060510 2021-01-03T13:04:51.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac17088700 1 -- 172.21.15.133:0/427601577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac10060510 msgr2=0x7fac100b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:51.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac17088700 1 --2- 172.21.15.133:0/427601577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac10060510 0x7fac100b5000 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fac00002f30 tx=0x7fac00006e80).stop 2021-01-03T13:04:51.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac17088700 1 -- 172.21.15.133:0/427601577 shutdown_connections 2021-01-03T13:04:51.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac17088700 1 --2- 172.21.15.133:0/427601577 >> v2:172.21.15.16:3300/0 conn(0x7fac100b4c20 0x7fac1005c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac17088700 1 --2- 172.21.15.133:0/427601577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac10060510 0x7fac100b5000 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac17088700 1 -- 172.21.15.133:0/427601577 >> 172.21.15.133:0/427601577 conn(0x7fac100b9f00 msgr2=0x7fac100b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:51.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac17088700 1 -- 172.21.15.133:0/427601577 shutdown_connections 2021-01-03T13:04:51.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.927+0000 7fac17088700 1 -- 172.21.15.133:0/427601577 wait complete. 2021-01-03T13:04:51.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac17088700 1 Processor -- start 2021-01-03T13:04:51.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac17088700 1 -- start start 2021-01-03T13:04:51.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac17088700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1005fd10 0x7fac100b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac17088700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac10060510 0x7fac1014edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac17088700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fac100b4c20 0x7fac1014f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac17088700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1008fd40 con 0x7fac10060510 2021-01-03T13:04:51.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac17088700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1014f790 con 0x7fac1005fd10 2021-01-03T13:04:51.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac17088700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1008ff70 con 0x7fac100b4c20 2021-01-03T13:04:51.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac16086700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1005fd10 0x7fac100b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac16086700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1005fd10 0x7fac100b28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36110/0 (socket says 172.21.15.133:36110) 2021-01-03T13:04:51.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac16086700 1 -- 172.21.15.133:0/1678719761 learned_addr learned my addr 172.21.15.133:0/1678719761 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:51.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac15885700 1 --2- 172.21.15.133:0/1678719761 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac10060510 0x7fac1014edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac16887700 1 --2- 172.21.15.133:0/1678719761 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fac100b4c20 0x7fac1014f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac16086700 1 -- 172.21.15.133:0/1678719761 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fac100b4c20 msgr2=0x7fac1014f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:51.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac16086700 1 --2- 172.21.15.133:0/1678719761 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fac100b4c20 0x7fac1014f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac16086700 1 -- 172.21.15.133:0/1678719761 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac10060510 msgr2=0x7fac1014edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:51.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac16086700 1 --2- 172.21.15.133:0/1678719761 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac10060510 0x7fac1014edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:51.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac16086700 1 -- 172.21.15.133:0/1678719761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac10090210 con 0x7fac1005fd10 2021-01-03T13:04:51.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac16086700 1 --2- 172.21.15.133:0/1678719761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1005fd10 0x7fac100b28e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7fac100913c0 tx=0x7fac0c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:51.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fabff7fe700 1 -- 172.21.15.133:0/1678719761 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac0c0127e0 con 0x7fac1005fd10 2021-01-03T13:04:51.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fabff7fe700 1 -- 172.21.15.133:0/1678719761 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c012940 con 0x7fac1005fd10 2021-01-03T13:04:51.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac17088700 1 -- 172.21.15.133:0/1678719761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac100904b0 con 0x7fac1005fd10 2021-01-03T13:04:51.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fabff7fe700 1 -- 172.21.15.133:0/1678719761 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac0c012ca0 con 0x7fac1005fd10 2021-01-03T13:04:51.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.931+0000 7fac17088700 1 -- 172.21.15.133:0/1678719761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac100b2dd0 con 0x7fac1005fd10 2021-01-03T13:04:51.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.935+0000 7fabff7fe700 1 -- 172.21.15.133:0/1678719761 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fac0c013480 con 0x7fac1005fd10 2021-01-03T13:04:51.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.935+0000 7fabff7fe700 1 --2- 172.21.15.133:0/1678719761 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fabf00553b0 0x7fabf0057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:51.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.935+0000 7fac17088700 1 -- 172.21.15.133:0/1678719761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac10057300 con 0x7fac1005fd10 2021-01-03T13:04:51.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.935+0000 7fac15885700 1 --2- 172.21.15.133:0/1678719761 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fabf00553b0 0x7fabf0057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:51.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.935+0000 7fabff7fe700 1 -- 172.21.15.133:0/1678719761 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fac0c06e670 con 0x7fac1005fd10 2021-01-03T13:04:51.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.935+0000 7fac15885700 1 --2- 172.21.15.133:0/1678719761 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fabf00553b0 0x7fabf0057870 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fac0001b000 tx=0x7fac00016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:51.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:51.943+0000 7fabff7fe700 1 -- 172.21.15.133:0/1678719761 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fac0c0447d0 con 0x7fac1005fd10 2021-01-03T13:04:52.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.083+0000 7fac17088700 1 -- 172.21.15.133:0/1678719761 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fac10067a00 con 0x7fac1005fd10 2021-01-03T13:04:52.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.083+0000 7fabff7fe700 1 -- 172.21.15.133:0/1678719761 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v80) v1 ==== 92+0+10 (secure 0 0 0) 0x7fac0c047df0 con 0x7fac1005fd10 2021-01-03T13:04:52.085 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:04:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.083+0000 7fac17088700 1 -- 172.21.15.133:0/1678719761 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fabf00553b0 msgr2=0x7fabf0057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.083+0000 7fac17088700 1 --2- 172.21.15.133:0/1678719761 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fabf00553b0 0x7fabf0057870 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fac0001b000 tx=0x7fac00016000).stop 2021-01-03T13:04:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.083+0000 7fac17088700 1 -- 172.21.15.133:0/1678719761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1005fd10 msgr2=0x7fac100b28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.083+0000 7fac17088700 1 --2- 172.21.15.133:0/1678719761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1005fd10 0x7fac100b28e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7fac100913c0 tx=0x7fac0c008040).stop 2021-01-03T13:04:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.083+0000 7fac17088700 1 -- 172.21.15.133:0/1678719761 shutdown_connections 2021-01-03T13:04:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.083+0000 7fac17088700 1 --2- 172.21.15.133:0/1678719761 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fabf00553b0 0x7fabf0057870 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.083+0000 7fac17088700 1 --2- 172.21.15.133:0/1678719761 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fac100b4c20 0x7fac1014f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.083+0000 7fac17088700 1 --2- 172.21.15.133:0/1678719761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1005fd10 0x7fac100b28e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.083+0000 7fac17088700 1 --2- 172.21.15.133:0/1678719761 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fac10060510 0x7fac1014edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.083+0000 7fac17088700 1 -- 172.21.15.133:0/1678719761 >> 172.21.15.133:0/1678719761 conn(0x7fac100b9f00 msgr2=0x7fac1013ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.083+0000 7fac17088700 1 -- 172.21.15.133:0/1678719761 shutdown_connections 2021-01-03T13:04:52.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.083+0000 7fac17088700 1 -- 172.21.15.133:0/1678719761 wait complete. 2021-01-03T13:04:52.098 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:04:52.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.211+0000 7f90bbfcc700 1 Processor -- start 2021-01-03T13:04:52.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.211+0000 7f90bbfcc700 1 -- start start 2021-01-03T13:04:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.211+0000 7f90bbfcc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f90b40b0670 0x7f90b40aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.211+0000 7f90bbfcc700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b4098550 con 0x7f90b40b5c10 2021-01-03T13:04:52.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.211+0000 7f90bbfcc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b40b5ff0 con 0x7f90b414aee0 2021-01-03T13:04:52.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.211+0000 7f90bbfcc700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b40b0b10 con 0x7f90b40b0670 2021-01-03T13:04:52.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.211+0000 7f90ba569700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f90b414aee0 0x7f90b4144470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57154/0 (socket says 172.21.15.133:57154) 2021-01-03T13:04:52.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.211+0000 7f90ba569700 1 -- 172.21.15.133:0/4283296947 learned_addr learned my addr 172.21.15.133:0/4283296947 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:52.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.211+0000 7f90b9567700 1 --2- 172.21.15.133:0/4283296947 >> v2:172.21.15.16:3300/0 conn(0x7f90b40b0670 0x7f90b40aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 -- 172.21.15.133:0/4283296947 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437149156 0 0) 0x7f90b40b5ff0 con 0x7f90b414aee0 2021-01-03T13:04:52.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 -- 172.21.15.133:0/4283296947 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f909c003230 con 0x7f90b414aee0 2021-01-03T13:04:52.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 -- 172.21.15.133:0/4283296947 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 192558133 0 0) 0x7f909c003230 con 0x7f90b414aee0 2021-01-03T13:04:52.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 -- 172.21.15.133:0/4283296947 >> v2:172.21.15.16:3300/0 conn(0x7f90b40b0670 msgr2=0x7f90b40aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:52.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 --2- 172.21.15.133:0/4283296947 >> v2:172.21.15.16:3300/0 conn(0x7f90b40b0670 0x7f90b40aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 -- 172.21.15.133:0/4283296947 >> v1:172.21.15.16:6789/0 conn(0x7f90b40b5c10 legacy=0x7f90b414a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 -- 172.21.15.133:0/4283296947 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b4098780 con 0x7f90b414aee0 2021-01-03T13:04:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 -- 172.21.15.133:0/4283296947 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f90ac001a50 con 0x7f90b414aee0 2021-01-03T13:04:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 -- 172.21.15.133:0/4283296947 >> v1:172.21.15.133:6789/0 conn(0x7f90b414aee0 legacy=0x7f90b4144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 --2- 172.21.15.133:0/4283296947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f909c003720 0x7f909c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 --2- 172.21.15.133:0/4283296947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f909c0044d0 0x7f909c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 --2- 172.21.15.133:0/4283296947 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f909c004e40 0x7f909c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.226 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 -- 172.21.15.133:0/4283296947 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b40b0b10 con 0x7f909c003720 2021-01-03T13:04:52.226 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 -- 172.21.15.133:0/4283296947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c004250 con 0x7f909c0044d0 2021-01-03T13:04:52.226 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 -- 172.21.15.133:0/4283296947 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909c00bc10 con 0x7f909c004e40 2021-01-03T13:04:52.226 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b9567700 1 --2- 172.21.15.133:0/4283296947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f909c0044d0 0x7f909c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b9d68700 1 --2- 172.21.15.133:0/4283296947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f909c003720 0x7f909c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90ba569700 1 --2- 172.21.15.133:0/4283296947 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f909c004e40 0x7f909c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b9567700 1 -- 172.21.15.133:0/4283296947 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f909c004e40 msgr2=0x7f909c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:52.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b9567700 1 --2- 172.21.15.133:0/4283296947 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f909c004e40 0x7f909c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b9567700 1 -- 172.21.15.133:0/4283296947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f909c003720 msgr2=0x7f909c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:52.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b9567700 1 --2- 172.21.15.133:0/4283296947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f909c003720 0x7f909c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90ba569700 1 -- 172.21.15.133:0/4283296947 reap_dead start 2021-01-03T13:04:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b9567700 1 -- 172.21.15.133:0/4283296947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c003230 con 0x7f909c0044d0 2021-01-03T13:04:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b9567700 1 --2- 172.21.15.133:0/4283296947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f909c0044d0 0x7f909c004950 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f90a400c000 tx=0x7f90a4008040).ready entity=mon.1 client_cookie=c3d15ae6bc0b937a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:52.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 -- 172.21.15.133:0/4283296947 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90a400e9d0 con 0x7f909c0044d0 2021-01-03T13:04:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 -- 172.21.15.133:0/4283296947 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a400eb30 con 0x7f909c0044d0 2021-01-03T13:04:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90b8d66700 1 -- 172.21.15.133:0/4283296947 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90a400ee90 con 0x7f909c0044d0 2021-01-03T13:04:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90bbfcc700 1 -- 172.21.15.133:0/4283296947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f909c0044d0 msgr2=0x7f909c004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90bbfcc700 1 --2- 172.21.15.133:0/4283296947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f909c0044d0 0x7f909c004950 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f90a400c000 tx=0x7f90a4008040).stop 2021-01-03T13:04:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90bbfcc700 1 -- 172.21.15.133:0/4283296947 shutdown_connections 2021-01-03T13:04:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90bbfcc700 1 --2- 172.21.15.133:0/4283296947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f909c0044d0 0x7f909c004950 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90bbfcc700 1 -- 172.21.15.133:0/4283296947 >> 172.21.15.133:0/4283296947 conn(0x7f90b405c8c0 msgr2=0x7f90b40b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90bbfcc700 1 -- 172.21.15.133:0/4283296947 shutdown_connections 2021-01-03T13:04:52.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90bbfcc700 1 -- 172.21.15.133:0/4283296947 wait complete. 2021-01-03T13:04:52.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90bbfcc700 1 Processor -- start 2021-01-03T13:04:52.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.215+0000 7f90bbfcc700 1 -- start start 2021-01-03T13:04:52.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90bbfcc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f909c0044d0 0x7f90b409a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90bbfcc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b41565e0 0x7f90b4156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90bbfcc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90b41435a0 0x7f90b4143a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90bbfcc700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b4156f50 con 0x7f90b41435a0 2021-01-03T13:04:52.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90bbfcc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b40adf50 con 0x7f90b41565e0 2021-01-03T13:04:52.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90bbfcc700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b4143f40 con 0x7f909c0044d0 2021-01-03T13:04:52.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90b9567700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b41565e0 0x7f90b4156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90b9567700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b41565e0 0x7f90b4156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36132/0 (socket says 172.21.15.133:36132) 2021-01-03T13:04:52.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90b9567700 1 -- 172.21.15.133:0/1347918148 learned_addr learned my addr 172.21.15.133:0/1347918148 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:52.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90ba569700 1 --2- 172.21.15.133:0/1347918148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90b41435a0 0x7f90b4143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90b9d68700 1 --2- 172.21.15.133:0/1347918148 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f909c0044d0 0x7f90b409a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90b9567700 1 -- 172.21.15.133:0/1347918148 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f909c0044d0 msgr2=0x7f90b409a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90b9567700 1 --2- 172.21.15.133:0/1347918148 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f909c0044d0 0x7f90b409a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90b9567700 1 -- 172.21.15.133:0/1347918148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90b41435a0 msgr2=0x7f90b4143a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90b9567700 1 --2- 172.21.15.133:0/1347918148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90b41435a0 0x7f90b4143a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90b9567700 1 -- 172.21.15.133:0/1347918148 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b40b4f30 con 0x7f90b41565e0 2021-01-03T13:04:52.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90b9567700 1 --2- 172.21.15.133:0/1347918148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b41565e0 0x7f90b4156a60 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f90b41564c0 tx=0x7f90a401a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:52.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90a2ffd700 1 -- 172.21.15.133:0/1347918148 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90a401c430 con 0x7f90b41565e0 2021-01-03T13:04:52.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90a2ffd700 1 -- 172.21.15.133:0/1347918148 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a401c590 con 0x7f90b41565e0 2021-01-03T13:04:52.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90bbfcc700 1 -- 172.21.15.133:0/1347918148 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b40adcb0 con 0x7f90b41565e0 2021-01-03T13:04:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90a2ffd700 1 -- 172.21.15.133:0/1347918148 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90a401c8f0 con 0x7f90b41565e0 2021-01-03T13:04:52.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90bbfcc700 1 -- 172.21.15.133:0/1347918148 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b40ae880 con 0x7f90b41565e0 2021-01-03T13:04:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.219+0000 7f90bbfcc700 1 -- 172.21.15.133:0/1347918148 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b4057300 con 0x7f90b41565e0 2021-01-03T13:04:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.223+0000 7f90a2ffd700 1 -- 172.21.15.133:0/1347918148 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f90a402c070 con 0x7f90b41565e0 2021-01-03T13:04:52.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.223+0000 7f90a2ffd700 1 --2- 172.21.15.133:0/1347918148 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f90940553b0 0x7f9094057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.223+0000 7f90a2ffd700 1 -- 172.21.15.133:0/1347918148 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f90a406f9c0 con 0x7f90b41565e0 2021-01-03T13:04:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.223+0000 7f90b9d68700 1 --2- 172.21.15.133:0/1347918148 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f90940553b0 0x7f9094057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.223+0000 7f90b9d68700 1 --2- 172.21.15.133:0/1347918148 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f90940553b0 0x7f9094057870 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f90b000d000 tx=0x7f90b0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:52.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.227+0000 7f90a2ffd700 1 -- 172.21.15.133:0/1347918148 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f90a4045cd0 con 0x7f90b41565e0 2021-01-03T13:04:52.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.371+0000 7f90bbfcc700 1 -- 172.21.15.133:0/1347918148 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90b405ce00 con 0x7f90b41565e0 2021-01-03T13:04:52.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.371+0000 7f90a2ffd700 1 -- 172.21.15.133:0/1347918148 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+10 (secure 0 0 0) 0x7f90a4016070 con 0x7f90b41565e0 2021-01-03T13:04:52.375 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:04:52.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.375+0000 7f90bbfcc700 1 -- 172.21.15.133:0/1347918148 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f90940553b0 msgr2=0x7f9094057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.375+0000 7f90bbfcc700 1 --2- 172.21.15.133:0/1347918148 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f90940553b0 0x7f9094057870 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f90b000d000 tx=0x7f90b0009040).stop 2021-01-03T13:04:52.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.375+0000 7f90bbfcc700 1 -- 172.21.15.133:0/1347918148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b41565e0 msgr2=0x7f90b4156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.375+0000 7f90bbfcc700 1 --2- 172.21.15.133:0/1347918148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b41565e0 0x7f90b4156a60 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f90b41564c0 tx=0x7f90a401a000).stop 2021-01-03T13:04:52.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.375+0000 7f90bbfcc700 1 -- 172.21.15.133:0/1347918148 shutdown_connections 2021-01-03T13:04:52.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.375+0000 7f90bbfcc700 1 --2- 172.21.15.133:0/1347918148 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f90940553b0 0x7f9094057870 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.375+0000 7f90bbfcc700 1 --2- 172.21.15.133:0/1347918148 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90b41435a0 0x7f90b4143a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.375+0000 7f90bbfcc700 1 --2- 172.21.15.133:0/1347918148 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f909c0044d0 0x7f90b409a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.375+0000 7f90bbfcc700 1 --2- 172.21.15.133:0/1347918148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90b41565e0 0x7f90b4156a60 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.375+0000 7f90bbfcc700 1 -- 172.21.15.133:0/1347918148 >> 172.21.15.133:0/1347918148 conn(0x7f90b405c8c0 msgr2=0x7f90b4145a70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:52.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.375+0000 7f90bbfcc700 1 -- 172.21.15.133:0/1347918148 shutdown_connections 2021-01-03T13:04:52.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.375+0000 7f90bbfcc700 1 -- 172.21.15.133:0/1347918148 wait complete. 2021-01-03T13:04:52.389 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:04:52.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.499+0000 7f36ef06d700 1 Processor -- start 2021-01-03T13:04:52.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.499+0000 7f36ef06d700 1 -- start start 2021-01-03T13:04:52.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.499+0000 7f36ef06d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f36e80b1590 0x7f36e80b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.499+0000 7f36ef06d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e805fd00 con 0x7f36e8066f30 2021-01-03T13:04:52.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.499+0000 7f36ef06d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e80accd0 con 0x7f36e805f920 2021-01-03T13:04:52.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.499+0000 7f36ef06d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e80b2980 con 0x7f36e80b1590 2021-01-03T13:04:52.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.499+0000 7f36ee86c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f36e80b1590 0x7f36e80b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.499+0000 7f36ee06b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f36e805f920 0x7f36e80b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57170/0 (socket says 172.21.15.133:57170) 2021-01-03T13:04:52.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.499+0000 7f36ee06b700 1 -- 172.21.15.133:0/731455093 learned_addr learned my addr 172.21.15.133:0/731455093 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:52.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.503+0000 7f36ee86c700 1 -- 172.21.15.133:0/731455093 >> v1:172.21.15.133:6789/0 conn(0x7f36e805f920 legacy=0x7f36e80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.503+0000 7f36ed069700 1 -- 172.21.15.133:0/731455093 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109102544 0 0) 0x7f36e80accd0 con 0x7f36e805f920 2021-01-03T13:04:52.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.503+0000 7f36ee86c700 1 -- 172.21.15.133:0/731455093 >> v1:172.21.15.16:6789/0 conn(0x7f36e8066f30 legacy=0x7f36e813ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.503+0000 7f36ee86c700 1 -- 172.21.15.133:0/731455093 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e80acf70 con 0x7f36e80b1590 2021-01-03T13:04:52.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.503+0000 7f36ee86c700 1 --2- 172.21.15.133:0/731455093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36e80b1590 0x7f36e80b0ab0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f36e00032b0 tx=0x7f36e00091a0).ready entity=mon.1 client_cookie=a94f445800e5844c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:52.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.503+0000 7f36ed069700 1 -- 172.21.15.133:0/731455093 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36e000ba50 con 0x7f36e80b1590 2021-01-03T13:04:52.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.503+0000 7f36ed069700 1 -- 172.21.15.133:0/731455093 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e000bbb0 con 0x7f36e80b1590 2021-01-03T13:04:52.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.503+0000 7f36ef06d700 1 -- 172.21.15.133:0/731455093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36e80b1590 msgr2=0x7f36e80b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.503+0000 7f36ed069700 1 -- 172.21.15.133:0/731455093 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36e000bd20 con 0x7f36e80b1590 2021-01-03T13:04:52.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.503+0000 7f36ef06d700 1 --2- 172.21.15.133:0/731455093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36e80b1590 0x7f36e80b0ab0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f36e00032b0 tx=0x7f36e00091a0).stop 2021-01-03T13:04:52.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.503+0000 7f36ef06d700 1 -- 172.21.15.133:0/731455093 shutdown_connections 2021-01-03T13:04:52.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.503+0000 7f36ef06d700 1 --2- 172.21.15.133:0/731455093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36e80b1590 0x7f36e80b0ab0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.503+0000 7f36ef06d700 1 -- 172.21.15.133:0/731455093 >> 172.21.15.133:0/731455093 conn(0x7f36e80b6110 msgr2=0x7f36e80b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:52.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.503+0000 7f36ef06d700 1 -- 172.21.15.133:0/731455093 shutdown_connections 2021-01-03T13:04:52.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.503+0000 7f36ef06d700 1 -- 172.21.15.133:0/731455093 wait complete. 2021-01-03T13:04:52.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.503+0000 7f36ef06d700 1 Processor -- start 2021-01-03T13:04:52.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.503+0000 7f36ef06d700 1 -- start start 2021-01-03T13:04:52.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ef06d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36e805f920 0x7f36e80b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ef06d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36e8066f30 0x7f36e8064af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ef06d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36e80b1590 0x7f36e8064fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ef06d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e8066390 con 0x7f36e8066f30 2021-01-03T13:04:52.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ef06d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80b5a60 con 0x7f36e80b1590 2021-01-03T13:04:52.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ef06d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80b57c0 con 0x7f36e805f920 2021-01-03T13:04:52.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ee86c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36e80b1590 0x7f36e8064fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ee86c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36e80b1590 0x7f36e8064fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36148/0 (socket says 172.21.15.133:36148) 2021-01-03T13:04:52.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ee86c700 1 -- 172.21.15.133:0/1468516029 learned_addr learned my addr 172.21.15.133:0/1468516029 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:52.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ee06b700 1 --2- 172.21.15.133:0/1468516029 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36e805f920 0x7f36e80b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ed86a700 1 --2- 172.21.15.133:0/1468516029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36e8066f30 0x7f36e8064af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ee86c700 1 -- 172.21.15.133:0/1468516029 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36e805f920 msgr2=0x7f36e80b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ee86c700 1 --2- 172.21.15.133:0/1468516029 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36e805f920 0x7f36e80b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ee86c700 1 -- 172.21.15.133:0/1468516029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36e8066f30 msgr2=0x7f36e8064af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ee86c700 1 --2- 172.21.15.133:0/1468516029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36e8066f30 0x7f36e8064af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ee86c700 1 -- 172.21.15.133:0/1468516029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e80665f0 con 0x7f36e80b1590 2021-01-03T13:04:52.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ee86c700 1 --2- 172.21.15.133:0/1468516029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36e80b1590 0x7f36e8064fe0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f36e00032b0 tx=0x7f36e0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:52.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36db7fe700 1 -- 172.21.15.133:0/1468516029 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36e0010870 con 0x7f36e80b1590 2021-01-03T13:04:52.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36db7fe700 1 -- 172.21.15.133:0/1468516029 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e00109d0 con 0x7f36e80b1590 2021-01-03T13:04:52.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ef06d700 1 -- 172.21.15.133:0/1468516029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e80af200 con 0x7f36e80b1590 2021-01-03T13:04:52.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36db7fe700 1 -- 172.21.15.133:0/1468516029 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36e0010d30 con 0x7f36e80b1590 2021-01-03T13:04:52.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ef06d700 1 -- 172.21.15.133:0/1468516029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e80b5210 con 0x7f36e80b1590 2021-01-03T13:04:52.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.507+0000 7f36ef06d700 1 -- 172.21.15.133:0/1468516029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e80b1090 con 0x7f36e80b1590 2021-01-03T13:04:52.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.511+0000 7f36db7fe700 1 -- 172.21.15.133:0/1468516029 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f36e0027030 con 0x7f36e80b1590 2021-01-03T13:04:52.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.511+0000 7f36db7fe700 1 --2- 172.21.15.133:0/1468516029 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f36c8055470 0x7f36c8057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.511+0000 7f36db7fe700 1 -- 172.21.15.133:0/1468516029 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f36e006f200 con 0x7f36e80b1590 2021-01-03T13:04:52.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.511+0000 7f36ee06b700 1 --2- 172.21.15.133:0/1468516029 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f36c8055470 0x7f36c8057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.511+0000 7f36ee06b700 1 --2- 172.21.15.133:0/1468516029 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f36c8055470 0x7f36c8057930 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f36dc00d000 tx=0x7f36dc001160).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:52.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.515+0000 7f36db7fe700 1 -- 172.21.15.133:0/1468516029 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f36e80b1090 con 0x7f36e80b1590 2021-01-03T13:04:52.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.659+0000 7f36ef06d700 1 -- 172.21.15.133:0/1468516029 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36e80b1090 con 0x7f36e80b1590 2021-01-03T13:04:52.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.659+0000 7f36db7fe700 1 -- 172.21.15.133:0/1468516029 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+10 (secure 0 0 0) 0x7f36e80b1090 con 0x7f36e80b1590 2021-01-03T13:04:52.662 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:04:52.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.663+0000 7f36ef06d700 1 -- 172.21.15.133:0/1468516029 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f36c8055470 msgr2=0x7f36c8057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.663+0000 7f36ef06d700 1 --2- 172.21.15.133:0/1468516029 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f36c8055470 0x7f36c8057930 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f36dc00d000 tx=0x7f36dc001160).stop 2021-01-03T13:04:52.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.663+0000 7f36ef06d700 1 -- 172.21.15.133:0/1468516029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36e80b1590 msgr2=0x7f36e8064fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.663+0000 7f36ef06d700 1 --2- 172.21.15.133:0/1468516029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36e80b1590 0x7f36e8064fe0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f36e00032b0 tx=0x7f36e0016000).stop 2021-01-03T13:04:52.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.663+0000 7f36ef06d700 1 -- 172.21.15.133:0/1468516029 shutdown_connections 2021-01-03T13:04:52.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.663+0000 7f36ef06d700 1 --2- 172.21.15.133:0/1468516029 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f36c8055470 0x7f36c8057930 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.663+0000 7f36ef06d700 1 --2- 172.21.15.133:0/1468516029 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36e80b1590 0x7f36e8064fe0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.663+0000 7f36ef06d700 1 --2- 172.21.15.133:0/1468516029 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f36e805f920 0x7f36e80b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.663+0000 7f36ef06d700 1 --2- 172.21.15.133:0/1468516029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36e8066f30 0x7f36e8064af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.663+0000 7f36ef06d700 1 -- 172.21.15.133:0/1468516029 >> 172.21.15.133:0/1468516029 conn(0x7f36e80b6110 msgr2=0x7f36e80b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:52.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.663+0000 7f36ef06d700 1 -- 172.21.15.133:0/1468516029 shutdown_connections 2021-01-03T13:04:52.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.663+0000 7f36ef06d700 1 -- 172.21.15.133:0/1468516029 wait complete. 2021-01-03T13:04:52.675 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:04:52.676 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:04:52.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.783+0000 7fee2027c700 1 Processor -- start 2021-01-03T13:04:52.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.783+0000 7fee2027c700 1 -- start start 2021-01-03T13:04:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee2027c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee180b5c10 0x7fee180aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee2027c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fee180b0670 0x7fee1814a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee2027c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee18098550 con 0x7fee1814acc0 2021-01-03T13:04:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee2027c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee180b5ff0 con 0x7fee180b5c10 2021-01-03T13:04:52.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee2027c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee180b0b10 con 0x7fee180b0670 2021-01-03T13:04:52.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee1e018700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee180b5c10 0x7fee180aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee1e819700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fee1814acc0 0x7fee18144470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57186/0 (socket says 172.21.15.133:57186) 2021-01-03T13:04:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee1e819700 1 -- 172.21.15.133:0/2782520317 learned_addr learned my addr 172.21.15.133:0/2782520317 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee1d817700 1 --2- 172.21.15.133:0/2782520317 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fee180b0670 0x7fee1814a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee1e018700 1 -- 172.21.15.133:0/2782520317 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fee180b0670 msgr2=0x7fee1814a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee1e018700 1 --2- 172.21.15.133:0/2782520317 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fee180b0670 0x7fee1814a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee1e018700 1 -- 172.21.15.133:0/2782520317 >> v1:172.21.15.133:6789/0 conn(0x7fee1814acc0 legacy=0x7fee18144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee1e018700 1 -- 172.21.15.133:0/2782520317 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee18098780 con 0x7fee180b5c10 2021-01-03T13:04:52.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee1e018700 1 --2- 172.21.15.133:0/2782520317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee180b5c10 0x7fee180aae70 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7fee0c002f30 tx=0x7fee0c006dc0).ready entity=mon.1 client_cookie=ff522ea4dba3c2ba server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:52.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee1d016700 1 -- 172.21.15.133:0/2782520317 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee0c0097f0 con 0x7fee180b5c10 2021-01-03T13:04:52.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee1d016700 1 -- 172.21.15.133:0/2782520317 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c009950 con 0x7fee180b5c10 2021-01-03T13:04:52.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee2027c700 1 -- 172.21.15.133:0/2782520317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee180b5c10 msgr2=0x7fee180aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee2027c700 1 --2- 172.21.15.133:0/2782520317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee180b5c10 0x7fee180aae70 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7fee0c002f30 tx=0x7fee0c006dc0).stop 2021-01-03T13:04:52.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee2027c700 1 -- 172.21.15.133:0/2782520317 shutdown_connections 2021-01-03T13:04:52.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee2027c700 1 --2- 172.21.15.133:0/2782520317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee180b5c10 0x7fee180aae70 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee2027c700 1 --2- 172.21.15.133:0/2782520317 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fee180b0670 0x7fee1814a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee2027c700 1 -- 172.21.15.133:0/2782520317 >> 172.21.15.133:0/2782520317 conn(0x7fee1805c8c0 msgr2=0x7fee180b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:52.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee2027c700 1 -- 172.21.15.133:0/2782520317 shutdown_connections 2021-01-03T13:04:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.787+0000 7fee2027c700 1 -- 172.21.15.133:0/2782520317 wait complete. 2021-01-03T13:04:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee2027c700 1 Processor -- start 2021-01-03T13:04:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee2027c700 1 -- start start 2021-01-03T13:04:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee2027c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee180b0670 0x7fee18156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee2027c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fee180b5c10 0x7fee181498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee2027c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee1814acc0 0x7fee180ac610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee2027c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee18147de0 con 0x7fee1814acc0 2021-01-03T13:04:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee2027c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee18146c70 con 0x7fee180b0670 2021-01-03T13:04:52.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee2027c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee18148300 con 0x7fee180b5c10 2021-01-03T13:04:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee1e018700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee180b0670 0x7fee18156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee1e018700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee180b0670 0x7fee18156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36158/0 (socket says 172.21.15.133:36158) 2021-01-03T13:04:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee1e018700 1 -- 172.21.15.133:0/2329929073 learned_addr learned my addr 172.21.15.133:0/2329929073 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee1d817700 1 --2- 172.21.15.133:0/2329929073 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fee180b5c10 0x7fee181498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee1e819700 1 --2- 172.21.15.133:0/2329929073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee1814acc0 0x7fee180ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee1e018700 1 -- 172.21.15.133:0/2329929073 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fee180b5c10 msgr2=0x7fee181498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee1e018700 1 --2- 172.21.15.133:0/2329929073 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fee180b5c10 0x7fee181498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee1e018700 1 -- 172.21.15.133:0/2329929073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee1814acc0 msgr2=0x7fee180ac610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee1e018700 1 --2- 172.21.15.133:0/2329929073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee1814acc0 0x7fee180ac610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee1e018700 1 -- 172.21.15.133:0/2329929073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee181467d0 con 0x7fee180b0670 2021-01-03T13:04:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee1e018700 1 --2- 172.21.15.133:0/2329929073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee180b0670 0x7fee18156bf0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fee0c002f30 tx=0x7fee0c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee177fe700 1 -- 172.21.15.133:0/2329929073 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee0c011b80 con 0x7fee180b0670 2021-01-03T13:04:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee177fe700 1 -- 172.21.15.133:0/2329929073 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c011ce0 con 0x7fee180b0670 2021-01-03T13:04:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee2027c700 1 -- 172.21.15.133:0/2329929073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee180ad090 con 0x7fee180b0670 2021-01-03T13:04:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee177fe700 1 -- 172.21.15.133:0/2329929073 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee0c01d640 con 0x7fee180b0670 2021-01-03T13:04:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.791+0000 7fee2027c700 1 -- 172.21.15.133:0/2329929073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee18147870 con 0x7fee180b0670 2021-01-03T13:04:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.795+0000 7fee2027c700 1 -- 172.21.15.133:0/2329929073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee18146e30 con 0x7fee180b0670 2021-01-03T13:04:52.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.795+0000 7fee177fe700 1 -- 172.21.15.133:0/2329929073 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fee0c024030 con 0x7fee180b0670 2021-01-03T13:04:52.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.795+0000 7fee177fe700 1 --2- 172.21.15.133:0/2329929073 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fedf80554e0 0x7fedf80579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:52.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.795+0000 7fee177fe700 1 -- 172.21.15.133:0/2329929073 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fee0c06f1b0 con 0x7fee180b0670 2021-01-03T13:04:52.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.795+0000 7fee1d817700 1 --2- 172.21.15.133:0/2329929073 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fedf80554e0 0x7fedf80579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:52.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.795+0000 7fee1d817700 1 --2- 172.21.15.133:0/2329929073 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fedf80554e0 0x7fedf80579a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fee0800c000 tx=0x7fee08008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:52.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.799+0000 7fee177fe700 1 -- 172.21.15.133:0/2329929073 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fee0c045480 con 0x7fee180b0670 2021-01-03T13:04:52.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.983+0000 7fee2027c700 1 -- 172.21.15.133:0/2329929073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee18147f50 con 0x7fee180b0670 2021-01-03T13:04:52.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.983+0000 7fee177fe700 1 -- 172.21.15.133:0/2329929073 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2496 (secure 0 0 0) 0x7fee0c022030 con 0x7fee180b0670 2021-01-03T13:04:52.987 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:04:52.987 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/524155035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":524155035},{"type":"v1","addr":"172.21.15.16:6833","nonce":524155035}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":31},{"gid":6175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1381538323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1381538323},{"type":"v1","addr":"172.21.15.133:6835","nonce":1381538323}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:03:59.914082+0000","modified":"2021-01-03T13:04:00.917279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6178},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6178":{"gid":6178,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1189475847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1189475847},{"type":"v1","addr":"172.21.15.133:6837","nonce":1189475847}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-01-03T13:04:52.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.987+0000 7fee2027c700 1 -- 172.21.15.133:0/2329929073 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fedf80554e0 msgr2=0x7fedf80579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.987+0000 7fee2027c700 1 --2- 172.21.15.133:0/2329929073 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fedf80554e0 0x7fedf80579a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fee0800c000 tx=0x7fee08008040).stop 2021-01-03T13:04:52.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.987+0000 7fee2027c700 1 -- 172.21.15.133:0/2329929073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee180b0670 msgr2=0x7fee18156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:52.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.987+0000 7fee2027c700 1 --2- 172.21.15.133:0/2329929073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee180b0670 0x7fee18156bf0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fee0c002f30 tx=0x7fee0c015000).stop 2021-01-03T13:04:52.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.987+0000 7fee2027c700 1 -- 172.21.15.133:0/2329929073 shutdown_connections 2021-01-03T13:04:52.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.987+0000 7fee2027c700 1 --2- 172.21.15.133:0/2329929073 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fedf80554e0 0x7fedf80579a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.987+0000 7fee2027c700 1 --2- 172.21.15.133:0/2329929073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fee1814acc0 0x7fee180ac610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.987+0000 7fee2027c700 1 --2- 172.21.15.133:0/2329929073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee180b0670 0x7fee18156bf0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.987+0000 7fee2027c700 1 --2- 172.21.15.133:0/2329929073 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fee180b5c10 0x7fee181498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:52.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.987+0000 7fee2027c700 1 -- 172.21.15.133:0/2329929073 >> 172.21.15.133:0/2329929073 conn(0x7fee1805c8c0 msgr2=0x7fee1814da90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:52.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.987+0000 7fee2027c700 1 -- 172.21.15.133:0/2329929073 shutdown_connections 2021-01-03T13:04:52.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:52.987+0000 7fee2027c700 1 -- 172.21.15.133:0/2329929073 wait complete. 2021-01-03T13:04:52.993 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 33 2021-01-03T13:04:53.302 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:03:59.914082+0000', 'modified': '2021-01-03T13:04:00.917279+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6178}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6178': {'gid': 6178, 'name': 'c', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/1189475847', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 1189475847}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 1189475847}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:04:53.303 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:04:53.303 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T13:04:53.435 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":6178,"want_state":"up:active","state":"up:active","rank_uptime":53.506366458999999,"mdsmap_epoch":33,"osdmap_epoch":80,"osdmap_epoch_barrier":80,"uptime":58.949091430999999} 2021-01-03T13:04:53.435 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 6178, "mdsmap_epoch": 33, "osdmap_epoch": 80, "osdmap_epoch_barrier": 80, "rank_uptime": 53.506366459, "state": "up:active", "uptime": 58.949091431, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:04:53.436 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:04:53.436 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-01-03T13:04:53.437 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi007.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-01-03T13:04:53.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:53.438 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:53.446 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:04:53.504 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:04:53.505 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:04:53.561 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:04:53.562 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:04:53.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:53.563 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:04:53.611 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:04:53.611 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:53.655 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:04:53.671 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:04:53.672 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:04:53.729 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:04:53.730 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:04:53.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:53.731 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:04:53.733 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2021-01-03T13:04:53.729+0000 7ff24283a0c0 -1 init, newargv = 0x564ff018ae80 newargc=9 2021-01-03T13:04:53.733 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12272]: starting ceph client 2021-01-03T13:04:53.744 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12272]: starting fuse 2021-01-03T13:04:54.838 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:04:54.854 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:04:54.855 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:04:54.915 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:04:54.916 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:04:54.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:54.917 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:04:54.964 INFO:teuthology.orchestra.run.smithi007.stdout:50 2021-01-03T13:04:54.965 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:04:54.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:54.966 DEBUG:teuthology.orchestra.run.smithi007:> sudo python3 -c ' 2021-01-03T13:04:54.966 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2021-01-03T13:04:54.966 DEBUG:teuthology.orchestra.run.smithi007:> import re 2021-01-03T13:04:54.967 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:04:54.967 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2021-01-03T13:04:54.967 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:04:54.968 DEBUG:teuthology.orchestra.run.smithi007:> def find_socket(client_name): 2021-01-03T13:04:54.968 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-01-03T13:04:54.969 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2021-01-03T13:04:54.969 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:04:54.969 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2021-01-03T13:04:54.970 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2021-01-03T13:04:54.970 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2021-01-03T13:04:54.971 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2021-01-03T13:04:54.971 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:04:54.971 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2021-01-03T13:04:54.972 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:04:54.972 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:04:54.972 DEBUG:teuthology.orchestra.run.smithi007:> return f 2021-01-03T13:04:54.973 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:04:54.973 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:04:54.974 DEBUG:teuthology.orchestra.run.smithi007:> print(find_socket("client.0")) 2021-01-03T13:04:54.974 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:04:55.058 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.12272.asok 2021-01-03T13:04:55.062 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12272.asok 2021-01-03T13:04:55.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:55.063 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12272.asok status 2021-01-03T13:04:55.164 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2021-01-03T13:04:55.164 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2021-01-03T13:04:55.164 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:04:55.165 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:04:55.165 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2021-01-03T13:04:55.165 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2021-01-03T13:04:55.165 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-01-03T13:04:55.165 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "12272", 2021-01-03T13:04:55.166 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2021-01-03T13:04:55.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:04:55.166 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2021-01-03T13:04:55.166 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2021-01-03T13:04:55.167 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 6439, 2021-01-03T13:04:55.167 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2021-01-03T13:04:55.167 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2021-01-03T13:04:55.167 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2021-01-03T13:04:55.167 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 6439 2021-01-03T13:04:55.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:04:55.168 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:04:55.168 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:04:55.168 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:04:55.168 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 795481812 2021-01-03T13:04:55.168 INFO:teuthology.orchestra.run.smithi007.stdout: } 2021-01-03T13:04:55.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:04:55.169 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:04:55.169 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:04:55.169 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:04:55.169 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 795481812 2021-01-03T13:04:55.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:04:55.170 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.6439 172.21.15.7:0/795481812", 2021-01-03T13:04:55.170 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "172.21.15.7:0/795481812", 2021-01-03T13:04:55.170 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2021-01-03T13:04:55.170 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 33, 2021-01-03T13:04:55.171 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 80, 2021-01-03T13:04:55.171 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:04:55.171 INFO:teuthology.orchestra.run.smithi007.stdout: "blacklisted": false, 2021-01-03T13:04:55.171 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2021-01-03T13:04:55.171 INFO:teuthology.orchestra.run.smithi007.stdout:} 2021-01-03T13:04:55.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:55.174 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:04:55.175 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:55.182 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:04:55.183 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:04:55.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:55.184 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:55.244 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:04:55.244 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:04:55.302 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:04:55.320 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:04:55.340 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:04:55.361 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:04:55.362 INFO:tasks.cephfs.mount:Terminating background process 2021-01-03T13:04:55.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:55.363 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:04:55.363 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:55.371 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:04:55.373 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:04:55.373 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T13:04:55.373 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:04:55.374 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:55.454 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12272]: fuse finished with error 0 and tester_r 0 2021-01-03T13:04:55.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:55.456 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:04:55.456 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:55.503 INFO:teuthology.orchestra.run.smithi007.stdout:ext2/ext3 2021-01-03T13:04:55.504 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:04:55.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:04:55.526 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:55.576 INFO:tasks.cephfs.mount:Terminating background process 2021-01-03T13:04:55.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:55.578 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:04:55.578 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:04:55.587 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:04:55.588 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:04:55.588 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi036.front.sepia.ceph.com... 2021-01-03T13:04:55.589 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:04:55.589 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:04:55.674 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[11783]: fuse finished with error 0 and tester_r 0 2021-01-03T13:04:55.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:55.677 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:04:55.677 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:04:55.684 INFO:teuthology.orchestra.run.smithi036.stdout:ext2/ext3 2021-01-03T13:04:55.685 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:04:55.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:04:55.804 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:04:55.853 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-01-03T13:04:55.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.971+0000 7f7e93fff700 1 Processor -- start 2021-01-03T13:04:55.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.971+0000 7f7e93fff700 1 -- start start 2021-01-03T13:04:55.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e93fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e940b9f40 0x7f7e94146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:55.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e93fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7e94146920 0x7f7e9414d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:55.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e93fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e940605f0 con 0x7f7e940b9b60 2021-01-03T13:04:55.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e93fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e940aed30 con 0x7f7e94146920 2021-01-03T13:04:55.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e93fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940600b0 con 0x7f7e940b9f40 2021-01-03T13:04:55.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e937fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7e94146920 0x7f7e9414d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:55.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e937fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7e94146920 0x7f7e9414d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36170/0 (socket says 172.21.15.133:36170) 2021-01-03T13:04:55.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e937fe700 1 -- 172.21.15.133:0/668185982 learned_addr learned my addr 172.21.15.133:0/668185982 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:55.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e92ffd700 1 --1- 172.21.15.133:0/668185982 >> v1:172.21.15.16:6789/0 conn(0x7f7e940b9b60 0x7f7e940b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:35926/0 (socket says 172.21.15.133:35926) 2021-01-03T13:04:55.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e927fc700 1 --2- 172.21.15.133:0/668185982 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e940b9f40 0x7f7e94146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:55.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e937fe700 1 -- 172.21.15.133:0/668185982 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e940b9f40 msgr2=0x7f7e94146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:55.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e937fe700 1 --2- 172.21.15.133:0/668185982 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e940b9f40 0x7f7e94146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:55.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e937fe700 1 -- 172.21.15.133:0/668185982 >> v1:172.21.15.16:6789/0 conn(0x7f7e940b9b60 legacy=0x7f7e940b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:55.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e937fe700 1 -- 172.21.15.133:0/668185982 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e94060350 con 0x7f7e94146920 2021-01-03T13:04:55.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e937fe700 1 --2- 172.21.15.133:0/668185982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e94146920 0x7f7e9414d500 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f7e8c0032b0 tx=0x7f7e8c009270).ready entity=mon.1 client_cookie=ea504f3e53c76467 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:55.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e91ffb700 1 -- 172.21.15.133:0/668185982 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e8c009e60 con 0x7f7e94146920 2021-01-03T13:04:55.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e91ffb700 1 -- 172.21.15.133:0/668185982 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c00bc00 con 0x7f7e94146920 2021-01-03T13:04:55.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e91ffb700 1 -- 172.21.15.133:0/668185982 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e8c00bd70 con 0x7f7e94146920 2021-01-03T13:04:55.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e93fff700 1 -- 172.21.15.133:0/668185982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e94146920 msgr2=0x7f7e9414d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:55.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e93fff700 1 --2- 172.21.15.133:0/668185982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e94146920 0x7f7e9414d500 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f7e8c0032b0 tx=0x7f7e8c009270).stop 2021-01-03T13:04:55.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e93fff700 1 -- 172.21.15.133:0/668185982 shutdown_connections 2021-01-03T13:04:55.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e93fff700 1 --2- 172.21.15.133:0/668185982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e94146920 0x7f7e9414d500 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:55.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e93fff700 1 --2- 172.21.15.133:0/668185982 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e940b9f40 0x7f7e94146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:55.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e93fff700 1 -- 172.21.15.133:0/668185982 >> 172.21.15.133:0/668185982 conn(0x7f7e940b69e0 msgr2=0x7f7e940b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:55.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e93fff700 1 -- 172.21.15.133:0/668185982 shutdown_connections 2021-01-03T13:04:55.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.975+0000 7f7e93fff700 1 -- 172.21.15.133:0/668185982 wait complete. 2021-01-03T13:04:55.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e93fff700 1 Processor -- start 2021-01-03T13:04:55.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e93fff700 1 -- start start 2021-01-03T13:04:55.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e93fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e940b9b60 0x7f7e940b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:55.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e93fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e940b9f40 0x7f7e940b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:55.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e93fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e94146920 0x7f7e940b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:55.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e93fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940b3630 con 0x7f7e940b9f40 2021-01-03T13:04:55.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e93fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e94140df0 con 0x7f7e94146920 2021-01-03T13:04:55.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e93fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e94152150 con 0x7f7e940b9b60 2021-01-03T13:04:55.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e937fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e94146920 0x7f7e940b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:55.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e927fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e940b9f40 0x7f7e940b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:55.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e937fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e94146920 0x7f7e940b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36176/0 (socket says 172.21.15.133:36176) 2021-01-03T13:04:55.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e927fc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e940b9f40 0x7f7e940b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:34714/0 (socket says 172.21.15.133:34714) 2021-01-03T13:04:55.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e937fe700 1 -- 172.21.15.133:0/842770269 learned_addr learned my addr 172.21.15.133:0/842770269 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:55.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e92ffd700 1 --2- 172.21.15.133:0/842770269 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e940b9b60 0x7f7e940b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:55.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e937fe700 1 -- 172.21.15.133:0/842770269 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e940b9b60 msgr2=0x7f7e940b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:55.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e937fe700 1 --2- 172.21.15.133:0/842770269 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e940b9b60 0x7f7e940b1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:55.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e937fe700 1 -- 172.21.15.133:0/842770269 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e940b9f40 msgr2=0x7f7e940b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:55.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e937fe700 1 --2- 172.21.15.133:0/842770269 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e940b9f40 0x7f7e940b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:55.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e937fe700 1 -- 172.21.15.133:0/842770269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e940b2270 con 0x7f7e94146920 2021-01-03T13:04:55.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e937fe700 1 --2- 172.21.15.133:0/842770269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e94146920 0x7f7e940b3140 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f7e94140c20 tx=0x7f7e8c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:55.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e83fff700 1 -- 172.21.15.133:0/842770269 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e8c01f3f0 con 0x7f7e94146920 2021-01-03T13:04:55.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e83fff700 1 -- 172.21.15.133:0/842770269 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c01f550 con 0x7f7e94146920 2021-01-03T13:04:55.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e93fff700 1 -- 172.21.15.133:0/842770269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e940b2510 con 0x7f7e94146920 2021-01-03T13:04:55.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e83fff700 1 -- 172.21.15.133:0/842770269 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e8c01f8b0 con 0x7f7e94146920 2021-01-03T13:04:55.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.979+0000 7f7e93fff700 1 -- 172.21.15.133:0/842770269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e94151dd0 con 0x7f7e94146920 2021-01-03T13:04:55.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.983+0000 7f7e93fff700 1 -- 172.21.15.133:0/842770269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e94057300 con 0x7f7e94146920 2021-01-03T13:04:55.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.983+0000 7f7e83fff700 1 -- 172.21.15.133:0/842770269 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7e8c026030 con 0x7f7e94146920 2021-01-03T13:04:55.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.983+0000 7f7e83fff700 1 --2- 172.21.15.133:0/842770269 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e70055330 0x7f7e700577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:55.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.983+0000 7f7e83fff700 1 -- 172.21.15.133:0/842770269 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f7e8c06ea20 con 0x7f7e94146920 2021-01-03T13:04:55.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.983+0000 7f7e92ffd700 1 --2- 172.21.15.133:0/842770269 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e70055330 0x7f7e700577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:55.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.983+0000 7f7e92ffd700 1 --2- 172.21.15.133:0/842770269 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e70055330 0x7f7e700577f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f7e8400d000 tx=0x7f7e84007b50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:55.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:55.995+0000 7f7e83fff700 1 -- 172.21.15.133:0/842770269 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7e8c044cf0 con 0x7f7e94146920 2021-01-03T13:04:56.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.135+0000 7f7e93fff700 1 -- 172.21.15.133:0/842770269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7e94146130 con 0x7f7e94146920 2021-01-03T13:04:56.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.143+0000 7f7e83fff700 1 -- 172.21.15.133:0/842770269 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7e8c048310 con 0x7f7e94146920 2021-01-03T13:04:56.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.147+0000 7f7e93fff700 1 -- 172.21.15.133:0/842770269 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e70055330 msgr2=0x7f7e700577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:56.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.147+0000 7f7e93fff700 1 --2- 172.21.15.133:0/842770269 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e70055330 0x7f7e700577f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f7e8400d000 tx=0x7f7e84007b50).stop 2021-01-03T13:04:56.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.147+0000 7f7e93fff700 1 -- 172.21.15.133:0/842770269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e94146920 msgr2=0x7f7e940b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:56.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.147+0000 7f7e93fff700 1 --2- 172.21.15.133:0/842770269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e94146920 0x7f7e940b3140 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f7e94140c20 tx=0x7f7e8c016000).stop 2021-01-03T13:04:56.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.147+0000 7f7e93fff700 1 -- 172.21.15.133:0/842770269 shutdown_connections 2021-01-03T13:04:56.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.147+0000 7f7e93fff700 1 --2- 172.21.15.133:0/842770269 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e70055330 0x7f7e700577f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:56.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.147+0000 7f7e93fff700 1 --2- 172.21.15.133:0/842770269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e94146920 0x7f7e940b3140 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:56.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.147+0000 7f7e93fff700 1 --2- 172.21.15.133:0/842770269 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e940b9b60 0x7f7e940b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:56.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.147+0000 7f7e93fff700 1 --2- 172.21.15.133:0/842770269 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e940b9f40 0x7f7e940b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:56.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.147+0000 7f7e93fff700 1 -- 172.21.15.133:0/842770269 >> 172.21.15.133:0/842770269 conn(0x7f7e940b69e0 msgr2=0x7f7e9405bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:56.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.147+0000 7f7e93fff700 1 -- 172.21.15.133:0/842770269 shutdown_connections 2021-01-03T13:04:56.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.147+0000 7f7e93fff700 1 -- 172.21.15.133:0/842770269 wait complete. 2021-01-03T13:04:56.166 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2021-01-03T13:04:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a9264700 1 Processor -- start 2021-01-03T13:04:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a9264700 1 -- start start 2021-01-03T13:04:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a9264700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc2a40b27e0 0x7fc2a40b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a9264700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc2a40ac1f0 0x7fc2a4149750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a9264700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a40af920 con 0x7fc2a40b2400 2021-01-03T13:04:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a9264700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a40ae7b0 con 0x7fc2a40b27e0 2021-01-03T13:04:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a9264700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a40b1ed0 con 0x7fc2a40ac1f0 2021-01-03T13:04:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc2a40b2400 0x7fc2a40b0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57212/0 (socket says 172.21.15.133:57212) 2021-01-03T13:04:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a3fff700 1 -- 172.21.15.133:0/3645699599 learned_addr learned my addr 172.21.15.133:0/3645699599 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a8a63700 1 --2- 172.21.15.133:0/3645699599 >> v2:172.21.15.133:3300/0 conn(0x7fc2a40ac1f0 0x7fc2a4149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a37fe700 1 --2- 172.21.15.133:0/3645699599 >> v2:172.21.15.16:3300/0 conn(0x7fc2a40b27e0 0x7fc2a40b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a2ffd700 1 -- 172.21.15.133:0/3645699599 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830382961 0 0) 0x7fc2a40af920 con 0x7fc2a40b2400 2021-01-03T13:04:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a2ffd700 1 -- 172.21.15.133:0/3645699599 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc290003230 con 0x7fc2a40b2400 2021-01-03T13:04:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a8a63700 1 -- 172.21.15.133:0/3645699599 >> v2:172.21.15.16:3300/0 conn(0x7fc2a40b27e0 msgr2=0x7fc2a40b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a8a63700 1 --2- 172.21.15.133:0/3645699599 >> v2:172.21.15.16:3300/0 conn(0x7fc2a40b27e0 0x7fc2a40b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a2ffd700 1 -- 172.21.15.133:0/3645699599 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1375478408 0 0) 0x7fc290003230 con 0x7fc2a40b2400 2021-01-03T13:04:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a8a63700 1 -- 172.21.15.133:0/3645699599 >> v1:172.21.15.133:6789/0 conn(0x7fc2a40b2400 legacy=0x7fc2a40b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a8a63700 1 -- 172.21.15.133:0/3645699599 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a40afbc0 con 0x7fc2a40ac1f0 2021-01-03T13:04:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a8a63700 1 --2- 172.21.15.133:0/3645699599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a40ac1f0 0x7fc2a4149750 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fc294001870 tx=0x7fc29c0091a0).ready entity=mon.1 client_cookie=42e2f3eef86f1b4b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a2ffd700 1 -- 172.21.15.133:0/3645699599 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2940016d0 con 0x7fc2a40ac1f0 2021-01-03T13:04:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a2ffd700 1 -- 172.21.15.133:0/3645699599 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c00b800 con 0x7fc2a40ac1f0 2021-01-03T13:04:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a2ffd700 1 -- 172.21.15.133:0/3645699599 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc29c00b970 con 0x7fc2a40ac1f0 2021-01-03T13:04:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a9264700 1 -- 172.21.15.133:0/3645699599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a40ac1f0 msgr2=0x7fc2a4149750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:56.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.275+0000 7fc2a9264700 1 --2- 172.21.15.133:0/3645699599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a40ac1f0 0x7fc2a4149750 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fc294001870 tx=0x7fc29c0091a0).stop 2021-01-03T13:04:56.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a9264700 1 -- 172.21.15.133:0/3645699599 shutdown_connections 2021-01-03T13:04:56.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a9264700 1 --2- 172.21.15.133:0/3645699599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a40ac1f0 0x7fc2a4149750 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:56.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a9264700 1 --2- 172.21.15.133:0/3645699599 >> v2:172.21.15.16:3300/0 conn(0x7fc2a40b27e0 0x7fc2a40b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:56.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a9264700 1 -- 172.21.15.133:0/3645699599 >> 172.21.15.133:0/3645699599 conn(0x7fc2a406b050 msgr2=0x7fc2a4060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:56.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a9264700 1 -- 172.21.15.133:0/3645699599 shutdown_connections 2021-01-03T13:04:56.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a9264700 1 -- 172.21.15.133:0/3645699599 wait complete. 2021-01-03T13:04:56.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a9264700 1 Processor -- start 2021-01-03T13:04:56.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a9264700 1 -- start start 2021-01-03T13:04:56.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a9264700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2a40ac1f0 0x7fc2a40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:56.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a9264700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2a40b2400 0x7fc2a413eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:56.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a9264700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a40b27e0 0x7fc2a40b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:56.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a9264700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a4143a90 con 0x7fc2a40ac1f0 2021-01-03T13:04:56.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a9264700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a4144260 con 0x7fc2a40b27e0 2021-01-03T13:04:56.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a9264700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a4144500 con 0x7fc2a40b2400 2021-01-03T13:04:56.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a8a63700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a40b27e0 0x7fc2a40b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:56.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a8a63700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a40b27e0 0x7fc2a40b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36190/0 (socket says 172.21.15.133:36190) 2021-01-03T13:04:56.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a8a63700 1 -- 172.21.15.133:0/3425379243 learned_addr learned my addr 172.21.15.133:0/3425379243 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:56.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a3fff700 1 --2- 172.21.15.133:0/3425379243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2a40ac1f0 0x7fc2a40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:56.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a37fe700 1 --2- 172.21.15.133:0/3425379243 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2a40b2400 0x7fc2a413eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:56.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a8a63700 1 -- 172.21.15.133:0/3425379243 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2a40b2400 msgr2=0x7fc2a413eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:56.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a8a63700 1 --2- 172.21.15.133:0/3425379243 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2a40b2400 0x7fc2a413eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:56.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a8a63700 1 -- 172.21.15.133:0/3425379243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2a40ac1f0 msgr2=0x7fc2a40b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:56.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a8a63700 1 --2- 172.21.15.133:0/3425379243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2a40ac1f0 0x7fc2a40b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:56.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a8a63700 1 -- 172.21.15.133:0/3425379243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a4141450 con 0x7fc2a40b27e0 2021-01-03T13:04:56.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a8a63700 1 --2- 172.21.15.133:0/3425379243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a40b27e0 0x7fc2a40b4c70 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fc294001870 tx=0x7fc29c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:56.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a17fa700 1 -- 172.21.15.133:0/3425379243 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc29c0119e0 con 0x7fc2a40b27e0 2021-01-03T13:04:56.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a17fa700 1 -- 172.21.15.133:0/3425379243 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c011b40 con 0x7fc2a40b27e0 2021-01-03T13:04:56.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a9264700 1 -- 172.21.15.133:0/3425379243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a41411a0 con 0x7fc2a40b27e0 2021-01-03T13:04:56.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a17fa700 1 -- 172.21.15.133:0/3425379243 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc29c011ea0 con 0x7fc2a40b27e0 2021-01-03T13:04:56.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.279+0000 7fc2a9264700 1 -- 172.21.15.133:0/3425379243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a41418f0 con 0x7fc2a40b27e0 2021-01-03T13:04:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.283+0000 7fc2a9264700 1 -- 172.21.15.133:0/3425379243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a4057300 con 0x7fc2a40b27e0 2021-01-03T13:04:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.283+0000 7fc2a17fa700 1 -- 172.21.15.133:0/3425379243 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc29c026030 con 0x7fc2a40b27e0 2021-01-03T13:04:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.283+0000 7fc2a17fa700 1 --2- 172.21.15.133:0/3425379243 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc284055350 0x7fc284057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.283+0000 7fc2a17fa700 1 -- 172.21.15.133:0/3425379243 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fc29c06e750 con 0x7fc2a40b27e0 2021-01-03T13:04:56.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.283+0000 7fc2a3fff700 1 --2- 172.21.15.133:0/3425379243 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc284055350 0x7fc284057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:56.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.283+0000 7fc2a3fff700 1 --2- 172.21.15.133:0/3425379243 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc284055350 0x7fc284057810 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fc29400d000 tx=0x7fc294000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:56.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.291+0000 7fc2a17fa700 1 -- 172.21.15.133:0/3425379243 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc29c0449c0 con 0x7fc2a40b27e0 2021-01-03T13:04:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:56.479+0000 7fc2a9264700 1 -- 172.21.15.133:0/3425379243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7fc2a405f080 con 0x7fc2a40b27e0 2021-01-03T13:04:57.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.390+0000 7fc2a17fa700 1 -- 172.21.15.133:0/3425379243 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v299) v1 ==== 139+0+0 (secure 0 0 0) 0x7fc29c0150d0 con 0x7fc2a40b27e0 2021-01-03T13:04:57.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.394+0000 7fc2a9264700 1 -- 172.21.15.133:0/3425379243 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc284055350 msgr2=0x7fc284057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:57.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.394+0000 7fc2a9264700 1 --2- 172.21.15.133:0/3425379243 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc284055350 0x7fc284057810 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fc29400d000 tx=0x7fc294000b80).stop 2021-01-03T13:04:57.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.394+0000 7fc2a9264700 1 -- 172.21.15.133:0/3425379243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a40b27e0 msgr2=0x7fc2a40b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:57.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.394+0000 7fc2a9264700 1 --2- 172.21.15.133:0/3425379243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a40b27e0 0x7fc2a40b4c70 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fc294001870 tx=0x7fc29c016000).stop 2021-01-03T13:04:57.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.394+0000 7fc2a9264700 1 -- 172.21.15.133:0/3425379243 shutdown_connections 2021-01-03T13:04:57.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.394+0000 7fc2a9264700 1 --2- 172.21.15.133:0/3425379243 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc284055350 0x7fc284057810 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:57.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.394+0000 7fc2a9264700 1 --2- 172.21.15.133:0/3425379243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc2a40ac1f0 0x7fc2a40b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:57.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.394+0000 7fc2a9264700 1 --2- 172.21.15.133:0/3425379243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a40b27e0 0x7fc2a40b4c70 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:57.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.394+0000 7fc2a9264700 1 --2- 172.21.15.133:0/3425379243 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2a40b2400 0x7fc2a413eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:57.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.394+0000 7fc2a9264700 1 -- 172.21.15.133:0/3425379243 >> 172.21.15.133:0/3425379243 conn(0x7fc2a406b050 msgr2=0x7fc2a40adbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:57.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.394+0000 7fc2a9264700 1 -- 172.21.15.133:0/3425379243 shutdown_connections 2021-01-03T13:04:57.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.394+0000 7fc2a9264700 1 -- 172.21.15.133:0/3425379243 wait complete. 2021-01-03T13:04:57.418 INFO:tasks.cephfs_test_runner:test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) ... ok 2021-01-03T13:04:57.418 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode (tasks.cephfs.test_misc.TestMisc) 2021-01-03T13:04:57.419 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-01-03T13:04:57.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.534+0000 7f991620a700 1 Processor -- start 2021-01-03T13:04:57.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.534+0000 7f991620a700 1 -- start start 2021-01-03T13:04:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.534+0000 7f991620a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99100b9b60 0x7f99100b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:57.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.534+0000 7f991620a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f99100b4de0 0x7f9910146b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.534+0000 7f991620a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9910147030 con 0x7f99100b4980 2021-01-03T13:04:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.534+0000 7f991620a700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99100aed30 con 0x7f99100b4de0 2021-01-03T13:04:57.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.534+0000 7f991620a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99100605f0 con 0x7f99100b9b60 2021-01-03T13:04:57.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.534+0000 7f9915a09700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f99100b4de0 0x7f9910146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:57.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.534+0000 7f9915a09700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f99100b4de0 0x7f9910146b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:34734/0 (socket says 172.21.15.133:34734) 2021-01-03T13:04:57.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.534+0000 7f9914a07700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f99100b4980 0x7f9910146430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:35954/0 (socket says 172.21.15.133:35954) 2021-01-03T13:04:57.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.534+0000 7f9915a09700 1 -- 172.21.15.133:0/2526411888 learned_addr learned my addr 172.21.15.133:0/2526411888 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.534+0000 7f9915208700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99100b9b60 0x7f99100b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.534+0000 7f9915a09700 1 -- 172.21.15.133:0/2526411888 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99100b9b60 msgr2=0x7f99100b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.534+0000 7f9915a09700 1 --2- 172.21.15.133:0/2526411888 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99100b9b60 0x7f99100b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:57.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.534+0000 7f9915a09700 1 -- 172.21.15.133:0/2526411888 >> v1:172.21.15.16:6789/0 conn(0x7f99100b4980 legacy=0x7f9910146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.534+0000 7f9915a09700 1 -- 172.21.15.133:0/2526411888 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99100600b0 con 0x7f99100b4de0 2021-01-03T13:04:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.538+0000 7f9915a09700 1 --2- 172.21.15.133:0/2526411888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99100b4de0 0x7f9910146b40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f99080032b0 tx=0x7f9908009270).ready entity=mon.0 client_cookie=3fc947f170002509 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.538+0000 7f9903fff700 1 -- 172.21.15.133:0/2526411888 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9908009e60 con 0x7f99100b4de0 2021-01-03T13:04:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.538+0000 7f9903fff700 1 -- 172.21.15.133:0/2526411888 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990800bc00 con 0x7f99100b4de0 2021-01-03T13:04:57.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.538+0000 7f9903fff700 1 -- 172.21.15.133:0/2526411888 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f990800bd70 con 0x7f99100b4de0 2021-01-03T13:04:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.538+0000 7f991620a700 1 -- 172.21.15.133:0/2526411888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99100b4de0 msgr2=0x7f9910146b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.538+0000 7f991620a700 1 --2- 172.21.15.133:0/2526411888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99100b4de0 0x7f9910146b40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f99080032b0 tx=0x7f9908009270).stop 2021-01-03T13:04:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.538+0000 7f991620a700 1 -- 172.21.15.133:0/2526411888 shutdown_connections 2021-01-03T13:04:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.538+0000 7f991620a700 1 --2- 172.21.15.133:0/2526411888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99100b4de0 0x7f9910146b40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.538+0000 7f991620a700 1 --2- 172.21.15.133:0/2526411888 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99100b9b60 0x7f99100b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:57.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.538+0000 7f991620a700 1 -- 172.21.15.133:0/2526411888 >> 172.21.15.133:0/2526411888 conn(0x7f99100b69e0 msgr2=0x7f99100b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:57.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.538+0000 7f991620a700 1 -- 172.21.15.133:0/2526411888 shutdown_connections 2021-01-03T13:04:57.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.538+0000 7f991620a700 1 -- 172.21.15.133:0/2526411888 wait complete. 2021-01-03T13:04:57.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.538+0000 7f991620a700 1 Processor -- start 2021-01-03T13:04:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.538+0000 7f991620a700 1 -- start start 2021-01-03T13:04:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f991620a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99100b4980 0x7f9910155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f991620a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99100b4de0 0x7f9910155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:57.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f991620a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99100b9b60 0x7f9910151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:57.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f991620a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9910141450 con 0x7f99100b4980 2021-01-03T13:04:57.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f991620a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9910156210 con 0x7f99100b9b60 2021-01-03T13:04:57.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f991620a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9910155db0 con 0x7f99100b4de0 2021-01-03T13:04:57.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f9915a09700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99100b9b60 0x7f9910151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:57.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f9915a09700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99100b9b60 0x7f9910151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36204/0 (socket says 172.21.15.133:36204) 2021-01-03T13:04:57.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f9915a09700 1 -- 172.21.15.133:0/149224778 learned_addr learned my addr 172.21.15.133:0/149224778 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:57.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f9914a07700 1 --2- 172.21.15.133:0/149224778 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99100b4de0 0x7f9910155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:57.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f9915208700 1 --2- 172.21.15.133:0/149224778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99100b4980 0x7f9910155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:57.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f9915a09700 1 -- 172.21.15.133:0/149224778 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99100b4de0 msgr2=0x7f9910155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:57.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f9915a09700 1 --2- 172.21.15.133:0/149224778 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99100b4de0 0x7f9910155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:57.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f9915a09700 1 -- 172.21.15.133:0/149224778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99100b4980 msgr2=0x7f9910155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:57.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f9915a09700 1 --2- 172.21.15.133:0/149224778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99100b4980 0x7f9910155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:57.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f9915a09700 1 -- 172.21.15.133:0/149224778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9910141dd0 con 0x7f99100b9b60 2021-01-03T13:04:57.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f9915a09700 1 --2- 172.21.15.133:0/149224778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99100b9b60 0x7f9910151ce0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f99100b0de0 tx=0x7f9908016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:57.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f99027fc700 1 -- 172.21.15.133:0/149224778 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f990801e610 con 0x7f99100b9b60 2021-01-03T13:04:57.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f99027fc700 1 -- 172.21.15.133:0/149224778 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990801e770 con 0x7f99100b9b60 2021-01-03T13:04:57.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f991620a700 1 -- 172.21.15.133:0/149224778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9910141680 con 0x7f99100b9b60 2021-01-03T13:04:57.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f99027fc700 1 -- 172.21.15.133:0/149224778 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f990801ead0 con 0x7f99100b9b60 2021-01-03T13:04:57.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f991620a700 1 -- 172.21.15.133:0/149224778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991009f1e0 con 0x7f99100b9b60 2021-01-03T13:04:57.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f991620a700 1 -- 172.21.15.133:0/149224778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9910155f20 con 0x7f99100b9b60 2021-01-03T13:04:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.542+0000 7f99027fc700 1 -- 172.21.15.133:0/149224778 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f990800f070 con 0x7f99100b9b60 2021-01-03T13:04:57.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.546+0000 7f99027fc700 1 --2- 172.21.15.133:0/149224778 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98f8055440 0x7f98f8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.546+0000 7f99027fc700 1 -- 172.21.15.133:0/149224778 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f990806f820 con 0x7f99100b9b60 2021-01-03T13:04:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.546+0000 7f9915208700 1 --2- 172.21.15.133:0/149224778 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98f8055440 0x7f98f8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.546+0000 7f9915208700 1 --2- 172.21.15.133:0/149224778 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98f8055440 0x7f98f8057900 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f990c00b000 tx=0x7f990c006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:57.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.550+0000 7f99027fc700 1 -- 172.21.15.133:0/149224778 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f99080459e0 con 0x7f99100b9b60 2021-01-03T13:04:57.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:57.738+0000 7f991620a700 1 -- 172.21.15.133:0/149224778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f9910057300 con 0x7f99100b9b60 2021-01-03T13:04:58.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.394+0000 7f99027fc700 1 -- 172.21.15.133:0/149224778 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v300) v1 ==== 129+0+0 (secure 0 0 0) 0x7f9908049000 con 0x7f99100b9b60 2021-01-03T13:04:58.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.398+0000 7f991620a700 1 -- 172.21.15.133:0/149224778 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98f8055440 msgr2=0x7f98f8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:58.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.398+0000 7f991620a700 1 --2- 172.21.15.133:0/149224778 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98f8055440 0x7f98f8057900 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f990c00b000 tx=0x7f990c006dc0).stop 2021-01-03T13:04:58.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.398+0000 7f991620a700 1 -- 172.21.15.133:0/149224778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99100b9b60 msgr2=0x7f9910151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:58.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.398+0000 7f991620a700 1 --2- 172.21.15.133:0/149224778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99100b9b60 0x7f9910151ce0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f99100b0de0 tx=0x7f9908016000).stop 2021-01-03T13:04:58.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.398+0000 7f991620a700 1 -- 172.21.15.133:0/149224778 shutdown_connections 2021-01-03T13:04:58.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.398+0000 7f991620a700 1 --2- 172.21.15.133:0/149224778 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98f8055440 0x7f98f8057900 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.398+0000 7f991620a700 1 --2- 172.21.15.133:0/149224778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f99100b4980 0x7f9910155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.398+0000 7f991620a700 1 --2- 172.21.15.133:0/149224778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99100b9b60 0x7f9910151ce0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.398+0000 7f991620a700 1 --2- 172.21.15.133:0/149224778 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f99100b4de0 0x7f9910155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.398+0000 7f991620a700 1 -- 172.21.15.133:0/149224778 >> 172.21.15.133:0/149224778 conn(0x7f99100b69e0 msgr2=0x7f991005c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.398+0000 7f991620a700 1 -- 172.21.15.133:0/149224778 shutdown_connections 2021-01-03T13:04:58.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.398+0000 7f991620a700 1 -- 172.21.15.133:0/149224778 wait complete. 2021-01-03T13:04:58.418 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-01-03T13:04:58.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f573e377700 1 Processor -- start 2021-01-03T13:04:58.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f573e377700 1 -- start start 2021-01-03T13:04:58.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f573e377700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573805c840 0x7f5738140c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:58.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f573e377700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57380b1b50 0x7f5738141100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:58.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f573e377700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f57380b27a0 0x7f573813ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:58.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f573e377700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573805cc20 con 0x7f57380b27a0 2021-01-03T13:04:58.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f573e377700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57380ab220 con 0x7f57380b1b50 2021-01-03T13:04:58.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f573e377700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5738144360 con 0x7f573805c840 2021-01-03T13:04:58.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f57377fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57380b1b50 0x7f5738141100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:58.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f57377fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57380b1b50 0x7f5738141100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36210/0 (socket says 172.21.15.133:36210) 2021-01-03T13:04:58.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f57377fe700 1 -- 172.21.15.133:0/1584778409 learned_addr learned my addr 172.21.15.133:0/1584778409 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:58.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f573c914700 1 --2- 172.21.15.133:0/1584778409 >> v2:172.21.15.16:3300/0 conn(0x7f57380b27a0 0x7f573813ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:58.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f5737fff700 1 --2- 172.21.15.133:0/1584778409 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573805c840 0x7f5738140c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:58.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f57377fe700 1 -- 172.21.15.133:0/1584778409 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573805c840 msgr2=0x7f5738140c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:58.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f57377fe700 1 --2- 172.21.15.133:0/1584778409 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573805c840 0x7f5738140c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f57377fe700 1 -- 172.21.15.133:0/1584778409 >> v2:172.21.15.16:3300/0 conn(0x7f57380b27a0 msgr2=0x7f573813ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:58.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f57377fe700 1 --2- 172.21.15.133:0/1584778409 >> v2:172.21.15.16:3300/0 conn(0x7f57380b27a0 0x7f573813ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f57377fe700 1 -- 172.21.15.133:0/1584778409 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5738144600 con 0x7f57380b1b50 2021-01-03T13:04:58.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f573c914700 1 --2- 172.21.15.133:0/1584778409 >> v2:172.21.15.16:3300/0 conn(0x7f57380b27a0 0x7f573813ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:04:58.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.534+0000 7f57377fe700 1 --2- 172.21.15.133:0/1584778409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57380b1b50 0x7f5738141100 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f5728002f30 tx=0x7f5728006e80).ready entity=mon.1 client_cookie=acdc5cec3b425eb8 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:58.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.538+0000 7f5736ffd700 1 -- 172.21.15.133:0/1584778409 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5728009640 con 0x7f57380b1b50 2021-01-03T13:04:58.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.538+0000 7f5736ffd700 1 -- 172.21.15.133:0/1584778409 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57280097a0 con 0x7f57380b1b50 2021-01-03T13:04:58.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.538+0000 7f5736ffd700 1 -- 172.21.15.133:0/1584778409 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5728009b00 con 0x7f57380b1b50 2021-01-03T13:04:58.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.538+0000 7f573e377700 1 -- 172.21.15.133:0/1584778409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57380b1b50 msgr2=0x7f5738141100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:58.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.538+0000 7f573e377700 1 --2- 172.21.15.133:0/1584778409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57380b1b50 0x7f5738141100 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f5728002f30 tx=0x7f5728006e80).stop 2021-01-03T13:04:58.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.538+0000 7f573e377700 1 -- 172.21.15.133:0/1584778409 shutdown_connections 2021-01-03T13:04:58.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.538+0000 7f573e377700 1 --2- 172.21.15.133:0/1584778409 >> v2:172.21.15.16:3300/0 conn(0x7f57380b27a0 0x7f573813ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.538+0000 7f573e377700 1 --2- 172.21.15.133:0/1584778409 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573805c840 0x7f5738140c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.538+0000 7f573e377700 1 --2- 172.21.15.133:0/1584778409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57380b1b50 0x7f5738141100 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.538+0000 7f573e377700 1 -- 172.21.15.133:0/1584778409 >> 172.21.15.133:0/1584778409 conn(0x7f573806aeb0 msgr2=0x7f573805bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:58.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.538+0000 7f573e377700 1 -- 172.21.15.133:0/1584778409 shutdown_connections 2021-01-03T13:04:58.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.538+0000 7f573e377700 1 -- 172.21.15.133:0/1584778409 wait complete. 2021-01-03T13:04:58.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.538+0000 7f573e377700 1 Processor -- start 2021-01-03T13:04:58.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.538+0000 7f573e377700 1 -- start start 2021-01-03T13:04:58.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.538+0000 7f573e377700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573805c840 0x7f573813cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:58.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f573e377700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57380b1b50 0x7f5738153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:58.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f573e377700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57380b27a0 0x7f5738153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:58.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f573e377700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5738141f60 con 0x7f57380b27a0 2021-01-03T13:04:58.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f573e377700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5738067510 con 0x7f57380b1b50 2021-01-03T13:04:58.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f573e377700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5738067270 con 0x7f573805c840 2021-01-03T13:04:58.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f57377fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57380b1b50 0x7f5738153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:58.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f57377fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57380b1b50 0x7f5738153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36216/0 (socket says 172.21.15.133:36216) 2021-01-03T13:04:58.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f57377fe700 1 -- 172.21.15.133:0/2738215823 learned_addr learned my addr 172.21.15.133:0/2738215823 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:58.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f573c914700 1 --2- 172.21.15.133:0/2738215823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57380b27a0 0x7f5738153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:58.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f5737fff700 1 --2- 172.21.15.133:0/2738215823 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573805c840 0x7f573813cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:58.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f57377fe700 1 -- 172.21.15.133:0/2738215823 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573805c840 msgr2=0x7f573813cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:58.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f57377fe700 1 --2- 172.21.15.133:0/2738215823 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573805c840 0x7f573813cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f57377fe700 1 -- 172.21.15.133:0/2738215823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57380b27a0 msgr2=0x7f5738153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f57377fe700 1 --2- 172.21.15.133:0/2738215823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57380b27a0 0x7f5738153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f57377fe700 1 -- 172.21.15.133:0/2738215823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5738067ab0 con 0x7f57380b1b50 2021-01-03T13:04:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f57377fe700 1 --2- 172.21.15.133:0/2738215823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57380b1b50 0x7f5738153010 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f5728002f30 tx=0x7f5728015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f57357fa700 1 -- 172.21.15.133:0/2738215823 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5728011a20 con 0x7f57380b1b50 2021-01-03T13:04:58.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f57357fa700 1 -- 172.21.15.133:0/2738215823 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5728011b80 con 0x7f57380b1b50 2021-01-03T13:04:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f57357fa700 1 -- 172.21.15.133:0/2738215823 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f572801d450 con 0x7f57380b1b50 2021-01-03T13:04:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f573e377700 1 -- 172.21.15.133:0/2738215823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5738067d50 con 0x7f57380b1b50 2021-01-03T13:04:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f573e377700 1 -- 172.21.15.133:0/2738215823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5738066e40 con 0x7f57380b1b50 2021-01-03T13:04:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.542+0000 7f573e377700 1 -- 172.21.15.133:0/2738215823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5738067ee0 con 0x7f57380b1b50 2021-01-03T13:04:58.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.546+0000 7f57357fa700 1 -- 172.21.15.133:0/2738215823 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f572800f070 con 0x7f57380b1b50 2021-01-03T13:04:58.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.546+0000 7f57357fa700 1 --2- 172.21.15.133:0/2738215823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5710055470 0x7f5710057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:58.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.546+0000 7f57357fa700 1 -- 172.21.15.133:0/2738215823 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f572806f520 con 0x7f57380b1b50 2021-01-03T13:04:58.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.546+0000 7f5737fff700 1 --2- 172.21.15.133:0/2738215823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5710055470 0x7f5710057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:58.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.546+0000 7f5737fff700 1 --2- 172.21.15.133:0/2738215823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5710055470 0x7f5710057930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f572000b000 tx=0x7f57200091a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:58.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.550+0000 7f57357fa700 1 -- 172.21.15.133:0/2738215823 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f57280458e0 con 0x7f57380b1b50 2021-01-03T13:04:58.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.694+0000 7f573e377700 1 -- 172.21.15.133:0/2738215823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7f5738057300 con 0x7f57380b1b50 2021-01-03T13:04:58.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.702+0000 7f57357fa700 1 -- 172.21.15.133:0/2738215823 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5728048ec0 con 0x7f57380b1b50 2021-01-03T13:04:58.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.706+0000 7f573e377700 1 -- 172.21.15.133:0/2738215823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5710055470 msgr2=0x7f5710057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:58.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.706+0000 7f573e377700 1 --2- 172.21.15.133:0/2738215823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5710055470 0x7f5710057930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f572000b000 tx=0x7f57200091a0).stop 2021-01-03T13:04:58.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.706+0000 7f573e377700 1 -- 172.21.15.133:0/2738215823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57380b1b50 msgr2=0x7f5738153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:58.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.706+0000 7f573e377700 1 --2- 172.21.15.133:0/2738215823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57380b1b50 0x7f5738153010 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f5728002f30 tx=0x7f5728015000).stop 2021-01-03T13:04:58.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.706+0000 7f573e377700 1 -- 172.21.15.133:0/2738215823 shutdown_connections 2021-01-03T13:04:58.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.706+0000 7f573e377700 1 --2- 172.21.15.133:0/2738215823 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5710055470 0x7f5710057930 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.706+0000 7f573e377700 1 --2- 172.21.15.133:0/2738215823 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f57380b27a0 0x7f5738153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.706+0000 7f573e377700 1 --2- 172.21.15.133:0/2738215823 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573805c840 0x7f573813cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.706+0000 7f573e377700 1 --2- 172.21.15.133:0/2738215823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57380b1b50 0x7f5738153010 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.706+0000 7f573e377700 1 -- 172.21.15.133:0/2738215823 >> 172.21.15.133:0/2738215823 conn(0x7f573806aeb0 msgr2=0x7f57380b0320 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:58.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.706+0000 7f573e377700 1 -- 172.21.15.133:0/2738215823 shutdown_connections 2021-01-03T13:04:58.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.706+0000 7f573e377700 1 -- 172.21.15.133:0/2738215823 wait complete. 2021-01-03T13:04:58.722 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:04:58.723 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:04:58.740 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:04:58.760 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:04:58.779 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:04:58.797 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:04:58.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:58.798 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:04:58.798 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:04:58.805 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-03T13:04:58.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:04:58.807 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-01-03T13:04:58.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:04:58.808 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:04:58.808 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:04:58.832 INFO:teuthology.orchestra.run.smithi036.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:04:58.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:04:58.833 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-01-03T13:04:58.834 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-01-03T13:04:58.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.958+0000 7fae9f38c700 1 Processor -- start 2021-01-03T13:04:58.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.958+0000 7fae9f38c700 1 -- start start 2021-01-03T13:04:58.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.958+0000 7fae9f38c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae980af7a0 0x7fae980afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:58.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.958+0000 7fae9f38c700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9805cca0 con 0x7fae9805c7c0 2021-01-03T13:04:58.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.958+0000 7fae9f38c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae981408f0 con 0x7fae98140480 2021-01-03T13:04:58.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.958+0000 7fae9f38c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae980b0070 con 0x7fae980af7a0 2021-01-03T13:04:58.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.958+0000 7fae9d929700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fae98140480 0x7fae981466c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57258/0 (socket says 172.21.15.133:57258) 2021-01-03T13:04:58.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.958+0000 7fae9d929700 1 -- 172.21.15.133:0/1941742244 learned_addr learned my addr 172.21.15.133:0/1941742244 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:58.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.958+0000 7fae9c927700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fae9805c7c0 0x7fae9813fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:35984/0 (socket says 172.21.15.133:35984) 2021-01-03T13:04:58.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.958+0000 7fae9d128700 1 --2- 172.21.15.133:0/1941742244 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae980af7a0 0x7fae980afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:58.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.958+0000 7fae83fff700 1 -- 172.21.15.133:0/1941742244 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967018763 0 0) 0x7fae981408f0 con 0x7fae98140480 2021-01-03T13:04:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.958+0000 7fae83fff700 1 -- 172.21.15.133:0/1941742244 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae7c003230 con 0x7fae98140480 2021-01-03T13:04:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae83fff700 1 -- 172.21.15.133:0/1941742244 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185974932 0 0) 0x7fae9805cca0 con 0x7fae9805c7c0 2021-01-03T13:04:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae83fff700 1 -- 172.21.15.133:0/1941742244 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae981408f0 con 0x7fae9805c7c0 2021-01-03T13:04:58.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae9d128700 1 -- 172.21.15.133:0/1941742244 >> v1:172.21.15.133:6789/0 conn(0x7fae98140480 legacy=0x7fae981466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:58.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae9d128700 1 -- 172.21.15.133:0/1941742244 >> v1:172.21.15.16:6789/0 conn(0x7fae9805c7c0 legacy=0x7fae9813fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:58.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae9d128700 1 -- 172.21.15.133:0/1941742244 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae980b0270 con 0x7fae980af7a0 2021-01-03T13:04:58.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae9d128700 1 --2- 172.21.15.133:0/1941742244 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae980af7a0 0x7fae980afb80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fae8c002f30 tx=0x7fae8c006dc0).ready entity=mon.2 client_cookie=5bbef6f8bd9633af server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:58.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae83fff700 1 -- 172.21.15.133:0/1941742244 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8c009730 con 0x7fae980af7a0 2021-01-03T13:04:58.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae83fff700 1 -- 172.21.15.133:0/1941742244 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c009890 con 0x7fae980af7a0 2021-01-03T13:04:58.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae83fff700 1 -- 172.21.15.133:0/1941742244 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8c009bf0 con 0x7fae980af7a0 2021-01-03T13:04:58.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae9f38c700 1 -- 172.21.15.133:0/1941742244 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae980af7a0 msgr2=0x7fae980afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:58.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae9f38c700 1 --2- 172.21.15.133:0/1941742244 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae980af7a0 0x7fae980afb80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fae8c002f30 tx=0x7fae8c006dc0).stop 2021-01-03T13:04:58.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae9f38c700 1 -- 172.21.15.133:0/1941742244 shutdown_connections 2021-01-03T13:04:58.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae9f38c700 1 --2- 172.21.15.133:0/1941742244 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae980af7a0 0x7fae980afb80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae9f38c700 1 -- 172.21.15.133:0/1941742244 >> 172.21.15.133:0/1941742244 conn(0x7fae980b9620 msgr2=0x7fae980b9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:58.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae9f38c700 1 -- 172.21.15.133:0/1941742244 shutdown_connections 2021-01-03T13:04:58.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae9f38c700 1 -- 172.21.15.133:0/1941742244 wait complete. 2021-01-03T13:04:58.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae9f38c700 1 Processor -- start 2021-01-03T13:04:58.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.962+0000 7fae9f38c700 1 -- start start 2021-01-03T13:04:58.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9f38c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae9805c7c0 0x7fae98155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:58.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9f38c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae980af7a0 0x7fae980b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:58.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9f38c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae98140480 0x7fae9805fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:58.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9f38c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae98138c10 con 0x7fae98140480 2021-01-03T13:04:58.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9f38c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae980b72c0 con 0x7fae9805c7c0 2021-01-03T13:04:58.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9f38c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae980b5c80 con 0x7fae980af7a0 2021-01-03T13:04:58.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9d128700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae9805c7c0 0x7fae98155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:58.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9d128700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae9805c7c0 0x7fae98155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36228/0 (socket says 172.21.15.133:36228) 2021-01-03T13:04:58.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9d128700 1 -- 172.21.15.133:0/2403678919 learned_addr learned my addr 172.21.15.133:0/2403678919 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:58.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9d929700 1 --2- 172.21.15.133:0/2403678919 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae98140480 0x7fae9805fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:58.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9c927700 1 --2- 172.21.15.133:0/2403678919 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae980af7a0 0x7fae980b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:58.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9d128700 1 -- 172.21.15.133:0/2403678919 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae980af7a0 msgr2=0x7fae980b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:58.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9d128700 1 --2- 172.21.15.133:0/2403678919 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae980af7a0 0x7fae980b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9d128700 1 -- 172.21.15.133:0/2403678919 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae98140480 msgr2=0x7fae9805fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:58.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9d128700 1 --2- 172.21.15.133:0/2403678919 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae98140480 0x7fae9805fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:58.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9d128700 1 -- 172.21.15.133:0/2403678919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae980b47b0 con 0x7fae9805c7c0 2021-01-03T13:04:58.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9c927700 1 --2- 172.21.15.133:0/2403678919 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae980af7a0 0x7fae980b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:04:58.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9d128700 1 --2- 172.21.15.133:0/2403678919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae9805c7c0 0x7fae98155d80 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fae98138eb0 tx=0x7fae8c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:58.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae8affd700 1 -- 172.21.15.133:0/2403678919 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8c011b90 con 0x7fae9805c7c0 2021-01-03T13:04:58.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae8affd700 1 -- 172.21.15.133:0/2403678919 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c011cf0 con 0x7fae9805c7c0 2021-01-03T13:04:58.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9f38c700 1 -- 172.21.15.133:0/2403678919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae98145ef0 con 0x7fae9805c7c0 2021-01-03T13:04:58.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae8affd700 1 -- 172.21.15.133:0/2403678919 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8c01d640 con 0x7fae9805c7c0 2021-01-03T13:04:58.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9f38c700 1 -- 172.21.15.133:0/2403678919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae98146190 con 0x7fae9805c7c0 2021-01-03T13:04:58.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae9f38c700 1 -- 172.21.15.133:0/2403678919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae98057300 con 0x7fae9805c7c0 2021-01-03T13:04:58.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.966+0000 7fae8affd700 1 -- 172.21.15.133:0/2403678919 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fae8c024030 con 0x7fae9805c7c0 2021-01-03T13:04:58.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.970+0000 7fae8affd700 1 --2- 172.21.15.133:0/2403678919 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae74055330 0x7fae740577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:58.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.970+0000 7fae8affd700 1 -- 172.21.15.133:0/2403678919 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fae8c06f0e0 con 0x7fae9805c7c0 2021-01-03T13:04:58.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.970+0000 7fae9c927700 1 --2- 172.21.15.133:0/2403678919 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae74055330 0x7fae740577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:58.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.970+0000 7fae9c927700 1 --2- 172.21.15.133:0/2403678919 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae74055330 0x7fae740577f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fae9400b000 tx=0x7fae940070e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:58.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:58.974+0000 7fae8affd700 1 -- 172.21.15.133:0/2403678919 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fae8c0453b0 con 0x7fae9805c7c0 2021-01-03T13:04:59.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.118+0000 7fae9f38c700 1 -- 172.21.15.133:0/2403678919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fae98067a00 con 0x7fae9805c7c0 2021-01-03T13:04:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.118+0000 7fae8affd700 1 -- 172.21.15.133:0/2403678919 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v80) v1 ==== 81+0+33771 (secure 0 0 0) 0x7fae8c022020 con 0x7fae9805c7c0 2021-01-03T13:04:59.123 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:04:59.124 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:04:59.124 INFO:teuthology.orchestra.run.smithi133.stdout: "epoch": 80, 2021-01-03T13:04:59.124 INFO:teuthology.orchestra.run.smithi133.stdout: "fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", 2021-01-03T13:04:59.124 INFO:teuthology.orchestra.run.smithi133.stdout: "created": "2021-01-03T12:57:43.298835+0000", 2021-01-03T13:04:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: "modified": "2021-01-03T13:04:45.311139+0000", 2021-01-03T13:04:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: "last_up_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:04:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: "last_in_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:04:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-01-03T13:04:59.125 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_num": 5799936, 2021-01-03T13:04:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_set": [ 2021-01-03T13:04:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: "pglog_hardlimit", 2021-01-03T13:04:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: "purged_snapdirs", 2021-01-03T13:04:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_deletes", 2021-01-03T13:04:59.126 INFO:teuthology.orchestra.run.smithi133.stdout: "sortbitwise" 2021-01-03T13:04:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:04:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_version": 4, 2021-01-03T13:04:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: "full_ratio": 0.94999998807907104, 2021-01-03T13:04:59.127 INFO:teuthology.orchestra.run.smithi133.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-01-03T13:04:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: "nearfull_ratio": 0.85000002384185791, 2021-01-03T13:04:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_snapshot": "", 2021-01-03T13:04:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_max": 14, 2021-01-03T13:04:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: "max_osd": 8, 2021-01-03T13:04:59.128 INFO:teuthology.orchestra.run.smithi133.stdout: "require_min_compat_client": "jewel", 2021-01-03T13:04:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: "min_compat_client": "jewel", 2021-01-03T13:04:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: "require_osd_release": "octopus", 2021-01-03T13:04:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: "pools": [ 2021-01-03T13:04:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.129 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 1, 2021-01-03T13:04:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "device_health_metrics", 2021-01-03T13:04:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:47.102954+0000", 2021-01-03T13:04:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:04:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:04:59.130 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:04:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:04:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:04:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:04:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:04:59.131 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:04:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 1, 2021-01-03T13:04:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 1, 2021-01-03T13:04:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 1, 2021-01-03T13:04:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 1, 2021-01-03T13:04:59.132 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 1, 2021-01-03T13:04:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:04:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:04:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:04:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:04:59.133 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:04:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:04:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:04:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "16", 2021-01-03T13:04:59.134 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:04:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:04:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:04:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:04:59.135 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:04:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:04:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:04:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:04:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:04:59.136 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:04:59.137 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:04:59.137 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:04:59.137 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:04:59.137 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:04:59.137 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:04:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:04:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:04:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:04:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:04:59.138 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:04:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:04:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:04:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:04:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:04:59.139 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:04:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:04:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:04:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:04:59.140 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:04:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:04:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:04:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:04:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:04:59.141 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:04:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:04:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:04:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:04:59.142 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:04:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 1 2021-01-03T13:04:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:04:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr_devicehealth": {} 2021-01-03T13:04:59.143 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 2, 2021-01-03T13:04:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "rbd", 2021-01-03T13:04:59.144 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:55.472799+0000", 2021-01-03T13:04:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:04:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:04:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:04:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:04:59.145 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:04:59.146 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:04:59.146 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:04:59.146 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:04:59.146 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:04:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:04:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:04:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:04:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:04:59.147 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:04:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:04:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:04:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:04:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:04:59.148 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:04:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:04:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "19", 2021-01-03T13:04:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:04:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:04:59.149 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:04:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:04:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:04:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:04:59.150 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:04:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:04:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:04:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:04:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:04:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:04:59.151 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:04:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:04:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:04:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:04:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:04:59.152 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:04:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:04:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:04:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:04:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:04:59.153 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:04:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:04:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:04:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:04:59.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:04:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:04:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:04:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:04:59.155 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:04:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:04:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:04:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:04:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:04:59.156 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:04:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:04:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:04:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:04:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd": {} 2021-01-03T13:04:59.157 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.158 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 13, 2021-01-03T13:04:59.158 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_metadata", 2021-01-03T13:04:59.159 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:03:57.389227+0000", 2021-01-03T13:04:59.159 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:04:59.159 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:04:59.159 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:04:59.159 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:04:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:04:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:04:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:04:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:04:59.160 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:04:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:04:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:04:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:04:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:04:59.161 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:04:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:04:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:04:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:04:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:04:59.162 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:04:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:04:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "77", 2021-01-03T13:04:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:04:59.163 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:04:59.164 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:04:59.164 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:04:59.164 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:04:59.164 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:04:59.164 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:04:59.165 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:04:59.165 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:04:59.165 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:04:59.165 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:04:59.165 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:04:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:04:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:04:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:04:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:04:59.166 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:04:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:04:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:04:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:04:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:04:59.167 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:04:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:04:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:04:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:04:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:04:59.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:04:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:04:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:04:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:04:59.169 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:04:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:04:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:04:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:04:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:04:59.170 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:04:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:04:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:04:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_bias": 4, 2021-01-03T13:04:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 16, 2021-01-03T13:04:59.171 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_priority": 5 2021-01-03T13:04:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:04:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:04:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": "cephfs" 2021-01-03T13:04:59.172 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 14, 2021-01-03T13:04:59.173 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_data", 2021-01-03T13:04:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:03:58.706858+0000", 2021-01-03T13:04:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:04:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:04:59.174 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:04:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:04:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:04:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:04:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:04:59.175 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:04:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:04:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:04:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:04:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:04:59.176 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:04:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:04:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:04:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:04:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:04:59.177 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:04:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:04:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:04:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "79", 2021-01-03T13:04:59.178 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:04:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:04:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:04:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:04:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:04:59.179 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:04:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:04:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:04:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:04:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:04:59.180 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:04:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:04:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:04:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:04:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:04:59.181 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:04:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:04:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:04:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:04:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:04:59.182 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:04:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:04:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:04:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:04:59.183 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:04:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:04:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:04:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:04:59.184 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:04:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:04:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:04:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:04:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:04:59.185 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:04:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:04:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:04:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:04:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:04:59.186 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:04:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:04:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: "data": "cephfs" 2021-01-03T13:04:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.187 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:04:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: "osds": [ 2021-01-03T13:04:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:04:59.188 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a", 2021-01-03T13:04:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:04:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:04:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:04:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:04:59.189 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:04:59.190 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:04:59.190 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:04:59.190 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 76, 2021-01-03T13:04:59.190 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:04:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:04:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:04:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.191 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6810", 2021-01-03T13:04:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:04:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.192 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6811", 2021-01-03T13:04:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:04:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:04:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.194 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6812", 2021-01-03T13:04:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:04:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.195 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6813", 2021-01-03T13:04:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:04:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.196 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:04:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.197 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6816", 2021-01-03T13:04:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:04:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.198 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6817", 2021-01-03T13:04:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:04:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.199 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:04:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6814", 2021-01-03T13:04:59.200 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:04:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6815", 2021-01-03T13:04:59.201 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:04:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6811/12124", 2021-01-03T13:04:59.202 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6813/12124", 2021-01-03T13:04:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6817/12124", 2021-01-03T13:04:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6815/12124", 2021-01-03T13:04:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:04:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:04:59.203 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:04:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:04:59.204 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9170d1de-58d4-4dfd-b9de-80dc15ca9e60", 2021-01-03T13:04:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:04:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:04:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:04:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:04:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:04:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:04:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:04:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 65, 2021-01-03T13:04:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:04:59.206 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:04:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:04:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.207 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6818", 2021-01-03T13:04:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:04:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.208 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6819", 2021-01-03T13:04:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:04:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:04:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.210 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6820", 2021-01-03T13:04:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:04:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.211 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6821", 2021-01-03T13:04:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:04:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.212 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:04:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6824", 2021-01-03T13:04:59.213 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:04:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6825", 2021-01-03T13:04:59.214 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:04:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:04:59.215 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6822", 2021-01-03T13:04:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:04:59.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6823", 2021-01-03T13:04:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:04:59.217 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6819/12123", 2021-01-03T13:04:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6821/12123", 2021-01-03T13:04:59.218 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6825/12123", 2021-01-03T13:04:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6823/12123", 2021-01-03T13:04:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:04:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:04:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:04:59.219 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:04:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9fc5adf9-3537-4953-9c65-0c67ecb53776", 2021-01-03T13:04:59.220 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:04:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:04:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:04:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:04:59.221 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:04:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:04:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:04:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 76, 2021-01-03T13:04:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:04:59.222 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:04:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:04:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.223 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6802", 2021-01-03T13:04:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:04:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.224 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6803", 2021-01-03T13:04:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:04:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.225 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:04:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6804", 2021-01-03T13:04:59.226 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:04:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6805", 2021-01-03T13:04:59.227 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:04:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:04:59.228 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6808", 2021-01-03T13:04:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:04:59.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.230 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.230 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6809", 2021-01-03T13:04:59.230 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:04:59.230 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:04:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6806", 2021-01-03T13:04:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:04:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6807", 2021-01-03T13:04:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:04:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.233 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6803/12122", 2021-01-03T13:04:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6805/12122", 2021-01-03T13:04:59.234 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6809/12122", 2021-01-03T13:04:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6807/12122", 2021-01-03T13:04:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:04:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:04:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:04:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:04:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "0ad45ce5-6635-4089-bbf8-c966d0fe5338", 2021-01-03T13:04:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:04:59.236 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:04:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:04:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:04:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:04:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:04:59.237 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:04:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 76, 2021-01-03T13:04:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:04:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:04:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:04:59.238 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6826", 2021-01-03T13:04:59.239 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:04:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6827", 2021-01-03T13:04:59.240 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:04:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:04:59.241 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.242 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.242 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6828", 2021-01-03T13:04:59.242 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:04:59.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.243 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.243 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6829", 2021-01-03T13:04:59.243 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:04:59.243 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.244 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.244 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:04:59.244 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.245 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.245 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6832", 2021-01-03T13:04:59.245 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:04:59.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.246 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.246 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6833", 2021-01-03T13:04:59.246 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:04:59.246 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.247 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.247 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:04:59.247 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.248 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.248 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6830", 2021-01-03T13:04:59.248 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:04:59.248 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.249 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.249 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6831", 2021-01-03T13:04:59.249 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:04:59.249 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.249 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.250 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6827/12136", 2021-01-03T13:04:59.250 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6829/12136", 2021-01-03T13:04:59.250 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6833/12136", 2021-01-03T13:04:59.251 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6831/12136", 2021-01-03T13:04:59.251 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:04:59.251 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:04:59.251 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:04:59.251 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.252 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:04:59.252 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "86b8d6d5-271b-4a70-ae7b-a227afb38d7c", 2021-01-03T13:04:59.252 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:04:59.253 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:04:59.253 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:04:59.253 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:04:59.253 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:04:59.253 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:04:59.254 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:04:59.254 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 74, 2021-01-03T13:04:59.254 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:04:59.254 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:04:59.255 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:04:59.255 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.255 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.255 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6808", 2021-01-03T13:04:59.256 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:04:59.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.256 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.256 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6809", 2021-01-03T13:04:59.256 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:04:59.257 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.257 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.257 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:04:59.257 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.258 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.258 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6810", 2021-01-03T13:04:59.258 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:04:59.259 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.259 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.259 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6811", 2021-01-03T13:04:59.259 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:04:59.260 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.260 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.260 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:04:59.260 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.261 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.261 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.261 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6814", 2021-01-03T13:04:59.261 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:04:59.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.262 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.262 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6815", 2021-01-03T13:04:59.262 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:04:59.263 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.263 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.263 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.263 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:04:59.263 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.264 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.264 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.264 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6812", 2021-01-03T13:04:59.264 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:04:59.264 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.265 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.265 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6813", 2021-01-03T13:04:59.265 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:04:59.265 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.266 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.266 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6809/12672", 2021-01-03T13:04:59.266 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6811/12672", 2021-01-03T13:04:59.266 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6815/12672", 2021-01-03T13:04:59.267 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6813/12672", 2021-01-03T13:04:59.267 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:04:59.267 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:04:59.267 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:04:59.268 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.268 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.268 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:04:59.268 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "173feb9d-f596-4030-85d8-1f4b46a9ffe5", 2021-01-03T13:04:59.269 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:04:59.269 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:04:59.269 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:04:59.269 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:04:59.269 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:04:59.270 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:04:59.270 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:04:59.270 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 76, 2021-01-03T13:04:59.270 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:04:59.270 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:04:59.271 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:04:59.271 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.271 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.271 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6817", 2021-01-03T13:04:59.272 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:04:59.272 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.272 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.272 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6819", 2021-01-03T13:04:59.273 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:04:59.273 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.273 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.274 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:04:59.274 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.274 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.274 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6820", 2021-01-03T13:04:59.275 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:04:59.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.275 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.275 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6822", 2021-01-03T13:04:59.276 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:04:59.276 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.276 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.276 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.276 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:04:59.277 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.277 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.277 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6828", 2021-01-03T13:04:59.277 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:04:59.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.278 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.278 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6830", 2021-01-03T13:04:59.279 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:04:59.279 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.279 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.279 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.279 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:04:59.280 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.280 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.280 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.280 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6824", 2021-01-03T13:04:59.280 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:04:59.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.281 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.281 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6826", 2021-01-03T13:04:59.281 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:04:59.282 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.282 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.282 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6819/12673", 2021-01-03T13:04:59.282 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6822/12673", 2021-01-03T13:04:59.283 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6830/12673", 2021-01-03T13:04:59.283 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6826/12673", 2021-01-03T13:04:59.283 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:04:59.283 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:04:59.283 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:04:59.284 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.284 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.284 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:04:59.284 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "b487980e-ad4d-43c1-91fa-4845f7af3d4d", 2021-01-03T13:04:59.285 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:04:59.285 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:04:59.285 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:04:59.285 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:04:59.285 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:04:59.286 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:04:59.286 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:04:59.286 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 77, 2021-01-03T13:04:59.286 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:04:59.287 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:04:59.287 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:04:59.287 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.287 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.287 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.288 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6800", 2021-01-03T13:04:59.288 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:04:59.288 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.288 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.288 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.288 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6801", 2021-01-03T13:04:59.289 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:04:59.289 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.289 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.289 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.290 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:04:59.290 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.290 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.290 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6802", 2021-01-03T13:04:59.291 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:04:59.291 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.291 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.291 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.291 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6803", 2021-01-03T13:04:59.292 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:04:59.292 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.292 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.292 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:04:59.292 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.293 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.293 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.293 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6806", 2021-01-03T13:04:59.293 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:04:59.293 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.294 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.294 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.294 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6807", 2021-01-03T13:04:59.294 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:04:59.294 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.295 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.295 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.295 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:04:59.295 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.295 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.296 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.296 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6804", 2021-01-03T13:04:59.296 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:04:59.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.297 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.297 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6805", 2021-01-03T13:04:59.297 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:04:59.297 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.297 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.298 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.298 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6801/12662", 2021-01-03T13:04:59.298 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6803/12662", 2021-01-03T13:04:59.298 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6807/12662", 2021-01-03T13:04:59.298 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6805/12662", 2021-01-03T13:04:59.299 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:04:59.299 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:04:59.299 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:04:59.299 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.299 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.300 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:04:59.300 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "38ea839a-451f-4c09-a545-4514e049b178", 2021-01-03T13:04:59.300 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:04:59.300 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:04:59.301 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:04:59.301 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:04:59.301 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:04:59.301 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:04:59.301 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:04:59.302 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 74, 2021-01-03T13:04:59.302 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:04:59.302 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:04:59.302 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:04:59.303 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.303 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.303 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6816", 2021-01-03T13:04:59.303 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:04:59.304 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.304 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.304 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.304 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6818", 2021-01-03T13:04:59.304 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:04:59.304 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.305 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.305 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:04:59.305 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.305 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.306 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.306 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6821", 2021-01-03T13:04:59.306 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:04:59.306 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.307 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.307 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6823", 2021-01-03T13:04:59.307 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:04:59.307 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.308 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.308 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.308 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:04:59.308 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.308 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.309 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.309 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6829", 2021-01-03T13:04:59.309 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:04:59.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.309 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.310 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.310 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6831", 2021-01-03T13:04:59.310 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:04:59.310 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.310 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.311 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.311 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:04:59.311 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:04:59.311 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.311 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:04:59.312 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6825", 2021-01-03T13:04:59.312 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:04:59.312 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.312 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.312 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:04:59.313 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6827", 2021-01-03T13:04:59.313 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:04:59.313 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.313 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.313 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.314 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6818/12674", 2021-01-03T13:04:59.314 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6823/12674", 2021-01-03T13:04:59.314 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6831/12674", 2021-01-03T13:04:59.314 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6827/12674", 2021-01-03T13:04:59.314 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:04:59.315 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:04:59.315 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:04:59.315 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:04:59.315 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.315 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:04:59.316 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_xinfo": [ 2021-01-03T13:04:59.316 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.316 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:04:59.316 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:04:59.316 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:04:59.317 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:04:59.317 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:04:59.317 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:04:59.317 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.659942+0000", 2021-01-03T13:04:59.317 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:04:59.318 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.318 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.318 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:04:59.318 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:04:59.318 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:04:59.319 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:04:59.319 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:04:59.319 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:04:59.319 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.750326+0000", 2021-01-03T13:04:59.319 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:04:59.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.320 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.320 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:04:59.320 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:04:59.320 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:04:59.321 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:04:59.321 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:04:59.321 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:04:59.321 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.587742+0000", 2021-01-03T13:04:59.321 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:04:59.322 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.322 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:04:59.322 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:04:59.322 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:04:59.323 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:04:59.323 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:04:59.323 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:04:59.323 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.855073+0000", 2021-01-03T13:04:59.323 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:04:59.324 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.324 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.324 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:04:59.324 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:04:59.324 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:04:59.325 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:04:59.325 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:04:59.325 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:04:59.325 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.565030+0000", 2021-01-03T13:04:59.325 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:04:59.326 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.326 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.326 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:04:59.326 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:04:59.326 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:04:59.327 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:04:59.327 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:04:59.327 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:04:59.327 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.786206+0000", 2021-01-03T13:04:59.327 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:04:59.328 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.328 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.328 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:04:59.328 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:04:59.328 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:04:59.329 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:04:59.329 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:04:59.329 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:04:59.329 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.576185+0000", 2021-01-03T13:04:59.329 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:04:59.330 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.330 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:04:59.330 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:04:59.330 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:04:59.330 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:04:59.331 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:04:59.331 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:04:59.331 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:04:59.331 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.823786+0000", 2021-01-03T13:04:59.331 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:04:59.332 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.332 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:04:59.332 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap": [], 2021-01-03T13:04:59.332 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap_items": [], 2021-01-03T13:04:59.332 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_temp": [], 2021-01-03T13:04:59.333 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_temp": [], 2021-01-03T13:04:59.333 INFO:teuthology.orchestra.run.smithi133.stdout: "blacklist": { 2021-01-03T13:04:59.333 INFO:teuthology.orchestra.run.smithi133.stdout: "172.21.15.7:0/2138852502": "2021-01-03T14:04:44.488855+0000" 2021-01-03T13:04:59.333 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.333 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profiles": { 2021-01-03T13:04:59.334 INFO:teuthology.orchestra.run.smithi133.stdout: "default": { 2021-01-03T13:04:59.334 INFO:teuthology.orchestra.run.smithi133.stdout: "crush-failure-domain": "osd", 2021-01-03T13:04:59.334 INFO:teuthology.orchestra.run.smithi133.stdout: "k": "2", 2021-01-03T13:04:59.334 INFO:teuthology.orchestra.run.smithi133.stdout: "m": "1", 2021-01-03T13:04:59.334 INFO:teuthology.orchestra.run.smithi133.stdout: "plugin": "jerasure", 2021-01-03T13:04:59.335 INFO:teuthology.orchestra.run.smithi133.stdout: "ruleset-failure-domain": "osd", 2021-01-03T13:04:59.335 INFO:teuthology.orchestra.run.smithi133.stdout: "technique": "reed_sol_van" 2021-01-03T13:04:59.335 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:04:59.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:04:59.335 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps_queue": [], 2021-01-03T13:04:59.336 INFO:teuthology.orchestra.run.smithi133.stdout: "new_removed_snaps": [], 2021-01-03T13:04:59.336 INFO:teuthology.orchestra.run.smithi133.stdout: "new_purged_snaps": [], 2021-01-03T13:04:59.336 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_node_flags": {}, 2021-01-03T13:04:59.336 INFO:teuthology.orchestra.run.smithi133.stdout: "device_class_flags": {} 2021-01-03T13:04:59.336 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:04:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.122+0000 7fae9f38c700 1 -- 172.21.15.133:0/2403678919 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae74055330 msgr2=0x7fae740577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.122+0000 7fae9f38c700 1 --2- 172.21.15.133:0/2403678919 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae74055330 0x7fae740577f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fae9400b000 tx=0x7fae940070e0).stop 2021-01-03T13:04:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.122+0000 7fae9f38c700 1 -- 172.21.15.133:0/2403678919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae9805c7c0 msgr2=0x7fae98155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:59.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.122+0000 7fae9f38c700 1 --2- 172.21.15.133:0/2403678919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae9805c7c0 0x7fae98155d80 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fae98138eb0 tx=0x7fae8c015000).stop 2021-01-03T13:04:59.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.122+0000 7fae9f38c700 1 -- 172.21.15.133:0/2403678919 shutdown_connections 2021-01-03T13:04:59.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.122+0000 7fae9f38c700 1 --2- 172.21.15.133:0/2403678919 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fae74055330 0x7fae740577f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.122+0000 7fae9f38c700 1 --2- 172.21.15.133:0/2403678919 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fae98140480 0x7fae9805fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.122+0000 7fae9f38c700 1 --2- 172.21.15.133:0/2403678919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae9805c7c0 0x7fae98155d80 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.122+0000 7fae9f38c700 1 --2- 172.21.15.133:0/2403678919 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fae980af7a0 0x7fae980b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.122+0000 7fae9f38c700 1 -- 172.21.15.133:0/2403678919 >> 172.21.15.133:0/2403678919 conn(0x7fae980b9620 msgr2=0x7fae980b5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.122+0000 7fae9f38c700 1 -- 172.21.15.133:0/2403678919 shutdown_connections 2021-01-03T13:04:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.122+0000 7fae9f38c700 1 -- 172.21.15.133:0/2403678919 wait complete. 2021-01-03T13:04:59.341 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:04:59.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cfc9c0700 1 Processor -- start 2021-01-03T13:04:59.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cfc9c0700 1 -- start start 2021-01-03T13:04:59.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cfc9c0700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0cf805c130 0x7f0cf80b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:59.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cfc9c0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cf80b02b0 0x7f0cf80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:59.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cfc9c0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf805c510 con 0x7f0cf80622f0 2021-01-03T13:04:59.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cfc9c0700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf81473d0 con 0x7f0cf805c130 2021-01-03T13:04:59.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cfc9c0700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf80b0ab0 con 0x7f0cf80b02b0 2021-01-03T13:04:59.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf7fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0cf80622f0 0x7f0cf80668a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57272/0 (socket says 172.21.15.133:57272) 2021-01-03T13:04:59.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf7fff700 1 -- 172.21.15.133:0/3535959195 learned_addr learned my addr 172.21.15.133:0/3535959195 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:04:59.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf6ffd700 1 --2- 172.21.15.133:0/3535959195 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cf80b02b0 0x7f0cf80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf77fe700 1 --2- 172.21.15.133:0/3535959195 >> v2:172.21.15.16:3300/0 conn(0x7f0cf805c130 0x7f0cf80b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf67fc700 1 -- 172.21.15.133:0/3535959195 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551620178 0 0) 0x7f0cf805c510 con 0x7f0cf80622f0 2021-01-03T13:04:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf67fc700 1 -- 172.21.15.133:0/3535959195 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cd8003230 con 0x7f0cf80622f0 2021-01-03T13:04:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf67fc700 1 -- 172.21.15.133:0/3535959195 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2535385155 0 0) 0x7f0cd8003230 con 0x7f0cf80622f0 2021-01-03T13:04:59.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf67fc700 1 -- 172.21.15.133:0/3535959195 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cf80b02b0 msgr2=0x7f0cf80b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:59.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf67fc700 1 --2- 172.21.15.133:0/3535959195 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cf80b02b0 0x7f0cf80b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf67fc700 1 -- 172.21.15.133:0/3535959195 >> v2:172.21.15.16:3300/0 conn(0x7f0cf805c130 msgr2=0x7f0cf80b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:59.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf67fc700 1 --2- 172.21.15.133:0/3535959195 >> v2:172.21.15.16:3300/0 conn(0x7f0cf805c130 0x7f0cf80b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf67fc700 1 -- 172.21.15.133:0/3535959195 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf80b15a0 con 0x7f0cf80622f0 2021-01-03T13:04:59.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf67fc700 1 -- 172.21.15.133:0/3535959195 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f0ce00016d0 con 0x7f0cf80622f0 2021-01-03T13:04:59.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf67fc700 1 -- 172.21.15.133:0/3535959195 >> v1:172.21.15.133:6789/0 conn(0x7f0cf80622f0 legacy=0x7f0cf80668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:59.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf67fc700 1 --2- 172.21.15.133:0/3535959195 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cf80b02b0 0x7f0cd8003740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:59.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf67fc700 1 --2- 172.21.15.133:0/3535959195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cd8003c50 0x7f0cd80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:59.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf67fc700 1 --2- 172.21.15.133:0/3535959195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cd80049c0 0x7f0cd8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:59.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf67fc700 1 -- 172.21.15.133:0/3535959195 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf81473d0 con 0x7f0cd80049c0 2021-01-03T13:04:59.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf67fc700 1 -- 172.21.15.133:0/3535959195 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd80041e0 con 0x7f0cd8003c50 2021-01-03T13:04:59.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf67fc700 1 -- 172.21.15.133:0/3535959195 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd800b720 con 0x7f0cf80b02b0 2021-01-03T13:04:59.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf6ffd700 1 --2- 172.21.15.133:0/3535959195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cd8003c50 0x7f0cd80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:59.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf77fe700 1 --2- 172.21.15.133:0/3535959195 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cf80b02b0 0x7f0cd8003740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:59.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf7fff700 1 --2- 172.21.15.133:0/3535959195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cd80049c0 0x7f0cd8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:59.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.458+0000 7f0cf6ffd700 1 -- 172.21.15.133:0/3535959195 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cf80b02b0 msgr2=0x7f0cd8003740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:59.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cf6ffd700 1 --2- 172.21.15.133:0/3535959195 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cf80b02b0 0x7f0cd8003740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cf6ffd700 1 -- 172.21.15.133:0/3535959195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cd80049c0 msgr2=0x7f0cd8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:59.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cf6ffd700 1 --2- 172.21.15.133:0/3535959195 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cd80049c0 0x7f0cd8004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cf6ffd700 1 -- 172.21.15.133:0/3535959195 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd8003230 con 0x7f0cd8003c50 2021-01-03T13:04:59.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cf6ffd700 1 --2- 172.21.15.133:0/3535959195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cd8003c50 0x7f0cd80044d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f0ce800c000 tx=0x7f0ce8008040).ready entity=mon.1 client_cookie=236fd5c5f8b8c4e2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:59.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cf67fc700 1 -- 172.21.15.133:0/3535959195 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ce800e910 con 0x7f0cd8003c50 2021-01-03T13:04:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cf67fc700 1 -- 172.21.15.133:0/3535959195 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce800ea70 con 0x7f0cd8003c50 2021-01-03T13:04:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cfc9c0700 1 -- 172.21.15.133:0/3535959195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cd8003c50 msgr2=0x7f0cd80044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cf67fc700 1 -- 172.21.15.133:0/3535959195 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ce800edd0 con 0x7f0cd8003c50 2021-01-03T13:04:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cfc9c0700 1 --2- 172.21.15.133:0/3535959195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cd8003c50 0x7f0cd80044d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f0ce800c000 tx=0x7f0ce8008040).stop 2021-01-03T13:04:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cf7fff700 1 -- 172.21.15.133:0/3535959195 reap_dead start 2021-01-03T13:04:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cfc9c0700 1 -- 172.21.15.133:0/3535959195 shutdown_connections 2021-01-03T13:04:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cfc9c0700 1 -- 172.21.15.133:0/3535959195 >> 172.21.15.133:0/3535959195 conn(0x7f0cf80b6110 msgr2=0x7f0cf80b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cfc9c0700 1 -- 172.21.15.133:0/3535959195 shutdown_connections 2021-01-03T13:04:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cfc9c0700 1 -- 172.21.15.133:0/3535959195 wait complete. 2021-01-03T13:04:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cfc9c0700 1 Processor -- start 2021-01-03T13:04:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cfc9c0700 1 -- start start 2021-01-03T13:04:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cfc9c0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cf8066660 0x7f0cf8152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cfc9c0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cf8064d90 0x7f0cf8064400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cfc9c0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cf8145250 0x7f0cf813e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cfc9c0700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf8066a40 con 0x7f0cf8145250 2021-01-03T13:04:59.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cfc9c0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf8065ad0 con 0x7f0cf8064d90 2021-01-03T13:04:59.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.462+0000 7f0cfc9c0700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf8152b10 con 0x7f0cf8066660 2021-01-03T13:04:59.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cf8064d90 0x7f0cf8064400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:59.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cf8064d90 0x7f0cf8064400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36250/0 (socket says 172.21.15.133:36250) 2021-01-03T13:04:59.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf6ffd700 1 -- 172.21.15.133:0/1587423054 learned_addr learned my addr 172.21.15.133:0/1587423054 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf77fe700 1 --2- 172.21.15.133:0/1587423054 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cf8066660 0x7f0cf8152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf6ffd700 1 -- 172.21.15.133:0/1587423054 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cf8066660 msgr2=0x7f0cf8152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf7fff700 1 --2- 172.21.15.133:0/1587423054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cf8145250 0x7f0cf813e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf6ffd700 1 --2- 172.21.15.133:0/1587423054 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cf8066660 0x7f0cf8152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf6ffd700 1 -- 172.21.15.133:0/1587423054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cf8145250 msgr2=0x7f0cf813e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf6ffd700 1 --2- 172.21.15.133:0/1587423054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cf8145250 0x7f0cf813e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf6ffd700 1 -- 172.21.15.133:0/1587423054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf80652d0 con 0x7f0cf8064d90 2021-01-03T13:04:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf77fe700 1 --2- 172.21.15.133:0/1587423054 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cf8066660 0x7f0cf8152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:04:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf7fff700 1 --2- 172.21.15.133:0/1587423054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cf8145250 0x7f0cf813e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:04:59.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf6ffd700 1 --2- 172.21.15.133:0/1587423054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cf8064d90 0x7f0cf8064400 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f0ce800c000 tx=0x7f0ce801a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:59.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf4ff9700 1 -- 172.21.15.133:0/1587423054 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ce801c430 con 0x7f0cf8064d90 2021-01-03T13:04:59.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cfc9c0700 1 -- 172.21.15.133:0/1587423054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf8065d30 con 0x7f0cf8064d90 2021-01-03T13:04:59.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf4ff9700 1 -- 172.21.15.133:0/1587423054 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce801c590 con 0x7f0cf8064d90 2021-01-03T13:04:59.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf4ff9700 1 -- 172.21.15.133:0/1587423054 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ce801c8f0 con 0x7f0cf8064d90 2021-01-03T13:04:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cfc9c0700 1 -- 172.21.15.133:0/1587423054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf80648f0 con 0x7f0cf8064d90 2021-01-03T13:04:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cfc9c0700 1 -- 172.21.15.133:0/1587423054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf8057300 con 0x7f0cf8064d90 2021-01-03T13:04:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf4ff9700 1 -- 172.21.15.133:0/1587423054 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0ce802c070 con 0x7f0cf8064d90 2021-01-03T13:04:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf4ff9700 1 --2- 172.21.15.133:0/1587423054 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0cdc055330 0x7f0cdc0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf4ff9700 1 -- 172.21.15.133:0/1587423054 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f0ce806faa0 con 0x7f0cf8064d90 2021-01-03T13:04:59.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.466+0000 7f0cf77fe700 1 --2- 172.21.15.133:0/1587423054 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0cdc055330 0x7f0cdc0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:59.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.470+0000 7f0cf77fe700 1 --2- 172.21.15.133:0/1587423054 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0cdc055330 0x7f0cdc0577f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f0cf000b000 tx=0x7f0cf0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:59.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.474+0000 7f0cf4ff9700 1 -- 172.21.15.133:0/1587423054 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0ce8045cd0 con 0x7f0cf8064d90 2021-01-03T13:04:59.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.650+0000 7f0cfc9c0700 1 -- 172.21.15.133:0/1587423054 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0cf8064270 con 0x7f0cf8064d90 2021-01-03T13:04:59.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.650+0000 7f0cf4ff9700 1 -- 172.21.15.133:0/1587423054 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+2496 (secure 0 0 0) 0x7f0ce8016070 con 0x7f0cf8064d90 2021-01-03T13:04:59.655 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:04:59.656 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":33,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/524155035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":524155035},{"type":"v1","addr":"172.21.15.16:6833","nonce":524155035}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":31},{"gid":6175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1381538323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1381538323},{"type":"v1","addr":"172.21.15.133:6835","nonce":1381538323}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:03:59.914082+0000","modified":"2021-01-03T13:04:00.917279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6178},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6178":{"gid":6178,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1189475847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1189475847},{"type":"v1","addr":"172.21.15.133:6837","nonce":1189475847}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-01-03T13:04:59.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.654+0000 7f0cfc9c0700 1 -- 172.21.15.133:0/1587423054 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0cdc055330 msgr2=0x7f0cdc0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:59.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.654+0000 7f0cfc9c0700 1 --2- 172.21.15.133:0/1587423054 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0cdc055330 0x7f0cdc0577f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f0cf000b000 tx=0x7f0cf0008040).stop 2021-01-03T13:04:59.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.654+0000 7f0cfc9c0700 1 -- 172.21.15.133:0/1587423054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cf8064d90 msgr2=0x7f0cf8064400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:59.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.654+0000 7f0cfc9c0700 1 --2- 172.21.15.133:0/1587423054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cf8064d90 0x7f0cf8064400 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f0ce800c000 tx=0x7f0ce801a000).stop 2021-01-03T13:04:59.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.654+0000 7f0cfc9c0700 1 -- 172.21.15.133:0/1587423054 shutdown_connections 2021-01-03T13:04:59.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.654+0000 7f0cfc9c0700 1 --2- 172.21.15.133:0/1587423054 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0cdc055330 0x7f0cdc0577f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.654+0000 7f0cfc9c0700 1 --2- 172.21.15.133:0/1587423054 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cf8145250 0x7f0cf813e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.654+0000 7f0cfc9c0700 1 --2- 172.21.15.133:0/1587423054 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cf8066660 0x7f0cf8152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.654+0000 7f0cfc9c0700 1 --2- 172.21.15.133:0/1587423054 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cf8064d90 0x7f0cf8064400 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.654+0000 7f0cfc9c0700 1 -- 172.21.15.133:0/1587423054 >> 172.21.15.133:0/1587423054 conn(0x7f0cf80b6110 msgr2=0x7f0cf8141410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:59.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.654+0000 7f0cfc9c0700 1 -- 172.21.15.133:0/1587423054 shutdown_connections 2021-01-03T13:04:59.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.654+0000 7f0cfc9c0700 1 -- 172.21.15.133:0/1587423054 wait complete. 2021-01-03T13:04:59.660 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 33 2021-01-03T13:04:59.670 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-01-03T13:04:59.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a321a5700 1 Processor -- start 2021-01-03T13:04:59.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a321a5700 1 -- start start 2021-01-03T13:04:59.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a321a5700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a2c0b52c0 0x7f6a2c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:59.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a321a5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a2c0b5c00 0x7f6a2c143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:59.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a321a5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2c060da0 con 0x7f6a2c0b0c90 2021-01-03T13:04:59.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a321a5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c067a90 con 0x7f6a2c0b5c00 2021-01-03T13:04:59.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a321a5700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0b0ad0 con 0x7f6a2c0b52c0 2021-01-03T13:04:59.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a319a4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a2c0b5c00 0x7f6a2c143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:59.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a319a4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a2c0b5c00 0x7f6a2c143eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36260/0 (socket says 172.21.15.133:36260) 2021-01-03T13:04:59.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a309a2700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6a2c0b0c90 0x7f6a2c098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57290/0 (socket says 172.21.15.133:57290) 2021-01-03T13:04:59.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a319a4700 1 -- 172.21.15.133:0/3587131623 learned_addr learned my addr 172.21.15.133:0/3587131623 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:59.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a311a3700 1 --2- 172.21.15.133:0/3587131623 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a2c0b52c0 0x7f6a2c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:59.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a319a4700 1 -- 172.21.15.133:0/3587131623 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a2c0b52c0 msgr2=0x7f6a2c0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:04:59.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a319a4700 1 --2- 172.21.15.133:0/3587131623 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a2c0b52c0 0x7f6a2c0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a23fff700 1 -- 172.21.15.133:0/3587131623 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869044044 0 0) 0x7f6a2c060da0 con 0x7f6a2c0b0c90 2021-01-03T13:04:59.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a319a4700 1 -- 172.21.15.133:0/3587131623 >> v1:172.21.15.133:6789/0 conn(0x7f6a2c0b0c90 legacy=0x7f6a2c098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:59.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a319a4700 1 -- 172.21.15.133:0/3587131623 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c0b56a0 con 0x7f6a2c0b5c00 2021-01-03T13:04:59.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a319a4700 1 --2- 172.21.15.133:0/3587131623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0b5c00 0x7f6a2c143eb0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f6a24002f30 tx=0x7f6a24006e80).ready entity=mon.1 client_cookie=c424b1497957356e server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:59.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a23fff700 1 -- 172.21.15.133:0/3587131623 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a240097f0 con 0x7f6a2c0b5c00 2021-01-03T13:04:59.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a23fff700 1 -- 172.21.15.133:0/3587131623 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a24009950 con 0x7f6a2c0b5c00 2021-01-03T13:04:59.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a23fff700 1 -- 172.21.15.133:0/3587131623 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a24009cb0 con 0x7f6a2c0b5c00 2021-01-03T13:04:59.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a321a5700 1 -- 172.21.15.133:0/3587131623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0b5c00 msgr2=0x7f6a2c143eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:59.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a321a5700 1 --2- 172.21.15.133:0/3587131623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0b5c00 0x7f6a2c143eb0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f6a24002f30 tx=0x7f6a24006e80).stop 2021-01-03T13:04:59.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a321a5700 1 -- 172.21.15.133:0/3587131623 shutdown_connections 2021-01-03T13:04:59.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a321a5700 1 --2- 172.21.15.133:0/3587131623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0b5c00 0x7f6a2c143eb0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a321a5700 1 --2- 172.21.15.133:0/3587131623 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a2c0b52c0 0x7f6a2c0b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a321a5700 1 -- 172.21.15.133:0/3587131623 >> 172.21.15.133:0/3587131623 conn(0x7f6a2c05bdf0 msgr2=0x7f6a2c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:04:59.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a321a5700 1 -- 172.21.15.133:0/3587131623 shutdown_connections 2021-01-03T13:04:59.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.782+0000 7f6a321a5700 1 -- 172.21.15.133:0/3587131623 wait complete. 2021-01-03T13:04:59.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a321a5700 1 Processor -- start 2021-01-03T13:04:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a321a5700 1 -- start start 2021-01-03T13:04:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a321a5700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a2c0b0c90 0x7f6a2c0ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a321a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0b52c0 0x7f6a2c1425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a321a5700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a2c0b5c00 0x7f6a2c142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a321a5700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0674f0 con 0x7f6a2c0b5c00 2021-01-03T13:04:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a321a5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c0aa7b0 con 0x7f6a2c0b52c0 2021-01-03T13:04:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a321a5700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c142fb0 con 0x7f6a2c0b0c90 2021-01-03T13:04:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a309a2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0b52c0 0x7f6a2c1425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a309a2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0b52c0 0x7f6a2c1425d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36264/0 (socket says 172.21.15.133:36264) 2021-01-03T13:04:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a309a2700 1 -- 172.21.15.133:0/2618374264 learned_addr learned my addr 172.21.15.133:0/2618374264 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:04:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a311a3700 1 --2- 172.21.15.133:0/2618374264 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a2c0b0c90 0x7f6a2c0ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a319a4700 1 --2- 172.21.15.133:0/2618374264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a2c0b5c00 0x7f6a2c142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a309a2700 1 -- 172.21.15.133:0/2618374264 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a2c0b0c90 msgr2=0x7f6a2c0ade60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a309a2700 1 --2- 172.21.15.133:0/2618374264 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a2c0b0c90 0x7f6a2c0ade60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a309a2700 1 -- 172.21.15.133:0/2618374264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a2c0b5c00 msgr2=0x7f6a2c142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:04:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a309a2700 1 --2- 172.21.15.133:0/2618374264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a2c0b5c00 0x7f6a2c142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:04:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a309a2700 1 -- 172.21.15.133:0/2618374264 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c067250 con 0x7f6a2c0b52c0 2021-01-03T13:04:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a319a4700 1 --2- 172.21.15.133:0/2618374264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a2c0b5c00 0x7f6a2c142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:04:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.786+0000 7f6a309a2700 1 --2- 172.21.15.133:0/2618374264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0b52c0 0x7f6a2c1425d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f6a1c000e90 tx=0x7f6a1c007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.790+0000 7f6a227fc700 1 -- 172.21.15.133:0/2618374264 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a1c0072e0 con 0x7f6a2c0b52c0 2021-01-03T13:04:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.790+0000 7f6a227fc700 1 -- 172.21.15.133:0/2618374264 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1c005520 con 0x7f6a2c0b52c0 2021-01-03T13:04:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.790+0000 7f6a321a5700 1 -- 172.21.15.133:0/2618374264 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c0aaa10 con 0x7f6a2c0b52c0 2021-01-03T13:04:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.790+0000 7f6a227fc700 1 -- 172.21.15.133:0/2618374264 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a1c005880 con 0x7f6a2c0b52c0 2021-01-03T13:04:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.790+0000 7f6a321a5700 1 -- 172.21.15.133:0/2618374264 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2c0af1f0 con 0x7f6a2c0b52c0 2021-01-03T13:04:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.790+0000 7f6a321a5700 1 -- 172.21.15.133:0/2618374264 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2c0ae690 con 0x7f6a2c0b52c0 2021-01-03T13:04:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.790+0000 7f6a227fc700 1 -- 172.21.15.133:0/2618374264 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6a1c010070 con 0x7f6a2c0b52c0 2021-01-03T13:04:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.790+0000 7f6a227fc700 1 --2- 172.21.15.133:0/2618374264 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a14055440 0x7f6a14057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:04:59.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.790+0000 7f6a227fc700 1 -- 172.21.15.133:0/2618374264 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f6a1c06d580 con 0x7f6a2c0b52c0 2021-01-03T13:04:59.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.790+0000 7f6a311a3700 1 --2- 172.21.15.133:0/2618374264 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a14055440 0x7f6a14057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:04:59.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.794+0000 7f6a311a3700 1 --2- 172.21.15.133:0/2618374264 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a14055440 0x7f6a14057900 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f6a2800b000 tx=0x7f6a280091a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:04:59.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.798+0000 7f6a227fc700 1 -- 172.21.15.133:0/2618374264 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6a1c043850 con 0x7f6a2c0b52c0 2021-01-03T13:04:59.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:04:59.978+0000 7f6a321a5700 1 -- 172.21.15.133:0/2618374264 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6a2c057300 con 0x7f6a2c0b52c0 2021-01-03T13:05:00.704 INFO:tasks.ceph.mon.b.smithi016.stderr:2021-01-03T13:05:00.702+0000 7fba5c9c4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-01-03T13:05:00.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.710+0000 7f6a227fc700 1 -- 172.21.15.133:0/2618374264 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6a1c018070 con 0x7f6a2c0b52c0 2021-01-03T13:05:00.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.710+0000 7f6a321a5700 1 -- 172.21.15.133:0/2618374264 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a14055440 msgr2=0x7f6a14057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:00.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.710+0000 7f6a321a5700 1 --2- 172.21.15.133:0/2618374264 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a14055440 0x7f6a14057900 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f6a2800b000 tx=0x7f6a280091a0).stop 2021-01-03T13:05:00.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.710+0000 7f6a321a5700 1 -- 172.21.15.133:0/2618374264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0b52c0 msgr2=0x7f6a2c1425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:00.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.710+0000 7f6a321a5700 1 --2- 172.21.15.133:0/2618374264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0b52c0 0x7f6a2c1425d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f6a1c000e90 tx=0x7f6a1c007a60).stop 2021-01-03T13:05:00.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.710+0000 7f6a321a5700 1 -- 172.21.15.133:0/2618374264 shutdown_connections 2021-01-03T13:05:00.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.710+0000 7f6a321a5700 1 --2- 172.21.15.133:0/2618374264 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a14055440 0x7f6a14057900 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:00.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.710+0000 7f6a321a5700 1 --2- 172.21.15.133:0/2618374264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a2c0b5c00 0x7f6a2c142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:00.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.710+0000 7f6a321a5700 1 --2- 172.21.15.133:0/2618374264 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a2c0b0c90 0x7f6a2c0ade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:00.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.710+0000 7f6a321a5700 1 --2- 172.21.15.133:0/2618374264 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a2c0b52c0 0x7f6a2c1425d0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:00.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.710+0000 7f6a321a5700 1 -- 172.21.15.133:0/2618374264 >> 172.21.15.133:0/2618374264 conn(0x7f6a2c05bdf0 msgr2=0x7f6a2c1434a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:00.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.714+0000 7f6a321a5700 1 -- 172.21.15.133:0/2618374264 shutdown_connections 2021-01-03T13:05:00.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.714+0000 7f6a321a5700 1 -- 172.21.15.133:0/2618374264 wait complete. 2021-01-03T13:05:00.719 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-01-03T13:05:00.732 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:05:00.745 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T13:05:00.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.838+0000 7fc996ef7700 1 Processor -- start 2021-01-03T13:05:00.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.838+0000 7fc996ef7700 1 -- start start 2021-01-03T13:05:00.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc996ef7700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc99005c840 0x7fc9900b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:00.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc996ef7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc99013c890 0x7fc99013cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:00.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc996ef7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc990140700 con 0x7fc99013fb40 2021-01-03T13:05:00.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc996ef7700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9900aa1f0 con 0x7fc99005c840 2021-01-03T13:05:00.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc996ef7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99005cc20 con 0x7fc99013c890 2021-01-03T13:05:00.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc995494700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc99013c890 0x7fc99013cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:00.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc98ffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc99013fb40 0x7fc99013fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57316/0 (socket says 172.21.15.133:57316) 2021-01-03T13:05:00.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc98ffff700 1 -- 172.21.15.133:0/458384254 learned_addr learned my addr 172.21.15.133:0/458384254 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:00.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc994c93700 1 --2- 172.21.15.133:0/458384254 >> v2:172.21.15.16:3300/0 conn(0x7fc99005c840 0x7fc9900b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:00.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc995494700 1 -- 172.21.15.133:0/458384254 >> v2:172.21.15.16:3300/0 conn(0x7fc99005c840 msgr2=0x7fc9900b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:00.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc995494700 1 --2- 172.21.15.133:0/458384254 >> v2:172.21.15.16:3300/0 conn(0x7fc99005c840 0x7fc9900b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:00.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc995494700 1 -- 172.21.15.133:0/458384254 >> v1:172.21.15.133:6789/0 conn(0x7fc99013fb40 legacy=0x7fc99013fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:00.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc995494700 1 -- 172.21.15.133:0/458384254 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc990143df0 con 0x7fc99013c890 2021-01-03T13:05:00.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc98f7fe700 1 -- 172.21.15.133:0/458384254 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607181275 0 0) 0x7fc9840010d0 con 0x7fc99013fb40 2021-01-03T13:05:00.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc995494700 1 --2- 172.21.15.133:0/458384254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc99013c890 0x7fc99013cd00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fc9900af650 tx=0x7fc9880091a0).ready entity=mon.1 client_cookie=18453cddf2298cb8 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:00.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc98f7fe700 1 -- 172.21.15.133:0/458384254 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc98800b960 con 0x7fc99013c890 2021-01-03T13:05:00.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc98f7fe700 1 -- 172.21.15.133:0/458384254 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98800bac0 con 0x7fc99013c890 2021-01-03T13:05:00.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc98f7fe700 1 -- 172.21.15.133:0/458384254 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc98800bc30 con 0x7fc99013c890 2021-01-03T13:05:00.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc996ef7700 1 -- 172.21.15.133:0/458384254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc99013c890 msgr2=0x7fc99013cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:00.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc996ef7700 1 --2- 172.21.15.133:0/458384254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc99013c890 0x7fc99013cd00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fc9900af650 tx=0x7fc9880091a0).stop 2021-01-03T13:05:00.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc996ef7700 1 -- 172.21.15.133:0/458384254 shutdown_connections 2021-01-03T13:05:00.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc996ef7700 1 --2- 172.21.15.133:0/458384254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc99013c890 0x7fc99013cd00 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:00.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc996ef7700 1 --2- 172.21.15.133:0/458384254 >> v2:172.21.15.16:3300/0 conn(0x7fc99005c840 0x7fc9900b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:00.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc996ef7700 1 -- 172.21.15.133:0/458384254 >> 172.21.15.133:0/458384254 conn(0x7fc99006aeb0 msgr2=0x7fc99005bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:00.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc996ef7700 1 -- 172.21.15.133:0/458384254 shutdown_connections 2021-01-03T13:05:00.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.842+0000 7fc996ef7700 1 -- 172.21.15.133:0/458384254 wait complete. 2021-01-03T13:05:00.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc996ef7700 1 Processor -- start 2021-01-03T13:05:00.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc996ef7700 1 -- start start 2021-01-03T13:05:00.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc996ef7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc99005c840 0x7fc9901381a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:00.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc996ef7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc99013c890 0x7fc990151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:00.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc996ef7700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc99013fb40 0x7fc990151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:00.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc996ef7700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9901510a0 con 0x7fc99013fb40 2021-01-03T13:05:00.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc996ef7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9900ac190 con 0x7fc99013c890 2021-01-03T13:05:00.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc996ef7700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc990151290 con 0x7fc99005c840 2021-01-03T13:05:00.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc98ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc99013c890 0x7fc990151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:00.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc98ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc99013c890 0x7fc990151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36290/0 (socket says 172.21.15.133:36290) 2021-01-03T13:05:00.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc98ffff700 1 -- 172.21.15.133:0/1031253123 learned_addr learned my addr 172.21.15.133:0/1031253123 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:00.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc994c93700 1 --2- 172.21.15.133:0/1031253123 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc99005c840 0x7fc9901381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc995494700 1 --2- 172.21.15.133:0/1031253123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc99013fb40 0x7fc990151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc98ffff700 1 -- 172.21.15.133:0/1031253123 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc99005c840 msgr2=0x7fc9901381a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc98ffff700 1 --2- 172.21.15.133:0/1031253123 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc99005c840 0x7fc9901381a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc98ffff700 1 -- 172.21.15.133:0/1031253123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc99013fb40 msgr2=0x7fc990151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:00.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc98ffff700 1 --2- 172.21.15.133:0/1031253123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc99013fb40 0x7fc990151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc98ffff700 1 -- 172.21.15.133:0/1031253123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc990140e10 con 0x7fc99013c890 2021-01-03T13:05:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc98ffff700 1 --2- 172.21.15.133:0/1031253123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc99013c890 0x7fc990151730 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fc984000e90 tx=0x7fc984007cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc98dffb700 1 -- 172.21.15.133:0/1031253123 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9840072e0 con 0x7fc99013c890 2021-01-03T13:05:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc98dffb700 1 -- 172.21.15.133:0/1031253123 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc984007440 con 0x7fc99013c890 2021-01-03T13:05:00.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc98dffb700 1 -- 172.21.15.133:0/1031253123 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9840057d0 con 0x7fc99013c890 2021-01-03T13:05:00.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc996ef7700 1 -- 172.21.15.133:0/1031253123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9900b4c50 con 0x7fc99013c890 2021-01-03T13:05:00.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.846+0000 7fc996ef7700 1 -- 172.21.15.133:0/1031253123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9900b6650 con 0x7fc99013c890 2021-01-03T13:05:00.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.850+0000 7fc996ef7700 1 -- 172.21.15.133:0/1031253123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9900ac350 con 0x7fc99013c890 2021-01-03T13:05:00.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.850+0000 7fc98dffb700 1 -- 172.21.15.133:0/1031253123 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc984010070 con 0x7fc99013c890 2021-01-03T13:05:00.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.850+0000 7fc98dffb700 1 --2- 172.21.15.133:0/1031253123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc970055330 0x7fc9700577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:00.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.850+0000 7fc98dffb700 1 -- 172.21.15.133:0/1031253123 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fc98406d560 con 0x7fc99013c890 2021-01-03T13:05:00.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.850+0000 7fc994c93700 1 --2- 172.21.15.133:0/1031253123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc970055330 0x7fc9700577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:00.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.850+0000 7fc994c93700 1 --2- 172.21.15.133:0/1031253123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc970055330 0x7fc9700577f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fc98000b000 tx=0x7fc980008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:00.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:00.854+0000 7fc98dffb700 1 -- 172.21.15.133:0/1031253123 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc9840437e0 con 0x7fc99013c890 2021-01-03T13:05:01.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.038+0000 7fc996ef7700 1 -- 172.21.15.133:0/1031253123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc990140700 con 0x7fc99013c890 2021-01-03T13:05:01.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.038+0000 7fc98dffb700 1 -- 172.21.15.133:0/1031253123 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2132 (secure 0 0 0) 0x7fc990140700 con 0x7fc99013c890 2021-01-03T13:05:01.041 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:01.041 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":34,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6099,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/524155035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":524155035},{"type":"v1","addr":"172.21.15.16:6833","nonce":524155035}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":31},{"gid":6175,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1381538323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1381538323},{"type":"v1","addr":"172.21.15.133:6835","nonce":1381538323}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:03:59.914082+0000","modified":"2021-01-03T13:05:00.704639+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2021-01-03T13:05:01.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.038+0000 7fc996ef7700 1 -- 172.21.15.133:0/1031253123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc970055330 msgr2=0x7fc9700577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:01.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.038+0000 7fc996ef7700 1 --2- 172.21.15.133:0/1031253123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc970055330 0x7fc9700577f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fc98000b000 tx=0x7fc980008040).stop 2021-01-03T13:05:01.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.038+0000 7fc996ef7700 1 -- 172.21.15.133:0/1031253123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc99013c890 msgr2=0x7fc990151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:01.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.038+0000 7fc996ef7700 1 --2- 172.21.15.133:0/1031253123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc99013c890 0x7fc990151730 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fc984000e90 tx=0x7fc984007cb0).stop 2021-01-03T13:05:01.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.038+0000 7fc996ef7700 1 -- 172.21.15.133:0/1031253123 shutdown_connections 2021-01-03T13:05:01.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.038+0000 7fc996ef7700 1 --2- 172.21.15.133:0/1031253123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc970055330 0x7fc9700577f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:01.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.038+0000 7fc996ef7700 1 --2- 172.21.15.133:0/1031253123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc99013fb40 0x7fc990151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:01.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.038+0000 7fc996ef7700 1 --2- 172.21.15.133:0/1031253123 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc99005c840 0x7fc9901381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:01.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.038+0000 7fc996ef7700 1 --2- 172.21.15.133:0/1031253123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc99013c890 0x7fc990151730 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:01.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.038+0000 7fc996ef7700 1 -- 172.21.15.133:0/1031253123 >> 172.21.15.133:0/1031253123 conn(0x7fc99006aeb0 msgr2=0x7fc99013e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.038+0000 7fc996ef7700 1 -- 172.21.15.133:0/1031253123 shutdown_connections 2021-01-03T13:05:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.038+0000 7fc996ef7700 1 -- 172.21.15.133:0/1031253123 wait complete. 2021-01-03T13:05:01.046 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 34 2021-01-03T13:05:01.055 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-01-03T13:05:01.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.214+0000 7fdcc9ae0700 1 Processor -- start 2021-01-03T13:05:01.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.214+0000 7fdcc9ae0700 1 -- start start 2021-01-03T13:05:01.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc9ae0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcc405f920 0x7fdcc40b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:01.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc9ae0700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc405fd00 con 0x7fdcc4066f30 2021-01-03T13:05:01.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc9ae0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc40accd0 con 0x7fdcc40b1590 2021-01-03T13:05:01.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc9ae0700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40b2980 con 0x7fdcc405f920 2021-01-03T13:05:01.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc92df700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdcc40b1590 0x7fdcc413ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57332/0 (socket says 172.21.15.133:57332) 2021-01-03T13:05:01.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc92df700 1 -- 172.21.15.133:0/2293372367 learned_addr learned my addr 172.21.15.133:0/2293372367 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:01.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc8ade700 1 --2- 172.21.15.133:0/2293372367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcc405f920 0x7fdcc40b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:01.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 -- 172.21.15.133:0/2293372367 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423996232 0 0) 0x7fdcc40accd0 con 0x7fdcc40b1590 2021-01-03T13:05:01.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 -- 172.21.15.133:0/2293372367 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdca4003230 con 0x7fdcc40b1590 2021-01-03T13:05:01.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 -- 172.21.15.133:0/2293372367 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781492812 0 0) 0x7fdcc405fd00 con 0x7fdcc4066f30 2021-01-03T13:05:01.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 -- 172.21.15.133:0/2293372367 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcc40accd0 con 0x7fdcc4066f30 2021-01-03T13:05:01.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 -- 172.21.15.133:0/2293372367 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2026573612 0 0) 0x7fdca4003230 con 0x7fdcc40b1590 2021-01-03T13:05:01.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 -- 172.21.15.133:0/2293372367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcc405f920 msgr2=0x7fdcc40b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:01.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 --2- 172.21.15.133:0/2293372367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcc405f920 0x7fdcc40b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:01.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 -- 172.21.15.133:0/2293372367 >> v1:172.21.15.16:6789/0 conn(0x7fdcc4066f30 legacy=0x7fdcc40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:01.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 -- 172.21.15.133:0/2293372367 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc40acf70 con 0x7fdcc40b1590 2021-01-03T13:05:01.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 -- 172.21.15.133:0/2293372367 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fdcbc0016d0 con 0x7fdcc40b1590 2021-01-03T13:05:01.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 -- 172.21.15.133:0/2293372367 >> v1:172.21.15.133:6789/0 conn(0x7fdcc40b1590 legacy=0x7fdcc413ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:01.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 --2- 172.21.15.133:0/2293372367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca40038b0 0x7fdca4003cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:01.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 --2- 172.21.15.133:0/2293372367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcc405f920 0x7fdca40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:01.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 --2- 172.21.15.133:0/2293372367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca40049c0 0x7fdca4004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:01.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 -- 172.21.15.133:0/2293372367 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40b2980 con 0x7fdca40038b0 2021-01-03T13:05:01.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 -- 172.21.15.133:0/2293372367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca4005360 con 0x7fdca40049c0 2021-01-03T13:05:01.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 -- 172.21.15.133:0/2293372367 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca400d980 con 0x7fdcc405f920 2021-01-03T13:05:01.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc92df700 1 --2- 172.21.15.133:0/2293372367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca40049c0 0x7fdca4004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:01.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc3fff700 1 --2- 172.21.15.133:0/2293372367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcc405f920 0x7fdca40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:01.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc8ade700 1 --2- 172.21.15.133:0/2293372367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca40038b0 0x7fdca4003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:01.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc92df700 1 -- 172.21.15.133:0/2293372367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcc405f920 msgr2=0x7fdca40044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:01.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc92df700 1 --2- 172.21.15.133:0/2293372367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcc405f920 0x7fdca40044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:01.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc92df700 1 -- 172.21.15.133:0/2293372367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca40038b0 msgr2=0x7fdca4003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:01.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc92df700 1 --2- 172.21.15.133:0/2293372367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca40038b0 0x7fdca4003cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:01.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc92df700 1 -- 172.21.15.133:0/2293372367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca4003230 con 0x7fdca40049c0 2021-01-03T13:05:01.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc92df700 1 --2- 172.21.15.133:0/2293372367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca40049c0 0x7fdca4004e40 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7fdcbc0014a0 tx=0x7fdcc40af0e0).ready entity=mon.1 client_cookie=2b72f19860dee4f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:01.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 -- 172.21.15.133:0/2293372367 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcbc00cde0 con 0x7fdca40049c0 2021-01-03T13:05:01.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 -- 172.21.15.133:0/2293372367 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc0070d0 con 0x7fdca40049c0 2021-01-03T13:05:01.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc37fe700 1 -- 172.21.15.133:0/2293372367 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcbc007430 con 0x7fdca40049c0 2021-01-03T13:05:01.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc9ae0700 1 -- 172.21.15.133:0/2293372367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca40049c0 msgr2=0x7fdca4004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc9ae0700 1 --2- 172.21.15.133:0/2293372367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca40049c0 0x7fdca4004e40 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7fdcbc0014a0 tx=0x7fdcc40af0e0).stop 2021-01-03T13:05:01.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc92df700 1 -- 172.21.15.133:0/2293372367 reap_dead start 2021-01-03T13:05:01.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc9ae0700 1 -- 172.21.15.133:0/2293372367 shutdown_connections 2021-01-03T13:05:01.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc9ae0700 1 -- 172.21.15.133:0/2293372367 >> 172.21.15.133:0/2293372367 conn(0x7fdcc40b6110 msgr2=0x7fdcc40b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:01.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc9ae0700 1 -- 172.21.15.133:0/2293372367 shutdown_connections 2021-01-03T13:05:01.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.218+0000 7fdcc9ae0700 1 -- 172.21.15.133:0/2293372367 wait complete. 2021-01-03T13:05:01.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.222+0000 7fdcc9ae0700 1 Processor -- start 2021-01-03T13:05:01.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.222+0000 7fdcc9ae0700 1 -- start start 2021-01-03T13:05:01.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc9ae0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcc413c340 0x7fdcc413b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:01.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc9ae0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc413cc30 0x7fdcc413d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:01.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc9ae0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcc4138870 0x7fdcc4138cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:01.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc9ae0700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc413bab0 con 0x7fdcc4138870 2021-01-03T13:05:01.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc9ae0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc413c720 con 0x7fdcc413cc30 2021-01-03T13:05:01.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc9ae0700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc413bce0 con 0x7fdcc413c340 2021-01-03T13:05:01.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc413cc30 0x7fdcc413d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:01.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc413cc30 0x7fdcc413d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36310/0 (socket says 172.21.15.133:36310) 2021-01-03T13:05:01.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc3fff700 1 -- 172.21.15.133:0/3702622093 learned_addr learned my addr 172.21.15.133:0/3702622093 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:01.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc92df700 1 --2- 172.21.15.133:0/3702622093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcc4138870 0x7fdcc4138cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:01.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc8ade700 1 --2- 172.21.15.133:0/3702622093 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcc413c340 0x7fdcc413b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:01.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc3fff700 1 -- 172.21.15.133:0/3702622093 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcc413c340 msgr2=0x7fdcc413b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:01.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc3fff700 1 --2- 172.21.15.133:0/3702622093 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcc413c340 0x7fdcc413b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:01.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc3fff700 1 -- 172.21.15.133:0/3702622093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcc4138870 msgr2=0x7fdcc4138cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:01.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc3fff700 1 --2- 172.21.15.133:0/3702622093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcc4138870 0x7fdcc4138cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:01.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc3fff700 1 -- 172.21.15.133:0/3702622093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc413f8d0 con 0x7fdcc413cc30 2021-01-03T13:05:01.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc92df700 1 --2- 172.21.15.133:0/3702622093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcc4138870 0x7fdcc4138cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:01.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc3fff700 1 --2- 172.21.15.133:0/3702622093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc413cc30 0x7fdcc413d090 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fdcc414d8a0 tx=0x7fdcac007b60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:01.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc1ffb700 1 -- 172.21.15.133:0/3702622093 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcac00fc10 con 0x7fdcc413cc30 2021-01-03T13:05:01.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc1ffb700 1 -- 172.21.15.133:0/3702622093 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac00fd70 con 0x7fdcc413cc30 2021-01-03T13:05:01.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc9ae0700 1 -- 172.21.15.133:0/3702622093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc413fb70 con 0x7fdcc413cc30 2021-01-03T13:05:01.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc1ffb700 1 -- 172.21.15.133:0/3702622093 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcac00fee0 con 0x7fdcc413cc30 2021-01-03T13:05:01.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc9ae0700 1 -- 172.21.15.133:0/3702622093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc41408b0 con 0x7fdcc413cc30 2021-01-03T13:05:01.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc9ae0700 1 -- 172.21.15.133:0/3702622093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc40665b0 con 0x7fdcc413cc30 2021-01-03T13:05:01.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc1ffb700 1 -- 172.21.15.133:0/3702622093 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fdcac01b030 con 0x7fdcc413cc30 2021-01-03T13:05:01.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.226+0000 7fdcc1ffb700 1 --2- 172.21.15.133:0/3702622093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdca80554e0 0x7fdca80579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:01.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.230+0000 7fdcc1ffb700 1 -- 172.21.15.133:0/3702622093 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fdcac06e260 con 0x7fdcc413cc30 2021-01-03T13:05:01.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.230+0000 7fdcc8ade700 1 --2- 172.21.15.133:0/3702622093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdca80554e0 0x7fdca80579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:01.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.230+0000 7fdcc8ade700 1 --2- 172.21.15.133:0/3702622093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdca80554e0 0x7fdca80579a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fdcb400b000 tx=0x7fdcb4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:01.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.234+0000 7fdcc1ffb700 1 -- 172.21.15.133:0/3702622093 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdcac0444e0 con 0x7fdcc413cc30 2021-01-03T13:05:01.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:01.422+0000 7fdcc9ae0700 1 -- 172.21.15.133:0/3702622093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdcc413fd00 con 0x7fdcc413cc30 2021-01-03T13:05:02.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.406+0000 7fdcc1ffb700 1 -- 172.21.15.133:0/3702622093 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdcac047b00 con 0x7fdcc413cc30 2021-01-03T13:05:02.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.410+0000 7fdcc9ae0700 1 -- 172.21.15.133:0/3702622093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdca80554e0 msgr2=0x7fdca80579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:02.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.410+0000 7fdcc9ae0700 1 --2- 172.21.15.133:0/3702622093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdca80554e0 0x7fdca80579a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fdcb400b000 tx=0x7fdcb4008040).stop 2021-01-03T13:05:02.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.410+0000 7fdcc9ae0700 1 -- 172.21.15.133:0/3702622093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc413cc30 msgr2=0x7fdcc413d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:02.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.410+0000 7fdcc9ae0700 1 --2- 172.21.15.133:0/3702622093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc413cc30 0x7fdcc413d090 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fdcc414d8a0 tx=0x7fdcac007b60).stop 2021-01-03T13:05:02.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.410+0000 7fdcc9ae0700 1 -- 172.21.15.133:0/3702622093 shutdown_connections 2021-01-03T13:05:02.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.410+0000 7fdcc9ae0700 1 --2- 172.21.15.133:0/3702622093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdca80554e0 0x7fdca80579a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:02.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.410+0000 7fdcc9ae0700 1 --2- 172.21.15.133:0/3702622093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcc4138870 0x7fdcc4138cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:02.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.410+0000 7fdcc9ae0700 1 --2- 172.21.15.133:0/3702622093 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcc413c340 0x7fdcc413b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:02.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.410+0000 7fdcc9ae0700 1 --2- 172.21.15.133:0/3702622093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcc413cc30 0x7fdcc413d090 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:02.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.410+0000 7fdcc9ae0700 1 -- 172.21.15.133:0/3702622093 >> 172.21.15.133:0/3702622093 conn(0x7fdcc40b6110 msgr2=0x7fdcc40b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:02.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.410+0000 7fdcc9ae0700 1 -- 172.21.15.133:0/3702622093 shutdown_connections 2021-01-03T13:05:02.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.410+0000 7fdcc9ae0700 1 -- 172.21.15.133:0/3702622093 wait complete. 2021-01-03T13:05:02.430 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-01-03T13:05:02.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.550+0000 7fdbdccdf700 1 Processor -- start 2021-01-03T13:05:02.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.550+0000 7fdbdccdf700 1 -- start start 2021-01-03T13:05:02.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbdccdf700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdbd80b5260 0x7fdbd81470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:02.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbdccdf700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdbd80b5c00 0x7fdbd81475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:02.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbdccdf700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd80b0c10 con 0x7fdbd81442a0 2021-01-03T13:05:02.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbdccdf700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd80b5640 con 0x7fdbd80b5c00 2021-01-03T13:05:02.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbdccdf700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd809a4f0 con 0x7fdbd80b5260 2021-01-03T13:05:02.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbd6ffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdbd80b5c00 0x7fdbd81475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:02.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbd77fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdbd80b5260 0x7fdbd81470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:02.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbd7fff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fdbd81442a0 0x7fdbd8144750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:36080/0 (socket says 172.21.15.133:36080) 2021-01-03T13:05:02.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbd6ffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdbd80b5c00 0x7fdbd81475a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:34856/0 (socket says 172.21.15.133:34856) 2021-01-03T13:05:02.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbd77fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdbd80b5260 0x7fdbd81470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:44620/0 (socket says 172.21.15.133:44620) 2021-01-03T13:05:02.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbd7fff700 1 -- 172.21.15.133:0/1175690745 learned_addr learned my addr 172.21.15.133:0/1175690745 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:02.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbd77fe700 1 -- 172.21.15.133:0/1175690745 >> v2:172.21.15.16:3300/0 conn(0x7fdbd80b5c00 msgr2=0x7fdbd81475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:02.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbd77fe700 1 --2- 172.21.15.133:0/1175690745 >> v2:172.21.15.16:3300/0 conn(0x7fdbd80b5c00 0x7fdbd81475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:02.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbd77fe700 1 -- 172.21.15.133:0/1175690745 >> v1:172.21.15.16:6789/0 conn(0x7fdbd81442a0 legacy=0x7fdbd8144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:02.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbd77fe700 1 -- 172.21.15.133:0/1175690745 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd80b0e40 con 0x7fdbd80b5260 2021-01-03T13:05:02.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbd6ffd700 1 --2- 172.21.15.133:0/1175690745 >> v2:172.21.15.16:3300/0 conn(0x7fdbd80b5c00 0x7fdbd81475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:02.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbd77fe700 1 --2- 172.21.15.133:0/1175690745 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdbd80b5260 0x7fdbd81470b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fdbd00010d0 tx=0x7fdbc80091a0).ready entity=mon.2 client_cookie=35d8e6af8ebf37c3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:02.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbd67fc700 1 -- 172.21.15.133:0/1175690745 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbc800b860 con 0x7fdbd80b5260 2021-01-03T13:05:02.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbd67fc700 1 -- 172.21.15.133:0/1175690745 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc800b9c0 con 0x7fdbd80b5260 2021-01-03T13:05:02.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbd67fc700 1 -- 172.21.15.133:0/1175690745 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbc800bb30 con 0x7fdbd80b5260 2021-01-03T13:05:02.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbdccdf700 1 -- 172.21.15.133:0/1175690745 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdbd80b5260 msgr2=0x7fdbd81470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:02.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbdccdf700 1 --2- 172.21.15.133:0/1175690745 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdbd80b5260 0x7fdbd81470b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fdbd00010d0 tx=0x7fdbc80091a0).stop 2021-01-03T13:05:02.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbdccdf700 1 -- 172.21.15.133:0/1175690745 shutdown_connections 2021-01-03T13:05:02.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbdccdf700 1 --2- 172.21.15.133:0/1175690745 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdbd80b5260 0x7fdbd81470b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:02.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbdccdf700 1 --2- 172.21.15.133:0/1175690745 >> v2:172.21.15.16:3300/0 conn(0x7fdbd80b5c00 0x7fdbd81475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:02.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbdccdf700 1 -- 172.21.15.133:0/1175690745 >> 172.21.15.133:0/1175690745 conn(0x7fdbd805bdf0 msgr2=0x7fdbd805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:02.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbdccdf700 1 -- 172.21.15.133:0/1175690745 shutdown_connections 2021-01-03T13:05:02.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.554+0000 7fdbdccdf700 1 -- 172.21.15.133:0/1175690745 wait complete. 2021-01-03T13:05:02.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.558+0000 7fdbdccdf700 1 Processor -- start 2021-01-03T13:05:02.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.558+0000 7fdbdccdf700 1 -- start start 2021-01-03T13:05:02.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.558+0000 7fdbdccdf700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbd80b5260 0x7fdbd805f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:02.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.558+0000 7fdbdccdf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbd80b5c00 0x7fdbd8159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:02.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.558+0000 7fdbdccdf700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdbd81442a0 0x7fdbd8155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:02.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.558+0000 7fdbdccdf700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd8066d70 con 0x7fdbd80b5260 2021-01-03T13:05:02.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.558+0000 7fdbdccdf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd8159460 con 0x7fdbd80b5c00 2021-01-03T13:05:02.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.558+0000 7fdbdccdf700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd8159700 con 0x7fdbd81442a0 2021-01-03T13:05:02.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.558+0000 7fdbd6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbd80b5c00 0x7fdbd8159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:02.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.558+0000 7fdbd7fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdbd81442a0 0x7fdbd8155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:02.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.558+0000 7fdbd6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbd80b5c00 0x7fdbd8159e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36324/0 (socket says 172.21.15.133:36324) 2021-01-03T13:05:02.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.558+0000 7fdbd6ffd700 1 -- 172.21.15.133:0/1907408718 learned_addr learned my addr 172.21.15.133:0/1907408718 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:02.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.558+0000 7fdbd77fe700 1 --2- 172.21.15.133:0/1907408718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbd80b5260 0x7fdbd805f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:02.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.558+0000 7fdbd6ffd700 1 -- 172.21.15.133:0/1907408718 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdbd81442a0 msgr2=0x7fdbd8155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:02.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.558+0000 7fdbd6ffd700 1 --2- 172.21.15.133:0/1907408718 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdbd81442a0 0x7fdbd8155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:02.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.562+0000 7fdbd6ffd700 1 -- 172.21.15.133:0/1907408718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbd80b5260 msgr2=0x7fdbd805f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:02.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.562+0000 7fdbd6ffd700 1 --2- 172.21.15.133:0/1907408718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbd80b5260 0x7fdbd805f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:02.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.562+0000 7fdbd6ffd700 1 -- 172.21.15.133:0/1907408718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd81599a0 con 0x7fdbd80b5c00 2021-01-03T13:05:02.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.562+0000 7fdbd6ffd700 1 --2- 172.21.15.133:0/1907408718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbd80b5c00 0x7fdbd8159e40 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fdbd8065c20 tx=0x7fdbc0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:02.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.562+0000 7fdbd4ff9700 1 -- 172.21.15.133:0/1907408718 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbc000c8f0 con 0x7fdbd80b5c00 2021-01-03T13:05:02.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.562+0000 7fdbd4ff9700 1 -- 172.21.15.133:0/1907408718 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc000ca50 con 0x7fdbd80b5c00 2021-01-03T13:05:02.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.562+0000 7fdbdccdf700 1 -- 172.21.15.133:0/1907408718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd81482f0 con 0x7fdbd80b5c00 2021-01-03T13:05:02.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.562+0000 7fdbd4ff9700 1 -- 172.21.15.133:0/1907408718 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbc000cdb0 con 0x7fdbd80b5c00 2021-01-03T13:05:02.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.562+0000 7fdbdccdf700 1 -- 172.21.15.133:0/1907408718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd81564b0 con 0x7fdbd80b5c00 2021-01-03T13:05:02.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.562+0000 7fdbd4ff9700 1 -- 172.21.15.133:0/1907408718 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fdbc0022070 con 0x7fdbd80b5c00 2021-01-03T13:05:02.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.562+0000 7fdbdccdf700 1 -- 172.21.15.133:0/1907408718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd8159b30 con 0x7fdbd80b5c00 2021-01-03T13:05:02.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.562+0000 7fdbd4ff9700 1 --2- 172.21.15.133:0/1907408718 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdbbc0554e0 0x7fdbbc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:02.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.562+0000 7fdbd4ff9700 1 -- 172.21.15.133:0/1907408718 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fdbc006e4f0 con 0x7fdbd80b5c00 2021-01-03T13:05:02.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.562+0000 7fdbd77fe700 1 --2- 172.21.15.133:0/1907408718 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdbbc0554e0 0x7fdbbc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:02.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.566+0000 7fdbd77fe700 1 --2- 172.21.15.133:0/1907408718 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdbbc0554e0 0x7fdbbc0579a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fdbc801b000 tx=0x7fdbc8016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:02.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.570+0000 7fdbd4ff9700 1 -- 172.21.15.133:0/1907408718 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdbc0044770 con 0x7fdbd80b5c00 2021-01-03T13:05:02.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:02.706+0000 7fdbdccdf700 1 -- 172.21.15.133:0/1907408718 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdbd8057300 con 0x7fdbd80b5c00 2021-01-03T13:05:03.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.426+0000 7fdbd4ff9700 1 -- 172.21.15.133:0/1907408718 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v82) v1 ==== 185+0+0 (secure 0 0 0) 0x7fdbc0047d90 con 0x7fdbd80b5c00 2021-01-03T13:05:03.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.430+0000 7fdbdccdf700 1 -- 172.21.15.133:0/1907408718 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdbbc0554e0 msgr2=0x7fdbbc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:03.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.430+0000 7fdbdccdf700 1 --2- 172.21.15.133:0/1907408718 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdbbc0554e0 0x7fdbbc0579a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fdbc801b000 tx=0x7fdbc8016000).stop 2021-01-03T13:05:03.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.430+0000 7fdbdccdf700 1 -- 172.21.15.133:0/1907408718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbd80b5c00 msgr2=0x7fdbd8159e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:03.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.430+0000 7fdbdccdf700 1 --2- 172.21.15.133:0/1907408718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbd80b5c00 0x7fdbd8159e40 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fdbd8065c20 tx=0x7fdbc0008040).stop 2021-01-03T13:05:03.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.430+0000 7fdbdccdf700 1 -- 172.21.15.133:0/1907408718 shutdown_connections 2021-01-03T13:05:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.430+0000 7fdbdccdf700 1 --2- 172.21.15.133:0/1907408718 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdbbc0554e0 0x7fdbbc0579a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.430+0000 7fdbdccdf700 1 --2- 172.21.15.133:0/1907408718 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdbd80b5260 0x7fdbd805f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.430+0000 7fdbdccdf700 1 --2- 172.21.15.133:0/1907408718 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdbd81442a0 0x7fdbd8155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.430+0000 7fdbdccdf700 1 --2- 172.21.15.133:0/1907408718 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbd80b5c00 0x7fdbd8159e40 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.430+0000 7fdbdccdf700 1 -- 172.21.15.133:0/1907408718 >> 172.21.15.133:0/1907408718 conn(0x7fdbd805bdf0 msgr2=0x7fdbd80aace0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:03.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.430+0000 7fdbdccdf700 1 -- 172.21.15.133:0/1907408718 shutdown_connections 2021-01-03T13:05:03.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.430+0000 7fdbdccdf700 1 -- 172.21.15.133:0/1907408718 wait complete. 2021-01-03T13:05:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2021-01-03T13:05:03.448 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-01-03T13:05:03.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.558+0000 7f8f1c67d700 1 Processor -- start 2021-01-03T13:05:03.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.558+0000 7f8f1c67d700 1 -- start start 2021-01-03T13:05:03.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1c67d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f140b0470 0x7f8f1405bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:03.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1c67d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1405cf20 con 0x7f8f14140410 2021-01-03T13:05:03.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1c67d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f14146580 con 0x7f8f141407f0 2021-01-03T13:05:03.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1c67d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f140b02d0 con 0x7f8f140b0470 2021-01-03T13:05:03.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19c18700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8f141407f0 0x7f8f14142dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57364/0 (socket says 172.21.15.133:57364) 2021-01-03T13:05:03.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19c18700 1 -- 172.21.15.133:0/3749196586 learned_addr learned my addr 172.21.15.133:0/3749196586 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:03.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1ac1a700 1 --2- 172.21.15.133:0/3749196586 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f140b0470 0x7f8f1405bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 -- 172.21.15.133:0/3749196586 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88722673 0 0) 0x7f8f14146580 con 0x7f8f141407f0 2021-01-03T13:05:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 -- 172.21.15.133:0/3749196586 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8efc003230 con 0x7f8f141407f0 2021-01-03T13:05:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 -- 172.21.15.133:0/3749196586 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599243191 0 0) 0x7f8f1405cf20 con 0x7f8f14140410 2021-01-03T13:05:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 -- 172.21.15.133:0/3749196586 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f14146580 con 0x7f8f14140410 2021-01-03T13:05:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 -- 172.21.15.133:0/3749196586 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2608584653 0 0) 0x7f8efc003230 con 0x7f8f141407f0 2021-01-03T13:05:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 -- 172.21.15.133:0/3749196586 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f140b0470 msgr2=0x7f8f1405bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 --2- 172.21.15.133:0/3749196586 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f140b0470 0x7f8f1405bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 -- 172.21.15.133:0/3749196586 >> v1:172.21.15.16:6789/0 conn(0x7f8f14140410 legacy=0x7f8f14146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:03.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 -- 172.21.15.133:0/3749196586 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f14146820 con 0x7f8f141407f0 2021-01-03T13:05:03.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 -- 172.21.15.133:0/3749196586 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f8f100016d0 con 0x7f8f141407f0 2021-01-03T13:05:03.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 -- 172.21.15.133:0/3749196586 >> v1:172.21.15.133:6789/0 conn(0x7f8f141407f0 legacy=0x7f8f14142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:03.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 --2- 172.21.15.133:0/3749196586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8efc0038b0 0x7f8efc003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:03.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 --2- 172.21.15.133:0/3749196586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8efc0044d0 0x7f8efc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:03.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 --2- 172.21.15.133:0/3749196586 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f140b0470 0x7f8efc004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:03.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 -- 172.21.15.133:0/3749196586 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc005330 con 0x7f8efc0044d0 2021-01-03T13:05:03.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1a419700 1 --2- 172.21.15.133:0/3749196586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8efc0038b0 0x7f8efc003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:03.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 -- 172.21.15.133:0/3749196586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc00b720 con 0x7f8efc0038b0 2021-01-03T13:05:03.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 -- 172.21.15.133:0/3749196586 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc00b8b0 con 0x7f8f140b0470 2021-01-03T13:05:03.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19c18700 1 --2- 172.21.15.133:0/3749196586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8efc0044d0 0x7f8efc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:03.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1ac1a700 1 --2- 172.21.15.133:0/3749196586 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f140b0470 0x7f8efc004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:03.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1a419700 1 -- 172.21.15.133:0/3749196586 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f140b0470 msgr2=0x7f8efc004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:03.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1a419700 1 --2- 172.21.15.133:0/3749196586 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f140b0470 0x7f8efc004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:03.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1a419700 1 -- 172.21.15.133:0/3749196586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8efc0044d0 msgr2=0x7f8efc004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:03.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1a419700 1 --2- 172.21.15.133:0/3749196586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8efc0044d0 0x7f8efc004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:03.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1a419700 1 -- 172.21.15.133:0/3749196586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc003230 con 0x7f8efc0038b0 2021-01-03T13:05:03.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1a419700 1 --2- 172.21.15.133:0/3749196586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8efc0038b0 0x7f8efc003cb0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f8efc0054a0 tx=0x7f8f04007b60).ready entity=mon.1 client_cookie=f2b1f9c63a4691f6 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:03.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 -- 172.21.15.133:0/3749196586 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f0400c7d0 con 0x7f8efc0038b0 2021-01-03T13:05:03.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 -- 172.21.15.133:0/3749196586 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0400c930 con 0x7f8efc0038b0 2021-01-03T13:05:03.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f19417700 1 -- 172.21.15.133:0/3749196586 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f0400cc90 con 0x7f8efc0038b0 2021-01-03T13:05:03.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1c67d700 1 -- 172.21.15.133:0/3749196586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8efc0038b0 msgr2=0x7f8efc003cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:03.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1c67d700 1 --2- 172.21.15.133:0/3749196586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8efc0038b0 0x7f8efc003cb0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f8efc0054a0 tx=0x7f8f04007b60).stop 2021-01-03T13:05:03.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1ac1a700 1 -- 172.21.15.133:0/3749196586 reap_dead start 2021-01-03T13:05:03.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1c67d700 1 -- 172.21.15.133:0/3749196586 shutdown_connections 2021-01-03T13:05:03.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1c67d700 1 -- 172.21.15.133:0/3749196586 >> 172.21.15.133:0/3749196586 conn(0x7f8f140b95d0 msgr2=0x7f8f140b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:03.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1c67d700 1 -- 172.21.15.133:0/3749196586 shutdown_connections 2021-01-03T13:05:03.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.562+0000 7f8f1c67d700 1 -- 172.21.15.133:0/3749196586 wait complete. 2021-01-03T13:05:03.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f1c67d700 1 Processor -- start 2021-01-03T13:05:03.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f1c67d700 1 -- start start 2021-01-03T13:05:03.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f1c67d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f140b7a20 0x7f8f14151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:03.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f1c67d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140b17e0 0x7f8f14155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:03.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f1c67d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f14155e60 0x7f8f1409ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:03.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f1c67d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f141552a0 con 0x7f8f14155e60 2021-01-03T13:05:03.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f1c67d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f140b7e00 con 0x7f8f140b17e0 2021-01-03T13:05:03.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f1c67d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f140914f0 con 0x7f8f140b7a20 2021-01-03T13:05:03.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f19c18700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140b17e0 0x7f8f14155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:03.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f19c18700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140b17e0 0x7f8f14155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36344/0 (socket says 172.21.15.133:36344) 2021-01-03T13:05:03.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f19c18700 1 -- 172.21.15.133:0/102674090 learned_addr learned my addr 172.21.15.133:0/102674090 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:03.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f1a419700 1 --2- 172.21.15.133:0/102674090 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f140b7a20 0x7f8f14151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:03.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f1ac1a700 1 --2- 172.21.15.133:0/102674090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f14155e60 0x7f8f1409ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:03.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f19c18700 1 -- 172.21.15.133:0/102674090 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f140b7a20 msgr2=0x7f8f14151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:03.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f19c18700 1 --2- 172.21.15.133:0/102674090 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f140b7a20 0x7f8f14151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:03.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f19c18700 1 -- 172.21.15.133:0/102674090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f14155e60 msgr2=0x7f8f1409ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:03.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f19c18700 1 --2- 172.21.15.133:0/102674090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f14155e60 0x7f8f1409ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:03.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f19c18700 1 -- 172.21.15.133:0/102674090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f140b1040 con 0x7f8f140b17e0 2021-01-03T13:05:03.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.566+0000 7f8f19c18700 1 --2- 172.21.15.133:0/102674090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140b17e0 0x7f8f14155970 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f8f100018b0 tx=0x7f8f140af150).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:03.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.570+0000 7f8f037fe700 1 -- 172.21.15.133:0/102674090 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f1000fa90 con 0x7f8f140b17e0 2021-01-03T13:05:03.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.570+0000 7f8f037fe700 1 -- 172.21.15.133:0/102674090 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1000fbf0 con 0x7f8f140b17e0 2021-01-03T13:05:03.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.570+0000 7f8f1c67d700 1 -- 172.21.15.133:0/102674090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f141554d0 con 0x7f8f140b17e0 2021-01-03T13:05:03.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.570+0000 7f8f037fe700 1 -- 172.21.15.133:0/102674090 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f10012350 con 0x7f8f140b17e0 2021-01-03T13:05:03.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.570+0000 7f8f1c67d700 1 -- 172.21.15.133:0/102674090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f140b0cc0 con 0x7f8f140b17e0 2021-01-03T13:05:03.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.570+0000 7f8f1c67d700 1 -- 172.21.15.133:0/102674090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f14057300 con 0x7f8f140b17e0 2021-01-03T13:05:03.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.570+0000 7f8f037fe700 1 -- 172.21.15.133:0/102674090 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8f100124b0 con 0x7f8f140b17e0 2021-01-03T13:05:03.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.570+0000 7f8f037fe700 1 --2- 172.21.15.133:0/102674090 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ef40553b0 0x7f8ef4057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:03.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.570+0000 7f8f037fe700 1 -- 172.21.15.133:0/102674090 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5764+0+0 (secure 0 0 0) 0x7f8f1006d760 con 0x7f8f140b17e0 2021-01-03T13:05:03.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.570+0000 7f8f1a419700 1 --2- 172.21.15.133:0/102674090 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ef40553b0 0x7f8ef4057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:03.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.574+0000 7f8f1a419700 1 --2- 172.21.15.133:0/102674090 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ef40553b0 0x7f8ef4057870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f8f04019000 tx=0x7f8f04017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:03.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.578+0000 7f8f037fe700 1 -- 172.21.15.133:0/102674090 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8f10043a90 con 0x7f8f140b17e0 2021-01-03T13:05:03.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:03.718+0000 7f8f1c67d700 1 -- 172.21.15.133:0/102674090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8f1405d270 con 0x7f8f140b17e0 2021-01-03T13:05:04.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.434+0000 7f8f037fe700 1 -- 172.21.15.133:0/102674090 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v83) v1 ==== 173+0+0 (secure 0 0 0) 0x7f8f10019070 con 0x7f8f140b17e0 2021-01-03T13:05:04.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.438+0000 7f8f1c67d700 1 -- 172.21.15.133:0/102674090 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ef40553b0 msgr2=0x7f8ef4057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:04.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.438+0000 7f8f1c67d700 1 --2- 172.21.15.133:0/102674090 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ef40553b0 0x7f8ef4057870 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f8f04019000 tx=0x7f8f04017000).stop 2021-01-03T13:05:04.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.438+0000 7f8f1c67d700 1 -- 172.21.15.133:0/102674090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140b17e0 msgr2=0x7f8f14155970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:04.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.438+0000 7f8f1c67d700 1 --2- 172.21.15.133:0/102674090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140b17e0 0x7f8f14155970 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f8f100018b0 tx=0x7f8f140af150).stop 2021-01-03T13:05:04.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.438+0000 7f8f1c67d700 1 -- 172.21.15.133:0/102674090 shutdown_connections 2021-01-03T13:05:04.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.438+0000 7f8f1c67d700 1 --2- 172.21.15.133:0/102674090 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8ef40553b0 0x7f8ef4057870 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:04.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.438+0000 7f8f1c67d700 1 --2- 172.21.15.133:0/102674090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8f14155e60 0x7f8f1409ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:04.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.438+0000 7f8f1c67d700 1 --2- 172.21.15.133:0/102674090 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8f140b7a20 0x7f8f14151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:04.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.438+0000 7f8f1c67d700 1 --2- 172.21.15.133:0/102674090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140b17e0 0x7f8f14155970 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:04.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.438+0000 7f8f1c67d700 1 -- 172.21.15.133:0/102674090 >> 172.21.15.133:0/102674090 conn(0x7f8f140b95d0 msgr2=0x7f8f140b8170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:04.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.438+0000 7f8f1c67d700 1 -- 172.21.15.133:0/102674090 shutdown_connections 2021-01-03T13:05:04.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.438+0000 7f8f1c67d700 1 -- 172.21.15.133:0/102674090 wait complete. 2021-01-03T13:05:04.445 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2021-01-03T13:05:04.458 INFO:tasks.ceph.mds.a:Restarting daemon 2021-01-03T13:05:04.458 INFO:tasks.ceph.mds.a:Stopping old one... 2021-01-03T13:05:04.459 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-01-03T13:05:04.459 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:05:04.459 INFO:tasks.ceph.mds.c:Restarting daemon 2021-01-03T13:05:04.460 INFO:tasks.ceph.mds.c:Stopping old one... 2021-01-03T13:05:04.460 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-01-03T13:05:04.460 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:05:04.461 INFO:tasks.ceph.mds.b:Restarting daemon 2021-01-03T13:05:04.461 INFO:tasks.ceph.mds.b:Stopping old one... 2021-01-03T13:05:04.461 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-01-03T13:05:04.462 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:05:04.472 INFO:tasks.ceph.mds.a:Stopped 2021-01-03T13:05:04.472 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-01-03T13:05:04.474 INFO:tasks.ceph.mds.b:Stopped 2021-01-03T13:05:04.474 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-01-03T13:05:04.475 INFO:tasks.ceph.mds.c:Stopped 2021-01-03T13:05:04.475 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-01-03T13:05:04.516 INFO:tasks.ceph.mds.a:Started 2021-01-03T13:05:04.517 DEBUG:teuthology.parallel:result is None 2021-01-03T13:05:04.519 INFO:tasks.ceph.mds.b:Started 2021-01-03T13:05:04.519 DEBUG:teuthology.parallel:result is None 2021-01-03T13:05:04.520 INFO:tasks.ceph.mds.c:Started 2021-01-03T13:05:04.520 DEBUG:teuthology.parallel:result is None 2021-01-03T13:05:04.521 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-01-03T13:05:04.589 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T13:05:04.592 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T13:05:04.597 INFO:tasks.ceph.mds.b.smithi016.stdout:starting mds.b at 2021-01-03T13:05:04.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.626+0000 7ffa24208700 1 Processor -- start 2021-01-03T13:05:04.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.626+0000 7ffa24208700 1 -- start start 2021-01-03T13:05:04.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa24208700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffa1c05c840 0x7ffa1c143940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:04.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa24208700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ffa1c146dc0 0x7ffa1c0b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:04.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa24208700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1c05cc20 con 0x7ffa1c067710 2021-01-03T13:05:04.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa24208700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa1c0ad5a0 con 0x7ffa1c146dc0 2021-01-03T13:05:04.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa24208700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c142f60 con 0x7ffa1c05c840 2021-01-03T13:05:04.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa227a5700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ffa1c067710 0x7ffa1c0b2480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57414/0 (socket says 172.21.15.133:57414) 2021-01-03T13:05:04.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa227a5700 1 -- 172.21.15.133:0/3823811978 learned_addr learned my addr 172.21.15.133:0/3823811978 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:04.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa217a3700 1 --2- 172.21.15.133:0/3823811978 >> v2:172.21.15.133:3300/0 conn(0x7ffa1c146dc0 0x7ffa1c0b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa21fa4700 1 --2- 172.21.15.133:0/3823811978 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffa1c05c840 0x7ffa1c143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa20fa2700 1 -- 172.21.15.133:0/3823811978 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489019693 0 0) 0x7ffa1c05cc20 con 0x7ffa1c067710 2021-01-03T13:05:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa20fa2700 1 -- 172.21.15.133:0/3823811978 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa04003230 con 0x7ffa1c067710 2021-01-03T13:05:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa217a3700 1 -- 172.21.15.133:0/3823811978 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffa1c05c840 msgr2=0x7ffa1c143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:04.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa217a3700 1 --2- 172.21.15.133:0/3823811978 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffa1c05c840 0x7ffa1c143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:04.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa217a3700 1 -- 172.21.15.133:0/3823811978 >> v1:172.21.15.133:6789/0 conn(0x7ffa1c067710 legacy=0x7ffa1c0b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:04.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa217a3700 1 -- 172.21.15.133:0/3823811978 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c143200 con 0x7ffa1c146dc0 2021-01-03T13:05:04.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa217a3700 1 --2- 172.21.15.133:0/3823811978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c146dc0 0x7ffa1c0b09a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7ffa0c002f30 tx=0x7ffa0c006dc0).ready entity=mon.1 client_cookie=af484276a4e89abd server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:04.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa20fa2700 1 -- 172.21.15.133:0/3823811978 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa0c0096a0 con 0x7ffa1c146dc0 2021-01-03T13:05:04.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa20fa2700 1 -- 172.21.15.133:0/3823811978 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c009800 con 0x7ffa1c146dc0 2021-01-03T13:05:04.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa20fa2700 1 -- 172.21.15.133:0/3823811978 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa0c009b60 con 0x7ffa1c146dc0 2021-01-03T13:05:04.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa24208700 1 -- 172.21.15.133:0/3823811978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c146dc0 msgr2=0x7ffa1c0b09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:04.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa24208700 1 --2- 172.21.15.133:0/3823811978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c146dc0 0x7ffa1c0b09a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7ffa0c002f30 tx=0x7ffa0c006dc0).stop 2021-01-03T13:05:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa24208700 1 -- 172.21.15.133:0/3823811978 shutdown_connections 2021-01-03T13:05:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa24208700 1 --2- 172.21.15.133:0/3823811978 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffa1c05c840 0x7ffa1c143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa24208700 1 --2- 172.21.15.133:0/3823811978 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c146dc0 0x7ffa1c0b09a0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:04.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa24208700 1 -- 172.21.15.133:0/3823811978 >> 172.21.15.133:0/3823811978 conn(0x7ffa1c06aeb0 msgr2=0x7ffa1c05bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:04.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa24208700 1 -- 172.21.15.133:0/3823811978 shutdown_connections 2021-01-03T13:05:04.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa24208700 1 -- 172.21.15.133:0/3823811978 wait complete. 2021-01-03T13:05:04.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa24208700 1 Processor -- start 2021-01-03T13:05:04.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.630+0000 7ffa24208700 1 -- start start 2021-01-03T13:05:04.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa24208700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa1c05c840 0x7ffa1c0b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:04.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa24208700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffa1c067710 0x7ffa1c13d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:04.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa24208700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c146dc0 0x7ffa1c1421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:04.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa24208700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0afd80 con 0x7ffa1c05c840 2021-01-03T13:05:04.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa24208700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c13d9c0 con 0x7ffa1c146dc0 2021-01-03T13:05:04.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa24208700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c141280 con 0x7ffa1c067710 2021-01-03T13:05:04.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa227a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c146dc0 0x7ffa1c1421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:04.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa21fa4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa1c05c840 0x7ffa1c0b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:04.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa217a3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffa1c067710 0x7ffa1c13d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:04.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa227a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c146dc0 0x7ffa1c1421b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36390/0 (socket says 172.21.15.133:36390) 2021-01-03T13:05:04.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa21fa4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa1c05c840 0x7ffa1c0b52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:34926/0 (socket says 172.21.15.133:34926) 2021-01-03T13:05:04.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa217a3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffa1c067710 0x7ffa1c13d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:44690/0 (socket says 172.21.15.133:44690) 2021-01-03T13:05:04.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa227a5700 1 -- 172.21.15.133:0/2300905888 learned_addr learned my addr 172.21.15.133:0/2300905888 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:04.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa227a5700 1 -- 172.21.15.133:0/2300905888 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffa1c067710 msgr2=0x7ffa1c13d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:04.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa227a5700 1 --2- 172.21.15.133:0/2300905888 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffa1c067710 0x7ffa1c13d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:04.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa227a5700 1 -- 172.21.15.133:0/2300905888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa1c05c840 msgr2=0x7ffa1c0b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:04.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa227a5700 1 --2- 172.21.15.133:0/2300905888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa1c05c840 0x7ffa1c0b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:04.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa227a5700 1 -- 172.21.15.133:0/2300905888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c0b3a70 con 0x7ffa1c146dc0 2021-01-03T13:05:04.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa227a5700 1 --2- 172.21.15.133:0/2300905888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c146dc0 0x7ffa1c1421b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7ffa1c0b5210 tx=0x7ffa14007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:04.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa0affd700 1 -- 172.21.15.133:0/2300905888 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa14005b70 con 0x7ffa1c146dc0 2021-01-03T13:05:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa0affd700 1 -- 172.21.15.133:0/2300905888 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa14005cd0 con 0x7ffa1c146dc0 2021-01-03T13:05:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa24208700 1 -- 172.21.15.133:0/2300905888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1c0af9a0 con 0x7ffa1c146dc0 2021-01-03T13:05:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa0affd700 1 -- 172.21.15.133:0/2300905888 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa14007300 con 0x7ffa1c146dc0 2021-01-03T13:05:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.634+0000 7ffa24208700 1 -- 172.21.15.133:0/2300905888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1c1414b0 con 0x7ffa1c146dc0 2021-01-03T13:05:04.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.638+0000 7ffa24208700 1 -- 172.21.15.133:0/2300905888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa1c142840 con 0x7ffa1c146dc0 2021-01-03T13:05:04.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.638+0000 7ffa0affd700 1 -- 172.21.15.133:0/2300905888 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ffa14010030 con 0x7ffa1c146dc0 2021-01-03T13:05:04.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.638+0000 7ffa0affd700 1 --2- 172.21.15.133:0/2300905888 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff9fc0554e0 0x7ff9fc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:04.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.638+0000 7ffa0affd700 1 -- 172.21.15.133:0/2300905888 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5382+0+0 (secure 0 0 0) 0x7ffa1406dce0 con 0x7ffa1c146dc0 2021-01-03T13:05:04.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.638+0000 7ffa21fa4700 1 --2- 172.21.15.133:0/2300905888 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff9fc0554e0 0x7ff9fc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:04.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.638+0000 7ffa21fa4700 1 --2- 172.21.15.133:0/2300905888 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff9fc0554e0 0x7ff9fc0579a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7ffa1800b000 tx=0x7ffa18006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:04.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.642+0000 7ffa0affd700 1 -- 172.21.15.133:0/2300905888 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ffa140441f0 con 0x7ffa1c146dc0 2021-01-03T13:05:04.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:04.806+0000 7ffa24208700 1 -- 172.21.15.133:0/2300905888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7ffa1c057300 con 0x7ffa1c146dc0 2021-01-03T13:05:05.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.630+0000 7ffa0affd700 1 -- 172.21.15.133:0/2300905888 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v85) v1 ==== 97+0+0 (secure 0 0 0) 0x7ffa14047810 con 0x7ffa1c146dc0 2021-01-03T13:05:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.634+0000 7ffa24208700 1 -- 172.21.15.133:0/2300905888 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff9fc0554e0 msgr2=0x7ff9fc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.634+0000 7ffa24208700 1 --2- 172.21.15.133:0/2300905888 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff9fc0554e0 0x7ff9fc0579a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7ffa1800b000 tx=0x7ffa18006dc0).stop 2021-01-03T13:05:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.634+0000 7ffa24208700 1 -- 172.21.15.133:0/2300905888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c146dc0 msgr2=0x7ffa1c1421b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.634+0000 7ffa24208700 1 --2- 172.21.15.133:0/2300905888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c146dc0 0x7ffa1c1421b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7ffa1c0b5210 tx=0x7ffa14007dd0).stop 2021-01-03T13:05:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.634+0000 7ffa24208700 1 -- 172.21.15.133:0/2300905888 shutdown_connections 2021-01-03T13:05:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.634+0000 7ffa24208700 1 --2- 172.21.15.133:0/2300905888 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff9fc0554e0 0x7ff9fc0579a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.634+0000 7ffa24208700 1 --2- 172.21.15.133:0/2300905888 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffa1c05c840 0x7ffa1c0b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.634+0000 7ffa24208700 1 --2- 172.21.15.133:0/2300905888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffa1c146dc0 0x7ffa1c1421b0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.634+0000 7ffa24208700 1 --2- 172.21.15.133:0/2300905888 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffa1c067710 0x7ffa1c13d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.634+0000 7ffa24208700 1 -- 172.21.15.133:0/2300905888 >> 172.21.15.133:0/2300905888 conn(0x7ffa1c06aeb0 msgr2=0x7ffa1c0b16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.634+0000 7ffa24208700 1 -- 172.21.15.133:0/2300905888 shutdown_connections 2021-01-03T13:05:05.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.634+0000 7ffa24208700 1 -- 172.21.15.133:0/2300905888 wait complete. 2021-01-03T13:05:05.644 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blacklist entries 2021-01-03T13:05:05.656 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-01-03T13:05:05.657 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-01-03T13:05:05.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.766+0000 7f09065e1700 1 Processor -- start 2021-01-03T13:05:05.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.766+0000 7f09065e1700 1 -- start start 2021-01-03T13:05:05.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.766+0000 7f09065e1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09000b0670 0x7f09000aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:05.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.766+0000 7f09065e1700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f090014aee0 0x7f0900144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:05.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.766+0000 7f09065e1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0900098550 con 0x7f09000b5c10 2021-01-03T13:05:05.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.766+0000 7f09065e1700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09000b5ff0 con 0x7f090014aee0 2021-01-03T13:05:05.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.766+0000 7f09065e1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09000b0b10 con 0x7f09000b0670 2021-01-03T13:05:05.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.766+0000 7f08fffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f09000b5c10 0x7f090014a7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57430/0 (socket says 172.21.15.133:57430) 2021-01-03T13:05:05.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.766+0000 7f08fffff700 1 -- 172.21.15.133:0/3873884456 learned_addr learned my addr 172.21.15.133:0/3873884456 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:05.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.766+0000 7f0904b7e700 1 --2- 172.21.15.133:0/3873884456 >> v2:172.21.15.16:3300/0 conn(0x7f090014aee0 0x7f0900144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:05.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.766+0000 7f08ff7fe700 1 --2- 172.21.15.133:0/3873884456 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09000b0670 0x7f09000aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:05.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.766+0000 7f08feffd700 1 -- 172.21.15.133:0/3873884456 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122865452 0 0) 0x7f0900098550 con 0x7f09000b5c10 2021-01-03T13:05:05.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.766+0000 7f08feffd700 1 -- 172.21.15.133:0/3873884456 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08ec003230 con 0x7f09000b5c10 2021-01-03T13:05:05.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f0904b7e700 1 -- 172.21.15.133:0/3873884456 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09000b0670 msgr2=0x7f09000aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:05.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f0904b7e700 1 --2- 172.21.15.133:0/3873884456 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09000b0670 0x7f09000aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:05.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f0904b7e700 1 -- 172.21.15.133:0/3873884456 >> v1:172.21.15.133:6789/0 conn(0x7f09000b5c10 legacy=0x7f090014a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:05.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f0904b7e700 1 -- 172.21.15.133:0/3873884456 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0900098780 con 0x7f090014aee0 2021-01-03T13:05:05.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f08ff7fe700 1 --2- 172.21.15.133:0/3873884456 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09000b0670 0x7f09000aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:05.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f0904b7e700 1 --2- 172.21.15.133:0/3873884456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f090014aee0 0x7f0900144470 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f08f0002f30 tx=0x7f08f0006dc0).ready entity=mon.0 client_cookie=4ece189c3e2c4886 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:05.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f08feffd700 1 -- 172.21.15.133:0/3873884456 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08f00096a0 con 0x7f090014aee0 2021-01-03T13:05:05.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f08feffd700 1 -- 172.21.15.133:0/3873884456 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f0009800 con 0x7f090014aee0 2021-01-03T13:05:05.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f08feffd700 1 -- 172.21.15.133:0/3873884456 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08f0009b60 con 0x7f090014aee0 2021-01-03T13:05:05.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f09065e1700 1 -- 172.21.15.133:0/3873884456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f090014aee0 msgr2=0x7f0900144470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:05.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f09065e1700 1 --2- 172.21.15.133:0/3873884456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f090014aee0 0x7f0900144470 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f08f0002f30 tx=0x7f08f0006dc0).stop 2021-01-03T13:05:05.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f09065e1700 1 -- 172.21.15.133:0/3873884456 shutdown_connections 2021-01-03T13:05:05.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f09065e1700 1 --2- 172.21.15.133:0/3873884456 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f090014aee0 0x7f0900144470 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:05.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f09065e1700 1 --2- 172.21.15.133:0/3873884456 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09000b0670 0x7f09000aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:05.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f09065e1700 1 -- 172.21.15.133:0/3873884456 >> 172.21.15.133:0/3873884456 conn(0x7f090005c8c0 msgr2=0x7f09000b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:05.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f09065e1700 1 -- 172.21.15.133:0/3873884456 shutdown_connections 2021-01-03T13:05:05.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f09065e1700 1 -- 172.21.15.133:0/3873884456 wait complete. 2021-01-03T13:05:05.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f09065e1700 1 Processor -- start 2021-01-03T13:05:05.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.770+0000 7f09065e1700 1 -- start start 2021-01-03T13:05:05.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f09065e1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09000b0670 0x7f0900145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:05.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f09065e1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09000b5c10 0x7f09000adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:05.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f09065e1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f090014aee0 0x7f09001433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:05.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f09065e1700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090015a1e0 con 0x7f09000b0670 2021-01-03T13:05:05.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f09065e1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0900146290 con 0x7f09000b5c10 2021-01-03T13:05:05.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f09065e1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0900146530 con 0x7f090014aee0 2021-01-03T13:05:05.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f08ff7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09000b5c10 0x7f09000adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:05.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f08ff7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09000b5c10 0x7f09000adb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36406/0 (socket says 172.21.15.133:36406) 2021-01-03T13:05:05.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f08ff7fe700 1 -- 172.21.15.133:0/1753687545 learned_addr learned my addr 172.21.15.133:0/1753687545 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:05.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f08fffff700 1 --2- 172.21.15.133:0/1753687545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09000b0670 0x7f0900145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:05.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f0904b7e700 1 --2- 172.21.15.133:0/1753687545 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f090014aee0 0x7f09001433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:05.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f08ff7fe700 1 -- 172.21.15.133:0/1753687545 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f090014aee0 msgr2=0x7f09001433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:05.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f08ff7fe700 1 --2- 172.21.15.133:0/1753687545 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f090014aee0 0x7f09001433d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:05.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f08ff7fe700 1 -- 172.21.15.133:0/1753687545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09000b0670 msgr2=0x7f0900145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:05.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f08ff7fe700 1 --2- 172.21.15.133:0/1753687545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09000b0670 0x7f0900145a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:05.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f08ff7fe700 1 -- 172.21.15.133:0/1753687545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09001467d0 con 0x7f09000b5c10 2021-01-03T13:05:05.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f0904b7e700 1 --2- 172.21.15.133:0/1753687545 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f090014aee0 0x7f09001433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:05.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f08ff7fe700 1 --2- 172.21.15.133:0/1753687545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09000b5c10 0x7f09000adb70 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f08f400c000 tx=0x7f08f4006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:05.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f08fd7fa700 1 -- 172.21.15.133:0/1753687545 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08f400cbf0 con 0x7f09000b5c10 2021-01-03T13:05:05.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f08fd7fa700 1 -- 172.21.15.133:0/1753687545 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f400cd50 con 0x7f09000b5c10 2021-01-03T13:05:05.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f09065e1700 1 -- 172.21.15.133:0/1753687545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09000ae260 con 0x7f09000b5c10 2021-01-03T13:05:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f08fd7fa700 1 -- 172.21.15.133:0/1753687545 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08f40125e0 con 0x7f09000b5c10 2021-01-03T13:05:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f09065e1700 1 -- 172.21.15.133:0/1753687545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0900159f20 con 0x7f09000b5c10 2021-01-03T13:05:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.774+0000 7f09065e1700 1 -- 172.21.15.133:0/1753687545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0900057300 con 0x7f09000b5c10 2021-01-03T13:05:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.778+0000 7f08fd7fa700 1 -- 172.21.15.133:0/1753687545 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f08f4012740 con 0x7f09000b5c10 2021-01-03T13:05:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.778+0000 7f08fd7fa700 1 --2- 172.21.15.133:0/1753687545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f08e0055470 0x7f08e0057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.778+0000 7f08fd7fa700 1 -- 172.21.15.133:0/1753687545 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f08f406e470 con 0x7f09000b5c10 2021-01-03T13:05:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.778+0000 7f08fffff700 1 --2- 172.21.15.133:0/1753687545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f08e0055470 0x7f08e0057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:05.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.778+0000 7f08fffff700 1 --2- 172.21.15.133:0/1753687545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f08e0055470 0x7f08e0057930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f08f800d000 tx=0x7f08f8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:05.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.782+0000 7f08fd7fa700 1 -- 172.21.15.133:0/1753687545 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f08f4044910 con 0x7f09000b5c10 2021-01-03T13:05:05.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.970+0000 7f09065e1700 1 -- 172.21.15.133:0/1753687545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f09000b2b50 con 0x7f09000b5c10 2021-01-03T13:05:05.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.974+0000 7f08fd7fa700 1 -- 172.21.15.133:0/1753687545 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f08f4047f30 con 0x7f09000b5c10 2021-01-03T13:05:05.977 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:05.977 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:05:05.977 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2021-01-03T13:05:05.977 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:05.977 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2021-01-03T13:05:05.978 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Fflox9BxAA6coLDFV/FaQ/G/cvtonWgg==", 2021-01-03T13:05:05.978 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:05.978 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:05:05.978 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:05.979 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:05.979 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:05.979 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:05.979 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:05.979 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:05.980 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2021-01-03T13:05:05.980 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfrnWWFRAA3PHH/FJOvDozCChrb1T8Dg==", 2021-01-03T13:05:05.980 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:05.980 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:05:05.980 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:05.981 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:05.981 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:05.981 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:05.981 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:05.981 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:05.982 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2021-01-03T13:05:05.982 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfpPPLDxAAVvg80vLejYKDH485/L1gSQ==", 2021-01-03T13:05:05.982 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:05.982 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:05:05.982 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:05.983 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:05.984 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:05.984 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:05.985 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:05.985 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:05.985 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2021-01-03T13:05:05.985 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAnv/FfQ+CcDRAAUkTDLby5scMkNzxa0lVdAQ==", 2021-01-03T13:05:05.985 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:05.986 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:05.986 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:05.986 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:05.986 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:05.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:05.987 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:05.987 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2021-01-03T13:05:05.987 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApv/Ff1iilLhAAbK9hZmL772nNKAEJ4i+pkw==", 2021-01-03T13:05:05.987 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:05.988 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:05.988 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:05.988 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:05.988 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:05.988 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:05.989 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:05.989 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2021-01-03T13:05:05.989 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAsv/Ffmoe2FhAA1EbxU5yHncN+pbC/EX6d9A==", 2021-01-03T13:05:05.989 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:05.989 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:05.990 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:05.990 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:05.990 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:05.990 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:05.990 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:05.991 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2021-01-03T13:05:05.991 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAuv/FfJh/VORAAG9aCOh5s/2Lw+yN9hBFWLw==", 2021-01-03T13:05:05.991 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:05.991 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:05.991 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:05.992 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:05.992 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:05.992 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:05.992 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:05.992 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2021-01-03T13:05:05.993 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyv/Ffus0NJhAALX1TIqQ9EIupaX8KtRu7rQ==", 2021-01-03T13:05:05.993 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:05.993 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:05.993 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:05.993 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:05.994 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:05.994 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:05.994 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:05.994 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2021-01-03T13:05:05.995 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1v/FfoL6kDBAAggoRy/o0qas/41yLYqDVgA==", 2021-01-03T13:05:05.995 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:05.995 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:05.995 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:05.995 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:05.996 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:05.996 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:05.996 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:05.996 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2021-01-03T13:05:05.997 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA3v/FfwOPCMBAAGOt8ShPQ/szNbCfaP/uZEQ==", 2021-01-03T13:05:05.997 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:05.997 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:05.997 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:05.997 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:05.998 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:05.998 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:05.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:05.998 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2021-01-03T13:05:05.999 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA6v/Ffoz5xFxAAn3xvUDSeNSWrBJTa1Nsb6w==", 2021-01-03T13:05:05.999 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:05.999 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:05.999 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:05.999 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:06.000 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:06.000 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:06.000 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:06.000 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2021-01-03T13:05:06.000 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfyGlbGxAALm0NezvPiTAnlwu8iPEuCw==", 2021-01-03T13:05:06.001 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:06.001 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:05:06.001 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:05:06.001 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:05:06.002 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:06.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:06.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:06.002 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2021-01-03T13:05:06.002 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Ffa2AFHhAAD4Pq5zMJ28SqqEosBA9vnQ==", 2021-01-03T13:05:06.003 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:06.003 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:05:06.003 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:05:06.003 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:05:06.003 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:06.004 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:06.004 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:06.004 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2021-01-03T13:05:06.004 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjv/FfjxN8JxAAkV2Ia66fh21QYMX5fr1gTw==", 2021-01-03T13:05:06.004 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:06.005 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:05:06.005 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:06.005 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:06.005 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:06.005 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:06.006 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:06.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:06.006 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2021-01-03T13:05:06.006 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAU/DBBAASi+hx05pZEsP+dV9iwbz4g==", 2021-01-03T13:05:06.007 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:06.007 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:05:06.007 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:05:06.007 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:06.007 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:06.008 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:06.008 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:06.008 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2021-01-03T13:05:06.008 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAOFAAhAAPQOSkofyJoEYvcAqKK2+Mg==", 2021-01-03T13:05:06.008 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:06.009 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:05:06.009 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:05:06.009 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:06.009 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:06.009 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:06.010 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:06.010 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:05:06.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.974+0000 7f09065e1700 1 -- 172.21.15.133:0/1753687545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f08e0055470 msgr2=0x7f08e0057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.974+0000 7f09065e1700 1 --2- 172.21.15.133:0/1753687545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f08e0055470 0x7f08e0057930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f08f800d000 tx=0x7f08f8009040).stop 2021-01-03T13:05:06.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.974+0000 7f09065e1700 1 -- 172.21.15.133:0/1753687545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09000b5c10 msgr2=0x7f09000adb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.974+0000 7f09065e1700 1 --2- 172.21.15.133:0/1753687545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09000b5c10 0x7f09000adb70 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f08f400c000 tx=0x7f08f4006dc0).stop 2021-01-03T13:05:06.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.974+0000 7f09065e1700 1 -- 172.21.15.133:0/1753687545 shutdown_connections 2021-01-03T13:05:06.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.974+0000 7f09065e1700 1 --2- 172.21.15.133:0/1753687545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f08e0055470 0x7f08e0057930 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.974+0000 7f09065e1700 1 --2- 172.21.15.133:0/1753687545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09000b0670 0x7f0900145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.974+0000 7f09065e1700 1 --2- 172.21.15.133:0/1753687545 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f090014aee0 0x7f09001433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.974+0000 7f09065e1700 1 --2- 172.21.15.133:0/1753687545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09000b5c10 0x7f09000adb70 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.974+0000 7f09065e1700 1 -- 172.21.15.133:0/1753687545 >> 172.21.15.133:0/1753687545 conn(0x7f090005c8c0 msgr2=0x7f09000b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:06.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.974+0000 7f09065e1700 1 -- 172.21.15.133:0/1753687545 shutdown_connections 2021-01-03T13:05:06.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:05.974+0000 7f09065e1700 1 -- 172.21.15.133:0/1753687545 wait complete. 2021-01-03T13:05:06.015 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:05:06.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f218932a700 1 Processor -- start 2021-01-03T13:05:06.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f218932a700 1 -- start start 2021-01-03T13:05:06.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f218932a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f21840b52c0 0x7f21840b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f218932a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f21840b5c00 0x7f2184143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f218932a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2184060da0 con 0x7f21840b0c90 2021-01-03T13:05:06.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f218932a700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2184067a90 con 0x7f21840b5c00 2021-01-03T13:05:06.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f218932a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21840b0ad0 con 0x7f21840b52c0 2021-01-03T13:05:06.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f2183fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f21840b52c0 0x7f21840b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f2183fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f21840b52c0 0x7f21840b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:44714/0 (socket says 172.21.15.133:44714) 2021-01-03T13:05:06.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f2183fff700 1 -- 172.21.15.133:0/2617616483 learned_addr learned my addr 172.21.15.133:0/2617616483 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:06.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f2188b29700 1 --2- 172.21.15.133:0/2617616483 >> v2:172.21.15.16:3300/0 conn(0x7f21840b5c00 0x7f2184143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f2183fff700 1 -- 172.21.15.133:0/2617616483 >> v2:172.21.15.16:3300/0 conn(0x7f21840b5c00 msgr2=0x7f2184143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:06.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f2183fff700 1 --2- 172.21.15.133:0/2617616483 >> v2:172.21.15.16:3300/0 conn(0x7f21840b5c00 0x7f2184143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f2183fff700 1 -- 172.21.15.133:0/2617616483 >> v1:172.21.15.16:6789/0 conn(0x7f21840b0c90 legacy=0x7f2184098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f2183fff700 1 -- 172.21.15.133:0/2617616483 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21840b56a0 con 0x7f21840b52c0 2021-01-03T13:05:06.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f2183fff700 1 --2- 172.21.15.133:0/2617616483 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f21840b52c0 0x7f21840b05e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f217c0032b0 tx=0x7f217c009270).ready entity=mon.2 client_cookie=1b1485ddd46fa99a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:06.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f2182ffd700 1 -- 172.21.15.133:0/2617616483 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f217c009e60 con 0x7f21840b52c0 2021-01-03T13:05:06.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f2182ffd700 1 -- 172.21.15.133:0/2617616483 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217c00bc00 con 0x7f21840b52c0 2021-01-03T13:05:06.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f2182ffd700 1 -- 172.21.15.133:0/2617616483 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f217c00bd70 con 0x7f21840b52c0 2021-01-03T13:05:06.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f218932a700 1 -- 172.21.15.133:0/2617616483 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f21840b52c0 msgr2=0x7f21840b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.126+0000 7f218932a700 1 --2- 172.21.15.133:0/2617616483 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f21840b52c0 0x7f21840b05e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f217c0032b0 tx=0x7f217c009270).stop 2021-01-03T13:05:06.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f218932a700 1 -- 172.21.15.133:0/2617616483 shutdown_connections 2021-01-03T13:05:06.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f218932a700 1 --2- 172.21.15.133:0/2617616483 >> v2:172.21.15.16:3300/0 conn(0x7f21840b5c00 0x7f2184143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f218932a700 1 --2- 172.21.15.133:0/2617616483 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f21840b52c0 0x7f21840b05e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f218932a700 1 -- 172.21.15.133:0/2617616483 >> 172.21.15.133:0/2617616483 conn(0x7f218405bdf0 msgr2=0x7f218405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:06.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f218932a700 1 -- 172.21.15.133:0/2617616483 shutdown_connections 2021-01-03T13:05:06.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f218932a700 1 -- 172.21.15.133:0/2617616483 wait complete. 2021-01-03T13:05:06.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f218932a700 1 Processor -- start 2021-01-03T13:05:06.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f218932a700 1 -- start start 2021-01-03T13:05:06.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f218932a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21840b0c90 0x7f2184064650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f218932a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f21840b52c0 0x7f2184156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f218932a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21840b5c00 0x7f21841598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f218932a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21840654c0 con 0x7f21840b0c90 2021-01-03T13:05:06.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f218932a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2184065220 con 0x7f21840b5c00 2021-01-03T13:05:06.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f218932a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2184156490 con 0x7f21840b52c0 2021-01-03T13:05:06.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f2188b29700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21840b5c00 0x7f21841598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f2188b29700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21840b5c00 0x7f21841598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36422/0 (socket says 172.21.15.133:36422) 2021-01-03T13:05:06.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f2183fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21840b0c90 0x7f2184064650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f2188b29700 1 -- 172.21.15.133:0/4193994450 learned_addr learned my addr 172.21.15.133:0/4193994450 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:06.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f21837fe700 1 --2- 172.21.15.133:0/4193994450 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f21840b52c0 0x7f2184156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f2188b29700 1 -- 172.21.15.133:0/4193994450 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f21840b52c0 msgr2=0x7f2184156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f2188b29700 1 --2- 172.21.15.133:0/4193994450 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f21840b52c0 0x7f2184156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f2188b29700 1 -- 172.21.15.133:0/4193994450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21840b0c90 msgr2=0x7f2184064650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f2188b29700 1 --2- 172.21.15.133:0/4193994450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21840b0c90 0x7f2184064650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f2188b29700 1 -- 172.21.15.133:0/4193994450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2184156730 con 0x7f21840b5c00 2021-01-03T13:05:06.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f2188b29700 1 --2- 172.21.15.133:0/4193994450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21840b5c00 0x7f21841598e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f216c006a50 tx=0x7f216c006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:06.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f21817fa700 1 -- 172.21.15.133:0/4193994450 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f216c00c7e0 con 0x7f21840b5c00 2021-01-03T13:05:06.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f21817fa700 1 -- 172.21.15.133:0/4193994450 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c00c940 con 0x7f21840b5c00 2021-01-03T13:05:06.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f21817fa700 1 -- 172.21.15.133:0/4193994450 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f216c00cca0 con 0x7f21840b5c00 2021-01-03T13:05:06.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f218932a700 1 -- 172.21.15.133:0/4193994450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2184063750 con 0x7f21840b5c00 2021-01-03T13:05:06.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.130+0000 7f218932a700 1 -- 172.21.15.133:0/4193994450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21841570c0 con 0x7f21840b5c00 2021-01-03T13:05:06.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.134+0000 7f218932a700 1 -- 172.21.15.133:0/4193994450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21841568c0 con 0x7f21840b5c00 2021-01-03T13:05:06.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.134+0000 7f21817fa700 1 -- 172.21.15.133:0/4193994450 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f216c01c460 con 0x7f21840b5c00 2021-01-03T13:05:06.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.134+0000 7f21817fa700 1 --2- 172.21.15.133:0/4193994450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2168055330 0x7f21680577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.134+0000 7f2183fff700 1 --2- 172.21.15.133:0/4193994450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2168055330 0x7f21680577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.134+0000 7f21817fa700 1 -- 172.21.15.133:0/4193994450 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f216c06e120 con 0x7f21840b5c00 2021-01-03T13:05:06.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.134+0000 7f2183fff700 1 --2- 172.21.15.133:0/4193994450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2168055330 0x7f21680577f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f217c01a000 tx=0x7f217c016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:06.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.138+0000 7f21817fa700 1 -- 172.21.15.133:0/4193994450 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f216c044560 con 0x7f21840b5c00 2021-01-03T13:05:06.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.278+0000 7f218932a700 1 -- 172.21.15.133:0/4193994450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2184057300 con 0x7f21840b5c00 2021-01-03T13:05:06.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.282+0000 7f21817fa700 1 -- 172.21.15.133:0/4193994450 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+13230 (secure 0 0 0) 0x7f216c00ce00 con 0x7f21840b5c00 2021-01-03T13:05:06.285 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:06.285 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":85,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:05:05.622999+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:05:06.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.282+0000 7f218932a700 1 -- 172.21.15.133:0/4193994450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2168055330 msgr2=0x7f21680577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.282+0000 7f218932a700 1 --2- 172.21.15.133:0/4193994450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2168055330 0x7f21680577f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f217c01a000 tx=0x7f217c016000).stop 2021-01-03T13:05:06.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.282+0000 7f218932a700 1 -- 172.21.15.133:0/4193994450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21840b5c00 msgr2=0x7f21841598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.282+0000 7f218932a700 1 --2- 172.21.15.133:0/4193994450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21840b5c00 0x7f21841598e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f216c006a50 tx=0x7f216c006dc0).stop 2021-01-03T13:05:06.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.282+0000 7f218932a700 1 -- 172.21.15.133:0/4193994450 shutdown_connections 2021-01-03T13:05:06.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.282+0000 7f218932a700 1 --2- 172.21.15.133:0/4193994450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2168055330 0x7f21680577f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.282+0000 7f218932a700 1 --2- 172.21.15.133:0/4193994450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21840b0c90 0x7f2184064650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.282+0000 7f218932a700 1 --2- 172.21.15.133:0/4193994450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21840b5c00 0x7f21841598e0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.282+0000 7f218932a700 1 --2- 172.21.15.133:0/4193994450 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f21840b52c0 0x7f2184156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.282+0000 7f218932a700 1 -- 172.21.15.133:0/4193994450 >> 172.21.15.133:0/4193994450 conn(0x7f218405bdf0 msgr2=0x7f2184060260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:06.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.282+0000 7f218932a700 1 -- 172.21.15.133:0/4193994450 shutdown_connections 2021-01-03T13:05:06.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.282+0000 7f218932a700 1 -- 172.21.15.133:0/4193994450 wait complete. 2021-01-03T13:05:06.298 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-01-03T13:05:06.299 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:05:06.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957b59e700 1 Processor -- start 2021-01-03T13:05:06.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957b59e700 1 -- start start 2021-01-03T13:05:06.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957b59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f957c0b5c00 0x7f957c1477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957b59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f957c1442a0 0x7f957c144750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957b59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f957c0b0c10 con 0x7f957c0b5260 2021-01-03T13:05:06.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957b59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f957c0b5640 con 0x7f957c1442a0 2021-01-03T13:05:06.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957b59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957c09a4f0 con 0x7f957c0b5c00 2021-01-03T13:05:06.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957a59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f957c0b5260 0x7f957c1470b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57458/0 (socket says 172.21.15.133:57458) 2021-01-03T13:05:06.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957a59c700 1 -- 172.21.15.133:0/2332642687 learned_addr learned my addr 172.21.15.133:0/2332642687 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:06.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957ad9d700 1 --2- 172.21.15.133:0/2332642687 >> v2:172.21.15.133:3300/0 conn(0x7f957c1442a0 0x7f957c144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f9579d9b700 1 --2- 172.21.15.133:0/2332642687 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f957c0b5c00 0x7f957c1477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957959a700 1 -- 172.21.15.133:0/2332642687 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173192254 0 0) 0x7f957c0b0c10 con 0x7f957c0b5260 2021-01-03T13:05:06.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957959a700 1 -- 172.21.15.133:0/2332642687 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f955c003230 con 0x7f957c0b5260 2021-01-03T13:05:06.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957ad9d700 1 -- 172.21.15.133:0/2332642687 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f957c0b5c00 msgr2=0x7f957c1477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:06.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957ad9d700 1 --2- 172.21.15.133:0/2332642687 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f957c0b5c00 0x7f957c1477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957959a700 1 -- 172.21.15.133:0/2332642687 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1013780297 0 0) 0x7f955c003230 con 0x7f957c0b5260 2021-01-03T13:05:06.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957ad9d700 1 -- 172.21.15.133:0/2332642687 >> v1:172.21.15.133:6789/0 conn(0x7f957c0b5260 legacy=0x7f957c1470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957ad9d700 1 -- 172.21.15.133:0/2332642687 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c0b0e40 con 0x7f957c1442a0 2021-01-03T13:05:06.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957ad9d700 1 --2- 172.21.15.133:0/2332642687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f957c1442a0 0x7f957c144750 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f9564001870 tx=0x7f9574006dc0).ready entity=mon.1 client_cookie=11ddbdde2241d026 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:06.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957959a700 1 -- 172.21.15.133:0/2332642687 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95640016d0 con 0x7f957c1442a0 2021-01-03T13:05:06.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957959a700 1 -- 172.21.15.133:0/2332642687 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957400d570 con 0x7f957c1442a0 2021-01-03T13:05:06.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957959a700 1 -- 172.21.15.133:0/2332642687 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f957400d6e0 con 0x7f957c1442a0 2021-01-03T13:05:06.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957b59e700 1 -- 172.21.15.133:0/2332642687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f957c1442a0 msgr2=0x7f957c144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.402+0000 7f957b59e700 1 --2- 172.21.15.133:0/2332642687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f957c1442a0 0x7f957c144750 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f9564001870 tx=0x7f9574006dc0).stop 2021-01-03T13:05:06.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f957b59e700 1 -- 172.21.15.133:0/2332642687 shutdown_connections 2021-01-03T13:05:06.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f957b59e700 1 --2- 172.21.15.133:0/2332642687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f957c1442a0 0x7f957c144750 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f957b59e700 1 --2- 172.21.15.133:0/2332642687 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f957c0b5c00 0x7f957c1477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f957b59e700 1 -- 172.21.15.133:0/2332642687 >> 172.21.15.133:0/2332642687 conn(0x7f957c05bdf0 msgr2=0x7f957c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:06.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f957b59e700 1 -- 172.21.15.133:0/2332642687 shutdown_connections 2021-01-03T13:05:06.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f957b59e700 1 -- 172.21.15.133:0/2332642687 wait complete. 2021-01-03T13:05:06.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f957b59e700 1 Processor -- start 2021-01-03T13:05:06.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f957b59e700 1 -- start start 2021-01-03T13:05:06.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f957b59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f957c0b5260 0x7f957c147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f957b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f957c0b5c00 0x7f957c155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f957b59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f957c1442a0 0x7f957c0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f957b59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c155f20 con 0x7f957c1442a0 2021-01-03T13:05:06.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f957b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c0653b0 con 0x7f957c0b5c00 2021-01-03T13:05:06.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f957b59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957c065650 con 0x7f957c0b5260 2021-01-03T13:05:06.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f9579d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f957c0b5c00 0x7f957c155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f9579d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f957c0b5c00 0x7f957c155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36434/0 (socket says 172.21.15.133:36434) 2021-01-03T13:05:06.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f9579d9b700 1 -- 172.21.15.133:0/1690683370 learned_addr learned my addr 172.21.15.133:0/1690683370 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:06.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f957a59c700 1 --2- 172.21.15.133:0/1690683370 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f957c0b5260 0x7f957c147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f957ad9d700 1 --2- 172.21.15.133:0/1690683370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f957c1442a0 0x7f957c0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f9579d9b700 1 -- 172.21.15.133:0/1690683370 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f957c0b5260 msgr2=0x7f957c147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f9579d9b700 1 --2- 172.21.15.133:0/1690683370 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f957c0b5260 0x7f957c147590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f9579d9b700 1 -- 172.21.15.133:0/1690683370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f957c1442a0 msgr2=0x7f957c0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f9579d9b700 1 --2- 172.21.15.133:0/1690683370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f957c1442a0 0x7f957c0addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f9579d9b700 1 -- 172.21.15.133:0/1690683370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c0658f0 con 0x7f957c0b5c00 2021-01-03T13:05:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f9579d9b700 1 --2- 172.21.15.133:0/1690683370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f957c0b5c00 0x7f957c155a30 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f957c06b030 tx=0x7f956c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:06.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.406+0000 7f95737fe700 1 -- 172.21.15.133:0/1690683370 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f956c00cc00 con 0x7f957c0b5c00 2021-01-03T13:05:06.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.410+0000 7f95737fe700 1 -- 172.21.15.133:0/1690683370 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956c00cd60 con 0x7f957c0b5c00 2021-01-03T13:05:06.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.410+0000 7f957b59e700 1 -- 172.21.15.133:0/1690683370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957c0ad910 con 0x7f957c0b5c00 2021-01-03T13:05:06.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.410+0000 7f95737fe700 1 -- 172.21.15.133:0/1690683370 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f956c0125e0 con 0x7f957c0b5c00 2021-01-03T13:05:06.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.410+0000 7f957b59e700 1 -- 172.21.15.133:0/1690683370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957c0ae2a0 con 0x7f957c0b5c00 2021-01-03T13:05:06.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.410+0000 7f957b59e700 1 -- 172.21.15.133:0/1690683370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f957c0adaa0 con 0x7f957c0b5c00 2021-01-03T13:05:06.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.410+0000 7f95737fe700 1 -- 172.21.15.133:0/1690683370 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f956c022070 con 0x7f957c0b5c00 2021-01-03T13:05:06.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.410+0000 7f95737fe700 1 --2- 172.21.15.133:0/1690683370 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9560055440 0x7f9560057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.410+0000 7f95737fe700 1 -- 172.21.15.133:0/1690683370 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f956c06e450 con 0x7f957c0b5c00 2021-01-03T13:05:06.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.410+0000 7f957a59c700 1 --2- 172.21.15.133:0/1690683370 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9560055440 0x7f9560057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.410+0000 7f957a59c700 1 --2- 172.21.15.133:0/1690683370 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9560055440 0x7f9560057900 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f956400b000 tx=0x7f9564000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:06.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.418+0000 7f95737fe700 1 -- 172.21.15.133:0/1690683370 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f956c044a80 con 0x7f957c0b5c00 2021-01-03T13:05:06.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.554+0000 7f957b59e700 1 -- 172.21.15.133:0/1690683370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f957c057300 con 0x7f957c0b5c00 2021-01-03T13:05:06.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.554+0000 7f95737fe700 1 -- 172.21.15.133:0/1690683370 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v85) v1 ==== 110+0+10 (secure 0 0 0) 0x7f956c0480a0 con 0x7f957c0b5c00 2021-01-03T13:05:06.558 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:05:06.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.554+0000 7f957b59e700 1 -- 172.21.15.133:0/1690683370 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9560055440 msgr2=0x7f9560057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.554+0000 7f957b59e700 1 --2- 172.21.15.133:0/1690683370 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9560055440 0x7f9560057900 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f956400b000 tx=0x7f9564000b80).stop 2021-01-03T13:05:06.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.554+0000 7f957b59e700 1 -- 172.21.15.133:0/1690683370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f957c0b5c00 msgr2=0x7f957c155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.554+0000 7f957b59e700 1 --2- 172.21.15.133:0/1690683370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f957c0b5c00 0x7f957c155a30 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f957c06b030 tx=0x7f956c0091a0).stop 2021-01-03T13:05:06.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.554+0000 7f957b59e700 1 -- 172.21.15.133:0/1690683370 shutdown_connections 2021-01-03T13:05:06.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.554+0000 7f957b59e700 1 --2- 172.21.15.133:0/1690683370 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9560055440 0x7f9560057900 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.554+0000 7f957b59e700 1 --2- 172.21.15.133:0/1690683370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f957c1442a0 0x7f957c0addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.554+0000 7f957b59e700 1 --2- 172.21.15.133:0/1690683370 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f957c0b5260 0x7f957c147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.554+0000 7f957b59e700 1 --2- 172.21.15.133:0/1690683370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f957c0b5c00 0x7f957c155a30 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.554+0000 7f957b59e700 1 -- 172.21.15.133:0/1690683370 >> 172.21.15.133:0/1690683370 conn(0x7f957c05bdf0 msgr2=0x7f957c0af920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:06.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.554+0000 7f957b59e700 1 -- 172.21.15.133:0/1690683370 shutdown_connections 2021-01-03T13:05:06.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.554+0000 7f957b59e700 1 -- 172.21.15.133:0/1690683370 wait complete. 2021-01-03T13:05:06.572 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:05:06.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.690+0000 7f2c1daeb700 1 Processor -- start 2021-01-03T13:05:06.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.690+0000 7f2c1daeb700 1 -- start start 2021-01-03T13:05:06.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.690+0000 7f2c1daeb700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c1805c130 0x7f2c180b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.690+0000 7f2c1daeb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2c180b02b0 0x7f2c180b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.690+0000 7f2c1daeb700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2c180622f0 0x7f2c180668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.690+0000 7f2c1daeb700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c181473d0 con 0x7f2c180622f0 2021-01-03T13:05:06.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.690+0000 7f2c1daeb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c180b0ab0 con 0x7f2c180b02b0 2021-01-03T13:05:06.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.690+0000 7f2c1daeb700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1805c510 con 0x7f2c1805c130 2021-01-03T13:05:06.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.690+0000 7f2c17fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2c180b02b0 0x7f2c180b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.690+0000 7f2c17fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2c180b02b0 0x7f2c180b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36442/0 (socket says 172.21.15.133:36442) 2021-01-03T13:05:06.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.690+0000 7f2c17fff700 1 -- 172.21.15.133:0/2010133306 learned_addr learned my addr 172.21.15.133:0/2010133306 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:06.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1d2ea700 1 --2- 172.21.15.133:0/2010133306 >> v2:172.21.15.16:3300/0 conn(0x7f2c180622f0 0x7f2c180668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1cae9700 1 --2- 172.21.15.133:0/2010133306 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c1805c130 0x7f2c180b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c17fff700 1 -- 172.21.15.133:0/2010133306 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c1805c130 msgr2=0x7f2c180b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:06.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c17fff700 1 --2- 172.21.15.133:0/2010133306 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c1805c130 0x7f2c180b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c17fff700 1 -- 172.21.15.133:0/2010133306 >> v2:172.21.15.16:3300/0 conn(0x7f2c180622f0 msgr2=0x7f2c180668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:06.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c17fff700 1 --2- 172.21.15.133:0/2010133306 >> v2:172.21.15.16:3300/0 conn(0x7f2c180622f0 0x7f2c180668a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c17fff700 1 -- 172.21.15.133:0/2010133306 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c180b15a0 con 0x7f2c180b02b0 2021-01-03T13:05:06.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1d2ea700 1 --2- 172.21.15.133:0/2010133306 >> v2:172.21.15.16:3300/0 conn(0x7f2c180622f0 0x7f2c180668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:06.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c17fff700 1 --2- 172.21.15.133:0/2010133306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c180b02b0 0x7f2c180b1ef0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f2c08002f30 tx=0x7f2c08006e80).ready entity=mon.1 client_cookie=287f1d3ac0b40f3f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:06.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c177fe700 1 -- 172.21.15.133:0/2010133306 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c080097f0 con 0x7f2c180b02b0 2021-01-03T13:05:06.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c177fe700 1 -- 172.21.15.133:0/2010133306 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c08009950 con 0x7f2c180b02b0 2021-01-03T13:05:06.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c177fe700 1 -- 172.21.15.133:0/2010133306 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c08009cb0 con 0x7f2c180b02b0 2021-01-03T13:05:06.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1daeb700 1 -- 172.21.15.133:0/2010133306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c180b02b0 msgr2=0x7f2c180b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1daeb700 1 --2- 172.21.15.133:0/2010133306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c180b02b0 0x7f2c180b1ef0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f2c08002f30 tx=0x7f2c08006e80).stop 2021-01-03T13:05:06.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1daeb700 1 -- 172.21.15.133:0/2010133306 shutdown_connections 2021-01-03T13:05:06.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1daeb700 1 --2- 172.21.15.133:0/2010133306 >> v2:172.21.15.16:3300/0 conn(0x7f2c180622f0 0x7f2c180668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1daeb700 1 --2- 172.21.15.133:0/2010133306 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c1805c130 0x7f2c180b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1daeb700 1 --2- 172.21.15.133:0/2010133306 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c180b02b0 0x7f2c180b1ef0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1daeb700 1 -- 172.21.15.133:0/2010133306 >> 172.21.15.133:0/2010133306 conn(0x7f2c180b6110 msgr2=0x7f2c180b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:06.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1daeb700 1 -- 172.21.15.133:0/2010133306 shutdown_connections 2021-01-03T13:05:06.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1daeb700 1 -- 172.21.15.133:0/2010133306 wait complete. 2021-01-03T13:05:06.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1daeb700 1 Processor -- start 2021-01-03T13:05:06.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1daeb700 1 -- start start 2021-01-03T13:05:06.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1daeb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1805c130 0x7f2c18066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1daeb700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c180622f0 0x7f2c180b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1daeb700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c180b02b0 0x7f2c180a2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1daeb700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c181550a0 con 0x7f2c180622f0 2021-01-03T13:05:06.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1daeb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c18065c90 con 0x7f2c1805c130 2021-01-03T13:05:06.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1daeb700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c18065750 con 0x7f2c180b02b0 2021-01-03T13:05:06.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1cae9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1805c130 0x7f2c18066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1cae9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1805c130 0x7f2c18066190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36448/0 (socket says 172.21.15.133:36448) 2021-01-03T13:05:06.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c17fff700 1 --2- 172.21.15.133:0/98483735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c180622f0 0x7f2c180b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.694+0000 7f2c1cae9700 1 -- 172.21.15.133:0/98483735 learned_addr learned my addr 172.21.15.133:0/98483735 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:06.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.698+0000 7f2c1d2ea700 1 --2- 172.21.15.133:0/98483735 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c180b02b0 0x7f2c180a2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.698+0000 7f2c1cae9700 1 -- 172.21.15.133:0/98483735 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c180b02b0 msgr2=0x7f2c180a2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.698+0000 7f2c1cae9700 1 --2- 172.21.15.133:0/98483735 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c180b02b0 0x7f2c180a2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.698+0000 7f2c1cae9700 1 -- 172.21.15.133:0/98483735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c180622f0 msgr2=0x7f2c180b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.698+0000 7f2c1cae9700 1 --2- 172.21.15.133:0/98483735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c180622f0 0x7f2c180b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.698+0000 7f2c1cae9700 1 -- 172.21.15.133:0/98483735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c180659f0 con 0x7f2c1805c130 2021-01-03T13:05:06.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.698+0000 7f2c1cae9700 1 --2- 172.21.15.133:0/98483735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1805c130 0x7f2c18066190 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f2c00003070 tx=0x7f2c00008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:06.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.698+0000 7f2c15ffb700 1 -- 172.21.15.133:0/98483735 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c00009790 con 0x7f2c1805c130 2021-01-03T13:05:06.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.698+0000 7f2c15ffb700 1 -- 172.21.15.133:0/98483735 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c000098f0 con 0x7f2c1805c130 2021-01-03T13:05:06.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.698+0000 7f2c1daeb700 1 -- 172.21.15.133:0/98483735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c180a30b0 con 0x7f2c1805c130 2021-01-03T13:05:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.698+0000 7f2c15ffb700 1 -- 172.21.15.133:0/98483735 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c00009c50 con 0x7f2c1805c130 2021-01-03T13:05:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.698+0000 7f2c1daeb700 1 -- 172.21.15.133:0/98483735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c18155720 con 0x7f2c1805c130 2021-01-03T13:05:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.698+0000 7f2c1daeb700 1 -- 172.21.15.133:0/98483735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c18155210 con 0x7f2c1805c130 2021-01-03T13:05:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.698+0000 7f2c15ffb700 1 -- 172.21.15.133:0/98483735 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2c00013480 con 0x7f2c1805c130 2021-01-03T13:05:06.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.698+0000 7f2c15ffb700 1 --2- 172.21.15.133:0/98483735 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2bfc0553b0 0x7f2bfc057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.702+0000 7f2c15ffb700 1 -- 172.21.15.133:0/98483735 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f2c0006dfa0 con 0x7f2c1805c130 2021-01-03T13:05:06.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.702+0000 7f2c17fff700 1 --2- 172.21.15.133:0/98483735 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2bfc0553b0 0x7f2bfc057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.702+0000 7f2c17fff700 1 --2- 172.21.15.133:0/98483735 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2bfc0553b0 0x7f2bfc057870 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f2c0801c000 tx=0x7f2c08015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:06.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.706+0000 7f2c15ffb700 1 -- 172.21.15.133:0/98483735 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2c00044570 con 0x7f2c1805c130 2021-01-03T13:05:06.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.846+0000 7f2c1daeb700 1 -- 172.21.15.133:0/98483735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2c18057300 con 0x7f2c1805c130 2021-01-03T13:05:06.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.846+0000 7f2c15ffb700 1 -- 172.21.15.133:0/98483735 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v85) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2c00009db0 con 0x7f2c1805c130 2021-01-03T13:05:06.851 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:05:06.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.850+0000 7f2c1daeb700 1 -- 172.21.15.133:0/98483735 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2bfc0553b0 msgr2=0x7f2bfc057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.850+0000 7f2c1daeb700 1 --2- 172.21.15.133:0/98483735 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2bfc0553b0 0x7f2bfc057870 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f2c0801c000 tx=0x7f2c08015000).stop 2021-01-03T13:05:06.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.850+0000 7f2c1daeb700 1 -- 172.21.15.133:0/98483735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1805c130 msgr2=0x7f2c18066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.850+0000 7f2c1daeb700 1 --2- 172.21.15.133:0/98483735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1805c130 0x7f2c18066190 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f2c00003070 tx=0x7f2c00008040).stop 2021-01-03T13:05:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.850+0000 7f2c1daeb700 1 -- 172.21.15.133:0/98483735 shutdown_connections 2021-01-03T13:05:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.850+0000 7f2c1daeb700 1 --2- 172.21.15.133:0/98483735 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2bfc0553b0 0x7f2bfc057870 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.850+0000 7f2c1daeb700 1 --2- 172.21.15.133:0/98483735 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c180b02b0 0x7f2c180a2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.850+0000 7f2c1daeb700 1 --2- 172.21.15.133:0/98483735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c1805c130 0x7f2c18066190 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.850+0000 7f2c1daeb700 1 --2- 172.21.15.133:0/98483735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c180622f0 0x7f2c180b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.850+0000 7f2c1daeb700 1 -- 172.21.15.133:0/98483735 >> 172.21.15.133:0/98483735 conn(0x7f2c180b6110 msgr2=0x7f2c181412a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:06.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.850+0000 7f2c1daeb700 1 -- 172.21.15.133:0/98483735 shutdown_connections 2021-01-03T13:05:06.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.850+0000 7f2c1daeb700 1 -- 172.21.15.133:0/98483735 wait complete. 2021-01-03T13:05:06.865 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-01-03T13:05:06.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de359e700 1 Processor -- start 2021-01-03T13:05:06.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de359e700 1 -- start start 2021-01-03T13:05:06.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de359e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2de40b1300 0x7f2de41428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2de40b2050 0x7f2de40a8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de359e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de40afa40 con 0x7f2de40b0c30 2021-01-03T13:05:06.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de359e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de40b25d0 con 0x7f2de40b1300 2021-01-03T13:05:06.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de40b2870 con 0x7f2de40b2050 2021-01-03T13:05:06.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de259c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2de40b1300 0x7f2de41428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de2d9d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2de40b2050 0x7f2de40a8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de259c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2de40b1300 0x7f2de41428c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:34994/0 (socket says 172.21.15.133:34994) 2021-01-03T13:05:06.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de1d9b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f2de40b0c30 0x7f2de40ad4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:36216/0 (socket says 172.21.15.133:36216) 2021-01-03T13:05:06.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de259c700 1 -- 172.21.15.133:0/3178997176 learned_addr learned my addr 172.21.15.133:0/3178997176 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:06.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de2d9d700 1 -- 172.21.15.133:0/3178997176 >> v2:172.21.15.16:3300/0 conn(0x7f2de40b1300 msgr2=0x7f2de41428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:06.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de2d9d700 1 --2- 172.21.15.133:0/3178997176 >> v2:172.21.15.16:3300/0 conn(0x7f2de40b1300 0x7f2de41428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de2d9d700 1 -- 172.21.15.133:0/3178997176 >> v1:172.21.15.16:6789/0 conn(0x7f2de40b0c30 legacy=0x7f2de40ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de2d9d700 1 -- 172.21.15.133:0/3178997176 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de40ad040 con 0x7f2de40b2050 2021-01-03T13:05:06.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de259c700 1 --2- 172.21.15.133:0/3178997176 >> v2:172.21.15.16:3300/0 conn(0x7f2de40b1300 0x7f2de41428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:06.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.974+0000 7f2de2d9d700 1 --2- 172.21.15.133:0/3178997176 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2de40b2050 0x7f2de40a8850 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f2ddc0032b0 tx=0x7f2ddc00a360).ready entity=mon.2 client_cookie=700dc4bb6fa88be2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:06.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.978+0000 7f2de159a700 1 -- 172.21.15.133:0/3178997176 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ddc010410 con 0x7f2de40b2050 2021-01-03T13:05:06.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.978+0000 7f2de159a700 1 -- 172.21.15.133:0/3178997176 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc010570 con 0x7f2de40b2050 2021-01-03T13:05:06.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.978+0000 7f2de159a700 1 -- 172.21.15.133:0/3178997176 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ddc0108d0 con 0x7f2de40b2050 2021-01-03T13:05:06.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.978+0000 7f2de359e700 1 -- 172.21.15.133:0/3178997176 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2de40b2050 msgr2=0x7f2de40a8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.978+0000 7f2de359e700 1 --2- 172.21.15.133:0/3178997176 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2de40b2050 0x7f2de40a8850 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f2ddc0032b0 tx=0x7f2ddc00a360).stop 2021-01-03T13:05:06.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.978+0000 7f2de359e700 1 -- 172.21.15.133:0/3178997176 shutdown_connections 2021-01-03T13:05:06.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.978+0000 7f2de359e700 1 --2- 172.21.15.133:0/3178997176 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2de40b2050 0x7f2de40a8850 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.978+0000 7f2de359e700 1 --2- 172.21.15.133:0/3178997176 >> v2:172.21.15.16:3300/0 conn(0x7f2de40b1300 0x7f2de41428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.978+0000 7f2de359e700 1 -- 172.21.15.133:0/3178997176 >> 172.21.15.133:0/3178997176 conn(0x7f2de406b050 msgr2=0x7f2de4060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:06.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.978+0000 7f2de359e700 1 -- 172.21.15.133:0/3178997176 shutdown_connections 2021-01-03T13:05:06.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.978+0000 7f2de359e700 1 -- 172.21.15.133:0/3178997176 wait complete. 2021-01-03T13:05:06.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.978+0000 7f2de359e700 1 Processor -- start 2021-01-03T13:05:06.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.978+0000 7f2de359e700 1 -- start start 2021-01-03T13:05:06.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2de40b0c30 0x7f2de40662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de40b1300 0x7f2de4064040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2de40b2050 0x7f2de413da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de359e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de409fd60 con 0x7f2de40b2050 2021-01-03T13:05:06.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4064b60 con 0x7f2de40b1300 2021-01-03T13:05:06.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4065670 con 0x7f2de40b0c30 2021-01-03T13:05:06.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de40b1300 0x7f2de4064040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de259c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2de40b0c30 0x7f2de40662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de40b1300 0x7f2de4064040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36462/0 (socket says 172.21.15.133:36462) 2021-01-03T13:05:06.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de1d9b700 1 -- 172.21.15.133:0/3973072911 learned_addr learned my addr 172.21.15.133:0/3973072911 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:06.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de2d9d700 1 --2- 172.21.15.133:0/3973072911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2de40b2050 0x7f2de413da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de1d9b700 1 -- 172.21.15.133:0/3973072911 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2de40b0c30 msgr2=0x7f2de40662e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de1d9b700 1 --2- 172.21.15.133:0/3973072911 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2de40b0c30 0x7f2de40662e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de1d9b700 1 -- 172.21.15.133:0/3973072911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2de40b2050 msgr2=0x7f2de413da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:06.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de1d9b700 1 --2- 172.21.15.133:0/3973072911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2de40b2050 0x7f2de413da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:06.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de1d9b700 1 -- 172.21.15.133:0/3973072911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de4065910 con 0x7f2de40b1300 2021-01-03T13:05:06.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de259c700 1 --2- 172.21.15.133:0/3973072911 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2de40b0c30 0x7f2de40662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:06.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de1d9b700 1 --2- 172.21.15.133:0/3973072911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de40b1300 0x7f2de4064040 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f2de405ce00 tx=0x7f2dcc007ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:06.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2ddb7fe700 1 -- 172.21.15.133:0/3973072911 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dcc0072e0 con 0x7f2de40b1300 2021-01-03T13:05:06.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2ddb7fe700 1 -- 172.21.15.133:0/3973072911 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc005520 con 0x7f2de40b1300 2021-01-03T13:05:06.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2ddb7fe700 1 -- 172.21.15.133:0/3973072911 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dcc005880 con 0x7f2de40b1300 2021-01-03T13:05:06.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de359e700 1 -- 172.21.15.133:0/3973072911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de4065bb0 con 0x7f2de40b1300 2021-01-03T13:05:06.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.982+0000 7f2de359e700 1 -- 172.21.15.133:0/3973072911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de4064820 con 0x7f2de40b1300 2021-01-03T13:05:06.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.986+0000 7f2ddb7fe700 1 -- 172.21.15.133:0/3973072911 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2dcc010070 con 0x7f2de40b1300 2021-01-03T13:05:06.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.986+0000 7f2de359e700 1 -- 172.21.15.133:0/3973072911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de4065d40 con 0x7f2de40b1300 2021-01-03T13:05:06.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.986+0000 7f2ddb7fe700 1 --2- 172.21.15.133:0/3973072911 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2dc8055440 0x7f2dc8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:06.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.986+0000 7f2ddb7fe700 1 -- 172.21.15.133:0/3973072911 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f2dcc06d1d0 con 0x7f2de40b1300 2021-01-03T13:05:06.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.986+0000 7f2de259c700 1 --2- 172.21.15.133:0/3973072911 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2dc8055440 0x7f2dc8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:06.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.990+0000 7f2de259c700 1 --2- 172.21.15.133:0/3973072911 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2dc8055440 0x7f2dc8057900 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f2dd4008000 tx=0x7f2dd4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:06.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:06.994+0000 7f2ddb7fe700 1 -- 172.21.15.133:0/3973072911 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2dcc043800 con 0x7f2de40b1300 2021-01-03T13:05:07.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.134+0000 7f2de359e700 1 -- 172.21.15.133:0/3973072911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2de4057300 con 0x7f2de40b1300 2021-01-03T13:05:07.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.134+0000 7f2ddb7fe700 1 -- 172.21.15.133:0/3973072911 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v85) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2dcc046e20 con 0x7f2de40b1300 2021-01-03T13:05:07.138 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:07.138 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2021-01-03T13:05:07.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:07.139 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2021-01-03T13:05:07.139 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2021-01-03T13:05:07.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:07.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:07.140 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2021-01-03T13:05:07.140 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2021-01-03T13:05:07.140 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:07.140 INFO:teuthology.orchestra.run.smithi133.stdout:] 2021-01-03T13:05:07.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.134+0000 7f2de359e700 1 -- 172.21.15.133:0/3973072911 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2dc8055440 msgr2=0x7f2dc8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:07.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.134+0000 7f2de359e700 1 --2- 172.21.15.133:0/3973072911 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2dc8055440 0x7f2dc8057900 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f2dd4008000 tx=0x7f2dd4008040).stop 2021-01-03T13:05:07.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.134+0000 7f2de359e700 1 -- 172.21.15.133:0/3973072911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de40b1300 msgr2=0x7f2de4064040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:07.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.134+0000 7f2de359e700 1 --2- 172.21.15.133:0/3973072911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de40b1300 0x7f2de4064040 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f2de405ce00 tx=0x7f2dcc007ba0).stop 2021-01-03T13:05:07.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.134+0000 7f2de359e700 1 -- 172.21.15.133:0/3973072911 shutdown_connections 2021-01-03T13:05:07.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.134+0000 7f2de359e700 1 --2- 172.21.15.133:0/3973072911 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2dc8055440 0x7f2dc8057900 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.134+0000 7f2de359e700 1 --2- 172.21.15.133:0/3973072911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2de40b2050 0x7f2de413da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.134+0000 7f2de359e700 1 --2- 172.21.15.133:0/3973072911 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2de40b0c30 0x7f2de40662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.134+0000 7f2de359e700 1 --2- 172.21.15.133:0/3973072911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2de40b1300 0x7f2de4064040 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.134+0000 7f2de359e700 1 -- 172.21.15.133:0/3973072911 >> 172.21.15.133:0/3973072911 conn(0x7f2de406b050 msgr2=0x7f2de40b5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:07.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.134+0000 7f2de359e700 1 -- 172.21.15.133:0/3973072911 shutdown_connections 2021-01-03T13:05:07.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.134+0000 7f2de359e700 1 -- 172.21.15.133:0/3973072911 wait complete. 2021-01-03T13:05:07.151 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-01-03T13:05:07.151 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-01-03T13:05:07.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.258+0000 7f807f0d2700 1 Processor -- start 2021-01-03T13:05:07.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.258+0000 7f807f0d2700 1 -- start start 2021-01-03T13:05:07.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807f0d2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f80780677a0 0x7f80780ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:07.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807f0d2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80780b1a50 0x7f80780a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:07.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807f0d2700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8078140ae0 con 0x7f807805c670 2021-01-03T13:05:07.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807f0d2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80780ace10 con 0x7f80780677a0 2021-01-03T13:05:07.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807f0d2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8078067b80 con 0x7f80780b1a50 2021-01-03T13:05:07.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807e0d0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f80780677a0 0x7f80780ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:07.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807e0d0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f80780677a0 0x7f80780ae3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36472/0 (socket says 172.21.15.133:36472) 2021-01-03T13:05:07.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807e8d1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80780b1a50 0x7f80780a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:07.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807e0d0700 1 -- 172.21.15.133:0/1493344867 learned_addr learned my addr 172.21.15.133:0/1493344867 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:07.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807e0d0700 1 -- 172.21.15.133:0/1493344867 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80780b1a50 msgr2=0x7f80780a8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:07.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807e0d0700 1 --2- 172.21.15.133:0/1493344867 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80780b1a50 0x7f80780a8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807e0d0700 1 -- 172.21.15.133:0/1493344867 >> v1:172.21.15.16:6789/0 conn(0x7f807805c670 legacy=0x7f8078146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:07.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807d0ce700 1 -- 172.21.15.133:0/1493344867 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980641044 0 0) 0x7f8078140ae0 con 0x7f807805c670 2021-01-03T13:05:07.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807e0d0700 1 -- 172.21.15.133:0/1493344867 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80780b1560 con 0x7f80780677a0 2021-01-03T13:05:07.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807e0d0700 1 --2- 172.21.15.133:0/1493344867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80780677a0 0x7f80780ae3b0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f8074002f30 tx=0x7f8074006e80).ready entity=mon.1 client_cookie=19ffe796777b5153 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:07.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807d0ce700 1 -- 172.21.15.133:0/1493344867 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80740097f0 con 0x7f80780677a0 2021-01-03T13:05:07.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807d0ce700 1 -- 172.21.15.133:0/1493344867 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8074009950 con 0x7f80780677a0 2021-01-03T13:05:07.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807d0ce700 1 -- 172.21.15.133:0/1493344867 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8074009cb0 con 0x7f80780677a0 2021-01-03T13:05:07.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807f0d2700 1 -- 172.21.15.133:0/1493344867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80780677a0 msgr2=0x7f80780ae3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:07.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807f0d2700 1 --2- 172.21.15.133:0/1493344867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80780677a0 0x7f80780ae3b0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f8074002f30 tx=0x7f8074006e80).stop 2021-01-03T13:05:07.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807f0d2700 1 -- 172.21.15.133:0/1493344867 shutdown_connections 2021-01-03T13:05:07.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807f0d2700 1 --2- 172.21.15.133:0/1493344867 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80780b1a50 0x7f80780a8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807f0d2700 1 --2- 172.21.15.133:0/1493344867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80780677a0 0x7f80780ae3b0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807f0d2700 1 -- 172.21.15.133:0/1493344867 >> 172.21.15.133:0/1493344867 conn(0x7f807806b050 msgr2=0x7f8078060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:07.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807f0d2700 1 -- 172.21.15.133:0/1493344867 shutdown_connections 2021-01-03T13:05:07.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.262+0000 7f807f0d2700 1 -- 172.21.15.133:0/1493344867 wait complete. 2021-01-03T13:05:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807f0d2700 1 Processor -- start 2021-01-03T13:05:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807f0d2700 1 -- start start 2021-01-03T13:05:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807f0d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f807805c670 0x7f80781497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:07.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807f0d2700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80780677a0 0x7f807813c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:07.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807f0d2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80780b1a50 0x7f807813c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:07.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807f0d2700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80781457f0 con 0x7f80780677a0 2021-01-03T13:05:07.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807f0d2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8078146b70 con 0x7f807805c670 2021-01-03T13:05:07.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807f0d2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8078146df0 con 0x7f80780b1a50 2021-01-03T13:05:07.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807e0d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f807805c670 0x7f80781497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:07.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807e0d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f807805c670 0x7f80781497f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36474/0 (socket says 172.21.15.133:36474) 2021-01-03T13:05:07.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807e0d0700 1 -- 172.21.15.133:0/3912244525 learned_addr learned my addr 172.21.15.133:0/3912244525 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:07.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807d8cf700 1 --2- 172.21.15.133:0/3912244525 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80780677a0 0x7f807813c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:07.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807e8d1700 1 --2- 172.21.15.133:0/3912244525 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80780b1a50 0x7f807813c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:07.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807e0d0700 1 -- 172.21.15.133:0/3912244525 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80780b1a50 msgr2=0x7f807813c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:07.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807e0d0700 1 --2- 172.21.15.133:0/3912244525 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80780b1a50 0x7f807813c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807e0d0700 1 -- 172.21.15.133:0/3912244525 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80780677a0 msgr2=0x7f807813c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807e0d0700 1 --2- 172.21.15.133:0/3912244525 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80780677a0 0x7f807813c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807e0d0700 1 -- 172.21.15.133:0/3912244525 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8078145a50 con 0x7f807805c670 2021-01-03T13:05:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807d8cf700 1 --2- 172.21.15.133:0/3912244525 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80780677a0 0x7f807813c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807e8d1700 1 --2- 172.21.15.133:0/3912244525 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80780b1a50 0x7f807813c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:07.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807e0d0700 1 --2- 172.21.15.133:0/3912244525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f807805c670 0x7f80781497f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f8074002f30 tx=0x7f8074015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:07.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f80677fe700 1 -- 172.21.15.133:0/3912244525 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8074011ce0 con 0x7f807805c670 2021-01-03T13:05:07.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f80677fe700 1 -- 172.21.15.133:0/3912244525 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8074011e40 con 0x7f807805c670 2021-01-03T13:05:07.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f80677fe700 1 -- 172.21.15.133:0/3912244525 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f807401e650 con 0x7f807805c670 2021-01-03T13:05:07.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807f0d2700 1 -- 172.21.15.133:0/3912244525 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8078145cf0 con 0x7f807805c670 2021-01-03T13:05:07.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.266+0000 7f807f0d2700 1 -- 172.21.15.133:0/3912244525 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8078149f30 con 0x7f807805c670 2021-01-03T13:05:07.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.270+0000 7f807f0d2700 1 -- 172.21.15.133:0/3912244525 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8078057300 con 0x7f807805c670 2021-01-03T13:05:07.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.270+0000 7f80677fe700 1 -- 172.21.15.133:0/3912244525 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8074025030 con 0x7f807805c670 2021-01-03T13:05:07.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.270+0000 7f80677fe700 1 --2- 172.21.15.133:0/3912244525 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80580554e0 0x7f80580579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:07.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.270+0000 7f80677fe700 1 -- 172.21.15.133:0/3912244525 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f807406f100 con 0x7f807805c670 2021-01-03T13:05:07.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.270+0000 7f807d8cf700 1 --2- 172.21.15.133:0/3912244525 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80580554e0 0x7f80580579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:07.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.270+0000 7f807d8cf700 1 --2- 172.21.15.133:0/3912244525 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80580554e0 0x7f80580579a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f806800b000 tx=0x7f8068009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:07.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.278+0000 7f80677fe700 1 -- 172.21.15.133:0/3912244525 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8074045690 con 0x7f807805c670 2021-01-03T13:05:07.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.418+0000 7f807f0d2700 1 -- 172.21.15.133:0/3912244525 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f807805f080 con 0x7f807805c670 2021-01-03T13:05:07.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.534+0000 7f80677fe700 1 -- 172.21.15.133:0/3912244525 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v86) v1 ==== 133+0+0 (secure 0 0 0) 0x7f8074048cb0 con 0x7f807805c670 2021-01-03T13:05:07.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.542+0000 7f807f0d2700 1 -- 172.21.15.133:0/3912244525 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80580554e0 msgr2=0x7f80580579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:07.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.542+0000 7f807f0d2700 1 --2- 172.21.15.133:0/3912244525 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80580554e0 0x7f80580579a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f806800b000 tx=0x7f8068009040).stop 2021-01-03T13:05:07.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.542+0000 7f807f0d2700 1 -- 172.21.15.133:0/3912244525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f807805c670 msgr2=0x7f80781497f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:07.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.542+0000 7f807f0d2700 1 --2- 172.21.15.133:0/3912244525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f807805c670 0x7f80781497f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f8074002f30 tx=0x7f8074015000).stop 2021-01-03T13:05:07.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.542+0000 7f807f0d2700 1 -- 172.21.15.133:0/3912244525 shutdown_connections 2021-01-03T13:05:07.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.542+0000 7f807f0d2700 1 --2- 172.21.15.133:0/3912244525 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80580554e0 0x7f80580579a0 secure :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0x7f806800b000 tx=0x7f8068009040).stop 2021-01-03T13:05:07.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.542+0000 7f807f0d2700 1 --2- 172.21.15.133:0/3912244525 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80780b1a50 0x7f807813c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.542+0000 7f807f0d2700 1 --2- 172.21.15.133:0/3912244525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f807805c670 0x7f80781497f0 secure :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0x7f8074002f30 tx=0x7f8074015000).stop 2021-01-03T13:05:07.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.542+0000 7f807f0d2700 1 --2- 172.21.15.133:0/3912244525 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80780677a0 0x7f807813c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.542+0000 7f807f0d2700 1 -- 172.21.15.133:0/3912244525 >> 172.21.15.133:0/3912244525 conn(0x7f807806b050 msgr2=0x7f80780b3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:07.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.542+0000 7f807f0d2700 1 -- 172.21.15.133:0/3912244525 shutdown_connections 2021-01-03T13:05:07.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.542+0000 7f807f0d2700 1 -- 172.21.15.133:0/3912244525 wait complete. 2021-01-03T13:05:07.548 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2021-01-03T13:05:07.559 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-01-03T13:05:07.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246c55c700 1 Processor -- start 2021-01-03T13:05:07.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246c55c700 1 -- start start 2021-01-03T13:05:07.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246c55c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f246409cea0 0x7f24640b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:07.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246c55c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f24640b40d0 0x7f24641442f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:07.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246c55c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24640b36a0 0x7f24641447e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:07.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246c55c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24640adf30 con 0x7f24640b40d0 2021-01-03T13:05:07.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246c55c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24640b2c90 con 0x7f24640b36a0 2021-01-03T13:05:07.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246c55c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2464060490 con 0x7f246409cea0 2021-01-03T13:05:07.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246aaf9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24640b36a0 0x7f24641447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:07.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246aaf9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f24640b36a0 0x7f24641447e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36484/0 (socket says 172.21.15.133:36484) 2021-01-03T13:05:07.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246aaf9700 1 -- 172.21.15.133:0/2103497059 learned_addr learned my addr 172.21.15.133:0/2103497059 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:07.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246a2f8700 1 --2- 172.21.15.133:0/2103497059 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f246409cea0 0x7f24640b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:07.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f2469af7700 1 --2- 172.21.15.133:0/2103497059 >> v2:172.21.15.16:3300/0 conn(0x7f24640b40d0 0x7f24641442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:07.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246aaf9700 1 -- 172.21.15.133:0/2103497059 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f246409cea0 msgr2=0x7f24640b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:07.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246aaf9700 1 --2- 172.21.15.133:0/2103497059 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f246409cea0 0x7f24640b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246aaf9700 1 -- 172.21.15.133:0/2103497059 >> v2:172.21.15.16:3300/0 conn(0x7f24640b40d0 msgr2=0x7f24641442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:07.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246aaf9700 1 --2- 172.21.15.133:0/2103497059 >> v2:172.21.15.16:3300/0 conn(0x7f24640b40d0 0x7f24641442f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246aaf9700 1 -- 172.21.15.133:0/2103497059 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24640b2ec0 con 0x7f24640b36a0 2021-01-03T13:05:07.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246aaf9700 1 --2- 172.21.15.133:0/2103497059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24640b36a0 0x7f24641447e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f245c002f30 tx=0x7f245c006e80).ready entity=mon.1 client_cookie=55e4b80ede4e400a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:07.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f24692f6700 1 -- 172.21.15.133:0/2103497059 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f245c0097f0 con 0x7f24640b36a0 2021-01-03T13:05:07.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f24692f6700 1 -- 172.21.15.133:0/2103497059 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c009950 con 0x7f24640b36a0 2021-01-03T13:05:07.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f24692f6700 1 -- 172.21.15.133:0/2103497059 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f245c009cb0 con 0x7f24640b36a0 2021-01-03T13:05:07.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246c55c700 1 -- 172.21.15.133:0/2103497059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24640b36a0 msgr2=0x7f24641447e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:07.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246c55c700 1 --2- 172.21.15.133:0/2103497059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24640b36a0 0x7f24641447e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f245c002f30 tx=0x7f245c006e80).stop 2021-01-03T13:05:07.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.678+0000 7f246c55c700 1 -- 172.21.15.133:0/2103497059 shutdown_connections 2021-01-03T13:05:07.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246c55c700 1 --2- 172.21.15.133:0/2103497059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24640b36a0 0x7f24641447e0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246c55c700 1 --2- 172.21.15.133:0/2103497059 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f246409cea0 0x7f24640b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246c55c700 1 --2- 172.21.15.133:0/2103497059 >> v2:172.21.15.16:3300/0 conn(0x7f24640b40d0 0x7f24641442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246c55c700 1 -- 172.21.15.133:0/2103497059 >> 172.21.15.133:0/2103497059 conn(0x7f246405bdf0 msgr2=0x7f246405c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:07.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246c55c700 1 -- 172.21.15.133:0/2103497059 shutdown_connections 2021-01-03T13:05:07.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246c55c700 1 -- 172.21.15.133:0/2103497059 wait complete. 2021-01-03T13:05:07.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246c55c700 1 Processor -- start 2021-01-03T13:05:07.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246c55c700 1 -- start start 2021-01-03T13:05:07.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246c55c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f246409cea0 0x7f2464146720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:07.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246c55c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24640b36a0 0x7f246409b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:07.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246c55c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2464147240 0x7f24641477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:07.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246c55c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24640674f0 con 0x7f246409cea0 2021-01-03T13:05:07.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246c55c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24640b18c0 con 0x7f2464147240 2021-01-03T13:05:07.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246c55c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24640b1b60 con 0x7f24640b36a0 2021-01-03T13:05:07.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246aaf9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2464147240 0x7f24641477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:07.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246aaf9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2464147240 0x7f24641477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36492/0 (socket says 172.21.15.133:36492) 2021-01-03T13:05:07.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f2469af7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24640b36a0 0x7f246409b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:07.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246aaf9700 1 -- 172.21.15.133:0/957663024 learned_addr learned my addr 172.21.15.133:0/957663024 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:07.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.682+0000 7f246a2f8700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f246409cea0 0x7f2464146720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:07.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.686+0000 7f246aaf9700 1 -- 172.21.15.133:0/957663024 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24640b36a0 msgr2=0x7f246409b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:07.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.686+0000 7f246aaf9700 1 --2- 172.21.15.133:0/957663024 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24640b36a0 0x7f246409b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.686+0000 7f246aaf9700 1 -- 172.21.15.133:0/957663024 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f246409cea0 msgr2=0x7f2464146720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:07.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.686+0000 7f246aaf9700 1 --2- 172.21.15.133:0/957663024 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f246409cea0 0x7f2464146720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:07.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.686+0000 7f246aaf9700 1 -- 172.21.15.133:0/957663024 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246409c060 con 0x7f2464147240 2021-01-03T13:05:07.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.686+0000 7f246a2f8700 1 --2- 172.21.15.133:0/957663024 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f246409cea0 0x7f2464146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:07.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.686+0000 7f246aaf9700 1 --2- 172.21.15.133:0/957663024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2464147240 0x7f24641477c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f245c002f30 tx=0x7f245c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:07.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.686+0000 7f24537fe700 1 -- 172.21.15.133:0/957663024 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f245c006bb0 con 0x7f2464147240 2021-01-03T13:05:07.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.686+0000 7f24537fe700 1 -- 172.21.15.133:0/957663024 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c011b80 con 0x7f2464147240 2021-01-03T13:05:07.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.686+0000 7f24537fe700 1 -- 172.21.15.133:0/957663024 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f245c0067b0 con 0x7f2464147240 2021-01-03T13:05:07.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.686+0000 7f246c55c700 1 -- 172.21.15.133:0/957663024 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2464067790 con 0x7f2464147240 2021-01-03T13:05:07.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.686+0000 7f246c55c700 1 -- 172.21.15.133:0/957663024 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2464147e50 con 0x7f2464147240 2021-01-03T13:05:07.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.686+0000 7f246c55c700 1 -- 172.21.15.133:0/957663024 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2464148420 con 0x7f2464147240 2021-01-03T13:05:07.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.686+0000 7f24537fe700 1 -- 172.21.15.133:0/957663024 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f245c025030 con 0x7f2464147240 2021-01-03T13:05:07.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.686+0000 7f24537fe700 1 --2- 172.21.15.133:0/957663024 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2444055330 0x7f24440577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:07.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.686+0000 7f24537fe700 1 -- 172.21.15.133:0/957663024 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f245c06f0c0 con 0x7f2464147240 2021-01-03T13:05:07.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.686+0000 7f246a2f8700 1 --2- 172.21.15.133:0/957663024 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2444055330 0x7f24440577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:07.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.690+0000 7f246a2f8700 1 --2- 172.21.15.133:0/957663024 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2444055330 0x7f24440577f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f246000b000 tx=0x7f24600091a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:07.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.694+0000 7f24537fe700 1 -- 172.21.15.133:0/957663024 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f245c045590 con 0x7f2464147240 2021-01-03T13:05:07.812 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:05:07.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:05:07.828 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:05:07.830 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:05:07.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:07.830+0000 7f246c55c700 1 -- 172.21.15.133:0/957663024 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f2464057300 con 0x7f2464147240 2021-01-03T13:05:08.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.542+0000 7f24537fe700 1 -- 172.21.15.133:0/957663024 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v87) v1 ==== 125+0+0 (secure 0 0 0) 0x7f245c023020 con 0x7f2464147240 2021-01-03T13:05:08.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.546+0000 7f246c55c700 1 -- 172.21.15.133:0/957663024 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2444055330 msgr2=0x7f24440577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:08.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.546+0000 7f246c55c700 1 --2- 172.21.15.133:0/957663024 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2444055330 0x7f24440577f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f246000b000 tx=0x7f24600091a0).stop 2021-01-03T13:05:08.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.546+0000 7f246c55c700 1 -- 172.21.15.133:0/957663024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2464147240 msgr2=0x7f24641477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:08.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.546+0000 7f246c55c700 1 --2- 172.21.15.133:0/957663024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2464147240 0x7f24641477c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f245c002f30 tx=0x7f245c015000).stop 2021-01-03T13:05:08.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.550+0000 7f246c55c700 1 -- 172.21.15.133:0/957663024 shutdown_connections 2021-01-03T13:05:08.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.550+0000 7f246c55c700 1 --2- 172.21.15.133:0/957663024 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2444055330 0x7f24440577f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:08.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.550+0000 7f246c55c700 1 --2- 172.21.15.133:0/957663024 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f246409cea0 0x7f2464146720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:08.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.550+0000 7f246c55c700 1 --2- 172.21.15.133:0/957663024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2464147240 0x7f24641477c0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:08.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.550+0000 7f246c55c700 1 --2- 172.21.15.133:0/957663024 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24640b36a0 0x7f246409b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:08.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.550+0000 7f246c55c700 1 -- 172.21.15.133:0/957663024 >> 172.21.15.133:0/957663024 conn(0x7f246405bdf0 msgr2=0x7f24640ac480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:08.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.550+0000 7f246c55c700 1 -- 172.21.15.133:0/957663024 shutdown_connections 2021-01-03T13:05:08.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.550+0000 7f246c55c700 1 -- 172.21.15.133:0/957663024 wait complete. 2021-01-03T13:05:08.556 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2021-01-03T13:05:08.565 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-01-03T13:05:08.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.666+0000 7f669f319700 1 Processor -- start 2021-01-03T13:05:08.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.666+0000 7f669f319700 1 -- start start 2021-01-03T13:05:08.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669f319700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f669809cea0 0x7f66980b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:08.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669f319700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66980b36a0 0x7f6698144a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:08.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669f319700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66980b2c90 con 0x7f66980b40d0 2021-01-03T13:05:08.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669f319700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66980adf30 con 0x7f669809cea0 2021-01-03T13:05:08.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669f319700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6698060490 con 0x7f66980b36a0 2021-01-03T13:05:08.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669d8b6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66980b36a0 0x7f6698144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:08.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669c8b4700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f66980b40d0 0x7f66981442f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57528/0 (socket says 172.21.15.133:57528) 2021-01-03T13:05:08.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669c8b4700 1 -- 172.21.15.133:0/1017248082 learned_addr learned my addr 172.21.15.133:0/1017248082 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:08.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669d0b5700 1 --2- 172.21.15.133:0/1017248082 >> v2:172.21.15.16:3300/0 conn(0x7f669809cea0 0x7f66980b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:08.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669d8b6700 1 -- 172.21.15.133:0/1017248082 >> v2:172.21.15.16:3300/0 conn(0x7f669809cea0 msgr2=0x7f66980b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:08.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669d8b6700 1 --2- 172.21.15.133:0/1017248082 >> v2:172.21.15.16:3300/0 conn(0x7f669809cea0 0x7f66980b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:08.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669d8b6700 1 -- 172.21.15.133:0/1017248082 >> v1:172.21.15.133:6789/0 conn(0x7f66980b40d0 legacy=0x7f66981442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:08.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669d8b6700 1 -- 172.21.15.133:0/1017248082 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66980b2ec0 con 0x7f66980b36a0 2021-01-03T13:05:08.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f6697fff700 1 -- 172.21.15.133:0/1017248082 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474957877 0 0) 0x7f66980b2c90 con 0x7f66980b40d0 2021-01-03T13:05:08.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669d0b5700 1 --2- 172.21.15.133:0/1017248082 >> v2:172.21.15.16:3300/0 conn(0x7f669809cea0 0x7f66980b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:08.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669d8b6700 1 --2- 172.21.15.133:0/1017248082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980b36a0 0x7f6698144a00 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f6690002f30 tx=0x7f6690006dc0).ready entity=mon.1 client_cookie=807818e79777f8bd server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:08.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f6697fff700 1 -- 172.21.15.133:0/1017248082 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66900097f0 con 0x7f66980b36a0 2021-01-03T13:05:08.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f6697fff700 1 -- 172.21.15.133:0/1017248082 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6690009950 con 0x7f66980b36a0 2021-01-03T13:05:08.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f6697fff700 1 -- 172.21.15.133:0/1017248082 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6690009cb0 con 0x7f66980b36a0 2021-01-03T13:05:08.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669f319700 1 -- 172.21.15.133:0/1017248082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980b36a0 msgr2=0x7f6698144a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:08.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669f319700 1 --2- 172.21.15.133:0/1017248082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980b36a0 0x7f6698144a00 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f6690002f30 tx=0x7f6690006dc0).stop 2021-01-03T13:05:08.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669f319700 1 -- 172.21.15.133:0/1017248082 shutdown_connections 2021-01-03T13:05:08.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669f319700 1 --2- 172.21.15.133:0/1017248082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980b36a0 0x7f6698144a00 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:08.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669f319700 1 --2- 172.21.15.133:0/1017248082 >> v2:172.21.15.16:3300/0 conn(0x7f669809cea0 0x7f66980b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:08.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669f319700 1 -- 172.21.15.133:0/1017248082 >> 172.21.15.133:0/1017248082 conn(0x7f669805bdf0 msgr2=0x7f669805c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:08.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669f319700 1 -- 172.21.15.133:0/1017248082 shutdown_connections 2021-01-03T13:05:08.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669f319700 1 -- 172.21.15.133:0/1017248082 wait complete. 2021-01-03T13:05:08.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669f319700 1 Processor -- start 2021-01-03T13:05:08.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.670+0000 7f669f319700 1 -- start start 2021-01-03T13:05:08.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669f319700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f669809cea0 0x7f6698143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:08.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669f319700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66980b36a0 0x7f66980624a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:08.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669f319700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980630e0 0x7f66980613e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:08.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669f319700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6698146760 con 0x7f66980b36a0 2021-01-03T13:05:08.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669f319700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6698148240 con 0x7f66980630e0 2021-01-03T13:05:08.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669f319700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6698067d90 con 0x7f669809cea0 2021-01-03T13:05:08.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669d8b6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980630e0 0x7f66980613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:08.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669d8b6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980630e0 0x7f66980613e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36506/0 (socket says 172.21.15.133:36506) 2021-01-03T13:05:08.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669d8b6700 1 -- 172.21.15.133:0/3141021953 learned_addr learned my addr 172.21.15.133:0/3141021953 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:08.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669c8b4700 1 --2- 172.21.15.133:0/3141021953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66980b36a0 0x7f66980624a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:08.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669d0b5700 1 --2- 172.21.15.133:0/3141021953 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f669809cea0 0x7f6698143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:08.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669d8b6700 1 -- 172.21.15.133:0/3141021953 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f669809cea0 msgr2=0x7f6698143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:08.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669d8b6700 1 --2- 172.21.15.133:0/3141021953 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f669809cea0 0x7f6698143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:08.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669d8b6700 1 -- 172.21.15.133:0/3141021953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66980b36a0 msgr2=0x7f66980624a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:08.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669d8b6700 1 --2- 172.21.15.133:0/3141021953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66980b36a0 0x7f66980624a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:08.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669d8b6700 1 -- 172.21.15.133:0/3141021953 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6698143d20 con 0x7f66980630e0 2021-01-03T13:05:08.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669d8b6700 1 --2- 172.21.15.133:0/3141021953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980630e0 0x7f66980613e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f6698062fc0 tx=0x7f6690015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:08.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f66967fc700 1 -- 172.21.15.133:0/3141021953 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6690011b00 con 0x7f66980630e0 2021-01-03T13:05:08.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f66967fc700 1 -- 172.21.15.133:0/3141021953 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6690011c60 con 0x7f66980630e0 2021-01-03T13:05:08.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669f319700 1 -- 172.21.15.133:0/3141021953 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6698067af0 con 0x7f66980630e0 2021-01-03T13:05:08.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f66967fc700 1 -- 172.21.15.133:0/3141021953 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f669001d450 con 0x7f66980630e0 2021-01-03T13:05:08.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669f319700 1 -- 172.21.15.133:0/3141021953 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66980445c0 con 0x7f66980630e0 2021-01-03T13:05:08.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669f319700 1 -- 172.21.15.133:0/3141021953 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6698146990 con 0x7f66980630e0 2021-01-03T13:05:08.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f66967fc700 1 -- 172.21.15.133:0/3141021953 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6690024030 con 0x7f66980630e0 2021-01-03T13:05:08.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f66967fc700 1 --2- 172.21.15.133:0/3141021953 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6678055440 0x7f6678057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:08.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f66967fc700 1 -- 172.21.15.133:0/3141021953 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f669006efa0 con 0x7f66980630e0 2021-01-03T13:05:08.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669d0b5700 1 --2- 172.21.15.133:0/3141021953 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6678055440 0x7f6678057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:08.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.674+0000 7f669d0b5700 1 --2- 172.21.15.133:0/3141021953 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6678055440 0x7f6678057900 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f668800d000 tx=0x7f6688008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:08.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.678+0000 7f66967fc700 1 -- 172.21.15.133:0/3141021953 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6690045310 con 0x7f66980630e0 2021-01-03T13:05:08.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.858+0000 7f669f319700 1 -- 172.21.15.133:0/3141021953 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f66981483d0 con 0x7f66980630e0 2021-01-03T13:05:08.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.870+0000 7f66967fc700 1 -- 172.21.15.133:0/3141021953 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 15 and data pool 16 v37) v1 ==== 189+0+0 (secure 0 0 0) 0x7f6690022070 con 0x7f66980630e0 2021-01-03T13:05:08.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.874+0000 7f669f319700 1 -- 172.21.15.133:0/3141021953 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6678055440 msgr2=0x7f6678057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:08.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.874+0000 7f669f319700 1 --2- 172.21.15.133:0/3141021953 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6678055440 0x7f6678057900 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f668800d000 tx=0x7f6688008040).stop 2021-01-03T13:05:08.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.874+0000 7f669f319700 1 -- 172.21.15.133:0/3141021953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980630e0 msgr2=0x7f66980613e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:08.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.874+0000 7f669f319700 1 --2- 172.21.15.133:0/3141021953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980630e0 0x7f66980613e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f6698062fc0 tx=0x7f6690015000).stop 2021-01-03T13:05:08.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.874+0000 7f669f319700 1 -- 172.21.15.133:0/3141021953 shutdown_connections 2021-01-03T13:05:08.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.874+0000 7f669f319700 1 --2- 172.21.15.133:0/3141021953 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6678055440 0x7f6678057900 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:08.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.874+0000 7f669f319700 1 --2- 172.21.15.133:0/3141021953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66980630e0 0x7f66980613e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:08.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.874+0000 7f669f319700 1 --2- 172.21.15.133:0/3141021953 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f669809cea0 0x7f6698143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:08.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.874+0000 7f669f319700 1 --2- 172.21.15.133:0/3141021953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f66980b36a0 0x7f66980624a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:08.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.874+0000 7f669f319700 1 -- 172.21.15.133:0/3141021953 >> 172.21.15.133:0/3141021953 conn(0x7f669805bdf0 msgr2=0x7f669805c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:08.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.874+0000 7f669f319700 1 -- 172.21.15.133:0/3141021953 shutdown_connections 2021-01-03T13:05:08.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.874+0000 7f669f319700 1 -- 172.21.15.133:0/3141021953 wait complete. 2021-01-03T13:05:08.881 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 15 and data pool 16 2021-01-03T13:05:08.896 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:05:08.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.990+0000 7fc06e853700 1 Processor -- start 2021-01-03T13:05:08.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.990+0000 7fc06e853700 1 -- start start 2021-01-03T13:05:08.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.990+0000 7fc06e853700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0680b52c0 0x7fc0680b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:08.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.990+0000 7fc06e853700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc068060da0 con 0x7fc0680b0c90 2021-01-03T13:05:08.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.990+0000 7fc06e853700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0680b0ad0 con 0x7fc0680b5c00 2021-01-03T13:05:08.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.990+0000 7fc06e853700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc068067a90 con 0x7fc0680b52c0 2021-01-03T13:05:08.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.990+0000 7fc06e052700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc0680b5c00 0x7fc068143eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57546/0 (socket says 172.21.15.133:57546) 2021-01-03T13:05:09.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.990+0000 7fc06e052700 1 -- 172.21.15.133:0/249425964 learned_addr learned my addr 172.21.15.133:0/249425964 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:09.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.990+0000 7fc06d851700 1 --2- 172.21.15.133:0/249425964 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0680b52c0 0x7fc0680b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.990+0000 7fc06c84f700 1 -- 172.21.15.133:0/249425964 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238315309 0 0) 0x7fc060001450 con 0x7fc0680b5c00 2021-01-03T13:05:09.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.990+0000 7fc06c84f700 1 -- 172.21.15.133:0/249425964 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc050003230 con 0x7fc0680b5c00 2021-01-03T13:05:09.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06c84f700 1 -- 172.21.15.133:0/249425964 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2080854715 0 0) 0x7fc050003230 con 0x7fc0680b5c00 2021-01-03T13:05:09.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06c84f700 1 -- 172.21.15.133:0/249425964 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0680b52c0 msgr2=0x7fc0680b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:09.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06c84f700 1 --2- 172.21.15.133:0/249425964 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0680b52c0 0x7fc0680b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06c84f700 1 -- 172.21.15.133:0/249425964 >> v1:172.21.15.16:6789/0 conn(0x7fc0680b0c90 legacy=0x7fc068098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06c84f700 1 -- 172.21.15.133:0/249425964 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0680b56a0 con 0x7fc0680b5c00 2021-01-03T13:05:09.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06c84f700 1 -- 172.21.15.133:0/249425964 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fc060001be0 con 0x7fc0680b5c00 2021-01-03T13:05:09.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06c84f700 1 -- 172.21.15.133:0/249425964 >> v1:172.21.15.133:6789/0 conn(0x7fc0680b5c00 legacy=0x7fc068143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06c84f700 1 --2- 172.21.15.133:0/249425964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc050003720 0x7fc050003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06c84f700 1 --2- 172.21.15.133:0/249425964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0500044d0 0x7fc050004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06c84f700 1 --2- 172.21.15.133:0/249425964 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0680b52c0 0x7fc050004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06c84f700 1 -- 172.21.15.133:0/249425964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc068067a90 con 0x7fc050003720 2021-01-03T13:05:09.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06c84f700 1 -- 172.21.15.133:0/249425964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc050005380 con 0x7fc0500044d0 2021-01-03T13:05:09.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06c84f700 1 -- 172.21.15.133:0/249425964 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0500042e0 con 0x7fc0680b52c0 2021-01-03T13:05:09.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06d050700 1 --2- 172.21.15.133:0/249425964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0500044d0 0x7fc050004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06d851700 1 --2- 172.21.15.133:0/249425964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc050003720 0x7fc050003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06d050700 1 -- 172.21.15.133:0/249425964 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0680b52c0 msgr2=0x7fc050004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:09.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06e052700 1 --2- 172.21.15.133:0/249425964 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0680b52c0 0x7fc050004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06d050700 1 --2- 172.21.15.133:0/249425964 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0680b52c0 0x7fc050004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06d050700 1 -- 172.21.15.133:0/249425964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc050003720 msgr2=0x7fc050003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:09.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06d050700 1 --2- 172.21.15.133:0/249425964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc050003720 0x7fc050003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06d050700 1 -- 172.21.15.133:0/249425964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc050003230 con 0x7fc0500044d0 2021-01-03T13:05:09.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06d851700 1 --2- 172.21.15.133:0/249425964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc050003720 0x7fc050003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:09.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06e052700 1 --2- 172.21.15.133:0/249425964 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0680b52c0 0x7fc050004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:09.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06d050700 1 --2- 172.21.15.133:0/249425964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0500044d0 0x7fc050004950 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7fc068062160 tx=0x7fc064007b60).ready entity=mon.1 client_cookie=53f4c1de83f64288 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:09.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06c84f700 1 -- 172.21.15.133:0/249425964 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc06400c600 con 0x7fc0500044d0 2021-01-03T13:05:09.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06c84f700 1 -- 172.21.15.133:0/249425964 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06400c760 con 0x7fc0500044d0 2021-01-03T13:05:09.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06c84f700 1 -- 172.21.15.133:0/249425964 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc06400cac0 con 0x7fc0500044d0 2021-01-03T13:05:09.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06e853700 1 -- 172.21.15.133:0/249425964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0500044d0 msgr2=0x7fc050004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06e853700 1 --2- 172.21.15.133:0/249425964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0500044d0 0x7fc050004950 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7fc068062160 tx=0x7fc064007b60).stop 2021-01-03T13:05:09.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06e052700 1 -- 172.21.15.133:0/249425964 reap_dead start 2021-01-03T13:05:09.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06e853700 1 -- 172.21.15.133:0/249425964 shutdown_connections 2021-01-03T13:05:09.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06e853700 1 -- 172.21.15.133:0/249425964 >> 172.21.15.133:0/249425964 conn(0x7fc06805bdf0 msgr2=0x7fc06805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:09.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06e853700 1 -- 172.21.15.133:0/249425964 shutdown_connections 2021-01-03T13:05:09.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06e853700 1 -- 172.21.15.133:0/249425964 wait complete. 2021-01-03T13:05:09.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06e853700 1 Processor -- start 2021-01-03T13:05:09.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.994+0000 7fc06e853700 1 -- start start 2021-01-03T13:05:09.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06e853700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc068066fe0 0x7fc06814c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06e853700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc068063540 0x7fc06814cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06e853700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0680647a0 0x7fc068064c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06e853700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0680aefc0 con 0x7fc068066fe0 2021-01-03T13:05:09.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06e853700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0680673c0 con 0x7fc068063540 2021-01-03T13:05:09.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06e853700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc068156de0 con 0x7fc0680647a0 2021-01-03T13:05:09.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06d050700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc068063540 0x7fc06814cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06d050700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc068063540 0x7fc06814cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36522/0 (socket says 172.21.15.133:36522) 2021-01-03T13:05:09.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06d050700 1 -- 172.21.15.133:0/2113643685 learned_addr learned my addr 172.21.15.133:0/2113643685 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:09.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06e052700 1 --2- 172.21.15.133:0/2113643685 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0680647a0 0x7fc068064c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06d851700 1 --2- 172.21.15.133:0/2113643685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc068066fe0 0x7fc06814c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06d050700 1 -- 172.21.15.133:0/2113643685 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0680647a0 msgr2=0x7fc068064c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06d050700 1 --2- 172.21.15.133:0/2113643685 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0680647a0 0x7fc068064c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06d050700 1 -- 172.21.15.133:0/2113643685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc068066fe0 msgr2=0x7fc06814c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06d050700 1 --2- 172.21.15.133:0/2113643685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc068066fe0 0x7fc06814c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06d050700 1 -- 172.21.15.133:0/2113643685 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc068064060 con 0x7fc068063540 2021-01-03T13:05:09.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06d050700 1 --2- 172.21.15.133:0/2113643685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc068063540 0x7fc06814cea0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7fc068064680 tx=0x7fc064016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:09.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc05affd700 1 -- 172.21.15.133:0/2113643685 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0640137a0 con 0x7fc068063540 2021-01-03T13:05:09.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc05affd700 1 -- 172.21.15.133:0/2113643685 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc064013900 con 0x7fc068063540 2021-01-03T13:05:09.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc05affd700 1 -- 172.21.15.133:0/2113643685 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc064013c60 con 0x7fc068063540 2021-01-03T13:05:09.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06e853700 1 -- 172.21.15.133:0/2113643685 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc068064300 con 0x7fc068063540 2021-01-03T13:05:09.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06e853700 1 -- 172.21.15.133:0/2113643685 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06814d390 con 0x7fc068063540 2021-01-03T13:05:09.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:08.998+0000 7fc06e853700 1 -- 172.21.15.133:0/2113643685 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc068156fe0 con 0x7fc068063540 2021-01-03T13:05:09.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.002+0000 7fc05affd700 1 -- 172.21.15.133:0/2113643685 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc064010030 con 0x7fc068063540 2021-01-03T13:05:09.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.002+0000 7fc05affd700 1 --2- 172.21.15.133:0/2113643685 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc048055440 0x7fc048057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.002+0000 7fc05affd700 1 -- 172.21.15.133:0/2113643685 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc06406ec60 con 0x7fc068063540 2021-01-03T13:05:09.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.002+0000 7fc06d851700 1 --2- 172.21.15.133:0/2113643685 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc048055440 0x7fc048057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.002+0000 7fc06d851700 1 --2- 172.21.15.133:0/2113643685 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc048055440 0x7fc048057900 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fc05c008000 tx=0x7fc05c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:09.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.006+0000 7fc05affd700 1 -- 172.21.15.133:0/2113643685 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc064074020 con 0x7fc068063540 2021-01-03T13:05:09.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.154+0000 7fc06e853700 1 -- 172.21.15.133:0/2113643685 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc068064490 con 0x7fc068063540 2021-01-03T13:05:09.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.154+0000 7fc05affd700 1 -- 172.21.15.133:0/2113643685 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16102 (secure 0 0 0) 0x7fc064001e60 con 0x7fc068063540 2021-01-03T13:05:09.159 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:09.160 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":89,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:05:08.865283+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:05:07.479446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-01-03T13:05:07.894287+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:05:09.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.158+0000 7fc06e853700 1 -- 172.21.15.133:0/2113643685 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc048055440 msgr2=0x7fc048057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.158+0000 7fc06e853700 1 --2- 172.21.15.133:0/2113643685 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc048055440 0x7fc048057900 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fc05c008000 tx=0x7fc05c008040).stop 2021-01-03T13:05:09.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.158+0000 7fc06e853700 1 -- 172.21.15.133:0/2113643685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc068063540 msgr2=0x7fc06814cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.158+0000 7fc06e853700 1 --2- 172.21.15.133:0/2113643685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc068063540 0x7fc06814cea0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7fc068064680 tx=0x7fc064016000).stop 2021-01-03T13:05:09.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.158+0000 7fc06e853700 1 -- 172.21.15.133:0/2113643685 shutdown_connections 2021-01-03T13:05:09.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.158+0000 7fc06e853700 1 --2- 172.21.15.133:0/2113643685 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc048055440 0x7fc048057900 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.158+0000 7fc06e853700 1 --2- 172.21.15.133:0/2113643685 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc068066fe0 0x7fc06814c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.158+0000 7fc06e853700 1 --2- 172.21.15.133:0/2113643685 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0680647a0 0x7fc068064c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.158+0000 7fc06e853700 1 --2- 172.21.15.133:0/2113643685 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc068063540 0x7fc06814cea0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.158+0000 7fc06e853700 1 -- 172.21.15.133:0/2113643685 >> 172.21.15.133:0/2113643685 conn(0x7fc06805bdf0 msgr2=0x7fc0680601f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:09.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.158+0000 7fc06e853700 1 -- 172.21.15.133:0/2113643685 shutdown_connections 2021-01-03T13:05:09.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.158+0000 7fc06e853700 1 -- 172.21.15.133:0/2113643685 wait complete. 2021-01-03T13:05:09.173 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:05:09.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f672ae63700 1 Processor -- start 2021-01-03T13:05:09.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f672ae63700 1 -- start start 2021-01-03T13:05:09.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f672ae63700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6724140480 0x7f67240afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f672ae63700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672405cca0 con 0x7f67240af7a0 2021-01-03T13:05:09.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f672ae63700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67240b0270 con 0x7f672405c7c0 2021-01-03T13:05:09.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f672ae63700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67240b0070 con 0x7f6724140480 2021-01-03T13:05:09.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f6729400700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6724140480 0x7f67240afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f6723fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f672405c7c0 0x7f67241466c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57564/0 (socket says 172.21.15.133:57564) 2021-01-03T13:05:09.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f6723fff700 1 -- 172.21.15.133:0/3229910215 learned_addr learned my addr 172.21.15.133:0/3229910215 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:09.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f6729400700 1 -- 172.21.15.133:0/3229910215 >> v1:172.21.15.133:6789/0 conn(0x7f672405c7c0 legacy=0x7f67241466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f67237fe700 1 -- 172.21.15.133:0/3229910215 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321967823 0 0) 0x7f67240b0270 con 0x7f672405c7c0 2021-01-03T13:05:09.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f6729400700 1 -- 172.21.15.133:0/3229910215 >> v1:172.21.15.16:6789/0 conn(0x7f67240af7a0 legacy=0x7f672413fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f6729400700 1 -- 172.21.15.133:0/3229910215 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67240b0510 con 0x7f6724140480 2021-01-03T13:05:09.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f6729400700 1 --2- 172.21.15.133:0/3229910215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6724140480 0x7f67240afb80 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f6714002f30 tx=0x7f6714006dc0).ready entity=mon.1 client_cookie=b929f915009a8a31 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:09.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f67237fe700 1 -- 172.21.15.133:0/3229910215 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67140097f0 con 0x7f6724140480 2021-01-03T13:05:09.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f67237fe700 1 -- 172.21.15.133:0/3229910215 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6714009950 con 0x7f6724140480 2021-01-03T13:05:09.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f67237fe700 1 -- 172.21.15.133:0/3229910215 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6714009cb0 con 0x7f6724140480 2021-01-03T13:05:09.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f672ae63700 1 -- 172.21.15.133:0/3229910215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6724140480 msgr2=0x7f67240afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f672ae63700 1 --2- 172.21.15.133:0/3229910215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6724140480 0x7f67240afb80 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f6714002f30 tx=0x7f6714006dc0).stop 2021-01-03T13:05:09.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f672ae63700 1 -- 172.21.15.133:0/3229910215 shutdown_connections 2021-01-03T13:05:09.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f672ae63700 1 --2- 172.21.15.133:0/3229910215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6724140480 0x7f67240afb80 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f672ae63700 1 -- 172.21.15.133:0/3229910215 >> 172.21.15.133:0/3229910215 conn(0x7f67240b9620 msgr2=0x7f67240b9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:09.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.282+0000 7f672ae63700 1 -- 172.21.15.133:0/3229910215 shutdown_connections 2021-01-03T13:05:09.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f672ae63700 1 -- 172.21.15.133:0/3229910215 wait complete. 2021-01-03T13:05:09.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f672ae63700 1 Processor -- start 2021-01-03T13:05:09.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f672ae63700 1 -- start start 2021-01-03T13:05:09.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f672ae63700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f672405c7c0 0x7f6724144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f672ae63700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67240af7a0 0x7f6724155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f672ae63700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6724140480 0x7f6724136ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f672ae63700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672413e260 con 0x7f67240af7a0 2021-01-03T13:05:09.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f672ae63700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672413e490 con 0x7f6724140480 2021-01-03T13:05:09.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f672ae63700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672413e730 con 0x7f672405c7c0 2021-01-03T13:05:09.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f6729400700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6724140480 0x7f6724136ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f6729400700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6724140480 0x7f6724136ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36540/0 (socket says 172.21.15.133:36540) 2021-01-03T13:05:09.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f6723fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67240af7a0 0x7f6724155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f6728bff700 1 --2- 172.21.15.133:0/1645518215 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f672405c7c0 0x7f6724144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f6729400700 1 -- 172.21.15.133:0/1645518215 learned_addr learned my addr 172.21.15.133:0/1645518215 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:09.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f6729400700 1 -- 172.21.15.133:0/1645518215 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f672405c7c0 msgr2=0x7f6724144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f6729400700 1 --2- 172.21.15.133:0/1645518215 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f672405c7c0 0x7f6724144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f6729400700 1 -- 172.21.15.133:0/1645518215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67240af7a0 msgr2=0x7f6724155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f6729400700 1 --2- 172.21.15.133:0/1645518215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67240af7a0 0x7f6724155c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f6729400700 1 -- 172.21.15.133:0/1645518215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672413e9d0 con 0x7f6724140480 2021-01-03T13:05:09.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f6729400700 1 --2- 172.21.15.133:0/1645518215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6724140480 0x7f6724136ab0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f6714002f30 tx=0x7f6714015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:09.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f6721ffb700 1 -- 172.21.15.133:0/1645518215 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6714011bd0 con 0x7f6724140480 2021-01-03T13:05:09.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f672ae63700 1 -- 172.21.15.133:0/1645518215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6724136fa0 con 0x7f6724140480 2021-01-03T13:05:09.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f6721ffb700 1 -- 172.21.15.133:0/1645518215 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6714011d30 con 0x7f6724140480 2021-01-03T13:05:09.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f6721ffb700 1 -- 172.21.15.133:0/1645518215 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6714011ea0 con 0x7f6724140480 2021-01-03T13:05:09.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.286+0000 7f672ae63700 1 -- 172.21.15.133:0/1645518215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67240b8a50 con 0x7f6724140480 2021-01-03T13:05:09.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.290+0000 7f672ae63700 1 -- 172.21.15.133:0/1645518215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6724057300 con 0x7f6724140480 2021-01-03T13:05:09.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.290+0000 7f6721ffb700 1 -- 172.21.15.133:0/1645518215 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6714024030 con 0x7f6724140480 2021-01-03T13:05:09.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.290+0000 7f6721ffb700 1 --2- 172.21.15.133:0/1645518215 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f67040554e0 0x7f67040579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.290+0000 7f6721ffb700 1 -- 172.21.15.133:0/1645518215 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f671406f3c0 con 0x7f6724140480 2021-01-03T13:05:09.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.290+0000 7f6728bff700 1 --2- 172.21.15.133:0/1645518215 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f67040554e0 0x7f67040579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.290+0000 7f6728bff700 1 --2- 172.21.15.133:0/1645518215 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f67040554e0 0x7f67040579a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f671c00d000 tx=0x7f671c000f00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:09.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.298+0000 7f6721ffb700 1 -- 172.21.15.133:0/1645518215 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6714045530 con 0x7f6724140480 2021-01-03T13:05:09.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.434+0000 7f672ae63700 1 -- 172.21.15.133:0/1645518215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6724067a00 con 0x7f6724140480 2021-01-03T13:05:09.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.434+0000 7f6721ffb700 1 -- 172.21.15.133:0/1645518215 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16102 (secure 0 0 0) 0x7f6714022020 con 0x7f6724140480 2021-01-03T13:05:09.439 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:09.440 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":89,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:05:08.865283+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:05:07.479446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-01-03T13:05:07.894287+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:05:09.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.438+0000 7f672ae63700 1 -- 172.21.15.133:0/1645518215 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f67040554e0 msgr2=0x7f67040579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.438+0000 7f672ae63700 1 --2- 172.21.15.133:0/1645518215 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f67040554e0 0x7f67040579a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f671c00d000 tx=0x7f671c000f00).stop 2021-01-03T13:05:09.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.438+0000 7f672ae63700 1 -- 172.21.15.133:0/1645518215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6724140480 msgr2=0x7f6724136ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.438+0000 7f672ae63700 1 --2- 172.21.15.133:0/1645518215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6724140480 0x7f6724136ab0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f6714002f30 tx=0x7f6714015000).stop 2021-01-03T13:05:09.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.438+0000 7f672ae63700 1 -- 172.21.15.133:0/1645518215 shutdown_connections 2021-01-03T13:05:09.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.438+0000 7f672ae63700 1 --2- 172.21.15.133:0/1645518215 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f67040554e0 0x7f67040579a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.438+0000 7f672ae63700 1 --2- 172.21.15.133:0/1645518215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6724140480 0x7f6724136ab0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.438+0000 7f672ae63700 1 --2- 172.21.15.133:0/1645518215 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f672405c7c0 0x7f6724144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.438+0000 7f672ae63700 1 --2- 172.21.15.133:0/1645518215 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67240af7a0 0x7f6724155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.438+0000 7f672ae63700 1 -- 172.21.15.133:0/1645518215 >> 172.21.15.133:0/1645518215 conn(0x7f67240b9620 msgr2=0x7f67240b5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:09.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.438+0000 7f672ae63700 1 -- 172.21.15.133:0/1645518215 shutdown_connections 2021-01-03T13:05:09.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.438+0000 7f672ae63700 1 -- 172.21.15.133:0/1645518215 wait complete. 2021-01-03T13:05:09.458 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-01-03T13:05:09.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e73fff700 1 Processor -- start 2021-01-03T13:05:09.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e73fff700 1 -- start start 2021-01-03T13:05:09.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e73fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e740b5260 0x7f7e741470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e73fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7e741442a0 0x7f7e74144750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e73fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e740b0c10 con 0x7f7e740b5c00 2021-01-03T13:05:09.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e73fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e740b5640 con 0x7f7e741442a0 2021-01-03T13:05:09.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e73fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7409a4f0 con 0x7f7e740b5260 2021-01-03T13:05:09.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e737fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7e741442a0 0x7f7e74144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e737fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7e741442a0 0x7f7e74144750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36546/0 (socket says 172.21.15.133:36546) 2021-01-03T13:05:09.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e737fe700 1 -- 172.21.15.133:0/3115105111 learned_addr learned my addr 172.21.15.133:0/3115105111 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:09.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e72ffd700 1 --2- 172.21.15.133:0/3115105111 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e740b5260 0x7f7e741470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e737fe700 1 -- 172.21.15.133:0/3115105111 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e740b5260 msgr2=0x7f7e741470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:09.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e737fe700 1 --2- 172.21.15.133:0/3115105111 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e740b5260 0x7f7e741470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e737fe700 1 -- 172.21.15.133:0/3115105111 >> v1:172.21.15.16:6789/0 conn(0x7f7e740b5c00 legacy=0x7f7e741475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e737fe700 1 -- 172.21.15.133:0/3115105111 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e740b0e40 con 0x7f7e741442a0 2021-01-03T13:05:09.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e737fe700 1 --2- 172.21.15.133:0/3115105111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e741442a0 0x7f7e74144750 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f7e64002f30 tx=0x7f7e64006e80).ready entity=mon.1 client_cookie=1e88733a26689f62 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:09.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e71ffb700 1 -- 172.21.15.133:0/3115105111 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e640097f0 con 0x7f7e741442a0 2021-01-03T13:05:09.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e71ffb700 1 -- 172.21.15.133:0/3115105111 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e64009950 con 0x7f7e741442a0 2021-01-03T13:05:09.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e71ffb700 1 -- 172.21.15.133:0/3115105111 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e64009cb0 con 0x7f7e741442a0 2021-01-03T13:05:09.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e73fff700 1 -- 172.21.15.133:0/3115105111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e741442a0 msgr2=0x7f7e74144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.570+0000 7f7e73fff700 1 --2- 172.21.15.133:0/3115105111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e741442a0 0x7f7e74144750 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f7e64002f30 tx=0x7f7e64006e80).stop 2021-01-03T13:05:09.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e73fff700 1 -- 172.21.15.133:0/3115105111 shutdown_connections 2021-01-03T13:05:09.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e73fff700 1 --2- 172.21.15.133:0/3115105111 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e740b5260 0x7f7e741470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e73fff700 1 --2- 172.21.15.133:0/3115105111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e741442a0 0x7f7e74144750 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e73fff700 1 -- 172.21.15.133:0/3115105111 >> 172.21.15.133:0/3115105111 conn(0x7f7e7405bdf0 msgr2=0x7f7e7405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:09.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e73fff700 1 -- 172.21.15.133:0/3115105111 shutdown_connections 2021-01-03T13:05:09.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e73fff700 1 -- 172.21.15.133:0/3115105111 wait complete. 2021-01-03T13:05:09.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e73fff700 1 Processor -- start 2021-01-03T13:05:09.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e73fff700 1 -- start start 2021-01-03T13:05:09.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e73fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e740b5260 0x7f7e74064810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e73fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e740b5c00 0x7f7e74143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e73fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e741442a0 0x7f7e74143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e73fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e74147290 con 0x7f7e740b5260 2021-01-03T13:05:09.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e73fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e741464c0 con 0x7f7e741442a0 2021-01-03T13:05:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e73fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740668f0 con 0x7f7e740b5c00 2021-01-03T13:05:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e737fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e741442a0 0x7f7e74143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e737fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e741442a0 0x7f7e74143780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36554/0 (socket says 172.21.15.133:36554) 2021-01-03T13:05:09.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e737fe700 1 -- 172.21.15.133:0/3772895130 learned_addr learned my addr 172.21.15.133:0/3772895130 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:09.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e727fc700 1 --2- 172.21.15.133:0/3772895130 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e740b5c00 0x7f7e74143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e72ffd700 1 --2- 172.21.15.133:0/3772895130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e740b5260 0x7f7e74064810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e737fe700 1 -- 172.21.15.133:0/3772895130 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e740b5c00 msgr2=0x7f7e74143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e737fe700 1 --2- 172.21.15.133:0/3772895130 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e740b5c00 0x7f7e74143290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e737fe700 1 -- 172.21.15.133:0/3772895130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e740b5260 msgr2=0x7f7e74064810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e737fe700 1 --2- 172.21.15.133:0/3772895130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e740b5260 0x7f7e74064810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e737fe700 1 -- 172.21.15.133:0/3772895130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e74066b90 con 0x7f7e741442a0 2021-01-03T13:05:09.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e737fe700 1 --2- 172.21.15.133:0/3772895130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e741442a0 0x7f7e74143780 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f7e64002f30 tx=0x7f7e64015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:09.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e6bfff700 1 -- 172.21.15.133:0/3772895130 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e64011cc0 con 0x7f7e741442a0 2021-01-03T13:05:09.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e6bfff700 1 -- 172.21.15.133:0/3772895130 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e64011e20 con 0x7f7e741442a0 2021-01-03T13:05:09.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e73fff700 1 -- 172.21.15.133:0/3772895130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e740af3e0 con 0x7f7e741442a0 2021-01-03T13:05:09.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e6bfff700 1 -- 172.21.15.133:0/3772895130 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e6401e650 con 0x7f7e741442a0 2021-01-03T13:05:09.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.574+0000 7f7e73fff700 1 -- 172.21.15.133:0/3772895130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e741455f0 con 0x7f7e741442a0 2021-01-03T13:05:09.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.578+0000 7f7e6bfff700 1 -- 172.21.15.133:0/3772895130 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7e64025030 con 0x7f7e741442a0 2021-01-03T13:05:09.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.578+0000 7f7e73fff700 1 -- 172.21.15.133:0/3772895130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e740675d0 con 0x7f7e741442a0 2021-01-03T13:05:09.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.578+0000 7f7e6bfff700 1 --2- 172.21.15.133:0/3772895130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e4c0554e0 0x7f7e4c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:09.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.578+0000 7f7e6bfff700 1 -- 172.21.15.133:0/3772895130 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7e6406f5e0 con 0x7f7e741442a0 2021-01-03T13:05:09.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.578+0000 7f7e72ffd700 1 --2- 172.21.15.133:0/3772895130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e4c0554e0 0x7f7e4c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:09.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.578+0000 7f7e72ffd700 1 --2- 172.21.15.133:0/3772895130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e4c0554e0 0x7f7e4c0579a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f7e5c008000 tx=0x7f7e5c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:09.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.586+0000 7f7e6bfff700 1 -- 172.21.15.133:0/3772895130 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7e740675d0 con 0x7f7e741442a0 2021-01-03T13:05:09.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.786+0000 7f7e73fff700 1 -- 172.21.15.133:0/3772895130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7e740675d0 con 0x7f7e741442a0 2021-01-03T13:05:09.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.870+0000 7f7e6bfff700 1 -- 172.21.15.133:0/3772895130 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7e740675d0 con 0x7f7e741442a0 2021-01-03T13:05:09.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.874+0000 7f7e73fff700 1 -- 172.21.15.133:0/3772895130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e4c0554e0 msgr2=0x7f7e4c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.874+0000 7f7e73fff700 1 --2- 172.21.15.133:0/3772895130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e4c0554e0 0x7f7e4c0579a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f7e5c008000 tx=0x7f7e5c008040).stop 2021-01-03T13:05:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.874+0000 7f7e73fff700 1 -- 172.21.15.133:0/3772895130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e741442a0 msgr2=0x7f7e74143780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.874+0000 7f7e73fff700 1 --2- 172.21.15.133:0/3772895130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e741442a0 0x7f7e74143780 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f7e64002f30 tx=0x7f7e64015000).stop 2021-01-03T13:05:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.874+0000 7f7e73fff700 1 -- 172.21.15.133:0/3772895130 shutdown_connections 2021-01-03T13:05:09.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.874+0000 7f7e73fff700 1 --2- 172.21.15.133:0/3772895130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e4c0554e0 0x7f7e4c0579a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.874+0000 7f7e73fff700 1 --2- 172.21.15.133:0/3772895130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e740b5260 0x7f7e74064810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.874+0000 7f7e73fff700 1 --2- 172.21.15.133:0/3772895130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e741442a0 0x7f7e74143780 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.874+0000 7f7e73fff700 1 --2- 172.21.15.133:0/3772895130 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e740b5c00 0x7f7e74143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:09.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.874+0000 7f7e73fff700 1 -- 172.21.15.133:0/3772895130 >> 172.21.15.133:0/3772895130 conn(0x7f7e7405bdf0 msgr2=0x7f7e740b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:09.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.874+0000 7f7e73fff700 1 -- 172.21.15.133:0/3772895130 shutdown_connections 2021-01-03T13:05:09.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.874+0000 7f7e73fff700 1 -- 172.21.15.133:0/3772895130 wait complete. 2021-01-03T13:05:09.895 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:05:10.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.998+0000 7faaa0137700 1 Processor -- start 2021-01-03T13:05:10.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:09.998+0000 7faaa0137700 1 -- start start 2021-01-03T13:05:10.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faaa0137700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faa980afa70 0x7faa9813f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faaa0137700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa9805cc20 con 0x7faa980af440 2021-01-03T13:05:10.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faaa0137700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa980ad2d0 con 0x7faa9805c840 2021-01-03T13:05:10.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faaa0137700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa980afec0 con 0x7faa980afa70 2021-01-03T13:05:10.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faa9e6d4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faa980afa70 0x7faa9813f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faa9ded3700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7faa9805c840 0x7faa9813f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57590/0 (socket says 172.21.15.133:57590) 2021-01-03T13:05:10.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faa9ded3700 1 -- 172.21.15.133:0/3628482241 learned_addr learned my addr 172.21.15.133:0/3628482241 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:10.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faa9e6d4700 1 -- 172.21.15.133:0/3628482241 >> v1:172.21.15.133:6789/0 conn(0x7faa9805c840 legacy=0x7faa9813f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faa9ced1700 1 -- 172.21.15.133:0/3628482241 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770190161 0 0) 0x7faa9805cc20 con 0x7faa980af440 2021-01-03T13:05:10.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faa9e6d4700 1 -- 172.21.15.133:0/3628482241 >> v1:172.21.15.16:6789/0 conn(0x7faa980af440 legacy=0x7faa98138c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faa9e6d4700 1 -- 172.21.15.133:0/3628482241 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa980ad570 con 0x7faa980afa70 2021-01-03T13:05:10.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faa9e6d4700 1 --2- 172.21.15.133:0/3628482241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa980afa70 0x7faa9813f960 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7faa980af390 tx=0x7faa90006dc0).ready entity=mon.1 client_cookie=330576610b2892ac server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:10.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faa9ced1700 1 -- 172.21.15.133:0/3628482241 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa90009730 con 0x7faa980afa70 2021-01-03T13:05:10.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faa9ced1700 1 -- 172.21.15.133:0/3628482241 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa90009890 con 0x7faa980afa70 2021-01-03T13:05:10.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faa9ced1700 1 -- 172.21.15.133:0/3628482241 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa90009bf0 con 0x7faa980afa70 2021-01-03T13:05:10.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faaa0137700 1 -- 172.21.15.133:0/3628482241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa980afa70 msgr2=0x7faa9813f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faaa0137700 1 --2- 172.21.15.133:0/3628482241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa980afa70 0x7faa9813f960 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7faa980af390 tx=0x7faa90006dc0).stop 2021-01-03T13:05:10.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faaa0137700 1 -- 172.21.15.133:0/3628482241 shutdown_connections 2021-01-03T13:05:10.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faaa0137700 1 --2- 172.21.15.133:0/3628482241 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa980afa70 0x7faa9813f960 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faaa0137700 1 -- 172.21.15.133:0/3628482241 >> 172.21.15.133:0/3628482241 conn(0x7faa9806aeb0 msgr2=0x7faa9805bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:10.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faaa0137700 1 -- 172.21.15.133:0/3628482241 shutdown_connections 2021-01-03T13:05:10.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.002+0000 7faaa0137700 1 -- 172.21.15.133:0/3628482241 wait complete. 2021-01-03T13:05:10.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faaa0137700 1 Processor -- start 2021-01-03T13:05:10.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faaa0137700 1 -- start start 2021-01-03T13:05:10.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faaa0137700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa9805c840 0x7faa9813c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faaa0137700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa980af440 0x7faa981539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faaa0137700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7faa980afa70 0x7faa9814cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faaa0137700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa98063af0 con 0x7faa980af440 2021-01-03T13:05:10.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faaa0137700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa98142c10 con 0x7faa9805c840 2021-01-03T13:05:10.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faaa0137700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa98142eb0 con 0x7faa980afa70 2021-01-03T13:05:10.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faa9ded3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa9805c840 0x7faa9813c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faa9ded3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa9805c840 0x7faa9813c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36566/0 (socket says 172.21.15.133:36566) 2021-01-03T13:05:10.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faa9ded3700 1 -- 172.21.15.133:0/1551551222 learned_addr learned my addr 172.21.15.133:0/1551551222 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:10.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faa9d6d2700 1 --2- 172.21.15.133:0/1551551222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa980af440 0x7faa981539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faa9e6d4700 1 --2- 172.21.15.133:0/1551551222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7faa980afa70 0x7faa9814cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faa9ded3700 1 -- 172.21.15.133:0/1551551222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7faa980afa70 msgr2=0x7faa9814cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faa9ded3700 1 --2- 172.21.15.133:0/1551551222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7faa980afa70 0x7faa9814cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faa9ded3700 1 -- 172.21.15.133:0/1551551222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa980af440 msgr2=0x7faa981539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faa9ded3700 1 --2- 172.21.15.133:0/1551551222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa980af440 0x7faa981539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faa9ded3700 1 -- 172.21.15.133:0/1551551222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa98153260 con 0x7faa9805c840 2021-01-03T13:05:10.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faa9ded3700 1 --2- 172.21.15.133:0/1551551222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa9805c840 0x7faa9813c0e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7faa94001450 tx=0x7faa94007f10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:10.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faa86ffd700 1 -- 172.21.15.133:0/1551551222 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa94005b70 con 0x7faa9805c840 2021-01-03T13:05:10.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faa86ffd700 1 -- 172.21.15.133:0/1551551222 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa94005cd0 con 0x7faa9805c840 2021-01-03T13:05:10.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faa86ffd700 1 -- 172.21.15.133:0/1551551222 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa94007300 con 0x7faa9805c840 2021-01-03T13:05:10.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faaa0137700 1 -- 172.21.15.133:0/1551551222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa98153500 con 0x7faa9805c840 2021-01-03T13:05:10.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.006+0000 7faaa0137700 1 -- 172.21.15.133:0/1551551222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa98153e90 con 0x7faa9805c840 2021-01-03T13:05:10.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.010+0000 7faaa0137700 1 -- 172.21.15.133:0/1551551222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa98057300 con 0x7faa9805c840 2021-01-03T13:05:10.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.010+0000 7faa86ffd700 1 -- 172.21.15.133:0/1551551222 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7faa94010030 con 0x7faa9805c840 2021-01-03T13:05:10.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.010+0000 7faa86ffd700 1 --2- 172.21.15.133:0/1551551222 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faa780554e0 0x7faa780579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.010+0000 7faa86ffd700 1 -- 172.21.15.133:0/1551551222 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faa9406dfb0 con 0x7faa9805c840 2021-01-03T13:05:10.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.010+0000 7faa9d6d2700 1 --2- 172.21.15.133:0/1551551222 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faa780554e0 0x7faa780579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.010+0000 7faa9d6d2700 1 --2- 172.21.15.133:0/1551551222 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faa780554e0 0x7faa780579a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7faa8800d000 tx=0x7faa880079f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:10.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.014+0000 7faa86ffd700 1 -- 172.21.15.133:0/1551551222 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7faa940442b0 con 0x7faa9805c840 2021-01-03T13:05:10.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.198+0000 7faaa0137700 1 -- 172.21.15.133:0/1551551222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa9805ce00 con 0x7faa9805c840 2021-01-03T13:05:10.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.198+0000 7faa86ffd700 1 -- 172.21.15.133:0/1551551222 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7faa940478d0 con 0x7faa9805c840 2021-01-03T13:05:10.203 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:10.203 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":38,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6523,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3593206473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3593206473},{"type":"v1","addr":"172.21.15.133:6835","nonce":3593206473}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/328558863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":328558863},{"type":"v1","addr":"172.21.15.133:6837","nonce":328558863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:08.865621+0000","modified":"2021-01-03T13:05:09.868458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/420953895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":420953895},{"type":"v1","addr":"172.21.15.16:6833","nonce":420953895}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-01-03T13:05:10.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.198+0000 7faaa0137700 1 -- 172.21.15.133:0/1551551222 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faa780554e0 msgr2=0x7faa780579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.198+0000 7faaa0137700 1 --2- 172.21.15.133:0/1551551222 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faa780554e0 0x7faa780579a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7faa8800d000 tx=0x7faa880079f0).stop 2021-01-03T13:05:10.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.198+0000 7faaa0137700 1 -- 172.21.15.133:0/1551551222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa9805c840 msgr2=0x7faa9813c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.198+0000 7faaa0137700 1 --2- 172.21.15.133:0/1551551222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa9805c840 0x7faa9813c0e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7faa94001450 tx=0x7faa94007f10).stop 2021-01-03T13:05:10.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.202+0000 7faaa0137700 1 -- 172.21.15.133:0/1551551222 shutdown_connections 2021-01-03T13:05:10.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.202+0000 7faaa0137700 1 --2- 172.21.15.133:0/1551551222 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faa780554e0 0x7faa780579a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.202+0000 7faaa0137700 1 --2- 172.21.15.133:0/1551551222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7faa980afa70 0x7faa9814cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.202+0000 7faaa0137700 1 --2- 172.21.15.133:0/1551551222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa9805c840 0x7faa9813c0e0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.202+0000 7faaa0137700 1 --2- 172.21.15.133:0/1551551222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa980af440 0x7faa981539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.202+0000 7faaa0137700 1 -- 172.21.15.133:0/1551551222 >> 172.21.15.133:0/1551551222 conn(0x7faa9806aeb0 msgr2=0x7faa980b3610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:10.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.202+0000 7faaa0137700 1 -- 172.21.15.133:0/1551551222 shutdown_connections 2021-01-03T13:05:10.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.202+0000 7faaa0137700 1 -- 172.21.15.133:0/1551551222 wait complete. 2021-01-03T13:05:10.207 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 38 2021-01-03T13:05:10.216 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:05:10.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.318+0000 7f7c64d66700 1 Processor -- start 2021-01-03T13:05:10.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.318+0000 7f7c64d66700 1 -- start start 2021-01-03T13:05:10.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.318+0000 7f7c64d66700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c6005c7c0 0x7f7c60140480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.318+0000 7f7c64d66700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7c600afb80 0x7f7c601466c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.318+0000 7f7c64d66700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6005cca0 con 0x7f7c600af7a0 2021-01-03T13:05:10.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.318+0000 7f7c64d66700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c600afff0 con 0x7f7c600afb80 2021-01-03T13:05:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.318+0000 7f7c64d66700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c600b0270 con 0x7f7c6005c7c0 2021-01-03T13:05:10.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.318+0000 7f7c5dd9b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c6005c7c0 0x7f7c60140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.318+0000 7f7c5ed9d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7c600afb80 0x7f7c601466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.318+0000 7f7c5e59c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7c600af7a0 0x7f7c6013fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:36332/0 (socket says 172.21.15.133:36332) 2021-01-03T13:05:10.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.318+0000 7f7c5e59c700 1 -- 172.21.15.133:0/2918395696 learned_addr learned my addr 172.21.15.133:0/2918395696 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:10.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.318+0000 7f7c5dd9b700 1 -- 172.21.15.133:0/2918395696 >> v2:172.21.15.16:3300/0 conn(0x7f7c600afb80 msgr2=0x7f7c601466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:10.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.318+0000 7f7c5dd9b700 1 --2- 172.21.15.133:0/2918395696 >> v2:172.21.15.16:3300/0 conn(0x7f7c600afb80 0x7f7c601466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.318+0000 7f7c5dd9b700 1 -- 172.21.15.133:0/2918395696 >> v1:172.21.15.16:6789/0 conn(0x7f7c600af7a0 legacy=0x7f7c6013fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.318+0000 7f7c5dd9b700 1 -- 172.21.15.133:0/2918395696 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c600b0510 con 0x7f7c6005c7c0 2021-01-03T13:05:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.318+0000 7f7c5dd9b700 1 --2- 172.21.15.133:0/2918395696 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c6005c7c0 0x7f7c60140480 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7c48002f30 tx=0x7f7c48006dc0).ready entity=mon.2 client_cookie=2496856399c6edb server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.318+0000 7f7c5d59a700 1 -- 172.21.15.133:0/2918395696 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c48009760 con 0x7f7c6005c7c0 2021-01-03T13:05:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c5d59a700 1 -- 172.21.15.133:0/2918395696 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c480098c0 con 0x7f7c6005c7c0 2021-01-03T13:05:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c5d59a700 1 -- 172.21.15.133:0/2918395696 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c48009c20 con 0x7f7c6005c7c0 2021-01-03T13:05:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c64d66700 1 -- 172.21.15.133:0/2918395696 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c6005c7c0 msgr2=0x7f7c60140480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c64d66700 1 --2- 172.21.15.133:0/2918395696 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c6005c7c0 0x7f7c60140480 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7c48002f30 tx=0x7f7c48006dc0).stop 2021-01-03T13:05:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c64d66700 1 -- 172.21.15.133:0/2918395696 shutdown_connections 2021-01-03T13:05:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c64d66700 1 --2- 172.21.15.133:0/2918395696 >> v2:172.21.15.16:3300/0 conn(0x7f7c600afb80 0x7f7c601466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c64d66700 1 --2- 172.21.15.133:0/2918395696 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c6005c7c0 0x7f7c60140480 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c64d66700 1 -- 172.21.15.133:0/2918395696 >> 172.21.15.133:0/2918395696 conn(0x7f7c600b9620 msgr2=0x7f7c600b9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:10.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c64d66700 1 -- 172.21.15.133:0/2918395696 shutdown_connections 2021-01-03T13:05:10.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c64d66700 1 -- 172.21.15.133:0/2918395696 wait complete. 2021-01-03T13:05:10.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c64d66700 1 Processor -- start 2021-01-03T13:05:10.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c64d66700 1 -- start start 2021-01-03T13:05:10.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c64d66700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c6005c7c0 0x7f7c60138d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c64d66700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c600af7a0 0x7f7c600b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c64d66700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c600afb80 0x7f7c60151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c64d66700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60137590 con 0x7f7c600af7a0 2021-01-03T13:05:10.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c64d66700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c600b7330 con 0x7f7c6005c7c0 2021-01-03T13:05:10.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c64d66700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c600b8270 con 0x7f7c600afb80 2021-01-03T13:05:10.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c5e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c6005c7c0 0x7f7c60138d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c5ed9d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c600afb80 0x7f7c60151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c5e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c6005c7c0 0x7f7c60138d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36580/0 (socket says 172.21.15.133:36580) 2021-01-03T13:05:10.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c5e59c700 1 -- 172.21.15.133:0/3987919446 learned_addr learned my addr 172.21.15.133:0/3987919446 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:10.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.322+0000 7f7c5dd9b700 1 --2- 172.21.15.133:0/3987919446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c600af7a0 0x7f7c600b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.326+0000 7f7c5e59c700 1 -- 172.21.15.133:0/3987919446 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c600afb80 msgr2=0x7f7c60151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.326+0000 7f7c5e59c700 1 --2- 172.21.15.133:0/3987919446 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c600afb80 0x7f7c60151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.326+0000 7f7c5e59c700 1 -- 172.21.15.133:0/3987919446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c600af7a0 msgr2=0x7f7c600b7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.326+0000 7f7c5e59c700 1 --2- 172.21.15.133:0/3987919446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c600af7a0 0x7f7c600b7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.326+0000 7f7c5e59c700 1 -- 172.21.15.133:0/3987919446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c60145990 con 0x7f7c6005c7c0 2021-01-03T13:05:10.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.326+0000 7f7c5ed9d700 1 --2- 172.21.15.133:0/3987919446 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c600afb80 0x7f7c60151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.326+0000 7f7c5e59c700 1 --2- 172.21.15.133:0/3987919446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c6005c7c0 0x7f7c60138d40 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f7c601376d0 tx=0x7f7c50007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.326+0000 7f7c577fe700 1 -- 172.21.15.133:0/3987919446 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c500072e0 con 0x7f7c6005c7c0 2021-01-03T13:05:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.326+0000 7f7c577fe700 1 -- 172.21.15.133:0/3987919446 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c50007440 con 0x7f7c6005c7c0 2021-01-03T13:05:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.326+0000 7f7c577fe700 1 -- 172.21.15.133:0/3987919446 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c500057d0 con 0x7f7c6005c7c0 2021-01-03T13:05:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.326+0000 7f7c64d66700 1 -- 172.21.15.133:0/3987919446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c600b7fd0 con 0x7f7c6005c7c0 2021-01-03T13:05:10.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.326+0000 7f7c64d66700 1 -- 172.21.15.133:0/3987919446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c600b7c80 con 0x7f7c6005c7c0 2021-01-03T13:05:10.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.326+0000 7f7c64d66700 1 -- 172.21.15.133:0/3987919446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c60057300 con 0x7f7c6005c7c0 2021-01-03T13:05:10.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.326+0000 7f7c577fe700 1 -- 172.21.15.133:0/3987919446 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7c50010070 con 0x7f7c6005c7c0 2021-01-03T13:05:10.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.330+0000 7f7c577fe700 1 --2- 172.21.15.133:0/3987919446 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7c440554e0 0x7f7c440579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.330+0000 7f7c577fe700 1 -- 172.21.15.133:0/3987919446 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7c5006d5e0 con 0x7f7c6005c7c0 2021-01-03T13:05:10.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.330+0000 7f7c5dd9b700 1 --2- 172.21.15.133:0/3987919446 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7c440554e0 0x7f7c440579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.330+0000 7f7c5dd9b700 1 --2- 172.21.15.133:0/3987919446 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7c440554e0 0x7f7c440579a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f7c4801a000 tx=0x7f7c48015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:10.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.334+0000 7f7c577fe700 1 -- 172.21.15.133:0/3987919446 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7c500437d0 con 0x7f7c6005c7c0 2021-01-03T13:05:10.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.478+0000 7f7c64d66700 1 -- 172.21.15.133:0/3987919446 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c600b9ef0 con 0x7f7c6005c7c0 2021-01-03T13:05:10.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.482+0000 7f7c577fe700 1 -- 172.21.15.133:0/3987919446 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f7c50018070 con 0x7f7c6005c7c0 2021-01-03T13:05:10.485 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:10.485 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":90,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:05:09.869273+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:05:07.479446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-01-03T13:05:07.894287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:05:10.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.482+0000 7f7c64d66700 1 -- 172.21.15.133:0/3987919446 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7c440554e0 msgr2=0x7f7c440579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.482+0000 7f7c64d66700 1 --2- 172.21.15.133:0/3987919446 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7c440554e0 0x7f7c440579a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f7c4801a000 tx=0x7f7c48015000).stop 2021-01-03T13:05:10.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.482+0000 7f7c64d66700 1 -- 172.21.15.133:0/3987919446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c6005c7c0 msgr2=0x7f7c60138d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.482+0000 7f7c64d66700 1 --2- 172.21.15.133:0/3987919446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c6005c7c0 0x7f7c60138d40 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f7c601376d0 tx=0x7f7c50007c10).stop 2021-01-03T13:05:10.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.482+0000 7f7c64d66700 1 -- 172.21.15.133:0/3987919446 shutdown_connections 2021-01-03T13:05:10.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.482+0000 7f7c64d66700 1 --2- 172.21.15.133:0/3987919446 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7c440554e0 0x7f7c440579a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.482+0000 7f7c64d66700 1 --2- 172.21.15.133:0/3987919446 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c600afb80 0x7f7c60151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.482+0000 7f7c64d66700 1 --2- 172.21.15.133:0/3987919446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c6005c7c0 0x7f7c60138d40 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.482+0000 7f7c64d66700 1 --2- 172.21.15.133:0/3987919446 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c600af7a0 0x7f7c600b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.482+0000 7f7c64d66700 1 -- 172.21.15.133:0/3987919446 >> 172.21.15.133:0/3987919446 conn(0x7f7c600b9620 msgr2=0x7f7c60060280 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:10.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.482+0000 7f7c64d66700 1 -- 172.21.15.133:0/3987919446 shutdown_connections 2021-01-03T13:05:10.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.482+0000 7f7c64d66700 1 -- 172.21.15.133:0/3987919446 wait complete. 2021-01-03T13:05:10.499 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:05:10.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd0121c1700 1 Processor -- start 2021-01-03T13:05:10.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd0121c1700 1 -- start start 2021-01-03T13:05:10.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd0121c1700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd00c0adc10 0x7fd00c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd0121c1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd00c062450 0x7fd00c0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd0121c1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd00c0b3190 0x7fd00c025140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd0121c1700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd00c0b1930 con 0x7fd00c0adc10 2021-01-03T13:05:10.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd0121c1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd00c0adff0 con 0x7fd00c0b3190 2021-01-03T13:05:10.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd0121c1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c05fb80 con 0x7fd00c062450 2021-01-03T13:05:10.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd013423700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd00c0b3190 0x7fd00c025140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd013423700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd00c0b3190 0x7fd00c025140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36590/0 (socket says 172.21.15.133:36590) 2021-01-03T13:05:10.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd013423700 1 -- 172.21.15.133:0/2739276109 learned_addr learned my addr 172.21.15.133:0/2739276109 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:10.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd0119c0700 1 --2- 172.21.15.133:0/2739276109 >> v2:172.21.15.16:3300/0 conn(0x7fd00c0adc10 0x7fd00c067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd0111bf700 1 --2- 172.21.15.133:0/2739276109 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd00c062450 0x7fd00c0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd013423700 1 -- 172.21.15.133:0/2739276109 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd00c062450 msgr2=0x7fd00c0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd013423700 1 --2- 172.21.15.133:0/2739276109 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd00c062450 0x7fd00c0b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd013423700 1 -- 172.21.15.133:0/2739276109 >> v2:172.21.15.16:3300/0 conn(0x7fd00c0adc10 msgr2=0x7fd00c067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd013423700 1 --2- 172.21.15.133:0/2739276109 >> v2:172.21.15.16:3300/0 conn(0x7fd00c0adc10 0x7fd00c067cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.618+0000 7fd013423700 1 -- 172.21.15.133:0/2739276109 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c05fed0 con 0x7fd00c0b3190 2021-01-03T13:05:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.622+0000 7fd013423700 1 --2- 172.21.15.133:0/2739276109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd00c0b3190 0x7fd00c025140 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fd004002f30 tx=0x7fd004006e80).ready entity=mon.1 client_cookie=2fa0e29f1879931d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:10.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.622+0000 7fd0109be700 1 -- 172.21.15.133:0/2739276109 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd004009640 con 0x7fd00c0b3190 2021-01-03T13:05:10.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.622+0000 7fd0109be700 1 -- 172.21.15.133:0/2739276109 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0040097a0 con 0x7fd00c0b3190 2021-01-03T13:05:10.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.622+0000 7fd0109be700 1 -- 172.21.15.133:0/2739276109 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd004009b00 con 0x7fd00c0b3190 2021-01-03T13:05:10.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.622+0000 7fd0121c1700 1 -- 172.21.15.133:0/2739276109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd00c0b3190 msgr2=0x7fd00c025140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.622+0000 7fd0121c1700 1 --2- 172.21.15.133:0/2739276109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd00c0b3190 0x7fd00c025140 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fd004002f30 tx=0x7fd004006e80).stop 2021-01-03T13:05:10.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.622+0000 7fd0121c1700 1 -- 172.21.15.133:0/2739276109 shutdown_connections 2021-01-03T13:05:10.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.622+0000 7fd0121c1700 1 --2- 172.21.15.133:0/2739276109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd00c0b3190 0x7fd00c025140 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.622+0000 7fd0121c1700 1 --2- 172.21.15.133:0/2739276109 >> v2:172.21.15.16:3300/0 conn(0x7fd00c0adc10 0x7fd00c067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.622+0000 7fd0121c1700 1 --2- 172.21.15.133:0/2739276109 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd00c062450 0x7fd00c0b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.622+0000 7fd0121c1700 1 -- 172.21.15.133:0/2739276109 >> 172.21.15.133:0/2739276109 conn(0x7fd00c060d10 msgr2=0x7fd00c061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:10.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.622+0000 7fd0121c1700 1 -- 172.21.15.133:0/2739276109 shutdown_connections 2021-01-03T13:05:10.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.622+0000 7fd0121c1700 1 -- 172.21.15.133:0/2739276109 wait complete. 2021-01-03T13:05:10.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.622+0000 7fd0121c1700 1 Processor -- start 2021-01-03T13:05:10.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.622+0000 7fd0121c1700 1 -- start start 2021-01-03T13:05:10.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd0121c1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd00c062450 0x7fd00c112720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd0121c1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd00c0adc10 0x7fd00c112c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd0121c1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd00c0b3190 0x7fd00c130aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd0121c1700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c153340 con 0x7fd00c0adc10 2021-01-03T13:05:10.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd0121c1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c152410 con 0x7fd00c0b3190 2021-01-03T13:05:10.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd0121c1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c11bb70 con 0x7fd00c062450 2021-01-03T13:05:10.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd013423700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd00c0b3190 0x7fd00c130aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd013423700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd00c0b3190 0x7fd00c130aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36594/0 (socket says 172.21.15.133:36594) 2021-01-03T13:05:10.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd013423700 1 -- 172.21.15.133:0/737934333 learned_addr learned my addr 172.21.15.133:0/737934333 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:10.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd0119c0700 1 --2- 172.21.15.133:0/737934333 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd00c062450 0x7fd00c112720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd0111bf700 1 --2- 172.21.15.133:0/737934333 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd00c0adc10 0x7fd00c112c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd013423700 1 -- 172.21.15.133:0/737934333 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd00c062450 msgr2=0x7fd00c112720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd013423700 1 --2- 172.21.15.133:0/737934333 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd00c062450 0x7fd00c112720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd013423700 1 -- 172.21.15.133:0/737934333 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd00c0adc10 msgr2=0x7fd00c112c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd013423700 1 --2- 172.21.15.133:0/737934333 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd00c0adc10 0x7fd00c112c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd013423700 1 -- 172.21.15.133:0/737934333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c152fa0 con 0x7fd00c0b3190 2021-01-03T13:05:10.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd013423700 1 --2- 172.21.15.133:0/737934333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd00c0b3190 0x7fd00c130aa0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fd004002f30 tx=0x7fd004015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:10.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fcffe7fc700 1 -- 172.21.15.133:0/737934333 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd004011ad0 con 0x7fd00c0b3190 2021-01-03T13:05:10.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fcffe7fc700 1 -- 172.21.15.133:0/737934333 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd004021070 con 0x7fd00c0b3190 2021-01-03T13:05:10.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd0121c1700 1 -- 172.21.15.133:0/737934333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd00c1529a0 con 0x7fd00c0b3190 2021-01-03T13:05:10.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fcffe7fc700 1 -- 172.21.15.133:0/737934333 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd004011e20 con 0x7fd00c0b3190 2021-01-03T13:05:10.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.626+0000 7fd0121c1700 1 -- 172.21.15.133:0/737934333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c153570 con 0x7fd00c0b3190 2021-01-03T13:05:10.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.630+0000 7fcffe7fc700 1 -- 172.21.15.133:0/737934333 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd00402d070 con 0x7fd00c0b3190 2021-01-03T13:05:10.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.630+0000 7fd0121c1700 1 -- 172.21.15.133:0/737934333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00c057300 con 0x7fd00c0b3190 2021-01-03T13:05:10.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.630+0000 7fcffe7fc700 1 --2- 172.21.15.133:0/737934333 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcff40553b0 0x7fcff4057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.630+0000 7fcffe7fc700 1 -- 172.21.15.133:0/737934333 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd004071350 con 0x7fd00c0b3190 2021-01-03T13:05:10.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.630+0000 7fd0119c0700 1 --2- 172.21.15.133:0/737934333 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcff40553b0 0x7fcff4057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.630+0000 7fd0119c0700 1 --2- 172.21.15.133:0/737934333 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcff40553b0 0x7fcff4057870 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fd00800b000 tx=0x7fd008006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:10.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.634+0000 7fcffe7fc700 1 -- 172.21.15.133:0/737934333 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd004047650 con 0x7fd00c0b3190 2021-01-03T13:05:10.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.822+0000 7fd0121c1700 1 -- 172.21.15.133:0/737934333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd00c068660 con 0x7fd00c0b3190 2021-01-03T13:05:10.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.834+0000 7fcffe7fc700 1 -- 172.21.15.133:0/737934333 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v21) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd00404ac70 con 0x7fd00c0b3190 2021-01-03T13:05:10.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.834+0000 7fd0121c1700 1 -- 172.21.15.133:0/737934333 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcff40553b0 msgr2=0x7fcff4057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.834+0000 7fd0121c1700 1 --2- 172.21.15.133:0/737934333 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcff40553b0 0x7fcff4057870 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fd00800b000 tx=0x7fd008006dc0).stop 2021-01-03T13:05:10.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.834+0000 7fd0121c1700 1 -- 172.21.15.133:0/737934333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd00c0b3190 msgr2=0x7fd00c130aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.834+0000 7fd0121c1700 1 --2- 172.21.15.133:0/737934333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd00c0b3190 0x7fd00c130aa0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fd004002f30 tx=0x7fd004015000).stop 2021-01-03T13:05:10.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.834+0000 7fd0121c1700 1 -- 172.21.15.133:0/737934333 shutdown_connections 2021-01-03T13:05:10.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.834+0000 7fd0121c1700 1 --2- 172.21.15.133:0/737934333 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcff40553b0 0x7fcff4057870 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.834+0000 7fd0121c1700 1 --2- 172.21.15.133:0/737934333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd00c0b3190 0x7fd00c130aa0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.834+0000 7fd0121c1700 1 --2- 172.21.15.133:0/737934333 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd00c062450 0x7fd00c112720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.834+0000 7fd0121c1700 1 --2- 172.21.15.133:0/737934333 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd00c0adc10 0x7fd00c112c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.834+0000 7fd0121c1700 1 -- 172.21.15.133:0/737934333 >> 172.21.15.133:0/737934333 conn(0x7fd00c060d10 msgr2=0x7fd00c0aef40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:10.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.834+0000 7fd0121c1700 1 -- 172.21.15.133:0/737934333 shutdown_connections 2021-01-03T13:05:10.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.834+0000 7fd0121c1700 1 -- 172.21.15.133:0/737934333 wait complete. 2021-01-03T13:05:10.842 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2021-01-03T13:05:10.851 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:05:10.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.970+0000 7f595d612700 1 Processor -- start 2021-01-03T13:05:10.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.970+0000 7f595d612700 1 -- start start 2021-01-03T13:05:10.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f595d612700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5958062450 0x7f5958067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f595d612700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f59580b33b0 0x7f595814f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f595d612700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59580adff0 con 0x7f59580adc10 2021-01-03T13:05:10.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f595d612700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59580b1930 con 0x7f59580b33b0 2021-01-03T13:05:10.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f595d612700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595805fb80 con 0x7f5958062450 2021-01-03T13:05:10.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f5957fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5958062450 0x7f5958067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f595ce11700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f59580adc10 0x7f59580b2ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57632/0 (socket says 172.21.15.133:57632) 2021-01-03T13:05:10.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f595ce11700 1 -- 172.21.15.133:0/2301121339 learned_addr learned my addr 172.21.15.133:0/2301121339 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:10.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f595e874700 1 --2- 172.21.15.133:0/2301121339 >> v2:172.21.15.16:3300/0 conn(0x7f59580b33b0 0x7f595814f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f5957fff700 1 -- 172.21.15.133:0/2301121339 >> v2:172.21.15.16:3300/0 conn(0x7f59580b33b0 msgr2=0x7f595814f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:10.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f5957fff700 1 --2- 172.21.15.133:0/2301121339 >> v2:172.21.15.16:3300/0 conn(0x7f59580b33b0 0x7f595814f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f5957fff700 1 -- 172.21.15.133:0/2301121339 >> v1:172.21.15.133:6789/0 conn(0x7f59580adc10 legacy=0x7f59580b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f5957fff700 1 -- 172.21.15.133:0/2301121339 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59580b3860 con 0x7f5958062450 2021-01-03T13:05:10.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f595e874700 1 --2- 172.21.15.133:0/2301121339 >> v2:172.21.15.16:3300/0 conn(0x7f59580b33b0 0x7f595814f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:10.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f5957fff700 1 --2- 172.21.15.133:0/2301121339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5958062450 0x7f5958067cb0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f5940002f30 tx=0x7f5940006dc0).ready entity=mon.1 client_cookie=524ef184b069f8d3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:10.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f59577fe700 1 -- 172.21.15.133:0/2301121339 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59400097f0 con 0x7f5958062450 2021-01-03T13:05:10.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f59577fe700 1 -- 172.21.15.133:0/2301121339 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5940009950 con 0x7f5958062450 2021-01-03T13:05:10.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f59577fe700 1 -- 172.21.15.133:0/2301121339 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5940009cb0 con 0x7f5958062450 2021-01-03T13:05:10.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f595d612700 1 -- 172.21.15.133:0/2301121339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5958062450 msgr2=0x7f5958067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f595d612700 1 --2- 172.21.15.133:0/2301121339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5958062450 0x7f5958067cb0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f5940002f30 tx=0x7f5940006dc0).stop 2021-01-03T13:05:10.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f595d612700 1 -- 172.21.15.133:0/2301121339 shutdown_connections 2021-01-03T13:05:10.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f595d612700 1 --2- 172.21.15.133:0/2301121339 >> v2:172.21.15.16:3300/0 conn(0x7f59580b33b0 0x7f595814f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f595d612700 1 --2- 172.21.15.133:0/2301121339 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5958062450 0x7f5958067cb0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f595d612700 1 -- 172.21.15.133:0/2301121339 >> 172.21.15.133:0/2301121339 conn(0x7f5958060d10 msgr2=0x7f5958061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:10.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f595d612700 1 -- 172.21.15.133:0/2301121339 shutdown_connections 2021-01-03T13:05:10.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.974+0000 7f595d612700 1 -- 172.21.15.133:0/2301121339 wait complete. 2021-01-03T13:05:10.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595d612700 1 Processor -- start 2021-01-03T13:05:10.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595d612700 1 -- start start 2021-01-03T13:05:10.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595d612700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5958062450 0x7f595812bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595d612700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59580adc10 0x7f5958125910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595d612700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59580b33b0 0x7f59580b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595d612700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59581288f0 con 0x7f59580adc10 2021-01-03T13:05:10.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595d612700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5958070fe0 con 0x7f59580b33b0 2021-01-03T13:05:10.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595d612700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595807fad0 con 0x7f5958062450 2021-01-03T13:05:10.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595e874700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59580b33b0 0x7f59580b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595e874700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59580b33b0 0x7f59580b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36610/0 (socket says 172.21.15.133:36610) 2021-01-03T13:05:10.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595e874700 1 -- 172.21.15.133:0/3120943859 learned_addr learned my addr 172.21.15.133:0/3120943859 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:10.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595ce11700 1 --2- 172.21.15.133:0/3120943859 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5958062450 0x7f595812bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f5957fff700 1 --2- 172.21.15.133:0/3120943859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59580adc10 0x7f5958125910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595e874700 1 -- 172.21.15.133:0/3120943859 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5958062450 msgr2=0x7f595812bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595e874700 1 --2- 172.21.15.133:0/3120943859 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5958062450 0x7f595812bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595e874700 1 -- 172.21.15.133:0/3120943859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59580adc10 msgr2=0x7f5958125910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:10.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595e874700 1 --2- 172.21.15.133:0/3120943859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59580adc10 0x7f5958125910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:10.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595e874700 1 -- 172.21.15.133:0/3120943859 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5958071210 con 0x7f59580b33b0 2021-01-03T13:05:10.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595e874700 1 --2- 172.21.15.133:0/3120943859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59580b33b0 0x7f59580b42a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f5950007000 tx=0x7f5950008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:10.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f59557fa700 1 -- 172.21.15.133:0/3120943859 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f595000e5e0 con 0x7f59580b33b0 2021-01-03T13:05:10.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595d612700 1 -- 172.21.15.133:0/3120943859 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59580707d0 con 0x7f59580b33b0 2021-01-03T13:05:10.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f59557fa700 1 -- 172.21.15.133:0/3120943859 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595000c070 con 0x7f59580b33b0 2021-01-03T13:05:10.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f59557fa700 1 -- 172.21.15.133:0/3120943859 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f595000e930 con 0x7f59580b33b0 2021-01-03T13:05:10.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.978+0000 7f595d612700 1 -- 172.21.15.133:0/3120943859 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59581282b0 con 0x7f59580b33b0 2021-01-03T13:05:10.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.982+0000 7f595d612700 1 -- 172.21.15.133:0/3120943859 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5958057300 con 0x7f59580b33b0 2021-01-03T13:05:10.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.982+0000 7f59557fa700 1 -- 172.21.15.133:0/3120943859 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f595000ea90 con 0x7f59580b33b0 2021-01-03T13:05:10.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.982+0000 7f59557fa700 1 --2- 172.21.15.133:0/3120943859 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f593c055440 0x7f593c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:10.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.982+0000 7f59557fa700 1 -- 172.21.15.133:0/3120943859 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f595006da20 con 0x7f59580b33b0 2021-01-03T13:05:10.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.982+0000 7f595ce11700 1 --2- 172.21.15.133:0/3120943859 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f593c055440 0x7f593c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:10.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.982+0000 7f595ce11700 1 --2- 172.21.15.133:0/3120943859 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f593c055440 0x7f593c057900 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f594800d000 tx=0x7f5948009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:10.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:10.990+0000 7f59557fa700 1 -- 172.21.15.133:0/3120943859 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5950043b90 con 0x7f59580b33b0 2021-01-03T13:05:11.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.178+0000 7f595d612700 1 -- 172.21.15.133:0/3120943859 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5958159f90 con 0x7f59580b33b0 2021-01-03T13:05:11.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.186+0000 7f59557fa700 1 -- 172.21.15.133:0/3120943859 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v22) v1 ==== 184+0+0 (secure 0 0 0) 0x7f59500471b0 con 0x7f59580b33b0 2021-01-03T13:05:11.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.190+0000 7f595d612700 1 -- 172.21.15.133:0/3120943859 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f593c055440 msgr2=0x7f593c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:11.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.190+0000 7f595d612700 1 --2- 172.21.15.133:0/3120943859 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f593c055440 0x7f593c057900 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f594800d000 tx=0x7f5948009040).stop 2021-01-03T13:05:11.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.190+0000 7f595d612700 1 -- 172.21.15.133:0/3120943859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59580b33b0 msgr2=0x7f59580b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:11.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.190+0000 7f595d612700 1 --2- 172.21.15.133:0/3120943859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59580b33b0 0x7f59580b42a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f5950007000 tx=0x7f5950008040).stop 2021-01-03T13:05:11.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.190+0000 7f595d612700 1 -- 172.21.15.133:0/3120943859 shutdown_connections 2021-01-03T13:05:11.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.190+0000 7f595d612700 1 --2- 172.21.15.133:0/3120943859 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f593c055440 0x7f593c057900 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:11.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.190+0000 7f595d612700 1 --2- 172.21.15.133:0/3120943859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59580b33b0 0x7f59580b42a0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:11.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.190+0000 7f595d612700 1 --2- 172.21.15.133:0/3120943859 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5958062450 0x7f595812bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:11.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.190+0000 7f595d612700 1 --2- 172.21.15.133:0/3120943859 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f59580adc10 0x7f5958125910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:11.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.190+0000 7f595d612700 1 -- 172.21.15.133:0/3120943859 >> 172.21.15.133:0/3120943859 conn(0x7f5958060d10 msgr2=0x7f59580ae380 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:11.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.190+0000 7f595d612700 1 -- 172.21.15.133:0/3120943859 shutdown_connections 2021-01-03T13:05:11.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.190+0000 7f595d612700 1 -- 172.21.15.133:0/3120943859 wait complete. 2021-01-03T13:05:11.197 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.1 2021-01-03T13:05:11.210 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:05:11.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedab59e700 1 Processor -- start 2021-01-03T13:05:11.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedab59e700 1 -- start start 2021-01-03T13:05:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedab59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fedac05c130 0x7fedac0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:11.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedab59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fedac1479e0 0x7fedac1445e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:11.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedab59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac05c510 con 0x7fedac061890 2021-01-03T13:05:11.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedab59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedac14a930 con 0x7fedac05c130 2021-01-03T13:05:11.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedab59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedac14abd0 con 0x7fedac1479e0 2021-01-03T13:05:11.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedaad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fedac1479e0 0x7fedac1445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:11.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7feda9d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fedac061890 0x7fedac1472d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57648/0 (socket says 172.21.15.133:57648) 2021-01-03T13:05:11.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7feda9d9b700 1 -- 172.21.15.133:0/3991733013 learned_addr learned my addr 172.21.15.133:0/3991733013 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:11.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedaa59c700 1 --2- 172.21.15.133:0/3991733013 >> v2:172.21.15.16:3300/0 conn(0x7fedac05c130 0x7fedac0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:11.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7feda959a700 1 -- 172.21.15.133:0/3991733013 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989924348 0 0) 0x7fedac05c510 con 0x7fedac061890 2021-01-03T13:05:11.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7feda959a700 1 -- 172.21.15.133:0/3991733013 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed90003230 con 0x7fedac061890 2021-01-03T13:05:11.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedaad9d700 1 -- 172.21.15.133:0/3991733013 >> v2:172.21.15.16:3300/0 conn(0x7fedac05c130 msgr2=0x7fedac0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:11.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedaad9d700 1 --2- 172.21.15.133:0/3991733013 >> v2:172.21.15.16:3300/0 conn(0x7fedac05c130 0x7fedac0b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:11.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedaad9d700 1 -- 172.21.15.133:0/3991733013 >> v1:172.21.15.133:6789/0 conn(0x7fedac061890 legacy=0x7fedac1472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:11.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedaad9d700 1 -- 172.21.15.133:0/3991733013 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac14ae70 con 0x7fedac1479e0 2021-01-03T13:05:11.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedaad9d700 1 --2- 172.21.15.133:0/3991733013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedac1479e0 0x7fedac1445e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7feda4002f30 tx=0x7feda4006dc0).ready entity=mon.1 client_cookie=c403be72938cfe26 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:11.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7feda959a700 1 -- 172.21.15.133:0/3991733013 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feda40096f0 con 0x7fedac1479e0 2021-01-03T13:05:11.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7feda959a700 1 -- 172.21.15.133:0/3991733013 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda4009850 con 0x7fedac1479e0 2021-01-03T13:05:11.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7feda959a700 1 -- 172.21.15.133:0/3991733013 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feda4009bf0 con 0x7fedac1479e0 2021-01-03T13:05:11.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedab59e700 1 -- 172.21.15.133:0/3991733013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedac1479e0 msgr2=0x7fedac1445e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:11.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedab59e700 1 --2- 172.21.15.133:0/3991733013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedac1479e0 0x7fedac1445e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7feda4002f30 tx=0x7feda4006dc0).stop 2021-01-03T13:05:11.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedab59e700 1 -- 172.21.15.133:0/3991733013 shutdown_connections 2021-01-03T13:05:11.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedab59e700 1 --2- 172.21.15.133:0/3991733013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedac1479e0 0x7fedac1445e0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:11.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedab59e700 1 --2- 172.21.15.133:0/3991733013 >> v2:172.21.15.16:3300/0 conn(0x7fedac05c130 0x7fedac0b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:11.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedab59e700 1 -- 172.21.15.133:0/3991733013 >> 172.21.15.133:0/3991733013 conn(0x7fedac0b6110 msgr2=0x7fedac0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:11.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedab59e700 1 -- 172.21.15.133:0/3991733013 shutdown_connections 2021-01-03T13:05:11.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.318+0000 7fedab59e700 1 -- 172.21.15.133:0/3991733013 wait complete. 2021-01-03T13:05:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7fedab59e700 1 Processor -- start 2021-01-03T13:05:11.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7fedab59e700 1 -- start start 2021-01-03T13:05:11.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7fedab59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fedac05c130 0x7fedac1446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:11.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7fedab59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedac061890 0x7fedac13ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:11.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7fedab59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fedac1479e0 0x7fedac13f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:11.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7fedab59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac149f40 con 0x7fedac05c130 2021-01-03T13:05:11.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7fedab59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac14a170 con 0x7fedac061890 2021-01-03T13:05:11.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7fedab59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac1594c0 con 0x7fedac1479e0 2021-01-03T13:05:11.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7feda9d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedac061890 0x7fedac13ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:11.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7feda9d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedac061890 0x7fedac13ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36622/0 (socket says 172.21.15.133:36622) 2021-01-03T13:05:11.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7feda9d9b700 1 -- 172.21.15.133:0/2967810524 learned_addr learned my addr 172.21.15.133:0/2967810524 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:11.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7fedaa59c700 1 --2- 172.21.15.133:0/2967810524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fedac05c130 0x7fedac1446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:11.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7fedaad9d700 1 --2- 172.21.15.133:0/2967810524 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fedac1479e0 0x7fedac13f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:11.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7feda9d9b700 1 -- 172.21.15.133:0/2967810524 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fedac1479e0 msgr2=0x7fedac13f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:11.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7feda9d9b700 1 --2- 172.21.15.133:0/2967810524 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fedac1479e0 0x7fedac13f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:11.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7feda9d9b700 1 -- 172.21.15.133:0/2967810524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fedac05c130 msgr2=0x7fedac1446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7feda9d9b700 1 --2- 172.21.15.133:0/2967810524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fedac05c130 0x7fedac1446f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7feda9d9b700 1 -- 172.21.15.133:0/2967810524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac1539b0 con 0x7fedac061890 2021-01-03T13:05:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7feda9d9b700 1 --2- 172.21.15.133:0/2967810524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedac061890 0x7fedac13ef70 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7fedac1473f0 tx=0x7feda0007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.322+0000 7fed9b7fe700 1 -- 172.21.15.133:0/2967810524 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feda00072e0 con 0x7fedac061890 2021-01-03T13:05:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.326+0000 7fed9b7fe700 1 -- 172.21.15.133:0/2967810524 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda0007440 con 0x7fedac061890 2021-01-03T13:05:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.326+0000 7fed9b7fe700 1 -- 172.21.15.133:0/2967810524 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feda00057d0 con 0x7fedac061890 2021-01-03T13:05:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.326+0000 7fedab59e700 1 -- 172.21.15.133:0/2967810524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac0ae130 con 0x7fedac061890 2021-01-03T13:05:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.326+0000 7fedab59e700 1 -- 172.21.15.133:0/2967810524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedac149950 con 0x7fedac061890 2021-01-03T13:05:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.326+0000 7fedab59e700 1 -- 172.21.15.133:0/2967810524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedac14a2e0 con 0x7fedac061890 2021-01-03T13:05:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.326+0000 7fed9b7fe700 1 -- 172.21.15.133:0/2967810524 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7feda0010070 con 0x7fedac061890 2021-01-03T13:05:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.326+0000 7fed9b7fe700 1 --2- 172.21.15.133:0/2967810524 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fed880554e0 0x7fed880579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.326+0000 7fed9b7fe700 1 -- 172.21.15.133:0/2967810524 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feda006d6a0 con 0x7fedac061890 2021-01-03T13:05:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.326+0000 7fedaa59c700 1 --2- 172.21.15.133:0/2967810524 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fed880554e0 0x7fed880579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:11.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.326+0000 7fedaa59c700 1 --2- 172.21.15.133:0/2967810524 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fed880554e0 0x7fed880579a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fed9c00b000 tx=0x7fed9c0091a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:11.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.334+0000 7fed9b7fe700 1 -- 172.21.15.133:0/2967810524 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7feda00439a0 con 0x7fedac061890 2021-01-03T13:05:11.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.514+0000 7fedab59e700 1 -- 172.21.15.133:0/2967810524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedac057300 con 0x7fedac061890 2021-01-03T13:05:11.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.518+0000 7fed9b7fe700 1 -- 172.21.15.133:0/2967810524 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7feda0046fc0 con 0x7fedac061890 2021-01-03T13:05:11.521 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:11.521 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":38,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6523,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3593206473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3593206473},{"type":"v1","addr":"172.21.15.133:6835","nonce":3593206473}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/328558863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":328558863},{"type":"v1","addr":"172.21.15.133:6837","nonce":328558863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:08.865621+0000","modified":"2021-01-03T13:05:09.868458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/420953895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":420953895},{"type":"v1","addr":"172.21.15.16:6833","nonce":420953895}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-01-03T13:05:11.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.518+0000 7fedab59e700 1 -- 172.21.15.133:0/2967810524 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fed880554e0 msgr2=0x7fed880579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:11.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.518+0000 7fedab59e700 1 --2- 172.21.15.133:0/2967810524 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fed880554e0 0x7fed880579a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fed9c00b000 tx=0x7fed9c0091a0).stop 2021-01-03T13:05:11.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.518+0000 7fedab59e700 1 -- 172.21.15.133:0/2967810524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedac061890 msgr2=0x7fedac13ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:11.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.518+0000 7fedab59e700 1 --2- 172.21.15.133:0/2967810524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedac061890 0x7fedac13ef70 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7fedac1473f0 tx=0x7feda0007aa0).stop 2021-01-03T13:05:11.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.518+0000 7fedab59e700 1 -- 172.21.15.133:0/2967810524 shutdown_connections 2021-01-03T13:05:11.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.518+0000 7fedab59e700 1 --2- 172.21.15.133:0/2967810524 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fed880554e0 0x7fed880579a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:11.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.518+0000 7fedab59e700 1 --2- 172.21.15.133:0/2967810524 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fedac05c130 0x7fedac1446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:11.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.518+0000 7fedab59e700 1 --2- 172.21.15.133:0/2967810524 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fedac1479e0 0x7fedac13f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:11.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.518+0000 7fedab59e700 1 --2- 172.21.15.133:0/2967810524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedac061890 0x7fedac13ef70 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:11.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.518+0000 7fedab59e700 1 -- 172.21.15.133:0/2967810524 >> 172.21.15.133:0/2967810524 conn(0x7fedac0b6110 msgr2=0x7fedac0b4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:11.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.518+0000 7fedab59e700 1 -- 172.21.15.133:0/2967810524 shutdown_connections 2021-01-03T13:05:11.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:11.518+0000 7fedab59e700 1 -- 172.21.15.133:0/2967810524 wait complete. 2021-01-03T13:05:11.526 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 38 2021-01-03T13:05:11.842 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:05:08.865621+0000', 'modified': '2021-01-03T13:05:09.868458+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6532}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6532': {'gid': 6532, 'name': 'b', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.16:6833/420953895', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6832', 'nonce': 420953895}, {'type': 'v1', 'addr': '172.21.15.16:6833', 'nonce': 420953895}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:05:11.842 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:05:11.843 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-01-03T13:05:11.978 INFO:teuthology.orchestra.run.smithi016.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":6532,"want_state":"up:active","state":"up:active","rank_uptime":3.0975019760000002,"mdsmap_epoch":38,"osdmap_epoch":90,"osdmap_epoch_barrier":89,"uptime":7.3682193050000002} 2021-01-03T13:05:11.979 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 6532, "mdsmap_epoch": 38, "osdmap_epoch": 90, "osdmap_epoch_barrier": 89, "rank_uptime": 3.097501976, "state": "up:active", "uptime": 7.368219305, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:05:11.980 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:05:12.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.098+0000 7fa30d7f8700 1 Processor -- start 2021-01-03T13:05:12.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.098+0000 7fa30d7f8700 1 -- start start 2021-01-03T13:05:12.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.098+0000 7fa30d7f8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3080b0c90 0x7fa3080b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.098+0000 7fa30d7f8700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa308060da0 con 0x7fa3080b52c0 2021-01-03T13:05:12.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.098+0000 7fa30d7f8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3080b0ad0 con 0x7fa3080b5c00 2021-01-03T13:05:12.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.098+0000 7fa30d7f8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa308067a90 con 0x7fa3080b0c90 2021-01-03T13:05:12.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.098+0000 7fa30cff7700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa3080b5c00 0x7fa308143eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57664/0 (socket says 172.21.15.133:57664) 2021-01-03T13:05:12.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.098+0000 7fa30cff7700 1 -- 172.21.15.133:0/2239902330 learned_addr learned my addr 172.21.15.133:0/2239902330 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:12.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.098+0000 7fa3077fe700 1 --2- 172.21.15.133:0/2239902330 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3080b0c90 0x7fa3080b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.098+0000 7fa306ffd700 1 -- 172.21.15.133:0/2239902330 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932105817 0 0) 0x7fa300001450 con 0x7fa3080b5c00 2021-01-03T13:05:12.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.098+0000 7fa306ffd700 1 -- 172.21.15.133:0/2239902330 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2e8003230 con 0x7fa3080b5c00 2021-01-03T13:05:12.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.098+0000 7fa306ffd700 1 -- 172.21.15.133:0/2239902330 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1526777566 0 0) 0x7fa2e8003230 con 0x7fa3080b5c00 2021-01-03T13:05:12.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.098+0000 7fa306ffd700 1 -- 172.21.15.133:0/2239902330 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3080b0c90 msgr2=0x7fa3080b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:12.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.098+0000 7fa306ffd700 1 --2- 172.21.15.133:0/2239902330 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3080b0c90 0x7fa3080b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.098+0000 7fa306ffd700 1 -- 172.21.15.133:0/2239902330 >> v1:172.21.15.16:6789/0 conn(0x7fa3080b52c0 legacy=0x7fa308098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.098+0000 7fa306ffd700 1 -- 172.21.15.133:0/2239902330 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3080b56a0 con 0x7fa3080b5c00 2021-01-03T13:05:12.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.098+0000 7fa306ffd700 1 -- 172.21.15.133:0/2239902330 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fa300001be0 con 0x7fa3080b5c00 2021-01-03T13:05:12.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa306ffd700 1 -- 172.21.15.133:0/2239902330 >> v1:172.21.15.133:6789/0 conn(0x7fa3080b5c00 legacy=0x7fa308143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa306ffd700 1 --2- 172.21.15.133:0/2239902330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2e8003720 0x7fa2e8003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa306ffd700 1 --2- 172.21.15.133:0/2239902330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2e80044d0 0x7fa2e8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa306ffd700 1 --2- 172.21.15.133:0/2239902330 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3080b0c90 0x7fa2e8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa306ffd700 1 -- 172.21.15.133:0/2239902330 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa308067a90 con 0x7fa2e8003720 2021-01-03T13:05:12.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa306ffd700 1 -- 172.21.15.133:0/2239902330 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e8004250 con 0x7fa2e80044d0 2021-01-03T13:05:12.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa306ffd700 1 -- 172.21.15.133:0/2239902330 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e800b720 con 0x7fa3080b0c90 2021-01-03T13:05:12.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa3077fe700 1 --2- 172.21.15.133:0/2239902330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2e80044d0 0x7fa2e8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa307fff700 1 --2- 172.21.15.133:0/2239902330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2e8003720 0x7fa2e8003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa30cff7700 1 --2- 172.21.15.133:0/2239902330 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3080b0c90 0x7fa2e8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa3077fe700 1 -- 172.21.15.133:0/2239902330 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3080b0c90 msgr2=0x7fa2e8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:12.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa3077fe700 1 --2- 172.21.15.133:0/2239902330 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3080b0c90 0x7fa2e8004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa3077fe700 1 -- 172.21.15.133:0/2239902330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2e8003720 msgr2=0x7fa2e8003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:12.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa3077fe700 1 --2- 172.21.15.133:0/2239902330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2e8003720 0x7fa2e8003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa3077fe700 1 -- 172.21.15.133:0/2239902330 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e8003230 con 0x7fa2e80044d0 2021-01-03T13:05:12.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa307fff700 1 --2- 172.21.15.133:0/2239902330 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2e8003720 0x7fa2e8003b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:12.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa3077fe700 1 --2- 172.21.15.133:0/2239902330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2e80044d0 0x7fa2e8004950 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fa2f000c000 tx=0x7fa2f0008040).ready entity=mon.1 client_cookie=6fc7c00287008320 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:12.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa306ffd700 1 -- 172.21.15.133:0/2239902330 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2f000e8a0 con 0x7fa2e80044d0 2021-01-03T13:05:12.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa306ffd700 1 -- 172.21.15.133:0/2239902330 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f000ea00 con 0x7fa2e80044d0 2021-01-03T13:05:12.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa306ffd700 1 -- 172.21.15.133:0/2239902330 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2f000ed60 con 0x7fa2e80044d0 2021-01-03T13:05:12.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa30d7f8700 1 -- 172.21.15.133:0/2239902330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2e80044d0 msgr2=0x7fa2e8004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa30d7f8700 1 --2- 172.21.15.133:0/2239902330 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2e80044d0 0x7fa2e8004950 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fa2f000c000 tx=0x7fa2f0008040).stop 2021-01-03T13:05:12.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa30cff7700 1 -- 172.21.15.133:0/2239902330 reap_dead start 2021-01-03T13:05:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa30d7f8700 1 -- 172.21.15.133:0/2239902330 shutdown_connections 2021-01-03T13:05:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa30d7f8700 1 -- 172.21.15.133:0/2239902330 >> 172.21.15.133:0/2239902330 conn(0x7fa30805bdf0 msgr2=0x7fa30805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa30d7f8700 1 -- 172.21.15.133:0/2239902330 shutdown_connections 2021-01-03T13:05:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa30d7f8700 1 -- 172.21.15.133:0/2239902330 wait complete. 2021-01-03T13:05:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa30d7f8700 1 Processor -- start 2021-01-03T13:05:12.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.102+0000 7fa30d7f8700 1 -- start start 2021-01-03T13:05:12.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa30d7f8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa308063a10 0x7fa308065750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa30d7f8700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3081560c0 0x7fa308156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa30d7f8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3080aea80 0x7fa3080aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa30d7f8700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa308063df0 con 0x7fa3081560c0 2021-01-03T13:05:12.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa30d7f8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa308064370 con 0x7fa308063a10 2021-01-03T13:05:12.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa30d7f8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080aa270 con 0x7fa3080aea80 2021-01-03T13:05:12.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa307fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa308063a10 0x7fa308065750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa307fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa308063a10 0x7fa308065750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36642/0 (socket says 172.21.15.133:36642) 2021-01-03T13:05:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa307fff700 1 -- 172.21.15.133:0/213693168 learned_addr learned my addr 172.21.15.133:0/213693168 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa3077fe700 1 --2- 172.21.15.133:0/213693168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3081560c0 0x7fa308156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa30cff7700 1 --2- 172.21.15.133:0/213693168 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3080aea80 0x7fa3080aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa307fff700 1 -- 172.21.15.133:0/213693168 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3080aea80 msgr2=0x7fa3080aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa307fff700 1 --2- 172.21.15.133:0/213693168 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3080aea80 0x7fa3080aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa307fff700 1 -- 172.21.15.133:0/213693168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3081560c0 msgr2=0x7fa308156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa307fff700 1 --2- 172.21.15.133:0/213693168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3081560c0 0x7fa308156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa307fff700 1 -- 172.21.15.133:0/213693168 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa308066030 con 0x7fa308063a10 2021-01-03T13:05:12.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa307fff700 1 --2- 172.21.15.133:0/213693168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa308063a10 0x7fa308065750 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fa2f8007530 tx=0x7fa2f8009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:12.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa3057fa700 1 -- 172.21.15.133:0/213693168 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2f800da10 con 0x7fa308063a10 2021-01-03T13:05:12.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa3057fa700 1 -- 172.21.15.133:0/213693168 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f800db70 con 0x7fa308063a10 2021-01-03T13:05:12.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa30d7f8700 1 -- 172.21.15.133:0/213693168 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa308156a30 con 0x7fa308063a10 2021-01-03T13:05:12.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa3057fa700 1 -- 172.21.15.133:0/213693168 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2f80133f0 con 0x7fa308063a10 2021-01-03T13:05:12.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa30d7f8700 1 -- 172.21.15.133:0/213693168 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3080aa710 con 0x7fa308063a10 2021-01-03T13:05:12.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.106+0000 7fa30d7f8700 1 -- 172.21.15.133:0/213693168 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa308057300 con 0x7fa308063a10 2021-01-03T13:05:12.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.110+0000 7fa3057fa700 1 -- 172.21.15.133:0/213693168 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa2f801a030 con 0x7fa308063a10 2021-01-03T13:05:12.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.110+0000 7fa3057fa700 1 --2- 172.21.15.133:0/213693168 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa2ec055330 0x7fa2ec0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.110+0000 7fa3057fa700 1 -- 172.21.15.133:0/213693168 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa2f806dc70 con 0x7fa308063a10 2021-01-03T13:05:12.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.110+0000 7fa3077fe700 1 --2- 172.21.15.133:0/213693168 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa2ec055330 0x7fa2ec0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.110+0000 7fa3077fe700 1 --2- 172.21.15.133:0/213693168 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa2ec055330 0x7fa2ec0577f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fa2f001b000 tx=0x7fa2f001a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:12.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.114+0000 7fa3057fa700 1 -- 172.21.15.133:0/213693168 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa2f8043f70 con 0x7fa308063a10 2021-01-03T13:05:12.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.250+0000 7fa30d7f8700 1 -- 172.21.15.133:0/213693168 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3080644b0 con 0x7fa308063a10 2021-01-03T13:05:12.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.254+0000 7fa3057fa700 1 -- 172.21.15.133:0/213693168 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fa2f8047590 con 0x7fa308063a10 2021-01-03T13:05:12.257 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:12.257 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":90,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:05:09.869273+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:05:07.479446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-01-03T13:05:07.894287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:05:12.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.254+0000 7fa30d7f8700 1 -- 172.21.15.133:0/213693168 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa2ec055330 msgr2=0x7fa2ec0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.254+0000 7fa30d7f8700 1 --2- 172.21.15.133:0/213693168 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa2ec055330 0x7fa2ec0577f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fa2f001b000 tx=0x7fa2f001a000).stop 2021-01-03T13:05:12.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.254+0000 7fa30d7f8700 1 -- 172.21.15.133:0/213693168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa308063a10 msgr2=0x7fa308065750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.254+0000 7fa30d7f8700 1 --2- 172.21.15.133:0/213693168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa308063a10 0x7fa308065750 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7fa2f8007530 tx=0x7fa2f8009040).stop 2021-01-03T13:05:12.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.254+0000 7fa30d7f8700 1 -- 172.21.15.133:0/213693168 shutdown_connections 2021-01-03T13:05:12.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.254+0000 7fa30d7f8700 1 --2- 172.21.15.133:0/213693168 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa2ec055330 0x7fa2ec0577f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.254+0000 7fa30d7f8700 1 --2- 172.21.15.133:0/213693168 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3080aea80 0x7fa3080aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.254+0000 7fa30d7f8700 1 --2- 172.21.15.133:0/213693168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa308063a10 0x7fa308065750 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.254+0000 7fa30d7f8700 1 --2- 172.21.15.133:0/213693168 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3081560c0 0x7fa308156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.254+0000 7fa30d7f8700 1 -- 172.21.15.133:0/213693168 >> 172.21.15.133:0/213693168 conn(0x7fa30805bdf0 msgr2=0x7fa308060220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:12.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.254+0000 7fa30d7f8700 1 -- 172.21.15.133:0/213693168 shutdown_connections 2021-01-03T13:05:12.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.254+0000 7fa30d7f8700 1 -- 172.21.15.133:0/213693168 wait complete. 2021-01-03T13:05:12.271 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:05:07.479446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:05:07.894287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:05:12.272 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:05:12.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff4a17a3700 1 Processor -- start 2021-01-03T13:05:12.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff4a17a3700 1 -- start start 2021-01-03T13:05:12.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff4a17a3700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff49c0b2990 0x7ff49c146300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff4a17a3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff49c0b34e0 0x7ff49c140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff4a17a3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49c1467f0 con 0x7ff49c0b7ab0 2021-01-03T13:05:12.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff4a17a3700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49c0b30f0 con 0x7ff49c0b2990 2021-01-03T13:05:12.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff4a17a3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c061480 con 0x7ff49c0b34e0 2021-01-03T13:05:12.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff49bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff49c0b7ab0 0x7ff49c0b1d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57680/0 (socket says 172.21.15.133:57680) 2021-01-03T13:05:12.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff49bfff700 1 -- 172.21.15.133:0/2353210913 learned_addr learned my addr 172.21.15.133:0/2353210913 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:12.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff4a0fa2700 1 --2- 172.21.15.133:0/2353210913 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff49c0b34e0 0x7ff49c140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff49b7fe700 1 --2- 172.21.15.133:0/2353210913 >> v2:172.21.15.16:3300/0 conn(0x7ff49c0b2990 0x7ff49c146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff49affd700 1 -- 172.21.15.133:0/2353210913 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368463350 0 0) 0x7ff49c1467f0 con 0x7ff49c0b7ab0 2021-01-03T13:05:12.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff49affd700 1 -- 172.21.15.133:0/2353210913 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff488003230 con 0x7ff49c0b7ab0 2021-01-03T13:05:12.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff4a0fa2700 1 -- 172.21.15.133:0/2353210913 >> v2:172.21.15.16:3300/0 conn(0x7ff49c0b2990 msgr2=0x7ff49c146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:12.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff4a0fa2700 1 --2- 172.21.15.133:0/2353210913 >> v2:172.21.15.16:3300/0 conn(0x7ff49c0b2990 0x7ff49c146300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff4a0fa2700 1 -- 172.21.15.133:0/2353210913 >> v1:172.21.15.133:6789/0 conn(0x7ff49c0b7ab0 legacy=0x7ff49c0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff4a0fa2700 1 -- 172.21.15.133:0/2353210913 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c061720 con 0x7ff49c0b34e0 2021-01-03T13:05:12.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff4a0fa2700 1 --2- 172.21.15.133:0/2353210913 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff49c0b34e0 0x7ff49c140060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7ff4940032b0 tx=0x7ff4940091a0).ready entity=mon.2 client_cookie=5aa1649ec925d686 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:12.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff49affd700 1 -- 172.21.15.133:0/2353210913 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff49400b940 con 0x7ff49c0b34e0 2021-01-03T13:05:12.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff49affd700 1 -- 172.21.15.133:0/2353210913 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49400baa0 con 0x7ff49c0b34e0 2021-01-03T13:05:12.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff49affd700 1 -- 172.21.15.133:0/2353210913 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff49400bc10 con 0x7ff49c0b34e0 2021-01-03T13:05:12.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff4a17a3700 1 -- 172.21.15.133:0/2353210913 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff49c0b34e0 msgr2=0x7ff49c140060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.386+0000 7ff4a17a3700 1 --2- 172.21.15.133:0/2353210913 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff49c0b34e0 0x7ff49c140060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7ff4940032b0 tx=0x7ff4940091a0).stop 2021-01-03T13:05:12.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.390+0000 7ff4a17a3700 1 -- 172.21.15.133:0/2353210913 shutdown_connections 2021-01-03T13:05:12.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.390+0000 7ff4a17a3700 1 --2- 172.21.15.133:0/2353210913 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff49c0b34e0 0x7ff49c140060 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.390+0000 7ff4a17a3700 1 --2- 172.21.15.133:0/2353210913 >> v2:172.21.15.16:3300/0 conn(0x7ff49c0b2990 0x7ff49c146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.390+0000 7ff4a17a3700 1 -- 172.21.15.133:0/2353210913 >> 172.21.15.133:0/2353210913 conn(0x7ff49c05c8c0 msgr2=0x7ff49c0b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:12.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.390+0000 7ff4a17a3700 1 -- 172.21.15.133:0/2353210913 shutdown_connections 2021-01-03T13:05:12.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.390+0000 7ff4a17a3700 1 -- 172.21.15.133:0/2353210913 wait complete. 2021-01-03T13:05:12.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.390+0000 7ff4a17a3700 1 Processor -- start 2021-01-03T13:05:12.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.390+0000 7ff4a17a3700 1 -- start start 2021-01-03T13:05:12.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.390+0000 7ff4a17a3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff49c0b2990 0x7ff49c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.390+0000 7ff4a17a3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff49c0b34e0 0x7ff49c0af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.390+0000 7ff4a17a3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff49c0b7ab0 0x7ff49c0b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.390+0000 7ff4a17a3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c151ef0 con 0x7ff49c0b2990 2021-01-03T13:05:12.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.390+0000 7ff4a17a3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0aec10 con 0x7ff49c0b7ab0 2021-01-03T13:05:12.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.390+0000 7ff4a17a3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0af3a0 con 0x7ff49c0b34e0 2021-01-03T13:05:12.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff4a0fa2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff49c0b7ab0 0x7ff49c0b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff4a0fa2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff49c0b7ab0 0x7ff49c0b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36658/0 (socket says 172.21.15.133:36658) 2021-01-03T13:05:12.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff4a0fa2700 1 -- 172.21.15.133:0/3385725667 learned_addr learned my addr 172.21.15.133:0/3385725667 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:12.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff49b7fe700 1 --2- 172.21.15.133:0/3385725667 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff49c0b34e0 0x7ff49c0af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff49bfff700 1 --2- 172.21.15.133:0/3385725667 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff49c0b2990 0x7ff49c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff4a0fa2700 1 -- 172.21.15.133:0/3385725667 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff49c0b34e0 msgr2=0x7ff49c0af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff4a0fa2700 1 --2- 172.21.15.133:0/3385725667 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff49c0b34e0 0x7ff49c0af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff4a0fa2700 1 -- 172.21.15.133:0/3385725667 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff49c0b2990 msgr2=0x7ff49c151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff4a0fa2700 1 --2- 172.21.15.133:0/3385725667 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff49c0b2990 0x7ff49c151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff4a0fa2700 1 -- 172.21.15.133:0/3385725667 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c0ae700 con 0x7ff49c0b7ab0 2021-01-03T13:05:12.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff4a0fa2700 1 --2- 172.21.15.133:0/3385725667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff49c0b7ab0 0x7ff49c0b00d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7ff4940032b0 tx=0x7ff494016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:12.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff4997fa700 1 -- 172.21.15.133:0/3385725667 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff494011e60 con 0x7ff49c0b7ab0 2021-01-03T13:05:12.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff4a17a3700 1 -- 172.21.15.133:0/3385725667 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49c0b0cb0 con 0x7ff49c0b7ab0 2021-01-03T13:05:12.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff4997fa700 1 -- 172.21.15.133:0/3385725667 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49401f3f0 con 0x7ff49c0b7ab0 2021-01-03T13:05:12.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff4997fa700 1 -- 172.21.15.133:0/3385725667 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff49401f750 con 0x7ff49c0b7ab0 2021-01-03T13:05:12.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff4a17a3700 1 -- 172.21.15.133:0/3385725667 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49c0b05c0 con 0x7ff49c0b7ab0 2021-01-03T13:05:12.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff4a17a3700 1 -- 172.21.15.133:0/3385725667 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49c0af560 con 0x7ff49c0b7ab0 2021-01-03T13:05:12.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.394+0000 7ff4997fa700 1 -- 172.21.15.133:0/3385725667 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff494026030 con 0x7ff49c0b7ab0 2021-01-03T13:05:12.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.398+0000 7ff4997fa700 1 --2- 172.21.15.133:0/3385725667 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff47c0553b0 0x7ff47c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.398+0000 7ff4997fa700 1 -- 172.21.15.133:0/3385725667 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff49406ed00 con 0x7ff49c0b7ab0 2021-01-03T13:05:12.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.398+0000 7ff49bfff700 1 --2- 172.21.15.133:0/3385725667 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff47c0553b0 0x7ff47c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.398+0000 7ff49bfff700 1 --2- 172.21.15.133:0/3385725667 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff47c0553b0 0x7ff47c057870 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7ff48c00d000 tx=0x7ff48c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:12.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.402+0000 7ff4997fa700 1 -- 172.21.15.133:0/3385725667 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff494045000 con 0x7ff49c0b7ab0 2021-01-03T13:05:12.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.542+0000 7ff4a17a3700 1 -- 172.21.15.133:0/3385725667 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff49c057300 con 0x7ff49c0b7ab0 2021-01-03T13:05:12.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.542+0000 7ff4997fa700 1 -- 172.21.15.133:0/3385725667 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v90) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff494024070 con 0x7ff49c0b7ab0 2021-01-03T13:05:12.548 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:05:12.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.546+0000 7ff4a17a3700 1 -- 172.21.15.133:0/3385725667 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff47c0553b0 msgr2=0x7ff47c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.546+0000 7ff4a17a3700 1 --2- 172.21.15.133:0/3385725667 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff47c0553b0 0x7ff47c057870 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7ff48c00d000 tx=0x7ff48c009040).stop 2021-01-03T13:05:12.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.546+0000 7ff4a17a3700 1 -- 172.21.15.133:0/3385725667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff49c0b7ab0 msgr2=0x7ff49c0b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.546+0000 7ff4a17a3700 1 --2- 172.21.15.133:0/3385725667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff49c0b7ab0 0x7ff49c0b00d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7ff4940032b0 tx=0x7ff494016000).stop 2021-01-03T13:05:12.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.546+0000 7ff4a17a3700 1 -- 172.21.15.133:0/3385725667 shutdown_connections 2021-01-03T13:05:12.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.546+0000 7ff4a17a3700 1 --2- 172.21.15.133:0/3385725667 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff47c0553b0 0x7ff47c057870 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.546+0000 7ff4a17a3700 1 --2- 172.21.15.133:0/3385725667 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff49c0b2990 0x7ff49c151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.546+0000 7ff4a17a3700 1 --2- 172.21.15.133:0/3385725667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff49c0b7ab0 0x7ff49c0b00d0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.546+0000 7ff4a17a3700 1 --2- 172.21.15.133:0/3385725667 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff49c0b34e0 0x7ff49c0af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.546+0000 7ff4a17a3700 1 -- 172.21.15.133:0/3385725667 >> 172.21.15.133:0/3385725667 conn(0x7ff49c05c8c0 msgr2=0x7ff49c0b6440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:12.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.546+0000 7ff4a17a3700 1 -- 172.21.15.133:0/3385725667 shutdown_connections 2021-01-03T13:05:12.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.546+0000 7ff4a17a3700 1 -- 172.21.15.133:0/3385725667 wait complete. 2021-01-03T13:05:12.561 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:05:12.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.674+0000 7f6a86554700 1 Processor -- start 2021-01-03T13:05:12.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.674+0000 7f6a86554700 1 -- start start 2021-01-03T13:05:12.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a86554700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a80066f30 0x7f6a800b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a86554700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8005fd00 con 0x7f6a800b1590 2021-01-03T13:05:12.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a86554700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a800accd0 con 0x7f6a8005f920 2021-01-03T13:05:12.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a86554700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a800b2980 con 0x7f6a80066f30 2021-01-03T13:05:12.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a85552700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6a8005f920 0x7f6a800b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57694/0 (socket says 172.21.15.133:57694) 2021-01-03T13:05:12.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a85552700 1 -- 172.21.15.133:0/2664740833 learned_addr learned my addr 172.21.15.133:0/2664740833 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:12.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a84d51700 1 --2- 172.21.15.133:0/2664740833 >> v2:172.21.15.133:3300/0 conn(0x7f6a80066f30 0x7f6a800b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a77fff700 1 -- 172.21.15.133:0/2664740833 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856222599 0 0) 0x7f6a800accd0 con 0x7f6a8005f920 2021-01-03T13:05:12.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a77fff700 1 -- 172.21.15.133:0/2664740833 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a64003230 con 0x7f6a8005f920 2021-01-03T13:05:12.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a84d51700 1 -- 172.21.15.133:0/2664740833 >> v1:172.21.15.133:6789/0 conn(0x7f6a8005f920 legacy=0x7f6a800b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a84d51700 1 -- 172.21.15.133:0/2664740833 >> v1:172.21.15.16:6789/0 conn(0x7f6a800b1590 legacy=0x7f6a8013ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a77fff700 1 -- 172.21.15.133:0/2664740833 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404800644 0 0) 0x7f6a8005fd00 con 0x7f6a800b1590 2021-01-03T13:05:12.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a84d51700 1 -- 172.21.15.133:0/2664740833 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a800acf70 con 0x7f6a80066f30 2021-01-03T13:05:12.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a84d51700 1 --2- 172.21.15.133:0/2664740833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a80066f30 0x7f6a800b0ab0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f6a70002f30 tx=0x7f6a70006dc0).ready entity=mon.1 client_cookie=54c1886e88c358fa server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:12.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a77fff700 1 -- 172.21.15.133:0/2664740833 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a70009800 con 0x7f6a80066f30 2021-01-03T13:05:12.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a77fff700 1 -- 172.21.15.133:0/2664740833 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a70009960 con 0x7f6a80066f30 2021-01-03T13:05:12.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a77fff700 1 -- 172.21.15.133:0/2664740833 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a70009cc0 con 0x7f6a80066f30 2021-01-03T13:05:12.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a86554700 1 -- 172.21.15.133:0/2664740833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a80066f30 msgr2=0x7f6a800b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a86554700 1 --2- 172.21.15.133:0/2664740833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a80066f30 0x7f6a800b0ab0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f6a70002f30 tx=0x7f6a70006dc0).stop 2021-01-03T13:05:12.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a86554700 1 -- 172.21.15.133:0/2664740833 shutdown_connections 2021-01-03T13:05:12.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a86554700 1 --2- 172.21.15.133:0/2664740833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a80066f30 0x7f6a800b0ab0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a86554700 1 -- 172.21.15.133:0/2664740833 >> 172.21.15.133:0/2664740833 conn(0x7f6a800b6110 msgr2=0x7f6a800b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:12.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a86554700 1 -- 172.21.15.133:0/2664740833 shutdown_connections 2021-01-03T13:05:12.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.678+0000 7f6a86554700 1 -- 172.21.15.133:0/2664740833 wait complete. 2021-01-03T13:05:12.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a86554700 1 Processor -- start 2021-01-03T13:05:12.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a86554700 1 -- start start 2021-01-03T13:05:12.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a86554700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a8005f920 0x7f6a80064b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a86554700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a80066f30 0x7f6a80151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a86554700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a800b1590 0x7f6a801522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a86554700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8014f7a0 con 0x7f6a8005f920 2021-01-03T13:05:12.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a86554700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8014f500 con 0x7f6a80066f30 2021-01-03T13:05:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a86554700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800a32b0 con 0x7f6a800b1590 2021-01-03T13:05:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a84d51700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a80066f30 0x7f6a80151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a84d51700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a80066f30 0x7f6a80151db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36670/0 (socket says 172.21.15.133:36670) 2021-01-03T13:05:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a84d51700 1 -- 172.21.15.133:0/2521179274 learned_addr learned my addr 172.21.15.133:0/2521179274 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a85552700 1 --2- 172.21.15.133:0/2521179274 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a8005f920 0x7f6a80064b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a85d53700 1 --2- 172.21.15.133:0/2521179274 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a800b1590 0x7f6a801522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a84d51700 1 -- 172.21.15.133:0/2521179274 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a800b1590 msgr2=0x7f6a801522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a84d51700 1 --2- 172.21.15.133:0/2521179274 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a800b1590 0x7f6a801522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a84d51700 1 -- 172.21.15.133:0/2521179274 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a8005f920 msgr2=0x7f6a80064b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a84d51700 1 --2- 172.21.15.133:0/2521179274 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a8005f920 0x7f6a80064b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a84d51700 1 -- 172.21.15.133:0/2521179274 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a800a3550 con 0x7f6a80066f30 2021-01-03T13:05:12.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.682+0000 7f6a84d51700 1 --2- 172.21.15.133:0/2521179274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a80066f30 0x7f6a80151db0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f6a70002f30 tx=0x7f6a70015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:12.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.686+0000 7f6a767fc700 1 -- 172.21.15.133:0/2521179274 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a70011bb0 con 0x7f6a80066f30 2021-01-03T13:05:12.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.686+0000 7f6a767fc700 1 -- 172.21.15.133:0/2521179274 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a70011d10 con 0x7f6a80066f30 2021-01-03T13:05:12.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.686+0000 7f6a86554700 1 -- 172.21.15.133:0/2521179274 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8014f220 con 0x7f6a80066f30 2021-01-03T13:05:12.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.686+0000 7f6a767fc700 1 -- 172.21.15.133:0/2521179274 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a7001d640 con 0x7f6a80066f30 2021-01-03T13:05:12.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.686+0000 7f6a86554700 1 -- 172.21.15.133:0/2521179274 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a80143360 con 0x7f6a80066f30 2021-01-03T13:05:12.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.686+0000 7f6a86554700 1 -- 172.21.15.133:0/2521179274 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a800a36e0 con 0x7f6a80066f30 2021-01-03T13:05:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.686+0000 7f6a767fc700 1 -- 172.21.15.133:0/2521179274 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6a7000f070 con 0x7f6a80066f30 2021-01-03T13:05:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.686+0000 7f6a767fc700 1 --2- 172.21.15.133:0/2521179274 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a68055440 0x7f6a68057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.686+0000 7f6a85552700 1 --2- 172.21.15.133:0/2521179274 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a68055440 0x7f6a68057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.686+0000 7f6a767fc700 1 -- 172.21.15.133:0/2521179274 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6a7006fab0 con 0x7f6a80066f30 2021-01-03T13:05:12.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.690+0000 7f6a85552700 1 --2- 172.21.15.133:0/2521179274 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a68055440 0x7f6a68057900 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f6a7c00d000 tx=0x7f6a7c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:12.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.694+0000 7f6a767fc700 1 -- 172.21.15.133:0/2521179274 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6a70045ce0 con 0x7f6a80066f30 2021-01-03T13:05:12.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.834+0000 7f6a86554700 1 -- 172.21.15.133:0/2521179274 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6a80057300 con 0x7f6a80066f30 2021-01-03T13:05:12.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.838+0000 7f6a767fc700 1 -- 172.21.15.133:0/2521179274 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v90) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6a700492c0 con 0x7f6a80066f30 2021-01-03T13:05:12.842 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:05:12.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.842+0000 7f6a86554700 1 -- 172.21.15.133:0/2521179274 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a68055440 msgr2=0x7f6a68057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.842+0000 7f6a86554700 1 --2- 172.21.15.133:0/2521179274 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a68055440 0x7f6a68057900 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f6a7c00d000 tx=0x7f6a7c009040).stop 2021-01-03T13:05:12.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.842+0000 7f6a86554700 1 -- 172.21.15.133:0/2521179274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a80066f30 msgr2=0x7f6a80151db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.842+0000 7f6a86554700 1 --2- 172.21.15.133:0/2521179274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a80066f30 0x7f6a80151db0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f6a70002f30 tx=0x7f6a70015000).stop 2021-01-03T13:05:12.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.842+0000 7f6a86554700 1 -- 172.21.15.133:0/2521179274 shutdown_connections 2021-01-03T13:05:12.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.842+0000 7f6a86554700 1 --2- 172.21.15.133:0/2521179274 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a68055440 0x7f6a68057900 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.842+0000 7f6a86554700 1 --2- 172.21.15.133:0/2521179274 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a8005f920 0x7f6a80064b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.842+0000 7f6a86554700 1 --2- 172.21.15.133:0/2521179274 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a800b1590 0x7f6a801522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.842+0000 7f6a86554700 1 --2- 172.21.15.133:0/2521179274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a80066f30 0x7f6a80151db0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.842+0000 7f6a86554700 1 -- 172.21.15.133:0/2521179274 >> 172.21.15.133:0/2521179274 conn(0x7f6a800b6110 msgr2=0x7f6a800b09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:12.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.842+0000 7f6a86554700 1 -- 172.21.15.133:0/2521179274 shutdown_connections 2021-01-03T13:05:12.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.842+0000 7f6a86554700 1 -- 172.21.15.133:0/2521179274 wait complete. 2021-01-03T13:05:12.864 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:05:12.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1909b55700 1 Processor -- start 2021-01-03T13:05:12.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1909b55700 1 -- start start 2021-01-03T13:05:12.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1909b55700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19040b5330 0x7f1904141630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1909b55700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1904144930 0x7f19040af310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1909b55700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19040b5710 con 0x7f19040b5ae0 2021-01-03T13:05:12.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1909b55700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19040b16b0 con 0x7f1904144930 2021-01-03T13:05:12.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1909b55700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1904140a60 con 0x7f19040b5330 2021-01-03T13:05:12.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1903fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f19040b5ae0 0x7f19040aec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57708/0 (socket says 172.21.15.133:57708) 2021-01-03T13:05:12.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1903fff700 1 -- 172.21.15.133:0/3960619358 learned_addr learned my addr 172.21.15.133:0/3960619358 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:12.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1908b53700 1 --2- 172.21.15.133:0/3960619358 >> v2:172.21.15.133:3300/0 conn(0x7f19040b5330 0x7f1904141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1909354700 1 --2- 172.21.15.133:0/3960619358 >> v2:172.21.15.16:3300/0 conn(0x7f1904144930 0x7f19040af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f19037fe700 1 -- 172.21.15.133:0/3960619358 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485621340 0 0) 0x7f19040b5710 con 0x7f19040b5ae0 2021-01-03T13:05:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f19037fe700 1 -- 172.21.15.133:0/3960619358 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18e4003230 con 0x7f19040b5ae0 2021-01-03T13:05:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1908b53700 1 -- 172.21.15.133:0/3960619358 >> v2:172.21.15.16:3300/0 conn(0x7f1904144930 msgr2=0x7f19040af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1908b53700 1 --2- 172.21.15.133:0/3960619358 >> v2:172.21.15.16:3300/0 conn(0x7f1904144930 0x7f19040af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1908b53700 1 -- 172.21.15.133:0/3960619358 >> v1:172.21.15.133:6789/0 conn(0x7f19040b5ae0 legacy=0x7f19040aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1908b53700 1 -- 172.21.15.133:0/3960619358 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1904140c50 con 0x7f19040b5330 2021-01-03T13:05:12.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1908b53700 1 --2- 172.21.15.133:0/3960619358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19040b5330 0x7f1904141630 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f18f4002f30 tx=0x7f18f4006dc0).ready entity=mon.1 client_cookie=ff3bfa7ef8893da7 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:12.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f19037fe700 1 -- 172.21.15.133:0/3960619358 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18f40097b0 con 0x7f19040b5330 2021-01-03T13:05:12.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f19037fe700 1 -- 172.21.15.133:0/3960619358 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f4009910 con 0x7f19040b5330 2021-01-03T13:05:12.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f19037fe700 1 -- 172.21.15.133:0/3960619358 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18f4009c70 con 0x7f19040b5330 2021-01-03T13:05:12.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1909b55700 1 -- 172.21.15.133:0/3960619358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19040b5330 msgr2=0x7f1904141630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:12.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.978+0000 7f1909b55700 1 --2- 172.21.15.133:0/3960619358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19040b5330 0x7f1904141630 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f18f4002f30 tx=0x7f18f4006dc0).stop 2021-01-03T13:05:12.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1909b55700 1 -- 172.21.15.133:0/3960619358 shutdown_connections 2021-01-03T13:05:12.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1909b55700 1 --2- 172.21.15.133:0/3960619358 >> v2:172.21.15.16:3300/0 conn(0x7f1904144930 0x7f19040af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1909b55700 1 --2- 172.21.15.133:0/3960619358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19040b5330 0x7f1904141630 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:12.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1909b55700 1 -- 172.21.15.133:0/3960619358 >> 172.21.15.133:0/3960619358 conn(0x7f190405bdf0 msgr2=0x7f190405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:12.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1909b55700 1 -- 172.21.15.133:0/3960619358 shutdown_connections 2021-01-03T13:05:12.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1909b55700 1 -- 172.21.15.133:0/3960619358 wait complete. 2021-01-03T13:05:12.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1909b55700 1 Processor -- start 2021-01-03T13:05:12.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1909b55700 1 -- start start 2021-01-03T13:05:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1909b55700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f19040b5330 0x7f1904064e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1909b55700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19040b5ae0 0x7f1904155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1909b55700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904144930 0x7f19041557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1909b55700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1904155ce0 con 0x7f19040b5ae0 2021-01-03T13:05:12.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1909b55700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1904065e90 con 0x7f1904144930 2021-01-03T13:05:12.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1909b55700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f190413c130 con 0x7f19040b5330 2021-01-03T13:05:12.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1909354700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904144930 0x7f19041557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:12.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1909354700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904144930 0x7f19041557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36686/0 (socket says 172.21.15.133:36686) 2021-01-03T13:05:12.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1909354700 1 -- 172.21.15.133:0/2300071734 learned_addr learned my addr 172.21.15.133:0/2300071734 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:13.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.982+0000 7f1903fff700 1 --2- 172.21.15.133:0/2300071734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19040b5ae0 0x7f1904155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:13.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1909354700 1 -- 172.21.15.133:0/2300071734 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f19040b5330 msgr2=0x7f1904064e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:13.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1908b53700 1 --2- 172.21.15.133:0/2300071734 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f19040b5330 0x7f1904064e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:13.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1909354700 1 --2- 172.21.15.133:0/2300071734 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f19040b5330 0x7f1904064e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1909354700 1 -- 172.21.15.133:0/2300071734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19040b5ae0 msgr2=0x7f1904155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:13.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1909354700 1 --2- 172.21.15.133:0/2300071734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19040b5ae0 0x7f1904155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1909354700 1 -- 172.21.15.133:0/2300071734 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19040660c0 con 0x7f1904144930 2021-01-03T13:05:13.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1908b53700 1 --2- 172.21.15.133:0/2300071734 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f19040b5330 0x7f1904064e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:13.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1909354700 1 --2- 172.21.15.133:0/2300071734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904144930 0x7f19041557f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f1904155e20 tx=0x7f18fc008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:13.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1901ffb700 1 -- 172.21.15.133:0/2300071734 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18fc00ba70 con 0x7f1904144930 2021-01-03T13:05:13.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1901ffb700 1 -- 172.21.15.133:0/2300071734 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18fc00bbd0 con 0x7f1904144930 2021-01-03T13:05:13.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1909b55700 1 -- 172.21.15.133:0/2300071734 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f190413c390 con 0x7f1904144930 2021-01-03T13:05:13.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1901ffb700 1 -- 172.21.15.133:0/2300071734 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18fc012420 con 0x7f1904144930 2021-01-03T13:05:13.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1909b55700 1 -- 172.21.15.133:0/2300071734 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1904066dd0 con 0x7f1904144930 2021-01-03T13:05:13.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1901ffb700 1 -- 172.21.15.133:0/2300071734 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f18fc012580 con 0x7f1904144930 2021-01-03T13:05:13.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1909b55700 1 -- 172.21.15.133:0/2300071734 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1904057300 con 0x7f1904144930 2021-01-03T13:05:13.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1901ffb700 1 --2- 172.21.15.133:0/2300071734 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18e8055350 0x7f18e8057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:13.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1901ffb700 1 -- 172.21.15.133:0/2300071734 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f18fc06e5c0 con 0x7f1904144930 2021-01-03T13:05:13.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1908b53700 1 --2- 172.21.15.133:0/2300071734 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18e8055350 0x7f18e8057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:13.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.986+0000 7f1908b53700 1 --2- 172.21.15.133:0/2300071734 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18e8055350 0x7f18e8057810 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f18f4007000 tx=0x7f18f4015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:13.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:12.994+0000 7f1901ffb700 1 -- 172.21.15.133:0/2300071734 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f18fc044860 con 0x7f1904144930 2021-01-03T13:05:13.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.134+0000 7f1909b55700 1 -- 172.21.15.133:0/2300071734 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f190406b110 con 0x7f1904144930 2021-01-03T13:05:13.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.134+0000 7f1901ffb700 1 -- 172.21.15.133:0/2300071734 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+10 (secure 0 0 0) 0x7f18fc047e80 con 0x7f1904144930 2021-01-03T13:05:13.140 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:05:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.138+0000 7f1909b55700 1 -- 172.21.15.133:0/2300071734 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18e8055350 msgr2=0x7f18e8057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.138+0000 7f1909b55700 1 --2- 172.21.15.133:0/2300071734 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18e8055350 0x7f18e8057810 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f18f4007000 tx=0x7f18f4015000).stop 2021-01-03T13:05:13.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.138+0000 7f1909b55700 1 -- 172.21.15.133:0/2300071734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904144930 msgr2=0x7f19041557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:13.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.138+0000 7f1909b55700 1 --2- 172.21.15.133:0/2300071734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904144930 0x7f19041557f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f1904155e20 tx=0x7f18fc008040).stop 2021-01-03T13:05:13.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.138+0000 7f1909b55700 1 -- 172.21.15.133:0/2300071734 shutdown_connections 2021-01-03T13:05:13.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.138+0000 7f1909b55700 1 --2- 172.21.15.133:0/2300071734 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18e8055350 0x7f18e8057810 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.138+0000 7f1909b55700 1 --2- 172.21.15.133:0/2300071734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904144930 0x7f19041557f0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.138+0000 7f1909b55700 1 --2- 172.21.15.133:0/2300071734 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f19040b5330 0x7f1904064e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.138+0000 7f1909b55700 1 --2- 172.21.15.133:0/2300071734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19040b5ae0 0x7f1904155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.138+0000 7f1909b55700 1 -- 172.21.15.133:0/2300071734 >> 172.21.15.133:0/2300071734 conn(0x7f190405bdf0 msgr2=0x7f19040b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:13.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.138+0000 7f1909b55700 1 -- 172.21.15.133:0/2300071734 shutdown_connections 2021-01-03T13:05:13.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.138+0000 7f1909b55700 1 -- 172.21.15.133:0/2300071734 wait complete. 2021-01-03T13:05:13.157 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:05:13.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689f59e700 1 Processor -- start 2021-01-03T13:05:13.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689f59e700 1 -- start start 2021-01-03T13:05:13.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689f59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f68a00b5260 0x7f68a01470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:13.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689f59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f68a00b5c00 0x7f68a01475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:13.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689f59e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a00b0c10 con 0x7f68a01442a0 2021-01-03T13:05:13.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689f59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a00b5640 con 0x7f68a00b5260 2021-01-03T13:05:13.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689f59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a009a4f0 con 0x7f68a00b5c00 2021-01-03T13:05:13.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689e59c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f68a00b5260 0x7f68a01470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:13.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689dd9b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f68a00b5c00 0x7f68a01475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:13.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689e59c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f68a00b5260 0x7f68a01470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:35230/0 (socket says 172.21.15.133:35230) 2021-01-03T13:05:13.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689dd9b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f68a00b5c00 0x7f68a01475a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:44994/0 (socket says 172.21.15.133:44994) 2021-01-03T13:05:13.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689e59c700 1 -- 172.21.15.133:0/1791412625 learned_addr learned my addr 172.21.15.133:0/1791412625 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:13.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689dd9b700 1 -- 172.21.15.133:0/1791412625 >> v2:172.21.15.16:3300/0 conn(0x7f68a00b5260 msgr2=0x7f68a01470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:13.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689dd9b700 1 --2- 172.21.15.133:0/1791412625 >> v2:172.21.15.16:3300/0 conn(0x7f68a00b5260 0x7f68a01470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689dd9b700 1 -- 172.21.15.133:0/1791412625 >> v1:172.21.15.16:6789/0 conn(0x7f68a01442a0 legacy=0x7f68a0144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:13.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689dd9b700 1 -- 172.21.15.133:0/1791412625 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a00b0e40 con 0x7f68a00b5c00 2021-01-03T13:05:13.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689dd9b700 1 --2- 172.21.15.133:0/1791412625 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f68a00b5c00 0x7f68a01475a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f6894002f30 tx=0x7f6894006dc0).ready entity=mon.2 client_cookie=a923145c5791b146 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:13.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689d59a700 1 -- 172.21.15.133:0/1791412625 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6894009760 con 0x7f68a00b5c00 2021-01-03T13:05:13.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689d59a700 1 -- 172.21.15.133:0/1791412625 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68940098c0 con 0x7f68a00b5c00 2021-01-03T13:05:13.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689d59a700 1 -- 172.21.15.133:0/1791412625 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6894009c20 con 0x7f68a00b5c00 2021-01-03T13:05:13.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689f59e700 1 -- 172.21.15.133:0/1791412625 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f68a00b5c00 msgr2=0x7f68a01475a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:13.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689f59e700 1 --2- 172.21.15.133:0/1791412625 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f68a00b5c00 0x7f68a01475a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f6894002f30 tx=0x7f6894006dc0).stop 2021-01-03T13:05:13.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689f59e700 1 -- 172.21.15.133:0/1791412625 shutdown_connections 2021-01-03T13:05:13.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689f59e700 1 --2- 172.21.15.133:0/1791412625 >> v2:172.21.15.16:3300/0 conn(0x7f68a00b5260 0x7f68a01470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689f59e700 1 --2- 172.21.15.133:0/1791412625 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f68a00b5c00 0x7f68a01475a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689f59e700 1 -- 172.21.15.133:0/1791412625 >> 172.21.15.133:0/1791412625 conn(0x7f68a005bdf0 msgr2=0x7f68a005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:13.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689f59e700 1 -- 172.21.15.133:0/1791412625 shutdown_connections 2021-01-03T13:05:13.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.270+0000 7f689f59e700 1 -- 172.21.15.133:0/1791412625 wait complete. 2021-01-03T13:05:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689f59e700 1 Processor -- start 2021-01-03T13:05:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689f59e700 1 -- start start 2021-01-03T13:05:13.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a00b5260 0x7f68a0142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:13.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689f59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68a00b5c00 0x7f68a0155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:13.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689f59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f68a01442a0 0x7f68a01562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:13.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689f59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a01404c0 con 0x7f68a00b5c00 2021-01-03T13:05:13.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a0140760 con 0x7f68a00b5260 2021-01-03T13:05:13.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689f59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a0140a00 con 0x7f68a01442a0 2021-01-03T13:05:13.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a00b5260 0x7f68a0142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:13.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a00b5260 0x7f68a0142ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36696/0 (socket says 172.21.15.133:36696) 2021-01-03T13:05:13.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689e59c700 1 -- 172.21.15.133:0/351636066 learned_addr learned my addr 172.21.15.133:0/351636066 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:13.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689dd9b700 1 --2- 172.21.15.133:0/351636066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68a00b5c00 0x7f68a0155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:13.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689ed9d700 1 --2- 172.21.15.133:0/351636066 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f68a01442a0 0x7f68a01562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:13.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689e59c700 1 -- 172.21.15.133:0/351636066 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f68a01442a0 msgr2=0x7f68a01562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:13.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689e59c700 1 --2- 172.21.15.133:0/351636066 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f68a01442a0 0x7f68a01562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689e59c700 1 -- 172.21.15.133:0/351636066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68a00b5c00 msgr2=0x7f68a0155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:13.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689e59c700 1 --2- 172.21.15.133:0/351636066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68a00b5c00 0x7f68a0155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689e59c700 1 -- 172.21.15.133:0/351636066 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a01433c0 con 0x7f68a00b5260 2021-01-03T13:05:13.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689ed9d700 1 --2- 172.21.15.133:0/351636066 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f68a01442a0 0x7f68a01562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:13.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689dd9b700 1 --2- 172.21.15.133:0/351636066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68a00b5c00 0x7f68a0155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:13.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689e59c700 1 --2- 172.21.15.133:0/351636066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a00b5260 0x7f68a0142ed0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f689000c000 tx=0x7f6890008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:13.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f688f7fe700 1 -- 172.21.15.133:0/351636066 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f689000c820 con 0x7f68a00b5260 2021-01-03T13:05:13.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f688f7fe700 1 -- 172.21.15.133:0/351636066 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689000c980 con 0x7f68a00b5260 2021-01-03T13:05:13.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f688f7fe700 1 -- 172.21.15.133:0/351636066 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f689000cce0 con 0x7f68a00b5260 2021-01-03T13:05:13.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689f59e700 1 -- 172.21.15.133:0/351636066 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a01418a0 con 0x7f68a00b5260 2021-01-03T13:05:13.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.274+0000 7f689f59e700 1 -- 172.21.15.133:0/351636066 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a01468d0 con 0x7f68a00b5260 2021-01-03T13:05:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.278+0000 7f689f59e700 1 -- 172.21.15.133:0/351636066 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a0140bc0 con 0x7f68a00b5260 2021-01-03T13:05:13.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.278+0000 7f688f7fe700 1 -- 172.21.15.133:0/351636066 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6890022070 con 0x7f68a00b5260 2021-01-03T13:05:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.278+0000 7f688f7fe700 1 --2- 172.21.15.133:0/351636066 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f687c055470 0x7f687c057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.278+0000 7f688f7fe700 1 -- 172.21.15.133:0/351636066 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f689006e400 con 0x7f68a00b5260 2021-01-03T13:05:13.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.278+0000 7f689dd9b700 1 --2- 172.21.15.133:0/351636066 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f687c055470 0x7f687c057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:13.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.278+0000 7f689dd9b700 1 --2- 172.21.15.133:0/351636066 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f687c055470 0x7f687c057930 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f6894018000 tx=0x7f6894015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:13.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.282+0000 7f688f7fe700 1 -- 172.21.15.133:0/351636066 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f68900445f0 con 0x7f68a00b5260 2021-01-03T13:05:13.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.426+0000 7f689f59e700 1 -- 172.21.15.133:0/351636066 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f68a0057300 con 0x7f68a00b5260 2021-01-03T13:05:13.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.426+0000 7f688f7fe700 1 -- 172.21.15.133:0/351636066 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+10 (secure 0 0 0) 0x7f6890047c10 con 0x7f68a00b5260 2021-01-03T13:05:13.431 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:05:13.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.430+0000 7f689f59e700 1 -- 172.21.15.133:0/351636066 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f687c055470 msgr2=0x7f687c057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:13.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.430+0000 7f689f59e700 1 --2- 172.21.15.133:0/351636066 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f687c055470 0x7f687c057930 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f6894018000 tx=0x7f6894015000).stop 2021-01-03T13:05:13.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.430+0000 7f689f59e700 1 -- 172.21.15.133:0/351636066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a00b5260 msgr2=0x7f68a0142ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:13.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.430+0000 7f689f59e700 1 --2- 172.21.15.133:0/351636066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a00b5260 0x7f68a0142ed0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f689000c000 tx=0x7f6890008040).stop 2021-01-03T13:05:13.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.430+0000 7f689f59e700 1 -- 172.21.15.133:0/351636066 shutdown_connections 2021-01-03T13:05:13.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.430+0000 7f689f59e700 1 --2- 172.21.15.133:0/351636066 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f687c055470 0x7f687c057930 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.430+0000 7f689f59e700 1 --2- 172.21.15.133:0/351636066 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f68a01442a0 0x7f68a01562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.430+0000 7f689f59e700 1 --2- 172.21.15.133:0/351636066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68a00b5260 0x7f68a0142ed0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.430+0000 7f689f59e700 1 --2- 172.21.15.133:0/351636066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68a00b5c00 0x7f68a0155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.430+0000 7f689f59e700 1 -- 172.21.15.133:0/351636066 >> 172.21.15.133:0/351636066 conn(0x7f68a005bdf0 msgr2=0x7f68a00b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:13.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.430+0000 7f689f59e700 1 -- 172.21.15.133:0/351636066 shutdown_connections 2021-01-03T13:05:13.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.430+0000 7f689f59e700 1 -- 172.21.15.133:0/351636066 wait complete. 2021-01-03T13:05:13.452 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:05:13.452 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:05:13.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.558+0000 7f82c3142700 1 Processor -- start 2021-01-03T13:05:13.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.558+0000 7f82c3142700 1 -- start start 2021-01-03T13:05:13.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.558+0000 7f82c3142700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82bc0b9b60 0x7f82bc0b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:13.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.558+0000 7f82c3142700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82bc0605f0 con 0x7f82bc0b4de0 2021-01-03T13:05:13.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.558+0000 7f82c3142700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82bc0600b0 con 0x7f82bc0b4980 2021-01-03T13:05:13.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.558+0000 7f82c3142700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc0aed30 con 0x7f82bc0b9b60 2021-01-03T13:05:13.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.558+0000 7f82c193f700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f82bc0b4980 0x7f82bc146430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57736/0 (socket says 172.21.15.133:57736) 2021-01-03T13:05:13.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.558+0000 7f82c193f700 1 -- 172.21.15.133:0/2399816147 learned_addr learned my addr 172.21.15.133:0/2399816147 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:13.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c2140700 1 --2- 172.21.15.133:0/2399816147 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82bc0b9b60 0x7f82bc0b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:13.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c113e700 1 -- 172.21.15.133:0/2399816147 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728177296 0 0) 0x7f82bc0600b0 con 0x7f82bc0b4980 2021-01-03T13:05:13.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c113e700 1 -- 172.21.15.133:0/2399816147 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82a4003230 con 0x7f82bc0b4980 2021-01-03T13:05:13.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c113e700 1 -- 172.21.15.133:0/2399816147 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406807204 0 0) 0x7f82bc0605f0 con 0x7f82bc0b4de0 2021-01-03T13:05:13.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c113e700 1 -- 172.21.15.133:0/2399816147 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82bc0600b0 con 0x7f82bc0b4de0 2021-01-03T13:05:13.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c2140700 1 -- 172.21.15.133:0/2399816147 >> v1:172.21.15.133:6789/0 conn(0x7f82bc0b4980 legacy=0x7f82bc146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:13.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c113e700 1 -- 172.21.15.133:0/2399816147 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 506432187 0 0) 0x7f82a4003230 con 0x7f82bc0b4980 2021-01-03T13:05:13.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c2140700 1 -- 172.21.15.133:0/2399816147 >> v1:172.21.15.16:6789/0 conn(0x7f82bc0b4de0 legacy=0x7f82bc14d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:13.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c2140700 1 -- 172.21.15.133:0/2399816147 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc060350 con 0x7f82bc0b9b60 2021-01-03T13:05:13.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c2140700 1 --2- 172.21.15.133:0/2399816147 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82bc0b9b60 0x7f82bc0b9f40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f82ac002f30 tx=0x7f82ac006dc0).ready entity=mon.2 client_cookie=70bfbbc93485deff server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:13.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c113e700 1 -- 172.21.15.133:0/2399816147 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82ac009730 con 0x7f82bc0b9b60 2021-01-03T13:05:13.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c113e700 1 -- 172.21.15.133:0/2399816147 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac009890 con 0x7f82bc0b9b60 2021-01-03T13:05:13.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c113e700 1 -- 172.21.15.133:0/2399816147 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82ac009bf0 con 0x7f82bc0b9b60 2021-01-03T13:05:13.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c3142700 1 -- 172.21.15.133:0/2399816147 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82bc0b9b60 msgr2=0x7f82bc0b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:13.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c3142700 1 --2- 172.21.15.133:0/2399816147 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82bc0b9b60 0x7f82bc0b9f40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f82ac002f30 tx=0x7f82ac006dc0).stop 2021-01-03T13:05:13.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c3142700 1 -- 172.21.15.133:0/2399816147 shutdown_connections 2021-01-03T13:05:13.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c3142700 1 --2- 172.21.15.133:0/2399816147 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82bc0b9b60 0x7f82bc0b9f40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c3142700 1 -- 172.21.15.133:0/2399816147 >> 172.21.15.133:0/2399816147 conn(0x7f82bc0b69e0 msgr2=0x7f82bc0b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:13.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c3142700 1 -- 172.21.15.133:0/2399816147 shutdown_connections 2021-01-03T13:05:13.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c3142700 1 -- 172.21.15.133:0/2399816147 wait complete. 2021-01-03T13:05:13.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.562+0000 7f82c3142700 1 Processor -- start 2021-01-03T13:05:13.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c3142700 1 -- start start 2021-01-03T13:05:13.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c3142700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82bc0b4980 0x7f82bc09f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:13.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c3142700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82bc0b4de0 0x7f82bc1451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:13.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c3142700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82bc0b9b60 0x7f82bc155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:13.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c3142700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc155e20 con 0x7f82bc0b4980 2021-01-03T13:05:13.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c3142700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc145ee0 con 0x7f82bc0b4de0 2021-01-03T13:05:13.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c3142700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc09c690 con 0x7f82bc0b9b60 2021-01-03T13:05:13.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c193f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82bc0b4de0 0x7f82bc1451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:13.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c193f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82bc0b4de0 0x7f82bc1451e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36710/0 (socket says 172.21.15.133:36710) 2021-01-03T13:05:13.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c193f700 1 -- 172.21.15.133:0/1350119515 learned_addr learned my addr 172.21.15.133:0/1350119515 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:13.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c193f700 1 -- 172.21.15.133:0/1350119515 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82bc0b9b60 msgr2=0x7f82bc155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:13.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c2140700 1 --2- 172.21.15.133:0/1350119515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82bc0b4980 0x7f82bc09f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:13.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c2941700 1 --2- 172.21.15.133:0/1350119515 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82bc0b9b60 0x7f82bc155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:13.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c193f700 1 --2- 172.21.15.133:0/1350119515 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82bc0b9b60 0x7f82bc155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c193f700 1 -- 172.21.15.133:0/1350119515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82bc0b4980 msgr2=0x7f82bc09f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:13.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c193f700 1 --2- 172.21.15.133:0/1350119515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82bc0b4980 0x7f82bc09f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c193f700 1 -- 172.21.15.133:0/1350119515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc09c930 con 0x7f82bc0b4de0 2021-01-03T13:05:13.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c2140700 1 --2- 172.21.15.133:0/1350119515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82bc0b4980 0x7f82bc09f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:13.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c2941700 1 --2- 172.21.15.133:0/1350119515 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82bc0b9b60 0x7f82bc155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:13.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c193f700 1 --2- 172.21.15.133:0/1350119515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82bc0b4de0 0x7f82bc1451e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f82bc09f140 tx=0x7f82b80017d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:13.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82ab7fe700 1 -- 172.21.15.133:0/1350119515 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82b8007170 con 0x7f82bc0b4de0 2021-01-03T13:05:13.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82ab7fe700 1 -- 172.21.15.133:0/1350119515 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b80072d0 con 0x7f82bc0b4de0 2021-01-03T13:05:13.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c3142700 1 -- 172.21.15.133:0/1350119515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82bc09cbd0 con 0x7f82bc0b4de0 2021-01-03T13:05:13.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82ab7fe700 1 -- 172.21.15.133:0/1350119515 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82b80048f0 con 0x7f82bc0b4de0 2021-01-03T13:05:13.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c3142700 1 -- 172.21.15.133:0/1350119515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82bc09ce90 con 0x7f82bc0b4de0 2021-01-03T13:05:13.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.566+0000 7f82c3142700 1 -- 172.21.15.133:0/1350119515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82bc057300 con 0x7f82bc0b4de0 2021-01-03T13:05:13.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.570+0000 7f82ab7fe700 1 -- 172.21.15.133:0/1350119515 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f82b8004a50 con 0x7f82bc0b4de0 2021-01-03T13:05:13.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.570+0000 7f82ab7fe700 1 --2- 172.21.15.133:0/1350119515 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f829c055440 0x7f829c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:13.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.570+0000 7f82ab7fe700 1 -- 172.21.15.133:0/1350119515 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f82b806dad0 con 0x7f82bc0b4de0 2021-01-03T13:05:13.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.570+0000 7f82c2140700 1 --2- 172.21.15.133:0/1350119515 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f829c055440 0x7f829c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:13.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.570+0000 7f82c2140700 1 --2- 172.21.15.133:0/1350119515 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f829c055440 0x7f829c057900 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f82ac016000 tx=0x7f82ac015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:13.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.574+0000 7f82ab7fe700 1 -- 172.21.15.133:0/1350119515 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f82b8043c40 con 0x7f82bc0b4de0 2021-01-03T13:05:13.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.758+0000 7f82c3142700 1 -- 172.21.15.133:0/1350119515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82bc09c240 con 0x7f82bc0b4de0 2021-01-03T13:05:13.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.758+0000 7f82ab7fe700 1 -- 172.21.15.133:0/1350119515 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f82b8047260 con 0x7f82bc0b4de0 2021-01-03T13:05:13.762 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:13.763 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":38,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6523,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3593206473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3593206473},{"type":"v1","addr":"172.21.15.133:6835","nonce":3593206473}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/328558863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":328558863},{"type":"v1","addr":"172.21.15.133:6837","nonce":328558863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:08.865621+0000","modified":"2021-01-03T13:05:09.868458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/420953895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":420953895},{"type":"v1","addr":"172.21.15.16:6833","nonce":420953895}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-01-03T13:05:13.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.758+0000 7f82c3142700 1 -- 172.21.15.133:0/1350119515 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f829c055440 msgr2=0x7f829c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:13.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.758+0000 7f82c3142700 1 --2- 172.21.15.133:0/1350119515 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f829c055440 0x7f829c057900 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f82ac016000 tx=0x7f82ac015000).stop 2021-01-03T13:05:13.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.758+0000 7f82c3142700 1 -- 172.21.15.133:0/1350119515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82bc0b4de0 msgr2=0x7f82bc1451e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:13.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.758+0000 7f82c3142700 1 --2- 172.21.15.133:0/1350119515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82bc0b4de0 0x7f82bc1451e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f82bc09f140 tx=0x7f82b80017d0).stop 2021-01-03T13:05:13.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.758+0000 7f82c3142700 1 -- 172.21.15.133:0/1350119515 shutdown_connections 2021-01-03T13:05:13.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.758+0000 7f82c3142700 1 --2- 172.21.15.133:0/1350119515 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f829c055440 0x7f829c057900 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.758+0000 7f82c3142700 1 --2- 172.21.15.133:0/1350119515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f82bc0b4980 0x7f82bc09f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.758+0000 7f82c3142700 1 --2- 172.21.15.133:0/1350119515 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f82bc0b9b60 0x7f82bc155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.758+0000 7f82c3142700 1 --2- 172.21.15.133:0/1350119515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82bc0b4de0 0x7f82bc1451e0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:13.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.758+0000 7f82c3142700 1 -- 172.21.15.133:0/1350119515 >> 172.21.15.133:0/1350119515 conn(0x7f82bc0b69e0 msgr2=0x7f82bc140a30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:13.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.762+0000 7f82c3142700 1 -- 172.21.15.133:0/1350119515 shutdown_connections 2021-01-03T13:05:13.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:13.762+0000 7f82c3142700 1 -- 172.21.15.133:0/1350119515 wait complete. 2021-01-03T13:05:13.767 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 38 2021-01-03T13:05:14.078 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:05:08.865621+0000', 'modified': '2021-01-03T13:05:09.868458+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6532}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6532': {'gid': 6532, 'name': 'b', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.16:6833/420953895', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6832', 'nonce': 420953895}, {'type': 'v1', 'addr': '172.21.15.16:6833', 'nonce': 420953895}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:05:14.079 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:05:14.080 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-01-03T13:05:14.213 INFO:teuthology.orchestra.run.smithi016.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":6532,"want_state":"up:active","state":"up:active","rank_uptime":5.3308982379999996,"mdsmap_epoch":38,"osdmap_epoch":90,"osdmap_epoch_barrier":89,"uptime":9.6016183569999995} 2021-01-03T13:05:14.214 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 6532, "mdsmap_epoch": 38, "osdmap_epoch": 90, "osdmap_epoch_barrier": 89, "rank_uptime": 5.330898238, "state": "up:active", "uptime": 9.601618357, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:05:14.215 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:05:14.215 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-01-03T13:05:14.216 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi007.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-01-03T13:05:14.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:14.217 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:14.227 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:05:14.288 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:05:14.854 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:05:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:05:14.871 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:05:14.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:14.872 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:05:14.919 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:05:14.920 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:14.965 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:05:14.981 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:05:14.982 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:05:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:05:15.038 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:05:15.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:15.039 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:05:15.042 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2021-01-03T13:05:15.040+0000 7f532766f0c0 -1 init, newargv = 0x5567bae24aa0 newargc=9 2021-01-03T13:05:15.042 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12361]: starting ceph client 2021-01-03T13:05:15.053 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12361]: starting fuse 2021-01-03T13:05:16.148 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:05:16.164 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:05:16.165 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:05:16.220 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:05:16.221 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:05:16.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:16.222 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:05:16.267 INFO:teuthology.orchestra.run.smithi007.stdout:50 2021-01-03T13:05:16.267 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:05:16.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:16.268 DEBUG:teuthology.orchestra.run.smithi007:> sudo python3 -c ' 2021-01-03T13:05:16.269 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2021-01-03T13:05:16.269 DEBUG:teuthology.orchestra.run.smithi007:> import re 2021-01-03T13:05:16.270 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:05:16.270 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2021-01-03T13:05:16.271 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:05:16.271 DEBUG:teuthology.orchestra.run.smithi007:> def find_socket(client_name): 2021-01-03T13:05:16.272 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-01-03T13:05:16.272 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2021-01-03T13:05:16.272 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:05:16.273 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2021-01-03T13:05:16.273 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2021-01-03T13:05:16.274 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2021-01-03T13:05:16.274 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2021-01-03T13:05:16.275 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:05:16.275 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2021-01-03T13:05:16.276 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:05:16.276 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:05:16.276 DEBUG:teuthology.orchestra.run.smithi007:> return f 2021-01-03T13:05:16.277 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:05:16.277 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:05:16.278 DEBUG:teuthology.orchestra.run.smithi007:> print(find_socket("client.0")) 2021-01-03T13:05:16.278 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:05:16.360 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.12361.asok 2021-01-03T13:05:16.365 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12361.asok 2021-01-03T13:05:16.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:16.366 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12361.asok status 2021-01-03T13:05:16.467 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2021-01-03T13:05:16.468 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2021-01-03T13:05:16.469 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:05:16.469 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:05:16.469 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2021-01-03T13:05:16.470 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2021-01-03T13:05:16.470 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-01-03T13:05:16.471 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "12361", 2021-01-03T13:05:16.471 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2021-01-03T13:05:16.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:05:16.472 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2021-01-03T13:05:16.473 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2021-01-03T13:05:16.473 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 6588, 2021-01-03T13:05:16.474 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2021-01-03T13:05:16.474 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2021-01-03T13:05:16.474 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2021-01-03T13:05:16.475 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 6588 2021-01-03T13:05:16.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:05:16.476 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:05:16.476 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:05:16.476 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:05:16.477 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 747463101 2021-01-03T13:05:16.477 INFO:teuthology.orchestra.run.smithi007.stdout: } 2021-01-03T13:05:16.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:05:16.478 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:05:16.479 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:05:16.479 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:05:16.480 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 747463101 2021-01-03T13:05:16.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:05:16.481 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.6588 172.21.15.7:0/747463101", 2021-01-03T13:05:16.481 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "172.21.15.7:0/747463101", 2021-01-03T13:05:16.481 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2021-01-03T13:05:16.482 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 38, 2021-01-03T13:05:16.482 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 90, 2021-01-03T13:05:16.483 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:05:16.484 INFO:teuthology.orchestra.run.smithi007.stdout: "blacklisted": false, 2021-01-03T13:05:16.484 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2021-01-03T13:05:16.484 INFO:teuthology.orchestra.run.smithi007.stdout:} 2021-01-03T13:05:16.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:16.487 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:05:16.487 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:16.495 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:05:16.496 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:05:16.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:16.497 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:16.557 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:05:16.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.674+0000 7f027865c700 1 Processor -- start 2021-01-03T13:05:16.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.674+0000 7f027865c700 1 -- start start 2021-01-03T13:05:16.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f027865c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f027005c7c0 0x7f0270140480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:16.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f027865c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f02700afb80 0x7f02701466c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:16.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f027865c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f027005cca0 con 0x7f02700af7a0 2021-01-03T13:05:16.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f027865c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02700afff0 con 0x7f02700afb80 2021-01-03T13:05:16.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f027865c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02700b0270 con 0x7f027005c7c0 2021-01-03T13:05:16.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f02763f8700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f02700af7a0 0x7f027013fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57750/0 (socket says 172.21.15.133:57750) 2021-01-03T13:05:16.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f02763f8700 1 -- 172.21.15.133:0/1466418091 learned_addr learned my addr 172.21.15.133:0/1466418091 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:16.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f0275bf7700 1 --2- 172.21.15.133:0/1466418091 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f027005c7c0 0x7f0270140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:16.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f0276bf9700 1 --2- 172.21.15.133:0/1466418091 >> v2:172.21.15.16:3300/0 conn(0x7f02700afb80 0x7f02701466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:16.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f02753f6700 1 -- 172.21.15.133:0/1466418091 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051244910 0 0) 0x7f027005cca0 con 0x7f02700af7a0 2021-01-03T13:05:16.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f02753f6700 1 -- 172.21.15.133:0/1466418091 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0258003230 con 0x7f02700af7a0 2021-01-03T13:05:16.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f0276bf9700 1 -- 172.21.15.133:0/1466418091 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f027005c7c0 msgr2=0x7f0270140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:16.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f0276bf9700 1 --2- 172.21.15.133:0/1466418091 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f027005c7c0 0x7f0270140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:16.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f0276bf9700 1 -- 172.21.15.133:0/1466418091 >> v1:172.21.15.133:6789/0 conn(0x7f02700af7a0 legacy=0x7f027013fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:16.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f02753f6700 1 -- 172.21.15.133:0/1466418091 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2100213494 0 0) 0x7f0258003230 con 0x7f02700af7a0 2021-01-03T13:05:16.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f0276bf9700 1 -- 172.21.15.133:0/1466418091 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02700b0510 con 0x7f02700afb80 2021-01-03T13:05:16.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f0276bf9700 1 --2- 172.21.15.133:0/1466418091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02700afb80 0x7f02701466c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f026c001870 tx=0x7f02680091a0).ready entity=mon.0 client_cookie=7dc31f05b348d2fb server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:16.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f02753f6700 1 -- 172.21.15.133:0/1466418091 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f026c0016d0 con 0x7f02700afb80 2021-01-03T13:05:16.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f02753f6700 1 -- 172.21.15.133:0/1466418091 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026800b800 con 0x7f02700afb80 2021-01-03T13:05:16.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f02753f6700 1 -- 172.21.15.133:0/1466418091 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f026800b970 con 0x7f02700afb80 2021-01-03T13:05:16.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f027865c700 1 -- 172.21.15.133:0/1466418091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02700afb80 msgr2=0x7f02701466c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:16.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f027865c700 1 --2- 172.21.15.133:0/1466418091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02700afb80 0x7f02701466c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f026c001870 tx=0x7f02680091a0).stop 2021-01-03T13:05:16.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f027865c700 1 -- 172.21.15.133:0/1466418091 shutdown_connections 2021-01-03T13:05:16.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f027865c700 1 --2- 172.21.15.133:0/1466418091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02700afb80 0x7f02701466c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:16.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f027865c700 1 --2- 172.21.15.133:0/1466418091 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f027005c7c0 0x7f0270140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:16.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f027865c700 1 -- 172.21.15.133:0/1466418091 >> 172.21.15.133:0/1466418091 conn(0x7f02700b9620 msgr2=0x7f02700b9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:16.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f027865c700 1 -- 172.21.15.133:0/1466418091 shutdown_connections 2021-01-03T13:05:16.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.678+0000 7f027865c700 1 -- 172.21.15.133:0/1466418091 wait complete. 2021-01-03T13:05:16.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f027865c700 1 Processor -- start 2021-01-03T13:05:16.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f027865c700 1 -- start start 2021-01-03T13:05:16.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f027865c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f027005c7c0 0x7f0270152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:16.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f027865c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02700af7a0 0x7f0270152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:16.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f027865c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02700afb80 0x7f0270136a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:16.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f027865c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0270152b00 con 0x7f02700af7a0 2021-01-03T13:05:16.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f027865c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02700b20b0 con 0x7f02700afb80 2021-01-03T13:05:16.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f027865c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02700b2350 con 0x7f027005c7c0 2021-01-03T13:05:16.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f0276bf9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02700afb80 0x7f0270136a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:16.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f0276bf9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02700afb80 0x7f0270136a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36728/0 (socket says 172.21.15.133:36728) 2021-01-03T13:05:16.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f0276bf9700 1 -- 172.21.15.133:0/3316157243 learned_addr learned my addr 172.21.15.133:0/3316157243 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:16.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f0275bf7700 1 --2- 172.21.15.133:0/3316157243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02700af7a0 0x7f0270152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:16.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f02763f8700 1 --2- 172.21.15.133:0/3316157243 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f027005c7c0 0x7f0270152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:16.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f0276bf9700 1 -- 172.21.15.133:0/3316157243 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f027005c7c0 msgr2=0x7f0270152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:16.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f0276bf9700 1 --2- 172.21.15.133:0/3316157243 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f027005c7c0 0x7f0270152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:16.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f0276bf9700 1 -- 172.21.15.133:0/3316157243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02700af7a0 msgr2=0x7f0270152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:16.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f0276bf9700 1 --2- 172.21.15.133:0/3316157243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02700af7a0 0x7f0270152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:16.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f0276bf9700 1 -- 172.21.15.133:0/3316157243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02700b25f0 con 0x7f02700afb80 2021-01-03T13:05:16.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f0276bf9700 1 --2- 172.21.15.133:0/3316157243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02700afb80 0x7f0270136a30 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f026c001870 tx=0x7f0268016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:16.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f025f7fe700 1 -- 172.21.15.133:0/3316157243 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f026800b950 con 0x7f02700afb80 2021-01-03T13:05:16.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f027865c700 1 -- 172.21.15.133:0/3316157243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02700b2890 con 0x7f02700afb80 2021-01-03T13:05:16.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f025f7fe700 1 -- 172.21.15.133:0/3316157243 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02680203f0 con 0x7f02700afb80 2021-01-03T13:05:16.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f025f7fe700 1 -- 172.21.15.133:0/3316157243 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0268020750 con 0x7f02700afb80 2021-01-03T13:05:16.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.682+0000 7f027865c700 1 -- 172.21.15.133:0/3316157243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02700b2ed0 con 0x7f02700afb80 2021-01-03T13:05:16.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.686+0000 7f027865c700 1 -- 172.21.15.133:0/3316157243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02700b0cd0 con 0x7f02700afb80 2021-01-03T13:05:16.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.686+0000 7f025f7fe700 1 -- 172.21.15.133:0/3316157243 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f026801e070 con 0x7f02700afb80 2021-01-03T13:05:16.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.686+0000 7f025f7fe700 1 --2- 172.21.15.133:0/3316157243 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f02500554e0 0x7f02500579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:16.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.686+0000 7f025f7fe700 1 -- 172.21.15.133:0/3316157243 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f026806eac0 con 0x7f02700afb80 2021-01-03T13:05:16.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.686+0000 7f02763f8700 1 --2- 172.21.15.133:0/3316157243 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f02500554e0 0x7f02500579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:16.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.686+0000 7f02763f8700 1 --2- 172.21.15.133:0/3316157243 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f02500554e0 0x7f02500579a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f026c00d000 tx=0x7f026c000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:16.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.694+0000 7f025f7fe700 1 -- 172.21.15.133:0/3316157243 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f02700b0cd0 con 0x7f02700afb80 2021-01-03T13:05:16.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.838+0000 7f027865c700 1 -- 172.21.15.133:0/3316157243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02700b0cd0 con 0x7f02700afb80 2021-01-03T13:05:16.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.838+0000 7f025f7fe700 1 -- 172.21.15.133:0/3316157243 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f0268031ef0 con 0x7f02700afb80 2021-01-03T13:05:16.844 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:16.844 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":90,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:05:09.869273+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:05:07.479446+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2021-01-03T13:05:07.894287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:05:16.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.842+0000 7f027865c700 1 -- 172.21.15.133:0/3316157243 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f02500554e0 msgr2=0x7f02500579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:16.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.842+0000 7f027865c700 1 --2- 172.21.15.133:0/3316157243 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f02500554e0 0x7f02500579a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f026c00d000 tx=0x7f026c000b80).stop 2021-01-03T13:05:16.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.842+0000 7f027865c700 1 -- 172.21.15.133:0/3316157243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02700afb80 msgr2=0x7f0270136a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.842+0000 7f027865c700 1 --2- 172.21.15.133:0/3316157243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02700afb80 0x7f0270136a30 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f026c001870 tx=0x7f0268016000).stop 2021-01-03T13:05:16.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.842+0000 7f027865c700 1 -- 172.21.15.133:0/3316157243 shutdown_connections 2021-01-03T13:05:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.842+0000 7f027865c700 1 --2- 172.21.15.133:0/3316157243 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f02500554e0 0x7f02500579a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.842+0000 7f027865c700 1 --2- 172.21.15.133:0/3316157243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02700afb80 0x7f0270136a30 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.842+0000 7f027865c700 1 --2- 172.21.15.133:0/3316157243 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f027005c7c0 0x7f0270152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.842+0000 7f027865c700 1 --2- 172.21.15.133:0/3316157243 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02700af7a0 0x7f0270152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.842+0000 7f027865c700 1 -- 172.21.15.133:0/3316157243 >> 172.21.15.133:0/3316157243 conn(0x7f02700b9620 msgr2=0x7f027005fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:16.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.842+0000 7f027865c700 1 -- 172.21.15.133:0/3316157243 shutdown_connections 2021-01-03T13:05:16.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.842+0000 7f027865c700 1 -- 172.21.15.133:0/3316157243 wait complete. 2021-01-03T13:05:16.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:05:07.479446+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:05:07.894287+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:05:16.859 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:05:16.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f7155cf1700 1 Processor -- start 2021-01-03T13:05:16.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f7155cf1700 1 -- start start 2021-01-03T13:05:16.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f7155cf1700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7150060510 0x7f715005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:16.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f7155cf1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f715005fd10 0x7f71500b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f7155cf1700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715005bf00 con 0x7f71500b4c20 2021-01-03T13:05:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f7155cf1700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715005c1a0 con 0x7f7150060510 2021-01-03T13:05:16.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f7155cf1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715005c440 con 0x7f715005fd10 2021-01-03T13:05:16.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f71554f0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f715005fd10 0x7f71500b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:16.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f714ffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7150060510 0x7f715005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:16.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f7154cef700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f71500b4c20 0x7f71500b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:36492/0 (socket says 172.21.15.133:36492) 2021-01-03T13:05:16.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f7154cef700 1 -- 172.21.15.133:0/2361841384 learned_addr learned my addr 172.21.15.133:0/2361841384 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:16.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f714f7fe700 1 -- 172.21.15.133:0/2361841384 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418777521 0 0) 0x7f715005bf00 con 0x7f71500b4c20 2021-01-03T13:05:16.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f71554f0700 1 -- 172.21.15.133:0/2361841384 >> v2:172.21.15.16:3300/0 conn(0x7f7150060510 msgr2=0x7f715005c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:16.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f71554f0700 1 --2- 172.21.15.133:0/2361841384 >> v2:172.21.15.16:3300/0 conn(0x7f7150060510 0x7f715005c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:16.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f71554f0700 1 -- 172.21.15.133:0/2361841384 >> v1:172.21.15.16:6789/0 conn(0x7f71500b4c20 legacy=0x7f71500b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:16.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f71554f0700 1 -- 172.21.15.133:0/2361841384 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71500b6ad0 con 0x7f715005fd10 2021-01-03T13:05:16.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f71554f0700 1 --2- 172.21.15.133:0/2361841384 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f715005fd10 0x7f71500b65e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f71480032b0 tx=0x7f71480091a0).ready entity=mon.2 client_cookie=67932c5f404122f2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:16.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f714f7fe700 1 -- 172.21.15.133:0/2361841384 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f714800b9a0 con 0x7f715005fd10 2021-01-03T13:05:16.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f714f7fe700 1 -- 172.21.15.133:0/2361841384 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714800bb00 con 0x7f715005fd10 2021-01-03T13:05:16.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f7155cf1700 1 -- 172.21.15.133:0/2361841384 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f715005fd10 msgr2=0x7f71500b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:16.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f714f7fe700 1 -- 172.21.15.133:0/2361841384 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f714800bc70 con 0x7f715005fd10 2021-01-03T13:05:16.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.974+0000 7f7155cf1700 1 --2- 172.21.15.133:0/2361841384 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f715005fd10 0x7f71500b65e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f71480032b0 tx=0x7f71480091a0).stop 2021-01-03T13:05:16.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.978+0000 7f7155cf1700 1 -- 172.21.15.133:0/2361841384 shutdown_connections 2021-01-03T13:05:16.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.978+0000 7f7155cf1700 1 --2- 172.21.15.133:0/2361841384 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f715005fd10 0x7f71500b65e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:16.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.978+0000 7f7155cf1700 1 --2- 172.21.15.133:0/2361841384 >> v2:172.21.15.16:3300/0 conn(0x7f7150060510 0x7f715005c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:16.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.978+0000 7f7155cf1700 1 -- 172.21.15.133:0/2361841384 >> 172.21.15.133:0/2361841384 conn(0x7f71500b9f00 msgr2=0x7f71500b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:16.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.978+0000 7f7155cf1700 1 -- 172.21.15.133:0/2361841384 shutdown_connections 2021-01-03T13:05:16.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.978+0000 7f7155cf1700 1 -- 172.21.15.133:0/2361841384 wait complete. 2021-01-03T13:05:16.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.978+0000 7f7155cf1700 1 Processor -- start 2021-01-03T13:05:16.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.978+0000 7f7155cf1700 1 -- start start 2021-01-03T13:05:16.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f7155cf1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715005fd10 0x7f71500af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:16.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f7155cf1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7150060510 0x7f7150151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:16.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f7155cf1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71500b4c20 0x7f7150152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:16.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f7155cf1700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7150142540 con 0x7f7150060510 2021-01-03T13:05:16.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f7155cf1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7150152820 con 0x7f715005fd10 2021-01-03T13:05:16.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f7155cf1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7150146630 con 0x7f71500b4c20 2021-01-03T13:05:16.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f7154cef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715005fd10 0x7f71500af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:16.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f7154cef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715005fd10 0x7f71500af840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36738/0 (socket says 172.21.15.133:36738) 2021-01-03T13:05:16.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f7154cef700 1 -- 172.21.15.133:0/901239954 learned_addr learned my addr 172.21.15.133:0/901239954 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:16.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f714ffff700 1 --2- 172.21.15.133:0/901239954 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7150060510 0x7f7150151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:16.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f71554f0700 1 --2- 172.21.15.133:0/901239954 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71500b4c20 0x7f7150152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:16.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f7154cef700 1 -- 172.21.15.133:0/901239954 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71500b4c20 msgr2=0x7f7150152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:16.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f7154cef700 1 --2- 172.21.15.133:0/901239954 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71500b4c20 0x7f7150152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:16.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f7154cef700 1 -- 172.21.15.133:0/901239954 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7150060510 msgr2=0x7f7150151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:16.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f7154cef700 1 --2- 172.21.15.133:0/901239954 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7150060510 0x7f7150151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:16.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f7154cef700 1 -- 172.21.15.133:0/901239954 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7150145db0 con 0x7f715005fd10 2021-01-03T13:05:16.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f7154cef700 1 --2- 172.21.15.133:0/901239954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715005fd10 0x7f71500af840 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f7150142f50 tx=0x7f7140007cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:16.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f714dffb700 1 -- 172.21.15.133:0/901239954 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71400072e0 con 0x7f715005fd10 2021-01-03T13:05:16.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f714dffb700 1 -- 172.21.15.133:0/901239954 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7140007440 con 0x7f715005fd10 2021-01-03T13:05:16.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f7155cf1700 1 -- 172.21.15.133:0/901239954 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7150146050 con 0x7f715005fd10 2021-01-03T13:05:16.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f714dffb700 1 -- 172.21.15.133:0/901239954 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71400057d0 con 0x7f715005fd10 2021-01-03T13:05:16.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.982+0000 7f7155cf1700 1 -- 172.21.15.133:0/901239954 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7150146320 con 0x7f715005fd10 2021-01-03T13:05:16.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.986+0000 7f7155cf1700 1 -- 172.21.15.133:0/901239954 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7150057300 con 0x7f715005fd10 2021-01-03T13:05:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.986+0000 7f714dffb700 1 -- 172.21.15.133:0/901239954 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f714001a060 con 0x7f715005fd10 2021-01-03T13:05:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.986+0000 7f714dffb700 1 --2- 172.21.15.133:0/901239954 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71300553b0 0x7f7130057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.986+0000 7f714dffb700 1 -- 172.21.15.133:0/901239954 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f714006d690 con 0x7f715005fd10 2021-01-03T13:05:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.986+0000 7f714ffff700 1 --2- 172.21.15.133:0/901239954 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71300553b0 0x7f7130057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.986+0000 7f714ffff700 1 --2- 172.21.15.133:0/901239954 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71300553b0 0x7f7130057870 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f714400b000 tx=0x7f7144006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:16.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:16.994+0000 7f714dffb700 1 -- 172.21.15.133:0/901239954 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7140043990 con 0x7f715005fd10 2021-01-03T13:05:17.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.134+0000 7f7155cf1700 1 -- 172.21.15.133:0/901239954 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7150067a00 con 0x7f715005fd10 2021-01-03T13:05:17.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.134+0000 7f714dffb700 1 -- 172.21.15.133:0/901239954 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v90) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7140018070 con 0x7f715005fd10 2021-01-03T13:05:17.141 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:05:17.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.138+0000 7f7155cf1700 1 -- 172.21.15.133:0/901239954 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71300553b0 msgr2=0x7f7130057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.138+0000 7f7155cf1700 1 --2- 172.21.15.133:0/901239954 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71300553b0 0x7f7130057870 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f714400b000 tx=0x7f7144006dc0).stop 2021-01-03T13:05:17.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.138+0000 7f7155cf1700 1 -- 172.21.15.133:0/901239954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715005fd10 msgr2=0x7f71500af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.138+0000 7f7155cf1700 1 --2- 172.21.15.133:0/901239954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715005fd10 0x7f71500af840 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f7150142f50 tx=0x7f7140007cb0).stop 2021-01-03T13:05:17.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.138+0000 7f7155cf1700 1 -- 172.21.15.133:0/901239954 shutdown_connections 2021-01-03T13:05:17.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.138+0000 7f7155cf1700 1 --2- 172.21.15.133:0/901239954 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71300553b0 0x7f7130057870 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.138+0000 7f7155cf1700 1 --2- 172.21.15.133:0/901239954 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71500b4c20 0x7f7150152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.138+0000 7f7155cf1700 1 --2- 172.21.15.133:0/901239954 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f715005fd10 0x7f71500af840 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.138+0000 7f7155cf1700 1 --2- 172.21.15.133:0/901239954 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7150060510 0x7f7150151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.138+0000 7f7155cf1700 1 -- 172.21.15.133:0/901239954 >> 172.21.15.133:0/901239954 conn(0x7f71500b9f00 msgr2=0x7f71500ae430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:17.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.138+0000 7f7155cf1700 1 -- 172.21.15.133:0/901239954 shutdown_connections 2021-01-03T13:05:17.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.138+0000 7f7155cf1700 1 -- 172.21.15.133:0/901239954 wait complete. 2021-01-03T13:05:17.159 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:05:17.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.266+0000 7f7bbf013700 1 Processor -- start 2021-01-03T13:05:17.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbf013700 1 -- start start 2021-01-03T13:05:17.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbf013700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7bb805c130 0x7f7bb80b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbf013700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7bb80b02b0 0x7f7bb80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbf013700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb805c510 con 0x7f7bb80622f0 2021-01-03T13:05:17.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbf013700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb81473d0 con 0x7f7bb80b02b0 2021-01-03T13:05:17.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbf013700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb80b0ab0 con 0x7f7bb805c130 2021-01-03T13:05:17.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbd810700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7bb80b02b0 0x7f7bb80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbd810700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7bb80b02b0 0x7f7bb80b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36748/0 (socket says 172.21.15.133:36748) 2021-01-03T13:05:17.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbd810700 1 -- 172.21.15.133:0/3804771835 learned_addr learned my addr 172.21.15.133:0/3804771835 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:17.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbe011700 1 --2- 172.21.15.133:0/3804771835 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7bb805c130 0x7f7bb80b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbd810700 1 -- 172.21.15.133:0/3804771835 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7bb805c130 msgr2=0x7f7bb80b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:17.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbd810700 1 --2- 172.21.15.133:0/3804771835 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7bb805c130 0x7f7bb80b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbd810700 1 -- 172.21.15.133:0/3804771835 >> v1:172.21.15.16:6789/0 conn(0x7f7bb80622f0 legacy=0x7f7bb80668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbd810700 1 -- 172.21.15.133:0/3804771835 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb80b15a0 con 0x7f7bb80b02b0 2021-01-03T13:05:17.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbd810700 1 --2- 172.21.15.133:0/3804771835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bb80b02b0 0x7f7bb80b1ef0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f7bac002f30 tx=0x7f7bac006e80).ready entity=mon.1 client_cookie=dbdb0cdda4eac42e server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:17.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbd00f700 1 -- 172.21.15.133:0/3804771835 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bac0097f0 con 0x7f7bb80b02b0 2021-01-03T13:05:17.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbd00f700 1 -- 172.21.15.133:0/3804771835 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bac009950 con 0x7f7bb80b02b0 2021-01-03T13:05:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbd00f700 1 -- 172.21.15.133:0/3804771835 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bac009cf0 con 0x7f7bb80b02b0 2021-01-03T13:05:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbf013700 1 -- 172.21.15.133:0/3804771835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bb80b02b0 msgr2=0x7f7bb80b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbf013700 1 --2- 172.21.15.133:0/3804771835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bb80b02b0 0x7f7bb80b1ef0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f7bac002f30 tx=0x7f7bac006e80).stop 2021-01-03T13:05:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbf013700 1 -- 172.21.15.133:0/3804771835 shutdown_connections 2021-01-03T13:05:17.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbf013700 1 --2- 172.21.15.133:0/3804771835 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7bb805c130 0x7f7bb80b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbf013700 1 --2- 172.21.15.133:0/3804771835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bb80b02b0 0x7f7bb80b1ef0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbf013700 1 -- 172.21.15.133:0/3804771835 >> 172.21.15.133:0/3804771835 conn(0x7f7bb80b6110 msgr2=0x7f7bb80b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:17.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbf013700 1 -- 172.21.15.133:0/3804771835 shutdown_connections 2021-01-03T13:05:17.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.270+0000 7f7bbf013700 1 -- 172.21.15.133:0/3804771835 wait complete. 2021-01-03T13:05:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbf013700 1 Processor -- start 2021-01-03T13:05:17.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbf013700 1 -- start start 2021-01-03T13:05:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbf013700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bb805c130 0x7f7bb8064740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbf013700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bb80622f0 0x7f7bb8066090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbf013700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7bb80b02b0 0x7f7bb8155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbf013700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8065f30 con 0x7f7bb805c130 2021-01-03T13:05:17.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbf013700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb80669d0 con 0x7f7bb80622f0 2021-01-03T13:05:17.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbf013700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8066730 con 0x7f7bb80b02b0 2021-01-03T13:05:17.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbd810700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bb80622f0 0x7f7bb8066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbd810700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bb80622f0 0x7f7bb8066090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36754/0 (socket says 172.21.15.133:36754) 2021-01-03T13:05:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbd810700 1 -- 172.21.15.133:0/518276961 learned_addr learned my addr 172.21.15.133:0/518276961 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:17.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbe011700 1 --2- 172.21.15.133:0/518276961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bb805c130 0x7f7bb8064740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbe812700 1 --2- 172.21.15.133:0/518276961 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7bb80b02b0 0x7f7bb8155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbd810700 1 -- 172.21.15.133:0/518276961 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7bb80b02b0 msgr2=0x7f7bb8155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbd810700 1 --2- 172.21.15.133:0/518276961 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7bb80b02b0 0x7f7bb8155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbd810700 1 -- 172.21.15.133:0/518276961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bb805c130 msgr2=0x7f7bb8064740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbd810700 1 --2- 172.21.15.133:0/518276961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bb805c130 0x7f7bb8064740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.274+0000 7f7bbd810700 1 -- 172.21.15.133:0/518276961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb80a37c0 con 0x7f7bb80622f0 2021-01-03T13:05:17.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.278+0000 7f7bbd810700 1 --2- 172.21.15.133:0/518276961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bb80622f0 0x7f7bb8066090 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f7bac002f30 tx=0x7f7bac015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:17.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.278+0000 7f7bab7fe700 1 -- 172.21.15.133:0/518276961 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bac011bd0 con 0x7f7bb80622f0 2021-01-03T13:05:17.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.278+0000 7f7bab7fe700 1 -- 172.21.15.133:0/518276961 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bac011d30 con 0x7f7bb80622f0 2021-01-03T13:05:17.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.278+0000 7f7bab7fe700 1 -- 172.21.15.133:0/518276961 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bac011ea0 con 0x7f7bb80622f0 2021-01-03T13:05:17.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.278+0000 7f7bbf013700 1 -- 172.21.15.133:0/518276961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb80a3a60 con 0x7f7bb80622f0 2021-01-03T13:05:17.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.278+0000 7f7bbf013700 1 -- 172.21.15.133:0/518276961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb8064000 con 0x7f7bb80622f0 2021-01-03T13:05:17.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.278+0000 7f7bbf013700 1 -- 172.21.15.133:0/518276961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb80a3bf0 con 0x7f7bb80622f0 2021-01-03T13:05:17.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.278+0000 7f7bab7fe700 1 -- 172.21.15.133:0/518276961 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7bac01a040 con 0x7f7bb80622f0 2021-01-03T13:05:17.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.278+0000 7f7bab7fe700 1 --2- 172.21.15.133:0/518276961 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7b98055330 0x7f7b980577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.278+0000 7f7bab7fe700 1 -- 172.21.15.133:0/518276961 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7bac06f060 con 0x7f7bb80622f0 2021-01-03T13:05:17.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.278+0000 7f7bbe011700 1 --2- 172.21.15.133:0/518276961 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7b98055330 0x7f7b980577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.278+0000 7f7bbe011700 1 --2- 172.21.15.133:0/518276961 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7b98055330 0x7f7b980577f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f7bb400c000 tx=0x7f7bb4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:17.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.286+0000 7f7bab7fe700 1 -- 172.21.15.133:0/518276961 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7bac045250 con 0x7f7bb80622f0 2021-01-03T13:05:17.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.426+0000 7f7bbf013700 1 -- 172.21.15.133:0/518276961 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7bb8057300 con 0x7f7bb80622f0 2021-01-03T13:05:17.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.426+0000 7f7bab7fe700 1 -- 172.21.15.133:0/518276961 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v90) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7bac024070 con 0x7f7bb80622f0 2021-01-03T13:05:17.432 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:05:17.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.430+0000 7f7bbf013700 1 -- 172.21.15.133:0/518276961 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7b98055330 msgr2=0x7f7b980577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.430+0000 7f7bbf013700 1 --2- 172.21.15.133:0/518276961 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7b98055330 0x7f7b980577f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f7bb400c000 tx=0x7f7bb4008040).stop 2021-01-03T13:05:17.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.430+0000 7f7bbf013700 1 -- 172.21.15.133:0/518276961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bb80622f0 msgr2=0x7f7bb8066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.430+0000 7f7bbf013700 1 --2- 172.21.15.133:0/518276961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bb80622f0 0x7f7bb8066090 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f7bac002f30 tx=0x7f7bac015000).stop 2021-01-03T13:05:17.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.430+0000 7f7bbf013700 1 -- 172.21.15.133:0/518276961 shutdown_connections 2021-01-03T13:05:17.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.430+0000 7f7bbf013700 1 --2- 172.21.15.133:0/518276961 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7b98055330 0x7f7b980577f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.430+0000 7f7bbf013700 1 --2- 172.21.15.133:0/518276961 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7bb805c130 0x7f7bb8064740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.430+0000 7f7bbf013700 1 --2- 172.21.15.133:0/518276961 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7bb80b02b0 0x7f7bb8155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.430+0000 7f7bbf013700 1 --2- 172.21.15.133:0/518276961 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bb80622f0 0x7f7bb8066090 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.430+0000 7f7bbf013700 1 -- 172.21.15.133:0/518276961 >> 172.21.15.133:0/518276961 conn(0x7f7bb80b6110 msgr2=0x7f7bb80ae610 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:17.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.430+0000 7f7bbf013700 1 -- 172.21.15.133:0/518276961 shutdown_connections 2021-01-03T13:05:17.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.430+0000 7f7bbf013700 1 -- 172.21.15.133:0/518276961 wait complete. 2021-01-03T13:05:17.450 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:05:17.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.558+0000 7f7285b06700 1 Processor -- start 2021-01-03T13:05:17.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.558+0000 7f7285b06700 1 -- start start 2021-01-03T13:05:17.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.558+0000 7f7285b06700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7280062f30 0x7f7280063310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.558+0000 7f7285b06700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f72800b2670 0x7f7280142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.558+0000 7f7285b06700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7280146410 con 0x7f72801431b0 2021-01-03T13:05:17.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.558+0000 7f7285b06700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72801466b0 con 0x7f72800b2670 2021-01-03T13:05:17.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.558+0000 7f7285b06700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7280146950 con 0x7f7280062f30 2021-01-03T13:05:17.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.558+0000 7f7284b04700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7280062f30 0x7f7280063310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.558+0000 7f7285305700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f72801431b0 0x7f728013c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57796/0 (socket says 172.21.15.133:57796) 2021-01-03T13:05:17.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.558+0000 7f7285305700 1 -- 172.21.15.133:0/1754149931 learned_addr learned my addr 172.21.15.133:0/1754149931 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:17.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.558+0000 7f727ffff700 1 --2- 172.21.15.133:0/1754149931 >> v2:172.21.15.16:3300/0 conn(0x7f72800b2670 0x7f7280142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f727f7fe700 1 -- 172.21.15.133:0/1754149931 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517191588 0 0) 0x7f7280146410 con 0x7f72801431b0 2021-01-03T13:05:17.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f727f7fe700 1 -- 172.21.15.133:0/1754149931 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f726c003230 con 0x7f72801431b0 2021-01-03T13:05:17.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7284b04700 1 -- 172.21.15.133:0/1754149931 >> v2:172.21.15.16:3300/0 conn(0x7f72800b2670 msgr2=0x7f7280142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:17.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7284b04700 1 --2- 172.21.15.133:0/1754149931 >> v2:172.21.15.16:3300/0 conn(0x7f72800b2670 0x7f7280142cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7284b04700 1 -- 172.21.15.133:0/1754149931 >> v1:172.21.15.133:6789/0 conn(0x7f72801431b0 legacy=0x7f728013c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7284b04700 1 -- 172.21.15.133:0/1754149931 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7280146bf0 con 0x7f7280062f30 2021-01-03T13:05:17.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f727ffff700 1 --2- 172.21.15.133:0/1754149931 >> v2:172.21.15.16:3300/0 conn(0x7f72800b2670 0x7f7280142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:17.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7284b04700 1 --2- 172.21.15.133:0/1754149931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7280062f30 0x7f7280063310 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f7274002f30 tx=0x7f7274006dc0).ready entity=mon.1 client_cookie=8cef015c0acad4b3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:17.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f727f7fe700 1 -- 172.21.15.133:0/1754149931 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72740096f0 con 0x7f7280062f30 2021-01-03T13:05:17.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f727f7fe700 1 -- 172.21.15.133:0/1754149931 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7274009850 con 0x7f7280062f30 2021-01-03T13:05:17.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f727f7fe700 1 -- 172.21.15.133:0/1754149931 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7274009bb0 con 0x7f7280062f30 2021-01-03T13:05:17.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7285b06700 1 -- 172.21.15.133:0/1754149931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7280062f30 msgr2=0x7f7280063310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7285b06700 1 --2- 172.21.15.133:0/1754149931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7280062f30 0x7f7280063310 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f7274002f30 tx=0x7f7274006dc0).stop 2021-01-03T13:05:17.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7285b06700 1 -- 172.21.15.133:0/1754149931 shutdown_connections 2021-01-03T13:05:17.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7285b06700 1 --2- 172.21.15.133:0/1754149931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7280062f30 0x7f7280063310 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7285b06700 1 --2- 172.21.15.133:0/1754149931 >> v2:172.21.15.16:3300/0 conn(0x7f72800b2670 0x7f7280142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7285b06700 1 -- 172.21.15.133:0/1754149931 >> 172.21.15.133:0/1754149931 conn(0x7f72800617b0 msgr2=0x7f728006aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:17.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7285b06700 1 -- 172.21.15.133:0/1754149931 shutdown_connections 2021-01-03T13:05:17.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7285b06700 1 -- 172.21.15.133:0/1754149931 wait complete. 2021-01-03T13:05:17.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7285b06700 1 Processor -- start 2021-01-03T13:05:17.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7285b06700 1 -- start start 2021-01-03T13:05:17.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7285b06700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7280062f30 0x7f72800b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7285b06700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72800b2670 0x7f728013a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7285b06700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f72801431b0 0x7f7280155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7285b06700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72800a9680 con 0x7f72800b2670 2021-01-03T13:05:17.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7285b06700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72800a9b50 con 0x7f7280062f30 2021-01-03T13:05:17.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7285b06700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72800a98b0 con 0x7f72801431b0 2021-01-03T13:05:17.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7284b04700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7280062f30 0x7f72800b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7284b04700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7280062f30 0x7f72800b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36766/0 (socket says 172.21.15.133:36766) 2021-01-03T13:05:17.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.562+0000 7f7284b04700 1 -- 172.21.15.133:0/1078923820 learned_addr learned my addr 172.21.15.133:0/1078923820 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:17.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f727ffff700 1 --2- 172.21.15.133:0/1078923820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72800b2670 0x7f728013a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f7285305700 1 --2- 172.21.15.133:0/1078923820 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f72801431b0 0x7f7280155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f7284b04700 1 -- 172.21.15.133:0/1078923820 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f72801431b0 msgr2=0x7f7280155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f7284b04700 1 --2- 172.21.15.133:0/1078923820 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f72801431b0 0x7f7280155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f7284b04700 1 -- 172.21.15.133:0/1078923820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72800b2670 msgr2=0x7f728013a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f7284b04700 1 --2- 172.21.15.133:0/1078923820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72800b2670 0x7f728013a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f7284b04700 1 -- 172.21.15.133:0/1078923820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72800abd50 con 0x7f7280062f30 2021-01-03T13:05:17.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f7284b04700 1 --2- 172.21.15.133:0/1078923820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7280062f30 0x7f72800b45d0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f7274002f30 tx=0x7f7274015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:17.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f727dffb700 1 -- 172.21.15.133:0/1078923820 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7274011b00 con 0x7f7280062f30 2021-01-03T13:05:17.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f727dffb700 1 -- 172.21.15.133:0/1078923820 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7274011c60 con 0x7f7280062f30 2021-01-03T13:05:17.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f7285b06700 1 -- 172.21.15.133:0/1078923820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72800abff0 con 0x7f7280062f30 2021-01-03T13:05:17.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f727dffb700 1 -- 172.21.15.133:0/1078923820 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f727401c3b0 con 0x7f7280062f30 2021-01-03T13:05:17.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f7285b06700 1 -- 172.21.15.133:0/1078923820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72800ab830 con 0x7f7280062f30 2021-01-03T13:05:17.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f7285b06700 1 -- 172.21.15.133:0/1078923820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72800abbb0 con 0x7f7280062f30 2021-01-03T13:05:17.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f727dffb700 1 -- 172.21.15.133:0/1078923820 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f727400f070 con 0x7f7280062f30 2021-01-03T13:05:17.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f727dffb700 1 --2- 172.21.15.133:0/1078923820 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7260055440 0x7f7260057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f727dffb700 1 -- 172.21.15.133:0/1078923820 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f727406eb90 con 0x7f7280062f30 2021-01-03T13:05:17.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.566+0000 7f727ffff700 1 --2- 172.21.15.133:0/1078923820 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7260055440 0x7f7260057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.570+0000 7f727ffff700 1 --2- 172.21.15.133:0/1078923820 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7260055440 0x7f7260057900 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f727000b000 tx=0x7f7270006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:17.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.574+0000 7f727dffb700 1 -- 172.21.15.133:0/1078923820 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f72800abbb0 con 0x7f7280062f30 2021-01-03T13:05:17.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.714+0000 7f7285b06700 1 -- 172.21.15.133:0/1078923820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f72800abbb0 con 0x7f7280062f30 2021-01-03T13:05:17.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.714+0000 7f727dffb700 1 -- 172.21.15.133:0/1078923820 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+10 (secure 0 0 0) 0x7f72800abbb0 con 0x7f7280062f30 2021-01-03T13:05:17.719 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:05:17.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.718+0000 7f7285b06700 1 -- 172.21.15.133:0/1078923820 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7260055440 msgr2=0x7f7260057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.718+0000 7f7285b06700 1 --2- 172.21.15.133:0/1078923820 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7260055440 0x7f7260057900 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f727000b000 tx=0x7f7270006dc0).stop 2021-01-03T13:05:17.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.718+0000 7f7285b06700 1 -- 172.21.15.133:0/1078923820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7280062f30 msgr2=0x7f72800b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.718+0000 7f7285b06700 1 --2- 172.21.15.133:0/1078923820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7280062f30 0x7f72800b45d0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f7274002f30 tx=0x7f7274015000).stop 2021-01-03T13:05:17.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.718+0000 7f7285b06700 1 -- 172.21.15.133:0/1078923820 shutdown_connections 2021-01-03T13:05:17.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.718+0000 7f7285b06700 1 --2- 172.21.15.133:0/1078923820 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7260055440 0x7f7260057900 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.718+0000 7f7285b06700 1 --2- 172.21.15.133:0/1078923820 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f72801431b0 0x7f7280155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.718+0000 7f7285b06700 1 --2- 172.21.15.133:0/1078923820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7280062f30 0x7f72800b45d0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.718+0000 7f7285b06700 1 --2- 172.21.15.133:0/1078923820 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72800b2670 0x7f728013a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.718+0000 7f7285b06700 1 -- 172.21.15.133:0/1078923820 >> 172.21.15.133:0/1078923820 conn(0x7f72800617b0 msgr2=0x7f72800ae830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:17.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.718+0000 7f7285b06700 1 -- 172.21.15.133:0/1078923820 shutdown_connections 2021-01-03T13:05:17.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.718+0000 7f7285b06700 1 -- 172.21.15.133:0/1078923820 wait complete. 2021-01-03T13:05:17.735 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:05:17.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.850+0000 7f7ada31a700 1 Processor -- start 2021-01-03T13:05:17.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.850+0000 7f7ada31a700 1 -- start start 2021-01-03T13:05:17.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.850+0000 7f7ada31a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ad40b5c00 0x7f7ad41477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.850+0000 7f7ada31a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ad41442a0 0x7f7ad4144730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.850+0000 7f7ada31a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad40b0c10 con 0x7f7ad40b5260 2021-01-03T13:05:17.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.850+0000 7f7ada31a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad40b5640 con 0x7f7ad40b5c00 2021-01-03T13:05:17.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.850+0000 7f7ada31a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad409a4f0 con 0x7f7ad41442a0 2021-01-03T13:05:17.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.850+0000 7f7ad8b17700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ad40b5c00 0x7f7ad41477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.850+0000 7f7ad9318700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7ad40b5260 0x7f7ad41470b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:36534/0 (socket says 172.21.15.133:36534) 2021-01-03T13:05:17.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ad9318700 1 -- 172.21.15.133:0/2353651737 learned_addr learned my addr 172.21.15.133:0/2353651737 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:17.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ad9b19700 1 --2- 172.21.15.133:0/2353651737 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ad41442a0 0x7f7ad4144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ad3fff700 1 -- 172.21.15.133:0/2353651737 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940742761 0 0) 0x7f7ad40b0c10 con 0x7f7ad40b5260 2021-01-03T13:05:17.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ad8b17700 1 -- 172.21.15.133:0/2353651737 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ad41442a0 msgr2=0x7f7ad4144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:17.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ad8b17700 1 --2- 172.21.15.133:0/2353651737 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ad41442a0 0x7f7ad4144730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ad8b17700 1 -- 172.21.15.133:0/2353651737 >> v1:172.21.15.16:6789/0 conn(0x7f7ad40b5260 legacy=0x7f7ad41470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ad8b17700 1 -- 172.21.15.133:0/2353651737 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad40b0e40 con 0x7f7ad40b5c00 2021-01-03T13:05:17.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ad9b19700 1 --2- 172.21.15.133:0/2353651737 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ad41442a0 0x7f7ad4144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:17.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ad8b17700 1 --2- 172.21.15.133:0/2353651737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad40b5c00 0x7f7ad41477c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f7ac8002f30 tx=0x7f7ac8006dc0).ready entity=mon.1 client_cookie=af3ab7d3b30d1e91 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:17.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ad3fff700 1 -- 172.21.15.133:0/2353651737 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ac8009760 con 0x7f7ad40b5c00 2021-01-03T13:05:17.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ad3fff700 1 -- 172.21.15.133:0/2353651737 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac80098c0 con 0x7f7ad40b5c00 2021-01-03T13:05:17.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ad3fff700 1 -- 172.21.15.133:0/2353651737 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ac8009c20 con 0x7f7ad40b5c00 2021-01-03T13:05:17.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ada31a700 1 -- 172.21.15.133:0/2353651737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad40b5c00 msgr2=0x7f7ad41477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ada31a700 1 --2- 172.21.15.133:0/2353651737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad40b5c00 0x7f7ad41477c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f7ac8002f30 tx=0x7f7ac8006dc0).stop 2021-01-03T13:05:17.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ada31a700 1 -- 172.21.15.133:0/2353651737 shutdown_connections 2021-01-03T13:05:17.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ada31a700 1 --2- 172.21.15.133:0/2353651737 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ad41442a0 0x7f7ad4144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ada31a700 1 --2- 172.21.15.133:0/2353651737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad40b5c00 0x7f7ad41477c0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ada31a700 1 -- 172.21.15.133:0/2353651737 >> 172.21.15.133:0/2353651737 conn(0x7f7ad405bdf0 msgr2=0x7f7ad405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:17.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ada31a700 1 -- 172.21.15.133:0/2353651737 shutdown_connections 2021-01-03T13:05:17.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ada31a700 1 -- 172.21.15.133:0/2353651737 wait complete. 2021-01-03T13:05:17.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ada31a700 1 Processor -- start 2021-01-03T13:05:17.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.854+0000 7f7ada31a700 1 -- start start 2021-01-03T13:05:17.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ada31a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad40b5260 0x7f7ad4142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ada31a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ad40b5c00 0x7f7ad40aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ada31a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ad41442a0 0x7f7ad40af300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ada31a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad40ad470 con 0x7f7ad41442a0 2021-01-03T13:05:17.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ada31a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad40ad710 con 0x7f7ad40b5260 2021-01-03T13:05:17.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ada31a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad40ad9b0 con 0x7f7ad40b5c00 2021-01-03T13:05:17.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ad9318700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad40b5260 0x7f7ad4142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ad9318700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad40b5260 0x7f7ad4142d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36782/0 (socket says 172.21.15.133:36782) 2021-01-03T13:05:17.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ad9318700 1 -- 172.21.15.133:0/3780290439 learned_addr learned my addr 172.21.15.133:0/3780290439 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:17.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ad9b19700 1 --2- 172.21.15.133:0/3780290439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ad41442a0 0x7f7ad40af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ad8b17700 1 --2- 172.21.15.133:0/3780290439 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ad40b5c00 0x7f7ad40aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ad9318700 1 -- 172.21.15.133:0/3780290439 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ad40b5c00 msgr2=0x7f7ad40aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ad9318700 1 --2- 172.21.15.133:0/3780290439 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ad40b5c00 0x7f7ad40aee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ad9318700 1 -- 172.21.15.133:0/3780290439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ad41442a0 msgr2=0x7f7ad40af300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ad9318700 1 --2- 172.21.15.133:0/3780290439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ad41442a0 0x7f7ad40af300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:17.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ad9318700 1 -- 172.21.15.133:0/3780290439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad40ae970 con 0x7f7ad40b5260 2021-01-03T13:05:17.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ad9318700 1 --2- 172.21.15.133:0/3780290439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad40b5260 0x7f7ad4142d80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f7ac4000b80 tx=0x7f7ac4007a30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:17.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ad27fc700 1 -- 172.21.15.133:0/3780290439 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ac4007320 con 0x7f7ad40b5260 2021-01-03T13:05:17.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ad27fc700 1 -- 172.21.15.133:0/3780290439 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac4007480 con 0x7f7ad40b5260 2021-01-03T13:05:17.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ad27fc700 1 -- 172.21.15.133:0/3780290439 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ac40057d0 con 0x7f7ad40b5260 2021-01-03T13:05:17.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ada31a700 1 -- 172.21.15.133:0/3780290439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad4065760 con 0x7f7ad40b5260 2021-01-03T13:05:17.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ada31a700 1 -- 172.21.15.133:0/3780290439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad4159480 con 0x7f7ad40b5260 2021-01-03T13:05:17.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.858+0000 7f7ada31a700 1 -- 172.21.15.133:0/3780290439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad40aeb00 con 0x7f7ad40b5260 2021-01-03T13:05:17.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.862+0000 7f7ad27fc700 1 -- 172.21.15.133:0/3780290439 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7ac4010030 con 0x7f7ad40b5260 2021-01-03T13:05:17.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.862+0000 7f7ad27fc700 1 --2- 172.21.15.133:0/3780290439 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7ab40553b0 0x7f7ab4057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:17.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.862+0000 7f7ad27fc700 1 -- 172.21.15.133:0/3780290439 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7ac406dd00 con 0x7f7ad40b5260 2021-01-03T13:05:17.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.862+0000 7f7ad8b17700 1 --2- 172.21.15.133:0/3780290439 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7ab40553b0 0x7f7ab4057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:17.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.862+0000 7f7ad8b17700 1 --2- 172.21.15.133:0/3780290439 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7ab40553b0 0x7f7ab4057870 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f7ac8018000 tx=0x7f7ac8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:17.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:17.866+0000 7f7ad27fc700 1 -- 172.21.15.133:0/3780290439 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7ac4071030 con 0x7f7ad40b5260 2021-01-03T13:05:18.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.006+0000 7f7ada31a700 1 -- 172.21.15.133:0/3780290439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7ad4057300 con 0x7f7ad40b5260 2021-01-03T13:05:18.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.010+0000 7f7ad27fc700 1 -- 172.21.15.133:0/3780290439 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7ac4043f60 con 0x7f7ad40b5260 2021-01-03T13:05:18.013 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:05:18.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.010+0000 7f7ada31a700 1 -- 172.21.15.133:0/3780290439 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7ab40553b0 msgr2=0x7f7ab4057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.010+0000 7f7ada31a700 1 --2- 172.21.15.133:0/3780290439 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7ab40553b0 0x7f7ab4057870 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f7ac8018000 tx=0x7f7ac8015000).stop 2021-01-03T13:05:18.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.010+0000 7f7ada31a700 1 -- 172.21.15.133:0/3780290439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad40b5260 msgr2=0x7f7ad4142d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:18.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.010+0000 7f7ada31a700 1 --2- 172.21.15.133:0/3780290439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad40b5260 0x7f7ad4142d80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f7ac4000b80 tx=0x7f7ac4007a30).stop 2021-01-03T13:05:18.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.010+0000 7f7ada31a700 1 -- 172.21.15.133:0/3780290439 shutdown_connections 2021-01-03T13:05:18.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.010+0000 7f7ada31a700 1 --2- 172.21.15.133:0/3780290439 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7ab40553b0 0x7f7ab4057870 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:18.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.010+0000 7f7ada31a700 1 --2- 172.21.15.133:0/3780290439 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ad41442a0 0x7f7ad40af300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:18.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.010+0000 7f7ada31a700 1 --2- 172.21.15.133:0/3780290439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad40b5260 0x7f7ad4142d80 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:18.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.010+0000 7f7ada31a700 1 --2- 172.21.15.133:0/3780290439 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ad40b5c00 0x7f7ad40aee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:18.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.010+0000 7f7ada31a700 1 -- 172.21.15.133:0/3780290439 >> 172.21.15.133:0/3780290439 conn(0x7f7ad405bdf0 msgr2=0x7f7ad41472f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:18.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.010+0000 7f7ada31a700 1 -- 172.21.15.133:0/3780290439 shutdown_connections 2021-01-03T13:05:18.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.010+0000 7f7ada31a700 1 -- 172.21.15.133:0/3780290439 wait complete. 2021-01-03T13:05:18.027 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:05:18.028 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:05:18.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe7813c3700 1 Processor -- start 2021-01-03T13:05:18.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe7813c3700 1 -- start start 2021-01-03T13:05:18.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe7813c3700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe77c05c840 0x7fe77c14b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:18.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe7813c3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c147220 0x7fe77c147690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:18.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe7813c3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe77c05cc20 con 0x7fe77c0b15b0 2021-01-03T13:05:18.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe7813c3700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77c0a9420 con 0x7fe77c05c840 2021-01-03T13:05:18.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe7813c3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c14b6c0 con 0x7fe77c147220 2021-01-03T13:05:18.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe77a7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe77c0b15b0 0x7fe77c0a8d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57822/0 (socket says 172.21.15.133:57822) 2021-01-03T13:05:18.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe77a7fc700 1 -- 172.21.15.133:0/1229928565 learned_addr learned my addr 172.21.15.133:0/1229928565 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:18.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe77affd700 1 --2- 172.21.15.133:0/1229928565 >> v2:172.21.15.16:3300/0 conn(0x7fe77c05c840 0x7fe77c14b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:18.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe77b7fe700 1 --2- 172.21.15.133:0/1229928565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c147220 0x7fe77c147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:18.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe779ffb700 1 -- 172.21.15.133:0/1229928565 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176013120 0 0) 0x7fe77c05cc20 con 0x7fe77c0b15b0 2021-01-03T13:05:18.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe779ffb700 1 -- 172.21.15.133:0/1229928565 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe760003230 con 0x7fe77c0b15b0 2021-01-03T13:05:18.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe779ffb700 1 -- 172.21.15.133:0/1229928565 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 858873433 0 0) 0x7fe760003230 con 0x7fe77c0b15b0 2021-01-03T13:05:18.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe779ffb700 1 -- 172.21.15.133:0/1229928565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c147220 msgr2=0x7fe77c147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:18.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe779ffb700 1 --2- 172.21.15.133:0/1229928565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c147220 0x7fe77c147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:18.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe779ffb700 1 -- 172.21.15.133:0/1229928565 >> v2:172.21.15.16:3300/0 conn(0x7fe77c05c840 msgr2=0x7fe77c14b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:18.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe779ffb700 1 --2- 172.21.15.133:0/1229928565 >> v2:172.21.15.16:3300/0 conn(0x7fe77c05c840 0x7fe77c14b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:18.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe779ffb700 1 -- 172.21.15.133:0/1229928565 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c14a830 con 0x7fe77c0b15b0 2021-01-03T13:05:18.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe779ffb700 1 -- 172.21.15.133:0/1229928565 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fe7740016d0 con 0x7fe77c0b15b0 2021-01-03T13:05:18.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe779ffb700 1 -- 172.21.15.133:0/1229928565 >> v1:172.21.15.133:6789/0 conn(0x7fe77c0b15b0 legacy=0x7fe77c0a8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:18.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe779ffb700 1 --2- 172.21.15.133:0/1229928565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe760003720 0x7fe760003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:18.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe779ffb700 1 --2- 172.21.15.133:0/1229928565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c147220 0x7fe7600044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:18.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe779ffb700 1 --2- 172.21.15.133:0/1229928565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7600049c0 0x7fe760004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:18.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe779ffb700 1 -- 172.21.15.133:0/1229928565 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0a9420 con 0x7fe760003720 2021-01-03T13:05:18.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe779ffb700 1 -- 172.21.15.133:0/1229928565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c14b6c0 con 0x7fe7600049c0 2021-01-03T13:05:18.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe779ffb700 1 -- 172.21.15.133:0/1229928565 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7600041c0 con 0x7fe77c147220 2021-01-03T13:05:18.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe77affd700 1 --2- 172.21.15.133:0/1229928565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe760003720 0x7fe760003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:18.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe77b7fe700 1 --2- 172.21.15.133:0/1229928565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7600049c0 0x7fe760004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:18.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe77a7fc700 1 --2- 172.21.15.133:0/1229928565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c147220 0x7fe7600044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:18.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe77b7fe700 1 -- 172.21.15.133:0/1229928565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c147220 msgr2=0x7fe7600044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:18.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe77b7fe700 1 --2- 172.21.15.133:0/1229928565 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c147220 0x7fe7600044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:18.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe77b7fe700 1 -- 172.21.15.133:0/1229928565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe760003720 msgr2=0x7fe760003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:18.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe77b7fe700 1 --2- 172.21.15.133:0/1229928565 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe760003720 0x7fe760003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:18.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.134+0000 7fe77b7fe700 1 -- 172.21.15.133:0/1229928565 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe760003230 con 0x7fe7600049c0 2021-01-03T13:05:18.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.138+0000 7fe77b7fe700 1 --2- 172.21.15.133:0/1229928565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7600049c0 0x7fe760004e40 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7fe76400c000 tx=0x7fe764008040).ready entity=mon.1 client_cookie=1215707db2c310fa server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:18.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.138+0000 7fe779ffb700 1 -- 172.21.15.133:0/1229928565 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe76400e970 con 0x7fe7600049c0 2021-01-03T13:05:18.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.138+0000 7fe779ffb700 1 -- 172.21.15.133:0/1229928565 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76400ead0 con 0x7fe7600049c0 2021-01-03T13:05:18.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.138+0000 7fe779ffb700 1 -- 172.21.15.133:0/1229928565 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe76400ee30 con 0x7fe7600049c0 2021-01-03T13:05:18.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.138+0000 7fe7813c3700 1 -- 172.21.15.133:0/1229928565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7600049c0 msgr2=0x7fe760004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:18.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.138+0000 7fe7813c3700 1 --2- 172.21.15.133:0/1229928565 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe7600049c0 0x7fe760004e40 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7fe76400c000 tx=0x7fe764008040).stop 2021-01-03T13:05:18.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.138+0000 7fe77b7fe700 1 -- 172.21.15.133:0/1229928565 reap_dead start 2021-01-03T13:05:18.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.138+0000 7fe7813c3700 1 -- 172.21.15.133:0/1229928565 shutdown_connections 2021-01-03T13:05:18.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.138+0000 7fe7813c3700 1 -- 172.21.15.133:0/1229928565 >> 172.21.15.133:0/1229928565 conn(0x7fe77c06aeb0 msgr2=0x7fe77c05bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:18.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.138+0000 7fe7813c3700 1 -- 172.21.15.133:0/1229928565 shutdown_connections 2021-01-03T13:05:18.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.138+0000 7fe7813c3700 1 -- 172.21.15.133:0/1229928565 wait complete. 2021-01-03T13:05:18.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.138+0000 7fe7813c3700 1 Processor -- start 2021-01-03T13:05:18.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.138+0000 7fe7813c3700 1 -- start start 2021-01-03T13:05:18.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe7813c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe77c13b250 0x7fe77c138cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:18.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe7813c3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c1391a0 0x7fe77c159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:18.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe7813c3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c159c50 0x7fe77c156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:18.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe7813c3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c143b60 con 0x7fe77c1391a0 2021-01-03T13:05:18.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe7813c3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c13bca0 con 0x7fe77c13b250 2021-01-03T13:05:18.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe7813c3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c13b630 con 0x7fe77c159c50 2021-01-03T13:05:18.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe77affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe77c13b250 0x7fe77c138cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:18.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe77affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe77c13b250 0x7fe77c138cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36802/0 (socket says 172.21.15.133:36802) 2021-01-03T13:05:18.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe77affd700 1 -- 172.21.15.133:0/3549863553 learned_addr learned my addr 172.21.15.133:0/3549863553 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:18.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe77a7fc700 1 --2- 172.21.15.133:0/3549863553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c1391a0 0x7fe77c159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:18.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe77b7fe700 1 --2- 172.21.15.133:0/3549863553 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c159c50 0x7fe77c156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:18.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe77affd700 1 -- 172.21.15.133:0/3549863553 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c159c50 msgr2=0x7fe77c156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:18.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe77affd700 1 --2- 172.21.15.133:0/3549863553 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c159c50 0x7fe77c156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:18.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe77affd700 1 -- 172.21.15.133:0/3549863553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c1391a0 msgr2=0x7fe77c159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:18.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe77affd700 1 --2- 172.21.15.133:0/3549863553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c1391a0 0x7fe77c159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:18.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe77affd700 1 -- 172.21.15.133:0/3549863553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c145240 con 0x7fe77c13b250 2021-01-03T13:05:18.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe77affd700 1 --2- 172.21.15.133:0/3549863553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe77c13b250 0x7fe77c138cb0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7fe77c143570 tx=0x7fe76c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:18.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe773fff700 1 -- 172.21.15.133:0/3549863553 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe76c00fbf0 con 0x7fe77c13b250 2021-01-03T13:05:18.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe773fff700 1 -- 172.21.15.133:0/3549863553 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c00fd50 con 0x7fe77c13b250 2021-01-03T13:05:18.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe7813c3700 1 -- 172.21.15.133:0/3549863553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c0b3610 con 0x7fe77c13b250 2021-01-03T13:05:18.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe773fff700 1 -- 172.21.15.133:0/3549863553 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe76c014630 con 0x7fe77c13b250 2021-01-03T13:05:18.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.142+0000 7fe7813c3700 1 -- 172.21.15.133:0/3549863553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c1438c0 con 0x7fe77c13b250 2021-01-03T13:05:18.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.146+0000 7fe7813c3700 1 -- 172.21.15.133:0/3549863553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c057300 con 0x7fe77c13b250 2021-01-03T13:05:18.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.146+0000 7fe773fff700 1 -- 172.21.15.133:0/3549863553 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe76c024070 con 0x7fe77c13b250 2021-01-03T13:05:18.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.146+0000 7fe773fff700 1 --2- 172.21.15.133:0/3549863553 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe754055500 0x7fe7540579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:18.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.146+0000 7fe773fff700 1 -- 172.21.15.133:0/3549863553 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe76c06eab0 con 0x7fe77c13b250 2021-01-03T13:05:18.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.146+0000 7fe77a7fc700 1 --2- 172.21.15.133:0/3549863553 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe754055500 0x7fe7540579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:18.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.146+0000 7fe77a7fc700 1 --2- 172.21.15.133:0/3549863553 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe754055500 0x7fe7540579c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fe774005000 tx=0x7fe77c0a7d80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:18.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.150+0000 7fe773fff700 1 -- 172.21.15.133:0/3549863553 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe76c044ca0 con 0x7fe77c13b250 2021-01-03T13:05:18.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.334+0000 7fe7813c3700 1 -- 172.21.15.133:0/3549863553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe77c05ce00 con 0x7fe77c13b250 2021-01-03T13:05:18.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.338+0000 7fe773fff700 1 -- 172.21.15.133:0/3549863553 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fe76c0482c0 con 0x7fe77c13b250 2021-01-03T13:05:18.341 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:18.341 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":38,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6523,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3593206473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3593206473},{"type":"v1","addr":"172.21.15.133:6835","nonce":3593206473}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/328558863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":328558863},{"type":"v1","addr":"172.21.15.133:6837","nonce":328558863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:08.865621+0000","modified":"2021-01-03T13:05:09.868458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/420953895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":420953895},{"type":"v1","addr":"172.21.15.16:6833","nonce":420953895}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-01-03T13:05:18.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.338+0000 7fe7813c3700 1 -- 172.21.15.133:0/3549863553 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe754055500 msgr2=0x7fe7540579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:18.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.338+0000 7fe7813c3700 1 --2- 172.21.15.133:0/3549863553 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe754055500 0x7fe7540579c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fe774005000 tx=0x7fe77c0a7d80).stop 2021-01-03T13:05:18.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.338+0000 7fe7813c3700 1 -- 172.21.15.133:0/3549863553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe77c13b250 msgr2=0x7fe77c138cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:18.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.338+0000 7fe7813c3700 1 --2- 172.21.15.133:0/3549863553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe77c13b250 0x7fe77c138cb0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7fe77c143570 tx=0x7fe76c0091a0).stop 2021-01-03T13:05:18.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.338+0000 7fe7813c3700 1 -- 172.21.15.133:0/3549863553 shutdown_connections 2021-01-03T13:05:18.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.338+0000 7fe7813c3700 1 --2- 172.21.15.133:0/3549863553 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe754055500 0x7fe7540579c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:18.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.338+0000 7fe7813c3700 1 --2- 172.21.15.133:0/3549863553 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe77c159c50 0x7fe77c156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:18.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.338+0000 7fe7813c3700 1 --2- 172.21.15.133:0/3549863553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe77c13b250 0x7fe77c138cb0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:18.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.338+0000 7fe7813c3700 1 --2- 172.21.15.133:0/3549863553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe77c1391a0 0x7fe77c159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:18.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.338+0000 7fe7813c3700 1 -- 172.21.15.133:0/3549863553 >> 172.21.15.133:0/3549863553 conn(0x7fe77c06aeb0 msgr2=0x7fe77c141370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:18.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.338+0000 7fe7813c3700 1 -- 172.21.15.133:0/3549863553 shutdown_connections 2021-01-03T13:05:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:18.338+0000 7fe7813c3700 1 -- 172.21.15.133:0/3549863553 wait complete. 2021-01-03T13:05:18.348 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 38 2021-01-03T13:05:18.662 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:05:08.865621+0000', 'modified': '2021-01-03T13:05:09.868458+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6532}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6532': {'gid': 6532, 'name': 'b', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.16:6833/420953895', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6832', 'nonce': 420953895}, {'type': 'v1', 'addr': '172.21.15.16:6833', 'nonce': 420953895}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:05:18.663 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:05:18.664 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-01-03T13:05:18.792 INFO:teuthology.orchestra.run.smithi016.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":6532,"want_state":"up:active","state":"up:active","rank_uptime":9.9115179389999994,"mdsmap_epoch":38,"osdmap_epoch":90,"osdmap_epoch_barrier":89,"uptime":14.182229807000001} 2021-01-03T13:05:18.793 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 6532, "mdsmap_epoch": 38, "osdmap_epoch": 90, "osdmap_epoch_barrier": 89, "rank_uptime": 9.911517939, "state": "up:active", "uptime": 14.182229807, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:05:18.793 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:05:18.793 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-01-03T13:05:18.794 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi036.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-01-03T13:05:18.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:18.795 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:18.803 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:05:18.861 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:05:18.862 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:05:18.917 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:05:18.918 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:05:18.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:18.919 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:05:18.964 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:05:18.965 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:19.008 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:05:19.025 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:05:19.025 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:05:19.079 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:05:19.080 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:05:19.081 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:19.082 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:05:19.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:2021-01-03T13:05:19.080+0000 7fecdbd060c0 -1 init, newargv = 0x5627d77998a0 newargc=9ceph-fuse[11884 2021-01-03T13:05:19.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:]: starting ceph client 2021-01-03T13:05:19.097 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[11884]: starting fuse 2021-01-03T13:05:20.194 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:05:20.216 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:05:20.218 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:05:20.282 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:05:20.282 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:05:20.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:20.283 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:05:20.343 INFO:teuthology.orchestra.run.smithi036.stdout:50 2021-01-03T13:05:20.351 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:05:20.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:20.354 DEBUG:teuthology.orchestra.run.smithi036:> sudo python3 -c ' 2021-01-03T13:05:20.355 DEBUG:teuthology.orchestra.run.smithi036:> import glob 2021-01-03T13:05:20.355 DEBUG:teuthology.orchestra.run.smithi036:> import re 2021-01-03T13:05:20.357 DEBUG:teuthology.orchestra.run.smithi036:> import os 2021-01-03T13:05:20.358 DEBUG:teuthology.orchestra.run.smithi036:> import subprocess 2021-01-03T13:05:20.365 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:05:20.366 DEBUG:teuthology.orchestra.run.smithi036:> def find_socket(client_name): 2021-01-03T13:05:20.367 DEBUG:teuthology.orchestra.run.smithi036:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-01-03T13:05:20.368 DEBUG:teuthology.orchestra.run.smithi036:> files = glob.glob(asok_path) 2021-01-03T13:05:20.370 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:05:20.371 DEBUG:teuthology.orchestra.run.smithi036:> # Given a non-glob path, it better be there 2021-01-03T13:05:20.374 DEBUG:teuthology.orchestra.run.smithi036:> if "*" not in asok_path: 2021-01-03T13:05:20.376 DEBUG:teuthology.orchestra.run.smithi036:> assert(len(files) == 1) 2021-01-03T13:05:20.377 DEBUG:teuthology.orchestra.run.smithi036:> return files[0] 2021-01-03T13:05:20.378 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:05:20.379 DEBUG:teuthology.orchestra.run.smithi036:> for f in files: 2021-01-03T13:05:20.380 DEBUG:teuthology.orchestra.run.smithi036:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:05:20.385 DEBUG:teuthology.orchestra.run.smithi036:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:05:20.385 DEBUG:teuthology.orchestra.run.smithi036:> return f 2021-01-03T13:05:20.386 DEBUG:teuthology.orchestra.run.smithi036:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:05:20.387 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:05:20.388 DEBUG:teuthology.orchestra.run.smithi036:> print(find_socket("client.1")) 2021-01-03T13:05:20.389 DEBUG:teuthology.orchestra.run.smithi036:> ' 2021-01-03T13:05:20.443 INFO:teuthology.orchestra.run.smithi036.stdout:/var/run/ceph/ceph-client.1.11884.asok 2021-01-03T13:05:20.452 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.11884.asok 2021-01-03T13:05:20.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:20.454 DEBUG:teuthology.orchestra.run.smithi036:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.11884.asok status 2021-01-03T13:05:20.560 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2021-01-03T13:05:20.561 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": { 2021-01-03T13:05:20.561 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:05:20.561 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:05:20.561 INFO:teuthology.orchestra.run.smithi036.stdout: "entity_id": "1", 2021-01-03T13:05:20.562 INFO:teuthology.orchestra.run.smithi036.stdout: "hostname": "smithi036", 2021-01-03T13:05:20.562 INFO:teuthology.orchestra.run.smithi036.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-01-03T13:05:20.562 INFO:teuthology.orchestra.run.smithi036.stdout: "pid": "11884", 2021-01-03T13:05:20.563 INFO:teuthology.orchestra.run.smithi036.stdout: "root": "/" 2021-01-03T13:05:20.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:05:20.564 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_count": 0, 2021-01-03T13:05:20.564 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_pinned_count": 0, 2021-01-03T13:05:20.565 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 6736, 2021-01-03T13:05:20.565 INFO:teuthology.orchestra.run.smithi036.stdout: "inst": { 2021-01-03T13:05:20.565 INFO:teuthology.orchestra.run.smithi036.stdout: "name": { 2021-01-03T13:05:20.565 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "client", 2021-01-03T13:05:20.565 INFO:teuthology.orchestra.run.smithi036.stdout: "num": 6736 2021-01-03T13:05:20.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:05:20.566 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:05:20.566 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:05:20.566 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:05:20.567 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 738293453 2021-01-03T13:05:20.567 INFO:teuthology.orchestra.run.smithi036.stdout: } 2021-01-03T13:05:20.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:05:20.567 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:05:20.567 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:05:20.568 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:05:20.568 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 738293453 2021-01-03T13:05:20.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:05:20.568 INFO:teuthology.orchestra.run.smithi036.stdout: "inst_str": "client.6736 172.21.15.36:0/738293453", 2021-01-03T13:05:20.568 INFO:teuthology.orchestra.run.smithi036.stdout: "addr_str": "172.21.15.36:0/738293453", 2021-01-03T13:05:20.569 INFO:teuthology.orchestra.run.smithi036.stdout: "inode_count": 1, 2021-01-03T13:05:20.569 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_epoch": 38, 2021-01-03T13:05:20.569 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch": 90, 2021-01-03T13:05:20.571 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:05:20.571 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklisted": false, 2021-01-03T13:05:20.571 INFO:teuthology.orchestra.run.smithi036.stdout: "fs_name": "cephfs" 2021-01-03T13:05:20.571 INFO:teuthology.orchestra.run.smithi036.stdout:} 2021-01-03T13:05:20.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:20.574 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:05:20.575 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:20.588 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:05:20.589 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:05:20.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:20.590 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:20.652 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:05:20.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.766+0000 7f281af80700 1 Processor -- start 2021-01-03T13:05:20.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.766+0000 7f281af80700 1 -- start start 2021-01-03T13:05:20.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f281af80700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f28140ac880 0x7f28140b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:20.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f281af80700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2814061680 0x7f2814061ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:20.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f281af80700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2814146680 con 0x7f2814061fd0 2021-01-03T13:05:20.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f281af80700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2814140830 con 0x7f2814061680 2021-01-03T13:05:20.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f281af80700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2814146920 con 0x7f28140ac880 2021-01-03T13:05:20.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f281951d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2814061fd0 0x7f2814142d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57844/0 (socket says 172.21.15.133:57844) 2021-01-03T13:05:20.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f281951d700 1 -- 172.21.15.133:0/4142363785 learned_addr learned my addr 172.21.15.133:0/4142363785 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:20.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f2813fff700 1 --2- 172.21.15.133:0/4142363785 >> v2:172.21.15.16:3300/0 conn(0x7f2814061680 0x7f2814061ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:20.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f2818d1c700 1 --2- 172.21.15.133:0/4142363785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f28140ac880 0x7f28140b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:20.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 -- 172.21.15.133:0/4142363785 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264655308 0 0) 0x7f2814146680 con 0x7f2814061fd0 2021-01-03T13:05:20.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 -- 172.21.15.133:0/4142363785 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f4003230 con 0x7f2814061fd0 2021-01-03T13:05:20.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 -- 172.21.15.133:0/4142363785 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2775606517 0 0) 0x7f27f4003230 con 0x7f2814061fd0 2021-01-03T13:05:20.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 -- 172.21.15.133:0/4142363785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f28140ac880 msgr2=0x7f28140b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:20.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 --2- 172.21.15.133:0/4142363785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f28140ac880 0x7f28140b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:20.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 -- 172.21.15.133:0/4142363785 >> v2:172.21.15.16:3300/0 conn(0x7f2814061680 msgr2=0x7f2814061ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:20.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 --2- 172.21.15.133:0/4142363785 >> v2:172.21.15.16:3300/0 conn(0x7f2814061680 0x7f2814061ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:20.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 -- 172.21.15.133:0/4142363785 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2814146bc0 con 0x7f2814061fd0 2021-01-03T13:05:20.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 -- 172.21.15.133:0/4142363785 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f280c001a50 con 0x7f2814061fd0 2021-01-03T13:05:20.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 -- 172.21.15.133:0/4142363785 >> v1:172.21.15.133:6789/0 conn(0x7f2814061fd0 legacy=0x7f2814142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:20.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 --2- 172.21.15.133:0/4142363785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f28140ac880 0x7f27f4003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:20.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 --2- 172.21.15.133:0/4142363785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27f4003c30 0x7f27f40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:20.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 --2- 172.21.15.133:0/4142363785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f40049c0 0x7f27f4004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:20.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 -- 172.21.15.133:0/4142363785 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2814146920 con 0x7f27f4003c30 2021-01-03T13:05:20.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 -- 172.21.15.133:0/4142363785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f40041c0 con 0x7f27f40049c0 2021-01-03T13:05:20.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 -- 172.21.15.133:0/4142363785 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f400b720 con 0x7f28140ac880 2021-01-03T13:05:20.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f281951d700 1 --2- 172.21.15.133:0/4142363785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f40049c0 0x7f27f4004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:20.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f2818d1c700 1 --2- 172.21.15.133:0/4142363785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f28140ac880 0x7f27f4003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:20.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f2813fff700 1 --2- 172.21.15.133:0/4142363785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27f4003c30 0x7f27f40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:20.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f281951d700 1 -- 172.21.15.133:0/4142363785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f28140ac880 msgr2=0x7f27f4003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:20.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f281951d700 1 --2- 172.21.15.133:0/4142363785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f28140ac880 0x7f27f4003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:20.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f281951d700 1 -- 172.21.15.133:0/4142363785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27f4003c30 msgr2=0x7f27f40044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:20.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f281951d700 1 --2- 172.21.15.133:0/4142363785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f27f4003c30 0x7f27f40044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:20.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f281951d700 1 -- 172.21.15.133:0/4142363785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f4003230 con 0x7f27f40049c0 2021-01-03T13:05:20.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f2818d1c700 1 --2- 172.21.15.133:0/4142363785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f28140ac880 0x7f27f4003720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:20.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f281951d700 1 --2- 172.21.15.133:0/4142363785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f40049c0 0x7f27f4004e40 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f280c001760 tx=0x7f2814063500).ready entity=mon.1 client_cookie=65eb948f031fcf20 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:20.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 -- 172.21.15.133:0/4142363785 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f280c005b70 con 0x7f27f40049c0 2021-01-03T13:05:20.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 -- 172.21.15.133:0/4142363785 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280c005cd0 con 0x7f27f40049c0 2021-01-03T13:05:20.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f28137fe700 1 -- 172.21.15.133:0/4142363785 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f280c0072c0 con 0x7f27f40049c0 2021-01-03T13:05:20.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f281af80700 1 -- 172.21.15.133:0/4142363785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f40049c0 msgr2=0x7f27f4004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:20.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f281af80700 1 --2- 172.21.15.133:0/4142363785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27f40049c0 0x7f27f4004e40 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f280c001760 tx=0x7f2814063500).stop 2021-01-03T13:05:20.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.770+0000 7f281951d700 1 -- 172.21.15.133:0/4142363785 reap_dead start 2021-01-03T13:05:20.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f281af80700 1 -- 172.21.15.133:0/4142363785 shutdown_connections 2021-01-03T13:05:20.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f281af80700 1 -- 172.21.15.133:0/4142363785 >> 172.21.15.133:0/4142363785 conn(0x7f281405bdf0 msgr2=0x7f281405c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:20.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f281af80700 1 -- 172.21.15.133:0/4142363785 shutdown_connections 2021-01-03T13:05:20.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f281af80700 1 -- 172.21.15.133:0/4142363785 wait complete. 2021-01-03T13:05:20.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f281af80700 1 Processor -- start 2021-01-03T13:05:20.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f281af80700 1 -- start start 2021-01-03T13:05:20.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f281af80700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28140aeab0 0x7f2814152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:20.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f281af80700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f281409cd60 0x7f28141417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:20.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f281af80700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2814141ca0 0x7f2814140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:20.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f281af80700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2814151b40 con 0x7f281409cd60 2021-01-03T13:05:20.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f281af80700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2814151d30 con 0x7f28140aeab0 2021-01-03T13:05:20.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f281af80700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2814151fd0 con 0x7f2814141ca0 2021-01-03T13:05:20.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f2818d1c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28140aeab0 0x7f2814152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:20.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f2818d1c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28140aeab0 0x7f2814152710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36820/0 (socket says 172.21.15.133:36820) 2021-01-03T13:05:20.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f2818d1c700 1 -- 172.21.15.133:0/792678672 learned_addr learned my addr 172.21.15.133:0/792678672 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:20.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f281951d700 1 --2- 172.21.15.133:0/792678672 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2814141ca0 0x7f2814140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:20.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f2813fff700 1 --2- 172.21.15.133:0/792678672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f281409cd60 0x7f28141417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:20.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f2818d1c700 1 -- 172.21.15.133:0/792678672 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2814141ca0 msgr2=0x7f2814140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:20.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f2818d1c700 1 --2- 172.21.15.133:0/792678672 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2814141ca0 0x7f2814140bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:20.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f2818d1c700 1 -- 172.21.15.133:0/792678672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f281409cd60 msgr2=0x7f28141417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:20.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f2818d1c700 1 --2- 172.21.15.133:0/792678672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f281409cd60 0x7f28141417b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:20.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f2818d1c700 1 -- 172.21.15.133:0/792678672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2814152270 con 0x7f28140aeab0 2021-01-03T13:05:20.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f2813fff700 1 --2- 172.21.15.133:0/792678672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f281409cd60 0x7f28141417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:20.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f2818d1c700 1 --2- 172.21.15.133:0/792678672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28140aeab0 0x7f2814152710 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f2804008000 tx=0x7f2804008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:20.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f2811ffb700 1 -- 172.21.15.133:0/792678672 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f280400e8a0 con 0x7f28140aeab0 2021-01-03T13:05:20.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f281af80700 1 -- 172.21.15.133:0/792678672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2814143bc0 con 0x7f28140aeab0 2021-01-03T13:05:20.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f2811ffb700 1 -- 172.21.15.133:0/792678672 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280400ea00 con 0x7f28140aeab0 2021-01-03T13:05:20.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f281af80700 1 -- 172.21.15.133:0/792678672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28140af030 con 0x7f28140aeab0 2021-01-03T13:05:20.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.774+0000 7f2811ffb700 1 -- 172.21.15.133:0/792678672 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f280400ed60 con 0x7f28140aeab0 2021-01-03T13:05:20.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.778+0000 7f2811ffb700 1 -- 172.21.15.133:0/792678672 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2804014470 con 0x7f28140aeab0 2021-01-03T13:05:20.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.778+0000 7f2811ffb700 1 --2- 172.21.15.133:0/792678672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27f8055440 0x7f27f8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:20.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.778+0000 7f2811ffb700 1 -- 172.21.15.133:0/792678672 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f280406e680 con 0x7f28140aeab0 2021-01-03T13:05:20.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.778+0000 7f2813fff700 1 --2- 172.21.15.133:0/792678672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27f8055440 0x7f27f8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:20.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.778+0000 7f281af80700 1 -- 172.21.15.133:0/792678672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2814057300 con 0x7f28140aeab0 2021-01-03T13:05:20.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.778+0000 7f2813fff700 1 --2- 172.21.15.133:0/792678672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27f8055440 0x7f27f8057900 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f27fc008000 tx=0x7f27fc008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:20.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.782+0000 7f2811ffb700 1 -- 172.21.15.133:0/792678672 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2804044880 con 0x7f28140aeab0 2021-01-03T13:05:20.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.962+0000 7f281af80700 1 -- 172.21.15.133:0/792678672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f281405ce00 con 0x7f28140aeab0 2021-01-03T13:05:20.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.962+0000 7f2811ffb700 1 -- 172.21.15.133:0/792678672 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f2804018030 con 0x7f28140aeab0 2021-01-03T13:05:20.966 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:20.967 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":38,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6523,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3593206473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3593206473},{"type":"v1","addr":"172.21.15.133:6835","nonce":3593206473}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/328558863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":328558863},{"type":"v1","addr":"172.21.15.133:6837","nonce":328558863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:08.865621+0000","modified":"2021-01-03T13:05:09.868458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/420953895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":420953895},{"type":"v1","addr":"172.21.15.16:6833","nonce":420953895}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-01-03T13:05:20.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.962+0000 7f281af80700 1 -- 172.21.15.133:0/792678672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27f8055440 msgr2=0x7f27f8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:20.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.962+0000 7f281af80700 1 --2- 172.21.15.133:0/792678672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27f8055440 0x7f27f8057900 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f27fc008000 tx=0x7f27fc008040).stop 2021-01-03T13:05:20.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.962+0000 7f281af80700 1 -- 172.21.15.133:0/792678672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28140aeab0 msgr2=0x7f2814152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:20.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.962+0000 7f281af80700 1 --2- 172.21.15.133:0/792678672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28140aeab0 0x7f2814152710 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f2804008000 tx=0x7f2804008040).stop 2021-01-03T13:05:20.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.962+0000 7f281af80700 1 -- 172.21.15.133:0/792678672 shutdown_connections 2021-01-03T13:05:20.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.962+0000 7f281af80700 1 --2- 172.21.15.133:0/792678672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f27f8055440 0x7f27f8057900 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:20.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.962+0000 7f281af80700 1 --2- 172.21.15.133:0/792678672 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2814141ca0 0x7f2814140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:20.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.962+0000 7f281af80700 1 --2- 172.21.15.133:0/792678672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f28140aeab0 0x7f2814152710 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:20.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.962+0000 7f281af80700 1 --2- 172.21.15.133:0/792678672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f281409cd60 0x7f28141417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:20.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.962+0000 7f281af80700 1 -- 172.21.15.133:0/792678672 >> 172.21.15.133:0/792678672 conn(0x7f281405bdf0 msgr2=0x7f28141440f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:20.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.962+0000 7f281af80700 1 -- 172.21.15.133:0/792678672 shutdown_connections 2021-01-03T13:05:20.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:20.962+0000 7f281af80700 1 -- 172.21.15.133:0/792678672 wait complete. 2021-01-03T13:05:20.971 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 38 2021-01-03T13:05:20.980 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump inode 1 2021-01-03T13:05:21.107 INFO:teuthology.orchestra.run.smithi016.stdout:{"path":"/","ino":1,"rdev":0,"ctime":"2021-01-03T13:05:16.553228+0000","btime":"2021-01-03T13:05:08.872541+0000","mode":17407,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":16,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":0,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-01-03T13:05:08.872541+0000","atime":"0.000000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-01-03T13:05:16.553228+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2021-01-03T13:05:08.872541+0000"},"version":3,"file_data_version":0,"xattr_version":1,"backtrace_version":3,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"request":1,"lock":3,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":1},"nref":9,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":1,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"xlockdone","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":1,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{"gather_set":[],"state":"sync","is_leased":false,"num_rdlocks":1,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"nestlock":{},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent"],"client_caps":[{"client_id":6588,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2},{"client_id":6736,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2}],"loner":-1,"want_loner":-1,"mds_caps_wanted":[]} 2021-01-03T13:05:21.108 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "2021-01-03T13:05:08.872541+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "0.000000", "auth_pins": 2, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 1, "state": "xlockdone", "xlock_by": {} }, "backtrace_version": 3, "btime": "2021-01-03T13:05:08.872541+0000", "change_attr": 1, "client_caps": [ { "client_id": 6588, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" }, { "client_id": 6736, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-01-03T13:05:16.553228+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 0, "ino": 1, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 16, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 17407, "mtime": "2021-01-03T13:05:08.872541+0000", "nestlock": {}, "nlink": 1, "nref": 9, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/", "pins": { "authpin": 1, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 3, "request": 1 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2021-01-03T13:05:16.553228+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": { "gather_set": [], "is_leased": false, "num_rdlocks": 1, "num_wrlocks": 0, "num_xlocks": 0, "state": "sync", "xlock_by": {} }, "states": [ "auth", "dirty", "dirtyparent" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "uid": 0, "version": 3, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2021-01-03T13:05:21.108 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:05:21.109 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:05:21.128 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:05:21.147 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:05:21.166 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:05:21.186 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:05:21.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:21.187 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:05:21.187 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:21.195 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:05:21.196 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:05:21.197 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T13:05:21.197 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:05:21.197 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:21.279 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12361]: fuse finished with error 0 and tester_r 0 2021-01-03T13:05:21.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:21.281 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:05:21.281 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:21.330 INFO:teuthology.orchestra.run.smithi007.stdout:ext2/ext3 2021-01-03T13:05:21.331 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:05:21.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:05:21.444 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:21.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:21.494 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:05:21.495 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:21.503 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:05:21.504 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:05:21.504 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi036.front.sepia.ceph.com... 2021-01-03T13:05:21.505 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:05:21.505 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:21.583 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[11884]: fuse finished with error 0 and tester_r 0 2021-01-03T13:05:21.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:21.585 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:05:21.585 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:21.632 INFO:teuthology.orchestra.run.smithi036.stdout:ext2/ext3 2021-01-03T13:05:21.633 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:05:21.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:05:21.682 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:21.689 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-01-03T13:05:21.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4b59e700 1 Processor -- start 2021-01-03T13:05:21.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4b59e700 1 -- start start 2021-01-03T13:05:21.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4b59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed4c0b5ae0 0x7fed4c0abd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:21.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4b59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fed4c099ff0 0x7fed4c13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:21.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4b59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c0b5710 con 0x7fed4c0b5330 2021-01-03T13:05:21.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4b59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c0b10f0 con 0x7fed4c099ff0 2021-01-03T13:05:21.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4b59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0ac270 con 0x7fed4c0b5ae0 2021-01-03T13:05:21.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4a59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fed4c0b5330 0x7fed4c142c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57860/0 (socket says 172.21.15.133:57860) 2021-01-03T13:05:21.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4a59c700 1 -- 172.21.15.133:0/908181319 learned_addr learned my addr 172.21.15.133:0/908181319 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:21.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed49d9b700 1 --2- 172.21.15.133:0/908181319 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed4c0b5ae0 0x7fed4c0abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:21.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4ad9d700 1 --2- 172.21.15.133:0/908181319 >> v2:172.21.15.16:3300/0 conn(0x7fed4c099ff0 0x7fed4c13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:21.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 -- 172.21.15.133:0/908181319 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986893492 0 0) 0x7fed4c0b5710 con 0x7fed4c0b5330 2021-01-03T13:05:21.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 -- 172.21.15.133:0/908181319 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed2c003230 con 0x7fed4c0b5330 2021-01-03T13:05:21.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 -- 172.21.15.133:0/908181319 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1392352395 0 0) 0x7fed2c003230 con 0x7fed4c0b5330 2021-01-03T13:05:21.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 -- 172.21.15.133:0/908181319 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed4c0b5ae0 msgr2=0x7fed4c0abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:21.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 --2- 172.21.15.133:0/908181319 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed4c0b5ae0 0x7fed4c0abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:21.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 -- 172.21.15.133:0/908181319 >> v2:172.21.15.16:3300/0 conn(0x7fed4c099ff0 msgr2=0x7fed4c13fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:21.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 --2- 172.21.15.133:0/908181319 >> v2:172.21.15.16:3300/0 conn(0x7fed4c099ff0 0x7fed4c13fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:21.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 -- 172.21.15.133:0/908181319 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c0ab280 con 0x7fed4c0b5330 2021-01-03T13:05:21.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 -- 172.21.15.133:0/908181319 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fed3c0016d0 con 0x7fed4c0b5330 2021-01-03T13:05:21.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 -- 172.21.15.133:0/908181319 >> v1:172.21.15.133:6789/0 conn(0x7fed4c0b5330 legacy=0x7fed4c142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:21.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 --2- 172.21.15.133:0/908181319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed2c0037a0 0x7fed2c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:21.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 --2- 172.21.15.133:0/908181319 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed4c0b5ae0 0x7fed2c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:21.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 --2- 172.21.15.133:0/908181319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed2c0049c0 0x7fed2c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:21.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 -- 172.21.15.133:0/908181319 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0b10f0 con 0x7fed2c0037a0 2021-01-03T13:05:21.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 -- 172.21.15.133:0/908181319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0ac270 con 0x7fed2c0049c0 2021-01-03T13:05:21.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 -- 172.21.15.133:0/908181319 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c004290 con 0x7fed4c0b5ae0 2021-01-03T13:05:21.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4ad9d700 1 --2- 172.21.15.133:0/908181319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed2c0049c0 0x7fed2c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:21.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4a59c700 1 --2- 172.21.15.133:0/908181319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed2c0037a0 0x7fed2c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:21.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed49d9b700 1 --2- 172.21.15.133:0/908181319 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed4c0b5ae0 0x7fed2c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:21.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4ad9d700 1 -- 172.21.15.133:0/908181319 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed4c0b5ae0 msgr2=0x7fed2c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:21.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4ad9d700 1 --2- 172.21.15.133:0/908181319 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed4c0b5ae0 0x7fed2c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:21.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4ad9d700 1 -- 172.21.15.133:0/908181319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed2c0037a0 msgr2=0x7fed2c003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:21.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4ad9d700 1 --2- 172.21.15.133:0/908181319 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed2c0037a0 0x7fed2c003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:21.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4ad9d700 1 -- 172.21.15.133:0/908181319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c003230 con 0x7fed2c0049c0 2021-01-03T13:05:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed49d9b700 1 --2- 172.21.15.133:0/908181319 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed4c0b5ae0 0x7fed2c0044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4ad9d700 1 --2- 172.21.15.133:0/908181319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed2c0049c0 0x7fed2c004e40 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fed4400c000 tx=0x7fed440091a0).ready entity=mon.1 client_cookie=4e0dbb4796cf0fd4 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 -- 172.21.15.133:0/908181319 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed4400ed00 con 0x7fed2c0049c0 2021-01-03T13:05:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 -- 172.21.15.133:0/908181319 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4400ee60 con 0x7fed2c0049c0 2021-01-03T13:05:21.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.809+0000 7fed4959a700 1 -- 172.21.15.133:0/908181319 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed440125e0 con 0x7fed2c0049c0 2021-01-03T13:05:21.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.813+0000 7fed4b59e700 1 -- 172.21.15.133:0/908181319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed2c0049c0 msgr2=0x7fed2c004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:21.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.813+0000 7fed4b59e700 1 --2- 172.21.15.133:0/908181319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed2c0049c0 0x7fed2c004e40 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7fed4400c000 tx=0x7fed440091a0).stop 2021-01-03T13:05:21.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.813+0000 7fed4ad9d700 1 -- 172.21.15.133:0/908181319 reap_dead start 2021-01-03T13:05:21.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.813+0000 7fed4b59e700 1 -- 172.21.15.133:0/908181319 shutdown_connections 2021-01-03T13:05:21.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.813+0000 7fed4b59e700 1 -- 172.21.15.133:0/908181319 >> 172.21.15.133:0/908181319 conn(0x7fed4c05bdf0 msgr2=0x7fed4c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:21.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.813+0000 7fed4b59e700 1 -- 172.21.15.133:0/908181319 shutdown_connections 2021-01-03T13:05:21.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.813+0000 7fed4b59e700 1 -- 172.21.15.133:0/908181319 wait complete. 2021-01-03T13:05:21.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.813+0000 7fed4b59e700 1 Processor -- start 2021-01-03T13:05:21.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.813+0000 7fed4b59e700 1 -- start start 2021-01-03T13:05:21.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4b59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed4c146810 0x7fed4c0ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:21.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4b59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed4c0ac440 0x7fed4c0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:21.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed4c13dee0 0x7fed4c13e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:21.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4b59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c145540 con 0x7fed4c0ac440 2021-01-03T13:05:21.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c146bf0 con 0x7fed4c13dee0 2021-01-03T13:05:21.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4b59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0af330 con 0x7fed4c146810 2021-01-03T13:05:21.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed4c13dee0 0x7fed4c13e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:21.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4a59c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed4c146810 0x7fed4c0ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:21.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed4c13dee0 0x7fed4c13e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36844/0 (socket says 172.21.15.133:36844) 2021-01-03T13:05:21.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4ad9d700 1 -- 172.21.15.133:0/3150349714 learned_addr learned my addr 172.21.15.133:0/3150349714 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:21.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed49d9b700 1 --2- 172.21.15.133:0/3150349714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed4c0ac440 0x7fed4c0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:21.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4ad9d700 1 -- 172.21.15.133:0/3150349714 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed4c146810 msgr2=0x7fed4c0ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:21.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4ad9d700 1 --2- 172.21.15.133:0/3150349714 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed4c146810 0x7fed4c0ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:21.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4ad9d700 1 -- 172.21.15.133:0/3150349714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed4c0ac440 msgr2=0x7fed4c0aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:21.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4ad9d700 1 --2- 172.21.15.133:0/3150349714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed4c0ac440 0x7fed4c0aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:21.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4ad9d700 1 -- 172.21.15.133:0/3150349714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c146210 con 0x7fed4c13dee0 2021-01-03T13:05:21.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4ad9d700 1 --2- 172.21.15.133:0/3150349714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed4c13dee0 0x7fed4c13e370 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7fed4c1448c0 tx=0x7fed4401a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:21.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed437fe700 1 -- 172.21.15.133:0/3150349714 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed440127f0 con 0x7fed4c13dee0 2021-01-03T13:05:21.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed437fe700 1 -- 172.21.15.133:0/3150349714 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed440095c0 con 0x7fed4c13dee0 2021-01-03T13:05:21.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4b59e700 1 -- 172.21.15.133:0/3150349714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c0adc50 con 0x7fed4c13dee0 2021-01-03T13:05:21.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed437fe700 1 -- 172.21.15.133:0/3150349714 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed44012b40 con 0x7fed4c13dee0 2021-01-03T13:05:21.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.817+0000 7fed4b59e700 1 -- 172.21.15.133:0/3150349714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c0ae190 con 0x7fed4c13dee0 2021-01-03T13:05:21.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.821+0000 7fed4b59e700 1 -- 172.21.15.133:0/3150349714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c057300 con 0x7fed4c13dee0 2021-01-03T13:05:21.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.821+0000 7fed437fe700 1 -- 172.21.15.133:0/3150349714 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fed4402d070 con 0x7fed4c13dee0 2021-01-03T13:05:21.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.821+0000 7fed437fe700 1 --2- 172.21.15.133:0/3150349714 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fed30055440 0x7fed30057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:21.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.821+0000 7fed437fe700 1 -- 172.21.15.133:0/3150349714 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fed4406f820 con 0x7fed4c13dee0 2021-01-03T13:05:21.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.821+0000 7fed4a59c700 1 --2- 172.21.15.133:0/3150349714 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fed30055440 0x7fed30057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:21.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.821+0000 7fed4a59c700 1 --2- 172.21.15.133:0/3150349714 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fed30055440 0x7fed30057900 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fed3c00d000 tx=0x7fed3c007040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:21.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.829+0000 7fed437fe700 1 -- 172.21.15.133:0/3150349714 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fed44045a80 con 0x7fed4c13dee0 2021-01-03T13:05:21.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.969+0000 7fed4b59e700 1 -- 172.21.15.133:0/3150349714 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fed4c05ce00 con 0x7fed4c13dee0 2021-01-03T13:05:21.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.981+0000 7fed437fe700 1 -- 172.21.15.133:0/3150349714 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fed440490a0 con 0x7fed4c13dee0 2021-01-03T13:05:21.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.985+0000 7fed4b59e700 1 -- 172.21.15.133:0/3150349714 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fed30055440 msgr2=0x7fed30057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:21.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.985+0000 7fed4b59e700 1 --2- 172.21.15.133:0/3150349714 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fed30055440 0x7fed30057900 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fed3c00d000 tx=0x7fed3c007040).stop 2021-01-03T13:05:21.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.985+0000 7fed4b59e700 1 -- 172.21.15.133:0/3150349714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed4c13dee0 msgr2=0x7fed4c13e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:21.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.985+0000 7fed4b59e700 1 --2- 172.21.15.133:0/3150349714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed4c13dee0 0x7fed4c13e370 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7fed4c1448c0 tx=0x7fed4401a000).stop 2021-01-03T13:05:21.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.985+0000 7fed4b59e700 1 -- 172.21.15.133:0/3150349714 shutdown_connections 2021-01-03T13:05:21.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.985+0000 7fed4b59e700 1 --2- 172.21.15.133:0/3150349714 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fed30055440 0x7fed30057900 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:21.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.985+0000 7fed4b59e700 1 --2- 172.21.15.133:0/3150349714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed4c13dee0 0x7fed4c13e370 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:21.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.985+0000 7fed4b59e700 1 --2- 172.21.15.133:0/3150349714 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fed4c146810 0x7fed4c0ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:21.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.985+0000 7fed4b59e700 1 --2- 172.21.15.133:0/3150349714 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed4c0ac440 0x7fed4c0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:21.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.985+0000 7fed4b59e700 1 -- 172.21.15.133:0/3150349714 >> 172.21.15.133:0/3150349714 conn(0x7fed4c05bdf0 msgr2=0x7fed4c0af920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:21.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.985+0000 7fed4b59e700 1 -- 172.21.15.133:0/3150349714 shutdown_connections 2021-01-03T13:05:21.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:21.985+0000 7fed4b59e700 1 -- 172.21.15.133:0/3150349714 wait complete. 2021-01-03T13:05:22.006 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2021-01-03T13:05:22.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.105+0000 7f7f5ccaf700 1 Processor -- start 2021-01-03T13:05:22.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.105+0000 7f7f5ccaf700 1 -- start start 2021-01-03T13:05:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5ccaf700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7f581437e0 0x7f7f580b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5ccaf700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f5805c510 con 0x7f7f5805cc10 2021-01-03T13:05:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5ccaf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f58147190 con 0x7f7f5805c130 2021-01-03T13:05:22.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5ccaf700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f580b5c10 con 0x7f7f581437e0 2021-01-03T13:05:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5659c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7f5805c130 0x7f7f58146370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57880/0 (socket says 172.21.15.133:57880) 2021-01-03T13:05:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5659c700 1 -- 172.21.15.133:0/379490627 learned_addr learned my addr 172.21.15.133:0/379490627 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:22.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f56d9d700 1 --2- 172.21.15.133:0/379490627 >> v2:172.21.15.16:3300/0 conn(0x7f7f581437e0 0x7f7f580b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:22.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 -- 172.21.15.133:0/379490627 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069076697 0 0) 0x7f7f58147190 con 0x7f7f5805c130 2021-01-03T13:05:22.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 -- 172.21.15.133:0/379490627 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f38003230 con 0x7f7f5805c130 2021-01-03T13:05:22.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 -- 172.21.15.133:0/379490627 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3754767191 0 0) 0x7f7f38003230 con 0x7f7f5805c130 2021-01-03T13:05:22.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 -- 172.21.15.133:0/379490627 >> v2:172.21.15.16:3300/0 conn(0x7f7f581437e0 msgr2=0x7f7f580b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:22.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 --2- 172.21.15.133:0/379490627 >> v2:172.21.15.16:3300/0 conn(0x7f7f581437e0 0x7f7f580b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:22.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 -- 172.21.15.133:0/379490627 >> v1:172.21.15.16:6789/0 conn(0x7f7f5805cc10 legacy=0x7f7f58146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:22.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 -- 172.21.15.133:0/379490627 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f580af8f0 con 0x7f7f5805c130 2021-01-03T13:05:22.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 -- 172.21.15.133:0/379490627 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f7f480016d0 con 0x7f7f5805c130 2021-01-03T13:05:22.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 -- 172.21.15.133:0/379490627 >> v1:172.21.15.133:6789/0 conn(0x7f7f5805c130 legacy=0x7f7f58146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:22.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 --2- 172.21.15.133:0/379490627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f38003720 0x7f7f38003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:22.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 --2- 172.21.15.133:0/379490627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f380044d0 0x7f7f38004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:22.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 --2- 172.21.15.133:0/379490627 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f38004e40 0x7f7f3800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:22.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 -- 172.21.15.133:0/379490627 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f580b5c10 con 0x7f7f38003720 2021-01-03T13:05:22.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 -- 172.21.15.133:0/379490627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f38004250 con 0x7f7f380044d0 2021-01-03T13:05:22.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 -- 172.21.15.133:0/379490627 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3800bc10 con 0x7f7f38004e40 2021-01-03T13:05:22.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5659c700 1 --2- 172.21.15.133:0/379490627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f38003720 0x7f7f38003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:22.120 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f55d9b700 1 --2- 172.21.15.133:0/379490627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f380044d0 0x7f7f38004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:22.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f56d9d700 1 --2- 172.21.15.133:0/379490627 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f38004e40 0x7f7f3800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:22.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5659c700 1 -- 172.21.15.133:0/379490627 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f38004e40 msgr2=0x7f7f3800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5659c700 1 --2- 172.21.15.133:0/379490627 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f38004e40 0x7f7f3800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5659c700 1 -- 172.21.15.133:0/379490627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f380044d0 msgr2=0x7f7f38004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5659c700 1 --2- 172.21.15.133:0/379490627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f380044d0 0x7f7f38004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5659c700 1 -- 172.21.15.133:0/379490627 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f38003230 con 0x7f7f38003720 2021-01-03T13:05:22.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f56d9d700 1 -- 172.21.15.133:0/379490627 reap_dead start 2021-01-03T13:05:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f55d9b700 1 --2- 172.21.15.133:0/379490627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f380044d0 0x7f7f38004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5659c700 1 --2- 172.21.15.133:0/379490627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f38003720 0x7f7f38003b40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f7f480013e0 tx=0x7f7f580af690).ready entity=mon.0 client_cookie=b111c31745fa2e1d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 -- 172.21.15.133:0/379490627 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f480070d0 con 0x7f7f38003720 2021-01-03T13:05:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 -- 172.21.15.133:0/379490627 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f48007230 con 0x7f7f38003720 2021-01-03T13:05:22.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5559a700 1 -- 172.21.15.133:0/379490627 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f480055e0 con 0x7f7f38003720 2021-01-03T13:05:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5ccaf700 1 -- 172.21.15.133:0/379490627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f38003720 msgr2=0x7f7f38003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5ccaf700 1 --2- 172.21.15.133:0/379490627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f38003720 0x7f7f38003b40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f7f480013e0 tx=0x7f7f580af690).stop 2021-01-03T13:05:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5ccaf700 1 -- 172.21.15.133:0/379490627 shutdown_connections 2021-01-03T13:05:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5ccaf700 1 --2- 172.21.15.133:0/379490627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f38003720 0x7f7f38003b40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:22.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5ccaf700 1 -- 172.21.15.133:0/379490627 >> 172.21.15.133:0/379490627 conn(0x7f7f580b95d0 msgr2=0x7f7f580b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:22.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5ccaf700 1 -- 172.21.15.133:0/379490627 shutdown_connections 2021-01-03T13:05:22.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.109+0000 7f7f5ccaf700 1 -- 172.21.15.133:0/379490627 wait complete. 2021-01-03T13:05:22.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.113+0000 7f7f5ccaf700 1 Processor -- start 2021-01-03T13:05:22.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.113+0000 7f7f5ccaf700 1 -- start start 2021-01-03T13:05:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f5ccaf700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f38003720 0x7f7f5809f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f5ccaf700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f580b71d0 0x7f7f58155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:22.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f5ccaf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f58156210 0x7f7f58137770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:22.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f5ccaf700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f58155650 con 0x7f7f580b71d0 2021-01-03T13:05:22.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f5ccaf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f58062d60 con 0x7f7f58156210 2021-01-03T13:05:22.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f5ccaf700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f58142000 con 0x7f7f38003720 2021-01-03T13:05:22.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f56d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f58156210 0x7f7f58137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:22.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f5659c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f38003720 0x7f7f5809f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:22.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f56d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f58156210 0x7f7f58137770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36864/0 (socket says 172.21.15.133:36864) 2021-01-03T13:05:22.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f55d9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f580b71d0 0x7f7f58155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:22.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f56d9d700 1 -- 172.21.15.133:0/2614591857 learned_addr learned my addr 172.21.15.133:0/2614591857 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:22.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f56d9d700 1 -- 172.21.15.133:0/2614591857 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f38003720 msgr2=0x7f7f5809f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:22.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f56d9d700 1 --2- 172.21.15.133:0/2614591857 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f38003720 0x7f7f5809f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:22.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f56d9d700 1 -- 172.21.15.133:0/2614591857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f580b71d0 msgr2=0x7f7f58155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:22.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f56d9d700 1 --2- 172.21.15.133:0/2614591857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f580b71d0 0x7f7f58155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:22.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f56d9d700 1 -- 172.21.15.133:0/2614591857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f581422a0 con 0x7f7f58156210 2021-01-03T13:05:22.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f55d9b700 1 --2- 172.21.15.133:0/2614591857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f580b71d0 0x7f7f58155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:22.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f56d9d700 1 --2- 172.21.15.133:0/2614591857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f58156210 0x7f7f58137770 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f7f58140690 tx=0x7f7f500091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:22.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f4f7fe700 1 -- 172.21.15.133:0/2614591857 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f50019070 con 0x7f7f58156210 2021-01-03T13:05:22.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f4f7fe700 1 -- 172.21.15.133:0/2614591857 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5000fab0 con 0x7f7f58156210 2021-01-03T13:05:22.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f5ccaf700 1 -- 172.21.15.133:0/2614591857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f58155880 con 0x7f7f58156210 2021-01-03T13:05:22.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f4f7fe700 1 -- 172.21.15.133:0/2614591857 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f5000fe10 con 0x7f7f58156210 2021-01-03T13:05:22.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f5ccaf700 1 -- 172.21.15.133:0/2614591857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5809c780 con 0x7f7f58156210 2021-01-03T13:05:22.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.117+0000 7f7f5ccaf700 1 -- 172.21.15.133:0/2614591857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f58057300 con 0x7f7f58156210 2021-01-03T13:05:22.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.121+0000 7f7f4f7fe700 1 -- 172.21.15.133:0/2614591857 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7f50014440 con 0x7f7f58156210 2021-01-03T13:05:22.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.121+0000 7f7f4f7fe700 1 --2- 172.21.15.133:0/2614591857 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7f3c0553b0 0x7f7f3c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:22.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.121+0000 7f7f4f7fe700 1 -- 172.21.15.133:0/2614591857 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7f5006e850 con 0x7f7f58156210 2021-01-03T13:05:22.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.121+0000 7f7f5659c700 1 --2- 172.21.15.133:0/2614591857 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7f3c0553b0 0x7f7f3c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:22.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.121+0000 7f7f5659c700 1 --2- 172.21.15.133:0/2614591857 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7f3c0553b0 0x7f7f3c057870 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f7f4801a000 tx=0x7f7f48015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:22.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.125+0000 7f7f4f7fe700 1 -- 172.21.15.133:0/2614591857 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7f50044af0 con 0x7f7f58156210 2021-01-03T13:05:22.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:22.313+0000 7f7f5ccaf700 1 -- 172.21.15.133:0/2614591857 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f7f5805c9f0 con 0x7f7f58156210 2021-01-03T13:05:23.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.269+0000 7f7f4f7fe700 1 -- 172.21.15.133:0/2614591857 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v323) v1 ==== 126+0+0 (secure 0 0 0) 0x7f7f50048110 con 0x7f7f58156210 2021-01-03T13:05:23.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.273+0000 7f7f5ccaf700 1 -- 172.21.15.133:0/2614591857 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7f3c0553b0 msgr2=0x7f7f3c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:23.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.273+0000 7f7f5ccaf700 1 --2- 172.21.15.133:0/2614591857 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7f3c0553b0 0x7f7f3c057870 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f7f4801a000 tx=0x7f7f48015000).stop 2021-01-03T13:05:23.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.273+0000 7f7f5ccaf700 1 -- 172.21.15.133:0/2614591857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f58156210 msgr2=0x7f7f58137770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:23.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.273+0000 7f7f5ccaf700 1 --2- 172.21.15.133:0/2614591857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f58156210 0x7f7f58137770 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f7f58140690 tx=0x7f7f500091a0).stop 2021-01-03T13:05:23.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.273+0000 7f7f5ccaf700 1 -- 172.21.15.133:0/2614591857 shutdown_connections 2021-01-03T13:05:23.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.273+0000 7f7f5ccaf700 1 --2- 172.21.15.133:0/2614591857 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7f3c0553b0 0x7f7f3c057870 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:23.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.273+0000 7f7f5ccaf700 1 --2- 172.21.15.133:0/2614591857 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f58156210 0x7f7f58137770 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:23.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.273+0000 7f7f5ccaf700 1 --2- 172.21.15.133:0/2614591857 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f38003720 0x7f7f5809f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:23.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.273+0000 7f7f5ccaf700 1 --2- 172.21.15.133:0/2614591857 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f580b71d0 0x7f7f58155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:23.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.273+0000 7f7f5ccaf700 1 -- 172.21.15.133:0/2614591857 >> 172.21.15.133:0/2614591857 conn(0x7f7f580b95d0 msgr2=0x7f7f581457d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:23.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.273+0000 7f7f5ccaf700 1 -- 172.21.15.133:0/2614591857 shutdown_connections 2021-01-03T13:05:23.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.277+0000 7f7f5ccaf700 1 -- 172.21.15.133:0/2614591857 wait complete. 2021-01-03T13:05:23.297 INFO:tasks.cephfs_test_runner:test_dump_inode (tasks.cephfs.test_misc.TestMisc) ... ok 2021-01-03T13:05:23.298 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) 2021-01-03T13:05:23.298 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-01-03T13:05:23.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc132fe5700 1 Processor -- start 2021-01-03T13:05:23.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc132fe5700 1 -- start start 2021-01-03T13:05:23.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc132fe5700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc12c0b5a70 0x7fc12c140270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:23.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc132fe5700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc12c146480 con 0x7fc12c0ac1a0 2021-01-03T13:05:23.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc132fe5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc12c146720 con 0x7fc12c143520 2021-01-03T13:05:23.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc132fe5700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c1469c0 con 0x7fc12c0b5a70 2021-01-03T13:05:23.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc131582700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc12c143520 0x7fc12c14d780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57902/0 (socket says 172.21.15.133:57902) 2021-01-03T13:05:23.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc131582700 1 -- 172.21.15.133:0/4010899477 learned_addr learned my addr 172.21.15.133:0/4010899477 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:23.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc130d81700 1 --2- 172.21.15.133:0/4010899477 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc12c0b5a70 0x7fc12c140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:23.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc12b7fe700 1 -- 172.21.15.133:0/4010899477 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469918162 0 0) 0x7fc12c146720 con 0x7fc12c143520 2021-01-03T13:05:23.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc12b7fe700 1 -- 172.21.15.133:0/4010899477 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc10c003230 con 0x7fc12c143520 2021-01-03T13:05:23.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc12b7fe700 1 -- 172.21.15.133:0/4010899477 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591967283 0 0) 0x7fc12c146480 con 0x7fc12c0ac1a0 2021-01-03T13:05:23.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc12b7fe700 1 -- 172.21.15.133:0/4010899477 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc12c146720 con 0x7fc12c0ac1a0 2021-01-03T13:05:23.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc130d81700 1 -- 172.21.15.133:0/4010899477 >> v1:172.21.15.133:6789/0 conn(0x7fc12c143520 legacy=0x7fc12c14d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:23.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc130d81700 1 -- 172.21.15.133:0/4010899477 >> v1:172.21.15.16:6789/0 conn(0x7fc12c0ac1a0 legacy=0x7fc12c142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:23.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc130d81700 1 -- 172.21.15.133:0/4010899477 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c146c60 con 0x7fc12c0b5a70 2021-01-03T13:05:23.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc130d81700 1 --2- 172.21.15.133:0/4010899477 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc12c0b5a70 0x7fc12c140270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fc1240032b0 tx=0x7fc1240091a0).ready entity=mon.2 client_cookie=4dd8880a4e3608fc server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:23.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc12b7fe700 1 -- 172.21.15.133:0/4010899477 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc12400b940 con 0x7fc12c0b5a70 2021-01-03T13:05:23.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc12b7fe700 1 -- 172.21.15.133:0/4010899477 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12400baa0 con 0x7fc12c0b5a70 2021-01-03T13:05:23.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc12b7fe700 1 -- 172.21.15.133:0/4010899477 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc12400bc10 con 0x7fc12c0b5a70 2021-01-03T13:05:23.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc132fe5700 1 -- 172.21.15.133:0/4010899477 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc12c0b5a70 msgr2=0x7fc12c140270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:23.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.409+0000 7fc132fe5700 1 --2- 172.21.15.133:0/4010899477 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc12c0b5a70 0x7fc12c140270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fc1240032b0 tx=0x7fc1240091a0).stop 2021-01-03T13:05:23.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc132fe5700 1 -- 172.21.15.133:0/4010899477 shutdown_connections 2021-01-03T13:05:23.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc132fe5700 1 --2- 172.21.15.133:0/4010899477 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc12c0b5a70 0x7fc12c140270 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:23.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc132fe5700 1 -- 172.21.15.133:0/4010899477 >> 172.21.15.133:0/4010899477 conn(0x7fc12c05c8c0 msgr2=0x7fc12c0b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:23.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc132fe5700 1 -- 172.21.15.133:0/4010899477 shutdown_connections 2021-01-03T13:05:23.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc132fe5700 1 -- 172.21.15.133:0/4010899477 wait complete. 2021-01-03T13:05:23.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc132fe5700 1 Processor -- start 2021-01-03T13:05:23.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc132fe5700 1 -- start start 2021-01-03T13:05:23.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc132fe5700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc12c0b5a70 0x7fc12c142e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:23.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc132fe5700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc12c143520 0x7fc12c1454e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:23.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc132fe5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc12c151b40 0x7fc12c155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:23.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc132fe5700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c1551a0 con 0x7fc12c0b5a70 2021-01-03T13:05:23.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc132fe5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c142190 con 0x7fc12c151b40 2021-01-03T13:05:23.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc132fe5700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c141c50 con 0x7fc12c143520 2021-01-03T13:05:23.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc131582700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc12c151b40 0x7fc12c155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:23.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc130d81700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc12c0b5a70 0x7fc12c142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:23.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc131582700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc12c151b40 0x7fc12c155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36878/0 (socket says 172.21.15.133:36878) 2021-01-03T13:05:23.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc131582700 1 -- 172.21.15.133:0/1214686948 learned_addr learned my addr 172.21.15.133:0/1214686948 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:23.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc12bfff700 1 --2- 172.21.15.133:0/1214686948 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc12c143520 0x7fc12c1454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:23.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc131582700 1 -- 172.21.15.133:0/1214686948 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc12c143520 msgr2=0x7fc12c1454e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:23.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc131582700 1 --2- 172.21.15.133:0/1214686948 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc12c143520 0x7fc12c1454e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:23.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc131582700 1 -- 172.21.15.133:0/1214686948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc12c0b5a70 msgr2=0x7fc12c142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:23.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.413+0000 7fc131582700 1 --2- 172.21.15.133:0/1214686948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc12c0b5a70 0x7fc12c142e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:23.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.417+0000 7fc131582700 1 -- 172.21.15.133:0/1214686948 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c141ef0 con 0x7fc12c151b40 2021-01-03T13:05:23.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.417+0000 7fc130d81700 1 --2- 172.21.15.133:0/1214686948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc12c0b5a70 0x7fc12c142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:23.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.417+0000 7fc12bfff700 1 --2- 172.21.15.133:0/1214686948 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc12c143520 0x7fc12c1454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:23.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.417+0000 7fc131582700 1 --2- 172.21.15.133:0/1214686948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc12c151b40 0x7fc12c155600 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fc11c0010d0 tx=0x7fc11c007a50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:23.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.417+0000 7fc129ffb700 1 -- 172.21.15.133:0/1214686948 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc11c0072e0 con 0x7fc12c151b40 2021-01-03T13:05:23.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.417+0000 7fc129ffb700 1 -- 172.21.15.133:0/1214686948 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c007440 con 0x7fc12c151b40 2021-01-03T13:05:23.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.417+0000 7fc129ffb700 1 -- 172.21.15.133:0/1214686948 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc11c0057d0 con 0x7fc12c151b40 2021-01-03T13:05:23.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.417+0000 7fc132fe5700 1 -- 172.21.15.133:0/1214686948 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc12c14a280 con 0x7fc12c151b40 2021-01-03T13:05:23.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.417+0000 7fc132fe5700 1 -- 172.21.15.133:0/1214686948 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12c155af0 con 0x7fc12c151b40 2021-01-03T13:05:23.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.417+0000 7fc132fe5700 1 -- 172.21.15.133:0/1214686948 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12c057300 con 0x7fc12c151b40 2021-01-03T13:05:23.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.417+0000 7fc129ffb700 1 -- 172.21.15.133:0/1214686948 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc11c010070 con 0x7fc12c151b40 2021-01-03T13:05:23.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.417+0000 7fc129ffb700 1 --2- 172.21.15.133:0/1214686948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc1100553f0 0x7fc1100578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:23.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.417+0000 7fc129ffb700 1 -- 172.21.15.133:0/1214686948 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc11c06d580 con 0x7fc12c151b40 2021-01-03T13:05:23.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.417+0000 7fc130d81700 1 --2- 172.21.15.133:0/1214686948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc1100553f0 0x7fc1100578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:23.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.421+0000 7fc130d81700 1 --2- 172.21.15.133:0/1214686948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc1100553f0 0x7fc1100578b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fc124019000 tx=0x7fc124016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:23.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.425+0000 7fc129ffb700 1 -- 172.21.15.133:0/1214686948 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc11c043770 con 0x7fc12c151b40 2021-01-03T13:05:23.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:23.613+0000 7fc132fe5700 1 -- 172.21.15.133:0/1214686948 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7fc12c05ce00 con 0x7fc12c151b40 2021-01-03T13:05:24.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.273+0000 7fc129ffb700 1 -- 172.21.15.133:0/1214686948 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v324) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc11c046d90 con 0x7fc12c151b40 2021-01-03T13:05:24.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.277+0000 7fc132fe5700 1 -- 172.21.15.133:0/1214686948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc1100553f0 msgr2=0x7fc1100578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:24.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.277+0000 7fc132fe5700 1 --2- 172.21.15.133:0/1214686948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc1100553f0 0x7fc1100578b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fc124019000 tx=0x7fc124016000).stop 2021-01-03T13:05:24.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.277+0000 7fc132fe5700 1 -- 172.21.15.133:0/1214686948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc12c151b40 msgr2=0x7fc12c155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:24.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.277+0000 7fc132fe5700 1 --2- 172.21.15.133:0/1214686948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc12c151b40 0x7fc12c155600 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fc11c0010d0 tx=0x7fc11c007a50).stop 2021-01-03T13:05:24.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.277+0000 7fc132fe5700 1 -- 172.21.15.133:0/1214686948 shutdown_connections 2021-01-03T13:05:24.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.277+0000 7fc132fe5700 1 --2- 172.21.15.133:0/1214686948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc1100553f0 0x7fc1100578b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:24.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.277+0000 7fc132fe5700 1 --2- 172.21.15.133:0/1214686948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc12c0b5a70 0x7fc12c142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:24.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.277+0000 7fc132fe5700 1 --2- 172.21.15.133:0/1214686948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc12c151b40 0x7fc12c155600 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:24.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.277+0000 7fc132fe5700 1 --2- 172.21.15.133:0/1214686948 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc12c143520 0x7fc12c1454e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:24.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.277+0000 7fc132fe5700 1 -- 172.21.15.133:0/1214686948 >> 172.21.15.133:0/1214686948 conn(0x7fc12c05c8c0 msgr2=0x7fc12c0b4000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:24.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.277+0000 7fc132fe5700 1 -- 172.21.15.133:0/1214686948 shutdown_connections 2021-01-03T13:05:24.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.277+0000 7fc132fe5700 1 -- 172.21.15.133:0/1214686948 wait complete. 2021-01-03T13:05:24.305 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-01-03T13:05:24.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58abfff700 1 Processor -- start 2021-01-03T13:05:24.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58abfff700 1 -- start start 2021-01-03T13:05:24.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58abfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f58ac0b2460 0x7f58ac0a9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:24.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58abfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58ac0a8850 0x7f58ac0a8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:24.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58abfff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ac0b16a0 con 0x7f58ac0b0a60 2021-01-03T13:05:24.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58abfff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ac0b2840 con 0x7f58ac0b2460 2021-01-03T13:05:24.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58abfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac0aeae0 con 0x7f58ac0a8850 2021-01-03T13:05:24.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58aa7fc700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f58ac0b0a60 0x7f58ac0ad490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:36644/0 (socket says 172.21.15.133:36644) 2021-01-03T13:05:24.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58aa7fc700 1 -- 172.21.15.133:0/339173260 learned_addr learned my addr 172.21.15.133:0/339173260 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:24.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58ab7fe700 1 --2- 172.21.15.133:0/339173260 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58ac0a8850 0x7f58ac0a8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:24.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58aaffd700 1 --2- 172.21.15.133:0/339173260 >> v2:172.21.15.16:3300/0 conn(0x7f58ac0b2460 0x7f58ac0a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:24.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58a9ffb700 1 -- 172.21.15.133:0/339173260 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685788351 0 0) 0x7f58ac0b16a0 con 0x7f58ac0b0a60 2021-01-03T13:05:24.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58a9ffb700 1 -- 172.21.15.133:0/339173260 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f588c003230 con 0x7f58ac0b0a60 2021-01-03T13:05:24.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58ab7fe700 1 -- 172.21.15.133:0/339173260 >> v2:172.21.15.16:3300/0 conn(0x7f58ac0b2460 msgr2=0x7f58ac0a9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:24.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58ab7fe700 1 --2- 172.21.15.133:0/339173260 >> v2:172.21.15.16:3300/0 conn(0x7f58ac0b2460 0x7f58ac0a9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:24.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58ab7fe700 1 -- 172.21.15.133:0/339173260 >> v1:172.21.15.16:6789/0 conn(0x7f58ac0b0a60 legacy=0x7f58ac0ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:24.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58ab7fe700 1 -- 172.21.15.133:0/339173260 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac0b1160 con 0x7f58ac0a8850 2021-01-03T13:05:24.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58aaffd700 1 --2- 172.21.15.133:0/339173260 >> v2:172.21.15.16:3300/0 conn(0x7f58ac0b2460 0x7f58ac0a9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:24.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.421+0000 7f58ab7fe700 1 --2- 172.21.15.133:0/339173260 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58ac0a8850 0x7f58ac0a8ca0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f58a4003300 tx=0x7f58a400a330).ready entity=mon.2 client_cookie=2faaaa9e1ca4dfdd server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:24.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.425+0000 7f58a9ffb700 1 -- 172.21.15.133:0/339173260 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58a400ce50 con 0x7f58ac0a8850 2021-01-03T13:05:24.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.425+0000 7f58a9ffb700 1 -- 172.21.15.133:0/339173260 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a4010410 con 0x7f58ac0a8850 2021-01-03T13:05:24.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.425+0000 7f58a9ffb700 1 -- 172.21.15.133:0/339173260 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58a4010770 con 0x7f58ac0a8850 2021-01-03T13:05:24.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.425+0000 7f58abfff700 1 -- 172.21.15.133:0/339173260 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58ac0a8850 msgr2=0x7f58ac0a8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:24.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.425+0000 7f58abfff700 1 --2- 172.21.15.133:0/339173260 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58ac0a8850 0x7f58ac0a8ca0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f58a4003300 tx=0x7f58a400a330).stop 2021-01-03T13:05:24.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.425+0000 7f58abfff700 1 -- 172.21.15.133:0/339173260 shutdown_connections 2021-01-03T13:05:24.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.425+0000 7f58abfff700 1 --2- 172.21.15.133:0/339173260 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58ac0a8850 0x7f58ac0a8ca0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:24.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.425+0000 7f58abfff700 1 --2- 172.21.15.133:0/339173260 >> v2:172.21.15.16:3300/0 conn(0x7f58ac0b2460 0x7f58ac0a9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:24.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.425+0000 7f58abfff700 1 -- 172.21.15.133:0/339173260 >> 172.21.15.133:0/339173260 conn(0x7f58ac06b050 msgr2=0x7f58ac060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:24.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.425+0000 7f58abfff700 1 -- 172.21.15.133:0/339173260 shutdown_connections 2021-01-03T13:05:24.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.425+0000 7f58abfff700 1 -- 172.21.15.133:0/339173260 wait complete. 2021-01-03T13:05:24.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.425+0000 7f58abfff700 1 Processor -- start 2021-01-03T13:05:24.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.425+0000 7f58abfff700 1 -- start start 2021-01-03T13:05:24.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58abfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58ac0a8850 0x7f58ac066c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:24.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58abfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58ac0b0a60 0x7f58ac0a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:24.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58abfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58ac0b2460 0x7f58ac0a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:24.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58abfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac065b90 con 0x7f58ac0a8850 2021-01-03T13:05:24.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58abfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac065e30 con 0x7f58ac0b0a60 2021-01-03T13:05:24.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58abfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac1438b0 con 0x7f58ac0b2460 2021-01-03T13:05:24.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58aa7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58ac0b0a60 0x7f58ac0a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:24.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58aa7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58ac0b0a60 0x7f58ac0a0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36890/0 (socket says 172.21.15.133:36890) 2021-01-03T13:05:24.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58aa7fc700 1 -- 172.21.15.133:0/1817171793 learned_addr learned my addr 172.21.15.133:0/1817171793 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:24.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58aaffd700 1 --2- 172.21.15.133:0/1817171793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58ac0a8850 0x7f58ac066c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:24.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58ab7fe700 1 --2- 172.21.15.133:0/1817171793 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58ac0b2460 0x7f58ac0a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:24.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58aa7fc700 1 -- 172.21.15.133:0/1817171793 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58ac0b2460 msgr2=0x7f58ac0a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:24.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58aa7fc700 1 --2- 172.21.15.133:0/1817171793 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58ac0b2460 0x7f58ac0a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:24.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58aa7fc700 1 -- 172.21.15.133:0/1817171793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58ac0a8850 msgr2=0x7f58ac066c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:24.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58aa7fc700 1 --2- 172.21.15.133:0/1817171793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58ac0a8850 0x7f58ac066c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:24.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58aa7fc700 1 -- 172.21.15.133:0/1817171793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac0658c0 con 0x7f58ac0b0a60 2021-01-03T13:05:24.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58aaffd700 1 --2- 172.21.15.133:0/1817171793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58ac0a8850 0x7f58ac066c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:24.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58aa7fc700 1 --2- 172.21.15.133:0/1817171793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58ac0b0a60 0x7f58ac0a0500 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f58940010d0 tx=0x7f5894007a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:24.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58a3fff700 1 -- 172.21.15.133:0/1817171793 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58940072e0 con 0x7f58ac0b0a60 2021-01-03T13:05:24.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58a3fff700 1 -- 172.21.15.133:0/1817171793 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5894007440 con 0x7f58ac0b0a60 2021-01-03T13:05:24.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58abfff700 1 -- 172.21.15.133:0/1817171793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ac143d50 con 0x7f58ac0b0a60 2021-01-03T13:05:24.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58a3fff700 1 -- 172.21.15.133:0/1817171793 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58940057d0 con 0x7f58ac0b0a60 2021-01-03T13:05:24.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58abfff700 1 -- 172.21.15.133:0/1817171793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ac066590 con 0x7f58ac0b0a60 2021-01-03T13:05:24.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58a3fff700 1 -- 172.21.15.133:0/1817171793 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5894010070 con 0x7f58ac0b0a60 2021-01-03T13:05:24.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58abfff700 1 -- 172.21.15.133:0/1817171793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ac057300 con 0x7f58ac0b0a60 2021-01-03T13:05:24.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.429+0000 7f58a3fff700 1 --2- 172.21.15.133:0/1817171793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5890055440 0x7f5890057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:24.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.433+0000 7f58a3fff700 1 -- 172.21.15.133:0/1817171793 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f589406d640 con 0x7f58ac0b0a60 2021-01-03T13:05:24.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.433+0000 7f58aaffd700 1 --2- 172.21.15.133:0/1817171793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5890055440 0x7f5890057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:24.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.433+0000 7f58aaffd700 1 --2- 172.21.15.133:0/1817171793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5890055440 0x7f5890057900 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f589c00b000 tx=0x7f589c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:24.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.437+0000 7f58a3fff700 1 -- 172.21.15.133:0/1817171793 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5894043940 con 0x7f58ac0b0a60 2021-01-03T13:05:24.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.577+0000 7f58abfff700 1 -- 172.21.15.133:0/1817171793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7f58ac143a20 con 0x7f58ac0b0a60 2021-01-03T13:05:24.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.589+0000 7f58a3fff700 1 -- 172.21.15.133:0/1817171793 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5894046f60 con 0x7f58ac0b0a60 2021-01-03T13:05:24.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.589+0000 7f58abfff700 1 -- 172.21.15.133:0/1817171793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5890055440 msgr2=0x7f5890057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:24.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.589+0000 7f58abfff700 1 --2- 172.21.15.133:0/1817171793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5890055440 0x7f5890057900 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f589c00b000 tx=0x7f589c008040).stop 2021-01-03T13:05:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.589+0000 7f58abfff700 1 -- 172.21.15.133:0/1817171793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58ac0b0a60 msgr2=0x7f58ac0a0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.589+0000 7f58abfff700 1 --2- 172.21.15.133:0/1817171793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58ac0b0a60 0x7f58ac0a0500 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f58940010d0 tx=0x7f5894007a70).stop 2021-01-03T13:05:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.589+0000 7f58abfff700 1 -- 172.21.15.133:0/1817171793 shutdown_connections 2021-01-03T13:05:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.589+0000 7f58abfff700 1 --2- 172.21.15.133:0/1817171793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5890055440 0x7f5890057900 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:24.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.589+0000 7f58abfff700 1 --2- 172.21.15.133:0/1817171793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f58ac0a8850 0x7f58ac066c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:24.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.589+0000 7f58abfff700 1 --2- 172.21.15.133:0/1817171793 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f58ac0b2460 0x7f58ac0a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:24.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.589+0000 7f58abfff700 1 --2- 172.21.15.133:0/1817171793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f58ac0b0a60 0x7f58ac0a0500 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:24.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.589+0000 7f58abfff700 1 -- 172.21.15.133:0/1817171793 >> 172.21.15.133:0/1817171793 conn(0x7f58ac06b050 msgr2=0x7f58ac0aba30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:24.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.589+0000 7f58abfff700 1 -- 172.21.15.133:0/1817171793 shutdown_connections 2021-01-03T13:05:24.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.589+0000 7f58abfff700 1 -- 172.21.15.133:0/1817171793 wait complete. 2021-01-03T13:05:24.609 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:05:24.610 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:05:24.628 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:05:24.647 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:05:24.665 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:05:24.686 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:05:24.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:24.687 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:05:24.687 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:24.696 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-03T13:05:24.697 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:05:24.698 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-01-03T13:05:24.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:24.699 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:05:24.699 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:24.717 INFO:teuthology.orchestra.run.smithi036.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:05:24.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:05:24.719 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-01-03T13:05:24.720 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-01-03T13:05:24.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.841+0000 7fc3f7fff700 1 Processor -- start 2021-01-03T13:05:24.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.841+0000 7fc3f7fff700 1 -- start start 2021-01-03T13:05:24.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.841+0000 7fc3f7fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc3f80b9f40 0x7fc3f8146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:24.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.841+0000 7fc3f7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3f8146920 0x7fc3f814d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:24.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.841+0000 7fc3f7fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f80605f0 con 0x7fc3f80b9b60 2021-01-03T13:05:24.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.841+0000 7fc3f7fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f80aed30 con 0x7fc3f80b9f40 2021-01-03T13:05:24.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.841+0000 7fc3f7fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f80600b0 con 0x7fc3f8146920 2021-01-03T13:05:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.841+0000 7fc3f77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3f8146920 0x7fc3f814d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.841+0000 7fc3f6ffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc3f80b9b60 0x7fc3f80b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:36656/0 (socket says 172.21.15.133:36656) 2021-01-03T13:05:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.841+0000 7fc3f77fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc3f8146920 0x7fc3f814d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36898/0 (socket says 172.21.15.133:36898) 2021-01-03T13:05:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.841+0000 7fc3f6ffd700 1 -- 172.21.15.133:0/1449795276 learned_addr learned my addr 172.21.15.133:0/1449795276 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:24.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.841+0000 7fc3f67fc700 1 --2- 172.21.15.133:0/1449795276 >> v2:172.21.15.16:3300/0 conn(0x7fc3f80b9f40 0x7fc3f8146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f5ffb700 1 -- 172.21.15.133:0/1449795276 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503195496 0 0) 0x7fc3f80605f0 con 0x7fc3f80b9b60 2021-01-03T13:05:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f5ffb700 1 -- 172.21.15.133:0/1449795276 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3dc003230 con 0x7fc3f80b9b60 2021-01-03T13:05:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f77fe700 1 -- 172.21.15.133:0/1449795276 >> v2:172.21.15.16:3300/0 conn(0x7fc3f80b9f40 msgr2=0x7fc3f8146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:24.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f77fe700 1 --2- 172.21.15.133:0/1449795276 >> v2:172.21.15.16:3300/0 conn(0x7fc3f80b9f40 0x7fc3f8146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f77fe700 1 -- 172.21.15.133:0/1449795276 >> v1:172.21.15.16:6789/0 conn(0x7fc3f80b9b60 legacy=0x7fc3f80b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f77fe700 1 -- 172.21.15.133:0/1449795276 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f8060350 con 0x7fc3f8146920 2021-01-03T13:05:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f77fe700 1 --2- 172.21.15.133:0/1449795276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3f8146920 0x7fc3f814d500 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fc3f0002f30 tx=0x7fc3f0006dc0).ready entity=mon.1 client_cookie=20ab5999a06217ae server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f5ffb700 1 -- 172.21.15.133:0/1449795276 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3f00096f0 con 0x7fc3f8146920 2021-01-03T13:05:24.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f5ffb700 1 -- 172.21.15.133:0/1449795276 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f0009850 con 0x7fc3f8146920 2021-01-03T13:05:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f5ffb700 1 -- 172.21.15.133:0/1449795276 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3f0009bb0 con 0x7fc3f8146920 2021-01-03T13:05:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f7fff700 1 -- 172.21.15.133:0/1449795276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3f8146920 msgr2=0x7fc3f814d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:24.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f7fff700 1 --2- 172.21.15.133:0/1449795276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3f8146920 0x7fc3f814d500 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fc3f0002f30 tx=0x7fc3f0006dc0).stop 2021-01-03T13:05:24.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f7fff700 1 -- 172.21.15.133:0/1449795276 shutdown_connections 2021-01-03T13:05:24.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f7fff700 1 --2- 172.21.15.133:0/1449795276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3f8146920 0x7fc3f814d500 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:24.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f7fff700 1 --2- 172.21.15.133:0/1449795276 >> v2:172.21.15.16:3300/0 conn(0x7fc3f80b9f40 0x7fc3f8146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:24.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f7fff700 1 -- 172.21.15.133:0/1449795276 >> 172.21.15.133:0/1449795276 conn(0x7fc3f80b69e0 msgr2=0x7fc3f80b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:24.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f7fff700 1 -- 172.21.15.133:0/1449795276 shutdown_connections 2021-01-03T13:05:24.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f7fff700 1 -- 172.21.15.133:0/1449795276 wait complete. 2021-01-03T13:05:24.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f7fff700 1 Processor -- start 2021-01-03T13:05:24.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f7fff700 1 -- start start 2021-01-03T13:05:24.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f7fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3f80b9b60 0x7fc3f80b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:24.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f7fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3f80b9f40 0x7fc3f81521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:24.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3f8146920 0x7fc3f809c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:24.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f7fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f809d7c0 con 0x7fc3f80b9f40 2021-01-03T13:05:24.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f7fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f809cb80 con 0x7fc3f8146920 2021-01-03T13:05:24.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f7fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f809cda0 con 0x7fc3f80b9b60 2021-01-03T13:05:24.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3f8146920 0x7fc3f809c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:24.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3f8146920 0x7fc3f809c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36904/0 (socket says 172.21.15.133:36904) 2021-01-03T13:05:24.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f77fe700 1 -- 172.21.15.133:0/274032837 learned_addr learned my addr 172.21.15.133:0/274032837 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:24.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.845+0000 7fc3f6ffd700 1 --2- 172.21.15.133:0/274032837 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3f80b9b60 0x7fc3f80b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:24.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3f77fe700 1 -- 172.21.15.133:0/274032837 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3f80b9b60 msgr2=0x7fc3f80b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:24.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3f77fe700 1 --2- 172.21.15.133:0/274032837 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3f80b9b60 0x7fc3f80b3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:24.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3f77fe700 1 -- 172.21.15.133:0/274032837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3f80b9f40 msgr2=0x7fc3f81521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:24.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3f77fe700 1 --2- 172.21.15.133:0/274032837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3f80b9f40 0x7fc3f81521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T13:05:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3f77fe700 1 -- 172.21.15.133:0/274032837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f8151a90 con 0x7fc3f8146920 2021-01-03T13:05:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3f6ffd700 1 --2- 172.21.15.133:0/274032837 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3f80b9b60 0x7fc3f80b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:24.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3f77fe700 1 --2- 172.21.15.133:0/274032837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3f8146920 0x7fc3f809c690 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7fc3f0002f30 tx=0x7fc3f0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3effff700 1 -- 172.21.15.133:0/274032837 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3f0009e20 con 0x7fc3f8146920 2021-01-03T13:05:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3effff700 1 -- 172.21.15.133:0/274032837 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f0011ce0 con 0x7fc3f8146920 2021-01-03T13:05:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3f7fff700 1 -- 172.21.15.133:0/274032837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f8151d30 con 0x7fc3f8146920 2021-01-03T13:05:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3effff700 1 -- 172.21.15.133:0/274032837 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3f001d640 con 0x7fc3f8146920 2021-01-03T13:05:24.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3f7fff700 1 -- 172.21.15.133:0/274032837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f8151780 con 0x7fc3f8146920 2021-01-03T13:05:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3f7fff700 1 -- 172.21.15.133:0/274032837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f8151ec0 con 0x7fc3f8146920 2021-01-03T13:05:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3effff700 1 -- 172.21.15.133:0/274032837 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc3f0024030 con 0x7fc3f8146920 2021-01-03T13:05:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3effff700 1 --2- 172.21.15.133:0/274032837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3d0055440 0x7fc3d0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3f6ffd700 1 --2- 172.21.15.133:0/274032837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3d0055440 0x7fc3d0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:24.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3effff700 1 -- 172.21.15.133:0/274032837 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc3f006f180 con 0x7fc3f8146920 2021-01-03T13:05:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.849+0000 7fc3f6ffd700 1 --2- 172.21.15.133:0/274032837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3d0055440 0x7fc3d0057900 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7fc3e0008000 tx=0x7fc3e0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:24.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.857+0000 7fc3effff700 1 -- 172.21.15.133:0/274032837 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc3f0045480 con 0x7fc3f8146920 2021-01-03T13:05:25.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:24.997+0000 7fc3f7fff700 1 -- 172.21.15.133:0/274032837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc3f8057300 con 0x7fc3f8146920 2021-01-03T13:05:25.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.001+0000 7fc3effff700 1 -- 172.21.15.133:0/274032837 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v90) v1 ==== 81+0+33696 (secure 0 0 0) 0x7fc3f0022020 con 0x7fc3f8146920 2021-01-03T13:05:25.006 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:25.007 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:05:25.007 INFO:teuthology.orchestra.run.smithi133.stdout: "epoch": 90, 2021-01-03T13:05:25.008 INFO:teuthology.orchestra.run.smithi133.stdout: "fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", 2021-01-03T13:05:25.008 INFO:teuthology.orchestra.run.smithi133.stdout: "created": "2021-01-03T12:57:43.298835+0000", 2021-01-03T13:05:25.008 INFO:teuthology.orchestra.run.smithi133.stdout: "modified": "2021-01-03T13:05:09.869273+0000", 2021-01-03T13:05:25.009 INFO:teuthology.orchestra.run.smithi133.stdout: "last_up_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:05:25.009 INFO:teuthology.orchestra.run.smithi133.stdout: "last_in_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:05:25.009 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-01-03T13:05:25.009 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_num": 5799936, 2021-01-03T13:05:25.010 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_set": [ 2021-01-03T13:05:25.010 INFO:teuthology.orchestra.run.smithi133.stdout: "pglog_hardlimit", 2021-01-03T13:05:25.010 INFO:teuthology.orchestra.run.smithi133.stdout: "purged_snapdirs", 2021-01-03T13:05:25.010 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_deletes", 2021-01-03T13:05:25.011 INFO:teuthology.orchestra.run.smithi133.stdout: "sortbitwise" 2021-01-03T13:05:25.011 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:05:25.011 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_version": 4, 2021-01-03T13:05:25.011 INFO:teuthology.orchestra.run.smithi133.stdout: "full_ratio": 0.94999998807907104, 2021-01-03T13:05:25.011 INFO:teuthology.orchestra.run.smithi133.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-01-03T13:05:25.012 INFO:teuthology.orchestra.run.smithi133.stdout: "nearfull_ratio": 0.85000002384185791, 2021-01-03T13:05:25.012 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_snapshot": "", 2021-01-03T13:05:25.012 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_max": 16, 2021-01-03T13:05:25.012 INFO:teuthology.orchestra.run.smithi133.stdout: "max_osd": 8, 2021-01-03T13:05:25.012 INFO:teuthology.orchestra.run.smithi133.stdout: "require_min_compat_client": "jewel", 2021-01-03T13:05:25.013 INFO:teuthology.orchestra.run.smithi133.stdout: "min_compat_client": "jewel", 2021-01-03T13:05:25.013 INFO:teuthology.orchestra.run.smithi133.stdout: "require_osd_release": "octopus", 2021-01-03T13:05:25.013 INFO:teuthology.orchestra.run.smithi133.stdout: "pools": [ 2021-01-03T13:05:25.013 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.014 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 1, 2021-01-03T13:05:25.014 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "device_health_metrics", 2021-01-03T13:05:25.014 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:47.102954+0000", 2021-01-03T13:05:25.014 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:05:25.014 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:05:25.015 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:05:25.015 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:05:25.015 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:05:25.015 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:05:25.015 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:05:25.016 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:05:25.016 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 1, 2021-01-03T13:05:25.016 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 1, 2021-01-03T13:05:25.016 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 1, 2021-01-03T13:05:25.017 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 1, 2021-01-03T13:05:25.017 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 1, 2021-01-03T13:05:25.017 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:05:25.018 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:05:25.018 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:05:25.018 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:05:25.018 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:05:25.019 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:05:25.019 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:05:25.019 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.019 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "16", 2021-01-03T13:05:25.019 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:05:25.020 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:05:25.020 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:05:25.020 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:05:25.020 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:05:25.020 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:05:25.021 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:05:25.021 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:05:25.021 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:05:25.021 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:05:25.021 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:05:25.022 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:05:25.022 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:05:25.022 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:05:25.022 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:05:25.023 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:05:25.023 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:05:25.023 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:05:25.023 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:05:25.023 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:05:25.024 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:05:25.024 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:05:25.024 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:05:25.024 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:05:25.024 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:05:25.025 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:05:25.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.025 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:05:25.025 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:05:25.025 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:05:25.026 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:05:25.026 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:05:25.026 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:05:25.026 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:05:25.026 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:05:25.027 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:05:25.027 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:05:25.027 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:05:25.027 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:05:25.028 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 1 2021-01-03T13:05:25.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.028 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:05:25.028 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr_devicehealth": {} 2021-01-03T13:05:25.029 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.029 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.029 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 2, 2021-01-03T13:05:25.029 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "rbd", 2021-01-03T13:05:25.030 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:55.472799+0000", 2021-01-03T13:05:25.030 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:05:25.030 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:05:25.030 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:05:25.031 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:05:25.031 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:05:25.031 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:05:25.031 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:05:25.031 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:05:25.032 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:05:25.032 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:05:25.032 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:05:25.032 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:05:25.032 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:05:25.033 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:05:25.033 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:05:25.033 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:05:25.033 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:05:25.033 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:05:25.034 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:05:25.034 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:05:25.034 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.034 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "19", 2021-01-03T13:05:25.035 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:05:25.035 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:05:25.035 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:05:25.035 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:05:25.035 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:05:25.036 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:05:25.036 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:05:25.036 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:05:25.036 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:05:25.036 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:05:25.037 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:05:25.037 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:05:25.037 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:05:25.037 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:05:25.037 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:05:25.038 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:05:25.038 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:05:25.038 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:05:25.038 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:05:25.039 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:05:25.039 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:05:25.039 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:05:25.039 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:05:25.040 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:05:25.040 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:05:25.040 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:05:25.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.040 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:05:25.041 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:05:25.041 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:05:25.041 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:05:25.041 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:05:25.041 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:05:25.042 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:05:25.042 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:05:25.042 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:05:25.042 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:05:25.043 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:05:25.043 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:05:25.043 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:05:25.043 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd": {} 2021-01-03T13:05:25.043 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.044 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 15, 2021-01-03T13:05:25.044 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_metadata", 2021-01-03T13:05:25.044 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:05:07.479446+0000", 2021-01-03T13:05:25.045 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:05:25.045 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:05:25.045 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:05:25.045 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:05:25.045 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:05:25.046 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:05:25.046 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:05:25.046 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:05:25.046 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:05:25.046 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:05:25.047 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:05:25.047 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:05:25.047 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:05:25.047 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:05:25.047 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:05:25.048 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:05:25.048 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:05:25.048 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:05:25.049 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:05:25.049 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:05:25.049 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.049 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "89", 2021-01-03T13:05:25.049 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:05:25.050 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:05:25.050 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:05:25.050 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:05:25.050 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:05:25.050 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:05:25.051 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:05:25.051 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:05:25.051 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:05:25.051 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:05:25.051 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:05:25.052 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:05:25.052 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:05:25.052 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:05:25.052 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:05:25.053 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:05:25.053 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:05:25.053 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:05:25.053 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:05:25.053 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:05:25.054 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:05:25.054 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:05:25.054 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:05:25.054 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:05:25.054 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:05:25.055 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:05:25.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.055 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:05:25.055 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:05:25.055 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:05:25.056 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:05:25.056 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:05:25.056 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:05:25.056 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:05:25.056 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:05:25.057 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:05:25.057 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:05:25.057 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:05:25.057 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:05:25.057 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_bias": 4, 2021-01-03T13:05:25.058 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 16, 2021-01-03T13:05:25.058 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_priority": 5 2021-01-03T13:05:25.058 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.058 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:05:25.059 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:05:25.059 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": "cephfs" 2021-01-03T13:05:25.059 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.059 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.060 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 16, 2021-01-03T13:05:25.060 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_data", 2021-01-03T13:05:25.060 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:05:07.894287+0000", 2021-01-03T13:05:25.061 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:05:25.061 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:05:25.061 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:05:25.061 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:05:25.062 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:05:25.062 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:05:25.062 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:05:25.062 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:05:25.062 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:05:25.063 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:05:25.063 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:05:25.063 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:05:25.063 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:05:25.063 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:05:25.064 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:05:25.064 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:05:25.064 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:05:25.064 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:05:25.064 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:05:25.065 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:05:25.065 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.065 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "90", 2021-01-03T13:05:25.065 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:05:25.065 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:05:25.066 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:05:25.066 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:05:25.066 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:05:25.066 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:05:25.066 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:05:25.067 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:05:25.067 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:05:25.067 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:05:25.067 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:05:25.067 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:05:25.068 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:05:25.068 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:05:25.068 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:05:25.068 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:05:25.068 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:05:25.069 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:05:25.069 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:05:25.069 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:05:25.070 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:05:25.070 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:05:25.070 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:05:25.070 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:05:25.071 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:05:25.071 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:05:25.071 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.071 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:05:25.071 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:05:25.072 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:05:25.072 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:05:25.072 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:05:25.072 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:05:25.072 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:05:25.073 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:05:25.073 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:05:25.073 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:05:25.073 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:05:25.073 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:05:25.074 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:05:25.074 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:05:25.074 INFO:teuthology.orchestra.run.smithi133.stdout: "data": "cephfs" 2021-01-03T13:05:25.074 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.075 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.075 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.075 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:05:25.075 INFO:teuthology.orchestra.run.smithi133.stdout: "osds": [ 2021-01-03T13:05:25.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.076 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:05:25.076 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a", 2021-01-03T13:05:25.076 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:05:25.076 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:05:25.076 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:05:25.077 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:05:25.077 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:05:25.077 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:05:25.077 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:05:25.077 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 87, 2021-01-03T13:05:25.078 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:05:25.078 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:05:25.078 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:05:25.078 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.079 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.079 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6810", 2021-01-03T13:05:25.079 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:05:25.080 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.080 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.080 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.080 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6811", 2021-01-03T13:05:25.081 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:05:25.081 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.081 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.081 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.081 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:05:25.082 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.082 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.082 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.082 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6812", 2021-01-03T13:05:25.083 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:05:25.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.083 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.083 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6813", 2021-01-03T13:05:25.084 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:05:25.084 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.084 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.084 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:05:25.085 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.085 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.085 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.085 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6816", 2021-01-03T13:05:25.085 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:05:25.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.086 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.086 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6817", 2021-01-03T13:05:25.087 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:05:25.087 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.087 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.087 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.087 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:05:25.088 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.088 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.088 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6814", 2021-01-03T13:05:25.088 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:05:25.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.089 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.089 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6815", 2021-01-03T13:05:25.090 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:05:25.090 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.090 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.091 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6811/12124", 2021-01-03T13:05:25.091 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6813/12124", 2021-01-03T13:05:25.091 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6817/12124", 2021-01-03T13:05:25.091 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6815/12124", 2021-01-03T13:05:25.092 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:05:25.092 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:05:25.092 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:05:25.093 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.093 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.093 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.093 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:05:25.093 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9170d1de-58d4-4dfd-b9de-80dc15ca9e60", 2021-01-03T13:05:25.094 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:05:25.094 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:05:25.094 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:05:25.095 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:05:25.095 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:05:25.095 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:05:25.095 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:05:25.095 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 86, 2021-01-03T13:05:25.096 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:05:25.096 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:05:25.096 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:05:25.096 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.097 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.097 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6818", 2021-01-03T13:05:25.097 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:05:25.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.098 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.098 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6819", 2021-01-03T13:05:25.098 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:05:25.098 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.098 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.099 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.099 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:05:25.099 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.099 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.100 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6820", 2021-01-03T13:05:25.100 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:05:25.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.101 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.101 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6821", 2021-01-03T13:05:25.101 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:05:25.101 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.102 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.102 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:05:25.102 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.103 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.103 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6824", 2021-01-03T13:05:25.103 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:05:25.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.104 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.104 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6825", 2021-01-03T13:05:25.104 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:05:25.104 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.104 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.105 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:05:25.105 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.105 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.106 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6822", 2021-01-03T13:05:25.106 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:05:25.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.106 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.107 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6823", 2021-01-03T13:05:25.107 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:05:25.107 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.107 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.108 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6819/12123", 2021-01-03T13:05:25.108 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6821/12123", 2021-01-03T13:05:25.108 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6825/12123", 2021-01-03T13:05:25.109 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6823/12123", 2021-01-03T13:05:25.109 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:05:25.109 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:05:25.109 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:05:25.110 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.110 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.111 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:05:25.111 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9fc5adf9-3537-4953-9c65-0c67ecb53776", 2021-01-03T13:05:25.111 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:05:25.111 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:05:25.112 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:05:25.112 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:05:25.112 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:05:25.112 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:05:25.113 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:05:25.113 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 87, 2021-01-03T13:05:25.114 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:05:25.114 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:05:25.114 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:05:25.114 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.115 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.116 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6802", 2021-01-03T13:05:25.116 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:05:25.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.116 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.117 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6803", 2021-01-03T13:05:25.117 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:05:25.117 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.117 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.118 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:05:25.118 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.119 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.119 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6804", 2021-01-03T13:05:25.120 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:05:25.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.120 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.121 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6805", 2021-01-03T13:05:25.122 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:05:25.122 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.123 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.123 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:05:25.123 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.124 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.124 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6808", 2021-01-03T13:05:25.124 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:05:25.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.125 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.125 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6809", 2021-01-03T13:05:25.125 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:05:25.125 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.125 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.126 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:05:25.126 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.127 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.127 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6806", 2021-01-03T13:05:25.127 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:05:25.127 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.128 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.128 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6807", 2021-01-03T13:05:25.128 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:05:25.129 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.129 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.129 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6803/12122", 2021-01-03T13:05:25.130 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6805/12122", 2021-01-03T13:05:25.130 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6809/12122", 2021-01-03T13:05:25.130 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6807/12122", 2021-01-03T13:05:25.131 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:05:25.131 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:05:25.131 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:05:25.131 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.132 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:05:25.132 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "0ad45ce5-6635-4089-bbf8-c966d0fe5338", 2021-01-03T13:05:25.132 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:05:25.132 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:05:25.133 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:05:25.133 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:05:25.133 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:05:25.134 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:05:25.135 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:05:25.135 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 87, 2021-01-03T13:05:25.135 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:05:25.135 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:05:25.136 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:05:25.136 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.136 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.136 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6826", 2021-01-03T13:05:25.137 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:05:25.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.138 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.138 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6827", 2021-01-03T13:05:25.138 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:05:25.138 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.139 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.140 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:05:25.140 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.140 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.141 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6828", 2021-01-03T13:05:25.141 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:05:25.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.141 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.142 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6829", 2021-01-03T13:05:25.142 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:05:25.142 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.142 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.143 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:05:25.143 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.143 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.143 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6832", 2021-01-03T13:05:25.144 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:05:25.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.144 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.144 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6833", 2021-01-03T13:05:25.145 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:05:25.146 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.146 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.146 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:05:25.147 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.147 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.147 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6830", 2021-01-03T13:05:25.147 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:05:25.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.148 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.148 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6831", 2021-01-03T13:05:25.148 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:05:25.149 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.149 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.150 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6827/12136", 2021-01-03T13:05:25.150 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6829/12136", 2021-01-03T13:05:25.150 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6833/12136", 2021-01-03T13:05:25.150 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6831/12136", 2021-01-03T13:05:25.151 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:05:25.151 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:05:25.151 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:05:25.151 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.152 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:05:25.152 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "86b8d6d5-271b-4a70-ae7b-a227afb38d7c", 2021-01-03T13:05:25.152 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:05:25.152 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:05:25.152 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:05:25.153 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:05:25.153 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:05:25.154 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:05:25.154 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:05:25.154 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 87, 2021-01-03T13:05:25.154 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:05:25.155 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:05:25.155 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:05:25.155 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.155 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.156 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6808", 2021-01-03T13:05:25.156 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:05:25.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.156 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.157 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6809", 2021-01-03T13:05:25.157 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:05:25.157 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.157 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.158 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:05:25.158 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.158 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.158 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6810", 2021-01-03T13:05:25.159 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:05:25.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.159 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.159 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6811", 2021-01-03T13:05:25.160 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:05:25.160 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.160 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.160 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:05:25.161 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.161 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.161 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6814", 2021-01-03T13:05:25.161 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:05:25.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.162 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.162 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6815", 2021-01-03T13:05:25.162 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:05:25.163 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.163 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.163 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:05:25.163 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.166 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.166 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6812", 2021-01-03T13:05:25.166 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:05:25.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.167 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.167 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6813", 2021-01-03T13:05:25.167 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:05:25.168 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.168 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.168 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6809/12672", 2021-01-03T13:05:25.169 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6811/12672", 2021-01-03T13:05:25.169 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6815/12672", 2021-01-03T13:05:25.169 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6813/12672", 2021-01-03T13:05:25.169 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:05:25.169 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:05:25.170 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:05:25.170 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.171 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:05:25.171 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "173feb9d-f596-4030-85d8-1f4b46a9ffe5", 2021-01-03T13:05:25.171 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:05:25.171 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:05:25.171 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:05:25.172 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:05:25.172 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:05:25.172 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:05:25.172 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:05:25.172 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 87, 2021-01-03T13:05:25.173 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:05:25.173 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:05:25.173 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:05:25.173 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.174 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.174 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.174 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6817", 2021-01-03T13:05:25.175 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:05:25.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.176 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.176 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6819", 2021-01-03T13:05:25.176 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:05:25.177 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.177 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.178 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:05:25.178 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.178 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.178 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6820", 2021-01-03T13:05:25.179 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:05:25.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.179 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.180 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6822", 2021-01-03T13:05:25.180 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:05:25.180 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.180 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.181 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:05:25.181 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.181 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.181 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6828", 2021-01-03T13:05:25.182 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:05:25.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.183 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.183 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6830", 2021-01-03T13:05:25.183 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:05:25.183 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.183 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.184 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:05:25.184 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.184 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.184 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6824", 2021-01-03T13:05:25.185 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:05:25.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.186 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.186 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.187 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6826", 2021-01-03T13:05:25.187 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:05:25.187 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.187 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.188 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6819/12673", 2021-01-03T13:05:25.188 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6822/12673", 2021-01-03T13:05:25.188 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6830/12673", 2021-01-03T13:05:25.188 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6826/12673", 2021-01-03T13:05:25.188 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:05:25.189 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:05:25.189 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:05:25.189 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.190 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:05:25.190 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "b487980e-ad4d-43c1-91fa-4845f7af3d4d", 2021-01-03T13:05:25.190 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:05:25.190 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:05:25.191 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:05:25.191 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:05:25.191 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:05:25.191 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:05:25.192 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:05:25.192 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 87, 2021-01-03T13:05:25.192 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:05:25.192 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:05:25.192 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:05:25.193 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.193 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.193 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6800", 2021-01-03T13:05:25.193 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:05:25.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.194 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.194 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6801", 2021-01-03T13:05:25.195 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:05:25.195 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.195 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.197 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:05:25.197 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.198 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.198 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6802", 2021-01-03T13:05:25.198 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:05:25.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.199 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.199 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6803", 2021-01-03T13:05:25.200 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:05:25.200 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.200 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.200 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:05:25.201 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.201 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.201 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6806", 2021-01-03T13:05:25.202 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:05:25.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.202 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.202 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6807", 2021-01-03T13:05:25.203 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:05:25.203 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.203 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.203 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:05:25.204 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.204 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.204 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6804", 2021-01-03T13:05:25.204 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:05:25.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.205 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.205 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6805", 2021-01-03T13:05:25.205 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:05:25.206 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.207 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.207 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6801/12662", 2021-01-03T13:05:25.207 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6803/12662", 2021-01-03T13:05:25.208 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6807/12662", 2021-01-03T13:05:25.208 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6805/12662", 2021-01-03T13:05:25.208 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:05:25.208 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:05:25.208 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:05:25.209 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.209 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:05:25.210 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "38ea839a-451f-4c09-a545-4514e049b178", 2021-01-03T13:05:25.210 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:05:25.210 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:05:25.210 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:05:25.210 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:05:25.211 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:05:25.211 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:05:25.211 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:05:25.211 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 74, 2021-01-03T13:05:25.212 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:05:25.212 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:05:25.212 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:05:25.212 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.213 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.213 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6816", 2021-01-03T13:05:25.213 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:05:25.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.214 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.214 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6818", 2021-01-03T13:05:25.214 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:05:25.214 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.215 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.216 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:05:25.216 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.217 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.218 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6821", 2021-01-03T13:05:25.218 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:05:25.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.218 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.219 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6823", 2021-01-03T13:05:25.219 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:05:25.219 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.219 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.220 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:05:25.220 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.220 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.220 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6829", 2021-01-03T13:05:25.221 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:05:25.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.221 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.222 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6831", 2021-01-03T13:05:25.222 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:05:25.222 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.222 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.224 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:05:25.229 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:25.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.230 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:25.230 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6825", 2021-01-03T13:05:25.231 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:05:25.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.231 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:25.232 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6827", 2021-01-03T13:05:25.232 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:05:25.232 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.232 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.233 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6818/12674", 2021-01-03T13:05:25.234 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6823/12674", 2021-01-03T13:05:25.234 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6831/12674", 2021-01-03T13:05:25.234 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6827/12674", 2021-01-03T13:05:25.234 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:05:25.234 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:05:25.235 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:05:25.235 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:25.235 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.235 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:05:25.235 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_xinfo": [ 2021-01-03T13:05:25.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.236 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:05:25.236 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:05:25.236 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:05:25.236 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:05:25.237 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:05:25.237 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:05:25.237 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.659942+0000", 2021-01-03T13:05:25.237 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:05:25.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.238 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:05:25.238 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:05:25.238 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:05:25.239 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:05:25.239 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:05:25.239 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:05:25.240 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.750326+0000", 2021-01-03T13:05:25.240 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:05:25.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.241 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:05:25.241 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:05:25.241 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:05:25.241 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:05:25.241 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:05:25.242 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:05:25.242 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.587742+0000", 2021-01-03T13:05:25.242 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:05:25.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.243 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:05:25.243 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:05:25.243 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:05:25.244 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:05:25.244 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:05:25.244 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:05:25.244 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.855073+0000", 2021-01-03T13:05:25.244 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:05:25.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.245 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:05:25.245 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:05:25.245 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:05:25.246 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:05:25.246 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:05:25.246 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:05:25.246 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.565030+0000", 2021-01-03T13:05:25.246 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:05:25.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.247 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.247 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:05:25.247 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:05:25.247 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:05:25.248 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:05:25.248 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:05:25.248 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:05:25.248 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.786206+0000", 2021-01-03T13:05:25.249 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:05:25.249 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.249 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:05:25.250 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:05:25.250 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:05:25.251 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:05:25.251 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:05:25.251 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:05:25.251 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.576185+0000", 2021-01-03T13:05:25.252 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:05:25.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:25.252 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:05:25.253 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:05:25.253 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:05:25.253 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:05:25.254 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:05:25.254 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:05:25.254 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.823786+0000", 2021-01-03T13:05:25.254 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:05:25.254 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.255 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:05:25.255 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap": [], 2021-01-03T13:05:25.255 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap_items": [], 2021-01-03T13:05:25.255 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_temp": [], 2021-01-03T13:05:25.255 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_temp": [], 2021-01-03T13:05:25.256 INFO:teuthology.orchestra.run.smithi133.stdout: "blacklist": {}, 2021-01-03T13:05:25.256 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profiles": { 2021-01-03T13:05:25.256 INFO:teuthology.orchestra.run.smithi133.stdout: "default": { 2021-01-03T13:05:25.256 INFO:teuthology.orchestra.run.smithi133.stdout: "crush-failure-domain": "osd", 2021-01-03T13:05:25.257 INFO:teuthology.orchestra.run.smithi133.stdout: "k": "2", 2021-01-03T13:05:25.257 INFO:teuthology.orchestra.run.smithi133.stdout: "m": "1", 2021-01-03T13:05:25.257 INFO:teuthology.orchestra.run.smithi133.stdout: "plugin": "jerasure", 2021-01-03T13:05:25.257 INFO:teuthology.orchestra.run.smithi133.stdout: "ruleset-failure-domain": "osd", 2021-01-03T13:05:25.257 INFO:teuthology.orchestra.run.smithi133.stdout: "technique": "reed_sol_van" 2021-01-03T13:05:25.257 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:25.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:25.258 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps_queue": [], 2021-01-03T13:05:25.258 INFO:teuthology.orchestra.run.smithi133.stdout: "new_removed_snaps": [], 2021-01-03T13:05:25.258 INFO:teuthology.orchestra.run.smithi133.stdout: "new_purged_snaps": [], 2021-01-03T13:05:25.258 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_node_flags": {}, 2021-01-03T13:05:25.259 INFO:teuthology.orchestra.run.smithi133.stdout: "device_class_flags": {} 2021-01-03T13:05:25.259 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:05:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.001+0000 7fc3f7fff700 1 -- 172.21.15.133:0/274032837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3d0055440 msgr2=0x7fc3d0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.001+0000 7fc3f7fff700 1 --2- 172.21.15.133:0/274032837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3d0055440 0x7fc3d0057900 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7fc3e0008000 tx=0x7fc3e0009040).stop 2021-01-03T13:05:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.001+0000 7fc3f7fff700 1 -- 172.21.15.133:0/274032837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3f8146920 msgr2=0x7fc3f809c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.001+0000 7fc3f7fff700 1 --2- 172.21.15.133:0/274032837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3f8146920 0x7fc3f809c690 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7fc3f0002f30 tx=0x7fc3f0015000).stop 2021-01-03T13:05:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.001+0000 7fc3f7fff700 1 -- 172.21.15.133:0/274032837 shutdown_connections 2021-01-03T13:05:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.001+0000 7fc3f7fff700 1 --2- 172.21.15.133:0/274032837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3d0055440 0x7fc3d0057900 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.001+0000 7fc3f7fff700 1 --2- 172.21.15.133:0/274032837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3f8146920 0x7fc3f809c690 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.001+0000 7fc3f7fff700 1 --2- 172.21.15.133:0/274032837 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3f80b9b60 0x7fc3f80b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.001+0000 7fc3f7fff700 1 --2- 172.21.15.133:0/274032837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3f80b9f40 0x7fc3f81521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T13:05:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.001+0000 7fc3f7fff700 1 -- 172.21.15.133:0/274032837 >> 172.21.15.133:0/274032837 conn(0x7fc3f80b69e0 msgr2=0x7fc3f8145520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.001+0000 7fc3f7fff700 1 -- 172.21.15.133:0/274032837 shutdown_connections 2021-01-03T13:05:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.001+0000 7fc3f7fff700 1 -- 172.21.15.133:0/274032837 wait complete. 2021-01-03T13:05:25.265 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:05:25.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.373+0000 7f562e8f5700 1 Processor -- start 2021-01-03T13:05:25.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.373+0000 7f562e8f5700 1 -- start start 2021-01-03T13:05:25.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f562e8f5700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f562805cc10 0x7f56281437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:25.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f562e8f5700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f562805c510 con 0x7f562805c130 2021-01-03T13:05:25.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f562e8f5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5628147190 con 0x7f56280b02d0 2021-01-03T13:05:25.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f562e8f5700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56280b0780 con 0x7f562805cc10 2021-01-03T13:05:25.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f562ce92700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f56280b02d0 0x7f5628146a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57944/0 (socket says 172.21.15.133:57944) 2021-01-03T13:05:25.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f562ce92700 1 -- 172.21.15.133:0/1550238506 learned_addr learned my addr 172.21.15.133:0/1550238506 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:25.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f56277fe700 1 --2- 172.21.15.133:0/1550238506 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f562805cc10 0x7f56281437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:25.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 -- 172.21.15.133:0/1550238506 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682667587 0 0) 0x7f5628147190 con 0x7f56280b02d0 2021-01-03T13:05:25.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 -- 172.21.15.133:0/1550238506 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5614003230 con 0x7f56280b02d0 2021-01-03T13:05:25.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 -- 172.21.15.133:0/1550238506 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807171110 0 0) 0x7f562805c510 con 0x7f562805c130 2021-01-03T13:05:25.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 -- 172.21.15.133:0/1550238506 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5628147190 con 0x7f562805c130 2021-01-03T13:05:25.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 -- 172.21.15.133:0/1550238506 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3170461970 0 0) 0x7f5614003230 con 0x7f56280b02d0 2021-01-03T13:05:25.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 -- 172.21.15.133:0/1550238506 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f562805cc10 msgr2=0x7f56281437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:25.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 --2- 172.21.15.133:0/1550238506 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f562805cc10 0x7f56281437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:25.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 -- 172.21.15.133:0/1550238506 >> v1:172.21.15.16:6789/0 conn(0x7f562805c130 legacy=0x7f5628146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:25.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 -- 172.21.15.133:0/1550238506 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56280b5c10 con 0x7f56280b02d0 2021-01-03T13:05:25.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 -- 172.21.15.133:0/1550238506 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f5620001a50 con 0x7f56280b02d0 2021-01-03T13:05:25.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 -- 172.21.15.133:0/1550238506 >> v1:172.21.15.133:6789/0 conn(0x7f56280b02d0 legacy=0x7f5628146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:25.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 --2- 172.21.15.133:0/1550238506 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f562805cc10 0x7f56140038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:25.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 --2- 172.21.15.133:0/1550238506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5614003da0 0x7f56140044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:25.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 --2- 172.21.15.133:0/1550238506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56140049c0 0x7f5614004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:25.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 -- 172.21.15.133:0/1550238506 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56280b0780 con 0x7f56140049c0 2021-01-03T13:05:25.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 -- 172.21.15.133:0/1550238506 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5614005330 con 0x7f5614003da0 2021-01-03T13:05:25.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 -- 172.21.15.133:0/1550238506 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561400b750 con 0x7f562805cc10 2021-01-03T13:05:25.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f56277fe700 1 --2- 172.21.15.133:0/1550238506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5614003da0 0x7f56140044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:25.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5627fff700 1 --2- 172.21.15.133:0/1550238506 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f562805cc10 0x7f56140038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:25.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f562ce92700 1 --2- 172.21.15.133:0/1550238506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56140049c0 0x7f5614004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:25.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f56277fe700 1 -- 172.21.15.133:0/1550238506 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f562805cc10 msgr2=0x7f56140038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:25.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f56277fe700 1 --2- 172.21.15.133:0/1550238506 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f562805cc10 0x7f56140038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:25.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f56277fe700 1 -- 172.21.15.133:0/1550238506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56140049c0 msgr2=0x7f5614004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:25.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f56277fe700 1 --2- 172.21.15.133:0/1550238506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56140049c0 0x7f5614004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:25.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f56277fe700 1 -- 172.21.15.133:0/1550238506 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5614003230 con 0x7f5614003da0 2021-01-03T13:05:25.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f562ce92700 1 --2- 172.21.15.133:0/1550238506 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56140049c0 0x7f5614004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:25.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f56277fe700 1 --2- 172.21.15.133:0/1550238506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5614003da0 0x7f56140044d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f561c00c000 tx=0x7f561c008040).ready entity=mon.1 client_cookie=e4a08420ba068f8b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:25.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 -- 172.21.15.133:0/1550238506 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f561c00e970 con 0x7f5614003da0 2021-01-03T13:05:25.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 -- 172.21.15.133:0/1550238506 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561c00ead0 con 0x7f5614003da0 2021-01-03T13:05:25.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f5626ffd700 1 -- 172.21.15.133:0/1550238506 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f561c00ee30 con 0x7f5614003da0 2021-01-03T13:05:25.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f562e8f5700 1 -- 172.21.15.133:0/1550238506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5614003da0 msgr2=0x7f56140044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:25.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f562e8f5700 1 --2- 172.21.15.133:0/1550238506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5614003da0 0x7f56140044d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f561c00c000 tx=0x7f561c008040).stop 2021-01-03T13:05:25.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.377+0000 7f562ce92700 1 -- 172.21.15.133:0/1550238506 reap_dead start 2021-01-03T13:05:25.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.381+0000 7f562e8f5700 1 -- 172.21.15.133:0/1550238506 shutdown_connections 2021-01-03T13:05:25.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.381+0000 7f562e8f5700 1 -- 172.21.15.133:0/1550238506 >> 172.21.15.133:0/1550238506 conn(0x7f56280b95d0 msgr2=0x7f56280b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:25.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.381+0000 7f562e8f5700 1 -- 172.21.15.133:0/1550238506 shutdown_connections 2021-01-03T13:05:25.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.381+0000 7f562e8f5700 1 -- 172.21.15.133:0/1550238506 wait complete. 2021-01-03T13:05:25.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.381+0000 7f562e8f5700 1 Processor -- start 2021-01-03T13:05:25.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.381+0000 7f562e8f5700 1 -- start start 2021-01-03T13:05:25.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.381+0000 7f562e8f5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5628139250 0x7f5628148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:25.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.381+0000 7f562e8f5700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f56281415c0 0x7f5628147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:25.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.381+0000 7f562e8f5700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5628147df0 0x7f5628155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:25.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.381+0000 7f562e8f5700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56280b9260 con 0x7f5628147df0 2021-01-03T13:05:25.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.381+0000 7f562e8f5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56281486f0 con 0x7f5628139250 2021-01-03T13:05:25.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.381+0000 7f562e8f5700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5628139630 con 0x7f56281415c0 2021-01-03T13:05:25.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f5627fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5628139250 0x7f5628148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:25.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f5627fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5628139250 0x7f5628148c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36922/0 (socket says 172.21.15.133:36922) 2021-01-03T13:05:25.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f5627fff700 1 -- 172.21.15.133:0/631502594 learned_addr learned my addr 172.21.15.133:0/631502594 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:25.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f56277fe700 1 --2- 172.21.15.133:0/631502594 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f56281415c0 0x7f5628147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:25.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f562ce92700 1 --2- 172.21.15.133:0/631502594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5628147df0 0x7f5628155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:25.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f5627fff700 1 -- 172.21.15.133:0/631502594 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f56281415c0 msgr2=0x7f5628147900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:25.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f5627fff700 1 --2- 172.21.15.133:0/631502594 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f56281415c0 0x7f5628147900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f5627fff700 1 -- 172.21.15.133:0/631502594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5628147df0 msgr2=0x7f5628155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f5627fff700 1 --2- 172.21.15.133:0/631502594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5628147df0 0x7f5628155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f5627fff700 1 -- 172.21.15.133:0/631502594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5628139e20 con 0x7f5628139250 2021-01-03T13:05:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f5627fff700 1 --2- 172.21.15.133:0/631502594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5628139250 0x7f5628148c00 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f56281429f0 tx=0x7f5618007b60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:25.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f56257fa700 1 -- 172.21.15.133:0/631502594 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f561800fc30 con 0x7f5628139250 2021-01-03T13:05:25.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f56257fa700 1 -- 172.21.15.133:0/631502594 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561800fd90 con 0x7f5628139250 2021-01-03T13:05:25.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f562e8f5700 1 -- 172.21.15.133:0/631502594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5628148920 con 0x7f5628139250 2021-01-03T13:05:25.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f56257fa700 1 -- 172.21.15.133:0/631502594 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5618014640 con 0x7f5628139250 2021-01-03T13:05:25.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f562e8f5700 1 -- 172.21.15.133:0/631502594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5628140ce0 con 0x7f5628139250 2021-01-03T13:05:25.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f562e8f5700 1 -- 172.21.15.133:0/631502594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5628057300 con 0x7f5628139250 2021-01-03T13:05:25.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f56257fa700 1 -- 172.21.15.133:0/631502594 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f561801b030 con 0x7f5628139250 2021-01-03T13:05:25.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.385+0000 7f56257fa700 1 --2- 172.21.15.133:0/631502594 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5608055330 0x7f56080577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:25.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.389+0000 7f56257fa700 1 -- 172.21.15.133:0/631502594 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f561806e100 con 0x7f5628139250 2021-01-03T13:05:25.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.389+0000 7f56277fe700 1 --2- 172.21.15.133:0/631502594 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5608055330 0x7f56080577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:25.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.389+0000 7f56277fe700 1 --2- 172.21.15.133:0/631502594 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5608055330 0x7f56080577f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f561c01c000 tx=0x7f561c01a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:25.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.393+0000 7f56257fa700 1 -- 172.21.15.133:0/631502594 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5618044400 con 0x7f5628139250 2021-01-03T13:05:25.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.581+0000 7f562e8f5700 1 -- 172.21.15.133:0/631502594 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f562805d270 con 0x7f5628139250 2021-01-03T13:05:25.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.581+0000 7f56257fa700 1 -- 172.21.15.133:0/631502594 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f5618047a20 con 0x7f5628139250 2021-01-03T13:05:25.585 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:25.586 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":38,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6523,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3593206473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3593206473},{"type":"v1","addr":"172.21.15.133:6835","nonce":3593206473}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/328558863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":328558863},{"type":"v1","addr":"172.21.15.133:6837","nonce":328558863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:08.865621+0000","modified":"2021-01-03T13:05:09.868458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6532},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6532":{"gid":6532,"name":"b","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/420953895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":420953895},{"type":"v1","addr":"172.21.15.16:6833","nonce":420953895}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-01-03T13:05:25.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.581+0000 7f562e8f5700 1 -- 172.21.15.133:0/631502594 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5608055330 msgr2=0x7f56080577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:25.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.581+0000 7f562e8f5700 1 --2- 172.21.15.133:0/631502594 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5608055330 0x7f56080577f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f561c01c000 tx=0x7f561c01a000).stop 2021-01-03T13:05:25.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.581+0000 7f562e8f5700 1 -- 172.21.15.133:0/631502594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5628139250 msgr2=0x7f5628148c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:25.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.581+0000 7f562e8f5700 1 --2- 172.21.15.133:0/631502594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5628139250 0x7f5628148c00 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f56281429f0 tx=0x7f5618007b60).stop 2021-01-03T13:05:25.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.581+0000 7f562e8f5700 1 -- 172.21.15.133:0/631502594 shutdown_connections 2021-01-03T13:05:25.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.581+0000 7f562e8f5700 1 --2- 172.21.15.133:0/631502594 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5608055330 0x7f56080577f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:25.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.581+0000 7f562e8f5700 1 --2- 172.21.15.133:0/631502594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5628147df0 0x7f5628155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:25.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.581+0000 7f562e8f5700 1 --2- 172.21.15.133:0/631502594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5628139250 0x7f5628148c00 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:25.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.581+0000 7f562e8f5700 1 --2- 172.21.15.133:0/631502594 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f56281415c0 0x7f5628147900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:25.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.581+0000 7f562e8f5700 1 -- 172.21.15.133:0/631502594 >> 172.21.15.133:0/631502594 conn(0x7f56280b95d0 msgr2=0x7f56281435b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:25.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.581+0000 7f562e8f5700 1 -- 172.21.15.133:0/631502594 shutdown_connections 2021-01-03T13:05:25.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.581+0000 7f562e8f5700 1 -- 172.21.15.133:0/631502594 wait complete. 2021-01-03T13:05:25.591 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 38 2021-01-03T13:05:25.599 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-01-03T13:05:25.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.701+0000 7f71d59e8700 1 Processor -- start 2021-01-03T13:05:25.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.701+0000 7f71d59e8700 1 -- start start 2021-01-03T13:05:25.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.701+0000 7f71d59e8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d00af200 0x7f71d005bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:25.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.701+0000 7f71d59e8700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d00af5e0 con 0x7f71d0144bb0 2021-01-03T13:05:25.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.701+0000 7f71d59e8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d005c620 con 0x7f71d00b0210 2021-01-03T13:05:25.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.701+0000 7f71d59e8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d005c8c0 con 0x7f71d00af200 2021-01-03T13:05:25.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.701+0000 7f71cffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f71d00b0210 0x7f71d0141180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57964/0 (socket says 172.21.15.133:57964) 2021-01-03T13:05:25.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.701+0000 7f71cffff700 1 -- 172.21.15.133:0/3352991642 learned_addr learned my addr 172.21.15.133:0/3352991642 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:25.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71d49e6700 1 --2- 172.21.15.133:0/3352991642 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d00af200 0x7f71d005bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:25.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71cf7fe700 1 -- 172.21.15.133:0/3352991642 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323236831 0 0) 0x7f71d005c620 con 0x7f71d00b0210 2021-01-03T13:05:25.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71cf7fe700 1 -- 172.21.15.133:0/3352991642 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71b0003230 con 0x7f71d00b0210 2021-01-03T13:05:25.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71cf7fe700 1 -- 172.21.15.133:0/3352991642 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1957078215 0 0) 0x7f71d00af5e0 con 0x7f71d0144bb0 2021-01-03T13:05:25.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71cf7fe700 1 -- 172.21.15.133:0/3352991642 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71d005c620 con 0x7f71d0144bb0 2021-01-03T13:05:25.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71d49e6700 1 -- 172.21.15.133:0/3352991642 >> v1:172.21.15.133:6789/0 conn(0x7f71d00b0210 legacy=0x7f71d0141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:25.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71d49e6700 1 -- 172.21.15.133:0/3352991642 >> v1:172.21.15.16:6789/0 conn(0x7f71d0144bb0 legacy=0x7f71d00ab300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:25.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71d49e6700 1 -- 172.21.15.133:0/3352991642 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d0140a40 con 0x7f71d00af200 2021-01-03T13:05:25.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71d49e6700 1 --2- 172.21.15.133:0/3352991642 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d00af200 0x7f71d005bdf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f71c0002f30 tx=0x7f71c0006dc0).ready entity=mon.2 client_cookie=627bcad05092bd63 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:25.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71cf7fe700 1 -- 172.21.15.133:0/3352991642 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c0009730 con 0x7f71d00af200 2021-01-03T13:05:25.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71cf7fe700 1 -- 172.21.15.133:0/3352991642 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c0009890 con 0x7f71d00af200 2021-01-03T13:05:25.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71cf7fe700 1 -- 172.21.15.133:0/3352991642 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c0009bf0 con 0x7f71d00af200 2021-01-03T13:05:25.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71d59e8700 1 -- 172.21.15.133:0/3352991642 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d00af200 msgr2=0x7f71d005bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:25.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71d59e8700 1 --2- 172.21.15.133:0/3352991642 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d00af200 0x7f71d005bdf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f71c0002f30 tx=0x7f71c0006dc0).stop 2021-01-03T13:05:25.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71d59e8700 1 -- 172.21.15.133:0/3352991642 shutdown_connections 2021-01-03T13:05:25.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71d59e8700 1 --2- 172.21.15.133:0/3352991642 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d00af200 0x7f71d005bdf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:25.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71d59e8700 1 -- 172.21.15.133:0/3352991642 >> 172.21.15.133:0/3352991642 conn(0x7f71d006b050 msgr2=0x7f71d0060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:25.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71d59e8700 1 -- 172.21.15.133:0/3352991642 shutdown_connections 2021-01-03T13:05:25.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.705+0000 7f71d59e8700 1 -- 172.21.15.133:0/3352991642 wait complete. 2021-01-03T13:05:25.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71d59e8700 1 Processor -- start 2021-01-03T13:05:25.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71d59e8700 1 -- start start 2021-01-03T13:05:25.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71d59e8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d00af200 0x7f71d0143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:25.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71d59e8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d00b0210 0x7f71d0064510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:25.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71d59e8700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71d0144bb0 0x7f71d0064a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:25.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71d59e8700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d014fef0 con 0x7f71d0144bb0 2021-01-03T13:05:25.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71d59e8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d0150190 con 0x7f71d00b0210 2021-01-03T13:05:25.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71d59e8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d0150430 con 0x7f71d00af200 2021-01-03T13:05:25.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71cffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d00b0210 0x7f71d0064510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:25.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71cffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d00b0210 0x7f71d0064510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36938/0 (socket says 172.21.15.133:36938) 2021-01-03T13:05:25.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71cffff700 1 -- 172.21.15.133:0/1959139047 learned_addr learned my addr 172.21.15.133:0/1959139047 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:25.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71d51e7700 1 --2- 172.21.15.133:0/1959139047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71d0144bb0 0x7f71d0064a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:25.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71d49e6700 1 --2- 172.21.15.133:0/1959139047 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d00af200 0x7f71d0143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:25.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71cffff700 1 -- 172.21.15.133:0/1959139047 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d00af200 msgr2=0x7f71d0143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:25.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71cffff700 1 --2- 172.21.15.133:0/1959139047 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d00af200 0x7f71d0143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:25.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71cffff700 1 -- 172.21.15.133:0/1959139047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71d0144bb0 msgr2=0x7f71d0064a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:25.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71cffff700 1 --2- 172.21.15.133:0/1959139047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71d0144bb0 0x7f71d0064a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:25.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71cffff700 1 -- 172.21.15.133:0/1959139047 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d01506d0 con 0x7f71d00b0210 2021-01-03T13:05:25.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71cffff700 1 --2- 172.21.15.133:0/1959139047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d00b0210 0x7f71d0064510 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f71b80010d0 tx=0x7f71b8007a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:25.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71cdffb700 1 -- 172.21.15.133:0/1959139047 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71b80072e0 con 0x7f71d00b0210 2021-01-03T13:05:25.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71cdffb700 1 -- 172.21.15.133:0/1959139047 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b8007440 con 0x7f71d00b0210 2021-01-03T13:05:25.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71d59e8700 1 -- 172.21.15.133:0/1959139047 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d0150b70 con 0x7f71d00b0210 2021-01-03T13:05:25.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71cdffb700 1 -- 172.21.15.133:0/1959139047 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71b80057d0 con 0x7f71d00b0210 2021-01-03T13:05:25.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.709+0000 7f71d59e8700 1 -- 172.21.15.133:0/1959139047 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d0063190 con 0x7f71d00b0210 2021-01-03T13:05:25.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.713+0000 7f71cdffb700 1 -- 172.21.15.133:0/1959139047 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f71b8010070 con 0x7f71d00b0210 2021-01-03T13:05:25.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.713+0000 7f71d59e8700 1 -- 172.21.15.133:0/1959139047 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d0150860 con 0x7f71d00b0210 2021-01-03T13:05:25.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.713+0000 7f71cdffb700 1 --2- 172.21.15.133:0/1959139047 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71b40554e0 0x7f71b40579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:25.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.713+0000 7f71cdffb700 1 -- 172.21.15.133:0/1959139047 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f71b806d540 con 0x7f71d00b0210 2021-01-03T13:05:25.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.713+0000 7f71d49e6700 1 --2- 172.21.15.133:0/1959139047 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71b40554e0 0x7f71b40579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:25.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.713+0000 7f71d49e6700 1 --2- 172.21.15.133:0/1959139047 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71b40554e0 0x7f71b40579a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f71c0019000 tx=0x7f71c0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:25.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.717+0000 7f71cdffb700 1 -- 172.21.15.133:0/1959139047 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f71b8043840 con 0x7f71d00b0210 2021-01-03T13:05:25.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:25.897+0000 7f71d59e8700 1 -- 172.21.15.133:0/1959139047 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f71d0057300 con 0x7f71d00b0210 2021-01-03T13:05:26.590 INFO:tasks.ceph.mon.b.smithi016.stderr:2021-01-03T13:05:26.586+0000 7fba5c9c4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-01-03T13:05:26.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.593+0000 7f71cdffb700 1 -- 172.21.15.133:0/1959139047 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 161+0+0 (secure 0 0 0) 0x7f71b8046e60 con 0x7f71d00b0210 2021-01-03T13:05:26.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.597+0000 7f71d59e8700 1 -- 172.21.15.133:0/1959139047 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71b40554e0 msgr2=0x7f71b40579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:26.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.597+0000 7f71d59e8700 1 --2- 172.21.15.133:0/1959139047 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71b40554e0 0x7f71b40579a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f71c0019000 tx=0x7f71c0015000).stop 2021-01-03T13:05:26.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.597+0000 7f71d59e8700 1 -- 172.21.15.133:0/1959139047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d00b0210 msgr2=0x7f71d0064510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:26.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.597+0000 7f71d59e8700 1 --2- 172.21.15.133:0/1959139047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d00b0210 0x7f71d0064510 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f71b80010d0 tx=0x7f71b8007a70).stop 2021-01-03T13:05:26.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.597+0000 7f71d59e8700 1 -- 172.21.15.133:0/1959139047 shutdown_connections 2021-01-03T13:05:26.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.597+0000 7f71d59e8700 1 --2- 172.21.15.133:0/1959139047 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71b40554e0 0x7f71b40579a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:26.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.597+0000 7f71d59e8700 1 --2- 172.21.15.133:0/1959139047 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71d0144bb0 0x7f71d0064a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:26.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.597+0000 7f71d59e8700 1 --2- 172.21.15.133:0/1959139047 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d00af200 0x7f71d0143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:26.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.597+0000 7f71d59e8700 1 --2- 172.21.15.133:0/1959139047 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d00b0210 0x7f71d0064510 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:26.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.597+0000 7f71d59e8700 1 -- 172.21.15.133:0/1959139047 >> 172.21.15.133:0/1959139047 conn(0x7f71d006b050 msgr2=0x7f71d00b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:26.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.597+0000 7f71d59e8700 1 -- 172.21.15.133:0/1959139047 shutdown_connections 2021-01-03T13:05:26.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.597+0000 7f71d59e8700 1 -- 172.21.15.133:0/1959139047 wait complete. 2021-01-03T13:05:26.606 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-01-03T13:05:26.616 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:05:26.627 INFO:tasks.ceph.mds.b.smithi016.stdout:starting mds.b at 2021-01-03T13:05:26.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.725+0000 7f55e3a22700 1 Processor -- start 2021-01-03T13:05:26.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.725+0000 7f55e3a22700 1 -- start start 2021-01-03T13:05:26.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55e3a22700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55dc060a30 0x7f55dc0ab190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:26.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55e3a22700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55dc05fff0 con 0x7f55dc0b5a70 2021-01-03T13:05:26.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55e3a22700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55dc0604c0 con 0x7f55dc0b1170 2021-01-03T13:05:26.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55e3a22700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc0610d0 con 0x7f55dc060a30 2021-01-03T13:05:26.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55e1fbf700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f55dc0b1170 0x7f55dc09a8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57980/0 (socket says 172.21.15.133:57980) 2021-01-03T13:05:26.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55e1fbf700 1 -- 172.21.15.133:0/1083974414 learned_addr learned my addr 172.21.15.133:0/1083974414 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:26.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55e0fbd700 1 --2- 172.21.15.133:0/1083974414 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55dc060a30 0x7f55dc0ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:26.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55cffff700 1 -- 172.21.15.133:0/1083974414 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034704048 0 0) 0x7f55dc0604c0 con 0x7f55dc0b1170 2021-01-03T13:05:26.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55cffff700 1 -- 172.21.15.133:0/1083974414 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55c0003230 con 0x7f55dc0b1170 2021-01-03T13:05:26.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55cffff700 1 -- 172.21.15.133:0/1083974414 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148405752 0 0) 0x7f55dc05fff0 con 0x7f55dc0b5a70 2021-01-03T13:05:26.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55cffff700 1 -- 172.21.15.133:0/1083974414 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55dc0604c0 con 0x7f55dc0b5a70 2021-01-03T13:05:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55e0fbd700 1 -- 172.21.15.133:0/1083974414 >> v1:172.21.15.133:6789/0 conn(0x7f55dc0b1170 legacy=0x7f55dc09a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:26.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55e0fbd700 1 -- 172.21.15.133:0/1083974414 >> v1:172.21.15.16:6789/0 conn(0x7f55dc0b5a70 legacy=0x7f55dc147820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:26.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55e0fbd700 1 -- 172.21.15.133:0/1083974414 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc147f30 con 0x7f55dc060a30 2021-01-03T13:05:26.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55e0fbd700 1 --2- 172.21.15.133:0/1083974414 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55dc060a30 0x7f55dc0ab190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f55d0002f30 tx=0x7f55d0006dc0).ready entity=mon.2 client_cookie=1c981b721a06762 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:26.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55cffff700 1 -- 172.21.15.133:0/1083974414 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55d0009730 con 0x7f55dc060a30 2021-01-03T13:05:26.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55cffff700 1 -- 172.21.15.133:0/1083974414 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d0009890 con 0x7f55dc060a30 2021-01-03T13:05:26.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55cffff700 1 -- 172.21.15.133:0/1083974414 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55d0009bf0 con 0x7f55dc060a30 2021-01-03T13:05:26.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55e3a22700 1 -- 172.21.15.133:0/1083974414 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55dc060a30 msgr2=0x7f55dc0ab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:26.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.729+0000 7f55e3a22700 1 --2- 172.21.15.133:0/1083974414 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55dc060a30 0x7f55dc0ab190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f55d0002f30 tx=0x7f55d0006dc0).stop 2021-01-03T13:05:26.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e3a22700 1 -- 172.21.15.133:0/1083974414 shutdown_connections 2021-01-03T13:05:26.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e3a22700 1 --2- 172.21.15.133:0/1083974414 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55dc060a30 0x7f55dc0ab190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:26.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e3a22700 1 -- 172.21.15.133:0/1083974414 >> 172.21.15.133:0/1083974414 conn(0x7f55dc05c8b0 msgr2=0x7f55dc0b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:26.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e3a22700 1 -- 172.21.15.133:0/1083974414 shutdown_connections 2021-01-03T13:05:26.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e3a22700 1 -- 172.21.15.133:0/1083974414 wait complete. 2021-01-03T13:05:26.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e3a22700 1 Processor -- start 2021-01-03T13:05:26.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e3a22700 1 -- start start 2021-01-03T13:05:26.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e3a22700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55dc060a30 0x7f55dc13e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:26.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e3a22700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55dc0b1170 0x7f55dc14cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:26.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e3a22700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55dc0b5a70 0x7f55dc144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:26.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e3a22700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc146950 con 0x7f55dc0b5a70 2021-01-03T13:05:26.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e3a22700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc13d8a0 con 0x7f55dc0b1170 2021-01-03T13:05:26.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e3a22700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc13db40 con 0x7f55dc060a30 2021-01-03T13:05:26.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e0fbd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55dc0b1170 0x7f55dc14cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:26.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e0fbd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55dc0b1170 0x7f55dc14cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36952/0 (socket says 172.21.15.133:36952) 2021-01-03T13:05:26.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e0fbd700 1 -- 172.21.15.133:0/2260022712 learned_addr learned my addr 172.21.15.133:0/2260022712 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:26.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e17be700 1 --2- 172.21.15.133:0/2260022712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55dc060a30 0x7f55dc13e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:26.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.733+0000 7f55e1fbf700 1 --2- 172.21.15.133:0/2260022712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55dc0b5a70 0x7f55dc144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:26.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.737+0000 7f55e0fbd700 1 -- 172.21.15.133:0/2260022712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55dc060a30 msgr2=0x7f55dc13e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:26.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.737+0000 7f55e0fbd700 1 --2- 172.21.15.133:0/2260022712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55dc060a30 0x7f55dc13e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:26.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.737+0000 7f55e0fbd700 1 -- 172.21.15.133:0/2260022712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55dc0b5a70 msgr2=0x7f55dc144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:26.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.737+0000 7f55e0fbd700 1 --2- 172.21.15.133:0/2260022712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55dc0b5a70 0x7f55dc144da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:26.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.737+0000 7f55e0fbd700 1 -- 172.21.15.133:0/2260022712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc146b80 con 0x7f55dc0b1170 2021-01-03T13:05:26.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.737+0000 7f55e0fbd700 1 --2- 172.21.15.133:0/2260022712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55dc0b1170 0x7f55dc14cab0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f55dc13de10 tx=0x7f55d0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:26.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.737+0000 7f55ce7fc700 1 -- 172.21.15.133:0/2260022712 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55d0011ac0 con 0x7f55dc0b1170 2021-01-03T13:05:26.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.737+0000 7f55ce7fc700 1 -- 172.21.15.133:0/2260022712 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d0011c20 con 0x7f55dc0b1170 2021-01-03T13:05:26.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.737+0000 7f55e3a22700 1 -- 172.21.15.133:0/2260022712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55dc0b3660 con 0x7f55dc0b1170 2021-01-03T13:05:26.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.737+0000 7f55ce7fc700 1 -- 172.21.15.133:0/2260022712 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55d001d450 con 0x7f55dc0b1170 2021-01-03T13:05:26.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.737+0000 7f55e3a22700 1 -- 172.21.15.133:0/2260022712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55dc145430 con 0x7f55dc0b1170 2021-01-03T13:05:26.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.737+0000 7f55e3a22700 1 -- 172.21.15.133:0/2260022712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55dc057300 con 0x7f55dc0b1170 2021-01-03T13:05:26.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.737+0000 7f55ce7fc700 1 -- 172.21.15.133:0/2260022712 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f55d000f070 con 0x7f55dc0b1170 2021-01-03T13:05:26.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.737+0000 7f55ce7fc700 1 --2- 172.21.15.133:0/2260022712 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55c4055330 0x7f55c40577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:26.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.737+0000 7f55ce7fc700 1 -- 172.21.15.133:0/2260022712 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f55d006ed30 con 0x7f55dc0b1170 2021-01-03T13:05:26.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.737+0000 7f55e17be700 1 --2- 172.21.15.133:0/2260022712 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55c4055330 0x7f55c40577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:26.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.741+0000 7f55e17be700 1 --2- 172.21.15.133:0/2260022712 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55c4055330 0x7f55c40577f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f55d800d000 tx=0x7f55d80079e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:26.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.745+0000 7f55ce7fc700 1 -- 172.21.15.133:0/2260022712 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f55d0044f40 con 0x7f55dc0b1170 2021-01-03T13:05:26.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.925+0000 7f55e3a22700 1 -- 172.21.15.133:0/2260022712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55dc05ce00 con 0x7f55dc0b1170 2021-01-03T13:05:26.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.929+0000 7f55ce7fc700 1 -- 172.21.15.133:0/2260022712 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+2135 (secure 0 0 0) 0x7f55d0022070 con 0x7f55dc0b1170 2021-01-03T13:05:26.933 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:26.933 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":39,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6523,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/3593206473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":3593206473},{"type":"v1","addr":"172.21.15.133:6835","nonce":3593206473}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36},{"gid":6529,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/328558863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":328558863},{"type":"v1","addr":"172.21.15.133:6837","nonce":328558863}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:08.865621+0000","modified":"2021-01-03T13:05:26.590212+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2021-01-03T13:05:26.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.929+0000 7f55e3a22700 1 -- 172.21.15.133:0/2260022712 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55c4055330 msgr2=0x7f55c40577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:26.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.929+0000 7f55e3a22700 1 --2- 172.21.15.133:0/2260022712 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55c4055330 0x7f55c40577f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f55d800d000 tx=0x7f55d80079e0).stop 2021-01-03T13:05:26.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.929+0000 7f55e3a22700 1 -- 172.21.15.133:0/2260022712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55dc0b1170 msgr2=0x7f55dc14cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:26.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.929+0000 7f55e3a22700 1 --2- 172.21.15.133:0/2260022712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55dc0b1170 0x7f55dc14cab0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f55dc13de10 tx=0x7f55d0015000).stop 2021-01-03T13:05:26.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.929+0000 7f55e3a22700 1 -- 172.21.15.133:0/2260022712 shutdown_connections 2021-01-03T13:05:26.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.929+0000 7f55e3a22700 1 --2- 172.21.15.133:0/2260022712 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55c4055330 0x7f55c40577f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:26.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.929+0000 7f55e3a22700 1 --2- 172.21.15.133:0/2260022712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55dc0b5a70 0x7f55dc144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:26.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.929+0000 7f55e3a22700 1 --2- 172.21.15.133:0/2260022712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55dc060a30 0x7f55dc13e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:26.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.929+0000 7f55e3a22700 1 --2- 172.21.15.133:0/2260022712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55dc0b1170 0x7f55dc14cab0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:26.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.929+0000 7f55e3a22700 1 -- 172.21.15.133:0/2260022712 >> 172.21.15.133:0/2260022712 conn(0x7f55dc05c8b0 msgr2=0x7f55dc098550 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:26.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.929+0000 7f55e3a22700 1 -- 172.21.15.133:0/2260022712 shutdown_connections 2021-01-03T13:05:26.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:26.929+0000 7f55e3a22700 1 -- 172.21.15.133:0/2260022712 wait complete. 2021-01-03T13:05:26.941 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 39 2021-01-03T13:05:26.947 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-01-03T13:05:27.072 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.061+0000 7ff452c61700 1 Processor -- start 2021-01-03T13:05:27.073 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.061+0000 7ff452c61700 1 -- start start 2021-01-03T13:05:27.073 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.061+0000 7ff452c61700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff44c0b0c90 0x7ff44c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:27.073 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.061+0000 7ff452c61700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff44c0b5c00 0x7ff44c143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:27.073 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.061+0000 7ff452c61700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44c060da0 con 0x7ff44c0b52c0 2021-01-03T13:05:27.074 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.061+0000 7ff452c61700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44c067a90 con 0x7ff44c0b5c00 2021-01-03T13:05:27.075 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.061+0000 7ff452c61700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0b0ad0 con 0x7ff44c0b0c90 2021-01-03T13:05:27.075 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.061+0000 7ff452460700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff44c0b5c00 0x7ff44c143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:27.075 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.061+0000 7ff452460700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff44c0b5c00 0x7ff44c143eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36962/0 (socket says 172.21.15.133:36962) 2021-01-03T13:05:27.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.061+0000 7ff452460700 1 -- 172.21.15.133:0/1102009886 learned_addr learned my addr 172.21.15.133:0/1102009886 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:27.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.061+0000 7ff45145e700 1 --2- 172.21.15.133:0/1102009886 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff44c0b0c90 0x7ff44c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:27.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.061+0000 7ff452460700 1 -- 172.21.15.133:0/1102009886 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff44c0b0c90 msgr2=0x7ff44c0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:27.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.061+0000 7ff452460700 1 --2- 172.21.15.133:0/1102009886 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff44c0b0c90 0x7ff44c0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:27.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.061+0000 7ff452460700 1 -- 172.21.15.133:0/1102009886 >> v1:172.21.15.16:6789/0 conn(0x7ff44c0b52c0 legacy=0x7ff44c098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:27.078 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.061+0000 7ff452460700 1 -- 172.21.15.133:0/1102009886 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c0b56a0 con 0x7ff44c0b5c00 2021-01-03T13:05:27.078 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.061+0000 7ff45145e700 1 --2- 172.21.15.133:0/1102009886 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff44c0b0c90 0x7ff44c0b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:27.078 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.061+0000 7ff452460700 1 --2- 172.21.15.133:0/1102009886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff44c0b5c00 0x7ff44c143eb0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7ff43c002f30 tx=0x7ff43c006e80).ready entity=mon.1 client_cookie=aa3e866734dc4a97 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:27.078 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.065+0000 7ff450c5d700 1 -- 172.21.15.133:0/1102009886 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff43c0097f0 con 0x7ff44c0b5c00 2021-01-03T13:05:27.079 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.065+0000 7ff450c5d700 1 -- 172.21.15.133:0/1102009886 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c009950 con 0x7ff44c0b5c00 2021-01-03T13:05:27.079 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.065+0000 7ff450c5d700 1 -- 172.21.15.133:0/1102009886 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff43c009cb0 con 0x7ff44c0b5c00 2021-01-03T13:05:27.079 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.065+0000 7ff452c61700 1 -- 172.21.15.133:0/1102009886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff44c0b5c00 msgr2=0x7ff44c143eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:27.079 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.065+0000 7ff452c61700 1 --2- 172.21.15.133:0/1102009886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff44c0b5c00 0x7ff44c143eb0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7ff43c002f30 tx=0x7ff43c006e80).stop 2021-01-03T13:05:27.079 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.065+0000 7ff452c61700 1 -- 172.21.15.133:0/1102009886 shutdown_connections 2021-01-03T13:05:27.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.065+0000 7ff452c61700 1 --2- 172.21.15.133:0/1102009886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff44c0b5c00 0x7ff44c143eb0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:27.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.065+0000 7ff452c61700 1 --2- 172.21.15.133:0/1102009886 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff44c0b0c90 0x7ff44c0b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:27.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.065+0000 7ff452c61700 1 -- 172.21.15.133:0/1102009886 >> 172.21.15.133:0/1102009886 conn(0x7ff44c05bdf0 msgr2=0x7ff44c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:27.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.065+0000 7ff452c61700 1 -- 172.21.15.133:0/1102009886 shutdown_connections 2021-01-03T13:05:27.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.065+0000 7ff452c61700 1 -- 172.21.15.133:0/1102009886 wait complete. 2021-01-03T13:05:27.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff452c61700 1 Processor -- start 2021-01-03T13:05:27.083 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff452c61700 1 -- start start 2021-01-03T13:05:27.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff452c61700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff44c0b0c90 0x7ff44c0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:27.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff452c61700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff44c0b52c0 0x7ff44c0af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:27.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff452c61700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff44c0b5c00 0x7ff44c0ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:27.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff452c61700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c156b30 con 0x7ff44c0b5c00 2021-01-03T13:05:27.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff452c61700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c156dd0 con 0x7ff44c0b0c90 2021-01-03T13:05:27.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff452c61700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0aed40 con 0x7ff44c0b52c0 2021-01-03T13:05:27.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff451c5f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff44c0b0c90 0x7ff44c0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:27.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff451c5f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff44c0b0c90 0x7ff44c0ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36964/0 (socket says 172.21.15.133:36964) 2021-01-03T13:05:27.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff451c5f700 1 -- 172.21.15.133:0/1058312122 learned_addr learned my addr 172.21.15.133:0/1058312122 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:27.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff452460700 1 --2- 172.21.15.133:0/1058312122 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff44c0b5c00 0x7ff44c0ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:27.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff45145e700 1 --2- 172.21.15.133:0/1058312122 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff44c0b52c0 0x7ff44c0af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:27.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff451c5f700 1 -- 172.21.15.133:0/1058312122 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff44c0b52c0 msgr2=0x7ff44c0af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:27.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff451c5f700 1 --2- 172.21.15.133:0/1058312122 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff44c0b52c0 0x7ff44c0af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:27.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff451c5f700 1 -- 172.21.15.133:0/1058312122 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff44c0b5c00 msgr2=0x7ff44c0ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:27.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff451c5f700 1 --2- 172.21.15.133:0/1058312122 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff44c0b5c00 0x7ff44c0ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:27.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff451c5f700 1 -- 172.21.15.133:0/1058312122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c156840 con 0x7ff44c0b0c90 2021-01-03T13:05:27.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff45145e700 1 --2- 172.21.15.133:0/1058312122 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff44c0b52c0 0x7ff44c0af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:27.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff451c5f700 1 --2- 172.21.15.133:0/1058312122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff44c0b0c90 0x7ff44c0ab5c0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7ff44c062160 tx=0x7ff444007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:27.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff44affd700 1 -- 172.21.15.133:0/1058312122 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff444007240 con 0x7ff44c0b0c90 2021-01-03T13:05:27.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff44affd700 1 -- 172.21.15.133:0/1058312122 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4440073a0 con 0x7ff44c0b0c90 2021-01-03T13:05:27.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff452c61700 1 -- 172.21.15.133:0/1058312122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44c0673c0 con 0x7ff44c0b0c90 2021-01-03T13:05:27.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff44affd700 1 -- 172.21.15.133:0/1058312122 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4440064e0 con 0x7ff44c0b0c90 2021-01-03T13:05:27.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.069+0000 7ff452c61700 1 -- 172.21.15.133:0/1058312122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44c0aa710 con 0x7ff44c0b0c90 2021-01-03T13:05:27.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.073+0000 7ff452c61700 1 -- 172.21.15.133:0/1058312122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44c0aef00 con 0x7ff44c0b0c90 2021-01-03T13:05:27.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.073+0000 7ff44affd700 1 -- 172.21.15.133:0/1058312122 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff444010070 con 0x7ff44c0b0c90 2021-01-03T13:05:27.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.073+0000 7ff44affd700 1 --2- 172.21.15.133:0/1058312122 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff42c055350 0x7ff42c057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:27.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.073+0000 7ff44affd700 1 -- 172.21.15.133:0/1058312122 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff44406d640 con 0x7ff44c0b0c90 2021-01-03T13:05:27.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.073+0000 7ff45145e700 1 --2- 172.21.15.133:0/1058312122 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff42c055350 0x7ff42c057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:27.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.073+0000 7ff45145e700 1 --2- 172.21.15.133:0/1058312122 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff42c055350 0x7ff42c057810 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7ff44000d000 tx=0x7ff440008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:27.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.081+0000 7ff44affd700 1 -- 172.21.15.133:0/1058312122 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff444043760 con 0x7ff44c0b0c90 2021-01-03T13:05:27.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.261+0000 7ff452c61700 1 -- 172.21.15.133:0/1058312122 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff44c057300 con 0x7ff44c0b0c90 2021-01-03T13:05:27.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.593+0000 7ff44affd700 1 -- 172.21.15.133:0/1058312122 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff444018070 con 0x7ff44c0b0c90 2021-01-03T13:05:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.597+0000 7ff452c61700 1 -- 172.21.15.133:0/1058312122 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff42c055350 msgr2=0x7ff42c057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.597+0000 7ff452c61700 1 --2- 172.21.15.133:0/1058312122 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff42c055350 0x7ff42c057810 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7ff44000d000 tx=0x7ff440008040).stop 2021-01-03T13:05:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.601+0000 7ff452c61700 1 -- 172.21.15.133:0/1058312122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff44c0b0c90 msgr2=0x7ff44c0ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.601+0000 7ff452c61700 1 --2- 172.21.15.133:0/1058312122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff44c0b0c90 0x7ff44c0ab5c0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7ff44c062160 tx=0x7ff444007be0).stop 2021-01-03T13:05:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.601+0000 7ff452c61700 1 -- 172.21.15.133:0/1058312122 shutdown_connections 2021-01-03T13:05:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.601+0000 7ff452c61700 1 --2- 172.21.15.133:0/1058312122 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff42c055350 0x7ff42c057810 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.601+0000 7ff452c61700 1 --2- 172.21.15.133:0/1058312122 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff44c0b5c00 0x7ff44c0ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.601+0000 7ff452c61700 1 --2- 172.21.15.133:0/1058312122 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff44c0b0c90 0x7ff44c0ab5c0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:27.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.601+0000 7ff452c61700 1 --2- 172.21.15.133:0/1058312122 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff44c0b52c0 0x7ff44c0af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:27.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.601+0000 7ff452c61700 1 -- 172.21.15.133:0/1058312122 >> 172.21.15.133:0/1058312122 conn(0x7ff44c05bdf0 msgr2=0x7ff44c0b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:27.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.601+0000 7ff452c61700 1 -- 172.21.15.133:0/1058312122 shutdown_connections 2021-01-03T13:05:27.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.601+0000 7ff452c61700 1 -- 172.21.15.133:0/1058312122 wait complete. 2021-01-03T13:05:27.622 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-01-03T13:05:27.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.741+0000 7f703bfff700 1 Processor -- start 2021-01-03T13:05:27.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.741+0000 7f703bfff700 1 -- start start 2021-01-03T13:05:27.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f703c060510 0x7f703c05c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:27.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703bfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f703c05fd10 0x7f703c0b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:27.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703bfff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c05bf00 con 0x7f703c0b4c20 2021-01-03T13:05:27.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703bfff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703c05c1a0 con 0x7f703c05fd10 2021-01-03T13:05:27.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703bfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703c05c440 con 0x7f703c060510 2021-01-03T13:05:27.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f70327fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f703c060510 0x7f703c05c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:27.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f70327fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f703c060510 0x7f703c05c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36974/0 (socket says 172.21.15.133:36974) 2021-01-03T13:05:27.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f70327fc700 1 -- 172.21.15.133:0/3805832777 learned_addr learned my addr 172.21.15.133:0/3805832777 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:27.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703affd700 1 --1- 172.21.15.133:0/3805832777 >> v1:172.21.15.133:6789/0 conn(0x7f703c0b4c20 0x7f703c0b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58004/0 (socket says 172.21.15.133:58004) 2021-01-03T13:05:27.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703b7fe700 1 --2- 172.21.15.133:0/3805832777 >> v2:172.21.15.16:3300/0 conn(0x7f703c05fd10 0x7f703c0b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:27.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f70327fc700 1 -- 172.21.15.133:0/3805832777 >> v2:172.21.15.16:3300/0 conn(0x7f703c05fd10 msgr2=0x7f703c0b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:27.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f70327fc700 1 --2- 172.21.15.133:0/3805832777 >> v2:172.21.15.16:3300/0 conn(0x7f703c05fd10 0x7f703c0b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:27.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f70327fc700 1 -- 172.21.15.133:0/3805832777 >> v1:172.21.15.133:6789/0 conn(0x7f703c0b4c20 legacy=0x7f703c0b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:27.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f70327fc700 1 -- 172.21.15.133:0/3805832777 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c0b6ad0 con 0x7f703c060510 2021-01-03T13:05:27.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f70327fc700 1 --2- 172.21.15.133:0/3805832777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703c060510 0x7f703c05c8e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f7024002f30 tx=0x7f7024006e80).ready entity=mon.1 client_cookie=c28616efd88287c0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:27.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703a7fc700 1 -- 172.21.15.133:0/3805832777 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70240097f0 con 0x7f703c060510 2021-01-03T13:05:27.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703a7fc700 1 -- 172.21.15.133:0/3805832777 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7024009950 con 0x7f703c060510 2021-01-03T13:05:27.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703a7fc700 1 -- 172.21.15.133:0/3805832777 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7024009cb0 con 0x7f703c060510 2021-01-03T13:05:27.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703bfff700 1 -- 172.21.15.133:0/3805832777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703c060510 msgr2=0x7f703c05c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:27.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703bfff700 1 --2- 172.21.15.133:0/3805832777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703c060510 0x7f703c05c8e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f7024002f30 tx=0x7f7024006e80).stop 2021-01-03T13:05:27.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703bfff700 1 -- 172.21.15.133:0/3805832777 shutdown_connections 2021-01-03T13:05:27.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703bfff700 1 --2- 172.21.15.133:0/3805832777 >> v2:172.21.15.16:3300/0 conn(0x7f703c05fd10 0x7f703c0b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:27.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703bfff700 1 --2- 172.21.15.133:0/3805832777 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703c060510 0x7f703c05c8e0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:27.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703bfff700 1 -- 172.21.15.133:0/3805832777 >> 172.21.15.133:0/3805832777 conn(0x7f703c0b9f00 msgr2=0x7f703c0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:27.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703bfff700 1 -- 172.21.15.133:0/3805832777 shutdown_connections 2021-01-03T13:05:27.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.745+0000 7f703bfff700 1 -- 172.21.15.133:0/3805832777 wait complete. 2021-01-03T13:05:27.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703bfff700 1 Processor -- start 2021-01-03T13:05:27.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703bfff700 1 -- start start 2021-01-03T13:05:27.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703c05fd10 0x7f703c09eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:27.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f703c060510 0x7f703c147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:27.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703bfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f703c0b4c20 0x7f703c147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:27.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703bfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c151b40 con 0x7f703c060510 2021-01-03T13:05:27.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703bfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c146010 con 0x7f703c05fd10 2021-01-03T13:05:27.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703bfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c144690 con 0x7f703c0b4c20 2021-01-03T13:05:27.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703c05fd10 0x7f703c09eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:27.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703c05fd10 0x7f703c09eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36978/0 (socket says 172.21.15.133:36978) 2021-01-03T13:05:27.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703affd700 1 -- 172.21.15.133:0/3475142172 learned_addr learned my addr 172.21.15.133:0/3475142172 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:27.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703b7fe700 1 --2- 172.21.15.133:0/3475142172 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f703c0b4c20 0x7f703c147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:27.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f70327fc700 1 --2- 172.21.15.133:0/3475142172 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f703c060510 0x7f703c147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:27.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703affd700 1 -- 172.21.15.133:0/3475142172 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f703c0b4c20 msgr2=0x7f703c147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:27.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703affd700 1 --2- 172.21.15.133:0/3475142172 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f703c0b4c20 0x7f703c147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:27.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703affd700 1 -- 172.21.15.133:0/3475142172 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f703c060510 msgr2=0x7f703c147610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:27.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703affd700 1 --2- 172.21.15.133:0/3475142172 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f703c060510 0x7f703c147610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:27.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703affd700 1 -- 172.21.15.133:0/3475142172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c145c60 con 0x7f703c05fd10 2021-01-03T13:05:27.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.749+0000 7f703affd700 1 --2- 172.21.15.133:0/3475142172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703c05fd10 0x7f703c09eba0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f703c061cb0 tx=0x7f702c007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:27.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.753+0000 7f7038ff9700 1 -- 172.21.15.133:0/3475142172 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f702c0072e0 con 0x7f703c05fd10 2021-01-03T13:05:27.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.753+0000 7f7038ff9700 1 -- 172.21.15.133:0/3475142172 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c005520 con 0x7f703c05fd10 2021-01-03T13:05:27.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.753+0000 7f7038ff9700 1 -- 172.21.15.133:0/3475142172 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f702c005880 con 0x7f703c05fd10 2021-01-03T13:05:27.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.753+0000 7f703bfff700 1 -- 172.21.15.133:0/3475142172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703c147ff0 con 0x7f703c05fd10 2021-01-03T13:05:27.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.753+0000 7f703bfff700 1 -- 172.21.15.133:0/3475142172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703c1441a0 con 0x7f703c05fd10 2021-01-03T13:05:27.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.753+0000 7f703bfff700 1 -- 172.21.15.133:0/3475142172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703c144850 con 0x7f703c05fd10 2021-01-03T13:05:27.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.753+0000 7f7038ff9700 1 -- 172.21.15.133:0/3475142172 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f702c010070 con 0x7f703c05fd10 2021-01-03T13:05:27.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.753+0000 7f7038ff9700 1 --2- 172.21.15.133:0/3475142172 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f70200553b0 0x7f7020057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:27.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.753+0000 7f7038ff9700 1 -- 172.21.15.133:0/3475142172 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f702c06d440 con 0x7f703c05fd10 2021-01-03T13:05:27.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.753+0000 7f70327fc700 1 --2- 172.21.15.133:0/3475142172 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f70200553b0 0x7f7020057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:27.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.757+0000 7f70327fc700 1 --2- 172.21.15.133:0/3475142172 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f70200553b0 0x7f7020057870 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f702401c000 tx=0x7f7024015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:27.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.761+0000 7f7038ff9700 1 -- 172.21.15.133:0/3475142172 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f702c043650 con 0x7f703c05fd10 2021-01-03T13:05:27.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:27.897+0000 7f703bfff700 1 -- 172.21.15.133:0/3475142172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f703c057300 con 0x7f703c05fd10 2021-01-03T13:05:28.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.641+0000 7f7038ff9700 1 -- 172.21.15.133:0/3475142172 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) v1 ==== 185+0+0 (secure 0 0 0) 0x7f702c046c70 con 0x7f703c05fd10 2021-01-03T13:05:28.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.645+0000 7f703bfff700 1 -- 172.21.15.133:0/3475142172 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f70200553b0 msgr2=0x7f7020057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:28.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.645+0000 7f703bfff700 1 --2- 172.21.15.133:0/3475142172 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f70200553b0 0x7f7020057870 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f702401c000 tx=0x7f7024015000).stop 2021-01-03T13:05:28.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.645+0000 7f703bfff700 1 -- 172.21.15.133:0/3475142172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703c05fd10 msgr2=0x7f703c09eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:28.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.645+0000 7f703bfff700 1 --2- 172.21.15.133:0/3475142172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703c05fd10 0x7f703c09eba0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f703c061cb0 tx=0x7f702c007c10).stop 2021-01-03T13:05:28.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.645+0000 7f703bfff700 1 -- 172.21.15.133:0/3475142172 shutdown_connections 2021-01-03T13:05:28.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.645+0000 7f703bfff700 1 --2- 172.21.15.133:0/3475142172 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f70200553b0 0x7f7020057870 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:28.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.645+0000 7f703bfff700 1 --2- 172.21.15.133:0/3475142172 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f703c0b4c20 0x7f703c147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:28.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.645+0000 7f703bfff700 1 --2- 172.21.15.133:0/3475142172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f703c05fd10 0x7f703c09eba0 secure :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0x7f703c061cb0 tx=0x7f702c007c10).stop 2021-01-03T13:05:28.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.645+0000 7f703bfff700 1 --2- 172.21.15.133:0/3475142172 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f703c060510 0x7f703c147610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:28.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.645+0000 7f703bfff700 1 -- 172.21.15.133:0/3475142172 >> 172.21.15.133:0/3475142172 conn(0x7f703c0b9f00 msgr2=0x7f703c0ae600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:28.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.645+0000 7f703bfff700 1 -- 172.21.15.133:0/3475142172 shutdown_connections 2021-01-03T13:05:28.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.645+0000 7f703bfff700 1 -- 172.21.15.133:0/3475142172 wait complete. 2021-01-03T13:05:28.659 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2021-01-03T13:05:28.665 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-01-03T13:05:28.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.777+0000 7f47ab59e700 1 Processor -- start 2021-01-03T13:05:28.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.777+0000 7f47ab59e700 1 -- start start 2021-01-03T13:05:28.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.777+0000 7f47ab59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47ac060510 0x7f47ac05c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:28.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.777+0000 7f47ab59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f47ac05fd10 0x7f47ac0b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:28.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.777+0000 7f47ab59e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ac05bf00 con 0x7f47ac0b4c20 2021-01-03T13:05:28.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.777+0000 7f47ab59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ac05c1a0 con 0x7f47ac05fd10 2021-01-03T13:05:28.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.777+0000 7f47ab59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac05c440 con 0x7f47ac060510 2021-01-03T13:05:28.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.777+0000 7f47aad9d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f47ac05fd10 0x7f47ac0b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:28.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.777+0000 7f47a9d9b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47ac060510 0x7f47ac05c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:28.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.777+0000 7f47aa59c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f47ac0b4c20 0x7f47ac0b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:36746/0 (socket says 172.21.15.133:36746) 2021-01-03T13:05:28.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.777+0000 7f47aa59c700 1 -- 172.21.15.133:0/2136228653 learned_addr learned my addr 172.21.15.133:0/2136228653 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:28.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47a9d9b700 1 -- 172.21.15.133:0/2136228653 >> v2:172.21.15.16:3300/0 conn(0x7f47ac05fd10 msgr2=0x7f47ac0b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:28.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47a9d9b700 1 --2- 172.21.15.133:0/2136228653 >> v2:172.21.15.16:3300/0 conn(0x7f47ac05fd10 0x7f47ac0b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:28.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47a9d9b700 1 -- 172.21.15.133:0/2136228653 >> v1:172.21.15.16:6789/0 conn(0x7f47ac0b4c20 legacy=0x7f47ac0b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:28.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47a959a700 1 -- 172.21.15.133:0/2136228653 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886570252 0 0) 0x7f47ac05bf00 con 0x7f47ac0b4c20 2021-01-03T13:05:28.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47a9d9b700 1 -- 172.21.15.133:0/2136228653 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ac0b6ad0 con 0x7f47ac060510 2021-01-03T13:05:28.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47aad9d700 1 --2- 172.21.15.133:0/2136228653 >> v2:172.21.15.16:3300/0 conn(0x7f47ac05fd10 0x7f47ac0b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:28.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47a9d9b700 1 --2- 172.21.15.133:0/2136228653 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47ac060510 0x7f47ac05c8e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f479c002f30 tx=0x7f479c006dc0).ready entity=mon.2 client_cookie=8e4baac1da4447e server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:28.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47a959a700 1 -- 172.21.15.133:0/2136228653 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f479c009760 con 0x7f47ac060510 2021-01-03T13:05:28.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47a959a700 1 -- 172.21.15.133:0/2136228653 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479c0098c0 con 0x7f47ac060510 2021-01-03T13:05:28.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47ab59e700 1 -- 172.21.15.133:0/2136228653 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47ac060510 msgr2=0x7f47ac05c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:28.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47ab59e700 1 --2- 172.21.15.133:0/2136228653 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47ac060510 0x7f47ac05c8e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f479c002f30 tx=0x7f479c006dc0).stop 2021-01-03T13:05:28.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47a959a700 1 -- 172.21.15.133:0/2136228653 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f479c009c20 con 0x7f47ac060510 2021-01-03T13:05:28.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47ab59e700 1 -- 172.21.15.133:0/2136228653 shutdown_connections 2021-01-03T13:05:28.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47ab59e700 1 --2- 172.21.15.133:0/2136228653 >> v2:172.21.15.16:3300/0 conn(0x7f47ac05fd10 0x7f47ac0b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:28.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47ab59e700 1 --2- 172.21.15.133:0/2136228653 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47ac060510 0x7f47ac05c8e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:28.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47ab59e700 1 -- 172.21.15.133:0/2136228653 >> 172.21.15.133:0/2136228653 conn(0x7f47ac0b9f00 msgr2=0x7f47ac0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:28.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47ab59e700 1 -- 172.21.15.133:0/2136228653 shutdown_connections 2021-01-03T13:05:28.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47ab59e700 1 -- 172.21.15.133:0/2136228653 wait complete. 2021-01-03T13:05:28.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47ab59e700 1 Processor -- start 2021-01-03T13:05:28.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.781+0000 7f47ab59e700 1 -- start start 2021-01-03T13:05:28.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47ab59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47ac05fd10 0x7f47ac09ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:28.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47ab59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47ac060510 0x7f47ac149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:28.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47ab59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47ac0b4c20 0x7f47ac149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:28.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47ab59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac140aa0 con 0x7f47ac05fd10 2021-01-03T13:05:28.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47ab59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac152b70 con 0x7f47ac060510 2021-01-03T13:05:28.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47ab59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac1528d0 con 0x7f47ac0b4c20 2021-01-03T13:05:28.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47a9d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47ac060510 0x7f47ac149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:28.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47a9d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47ac060510 0x7f47ac149940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:36994/0 (socket says 172.21.15.133:36994) 2021-01-03T13:05:28.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47a9d9b700 1 -- 172.21.15.133:0/784928621 learned_addr learned my addr 172.21.15.133:0/784928621 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:28.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47aa59c700 1 --2- 172.21.15.133:0/784928621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47ac05fd10 0x7f47ac09ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:28.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47aad9d700 1 --2- 172.21.15.133:0/784928621 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47ac0b4c20 0x7f47ac149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:28.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47a9d9b700 1 -- 172.21.15.133:0/784928621 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47ac0b4c20 msgr2=0x7f47ac149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:28.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47a9d9b700 1 --2- 172.21.15.133:0/784928621 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47ac0b4c20 0x7f47ac149e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:28.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47a9d9b700 1 -- 172.21.15.133:0/784928621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47ac05fd10 msgr2=0x7f47ac09ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:28.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47a9d9b700 1 --2- 172.21.15.133:0/784928621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47ac05fd10 0x7f47ac09ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:28.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47a9d9b700 1 -- 172.21.15.133:0/784928621 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ac143020 con 0x7f47ac060510 2021-01-03T13:05:28.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47a9d9b700 1 --2- 172.21.15.133:0/784928621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47ac060510 0x7f47ac149940 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f479c002f30 tx=0x7f479c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:28.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47a37fe700 1 -- 172.21.15.133:0/784928621 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f479c011a00 con 0x7f47ac060510 2021-01-03T13:05:28.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47a37fe700 1 -- 172.21.15.133:0/784928621 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479c011b60 con 0x7f47ac060510 2021-01-03T13:05:28.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47ab59e700 1 -- 172.21.15.133:0/784928621 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ac1434c0 con 0x7f47ac060510 2021-01-03T13:05:28.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47a37fe700 1 -- 172.21.15.133:0/784928621 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f479c01d440 con 0x7f47ac060510 2021-01-03T13:05:28.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47ab59e700 1 -- 172.21.15.133:0/784928621 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ac1524a0 con 0x7f47ac060510 2021-01-03T13:05:28.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47ab59e700 1 -- 172.21.15.133:0/784928621 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ac1431b0 con 0x7f47ac060510 2021-01-03T13:05:28.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.785+0000 7f47a37fe700 1 -- 172.21.15.133:0/784928621 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f479c024030 con 0x7f47ac060510 2021-01-03T13:05:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.789+0000 7f47a37fe700 1 --2- 172.21.15.133:0/784928621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4790055330 0x7f47900577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.789+0000 7f47a37fe700 1 -- 172.21.15.133:0/784928621 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f479c06ea80 con 0x7f47ac060510 2021-01-03T13:05:28.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.789+0000 7f47aa59c700 1 --2- 172.21.15.133:0/784928621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4790055330 0x7f47900577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:28.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.789+0000 7f47aa59c700 1 --2- 172.21.15.133:0/784928621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4790055330 0x7f47900577f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f479400d000 tx=0x7f4794007bd0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:28.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.793+0000 7f47a37fe700 1 -- 172.21.15.133:0/784928621 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f479c044f60 con 0x7f47ac060510 2021-01-03T13:05:28.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:28.933+0000 7f47ab59e700 1 -- 172.21.15.133:0/784928621 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f47ac057300 con 0x7f47ac060510 2021-01-03T13:05:29.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.649+0000 7f47a37fe700 1 -- 172.21.15.133:0/784928621 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) v1 ==== 173+0+0 (secure 0 0 0) 0x7f479c022020 con 0x7f47ac060510 2021-01-03T13:05:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.653+0000 7f47ab59e700 1 -- 172.21.15.133:0/784928621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4790055330 msgr2=0x7f47900577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:29.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.653+0000 7f47ab59e700 1 --2- 172.21.15.133:0/784928621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4790055330 0x7f47900577f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f479400d000 tx=0x7f4794007bd0).stop 2021-01-03T13:05:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.653+0000 7f47ab59e700 1 -- 172.21.15.133:0/784928621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47ac060510 msgr2=0x7f47ac149940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.653+0000 7f47ab59e700 1 --2- 172.21.15.133:0/784928621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47ac060510 0x7f47ac149940 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f479c002f30 tx=0x7f479c015000).stop 2021-01-03T13:05:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.653+0000 7f47ab59e700 1 -- 172.21.15.133:0/784928621 shutdown_connections 2021-01-03T13:05:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.653+0000 7f47ab59e700 1 --2- 172.21.15.133:0/784928621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4790055330 0x7f47900577f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:29.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.653+0000 7f47ab59e700 1 --2- 172.21.15.133:0/784928621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f47ac05fd10 0x7f47ac09ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.653+0000 7f47ab59e700 1 --2- 172.21.15.133:0/784928621 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f47ac0b4c20 0x7f47ac149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.653+0000 7f47ab59e700 1 --2- 172.21.15.133:0/784928621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47ac060510 0x7f47ac149940 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.653+0000 7f47ab59e700 1 -- 172.21.15.133:0/784928621 >> 172.21.15.133:0/784928621 conn(0x7f47ac0b9f00 msgr2=0x7f47ac09c690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:29.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.653+0000 7f47ab59e700 1 -- 172.21.15.133:0/784928621 shutdown_connections 2021-01-03T13:05:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.653+0000 7f47ab59e700 1 -- 172.21.15.133:0/784928621 wait complete. 2021-01-03T13:05:29.662 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2021-01-03T13:05:29.676 INFO:tasks.ceph.mds.a:Restarting daemon 2021-01-03T13:05:29.676 INFO:tasks.ceph.mds.a:Stopping old one... 2021-01-03T13:05:29.677 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-01-03T13:05:29.677 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:05:29.677 INFO:tasks.ceph.mds.c:Restarting daemon 2021-01-03T13:05:29.677 INFO:tasks.ceph.mds.c:Stopping old one... 2021-01-03T13:05:29.678 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-01-03T13:05:29.678 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:05:29.679 INFO:tasks.ceph.mds.b:Restarting daemon 2021-01-03T13:05:29.679 INFO:tasks.ceph.mds.b:Stopping old one... 2021-01-03T13:05:29.679 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-01-03T13:05:29.680 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:05:29.691 INFO:tasks.ceph.mds.a:Stopped 2021-01-03T13:05:29.692 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-01-03T13:05:29.693 INFO:tasks.ceph.mds.b:Stopped 2021-01-03T13:05:29.693 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-01-03T13:05:29.695 INFO:tasks.ceph.mds.c:Stopped 2021-01-03T13:05:29.695 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-01-03T13:05:29.737 INFO:tasks.ceph.mds.b:Started 2021-01-03T13:05:29.737 DEBUG:teuthology.parallel:result is None 2021-01-03T13:05:29.738 INFO:tasks.ceph.mds.a:Started 2021-01-03T13:05:29.739 DEBUG:teuthology.parallel:result is None 2021-01-03T13:05:29.740 INFO:tasks.ceph.mds.c:Started 2021-01-03T13:05:29.740 DEBUG:teuthology.parallel:result is None 2021-01-03T13:05:29.741 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-01-03T13:05:29.809 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T13:05:29.815 INFO:tasks.ceph.mds.b.smithi016.stdout:starting mds.b at 2021-01-03T13:05:29.816 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T13:05:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a2359e700 1 Processor -- start 2021-01-03T13:05:29.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a2359e700 1 -- start start 2021-01-03T13:05:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a2359e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7a240b02b0 0x7f7a240668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a2359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7a240622f0 0x7f7a24066d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a2359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2405c510 con 0x7f7a2405c130 2021-01-03T13:05:29.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a2359e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a241473d0 con 0x7f7a240b02b0 2021-01-03T13:05:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a2359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a240b0ab0 con 0x7f7a240622f0 2021-01-03T13:05:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a2259c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7a2405c130 0x7f7a240b1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58056/0 (socket says 172.21.15.133:58056) 2021-01-03T13:05:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a2259c700 1 -- 172.21.15.133:0/20806947 learned_addr learned my addr 172.21.15.133:0/20806947 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a21d9b700 1 --2- 172.21.15.133:0/20806947 >> v2:172.21.15.16:3300/0 conn(0x7f7a240b02b0 0x7f7a240668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a22d9d700 1 --2- 172.21.15.133:0/20806947 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7a240622f0 0x7f7a24066d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a2159a700 1 -- 172.21.15.133:0/20806947 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723550751 0 0) 0x7f7a2405c510 con 0x7f7a2405c130 2021-01-03T13:05:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a2159a700 1 -- 172.21.15.133:0/20806947 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a08003230 con 0x7f7a2405c130 2021-01-03T13:05:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a21d9b700 1 -- 172.21.15.133:0/20806947 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7a240622f0 msgr2=0x7f7a24066d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a21d9b700 1 --2- 172.21.15.133:0/20806947 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7a240622f0 0x7f7a24066d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a21d9b700 1 -- 172.21.15.133:0/20806947 >> v1:172.21.15.133:6789/0 conn(0x7f7a2405c130 legacy=0x7f7a240b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a21d9b700 1 -- 172.21.15.133:0/20806947 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a240b15a0 con 0x7f7a240b02b0 2021-01-03T13:05:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a21d9b700 1 --2- 172.21.15.133:0/20806947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a240b02b0 0x7f7a240668a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f7a18002f30 tx=0x7f7a18006dc0).ready entity=mon.0 client_cookie=4caaec55205924cf server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:29.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a2159a700 1 -- 172.21.15.133:0/20806947 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a180096a0 con 0x7f7a240b02b0 2021-01-03T13:05:29.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a2159a700 1 -- 172.21.15.133:0/20806947 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a18009800 con 0x7f7a240b02b0 2021-01-03T13:05:29.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a2159a700 1 -- 172.21.15.133:0/20806947 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a18009ba0 con 0x7f7a240b02b0 2021-01-03T13:05:29.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a2359e700 1 -- 172.21.15.133:0/20806947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a240b02b0 msgr2=0x7f7a240668a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:29.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.849+0000 7f7a2359e700 1 --2- 172.21.15.133:0/20806947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a240b02b0 0x7f7a240668a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f7a18002f30 tx=0x7f7a18006dc0).stop 2021-01-03T13:05:29.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a2359e700 1 -- 172.21.15.133:0/20806947 shutdown_connections 2021-01-03T13:05:29.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a2359e700 1 --2- 172.21.15.133:0/20806947 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7a240622f0 0x7f7a24066d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:29.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a2359e700 1 --2- 172.21.15.133:0/20806947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a240b02b0 0x7f7a240668a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:29.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a2359e700 1 -- 172.21.15.133:0/20806947 >> 172.21.15.133:0/20806947 conn(0x7f7a240b6110 msgr2=0x7f7a240b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:29.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a2359e700 1 -- 172.21.15.133:0/20806947 shutdown_connections 2021-01-03T13:05:29.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a2359e700 1 -- 172.21.15.133:0/20806947 wait complete. 2021-01-03T13:05:29.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a2359e700 1 Processor -- start 2021-01-03T13:05:29.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a2359e700 1 -- start start 2021-01-03T13:05:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a2359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a2405c130 0x7f7a240a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a2359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7a240622f0 0x7f7a24151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a2359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a240b02b0 0x7f7a24151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a2359e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a24063ca0 con 0x7f7a2405c130 2021-01-03T13:05:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a2359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a24065a80 con 0x7f7a240b02b0 2021-01-03T13:05:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a2359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a24152440 con 0x7f7a240622f0 2021-01-03T13:05:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a22d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a240b02b0 0x7f7a24151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a22d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a240b02b0 0x7f7a24151f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37034/0 (socket says 172.21.15.133:37034) 2021-01-03T13:05:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a22d9d700 1 -- 172.21.15.133:0/769224450 learned_addr learned my addr 172.21.15.133:0/769224450 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a21d9b700 1 --2- 172.21.15.133:0/769224450 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7a240622f0 0x7f7a24151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a2259c700 1 --2- 172.21.15.133:0/769224450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a2405c130 0x7f7a240a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a22d9d700 1 -- 172.21.15.133:0/769224450 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7a240622f0 msgr2=0x7f7a24151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a22d9d700 1 --2- 172.21.15.133:0/769224450 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7a240622f0 0x7f7a24151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a22d9d700 1 -- 172.21.15.133:0/769224450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a2405c130 msgr2=0x7f7a240a3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a22d9d700 1 --2- 172.21.15.133:0/769224450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a2405c130 0x7f7a240a3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a22d9d700 1 -- 172.21.15.133:0/769224450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a240667c0 con 0x7f7a240b02b0 2021-01-03T13:05:29.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a22d9d700 1 --2- 172.21.15.133:0/769224450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a240b02b0 0x7f7a24151f50 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f7a1c00c000 tx=0x7f7a1c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:29.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a137fe700 1 -- 172.21.15.133:0/769224450 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a1c00c8f0 con 0x7f7a240b02b0 2021-01-03T13:05:29.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a137fe700 1 -- 172.21.15.133:0/769224450 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c00ca50 con 0x7f7a240b02b0 2021-01-03T13:05:29.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a2359e700 1 -- 172.21.15.133:0/769224450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a24066a60 con 0x7f7a240b02b0 2021-01-03T13:05:29.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a137fe700 1 -- 172.21.15.133:0/769224450 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a1c00cdb0 con 0x7f7a240b02b0 2021-01-03T13:05:29.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.853+0000 7f7a2359e700 1 -- 172.21.15.133:0/769224450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a24065780 con 0x7f7a240b02b0 2021-01-03T13:05:29.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.857+0000 7f7a2359e700 1 -- 172.21.15.133:0/769224450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a24064cb0 con 0x7f7a240b02b0 2021-01-03T13:05:29.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.857+0000 7f7a137fe700 1 -- 172.21.15.133:0/769224450 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7a1c022070 con 0x7f7a240b02b0 2021-01-03T13:05:29.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.857+0000 7f7a137fe700 1 --2- 172.21.15.133:0/769224450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7a000553b0 0x7f7a00057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:29.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.857+0000 7f7a137fe700 1 -- 172.21.15.133:0/769224450 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f7a1c06e260 con 0x7f7a240b02b0 2021-01-03T13:05:29.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.857+0000 7f7a2259c700 1 --2- 172.21.15.133:0/769224450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7a000553b0 0x7f7a00057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.857+0000 7f7a2259c700 1 --2- 172.21.15.133:0/769224450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7a000553b0 0x7f7a00057870 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f7a1400d000 tx=0x7f7a14009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:29.865+0000 7f7a137fe700 1 -- 172.21.15.133:0/769224450 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7a1c044840 con 0x7f7a240b02b0 2021-01-03T13:05:30.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.013+0000 7f7a2359e700 1 -- 172.21.15.133:0/769224450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f7a24057300 con 0x7f7a240b02b0 2021-01-03T13:05:30.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.845+0000 7f7a137fe700 1 -- 172.21.15.133:0/769224450 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v97) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7a1c016070 con 0x7f7a240b02b0 2021-01-03T13:05:30.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.849+0000 7f7a2359e700 1 -- 172.21.15.133:0/769224450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7a000553b0 msgr2=0x7f7a00057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:30.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.849+0000 7f7a2359e700 1 --2- 172.21.15.133:0/769224450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7a000553b0 0x7f7a00057870 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f7a1400d000 tx=0x7f7a14009040).stop 2021-01-03T13:05:30.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.849+0000 7f7a2359e700 1 -- 172.21.15.133:0/769224450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a240b02b0 msgr2=0x7f7a24151f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:30.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.849+0000 7f7a2359e700 1 --2- 172.21.15.133:0/769224450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a240b02b0 0x7f7a24151f50 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f7a1c00c000 tx=0x7f7a1c0091a0).stop 2021-01-03T13:05:30.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.849+0000 7f7a2359e700 1 -- 172.21.15.133:0/769224450 shutdown_connections 2021-01-03T13:05:30.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.849+0000 7f7a2359e700 1 --2- 172.21.15.133:0/769224450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7a000553b0 0x7f7a00057870 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:30.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.849+0000 7f7a2359e700 1 --2- 172.21.15.133:0/769224450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7a2405c130 0x7f7a240a3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:30.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.849+0000 7f7a2359e700 1 --2- 172.21.15.133:0/769224450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a240b02b0 0x7f7a24151f50 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:30.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.849+0000 7f7a2359e700 1 --2- 172.21.15.133:0/769224450 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7a240622f0 0x7f7a24151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:30.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.849+0000 7f7a2359e700 1 -- 172.21.15.133:0/769224450 >> 172.21.15.133:0/769224450 conn(0x7f7a240b6110 msgr2=0x7f7a240b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:30.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.849+0000 7f7a2359e700 1 -- 172.21.15.133:0/769224450 shutdown_connections 2021-01-03T13:05:30.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.849+0000 7f7a2359e700 1 -- 172.21.15.133:0/769224450 wait complete. 2021-01-03T13:05:30.859 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blacklist entries 2021-01-03T13:05:30.871 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-01-03T13:05:30.871 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-01-03T13:05:30.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.985+0000 7f62527af700 1 Processor -- start 2021-01-03T13:05:30.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f62527af700 1 -- start start 2021-01-03T13:05:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f62527af700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f624c0b9f40 0x7f624c146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f62527af700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f624c146920 0x7f624c14d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:30.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f62527af700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624c0605f0 con 0x7f624c0b9b60 2021-01-03T13:05:30.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f62527af700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624c0aed30 con 0x7f624c146920 2021-01-03T13:05:30.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f62527af700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0600b0 con 0x7f624c0b9f40 2021-01-03T13:05:30.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f62517ad700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f624c0b9b60 0x7f624c0b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58074/0 (socket says 172.21.15.133:58074) 2021-01-03T13:05:30.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f62517ad700 1 -- 172.21.15.133:0/3994300187 learned_addr learned my addr 172.21.15.133:0/3994300187 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f6251fae700 1 --2- 172.21.15.133:0/3994300187 >> v2:172.21.15.16:3300/0 conn(0x7f624c146920 0x7f624c14d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f6250fac700 1 --2- 172.21.15.133:0/3994300187 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f624c0b9f40 0x7f624c146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:30.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 -- 172.21.15.133:0/3994300187 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544684738 0 0) 0x7f624c0605f0 con 0x7f624c0b9b60 2021-01-03T13:05:31.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 -- 172.21.15.133:0/3994300187 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6230003230 con 0x7f624c0b9b60 2021-01-03T13:05:31.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 -- 172.21.15.133:0/3994300187 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 138354484 0 0) 0x7f6230003230 con 0x7f624c0b9b60 2021-01-03T13:05:31.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 -- 172.21.15.133:0/3994300187 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f624c0b9f40 msgr2=0x7f624c146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:31.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 --2- 172.21.15.133:0/3994300187 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f624c0b9f40 0x7f624c146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 -- 172.21.15.133:0/3994300187 >> v2:172.21.15.16:3300/0 conn(0x7f624c146920 msgr2=0x7f624c14d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 --2- 172.21.15.133:0/3994300187 >> v2:172.21.15.16:3300/0 conn(0x7f624c146920 0x7f624c14d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 -- 172.21.15.133:0/3994300187 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c060350 con 0x7f624c0b9b60 2021-01-03T13:05:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 -- 172.21.15.133:0/3994300187 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f62400016d0 con 0x7f624c0b9b60 2021-01-03T13:05:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 -- 172.21.15.133:0/3994300187 >> v1:172.21.15.133:6789/0 conn(0x7f624c0b9b60 legacy=0x7f624c0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 --2- 172.21.15.133:0/3994300187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62300037a0 0x7f6230003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 --2- 172.21.15.133:0/3994300187 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f624c0b9f40 0x7f62300044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 --2- 172.21.15.133:0/3994300187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62300049c0 0x7f6230004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 -- 172.21.15.133:0/3994300187 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0aed30 con 0x7f62300049c0 2021-01-03T13:05:31.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 -- 172.21.15.133:0/3994300187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0600b0 con 0x7f62300037a0 2021-01-03T13:05:31.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 -- 172.21.15.133:0/3994300187 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6230004290 con 0x7f624c0b9f40 2021-01-03T13:05:31.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f62517ad700 1 --2- 172.21.15.133:0/3994300187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62300037a0 0x7f6230003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f6250fac700 1 --2- 172.21.15.133:0/3994300187 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f624c0b9f40 0x7f62300044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f6251fae700 1 --2- 172.21.15.133:0/3994300187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62300049c0 0x7f6230004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f62517ad700 1 -- 172.21.15.133:0/3994300187 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f624c0b9f40 msgr2=0x7f62300044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:31.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f62517ad700 1 --2- 172.21.15.133:0/3994300187 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f624c0b9f40 0x7f62300044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f62517ad700 1 -- 172.21.15.133:0/3994300187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62300049c0 msgr2=0x7f6230004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:31.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f62517ad700 1 --2- 172.21.15.133:0/3994300187 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f62300049c0 0x7f6230004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f62517ad700 1 -- 172.21.15.133:0/3994300187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6230003230 con 0x7f62300037a0 2021-01-03T13:05:31.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f62517ad700 1 --2- 172.21.15.133:0/3994300187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62300037a0 0x7f6230003bc0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f62400013e0 tx=0x7f624c142b90).ready entity=mon.1 client_cookie=8ef78906feae8f37 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 -- 172.21.15.133:0/3994300187 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62400070d0 con 0x7f62300037a0 2021-01-03T13:05:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 -- 172.21.15.133:0/3994300187 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6240007230 con 0x7f62300037a0 2021-01-03T13:05:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f623ffff700 1 -- 172.21.15.133:0/3994300187 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62400055e0 con 0x7f62300037a0 2021-01-03T13:05:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f62527af700 1 -- 172.21.15.133:0/3994300187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62300037a0 msgr2=0x7f6230003bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f62527af700 1 --2- 172.21.15.133:0/3994300187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62300037a0 0x7f6230003bc0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f62400013e0 tx=0x7f624c142b90).stop 2021-01-03T13:05:31.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.989+0000 7f6251fae700 1 -- 172.21.15.133:0/3994300187 reap_dead start 2021-01-03T13:05:31.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62527af700 1 -- 172.21.15.133:0/3994300187 shutdown_connections 2021-01-03T13:05:31.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62527af700 1 -- 172.21.15.133:0/3994300187 >> 172.21.15.133:0/3994300187 conn(0x7f624c0b69e0 msgr2=0x7f624c0b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:31.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62527af700 1 -- 172.21.15.133:0/3994300187 shutdown_connections 2021-01-03T13:05:31.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62527af700 1 -- 172.21.15.133:0/3994300187 wait complete. 2021-01-03T13:05:31.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62527af700 1 Processor -- start 2021-01-03T13:05:31.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62527af700 1 -- start start 2021-01-03T13:05:31.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62527af700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c155130 0x7f624c09d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62527af700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f624c09c690 0x7f624c1518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62527af700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f624c09ebf0 0x7f624c151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62527af700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c155510 con 0x7f624c09ebf0 2021-01-03T13:05:31.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62527af700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c09e440 con 0x7f624c155130 2021-01-03T13:05:31.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62527af700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c09e6a0 con 0x7f624c09c690 2021-01-03T13:05:31.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62517ad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c155130 0x7f624c09d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62517ad700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c155130 0x7f624c09d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37054/0 (socket says 172.21.15.133:37054) 2021-01-03T13:05:31.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62517ad700 1 -- 172.21.15.133:0/1496740039 learned_addr learned my addr 172.21.15.133:0/1496740039 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:31.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f6251fae700 1 --2- 172.21.15.133:0/1496740039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f624c09ebf0 0x7f624c151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f6250fac700 1 --2- 172.21.15.133:0/1496740039 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f624c09c690 0x7f624c1518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62517ad700 1 -- 172.21.15.133:0/1496740039 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f624c09c690 msgr2=0x7f624c1518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62517ad700 1 --2- 172.21.15.133:0/1496740039 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f624c09c690 0x7f624c1518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62517ad700 1 -- 172.21.15.133:0/1496740039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f624c09ebf0 msgr2=0x7f624c151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62517ad700 1 --2- 172.21.15.133:0/1496740039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f624c09ebf0 0x7f624c151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62517ad700 1 -- 172.21.15.133:0/1496740039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c155770 con 0x7f624c155130 2021-01-03T13:05:31.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62517ad700 1 --2- 172.21.15.133:0/1496740039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c155130 0x7f624c09d020 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f62400013e0 tx=0x7f6240013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:31.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f623effd700 1 -- 172.21.15.133:0/1496740039 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f624001a070 con 0x7f624c155130 2021-01-03T13:05:31.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f623effd700 1 -- 172.21.15.133:0/1496740039 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6240005ce0 con 0x7f624c155130 2021-01-03T13:05:31.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f623effd700 1 -- 172.21.15.133:0/1496740039 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6240013640 con 0x7f624c155130 2021-01-03T13:05:31.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62527af700 1 -- 172.21.15.133:0/1496740039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624c09e940 con 0x7f624c155130 2021-01-03T13:05:31.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.993+0000 7f62527af700 1 -- 172.21.15.133:0/1496740039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624c09d510 con 0x7f624c155130 2021-01-03T13:05:31.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.997+0000 7f62527af700 1 -- 172.21.15.133:0/1496740039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624c0b0960 con 0x7f624c155130 2021-01-03T13:05:31.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.997+0000 7f623effd700 1 -- 172.21.15.133:0/1496740039 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6240010070 con 0x7f624c155130 2021-01-03T13:05:31.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.997+0000 7f623effd700 1 --2- 172.21.15.133:0/1496740039 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62280554e0 0x7f62280579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.997+0000 7f623effd700 1 -- 172.21.15.133:0/1496740039 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f624006e780 con 0x7f624c155130 2021-01-03T13:05:31.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.997+0000 7f6250fac700 1 --2- 172.21.15.133:0/1496740039 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62280554e0 0x7f62280579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:30.997+0000 7f6250fac700 1 --2- 172.21.15.133:0/1496740039 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62280554e0 0x7f62280579a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f6248008000 tx=0x7f6248008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:31.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.001+0000 7f623effd700 1 -- 172.21.15.133:0/1496740039 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6240044db0 con 0x7f624c155130 2021-01-03T13:05:31.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.185+0000 7f62527af700 1 -- 172.21.15.133:0/1496740039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f624c057300 con 0x7f624c155130 2021-01-03T13:05:31.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.185+0000 7f623effd700 1 -- 172.21.15.133:0/1496740039 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f62400483d0 con 0x7f624c155130 2021-01-03T13:05:31.189 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:31.190 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:05:31.190 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2021-01-03T13:05:31.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:31.190 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2021-01-03T13:05:31.191 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Fflox9BxAA6coLDFV/FaQ/G/cvtonWgg==", 2021-01-03T13:05:31.191 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:31.191 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:05:31.191 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:31.191 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:31.192 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:31.192 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:31.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:31.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:31.192 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2021-01-03T13:05:31.193 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfrnWWFRAA3PHH/FJOvDozCChrb1T8Dg==", 2021-01-03T13:05:31.193 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:31.193 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:05:31.193 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:31.193 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:31.194 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:31.194 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:31.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:31.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:31.194 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2021-01-03T13:05:31.195 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfpPPLDxAAVvg80vLejYKDH485/L1gSQ==", 2021-01-03T13:05:31.195 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:31.195 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:05:31.196 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:31.196 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:31.196 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:31.196 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:31.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:31.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:31.197 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2021-01-03T13:05:31.197 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAnv/FfQ+CcDRAAUkTDLby5scMkNzxa0lVdAQ==", 2021-01-03T13:05:31.198 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:31.199 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:31.199 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:31.199 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:31.199 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:31.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:31.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:31.200 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2021-01-03T13:05:31.200 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApv/Ff1iilLhAAbK9hZmL772nNKAEJ4i+pkw==", 2021-01-03T13:05:31.200 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:31.201 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:31.201 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:31.201 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:31.201 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:31.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:31.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:31.202 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2021-01-03T13:05:31.202 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAsv/Ffmoe2FhAA1EbxU5yHncN+pbC/EX6d9A==", 2021-01-03T13:05:31.202 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:31.202 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:31.203 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:31.203 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:31.203 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:31.203 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:31.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:31.204 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2021-01-03T13:05:31.204 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAuv/FfJh/VORAAG9aCOh5s/2Lw+yN9hBFWLw==", 2021-01-03T13:05:31.204 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:31.205 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:31.205 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:31.205 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:31.205 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:31.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:31.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:31.206 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2021-01-03T13:05:31.206 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyv/Ffus0NJhAALX1TIqQ9EIupaX8KtRu7rQ==", 2021-01-03T13:05:31.206 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:31.207 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:31.207 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:31.207 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:31.207 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:31.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:31.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:31.208 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2021-01-03T13:05:31.208 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1v/FfoL6kDBAAggoRy/o0qas/41yLYqDVgA==", 2021-01-03T13:05:31.208 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:31.208 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:31.209 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:31.209 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:31.209 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:31.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:31.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:31.210 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2021-01-03T13:05:31.210 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA3v/FfwOPCMBAAGOt8ShPQ/szNbCfaP/uZEQ==", 2021-01-03T13:05:31.211 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:31.211 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:31.211 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:31.211 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:31.212 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:31.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:31.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:31.212 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2021-01-03T13:05:31.213 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA6v/Ffoz5xFxAAn3xvUDSeNSWrBJTa1Nsb6w==", 2021-01-03T13:05:31.213 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:31.213 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:31.213 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:31.213 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:31.214 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:31.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:31.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:31.214 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2021-01-03T13:05:31.215 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfyGlbGxAALm0NezvPiTAnlwu8iPEuCw==", 2021-01-03T13:05:31.215 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:31.215 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:05:31.215 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:05:31.216 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:05:31.216 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:31.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:31.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:31.216 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2021-01-03T13:05:31.217 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Ffa2AFHhAAD4Pq5zMJ28SqqEosBA9vnQ==", 2021-01-03T13:05:31.217 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:31.217 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:05:31.217 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:05:31.217 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:05:31.218 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:31.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:31.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:31.218 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2021-01-03T13:05:31.218 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjv/FfjxN8JxAAkV2Ia66fh21QYMX5fr1gTw==", 2021-01-03T13:05:31.219 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:31.219 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:05:31.219 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:31.219 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:31.219 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:31.220 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:31.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:31.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:31.220 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2021-01-03T13:05:31.220 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAU/DBBAASi+hx05pZEsP+dV9iwbz4g==", 2021-01-03T13:05:31.221 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:31.221 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:05:31.221 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:05:31.221 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:31.221 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:31.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:31.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:31.223 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2021-01-03T13:05:31.224 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAOFAAhAAPQOSkofyJoEYvcAqKK2+Mg==", 2021-01-03T13:05:31.224 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:31.224 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:05:31.224 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:05:31.225 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:31.225 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:31.225 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:31.226 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:31.226 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:05:31.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.185+0000 7f62527af700 1 -- 172.21.15.133:0/1496740039 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62280554e0 msgr2=0x7f62280579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.185+0000 7f62527af700 1 --2- 172.21.15.133:0/1496740039 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62280554e0 0x7f62280579a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f6248008000 tx=0x7f6248008040).stop 2021-01-03T13:05:31.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.185+0000 7f62527af700 1 -- 172.21.15.133:0/1496740039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c155130 msgr2=0x7f624c09d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.185+0000 7f62527af700 1 --2- 172.21.15.133:0/1496740039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c155130 0x7f624c09d020 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f62400013e0 tx=0x7f6240013000).stop 2021-01-03T13:05:31.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.185+0000 7f62527af700 1 -- 172.21.15.133:0/1496740039 shutdown_connections 2021-01-03T13:05:31.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.185+0000 7f62527af700 1 --2- 172.21.15.133:0/1496740039 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62280554e0 0x7f62280579a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.185+0000 7f62527af700 1 --2- 172.21.15.133:0/1496740039 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f624c09ebf0 0x7f624c151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.185+0000 7f62527af700 1 --2- 172.21.15.133:0/1496740039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f624c155130 0x7f624c09d020 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.185+0000 7f62527af700 1 --2- 172.21.15.133:0/1496740039 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f624c09c690 0x7f624c1518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.185+0000 7f62527af700 1 -- 172.21.15.133:0/1496740039 >> 172.21.15.133:0/1496740039 conn(0x7f624c0b69e0 msgr2=0x7f624c062060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:31.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.185+0000 7f62527af700 1 -- 172.21.15.133:0/1496740039 shutdown_connections 2021-01-03T13:05:31.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.185+0000 7f62527af700 1 -- 172.21.15.133:0/1496740039 wait complete. 2021-01-03T13:05:31.230 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:05:31.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.337+0000 7fa9ef59e700 1 Processor -- start 2021-01-03T13:05:31.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.337+0000 7fa9ef59e700 1 -- start start 2021-01-03T13:05:31.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.337+0000 7fa9ef59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa9f00b9f40 0x7fa9f0146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.337+0000 7fa9ef59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa9f0146920 0x7fa9f014d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.337+0000 7fa9ef59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f00605f0 con 0x7fa9f00b9b60 2021-01-03T13:05:31.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.337+0000 7fa9ef59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f00aed30 con 0x7fa9f00b9f40 2021-01-03T13:05:31.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.337+0000 7fa9ef59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f00600b0 con 0x7fa9f0146920 2021-01-03T13:05:31.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9eed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa9f0146920 0x7fa9f014d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9eed9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa9f0146920 0x7fa9f014d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37066/0 (socket says 172.21.15.133:37066) 2021-01-03T13:05:31.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9eed9d700 1 -- 172.21.15.133:0/757867294 learned_addr learned my addr 172.21.15.133:0/757867294 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:31.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9ee59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa9f00b9b60 0x7fa9f00b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58094/0 (socket says 172.21.15.133:58094) 2021-01-03T13:05:31.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9edd9b700 1 --2- 172.21.15.133:0/757867294 >> v2:172.21.15.16:3300/0 conn(0x7fa9f00b9f40 0x7fa9f0146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9eed9d700 1 -- 172.21.15.133:0/757867294 >> v2:172.21.15.16:3300/0 conn(0x7fa9f00b9f40 msgr2=0x7fa9f0146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:31.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9eed9d700 1 --2- 172.21.15.133:0/757867294 >> v2:172.21.15.16:3300/0 conn(0x7fa9f00b9f40 0x7fa9f0146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9eed9d700 1 -- 172.21.15.133:0/757867294 >> v1:172.21.15.133:6789/0 conn(0x7fa9f00b9b60 legacy=0x7fa9f00b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9eed9d700 1 -- 172.21.15.133:0/757867294 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f0060350 con 0x7fa9f0146920 2021-01-03T13:05:31.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9ed59a700 1 -- 172.21.15.133:0/757867294 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345449467 0 0) 0x7fa9f00605f0 con 0x7fa9f00b9b60 2021-01-03T13:05:31.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9eed9d700 1 --2- 172.21.15.133:0/757867294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9f0146920 0x7fa9f014d500 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7fa9e80032b0 tx=0x7fa9e8009270).ready entity=mon.1 client_cookie=90bbf57084efe406 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:31.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9ed59a700 1 -- 172.21.15.133:0/757867294 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9e8009e60 con 0x7fa9f0146920 2021-01-03T13:05:31.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9ed59a700 1 -- 172.21.15.133:0/757867294 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e800bc00 con 0x7fa9f0146920 2021-01-03T13:05:31.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9ed59a700 1 -- 172.21.15.133:0/757867294 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9e800bd70 con 0x7fa9f0146920 2021-01-03T13:05:31.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9ef59e700 1 -- 172.21.15.133:0/757867294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9f0146920 msgr2=0x7fa9f014d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9ef59e700 1 --2- 172.21.15.133:0/757867294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9f0146920 0x7fa9f014d500 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7fa9e80032b0 tx=0x7fa9e8009270).stop 2021-01-03T13:05:31.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9ef59e700 1 -- 172.21.15.133:0/757867294 shutdown_connections 2021-01-03T13:05:31.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9ef59e700 1 --2- 172.21.15.133:0/757867294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9f0146920 0x7fa9f014d500 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9ef59e700 1 --2- 172.21.15.133:0/757867294 >> v2:172.21.15.16:3300/0 conn(0x7fa9f00b9f40 0x7fa9f0146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9ef59e700 1 -- 172.21.15.133:0/757867294 >> 172.21.15.133:0/757867294 conn(0x7fa9f00b69e0 msgr2=0x7fa9f00b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:31.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9ef59e700 1 -- 172.21.15.133:0/757867294 shutdown_connections 2021-01-03T13:05:31.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9ef59e700 1 -- 172.21.15.133:0/757867294 wait complete. 2021-01-03T13:05:31.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9ef59e700 1 Processor -- start 2021-01-03T13:05:31.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.341+0000 7fa9ef59e700 1 -- start start 2021-01-03T13:05:31.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9ef59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9f00b9b60 0x7fa9f00b89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9ef59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9f00b9f40 0x7fa9f00b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9ef59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9f0146920 0x7fa9f00b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9ef59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00b20a0 con 0x7fa9f00b9b60 2021-01-03T13:05:31.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9ef59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00b2680 con 0x7fa9f0146920 2021-01-03T13:05:31.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9ef59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f00b1c60 con 0x7fa9f00b9f40 2021-01-03T13:05:31.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9eed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9f0146920 0x7fa9f00b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9eed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9f0146920 0x7fa9f00b2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37072/0 (socket says 172.21.15.133:37072) 2021-01-03T13:05:31.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9eed9d700 1 -- 172.21.15.133:0/232664071 learned_addr learned my addr 172.21.15.133:0/232664071 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:31.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9edd9b700 1 --2- 172.21.15.133:0/232664071 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9f00b9f40 0x7fa9f00b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9ee59c700 1 --2- 172.21.15.133:0/232664071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9f00b9b60 0x7fa9f00b89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9eed9d700 1 -- 172.21.15.133:0/232664071 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9f00b9f40 msgr2=0x7fa9f00b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9eed9d700 1 --2- 172.21.15.133:0/232664071 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9f00b9f40 0x7fa9f00b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9eed9d700 1 -- 172.21.15.133:0/232664071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9f00b9b60 msgr2=0x7fa9f00b89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9eed9d700 1 --2- 172.21.15.133:0/232664071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9f00b9b60 0x7fa9f00b89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9eed9d700 1 -- 172.21.15.133:0/232664071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f00b22d0 con 0x7fa9f0146920 2021-01-03T13:05:31.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9edd9b700 1 --2- 172.21.15.133:0/232664071 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9f00b9f40 0x7fa9f00b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:31.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9ee59c700 1 --2- 172.21.15.133:0/232664071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9f00b9b60 0x7fa9f00b89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:31.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9eed9d700 1 --2- 172.21.15.133:0/232664071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9f0146920 0x7fa9f00b2ae0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7fa9e80032b0 tx=0x7fa9e8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:31.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9e77fe700 1 -- 172.21.15.133:0/232664071 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9e801f5e0 con 0x7fa9f0146920 2021-01-03T13:05:31.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9ef59e700 1 -- 172.21.15.133:0/232664071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f00b19c0 con 0x7fa9f0146920 2021-01-03T13:05:31.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9ef59e700 1 -- 172.21.15.133:0/232664071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f009d110 con 0x7fa9f0146920 2021-01-03T13:05:31.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9e77fe700 1 -- 172.21.15.133:0/232664071 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e801f740 con 0x7fa9f0146920 2021-01-03T13:05:31.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9e77fe700 1 -- 172.21.15.133:0/232664071 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9e801faa0 con 0x7fa9f0146920 2021-01-03T13:05:31.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.345+0000 7fa9ef59e700 1 -- 172.21.15.133:0/232664071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f0057300 con 0x7fa9f0146920 2021-01-03T13:05:31.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.349+0000 7fa9e77fe700 1 -- 172.21.15.133:0/232664071 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa9e800f070 con 0x7fa9f0146920 2021-01-03T13:05:31.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.349+0000 7fa9e77fe700 1 --2- 172.21.15.133:0/232664071 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa9d40553b0 0x7fa9d4057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.349+0000 7fa9e77fe700 1 -- 172.21.15.133:0/232664071 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa9e806ed50 con 0x7fa9f0146920 2021-01-03T13:05:31.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.349+0000 7fa9ee59c700 1 --2- 172.21.15.133:0/232664071 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa9d40553b0 0x7fa9d4057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.349+0000 7fa9ee59c700 1 --2- 172.21.15.133:0/232664071 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa9d40553b0 0x7fa9d4057870 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fa9d800b000 tx=0x7fa9d8007100).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:31.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.357+0000 7fa9e77fe700 1 -- 172.21.15.133:0/232664071 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa9e8045270 con 0x7fa9f0146920 2021-01-03T13:05:31.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.497+0000 7fa9ef59e700 1 -- 172.21.15.133:0/232664071 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9f0067a00 con 0x7fa9f0146920 2021-01-03T13:05:31.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.501+0000 7fa9e77fe700 1 -- 172.21.15.133:0/232664071 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+13230 (secure 0 0 0) 0x7fa9e8024090 con 0x7fa9f0146920 2021-01-03T13:05:31.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.505+0000 7fa9ef59e700 1 -- 172.21.15.133:0/232664071 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa9d40553b0 msgr2=0x7fa9d4057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.505+0000 7fa9ef59e700 1 --2- 172.21.15.133:0/232664071 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa9d40553b0 0x7fa9d4057870 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fa9d800b000 tx=0x7fa9d8007100).stop 2021-01-03T13:05:31.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.505+0000 7fa9ef59e700 1 -- 172.21.15.133:0/232664071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9f0146920 msgr2=0x7fa9f00b2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.505+0000 7fa9ef59e700 1 --2- 172.21.15.133:0/232664071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9f0146920 0x7fa9f00b2ae0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7fa9e80032b0 tx=0x7fa9e8016000).stop 2021-01-03T13:05:31.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.505+0000 7fa9ef59e700 1 -- 172.21.15.133:0/232664071 shutdown_connections 2021-01-03T13:05:31.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.505+0000 7fa9ef59e700 1 --2- 172.21.15.133:0/232664071 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa9d40553b0 0x7fa9d4057870 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.505+0000 7fa9ef59e700 1 --2- 172.21.15.133:0/232664071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9f00b9b60 0x7fa9f00b89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.505+0000 7fa9ef59e700 1 --2- 172.21.15.133:0/232664071 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9f0146920 0x7fa9f00b2ae0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.505+0000 7fa9ef59e700 1 --2- 172.21.15.133:0/232664071 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9f00b9f40 0x7fa9f00b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.505+0000 7fa9ef59e700 1 -- 172.21.15.133:0/232664071 >> 172.21.15.133:0/232664071 conn(0x7fa9f00b69e0 msgr2=0x7fa9f005bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:31.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.505+0000 7fa9ef59e700 1 -- 172.21.15.133:0/232664071 shutdown_connections 2021-01-03T13:05:31.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.505+0000 7fa9ef59e700 1 -- 172.21.15.133:0/232664071 wait complete. 2021-01-03T13:05:31.518 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:31.518 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":97,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:05:30.840636+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:05:31.525 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-01-03T13:05:31.526 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:05:31.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.637+0000 7fbace9c4700 1 Processor -- start 2021-01-03T13:05:31.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.637+0000 7fbace9c4700 1 -- start start 2021-01-03T13:05:31.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.637+0000 7fbace9c4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbac809a090 0x7fbac8140580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.637+0000 7fbace9c4700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbac8060d10 0x7fbac805fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.637+0000 7fbace9c4700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac805f5e0 con 0x7fbac80b5330 2021-01-03T13:05:31.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.637+0000 7fbace9c4700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac8143730 con 0x7fbac8060d10 2021-01-03T13:05:31.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.637+0000 7fbace9c4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac8140a70 con 0x7fbac809a090 2021-01-03T13:05:31.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.637+0000 7fbacd9c2700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fbac80b5330 0x7fbac813fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:36836/0 (socket says 172.21.15.133:36836) 2021-01-03T13:05:31.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.637+0000 7fbace1c3700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbac8060d10 0x7fbac805fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.637+0000 7fbacd9c2700 1 -- 172.21.15.133:0/3110800076 learned_addr learned my addr 172.21.15.133:0/3110800076 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:31.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.637+0000 7fbacd1c1700 1 --2- 172.21.15.133:0/3110800076 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbac809a090 0x7fbac8140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace1c3700 1 -- 172.21.15.133:0/3110800076 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbac809a090 msgr2=0x7fbac8140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:31.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace1c3700 1 --2- 172.21.15.133:0/3110800076 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbac809a090 0x7fbac8140580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace1c3700 1 -- 172.21.15.133:0/3110800076 >> v1:172.21.15.16:6789/0 conn(0x7fbac80b5330 legacy=0x7fbac813fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace1c3700 1 -- 172.21.15.133:0/3110800076 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac80b5710 con 0x7fbac8060d10 2021-01-03T13:05:31.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace1c3700 1 --2- 172.21.15.133:0/3110800076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbac8060d10 0x7fbac805fa10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fbac00032b0 tx=0x7fbac00091a0).ready entity=mon.0 client_cookie=4f37f4e0887d0240 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:31.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbacc9c0700 1 -- 172.21.15.133:0/3110800076 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac000b9a0 con 0x7fbac8060d10 2021-01-03T13:05:31.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbacc9c0700 1 -- 172.21.15.133:0/3110800076 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac000bb00 con 0x7fbac8060d10 2021-01-03T13:05:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace9c4700 1 -- 172.21.15.133:0/3110800076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbac8060d10 msgr2=0x7fbac805fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbacc9c0700 1 -- 172.21.15.133:0/3110800076 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac000bc70 con 0x7fbac8060d10 2021-01-03T13:05:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace9c4700 1 --2- 172.21.15.133:0/3110800076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbac8060d10 0x7fbac805fa10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fbac00032b0 tx=0x7fbac00091a0).stop 2021-01-03T13:05:31.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace9c4700 1 -- 172.21.15.133:0/3110800076 shutdown_connections 2021-01-03T13:05:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace9c4700 1 --2- 172.21.15.133:0/3110800076 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbac8060d10 0x7fbac805fa10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace9c4700 1 --2- 172.21.15.133:0/3110800076 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbac809a090 0x7fbac8140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace9c4700 1 -- 172.21.15.133:0/3110800076 >> 172.21.15.133:0/3110800076 conn(0x7fbac805bdf0 msgr2=0x7fbac805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:31.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace9c4700 1 -- 172.21.15.133:0/3110800076 shutdown_connections 2021-01-03T13:05:31.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace9c4700 1 -- 172.21.15.133:0/3110800076 wait complete. 2021-01-03T13:05:31.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace9c4700 1 Processor -- start 2021-01-03T13:05:31.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace9c4700 1 -- start start 2021-01-03T13:05:31.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace9c4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac8060d10 0x7fbac80ac780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace9c4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbac809a090 0x7fbac8146770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace9c4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbac80b5330 0x7fbac8146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace9c4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac8145370 con 0x7fbac809a090 2021-01-03T13:05:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace9c4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80ade20 con 0x7fbac8060d10 2021-01-03T13:05:31.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace9c4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80ae0c0 con 0x7fbac80b5330 2021-01-03T13:05:31.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbacd9c2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac8060d10 0x7fbac80ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbacd9c2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac8060d10 0x7fbac80ac780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37082/0 (socket says 172.21.15.133:37082) 2021-01-03T13:05:31.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbacd9c2700 1 -- 172.21.15.133:0/807956401 learned_addr learned my addr 172.21.15.133:0/807956401 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:31.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbace1c3700 1 --2- 172.21.15.133:0/807956401 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbac80b5330 0x7fbac8146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.641+0000 7fbacd1c1700 1 --2- 172.21.15.133:0/807956401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbac809a090 0x7fbac8146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.645+0000 7fbacd9c2700 1 -- 172.21.15.133:0/807956401 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbac80b5330 msgr2=0x7fbac8146c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.645+0000 7fbacd9c2700 1 --2- 172.21.15.133:0/807956401 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbac80b5330 0x7fbac8146c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.645+0000 7fbacd9c2700 1 -- 172.21.15.133:0/807956401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbac809a090 msgr2=0x7fbac8146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.645+0000 7fbacd9c2700 1 --2- 172.21.15.133:0/807956401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbac809a090 0x7fbac8146770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.645+0000 7fbacd9c2700 1 -- 172.21.15.133:0/807956401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac80ae360 con 0x7fbac8060d10 2021-01-03T13:05:31.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.645+0000 7fbacd9c2700 1 --2- 172.21.15.133:0/807956401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac8060d10 0x7fbac80ac780 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7fbac8061ec0 tx=0x7fbac4007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:31.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.645+0000 7fbab6ffd700 1 -- 172.21.15.133:0/807956401 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac40072e0 con 0x7fbac8060d10 2021-01-03T13:05:31.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.645+0000 7fbab6ffd700 1 -- 172.21.15.133:0/807956401 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac4007440 con 0x7fbac8060d10 2021-01-03T13:05:31.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.645+0000 7fbab6ffd700 1 -- 172.21.15.133:0/807956401 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbac40057d0 con 0x7fbac8060d10 2021-01-03T13:05:31.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.645+0000 7fbace9c4700 1 -- 172.21.15.133:0/807956401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac8147150 con 0x7fbac8060d10 2021-01-03T13:05:31.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.645+0000 7fbace9c4700 1 -- 172.21.15.133:0/807956401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac80ae800 con 0x7fbac8060d10 2021-01-03T13:05:31.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.645+0000 7fbace9c4700 1 -- 172.21.15.133:0/807956401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac8142f60 con 0x7fbac8060d10 2021-01-03T13:05:31.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.645+0000 7fbab6ffd700 1 -- 172.21.15.133:0/807956401 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fbac4010070 con 0x7fbac8060d10 2021-01-03T13:05:31.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.645+0000 7fbab6ffd700 1 --2- 172.21.15.133:0/807956401 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbaa80553b0 0x7fbaa8057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.645+0000 7fbab6ffd700 1 -- 172.21.15.133:0/807956401 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fbac406d270 con 0x7fbac8060d10 2021-01-03T13:05:31.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.645+0000 7fbacd1c1700 1 --2- 172.21.15.133:0/807956401 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbaa80553b0 0x7fbaa8057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.649+0000 7fbacd1c1700 1 --2- 172.21.15.133:0/807956401 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbaa80553b0 0x7fbaa8057870 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fbab800b000 tx=0x7fbab8006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:31.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.653+0000 7fbab6ffd700 1 -- 172.21.15.133:0/807956401 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbac4043800 con 0x7fbac8060d10 2021-01-03T13:05:31.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.793+0000 7fbace9c4700 1 -- 172.21.15.133:0/807956401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbac80ae4f0 con 0x7fbac8060d10 2021-01-03T13:05:31.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.793+0000 7fbab6ffd700 1 -- 172.21.15.133:0/807956401 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v97) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbac4046e20 con 0x7fbac8060d10 2021-01-03T13:05:31.799 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:05:31.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.793+0000 7fbace9c4700 1 -- 172.21.15.133:0/807956401 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbaa80553b0 msgr2=0x7fbaa8057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.793+0000 7fbace9c4700 1 --2- 172.21.15.133:0/807956401 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbaa80553b0 0x7fbaa8057870 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fbab800b000 tx=0x7fbab8006dc0).stop 2021-01-03T13:05:31.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.793+0000 7fbace9c4700 1 -- 172.21.15.133:0/807956401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac8060d10 msgr2=0x7fbac80ac780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.793+0000 7fbace9c4700 1 --2- 172.21.15.133:0/807956401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac8060d10 0x7fbac80ac780 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7fbac8061ec0 tx=0x7fbac4007c70).stop 2021-01-03T13:05:31.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.797+0000 7fbace9c4700 1 -- 172.21.15.133:0/807956401 shutdown_connections 2021-01-03T13:05:31.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.797+0000 7fbace9c4700 1 --2- 172.21.15.133:0/807956401 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbaa80553b0 0x7fbaa8057870 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.797+0000 7fbace9c4700 1 --2- 172.21.15.133:0/807956401 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbac80b5330 0x7fbac8146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.797+0000 7fbace9c4700 1 --2- 172.21.15.133:0/807956401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbac8060d10 0x7fbac80ac780 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.797+0000 7fbace9c4700 1 --2- 172.21.15.133:0/807956401 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbac809a090 0x7fbac8146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.797+0000 7fbace9c4700 1 -- 172.21.15.133:0/807956401 >> 172.21.15.133:0/807956401 conn(0x7fbac805bdf0 msgr2=0x7fbac813e840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:31.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.797+0000 7fbace9c4700 1 -- 172.21.15.133:0/807956401 shutdown_connections 2021-01-03T13:05:31.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.797+0000 7fbace9c4700 1 -- 172.21.15.133:0/807956401 wait complete. 2021-01-03T13:05:31.812 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:05:31.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.925+0000 7f92c1f49700 1 Processor -- start 2021-01-03T13:05:31.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.925+0000 7f92c1f49700 1 -- start start 2021-01-03T13:05:31.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.925+0000 7f92c1f49700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92bc066f30 0x7f92bc0b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.925+0000 7f92c1f49700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92bc05fd00 con 0x7f92bc05f920 2021-01-03T13:05:31.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.925+0000 7f92c1f49700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92bc0accd0 con 0x7f92bc0b1590 2021-01-03T13:05:31.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.925+0000 7f92c1f49700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92bc0b2980 con 0x7f92bc066f30 2021-01-03T13:05:31.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.925+0000 7f92bbfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92bc066f30 0x7f92bc0b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.925+0000 7f92bbfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92bc066f30 0x7f92bc0b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37090/0 (socket says 172.21.15.133:37090) 2021-01-03T13:05:31.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.925+0000 7f92bbfff700 1 -- 172.21.15.133:0/3403494198 learned_addr learned my addr 172.21.15.133:0/3403494198 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:31.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.925+0000 7f92c1748700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f92bc0b1590 0x7f92bc13ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58126/0 (socket says 172.21.15.133:58126) 2021-01-03T13:05:31.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.925+0000 7f92bbfff700 1 -- 172.21.15.133:0/3403494198 >> v1:172.21.15.133:6789/0 conn(0x7f92bc0b1590 legacy=0x7f92bc13ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.925+0000 7f92bbfff700 1 -- 172.21.15.133:0/3403494198 >> v1:172.21.15.16:6789/0 conn(0x7f92bc05f920 legacy=0x7f92bc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:31.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.925+0000 7f92bbfff700 1 -- 172.21.15.133:0/3403494198 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc0acf70 con 0x7f92bc066f30 2021-01-03T13:05:31.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.925+0000 7f92bbfff700 1 --2- 172.21.15.133:0/3403494198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92bc066f30 0x7f92bc0b0ab0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f92bc0b0580 tx=0x7f92ac006e80).ready entity=mon.1 client_cookie=80f01a7722f4db33 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:31.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92bb7fe700 1 -- 172.21.15.133:0/3403494198 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92ac0097b0 con 0x7f92bc066f30 2021-01-03T13:05:31.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92bb7fe700 1 -- 172.21.15.133:0/3403494198 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac009910 con 0x7f92bc066f30 2021-01-03T13:05:31.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92bb7fe700 1 -- 172.21.15.133:0/3403494198 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92ac009a80 con 0x7f92bc066f30 2021-01-03T13:05:31.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1f49700 1 -- 172.21.15.133:0/3403494198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92bc066f30 msgr2=0x7f92bc0b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1f49700 1 --2- 172.21.15.133:0/3403494198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92bc066f30 0x7f92bc0b0ab0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f92bc0b0580 tx=0x7f92ac006e80).stop 2021-01-03T13:05:31.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1f49700 1 -- 172.21.15.133:0/3403494198 shutdown_connections 2021-01-03T13:05:31.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1f49700 1 --2- 172.21.15.133:0/3403494198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92bc066f30 0x7f92bc0b0ab0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1f49700 1 -- 172.21.15.133:0/3403494198 >> 172.21.15.133:0/3403494198 conn(0x7f92bc0b6110 msgr2=0x7f92bc0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:31.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1f49700 1 -- 172.21.15.133:0/3403494198 shutdown_connections 2021-01-03T13:05:31.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1f49700 1 -- 172.21.15.133:0/3403494198 wait complete. 2021-01-03T13:05:31.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1f49700 1 Processor -- start 2021-01-03T13:05:31.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1f49700 1 -- start start 2021-01-03T13:05:31.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1f49700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92bc05f920 0x7f92bc0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1f49700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92bc066f30 0x7f92bc144720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1f49700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92bc0b1590 0x7f92bc144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1f49700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc0a04e0 con 0x7f92bc05f920 2021-01-03T13:05:31.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1f49700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc150640 con 0x7f92bc0b1590 2021-01-03T13:05:31.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1f49700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc09e7b0 con 0x7f92bc066f30 2021-01-03T13:05:31.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1748700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92bc0b1590 0x7f92bc144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1748700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92bc0b1590 0x7f92bc144c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37100/0 (socket says 172.21.15.133:37100) 2021-01-03T13:05:31.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1748700 1 -- 172.21.15.133:0/99417595 learned_addr learned my addr 172.21.15.133:0/99417595 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:31.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92bbfff700 1 --2- 172.21.15.133:0/99417595 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92bc066f30 0x7f92bc144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c0f47700 1 --2- 172.21.15.133:0/99417595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92bc05f920 0x7f92bc0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1748700 1 -- 172.21.15.133:0/99417595 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92bc066f30 msgr2=0x7f92bc144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1748700 1 --2- 172.21.15.133:0/99417595 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92bc066f30 0x7f92bc144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1748700 1 -- 172.21.15.133:0/99417595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92bc05f920 msgr2=0x7f92bc0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:31.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1748700 1 --2- 172.21.15.133:0/99417595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92bc05f920 0x7f92bc0b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:31.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1748700 1 -- 172.21.15.133:0/99417595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc1508b0 con 0x7f92bc0b1590 2021-01-03T13:05:31.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c0f47700 1 --2- 172.21.15.133:0/99417595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92bc05f920 0x7f92bc0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:31.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.929+0000 7f92c1748700 1 --2- 172.21.15.133:0/99417595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92bc0b1590 0x7f92bc144c10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f92bc0b6c00 tx=0x7f92b4007f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:31.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.933+0000 7f92b9ffb700 1 -- 172.21.15.133:0/99417595 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92b4002040 con 0x7f92bc0b1590 2021-01-03T13:05:31.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.933+0000 7f92b9ffb700 1 -- 172.21.15.133:0/99417595 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b4005ab0 con 0x7f92bc0b1590 2021-01-03T13:05:31.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.933+0000 7f92b9ffb700 1 -- 172.21.15.133:0/99417595 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92b4005e10 con 0x7f92bc0b1590 2021-01-03T13:05:31.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.933+0000 7f92c1f49700 1 -- 172.21.15.133:0/99417595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92bc144280 con 0x7f92bc0b1590 2021-01-03T13:05:31.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.933+0000 7f92c1f49700 1 -- 172.21.15.133:0/99417595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92bc145d40 con 0x7f92bc0b1590 2021-01-03T13:05:31.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.933+0000 7f92c1f49700 1 -- 172.21.15.133:0/99417595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92bc144410 con 0x7f92bc0b1590 2021-01-03T13:05:31.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.933+0000 7f92b9ffb700 1 -- 172.21.15.133:0/99417595 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f92b4010030 con 0x7f92bc0b1590 2021-01-03T13:05:31.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.933+0000 7f92b9ffb700 1 --2- 172.21.15.133:0/99417595 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f92a0055440 0x7f92a0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:31.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.933+0000 7f92b9ffb700 1 -- 172.21.15.133:0/99417595 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f92b406db70 con 0x7f92bc0b1590 2021-01-03T13:05:31.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.933+0000 7f92c0f47700 1 --2- 172.21.15.133:0/99417595 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f92a0055440 0x7f92a0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:31.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.937+0000 7f92c0f47700 1 --2- 172.21.15.133:0/99417595 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f92a0055440 0x7f92a0057900 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f92a4008000 tx=0x7f92a4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:31.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:31.941+0000 7f92b9ffb700 1 -- 172.21.15.133:0/99417595 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f92b40441a0 con 0x7f92bc0b1590 2021-01-03T13:05:32.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.077+0000 7f92c1f49700 1 -- 172.21.15.133:0/99417595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f92bc057300 con 0x7f92bc0b1590 2021-01-03T13:05:32.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.081+0000 7f92b9ffb700 1 -- 172.21.15.133:0/99417595 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v97) v1 ==== 92+0+10 (secure 0 0 0) 0x7f92b40477c0 con 0x7f92bc0b1590 2021-01-03T13:05:32.085 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:05:32.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.081+0000 7f92c1f49700 1 -- 172.21.15.133:0/99417595 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f92a0055440 msgr2=0x7f92a0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:32.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.081+0000 7f92c1f49700 1 --2- 172.21.15.133:0/99417595 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f92a0055440 0x7f92a0057900 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f92a4008000 tx=0x7f92a4009040).stop 2021-01-03T13:05:32.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.081+0000 7f92c1f49700 1 -- 172.21.15.133:0/99417595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92bc0b1590 msgr2=0x7f92bc144c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:32.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.081+0000 7f92c1f49700 1 --2- 172.21.15.133:0/99417595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92bc0b1590 0x7f92bc144c10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f92bc0b6c00 tx=0x7f92b4007f70).stop 2021-01-03T13:05:32.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.081+0000 7f92c1f49700 1 -- 172.21.15.133:0/99417595 shutdown_connections 2021-01-03T13:05:32.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.081+0000 7f92c1f49700 1 --2- 172.21.15.133:0/99417595 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f92a0055440 0x7f92a0057900 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.081+0000 7f92c1f49700 1 --2- 172.21.15.133:0/99417595 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92bc05f920 0x7f92bc0b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.081+0000 7f92c1f49700 1 --2- 172.21.15.133:0/99417595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92bc0b1590 0x7f92bc144c10 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.081+0000 7f92c1f49700 1 --2- 172.21.15.133:0/99417595 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92bc066f30 0x7f92bc144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.081+0000 7f92c1f49700 1 -- 172.21.15.133:0/99417595 >> 172.21.15.133:0/99417595 conn(0x7f92bc0b6110 msgr2=0x7f92bc0ad460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:32.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.081+0000 7f92c1f49700 1 -- 172.21.15.133:0/99417595 shutdown_connections 2021-01-03T13:05:32.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.081+0000 7f92c1f49700 1 -- 172.21.15.133:0/99417595 wait complete. 2021-01-03T13:05:32.098 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-01-03T13:05:32.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.197+0000 7fb0b8e35700 1 Processor -- start 2021-01-03T13:05:32.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.197+0000 7fb0b8e35700 1 -- start start 2021-01-03T13:05:32.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b8e35700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb0b405c130 0x7fb0b41437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:32.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b8e35700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb0b405cc10 0x7fb0b40b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:32.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b8e35700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b405c510 con 0x7fb0b4146370 2021-01-03T13:05:32.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b8e35700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b40b5c10 con 0x7fb0b405cc10 2021-01-03T13:05:32.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b8e35700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b40af8f0 con 0x7fb0b405c130 2021-01-03T13:05:32.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb0b405c130 0x7fb0b41437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:32.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb0b405c130 0x7fb0b41437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37104/0 (socket says 172.21.15.133:37104) 2021-01-03T13:05:32.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b259c700 1 -- 172.21.15.133:0/2517604386 learned_addr learned my addr 172.21.15.133:0/2517604386 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:32.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b1d9b700 1 --2- 172.21.15.133:0/2517604386 >> v2:172.21.15.16:3300/0 conn(0x7fb0b405cc10 0x7fb0b40b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:32.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b259c700 1 -- 172.21.15.133:0/2517604386 >> v2:172.21.15.16:3300/0 conn(0x7fb0b405cc10 msgr2=0x7fb0b40b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:32.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b259c700 1 --2- 172.21.15.133:0/2517604386 >> v2:172.21.15.16:3300/0 conn(0x7fb0b405cc10 0x7fb0b40b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b259c700 1 -- 172.21.15.133:0/2517604386 >> v1:172.21.15.16:6789/0 conn(0x7fb0b4146370 legacy=0x7fb0b4146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b259c700 1 -- 172.21.15.133:0/2517604386 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b40afb90 con 0x7fb0b405c130 2021-01-03T13:05:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b259c700 1 --2- 172.21.15.133:0/2517604386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b405c130 0x7fb0b41437e0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7fb0a40032b0 tx=0x7fb0a4009270).ready entity=mon.1 client_cookie=c267477b0b71f274 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b159a700 1 -- 172.21.15.133:0/2517604386 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0a4009e60 con 0x7fb0b405c130 2021-01-03T13:05:32.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b159a700 1 -- 172.21.15.133:0/2517604386 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a400bc00 con 0x7fb0b405c130 2021-01-03T13:05:32.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b159a700 1 -- 172.21.15.133:0/2517604386 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0a400bd70 con 0x7fb0b405c130 2021-01-03T13:05:32.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b8e35700 1 -- 172.21.15.133:0/2517604386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b405c130 msgr2=0x7fb0b41437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:32.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b8e35700 1 --2- 172.21.15.133:0/2517604386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b405c130 0x7fb0b41437e0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7fb0a40032b0 tx=0x7fb0a4009270).stop 2021-01-03T13:05:32.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b8e35700 1 -- 172.21.15.133:0/2517604386 shutdown_connections 2021-01-03T13:05:32.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b8e35700 1 --2- 172.21.15.133:0/2517604386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b405c130 0x7fb0b41437e0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b8e35700 1 --2- 172.21.15.133:0/2517604386 >> v2:172.21.15.16:3300/0 conn(0x7fb0b405cc10 0x7fb0b40b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b8e35700 1 -- 172.21.15.133:0/2517604386 >> 172.21.15.133:0/2517604386 conn(0x7fb0b40b95d0 msgr2=0x7fb0b40b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:32.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b8e35700 1 -- 172.21.15.133:0/2517604386 shutdown_connections 2021-01-03T13:05:32.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b8e35700 1 -- 172.21.15.133:0/2517604386 wait complete. 2021-01-03T13:05:32.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b8e35700 1 Processor -- start 2021-01-03T13:05:32.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.201+0000 7fb0b8e35700 1 -- start start 2021-01-03T13:05:32.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b8e35700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0b405c130 0x7fb0b4139dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:32.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b8e35700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb0b405cc10 0x7fb0b4141180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:32.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b8e35700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b4146370 0x7fb0b4141670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:32.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b8e35700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b40b8680 con 0x7fb0b405c130 2021-01-03T13:05:32.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b8e35700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b4142200 con 0x7fb0b4146370 2021-01-03T13:05:32.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b8e35700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b4142460 con 0x7fb0b405cc10 2021-01-03T13:05:32.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b2d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b4146370 0x7fb0b4141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:32.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b2d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b4146370 0x7fb0b4141670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37114/0 (socket says 172.21.15.133:37114) 2021-01-03T13:05:32.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b1d9b700 1 --2- 172.21.15.133:0/1475548007 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb0b405cc10 0x7fb0b4141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:32.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b259c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0b405c130 0x7fb0b4139dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:32.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b2d9d700 1 -- 172.21.15.133:0/1475548007 learned_addr learned my addr 172.21.15.133:0/1475548007 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:32.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b2d9d700 1 -- 172.21.15.133:0/1475548007 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb0b405cc10 msgr2=0x7fb0b4141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:32.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b2d9d700 1 --2- 172.21.15.133:0/1475548007 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb0b405cc10 0x7fb0b4141180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b2d9d700 1 -- 172.21.15.133:0/1475548007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0b405c130 msgr2=0x7fb0b4139dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:32.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b2d9d700 1 --2- 172.21.15.133:0/1475548007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0b405c130 0x7fb0b4139dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b2d9d700 1 -- 172.21.15.133:0/1475548007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b4142700 con 0x7fb0b4146370 2021-01-03T13:05:32.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b2d9d700 1 --2- 172.21.15.133:0/1475548007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b4146370 0x7fb0b4141670 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7fb0b4067f50 tx=0x7fb0ac007bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:32.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0ab7fe700 1 -- 172.21.15.133:0/1475548007 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0ac013410 con 0x7fb0b4146370 2021-01-03T13:05:32.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0ab7fe700 1 -- 172.21.15.133:0/1475548007 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ac013570 con 0x7fb0b4146370 2021-01-03T13:05:32.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b8e35700 1 -- 172.21.15.133:0/1475548007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b4140ce0 con 0x7fb0b4146370 2021-01-03T13:05:32.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0ab7fe700 1 -- 172.21.15.133:0/1475548007 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0ac0138d0 con 0x7fb0b4146370 2021-01-03T13:05:32.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.205+0000 7fb0b8e35700 1 -- 172.21.15.133:0/1475548007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b40b71d0 con 0x7fb0b4146370 2021-01-03T13:05:32.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.209+0000 7fb0b8e35700 1 -- 172.21.15.133:0/1475548007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b413a450 con 0x7fb0b4146370 2021-01-03T13:05:32.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.209+0000 7fb0ab7fe700 1 -- 172.21.15.133:0/1475548007 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb0ac010030 con 0x7fb0b4146370 2021-01-03T13:05:32.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.209+0000 7fb0ab7fe700 1 --2- 172.21.15.133:0/1475548007 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb098055470 0x7fb098057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:32.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.209+0000 7fb0ab7fe700 1 -- 172.21.15.133:0/1475548007 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb0ac06da80 con 0x7fb0b4146370 2021-01-03T13:05:32.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.209+0000 7fb0b259c700 1 --2- 172.21.15.133:0/1475548007 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb098055470 0x7fb098057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:32.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.209+0000 7fb0b259c700 1 --2- 172.21.15.133:0/1475548007 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb098055470 0x7fb098057930 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fb0a401a000 tx=0x7fb0a4016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:32.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.217+0000 7fb0ab7fe700 1 -- 172.21.15.133:0/1475548007 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb0ac043fa0 con 0x7fb0b4146370 2021-01-03T13:05:32.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.357+0000 7fb0b8e35700 1 -- 172.21.15.133:0/1475548007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb0b4140e70 con 0x7fb0b4146370 2021-01-03T13:05:32.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.357+0000 7fb0ab7fe700 1 -- 172.21.15.133:0/1475548007 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v97) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb0ac0475c0 con 0x7fb0b4146370 2021-01-03T13:05:32.363 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:32.363 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2021-01-03T13:05:32.363 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:32.363 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2021-01-03T13:05:32.364 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2021-01-03T13:05:32.364 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:32.364 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:32.364 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2021-01-03T13:05:32.364 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2021-01-03T13:05:32.365 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:32.365 INFO:teuthology.orchestra.run.smithi133.stdout:] 2021-01-03T13:05:32.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.357+0000 7fb0b8e35700 1 -- 172.21.15.133:0/1475548007 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb098055470 msgr2=0x7fb098057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:32.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.357+0000 7fb0b8e35700 1 --2- 172.21.15.133:0/1475548007 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb098055470 0x7fb098057930 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fb0a401a000 tx=0x7fb0a4016000).stop 2021-01-03T13:05:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.357+0000 7fb0b8e35700 1 -- 172.21.15.133:0/1475548007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b4146370 msgr2=0x7fb0b4141670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.357+0000 7fb0b8e35700 1 --2- 172.21.15.133:0/1475548007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b4146370 0x7fb0b4141670 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7fb0b4067f50 tx=0x7fb0ac007bf0).stop 2021-01-03T13:05:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.357+0000 7fb0b8e35700 1 -- 172.21.15.133:0/1475548007 shutdown_connections 2021-01-03T13:05:32.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.361+0000 7fb0b8e35700 1 --2- 172.21.15.133:0/1475548007 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb098055470 0x7fb098057930 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.361+0000 7fb0b8e35700 1 --2- 172.21.15.133:0/1475548007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb0b405c130 0x7fb0b4139dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.361+0000 7fb0b8e35700 1 --2- 172.21.15.133:0/1475548007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb0b4146370 0x7fb0b4141670 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.361+0000 7fb0b8e35700 1 --2- 172.21.15.133:0/1475548007 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb0b405cc10 0x7fb0b4141180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.361+0000 7fb0b8e35700 1 -- 172.21.15.133:0/1475548007 >> 172.21.15.133:0/1475548007 conn(0x7fb0b40b95d0 msgr2=0x7fb0b413c120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:32.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.361+0000 7fb0b8e35700 1 -- 172.21.15.133:0/1475548007 shutdown_connections 2021-01-03T13:05:32.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.361+0000 7fb0b8e35700 1 -- 172.21.15.133:0/1475548007 wait complete. 2021-01-03T13:05:32.376 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-01-03T13:05:32.376 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-01-03T13:05:32.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.485+0000 7fd996b19700 1 Processor -- start 2021-01-03T13:05:32.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.485+0000 7fd996b19700 1 -- start start 2021-01-03T13:05:32.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd996b19700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd9900b4c20 0x7fd99005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:32.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd996b19700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd990060510 0x7fd9900b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:32.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd996b19700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9900b6cf0 con 0x7fd99005fd10 2021-01-03T13:05:32.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd996b19700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd99005bf00 con 0x7fd9900b4c20 2021-01-03T13:05:32.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd996b19700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99005c1a0 con 0x7fd990060510 2021-01-03T13:05:32.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd995b17700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd9900b4c20 0x7fd99005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:32.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd995b17700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd9900b4c20 0x7fd99005c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37122/0 (socket says 172.21.15.133:37122) 2021-01-03T13:05:32.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd995b17700 1 -- 172.21.15.133:0/1068023630 learned_addr learned my addr 172.21.15.133:0/1068023630 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:32.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd995316700 1 --2- 172.21.15.133:0/1068023630 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd990060510 0x7fd9900b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:32.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd995b17700 1 -- 172.21.15.133:0/1068023630 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd990060510 msgr2=0x7fd9900b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:32.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd995b17700 1 --2- 172.21.15.133:0/1068023630 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd990060510 0x7fd9900b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd995b17700 1 -- 172.21.15.133:0/1068023630 >> v1:172.21.15.16:6789/0 conn(0x7fd99005fd10 legacy=0x7fd9900b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:32.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd995b17700 1 -- 172.21.15.133:0/1068023630 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd99005c440 con 0x7fd9900b4c20 2021-01-03T13:05:32.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd995b17700 1 --2- 172.21.15.133:0/1068023630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9900b4c20 0x7fd99005c8e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fd980002f30 tx=0x7fd980006e80).ready entity=mon.1 client_cookie=ce0f8156ffae4c01 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:32.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd994b15700 1 -- 172.21.15.133:0/1068023630 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9800097f0 con 0x7fd9900b4c20 2021-01-03T13:05:32.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd994b15700 1 -- 172.21.15.133:0/1068023630 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd980009950 con 0x7fd9900b4c20 2021-01-03T13:05:32.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd994b15700 1 -- 172.21.15.133:0/1068023630 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd980009cb0 con 0x7fd9900b4c20 2021-01-03T13:05:32.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd996b19700 1 -- 172.21.15.133:0/1068023630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9900b4c20 msgr2=0x7fd99005c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:32.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd996b19700 1 --2- 172.21.15.133:0/1068023630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9900b4c20 0x7fd99005c8e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fd980002f30 tx=0x7fd980006e80).stop 2021-01-03T13:05:32.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd996b19700 1 -- 172.21.15.133:0/1068023630 shutdown_connections 2021-01-03T13:05:32.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd996b19700 1 --2- 172.21.15.133:0/1068023630 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9900b4c20 0x7fd99005c8e0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd996b19700 1 --2- 172.21.15.133:0/1068023630 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd990060510 0x7fd9900b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd996b19700 1 -- 172.21.15.133:0/1068023630 >> 172.21.15.133:0/1068023630 conn(0x7fd9900b9f00 msgr2=0x7fd9900b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:32.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd996b19700 1 -- 172.21.15.133:0/1068023630 shutdown_connections 2021-01-03T13:05:32.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.489+0000 7fd996b19700 1 -- 172.21.15.133:0/1068023630 wait complete. 2021-01-03T13:05:32.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd996b19700 1 Processor -- start 2021-01-03T13:05:32.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd996b19700 1 -- start start 2021-01-03T13:05:32.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd996b19700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd99005fd10 0x7fd99013eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:32.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd996b19700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd990060510 0x7fd9900b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:32.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd996b19700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd9900b4c20 0x7fd990142d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:32.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd996b19700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900b1fc0 con 0x7fd990060510 2021-01-03T13:05:32.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd996b19700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9901428a0 con 0x7fd99005fd10 2021-01-03T13:05:32.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd996b19700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9900b3360 con 0x7fd9900b4c20 2021-01-03T13:05:32.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd995b17700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd99005fd10 0x7fd99013eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:32.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd995b17700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd99005fd10 0x7fd99013eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37124/0 (socket says 172.21.15.133:37124) 2021-01-03T13:05:32.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd995b17700 1 -- 172.21.15.133:0/364583290 learned_addr learned my addr 172.21.15.133:0/364583290 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:32.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd995316700 1 --2- 172.21.15.133:0/364583290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd990060510 0x7fd9900b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:32.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd996318700 1 --2- 172.21.15.133:0/364583290 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd9900b4c20 0x7fd990142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:32.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd995b17700 1 -- 172.21.15.133:0/364583290 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd9900b4c20 msgr2=0x7fd990142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:32.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd995b17700 1 --2- 172.21.15.133:0/364583290 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd9900b4c20 0x7fd990142d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd995b17700 1 -- 172.21.15.133:0/364583290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd990060510 msgr2=0x7fd9900b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:32.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd995b17700 1 --2- 172.21.15.133:0/364583290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd990060510 0x7fd9900b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd995b17700 1 -- 172.21.15.133:0/364583290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9900b3600 con 0x7fd99005fd10 2021-01-03T13:05:32.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.493+0000 7fd995316700 1 --2- 172.21.15.133:0/364583290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd990060510 0x7fd9900b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:32.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.497+0000 7fd995b17700 1 --2- 172.21.15.133:0/364583290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd99005fd10 0x7fd99013eeb0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7fd980002f30 tx=0x7fd980015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:32.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.497+0000 7fd97effd700 1 -- 172.21.15.133:0/364583290 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd980011ce0 con 0x7fd99005fd10 2021-01-03T13:05:32.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.497+0000 7fd97effd700 1 -- 172.21.15.133:0/364583290 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd980011e40 con 0x7fd99005fd10 2021-01-03T13:05:32.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.497+0000 7fd996b19700 1 -- 172.21.15.133:0/364583290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9900b1940 con 0x7fd99005fd10 2021-01-03T13:05:32.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.497+0000 7fd97effd700 1 -- 172.21.15.133:0/364583290 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd98001e650 con 0x7fd99005fd10 2021-01-03T13:05:32.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.497+0000 7fd996b19700 1 -- 172.21.15.133:0/364583290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9900b1c40 con 0x7fd99005fd10 2021-01-03T13:05:32.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.497+0000 7fd996b19700 1 -- 172.21.15.133:0/364583290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd990057300 con 0x7fd99005fd10 2021-01-03T13:05:32.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.497+0000 7fd97effd700 1 -- 172.21.15.133:0/364583290 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd980025030 con 0x7fd99005fd10 2021-01-03T13:05:32.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.497+0000 7fd97effd700 1 --2- 172.21.15.133:0/364583290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd9700553b0 0x7fd970057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:32.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.497+0000 7fd97effd700 1 -- 172.21.15.133:0/364583290 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd98006f0b0 con 0x7fd99005fd10 2021-01-03T13:05:32.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.497+0000 7fd995316700 1 --2- 172.21.15.133:0/364583290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd9700553b0 0x7fd970057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:32.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.497+0000 7fd995316700 1 --2- 172.21.15.133:0/364583290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd9700553b0 0x7fd970057870 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fd98c00b000 tx=0x7fd98c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:32.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.505+0000 7fd97effd700 1 -- 172.21.15.133:0/364583290 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd980045640 con 0x7fd99005fd10 2021-01-03T13:05:32.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.645+0000 7fd996b19700 1 -- 172.21.15.133:0/364583290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fd990067a00 con 0x7fd99005fd10 2021-01-03T13:05:32.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.853+0000 7fd97effd700 1 -- 172.21.15.133:0/364583290 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v98) v1 ==== 133+0+0 (secure 0 0 0) 0x7fd980048c60 con 0x7fd99005fd10 2021-01-03T13:05:32.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.857+0000 7fd996b19700 1 -- 172.21.15.133:0/364583290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd9700553b0 msgr2=0x7fd970057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:32.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.857+0000 7fd996b19700 1 --2- 172.21.15.133:0/364583290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd9700553b0 0x7fd970057870 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fd98c00b000 tx=0x7fd98c008040).stop 2021-01-03T13:05:32.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.857+0000 7fd996b19700 1 -- 172.21.15.133:0/364583290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd99005fd10 msgr2=0x7fd99013eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:32.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.857+0000 7fd996b19700 1 --2- 172.21.15.133:0/364583290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd99005fd10 0x7fd99013eeb0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7fd980002f30 tx=0x7fd980015000).stop 2021-01-03T13:05:32.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.857+0000 7fd996b19700 1 -- 172.21.15.133:0/364583290 shutdown_connections 2021-01-03T13:05:32.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.857+0000 7fd996b19700 1 --2- 172.21.15.133:0/364583290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd9700553b0 0x7fd970057870 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.857+0000 7fd996b19700 1 --2- 172.21.15.133:0/364583290 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd9900b4c20 0x7fd990142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.857+0000 7fd996b19700 1 --2- 172.21.15.133:0/364583290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd99005fd10 0x7fd99013eeb0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.857+0000 7fd996b19700 1 --2- 172.21.15.133:0/364583290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd990060510 0x7fd9900b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:32.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.857+0000 7fd996b19700 1 -- 172.21.15.133:0/364583290 >> 172.21.15.133:0/364583290 conn(0x7fd9900b9f00 msgr2=0x7fd9900af8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:32.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.857+0000 7fd996b19700 1 -- 172.21.15.133:0/364583290 shutdown_connections 2021-01-03T13:05:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.857+0000 7fd996b19700 1 -- 172.21.15.133:0/364583290 wait complete. 2021-01-03T13:05:32.875 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2021-01-03T13:05:32.877 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-01-03T13:05:32.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.985+0000 7fc6b3fff700 1 Processor -- start 2021-01-03T13:05:32.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.985+0000 7fc6b3fff700 1 -- start start 2021-01-03T13:05:32.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b3fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6b40677a0 0x7fc6b4146c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:32.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc6b40b0210 0x7fc6b40a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:32.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b3fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b40adbd0 con 0x7fc6b40a8f70 2021-01-03T13:05:32.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b3fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b405c920 con 0x7fc6b40b0210 2021-01-03T13:05:32.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b3fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b4067b80 con 0x7fc6b40677a0 2021-01-03T13:05:32.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6aa7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc6b40b0210 0x7fc6b40a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:32.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b37fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc6b40a8f70 0x7fc6b4142d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58166/0 (socket says 172.21.15.133:58166) 2021-01-03T13:05:32.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6aa7fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc6b40b0210 0x7fc6b40a8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37134/0 (socket says 172.21.15.133:37134) 2021-01-03T13:05:32.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b37fe700 1 -- 172.21.15.133:0/568567721 learned_addr learned my addr 172.21.15.133:0/568567721 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:33.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b2ffd700 1 --2- 172.21.15.133:0/568567721 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6b40677a0 0x7fc6b4146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:33.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6aa7fc700 1 -- 172.21.15.133:0/568567721 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6b40677a0 msgr2=0x7fc6b4146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:33.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6aa7fc700 1 --2- 172.21.15.133:0/568567721 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6b40677a0 0x7fc6b4146c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:33.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6aa7fc700 1 -- 172.21.15.133:0/568567721 >> v1:172.21.15.133:6789/0 conn(0x7fc6b40a8f70 legacy=0x7fc6b4142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:33.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b27fc700 1 -- 172.21.15.133:0/568567721 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571740585 0 0) 0x7fc6b40adbd0 con 0x7fc6b40a8f70 2021-01-03T13:05:33.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6aa7fc700 1 -- 172.21.15.133:0/568567721 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b40ade00 con 0x7fc6b40b0210 2021-01-03T13:05:33.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6aa7fc700 1 --2- 172.21.15.133:0/568567721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6b40b0210 0x7fc6b40a8a80 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fc69c002f30 tx=0x7fc69c006dc0).ready entity=mon.1 client_cookie=bb9ce9be86fada33 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:33.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b27fc700 1 -- 172.21.15.133:0/568567721 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc69c0097f0 con 0x7fc6b40b0210 2021-01-03T13:05:33.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b27fc700 1 -- 172.21.15.133:0/568567721 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c009950 con 0x7fc6b40b0210 2021-01-03T13:05:33.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b27fc700 1 -- 172.21.15.133:0/568567721 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc69c009cb0 con 0x7fc6b40b0210 2021-01-03T13:05:33.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b3fff700 1 -- 172.21.15.133:0/568567721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6b40b0210 msgr2=0x7fc6b40a8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:33.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b3fff700 1 --2- 172.21.15.133:0/568567721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6b40b0210 0x7fc6b40a8a80 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7fc69c002f30 tx=0x7fc69c006dc0).stop 2021-01-03T13:05:33.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b3fff700 1 -- 172.21.15.133:0/568567721 shutdown_connections 2021-01-03T13:05:33.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b3fff700 1 --2- 172.21.15.133:0/568567721 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6b40677a0 0x7fc6b4146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:33.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b3fff700 1 --2- 172.21.15.133:0/568567721 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6b40b0210 0x7fc6b40a8a80 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:33.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b3fff700 1 -- 172.21.15.133:0/568567721 >> 172.21.15.133:0/568567721 conn(0x7fc6b406b050 msgr2=0x7fc6b4060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:33.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b3fff700 1 -- 172.21.15.133:0/568567721 shutdown_connections 2021-01-03T13:05:33.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b3fff700 1 -- 172.21.15.133:0/568567721 wait complete. 2021-01-03T13:05:33.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b3fff700 1 Processor -- start 2021-01-03T13:05:33.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.989+0000 7fc6b3fff700 1 -- start start 2021-01-03T13:05:33.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6b3fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6b40677a0 0x7fc6b41436e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:33.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6b3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6b40a8f70 0x7fc6b4140ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:33.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6b3fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6b40b0210 0x7fc6b41414e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:33.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6b3fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b41419d0 con 0x7fc6b40b0210 2021-01-03T13:05:33.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6b3fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b4151f80 con 0x7fc6b40a8f70 2021-01-03T13:05:33.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6b3fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b4152220 con 0x7fc6b40677a0 2021-01-03T13:05:33.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6aa7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6b40a8f70 0x7fc6b4140ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:33.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6aa7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6b40a8f70 0x7fc6b4140ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37140/0 (socket says 172.21.15.133:37140) 2021-01-03T13:05:33.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6aa7fc700 1 -- 172.21.15.133:0/462681507 learned_addr learned my addr 172.21.15.133:0/462681507 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:33.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6b37fe700 1 --2- 172.21.15.133:0/462681507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6b40b0210 0x7fc6b41414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:33.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6b2ffd700 1 --2- 172.21.15.133:0/462681507 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6b40677a0 0x7fc6b41436e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:33.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6aa7fc700 1 -- 172.21.15.133:0/462681507 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6b40677a0 msgr2=0x7fc6b41436e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:33.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6aa7fc700 1 --2- 172.21.15.133:0/462681507 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6b40677a0 0x7fc6b41436e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:33.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6aa7fc700 1 -- 172.21.15.133:0/462681507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6b40b0210 msgr2=0x7fc6b41414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:33.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6aa7fc700 1 --2- 172.21.15.133:0/462681507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6b40b0210 0x7fc6b41414e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:33.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6aa7fc700 1 -- 172.21.15.133:0/462681507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b41524c0 con 0x7fc6b40a8f70 2021-01-03T13:05:33.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6b37fe700 1 --2- 172.21.15.133:0/462681507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6b40b0210 0x7fc6b41414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:33.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6aa7fc700 1 --2- 172.21.15.133:0/462681507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6b40a8f70 0x7fc6b4140ff0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7fc6b4141b10 tx=0x7fc69c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:33.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6b0ff9700 1 -- 172.21.15.133:0/462681507 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc69c011c60 con 0x7fc6b40a8f70 2021-01-03T13:05:33.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6b0ff9700 1 -- 172.21.15.133:0/462681507 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c011dc0 con 0x7fc6b40a8f70 2021-01-03T13:05:33.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6b0ff9700 1 -- 172.21.15.133:0/462681507 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc69c01d640 con 0x7fc6b40a8f70 2021-01-03T13:05:33.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6b3fff700 1 -- 172.21.15.133:0/462681507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b4152760 con 0x7fc6b40a8f70 2021-01-03T13:05:33.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.993+0000 7fc6b3fff700 1 -- 172.21.15.133:0/462681507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b4152c00 con 0x7fc6b40a8f70 2021-01-03T13:05:33.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.997+0000 7fc6b0ff9700 1 -- 172.21.15.133:0/462681507 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc69c024030 con 0x7fc6b40a8f70 2021-01-03T13:05:33.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.997+0000 7fc6b3fff700 1 -- 172.21.15.133:0/462681507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b41528f0 con 0x7fc6b40a8f70 2021-01-03T13:05:33.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.997+0000 7fc6b0ff9700 1 --2- 172.21.15.133:0/462681507 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc698055400 0x7fc6980578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:33.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.997+0000 7fc6b0ff9700 1 -- 172.21.15.133:0/462681507 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fc69c06f0c0 con 0x7fc6b40a8f70 2021-01-03T13:05:33.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.997+0000 7fc6b2ffd700 1 --2- 172.21.15.133:0/462681507 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc698055400 0x7fc6980578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:33.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:32.997+0000 7fc6b2ffd700 1 --2- 172.21.15.133:0/462681507 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc698055400 0x7fc6980578c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fc6a4008000 tx=0x7fc6a4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:33.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:33.001+0000 7fc6b0ff9700 1 -- 172.21.15.133:0/462681507 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc69c045590 con 0x7fc6b40a8f70 2021-01-03T13:05:33.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:33.141+0000 7fc6b3fff700 1 -- 172.21.15.133:0/462681507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fc6b4057300 con 0x7fc6b40a8f70 2021-01-03T13:05:33.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:33.865+0000 7fc6b0ff9700 1 -- 172.21.15.133:0/462681507 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v99) v1 ==== 125+0+0 (secure 0 0 0) 0x7fc69c022020 con 0x7fc6b40a8f70 2021-01-03T13:05:33.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:33.869+0000 7fc6b3fff700 1 -- 172.21.15.133:0/462681507 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc698055400 msgr2=0x7fc6980578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:33.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:33.869+0000 7fc6b3fff700 1 --2- 172.21.15.133:0/462681507 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc698055400 0x7fc6980578c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fc6a4008000 tx=0x7fc6a4008040).stop 2021-01-03T13:05:33.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:33.869+0000 7fc6b3fff700 1 -- 172.21.15.133:0/462681507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6b40a8f70 msgr2=0x7fc6b4140ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:33.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:33.869+0000 7fc6b3fff700 1 --2- 172.21.15.133:0/462681507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6b40a8f70 0x7fc6b4140ff0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7fc6b4141b10 tx=0x7fc69c015000).stop 2021-01-03T13:05:33.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:33.869+0000 7fc6b3fff700 1 -- 172.21.15.133:0/462681507 shutdown_connections 2021-01-03T13:05:33.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:33.869+0000 7fc6b3fff700 1 --2- 172.21.15.133:0/462681507 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc698055400 0x7fc6980578c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:33.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:33.869+0000 7fc6b3fff700 1 --2- 172.21.15.133:0/462681507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc6b40b0210 0x7fc6b41414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:33.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:33.869+0000 7fc6b3fff700 1 --2- 172.21.15.133:0/462681507 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6b40677a0 0x7fc6b41436e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:33.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:33.869+0000 7fc6b3fff700 1 --2- 172.21.15.133:0/462681507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6b40a8f70 0x7fc6b4140ff0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:33.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:33.869+0000 7fc6b3fff700 1 -- 172.21.15.133:0/462681507 >> 172.21.15.133:0/462681507 conn(0x7fc6b406b050 msgr2=0x7fc6b40b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:33.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:33.869+0000 7fc6b3fff700 1 -- 172.21.15.133:0/462681507 shutdown_connections 2021-01-03T13:05:33.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:33.869+0000 7fc6b3fff700 1 -- 172.21.15.133:0/462681507 wait complete. 2021-01-03T13:05:33.877 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2021-01-03T13:05:33.889 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-01-03T13:05:34.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:33.997+0000 7f71de1e8700 1 Processor -- start 2021-01-03T13:05:34.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:33.997+0000 7f71de1e8700 1 -- start start 2021-01-03T13:05:34.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71de1e8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d80b0470 0x7f71d805bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71de1e8700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d805cf20 con 0x7f71d81407f0 2021-01-03T13:05:34.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71de1e8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d8146580 con 0x7f71d8140410 2021-01-03T13:05:34.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71de1e8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80b02d0 con 0x7f71d80b0470 2021-01-03T13:05:34.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71d77fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f71d8140410 0x7f71d8146cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58178/0 (socket says 172.21.15.133:58178) 2021-01-03T13:05:34.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71d77fe700 1 -- 172.21.15.133:0/3286404389 learned_addr learned my addr 172.21.15.133:0/3286404389 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:34.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71d7fff700 1 --2- 172.21.15.133:0/3286404389 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d80b0470 0x7f71d805bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71d67fc700 1 -- 172.21.15.133:0/3286404389 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340172152 0 0) 0x7f71d8146580 con 0x7f71d8140410 2021-01-03T13:05:34.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71d67fc700 1 -- 172.21.15.133:0/3286404389 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71c4003230 con 0x7f71d8140410 2021-01-03T13:05:34.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71d7fff700 1 -- 172.21.15.133:0/3286404389 >> v1:172.21.15.133:6789/0 conn(0x7f71d8140410 legacy=0x7f71d8146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71d67fc700 1 -- 172.21.15.133:0/3286404389 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974762802 0 0) 0x7f71d805cf20 con 0x7f71d81407f0 2021-01-03T13:05:34.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71d7fff700 1 -- 172.21.15.133:0/3286404389 >> v1:172.21.15.16:6789/0 conn(0x7f71d81407f0 legacy=0x7f71d8142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71d7fff700 1 -- 172.21.15.133:0/3286404389 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d8146820 con 0x7f71d80b0470 2021-01-03T13:05:34.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71d7fff700 1 --2- 172.21.15.133:0/3286404389 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d80b0470 0x7f71d805bdf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f71d00032b0 tx=0x7f71d00091a0).ready entity=mon.2 client_cookie=e9c0cc70ba5c6bed server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:34.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71d67fc700 1 -- 172.21.15.133:0/3286404389 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71d000b9f0 con 0x7f71d80b0470 2021-01-03T13:05:34.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71d67fc700 1 -- 172.21.15.133:0/3286404389 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d000bb50 con 0x7f71d80b0470 2021-01-03T13:05:34.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71d67fc700 1 -- 172.21.15.133:0/3286404389 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71d000bcc0 con 0x7f71d80b0470 2021-01-03T13:05:34.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71de1e8700 1 -- 172.21.15.133:0/3286404389 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d80b0470 msgr2=0x7f71d805bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71de1e8700 1 --2- 172.21.15.133:0/3286404389 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d80b0470 0x7f71d805bdf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f71d00032b0 tx=0x7f71d00091a0).stop 2021-01-03T13:05:34.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71de1e8700 1 -- 172.21.15.133:0/3286404389 shutdown_connections 2021-01-03T13:05:34.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71de1e8700 1 --2- 172.21.15.133:0/3286404389 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d80b0470 0x7f71d805bdf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71de1e8700 1 -- 172.21.15.133:0/3286404389 >> 172.21.15.133:0/3286404389 conn(0x7f71d80b95d0 msgr2=0x7f71d80b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:34.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71de1e8700 1 -- 172.21.15.133:0/3286404389 shutdown_connections 2021-01-03T13:05:34.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.001+0000 7f71de1e8700 1 -- 172.21.15.133:0/3286404389 wait complete. 2021-01-03T13:05:34.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71de1e8700 1 Processor -- start 2021-01-03T13:05:34.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71de1e8700 1 -- start start 2021-01-03T13:05:34.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71de1e8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d80b0470 0x7f71d809cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71de1e8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d8140410 0x7f71d80b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71de1e8700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71d81407f0 0x7f71d80b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71de1e8700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d809c3c0 con 0x7f71d81407f0 2021-01-03T13:05:34.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71de1e8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d81432d0 con 0x7f71d80b0470 2021-01-03T13:05:34.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71de1e8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d809c120 con 0x7f71d8140410 2021-01-03T13:05:34.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71d77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d80b0470 0x7f71d809cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71d77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d80b0470 0x7f71d809cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37152/0 (socket says 172.21.15.133:37152) 2021-01-03T13:05:34.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71d77fe700 1 -- 172.21.15.133:0/1888575459 learned_addr learned my addr 172.21.15.133:0/1888575459 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:34.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71d6ffd700 1 --2- 172.21.15.133:0/1888575459 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d8140410 0x7f71d80b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71d7fff700 1 --2- 172.21.15.133:0/1888575459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71d81407f0 0x7f71d80b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71d77fe700 1 -- 172.21.15.133:0/1888575459 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d8140410 msgr2=0x7f71d80b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71d77fe700 1 --2- 172.21.15.133:0/1888575459 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d8140410 0x7f71d80b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71d77fe700 1 -- 172.21.15.133:0/1888575459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71d81407f0 msgr2=0x7f71d80b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71d77fe700 1 --2- 172.21.15.133:0/1888575459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71d81407f0 0x7f71d80b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71d77fe700 1 -- 172.21.15.133:0/1888575459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d8143570 con 0x7f71d80b0470 2021-01-03T13:05:34.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71d7fff700 1 --2- 172.21.15.133:0/1888575459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71d81407f0 0x7f71d80b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:34.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71d77fe700 1 --2- 172.21.15.133:0/1888575459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d80b0470 0x7f71d809cfb0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f71d809f650 tx=0x7f71cc007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:34.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71d4ff9700 1 -- 172.21.15.133:0/1888575459 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71cc0072e0 con 0x7f71d80b0470 2021-01-03T13:05:34.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71d4ff9700 1 -- 172.21.15.133:0/1888575459 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc007440 con 0x7f71d80b0470 2021-01-03T13:05:34.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71de1e8700 1 -- 172.21.15.133:0/1888575459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d8141cd0 con 0x7f71d80b0470 2021-01-03T13:05:34.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71d4ff9700 1 -- 172.21.15.133:0/1888575459 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71cc0057d0 con 0x7f71d80b0470 2021-01-03T13:05:34.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.005+0000 7f71de1e8700 1 -- 172.21.15.133:0/1888575459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d8140e00 con 0x7f71d80b0470 2021-01-03T13:05:34.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.009+0000 7f71de1e8700 1 -- 172.21.15.133:0/1888575459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d8057300 con 0x7f71d80b0470 2021-01-03T13:05:34.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.009+0000 7f71d4ff9700 1 -- 172.21.15.133:0/1888575459 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f71cc01a060 con 0x7f71d80b0470 2021-01-03T13:05:34.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.009+0000 7f71d4ff9700 1 --2- 172.21.15.133:0/1888575459 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71b80553b0 0x7f71b8057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.009+0000 7f71d6ffd700 1 --2- 172.21.15.133:0/1888575459 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71b80553b0 0x7f71b8057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.009+0000 7f71d4ff9700 1 -- 172.21.15.133:0/1888575459 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f71cc06d3b0 con 0x7f71d80b0470 2021-01-03T13:05:34.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.009+0000 7f71d6ffd700 1 --2- 172.21.15.133:0/1888575459 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71b80553b0 0x7f71b8057870 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f71c8003040 tx=0x7f71c8007b40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:34.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.013+0000 7f71d4ff9700 1 -- 172.21.15.133:0/1888575459 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f71cc043610 con 0x7f71d80b0470 2021-01-03T13:05:34.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.197+0000 7f71de1e8700 1 -- 172.21.15.133:0/1888575459 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f71d8141570 con 0x7f71d80b0470 2021-01-03T13:05:34.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.209+0000 7f71d4ff9700 1 -- 172.21.15.133:0/1888575459 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 17 and data pool 18 v42) v1 ==== 189+0+0 (secure 0 0 0) 0x7f71cc018020 con 0x7f71d80b0470 2021-01-03T13:05:34.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.217+0000 7f71de1e8700 1 -- 172.21.15.133:0/1888575459 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71b80553b0 msgr2=0x7f71b8057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.217+0000 7f71de1e8700 1 --2- 172.21.15.133:0/1888575459 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71b80553b0 0x7f71b8057870 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f71c8003040 tx=0x7f71c8007b40).stop 2021-01-03T13:05:34.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.217+0000 7f71de1e8700 1 -- 172.21.15.133:0/1888575459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d80b0470 msgr2=0x7f71d809cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.217+0000 7f71de1e8700 1 --2- 172.21.15.133:0/1888575459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d80b0470 0x7f71d809cfb0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f71d809f650 tx=0x7f71cc007aa0).stop 2021-01-03T13:05:34.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.217+0000 7f71de1e8700 1 -- 172.21.15.133:0/1888575459 shutdown_connections 2021-01-03T13:05:34.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.217+0000 7f71de1e8700 1 --2- 172.21.15.133:0/1888575459 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f71b80553b0 0x7f71b8057870 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.217+0000 7f71de1e8700 1 --2- 172.21.15.133:0/1888575459 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f71d81407f0 0x7f71d80b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.217+0000 7f71de1e8700 1 --2- 172.21.15.133:0/1888575459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71d80b0470 0x7f71d809cfb0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.217+0000 7f71de1e8700 1 --2- 172.21.15.133:0/1888575459 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f71d8140410 0x7f71d80b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.217+0000 7f71de1e8700 1 -- 172.21.15.133:0/1888575459 >> 172.21.15.133:0/1888575459 conn(0x7f71d80b95d0 msgr2=0x7f71d80b8170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:34.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.217+0000 7f71de1e8700 1 -- 172.21.15.133:0/1888575459 shutdown_connections 2021-01-03T13:05:34.226 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.217+0000 7f71de1e8700 1 -- 172.21.15.133:0/1888575459 wait complete. 2021-01-03T13:05:34.227 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 17 and data pool 18 2021-01-03T13:05:34.243 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:05:34.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe8282cf700 1 Processor -- start 2021-01-03T13:05:34.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe8282cf700 1 -- start start 2021-01-03T13:05:34.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe8282cf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe8200b3f20 0x7fe820061e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe8282cf700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe820062380 con 0x7fe8201472a0 2021-01-03T13:05:34.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe8282cf700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8200614f0 con 0x7fe8200ac6e0 2021-01-03T13:05:34.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe8282cf700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe82014ae20 con 0x7fe8200b3f20 2021-01-03T13:05:34.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe82606b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe8200b3f20 0x7fe820061e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe82606b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe8200b3f20 0x7fe820061e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37168/0 (socket says 172.21.15.133:37168) 2021-01-03T13:05:34.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe82606b700 1 -- 172.21.15.133:0/641782094 learned_addr learned my addr 172.21.15.133:0/641782094 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:34.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe82586a700 1 --1- 172.21.15.133:0/641782094 >> v1:172.21.15.133:6789/0 conn(0x7fe8200ac6e0 0x7fe82014a710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58202/0 (socket says 172.21.15.133:58202) 2021-01-03T13:05:34.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe82606b700 1 -- 172.21.15.133:0/641782094 >> v1:172.21.15.133:6789/0 conn(0x7fe8200ac6e0 legacy=0x7fe82014a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe82606b700 1 -- 172.21.15.133:0/641782094 >> v1:172.21.15.16:6789/0 conn(0x7fe8201472a0 legacy=0x7fe8201476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:34.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe82606b700 1 -- 172.21.15.133:0/641782094 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8201480e0 con 0x7fe8200b3f20 2021-01-03T13:05:34.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe82606b700 1 --2- 172.21.15.133:0/641782094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8200b3f20 0x7fe820061e90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fe82005cdc0 tx=0x7fe81c009270).ready entity=mon.1 client_cookie=4719abf8306ced37 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:34.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe825069700 1 -- 172.21.15.133:0/641782094 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe81c00bbc0 con 0x7fe8200b3f20 2021-01-03T13:05:34.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe825069700 1 -- 172.21.15.133:0/641782094 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81c00bd20 con 0x7fe8200b3f20 2021-01-03T13:05:34.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe825069700 1 -- 172.21.15.133:0/641782094 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe81c00be90 con 0x7fe8200b3f20 2021-01-03T13:05:34.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe8282cf700 1 -- 172.21.15.133:0/641782094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8200b3f20 msgr2=0x7fe820061e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.345+0000 7fe8282cf700 1 --2- 172.21.15.133:0/641782094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8200b3f20 0x7fe820061e90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fe82005cdc0 tx=0x7fe81c009270).stop 2021-01-03T13:05:34.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.349+0000 7fe8282cf700 1 -- 172.21.15.133:0/641782094 shutdown_connections 2021-01-03T13:05:34.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.349+0000 7fe8282cf700 1 --2- 172.21.15.133:0/641782094 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8200b3f20 0x7fe820061e90 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.349+0000 7fe8282cf700 1 -- 172.21.15.133:0/641782094 >> 172.21.15.133:0/641782094 conn(0x7fe82005bdf0 msgr2=0x7fe82005c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:34.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.349+0000 7fe8282cf700 1 -- 172.21.15.133:0/641782094 shutdown_connections 2021-01-03T13:05:34.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.349+0000 7fe8282cf700 1 -- 172.21.15.133:0/641782094 wait complete. 2021-01-03T13:05:34.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.349+0000 7fe8282cf700 1 Processor -- start 2021-01-03T13:05:34.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.349+0000 7fe8282cf700 1 -- start start 2021-01-03T13:05:34.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.349+0000 7fe8282cf700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8200ac6e0 0x7fe820149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.349+0000 7fe8282cf700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8200b3f20 0x7fe82009ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.349+0000 7fe8282cf700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe8201472a0 0x7fe8201416c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.349+0000 7fe8282cf700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82014a6a0 con 0x7fe8200b3f20 2021-01-03T13:05:34.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.349+0000 7fe8282cf700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8200b4370 con 0x7fe8200ac6e0 2021-01-03T13:05:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.349+0000 7fe8282cf700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe820142140 con 0x7fe8201472a0 2021-01-03T13:05:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.349+0000 7fe82606b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8200ac6e0 0x7fe820149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe82606b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8200ac6e0 0x7fe820149ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37174/0 (socket says 172.21.15.133:37174) 2021-01-03T13:05:34.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe82606b700 1 -- 172.21.15.133:0/2210662507 learned_addr learned my addr 172.21.15.133:0/2210662507 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe82686c700 1 --2- 172.21.15.133:0/2210662507 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe8201472a0 0x7fe8201416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe82586a700 1 --2- 172.21.15.133:0/2210662507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8200b3f20 0x7fe82009ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe82606b700 1 -- 172.21.15.133:0/2210662507 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe8201472a0 msgr2=0x7fe8201416c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe82606b700 1 --2- 172.21.15.133:0/2210662507 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe8201472a0 0x7fe8201416c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe82606b700 1 -- 172.21.15.133:0/2210662507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8200b3f20 msgr2=0x7fe82009ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe82606b700 1 --2- 172.21.15.133:0/2210662507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8200b3f20 0x7fe82009ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe82606b700 1 -- 172.21.15.133:0/2210662507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8200b7fa0 con 0x7fe8200ac6e0 2021-01-03T13:05:34.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe82606b700 1 --2- 172.21.15.133:0/2210662507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8200ac6e0 0x7fe820149ba0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7fe82005cdc0 tx=0x7fe81c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:34.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe80f7fe700 1 -- 172.21.15.133:0/2210662507 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe81c0107a0 con 0x7fe8200ac6e0 2021-01-03T13:05:34.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe80f7fe700 1 -- 172.21.15.133:0/2210662507 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81c010900 con 0x7fe8200ac6e0 2021-01-03T13:05:34.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe8282cf700 1 -- 172.21.15.133:0/2210662507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82014a390 con 0x7fe8200ac6e0 2021-01-03T13:05:34.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe80f7fe700 1 -- 172.21.15.133:0/2210662507 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe81c010c60 con 0x7fe8200ac6e0 2021-01-03T13:05:34.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe8282cf700 1 -- 172.21.15.133:0/2210662507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82009d380 con 0x7fe8200ac6e0 2021-01-03T13:05:34.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe8282cf700 1 -- 172.21.15.133:0/2210662507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8200b8130 con 0x7fe8200ac6e0 2021-01-03T13:05:34.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe80f7fe700 1 -- 172.21.15.133:0/2210662507 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe81c026030 con 0x7fe8200ac6e0 2021-01-03T13:05:34.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe80f7fe700 1 --2- 172.21.15.133:0/2210662507 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe8000553b0 0x7fe800057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe82586a700 1 --2- 172.21.15.133:0/2210662507 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe8000553b0 0x7fe800057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.353+0000 7fe80f7fe700 1 -- 172.21.15.133:0/2210662507 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe81c06f480 con 0x7fe8200ac6e0 2021-01-03T13:05:34.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.357+0000 7fe82586a700 1 --2- 172.21.15.133:0/2210662507 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe8000553b0 0x7fe800057870 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fe81000b000 tx=0x7fe810007160).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:34.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.361+0000 7fe80f7fe700 1 -- 172.21.15.133:0/2210662507 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe81c045670 con 0x7fe8200ac6e0 2021-01-03T13:05:34.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.501+0000 7fe8282cf700 1 -- 172.21.15.133:0/2210662507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe820062380 con 0x7fe8200ac6e0 2021-01-03T13:05:34.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.501+0000 7fe80f7fe700 1 -- 172.21.15.133:0/2210662507 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16118 (secure 0 0 0) 0x7fe820062380 con 0x7fe8200ac6e0 2021-01-03T13:05:34.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.505+0000 7fe8282cf700 1 -- 172.21.15.133:0/2210662507 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe8000553b0 msgr2=0x7fe800057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.505+0000 7fe8282cf700 1 --2- 172.21.15.133:0/2210662507 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe8000553b0 0x7fe800057870 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fe81000b000 tx=0x7fe810007160).stop 2021-01-03T13:05:34.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.505+0000 7fe8282cf700 1 -- 172.21.15.133:0/2210662507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8200ac6e0 msgr2=0x7fe820149ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.505+0000 7fe8282cf700 1 --2- 172.21.15.133:0/2210662507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8200ac6e0 0x7fe820149ba0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7fe82005cdc0 tx=0x7fe81c016000).stop 2021-01-03T13:05:34.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.505+0000 7fe8282cf700 1 -- 172.21.15.133:0/2210662507 shutdown_connections 2021-01-03T13:05:34.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.505+0000 7fe8282cf700 1 --2- 172.21.15.133:0/2210662507 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe8000553b0 0x7fe800057870 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.505+0000 7fe8282cf700 1 --2- 172.21.15.133:0/2210662507 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe8201472a0 0x7fe8201416c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.505+0000 7fe8282cf700 1 --2- 172.21.15.133:0/2210662507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8200ac6e0 0x7fe820149ba0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.505+0000 7fe8282cf700 1 --2- 172.21.15.133:0/2210662507 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8200b3f20 0x7fe82009ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.505+0000 7fe8282cf700 1 -- 172.21.15.133:0/2210662507 >> 172.21.15.133:0/2210662507 conn(0x7fe82005bdf0 msgr2=0x7fe820145410 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:34.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.505+0000 7fe8282cf700 1 -- 172.21.15.133:0/2210662507 shutdown_connections 2021-01-03T13:05:34.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.505+0000 7fe8282cf700 1 -- 172.21.15.133:0/2210662507 wait complete. 2021-01-03T13:05:34.515 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:34.515 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":100,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:05:34.203445+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:05:32.702569+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-01-03T13:05:33.206759+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:05:34.522 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:05:34.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.625+0000 7f6f6d60b700 1 Processor -- start 2021-01-03T13:05:34.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.625+0000 7f6f6d60b700 1 -- start start 2021-01-03T13:05:34.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.625+0000 7f6f6d60b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6f68066f70 0x7f6f6805fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6d60b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6f680b2750 0x7f6f68144260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6d60b700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f680afe70 con 0x7f6f68067350 2021-01-03T13:05:34.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6d60b700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f68060310 con 0x7f6f680b2750 2021-01-03T13:05:34.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6d60b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680605a0 con 0x7f6f68066f70 2021-01-03T13:05:34.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6ce0a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6f680b2750 0x7f6f68144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f5f7fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6f68067350 0x7f6f680af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:36942/0 (socket says 172.21.15.133:36942) 2021-01-03T13:05:34.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f5f7fe700 1 -- 172.21.15.133:0/1041346010 learned_addr learned my addr 172.21.15.133:0/1041346010 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:34.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f67fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6f68066f70 0x7f6f6805fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6ce0a700 1 -- 172.21.15.133:0/1041346010 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6f68066f70 msgr2=0x7f6f6805fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:34.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6ce0a700 1 --2- 172.21.15.133:0/1041346010 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6f68066f70 0x7f6f6805fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6ce0a700 1 -- 172.21.15.133:0/1041346010 >> v1:172.21.15.16:6789/0 conn(0x7f6f68067350 legacy=0x7f6f680af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f677fe700 1 -- 172.21.15.133:0/1041346010 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942996860 0 0) 0x7f6f680afe70 con 0x7f6f68067350 2021-01-03T13:05:34.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6ce0a700 1 -- 172.21.15.133:0/1041346010 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f680b0b50 con 0x7f6f680b2750 2021-01-03T13:05:34.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6ce0a700 1 --2- 172.21.15.133:0/1041346010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f680b2750 0x7f6f68144260 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f6f600032b0 tx=0x7f6f600091a0).ready entity=mon.0 client_cookie=ac00ad7810f94a4f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:34.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f677fe700 1 -- 172.21.15.133:0/1041346010 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6000b9a0 con 0x7f6f680b2750 2021-01-03T13:05:34.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f677fe700 1 -- 172.21.15.133:0/1041346010 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6000bb00 con 0x7f6f680b2750 2021-01-03T13:05:34.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f677fe700 1 -- 172.21.15.133:0/1041346010 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6000bc70 con 0x7f6f680b2750 2021-01-03T13:05:34.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6d60b700 1 -- 172.21.15.133:0/1041346010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f680b2750 msgr2=0x7f6f68144260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6d60b700 1 --2- 172.21.15.133:0/1041346010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f680b2750 0x7f6f68144260 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f6f600032b0 tx=0x7f6f600091a0).stop 2021-01-03T13:05:34.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6d60b700 1 -- 172.21.15.133:0/1041346010 shutdown_connections 2021-01-03T13:05:34.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6d60b700 1 --2- 172.21.15.133:0/1041346010 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f680b2750 0x7f6f68144260 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6d60b700 1 --2- 172.21.15.133:0/1041346010 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6f68066f70 0x7f6f6805fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6d60b700 1 -- 172.21.15.133:0/1041346010 >> 172.21.15.133:0/1041346010 conn(0x7f6f680b6110 msgr2=0x7f6f680b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:34.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6d60b700 1 -- 172.21.15.133:0/1041346010 shutdown_connections 2021-01-03T13:05:34.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.629+0000 7f6f6d60b700 1 -- 172.21.15.133:0/1041346010 wait complete. 2021-01-03T13:05:34.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6d60b700 1 Processor -- start 2021-01-03T13:05:34.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6d60b700 1 -- start start 2021-01-03T13:05:34.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6d60b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6f68066f70 0x7f6f68140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6d60b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f68067350 0x7f6f680b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6d60b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f680b2750 0x7f6f68063fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6d60b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680b5060 con 0x7f6f68067350 2021-01-03T13:05:34.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6d60b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68150410 con 0x7f6f680b2750 2021-01-03T13:05:34.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6d60b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f681506b0 con 0x7f6f68066f70 2021-01-03T13:05:34.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6ce0a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f680b2750 0x7f6f68063fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6ce0a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f680b2750 0x7f6f68063fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37190/0 (socket says 172.21.15.133:37190) 2021-01-03T13:05:34.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6ce0a700 1 -- 172.21.15.133:0/447781449 learned_addr learned my addr 172.21.15.133:0/447781449 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:34.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f67fff700 1 --2- 172.21.15.133:0/447781449 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6f68066f70 0x7f6f68140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f5f7fe700 1 --2- 172.21.15.133:0/447781449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f68067350 0x7f6f680b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6ce0a700 1 -- 172.21.15.133:0/447781449 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6f68066f70 msgr2=0x7f6f68140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6ce0a700 1 --2- 172.21.15.133:0/447781449 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6f68066f70 0x7f6f68140880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6ce0a700 1 -- 172.21.15.133:0/447781449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f68067350 msgr2=0x7f6f680b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6ce0a700 1 --2- 172.21.15.133:0/447781449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f68067350 0x7f6f680b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6ce0a700 1 -- 172.21.15.133:0/447781449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f68063b10 con 0x7f6f680b2750 2021-01-03T13:05:34.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6ce0a700 1 --2- 172.21.15.133:0/447781449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f680b2750 0x7f6f68063fb0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f6f68140da0 tx=0x7f6f60016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:34.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f65ffb700 1 -- 172.21.15.133:0/447781449 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f600205f0 con 0x7f6f680b2750 2021-01-03T13:05:34.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f65ffb700 1 -- 172.21.15.133:0/447781449 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f60020750 con 0x7f6f680b2750 2021-01-03T13:05:34.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6d60b700 1 -- 172.21.15.133:0/447781449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f680b5bf0 con 0x7f6f680b2750 2021-01-03T13:05:34.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f65ffb700 1 -- 172.21.15.133:0/447781449 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f60020ab0 con 0x7f6f680b2750 2021-01-03T13:05:34.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.633+0000 7f6f6d60b700 1 -- 172.21.15.133:0/447781449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6813ea50 con 0x7f6f680b2750 2021-01-03T13:05:34.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.637+0000 7f6f6d60b700 1 -- 172.21.15.133:0/447781449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f68063ca0 con 0x7f6f680b2750 2021-01-03T13:05:34.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.637+0000 7f6f65ffb700 1 -- 172.21.15.133:0/447781449 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6f60027030 con 0x7f6f680b2750 2021-01-03T13:05:34.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.637+0000 7f6f65ffb700 1 --2- 172.21.15.133:0/447781449 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6f4c055440 0x7f6f4c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.637+0000 7f6f65ffb700 1 -- 172.21.15.133:0/447781449 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6f6006f2d0 con 0x7f6f680b2750 2021-01-03T13:05:34.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.637+0000 7f6f67fff700 1 --2- 172.21.15.133:0/447781449 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6f4c055440 0x7f6f4c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.637+0000 7f6f67fff700 1 --2- 172.21.15.133:0/447781449 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6f4c055440 0x7f6f4c057900 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f6f5800b000 tx=0x7f6f58006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:34.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.641+0000 7f6f65ffb700 1 -- 172.21.15.133:0/447781449 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6f60045570 con 0x7f6f680b2750 2021-01-03T13:05:34.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.785+0000 7f6f6d60b700 1 -- 172.21.15.133:0/447781449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f68057300 con 0x7f6f680b2750 2021-01-03T13:05:34.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.789+0000 7f6f65ffb700 1 -- 172.21.15.133:0/447781449 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16118 (secure 0 0 0) 0x7f6f60048b90 con 0x7f6f680b2750 2021-01-03T13:05:34.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.789+0000 7f6f6d60b700 1 -- 172.21.15.133:0/447781449 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6f4c055440 msgr2=0x7f6f4c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.789+0000 7f6f6d60b700 1 --2- 172.21.15.133:0/447781449 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6f4c055440 0x7f6f4c057900 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f6f5800b000 tx=0x7f6f58006dc0).stop 2021-01-03T13:05:34.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.789+0000 7f6f6d60b700 1 -- 172.21.15.133:0/447781449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f680b2750 msgr2=0x7f6f68063fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.789+0000 7f6f6d60b700 1 --2- 172.21.15.133:0/447781449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f680b2750 0x7f6f68063fb0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f6f68140da0 tx=0x7f6f60016000).stop 2021-01-03T13:05:34.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.789+0000 7f6f6d60b700 1 -- 172.21.15.133:0/447781449 shutdown_connections 2021-01-03T13:05:34.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.789+0000 7f6f6d60b700 1 --2- 172.21.15.133:0/447781449 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6f4c055440 0x7f6f4c057900 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.789+0000 7f6f6d60b700 1 --2- 172.21.15.133:0/447781449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6f680b2750 0x7f6f68063fb0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.789+0000 7f6f6d60b700 1 --2- 172.21.15.133:0/447781449 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6f68066f70 0x7f6f68140880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.789+0000 7f6f6d60b700 1 --2- 172.21.15.133:0/447781449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6f68067350 0x7f6f680b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.789+0000 7f6f6d60b700 1 -- 172.21.15.133:0/447781449 >> 172.21.15.133:0/447781449 conn(0x7f6f680b6110 msgr2=0x7f6f6805c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:34.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.789+0000 7f6f6d60b700 1 -- 172.21.15.133:0/447781449 shutdown_connections 2021-01-03T13:05:34.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.789+0000 7f6f6d60b700 1 -- 172.21.15.133:0/447781449 wait complete. 2021-01-03T13:05:34.806 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:34.807 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":100,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:05:34.203445+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:05:32.702569+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-01-03T13:05:33.206759+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:05:34.809 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-01-03T13:05:34.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.929+0000 7fe24b59e700 1 Processor -- start 2021-01-03T13:05:34.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.929+0000 7fe24b59e700 1 -- start start 2021-01-03T13:05:34.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24b59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe24c0b7ab0 0x7fe24c146300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24b59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe24c0b2990 0x7fe24c0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24b59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe24c0b34e0 0x7fe24c140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24b59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24c0b30f0 con 0x7fe24c0b2990 2021-01-03T13:05:34.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24b59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24c1467f0 con 0x7fe24c0b7ab0 2021-01-03T13:05:34.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24b59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c061480 con 0x7fe24c0b34e0 2021-01-03T13:05:34.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24a59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe24c0b7ab0 0x7fe24c146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24ad9d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe24c0b34e0 0x7fe24c140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24a59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe24c0b7ab0 0x7fe24c146300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37194/0 (socket says 172.21.15.133:37194) 2021-01-03T13:05:34.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24a59c700 1 -- 172.21.15.133:0/3719527995 learned_addr learned my addr 172.21.15.133:0/3719527995 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:34.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe249d9b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe24c0b2990 0x7fe24c0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24ad9d700 1 -- 172.21.15.133:0/3719527995 >> v2:172.21.15.133:3300/0 conn(0x7fe24c0b7ab0 msgr2=0x7fe24c146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:34.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24ad9d700 1 --2- 172.21.15.133:0/3719527995 >> v2:172.21.15.133:3300/0 conn(0x7fe24c0b7ab0 0x7fe24c146300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24ad9d700 1 -- 172.21.15.133:0/3719527995 >> v2:172.21.15.16:3300/0 conn(0x7fe24c0b2990 msgr2=0x7fe24c0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:34.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24ad9d700 1 --2- 172.21.15.133:0/3719527995 >> v2:172.21.15.16:3300/0 conn(0x7fe24c0b2990 0x7fe24c0b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24ad9d700 1 -- 172.21.15.133:0/3719527995 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c061720 con 0x7fe24c0b34e0 2021-01-03T13:05:34.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe249d9b700 1 --2- 172.21.15.133:0/3719527995 >> v2:172.21.15.16:3300/0 conn(0x7fe24c0b2990 0x7fe24c0b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:34.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24a59c700 1 --2- 172.21.15.133:0/3719527995 >> v2:172.21.15.133:3300/0 conn(0x7fe24c0b7ab0 0x7fe24c146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:34.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24ad9d700 1 --2- 172.21.15.133:0/3719527995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe24c0b34e0 0x7fe24c140060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fe2440032b0 tx=0x7fe2440091a0).ready entity=mon.2 client_cookie=1c482b2b9af45d62 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:34.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24959a700 1 -- 172.21.15.133:0/3719527995 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe24400b940 con 0x7fe24c0b34e0 2021-01-03T13:05:34.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24959a700 1 -- 172.21.15.133:0/3719527995 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24400baa0 con 0x7fe24c0b34e0 2021-01-03T13:05:34.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24959a700 1 -- 172.21.15.133:0/3719527995 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe24400bc10 con 0x7fe24c0b34e0 2021-01-03T13:05:34.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24b59e700 1 -- 172.21.15.133:0/3719527995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe24c0b34e0 msgr2=0x7fe24c140060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24b59e700 1 --2- 172.21.15.133:0/3719527995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe24c0b34e0 0x7fe24c140060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fe2440032b0 tx=0x7fe2440091a0).stop 2021-01-03T13:05:34.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24b59e700 1 -- 172.21.15.133:0/3719527995 shutdown_connections 2021-01-03T13:05:34.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24b59e700 1 --2- 172.21.15.133:0/3719527995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe24c0b34e0 0x7fe24c140060 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24b59e700 1 --2- 172.21.15.133:0/3719527995 >> v2:172.21.15.133:3300/0 conn(0x7fe24c0b7ab0 0x7fe24c146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24b59e700 1 --2- 172.21.15.133:0/3719527995 >> v2:172.21.15.16:3300/0 conn(0x7fe24c0b2990 0x7fe24c0b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24b59e700 1 -- 172.21.15.133:0/3719527995 >> 172.21.15.133:0/3719527995 conn(0x7fe24c05c8c0 msgr2=0x7fe24c0b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:34.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24b59e700 1 -- 172.21.15.133:0/3719527995 shutdown_connections 2021-01-03T13:05:34.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.933+0000 7fe24b59e700 1 -- 172.21.15.133:0/3719527995 wait complete. 2021-01-03T13:05:34.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24b59e700 1 Processor -- start 2021-01-03T13:05:34.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24b59e700 1 -- start start 2021-01-03T13:05:34.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24b59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe24c0b2990 0x7fe24c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24b59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24c0b34e0 0x7fe24c152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe24c0b7ab0 0x7fe24c1525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24b59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c0654d0 con 0x7fe24c0b34e0 2021-01-03T13:05:34.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c151c30 con 0x7fe24c0b7ab0 2021-01-03T13:05:34.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24b59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c066340 con 0x7fe24c0b2990 2021-01-03T13:05:34.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe24c0b7ab0 0x7fe24c1525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe24c0b7ab0 0x7fe24c1525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37204/0 (socket says 172.21.15.133:37204) 2021-01-03T13:05:34.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24ad9d700 1 -- 172.21.15.133:0/1592017908 learned_addr learned my addr 172.21.15.133:0/1592017908 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:34.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24a59c700 1 --2- 172.21.15.133:0/1592017908 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe24c0b2990 0x7fe24c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe249d9b700 1 --2- 172.21.15.133:0/1592017908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24c0b34e0 0x7fe24c152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24ad9d700 1 -- 172.21.15.133:0/1592017908 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe24c0b2990 msgr2=0x7fe24c0672e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24ad9d700 1 --2- 172.21.15.133:0/1592017908 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe24c0b2990 0x7fe24c0672e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24ad9d700 1 -- 172.21.15.133:0/1592017908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24c0b34e0 msgr2=0x7fe24c152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:34.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24ad9d700 1 --2- 172.21.15.133:0/1592017908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24c0b34e0 0x7fe24c152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:34.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24ad9d700 1 -- 172.21.15.133:0/1592017908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c0665e0 con 0x7fe24c0b7ab0 2021-01-03T13:05:34.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24ad9d700 1 --2- 172.21.15.133:0/1592017908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe24c0b7ab0 0x7fe24c1525f0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7fe24c0aef80 tx=0x7fe244016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:34.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe23b7fe700 1 -- 172.21.15.133:0/1592017908 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe244011dc0 con 0x7fe24c0b7ab0 2021-01-03T13:05:34.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe23b7fe700 1 -- 172.21.15.133:0/1592017908 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24401f3f0 con 0x7fe24c0b7ab0 2021-01-03T13:05:34.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24b59e700 1 -- 172.21.15.133:0/1592017908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24c066880 con 0x7fe24c0b7ab0 2021-01-03T13:05:34.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe23b7fe700 1 -- 172.21.15.133:0/1592017908 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe24401f750 con 0x7fe24c0b7ab0 2021-01-03T13:05:34.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.937+0000 7fe24b59e700 1 -- 172.21.15.133:0/1592017908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24c0ae620 con 0x7fe24c0b7ab0 2021-01-03T13:05:34.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.941+0000 7fe24b59e700 1 -- 172.21.15.133:0/1592017908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24c057300 con 0x7fe24c0b7ab0 2021-01-03T13:05:34.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.941+0000 7fe23b7fe700 1 -- 172.21.15.133:0/1592017908 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe24400f070 con 0x7fe24c0b7ab0 2021-01-03T13:05:34.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.941+0000 7fe23b7fe700 1 --2- 172.21.15.133:0/1592017908 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe228055330 0x7fe2280577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:34.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.941+0000 7fe23b7fe700 1 -- 172.21.15.133:0/1592017908 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe24406e540 con 0x7fe24c0b7ab0 2021-01-03T13:05:34.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.941+0000 7fe24a59c700 1 --2- 172.21.15.133:0/1592017908 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe228055330 0x7fe2280577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:34.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.941+0000 7fe24a59c700 1 --2- 172.21.15.133:0/1592017908 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe228055330 0x7fe2280577f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fe23c008000 tx=0x7fe23c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:34.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:34.949+0000 7fe23b7fe700 1 -- 172.21.15.133:0/1592017908 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe244044840 con 0x7fe24c0b7ab0 2021-01-03T13:05:35.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.129+0000 7fe24b59e700 1 -- 172.21.15.133:0/1592017908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe24c140a30 con 0x7fe24c0b7ab0 2021-01-03T13:05:35.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.209+0000 7fe23b7fe700 1 -- 172.21.15.133:0/1592017908 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe2440240b0 con 0x7fe24c0b7ab0 2021-01-03T13:05:35.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.213+0000 7fe24b59e700 1 -- 172.21.15.133:0/1592017908 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe228055330 msgr2=0x7fe2280577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.213+0000 7fe24b59e700 1 --2- 172.21.15.133:0/1592017908 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe228055330 0x7fe2280577f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fe23c008000 tx=0x7fe23c008040).stop 2021-01-03T13:05:35.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.213+0000 7fe24b59e700 1 -- 172.21.15.133:0/1592017908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe24c0b7ab0 msgr2=0x7fe24c1525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.213+0000 7fe24b59e700 1 --2- 172.21.15.133:0/1592017908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe24c0b7ab0 0x7fe24c1525f0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7fe24c0aef80 tx=0x7fe244016000).stop 2021-01-03T13:05:35.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.213+0000 7fe24b59e700 1 -- 172.21.15.133:0/1592017908 shutdown_connections 2021-01-03T13:05:35.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.213+0000 7fe24b59e700 1 --2- 172.21.15.133:0/1592017908 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe228055330 0x7fe2280577f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.213+0000 7fe24b59e700 1 --2- 172.21.15.133:0/1592017908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe24c0b7ab0 0x7fe24c1525f0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.213+0000 7fe24b59e700 1 --2- 172.21.15.133:0/1592017908 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe24c0b2990 0x7fe24c0672e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.213+0000 7fe24b59e700 1 --2- 172.21.15.133:0/1592017908 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe24c0b34e0 0x7fe24c152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.213+0000 7fe24b59e700 1 -- 172.21.15.133:0/1592017908 >> 172.21.15.133:0/1592017908 conn(0x7fe24c05c8c0 msgr2=0x7fe24c062850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:35.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.213+0000 7fe24b59e700 1 -- 172.21.15.133:0/1592017908 shutdown_connections 2021-01-03T13:05:35.226 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.213+0000 7fe24b59e700 1 -- 172.21.15.133:0/1592017908 wait complete. 2021-01-03T13:05:35.235 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:05:35.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.337+0000 7fe52359e700 1 Processor -- start 2021-01-03T13:05:35.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.337+0000 7fe52359e700 1 -- start start 2021-01-03T13:05:35.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.337+0000 7fe52359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe52405f920 0x7fe5240b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.337+0000 7fe52359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe524066f30 0x7fe5240b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.337+0000 7fe52359e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52405fd00 con 0x7fe5240b1590 2021-01-03T13:05:35.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.337+0000 7fe52359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5240ae700 con 0x7fe52405f920 2021-01-03T13:05:35.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.337+0000 7fe52359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5240accd0 con 0x7fe524066f30 2021-01-03T13:05:35.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.337+0000 7fe52259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe52405f920 0x7fe5240b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.337+0000 7fe52259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe52405f920 0x7fe5240b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37210/0 (socket says 172.21.15.133:37210) 2021-01-03T13:05:35.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.337+0000 7fe52259c700 1 -- 172.21.15.133:0/4270592185 learned_addr learned my addr 172.21.15.133:0/4270592185 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:35.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.337+0000 7fe521d9b700 1 --2- 172.21.15.133:0/4270592185 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe524066f30 0x7fe5240b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.337+0000 7fe52259c700 1 -- 172.21.15.133:0/4270592185 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe524066f30 msgr2=0x7fe5240b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:35.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.337+0000 7fe52259c700 1 --2- 172.21.15.133:0/4270592185 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe524066f30 0x7fe5240b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.337+0000 7fe52259c700 1 -- 172.21.15.133:0/4270592185 >> v1:172.21.15.16:6789/0 conn(0x7fe5240b1590 legacy=0x7fe5240613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.337+0000 7fe52259c700 1 -- 172.21.15.133:0/4270592185 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5240acf70 con 0x7fe52405f920 2021-01-03T13:05:35.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52259c700 1 --2- 172.21.15.133:0/4270592185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe52405f920 0x7fe5240b0ab0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fe518002f30 tx=0x7fe518006e80).ready entity=mon.1 client_cookie=db56d40dd59fe786 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:35.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52159a700 1 -- 172.21.15.133:0/4270592185 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5180097f0 con 0x7fe52405f920 2021-01-03T13:05:35.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52159a700 1 -- 172.21.15.133:0/4270592185 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe518009950 con 0x7fe52405f920 2021-01-03T13:05:35.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52359e700 1 -- 172.21.15.133:0/4270592185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe52405f920 msgr2=0x7fe5240b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52159a700 1 -- 172.21.15.133:0/4270592185 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe518009cb0 con 0x7fe52405f920 2021-01-03T13:05:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52359e700 1 --2- 172.21.15.133:0/4270592185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe52405f920 0x7fe5240b0ab0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fe518002f30 tx=0x7fe518006e80).stop 2021-01-03T13:05:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52359e700 1 -- 172.21.15.133:0/4270592185 shutdown_connections 2021-01-03T13:05:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52359e700 1 --2- 172.21.15.133:0/4270592185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe52405f920 0x7fe5240b0ab0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52359e700 1 --2- 172.21.15.133:0/4270592185 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe524066f30 0x7fe5240b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52359e700 1 -- 172.21.15.133:0/4270592185 >> 172.21.15.133:0/4270592185 conn(0x7fe5240b6110 msgr2=0x7fe5240b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52359e700 1 -- 172.21.15.133:0/4270592185 shutdown_connections 2021-01-03T13:05:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52359e700 1 -- 172.21.15.133:0/4270592185 wait complete. 2021-01-03T13:05:35.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52359e700 1 Processor -- start 2021-01-03T13:05:35.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52359e700 1 -- start start 2021-01-03T13:05:35.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe52405f920 0x7fe524142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe524066f30 0x7fe524150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5240b1590 0x7fe524150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52359e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe524146c20 con 0x7fe524066f30 2021-01-03T13:05:35.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe524145a60 con 0x7fe52405f920 2021-01-03T13:05:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe524145c90 con 0x7fe5240b1590 2021-01-03T13:05:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe52405f920 0x7fe524142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe52405f920 0x7fe524142c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37214/0 (socket says 172.21.15.133:37214) 2021-01-03T13:05:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe52259c700 1 -- 172.21.15.133:0/3433520128 learned_addr learned my addr 172.21.15.133:0/3433520128 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:35.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe522d9d700 1 --2- 172.21.15.133:0/3433520128 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5240b1590 0x7fe524150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.341+0000 7fe521d9b700 1 --2- 172.21.15.133:0/3433520128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe524066f30 0x7fe524150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.345+0000 7fe52259c700 1 -- 172.21.15.133:0/3433520128 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5240b1590 msgr2=0x7fe524150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.345+0000 7fe52259c700 1 --2- 172.21.15.133:0/3433520128 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5240b1590 0x7fe524150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.345+0000 7fe52259c700 1 -- 172.21.15.133:0/3433520128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe524066f30 msgr2=0x7fe524150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.345+0000 7fe52259c700 1 --2- 172.21.15.133:0/3433520128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe524066f30 0x7fe524150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.345+0000 7fe52259c700 1 -- 172.21.15.133:0/3433520128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe524145f30 con 0x7fe52405f920 2021-01-03T13:05:35.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.345+0000 7fe52259c700 1 --2- 172.21.15.133:0/3433520128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe52405f920 0x7fe524142c90 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fe524146d60 tx=0x7fe518015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:35.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.345+0000 7fe5137fe700 1 -- 172.21.15.133:0/3433520128 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe518011b00 con 0x7fe52405f920 2021-01-03T13:05:35.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.345+0000 7fe5137fe700 1 -- 172.21.15.133:0/3433520128 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe518011c60 con 0x7fe52405f920 2021-01-03T13:05:35.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.345+0000 7fe5137fe700 1 -- 172.21.15.133:0/3433520128 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe51801e460 con 0x7fe52405f920 2021-01-03T13:05:35.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.345+0000 7fe52359e700 1 -- 172.21.15.133:0/3433520128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52414fd80 con 0x7fe52405f920 2021-01-03T13:05:35.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.345+0000 7fe52359e700 1 -- 172.21.15.133:0/3433520128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5241532f0 con 0x7fe52405f920 2021-01-03T13:05:35.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.345+0000 7fe52359e700 1 -- 172.21.15.133:0/3433520128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe524057300 con 0x7fe52405f920 2021-01-03T13:05:35.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.345+0000 7fe5137fe700 1 -- 172.21.15.133:0/3433520128 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe518025030 con 0x7fe52405f920 2021-01-03T13:05:35.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.345+0000 7fe5137fe700 1 --2- 172.21.15.133:0/3433520128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5000554e0 0x7fe5000579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.345+0000 7fe5137fe700 1 -- 172.21.15.133:0/3433520128 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe51806f1a0 con 0x7fe52405f920 2021-01-03T13:05:35.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.345+0000 7fe521d9b700 1 --2- 172.21.15.133:0/3433520128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5000554e0 0x7fe5000579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.349+0000 7fe521d9b700 1 --2- 172.21.15.133:0/3433520128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5000554e0 0x7fe5000579a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7fe51400b000 tx=0x7fe5140091a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:35.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.353+0000 7fe5137fe700 1 -- 172.21.15.133:0/3433520128 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe5180454a0 con 0x7fe52405f920 2021-01-03T13:05:35.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.541+0000 7fe52359e700 1 -- 172.21.15.133:0/3433520128 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe524061020 con 0x7fe52405f920 2021-01-03T13:05:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.541+0000 7fe5137fe700 1 -- 172.21.15.133:0/3433520128 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2499 (secure 0 0 0) 0x7fe518023090 con 0x7fe52405f920 2021-01-03T13:05:35.547 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:35.547 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":43,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6014,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1098287672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1098287672},{"type":"v1","addr":"172.21.15.133:6837","nonce":1098287672}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1817607475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1817607475},{"type":"v1","addr":"172.21.15.16:6833","nonce":1817607475}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:34.203844+0000","modified":"2021-01-03T13:05:35.206833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6817},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6817":{"gid":6817,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/1339474843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1339474843},{"type":"v1","addr":"172.21.15.133:6835","nonce":1339474843}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-01-03T13:05:35.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.545+0000 7fe52359e700 1 -- 172.21.15.133:0/3433520128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5000554e0 msgr2=0x7fe5000579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.545+0000 7fe52359e700 1 --2- 172.21.15.133:0/3433520128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5000554e0 0x7fe5000579a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7fe51400b000 tx=0x7fe5140091a0).stop 2021-01-03T13:05:35.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.545+0000 7fe52359e700 1 -- 172.21.15.133:0/3433520128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe52405f920 msgr2=0x7fe524142c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.545+0000 7fe52359e700 1 --2- 172.21.15.133:0/3433520128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe52405f920 0x7fe524142c90 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7fe524146d60 tx=0x7fe518015000).stop 2021-01-03T13:05:35.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.545+0000 7fe52359e700 1 -- 172.21.15.133:0/3433520128 shutdown_connections 2021-01-03T13:05:35.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.545+0000 7fe52359e700 1 --2- 172.21.15.133:0/3433520128 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5000554e0 0x7fe5000579a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.545+0000 7fe52359e700 1 --2- 172.21.15.133:0/3433520128 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5240b1590 0x7fe524150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.545+0000 7fe52359e700 1 --2- 172.21.15.133:0/3433520128 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe52405f920 0x7fe524142c90 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.545+0000 7fe52359e700 1 --2- 172.21.15.133:0/3433520128 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe524066f30 0x7fe524150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.545+0000 7fe52359e700 1 -- 172.21.15.133:0/3433520128 >> 172.21.15.133:0/3433520128 conn(0x7fe5240b6110 msgr2=0x7fe5240613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:35.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.545+0000 7fe52359e700 1 -- 172.21.15.133:0/3433520128 shutdown_connections 2021-01-03T13:05:35.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.545+0000 7fe52359e700 1 -- 172.21.15.133:0/3433520128 wait complete. 2021-01-03T13:05:35.557 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 43 2021-01-03T13:05:35.565 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:05:35.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.669+0000 7f6395fc9700 1 Processor -- start 2021-01-03T13:05:35.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.669+0000 7f6395fc9700 1 -- start start 2021-01-03T13:05:35.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.669+0000 7f6395fc9700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f63900b0c90 0x7f63900b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.669+0000 7f6395fc9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63900b5c00 0x7f6390143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.669+0000 7f6395fc9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6390060da0 con 0x7f63900b52c0 2021-01-03T13:05:35.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.669+0000 7f6395fc9700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6390067a90 con 0x7f63900b0c90 2021-01-03T13:05:35.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.669+0000 7f6395fc9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63900b0ad0 con 0x7f63900b5c00 2021-01-03T13:05:35.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.669+0000 7f63957c8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63900b5c00 0x7f6390143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.669+0000 7f63957c8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63900b5c00 0x7f6390143eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37226/0 (socket says 172.21.15.133:37226) 2021-01-03T13:05:35.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.669+0000 7f63957c8700 1 -- 172.21.15.133:0/1255228035 learned_addr learned my addr 172.21.15.133:0/1255228035 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:35.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.669+0000 7f6394fc7700 1 --1- 172.21.15.133:0/1255228035 >> v1:172.21.15.133:6789/0 conn(0x7f63900b52c0 0x7f6390098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58254/0 (socket says 172.21.15.133:58254) 2021-01-03T13:05:35.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.669+0000 7f638ffff700 1 --2- 172.21.15.133:0/1255228035 >> v2:172.21.15.16:3300/0 conn(0x7f63900b0c90 0x7f63900b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.669+0000 7f63957c8700 1 -- 172.21.15.133:0/1255228035 >> v2:172.21.15.16:3300/0 conn(0x7f63900b0c90 msgr2=0x7f63900b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:35.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.669+0000 7f63957c8700 1 --2- 172.21.15.133:0/1255228035 >> v2:172.21.15.16:3300/0 conn(0x7f63900b0c90 0x7f63900b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.669+0000 7f63957c8700 1 -- 172.21.15.133:0/1255228035 >> v1:172.21.15.133:6789/0 conn(0x7f63900b52c0 legacy=0x7f6390098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.669+0000 7f63957c8700 1 -- 172.21.15.133:0/1255228035 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63900b56a0 con 0x7f63900b5c00 2021-01-03T13:05:35.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.669+0000 7f63957c8700 1 --2- 172.21.15.133:0/1255228035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b5c00 0x7f6390143eb0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f6388002f30 tx=0x7f6388006e80).ready entity=mon.1 client_cookie=ec6e4974477b5c2f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:35.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f638f7fe700 1 -- 172.21.15.133:0/1255228035 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63880097f0 con 0x7f63900b5c00 2021-01-03T13:05:35.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f638f7fe700 1 -- 172.21.15.133:0/1255228035 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6388009950 con 0x7f63900b5c00 2021-01-03T13:05:35.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f638f7fe700 1 -- 172.21.15.133:0/1255228035 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6388009cb0 con 0x7f63900b5c00 2021-01-03T13:05:35.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f6395fc9700 1 -- 172.21.15.133:0/1255228035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b5c00 msgr2=0x7f6390143eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f6395fc9700 1 --2- 172.21.15.133:0/1255228035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b5c00 0x7f6390143eb0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f6388002f30 tx=0x7f6388006e80).stop 2021-01-03T13:05:35.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f6395fc9700 1 -- 172.21.15.133:0/1255228035 shutdown_connections 2021-01-03T13:05:35.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f6395fc9700 1 --2- 172.21.15.133:0/1255228035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b5c00 0x7f6390143eb0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f6395fc9700 1 --2- 172.21.15.133:0/1255228035 >> v2:172.21.15.16:3300/0 conn(0x7f63900b0c90 0x7f63900b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f6395fc9700 1 -- 172.21.15.133:0/1255228035 >> 172.21.15.133:0/1255228035 conn(0x7f639005bdf0 msgr2=0x7f639005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:35.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f6395fc9700 1 -- 172.21.15.133:0/1255228035 shutdown_connections 2021-01-03T13:05:35.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f6395fc9700 1 -- 172.21.15.133:0/1255228035 wait complete. 2021-01-03T13:05:35.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f6395fc9700 1 Processor -- start 2021-01-03T13:05:35.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f6395fc9700 1 -- start start 2021-01-03T13:05:35.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f6395fc9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63900b0c90 0x7f63900adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f6395fc9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63900b52c0 0x7f63900acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f6395fc9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b5c00 0x7f6390066f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f6395fc9700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6390066670 con 0x7f63900b0c90 2021-01-03T13:05:35.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f6395fc9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639015a0f0 con 0x7f63900b5c00 2021-01-03T13:05:35.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f6395fc9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6390064830 con 0x7f63900b52c0 2021-01-03T13:05:35.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f63957c8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b5c00 0x7f6390066f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f63957c8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b5c00 0x7f6390066f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37232/0 (socket says 172.21.15.133:37232) 2021-01-03T13:05:35.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.673+0000 7f63957c8700 1 -- 172.21.15.133:0/2702308007 learned_addr learned my addr 172.21.15.133:0/2702308007 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:35.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.677+0000 7f6394fc7700 1 --2- 172.21.15.133:0/2702308007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63900b0c90 0x7f63900adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.677+0000 7f638ffff700 1 --2- 172.21.15.133:0/2702308007 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63900b52c0 0x7f63900acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.677+0000 7f63957c8700 1 -- 172.21.15.133:0/2702308007 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63900b52c0 msgr2=0x7f63900acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.677+0000 7f63957c8700 1 --2- 172.21.15.133:0/2702308007 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63900b52c0 0x7f63900acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.677+0000 7f63957c8700 1 -- 172.21.15.133:0/2702308007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63900b0c90 msgr2=0x7f63900adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.677+0000 7f63957c8700 1 --2- 172.21.15.133:0/2702308007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63900b0c90 0x7f63900adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.677+0000 7f63957c8700 1 -- 172.21.15.133:0/2702308007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639015a320 con 0x7f63900b5c00 2021-01-03T13:05:35.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.677+0000 7f638ffff700 1 --2- 172.21.15.133:0/2702308007 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63900b52c0 0x7f63900acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:35.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.677+0000 7f63957c8700 1 --2- 172.21.15.133:0/2702308007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b5c00 0x7f6390066f00 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f63900aed80 tx=0x7f6388015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:35.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.677+0000 7f638dffb700 1 -- 172.21.15.133:0/2702308007 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6388009e60 con 0x7f63900b5c00 2021-01-03T13:05:35.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.677+0000 7f638dffb700 1 -- 172.21.15.133:0/2702308007 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6388009c50 con 0x7f63900b5c00 2021-01-03T13:05:35.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.677+0000 7f638dffb700 1 -- 172.21.15.133:0/2702308007 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f638801e650 con 0x7f63900b5c00 2021-01-03T13:05:35.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.677+0000 7f6395fc9700 1 -- 172.21.15.133:0/2702308007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6390063540 con 0x7f63900b5c00 2021-01-03T13:05:35.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.677+0000 7f6395fc9700 1 -- 172.21.15.133:0/2702308007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63900af680 con 0x7f63900b5c00 2021-01-03T13:05:35.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.677+0000 7f6395fc9700 1 -- 172.21.15.133:0/2702308007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6390064670 con 0x7f63900b5c00 2021-01-03T13:05:35.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.677+0000 7f638dffb700 1 -- 172.21.15.133:0/2702308007 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6388025030 con 0x7f63900b5c00 2021-01-03T13:05:35.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.677+0000 7f638dffb700 1 --2- 172.21.15.133:0/2702308007 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63680554e0 0x7f63680579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.681+0000 7f6394fc7700 1 --2- 172.21.15.133:0/2702308007 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63680554e0 0x7f63680579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.681+0000 7f638dffb700 1 -- 172.21.15.133:0/2702308007 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f638806f6f0 con 0x7f63900b5c00 2021-01-03T13:05:35.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.681+0000 7f6394fc7700 1 --2- 172.21.15.133:0/2702308007 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63680554e0 0x7f63680579a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f638000d000 tx=0x7f6380007b10).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:35.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.685+0000 7f638dffb700 1 -- 172.21.15.133:0/2702308007 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f63880458e0 con 0x7f63900b5c00 2021-01-03T13:05:35.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.825+0000 7f6395fc9700 1 -- 172.21.15.133:0/2702308007 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f639015a4b0 con 0x7f63900b5c00 2021-01-03T13:05:35.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.825+0000 7f638dffb700 1 -- 172.21.15.133:0/2702308007 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16106 (secure 0 0 0) 0x7f6388023020 con 0x7f63900b5c00 2021-01-03T13:05:35.832 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:35.833 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":101,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:05:35.207493+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:05:32.702569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-01-03T13:05:33.206759+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:05:35.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.829+0000 7f6395fc9700 1 -- 172.21.15.133:0/2702308007 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63680554e0 msgr2=0x7f63680579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.829+0000 7f6395fc9700 1 --2- 172.21.15.133:0/2702308007 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63680554e0 0x7f63680579a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f638000d000 tx=0x7f6380007b10).stop 2021-01-03T13:05:35.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.829+0000 7f6395fc9700 1 -- 172.21.15.133:0/2702308007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b5c00 msgr2=0x7f6390066f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.829+0000 7f6395fc9700 1 --2- 172.21.15.133:0/2702308007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b5c00 0x7f6390066f00 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f63900aed80 tx=0x7f6388015000).stop 2021-01-03T13:05:35.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.829+0000 7f6395fc9700 1 -- 172.21.15.133:0/2702308007 shutdown_connections 2021-01-03T13:05:35.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.829+0000 7f6395fc9700 1 --2- 172.21.15.133:0/2702308007 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63680554e0 0x7f63680579a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.829+0000 7f6395fc9700 1 --2- 172.21.15.133:0/2702308007 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63900b0c90 0x7f63900adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.829+0000 7f6395fc9700 1 --2- 172.21.15.133:0/2702308007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63900b5c00 0x7f6390066f00 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.829+0000 7f6395fc9700 1 --2- 172.21.15.133:0/2702308007 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63900b52c0 0x7f63900acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.829+0000 7f6395fc9700 1 -- 172.21.15.133:0/2702308007 >> 172.21.15.133:0/2702308007 conn(0x7f639005bdf0 msgr2=0x7f639005f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:35.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.829+0000 7f6395fc9700 1 -- 172.21.15.133:0/2702308007 shutdown_connections 2021-01-03T13:05:35.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.829+0000 7f6395fc9700 1 -- 172.21.15.133:0/2702308007 wait complete. 2021-01-03T13:05:35.848 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:05:35.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f16a1004700 1 Processor -- start 2021-01-03T13:05:35.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f16a1004700 1 -- start start 2021-01-03T13:05:35.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f16a1004700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f169c062450 0x7f169c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f16a1004700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f169c0b33b0 0x7f169c14f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f16a1004700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c0adff0 con 0x7f169c0adc10 2021-01-03T13:05:35.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f16a1004700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c0b1930 con 0x7f169c0b33b0 2021-01-03T13:05:35.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f16a1004700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c05fb80 con 0x7f169c062450 2021-01-03T13:05:35.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f16a2266700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f169c0b33b0 0x7f169c14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f16a2266700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f169c0b33b0 0x7f169c14f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37240/0 (socket says 172.21.15.133:37240) 2021-01-03T13:05:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f16a2266700 1 -- 172.21.15.133:0/1686167683 learned_addr learned my addr 172.21.15.133:0/1686167683 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f169bfff700 1 --2- 172.21.15.133:0/1686167683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f169c062450 0x7f169c067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f16a2266700 1 -- 172.21.15.133:0/1686167683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f169c062450 msgr2=0x7f169c067cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f16a2266700 1 --2- 172.21.15.133:0/1686167683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f169c062450 0x7f169c067cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f169b7fe700 1 -- 172.21.15.133:0/1686167683 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282443312 0 0) 0x7f169c0adff0 con 0x7f169c0adc10 2021-01-03T13:05:35.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f16a2266700 1 -- 172.21.15.133:0/1686167683 >> v1:172.21.15.16:6789/0 conn(0x7f169c0adc10 legacy=0x7f169c0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f16a2266700 1 -- 172.21.15.133:0/1686167683 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c05fed0 con 0x7f169c0b33b0 2021-01-03T13:05:35.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f16a2266700 1 --2- 172.21.15.133:0/1686167683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f169c0b33b0 0x7f169c14f870 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f16940032b0 tx=0x7f1694009270).ready entity=mon.1 client_cookie=dafc18544d55b70a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:35.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f169b7fe700 1 -- 172.21.15.133:0/1686167683 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1694009e60 con 0x7f169c0b33b0 2021-01-03T13:05:35.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f169b7fe700 1 -- 172.21.15.133:0/1686167683 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169400bc00 con 0x7f169c0b33b0 2021-01-03T13:05:35.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f169b7fe700 1 -- 172.21.15.133:0/1686167683 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f169400bd70 con 0x7f169c0b33b0 2021-01-03T13:05:35.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f16a1004700 1 -- 172.21.15.133:0/1686167683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f169c0b33b0 msgr2=0x7f169c14f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.961+0000 7f16a1004700 1 --2- 172.21.15.133:0/1686167683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f169c0b33b0 0x7f169c14f870 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f16940032b0 tx=0x7f1694009270).stop 2021-01-03T13:05:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.965+0000 7f16a1004700 1 -- 172.21.15.133:0/1686167683 shutdown_connections 2021-01-03T13:05:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.965+0000 7f16a1004700 1 --2- 172.21.15.133:0/1686167683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f169c0b33b0 0x7f169c14f870 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.965+0000 7f16a1004700 1 --2- 172.21.15.133:0/1686167683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f169c062450 0x7f169c067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.965+0000 7f16a1004700 1 -- 172.21.15.133:0/1686167683 >> 172.21.15.133:0/1686167683 conn(0x7f169c060d10 msgr2=0x7f169c061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.965+0000 7f16a1004700 1 -- 172.21.15.133:0/1686167683 shutdown_connections 2021-01-03T13:05:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.965+0000 7f16a1004700 1 -- 172.21.15.133:0/1686167683 wait complete. 2021-01-03T13:05:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.965+0000 7f16a1004700 1 Processor -- start 2021-01-03T13:05:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.965+0000 7f16a1004700 1 -- start start 2021-01-03T13:05:35.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a1004700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f169c062450 0x7f169c0b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a1004700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f169c0adc10 0x7f169c12b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a1004700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f169c0b33b0 0x7f169c153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a1004700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c12bf50 con 0x7f169c0adc10 2021-01-03T13:05:35.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a1004700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c12ade0 con 0x7f169c0b33b0 2021-01-03T13:05:35.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a1004700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c12dac0 con 0x7f169c062450 2021-01-03T13:05:35.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a2266700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f169c0b33b0 0x7f169c153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a2266700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f169c0b33b0 0x7f169c153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37246/0 (socket says 172.21.15.133:37246) 2021-01-03T13:05:35.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a2266700 1 -- 172.21.15.133:0/1738588034 learned_addr learned my addr 172.21.15.133:0/1738588034 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:35.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a0803700 1 --2- 172.21.15.133:0/1738588034 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f169c062450 0x7f169c0b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f169bfff700 1 --2- 172.21.15.133:0/1738588034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f169c0adc10 0x7f169c12b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a2266700 1 -- 172.21.15.133:0/1738588034 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f169c062450 msgr2=0x7f169c0b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a2266700 1 --2- 172.21.15.133:0/1738588034 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f169c062450 0x7f169c0b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a2266700 1 -- 172.21.15.133:0/1738588034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f169c0adc10 msgr2=0x7f169c12b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:35.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a2266700 1 --2- 172.21.15.133:0/1738588034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f169c0adc10 0x7f169c12b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:35.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a2266700 1 -- 172.21.15.133:0/1738588034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c12c170 con 0x7f169c0b33b0 2021-01-03T13:05:35.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a2266700 1 --2- 172.21.15.133:0/1738588034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f169c0b33b0 0x7f169c153200 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f16940032b0 tx=0x7f1694016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:35.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16997fa700 1 -- 172.21.15.133:0/1738588034 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f169401f5e0 con 0x7f169c0b33b0 2021-01-03T13:05:35.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16997fa700 1 -- 172.21.15.133:0/1738588034 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169401f740 con 0x7f169c0b33b0 2021-01-03T13:05:35.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16997fa700 1 -- 172.21.15.133:0/1738588034 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f169401faa0 con 0x7f169c0b33b0 2021-01-03T13:05:35.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a1004700 1 -- 172.21.15.133:0/1738588034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c12b010 con 0x7f169c0b33b0 2021-01-03T13:05:35.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a1004700 1 -- 172.21.15.133:0/1738588034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c12c490 con 0x7f169c0b33b0 2021-01-03T13:05:35.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.969+0000 7f16a1004700 1 -- 172.21.15.133:0/1738588034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169c12b1a0 con 0x7f169c0b33b0 2021-01-03T13:05:35.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.973+0000 7f16997fa700 1 -- 172.21.15.133:0/1738588034 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1694026030 con 0x7f169c0b33b0 2021-01-03T13:05:35.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.973+0000 7f16997fa700 1 --2- 172.21.15.133:0/1738588034 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f167c055320 0x7f167c0577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:35.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.973+0000 7f16997fa700 1 -- 172.21.15.133:0/1738588034 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f169406f200 con 0x7f169c0b33b0 2021-01-03T13:05:35.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.973+0000 7f16a0803700 1 --2- 172.21.15.133:0/1738588034 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f167c055320 0x7f167c0577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:35.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.973+0000 7f16a0803700 1 --2- 172.21.15.133:0/1738588034 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f167c055320 0x7f167c0577e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f168c00d000 tx=0x7f168c0079d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:35.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:35.981+0000 7f16997fa700 1 -- 172.21.15.133:0/1738588034 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1694045500 con 0x7f169c0b33b0 2021-01-03T13:05:36.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.169+0000 7f16a1004700 1 -- 172.21.15.133:0/1738588034 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f169c057300 con 0x7f169c0b33b0 2021-01-03T13:05:36.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.177+0000 7f16997fa700 1 -- 172.21.15.133:0/1738588034 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v23) v1 ==== 184+0+0 (secure 0 0 0) 0x7f16940240e0 con 0x7f169c0b33b0 2021-01-03T13:05:36.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.181+0000 7f16a1004700 1 -- 172.21.15.133:0/1738588034 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f167c055320 msgr2=0x7f167c0577e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:36.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.181+0000 7f16a1004700 1 --2- 172.21.15.133:0/1738588034 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f167c055320 0x7f167c0577e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f168c00d000 tx=0x7f168c0079d0).stop 2021-01-03T13:05:36.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.181+0000 7f16a1004700 1 -- 172.21.15.133:0/1738588034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f169c0b33b0 msgr2=0x7f169c153200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:36.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.181+0000 7f16a1004700 1 --2- 172.21.15.133:0/1738588034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f169c0b33b0 0x7f169c153200 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f16940032b0 tx=0x7f1694016000).stop 2021-01-03T13:05:36.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.181+0000 7f16a1004700 1 -- 172.21.15.133:0/1738588034 shutdown_connections 2021-01-03T13:05:36.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.181+0000 7f16a1004700 1 --2- 172.21.15.133:0/1738588034 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f167c055320 0x7f167c0577e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.181+0000 7f16a1004700 1 --2- 172.21.15.133:0/1738588034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f169c0b33b0 0x7f169c153200 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.181+0000 7f16a1004700 1 --2- 172.21.15.133:0/1738588034 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f169c062450 0x7f169c0b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.181+0000 7f16a1004700 1 --2- 172.21.15.133:0/1738588034 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f169c0adc10 0x7f169c12b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.181+0000 7f16a1004700 1 -- 172.21.15.133:0/1738588034 >> 172.21.15.133:0/1738588034 conn(0x7f169c060d10 msgr2=0x7f169c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:36.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.181+0000 7f16a1004700 1 -- 172.21.15.133:0/1738588034 shutdown_connections 2021-01-03T13:05:36.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.181+0000 7f16a1004700 1 -- 172.21.15.133:0/1738588034 wait complete. 2021-01-03T13:05:36.190 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2021-01-03T13:05:36.212 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:05:36.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f96a61700 1 Processor -- start 2021-01-03T13:05:36.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f96a61700 1 -- start start 2021-01-03T13:05:36.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f96a61700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4f900b5120 0x7f4f900ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:36.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f96a61700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4f90060b00 0x7f4f900abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:36.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f96a61700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9009a380 con 0x7f4f900af9f0 2021-01-03T13:05:36.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f96a61700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f90062340 con 0x7f4f900b5120 2021-01-03T13:05:36.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f96a61700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f900ac2c0 con 0x7f4f90060b00 2021-01-03T13:05:36.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f8ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4f90060b00 0x7f4f900abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:36.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f8ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4f90060b00 0x7f4f900abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37252/0 (socket says 172.21.15.133:37252) 2021-01-03T13:05:36.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f8ffff700 1 -- 172.21.15.133:0/3244484177 learned_addr learned my addr 172.21.15.133:0/3244484177 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:36.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f94ffe700 1 --2- 172.21.15.133:0/3244484177 >> v2:172.21.15.16:3300/0 conn(0x7f4f900b5120 0x7f4f900ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:36.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f8ffff700 1 -- 172.21.15.133:0/3244484177 >> v2:172.21.15.16:3300/0 conn(0x7f4f900b5120 msgr2=0x7f4f900ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:36.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f8ffff700 1 --2- 172.21.15.133:0/3244484177 >> v2:172.21.15.16:3300/0 conn(0x7f4f900b5120 0x7f4f900ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f8ffff700 1 -- 172.21.15.133:0/3244484177 >> v1:172.21.15.16:6789/0 conn(0x7f4f900af9f0 legacy=0x7f4f900afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:36.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f8ffff700 1 -- 172.21.15.133:0/3244484177 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f90060090 con 0x7f4f90060b00 2021-01-03T13:05:36.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f8ffff700 1 --2- 172.21.15.133:0/3244484177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f90060b00 0x7f4f900abdd0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f4f900aa890 tx=0x7f4f78006e80).ready entity=mon.1 client_cookie=18713396fe1f895f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:36.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f8f7fe700 1 -- 172.21.15.133:0/3244484177 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f780097b0 con 0x7f4f90060b00 2021-01-03T13:05:36.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f8f7fe700 1 -- 172.21.15.133:0/3244484177 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f78009910 con 0x7f4f90060b00 2021-01-03T13:05:36.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f8f7fe700 1 -- 172.21.15.133:0/3244484177 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f78009a80 con 0x7f4f90060b00 2021-01-03T13:05:36.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f96a61700 1 -- 172.21.15.133:0/3244484177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f90060b00 msgr2=0x7f4f900abdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:36.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f96a61700 1 --2- 172.21.15.133:0/3244484177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f90060b00 0x7f4f900abdd0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f4f900aa890 tx=0x7f4f78006e80).stop 2021-01-03T13:05:36.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f96a61700 1 -- 172.21.15.133:0/3244484177 shutdown_connections 2021-01-03T13:05:36.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f96a61700 1 --2- 172.21.15.133:0/3244484177 >> v2:172.21.15.16:3300/0 conn(0x7f4f900b5120 0x7f4f900ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f96a61700 1 --2- 172.21.15.133:0/3244484177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f90060b00 0x7f4f900abdd0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f96a61700 1 -- 172.21.15.133:0/3244484177 >> 172.21.15.133:0/3244484177 conn(0x7f4f9005bdf0 msgr2=0x7f4f9005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:36.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f96a61700 1 -- 172.21.15.133:0/3244484177 shutdown_connections 2021-01-03T13:05:36.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.329+0000 7f4f96a61700 1 -- 172.21.15.133:0/3244484177 wait complete. 2021-01-03T13:05:36.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f96a61700 1 Processor -- start 2021-01-03T13:05:36.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f96a61700 1 -- start start 2021-01-03T13:05:36.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f96a61700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f90060b00 0x7f4f90132db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:36.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f96a61700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f900af9f0 0x7f4f90065810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:36.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f96a61700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4f900b5120 0x7f4f90065d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:36.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f96a61700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9012ef10 con 0x7f4f90060b00 2021-01-03T13:05:36.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f96a61700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900809b0 con 0x7f4f900af9f0 2021-01-03T13:05:36.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f96a61700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9012f140 con 0x7f4f900b5120 2021-01-03T13:05:36.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f8ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f900af9f0 0x7f4f90065810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:36.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f8ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f900af9f0 0x7f4f90065810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37258/0 (socket says 172.21.15.133:37258) 2021-01-03T13:05:36.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f8ffff700 1 -- 172.21.15.133:0/2878267402 learned_addr learned my addr 172.21.15.133:0/2878267402 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:36.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f94ffe700 1 --2- 172.21.15.133:0/2878267402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f90060b00 0x7f4f90132db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:36.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f957ff700 1 --2- 172.21.15.133:0/2878267402 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4f900b5120 0x7f4f90065d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:36.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f8ffff700 1 -- 172.21.15.133:0/2878267402 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4f900b5120 msgr2=0x7f4f90065d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:36.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f8ffff700 1 --2- 172.21.15.133:0/2878267402 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4f900b5120 0x7f4f90065d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f8ffff700 1 -- 172.21.15.133:0/2878267402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f90060b00 msgr2=0x7f4f90132db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:36.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f8ffff700 1 --2- 172.21.15.133:0/2878267402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f90060b00 0x7f4f90132db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f8ffff700 1 -- 172.21.15.133:0/2878267402 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f90080710 con 0x7f4f900af9f0 2021-01-03T13:05:36.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f957ff700 1 --2- 172.21.15.133:0/2878267402 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4f900b5120 0x7f4f90065d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:36.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f94ffe700 1 --2- 172.21.15.133:0/2878267402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f90060b00 0x7f4f90132db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:36.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f8ffff700 1 --2- 172.21.15.133:0/2878267402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f900af9f0 0x7f4f90065810 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f4f90066da0 tx=0x7f4f78016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:36.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f8d7fa700 1 -- 172.21.15.133:0/2878267402 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f78011db0 con 0x7f4f900af9f0 2021-01-03T13:05:36.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f8d7fa700 1 -- 172.21.15.133:0/2878267402 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f78021440 con 0x7f4f900af9f0 2021-01-03T13:05:36.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f96a61700 1 -- 172.21.15.133:0/2878267402 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f90066e80 con 0x7f4f900af9f0 2021-01-03T13:05:36.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f8d7fa700 1 -- 172.21.15.133:0/2878267402 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f780217a0 con 0x7f4f900af9f0 2021-01-03T13:05:36.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.333+0000 7f4f96a61700 1 -- 172.21.15.133:0/2878267402 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f900661f0 con 0x7f4f900af9f0 2021-01-03T13:05:36.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.337+0000 7f4f96a61700 1 -- 172.21.15.133:0/2878267402 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9012ecb0 con 0x7f4f900af9f0 2021-01-03T13:05:36.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.337+0000 7f4f8d7fa700 1 -- 172.21.15.133:0/2878267402 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4f7800f070 con 0x7f4f900af9f0 2021-01-03T13:05:36.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.337+0000 7f4f8d7fa700 1 --2- 172.21.15.133:0/2878267402 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4f740554d0 0x7f4f74057990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:36.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.337+0000 7f4f8d7fa700 1 -- 172.21.15.133:0/2878267402 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4f7806f3f0 con 0x7f4f900af9f0 2021-01-03T13:05:36.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.337+0000 7f4f94ffe700 1 --2- 172.21.15.133:0/2878267402 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4f740554d0 0x7f4f74057990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:36.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.337+0000 7f4f94ffe700 1 --2- 172.21.15.133:0/2878267402 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4f740554d0 0x7f4f74057990 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f4f8000c000 tx=0x7f4f80008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:36.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.345+0000 7f4f8d7fa700 1 -- 172.21.15.133:0/2878267402 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4f780456f0 con 0x7f4f900af9f0 2021-01-03T13:05:36.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.533+0000 7f4f96a61700 1 -- 172.21.15.133:0/2878267402 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4f90067010 con 0x7f4f900af9f0 2021-01-03T13:05:36.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.541+0000 7f4f8d7fa700 1 -- 172.21.15.133:0/2878267402 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v24) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4f78015020 con 0x7f4f900af9f0 2021-01-03T13:05:36.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.545+0000 7f4f96a61700 1 -- 172.21.15.133:0/2878267402 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4f740554d0 msgr2=0x7f4f74057990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:36.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.545+0000 7f4f96a61700 1 --2- 172.21.15.133:0/2878267402 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4f740554d0 0x7f4f74057990 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f4f8000c000 tx=0x7f4f80008040).stop 2021-01-03T13:05:36.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.545+0000 7f4f96a61700 1 -- 172.21.15.133:0/2878267402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f900af9f0 msgr2=0x7f4f90065810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:36.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.545+0000 7f4f96a61700 1 --2- 172.21.15.133:0/2878267402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f900af9f0 0x7f4f90065810 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f4f90066da0 tx=0x7f4f78016000).stop 2021-01-03T13:05:36.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.545+0000 7f4f96a61700 1 -- 172.21.15.133:0/2878267402 shutdown_connections 2021-01-03T13:05:36.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.545+0000 7f4f96a61700 1 --2- 172.21.15.133:0/2878267402 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4f740554d0 0x7f4f74057990 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.545+0000 7f4f96a61700 1 --2- 172.21.15.133:0/2878267402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f90060b00 0x7f4f90132db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.545+0000 7f4f96a61700 1 --2- 172.21.15.133:0/2878267402 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4f900b5120 0x7f4f90065d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.545+0000 7f4f96a61700 1 --2- 172.21.15.133:0/2878267402 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f900af9f0 0x7f4f90065810 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.545+0000 7f4f96a61700 1 -- 172.21.15.133:0/2878267402 >> 172.21.15.133:0/2878267402 conn(0x7f4f9005bdf0 msgr2=0x7f4f900af000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:36.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.545+0000 7f4f96a61700 1 -- 172.21.15.133:0/2878267402 shutdown_connections 2021-01-03T13:05:36.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.545+0000 7f4f96a61700 1 -- 172.21.15.133:0/2878267402 wait complete. 2021-01-03T13:05:36.553 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.1 2021-01-03T13:05:36.564 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:05:36.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef74db700 1 Processor -- start 2021-01-03T13:05:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef74db700 1 -- start start 2021-01-03T13:05:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef74db700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ef00b52c0 0x7f5ef00b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:36.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef74db700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5ef00b5c00 0x7f5ef0143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef74db700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef0060da0 con 0x7f5ef00b0c90 2021-01-03T13:05:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef74db700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef0067a90 con 0x7f5ef00b5c00 2021-01-03T13:05:36.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef74db700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00b0ad0 con 0x7f5ef00b52c0 2021-01-03T13:05:36.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef64d9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ef00b52c0 0x7f5ef00b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:36.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef64d9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ef00b52c0 0x7f5ef00b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:45566/0 (socket says 172.21.15.133:45566) 2021-01-03T13:05:36.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef64d9700 1 -- 172.21.15.133:0/2782539737 learned_addr learned my addr 172.21.15.133:0/2782539737 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:36.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef6cda700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5ef00b5c00 0x7f5ef0143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:36.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef5cd8700 1 --1- 172.21.15.133:0/2782539737 >> v1:172.21.15.16:6789/0 conn(0x7f5ef00b0c90 0x7f5ef0098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:37026/0 (socket says 172.21.15.133:37026) 2021-01-03T13:05:36.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef6cda700 1 -- 172.21.15.133:0/2782539737 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ef00b52c0 msgr2=0x7f5ef00b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:36.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef6cda700 1 --2- 172.21.15.133:0/2782539737 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ef00b52c0 0x7f5ef00b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef6cda700 1 -- 172.21.15.133:0/2782539737 >> v1:172.21.15.16:6789/0 conn(0x7f5ef00b0c90 legacy=0x7f5ef0098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:36.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef54d7700 1 -- 172.21.15.133:0/2782539737 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664541757 0 0) 0x7f5ef0060da0 con 0x7f5ef00b0c90 2021-01-03T13:05:36.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef6cda700 1 -- 172.21.15.133:0/2782539737 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef00b56a0 con 0x7f5ef00b5c00 2021-01-03T13:05:36.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef64d9700 1 --2- 172.21.15.133:0/2782539737 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ef00b52c0 0x7f5ef00b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:36.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef6cda700 1 --2- 172.21.15.133:0/2782539737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef00b5c00 0x7f5ef0143eb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f5ee0002f30 tx=0x7f5ee0006dc0).ready entity=mon.0 client_cookie=286bf304ec907b35 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:36.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef54d7700 1 -- 172.21.15.133:0/2782539737 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ee0009760 con 0x7f5ef00b5c00 2021-01-03T13:05:36.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef54d7700 1 -- 172.21.15.133:0/2782539737 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee00098c0 con 0x7f5ef00b5c00 2021-01-03T13:05:36.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef74db700 1 -- 172.21.15.133:0/2782539737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef00b5c00 msgr2=0x7f5ef0143eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:36.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef54d7700 1 -- 172.21.15.133:0/2782539737 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ee0009c20 con 0x7f5ef00b5c00 2021-01-03T13:05:36.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.673+0000 7f5ef74db700 1 --2- 172.21.15.133:0/2782539737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef00b5c00 0x7f5ef0143eb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f5ee0002f30 tx=0x7f5ee0006dc0).stop 2021-01-03T13:05:36.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef74db700 1 -- 172.21.15.133:0/2782539737 shutdown_connections 2021-01-03T13:05:36.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef74db700 1 --2- 172.21.15.133:0/2782539737 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef00b5c00 0x7f5ef0143eb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef74db700 1 --2- 172.21.15.133:0/2782539737 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ef00b52c0 0x7f5ef00b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef74db700 1 -- 172.21.15.133:0/2782539737 >> 172.21.15.133:0/2782539737 conn(0x7f5ef005bdf0 msgr2=0x7f5ef005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef74db700 1 -- 172.21.15.133:0/2782539737 shutdown_connections 2021-01-03T13:05:36.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef74db700 1 -- 172.21.15.133:0/2782539737 wait complete. 2021-01-03T13:05:36.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef74db700 1 Processor -- start 2021-01-03T13:05:36.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef74db700 1 -- start start 2021-01-03T13:05:36.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef74db700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ef00b0c90 0x7f5ef00648e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:36.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef74db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ef00b52c0 0x7f5ef00aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:36.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef74db700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef00b5c00 0x7f5ef00abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:36.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef74db700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00ac8e0 con 0x7f5ef00b5c00 2021-01-03T13:05:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef74db700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00aa970 con 0x7f5ef00b52c0 2021-01-03T13:05:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef74db700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00aa6d0 con 0x7f5ef00b0c90 2021-01-03T13:05:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef5cd8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ef00b52c0 0x7f5ef00aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef5cd8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ef00b52c0 0x7f5ef00aad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37274/0 (socket says 172.21.15.133:37274) 2021-01-03T13:05:36.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef5cd8700 1 -- 172.21.15.133:0/4214943651 learned_addr learned my addr 172.21.15.133:0/4214943651 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef6cda700 1 --2- 172.21.15.133:0/4214943651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef00b5c00 0x7f5ef00abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef64d9700 1 --2- 172.21.15.133:0/4214943651 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ef00b0c90 0x7f5ef00648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef5cd8700 1 -- 172.21.15.133:0/4214943651 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ef00b0c90 msgr2=0x7f5ef00648e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef5cd8700 1 --2- 172.21.15.133:0/4214943651 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ef00b0c90 0x7f5ef00648e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef5cd8700 1 -- 172.21.15.133:0/4214943651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef00b5c00 msgr2=0x7f5ef00abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef5cd8700 1 --2- 172.21.15.133:0/4214943651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef00b5c00 0x7f5ef00abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef5cd8700 1 -- 172.21.15.133:0/4214943651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef00ab860 con 0x7f5ef00b52c0 2021-01-03T13:05:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef6cda700 1 --2- 172.21.15.133:0/4214943651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef00b5c00 0x7f5ef00abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef5cd8700 1 --2- 172.21.15.133:0/4214943651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ef00b52c0 0x7f5ef00aad90 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f5ee8000b80 tx=0x7f5ee8007a00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:36.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ee77fe700 1 -- 172.21.15.133:0/4214943651 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ee80072e0 con 0x7f5ef00b52c0 2021-01-03T13:05:36.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ee77fe700 1 -- 172.21.15.133:0/4214943651 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee8005520 con 0x7f5ef00b52c0 2021-01-03T13:05:36.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ee77fe700 1 -- 172.21.15.133:0/4214943651 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ee8005880 con 0x7f5ef00b52c0 2021-01-03T13:05:36.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.677+0000 7f5ef74db700 1 -- 172.21.15.133:0/4214943651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef00ab280 con 0x7f5ef00b52c0 2021-01-03T13:05:36.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.681+0000 7f5ef74db700 1 -- 172.21.15.133:0/4214943651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef00acb40 con 0x7f5ef00b52c0 2021-01-03T13:05:36.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.681+0000 7f5ef74db700 1 -- 172.21.15.133:0/4214943651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef0057300 con 0x7f5ef00b52c0 2021-01-03T13:05:36.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.681+0000 7f5ee77fe700 1 -- 172.21.15.133:0/4214943651 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5ee8010070 con 0x7f5ef00b52c0 2021-01-03T13:05:36.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.681+0000 7f5ee77fe700 1 --2- 172.21.15.133:0/4214943651 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ed0055440 0x7f5ed0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:36.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.681+0000 7f5ee77fe700 1 -- 172.21.15.133:0/4214943651 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5ee806d4d0 con 0x7f5ef00b52c0 2021-01-03T13:05:36.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.681+0000 7f5ef64d9700 1 --2- 172.21.15.133:0/4214943651 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ed0055440 0x7f5ed0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:36.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.681+0000 7f5ef64d9700 1 --2- 172.21.15.133:0/4214943651 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ed0055440 0x7f5ed0057900 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f5eec00b000 tx=0x7f5eec009270).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:36.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.689+0000 7f5ee77fe700 1 -- 172.21.15.133:0/4214943651 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5ee8043730 con 0x7f5ef00b52c0 2021-01-03T13:05:36.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.869+0000 7f5ef74db700 1 -- 172.21.15.133:0/4214943651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ef0067360 con 0x7f5ef00b52c0 2021-01-03T13:05:36.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.877+0000 7f5ee77fe700 1 -- 172.21.15.133:0/4214943651 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2499 (secure 0 0 0) 0x7f5ee8018070 con 0x7f5ef00b52c0 2021-01-03T13:05:36.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.877+0000 7f5ef74db700 1 -- 172.21.15.133:0/4214943651 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ed0055440 msgr2=0x7f5ed0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:36.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.877+0000 7f5ef74db700 1 --2- 172.21.15.133:0/4214943651 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ed0055440 0x7f5ed0057900 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f5eec00b000 tx=0x7f5eec009270).stop 2021-01-03T13:05:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.877+0000 7f5ef74db700 1 -- 172.21.15.133:0/4214943651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ef00b52c0 msgr2=0x7f5ef00aad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.877+0000 7f5ef74db700 1 --2- 172.21.15.133:0/4214943651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ef00b52c0 0x7f5ef00aad90 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f5ee8000b80 tx=0x7f5ee8007a00).stop 2021-01-03T13:05:36.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.877+0000 7f5ef74db700 1 -- 172.21.15.133:0/4214943651 shutdown_connections 2021-01-03T13:05:36.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.877+0000 7f5ef74db700 1 --2- 172.21.15.133:0/4214943651 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ed0055440 0x7f5ed0057900 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.877+0000 7f5ef74db700 1 --2- 172.21.15.133:0/4214943651 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5ef00b5c00 0x7f5ef00abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.877+0000 7f5ef74db700 1 --2- 172.21.15.133:0/4214943651 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5ef00b0c90 0x7f5ef00648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.877+0000 7f5ef74db700 1 --2- 172.21.15.133:0/4214943651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ef00b52c0 0x7f5ef00aad90 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:36.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.877+0000 7f5ef74db700 1 -- 172.21.15.133:0/4214943651 >> 172.21.15.133:0/4214943651 conn(0x7f5ef005bdf0 msgr2=0x7f5ef01434a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:36.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.877+0000 7f5ef74db700 1 -- 172.21.15.133:0/4214943651 shutdown_connections 2021-01-03T13:05:36.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:36.877+0000 7f5ef74db700 1 -- 172.21.15.133:0/4214943651 wait complete. 2021-01-03T13:05:36.900 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 43 2021-01-03T13:05:36.900 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:36.901 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":43,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6014,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1098287672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1098287672},{"type":"v1","addr":"172.21.15.133:6837","nonce":1098287672}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1817607475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1817607475},{"type":"v1","addr":"172.21.15.16:6833","nonce":1817607475}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:34.203844+0000","modified":"2021-01-03T13:05:35.206833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6817},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6817":{"gid":6817,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/1339474843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1339474843},{"type":"v1","addr":"172.21.15.133:6835","nonce":1339474843}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-01-03T13:05:37.211 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:05:34.203844+0000', 'modified': '2021-01-03T13:05:35.206833+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6817}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6817': {'gid': 6817, 'name': 'c', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6835/1339474843', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 1339474843}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 1339474843}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:05:37.212 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:05:37.212 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T13:05:37.340 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":6817,"want_state":"up:active","state":"up:active","rank_uptime":3.1219108659999999,"mdsmap_epoch":43,"osdmap_epoch":102,"osdmap_epoch_barrier":100,"uptime":7.5193184860000004} 2021-01-03T13:05:37.341 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 6817, "mdsmap_epoch": 43, "osdmap_epoch": 102, "osdmap_epoch_barrier": 100, "rank_uptime": 3.121910866, "state": "up:active", "uptime": 7.519318486, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:05:37.341 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:05:37.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.449+0000 7febe0da2700 1 Processor -- start 2021-01-03T13:05:37.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.449+0000 7febe0da2700 1 -- start start 2021-01-03T13:05:37.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febe0da2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7febdc0b9b60 0x7febdc0b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:37.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febe0da2700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7febdc0b4e10 0x7febdc146b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:37.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febe0da2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febdc147030 con 0x7febdc0b4980 2021-01-03T13:05:37.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febe0da2700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febdc0aed30 con 0x7febdc0b4e10 2021-01-03T13:05:37.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febe0da2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febdc0605f0 con 0x7febdc0b9b60 2021-01-03T13:05:37.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febd2ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7febdc0b4980 0x7febdc146430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58310/0 (socket says 172.21.15.133:58310) 2021-01-03T13:05:37.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febd2ffd700 1 -- 172.21.15.133:0/569953343 learned_addr learned my addr 172.21.15.133:0/569953343 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:37.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdb7fe700 1 --2- 172.21.15.133:0/569953343 >> v2:172.21.15.133:3300/0 conn(0x7febdc0b9b60 0x7febdc0b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:37.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdbfff700 1 --2- 172.21.15.133:0/569953343 >> v2:172.21.15.16:3300/0 conn(0x7febdc0b4e10 0x7febdc146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:37.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 -- 172.21.15.133:0/569953343 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060892883 0 0) 0x7febdc147030 con 0x7febdc0b4980 2021-01-03T13:05:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 -- 172.21.15.133:0/569953343 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febbc003230 con 0x7febdc0b4980 2021-01-03T13:05:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 -- 172.21.15.133:0/569953343 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 227608759 0 0) 0x7febbc003230 con 0x7febdc0b4980 2021-01-03T13:05:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 -- 172.21.15.133:0/569953343 >> v2:172.21.15.133:3300/0 conn(0x7febdc0b9b60 msgr2=0x7febdc0b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 --2- 172.21.15.133:0/569953343 >> v2:172.21.15.133:3300/0 conn(0x7febdc0b9b60 0x7febdc0b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 -- 172.21.15.133:0/569953343 >> v2:172.21.15.16:3300/0 conn(0x7febdc0b4e10 msgr2=0x7febdc146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:37.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 --2- 172.21.15.133:0/569953343 >> v2:172.21.15.16:3300/0 conn(0x7febdc0b4e10 0x7febdc146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 -- 172.21.15.133:0/569953343 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc0600b0 con 0x7febdc0b4980 2021-01-03T13:05:37.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 -- 172.21.15.133:0/569953343 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7febc40016d0 con 0x7febdc0b4980 2021-01-03T13:05:37.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 -- 172.21.15.133:0/569953343 >> v1:172.21.15.133:6789/0 conn(0x7febdc0b4980 legacy=0x7febdc146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:37.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 --2- 172.21.15.133:0/569953343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febbc003720 0x7febbc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:37.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 --2- 172.21.15.133:0/569953343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febbc0044d0 0x7febbc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 --2- 172.21.15.133:0/569953343 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febbc004e40 0x7febbc00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 -- 172.21.15.133:0/569953343 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc0aed30 con 0x7febbc003720 2021-01-03T13:05:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 -- 172.21.15.133:0/569953343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc0605f0 con 0x7febbc0044d0 2021-01-03T13:05:37.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 -- 172.21.15.133:0/569953343 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febbc004250 con 0x7febbc004e40 2021-01-03T13:05:37.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febd2ffd700 1 --2- 172.21.15.133:0/569953343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febbc0044d0 0x7febbc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:37.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdb7fe700 1 --2- 172.21.15.133:0/569953343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febbc003720 0x7febbc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:37.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdbfff700 1 --2- 172.21.15.133:0/569953343 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febbc004e40 0x7febbc00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febd2ffd700 1 -- 172.21.15.133:0/569953343 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febbc004e40 msgr2=0x7febbc00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:37.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febd2ffd700 1 --2- 172.21.15.133:0/569953343 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febbc004e40 0x7febbc00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febd2ffd700 1 -- 172.21.15.133:0/569953343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febbc003720 msgr2=0x7febbc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:37.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febd2ffd700 1 --2- 172.21.15.133:0/569953343 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febbc003720 0x7febbc003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febd2ffd700 1 -- 172.21.15.133:0/569953343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc003230 con 0x7febbc0044d0 2021-01-03T13:05:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdbfff700 1 -- 172.21.15.133:0/569953343 reap_dead start 2021-01-03T13:05:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febd2ffd700 1 --2- 172.21.15.133:0/569953343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febbc0044d0 0x7febbc004950 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7febc40013e0 tx=0x7febdc0af460).ready entity=mon.1 client_cookie=3e97738697e63d87 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 -- 172.21.15.133:0/569953343 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc400ce00 con 0x7febbc0044d0 2021-01-03T13:05:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 -- 172.21.15.133:0/569953343 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc40072e0 con 0x7febbc0044d0 2021-01-03T13:05:37.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febdaffd700 1 -- 172.21.15.133:0/569953343 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc40057d0 con 0x7febbc0044d0 2021-01-03T13:05:37.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febe0da2700 1 -- 172.21.15.133:0/569953343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febbc0044d0 msgr2=0x7febbc004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:37.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febe0da2700 1 --2- 172.21.15.133:0/569953343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febbc0044d0 0x7febbc004950 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7febc40013e0 tx=0x7febdc0af460).stop 2021-01-03T13:05:37.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febe0da2700 1 -- 172.21.15.133:0/569953343 shutdown_connections 2021-01-03T13:05:37.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febe0da2700 1 --2- 172.21.15.133:0/569953343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febbc0044d0 0x7febbc004950 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.453+0000 7febe0da2700 1 -- 172.21.15.133:0/569953343 >> 172.21.15.133:0/569953343 conn(0x7febdc0b69e0 msgr2=0x7febdc0b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:37.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.457+0000 7febe0da2700 1 -- 172.21.15.133:0/569953343 shutdown_connections 2021-01-03T13:05:37.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.457+0000 7febe0da2700 1 -- 172.21.15.133:0/569953343 wait complete. 2021-01-03T13:05:37.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.457+0000 7febe0da2700 1 Processor -- start 2021-01-03T13:05:37.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.457+0000 7febe0da2700 1 -- start start 2021-01-03T13:05:37.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.457+0000 7febe0da2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febbc0044d0 0x7febdc09e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:37.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.457+0000 7febe0da2700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febdc13f6e0 0x7febdc13fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:37.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.457+0000 7febe0da2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febdc0b1700 0x7febdc0b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:37.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.457+0000 7febe0da2700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc1472b0 con 0x7febdc13f6e0 2021-01-03T13:05:37.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.457+0000 7febe0da2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc0b31c0 con 0x7febbc0044d0 2021-01-03T13:05:37.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.457+0000 7febe0da2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febdc146350 con 0x7febdc0b1700 2021-01-03T13:05:37.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.457+0000 7febdb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febbc0044d0 0x7febdc09e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:37.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.457+0000 7febdb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febbc0044d0 0x7febdc09e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37290/0 (socket says 172.21.15.133:37290) 2021-01-03T13:05:37.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.457+0000 7febdb7fe700 1 -- 172.21.15.133:0/1182795562 learned_addr learned my addr 172.21.15.133:0/1182795562 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:37.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.461+0000 7febdbfff700 1 --2- 172.21.15.133:0/1182795562 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febdc0b1700 0x7febdc0b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:37.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.461+0000 7febd2ffd700 1 --2- 172.21.15.133:0/1182795562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febdc13f6e0 0x7febdc13fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:37.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.461+0000 7febdb7fe700 1 -- 172.21.15.133:0/1182795562 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febdc0b1700 msgr2=0x7febdc0b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:37.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.461+0000 7febdb7fe700 1 --2- 172.21.15.133:0/1182795562 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febdc0b1700 0x7febdc0b1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.461+0000 7febdb7fe700 1 -- 172.21.15.133:0/1182795562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febdc13f6e0 msgr2=0x7febdc13fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:37.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.461+0000 7febdb7fe700 1 --2- 172.21.15.133:0/1182795562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febdc13f6e0 0x7febdc13fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.461+0000 7febdb7fe700 1 -- 172.21.15.133:0/1182795562 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc0b33e0 con 0x7febbc0044d0 2021-01-03T13:05:37.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.461+0000 7febdb7fe700 1 --2- 172.21.15.133:0/1182795562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febbc0044d0 0x7febdc09e380 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7febcc006750 tx=0x7febcc008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:37.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.461+0000 7febd97fa700 1 -- 172.21.15.133:0/1182795562 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febcc00fa90 con 0x7febbc0044d0 2021-01-03T13:05:37.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.461+0000 7febe0da2700 1 -- 172.21.15.133:0/1182795562 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febdc148580 con 0x7febbc0044d0 2021-01-03T13:05:37.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.461+0000 7febd97fa700 1 -- 172.21.15.133:0/1182795562 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febcc00fbf0 con 0x7febbc0044d0 2021-01-03T13:05:37.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.461+0000 7febd97fa700 1 -- 172.21.15.133:0/1182795562 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febcc00fd60 con 0x7febbc0044d0 2021-01-03T13:05:37.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.461+0000 7febe0da2700 1 -- 172.21.15.133:0/1182795562 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febdc140030 con 0x7febbc0044d0 2021-01-03T13:05:37.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.461+0000 7febe0da2700 1 -- 172.21.15.133:0/1182795562 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febdc146550 con 0x7febbc0044d0 2021-01-03T13:05:37.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.461+0000 7febd97fa700 1 -- 172.21.15.133:0/1182795562 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7febcc024070 con 0x7febbc0044d0 2021-01-03T13:05:37.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.465+0000 7febd97fa700 1 --2- 172.21.15.133:0/1182795562 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febc00554e0 0x7febc00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:37.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.465+0000 7febd97fa700 1 -- 172.21.15.133:0/1182795562 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7febcc06e860 con 0x7febbc0044d0 2021-01-03T13:05:37.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.465+0000 7febd2ffd700 1 --2- 172.21.15.133:0/1182795562 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febc00554e0 0x7febc00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:37.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.465+0000 7febd2ffd700 1 --2- 172.21.15.133:0/1182795562 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febc00554e0 0x7febc00579a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7febc4018000 tx=0x7febc4015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:37.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.469+0000 7febd97fa700 1 -- 172.21.15.133:0/1182795562 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7febcc044ac0 con 0x7febbc0044d0 2021-01-03T13:05:37.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.609+0000 7febe0da2700 1 -- 172.21.15.133:0/1182795562 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febdc0b3570 con 0x7febbc0044d0 2021-01-03T13:05:37.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.609+0000 7febd97fa700 1 -- 172.21.15.133:0/1182795562 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16093 (secure 0 0 0) 0x7febcc0480e0 con 0x7febbc0044d0 2021-01-03T13:05:37.617 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:37.617 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":102,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:05:36.216269+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:05:32.702569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-01-03T13:05:33.206759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:05:37.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.613+0000 7febe0da2700 1 -- 172.21.15.133:0/1182795562 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febc00554e0 msgr2=0x7febc00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:37.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.613+0000 7febe0da2700 1 --2- 172.21.15.133:0/1182795562 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febc00554e0 0x7febc00579a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7febc4018000 tx=0x7febc4015000).stop 2021-01-03T13:05:37.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.613+0000 7febe0da2700 1 -- 172.21.15.133:0/1182795562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febbc0044d0 msgr2=0x7febdc09e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:37.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.613+0000 7febe0da2700 1 --2- 172.21.15.133:0/1182795562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febbc0044d0 0x7febdc09e380 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7febcc006750 tx=0x7febcc008040).stop 2021-01-03T13:05:37.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.613+0000 7febe0da2700 1 -- 172.21.15.133:0/1182795562 shutdown_connections 2021-01-03T13:05:37.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.613+0000 7febe0da2700 1 --2- 172.21.15.133:0/1182795562 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febc00554e0 0x7febc00579a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.613+0000 7febe0da2700 1 --2- 172.21.15.133:0/1182795562 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febdc0b1700 0x7febdc0b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.613+0000 7febe0da2700 1 --2- 172.21.15.133:0/1182795562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febbc0044d0 0x7febdc09e380 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.613+0000 7febe0da2700 1 --2- 172.21.15.133:0/1182795562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febdc13f6e0 0x7febdc13fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.613+0000 7febe0da2700 1 -- 172.21.15.133:0/1182795562 >> 172.21.15.133:0/1182795562 conn(0x7febdc0b69e0 msgr2=0x7febdc0afa90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:37.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.613+0000 7febe0da2700 1 -- 172.21.15.133:0/1182795562 shutdown_connections 2021-01-03T13:05:37.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.613+0000 7febe0da2700 1 -- 172.21.15.133:0/1182795562 wait complete. 2021-01-03T13:05:37.636 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:05:32.702569+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:05:33.206759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:05:37.637 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:05:37.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c915e6700 1 Processor -- start 2021-01-03T13:05:37.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c915e6700 1 -- start start 2021-01-03T13:05:37.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c915e6700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8c8c0b1580 0x7f8c8c0ad050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:37.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c915e6700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c8c1441d0 con 0x7f8c8c0b5a70 2021-01-03T13:05:37.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c915e6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c8c0b1ae0 con 0x7f8c8c13e730 2021-01-03T13:05:37.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c915e6700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c8c0b01f0 con 0x7f8c8c0b1580 2021-01-03T13:05:37.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c83fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8c8c13e730 0x7f8c8c0ac940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58332/0 (socket says 172.21.15.133:58332) 2021-01-03T13:05:37.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c83fff700 1 -- 172.21.15.133:0/354193101 learned_addr learned my addr 172.21.15.133:0/354193101 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:37.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c8b7fe700 1 --2- 172.21.15.133:0/354193101 >> v2:172.21.15.16:3300/0 conn(0x7f8c8c0b1580 0x7f8c8c0ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:37.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c8a7fc700 1 -- 172.21.15.133:0/354193101 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498024697 0 0) 0x7f8c8c0b1ae0 con 0x7f8c8c13e730 2021-01-03T13:05:37.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c8a7fc700 1 -- 172.21.15.133:0/354193101 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c6c003230 con 0x7f8c8c13e730 2021-01-03T13:05:37.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c8a7fc700 1 -- 172.21.15.133:0/354193101 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255753407 0 0) 0x7f8c8c1441d0 con 0x7f8c8c0b5a70 2021-01-03T13:05:37.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c8a7fc700 1 -- 172.21.15.133:0/354193101 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c8c0b1ae0 con 0x7f8c8c0b5a70 2021-01-03T13:05:37.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c8b7fe700 1 -- 172.21.15.133:0/354193101 >> v1:172.21.15.133:6789/0 conn(0x7f8c8c13e730 legacy=0x7f8c8c0ac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:37.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c8b7fe700 1 -- 172.21.15.133:0/354193101 >> v1:172.21.15.16:6789/0 conn(0x7f8c8c0b5a70 legacy=0x7f8c8c13e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:37.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c8b7fe700 1 -- 172.21.15.133:0/354193101 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c0b0490 con 0x7f8c8c0b1580 2021-01-03T13:05:37.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c8b7fe700 1 --2- 172.21.15.133:0/354193101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c8c0b1580 0x7f8c8c0ad050 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f8c840032b0 tx=0x7f8c840091a0).ready entity=mon.0 client_cookie=85d8f54136397ca0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:37.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c8a7fc700 1 -- 172.21.15.133:0/354193101 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c8400b940 con 0x7f8c8c0b1580 2021-01-03T13:05:37.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c8a7fc700 1 -- 172.21.15.133:0/354193101 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8400baa0 con 0x7f8c8c0b1580 2021-01-03T13:05:37.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c8a7fc700 1 -- 172.21.15.133:0/354193101 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c8400bc10 con 0x7f8c8c0b1580 2021-01-03T13:05:37.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c915e6700 1 -- 172.21.15.133:0/354193101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c8c0b1580 msgr2=0x7f8c8c0ad050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:37.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.757+0000 7f8c915e6700 1 --2- 172.21.15.133:0/354193101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c8c0b1580 0x7f8c8c0ad050 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f8c840032b0 tx=0x7f8c840091a0).stop 2021-01-03T13:05:37.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c915e6700 1 -- 172.21.15.133:0/354193101 shutdown_connections 2021-01-03T13:05:37.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c915e6700 1 --2- 172.21.15.133:0/354193101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c8c0b1580 0x7f8c8c0ad050 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c915e6700 1 -- 172.21.15.133:0/354193101 >> 172.21.15.133:0/354193101 conn(0x7f8c8c05c8c0 msgr2=0x7f8c8c0b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:37.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c915e6700 1 -- 172.21.15.133:0/354193101 shutdown_connections 2021-01-03T13:05:37.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c915e6700 1 -- 172.21.15.133:0/354193101 wait complete. 2021-01-03T13:05:37.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c915e6700 1 Processor -- start 2021-01-03T13:05:37.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c915e6700 1 -- start start 2021-01-03T13:05:37.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c915e6700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8c8c0b1580 0x7f8c8c0b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:37.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c915e6700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c8c0b5a70 0x7f8c8c151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:37.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c915e6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c8c09b070 0x7f8c8c152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:37.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c915e6700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c1431c0 con 0x7f8c8c0b5a70 2021-01-03T13:05:37.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c915e6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c142cc0 con 0x7f8c8c09b070 2021-01-03T13:05:37.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c915e6700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8c142f20 con 0x7f8c8c0b1580 2021-01-03T13:05:37.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c8b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c8c09b070 0x7f8c8c152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:37.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c8b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c8c09b070 0x7f8c8c152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37308/0 (socket says 172.21.15.133:37308) 2021-01-03T13:05:37.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c8b7fe700 1 -- 172.21.15.133:0/858811027 learned_addr learned my addr 172.21.15.133:0/858811027 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:37.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c8affd700 1 --2- 172.21.15.133:0/858811027 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8c8c0b1580 0x7f8c8c0b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:37.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.761+0000 7f8c83fff700 1 --2- 172.21.15.133:0/858811027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c8c0b5a70 0x7f8c8c151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:37.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.765+0000 7f8c8b7fe700 1 -- 172.21.15.133:0/858811027 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8c8c0b1580 msgr2=0x7f8c8c0b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:37.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.765+0000 7f8c8b7fe700 1 --2- 172.21.15.133:0/858811027 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8c8c0b1580 0x7f8c8c0b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.765+0000 7f8c8b7fe700 1 -- 172.21.15.133:0/858811027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c8c0b5a70 msgr2=0x7f8c8c151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:37.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.765+0000 7f8c8b7fe700 1 --2- 172.21.15.133:0/858811027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c8c0b5a70 0x7f8c8c151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.765+0000 7f8c8b7fe700 1 -- 172.21.15.133:0/858811027 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c1455a0 con 0x7f8c8c09b070 2021-01-03T13:05:37.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.765+0000 7f8c8affd700 1 --2- 172.21.15.133:0/858811027 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8c8c0b1580 0x7f8c8c0b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:37.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.765+0000 7f8c83fff700 1 --2- 172.21.15.133:0/858811027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c8c0b5a70 0x7f8c8c151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:37.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.765+0000 7f8c8b7fe700 1 --2- 172.21.15.133:0/858811027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c8c09b070 0x7f8c8c152120 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f8c840032b0 tx=0x7f8c84016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:37.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.765+0000 7f8c88ff9700 1 -- 172.21.15.133:0/858811027 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c84011db0 con 0x7f8c8c09b070 2021-01-03T13:05:37.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.765+0000 7f8c915e6700 1 -- 172.21.15.133:0/858811027 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8c145840 con 0x7f8c8c09b070 2021-01-03T13:05:37.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.765+0000 7f8c88ff9700 1 -- 172.21.15.133:0/858811027 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8401f3f0 con 0x7f8c8c09b070 2021-01-03T13:05:37.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.765+0000 7f8c915e6700 1 -- 172.21.15.133:0/858811027 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8c0b4880 con 0x7f8c8c09b070 2021-01-03T13:05:37.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.765+0000 7f8c88ff9700 1 -- 172.21.15.133:0/858811027 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c8401f750 con 0x7f8c8c09b070 2021-01-03T13:05:37.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.765+0000 7f8c915e6700 1 -- 172.21.15.133:0/858811027 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c8c1459d0 con 0x7f8c8c09b070 2021-01-03T13:05:37.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.765+0000 7f8c88ff9700 1 -- 172.21.15.133:0/858811027 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8c84026030 con 0x7f8c8c09b070 2021-01-03T13:05:37.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.765+0000 7f8c88ff9700 1 --2- 172.21.15.133:0/858811027 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8c70055440 0x7f8c70057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:37.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.765+0000 7f8c8affd700 1 --2- 172.21.15.133:0/858811027 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8c70055440 0x7f8c70057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:37.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.769+0000 7f8c88ff9700 1 -- 172.21.15.133:0/858811027 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8c8406ea40 con 0x7f8c8c09b070 2021-01-03T13:05:37.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.769+0000 7f8c8affd700 1 --2- 172.21.15.133:0/858811027 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8c70055440 0x7f8c70057900 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f8c7c00d000 tx=0x7f8c7c0079d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:37.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.773+0000 7f8c88ff9700 1 -- 172.21.15.133:0/858811027 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8c84044ca0 con 0x7f8c8c09b070 2021-01-03T13:05:37.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.913+0000 7f8c915e6700 1 -- 172.21.15.133:0/858811027 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8c8c057300 con 0x7f8c8c09b070 2021-01-03T13:05:37.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.913+0000 7f8c88ff9700 1 -- 172.21.15.133:0/858811027 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v102) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8c840240b0 con 0x7f8c8c09b070 2021-01-03T13:05:37.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.917+0000 7f8c915e6700 1 -- 172.21.15.133:0/858811027 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8c70055440 msgr2=0x7f8c70057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:37.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.917+0000 7f8c915e6700 1 --2- 172.21.15.133:0/858811027 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8c70055440 0x7f8c70057900 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f8c7c00d000 tx=0x7f8c7c0079d0).stop 2021-01-03T13:05:37.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.917+0000 7f8c915e6700 1 -- 172.21.15.133:0/858811027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c8c09b070 msgr2=0x7f8c8c152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:37.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.917+0000 7f8c915e6700 1 --2- 172.21.15.133:0/858811027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c8c09b070 0x7f8c8c152120 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f8c840032b0 tx=0x7f8c84016000).stop 2021-01-03T13:05:37.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.917+0000 7f8c915e6700 1 -- 172.21.15.133:0/858811027 shutdown_connections 2021-01-03T13:05:37.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.917+0000 7f8c915e6700 1 --2- 172.21.15.133:0/858811027 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8c70055440 0x7f8c70057900 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.917+0000 7f8c915e6700 1 --2- 172.21.15.133:0/858811027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c8c09b070 0x7f8c8c152120 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.917+0000 7f8c915e6700 1 --2- 172.21.15.133:0/858811027 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8c8c0b1580 0x7f8c8c0b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.917+0000 7f8c915e6700 1 --2- 172.21.15.133:0/858811027 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8c8c0b5a70 0x7f8c8c151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:37.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.917+0000 7f8c915e6700 1 -- 172.21.15.133:0/858811027 >> 172.21.15.133:0/858811027 conn(0x7f8c8c05c8c0 msgr2=0x7f8c8c140cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:37.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.917+0000 7f8c915e6700 1 -- 172.21.15.133:0/858811027 shutdown_connections 2021-01-03T13:05:37.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:37.917+0000 7f8c915e6700 1 -- 172.21.15.133:0/858811027 wait complete. 2021-01-03T13:05:37.926 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:05:37.934 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:05:37.941 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:05:37.944 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:05:37.958 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:05:37.978 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:05:38.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.041+0000 7f4b4b59e700 1 Processor -- start 2021-01-03T13:05:38.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.041+0000 7f4b4b59e700 1 -- start start 2021-01-03T13:05:38.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4b59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4b4c0ace10 0x7f4b4c0ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4b59e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c0b7880 con 0x7f4b4c144120 2021-01-03T13:05:38.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4b59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c0ad6e0 con 0x7f4b4c0b2e80 2021-01-03T13:05:38.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4b59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0adad0 con 0x7f4b4c0ace10 2021-01-03T13:05:38.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b49d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4b4c0b2e80 0x7f4b4c0b7170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58344/0 (socket says 172.21.15.133:58344) 2021-01-03T13:05:38.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b49d9b700 1 -- 172.21.15.133:0/3935020953 learned_addr learned my addr 172.21.15.133:0/3935020953 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:38.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4a59c700 1 --2- 172.21.15.133:0/3935020953 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4b4c0ace10 0x7f4b4c0ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 -- 172.21.15.133:0/3935020953 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555150244 0 0) 0x7f4b4c0ad6e0 con 0x7f4b4c0b2e80 2021-01-03T13:05:38.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 -- 172.21.15.133:0/3935020953 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b30003230 con 0x7f4b4c0b2e80 2021-01-03T13:05:38.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 -- 172.21.15.133:0/3935020953 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1938713860 0 0) 0x7f4b30003230 con 0x7f4b4c0b2e80 2021-01-03T13:05:38.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 -- 172.21.15.133:0/3935020953 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4b4c0ace10 msgr2=0x7f4b4c0ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:38.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 --2- 172.21.15.133:0/3935020953 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4b4c0ace10 0x7f4b4c0ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 -- 172.21.15.133:0/3935020953 >> v1:172.21.15.16:6789/0 conn(0x7f4b4c144120 legacy=0x7f4b4c1445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 -- 172.21.15.133:0/3935020953 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c0add70 con 0x7f4b4c0b2e80 2021-01-03T13:05:38.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 -- 172.21.15.133:0/3935020953 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f4b400016d0 con 0x7f4b4c0b2e80 2021-01-03T13:05:38.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 -- 172.21.15.133:0/3935020953 >> v1:172.21.15.133:6789/0 conn(0x7f4b4c0b2e80 legacy=0x7f4b4c0b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 --2- 172.21.15.133:0/3935020953 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4b4c0ace10 0x7f4b30003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 --2- 172.21.15.133:0/3935020953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30003c10 0x7f4b300044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 --2- 172.21.15.133:0/3935020953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b300049c0 0x7f4b30004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 -- 172.21.15.133:0/3935020953 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0adad0 con 0x7f4b300049c0 2021-01-03T13:05:38.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 -- 172.21.15.133:0/3935020953 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b30004130 con 0x7f4b30003c10 2021-01-03T13:05:38.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 -- 172.21.15.133:0/3935020953 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300042f0 con 0x7f4b4c0ace10 2021-01-03T13:05:38.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b49d9b700 1 --2- 172.21.15.133:0/3935020953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30003c10 0x7f4b300044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4ad9d700 1 --2- 172.21.15.133:0/3935020953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b300049c0 0x7f4b30004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4a59c700 1 --2- 172.21.15.133:0/3935020953 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4b4c0ace10 0x7f4b30003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b49d9b700 1 -- 172.21.15.133:0/3935020953 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4b4c0ace10 msgr2=0x7f4b30003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:38.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b49d9b700 1 --2- 172.21.15.133:0/3935020953 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4b4c0ace10 0x7f4b30003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b49d9b700 1 -- 172.21.15.133:0/3935020953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b300049c0 msgr2=0x7f4b30004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:38.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b49d9b700 1 --2- 172.21.15.133:0/3935020953 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b300049c0 0x7f4b30004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b49d9b700 1 -- 172.21.15.133:0/3935020953 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b30003230 con 0x7f4b30003c10 2021-01-03T13:05:38.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b49d9b700 1 --2- 172.21.15.133:0/3935020953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30003c10 0x7f4b300044d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f4b400013e0 tx=0x7f4b4c0ac5c0).ready entity=mon.1 client_cookie=bf56e3a5459e4fcc server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:38.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 -- 172.21.15.133:0/3935020953 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b400070d0 con 0x7f4b30003c10 2021-01-03T13:05:38.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 -- 172.21.15.133:0/3935020953 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b40007230 con 0x7f4b30003c10 2021-01-03T13:05:38.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4959a700 1 -- 172.21.15.133:0/3935020953 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b400055e0 con 0x7f4b30003c10 2021-01-03T13:05:38.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4b59e700 1 -- 172.21.15.133:0/3935020953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30003c10 msgr2=0x7f4b300044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4b59e700 1 --2- 172.21.15.133:0/3935020953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b30003c10 0x7f4b300044d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f4b400013e0 tx=0x7f4b4c0ac5c0).stop 2021-01-03T13:05:38.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4ad9d700 1 -- 172.21.15.133:0/3935020953 reap_dead start 2021-01-03T13:05:38.071 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4b59e700 1 -- 172.21.15.133:0/3935020953 shutdown_connections 2021-01-03T13:05:38.071 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4b59e700 1 -- 172.21.15.133:0/3935020953 >> 172.21.15.133:0/3935020953 conn(0x7f4b4c05bdf0 msgr2=0x7f4b4c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:38.071 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4b59e700 1 -- 172.21.15.133:0/3935020953 shutdown_connections 2021-01-03T13:05:38.071 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.045+0000 7f4b4b59e700 1 -- 172.21.15.133:0/3935020953 wait complete. 2021-01-03T13:05:38.071 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4b59e700 1 Processor -- start 2021-01-03T13:05:38.072 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4b59e700 1 -- start start 2021-01-03T13:05:38.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b4c1475f0 0x7f4b4c1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4b59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b4c1535d0 0x7f4b4c13d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4b59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4b4c13d8f0 0x7f4b4c13e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4b59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c140d90 con 0x7f4b4c1535d0 2021-01-03T13:05:38.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c140770 con 0x7f4b4c1475f0 2021-01-03T13:05:38.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4b59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c1479d0 con 0x7f4b4c13d8f0 2021-01-03T13:05:38.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b4c1475f0 0x7f4b4c1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b4c1475f0 0x7f4b4c1530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37324/0 (socket says 172.21.15.133:37324) 2021-01-03T13:05:38.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4a59c700 1 -- 172.21.15.133:0/479483512 learned_addr learned my addr 172.21.15.133:0/479483512 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:38.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4ad9d700 1 --2- 172.21.15.133:0/479483512 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4b4c13d8f0 0x7f4b4c13e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b49d9b700 1 --2- 172.21.15.133:0/479483512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b4c1535d0 0x7f4b4c13d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4a59c700 1 -- 172.21.15.133:0/479483512 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4b4c13d8f0 msgr2=0x7f4b4c13e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4a59c700 1 --2- 172.21.15.133:0/479483512 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4b4c13d8f0 0x7f4b4c13e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4a59c700 1 -- 172.21.15.133:0/479483512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b4c1535d0 msgr2=0x7f4b4c13d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4a59c700 1 --2- 172.21.15.133:0/479483512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b4c1535d0 0x7f4b4c13d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4a59c700 1 -- 172.21.15.133:0/479483512 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c141340 con 0x7f4b4c1475f0 2021-01-03T13:05:38.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4ad9d700 1 --2- 172.21.15.133:0/479483512 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4b4c13d8f0 0x7f4b4c13e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4a59c700 1 --2- 172.21.15.133:0/479483512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b4c1475f0 0x7f4b4c1530e0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f4b3c006ad0 tx=0x7f4b3c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b3b7fe700 1 -- 172.21.15.133:0/479483512 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b3c00fd70 con 0x7f4b4c1475f0 2021-01-03T13:05:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b3b7fe700 1 -- 172.21.15.133:0/479483512 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c00fed0 con 0x7f4b4c1475f0 2021-01-03T13:05:38.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4b59e700 1 -- 172.21.15.133:0/479483512 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4c1410c0 con 0x7f4b4c1475f0 2021-01-03T13:05:38.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b3b7fe700 1 -- 172.21.15.133:0/479483512 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b3c014630 con 0x7f4b4c1475f0 2021-01-03T13:05:38.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.049+0000 7f4b4b59e700 1 -- 172.21.15.133:0/479483512 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c153a30 con 0x7f4b4c1475f0 2021-01-03T13:05:38.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.053+0000 7f4b4b59e700 1 -- 172.21.15.133:0/479483512 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4c057300 con 0x7f4b4c1475f0 2021-01-03T13:05:38.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.053+0000 7f4b3b7fe700 1 -- 172.21.15.133:0/479483512 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4b3c024070 con 0x7f4b4c1475f0 2021-01-03T13:05:38.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.053+0000 7f4b3b7fe700 1 --2- 172.21.15.133:0/479483512 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4b28055440 0x7f4b28057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.053+0000 7f4b3b7fe700 1 -- 172.21.15.133:0/479483512 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4b3c06eb80 con 0x7f4b4c1475f0 2021-01-03T13:05:38.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.053+0000 7f4b49d9b700 1 --2- 172.21.15.133:0/479483512 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4b28055440 0x7f4b28057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.053+0000 7f4b49d9b700 1 --2- 172.21.15.133:0/479483512 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4b28055440 0x7f4b28057900 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f4b40005000 tx=0x7f4b40015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:38.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.061+0000 7f4b3b7fe700 1 -- 172.21.15.133:0/479483512 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4b3c044e80 con 0x7f4b4c1475f0 2021-01-03T13:05:38.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.197+0000 7f4b4b59e700 1 -- 172.21.15.133:0/479483512 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4b4c1414d0 con 0x7f4b4c1475f0 2021-01-03T13:05:38.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.197+0000 7f4b3b7fe700 1 -- 172.21.15.133:0/479483512 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v102) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4b3c0484a0 con 0x7f4b4c1475f0 2021-01-03T13:05:38.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.201+0000 7f4b4b59e700 1 -- 172.21.15.133:0/479483512 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4b28055440 msgr2=0x7f4b28057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.201+0000 7f4b4b59e700 1 --2- 172.21.15.133:0/479483512 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4b28055440 0x7f4b28057900 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f4b40005000 tx=0x7f4b40015000).stop 2021-01-03T13:05:38.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.201+0000 7f4b4b59e700 1 -- 172.21.15.133:0/479483512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b4c1475f0 msgr2=0x7f4b4c1530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.201+0000 7f4b4b59e700 1 --2- 172.21.15.133:0/479483512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b4c1475f0 0x7f4b4c1530e0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f4b3c006ad0 tx=0x7f4b3c0091a0).stop 2021-01-03T13:05:38.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.201+0000 7f4b4b59e700 1 -- 172.21.15.133:0/479483512 shutdown_connections 2021-01-03T13:05:38.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.201+0000 7f4b4b59e700 1 --2- 172.21.15.133:0/479483512 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4b28055440 0x7f4b28057900 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.201+0000 7f4b4b59e700 1 --2- 172.21.15.133:0/479483512 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4b4c13d8f0 0x7f4b4c13e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.201+0000 7f4b4b59e700 1 --2- 172.21.15.133:0/479483512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b4c1475f0 0x7f4b4c1530e0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.201+0000 7f4b4b59e700 1 --2- 172.21.15.133:0/479483512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b4c1535d0 0x7f4b4c13d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.201+0000 7f4b4b59e700 1 -- 172.21.15.133:0/479483512 >> 172.21.15.133:0/479483512 conn(0x7f4b4c05bdf0 msgr2=0x7f4b4c1438d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:38.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.201+0000 7f4b4b59e700 1 -- 172.21.15.133:0/479483512 shutdown_connections 2021-01-03T13:05:38.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.201+0000 7f4b4b59e700 1 -- 172.21.15.133:0/479483512 wait complete. 2021-01-03T13:05:38.211 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:05:38.235 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:05:38.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f7127fff700 1 Processor -- start 2021-01-03T13:05:38.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f7127fff700 1 -- start start 2021-01-03T13:05:38.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f7127fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7128060510 0x7f712805c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f7127fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f712805fd10 0x7f71280b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f7127fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712805bf00 con 0x7f71280b4c20 2021-01-03T13:05:38.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f7127fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712805c1a0 con 0x7f712805fd10 2021-01-03T13:05:38.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f7127fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712805c440 con 0x7f7128060510 2021-01-03T13:05:38.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f71277fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f712805fd10 0x7f71280b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f71277fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f712805fd10 0x7f71280b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37334/0 (socket says 172.21.15.133:37334) 2021-01-03T13:05:38.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f71277fe700 1 -- 172.21.15.133:0/1470062773 learned_addr learned my addr 172.21.15.133:0/1470062773 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:38.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f71267fc700 1 --2- 172.21.15.133:0/1470062773 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7128060510 0x7f712805c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f71277fe700 1 -- 172.21.15.133:0/1470062773 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7128060510 msgr2=0x7f712805c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:38.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f71277fe700 1 --2- 172.21.15.133:0/1470062773 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7128060510 0x7f712805c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f71277fe700 1 -- 172.21.15.133:0/1470062773 >> v1:172.21.15.16:6789/0 conn(0x7f71280b4c20 legacy=0x7f71280b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f71277fe700 1 -- 172.21.15.133:0/1470062773 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71280b6ad0 con 0x7f712805fd10 2021-01-03T13:05:38.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f71277fe700 1 --2- 172.21.15.133:0/1470062773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f712805fd10 0x7f71280b65e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f71200032b0 tx=0x7f7120009270).ready entity=mon.1 client_cookie=b14c328b3de6c1e1 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:38.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f7125ffb700 1 -- 172.21.15.133:0/1470062773 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7120009e60 con 0x7f712805fd10 2021-01-03T13:05:38.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f7125ffb700 1 -- 172.21.15.133:0/1470062773 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712000bc00 con 0x7f712805fd10 2021-01-03T13:05:38.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f7125ffb700 1 -- 172.21.15.133:0/1470062773 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f712000bd70 con 0x7f712805fd10 2021-01-03T13:05:38.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f7127fff700 1 -- 172.21.15.133:0/1470062773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f712805fd10 msgr2=0x7f71280b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.393+0000 7f7127fff700 1 --2- 172.21.15.133:0/1470062773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f712805fd10 0x7f71280b65e0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f71200032b0 tx=0x7f7120009270).stop 2021-01-03T13:05:38.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.397+0000 7f7127fff700 1 -- 172.21.15.133:0/1470062773 shutdown_connections 2021-01-03T13:05:38.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.397+0000 7f7127fff700 1 --2- 172.21.15.133:0/1470062773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f712805fd10 0x7f71280b65e0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.397+0000 7f7127fff700 1 --2- 172.21.15.133:0/1470062773 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7128060510 0x7f712805c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.397+0000 7f7127fff700 1 -- 172.21.15.133:0/1470062773 >> 172.21.15.133:0/1470062773 conn(0x7f71280b9f00 msgr2=0x7f71280b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:38.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.397+0000 7f7127fff700 1 -- 172.21.15.133:0/1470062773 shutdown_connections 2021-01-03T13:05:38.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.397+0000 7f7127fff700 1 -- 172.21.15.133:0/1470062773 wait complete. 2021-01-03T13:05:38.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.397+0000 7f7127fff700 1 Processor -- start 2021-01-03T13:05:38.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.397+0000 7f7127fff700 1 -- start start 2021-01-03T13:05:38.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f7127fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f712805fd10 0x7f712809e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f7127fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7128060510 0x7f71280b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f7127fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71280b4c20 0x7f7128154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f7127fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71280b07a0 con 0x7f7128060510 2021-01-03T13:05:38.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f7127fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71280b09d0 con 0x7f71280b4c20 2021-01-03T13:05:38.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f7127fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71280b0c70 con 0x7f712805fd10 2021-01-03T13:05:38.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f71277fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71280b4c20 0x7f7128154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f71277fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71280b4c20 0x7f7128154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37342/0 (socket says 172.21.15.133:37342) 2021-01-03T13:05:38.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f71277fe700 1 -- 172.21.15.133:0/1564180607 learned_addr learned my addr 172.21.15.133:0/1564180607 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:38.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f7126ffd700 1 --2- 172.21.15.133:0/1564180607 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f712805fd10 0x7f712809e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f71267fc700 1 --2- 172.21.15.133:0/1564180607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7128060510 0x7f71280b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f71277fe700 1 -- 172.21.15.133:0/1564180607 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f712805fd10 msgr2=0x7f712809e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f71277fe700 1 --2- 172.21.15.133:0/1564180607 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f712805fd10 0x7f712809e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f71277fe700 1 -- 172.21.15.133:0/1564180607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7128060510 msgr2=0x7f71280b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f71277fe700 1 --2- 172.21.15.133:0/1564180607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7128060510 0x7f71280b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f71277fe700 1 -- 172.21.15.133:0/1564180607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71280b0f10 con 0x7f71280b4c20 2021-01-03T13:05:38.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f71267fc700 1 --2- 172.21.15.133:0/1564180607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7128060510 0x7f71280b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:38.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f71277fe700 1 --2- 172.21.15.133:0/1564180607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71280b4c20 0x7f7128154f90 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f71200032b0 tx=0x7f7120016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:38.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f7117fff700 1 -- 172.21.15.133:0/1564180607 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71200107a0 con 0x7f71280b4c20 2021-01-03T13:05:38.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f7117fff700 1 -- 172.21.15.133:0/1564180607 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7120010900 con 0x7f71280b4c20 2021-01-03T13:05:38.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f7127fff700 1 -- 172.21.15.133:0/1564180607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71280b1e60 con 0x7f71280b4c20 2021-01-03T13:05:38.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f7117fff700 1 -- 172.21.15.133:0/1564180607 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7120010c60 con 0x7f71280b4c20 2021-01-03T13:05:38.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f7127fff700 1 -- 172.21.15.133:0/1564180607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71280b13b0 con 0x7f71280b4c20 2021-01-03T13:05:38.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f7117fff700 1 -- 172.21.15.133:0/1564180607 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f712000f070 con 0x7f71280b4c20 2021-01-03T13:05:38.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f7127fff700 1 -- 172.21.15.133:0/1564180607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71280b10a0 con 0x7f71280b4c20 2021-01-03T13:05:38.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f7117fff700 1 --2- 172.21.15.133:0/1564180607 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7104055440 0x7f7104057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f7126ffd700 1 --2- 172.21.15.133:0/1564180607 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7104055440 0x7f7104057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.401+0000 7f7117fff700 1 -- 172.21.15.133:0/1564180607 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f712006f7d0 con 0x7f71280b4c20 2021-01-03T13:05:38.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.405+0000 7f7126ffd700 1 --2- 172.21.15.133:0/1564180607 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7104055440 0x7f7104057900 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f711800b000 tx=0x7f7118009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:38.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.409+0000 7f7117fff700 1 -- 172.21.15.133:0/1564180607 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f71200459c0 con 0x7f71280b4c20 2021-01-03T13:05:38.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.549+0000 7f7127fff700 1 -- 172.21.15.133:0/1564180607 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7128057300 con 0x7f71280b4c20 2021-01-03T13:05:38.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.549+0000 7f7117fff700 1 -- 172.21.15.133:0/1564180607 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7120048fe0 con 0x7f71280b4c20 2021-01-03T13:05:38.556 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:05:38.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.553+0000 7f7127fff700 1 -- 172.21.15.133:0/1564180607 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7104055440 msgr2=0x7f7104057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.553+0000 7f7127fff700 1 --2- 172.21.15.133:0/1564180607 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7104055440 0x7f7104057900 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f711800b000 tx=0x7f7118009040).stop 2021-01-03T13:05:38.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.553+0000 7f7127fff700 1 -- 172.21.15.133:0/1564180607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71280b4c20 msgr2=0x7f7128154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.553+0000 7f7127fff700 1 --2- 172.21.15.133:0/1564180607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71280b4c20 0x7f7128154f90 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f71200032b0 tx=0x7f7120016000).stop 2021-01-03T13:05:38.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.553+0000 7f7127fff700 1 -- 172.21.15.133:0/1564180607 shutdown_connections 2021-01-03T13:05:38.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.553+0000 7f7127fff700 1 --2- 172.21.15.133:0/1564180607 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7104055440 0x7f7104057900 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.553+0000 7f7127fff700 1 --2- 172.21.15.133:0/1564180607 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71280b4c20 0x7f7128154f90 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.553+0000 7f7127fff700 1 --2- 172.21.15.133:0/1564180607 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f712805fd10 0x7f712809e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.553+0000 7f7127fff700 1 --2- 172.21.15.133:0/1564180607 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7128060510 0x7f71280b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.553+0000 7f7127fff700 1 -- 172.21.15.133:0/1564180607 >> 172.21.15.133:0/1564180607 conn(0x7f71280b9f00 msgr2=0x7f71280b3900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:38.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.553+0000 7f7127fff700 1 -- 172.21.15.133:0/1564180607 shutdown_connections 2021-01-03T13:05:38.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.553+0000 7f7127fff700 1 -- 172.21.15.133:0/1564180607 wait complete. 2021-01-03T13:05:38.573 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:05:38.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56e4da700 1 Processor -- start 2021-01-03T13:05:38.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56e4da700 1 -- start start 2021-01-03T13:05:38.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56e4da700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb56805f920 0x7fb5680b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56e4da700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb568066f30 0x7fb5680b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56e4da700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56805fd00 con 0x7fb5680b1590 2021-01-03T13:05:38.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56e4da700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5680ae700 con 0x7fb56805f920 2021-01-03T13:05:38.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56e4da700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5680accd0 con 0x7fb568066f30 2021-01-03T13:05:38.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56ccd7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb568066f30 0x7fb5680b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56ccd7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb568066f30 0x7fb5680b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37346/0 (socket says 172.21.15.133:37346) 2021-01-03T13:05:38.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56ccd7700 1 -- 172.21.15.133:0/3971828698 learned_addr learned my addr 172.21.15.133:0/3971828698 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:38.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56d4d8700 1 --2- 172.21.15.133:0/3971828698 >> v2:172.21.15.16:3300/0 conn(0x7fb56805f920 0x7fb5680b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56ccd7700 1 -- 172.21.15.133:0/3971828698 >> v2:172.21.15.16:3300/0 conn(0x7fb56805f920 msgr2=0x7fb5680b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:38.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56ccd7700 1 --2- 172.21.15.133:0/3971828698 >> v2:172.21.15.16:3300/0 conn(0x7fb56805f920 0x7fb5680b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56ccd7700 1 -- 172.21.15.133:0/3971828698 >> v1:172.21.15.16:6789/0 conn(0x7fb5680b1590 legacy=0x7fb5680613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56ccd7700 1 -- 172.21.15.133:0/3971828698 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5680acf70 con 0x7fb568066f30 2021-01-03T13:05:38.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56ccd7700 1 --2- 172.21.15.133:0/3971828698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb568066f30 0x7fb5680b2270 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7fb564002f30 tx=0x7fb564006e80).ready entity=mon.1 client_cookie=20810e60efaa2e08 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:38.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb55bfff700 1 -- 172.21.15.133:0/3971828698 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5640097f0 con 0x7fb568066f30 2021-01-03T13:05:38.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb55bfff700 1 -- 172.21.15.133:0/3971828698 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb564009950 con 0x7fb568066f30 2021-01-03T13:05:38.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb55bfff700 1 -- 172.21.15.133:0/3971828698 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb564009cb0 con 0x7fb568066f30 2021-01-03T13:05:38.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56e4da700 1 -- 172.21.15.133:0/3971828698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb568066f30 msgr2=0x7fb5680b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56e4da700 1 --2- 172.21.15.133:0/3971828698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb568066f30 0x7fb5680b2270 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7fb564002f30 tx=0x7fb564006e80).stop 2021-01-03T13:05:38.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56e4da700 1 -- 172.21.15.133:0/3971828698 shutdown_connections 2021-01-03T13:05:38.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56e4da700 1 --2- 172.21.15.133:0/3971828698 >> v2:172.21.15.16:3300/0 conn(0x7fb56805f920 0x7fb5680b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56e4da700 1 --2- 172.21.15.133:0/3971828698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb568066f30 0x7fb5680b2270 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56e4da700 1 -- 172.21.15.133:0/3971828698 >> 172.21.15.133:0/3971828698 conn(0x7fb5680b6110 msgr2=0x7fb5680b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:38.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56e4da700 1 -- 172.21.15.133:0/3971828698 shutdown_connections 2021-01-03T13:05:38.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.689+0000 7fb56e4da700 1 -- 172.21.15.133:0/3971828698 wait complete. 2021-01-03T13:05:38.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56e4da700 1 Processor -- start 2021-01-03T13:05:38.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56e4da700 1 -- start start 2021-01-03T13:05:38.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56e4da700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb56805f920 0x7fb568142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56e4da700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb568066f30 0x7fb56813f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56e4da700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5680b1590 0x7fb56813f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56e4da700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb568146ad0 con 0x7fb56805f920 2021-01-03T13:05:38.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56e4da700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb568147cb0 con 0x7fb568066f30 2021-01-03T13:05:38.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56e4da700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb568146d00 con 0x7fb5680b1590 2021-01-03T13:05:38.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56ccd7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb568066f30 0x7fb56813f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56ccd7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb568066f30 0x7fb56813f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37354/0 (socket says 172.21.15.133:37354) 2021-01-03T13:05:38.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56ccd7700 1 -- 172.21.15.133:0/1694264437 learned_addr learned my addr 172.21.15.133:0/1694264437 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:38.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56dcd9700 1 --2- 172.21.15.133:0/1694264437 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5680b1590 0x7fb56813f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56d4d8700 1 --2- 172.21.15.133:0/1694264437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb56805f920 0x7fb568142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56ccd7700 1 -- 172.21.15.133:0/1694264437 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5680b1590 msgr2=0x7fb56813f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56ccd7700 1 --2- 172.21.15.133:0/1694264437 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5680b1590 0x7fb56813f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56ccd7700 1 -- 172.21.15.133:0/1694264437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb56805f920 msgr2=0x7fb568142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56ccd7700 1 --2- 172.21.15.133:0/1694264437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb56805f920 0x7fb568142db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56ccd7700 1 -- 172.21.15.133:0/1694264437 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb568146fa0 con 0x7fb568066f30 2021-01-03T13:05:38.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56ccd7700 1 --2- 172.21.15.133:0/1694264437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb568066f30 0x7fb56813f360 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7fb564002f30 tx=0x7fb564015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:38.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb55a7fc700 1 -- 172.21.15.133:0/1694264437 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb564011c10 con 0x7fb568066f30 2021-01-03T13:05:38.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb55a7fc700 1 -- 172.21.15.133:0/1694264437 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb564011d70 con 0x7fb568066f30 2021-01-03T13:05:38.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56e4da700 1 -- 172.21.15.133:0/1694264437 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb568143630 con 0x7fb568066f30 2021-01-03T13:05:38.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb55a7fc700 1 -- 172.21.15.133:0/1694264437 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb56401e650 con 0x7fb568066f30 2021-01-03T13:05:38.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.693+0000 7fb56e4da700 1 -- 172.21.15.133:0/1694264437 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56809f4a0 con 0x7fb568066f30 2021-01-03T13:05:38.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.697+0000 7fb56e4da700 1 -- 172.21.15.133:0/1694264437 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb568147a70 con 0x7fb568066f30 2021-01-03T13:05:38.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.697+0000 7fb55a7fc700 1 -- 172.21.15.133:0/1694264437 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb56401a040 con 0x7fb568066f30 2021-01-03T13:05:38.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.697+0000 7fb55a7fc700 1 --2- 172.21.15.133:0/1694264437 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5480554e0 0x7fb5480579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.697+0000 7fb55a7fc700 1 -- 172.21.15.133:0/1694264437 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb56406ef40 con 0x7fb568066f30 2021-01-03T13:05:38.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.697+0000 7fb56d4d8700 1 --2- 172.21.15.133:0/1694264437 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5480554e0 0x7fb5480579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.697+0000 7fb56d4d8700 1 --2- 172.21.15.133:0/1694264437 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5480554e0 0x7fb5480579a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7fb55c00c000 tx=0x7fb55c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:38.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.705+0000 7fb55a7fc700 1 -- 172.21.15.133:0/1694264437 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb56406adf0 con 0x7fb568066f30 2021-01-03T13:05:38.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.849+0000 7fb56e4da700 1 -- 172.21.15.133:0/1694264437 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb568147df0 con 0x7fb568066f30 2021-01-03T13:05:38.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.849+0000 7fb55a7fc700 1 -- 172.21.15.133:0/1694264437 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb564023020 con 0x7fb568066f30 2021-01-03T13:05:38.856 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:05:38.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.853+0000 7fb56e4da700 1 -- 172.21.15.133:0/1694264437 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5480554e0 msgr2=0x7fb5480579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.853+0000 7fb56e4da700 1 --2- 172.21.15.133:0/1694264437 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5480554e0 0x7fb5480579a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7fb55c00c000 tx=0x7fb55c008040).stop 2021-01-03T13:05:38.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.853+0000 7fb56e4da700 1 -- 172.21.15.133:0/1694264437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb568066f30 msgr2=0x7fb56813f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:38.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.853+0000 7fb56e4da700 1 --2- 172.21.15.133:0/1694264437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb568066f30 0x7fb56813f360 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7fb564002f30 tx=0x7fb564015000).stop 2021-01-03T13:05:38.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.853+0000 7fb56e4da700 1 -- 172.21.15.133:0/1694264437 shutdown_connections 2021-01-03T13:05:38.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.853+0000 7fb56e4da700 1 --2- 172.21.15.133:0/1694264437 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb5480554e0 0x7fb5480579a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.853+0000 7fb56e4da700 1 --2- 172.21.15.133:0/1694264437 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb56805f920 0x7fb568142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.853+0000 7fb56e4da700 1 --2- 172.21.15.133:0/1694264437 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb5680b1590 0x7fb56813f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.853+0000 7fb56e4da700 1 --2- 172.21.15.133:0/1694264437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb568066f30 0x7fb56813f360 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:38.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.853+0000 7fb56e4da700 1 -- 172.21.15.133:0/1694264437 >> 172.21.15.133:0/1694264437 conn(0x7fb5680b6110 msgr2=0x7fb568065af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:38.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.853+0000 7fb56e4da700 1 -- 172.21.15.133:0/1694264437 shutdown_connections 2021-01-03T13:05:38.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.853+0000 7fb56e4da700 1 -- 172.21.15.133:0/1694264437 wait complete. 2021-01-03T13:05:38.870 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:05:38.871 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:05:38.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.981+0000 7fea25e4f700 1 Processor -- start 2021-01-03T13:05:38.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.981+0000 7fea25e4f700 1 -- start start 2021-01-03T13:05:38.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea25e4f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea200b0210 0x7fea20141180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:38.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea25e4f700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea200af5e0 con 0x7fea200af200 2021-01-03T13:05:38.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea25e4f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2005c620 con 0x7fea20144bb0 2021-01-03T13:05:38.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea25e4f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2005c8c0 con 0x7fea200b0210 2021-01-03T13:05:38.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea2564e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fea20144bb0 0x7fea200ab300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58396/0 (socket says 172.21.15.133:58396) 2021-01-03T13:05:38.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea2564e700 1 -- 172.21.15.133:0/3505255260 learned_addr learned my addr 172.21.15.133:0/3505255260 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:38.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea1ffff700 1 --2- 172.21.15.133:0/3505255260 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea200b0210 0x7fea20141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:38.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea1f7fe700 1 -- 172.21.15.133:0/3505255260 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820834233 0 0) 0x7fea2005c620 con 0x7fea20144bb0 2021-01-03T13:05:38.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea1f7fe700 1 -- 172.21.15.133:0/3505255260 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea0c003230 con 0x7fea20144bb0 2021-01-03T13:05:38.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea1f7fe700 1 -- 172.21.15.133:0/3505255260 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3181489541 0 0) 0x7fea200af5e0 con 0x7fea200af200 2021-01-03T13:05:38.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea1f7fe700 1 -- 172.21.15.133:0/3505255260 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea2005c620 con 0x7fea200af200 2021-01-03T13:05:39.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea1f7fe700 1 -- 172.21.15.133:0/3505255260 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2138134190 0 0) 0x7fea0c003230 con 0x7fea20144bb0 2021-01-03T13:05:39.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea1ffff700 1 -- 172.21.15.133:0/3505255260 >> v1:172.21.15.133:6789/0 conn(0x7fea20144bb0 legacy=0x7fea200ab300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:39.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea1ffff700 1 -- 172.21.15.133:0/3505255260 >> v1:172.21.15.16:6789/0 conn(0x7fea200af200 legacy=0x7fea2005bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:39.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea1ffff700 1 -- 172.21.15.133:0/3505255260 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea20140a40 con 0x7fea200b0210 2021-01-03T13:05:39.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea1ffff700 1 --2- 172.21.15.133:0/3505255260 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea200b0210 0x7fea20141180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fea18001450 tx=0x7fea14006dc0).ready entity=mon.2 client_cookie=2ee28fe27d1f325d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:39.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea1f7fe700 1 -- 172.21.15.133:0/3505255260 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea18001a70 con 0x7fea200b0210 2021-01-03T13:05:39.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea1f7fe700 1 -- 172.21.15.133:0/3505255260 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1400d5c0 con 0x7fea200b0210 2021-01-03T13:05:39.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea1f7fe700 1 -- 172.21.15.133:0/3505255260 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea1400d730 con 0x7fea200b0210 2021-01-03T13:05:39.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea25e4f700 1 -- 172.21.15.133:0/3505255260 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea200b0210 msgr2=0x7fea20141180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:39.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.985+0000 7fea25e4f700 1 --2- 172.21.15.133:0/3505255260 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea200b0210 0x7fea20141180 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fea18001450 tx=0x7fea14006dc0).stop 2021-01-03T13:05:39.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea25e4f700 1 -- 172.21.15.133:0/3505255260 shutdown_connections 2021-01-03T13:05:39.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea25e4f700 1 --2- 172.21.15.133:0/3505255260 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea200b0210 0x7fea20141180 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:39.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea25e4f700 1 -- 172.21.15.133:0/3505255260 >> 172.21.15.133:0/3505255260 conn(0x7fea2006b050 msgr2=0x7fea20060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:39.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea25e4f700 1 -- 172.21.15.133:0/3505255260 shutdown_connections 2021-01-03T13:05:39.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea25e4f700 1 -- 172.21.15.133:0/3505255260 wait complete. 2021-01-03T13:05:39.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea25e4f700 1 Processor -- start 2021-01-03T13:05:39.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea25e4f700 1 -- start start 2021-01-03T13:05:39.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea25e4f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea200af200 0x7fea20143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:39.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea25e4f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea200b0210 0x7fea20066a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:39.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea25e4f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea20144bb0 0x7fea2013db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:39.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea25e4f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea20062f70 con 0x7fea200af200 2021-01-03T13:05:39.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea25e4f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea20063520 con 0x7fea200b0210 2021-01-03T13:05:39.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea25e4f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea200637b0 con 0x7fea20144bb0 2021-01-03T13:05:39.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea1ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea200b0210 0x7fea20066a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:39.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea24e4d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea200af200 0x7fea20143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:39.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea1ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea200b0210 0x7fea20066a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37368/0 (socket says 172.21.15.133:37368) 2021-01-03T13:05:39.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea1ffff700 1 -- 172.21.15.133:0/3857903740 learned_addr learned my addr 172.21.15.133:0/3857903740 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:39.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.989+0000 7fea2564e700 1 --2- 172.21.15.133:0/3857903740 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea20144bb0 0x7fea2013db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:39.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.993+0000 7fea24e4d700 1 -- 172.21.15.133:0/3857903740 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea20144bb0 msgr2=0x7fea2013db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:39.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.993+0000 7fea24e4d700 1 --2- 172.21.15.133:0/3857903740 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea20144bb0 0x7fea2013db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:39.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.993+0000 7fea24e4d700 1 -- 172.21.15.133:0/3857903740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea200b0210 msgr2=0x7fea20066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:39.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.993+0000 7fea24e4d700 1 --2- 172.21.15.133:0/3857903740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea200b0210 0x7fea20066a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:39.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.993+0000 7fea24e4d700 1 -- 172.21.15.133:0/3857903740 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea200631a0 con 0x7fea200af200 2021-01-03T13:05:39.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.993+0000 7fea24e4d700 1 --2- 172.21.15.133:0/3857903740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea200af200 0x7fea20143090 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fea100010d0 tx=0x7fea100079f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:39.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.993+0000 7fea1dffb700 1 -- 172.21.15.133:0/3857903740 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea1000f470 con 0x7fea200af200 2021-01-03T13:05:39.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.993+0000 7fea1dffb700 1 -- 172.21.15.133:0/3857903740 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1000f5d0 con 0x7fea200af200 2021-01-03T13:05:39.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.993+0000 7fea25e4f700 1 -- 172.21.15.133:0/3857903740 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea20143a60 con 0x7fea200af200 2021-01-03T13:05:39.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.993+0000 7fea1dffb700 1 -- 172.21.15.133:0/3857903740 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea1000f930 con 0x7fea200af200 2021-01-03T13:05:39.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.993+0000 7fea25e4f700 1 -- 172.21.15.133:0/3857903740 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea200ae690 con 0x7fea200af200 2021-01-03T13:05:39.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.993+0000 7fea25e4f700 1 -- 172.21.15.133:0/3857903740 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea20057300 con 0x7fea200af200 2021-01-03T13:05:39.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.993+0000 7fea1dffb700 1 -- 172.21.15.133:0/3857903740 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fea10019030 con 0x7fea200af200 2021-01-03T13:05:39.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.993+0000 7fea1dffb700 1 --2- 172.21.15.133:0/3857903740 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea000553b0 0x7fea00057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:39.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.993+0000 7fea1dffb700 1 -- 172.21.15.133:0/3857903740 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fea1006d640 con 0x7fea200af200 2021-01-03T13:05:39.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.993+0000 7fea1ffff700 1 --2- 172.21.15.133:0/3857903740 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea000553b0 0x7fea00057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:39.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:38.997+0000 7fea1ffff700 1 --2- 172.21.15.133:0/3857903740 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea000553b0 0x7fea00057870 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fea1401b000 tx=0x7fea14015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:39.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:39.005+0000 7fea1dffb700 1 -- 172.21.15.133:0/3857903740 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fea10043830 con 0x7fea200af200 2021-01-03T13:05:39.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:39.193+0000 7fea25e4f700 1 -- 172.21.15.133:0/3857903740 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea20063360 con 0x7fea200af200 2021-01-03T13:05:39.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:39.193+0000 7fea1dffb700 1 -- 172.21.15.133:0/3857903740 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2499 (secure 0 0 0) 0x7fea100349e0 con 0x7fea200af200 2021-01-03T13:05:39.199 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:39.199 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":43,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6014,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1098287672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1098287672},{"type":"v1","addr":"172.21.15.133:6837","nonce":1098287672}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1817607475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1817607475},{"type":"v1","addr":"172.21.15.16:6833","nonce":1817607475}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:34.203844+0000","modified":"2021-01-03T13:05:35.206833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6817},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6817":{"gid":6817,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/1339474843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1339474843},{"type":"v1","addr":"172.21.15.133:6835","nonce":1339474843}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-01-03T13:05:39.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:39.193+0000 7fea25e4f700 1 -- 172.21.15.133:0/3857903740 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea000553b0 msgr2=0x7fea00057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:39.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:39.193+0000 7fea25e4f700 1 --2- 172.21.15.133:0/3857903740 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea000553b0 0x7fea00057870 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fea1401b000 tx=0x7fea14015000).stop 2021-01-03T13:05:39.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:39.193+0000 7fea25e4f700 1 -- 172.21.15.133:0/3857903740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea200af200 msgr2=0x7fea20143090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:39.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:39.193+0000 7fea25e4f700 1 --2- 172.21.15.133:0/3857903740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea200af200 0x7fea20143090 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fea100010d0 tx=0x7fea100079f0).stop 2021-01-03T13:05:39.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:39.193+0000 7fea25e4f700 1 -- 172.21.15.133:0/3857903740 shutdown_connections 2021-01-03T13:05:39.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:39.193+0000 7fea25e4f700 1 --2- 172.21.15.133:0/3857903740 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea000553b0 0x7fea00057870 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:39.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:39.193+0000 7fea25e4f700 1 --2- 172.21.15.133:0/3857903740 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea200af200 0x7fea20143090 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:39.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:39.193+0000 7fea25e4f700 1 --2- 172.21.15.133:0/3857903740 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea20144bb0 0x7fea2013db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:39.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:39.193+0000 7fea25e4f700 1 --2- 172.21.15.133:0/3857903740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea200b0210 0x7fea20066a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:39.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:39.193+0000 7fea25e4f700 1 -- 172.21.15.133:0/3857903740 >> 172.21.15.133:0/3857903740 conn(0x7fea2006b050 msgr2=0x7fea201410a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:39.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:39.193+0000 7fea25e4f700 1 -- 172.21.15.133:0/3857903740 shutdown_connections 2021-01-03T13:05:39.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:39.193+0000 7fea25e4f700 1 -- 172.21.15.133:0/3857903740 wait complete. 2021-01-03T13:05:39.214 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 43 2021-01-03T13:05:39.519 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:05:34.203844+0000', 'modified': '2021-01-03T13:05:35.206833+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6817}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6817': {'gid': 6817, 'name': 'c', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6835/1339474843', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 1339474843}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 1339474843}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:05:39.520 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:05:39.521 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T13:05:39.652 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":6817,"want_state":"up:active","state":"up:active","rank_uptime":5.4335043479999996,"mdsmap_epoch":43,"osdmap_epoch":102,"osdmap_epoch_barrier":100,"uptime":9.8309100049999998} 2021-01-03T13:05:39.653 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 6817, "mdsmap_epoch": 43, "osdmap_epoch": 102, "osdmap_epoch_barrier": 100, "rank_uptime": 5.433504348, "state": "up:active", "uptime": 9.830910005, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:05:39.660 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:05:39.661 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-01-03T13:05:39.661 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi007.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-01-03T13:05:39.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:39.662 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:39.670 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:05:39.728 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:05:39.729 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:05:39.784 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:05:39.786 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:05:39.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:39.787 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:05:39.835 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:05:39.836 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:39.879 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:05:39.898 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:05:39.898 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:05:39.955 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:05:39.956 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:05:39.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:39.958 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:05:39.959 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2021-01-03T13:05:39.952+0000 7fa60373b0c0 -1 init, newargv = 0x55c7e6d332c0 newargc=9 2021-01-03T13:05:39.959 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12448]: starting ceph client 2021-01-03T13:05:39.978 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12448]: starting fuse 2021-01-03T13:05:41.066 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:05:41.083 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:05:41.083 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:05:41.140 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:05:41.141 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:05:41.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:41.143 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:05:41.191 INFO:teuthology.orchestra.run.smithi007.stdout:50 2021-01-03T13:05:41.192 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:05:41.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:41.193 DEBUG:teuthology.orchestra.run.smithi007:> sudo python3 -c ' 2021-01-03T13:05:41.193 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2021-01-03T13:05:41.194 DEBUG:teuthology.orchestra.run.smithi007:> import re 2021-01-03T13:05:41.194 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:05:41.195 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2021-01-03T13:05:41.195 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:05:41.195 DEBUG:teuthology.orchestra.run.smithi007:> def find_socket(client_name): 2021-01-03T13:05:41.196 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-01-03T13:05:41.196 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2021-01-03T13:05:41.197 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:05:41.197 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2021-01-03T13:05:41.197 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2021-01-03T13:05:41.198 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2021-01-03T13:05:41.198 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2021-01-03T13:05:41.199 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:05:41.199 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2021-01-03T13:05:41.200 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:05:41.200 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:05:41.200 DEBUG:teuthology.orchestra.run.smithi007:> return f 2021-01-03T13:05:41.201 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:05:41.201 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:05:41.202 DEBUG:teuthology.orchestra.run.smithi007:> print(find_socket("client.0")) 2021-01-03T13:05:41.202 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:05:41.284 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.12448.asok 2021-01-03T13:05:41.291 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12448.asok 2021-01-03T13:05:41.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:41.292 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12448.asok status 2021-01-03T13:05:41.397 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2021-01-03T13:05:41.397 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2021-01-03T13:05:41.397 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:05:41.398 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:05:41.398 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2021-01-03T13:05:41.398 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2021-01-03T13:05:41.398 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-01-03T13:05:41.398 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "12448", 2021-01-03T13:05:41.399 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2021-01-03T13:05:41.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:05:41.399 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2021-01-03T13:05:41.399 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2021-01-03T13:05:41.399 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 6122, 2021-01-03T13:05:41.400 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2021-01-03T13:05:41.400 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2021-01-03T13:05:41.400 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2021-01-03T13:05:41.400 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 6122 2021-01-03T13:05:41.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:05:41.401 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:05:41.401 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:05:41.401 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:05:41.401 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1839052252 2021-01-03T13:05:41.402 INFO:teuthology.orchestra.run.smithi007.stdout: } 2021-01-03T13:05:41.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:05:41.402 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:05:41.402 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:05:41.403 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:05:41.403 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1839052252 2021-01-03T13:05:41.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:05:41.403 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.6122 172.21.15.7:0/1839052252", 2021-01-03T13:05:41.403 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "172.21.15.7:0/1839052252", 2021-01-03T13:05:41.404 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2021-01-03T13:05:41.404 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 43, 2021-01-03T13:05:41.404 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 102, 2021-01-03T13:05:41.404 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:05:41.405 INFO:teuthology.orchestra.run.smithi007.stdout: "blacklisted": false, 2021-01-03T13:05:41.405 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2021-01-03T13:05:41.405 INFO:teuthology.orchestra.run.smithi007.stdout:} 2021-01-03T13:05:41.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:41.408 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:05:41.408 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:41.415 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:05:41.416 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:05:41.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:41.417 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:41.475 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:05:41.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.593+0000 7fc530ef2700 1 Processor -- start 2021-01-03T13:05:41.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.593+0000 7fc530ef2700 1 -- start start 2021-01-03T13:05:41.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.593+0000 7fc530ef2700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc52c0b5ae0 0x7fc52c0abd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:41.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.593+0000 7fc530ef2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc52c099ff0 0x7fc52c13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:41.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.593+0000 7fc530ef2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52c0b5710 con 0x7fc52c0b5330 2021-01-03T13:05:41.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.593+0000 7fc530ef2700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52c0b10f0 con 0x7fc52c0b5ae0 2021-01-03T13:05:41.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.593+0000 7fc530ef2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c0ac270 con 0x7fc52c099ff0 2021-01-03T13:05:41.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.593+0000 7fc52b7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc52c0b5330 0x7fc52c142c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58406/0 (socket says 172.21.15.133:58406) 2021-01-03T13:05:41.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.593+0000 7fc52b7fe700 1 -- 172.21.15.133:0/3815859912 learned_addr learned my addr 172.21.15.133:0/3815859912 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:41.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc52bfff700 1 --2- 172.21.15.133:0/3815859912 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc52c099ff0 0x7fc52c13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:41.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc52affd700 1 --2- 172.21.15.133:0/3815859912 >> v2:172.21.15.16:3300/0 conn(0x7fc52c0b5ae0 0x7fc52c0abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:41.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc52a7fc700 1 -- 172.21.15.133:0/3815859912 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152173073 0 0) 0x7fc52c0b5710 con 0x7fc52c0b5330 2021-01-03T13:05:41.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc52a7fc700 1 -- 172.21.15.133:0/3815859912 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc518003230 con 0x7fc52c0b5330 2021-01-03T13:05:41.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc52bfff700 1 -- 172.21.15.133:0/3815859912 >> v2:172.21.15.16:3300/0 conn(0x7fc52c0b5ae0 msgr2=0x7fc52c0abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:41.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc52a7fc700 1 -- 172.21.15.133:0/3815859912 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3282009798 0 0) 0x7fc518003230 con 0x7fc52c0b5330 2021-01-03T13:05:41.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc52bfff700 1 --2- 172.21.15.133:0/3815859912 >> v2:172.21.15.16:3300/0 conn(0x7fc52c0b5ae0 0x7fc52c0abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:41.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc52bfff700 1 -- 172.21.15.133:0/3815859912 >> v1:172.21.15.133:6789/0 conn(0x7fc52c0b5330 legacy=0x7fc52c142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:41.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc52bfff700 1 -- 172.21.15.133:0/3815859912 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c0ab280 con 0x7fc52c099ff0 2021-01-03T13:05:41.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc52affd700 1 --2- 172.21.15.133:0/3815859912 >> v2:172.21.15.16:3300/0 conn(0x7fc52c0b5ae0 0x7fc52c0abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:41.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc52bfff700 1 --2- 172.21.15.133:0/3815859912 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc52c099ff0 0x7fc52c13fe70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fc5240032b0 tx=0x7fc5240091a0).ready entity=mon.2 client_cookie=47d6feaf487a7bdf server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:41.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc52a7fc700 1 -- 172.21.15.133:0/3815859912 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc52400b940 con 0x7fc52c099ff0 2021-01-03T13:05:41.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc52a7fc700 1 -- 172.21.15.133:0/3815859912 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52400baa0 con 0x7fc52c099ff0 2021-01-03T13:05:41.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc52a7fc700 1 -- 172.21.15.133:0/3815859912 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc52400bc10 con 0x7fc52c099ff0 2021-01-03T13:05:41.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc530ef2700 1 -- 172.21.15.133:0/3815859912 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc52c099ff0 msgr2=0x7fc52c13fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:41.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc530ef2700 1 --2- 172.21.15.133:0/3815859912 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc52c099ff0 0x7fc52c13fe70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fc5240032b0 tx=0x7fc5240091a0).stop 2021-01-03T13:05:41.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc530ef2700 1 -- 172.21.15.133:0/3815859912 shutdown_connections 2021-01-03T13:05:41.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc530ef2700 1 --2- 172.21.15.133:0/3815859912 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc52c099ff0 0x7fc52c13fe70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:41.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc530ef2700 1 --2- 172.21.15.133:0/3815859912 >> v2:172.21.15.16:3300/0 conn(0x7fc52c0b5ae0 0x7fc52c0abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:41.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc530ef2700 1 -- 172.21.15.133:0/3815859912 >> 172.21.15.133:0/3815859912 conn(0x7fc52c05bdf0 msgr2=0x7fc52c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:41.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc530ef2700 1 -- 172.21.15.133:0/3815859912 shutdown_connections 2021-01-03T13:05:41.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.597+0000 7fc530ef2700 1 -- 172.21.15.133:0/3815859912 wait complete. 2021-01-03T13:05:41.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc530ef2700 1 Processor -- start 2021-01-03T13:05:41.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc530ef2700 1 -- start start 2021-01-03T13:05:41.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc530ef2700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc52c099ff0 0x7fc52c0ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:41.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc530ef2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52c0b5330 0x7fc52c0ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:41.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc530ef2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc52c0b5ae0 0x7fc52c0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:41.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc530ef2700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c145930 con 0x7fc52c099ff0 2021-01-03T13:05:41.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc530ef2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c152530 con 0x7fc52c0b5330 2021-01-03T13:05:41.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc530ef2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c1527d0 con 0x7fc52c0b5ae0 2021-01-03T13:05:41.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc52affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52c0b5330 0x7fc52c0ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:41.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc52affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52c0b5330 0x7fc52c0ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37382/0 (socket says 172.21.15.133:37382) 2021-01-03T13:05:41.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc52affd700 1 -- 172.21.15.133:0/1293963433 learned_addr learned my addr 172.21.15.133:0/1293963433 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:41.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc52bfff700 1 --2- 172.21.15.133:0/1293963433 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc52c0b5ae0 0x7fc52c0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:41.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc52b7fe700 1 --2- 172.21.15.133:0/1293963433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc52c099ff0 0x7fc52c0ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:41.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc52affd700 1 -- 172.21.15.133:0/1293963433 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc52c0b5ae0 msgr2=0x7fc52c0aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:41.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc52affd700 1 --2- 172.21.15.133:0/1293963433 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc52c0b5ae0 0x7fc52c0aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:41.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc52affd700 1 -- 172.21.15.133:0/1293963433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc52c099ff0 msgr2=0x7fc52c0ad8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:41.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc52affd700 1 --2- 172.21.15.133:0/1293963433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc52c099ff0 0x7fc52c0ad8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:41.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc52affd700 1 -- 172.21.15.133:0/1293963433 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c0ae410 con 0x7fc52c0b5330 2021-01-03T13:05:41.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc52affd700 1 --2- 172.21.15.133:0/1293963433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52c0b5330 0x7fc52c0ae8b0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7fc52c0ad4e0 tx=0x7fc520008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:41.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc528ff9700 1 -- 172.21.15.133:0/1293963433 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc52000c8f0 con 0x7fc52c0b5330 2021-01-03T13:05:41.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc530ef2700 1 -- 172.21.15.133:0/1293963433 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52c0af290 con 0x7fc52c0b5330 2021-01-03T13:05:41.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc530ef2700 1 -- 172.21.15.133:0/1293963433 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52c1441f0 con 0x7fc52c0b5330 2021-01-03T13:05:41.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc528ff9700 1 -- 172.21.15.133:0/1293963433 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52000ca50 con 0x7fc52c0b5330 2021-01-03T13:05:41.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.601+0000 7fc528ff9700 1 -- 172.21.15.133:0/1293963433 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc52000cdb0 con 0x7fc52c0b5330 2021-01-03T13:05:41.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.605+0000 7fc530ef2700 1 -- 172.21.15.133:0/1293963433 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5080033e0 con 0x7fc52c0b5330 2021-01-03T13:05:41.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.605+0000 7fc528ff9700 1 -- 172.21.15.133:0/1293963433 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc52001b400 con 0x7fc52c0b5330 2021-01-03T13:05:41.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.605+0000 7fc528ff9700 1 --2- 172.21.15.133:0/1293963433 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc50c0553b0 0x7fc50c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:41.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.605+0000 7fc52b7fe700 1 --2- 172.21.15.133:0/1293963433 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc50c0553b0 0x7fc50c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:41.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.605+0000 7fc528ff9700 1 -- 172.21.15.133:0/1293963433 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc52006e670 con 0x7fc52c0b5330 2021-01-03T13:05:41.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.605+0000 7fc52b7fe700 1 --2- 172.21.15.133:0/1293963433 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc50c0553b0 0x7fc50c057870 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fc51c00d000 tx=0x7fc51c001740).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:41.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.613+0000 7fc528ff9700 1 -- 172.21.15.133:0/1293963433 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc520044830 con 0x7fc52c0b5330 2021-01-03T13:05:41.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.753+0000 7fc530ef2700 1 -- 172.21.15.133:0/1293963433 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc508002270 con 0x7fc52c0b5330 2021-01-03T13:05:41.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.757+0000 7fc528ff9700 1 -- 172.21.15.133:0/1293963433 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16093 (secure 0 0 0) 0x7fc520047e50 con 0x7fc52c0b5330 2021-01-03T13:05:41.763 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:41.763 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":102,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:05:36.216269+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:05:32.702569+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2021-01-03T13:05:33.206759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:05:41.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.757+0000 7fc530ef2700 1 -- 172.21.15.133:0/1293963433 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc50c0553b0 msgr2=0x7fc50c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:41.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.757+0000 7fc530ef2700 1 --2- 172.21.15.133:0/1293963433 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc50c0553b0 0x7fc50c057870 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fc51c00d000 tx=0x7fc51c001740).stop 2021-01-03T13:05:41.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.757+0000 7fc530ef2700 1 -- 172.21.15.133:0/1293963433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52c0b5330 msgr2=0x7fc52c0ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:41.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.757+0000 7fc530ef2700 1 --2- 172.21.15.133:0/1293963433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52c0b5330 0x7fc52c0ae8b0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7fc52c0ad4e0 tx=0x7fc520008040).stop 2021-01-03T13:05:41.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.761+0000 7fc530ef2700 1 -- 172.21.15.133:0/1293963433 shutdown_connections 2021-01-03T13:05:41.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.761+0000 7fc530ef2700 1 --2- 172.21.15.133:0/1293963433 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc50c0553b0 0x7fc50c057870 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:41.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.761+0000 7fc530ef2700 1 --2- 172.21.15.133:0/1293963433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc52c099ff0 0x7fc52c0ad8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:41.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.761+0000 7fc530ef2700 1 --2- 172.21.15.133:0/1293963433 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc52c0b5ae0 0x7fc52c0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:41.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.761+0000 7fc530ef2700 1 --2- 172.21.15.133:0/1293963433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc52c0b5330 0x7fc52c0ae8b0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:41.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.761+0000 7fc530ef2700 1 -- 172.21.15.133:0/1293963433 >> 172.21.15.133:0/1293963433 conn(0x7fc52c05bdf0 msgr2=0x7fc52c13f160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:41.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.761+0000 7fc530ef2700 1 -- 172.21.15.133:0/1293963433 shutdown_connections 2021-01-03T13:05:41.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.761+0000 7fc530ef2700 1 -- 172.21.15.133:0/1293963433 wait complete. 2021-01-03T13:05:41.776 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:05:32.702569+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:05:33.206759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:05:41.777 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:05:41.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.881+0000 7f9e5ffff700 1 Processor -- start 2021-01-03T13:05:41.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.881+0000 7f9e5ffff700 1 -- start start 2021-01-03T13:05:41.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.881+0000 7f9e5ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9e60060510 0x7f9e6005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:41.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.881+0000 7f9e5ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e6005fd10 0x7f9e600b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:41.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.881+0000 7f9e5ffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6005bf00 con 0x7f9e600b4c20 2021-01-03T13:05:41.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.881+0000 7f9e5ffff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6005c1a0 con 0x7f9e6005fd10 2021-01-03T13:05:41.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.881+0000 7f9e5ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6005c440 con 0x7f9e60060510 2021-01-03T13:05:41.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e6005fd10 0x7f9e600b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:41.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e6005fd10 0x7f9e600b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37392/0 (socket says 172.21.15.133:37392) 2021-01-03T13:05:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5f7fe700 1 -- 172.21.15.133:0/1368510367 learned_addr learned my addr 172.21.15.133:0/1368510367 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5e7fc700 1 --2- 172.21.15.133:0/1368510367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9e60060510 0x7f9e6005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5f7fe700 1 -- 172.21.15.133:0/1368510367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9e60060510 msgr2=0x7f9e6005c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5f7fe700 1 --2- 172.21.15.133:0/1368510367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9e60060510 0x7f9e6005c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5f7fe700 1 -- 172.21.15.133:0/1368510367 >> v1:172.21.15.133:6789/0 conn(0x7f9e600b4c20 legacy=0x7f9e600b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:41.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5f7fe700 1 -- 172.21.15.133:0/1368510367 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e600b6ad0 con 0x7f9e6005fd10 2021-01-03T13:05:41.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5f7fe700 1 --2- 172.21.15.133:0/1368510367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6005fd10 0x7f9e600b65e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f9e58002f30 tx=0x7f9e58006e80).ready entity=mon.1 client_cookie=ff56532dfb886d58 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:41.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5dffb700 1 -- 172.21.15.133:0/1368510367 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e580097f0 con 0x7f9e6005fd10 2021-01-03T13:05:41.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5dffb700 1 -- 172.21.15.133:0/1368510367 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e58009950 con 0x7f9e6005fd10 2021-01-03T13:05:41.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5ffff700 1 -- 172.21.15.133:0/1368510367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6005fd10 msgr2=0x7f9e600b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:41.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5dffb700 1 -- 172.21.15.133:0/1368510367 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e58009cb0 con 0x7f9e6005fd10 2021-01-03T13:05:41.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5ffff700 1 --2- 172.21.15.133:0/1368510367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6005fd10 0x7f9e600b65e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f9e58002f30 tx=0x7f9e58006e80).stop 2021-01-03T13:05:41.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5ffff700 1 -- 172.21.15.133:0/1368510367 shutdown_connections 2021-01-03T13:05:41.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5ffff700 1 --2- 172.21.15.133:0/1368510367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6005fd10 0x7f9e600b65e0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:41.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5ffff700 1 --2- 172.21.15.133:0/1368510367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9e60060510 0x7f9e6005c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:41.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5ffff700 1 -- 172.21.15.133:0/1368510367 >> 172.21.15.133:0/1368510367 conn(0x7f9e600b9f00 msgr2=0x7f9e600b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:41.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5ffff700 1 -- 172.21.15.133:0/1368510367 shutdown_connections 2021-01-03T13:05:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5ffff700 1 -- 172.21.15.133:0/1368510367 wait complete. 2021-01-03T13:05:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5ffff700 1 Processor -- start 2021-01-03T13:05:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.885+0000 7f9e5ffff700 1 -- start start 2021-01-03T13:05:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6005fd10 0x7f9e600aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9e60060510 0x7f9e601556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:41.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e600b4c20 0x7f9e60155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:41.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5ffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e600b3fc0 con 0x7f9e600b4c20 2021-01-03T13:05:41.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e600918f0 con 0x7f9e6005fd10 2021-01-03T13:05:41.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e600b27f0 con 0x7f9e60060510 2021-01-03T13:05:41.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6005fd10 0x7f9e600aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5effd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6005fd10 0x7f9e600aecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37394/0 (socket says 172.21.15.133:37394) 2021-01-03T13:05:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5effd700 1 -- 172.21.15.133:0/858779592 learned_addr learned my addr 172.21.15.133:0/858779592 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5f7fe700 1 --2- 172.21.15.133:0/858779592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e600b4c20 0x7f9e60155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5e7fc700 1 --2- 172.21.15.133:0/858779592 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9e60060510 0x7f9e601556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:41.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5effd700 1 -- 172.21.15.133:0/858779592 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9e60060510 msgr2=0x7f9e601556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5effd700 1 --2- 172.21.15.133:0/858779592 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9e60060510 0x7f9e601556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5effd700 1 -- 172.21.15.133:0/858779592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e600b4c20 msgr2=0x7f9e60155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5effd700 1 --2- 172.21.15.133:0/858779592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e600b4c20 0x7f9e60155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5effd700 1 -- 172.21.15.133:0/858779592 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e600b2a20 con 0x7f9e6005fd10 2021-01-03T13:05:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5effd700 1 --2- 172.21.15.133:0/858779592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6005fd10 0x7f9e600aecf0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f9e6005c7c0 tx=0x7f9e50007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:41.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e57fff700 1 -- 172.21.15.133:0/858779592 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e50007240 con 0x7f9e6005fd10 2021-01-03T13:05:41.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e57fff700 1 -- 172.21.15.133:0/858779592 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e500073a0 con 0x7f9e6005fd10 2021-01-03T13:05:41.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5ffff700 1 -- 172.21.15.133:0/858779592 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e600b2cc0 con 0x7f9e6005fd10 2021-01-03T13:05:41.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e57fff700 1 -- 172.21.15.133:0/858779592 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e500066d0 con 0x7f9e6005fd10 2021-01-03T13:05:41.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5ffff700 1 -- 172.21.15.133:0/858779592 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e600b1c30 con 0x7f9e6005fd10 2021-01-03T13:05:41.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.889+0000 7f9e5ffff700 1 -- 172.21.15.133:0/858779592 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e600b3cb0 con 0x7f9e6005fd10 2021-01-03T13:05:41.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.893+0000 7f9e57fff700 1 -- 172.21.15.133:0/858779592 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9e50010030 con 0x7f9e6005fd10 2021-01-03T13:05:41.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.893+0000 7f9e57fff700 1 --2- 172.21.15.133:0/858779592 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9e44055440 0x7f9e44057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:41.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.893+0000 7f9e57fff700 1 -- 172.21.15.133:0/858779592 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9e5006dc30 con 0x7f9e6005fd10 2021-01-03T13:05:41.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.893+0000 7f9e5e7fc700 1 --2- 172.21.15.133:0/858779592 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9e44055440 0x7f9e44057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:41.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.893+0000 7f9e5e7fc700 1 --2- 172.21.15.133:0/858779592 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9e44055440 0x7f9e44057900 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f9e4800c000 tx=0x7f9e48008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:41.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:41.897+0000 7f9e57fff700 1 -- 172.21.15.133:0/858779592 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9e50043e90 con 0x7f9e6005fd10 2021-01-03T13:05:42.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.037+0000 7f9e5ffff700 1 -- 172.21.15.133:0/858779592 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9e60057300 con 0x7f9e6005fd10 2021-01-03T13:05:42.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.037+0000 7f9e57fff700 1 -- 172.21.15.133:0/858779592 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v102) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9e500474b0 con 0x7f9e6005fd10 2021-01-03T13:05:42.043 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:05:42.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.041+0000 7f9e5ffff700 1 -- 172.21.15.133:0/858779592 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9e44055440 msgr2=0x7f9e44057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.041+0000 7f9e5ffff700 1 --2- 172.21.15.133:0/858779592 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9e44055440 0x7f9e44057900 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f9e4800c000 tx=0x7f9e48008040).stop 2021-01-03T13:05:42.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.041+0000 7f9e5ffff700 1 -- 172.21.15.133:0/858779592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6005fd10 msgr2=0x7f9e600aecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.041+0000 7f9e5ffff700 1 --2- 172.21.15.133:0/858779592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6005fd10 0x7f9e600aecf0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f9e6005c7c0 tx=0x7f9e50007bd0).stop 2021-01-03T13:05:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.041+0000 7f9e5ffff700 1 -- 172.21.15.133:0/858779592 shutdown_connections 2021-01-03T13:05:42.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.041+0000 7f9e5ffff700 1 --2- 172.21.15.133:0/858779592 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9e44055440 0x7f9e44057900 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.041+0000 7f9e5ffff700 1 --2- 172.21.15.133:0/858779592 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e600b4c20 0x7f9e60155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.041+0000 7f9e5ffff700 1 --2- 172.21.15.133:0/858779592 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e6005fd10 0x7f9e600aecf0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.041+0000 7f9e5ffff700 1 --2- 172.21.15.133:0/858779592 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9e60060510 0x7f9e601556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.041+0000 7f9e5ffff700 1 -- 172.21.15.133:0/858779592 >> 172.21.15.133:0/858779592 conn(0x7f9e600b9f00 msgr2=0x7f9e600b7030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:42.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.041+0000 7f9e5ffff700 1 -- 172.21.15.133:0/858779592 shutdown_connections 2021-01-03T13:05:42.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.041+0000 7f9e5ffff700 1 -- 172.21.15.133:0/858779592 wait complete. 2021-01-03T13:05:42.056 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:05:42.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.169+0000 7f89f7fff700 1 Processor -- start 2021-01-03T13:05:42.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.169+0000 7f89f7fff700 1 -- start start 2021-01-03T13:05:42.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.169+0000 7f89f7fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f89f80b5c00 0x7f89f81477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.169+0000 7f89f7fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f80b0c10 con 0x7f89f81442a0 2021-01-03T13:05:42.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.169+0000 7f89f7fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f80b5640 con 0x7f89f80b5260 2021-01-03T13:05:42.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.169+0000 7f89f7fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f809a4f0 con 0x7f89f80b5c00 2021-01-03T13:05:42.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.169+0000 7f89f6ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f89f80b5260 0x7f89f81470b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58434/0 (socket says 172.21.15.133:58434) 2021-01-03T13:05:42.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.169+0000 7f89f6ffd700 1 -- 172.21.15.133:0/2912666537 learned_addr learned my addr 172.21.15.133:0/2912666537 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:42.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.169+0000 7f89f67fc700 1 --2- 172.21.15.133:0/2912666537 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f89f80b5c00 0x7f89f81477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.169+0000 7f89f5ffb700 1 -- 172.21.15.133:0/2912666537 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116315912 0 0) 0x7f89f80b5640 con 0x7f89f80b5260 2021-01-03T13:05:42.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.169+0000 7f89f5ffb700 1 -- 172.21.15.133:0/2912666537 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89dc003230 con 0x7f89f80b5260 2021-01-03T13:05:42.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.169+0000 7f89f5ffb700 1 -- 172.21.15.133:0/2912666537 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881101711 0 0) 0x7f89f80b0c10 con 0x7f89f81442a0 2021-01-03T13:05:42.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.169+0000 7f89f5ffb700 1 -- 172.21.15.133:0/2912666537 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89f80b5640 con 0x7f89f81442a0 2021-01-03T13:05:42.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.169+0000 7f89f67fc700 1 -- 172.21.15.133:0/2912666537 >> v1:172.21.15.133:6789/0 conn(0x7f89f80b5260 legacy=0x7f89f81470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.169+0000 7f89f67fc700 1 -- 172.21.15.133:0/2912666537 >> v1:172.21.15.16:6789/0 conn(0x7f89f81442a0 legacy=0x7f89f8144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.169+0000 7f89f67fc700 1 -- 172.21.15.133:0/2912666537 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f80b0e40 con 0x7f89f80b5c00 2021-01-03T13:05:42.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.173+0000 7f89f67fc700 1 --2- 172.21.15.133:0/2912666537 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f89f80b5c00 0x7f89f81477c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f89e8002f30 tx=0x7f89e8006dc0).ready entity=mon.2 client_cookie=4586cd84942383b7 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:42.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.173+0000 7f89f5ffb700 1 -- 172.21.15.133:0/2912666537 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e8009730 con 0x7f89f80b5c00 2021-01-03T13:05:42.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.173+0000 7f89f5ffb700 1 -- 172.21.15.133:0/2912666537 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8009890 con 0x7f89f80b5c00 2021-01-03T13:05:42.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.173+0000 7f89f5ffb700 1 -- 172.21.15.133:0/2912666537 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89e8009bf0 con 0x7f89f80b5c00 2021-01-03T13:05:42.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.173+0000 7f89f7fff700 1 -- 172.21.15.133:0/2912666537 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f89f80b5c00 msgr2=0x7f89f81477c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.173+0000 7f89f7fff700 1 --2- 172.21.15.133:0/2912666537 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f89f80b5c00 0x7f89f81477c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f89e8002f30 tx=0x7f89e8006dc0).stop 2021-01-03T13:05:42.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.173+0000 7f89f7fff700 1 -- 172.21.15.133:0/2912666537 shutdown_connections 2021-01-03T13:05:42.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.173+0000 7f89f7fff700 1 --2- 172.21.15.133:0/2912666537 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f89f80b5c00 0x7f89f81477c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.173+0000 7f89f7fff700 1 -- 172.21.15.133:0/2912666537 >> 172.21.15.133:0/2912666537 conn(0x7f89f805bdf0 msgr2=0x7f89f805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:42.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.173+0000 7f89f7fff700 1 -- 172.21.15.133:0/2912666537 shutdown_connections 2021-01-03T13:05:42.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.173+0000 7f89f7fff700 1 -- 172.21.15.133:0/2912666537 wait complete. 2021-01-03T13:05:42.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.173+0000 7f89f7fff700 1 Processor -- start 2021-01-03T13:05:42.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.173+0000 7f89f7fff700 1 -- start start 2021-01-03T13:05:42.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f80b5260 0x7f89f814d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f7fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f89f80b5c00 0x7f89f8159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f7fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89f81442a0 0x7f89f8159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f7fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f81485d0 con 0x7f89f81442a0 2021-01-03T13:05:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f7fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f8148870 con 0x7f89f80b5260 2021-01-03T13:05:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f7fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f8148b10 con 0x7f89f80b5c00 2021-01-03T13:05:42.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f80b5260 0x7f89f814d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f80b5260 0x7f89f814d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37408/0 (socket says 172.21.15.133:37408) 2021-01-03T13:05:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f6ffd700 1 -- 172.21.15.133:0/1478053112 learned_addr learned my addr 172.21.15.133:0/1478053112 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f67fc700 1 --2- 172.21.15.133:0/1478053112 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f89f80b5c00 0x7f89f8159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f77fe700 1 --2- 172.21.15.133:0/1478053112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89f81442a0 0x7f89f8159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f6ffd700 1 -- 172.21.15.133:0/1478053112 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f89f80b5c00 msgr2=0x7f89f8159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f6ffd700 1 --2- 172.21.15.133:0/1478053112 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f89f80b5c00 0x7f89f8159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f6ffd700 1 -- 172.21.15.133:0/1478053112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89f81442a0 msgr2=0x7f89f8159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f6ffd700 1 --2- 172.21.15.133:0/1478053112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89f81442a0 0x7f89f8159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f6ffd700 1 -- 172.21.15.133:0/1478053112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f814b030 con 0x7f89f80b5260 2021-01-03T13:05:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f6ffd700 1 --2- 172.21.15.133:0/1478053112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f80b5260 0x7f89f814d9f0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f89ec001090 tx=0x7f89ec007ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89e7fff700 1 -- 172.21.15.133:0/1478053112 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89ec0072e0 con 0x7f89f80b5260 2021-01-03T13:05:42.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89e7fff700 1 -- 172.21.15.133:0/1478053112 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec007440 con 0x7f89f80b5260 2021-01-03T13:05:42.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89e7fff700 1 -- 172.21.15.133:0/1478053112 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89ec0057d0 con 0x7f89f80b5260 2021-01-03T13:05:42.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f7fff700 1 -- 172.21.15.133:0/1478053112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f814aa30 con 0x7f89f80b5260 2021-01-03T13:05:42.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f7fff700 1 -- 172.21.15.133:0/1478053112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f815a1c0 con 0x7f89f80b5260 2021-01-03T13:05:42.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.177+0000 7f89f7fff700 1 -- 172.21.15.133:0/1478053112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f80aa900 con 0x7f89f80b5260 2021-01-03T13:05:42.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.181+0000 7f89e7fff700 1 -- 172.21.15.133:0/1478053112 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f89ec010070 con 0x7f89f80b5260 2021-01-03T13:05:42.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.181+0000 7f89e7fff700 1 --2- 172.21.15.133:0/1478053112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f89d4055330 0x7f89d40577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.181+0000 7f89e7fff700 1 -- 172.21.15.133:0/1478053112 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f89ec06d470 con 0x7f89f80b5260 2021-01-03T13:05:42.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.181+0000 7f89f67fc700 1 --2- 172.21.15.133:0/1478053112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f89d4055330 0x7f89d40577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.181+0000 7f89f67fc700 1 --2- 172.21.15.133:0/1478053112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f89d4055330 0x7f89d40577f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f89e8019000 tx=0x7f89e8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:42.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.185+0000 7f89e7fff700 1 -- 172.21.15.133:0/1478053112 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f89f80aa900 con 0x7f89f80b5260 2021-01-03T13:05:42.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.333+0000 7f89f7fff700 1 -- 172.21.15.133:0/1478053112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f89f80aa900 con 0x7f89f80b5260 2021-01-03T13:05:42.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.333+0000 7f89e7fff700 1 -- 172.21.15.133:0/1478053112 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v102) v1 ==== 92+0+10 (secure 0 0 0) 0x7f89f80aa900 con 0x7f89f80b5260 2021-01-03T13:05:42.338 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:05:42.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.333+0000 7f89f7fff700 1 -- 172.21.15.133:0/1478053112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f89d4055330 msgr2=0x7f89d40577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.333+0000 7f89f7fff700 1 --2- 172.21.15.133:0/1478053112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f89d4055330 0x7f89d40577f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f89e8019000 tx=0x7f89e8015000).stop 2021-01-03T13:05:42.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.333+0000 7f89f7fff700 1 -- 172.21.15.133:0/1478053112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f80b5260 msgr2=0x7f89f814d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.333+0000 7f89f7fff700 1 --2- 172.21.15.133:0/1478053112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f80b5260 0x7f89f814d9f0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f89ec001090 tx=0x7f89ec007ad0).stop 2021-01-03T13:05:42.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.333+0000 7f89f7fff700 1 -- 172.21.15.133:0/1478053112 shutdown_connections 2021-01-03T13:05:42.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.333+0000 7f89f7fff700 1 --2- 172.21.15.133:0/1478053112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f89d4055330 0x7f89d40577f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.333+0000 7f89f7fff700 1 --2- 172.21.15.133:0/1478053112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89f81442a0 0x7f89f8159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.333+0000 7f89f7fff700 1 --2- 172.21.15.133:0/1478053112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f80b5260 0x7f89f814d9f0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.333+0000 7f89f7fff700 1 --2- 172.21.15.133:0/1478053112 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f89f80b5c00 0x7f89f8159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.333+0000 7f89f7fff700 1 -- 172.21.15.133:0/1478053112 >> 172.21.15.133:0/1478053112 conn(0x7f89f805bdf0 msgr2=0x7f89f8147170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:42.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.333+0000 7f89f7fff700 1 -- 172.21.15.133:0/1478053112 shutdown_connections 2021-01-03T13:05:42.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.333+0000 7f89f7fff700 1 -- 172.21.15.133:0/1478053112 wait complete. 2021-01-03T13:05:42.351 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:05:42.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d1770f700 1 Processor -- start 2021-01-03T13:05:42.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d1770f700 1 -- start start 2021-01-03T13:05:42.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d1770f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2d100b2780 0x7f2d10060430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d1770f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2d100b2c90 0x7f2d101440c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d1770f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d10060920 con 0x7f2d100b3ee0 2021-01-03T13:05:42.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d1770f700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d101472b0 con 0x7f2d100b2c90 2021-01-03T13:05:42.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d1770f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100b42c0 con 0x7f2d100b2780 2021-01-03T13:05:42.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d154ab700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2d100b3ee0 0x7f2d1005fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58448/0 (socket says 172.21.15.133:58448) 2021-01-03T13:05:42.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d154ab700 1 -- 172.21.15.133:0/4280140712 learned_addr learned my addr 172.21.15.133:0/4280140712 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:42.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d14caa700 1 --2- 172.21.15.133:0/4280140712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2d100b2780 0x7f2d10060430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d15cac700 1 --2- 172.21.15.133:0/4280140712 >> v2:172.21.15.16:3300/0 conn(0x7f2d100b2c90 0x7f2d101440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d07fff700 1 -- 172.21.15.133:0/4280140712 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266041099 0 0) 0x7f2d10060920 con 0x7f2d100b3ee0 2021-01-03T13:05:42.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d07fff700 1 -- 172.21.15.133:0/4280140712 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cf4003230 con 0x7f2d100b3ee0 2021-01-03T13:05:42.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d07fff700 1 -- 172.21.15.133:0/4280140712 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4137306455 0 0) 0x7f2cf4003230 con 0x7f2d100b3ee0 2021-01-03T13:05:42.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d07fff700 1 -- 172.21.15.133:0/4280140712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2d100b2780 msgr2=0x7f2d10060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:42.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d07fff700 1 --2- 172.21.15.133:0/4280140712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2d100b2780 0x7f2d10060430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d07fff700 1 -- 172.21.15.133:0/4280140712 >> v2:172.21.15.16:3300/0 conn(0x7f2d100b2c90 msgr2=0x7f2d101440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:42.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d07fff700 1 --2- 172.21.15.133:0/4280140712 >> v2:172.21.15.16:3300/0 conn(0x7f2d100b2c90 0x7f2d101440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d07fff700 1 -- 172.21.15.133:0/4280140712 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1014b590 con 0x7f2d100b3ee0 2021-01-03T13:05:42.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d07fff700 1 -- 172.21.15.133:0/4280140712 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f2d0c0016d0 con 0x7f2d100b3ee0 2021-01-03T13:05:42.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d07fff700 1 -- 172.21.15.133:0/4280140712 >> v1:172.21.15.133:6789/0 conn(0x7f2d100b3ee0 legacy=0x7f2d1005fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d07fff700 1 --2- 172.21.15.133:0/4280140712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf4003720 0x7f2cf4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d07fff700 1 --2- 172.21.15.133:0/4280140712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cf40044d0 0x7f2cf4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d07fff700 1 --2- 172.21.15.133:0/4280140712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2d100b2780 0x7f2cf4004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d07fff700 1 -- 172.21.15.133:0/4280140712 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100b42c0 con 0x7f2cf40044d0 2021-01-03T13:05:42.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d07fff700 1 -- 172.21.15.133:0/4280140712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf4005380 con 0x7f2cf4003720 2021-01-03T13:05:42.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d07fff700 1 -- 172.21.15.133:0/4280140712 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf40042e0 con 0x7f2d100b2780 2021-01-03T13:05:42.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d154ab700 1 --2- 172.21.15.133:0/4280140712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf4003720 0x7f2cf4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d14caa700 1 --2- 172.21.15.133:0/4280140712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cf40044d0 0x7f2cf4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d15cac700 1 --2- 172.21.15.133:0/4280140712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2d100b2780 0x7f2cf4004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d154ab700 1 -- 172.21.15.133:0/4280140712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2d100b2780 msgr2=0x7f2cf4004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:42.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d154ab700 1 --2- 172.21.15.133:0/4280140712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2d100b2780 0x7f2cf4004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d154ab700 1 -- 172.21.15.133:0/4280140712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cf40044d0 msgr2=0x7f2cf4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:42.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d154ab700 1 --2- 172.21.15.133:0/4280140712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2cf40044d0 0x7f2cf4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.461+0000 7f2d154ab700 1 -- 172.21.15.133:0/4280140712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf4003230 con 0x7f2cf4003720 2021-01-03T13:05:42.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d154ab700 1 --2- 172.21.15.133:0/4280140712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf4003720 0x7f2cf4003b40 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f2d0c0013e0 tx=0x7f2d0c0077c0).ready entity=mon.1 client_cookie=94e7b5379cb82cd3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:42.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d07fff700 1 -- 172.21.15.133:0/4280140712 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d0c0070d0 con 0x7f2cf4003720 2021-01-03T13:05:42.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d07fff700 1 -- 172.21.15.133:0/4280140712 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0c007230 con 0x7f2cf4003720 2021-01-03T13:05:42.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d1770f700 1 -- 172.21.15.133:0/4280140712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf4003720 msgr2=0x7f2cf4003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d07fff700 1 -- 172.21.15.133:0/4280140712 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d0c0055e0 con 0x7f2cf4003720 2021-01-03T13:05:42.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d1770f700 1 --2- 172.21.15.133:0/4280140712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf4003720 0x7f2cf4003b40 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f2d0c0013e0 tx=0x7f2d0c0077c0).stop 2021-01-03T13:05:42.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d15cac700 1 -- 172.21.15.133:0/4280140712 reap_dead start 2021-01-03T13:05:42.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d1770f700 1 -- 172.21.15.133:0/4280140712 shutdown_connections 2021-01-03T13:05:42.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d1770f700 1 -- 172.21.15.133:0/4280140712 >> 172.21.15.133:0/4280140712 conn(0x7f2d1005bdf0 msgr2=0x7f2d1005c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:42.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d1770f700 1 -- 172.21.15.133:0/4280140712 shutdown_connections 2021-01-03T13:05:42.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d1770f700 1 -- 172.21.15.133:0/4280140712 wait complete. 2021-01-03T13:05:42.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d1770f700 1 Processor -- start 2021-01-03T13:05:42.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d1770f700 1 -- start start 2021-01-03T13:05:42.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d1770f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d100ae940 0x7f2d10064da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d1770f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d10065290 0x7f2d10159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d1770f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2d10159e70 0x7f2d1015a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d1770f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d10067270 con 0x7f2d100ae940 2021-01-03T13:05:42.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d1770f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d100af0d0 con 0x7f2d10065290 2021-01-03T13:05:42.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d1770f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1015a7f0 con 0x7f2d10159e70 2021-01-03T13:05:42.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d14caa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d10065290 0x7f2d10159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d14caa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d10065290 0x7f2d10159980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37428/0 (socket says 172.21.15.133:37428) 2021-01-03T13:05:42.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d14caa700 1 -- 172.21.15.133:0/3095816008 learned_addr learned my addr 172.21.15.133:0/3095816008 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:42.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d154ab700 1 --2- 172.21.15.133:0/3095816008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d100ae940 0x7f2d10064da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.465+0000 7f2d15cac700 1 --2- 172.21.15.133:0/3095816008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2d10159e70 0x7f2d1015a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.469+0000 7f2d14caa700 1 -- 172.21.15.133:0/3095816008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2d10159e70 msgr2=0x7f2d1015a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.469+0000 7f2d14caa700 1 --2- 172.21.15.133:0/3095816008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2d10159e70 0x7f2d1015a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.469+0000 7f2d14caa700 1 -- 172.21.15.133:0/3095816008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d100ae940 msgr2=0x7f2d10064da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.469+0000 7f2d14caa700 1 --2- 172.21.15.133:0/3095816008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d100ae940 0x7f2d10064da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.469+0000 7f2d14caa700 1 -- 172.21.15.133:0/3095816008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d100aed20 con 0x7f2d10065290 2021-01-03T13:05:42.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.469+0000 7f2d154ab700 1 --2- 172.21.15.133:0/3095816008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d100ae940 0x7f2d10064da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:42.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.469+0000 7f2d14caa700 1 --2- 172.21.15.133:0/3095816008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d10065290 0x7f2d10159980 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f2d00008000 tx=0x7f2d00008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:42.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.469+0000 7f2d067fc700 1 -- 172.21.15.133:0/3095816008 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d0000f980 con 0x7f2d10065290 2021-01-03T13:05:42.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.469+0000 7f2d067fc700 1 -- 172.21.15.133:0/3095816008 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0000fae0 con 0x7f2d10065290 2021-01-03T13:05:42.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.469+0000 7f2d1770f700 1 -- 172.21.15.133:0/3095816008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1009c2f0 con 0x7f2d10065290 2021-01-03T13:05:42.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.469+0000 7f2d067fc700 1 -- 172.21.15.133:0/3095816008 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d0000fc50 con 0x7f2d10065290 2021-01-03T13:05:42.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.469+0000 7f2d1770f700 1 -- 172.21.15.133:0/3095816008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1009baa0 con 0x7f2d10065290 2021-01-03T13:05:42.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.469+0000 7f2d1770f700 1 -- 172.21.15.133:0/3095816008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d10057300 con 0x7f2d10065290 2021-01-03T13:05:42.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.469+0000 7f2d067fc700 1 -- 172.21.15.133:0/3095816008 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2d00024070 con 0x7f2d10065290 2021-01-03T13:05:42.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.469+0000 7f2d067fc700 1 --2- 172.21.15.133:0/3095816008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2cf8055440 0x7f2cf8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.473+0000 7f2d067fc700 1 -- 172.21.15.133:0/3095816008 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2d0006e790 con 0x7f2d10065290 2021-01-03T13:05:42.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.473+0000 7f2d154ab700 1 --2- 172.21.15.133:0/3095816008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2cf8055440 0x7f2cf8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.473+0000 7f2d154ab700 1 --2- 172.21.15.133:0/3095816008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2cf8055440 0x7f2cf8057900 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f2d0c017000 tx=0x7f2d0c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:42.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.477+0000 7f2d067fc700 1 -- 172.21.15.133:0/3095816008 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2d00044a90 con 0x7f2d10065290 2021-01-03T13:05:42.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.617+0000 7f2d1770f700 1 -- 172.21.15.133:0/3095816008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d10141700 con 0x7f2d10065290 2021-01-03T13:05:42.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.617+0000 7f2d067fc700 1 -- 172.21.15.133:0/3095816008 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2d000480b0 con 0x7f2d10065290 2021-01-03T13:05:42.623 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:05:42.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.617+0000 7f2d1770f700 1 -- 172.21.15.133:0/3095816008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2cf8055440 msgr2=0x7f2cf8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.617+0000 7f2d1770f700 1 --2- 172.21.15.133:0/3095816008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2cf8055440 0x7f2cf8057900 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f2d0c017000 tx=0x7f2d0c015000).stop 2021-01-03T13:05:42.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.617+0000 7f2d1770f700 1 -- 172.21.15.133:0/3095816008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d10065290 msgr2=0x7f2d10159980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.617+0000 7f2d1770f700 1 --2- 172.21.15.133:0/3095816008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d10065290 0x7f2d10159980 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f2d00008000 tx=0x7f2d00008040).stop 2021-01-03T13:05:42.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.621+0000 7f2d1770f700 1 -- 172.21.15.133:0/3095816008 shutdown_connections 2021-01-03T13:05:42.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.621+0000 7f2d1770f700 1 --2- 172.21.15.133:0/3095816008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2cf8055440 0x7f2cf8057900 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.621+0000 7f2d1770f700 1 --2- 172.21.15.133:0/3095816008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2d100ae940 0x7f2d10064da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.621+0000 7f2d1770f700 1 --2- 172.21.15.133:0/3095816008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2d10159e70 0x7f2d1015a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.621+0000 7f2d1770f700 1 --2- 172.21.15.133:0/3095816008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d10065290 0x7f2d10159980 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.621+0000 7f2d1770f700 1 -- 172.21.15.133:0/3095816008 >> 172.21.15.133:0/3095816008 conn(0x7f2d1005bdf0 msgr2=0x7f2d100600f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:42.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.621+0000 7f2d1770f700 1 -- 172.21.15.133:0/3095816008 shutdown_connections 2021-01-03T13:05:42.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.621+0000 7f2d1770f700 1 -- 172.21.15.133:0/3095816008 wait complete. 2021-01-03T13:05:42.640 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:05:42.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.753+0000 7fc1b65e2700 1 Processor -- start 2021-01-03T13:05:42.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.753+0000 7fc1b65e2700 1 -- start start 2021-01-03T13:05:42.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b65e2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1b0066f70 0x7fc1b005fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b65e2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1b0067350 0x7fc1b00af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b65e2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b0060310 con 0x7fc1b00afc50 2021-01-03T13:05:42.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b65e2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b00605a0 con 0x7fc1b0067350 2021-01-03T13:05:42.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b65e2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b00b0b50 con 0x7fc1b0066f70 2021-01-03T13:05:42.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b4ddf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1b0067350 0x7fc1b00af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b4ddf700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1b0067350 0x7fc1b00af760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37438/0 (socket says 172.21.15.133:37438) 2021-01-03T13:05:42.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b4ddf700 1 -- 172.21.15.133:0/514442725 learned_addr learned my addr 172.21.15.133:0/514442725 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:42.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b55e0700 1 --2- 172.21.15.133:0/514442725 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1b0066f70 0x7fc1b005fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b4ddf700 1 -- 172.21.15.133:0/514442725 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1b0066f70 msgr2=0x7fc1b005fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:42.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b4ddf700 1 --2- 172.21.15.133:0/514442725 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1b0066f70 0x7fc1b005fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b4ddf700 1 -- 172.21.15.133:0/514442725 >> v1:172.21.15.133:6789/0 conn(0x7fc1b00afc50 legacy=0x7fc1b0144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1a7fff700 1 -- 172.21.15.133:0/514442725 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712554183 0 0) 0x7fc1b0060310 con 0x7fc1b00afc50 2021-01-03T13:05:42.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b4ddf700 1 -- 172.21.15.133:0/514442725 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b00b0df0 con 0x7fc1b0067350 2021-01-03T13:05:42.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b4ddf700 1 --2- 172.21.15.133:0/514442725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1b0067350 0x7fc1b00af760 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7fc1a0002f30 tx=0x7fc1a0006e80).ready entity=mon.1 client_cookie=1da362852ca52b25 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:42.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1a7fff700 1 -- 172.21.15.133:0/514442725 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1a00097f0 con 0x7fc1b0067350 2021-01-03T13:05:42.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1a7fff700 1 -- 172.21.15.133:0/514442725 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a0009950 con 0x7fc1b0067350 2021-01-03T13:05:42.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1a7fff700 1 -- 172.21.15.133:0/514442725 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1a0009cb0 con 0x7fc1b0067350 2021-01-03T13:05:42.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b65e2700 1 -- 172.21.15.133:0/514442725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1b0067350 msgr2=0x7fc1b00af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b65e2700 1 --2- 172.21.15.133:0/514442725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1b0067350 0x7fc1b00af760 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7fc1a0002f30 tx=0x7fc1a0006e80).stop 2021-01-03T13:05:42.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b65e2700 1 -- 172.21.15.133:0/514442725 shutdown_connections 2021-01-03T13:05:42.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b65e2700 1 --2- 172.21.15.133:0/514442725 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1b0066f70 0x7fc1b005fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b65e2700 1 --2- 172.21.15.133:0/514442725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1b0067350 0x7fc1b00af760 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b65e2700 1 -- 172.21.15.133:0/514442725 >> 172.21.15.133:0/514442725 conn(0x7fc1b00b6110 msgr2=0x7fc1b00b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:42.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b65e2700 1 -- 172.21.15.133:0/514442725 shutdown_connections 2021-01-03T13:05:42.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.757+0000 7fc1b65e2700 1 -- 172.21.15.133:0/514442725 wait complete. 2021-01-03T13:05:42.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.761+0000 7fc1b65e2700 1 Processor -- start 2021-01-03T13:05:42.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.761+0000 7fc1b65e2700 1 -- start start 2021-01-03T13:05:42.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.761+0000 7fc1b65e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1b0066f70 0x7fc1b0145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.761+0000 7fc1b65e2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1b0067350 0x7fc1b0140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.761+0000 7fc1b65e2700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1b013f3b0 0x7fc1b01467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.761+0000 7fc1b65e2700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0141590 con 0x7fc1b013f3b0 2021-01-03T13:05:42.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.761+0000 7fc1b65e2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b013ea50 con 0x7fc1b0066f70 2021-01-03T13:05:42.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.761+0000 7fc1b65e2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b013a050 con 0x7fc1b0067350 2021-01-03T13:05:42.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.761+0000 7fc1b55e0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1b0066f70 0x7fc1b0145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.761+0000 7fc1b55e0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1b0066f70 0x7fc1b0145820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37442/0 (socket says 172.21.15.133:37442) 2021-01-03T13:05:42.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.761+0000 7fc1b55e0700 1 -- 172.21.15.133:0/196523242 learned_addr learned my addr 172.21.15.133:0/196523242 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:42.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.761+0000 7fc1b4ddf700 1 --2- 172.21.15.133:0/196523242 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1b0067350 0x7fc1b0140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.761+0000 7fc1b5de1700 1 --2- 172.21.15.133:0/196523242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1b013f3b0 0x7fc1b01467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.765+0000 7fc1b55e0700 1 -- 172.21.15.133:0/196523242 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1b0067350 msgr2=0x7fc1b0140bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.765+0000 7fc1b55e0700 1 --2- 172.21.15.133:0/196523242 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1b0067350 0x7fc1b0140bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.765+0000 7fc1b55e0700 1 -- 172.21.15.133:0/196523242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1b013f3b0 msgr2=0x7fc1b01467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.765+0000 7fc1b55e0700 1 --2- 172.21.15.133:0/196523242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1b013f3b0 0x7fc1b01467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.765+0000 7fc1b55e0700 1 -- 172.21.15.133:0/196523242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b01464b0 con 0x7fc1b0066f70 2021-01-03T13:05:42.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.765+0000 7fc1b55e0700 1 --2- 172.21.15.133:0/196523242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1b0066f70 0x7fc1b0145820 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7fc1ac00c000 tx=0x7fc1ac006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:42.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.765+0000 7fc1a67fc700 1 -- 172.21.15.133:0/196523242 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1ac00ca10 con 0x7fc1b0066f70 2021-01-03T13:05:42.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.765+0000 7fc1a67fc700 1 -- 172.21.15.133:0/196523242 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac00cb70 con 0x7fc1b0066f70 2021-01-03T13:05:42.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.765+0000 7fc1b65e2700 1 -- 172.21.15.133:0/196523242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b013ec80 con 0x7fc1b0066f70 2021-01-03T13:05:42.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.765+0000 7fc1a67fc700 1 -- 172.21.15.133:0/196523242 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1ac0123f0 con 0x7fc1b0066f70 2021-01-03T13:05:42.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.765+0000 7fc1b65e2700 1 -- 172.21.15.133:0/196523242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b0148160 con 0x7fc1b0066f70 2021-01-03T13:05:42.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.765+0000 7fc1b65e2700 1 -- 172.21.15.133:0/196523242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b0057300 con 0x7fc1b0066f70 2021-01-03T13:05:42.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.765+0000 7fc1a67fc700 1 -- 172.21.15.133:0/196523242 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc1ac012550 con 0x7fc1b0066f70 2021-01-03T13:05:42.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.765+0000 7fc1a67fc700 1 --2- 172.21.15.133:0/196523242 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc198055440 0x7fc198057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:42.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.765+0000 7fc1a67fc700 1 -- 172.21.15.133:0/196523242 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc1ac06e2b0 con 0x7fc1b0066f70 2021-01-03T13:05:42.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.765+0000 7fc1b4ddf700 1 --2- 172.21.15.133:0/196523242 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc198055440 0x7fc198057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:42.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.769+0000 7fc1b4ddf700 1 --2- 172.21.15.133:0/196523242 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc198055440 0x7fc198057900 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fc1a001c000 tx=0x7fc1a0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:42.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.773+0000 7fc1a67fc700 1 -- 172.21.15.133:0/196523242 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc1ac0444b0 con 0x7fc1b0066f70 2021-01-03T13:05:42.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.913+0000 7fc1b65e2700 1 -- 172.21.15.133:0/196523242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc1b0061020 con 0x7fc1b0066f70 2021-01-03T13:05:42.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.913+0000 7fc1a67fc700 1 -- 172.21.15.133:0/196523242 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc1ac047ad0 con 0x7fc1b0066f70 2021-01-03T13:05:42.919 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:05:42.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.913+0000 7fc1b65e2700 1 -- 172.21.15.133:0/196523242 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc198055440 msgr2=0x7fc198057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.913+0000 7fc1b65e2700 1 --2- 172.21.15.133:0/196523242 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc198055440 0x7fc198057900 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fc1a001c000 tx=0x7fc1a0015000).stop 2021-01-03T13:05:42.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.913+0000 7fc1b65e2700 1 -- 172.21.15.133:0/196523242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1b0066f70 msgr2=0x7fc1b0145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:42.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.913+0000 7fc1b65e2700 1 --2- 172.21.15.133:0/196523242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1b0066f70 0x7fc1b0145820 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7fc1ac00c000 tx=0x7fc1ac006dc0).stop 2021-01-03T13:05:42.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.913+0000 7fc1b65e2700 1 -- 172.21.15.133:0/196523242 shutdown_connections 2021-01-03T13:05:42.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.913+0000 7fc1b65e2700 1 --2- 172.21.15.133:0/196523242 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc198055440 0x7fc198057900 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.913+0000 7fc1b65e2700 1 --2- 172.21.15.133:0/196523242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc1b013f3b0 0x7fc1b01467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.913+0000 7fc1b65e2700 1 --2- 172.21.15.133:0/196523242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1b0066f70 0x7fc1b0145820 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.913+0000 7fc1b65e2700 1 --2- 172.21.15.133:0/196523242 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc1b0067350 0x7fc1b0140bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:42.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.913+0000 7fc1b65e2700 1 -- 172.21.15.133:0/196523242 >> 172.21.15.133:0/196523242 conn(0x7fc1b00b6110 msgr2=0x7fc1b01421b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:42.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.913+0000 7fc1b65e2700 1 -- 172.21.15.133:0/196523242 shutdown_connections 2021-01-03T13:05:42.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:42.913+0000 7fc1b65e2700 1 -- 172.21.15.133:0/196523242 wait complete. 2021-01-03T13:05:42.936 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:05:42.939 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:05:43.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.045+0000 7fdcb1909700 1 Processor -- start 2021-01-03T13:05:43.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.045+0000 7fdcb1909700 1 -- start start 2021-01-03T13:05:43.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.045+0000 7fdcb1909700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcac1479e0 0x7fdcac0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:43.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.045+0000 7fdcb1909700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdcac061890 0x7fdcac1445e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:43.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.045+0000 7fdcb1909700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcac061c90 con 0x7fdcac05c130 2021-01-03T13:05:43.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.045+0000 7fdcb1909700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac05c510 con 0x7fdcac061890 2021-01-03T13:05:43.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.045+0000 7fdcb1909700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac14a930 con 0x7fdcac1479e0 2021-01-03T13:05:43.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.045+0000 7fdcb1108700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdcac061890 0x7fdcac1445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.045+0000 7fdcb1108700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdcac061890 0x7fdcac1445e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37454/0 (socket says 172.21.15.133:37454) 2021-01-03T13:05:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.045+0000 7fdcb1108700 1 -- 172.21.15.133:0/169738743 learned_addr learned my addr 172.21.15.133:0/169738743 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:43.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.045+0000 7fdcb1108700 1 -- 172.21.15.133:0/169738743 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcac1479e0 msgr2=0x7fdcac0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.045+0000 7fdcabfff700 1 --2- 172.21.15.133:0/169738743 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcac1479e0 0x7fdcac0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.045+0000 7fdcb1108700 1 --2- 172.21.15.133:0/169738743 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcac1479e0 0x7fdcac0b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:43.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.045+0000 7fdcb1108700 1 -- 172.21.15.133:0/169738743 >> v1:172.21.15.16:6789/0 conn(0x7fdcac05c130 legacy=0x7fdcac1472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:43.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.045+0000 7fdcb1108700 1 -- 172.21.15.133:0/169738743 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac14abd0 con 0x7fdcac061890 2021-01-03T13:05:43.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcabfff700 1 --2- 172.21.15.133:0/169738743 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcac1479e0 0x7fdcac0b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:43.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb1108700 1 --2- 172.21.15.133:0/169738743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcac061890 0x7fdcac1445e0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7fdcac0b6cd0 tx=0x7fdca4009270).ready entity=mon.1 client_cookie=d6becd01b612b558 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:43.064 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcab7fe700 1 -- 172.21.15.133:0/169738743 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdca400bbc0 con 0x7fdcac061890 2021-01-03T13:05:43.065 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcab7fe700 1 -- 172.21.15.133:0/169738743 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca400bd20 con 0x7fdcac061890 2021-01-03T13:05:43.065 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb1909700 1 -- 172.21.15.133:0/169738743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcac061890 msgr2=0x7fdcac1445e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:43.065 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcab7fe700 1 -- 172.21.15.133:0/169738743 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdca4011400 con 0x7fdcac061890 2021-01-03T13:05:43.066 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb1909700 1 --2- 172.21.15.133:0/169738743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcac061890 0x7fdcac1445e0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7fdcac0b6cd0 tx=0x7fdca4009270).stop 2021-01-03T13:05:43.066 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb1909700 1 -- 172.21.15.133:0/169738743 shutdown_connections 2021-01-03T13:05:43.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb1909700 1 --2- 172.21.15.133:0/169738743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcac061890 0x7fdcac1445e0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:43.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb1909700 1 --2- 172.21.15.133:0/169738743 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcac1479e0 0x7fdcac0b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:43.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb1909700 1 -- 172.21.15.133:0/169738743 >> 172.21.15.133:0/169738743 conn(0x7fdcac0b6110 msgr2=0x7fdcac0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:43.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb1909700 1 -- 172.21.15.133:0/169738743 shutdown_connections 2021-01-03T13:05:43.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb1909700 1 -- 172.21.15.133:0/169738743 wait complete. 2021-01-03T13:05:43.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb1909700 1 Processor -- start 2021-01-03T13:05:43.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb1909700 1 -- start start 2021-01-03T13:05:43.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb1909700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcac05c130 0x7fdcac14c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:43.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb1909700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcac061890 0x7fdcac146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:43.071 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb1909700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcac1479e0 0x7fdcac1464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:43.071 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb1909700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac14d360 con 0x7fdcac1479e0 2021-01-03T13:05:43.071 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb1909700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac1451e0 con 0x7fdcac05c130 2021-01-03T13:05:43.072 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb1909700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac145480 con 0x7fdcac061890 2021-01-03T13:05:43.072 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb0907700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcac05c130 0x7fdcac14c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:43.072 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb0907700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcac05c130 0x7fdcac14c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37456/0 (socket says 172.21.15.133:37456) 2021-01-03T13:05:43.073 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.049+0000 7fdcb0907700 1 -- 172.21.15.133:0/176704188 learned_addr learned my addr 172.21.15.133:0/176704188 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:43.073 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.053+0000 7fdcabfff700 1 --2- 172.21.15.133:0/176704188 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcac061890 0x7fdcac146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:43.074 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.053+0000 7fdcb1108700 1 --2- 172.21.15.133:0/176704188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcac1479e0 0x7fdcac1464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:43.074 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.053+0000 7fdcb0907700 1 -- 172.21.15.133:0/176704188 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcac061890 msgr2=0x7fdcac146000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:43.075 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.053+0000 7fdcb0907700 1 --2- 172.21.15.133:0/176704188 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcac061890 0x7fdcac146000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:43.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.053+0000 7fdcb0907700 1 -- 172.21.15.133:0/176704188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcac1479e0 msgr2=0x7fdcac1464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:43.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.053+0000 7fdcb0907700 1 --2- 172.21.15.133:0/176704188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcac1479e0 0x7fdcac1464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:43.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.053+0000 7fdcb0907700 1 -- 172.21.15.133:0/176704188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac145b60 con 0x7fdcac05c130 2021-01-03T13:05:43.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.053+0000 7fdcb0907700 1 --2- 172.21.15.133:0/176704188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcac05c130 0x7fdcac14c7a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7fdcac0b00b0 tx=0x7fdca0007c00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:43.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.053+0000 7fdca9ffb700 1 -- 172.21.15.133:0/176704188 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdca000e4a0 con 0x7fdcac05c130 2021-01-03T13:05:43.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.053+0000 7fdca9ffb700 1 -- 172.21.15.133:0/176704188 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca000e600 con 0x7fdcac05c130 2021-01-03T13:05:43.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.053+0000 7fdca9ffb700 1 -- 172.21.15.133:0/176704188 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdca000e960 con 0x7fdcac05c130 2021-01-03T13:05:43.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.053+0000 7fdcb1909700 1 -- 172.21.15.133:0/176704188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcac0ae4b0 con 0x7fdcac05c130 2021-01-03T13:05:43.078 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.053+0000 7fdcb1909700 1 -- 172.21.15.133:0/176704188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcac146c00 con 0x7fdcac05c130 2021-01-03T13:05:43.078 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.053+0000 7fdcb1909700 1 -- 172.21.15.133:0/176704188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcac145680 con 0x7fdcac05c130 2021-01-03T13:05:43.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.053+0000 7fdca9ffb700 1 -- 172.21.15.133:0/176704188 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fdca0010030 con 0x7fdcac05c130 2021-01-03T13:05:43.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.057+0000 7fdca9ffb700 1 --2- 172.21.15.133:0/176704188 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdc8c055440 0x7fdc8c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:43.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.057+0000 7fdca9ffb700 1 -- 172.21.15.133:0/176704188 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdca006dd50 con 0x7fdcac05c130 2021-01-03T13:05:43.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.057+0000 7fdcabfff700 1 --2- 172.21.15.133:0/176704188 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdc8c055440 0x7fdc8c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:43.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.057+0000 7fdcabfff700 1 --2- 172.21.15.133:0/176704188 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdc8c055440 0x7fdc8c057900 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fdc9c00d000 tx=0x7fdc9c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:43.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.061+0000 7fdca9ffb700 1 -- 172.21.15.133:0/176704188 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdca0044050 con 0x7fdcac05c130 2021-01-03T13:05:43.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.241+0000 7fdcb1909700 1 -- 172.21.15.133:0/176704188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcac145cf0 con 0x7fdcac05c130 2021-01-03T13:05:43.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.245+0000 7fdca9ffb700 1 -- 172.21.15.133:0/176704188 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2499 (secure 0 0 0) 0x7fdca0047670 con 0x7fdcac05c130 2021-01-03T13:05:43.250 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:43.250 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":43,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6014,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1098287672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1098287672},{"type":"v1","addr":"172.21.15.133:6837","nonce":1098287672}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1817607475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1817607475},{"type":"v1","addr":"172.21.15.16:6833","nonce":1817607475}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:34.203844+0000","modified":"2021-01-03T13:05:35.206833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6817},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6817":{"gid":6817,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/1339474843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1339474843},{"type":"v1","addr":"172.21.15.133:6835","nonce":1339474843}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-01-03T13:05:43.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.245+0000 7fdcb1909700 1 -- 172.21.15.133:0/176704188 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdc8c055440 msgr2=0x7fdc8c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:43.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.245+0000 7fdcb1909700 1 --2- 172.21.15.133:0/176704188 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdc8c055440 0x7fdc8c057900 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fdc9c00d000 tx=0x7fdc9c008040).stop 2021-01-03T13:05:43.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.245+0000 7fdcb1909700 1 -- 172.21.15.133:0/176704188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcac05c130 msgr2=0x7fdcac14c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:43.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.245+0000 7fdcb1909700 1 --2- 172.21.15.133:0/176704188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcac05c130 0x7fdcac14c7a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7fdcac0b00b0 tx=0x7fdca0007c00).stop 2021-01-03T13:05:43.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.245+0000 7fdcb1909700 1 -- 172.21.15.133:0/176704188 shutdown_connections 2021-01-03T13:05:43.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.245+0000 7fdcb1909700 1 --2- 172.21.15.133:0/176704188 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdc8c055440 0x7fdc8c057900 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:43.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.245+0000 7fdcb1909700 1 --2- 172.21.15.133:0/176704188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdcac1479e0 0x7fdcac1464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:43.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.245+0000 7fdcb1909700 1 --2- 172.21.15.133:0/176704188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdcac05c130 0x7fdcac14c7a0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:43.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.245+0000 7fdcb1909700 1 --2- 172.21.15.133:0/176704188 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdcac061890 0x7fdcac146000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:43.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.245+0000 7fdcb1909700 1 -- 172.21.15.133:0/176704188 >> 172.21.15.133:0/176704188 conn(0x7fdcac0b6110 msgr2=0x7fdcac0b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:43.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.245+0000 7fdcb1909700 1 -- 172.21.15.133:0/176704188 shutdown_connections 2021-01-03T13:05:43.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:43.245+0000 7fdcb1909700 1 -- 172.21.15.133:0/176704188 wait complete. 2021-01-03T13:05:43.256 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 43 2021-01-03T13:05:43.568 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:05:34.203844+0000', 'modified': '2021-01-03T13:05:35.206833+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6817}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6817': {'gid': 6817, 'name': 'c', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6835/1339474843', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 1339474843}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 1339474843}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:05:43.568 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:05:43.569 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T13:05:43.699 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":6817,"want_state":"up:active","state":"up:active","rank_uptime":9.4807550719999991,"mdsmap_epoch":43,"osdmap_epoch":102,"osdmap_epoch_barrier":100,"uptime":13.878172804} 2021-01-03T13:05:43.699 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 6817, "mdsmap_epoch": 43, "osdmap_epoch": 102, "osdmap_epoch_barrier": 100, "rank_uptime": 9.480755072, "state": "up:active", "uptime": 13.878172804, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:05:43.700 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:05:43.700 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-01-03T13:05:43.701 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi036.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-01-03T13:05:43.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:43.701 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:43.710 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:05:43.770 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:05:43.771 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:05:43.831 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:05:43.831 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:05:43.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:43.832 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:05:43.880 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:05:43.881 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:43.924 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:05:43.941 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:05:43.942 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:05:43.998 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:2021-01-03T13:05:43.995+0000 7f4547cd40c0 -1 init, newargv = 0x557aa2d70ce0 newargc=9 2021-01-03T13:05:43.999 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[11970]: starting ceph client 2021-01-03T13:05:44.000 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:05:44.002 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:05:44.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:44.003 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:05:44.009 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[11970]: starting fuse 2021-01-03T13:05:44.015 INFO:teuthology.orchestra.run.smithi036.stdout:50 2021-01-03T13:05:44.016 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:05:44.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:44.017 DEBUG:teuthology.orchestra.run.smithi036:> sudo python3 -c ' 2021-01-03T13:05:44.017 DEBUG:teuthology.orchestra.run.smithi036:> import glob 2021-01-03T13:05:44.018 DEBUG:teuthology.orchestra.run.smithi036:> import re 2021-01-03T13:05:44.018 DEBUG:teuthology.orchestra.run.smithi036:> import os 2021-01-03T13:05:44.019 DEBUG:teuthology.orchestra.run.smithi036:> import subprocess 2021-01-03T13:05:44.019 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:05:44.019 DEBUG:teuthology.orchestra.run.smithi036:> def find_socket(client_name): 2021-01-03T13:05:44.020 DEBUG:teuthology.orchestra.run.smithi036:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-01-03T13:05:44.020 DEBUG:teuthology.orchestra.run.smithi036:> files = glob.glob(asok_path) 2021-01-03T13:05:44.021 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:05:44.021 DEBUG:teuthology.orchestra.run.smithi036:> # Given a non-glob path, it better be there 2021-01-03T13:05:44.021 DEBUG:teuthology.orchestra.run.smithi036:> if "*" not in asok_path: 2021-01-03T13:05:44.022 DEBUG:teuthology.orchestra.run.smithi036:> assert(len(files) == 1) 2021-01-03T13:05:44.022 DEBUG:teuthology.orchestra.run.smithi036:> return files[0] 2021-01-03T13:05:44.023 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:05:44.023 DEBUG:teuthology.orchestra.run.smithi036:> for f in files: 2021-01-03T13:05:44.024 DEBUG:teuthology.orchestra.run.smithi036:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:05:44.025 DEBUG:teuthology.orchestra.run.smithi036:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:05:44.026 DEBUG:teuthology.orchestra.run.smithi036:> return f 2021-01-03T13:05:44.026 DEBUG:teuthology.orchestra.run.smithi036:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:05:44.027 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:05:44.028 DEBUG:teuthology.orchestra.run.smithi036:> print(find_socket("client.1")) 2021-01-03T13:05:44.029 DEBUG:teuthology.orchestra.run.smithi036:> ' 2021-01-03T13:05:44.106 INFO:teuthology.orchestra.run.smithi036.stdout:/var/run/ceph/ceph-client.1.11970.asok 2021-01-03T13:05:44.112 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.11970.asok 2021-01-03T13:05:44.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:44.113 DEBUG:teuthology.orchestra.run.smithi036:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.11970.asok status 2021-01-03T13:05:44.221 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2021-01-03T13:05:44.221 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": { 2021-01-03T13:05:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:05:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:05:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: "entity_id": "1", 2021-01-03T13:05:44.222 INFO:teuthology.orchestra.run.smithi036.stdout: "hostname": "smithi036", 2021-01-03T13:05:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-01-03T13:05:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: "pid": "11970", 2021-01-03T13:05:44.223 INFO:teuthology.orchestra.run.smithi036.stdout: "root": "/" 2021-01-03T13:05:44.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:05:44.225 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_count": 0, 2021-01-03T13:05:44.225 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_pinned_count": 0, 2021-01-03T13:05:44.225 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 7030, 2021-01-03T13:05:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: "inst": { 2021-01-03T13:05:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: "name": { 2021-01-03T13:05:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "client", 2021-01-03T13:05:44.226 INFO:teuthology.orchestra.run.smithi036.stdout: "num": 7030 2021-01-03T13:05:44.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:05:44.227 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:05:44.227 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:05:44.227 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:05:44.227 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 1153985456 2021-01-03T13:05:44.228 INFO:teuthology.orchestra.run.smithi036.stdout: } 2021-01-03T13:05:44.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:05:44.228 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:05:44.228 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:05:44.228 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:05:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 1153985456 2021-01-03T13:05:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:05:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: "inst_str": "client.7030 172.21.15.36:0/1153985456", 2021-01-03T13:05:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: "addr_str": "172.21.15.36:0/1153985456", 2021-01-03T13:05:44.229 INFO:teuthology.orchestra.run.smithi036.stdout: "inode_count": 1, 2021-01-03T13:05:44.230 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_epoch": 43, 2021-01-03T13:05:44.230 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch": 102, 2021-01-03T13:05:44.230 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:05:44.230 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklisted": false, 2021-01-03T13:05:44.231 INFO:teuthology.orchestra.run.smithi036.stdout: "fs_name": "cephfs" 2021-01-03T13:05:44.231 INFO:teuthology.orchestra.run.smithi036.stdout:} 2021-01-03T13:05:44.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:44.232 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:05:44.233 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:44.242 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:05:44.243 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:05:44.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:44.244 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:44.301 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-01-03T13:05:44.301 DEBUG:teuthology.orchestra.run.smithi007:> cd /home/ubuntu/cephtest/mnt.0 && sudo mkdir -p foo 2021-01-03T13:05:44.334 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-01-03T13:05:44.334 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:05:44.334 DEBUG:teuthology.orchestra.run.smithi007:> import stat 2021-01-03T13:05:44.335 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:05:44.335 DEBUG:teuthology.orchestra.run.smithi007:> print(os.stat("/home/ubuntu/cephtest/mnt.0/foo").st_ino) 2021-01-03T13:05:44.336 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:05:44.460 INFO:teuthology.orchestra.run.smithi007.stdout:1099511627776 2021-01-03T13:05:44.650 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:05:44.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f708c965700 1 Processor -- start 2021-01-03T13:05:44.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f708c965700 1 -- start start 2021-01-03T13:05:44.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f708c965700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f70880b0c90 0x7f70880b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:44.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f708c965700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70880b5c00 0x7f7088143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:44.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f708c965700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7088060da0 con 0x7f70880b52c0 2021-01-03T13:05:44.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f708c965700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7088067a90 con 0x7f70880b0c90 2021-01-03T13:05:44.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f708c965700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70880b0ad0 con 0x7f70880b5c00 2021-01-03T13:05:44.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f708659c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f70880b0c90 0x7f70880b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:44.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f7086d9d700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f70880b52c0 0x7f7088098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:37224/0 (socket says 172.21.15.133:37224) 2021-01-03T13:05:44.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f7086d9d700 1 -- 172.21.15.133:0/1324235618 learned_addr learned my addr 172.21.15.133:0/1324235618 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:44.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f708759e700 1 --2- 172.21.15.133:0/1324235618 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70880b5c00 0x7f7088143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:44.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f708659c700 1 -- 172.21.15.133:0/1324235618 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70880b5c00 msgr2=0x7f7088143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:44.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f708659c700 1 --2- 172.21.15.133:0/1324235618 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70880b5c00 0x7f7088143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:44.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f708659c700 1 -- 172.21.15.133:0/1324235618 >> v1:172.21.15.16:6789/0 conn(0x7f70880b52c0 legacy=0x7f7088098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:44.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f708659c700 1 -- 172.21.15.133:0/1324235618 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70880b56a0 con 0x7f70880b0c90 2021-01-03T13:05:44.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f708659c700 1 --2- 172.21.15.133:0/1324235618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70880b0c90 0x7f70880b05e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f7080001450 tx=0x7f7078006dc0).ready entity=mon.0 client_cookie=cd8f1c9ba7053aca server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:44.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f7085d9b700 1 -- 172.21.15.133:0/1324235618 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70780095d0 con 0x7f70880b0c90 2021-01-03T13:05:44.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f7085d9b700 1 -- 172.21.15.133:0/1324235618 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7078009730 con 0x7f70880b0c90 2021-01-03T13:05:44.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f7085d9b700 1 -- 172.21.15.133:0/1324235618 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7078009a90 con 0x7f70880b0c90 2021-01-03T13:05:44.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f708c965700 1 -- 172.21.15.133:0/1324235618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70880b0c90 msgr2=0x7f70880b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:44.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.765+0000 7f708c965700 1 --2- 172.21.15.133:0/1324235618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70880b0c90 0x7f70880b05e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f7080001450 tx=0x7f7078006dc0).stop 2021-01-03T13:05:44.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f708c965700 1 -- 172.21.15.133:0/1324235618 shutdown_connections 2021-01-03T13:05:44.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f708c965700 1 --2- 172.21.15.133:0/1324235618 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70880b5c00 0x7f7088143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:44.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f708c965700 1 --2- 172.21.15.133:0/1324235618 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70880b0c90 0x7f70880b05e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:44.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f708c965700 1 -- 172.21.15.133:0/1324235618 >> 172.21.15.133:0/1324235618 conn(0x7f708805bdf0 msgr2=0x7f708805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:44.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f708c965700 1 -- 172.21.15.133:0/1324235618 shutdown_connections 2021-01-03T13:05:44.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f708c965700 1 -- 172.21.15.133:0/1324235618 wait complete. 2021-01-03T13:05:44.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f708c965700 1 Processor -- start 2021-01-03T13:05:44.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f708c965700 1 -- start start 2021-01-03T13:05:44.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f708c965700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880b0c90 0x7f708814dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:44.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f708c965700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70880b52c0 0x7f7088064290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:44.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f708c965700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70880b5c00 0x7f7088064df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:44.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f708c965700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7088066d80 con 0x7f70880b52c0 2021-01-03T13:05:44.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f708c965700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7088067020 con 0x7f70880b0c90 2021-01-03T13:05:44.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f708c965700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70880672c0 con 0x7f70880b5c00 2021-01-03T13:05:44.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f7086d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880b0c90 0x7f708814dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:44.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f7086d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880b0c90 0x7f708814dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37472/0 (socket says 172.21.15.133:37472) 2021-01-03T13:05:44.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f7086d9d700 1 -- 172.21.15.133:0/622380061 learned_addr learned my addr 172.21.15.133:0/622380061 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:44.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f708759e700 1 --2- 172.21.15.133:0/622380061 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70880b5c00 0x7f7088064df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:44.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f708659c700 1 --2- 172.21.15.133:0/622380061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70880b52c0 0x7f7088064290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:44.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f7086d9d700 1 -- 172.21.15.133:0/622380061 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70880b5c00 msgr2=0x7f7088064df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:44.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f7086d9d700 1 --2- 172.21.15.133:0/622380061 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70880b5c00 0x7f7088064df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f7086d9d700 1 -- 172.21.15.133:0/622380061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70880b52c0 msgr2=0x7f7088064290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f7086d9d700 1 --2- 172.21.15.133:0/622380061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70880b52c0 0x7f7088064290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f7086d9d700 1 -- 172.21.15.133:0/622380061 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7088067560 con 0x7f70880b0c90 2021-01-03T13:05:44.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.769+0000 7f7086d9d700 1 --2- 172.21.15.133:0/622380061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880b0c90 0x7f708814dff0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f7080001510 tx=0x7f7080007f50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:44.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.773+0000 7f707ffff700 1 -- 172.21.15.133:0/622380061 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7080005b70 con 0x7f70880b0c90 2021-01-03T13:05:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.773+0000 7f708c965700 1 -- 172.21.15.133:0/622380061 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70880ae8c0 con 0x7f70880b0c90 2021-01-03T13:05:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.773+0000 7f707ffff700 1 -- 172.21.15.133:0/622380061 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7080005cd0 con 0x7f70880b0c90 2021-01-03T13:05:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.773+0000 7f707ffff700 1 -- 172.21.15.133:0/622380061 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7080007300 con 0x7f70880b0c90 2021-01-03T13:05:44.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.773+0000 7f708c965700 1 -- 172.21.15.133:0/622380061 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7088064780 con 0x7f70880b0c90 2021-01-03T13:05:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.773+0000 7f708c965700 1 -- 172.21.15.133:0/622380061 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7088057300 con 0x7f70880b0c90 2021-01-03T13:05:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.773+0000 7f707ffff700 1 -- 172.21.15.133:0/622380061 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7080010030 con 0x7f70880b0c90 2021-01-03T13:05:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.773+0000 7f707ffff700 1 --2- 172.21.15.133:0/622380061 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f706c055470 0x7f706c057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.773+0000 7f707ffff700 1 -- 172.21.15.133:0/622380061 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f708006e160 con 0x7f70880b0c90 2021-01-03T13:05:44.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.773+0000 7f708659c700 1 --2- 172.21.15.133:0/622380061 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f706c055470 0x7f706c057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:44.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.777+0000 7f708659c700 1 --2- 172.21.15.133:0/622380061 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f706c055470 0x7f706c057930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f707801a000 tx=0x7f7078015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:44.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.777+0000 7f707ffff700 1 -- 172.21.15.133:0/622380061 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f70800443c0 con 0x7f70880b0c90 2021-01-03T13:05:44.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.965+0000 7f708c965700 1 -- 172.21.15.133:0/622380061 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7088060860 con 0x7f70880b0c90 2021-01-03T13:05:44.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.965+0000 7f707ffff700 1 -- 172.21.15.133:0/622380061 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2499 (secure 0 0 0) 0x7f70800479e0 con 0x7f70880b0c90 2021-01-03T13:05:44.971 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:44.972 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":43,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6014,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1098287672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1098287672},{"type":"v1","addr":"172.21.15.133:6837","nonce":1098287672}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1817607475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1817607475},{"type":"v1","addr":"172.21.15.16:6833","nonce":1817607475}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:34.203844+0000","modified":"2021-01-03T13:05:35.206833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6817},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6817":{"gid":6817,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/1339474843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1339474843},{"type":"v1","addr":"172.21.15.133:6835","nonce":1339474843}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-01-03T13:05:44.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.969+0000 7f708c965700 1 -- 172.21.15.133:0/622380061 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f706c055470 msgr2=0x7f706c057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:44.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.969+0000 7f708c965700 1 --2- 172.21.15.133:0/622380061 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f706c055470 0x7f706c057930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f707801a000 tx=0x7f7078015000).stop 2021-01-03T13:05:44.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.969+0000 7f708c965700 1 -- 172.21.15.133:0/622380061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880b0c90 msgr2=0x7f708814dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:44.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.969+0000 7f708c965700 1 --2- 172.21.15.133:0/622380061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880b0c90 0x7f708814dff0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f7080001510 tx=0x7f7080007f50).stop 2021-01-03T13:05:44.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.969+0000 7f708c965700 1 -- 172.21.15.133:0/622380061 shutdown_connections 2021-01-03T13:05:44.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.969+0000 7f708c965700 1 --2- 172.21.15.133:0/622380061 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f706c055470 0x7f706c057930 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:44.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.969+0000 7f708c965700 1 --2- 172.21.15.133:0/622380061 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f70880b5c00 0x7f7088064df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:44.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.969+0000 7f708c965700 1 --2- 172.21.15.133:0/622380061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880b0c90 0x7f708814dff0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:44.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.969+0000 7f708c965700 1 --2- 172.21.15.133:0/622380061 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70880b52c0 0x7f7088064290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:44.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.969+0000 7f708c965700 1 -- 172.21.15.133:0/622380061 >> 172.21.15.133:0/622380061 conn(0x7f708805bdf0 msgr2=0x7f70880600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:44.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.969+0000 7f708c965700 1 -- 172.21.15.133:0/622380061 shutdown_connections 2021-01-03T13:05:44.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:44.969+0000 7f708c965700 1 -- 172.21.15.133:0/622380061 wait complete. 2021-01-03T13:05:44.977 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 43 2021-01-03T13:05:44.984 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 0x10000000000 2021-01-03T13:05:45.096 INFO:teuthology.orchestra.run.smithi133.stdout:{"path":"/foo","ino":1099511627776,"rdev":0,"ctime":"2021-01-03T13:05:44.323856+0000","btime":"2021-01-03T13:05:44.323856+0000","mode":16877,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2021-01-03T13:05:44.323856+0000","atime":"2021-01-03T13:05:44.323856+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":6122,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":6122,"want_loner":6122,"mds_caps_wanted":[]} 2021-01-03T13:05:45.097 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2021-01-03T13:05:44.323856+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "backtrace_version": 2, "btime": "2021-01-03T13:05:44.323856+0000", "change_attr": 0, "client_caps": [ { "client_id": 6122, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2021-01-03T13:05:44.323856+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "flocklock": {}, "gid": 0, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 6122, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2021-01-03T13:05:44.323856+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/foo", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 0, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": 6122, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "xattrs": [] } 2021-01-03T13:05:45.098 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:05:45.098 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:05:45.118 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:05:45.136 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:05:45.155 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:05:45.173 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:05:45.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:45.174 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:05:45.174 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:45.182 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:05:45.183 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:05:45.184 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T13:05:45.184 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:05:45.184 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:45.262 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12448]: fuse finished with error 0 and tester_r 0 2021-01-03T13:05:45.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:45.264 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:05:45.265 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:45.312 INFO:teuthology.orchestra.run.smithi007.stdout:ext2/ext3 2021-01-03T13:05:45.314 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:05:45.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:05:45.357 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:45.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:45.405 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:05:45.405 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:45.413 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:05:45.579 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:05:45.579 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi036.front.sepia.ceph.com... 2021-01-03T13:05:45.580 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:05:45.580 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:45.655 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[11970]: fuse finished with error 0 and tester_r 0 2021-01-03T13:05:45.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:45.657 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:05:45.657 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:45.704 INFO:teuthology.orchestra.run.smithi036.stdout:ext2/ext3 2021-01-03T13:05:45.705 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:05:45.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:05:45.794 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:45.801 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-01-03T13:05:45.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.921+0000 7f9be6593700 1 Processor -- start 2021-01-03T13:05:45.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.921+0000 7f9be6593700 1 -- start start 2021-01-03T13:05:45.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.921+0000 7f9be6593700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9be00ace10 0x7f9be00b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:45.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.921+0000 7f9be6593700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9be00ad1f0 0x7f9be00b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:45.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.921+0000 7f9be6593700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9be00b5470 0x7f9be0140a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:45.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.921+0000 7f9be6593700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be0144050 con 0x7f9be00b5470 2021-01-03T13:05:45.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.921+0000 7f9be6593700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be0144f00 con 0x7f9be00ad1f0 2021-01-03T13:05:45.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.921+0000 7f9be6593700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be0144280 con 0x7f9be00ace10 2021-01-03T13:05:45.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.921+0000 7f9be4d90700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9be00ad1f0 0x7f9be00b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:45.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.921+0000 7f9be4d90700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9be00ad1f0 0x7f9be00b4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37478/0 (socket says 172.21.15.133:37478) 2021-01-03T13:05:45.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.921+0000 7f9be4d90700 1 -- 172.21.15.133:0/630407845 learned_addr learned my addr 172.21.15.133:0/630407845 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:45.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.921+0000 7f9be5591700 1 --2- 172.21.15.133:0/630407845 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9be00ace10 0x7f9be00b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:45.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.921+0000 7f9be5d92700 1 --2- 172.21.15.133:0/630407845 >> v2:172.21.15.16:3300/0 conn(0x7f9be00b5470 0x7f9be0140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:45.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be4d90700 1 -- 172.21.15.133:0/630407845 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9be00ace10 msgr2=0x7f9be00b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:45.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be4d90700 1 --2- 172.21.15.133:0/630407845 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9be00ace10 0x7f9be00b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:45.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be4d90700 1 -- 172.21.15.133:0/630407845 >> v2:172.21.15.16:3300/0 conn(0x7f9be00b5470 msgr2=0x7f9be0140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:45.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be4d90700 1 --2- 172.21.15.133:0/630407845 >> v2:172.21.15.16:3300/0 conn(0x7f9be00b5470 0x7f9be0140a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:45.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be4d90700 1 -- 172.21.15.133:0/630407845 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be0144520 con 0x7f9be00ad1f0 2021-01-03T13:05:45.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be4d90700 1 --2- 172.21.15.133:0/630407845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00ad1f0 0x7f9be00b4f80 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f9bdc002f30 tx=0x7f9bdc006e80).ready entity=mon.1 client_cookie=eac9328e530b0a03 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:45.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9bd3fff700 1 -- 172.21.15.133:0/630407845 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bdc009640 con 0x7f9be00ad1f0 2021-01-03T13:05:45.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9bd3fff700 1 -- 172.21.15.133:0/630407845 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc0097a0 con 0x7f9be00ad1f0 2021-01-03T13:05:45.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be6593700 1 -- 172.21.15.133:0/630407845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00ad1f0 msgr2=0x7f9be00b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:45.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9bd3fff700 1 -- 172.21.15.133:0/630407845 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bdc009b00 con 0x7f9be00ad1f0 2021-01-03T13:05:45.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be6593700 1 --2- 172.21.15.133:0/630407845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00ad1f0 0x7f9be00b4f80 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f9bdc002f30 tx=0x7f9bdc006e80).stop 2021-01-03T13:05:45.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be6593700 1 -- 172.21.15.133:0/630407845 shutdown_connections 2021-01-03T13:05:45.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be6593700 1 --2- 172.21.15.133:0/630407845 >> v2:172.21.15.16:3300/0 conn(0x7f9be00b5470 0x7f9be0140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:45.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be6593700 1 --2- 172.21.15.133:0/630407845 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9be00ace10 0x7f9be00b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:45.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be6593700 1 --2- 172.21.15.133:0/630407845 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00ad1f0 0x7f9be00b4f80 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:45.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be6593700 1 -- 172.21.15.133:0/630407845 >> 172.21.15.133:0/630407845 conn(0x7f9be005bdf0 msgr2=0x7f9be005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:45.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be6593700 1 -- 172.21.15.133:0/630407845 shutdown_connections 2021-01-03T13:05:45.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be6593700 1 -- 172.21.15.133:0/630407845 wait complete. 2021-01-03T13:05:45.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be6593700 1 Processor -- start 2021-01-03T13:05:45.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be6593700 1 -- start start 2021-01-03T13:05:45.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be6593700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9be00ace10 0x7f9be0141130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:45.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be6593700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9be00ad1f0 0x7f9be01401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:45.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be6593700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00b5470 0x7f9be014fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:45.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be6593700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be00b0390 con 0x7f9be00ace10 2021-01-03T13:05:45.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be6593700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be00636c0 con 0x7f9be00b5470 2021-01-03T13:05:45.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be6593700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be0150810 con 0x7f9be00ad1f0 2021-01-03T13:05:45.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be5d92700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00b5470 0x7f9be014fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:45.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be5d92700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00b5470 0x7f9be014fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37488/0 (socket says 172.21.15.133:37488) 2021-01-03T13:05:45.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be5d92700 1 -- 172.21.15.133:0/3368726676 learned_addr learned my addr 172.21.15.133:0/3368726676 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:45.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be5591700 1 --2- 172.21.15.133:0/3368726676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9be00ace10 0x7f9be0141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:45.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.925+0000 7f9be4d90700 1 --2- 172.21.15.133:0/3368726676 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9be00ad1f0 0x7f9be01401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:45.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.929+0000 7f9be5d92700 1 -- 172.21.15.133:0/3368726676 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9be00ad1f0 msgr2=0x7f9be01401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:45.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.929+0000 7f9be5d92700 1 --2- 172.21.15.133:0/3368726676 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9be00ad1f0 0x7f9be01401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:45.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.929+0000 7f9be5d92700 1 -- 172.21.15.133:0/3368726676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9be00ace10 msgr2=0x7f9be0141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:45.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.929+0000 7f9be5d92700 1 --2- 172.21.15.133:0/3368726676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9be00ace10 0x7f9be0141130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:45.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.929+0000 7f9be5d92700 1 -- 172.21.15.133:0/3368726676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be0140c40 con 0x7f9be00b5470 2021-01-03T13:05:45.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.929+0000 7f9be5d92700 1 --2- 172.21.15.133:0/3368726676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00b5470 0x7f9be014fc10 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f9bd800c000 tx=0x7f9bd80091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:45.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.929+0000 7f9bd27fc700 1 -- 172.21.15.133:0/3368726676 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bd800c8f0 con 0x7f9be00b5470 2021-01-03T13:05:45.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.929+0000 7f9bd27fc700 1 -- 172.21.15.133:0/3368726676 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd800ca50 con 0x7f9be00b5470 2021-01-03T13:05:45.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.929+0000 7f9be6593700 1 -- 172.21.15.133:0/3368726676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be01406b0 con 0x7f9be00b5470 2021-01-03T13:05:45.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.929+0000 7f9bd27fc700 1 -- 172.21.15.133:0/3368726676 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bd800cdb0 con 0x7f9be00b5470 2021-01-03T13:05:45.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.929+0000 7f9be6593700 1 -- 172.21.15.133:0/3368726676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be0063cd0 con 0x7f9be00b5470 2021-01-03T13:05:45.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.929+0000 7f9be6593700 1 -- 172.21.15.133:0/3368726676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be01509d0 con 0x7f9be00b5470 2021-01-03T13:05:45.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.929+0000 7f9bd27fc700 1 -- 172.21.15.133:0/3368726676 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9bd8022070 con 0x7f9be00b5470 2021-01-03T13:05:45.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.929+0000 7f9bd27fc700 1 --2- 172.21.15.133:0/3368726676 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9bc80553b0 0x7f9bc8057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:45.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.929+0000 7f9bd27fc700 1 -- 172.21.15.133:0/3368726676 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9bd806e5d0 con 0x7f9be00b5470 2021-01-03T13:05:45.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.929+0000 7f9be5591700 1 --2- 172.21.15.133:0/3368726676 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9bc80553b0 0x7f9bc8057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:45.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.933+0000 7f9be5591700 1 --2- 172.21.15.133:0/3368726676 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9bc80553b0 0x7f9bc8057870 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f9bd400b000 tx=0x7f9bd4006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:45.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:45.937+0000 7f9bd27fc700 1 -- 172.21.15.133:0/3368726676 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9bd8044830 con 0x7f9be00b5470 2021-01-03T13:05:46.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.077+0000 7f9be6593700 1 -- 172.21.15.133:0/3368726676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9be0057300 con 0x7f9be00b5470 2021-01-03T13:05:46.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.085+0000 7f9bd27fc700 1 -- 172.21.15.133:0/3368726676 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9bd8016020 con 0x7f9be00b5470 2021-01-03T13:05:46.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.089+0000 7f9be6593700 1 -- 172.21.15.133:0/3368726676 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9bc80553b0 msgr2=0x7f9bc8057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:46.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.089+0000 7f9be6593700 1 --2- 172.21.15.133:0/3368726676 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9bc80553b0 0x7f9bc8057870 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f9bd400b000 tx=0x7f9bd4006dc0).stop 2021-01-03T13:05:46.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.089+0000 7f9be6593700 1 -- 172.21.15.133:0/3368726676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00b5470 msgr2=0x7f9be014fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:46.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.089+0000 7f9be6593700 1 --2- 172.21.15.133:0/3368726676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00b5470 0x7f9be014fc10 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f9bd800c000 tx=0x7f9bd80091a0).stop 2021-01-03T13:05:46.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.089+0000 7f9be6593700 1 -- 172.21.15.133:0/3368726676 shutdown_connections 2021-01-03T13:05:46.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.089+0000 7f9be6593700 1 --2- 172.21.15.133:0/3368726676 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9bc80553b0 0x7f9bc8057870 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:46.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.089+0000 7f9be6593700 1 --2- 172.21.15.133:0/3368726676 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9be00ace10 0x7f9be0141130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:46.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.089+0000 7f9be6593700 1 --2- 172.21.15.133:0/3368726676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00b5470 0x7f9be014fc10 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:46.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.089+0000 7f9be6593700 1 --2- 172.21.15.133:0/3368726676 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9be00ad1f0 0x7f9be01401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:46.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.089+0000 7f9be6593700 1 -- 172.21.15.133:0/3368726676 >> 172.21.15.133:0/3368726676 conn(0x7f9be005bdf0 msgr2=0x7f9be01428a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:46.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.089+0000 7f9be6593700 1 -- 172.21.15.133:0/3368726676 shutdown_connections 2021-01-03T13:05:46.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.089+0000 7f9be6593700 1 -- 172.21.15.133:0/3368726676 wait complete. 2021-01-03T13:05:46.106 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2021-01-03T13:05:46.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.217+0000 7fd3fb59e700 1 Processor -- start 2021-01-03T13:05:46.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.217+0000 7fd3fb59e700 1 -- start start 2021-01-03T13:05:46.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.217+0000 7fd3fb59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd3fc0b1590 0x7fd3fc0b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:46.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.217+0000 7fd3fb59e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3fc05fd00 con 0x7fd3fc066f30 2021-01-03T13:05:46.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.217+0000 7fd3fb59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3fc0accd0 con 0x7fd3fc05f920 2021-01-03T13:05:46.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.217+0000 7fd3fb59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3fc0b2980 con 0x7fd3fc0b1590 2021-01-03T13:05:46.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.217+0000 7fd3fa59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd3fc05f920 0x7fd3fc0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58526/0 (socket says 172.21.15.133:58526) 2021-01-03T13:05:46.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.217+0000 7fd3fa59c700 1 -- 172.21.15.133:0/4014584101 learned_addr learned my addr 172.21.15.133:0/4014584101 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:46.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3fad9d700 1 --2- 172.21.15.133:0/4014584101 >> v2:172.21.15.16:3300/0 conn(0x7fd3fc0b1590 0x7fd3fc0b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:46.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 -- 172.21.15.133:0/4014584101 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603514215 0 0) 0x7fd3fc0accd0 con 0x7fd3fc05f920 2021-01-03T13:05:46.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 -- 172.21.15.133:0/4014584101 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3dc003230 con 0x7fd3fc05f920 2021-01-03T13:05:46.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 -- 172.21.15.133:0/4014584101 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32522044 0 0) 0x7fd3fc05fd00 con 0x7fd3fc066f30 2021-01-03T13:05:46.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 -- 172.21.15.133:0/4014584101 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3fc0accd0 con 0x7fd3fc066f30 2021-01-03T13:05:46.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 -- 172.21.15.133:0/4014584101 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3223700092 0 0) 0x7fd3dc003230 con 0x7fd3fc05f920 2021-01-03T13:05:46.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 -- 172.21.15.133:0/4014584101 >> v2:172.21.15.16:3300/0 conn(0x7fd3fc0b1590 msgr2=0x7fd3fc0b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:46.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 --2- 172.21.15.133:0/4014584101 >> v2:172.21.15.16:3300/0 conn(0x7fd3fc0b1590 0x7fd3fc0b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:46.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 -- 172.21.15.133:0/4014584101 >> v1:172.21.15.16:6789/0 conn(0x7fd3fc066f30 legacy=0x7fd3fc13ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:46.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 -- 172.21.15.133:0/4014584101 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc0acf70 con 0x7fd3fc05f920 2021-01-03T13:05:46.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 -- 172.21.15.133:0/4014584101 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fd3ec0016d0 con 0x7fd3fc05f920 2021-01-03T13:05:46.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 -- 172.21.15.133:0/4014584101 >> v1:172.21.15.133:6789/0 conn(0x7fd3fc05f920 legacy=0x7fd3fc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:46.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 --2- 172.21.15.133:0/4014584101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3dc0038b0 0x7fd3dc003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:46.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 --2- 172.21.15.133:0/4014584101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3dc0044d0 0x7fd3dc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:46.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 --2- 172.21.15.133:0/4014584101 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd3dc004e40 0x7fd3dc00d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:46.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 -- 172.21.15.133:0/4014584101 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc0b2980 con 0x7fd3dc0044d0 2021-01-03T13:05:46.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 -- 172.21.15.133:0/4014584101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc0053a0 con 0x7fd3dc0038b0 2021-01-03T13:05:46.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 -- 172.21.15.133:0/4014584101 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc00dea0 con 0x7fd3dc004e40 2021-01-03T13:05:46.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3fa59c700 1 --2- 172.21.15.133:0/4014584101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3dc0038b0 0x7fd3dc003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:46.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f1d9b700 1 --2- 172.21.15.133:0/4014584101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3dc0044d0 0x7fd3dc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:46.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3fad9d700 1 --2- 172.21.15.133:0/4014584101 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd3dc004e40 0x7fd3dc00d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:46.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3fa59c700 1 -- 172.21.15.133:0/4014584101 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd3dc004e40 msgr2=0x7fd3dc00d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:46.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3fa59c700 1 --2- 172.21.15.133:0/4014584101 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd3dc004e40 0x7fd3dc00d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:46.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3fa59c700 1 -- 172.21.15.133:0/4014584101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3dc0044d0 msgr2=0x7fd3dc004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:46.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3fa59c700 1 --2- 172.21.15.133:0/4014584101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3dc0044d0 0x7fd3dc004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:46.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3fa59c700 1 -- 172.21.15.133:0/4014584101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc003230 con 0x7fd3dc0038b0 2021-01-03T13:05:46.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3fad9d700 1 -- 172.21.15.133:0/4014584101 reap_dead start 2021-01-03T13:05:46.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f1d9b700 1 --2- 172.21.15.133:0/4014584101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3dc0044d0 0x7fd3dc004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:46.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3fa59c700 1 --2- 172.21.15.133:0/4014584101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3dc0038b0 0x7fd3dc003cb0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fd3ec0014a0 tx=0x7fd3fc060050).ready entity=mon.1 client_cookie=d6789de937af8e7b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:46.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 -- 172.21.15.133:0/4014584101 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3ec00ce00 con 0x7fd3dc0038b0 2021-01-03T13:05:46.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 -- 172.21.15.133:0/4014584101 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ec0072e0 con 0x7fd3dc0038b0 2021-01-03T13:05:46.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3f9d9b700 1 -- 172.21.15.133:0/4014584101 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3ec0057d0 con 0x7fd3dc0038b0 2021-01-03T13:05:46.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3fb59e700 1 -- 172.21.15.133:0/4014584101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3dc0038b0 msgr2=0x7fd3dc003cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:46.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3fb59e700 1 --2- 172.21.15.133:0/4014584101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3dc0038b0 0x7fd3dc003cb0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7fd3ec0014a0 tx=0x7fd3fc060050).stop 2021-01-03T13:05:46.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3fb59e700 1 -- 172.21.15.133:0/4014584101 shutdown_connections 2021-01-03T13:05:46.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3fb59e700 1 --2- 172.21.15.133:0/4014584101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3dc0038b0 0x7fd3dc003cb0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:46.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3fb59e700 1 -- 172.21.15.133:0/4014584101 >> 172.21.15.133:0/4014584101 conn(0x7fd3fc0b6110 msgr2=0x7fd3fc0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:46.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3fb59e700 1 -- 172.21.15.133:0/4014584101 shutdown_connections 2021-01-03T13:05:46.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.221+0000 7fd3fb59e700 1 -- 172.21.15.133:0/4014584101 wait complete. 2021-01-03T13:05:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3fb59e700 1 Processor -- start 2021-01-03T13:05:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3fb59e700 1 -- start start 2021-01-03T13:05:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3fb59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd3dc0038b0 0x7fd3fc150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3fb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3fc13bad0 0x7fd3fc140d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3fb59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3fc0648a0 0x7fd3fc066230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3fb59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc13fc30 con 0x7fd3fc0648a0 2021-01-03T13:05:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3fb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc13f990 con 0x7fd3fc13bad0 2021-01-03T13:05:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3fb59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3fc13e810 con 0x7fd3dc0038b0 2021-01-03T13:05:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3f1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3fc13bad0 0x7fd3fc140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:46.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3f1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3fc13bad0 0x7fd3fc140d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37508/0 (socket says 172.21.15.133:37508) 2021-01-03T13:05:46.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3f1d9b700 1 -- 172.21.15.133:0/3688341793 learned_addr learned my addr 172.21.15.133:0/3688341793 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:46.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3fad9d700 1 --2- 172.21.15.133:0/3688341793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3fc0648a0 0x7fd3fc066230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:46.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3fa59c700 1 --2- 172.21.15.133:0/3688341793 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd3dc0038b0 0x7fd3fc150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:46.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3f1d9b700 1 -- 172.21.15.133:0/3688341793 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd3dc0038b0 msgr2=0x7fd3fc150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:46.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3f1d9b700 1 --2- 172.21.15.133:0/3688341793 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd3dc0038b0 0x7fd3fc150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:46.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3f1d9b700 1 -- 172.21.15.133:0/3688341793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3fc0648a0 msgr2=0x7fd3fc066230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:46.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3f1d9b700 1 --2- 172.21.15.133:0/3688341793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3fc0648a0 0x7fd3fc066230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:46.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3f1d9b700 1 -- 172.21.15.133:0/3688341793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc13aa80 con 0x7fd3fc13bad0 2021-01-03T13:05:46.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3f1d9b700 1 --2- 172.21.15.133:0/3688341793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3fc13bad0 0x7fd3fc140d70 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7fd3e400b000 tx=0x7fd3e4009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3f3fff700 1 -- 172.21.15.133:0/3688341793 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3e4001720 con 0x7fd3fc13bad0 2021-01-03T13:05:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3f3fff700 1 -- 172.21.15.133:0/3688341793 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e4001880 con 0x7fd3fc13bad0 2021-01-03T13:05:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3fb59e700 1 -- 172.21.15.133:0/3688341793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3fc13b6d0 con 0x7fd3fc13bad0 2021-01-03T13:05:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3f3fff700 1 -- 172.21.15.133:0/3688341793 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3e4001be0 con 0x7fd3fc13bad0 2021-01-03T13:05:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.225+0000 7fd3fb59e700 1 -- 172.21.15.133:0/3688341793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3fc064ed0 con 0x7fd3fc13bad0 2021-01-03T13:05:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.229+0000 7fd3f3fff700 1 -- 172.21.15.133:0/3688341793 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd3e401b030 con 0x7fd3fc13bad0 2021-01-03T13:05:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.229+0000 7fd3fb59e700 1 -- 172.21.15.133:0/3688341793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3fc057300 con 0x7fd3fc13bad0 2021-01-03T13:05:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.229+0000 7fd3f3fff700 1 --2- 172.21.15.133:0/3688341793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd3e0055350 0x7fd3e0057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:46.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.229+0000 7fd3f3fff700 1 -- 172.21.15.133:0/3688341793 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd3e406e030 con 0x7fd3fc13bad0 2021-01-03T13:05:46.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.229+0000 7fd3fa59c700 1 --2- 172.21.15.133:0/3688341793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd3e0055350 0x7fd3e0057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:46.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.229+0000 7fd3fa59c700 1 --2- 172.21.15.133:0/3688341793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd3e0055350 0x7fd3e0057810 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fd3ec017000 tx=0x7fd3ec013000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:46.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.237+0000 7fd3f3fff700 1 -- 172.21.15.133:0/3688341793 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd3e4044290 con 0x7fd3fc13bad0 2021-01-03T13:05:46.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:46.425+0000 7fd3fb59e700 1 -- 172.21.15.133:0/3688341793 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7fd3fc061020 con 0x7fd3fc13bad0 2021-01-03T13:05:47.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.265+0000 7fd3f3fff700 1 -- 172.21.15.133:0/3688341793 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v345) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd3e40478b0 con 0x7fd3fc13bad0 2021-01-03T13:05:47.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.269+0000 7fd3fb59e700 1 -- 172.21.15.133:0/3688341793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd3e0055350 msgr2=0x7fd3e0057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:47.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.269+0000 7fd3fb59e700 1 --2- 172.21.15.133:0/3688341793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd3e0055350 0x7fd3e0057810 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fd3ec017000 tx=0x7fd3ec013000).stop 2021-01-03T13:05:47.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.269+0000 7fd3fb59e700 1 -- 172.21.15.133:0/3688341793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3fc13bad0 msgr2=0x7fd3fc140d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:47.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.269+0000 7fd3fb59e700 1 --2- 172.21.15.133:0/3688341793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3fc13bad0 0x7fd3fc140d70 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7fd3e400b000 tx=0x7fd3e4009040).stop 2021-01-03T13:05:47.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.269+0000 7fd3fb59e700 1 -- 172.21.15.133:0/3688341793 shutdown_connections 2021-01-03T13:05:47.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.269+0000 7fd3fb59e700 1 --2- 172.21.15.133:0/3688341793 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd3e0055350 0x7fd3e0057810 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:47.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.269+0000 7fd3fb59e700 1 --2- 172.21.15.133:0/3688341793 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3fc0648a0 0x7fd3fc066230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:47.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.269+0000 7fd3fb59e700 1 --2- 172.21.15.133:0/3688341793 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd3dc0038b0 0x7fd3fc150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:47.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.269+0000 7fd3fb59e700 1 --2- 172.21.15.133:0/3688341793 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3fc13bad0 0x7fd3fc140d70 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.269+0000 7fd3fb59e700 1 -- 172.21.15.133:0/3688341793 >> 172.21.15.133:0/3688341793 conn(0x7fd3fc0b6110 msgr2=0x7fd3fc0b3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.269+0000 7fd3fb59e700 1 -- 172.21.15.133:0/3688341793 shutdown_connections 2021-01-03T13:05:47.277 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.269+0000 7fd3fb59e700 1 -- 172.21.15.133:0/3688341793 wait complete. 2021-01-03T13:05:47.291 INFO:tasks.cephfs_test_runner:test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) ... ok 2021-01-03T13:05:47.291 INFO:tasks.cephfs_test_runner:Starting test: test_filtered_df (tasks.cephfs.test_misc.TestMisc) 2021-01-03T13:05:47.292 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-01-03T13:05:47.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.397+0000 7fb3de3a9700 1 Processor -- start 2021-01-03T13:05:47.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.397+0000 7fb3de3a9700 1 -- start start 2021-01-03T13:05:47.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3de3a9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb3d805c840 0x7fb3d80b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:47.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3de3a9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb3d813fb40 0x7fb3d813fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:47.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3de3a9700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb3d80b03f0 0x7fb3d80b0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:47.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3de3a9700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d80aa1f0 con 0x7fb3d80b03f0 2021-01-03T13:05:47.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3de3a9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d805cc20 con 0x7fb3d805c840 2021-01-03T13:05:47.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3de3a9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d8143df0 con 0x7fb3d813fb40 2021-01-03T13:05:47.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3d7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb3d805c840 0x7fb3d80b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:47.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3d7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb3d805c840 0x7fb3d80b16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37512/0 (socket says 172.21.15.133:37512) 2021-01-03T13:05:47.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3d7fff700 1 -- 172.21.15.133:0/3985877590 learned_addr learned my addr 172.21.15.133:0/3985877590 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:47.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3d77fe700 1 --2- 172.21.15.133:0/3985877590 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb3d813fb40 0x7fb3d813fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:47.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3dc946700 1 --2- 172.21.15.133:0/3985877590 >> v2:172.21.15.16:3300/0 conn(0x7fb3d80b03f0 0x7fb3d80b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:47.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3d7fff700 1 -- 172.21.15.133:0/3985877590 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb3d813fb40 msgr2=0x7fb3d813fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:47.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3d7fff700 1 --2- 172.21.15.133:0/3985877590 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb3d813fb40 0x7fb3d813fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:47.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3d7fff700 1 -- 172.21.15.133:0/3985877590 >> v2:172.21.15.16:3300/0 conn(0x7fb3d80b03f0 msgr2=0x7fb3d80b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:47.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3d7fff700 1 --2- 172.21.15.133:0/3985877590 >> v2:172.21.15.16:3300/0 conn(0x7fb3d80b03f0 0x7fb3d80b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:47.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3d7fff700 1 -- 172.21.15.133:0/3985877590 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d80a9ab0 con 0x7fb3d805c840 2021-01-03T13:05:47.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3d7fff700 1 --2- 172.21.15.133:0/3985877590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d805c840 0x7fb3d80b16b0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7fb3c8002f30 tx=0x7fb3c8006e80).ready entity=mon.1 client_cookie=518616d8ae74be4d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:47.412 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3d6ffd700 1 -- 172.21.15.133:0/3985877590 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3c8009640 con 0x7fb3d805c840 2021-01-03T13:05:47.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3d6ffd700 1 -- 172.21.15.133:0/3985877590 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c80097a0 con 0x7fb3d805c840 2021-01-03T13:05:47.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3d6ffd700 1 -- 172.21.15.133:0/3985877590 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3c8009b00 con 0x7fb3d805c840 2021-01-03T13:05:47.413 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3de3a9700 1 -- 172.21.15.133:0/3985877590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d805c840 msgr2=0x7fb3d80b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:47.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.401+0000 7fb3de3a9700 1 --2- 172.21.15.133:0/3985877590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d805c840 0x7fb3d80b16b0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7fb3c8002f30 tx=0x7fb3c8006e80).stop 2021-01-03T13:05:47.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.405+0000 7fb3de3a9700 1 -- 172.21.15.133:0/3985877590 shutdown_connections 2021-01-03T13:05:47.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.405+0000 7fb3de3a9700 1 --2- 172.21.15.133:0/3985877590 >> v2:172.21.15.16:3300/0 conn(0x7fb3d80b03f0 0x7fb3d80b0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:47.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.405+0000 7fb3de3a9700 1 --2- 172.21.15.133:0/3985877590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d805c840 0x7fb3d80b16b0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:47.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.405+0000 7fb3de3a9700 1 --2- 172.21.15.133:0/3985877590 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb3d813fb40 0x7fb3d813fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:47.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.405+0000 7fb3de3a9700 1 -- 172.21.15.133:0/3985877590 >> 172.21.15.133:0/3985877590 conn(0x7fb3d806aeb0 msgr2=0x7fb3d805bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:47.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.405+0000 7fb3de3a9700 1 -- 172.21.15.133:0/3985877590 shutdown_connections 2021-01-03T13:05:47.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.405+0000 7fb3de3a9700 1 -- 172.21.15.133:0/3985877590 wait complete. 2021-01-03T13:05:47.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.405+0000 7fb3de3a9700 1 Processor -- start 2021-01-03T13:05:47.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.405+0000 7fb3de3a9700 1 -- start start 2021-01-03T13:05:47.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3de3a9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb3d805c840 0x7fb3d814f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:47.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3de3a9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3d80b03f0 0x7fb3d80b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:47.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3de3a9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d813fb40 0x7fb3d80abd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:47.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3de3a9700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d814ecd0 con 0x7fb3d80b03f0 2021-01-03T13:05:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3de3a9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d80b3cb0 con 0x7fb3d813fb40 2021-01-03T13:05:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3de3a9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d814ef30 con 0x7fb3d805c840 2021-01-03T13:05:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3dc946700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d813fb40 0x7fb3d80abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:47.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3dc946700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d813fb40 0x7fb3d80abd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37522/0 (socket says 172.21.15.133:37522) 2021-01-03T13:05:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3dc946700 1 -- 172.21.15.133:0/2765599713 learned_addr learned my addr 172.21.15.133:0/2765599713 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3d7fff700 1 --2- 172.21.15.133:0/2765599713 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb3d805c840 0x7fb3d814f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3d77fe700 1 --2- 172.21.15.133:0/2765599713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3d80b03f0 0x7fb3d80b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3dc946700 1 -- 172.21.15.133:0/2765599713 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb3d805c840 msgr2=0x7fb3d814f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:47.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3dc946700 1 --2- 172.21.15.133:0/2765599713 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb3d805c840 0x7fb3d814f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:47.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3dc946700 1 -- 172.21.15.133:0/2765599713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3d80b03f0 msgr2=0x7fb3d80b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:47.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3dc946700 1 --2- 172.21.15.133:0/2765599713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3d80b03f0 0x7fb3d80b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:47.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3dc946700 1 -- 172.21.15.133:0/2765599713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d814f1d0 con 0x7fb3d813fb40 2021-01-03T13:05:47.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3d77fe700 1 --2- 172.21.15.133:0/2765599713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3d80b03f0 0x7fb3d80b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:47.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3dc946700 1 --2- 172.21.15.133:0/2765599713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d813fb40 0x7fb3d80abd10 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7fb3d0006dd0 tx=0x7fb3d00091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:47.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3d57fa700 1 -- 172.21.15.133:0/2765599713 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d000eee0 con 0x7fb3d813fb40 2021-01-03T13:05:47.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3d57fa700 1 -- 172.21.15.133:0/2765599713 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d000cbb0 con 0x7fb3d813fb40 2021-01-03T13:05:47.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3de3a9700 1 -- 172.21.15.133:0/2765599713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d80ac200 con 0x7fb3d813fb40 2021-01-03T13:05:47.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3d57fa700 1 -- 172.21.15.133:0/2765599713 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d00123f0 con 0x7fb3d813fb40 2021-01-03T13:05:47.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3de3a9700 1 -- 172.21.15.133:0/2765599713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d80642a0 con 0x7fb3d813fb40 2021-01-03T13:05:47.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3d57fa700 1 -- 172.21.15.133:0/2765599713 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb3d0022070 con 0x7fb3d813fb40 2021-01-03T13:05:47.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.409+0000 7fb3de3a9700 1 -- 172.21.15.133:0/2765599713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d8057300 con 0x7fb3d813fb40 2021-01-03T13:05:47.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.413+0000 7fb3d57fa700 1 --2- 172.21.15.133:0/2765599713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb3b80553b0 0x7fb3b8057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:47.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.413+0000 7fb3d7fff700 1 --2- 172.21.15.133:0/2765599713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb3b80553b0 0x7fb3b8057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:47.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.413+0000 7fb3d57fa700 1 -- 172.21.15.133:0/2765599713 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb3d006e6b0 con 0x7fb3d813fb40 2021-01-03T13:05:47.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.413+0000 7fb3d7fff700 1 --2- 172.21.15.133:0/2765599713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb3b80553b0 0x7fb3b8057870 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fb3c8019000 tx=0x7fb3c8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:47.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.417+0000 7fb3d57fa700 1 -- 172.21.15.133:0/2765599713 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb3d00449b0 con 0x7fb3d813fb40 2021-01-03T13:05:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:47.613+0000 7fb3de3a9700 1 -- 172.21.15.133:0/2765599713 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7fb3d80b1540 con 0x7fb3d813fb40 2021-01-03T13:05:48.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.269+0000 7fb3d57fa700 1 -- 172.21.15.133:0/2765599713 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v346) v1 ==== 130+0+0 (secure 0 0 0) 0x7fb3d0016020 con 0x7fb3d813fb40 2021-01-03T13:05:48.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.273+0000 7fb3de3a9700 1 -- 172.21.15.133:0/2765599713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb3b80553b0 msgr2=0x7fb3b8057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:48.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.273+0000 7fb3de3a9700 1 --2- 172.21.15.133:0/2765599713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb3b80553b0 0x7fb3b8057870 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fb3c8019000 tx=0x7fb3c8015000).stop 2021-01-03T13:05:48.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.273+0000 7fb3de3a9700 1 -- 172.21.15.133:0/2765599713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d813fb40 msgr2=0x7fb3d80abd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:48.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.273+0000 7fb3de3a9700 1 --2- 172.21.15.133:0/2765599713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d813fb40 0x7fb3d80abd10 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7fb3d0006dd0 tx=0x7fb3d00091a0).stop 2021-01-03T13:05:48.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.273+0000 7fb3de3a9700 1 -- 172.21.15.133:0/2765599713 shutdown_connections 2021-01-03T13:05:48.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.273+0000 7fb3de3a9700 1 --2- 172.21.15.133:0/2765599713 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb3b80553b0 0x7fb3b8057870 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:48.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.273+0000 7fb3de3a9700 1 --2- 172.21.15.133:0/2765599713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3d813fb40 0x7fb3d80abd10 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:48.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.273+0000 7fb3de3a9700 1 --2- 172.21.15.133:0/2765599713 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb3d805c840 0x7fb3d814f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:48.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.273+0000 7fb3de3a9700 1 --2- 172.21.15.133:0/2765599713 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb3d80b03f0 0x7fb3d80b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:48.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.273+0000 7fb3de3a9700 1 -- 172.21.15.133:0/2765599713 >> 172.21.15.133:0/2765599713 conn(0x7fb3d806aeb0 msgr2=0x7fb3d80aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:48.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.273+0000 7fb3de3a9700 1 -- 172.21.15.133:0/2765599713 shutdown_connections 2021-01-03T13:05:48.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.273+0000 7fb3de3a9700 1 -- 172.21.15.133:0/2765599713 wait complete. 2021-01-03T13:05:48.294 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-01-03T13:05:48.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ee6b700 1 Processor -- start 2021-01-03T13:05:48.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ee6b700 1 -- start start 2021-01-03T13:05:48.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ee6b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff718060510 0x7ff71805c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:48.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ee6b700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7180b6cf0 con 0x7ff71805fd10 2021-01-03T13:05:48.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ee6b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71805bf00 con 0x7ff7180b4c20 2021-01-03T13:05:48.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ee6b700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71805c1a0 con 0x7ff718060510 2021-01-03T13:05:48.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71de69700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff7180b4c20 0x7ff7180b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58560/0 (socket says 172.21.15.133:58560) 2021-01-03T13:05:48.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71de69700 1 -- 172.21.15.133:0/1965784724 learned_addr learned my addr 172.21.15.133:0/1965784724 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:48.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71d668700 1 --2- 172.21.15.133:0/1965784724 >> v2:172.21.15.16:3300/0 conn(0x7ff718060510 0x7ff71805c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:48.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 -- 172.21.15.133:0/1965784724 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767262831 0 0) 0x7ff71805bf00 con 0x7ff7180b4c20 2021-01-03T13:05:48.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 -- 172.21.15.133:0/1965784724 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff700003230 con 0x7ff7180b4c20 2021-01-03T13:05:48.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 -- 172.21.15.133:0/1965784724 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880357128 0 0) 0x7ff7180b6cf0 con 0x7ff71805fd10 2021-01-03T13:05:48.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 -- 172.21.15.133:0/1965784724 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff71805bf00 con 0x7ff71805fd10 2021-01-03T13:05:48.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 -- 172.21.15.133:0/1965784724 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1098613793 0 0) 0x7ff700003230 con 0x7ff7180b4c20 2021-01-03T13:05:48.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 -- 172.21.15.133:0/1965784724 >> v2:172.21.15.16:3300/0 conn(0x7ff718060510 msgr2=0x7ff71805c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:48.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 --2- 172.21.15.133:0/1965784724 >> v2:172.21.15.16:3300/0 conn(0x7ff718060510 0x7ff71805c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:48.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 -- 172.21.15.133:0/1965784724 >> v1:172.21.15.16:6789/0 conn(0x7ff71805fd10 legacy=0x7ff7180b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:48.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 -- 172.21.15.133:0/1965784724 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71805c440 con 0x7ff7180b4c20 2021-01-03T13:05:48.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 -- 172.21.15.133:0/1965784724 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7ff7140016d0 con 0x7ff7180b4c20 2021-01-03T13:05:48.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 -- 172.21.15.133:0/1965784724 >> v1:172.21.15.133:6789/0 conn(0x7ff7180b4c20 legacy=0x7ff7180b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:48.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 --2- 172.21.15.133:0/1965784724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7000038b0 0x7ff700003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:48.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 --2- 172.21.15.133:0/1965784724 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7000044d0 0x7ff700004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:48.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 --2- 172.21.15.133:0/1965784724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff700004e40 0x7ff70000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:48.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 -- 172.21.15.133:0/1965784724 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71805c1a0 con 0x7ff700004e40 2021-01-03T13:05:48.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 -- 172.21.15.133:0/1965784724 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000053a0 con 0x7ff7000038b0 2021-01-03T13:05:48.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 -- 172.21.15.133:0/1965784724 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70000bc90 con 0x7ff7000044d0 2021-01-03T13:05:48.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71d668700 1 --2- 172.21.15.133:0/1965784724 >> v2:172.21.15.16:3300/0 conn(0x7ff718060510 0x7ff71805c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:48.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71de69700 1 --2- 172.21.15.133:0/1965784724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7000038b0 0x7ff700003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:48.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71de69700 1 -- 172.21.15.133:0/1965784724 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7000044d0 msgr2=0x7ff700004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:48.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71de69700 1 --2- 172.21.15.133:0/1965784724 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7000044d0 0x7ff700004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-03T13:05:48.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71de69700 1 -- 172.21.15.133:0/1965784724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff700004e40 msgr2=0x7ff70000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:48.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71de69700 1 --2- 172.21.15.133:0/1965784724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff700004e40 0x7ff70000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-03T13:05:48.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71de69700 1 -- 172.21.15.133:0/1965784724 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff700003230 con 0x7ff7000038b0 2021-01-03T13:05:48.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71e66a700 1 -- 172.21.15.133:0/1965784724 reap_dead start 2021-01-03T13:05:48.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71de69700 1 --2- 172.21.15.133:0/1965784724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7000038b0 0x7ff700003cb0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7ff7140014a0 tx=0x7ff71805bdf0).ready entity=mon.1 client_cookie=b66d665537001d88 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:48.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 -- 172.21.15.133:0/1965784724 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff71400ce00 con 0x7ff7000038b0 2021-01-03T13:05:48.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 -- 172.21.15.133:0/1965784724 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7140072e0 con 0x7ff7000038b0 2021-01-03T13:05:48.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ce67700 1 -- 172.21.15.133:0/1965784724 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7140057d0 con 0x7ff7000038b0 2021-01-03T13:05:48.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ee6b700 1 -- 172.21.15.133:0/1965784724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7000038b0 msgr2=0x7ff700003cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:48.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ee6b700 1 --2- 172.21.15.133:0/1965784724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7000038b0 0x7ff700003cb0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7ff7140014a0 tx=0x7ff71805bdf0).stop 2021-01-03T13:05:48.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ee6b700 1 -- 172.21.15.133:0/1965784724 shutdown_connections 2021-01-03T13:05:48.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ee6b700 1 --2- 172.21.15.133:0/1965784724 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7000038b0 0x7ff700003cb0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:48.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ee6b700 1 -- 172.21.15.133:0/1965784724 >> 172.21.15.133:0/1965784724 conn(0x7ff7180b9f00 msgr2=0x7ff7180b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:48.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ee6b700 1 -- 172.21.15.133:0/1965784724 shutdown_connections 2021-01-03T13:05:48.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.417+0000 7ff71ee6b700 1 -- 172.21.15.133:0/1965784724 wait complete. 2021-01-03T13:05:48.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71ee6b700 1 Processor -- start 2021-01-03T13:05:48.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71ee6b700 1 -- start start 2021-01-03T13:05:48.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71ee6b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7000038b0 0x7ff71809e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:48.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71ee6b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7180b3290 0x7ff71813a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:48.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71ee6b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7180b3710 0x7ff71813ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:48.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71ee6b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7180b2650 con 0x7ff7180b3710 2021-01-03T13:05:48.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71ee6b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7180b28b0 con 0x7ff7000038b0 2021-01-03T13:05:48.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71ee6b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7180b2b50 con 0x7ff7180b3290 2021-01-03T13:05:48.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71de69700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7000038b0 0x7ff71809e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:48.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71de69700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7000038b0 0x7ff71809e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37538/0 (socket says 172.21.15.133:37538) 2021-01-03T13:05:48.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71de69700 1 -- 172.21.15.133:0/2647597858 learned_addr learned my addr 172.21.15.133:0/2647597858 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:48.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71d668700 1 --2- 172.21.15.133:0/2647597858 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7180b3290 0x7ff71813a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:48.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71e66a700 1 --2- 172.21.15.133:0/2647597858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7180b3710 0x7ff71813ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:48.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71de69700 1 -- 172.21.15.133:0/2647597858 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7180b3290 msgr2=0x7ff71813a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:48.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71de69700 1 --2- 172.21.15.133:0/2647597858 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7180b3290 0x7ff71813a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:48.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71de69700 1 -- 172.21.15.133:0/2647597858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7180b3710 msgr2=0x7ff71813ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:48.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71de69700 1 --2- 172.21.15.133:0/2647597858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7180b3710 0x7ff71813ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:48.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71de69700 1 -- 172.21.15.133:0/2647597858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7180b2df0 con 0x7ff7000038b0 2021-01-03T13:05:48.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71d668700 1 --2- 172.21.15.133:0/2647597858 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7180b3290 0x7ff71813a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:48.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71e66a700 1 --2- 172.21.15.133:0/2647597858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7180b3710 0x7ff71813ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:48.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71de69700 1 --2- 172.21.15.133:0/2647597858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7000038b0 0x7ff71809e660 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7ff7140014a0 tx=0x7ff714013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:48.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff706ffd700 1 -- 172.21.15.133:0/2647597858 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff71401a070 con 0x7ff7000038b0 2021-01-03T13:05:48.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff706ffd700 1 -- 172.21.15.133:0/2647597858 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff714005d60 con 0x7ff7000038b0 2021-01-03T13:05:48.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71ee6b700 1 -- 172.21.15.133:0/2647597858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7181437b0 con 0x7ff7000038b0 2021-01-03T13:05:48.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff706ffd700 1 -- 172.21.15.133:0/2647597858 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff714013640 con 0x7ff7000038b0 2021-01-03T13:05:48.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.421+0000 7ff71ee6b700 1 -- 172.21.15.133:0/2647597858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff718140c40 con 0x7ff7000038b0 2021-01-03T13:05:48.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.425+0000 7ff71ee6b700 1 -- 172.21.15.133:0/2647597858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7180b2f80 con 0x7ff7000038b0 2021-01-03T13:05:48.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.425+0000 7ff706ffd700 1 -- 172.21.15.133:0/2647597858 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff714010070 con 0x7ff7000038b0 2021-01-03T13:05:48.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.425+0000 7ff706ffd700 1 --2- 172.21.15.133:0/2647597858 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff6f80554e0 0x7ff6f80579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:48.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.425+0000 7ff706ffd700 1 -- 172.21.15.133:0/2647597858 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff71406e600 con 0x7ff7000038b0 2021-01-03T13:05:48.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.425+0000 7ff71d668700 1 --2- 172.21.15.133:0/2647597858 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff6f80554e0 0x7ff6f80579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:48.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.425+0000 7ff71d668700 1 --2- 172.21.15.133:0/2647597858 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff6f80554e0 0x7ff6f80579a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7ff70800b000 tx=0x7ff708008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:48.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.433+0000 7ff706ffd700 1 -- 172.21.15.133:0/2647597858 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff7140447f0 con 0x7ff7000038b0 2021-01-03T13:05:48.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.573+0000 7ff71ee6b700 1 -- 172.21.15.133:0/2647597858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7ff718057300 con 0x7ff7000038b0 2021-01-03T13:05:48.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.585+0000 7ff706ffd700 1 -- 172.21.15.133:0/2647597858 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff714047e10 con 0x7ff7000038b0 2021-01-03T13:05:48.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.589+0000 7ff71ee6b700 1 -- 172.21.15.133:0/2647597858 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff6f80554e0 msgr2=0x7ff6f80579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:48.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.589+0000 7ff71ee6b700 1 --2- 172.21.15.133:0/2647597858 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff6f80554e0 0x7ff6f80579a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7ff70800b000 tx=0x7ff708008040).stop 2021-01-03T13:05:48.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.589+0000 7ff71ee6b700 1 -- 172.21.15.133:0/2647597858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7000038b0 msgr2=0x7ff71809e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:48.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.589+0000 7ff71ee6b700 1 --2- 172.21.15.133:0/2647597858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7000038b0 0x7ff71809e660 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7ff7140014a0 tx=0x7ff714013000).stop 2021-01-03T13:05:48.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.589+0000 7ff71ee6b700 1 -- 172.21.15.133:0/2647597858 shutdown_connections 2021-01-03T13:05:48.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.589+0000 7ff71ee6b700 1 --2- 172.21.15.133:0/2647597858 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff6f80554e0 0x7ff6f80579a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:48.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.589+0000 7ff71ee6b700 1 --2- 172.21.15.133:0/2647597858 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7180b3710 0x7ff71813ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:48.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.589+0000 7ff71ee6b700 1 --2- 172.21.15.133:0/2647597858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7000038b0 0x7ff71809e660 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:48.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.589+0000 7ff71ee6b700 1 --2- 172.21.15.133:0/2647597858 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7180b3290 0x7ff71813a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:48.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.589+0000 7ff71ee6b700 1 -- 172.21.15.133:0/2647597858 >> 172.21.15.133:0/2647597858 conn(0x7ff7180b9f00 msgr2=0x7ff71813ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:48.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.589+0000 7ff71ee6b700 1 -- 172.21.15.133:0/2647597858 shutdown_connections 2021-01-03T13:05:48.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.589+0000 7ff71ee6b700 1 -- 172.21.15.133:0/2647597858 wait complete. 2021-01-03T13:05:48.610 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:05:48.611 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:05:48.629 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:05:48.648 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:05:48.667 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:05:48.686 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:05:48.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:48.687 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:05:48.687 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:05:48.694 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-03T13:05:48.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:05:48.695 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-01-03T13:05:48.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:05:48.696 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:05:48.697 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:05:48.716 INFO:teuthology.orchestra.run.smithi036.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:05:48.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:05:48.718 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-01-03T13:05:48.719 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-01-03T13:05:48.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.837+0000 7f211ae4c700 1 Processor -- start 2021-01-03T13:05:48.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.837+0000 7f211ae4c700 1 -- start start 2021-01-03T13:05:48.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f211ae4c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f21140af7a0 0x7f21140afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:48.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f211ae4c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2114140480 0x7f21141466c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:48.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f211ae4c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211405cca0 con 0x7f211405c7c0 2021-01-03T13:05:48.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f211ae4c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21140b0070 con 0x7f21140af7a0 2021-01-03T13:05:48.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f211ae4c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21141408d0 con 0x7f2114140480 2021-01-03T13:05:48.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f2113fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f211405c7c0 0x7f211413fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58578/0 (socket says 172.21.15.133:58578) 2021-01-03T13:05:48.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f2113fff700 1 -- 172.21.15.133:0/3280937899 learned_addr learned my addr 172.21.15.133:0/3280937899 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:48.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f21193e9700 1 --2- 172.21.15.133:0/3280937899 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2114140480 0x7f21141466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:48.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f2118be8700 1 --2- 172.21.15.133:0/3280937899 >> v2:172.21.15.16:3300/0 conn(0x7f21140af7a0 0x7f21140afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:48.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f21137fe700 1 -- 172.21.15.133:0/3280937899 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089989220 0 0) 0x7f211405cca0 con 0x7f211405c7c0 2021-01-03T13:05:48.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f21137fe700 1 -- 172.21.15.133:0/3280937899 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2100003230 con 0x7f211405c7c0 2021-01-03T13:05:48.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f21193e9700 1 -- 172.21.15.133:0/3280937899 >> v2:172.21.15.16:3300/0 conn(0x7f21140af7a0 msgr2=0x7f21140afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:48.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f21193e9700 1 --2- 172.21.15.133:0/3280937899 >> v2:172.21.15.16:3300/0 conn(0x7f21140af7a0 0x7f21140afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:48.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f21193e9700 1 -- 172.21.15.133:0/3280937899 >> v1:172.21.15.133:6789/0 conn(0x7f211405c7c0 legacy=0x7f211413fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:48.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f21193e9700 1 -- 172.21.15.133:0/3280937899 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21140b0270 con 0x7f2114140480 2021-01-03T13:05:48.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f21193e9700 1 --2- 172.21.15.133:0/3280937899 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2114140480 0x7f21141466c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f210c0032b0 tx=0x7f210c0091a0).ready entity=mon.2 client_cookie=9a47a8fb4431f4ff server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:48.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f21137fe700 1 -- 172.21.15.133:0/3280937899 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f210c00b940 con 0x7f2114140480 2021-01-03T13:05:48.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f21137fe700 1 -- 172.21.15.133:0/3280937899 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c00baa0 con 0x7f2114140480 2021-01-03T13:05:48.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f21137fe700 1 -- 172.21.15.133:0/3280937899 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f210c00bc10 con 0x7f2114140480 2021-01-03T13:05:48.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f211ae4c700 1 -- 172.21.15.133:0/3280937899 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2114140480 msgr2=0x7f21141466c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:48.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f211ae4c700 1 --2- 172.21.15.133:0/3280937899 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2114140480 0x7f21141466c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f210c0032b0 tx=0x7f210c0091a0).stop 2021-01-03T13:05:48.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f211ae4c700 1 -- 172.21.15.133:0/3280937899 shutdown_connections 2021-01-03T13:05:48.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f211ae4c700 1 --2- 172.21.15.133:0/3280937899 >> v2:172.21.15.16:3300/0 conn(0x7f21140af7a0 0x7f21140afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:48.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f211ae4c700 1 --2- 172.21.15.133:0/3280937899 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2114140480 0x7f21141466c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:48.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f211ae4c700 1 -- 172.21.15.133:0/3280937899 >> 172.21.15.133:0/3280937899 conn(0x7f21140b9620 msgr2=0x7f21140b9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:48.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f211ae4c700 1 -- 172.21.15.133:0/3280937899 shutdown_connections 2021-01-03T13:05:48.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.841+0000 7f211ae4c700 1 -- 172.21.15.133:0/3280937899 wait complete. 2021-01-03T13:05:48.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f211ae4c700 1 Processor -- start 2021-01-03T13:05:48.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f211ae4c700 1 -- start start 2021-01-03T13:05:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f211ae4c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211405c7c0 0x7f21141487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f211ae4c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21140af7a0 0x7f21140b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f211ae4c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2114140480 0x7f2114154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f211ae4c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211414a3b0 con 0x7f21140af7a0 2021-01-03T13:05:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f211ae4c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211409c820 con 0x7f211405c7c0 2021-01-03T13:05:48.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f211ae4c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211409cac0 con 0x7f2114140480 2021-01-03T13:05:48.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f2118be8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211405c7c0 0x7f21141487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:48.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f2118be8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211405c7c0 0x7f21141487b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37552/0 (socket says 172.21.15.133:37552) 2021-01-03T13:05:48.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f2118be8700 1 -- 172.21.15.133:0/2595290951 learned_addr learned my addr 172.21.15.133:0/2595290951 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:48.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f21193e9700 1 --2- 172.21.15.133:0/2595290951 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2114140480 0x7f2114154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:48.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f2113fff700 1 --2- 172.21.15.133:0/2595290951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21140af7a0 0x7f21140b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:48.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f2118be8700 1 -- 172.21.15.133:0/2595290951 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2114140480 msgr2=0x7f2114154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:48.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f2118be8700 1 --2- 172.21.15.133:0/2595290951 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2114140480 0x7f2114154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:48.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f2118be8700 1 -- 172.21.15.133:0/2595290951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21140af7a0 msgr2=0x7f21140b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:48.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f2118be8700 1 --2- 172.21.15.133:0/2595290951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21140af7a0 0x7f21140b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:48.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f2118be8700 1 -- 172.21.15.133:0/2595290951 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211413a2f0 con 0x7f211405c7c0 2021-01-03T13:05:48.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f21193e9700 1 --2- 172.21.15.133:0/2595290951 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2114140480 0x7f2114154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:48.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f2118be8700 1 --2- 172.21.15.133:0/2595290951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211405c7c0 0x7f21141487b0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f21141461d0 tx=0x7f2104006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:48.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f2111ffb700 1 -- 172.21.15.133:0/2595290951 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f210400ca80 con 0x7f211405c7c0 2021-01-03T13:05:48.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f211ae4c700 1 -- 172.21.15.133:0/2595290951 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2114149f80 con 0x7f211405c7c0 2021-01-03T13:05:48.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f2111ffb700 1 -- 172.21.15.133:0/2595290951 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210400cbe0 con 0x7f211405c7c0 2021-01-03T13:05:48.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f211ae4c700 1 -- 172.21.15.133:0/2595290951 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21140b8a80 con 0x7f211405c7c0 2021-01-03T13:05:48.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f2111ffb700 1 -- 172.21.15.133:0/2595290951 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f210400b370 con 0x7f211405c7c0 2021-01-03T13:05:48.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.845+0000 7f211ae4c700 1 -- 172.21.15.133:0/2595290951 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211409cc80 con 0x7f211405c7c0 2021-01-03T13:05:48.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.849+0000 7f2111ffb700 1 -- 172.21.15.133:0/2595290951 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f210401c460 con 0x7f211405c7c0 2021-01-03T13:05:48.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.849+0000 7f2111ffb700 1 --2- 172.21.15.133:0/2595290951 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f20f40554e0 0x7f20f40579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:48.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.849+0000 7f2111ffb700 1 -- 172.21.15.133:0/2595290951 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f210406e520 con 0x7f211405c7c0 2021-01-03T13:05:48.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.849+0000 7f2113fff700 1 --2- 172.21.15.133:0/2595290951 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f20f40554e0 0x7f20f40579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:48.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.849+0000 7f2113fff700 1 --2- 172.21.15.133:0/2595290951 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f20f40554e0 0x7f20f40579a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f210800b000 tx=0x7f2108009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:48.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.853+0000 7f2111ffb700 1 -- 172.21.15.133:0/2595290951 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2104044630 con 0x7f211405c7c0 2021-01-03T13:05:48.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.989+0000 7f211ae4c700 1 -- 172.21.15.133:0/2595290951 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2114057300 con 0x7f211405c7c0 2021-01-03T13:05:48.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.989+0000 7f2111ffb700 1 -- 172.21.15.133:0/2595290951 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v102) v1 ==== 81+0+33700 (secure 0 0 0) 0x7f2104047c50 con 0x7f211405c7c0 2021-01-03T13:05:48.996 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:48.997 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:05:48.997 INFO:teuthology.orchestra.run.smithi133.stdout: "epoch": 102, 2021-01-03T13:05:48.997 INFO:teuthology.orchestra.run.smithi133.stdout: "fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", 2021-01-03T13:05:48.997 INFO:teuthology.orchestra.run.smithi133.stdout: "created": "2021-01-03T12:57:43.298835+0000", 2021-01-03T13:05:48.998 INFO:teuthology.orchestra.run.smithi133.stdout: "modified": "2021-01-03T13:05:36.216269+0000", 2021-01-03T13:05:48.998 INFO:teuthology.orchestra.run.smithi133.stdout: "last_up_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:05:48.998 INFO:teuthology.orchestra.run.smithi133.stdout: "last_in_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:05:48.998 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-01-03T13:05:48.999 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_num": 5799936, 2021-01-03T13:05:48.999 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_set": [ 2021-01-03T13:05:48.999 INFO:teuthology.orchestra.run.smithi133.stdout: "pglog_hardlimit", 2021-01-03T13:05:48.999 INFO:teuthology.orchestra.run.smithi133.stdout: "purged_snapdirs", 2021-01-03T13:05:49.000 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_deletes", 2021-01-03T13:05:49.000 INFO:teuthology.orchestra.run.smithi133.stdout: "sortbitwise" 2021-01-03T13:05:49.000 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:05:49.000 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_version": 4, 2021-01-03T13:05:49.001 INFO:teuthology.orchestra.run.smithi133.stdout: "full_ratio": 0.94999998807907104, 2021-01-03T13:05:49.001 INFO:teuthology.orchestra.run.smithi133.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-01-03T13:05:49.001 INFO:teuthology.orchestra.run.smithi133.stdout: "nearfull_ratio": 0.85000002384185791, 2021-01-03T13:05:49.002 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_snapshot": "", 2021-01-03T13:05:49.003 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_max": 18, 2021-01-03T13:05:49.003 INFO:teuthology.orchestra.run.smithi133.stdout: "max_osd": 8, 2021-01-03T13:05:49.004 INFO:teuthology.orchestra.run.smithi133.stdout: "require_min_compat_client": "jewel", 2021-01-03T13:05:49.004 INFO:teuthology.orchestra.run.smithi133.stdout: "min_compat_client": "jewel", 2021-01-03T13:05:49.005 INFO:teuthology.orchestra.run.smithi133.stdout: "require_osd_release": "octopus", 2021-01-03T13:05:49.005 INFO:teuthology.orchestra.run.smithi133.stdout: "pools": [ 2021-01-03T13:05:49.006 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.006 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 1, 2021-01-03T13:05:49.006 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "device_health_metrics", 2021-01-03T13:05:49.007 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:47.102954+0000", 2021-01-03T13:05:49.007 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:05:49.008 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:05:49.008 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:05:49.008 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:05:49.009 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:05:49.009 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:05:49.009 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:05:49.010 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:05:49.011 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 1, 2021-01-03T13:05:49.011 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 1, 2021-01-03T13:05:49.012 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 1, 2021-01-03T13:05:49.012 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 1, 2021-01-03T13:05:49.012 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 1, 2021-01-03T13:05:49.013 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:05:49.013 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:05:49.014 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:05:49.014 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:05:49.015 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:05:49.015 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:05:49.016 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:05:49.016 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.017 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "16", 2021-01-03T13:05:49.017 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:05:49.017 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:05:49.018 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:05:49.018 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:05:49.019 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:05:49.019 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:05:49.020 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:05:49.020 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:05:49.020 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:05:49.021 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:05:49.021 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:05:49.022 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:05:49.022 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:05:49.023 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:05:49.023 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:05:49.023 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:05:49.023 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:05:49.023 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:05:49.024 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:05:49.024 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:05:49.024 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:05:49.024 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:05:49.025 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:05:49.025 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:05:49.025 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:05:49.025 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:05:49.025 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.026 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:05:49.026 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:05:49.026 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:05:49.026 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:05:49.027 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:05:49.027 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:05:49.027 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:05:49.027 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:05:49.028 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:05:49.028 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:05:49.028 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:05:49.028 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:05:49.029 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 1 2021-01-03T13:05:49.029 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.029 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:05:49.029 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr_devicehealth": {} 2021-01-03T13:05:49.030 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.030 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.030 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.030 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 2, 2021-01-03T13:05:49.031 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "rbd", 2021-01-03T13:05:49.031 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:55.472799+0000", 2021-01-03T13:05:49.031 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:05:49.031 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:05:49.031 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:05:49.032 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:05:49.032 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:05:49.032 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:05:49.032 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:05:49.033 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:05:49.033 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:05:49.033 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:05:49.033 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:05:49.034 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:05:49.034 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:05:49.034 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:05:49.034 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:05:49.035 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:05:49.035 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:05:49.035 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:05:49.035 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:05:49.036 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:05:49.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.036 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "19", 2021-01-03T13:05:49.036 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:05:49.037 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:05:49.037 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:05:49.037 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:05:49.037 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:05:49.038 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:05:49.038 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:05:49.038 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:05:49.038 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:05:49.039 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:05:49.039 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:05:49.039 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:05:49.040 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:05:49.040 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:05:49.040 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:05:49.040 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:05:49.041 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:05:49.041 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:05:49.041 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:05:49.041 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:05:49.042 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:05:49.042 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:05:49.042 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:05:49.042 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:05:49.042 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:05:49.043 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:05:49.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.043 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:05:49.044 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:05:49.045 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:05:49.045 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:05:49.045 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:05:49.046 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:05:49.046 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:05:49.047 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:05:49.047 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:05:49.047 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:05:49.047 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:05:49.048 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:05:49.048 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:05:49.048 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd": {} 2021-01-03T13:05:49.048 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.049 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.049 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 17, 2021-01-03T13:05:49.049 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_metadata", 2021-01-03T13:05:49.049 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:05:32.702569+0000", 2021-01-03T13:05:49.050 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:05:49.050 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:05:49.051 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:05:49.051 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:05:49.051 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:05:49.051 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:05:49.051 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:05:49.052 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:05:49.052 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:05:49.052 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:05:49.053 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:05:49.053 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:05:49.053 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:05:49.054 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:05:49.054 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:05:49.055 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:05:49.055 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:05:49.056 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:05:49.057 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:05:49.057 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:05:49.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.058 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "101", 2021-01-03T13:05:49.058 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:05:49.058 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:05:49.059 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:05:49.059 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:05:49.059 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:05:49.060 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:05:49.060 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:05:49.061 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:05:49.061 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:05:49.061 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:05:49.062 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:05:49.062 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:05:49.062 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:05:49.063 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:05:49.063 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:05:49.063 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:05:49.063 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:05:49.064 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:05:49.064 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:05:49.064 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:05:49.064 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:05:49.064 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:05:49.065 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:05:49.066 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:05:49.067 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:05:49.067 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:05:49.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.068 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:05:49.068 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:05:49.069 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:05:49.069 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:05:49.070 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:05:49.070 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:05:49.070 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:05:49.071 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:05:49.072 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:05:49.072 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:05:49.073 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:05:49.073 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:05:49.074 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_bias": 4, 2021-01-03T13:05:49.074 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 16, 2021-01-03T13:05:49.074 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_priority": 5 2021-01-03T13:05:49.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.075 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:05:49.075 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:05:49.075 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": "cephfs" 2021-01-03T13:05:49.076 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.076 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.078 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 18, 2021-01-03T13:05:49.079 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_data", 2021-01-03T13:05:49.079 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:05:33.206759+0000", 2021-01-03T13:05:49.079 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:05:49.079 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:05:49.079 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:05:49.080 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:05:49.080 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:05:49.080 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:05:49.080 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:05:49.081 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:05:49.081 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:05:49.081 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:05:49.081 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:05:49.082 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:05:49.082 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:05:49.082 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:05:49.082 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:05:49.083 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:05:49.083 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:05:49.084 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:05:49.084 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:05:49.084 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:05:49.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.085 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "102", 2021-01-03T13:05:49.085 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:05:49.085 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:05:49.086 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:05:49.086 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:05:49.086 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:05:49.087 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:05:49.087 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:05:49.087 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:05:49.088 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:05:49.088 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:05:49.089 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:05:49.089 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:05:49.089 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:05:49.089 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:05:49.090 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:05:49.090 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:05:49.090 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:05:49.091 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:05:49.091 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:05:49.091 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:05:49.091 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:05:49.091 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:05:49.092 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:05:49.092 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:05:49.092 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:05:49.092 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:05:49.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.093 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:05:49.093 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:05:49.093 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:05:49.093 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:05:49.093 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:05:49.094 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:05:49.094 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:05:49.094 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:05:49.094 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:05:49.094 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:05:49.095 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:05:49.095 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:05:49.095 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:05:49.095 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:05:49.096 INFO:teuthology.orchestra.run.smithi133.stdout: "data": "cephfs" 2021-01-03T13:05:49.096 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.096 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.096 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.096 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:05:49.097 INFO:teuthology.orchestra.run.smithi133.stdout: "osds": [ 2021-01-03T13:05:49.097 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.097 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:05:49.097 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a", 2021-01-03T13:05:49.097 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:05:49.098 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:05:49.098 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:05:49.098 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:05:49.098 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:05:49.098 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:05:49.099 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:05:49.099 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 99, 2021-01-03T13:05:49.099 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:05:49.099 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:05:49.099 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:05:49.100 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.100 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.100 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6810", 2021-01-03T13:05:49.100 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:05:49.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.101 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.101 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.101 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6811", 2021-01-03T13:05:49.101 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:05:49.102 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.102 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.102 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:05:49.102 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.103 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.103 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6812", 2021-01-03T13:05:49.103 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:05:49.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.104 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.104 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6813", 2021-01-03T13:05:49.104 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:05:49.104 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.105 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.105 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:05:49.105 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.106 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.106 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.106 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6816", 2021-01-03T13:05:49.106 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:05:49.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.107 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.107 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6817", 2021-01-03T13:05:49.107 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:05:49.107 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.108 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.108 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:05:49.108 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.109 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.109 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6814", 2021-01-03T13:05:49.109 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:05:49.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.109 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.110 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.110 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6815", 2021-01-03T13:05:49.110 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:05:49.110 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.110 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.111 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6811/12124", 2021-01-03T13:05:49.111 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6813/12124", 2021-01-03T13:05:49.111 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6817/12124", 2021-01-03T13:05:49.111 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6815/12124", 2021-01-03T13:05:49.112 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:05:49.112 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:05:49.112 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:05:49.112 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.113 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.113 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:05:49.113 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9170d1de-58d4-4dfd-b9de-80dc15ca9e60", 2021-01-03T13:05:49.113 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:05:49.113 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:05:49.114 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:05:49.114 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:05:49.114 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:05:49.114 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:05:49.114 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:05:49.115 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 99, 2021-01-03T13:05:49.115 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:05:49.115 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:05:49.115 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:05:49.115 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.116 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.116 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6818", 2021-01-03T13:05:49.116 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:05:49.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.117 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.117 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.117 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6819", 2021-01-03T13:05:49.117 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:05:49.117 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.118 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.118 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:05:49.118 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.119 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.119 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6820", 2021-01-03T13:05:49.119 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:05:49.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.120 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.120 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6821", 2021-01-03T13:05:49.120 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:05:49.120 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.120 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.121 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.121 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:05:49.121 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.121 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.122 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6824", 2021-01-03T13:05:49.122 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:05:49.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.122 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.123 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6825", 2021-01-03T13:05:49.123 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:05:49.123 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.123 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.124 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:05:49.124 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.124 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.124 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6822", 2021-01-03T13:05:49.125 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:05:49.125 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.125 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.125 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6823", 2021-01-03T13:05:49.126 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:05:49.126 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.126 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.126 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6819/12123", 2021-01-03T13:05:49.127 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6821/12123", 2021-01-03T13:05:49.127 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6825/12123", 2021-01-03T13:05:49.127 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6823/12123", 2021-01-03T13:05:49.127 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:05:49.127 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:05:49.128 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:05:49.128 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.128 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:05:49.129 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9fc5adf9-3537-4953-9c65-0c67ecb53776", 2021-01-03T13:05:49.129 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:05:49.129 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:05:49.129 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:05:49.129 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:05:49.130 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:05:49.130 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:05:49.130 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:05:49.130 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 100, 2021-01-03T13:05:49.130 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:05:49.131 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:05:49.131 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:05:49.131 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.131 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.132 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6802", 2021-01-03T13:05:49.132 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:05:49.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.132 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.132 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6803", 2021-01-03T13:05:49.133 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:05:49.133 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.133 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.134 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:05:49.134 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.134 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.134 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6804", 2021-01-03T13:05:49.135 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:05:49.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.135 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.135 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6805", 2021-01-03T13:05:49.136 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:05:49.136 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.136 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.136 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:05:49.137 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.137 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.137 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6808", 2021-01-03T13:05:49.137 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:05:49.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.138 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.138 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6809", 2021-01-03T13:05:49.138 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:05:49.139 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.139 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.139 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:05:49.139 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.140 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.140 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6806", 2021-01-03T13:05:49.140 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:05:49.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.141 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.141 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6807", 2021-01-03T13:05:49.141 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:05:49.141 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.141 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.142 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6803/12122", 2021-01-03T13:05:49.142 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6805/12122", 2021-01-03T13:05:49.142 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6809/12122", 2021-01-03T13:05:49.143 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6807/12122", 2021-01-03T13:05:49.143 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:05:49.143 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:05:49.143 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:05:49.143 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.144 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:05:49.144 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "0ad45ce5-6635-4089-bbf8-c966d0fe5338", 2021-01-03T13:05:49.144 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:05:49.144 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:05:49.145 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:05:49.145 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:05:49.145 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:05:49.145 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:05:49.145 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:05:49.146 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 99, 2021-01-03T13:05:49.146 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:05:49.146 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:05:49.146 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:05:49.146 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.147 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.147 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6826", 2021-01-03T13:05:49.147 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:05:49.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.148 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.148 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6827", 2021-01-03T13:05:49.148 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:05:49.149 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.149 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.149 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:05:49.149 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.150 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.150 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6828", 2021-01-03T13:05:49.150 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:05:49.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.151 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.151 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6829", 2021-01-03T13:05:49.151 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:05:49.152 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.152 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.152 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:05:49.153 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.153 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.153 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6832", 2021-01-03T13:05:49.153 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:05:49.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.154 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.154 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6833", 2021-01-03T13:05:49.155 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:05:49.155 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.155 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.155 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:05:49.156 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.156 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.156 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6830", 2021-01-03T13:05:49.156 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:05:49.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.157 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.157 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6831", 2021-01-03T13:05:49.157 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:05:49.158 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.158 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.158 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6827/12136", 2021-01-03T13:05:49.158 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6829/12136", 2021-01-03T13:05:49.159 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6833/12136", 2021-01-03T13:05:49.159 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6831/12136", 2021-01-03T13:05:49.159 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:05:49.159 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:05:49.159 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:05:49.160 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.160 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:05:49.160 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "86b8d6d5-271b-4a70-ae7b-a227afb38d7c", 2021-01-03T13:05:49.161 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:05:49.161 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:05:49.161 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:05:49.161 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:05:49.161 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:05:49.162 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:05:49.162 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:05:49.162 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 98, 2021-01-03T13:05:49.162 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:05:49.162 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:05:49.163 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:05:49.163 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.163 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.163 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6808", 2021-01-03T13:05:49.164 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:05:49.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.164 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.164 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.164 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6809", 2021-01-03T13:05:49.165 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:05:49.165 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.165 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.165 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:05:49.166 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.166 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.166 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6810", 2021-01-03T13:05:49.166 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:05:49.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.167 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.167 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6811", 2021-01-03T13:05:49.167 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:05:49.168 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.168 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.168 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.168 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:05:49.168 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.169 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.169 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6814", 2021-01-03T13:05:49.169 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:05:49.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.170 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.170 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6815", 2021-01-03T13:05:49.170 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:05:49.171 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.171 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.171 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:05:49.171 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.172 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.172 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6812", 2021-01-03T13:05:49.172 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:05:49.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.173 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.173 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6813", 2021-01-03T13:05:49.173 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:05:49.173 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.173 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.174 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6809/12672", 2021-01-03T13:05:49.174 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6811/12672", 2021-01-03T13:05:49.174 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6815/12672", 2021-01-03T13:05:49.174 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6813/12672", 2021-01-03T13:05:49.175 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:05:49.175 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:05:49.175 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:05:49.175 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.175 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.176 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:05:49.176 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "173feb9d-f596-4030-85d8-1f4b46a9ffe5", 2021-01-03T13:05:49.176 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:05:49.176 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:05:49.177 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:05:49.177 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:05:49.177 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:05:49.177 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:05:49.177 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:05:49.178 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 87, 2021-01-03T13:05:49.178 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:05:49.178 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:05:49.178 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:05:49.178 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.179 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.179 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6817", 2021-01-03T13:05:49.179 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:05:49.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.180 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.180 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6819", 2021-01-03T13:05:49.180 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:05:49.181 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.181 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.181 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:05:49.181 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.182 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.182 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6820", 2021-01-03T13:05:49.182 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:05:49.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.183 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.183 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.183 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6822", 2021-01-03T13:05:49.183 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:05:49.183 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.184 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.184 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:05:49.184 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.184 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.185 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.185 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6828", 2021-01-03T13:05:49.185 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:05:49.185 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.186 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.186 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6830", 2021-01-03T13:05:49.186 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:05:49.186 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.186 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.187 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.187 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:05:49.187 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.187 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.188 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6824", 2021-01-03T13:05:49.188 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:05:49.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.188 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.189 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6826", 2021-01-03T13:05:49.189 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:05:49.189 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.189 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.190 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6819/12673", 2021-01-03T13:05:49.190 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6822/12673", 2021-01-03T13:05:49.190 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6830/12673", 2021-01-03T13:05:49.190 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6826/12673", 2021-01-03T13:05:49.190 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:05:49.191 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:05:49.191 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:05:49.191 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.192 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:05:49.192 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "b487980e-ad4d-43c1-91fa-4845f7af3d4d", 2021-01-03T13:05:49.192 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:05:49.192 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:05:49.192 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:05:49.193 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:05:49.193 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:05:49.193 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:05:49.193 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:05:49.193 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 98, 2021-01-03T13:05:49.194 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:05:49.194 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:05:49.194 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:05:49.194 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.195 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.195 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6800", 2021-01-03T13:05:49.195 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:05:49.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.196 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.196 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6801", 2021-01-03T13:05:49.196 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:05:49.196 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.196 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.197 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:05:49.197 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.197 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.198 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6802", 2021-01-03T13:05:49.198 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:05:49.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.198 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.198 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.199 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6803", 2021-01-03T13:05:49.199 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:05:49.199 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.199 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.199 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.200 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:05:49.200 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.200 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.200 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6806", 2021-01-03T13:05:49.201 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:05:49.201 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.201 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.201 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6807", 2021-01-03T13:05:49.202 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:05:49.202 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.202 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.202 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:05:49.203 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.203 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.203 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6804", 2021-01-03T13:05:49.203 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:05:49.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.204 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.204 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6805", 2021-01-03T13:05:49.204 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:05:49.205 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.205 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.205 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6801/12662", 2021-01-03T13:05:49.205 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6803/12662", 2021-01-03T13:05:49.206 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6807/12662", 2021-01-03T13:05:49.206 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6805/12662", 2021-01-03T13:05:49.206 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:05:49.206 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:05:49.206 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:05:49.207 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.207 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:05:49.207 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "38ea839a-451f-4c09-a545-4514e049b178", 2021-01-03T13:05:49.208 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:05:49.208 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:05:49.208 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:05:49.208 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:05:49.208 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:05:49.209 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:05:49.209 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:05:49.209 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 99, 2021-01-03T13:05:49.209 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:05:49.209 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:05:49.210 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:05:49.210 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.210 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.210 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6816", 2021-01-03T13:05:49.211 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:05:49.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.211 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.211 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6818", 2021-01-03T13:05:49.212 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:05:49.212 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.212 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.212 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:05:49.213 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.213 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.213 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6821", 2021-01-03T13:05:49.213 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:05:49.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.214 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.214 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6823", 2021-01-03T13:05:49.214 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:05:49.215 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.215 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.215 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.215 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:05:49.215 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.216 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.216 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6829", 2021-01-03T13:05:49.216 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:05:49.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.217 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.217 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6831", 2021-01-03T13:05:49.217 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:05:49.217 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.218 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.218 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:05:49.218 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:05:49.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.219 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:05:49.219 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6825", 2021-01-03T13:05:49.219 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:05:49.219 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.220 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:05:49.220 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6827", 2021-01-03T13:05:49.220 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:05:49.220 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.220 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.221 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6818/12674", 2021-01-03T13:05:49.221 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6823/12674", 2021-01-03T13:05:49.221 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6831/12674", 2021-01-03T13:05:49.221 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6827/12674", 2021-01-03T13:05:49.222 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:05:49.222 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:05:49.222 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:05:49.222 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:49.222 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.223 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:05:49.223 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_xinfo": [ 2021-01-03T13:05:49.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.223 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:05:49.223 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:05:49.224 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:05:49.224 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:05:49.224 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:05:49.224 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:05:49.224 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.659942+0000", 2021-01-03T13:05:49.225 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:05:49.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.225 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:05:49.225 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:05:49.226 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:05:49.226 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:05:49.226 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:05:49.226 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:05:49.227 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.750326+0000", 2021-01-03T13:05:49.227 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:05:49.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.227 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:05:49.227 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:05:49.228 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:05:49.228 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:05:49.228 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:05:49.228 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:05:49.228 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.587742+0000", 2021-01-03T13:05:49.229 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:05:49.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.229 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:05:49.229 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:05:49.230 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:05:49.230 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:05:49.230 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:05:49.230 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:05:49.230 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.855073+0000", 2021-01-03T13:05:49.231 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:05:49.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.231 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.231 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:05:49.231 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:05:49.232 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:05:49.232 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:05:49.232 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:05:49.232 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:05:49.232 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.565030+0000", 2021-01-03T13:05:49.233 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:05:49.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.233 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:05:49.233 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:05:49.234 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:05:49.234 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:05:49.234 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:05:49.234 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:05:49.234 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.786206+0000", 2021-01-03T13:05:49.235 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:05:49.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.235 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:05:49.235 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:05:49.236 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:05:49.236 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:05:49.236 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:05:49.236 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:05:49.236 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.576185+0000", 2021-01-03T13:05:49.237 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:05:49.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:49.237 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:05:49.237 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:05:49.238 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:05:49.238 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:05:49.238 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:05:49.238 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:05:49.239 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.823786+0000", 2021-01-03T13:05:49.239 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:05:49.239 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.239 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:05:49.239 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap": [], 2021-01-03T13:05:49.239 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap_items": [], 2021-01-03T13:05:49.240 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_temp": [], 2021-01-03T13:05:49.240 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_temp": [], 2021-01-03T13:05:49.240 INFO:teuthology.orchestra.run.smithi133.stdout: "blacklist": {}, 2021-01-03T13:05:49.240 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profiles": { 2021-01-03T13:05:49.240 INFO:teuthology.orchestra.run.smithi133.stdout: "default": { 2021-01-03T13:05:49.241 INFO:teuthology.orchestra.run.smithi133.stdout: "crush-failure-domain": "osd", 2021-01-03T13:05:49.241 INFO:teuthology.orchestra.run.smithi133.stdout: "k": "2", 2021-01-03T13:05:49.241 INFO:teuthology.orchestra.run.smithi133.stdout: "m": "1", 2021-01-03T13:05:49.241 INFO:teuthology.orchestra.run.smithi133.stdout: "plugin": "jerasure", 2021-01-03T13:05:49.241 INFO:teuthology.orchestra.run.smithi133.stdout: "ruleset-failure-domain": "osd", 2021-01-03T13:05:49.242 INFO:teuthology.orchestra.run.smithi133.stdout: "technique": "reed_sol_van" 2021-01-03T13:05:49.242 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:49.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:49.242 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps_queue": [], 2021-01-03T13:05:49.242 INFO:teuthology.orchestra.run.smithi133.stdout: "new_removed_snaps": [], 2021-01-03T13:05:49.243 INFO:teuthology.orchestra.run.smithi133.stdout: "new_purged_snaps": [], 2021-01-03T13:05:49.243 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_node_flags": {}, 2021-01-03T13:05:49.243 INFO:teuthology.orchestra.run.smithi133.stdout: "device_class_flags": {} 2021-01-03T13:05:49.243 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:05:49.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.993+0000 7f211ae4c700 1 -- 172.21.15.133:0/2595290951 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f20f40554e0 msgr2=0x7f20f40579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:49.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.993+0000 7f211ae4c700 1 --2- 172.21.15.133:0/2595290951 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f20f40554e0 0x7f20f40579a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f210800b000 tx=0x7f2108009040).stop 2021-01-03T13:05:49.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.993+0000 7f211ae4c700 1 -- 172.21.15.133:0/2595290951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211405c7c0 msgr2=0x7f21141487b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:49.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.993+0000 7f211ae4c700 1 --2- 172.21.15.133:0/2595290951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211405c7c0 0x7f21141487b0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f21141461d0 tx=0x7f2104006dc0).stop 2021-01-03T13:05:49.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.993+0000 7f211ae4c700 1 -- 172.21.15.133:0/2595290951 shutdown_connections 2021-01-03T13:05:49.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.993+0000 7f211ae4c700 1 --2- 172.21.15.133:0/2595290951 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f20f40554e0 0x7f20f40579a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.993+0000 7f211ae4c700 1 --2- 172.21.15.133:0/2595290951 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2114140480 0x7f2114154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.993+0000 7f211ae4c700 1 --2- 172.21.15.133:0/2595290951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f211405c7c0 0x7f21141487b0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.993+0000 7f211ae4c700 1 --2- 172.21.15.133:0/2595290951 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21140af7a0 0x7f21140b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.993+0000 7f211ae4c700 1 -- 172.21.15.133:0/2595290951 >> 172.21.15.133:0/2595290951 conn(0x7f21140b9620 msgr2=0x7f211413ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:49.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.993+0000 7f211ae4c700 1 -- 172.21.15.133:0/2595290951 shutdown_connections 2021-01-03T13:05:49.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:48.993+0000 7f211ae4c700 1 -- 172.21.15.133:0/2595290951 wait complete. 2021-01-03T13:05:49.248 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:05:49.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.365+0000 7f86a8cec700 1 Processor -- start 2021-01-03T13:05:49.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.365+0000 7f86a8cec700 1 -- start start 2021-01-03T13:05:49.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.365+0000 7f86a8cec700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f86a40b5ae0 0x7f86a40ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:49.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.365+0000 7f86a8cec700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f86a4140a80 0x7f86a4140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:49.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.365+0000 7f86a8cec700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a4144050 con 0x7f86a40ace10 2021-01-03T13:05:49.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.365+0000 7f86a8cec700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a4144f00 con 0x7f86a40b5ae0 2021-01-03T13:05:49.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.365+0000 7f86a8cec700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40ad6e0 con 0x7f86a4140a80 2021-01-03T13:05:49.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.365+0000 7f86a2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f86a40b5ae0 0x7f86a40ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:49.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.365+0000 7f86a2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f86a40b5ae0 0x7f86a40ad1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37560/0 (socket says 172.21.15.133:37560) 2021-01-03T13:05:49.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.365+0000 7f86a2ffd700 1 -- 172.21.15.133:0/1833727880 learned_addr learned my addr 172.21.15.133:0/1833727880 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:49.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.365+0000 7f86a3fff700 1 --2- 172.21.15.133:0/1833727880 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f86a4140a80 0x7f86a4140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:49.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.365+0000 7f86a2ffd700 1 -- 172.21.15.133:0/1833727880 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f86a4140a80 msgr2=0x7f86a4140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:49.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.365+0000 7f86a2ffd700 1 --2- 172.21.15.133:0/1833727880 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f86a4140a80 0x7f86a4140ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.365+0000 7f86a2ffd700 1 -- 172.21.15.133:0/1833727880 >> v1:172.21.15.16:6789/0 conn(0x7f86a40ace10 legacy=0x7f86a40b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:49.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.365+0000 7f86a2ffd700 1 -- 172.21.15.133:0/1833727880 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a4144280 con 0x7f86a40b5ae0 2021-01-03T13:05:49.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.369+0000 7f86a2ffd700 1 --2- 172.21.15.133:0/1833727880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86a40b5ae0 0x7f86a40ad1f0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f8694002f30 tx=0x7f8694006e80).ready entity=mon.1 client_cookie=31526c9aef676bb2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:49.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.369+0000 7f86a27fc700 1 -- 172.21.15.133:0/1833727880 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86940097f0 con 0x7f86a40b5ae0 2021-01-03T13:05:49.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.369+0000 7f86a27fc700 1 -- 172.21.15.133:0/1833727880 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8694009950 con 0x7f86a40b5ae0 2021-01-03T13:05:49.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.369+0000 7f86a27fc700 1 -- 172.21.15.133:0/1833727880 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8694009cb0 con 0x7f86a40b5ae0 2021-01-03T13:05:49.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.369+0000 7f86a8cec700 1 -- 172.21.15.133:0/1833727880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86a40b5ae0 msgr2=0x7f86a40ad1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:49.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.369+0000 7f86a8cec700 1 --2- 172.21.15.133:0/1833727880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86a40b5ae0 0x7f86a40ad1f0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f8694002f30 tx=0x7f8694006e80).stop 2021-01-03T13:05:49.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.369+0000 7f86a8cec700 1 -- 172.21.15.133:0/1833727880 shutdown_connections 2021-01-03T13:05:49.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.369+0000 7f86a8cec700 1 --2- 172.21.15.133:0/1833727880 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f86a4140a80 0x7f86a4140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.369+0000 7f86a8cec700 1 --2- 172.21.15.133:0/1833727880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86a40b5ae0 0x7f86a40ad1f0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.369+0000 7f86a8cec700 1 -- 172.21.15.133:0/1833727880 >> 172.21.15.133:0/1833727880 conn(0x7f86a405bdf0 msgr2=0x7f86a405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:49.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.369+0000 7f86a8cec700 1 -- 172.21.15.133:0/1833727880 shutdown_connections 2021-01-03T13:05:49.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.369+0000 7f86a8cec700 1 -- 172.21.15.133:0/1833727880 wait complete. 2021-01-03T13:05:49.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.369+0000 7f86a8cec700 1 Processor -- start 2021-01-03T13:05:49.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.369+0000 7f86a8cec700 1 -- start start 2021-01-03T13:05:49.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a8cec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86a40ace10 0x7f86a41423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:49.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a8cec700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86a40b5ae0 0x7f86a40b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:49.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a8cec700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f86a4140a80 0x7f86a40ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:49.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a8cec700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a4063540 con 0x7f86a40b5ae0 2021-01-03T13:05:49.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a8cec700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a4063a50 con 0x7f86a40ace10 2021-01-03T13:05:49.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a8cec700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a4064170 con 0x7f86a4140a80 2021-01-03T13:05:49.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86a40ace10 0x7f86a41423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:49.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86a40ace10 0x7f86a41423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37566/0 (socket says 172.21.15.133:37566) 2021-01-03T13:05:49.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a37fe700 1 -- 172.21.15.133:0/3785038797 learned_addr learned my addr 172.21.15.133:0/3785038797 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:49.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a2ffd700 1 --2- 172.21.15.133:0/3785038797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86a40b5ae0 0x7f86a40b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:49.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a3fff700 1 --2- 172.21.15.133:0/3785038797 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f86a4140a80 0x7f86a40ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:49.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a37fe700 1 -- 172.21.15.133:0/3785038797 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f86a4140a80 msgr2=0x7f86a40ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:49.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a37fe700 1 --2- 172.21.15.133:0/3785038797 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f86a4140a80 0x7f86a40ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a37fe700 1 -- 172.21.15.133:0/3785038797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86a40b5ae0 msgr2=0x7f86a40b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:49.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a37fe700 1 --2- 172.21.15.133:0/3785038797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86a40b5ae0 0x7f86a40b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a37fe700 1 -- 172.21.15.133:0/3785038797 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a4063c80 con 0x7f86a40ace10 2021-01-03T13:05:49.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a37fe700 1 --2- 172.21.15.133:0/3785038797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86a40ace10 0x7f86a41423b0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f86a4061f30 tx=0x7f868c007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:49.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a0ff9700 1 -- 172.21.15.133:0/3785038797 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f868c0072a0 con 0x7f86a40ace10 2021-01-03T13:05:49.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a0ff9700 1 -- 172.21.15.133:0/3785038797 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868c0064e0 con 0x7f86a40ace10 2021-01-03T13:05:49.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a8cec700 1 -- 172.21.15.133:0/3785038797 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a409a2b0 con 0x7f86a40ace10 2021-01-03T13:05:49.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a0ff9700 1 -- 172.21.15.133:0/3785038797 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f868c006840 con 0x7f86a40ace10 2021-01-03T13:05:49.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a8cec700 1 -- 172.21.15.133:0/3785038797 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a40644a0 con 0x7f86a40ace10 2021-01-03T13:05:49.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.373+0000 7f86a8cec700 1 -- 172.21.15.133:0/3785038797 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a4057300 con 0x7f86a40ace10 2021-01-03T13:05:49.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.377+0000 7f86a0ff9700 1 -- 172.21.15.133:0/3785038797 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f868c019020 con 0x7f86a40ace10 2021-01-03T13:05:49.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.377+0000 7f86a0ff9700 1 --2- 172.21.15.133:0/3785038797 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8688055330 0x7f86880577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:49.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.377+0000 7f86a0ff9700 1 -- 172.21.15.133:0/3785038797 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f868c06d7a0 con 0x7f86a40ace10 2021-01-03T13:05:49.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.377+0000 7f86a2ffd700 1 --2- 172.21.15.133:0/3785038797 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8688055330 0x7f86880577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:49.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.377+0000 7f86a2ffd700 1 --2- 172.21.15.133:0/3785038797 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8688055330 0x7f86880577f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f869401a000 tx=0x7f8694015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:49.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.381+0000 7f86a0ff9700 1 -- 172.21.15.133:0/3785038797 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f868c043a00 con 0x7f86a40ace10 2021-01-03T13:05:49.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.569+0000 7f86a8cec700 1 -- 172.21.15.133:0/3785038797 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86a4061000 con 0x7f86a40ace10 2021-01-03T13:05:49.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.569+0000 7f86a0ff9700 1 -- 172.21.15.133:0/3785038797 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+2499 (secure 0 0 0) 0x7f868c047020 con 0x7f86a40ace10 2021-01-03T13:05:49.574 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:49.574 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":43,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6014,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1098287672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1098287672},{"type":"v1","addr":"172.21.15.133:6837","nonce":1098287672}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1817607475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1817607475},{"type":"v1","addr":"172.21.15.16:6833","nonce":1817607475}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:34.203844+0000","modified":"2021-01-03T13:05:35.206833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6817},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6817":{"gid":6817,"name":"c","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/1339474843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1339474843},{"type":"v1","addr":"172.21.15.133:6835","nonce":1339474843}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-01-03T13:05:49.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.569+0000 7f86a8cec700 1 -- 172.21.15.133:0/3785038797 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8688055330 msgr2=0x7f86880577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:49.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.569+0000 7f86a8cec700 1 --2- 172.21.15.133:0/3785038797 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8688055330 0x7f86880577f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f869401a000 tx=0x7f8694015000).stop 2021-01-03T13:05:49.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.569+0000 7f86a8cec700 1 -- 172.21.15.133:0/3785038797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86a40ace10 msgr2=0x7f86a41423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:49.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.569+0000 7f86a8cec700 1 --2- 172.21.15.133:0/3785038797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86a40ace10 0x7f86a41423b0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f86a4061f30 tx=0x7f868c007be0).stop 2021-01-03T13:05:49.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.569+0000 7f86a8cec700 1 -- 172.21.15.133:0/3785038797 shutdown_connections 2021-01-03T13:05:49.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.569+0000 7f86a8cec700 1 --2- 172.21.15.133:0/3785038797 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8688055330 0x7f86880577f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.569+0000 7f86a8cec700 1 --2- 172.21.15.133:0/3785038797 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f86a4140a80 0x7f86a40ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.569+0000 7f86a8cec700 1 --2- 172.21.15.133:0/3785038797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86a40ace10 0x7f86a41423b0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.569+0000 7f86a8cec700 1 --2- 172.21.15.133:0/3785038797 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f86a40b5ae0 0x7f86a40b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.569+0000 7f86a8cec700 1 -- 172.21.15.133:0/3785038797 >> 172.21.15.133:0/3785038797 conn(0x7f86a405bdf0 msgr2=0x7f86a413e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:49.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.569+0000 7f86a8cec700 1 -- 172.21.15.133:0/3785038797 shutdown_connections 2021-01-03T13:05:49.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.569+0000 7f86a8cec700 1 -- 172.21.15.133:0/3785038797 wait complete. 2021-01-03T13:05:49.580 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 43 2021-01-03T13:05:49.590 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-01-03T13:05:49.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.697+0000 7f9f3f91a700 1 Processor -- start 2021-01-03T13:05:49.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.697+0000 7f9f3f91a700 1 -- start start 2021-01-03T13:05:49.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.697+0000 7f9f3f91a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9f3813e730 0x7f9f380ac940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:49.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.697+0000 7f9f3f91a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f381441d0 con 0x7f9f380b5a70 2021-01-03T13:05:49.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.697+0000 7f9f3f91a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f380b1ae0 con 0x7f9f380b1580 2021-01-03T13:05:49.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.697+0000 7f9f3f91a700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f380b01f0 con 0x7f9f3813e730 2021-01-03T13:05:49.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.697+0000 7f9f3deb7700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9f380b1580 0x7f9f380ace30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58610/0 (socket says 172.21.15.133:58610) 2021-01-03T13:05:49.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.697+0000 7f9f3deb7700 1 -- 172.21.15.133:0/3999356933 learned_addr learned my addr 172.21.15.133:0/3999356933 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:49.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3ceb5700 1 --2- 172.21.15.133:0/3999356933 >> v2:172.21.15.16:3300/0 conn(0x7f9f3813e730 0x7f9f380ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:49.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 -- 172.21.15.133:0/3999356933 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826269150 0 0) 0x7f9f380b1ae0 con 0x7f9f380b1580 2021-01-03T13:05:49.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 -- 172.21.15.133:0/3999356933 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f24003230 con 0x7f9f380b1580 2021-01-03T13:05:49.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 -- 172.21.15.133:0/3999356933 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742737417 0 0) 0x7f9f381441d0 con 0x7f9f380b5a70 2021-01-03T13:05:49.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 -- 172.21.15.133:0/3999356933 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f380b1ae0 con 0x7f9f380b5a70 2021-01-03T13:05:49.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 -- 172.21.15.133:0/3999356933 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 558028150 0 0) 0x7f9f24003230 con 0x7f9f380b1580 2021-01-03T13:05:49.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 -- 172.21.15.133:0/3999356933 >> v2:172.21.15.16:3300/0 conn(0x7f9f3813e730 msgr2=0x7f9f380ac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:49.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 --2- 172.21.15.133:0/3999356933 >> v2:172.21.15.16:3300/0 conn(0x7f9f3813e730 0x7f9f380ac940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 -- 172.21.15.133:0/3999356933 >> v1:172.21.15.16:6789/0 conn(0x7f9f380b5a70 legacy=0x7f9f3813e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:49.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 -- 172.21.15.133:0/3999356933 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f380b0490 con 0x7f9f380b1580 2021-01-03T13:05:49.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 -- 172.21.15.133:0/3999356933 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f9f30001a50 con 0x7f9f380b1580 2021-01-03T13:05:49.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 -- 172.21.15.133:0/3999356933 >> v1:172.21.15.133:6789/0 conn(0x7f9f380b1580 legacy=0x7f9f380ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:49.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 --2- 172.21.15.133:0/3999356933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f24003900 0x7f9f24003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:49.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 --2- 172.21.15.133:0/3999356933 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9f240044d0 0x7f9f24004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:49.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 --2- 172.21.15.133:0/3999356933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f24004e40 0x7f9f2400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:49.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 -- 172.21.15.133:0/3999356933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f380b01f0 con 0x7f9f24004e40 2021-01-03T13:05:49.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 -- 172.21.15.133:0/3999356933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2400bc10 con 0x7f9f24003900 2021-01-03T13:05:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 -- 172.21.15.133:0/3999356933 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2400bd50 con 0x7f9f240044d0 2021-01-03T13:05:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3d6b6700 1 --2- 172.21.15.133:0/3999356933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f24003900 0x7f9f24003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3ceb5700 1 --2- 172.21.15.133:0/3999356933 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9f240044d0 0x7f9f24004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3deb7700 1 --2- 172.21.15.133:0/3999356933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f24004e40 0x7f9f2400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3d6b6700 1 -- 172.21.15.133:0/3999356933 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9f240044d0 msgr2=0x7f9f24004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:49.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3d6b6700 1 --2- 172.21.15.133:0/3999356933 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9f240044d0 0x7f9f24004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3d6b6700 1 -- 172.21.15.133:0/3999356933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f24004e40 msgr2=0x7f9f2400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:49.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3d6b6700 1 --2- 172.21.15.133:0/3999356933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f24004e40 0x7f9f2400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3d6b6700 1 -- 172.21.15.133:0/3999356933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f24003230 con 0x7f9f24003900 2021-01-03T13:05:49.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3ceb5700 1 --2- 172.21.15.133:0/3999356933 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9f240044d0 0x7f9f24004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:49.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3deb7700 1 --2- 172.21.15.133:0/3999356933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f24004e40 0x7f9f2400b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:49.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3deb7700 1 -- 172.21.15.133:0/3999356933 reap_dead start 2021-01-03T13:05:49.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3d6b6700 1 --2- 172.21.15.133:0/3999356933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f24003900 0x7f9f24003d00 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f9f280010d0 tx=0x7f9f28007b60).ready entity=mon.1 client_cookie=7e3bf2c8aa92d2d5 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:49.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 -- 172.21.15.133:0/3999356933 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f2800c870 con 0x7f9f24003900 2021-01-03T13:05:49.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 -- 172.21.15.133:0/3999356933 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2800c9d0 con 0x7f9f24003900 2021-01-03T13:05:49.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f2ffff700 1 -- 172.21.15.133:0/3999356933 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f2800cd30 con 0x7f9f24003900 2021-01-03T13:05:49.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3f91a700 1 -- 172.21.15.133:0/3999356933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f24003900 msgr2=0x7f9f24003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:49.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3f91a700 1 --2- 172.21.15.133:0/3999356933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f24003900 0x7f9f24003d00 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f9f280010d0 tx=0x7f9f28007b60).stop 2021-01-03T13:05:49.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3f91a700 1 -- 172.21.15.133:0/3999356933 shutdown_connections 2021-01-03T13:05:49.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3f91a700 1 --2- 172.21.15.133:0/3999356933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f24003900 0x7f9f24003d00 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3f91a700 1 -- 172.21.15.133:0/3999356933 >> 172.21.15.133:0/3999356933 conn(0x7f9f3805c8c0 msgr2=0x7f9f380b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:49.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3f91a700 1 -- 172.21.15.133:0/3999356933 shutdown_connections 2021-01-03T13:05:49.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.701+0000 7f9f3f91a700 1 -- 172.21.15.133:0/3999356933 wait complete. 2021-01-03T13:05:49.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3f91a700 1 Processor -- start 2021-01-03T13:05:49.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3f91a700 1 -- start start 2021-01-03T13:05:49.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3f91a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9f24003900 0x7f9f381433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:49.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3f91a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f380b2dc0 0x7f9f380b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:49.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3f91a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f38146490 0x7f9f38146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:49.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3f91a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f38147b20 con 0x7f9f380b2dc0 2021-01-03T13:05:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3f91a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f38145f40 con 0x7f9f38146490 2021-01-03T13:05:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3f91a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f38145490 con 0x7f9f24003900 2021-01-03T13:05:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3deb7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f38146490 0x7f9f38146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3deb7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f38146490 0x7f9f38146940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37590/0 (socket says 172.21.15.133:37590) 2021-01-03T13:05:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3deb7700 1 -- 172.21.15.133:0/3957210563 learned_addr learned my addr 172.21.15.133:0/3957210563 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3d6b6700 1 --2- 172.21.15.133:0/3957210563 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9f24003900 0x7f9f381433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3ceb5700 1 --2- 172.21.15.133:0/3957210563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f380b2dc0 0x7f9f380b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3deb7700 1 -- 172.21.15.133:0/3957210563 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9f24003900 msgr2=0x7f9f381433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3deb7700 1 --2- 172.21.15.133:0/3957210563 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9f24003900 0x7f9f381433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3deb7700 1 -- 172.21.15.133:0/3957210563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f380b2dc0 msgr2=0x7f9f380b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:49.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3deb7700 1 --2- 172.21.15.133:0/3957210563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f380b2dc0 0x7f9f380b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:49.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3deb7700 1 -- 172.21.15.133:0/3957210563 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f38146170 con 0x7f9f38146490 2021-01-03T13:05:49.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3deb7700 1 --2- 172.21.15.133:0/3957210563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f38146490 0x7f9f38146940 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f9f380b4750 tx=0x7f9f30009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:49.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f2e7fc700 1 -- 172.21.15.133:0/3957210563 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f3000dec0 con 0x7f9f38146490 2021-01-03T13:05:49.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f2e7fc700 1 -- 172.21.15.133:0/3957210563 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f30004a80 con 0x7f9f38146490 2021-01-03T13:05:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3f91a700 1 -- 172.21.15.133:0/3957210563 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f380b4990 con 0x7f9f38146490 2021-01-03T13:05:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f2e7fc700 1 -- 172.21.15.133:0/3957210563 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f30004de0 con 0x7f9f38146490 2021-01-03T13:05:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.705+0000 7f9f3f91a700 1 -- 172.21.15.133:0/3957210563 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f38066ea0 con 0x7f9f38146490 2021-01-03T13:05:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.709+0000 7f9f3f91a700 1 -- 172.21.15.133:0/3957210563 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f380b4b20 con 0x7f9f38146490 2021-01-03T13:05:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.709+0000 7f9f2e7fc700 1 -- 172.21.15.133:0/3957210563 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9f3001c060 con 0x7f9f38146490 2021-01-03T13:05:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.709+0000 7f9f2e7fc700 1 --2- 172.21.15.133:0/3957210563 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9f180553b0 0x7f9f18057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.709+0000 7f9f3d6b6700 1 --2- 172.21.15.133:0/3957210563 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9f180553b0 0x7f9f18057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.709+0000 7f9f2e7fc700 1 -- 172.21.15.133:0/3957210563 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9f3006d4a0 con 0x7f9f38146490 2021-01-03T13:05:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.709+0000 7f9f3d6b6700 1 --2- 172.21.15.133:0/3957210563 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9f180553b0 0x7f9f18057870 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f9f28019000 tx=0x7f9f28016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:49.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.717+0000 7f9f2e7fc700 1 -- 172.21.15.133:0/3957210563 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9f300437a0 con 0x7f9f38146490 2021-01-03T13:05:49.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:49.897+0000 7f9f3f91a700 1 -- 172.21.15.133:0/3957210563 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9f38057300 con 0x7f9f38146490 2021-01-03T13:05:50.586 INFO:tasks.ceph.mon.b.smithi016.stderr:2021-01-03T13:05:50.581+0000 7fba5c9c4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-01-03T13:05:50.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.593+0000 7f9f2e7fc700 1 -- 172.21.15.133:0/3957210563 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9f3001a030 con 0x7f9f38146490 2021-01-03T13:05:50.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.593+0000 7f9f3f91a700 1 -- 172.21.15.133:0/3957210563 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9f180553b0 msgr2=0x7f9f18057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:50.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.593+0000 7f9f3f91a700 1 --2- 172.21.15.133:0/3957210563 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9f180553b0 0x7f9f18057870 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f9f28019000 tx=0x7f9f28016000).stop 2021-01-03T13:05:50.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.593+0000 7f9f3f91a700 1 -- 172.21.15.133:0/3957210563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f38146490 msgr2=0x7f9f38146940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:50.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.593+0000 7f9f3f91a700 1 --2- 172.21.15.133:0/3957210563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f38146490 0x7f9f38146940 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f9f380b4750 tx=0x7f9f30009040).stop 2021-01-03T13:05:50.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.597+0000 7f9f3f91a700 1 -- 172.21.15.133:0/3957210563 shutdown_connections 2021-01-03T13:05:50.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.597+0000 7f9f3f91a700 1 --2- 172.21.15.133:0/3957210563 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9f180553b0 0x7f9f18057870 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:50.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.597+0000 7f9f3f91a700 1 --2- 172.21.15.133:0/3957210563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f38146490 0x7f9f38146940 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:50.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.597+0000 7f9f3f91a700 1 --2- 172.21.15.133:0/3957210563 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9f24003900 0x7f9f381433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:50.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.597+0000 7f9f3f91a700 1 --2- 172.21.15.133:0/3957210563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f380b2dc0 0x7f9f380b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:50.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.597+0000 7f9f3f91a700 1 -- 172.21.15.133:0/3957210563 >> 172.21.15.133:0/3957210563 conn(0x7f9f3805c8c0 msgr2=0x7f9f380b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:50.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.597+0000 7f9f3f91a700 1 -- 172.21.15.133:0/3957210563 shutdown_connections 2021-01-03T13:05:50.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.597+0000 7f9f3f91a700 1 -- 172.21.15.133:0/3957210563 wait complete. 2021-01-03T13:05:50.607 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-01-03T13:05:50.622 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:05:50.623 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T13:05:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.737+0000 7f1929cec700 1 Processor -- start 2021-01-03T13:05:50.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.737+0000 7f1929cec700 1 -- start start 2021-01-03T13:05:50.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f1929cec700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f192413fb40 0x7f192413fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:50.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f1929cec700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192405cc20 con 0x7f192413c890 2021-01-03T13:05:50.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f1929cec700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1924143df0 con 0x7f192405c840 2021-01-03T13:05:50.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f1929cec700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19240aa1f0 con 0x7f192413fb40 2021-01-03T13:05:50.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19237fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f192405c840 0x7f19240b16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58638/0 (socket says 172.21.15.133:58638) 2021-01-03T13:05:50.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19237fe700 1 -- 172.21.15.133:0/1760797442 learned_addr learned my addr 172.21.15.133:0/1760797442 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:50.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f1922ffd700 1 --2- 172.21.15.133:0/1760797442 >> v2:172.21.15.16:3300/0 conn(0x7f192413fb40 0x7f192413fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:50.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 -- 172.21.15.133:0/1760797442 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191462335 0 0) 0x7f1924143df0 con 0x7f192405c840 2021-01-03T13:05:50.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 -- 172.21.15.133:0/1760797442 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1904003230 con 0x7f192405c840 2021-01-03T13:05:50.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 -- 172.21.15.133:0/1760797442 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 445555016 0 0) 0x7f1904003230 con 0x7f192405c840 2021-01-03T13:05:50.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 -- 172.21.15.133:0/1760797442 >> v2:172.21.15.16:3300/0 conn(0x7f192413fb40 msgr2=0x7f192413fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:50.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 --2- 172.21.15.133:0/1760797442 >> v2:172.21.15.16:3300/0 conn(0x7f192413fb40 0x7f192413fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:50.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 -- 172.21.15.133:0/1760797442 >> v1:172.21.15.16:6789/0 conn(0x7f192413c890 legacy=0x7f192413cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:50.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 -- 172.21.15.133:0/1760797442 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19240a9ab0 con 0x7f192405c840 2021-01-03T13:05:50.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 -- 172.21.15.133:0/1760797442 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f1914001a50 con 0x7f192405c840 2021-01-03T13:05:50.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 -- 172.21.15.133:0/1760797442 >> v1:172.21.15.133:6789/0 conn(0x7f192405c840 legacy=0x7f19240b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:50.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 --2- 172.21.15.133:0/1760797442 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1904003720 0x7f1904003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:50.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 --2- 172.21.15.133:0/1760797442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19040044d0 0x7f1904004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:50.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 --2- 172.21.15.133:0/1760797442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904004e40 0x7f190400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:50.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 -- 172.21.15.133:0/1760797442 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19240aa1f0 con 0x7f19040044d0 2021-01-03T13:05:50.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 -- 172.21.15.133:0/1760797442 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1904004240 con 0x7f1904004e40 2021-01-03T13:05:50.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 -- 172.21.15.133:0/1760797442 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f190400bc10 con 0x7f1904003720 2021-01-03T13:05:50.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f1923fff700 1 --2- 172.21.15.133:0/1760797442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904004e40 0x7f190400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:50.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f1922ffd700 1 --2- 172.21.15.133:0/1760797442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19040044d0 0x7f1904004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:50.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19237fe700 1 --2- 172.21.15.133:0/1760797442 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1904003720 0x7f1904003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:50.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f1923fff700 1 -- 172.21.15.133:0/1760797442 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1904003720 msgr2=0x7f1904003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:50.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f1923fff700 1 --2- 172.21.15.133:0/1760797442 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1904003720 0x7f1904003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:50.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f1923fff700 1 -- 172.21.15.133:0/1760797442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19040044d0 msgr2=0x7f1904004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:50.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f1923fff700 1 --2- 172.21.15.133:0/1760797442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19040044d0 0x7f1904004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:50.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f1923fff700 1 -- 172.21.15.133:0/1760797442 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1904003230 con 0x7f1904004e40 2021-01-03T13:05:50.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f1923fff700 1 -- 172.21.15.133:0/1760797442 reap_dead start 2021-01-03T13:05:50.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f1923fff700 1 --2- 172.21.15.133:0/1760797442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904004e40 0x7f190400b720 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f191c000fe0 tx=0x7f191c007b40).ready entity=mon.1 client_cookie=94ca373e7cbe6b9 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:50.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 -- 172.21.15.133:0/1760797442 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f191c00c870 con 0x7f1904004e40 2021-01-03T13:05:50.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 -- 172.21.15.133:0/1760797442 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c00c9d0 con 0x7f1904004e40 2021-01-03T13:05:50.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f19227fc700 1 -- 172.21.15.133:0/1760797442 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f191c00cd30 con 0x7f1904004e40 2021-01-03T13:05:50.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f1929cec700 1 -- 172.21.15.133:0/1760797442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904004e40 msgr2=0x7f190400b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:50.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.741+0000 7f1929cec700 1 --2- 172.21.15.133:0/1760797442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904004e40 0x7f190400b720 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f191c000fe0 tx=0x7f191c007b40).stop 2021-01-03T13:05:50.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f1929cec700 1 -- 172.21.15.133:0/1760797442 shutdown_connections 2021-01-03T13:05:50.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f1929cec700 1 --2- 172.21.15.133:0/1760797442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904004e40 0x7f190400b720 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:50.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f1929cec700 1 -- 172.21.15.133:0/1760797442 >> 172.21.15.133:0/1760797442 conn(0x7f192406aeb0 msgr2=0x7f192405bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:50.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f1929cec700 1 -- 172.21.15.133:0/1760797442 shutdown_connections 2021-01-03T13:05:50.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f1929cec700 1 -- 172.21.15.133:0/1760797442 wait complete. 2021-01-03T13:05:50.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f1929cec700 1 Processor -- start 2021-01-03T13:05:50.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f1929cec700 1 -- start start 2021-01-03T13:05:50.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f1929cec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904004e40 0x7f1924067850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:50.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f1929cec700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f19240b4e70 0x7f1924155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:50.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f1929cec700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1924155870 0x7f19240b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:50.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f1929cec700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1924154f50 con 0x7f1924155870 2021-01-03T13:05:50.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f1929cec700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19240b5710 con 0x7f1904004e40 2021-01-03T13:05:50.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f1929cec700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19240b59b0 con 0x7f19240b4e70 2021-01-03T13:05:50.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f19237fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904004e40 0x7f1924067850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:50.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f19237fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904004e40 0x7f1924067850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37620/0 (socket says 172.21.15.133:37620) 2021-01-03T13:05:50.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f19237fe700 1 -- 172.21.15.133:0/2514578348 learned_addr learned my addr 172.21.15.133:0/2514578348 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:50.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f1922ffd700 1 --2- 172.21.15.133:0/2514578348 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f19240b4e70 0x7f1924155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:50.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f1923fff700 1 --2- 172.21.15.133:0/2514578348 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1924155870 0x7f19240b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:50.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f19237fe700 1 -- 172.21.15.133:0/2514578348 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f19240b4e70 msgr2=0x7f1924155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:50.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f19237fe700 1 --2- 172.21.15.133:0/2514578348 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f19240b4e70 0x7f1924155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:50.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f19237fe700 1 -- 172.21.15.133:0/2514578348 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1924155870 msgr2=0x7f19240b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:50.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f19237fe700 1 --2- 172.21.15.133:0/2514578348 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1924155870 0x7f19240b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:50.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.745+0000 7f19237fe700 1 -- 172.21.15.133:0/2514578348 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19240b5c50 con 0x7f1904004e40 2021-01-03T13:05:50.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.749+0000 7f19237fe700 1 --2- 172.21.15.133:0/2514578348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904004e40 0x7f1924067850 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f1914007a80 tx=0x7f19240a9c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:50.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.749+0000 7f1920ff9700 1 -- 172.21.15.133:0/2514578348 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f191400fd70 con 0x7f1904004e40 2021-01-03T13:05:50.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.749+0000 7f1920ff9700 1 -- 172.21.15.133:0/2514578348 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191400fed0 con 0x7f1904004e40 2021-01-03T13:05:50.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.749+0000 7f1929cec700 1 -- 172.21.15.133:0/2514578348 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19240a1a50 con 0x7f1904004e40 2021-01-03T13:05:50.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.749+0000 7f1920ff9700 1 -- 172.21.15.133:0/2514578348 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1914015600 con 0x7f1904004e40 2021-01-03T13:05:50.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.749+0000 7f1929cec700 1 -- 172.21.15.133:0/2514578348 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1924142970 con 0x7f1904004e40 2021-01-03T13:05:50.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.749+0000 7f1929cec700 1 -- 172.21.15.133:0/2514578348 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1924155090 con 0x7f1904004e40 2021-01-03T13:05:50.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.749+0000 7f1920ff9700 1 -- 172.21.15.133:0/2514578348 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1914015760 con 0x7f1904004e40 2021-01-03T13:05:50.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.749+0000 7f1920ff9700 1 --2- 172.21.15.133:0/2514578348 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f19080553b0 0x7f1908057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:50.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.749+0000 7f1920ff9700 1 -- 172.21.15.133:0/2514578348 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f191406e740 con 0x7f1904004e40 2021-01-03T13:05:50.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.749+0000 7f1922ffd700 1 --2- 172.21.15.133:0/2514578348 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f19080553b0 0x7f1908057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:50.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.753+0000 7f1922ffd700 1 --2- 172.21.15.133:0/2514578348 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f19080553b0 0x7f1908057870 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f190c008000 tx=0x7f190c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:50.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.757+0000 7f1920ff9700 1 -- 172.21.15.133:0/2514578348 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1914044990 con 0x7f1904004e40 2021-01-03T13:05:50.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.941+0000 7f1929cec700 1 -- 172.21.15.133:0/2514578348 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1924057300 con 0x7f1904004e40 2021-01-03T13:05:50.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.941+0000 7f1920ff9700 1 -- 172.21.15.133:0/2514578348 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+2136 (secure 0 0 0) 0x7f1914047fb0 con 0x7f1904004e40 2021-01-03T13:05:50.954 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:50.955 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":44,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6014,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1098287672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1098287672},{"type":"v1","addr":"172.21.15.133:6837","nonce":1098287672}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41},{"gid":6017,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/1817607475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1817607475},{"type":"v1","addr":"172.21.15.16:6833","nonce":1817607475}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:34.203844+0000","modified":"2021-01-03T13:05:50.586561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":103,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2021-01-03T13:05:50.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.945+0000 7f1929cec700 1 -- 172.21.15.133:0/2514578348 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f19080553b0 msgr2=0x7f1908057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:50.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.945+0000 7f1929cec700 1 --2- 172.21.15.133:0/2514578348 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f19080553b0 0x7f1908057870 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f190c008000 tx=0x7f190c008040).stop 2021-01-03T13:05:50.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.945+0000 7f1929cec700 1 -- 172.21.15.133:0/2514578348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904004e40 msgr2=0x7f1924067850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:50.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.945+0000 7f1929cec700 1 --2- 172.21.15.133:0/2514578348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904004e40 0x7f1924067850 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f1914007a80 tx=0x7f19240a9c40).stop 2021-01-03T13:05:50.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.945+0000 7f1929cec700 1 -- 172.21.15.133:0/2514578348 shutdown_connections 2021-01-03T13:05:50.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.945+0000 7f1929cec700 1 --2- 172.21.15.133:0/2514578348 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f19080553b0 0x7f1908057870 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:50.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.945+0000 7f1929cec700 1 --2- 172.21.15.133:0/2514578348 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1924155870 0x7f19240b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:50.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.945+0000 7f1929cec700 1 --2- 172.21.15.133:0/2514578348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1904004e40 0x7f1924067850 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:50.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.945+0000 7f1929cec700 1 --2- 172.21.15.133:0/2514578348 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f19240b4e70 0x7f1924155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:50.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.945+0000 7f1929cec700 1 -- 172.21.15.133:0/2514578348 >> 172.21.15.133:0/2514578348 conn(0x7f192406aeb0 msgr2=0x7f19240b1540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:50.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.945+0000 7f1929cec700 1 -- 172.21.15.133:0/2514578348 shutdown_connections 2021-01-03T13:05:50.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:50.945+0000 7f1929cec700 1 -- 172.21.15.133:0/2514578348 wait complete. 2021-01-03T13:05:50.959 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 44 2021-01-03T13:05:50.973 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-01-03T13:05:51.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.089+0000 7f0569190700 1 Processor -- start 2021-01-03T13:05:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.089+0000 7f0569190700 1 -- start start 2021-01-03T13:05:51.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.089+0000 7f0569190700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f056405cc10 0x7f05641437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.089+0000 7f0569190700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05640b02d0 0x7f0564146a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.089+0000 7f0569190700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056405c510 con 0x7f056405c130 2021-01-03T13:05:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.089+0000 7f0569190700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05640b0780 con 0x7f056405cc10 2021-01-03T13:05:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.089+0000 7f0569190700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05640b5c10 con 0x7f05640b02d0 2021-01-03T13:05:51.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.089+0000 7f056259c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f056405cc10 0x7f05641437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:51.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.089+0000 7f056359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05640b02d0 0x7f0564146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:51.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.089+0000 7f0562d9d700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f056405c130 0x7f0564146370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:37386/0 (socket says 172.21.15.133:37386) 2021-01-03T13:05:51.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.089+0000 7f0562d9d700 1 -- 172.21.15.133:0/2219334568 learned_addr learned my addr 172.21.15.133:0/2219334568 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:51.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f056259c700 1 -- 172.21.15.133:0/2219334568 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05640b02d0 msgr2=0x7f0564146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:51.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f056259c700 1 --2- 172.21.15.133:0/2219334568 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05640b02d0 0x7f0564146a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:51.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f056259c700 1 -- 172.21.15.133:0/2219334568 >> v1:172.21.15.16:6789/0 conn(0x7f056405c130 legacy=0x7f0564146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:51.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f056259c700 1 -- 172.21.15.133:0/2219334568 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05640af8f0 con 0x7f056405cc10 2021-01-03T13:05:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f056259c700 1 --2- 172.21.15.133:0/2219334568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f056405cc10 0x7f05641437e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f054c002f30 tx=0x7f054c006dc0).ready entity=mon.0 client_cookie=c371010152312640 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:51.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f0561d9b700 1 -- 172.21.15.133:0/2219334568 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c009760 con 0x7f056405cc10 2021-01-03T13:05:51.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f0561d9b700 1 -- 172.21.15.133:0/2219334568 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c0098c0 con 0x7f056405cc10 2021-01-03T13:05:51.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f0561d9b700 1 -- 172.21.15.133:0/2219334568 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f054c009c20 con 0x7f056405cc10 2021-01-03T13:05:51.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f0569190700 1 -- 172.21.15.133:0/2219334568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f056405cc10 msgr2=0x7f05641437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:51.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f0569190700 1 --2- 172.21.15.133:0/2219334568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f056405cc10 0x7f05641437e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f054c002f30 tx=0x7f054c006dc0).stop 2021-01-03T13:05:51.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f0569190700 1 -- 172.21.15.133:0/2219334568 shutdown_connections 2021-01-03T13:05:51.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f0569190700 1 --2- 172.21.15.133:0/2219334568 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05640b02d0 0x7f0564146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:51.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f0569190700 1 --2- 172.21.15.133:0/2219334568 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f056405cc10 0x7f05641437e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:51.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f0569190700 1 -- 172.21.15.133:0/2219334568 >> 172.21.15.133:0/2219334568 conn(0x7f05640b95d0 msgr2=0x7f05640b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:51.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f0569190700 1 -- 172.21.15.133:0/2219334568 shutdown_connections 2021-01-03T13:05:51.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f0569190700 1 -- 172.21.15.133:0/2219334568 wait complete. 2021-01-03T13:05:51.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f0569190700 1 Processor -- start 2021-01-03T13:05:51.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.093+0000 7f0569190700 1 -- start start 2021-01-03T13:05:51.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f0569190700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f056405c130 0x7f05641449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f0569190700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f056405cc10 0x7f056413e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f0569190700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05640b02d0 0x7f056413edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f0569190700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0564142dd0 con 0x7f056405c130 2021-01-03T13:05:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f0569190700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056413e210 con 0x7f05640b02d0 2021-01-03T13:05:51.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f0569190700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0564142680 con 0x7f056405cc10 2021-01-03T13:05:51.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f056359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05640b02d0 0x7f056413edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:51.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f056359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05640b02d0 0x7f056413edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37636/0 (socket says 172.21.15.133:37636) 2021-01-03T13:05:51.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f056359e700 1 -- 172.21.15.133:0/2100529026 learned_addr learned my addr 172.21.15.133:0/2100529026 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:51.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f056259c700 1 --2- 172.21.15.133:0/2100529026 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f056405cc10 0x7f056413e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:51.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f0562d9d700 1 --2- 172.21.15.133:0/2100529026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f056405c130 0x7f05641449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:51.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f056359e700 1 -- 172.21.15.133:0/2100529026 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f056405cc10 msgr2=0x7f056413e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:51.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f056359e700 1 --2- 172.21.15.133:0/2100529026 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f056405cc10 0x7f056413e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:51.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f056359e700 1 -- 172.21.15.133:0/2100529026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f056405c130 msgr2=0x7f05641449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:51.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f056359e700 1 --2- 172.21.15.133:0/2100529026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f056405c130 0x7f05641449f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:51.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f056359e700 1 -- 172.21.15.133:0/2100529026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056413e440 con 0x7f05640b02d0 2021-01-03T13:05:51.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f056359e700 1 --2- 172.21.15.133:0/2100529026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05640b02d0 0x7f056413edd0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f055c006dd0 tx=0x7f055c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:51.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f055bfff700 1 -- 172.21.15.133:0/2100529026 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f055c00c8d0 con 0x7f05640b02d0 2021-01-03T13:05:51.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f055bfff700 1 -- 172.21.15.133:0/2100529026 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c00ca30 con 0x7f05640b02d0 2021-01-03T13:05:51.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f0569190700 1 -- 172.21.15.133:0/2100529026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056409ca20 con 0x7f05640b02d0 2021-01-03T13:05:51.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f055bfff700 1 -- 172.21.15.133:0/2100529026 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f055c00cd90 con 0x7f05640b02d0 2021-01-03T13:05:51.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.097+0000 7f0569190700 1 -- 172.21.15.133:0/2100529026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0564142300 con 0x7f05640b02d0 2021-01-03T13:05:51.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.101+0000 7f0569190700 1 -- 172.21.15.133:0/2100529026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056409c2c0 con 0x7f05640b02d0 2021-01-03T13:05:51.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.101+0000 7f055bfff700 1 -- 172.21.15.133:0/2100529026 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f055c022070 con 0x7f05640b02d0 2021-01-03T13:05:51.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.101+0000 7f055bfff700 1 --2- 172.21.15.133:0/2100529026 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0548055330 0x7f05480577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:51.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.101+0000 7f055bfff700 1 -- 172.21.15.133:0/2100529026 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f055c06e5c0 con 0x7f05640b02d0 2021-01-03T13:05:51.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.101+0000 7f0562d9d700 1 --2- 172.21.15.133:0/2100529026 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0548055330 0x7f05480577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:51.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.101+0000 7f0562d9d700 1 --2- 172.21.15.133:0/2100529026 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0548055330 0x7f05480577f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f055400d000 tx=0x7f0554009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:51.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.105+0000 7f055bfff700 1 -- 172.21.15.133:0/2100529026 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f055c044870 con 0x7f05640b02d0 2021-01-03T13:05:51.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.289+0000 7f0569190700 1 -- 172.21.15.133:0/2100529026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f056413e5d0 con 0x7f05640b02d0 2021-01-03T13:05:51.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.593+0000 7f055bfff700 1 -- 172.21.15.133:0/2100529026 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7f055c016020 con 0x7f05640b02d0 2021-01-03T13:05:51.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.593+0000 7f0569190700 1 -- 172.21.15.133:0/2100529026 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0548055330 msgr2=0x7f05480577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:51.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.593+0000 7f0569190700 1 --2- 172.21.15.133:0/2100529026 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0548055330 0x7f05480577f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f055400d000 tx=0x7f0554009040).stop 2021-01-03T13:05:51.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.593+0000 7f0569190700 1 -- 172.21.15.133:0/2100529026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05640b02d0 msgr2=0x7f056413edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:51.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.593+0000 7f0569190700 1 --2- 172.21.15.133:0/2100529026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05640b02d0 0x7f056413edd0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f055c006dd0 tx=0x7f055c0091a0).stop 2021-01-03T13:05:51.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.597+0000 7f0569190700 1 -- 172.21.15.133:0/2100529026 shutdown_connections 2021-01-03T13:05:51.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.597+0000 7f0569190700 1 --2- 172.21.15.133:0/2100529026 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0548055330 0x7f05480577f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:51.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.597+0000 7f0569190700 1 --2- 172.21.15.133:0/2100529026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f056405c130 0x7f05641449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:51.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.597+0000 7f0569190700 1 --2- 172.21.15.133:0/2100529026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05640b02d0 0x7f056413edd0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.597+0000 7f0569190700 1 --2- 172.21.15.133:0/2100529026 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f056405cc10 0x7f056413e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.597+0000 7f0569190700 1 -- 172.21.15.133:0/2100529026 >> 172.21.15.133:0/2100529026 conn(0x7f05640b95d0 msgr2=0x7f056413c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.597+0000 7f0569190700 1 -- 172.21.15.133:0/2100529026 shutdown_connections 2021-01-03T13:05:51.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.597+0000 7f0569190700 1 -- 172.21.15.133:0/2100529026 wait complete. 2021-01-03T13:05:51.621 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-01-03T13:05:51.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.729+0000 7fa8769d2700 1 Processor -- start 2021-01-03T13:05:51.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.729+0000 7fa8769d2700 1 -- start start 2021-01-03T13:05:51.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.729+0000 7fa8769d2700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa87005c130 0x7fa8700b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:51.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.729+0000 7fa8769d2700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87005c510 con 0x7fa8700622f0 2021-01-03T13:05:51.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.729+0000 7fa8769d2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8700b15a0 con 0x7fa8700b02b0 2021-01-03T13:05:51.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.729+0000 7fa8769d2700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8701473d0 con 0x7fa87005c130 2021-01-03T13:05:51.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.729+0000 7fa8751cf700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa8700b02b0 0x7fa8700668a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58676/0 (socket says 172.21.15.133:58676) 2021-01-03T13:05:51.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.729+0000 7fa8751cf700 1 -- 172.21.15.133:0/1159839036 learned_addr learned my addr 172.21.15.133:0/1159839036 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:51.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.729+0000 7fa8759d0700 1 --2- 172.21.15.133:0/1159839036 >> v2:172.21.15.16:3300/0 conn(0x7fa87005c130 0x7fa8700b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:51.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.729+0000 7fa8749ce700 1 -- 172.21.15.133:0/1159839036 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193936060 0 0) 0x7fa8700b15a0 con 0x7fa8700b02b0 2021-01-03T13:05:51.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.729+0000 7fa8749ce700 1 -- 172.21.15.133:0/1159839036 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa858003230 con 0x7fa8700b02b0 2021-01-03T13:05:51.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.733+0000 7fa8759d0700 1 -- 172.21.15.133:0/1159839036 >> v1:172.21.15.133:6789/0 conn(0x7fa8700b02b0 legacy=0x7fa8700668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:51.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.733+0000 7fa8759d0700 1 -- 172.21.15.133:0/1159839036 >> v1:172.21.15.16:6789/0 conn(0x7fa8700622f0 legacy=0x7fa87014d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:51.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.733+0000 7fa8749ce700 1 -- 172.21.15.133:0/1159839036 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163686055 0 0) 0x7fa87005c510 con 0x7fa8700622f0 2021-01-03T13:05:51.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.733+0000 7fa8759d0700 1 -- 172.21.15.133:0/1159839036 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa870061920 con 0x7fa87005c130 2021-01-03T13:05:51.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.733+0000 7fa8759d0700 1 --2- 172.21.15.133:0/1159839036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa87005c130 0x7fa8700b1a00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fa86c0032b0 tx=0x7fa86c0091a0).ready entity=mon.0 client_cookie=f094c2d6aab7de6a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:51.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.733+0000 7fa8749ce700 1 -- 172.21.15.133:0/1159839036 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa86c00b9a0 con 0x7fa87005c130 2021-01-03T13:05:51.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.733+0000 7fa8749ce700 1 -- 172.21.15.133:0/1159839036 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c00bb00 con 0x7fa87005c130 2021-01-03T13:05:51.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.733+0000 7fa8749ce700 1 -- 172.21.15.133:0/1159839036 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa86c00bc70 con 0x7fa87005c130 2021-01-03T13:05:51.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.733+0000 7fa8769d2700 1 -- 172.21.15.133:0/1159839036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa87005c130 msgr2=0x7fa8700b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:51.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.733+0000 7fa8769d2700 1 --2- 172.21.15.133:0/1159839036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa87005c130 0x7fa8700b1a00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fa86c0032b0 tx=0x7fa86c0091a0).stop 2021-01-03T13:05:51.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.733+0000 7fa8769d2700 1 -- 172.21.15.133:0/1159839036 shutdown_connections 2021-01-03T13:05:51.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.733+0000 7fa8769d2700 1 --2- 172.21.15.133:0/1159839036 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa87005c130 0x7fa8700b1a00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:51.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.733+0000 7fa8769d2700 1 -- 172.21.15.133:0/1159839036 >> 172.21.15.133:0/1159839036 conn(0x7fa8700b6110 msgr2=0x7fa8700b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:51.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.733+0000 7fa8769d2700 1 -- 172.21.15.133:0/1159839036 shutdown_connections 2021-01-03T13:05:51.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.733+0000 7fa8769d2700 1 -- 172.21.15.133:0/1159839036 wait complete. 2021-01-03T13:05:51.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.733+0000 7fa8769d2700 1 Processor -- start 2021-01-03T13:05:51.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.733+0000 7fa8769d2700 1 -- start start 2021-01-03T13:05:51.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8769d2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87005c130 0x7fa8701431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:51.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8769d2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa8700622f0 0x7fa870155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8769d2700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8700b02b0 0x7fa870151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8769d2700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa870155ff0 con 0x7fa8700b02b0 2021-01-03T13:05:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8769d2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8701482a0 con 0x7fa87005c130 2021-01-03T13:05:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8769d2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa870155120 con 0x7fa8700622f0 2021-01-03T13:05:51.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8759d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87005c130 0x7fa8701431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8759d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87005c130 0x7fa8701431a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37648/0 (socket says 172.21.15.133:37648) 2021-01-03T13:05:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8759d0700 1 -- 172.21.15.133:0/2629251796 learned_addr learned my addr 172.21.15.133:0/2629251796 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8761d1700 1 --2- 172.21.15.133:0/2629251796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8700b02b0 0x7fa870151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8751cf700 1 --2- 172.21.15.133:0/2629251796 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa8700622f0 0x7fa870155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:51.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8759d0700 1 -- 172.21.15.133:0/2629251796 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa8700622f0 msgr2=0x7fa870155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:51.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8759d0700 1 --2- 172.21.15.133:0/2629251796 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa8700622f0 0x7fa870155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:51.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8759d0700 1 -- 172.21.15.133:0/2629251796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8700b02b0 msgr2=0x7fa870151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:51.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8759d0700 1 --2- 172.21.15.133:0/2629251796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8700b02b0 0x7fa870151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:51.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8759d0700 1 -- 172.21.15.133:0/2629251796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8701553c0 con 0x7fa87005c130 2021-01-03T13:05:51.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8759d0700 1 --2- 172.21.15.133:0/2629251796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87005c130 0x7fa8701431a0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7fa86c0032b0 tx=0x7fa86c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:51.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa85effd700 1 -- 172.21.15.133:0/2629251796 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa86c01f3f0 con 0x7fa87005c130 2021-01-03T13:05:51.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa85effd700 1 -- 172.21.15.133:0/2629251796 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c01f550 con 0x7fa87005c130 2021-01-03T13:05:51.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa85effd700 1 -- 172.21.15.133:0/2629251796 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa86c01f8b0 con 0x7fa87005c130 2021-01-03T13:05:51.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8769d2700 1 -- 172.21.15.133:0/2629251796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa870155660 con 0x7fa87005c130 2021-01-03T13:05:51.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.737+0000 7fa8769d2700 1 -- 172.21.15.133:0/2629251796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa870152080 con 0x7fa87005c130 2021-01-03T13:05:51.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.741+0000 7fa8769d2700 1 -- 172.21.15.133:0/2629251796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa870057300 con 0x7fa87005c130 2021-01-03T13:05:51.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.741+0000 7fa85effd700 1 -- 172.21.15.133:0/2629251796 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa86c026030 con 0x7fa87005c130 2021-01-03T13:05:51.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.741+0000 7fa85effd700 1 --2- 172.21.15.133:0/2629251796 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa8500553b0 0x7fa850057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:51.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.741+0000 7fa85effd700 1 -- 172.21.15.133:0/2629251796 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa86c06ebf0 con 0x7fa87005c130 2021-01-03T13:05:51.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.741+0000 7fa8751cf700 1 --2- 172.21.15.133:0/2629251796 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa8500553b0 0x7fa850057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:51.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.741+0000 7fa8751cf700 1 --2- 172.21.15.133:0/2629251796 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa8500553b0 0x7fa850057870 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fa86000d000 tx=0x7fa860009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:51.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.745+0000 7fa85effd700 1 -- 172.21.15.133:0/2629251796 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa86c044ea0 con 0x7fa87005c130 2021-01-03T13:05:51.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:51.885+0000 7fa8769d2700 1 -- 172.21.15.133:0/2629251796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa870061020 con 0x7fa87005c130 2021-01-03T13:05:52.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.637+0000 7fa85effd700 1 -- 172.21.15.133:0/2629251796 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v104) v1 ==== 185+0+0 (secure 0 0 0) 0x7fa86c0240e0 con 0x7fa87005c130 2021-01-03T13:05:52.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.641+0000 7fa8769d2700 1 -- 172.21.15.133:0/2629251796 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa8500553b0 msgr2=0x7fa850057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:52.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.641+0000 7fa8769d2700 1 --2- 172.21.15.133:0/2629251796 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa8500553b0 0x7fa850057870 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fa86000d000 tx=0x7fa860009040).stop 2021-01-03T13:05:52.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.641+0000 7fa8769d2700 1 -- 172.21.15.133:0/2629251796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87005c130 msgr2=0x7fa8701431a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:52.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.641+0000 7fa8769d2700 1 --2- 172.21.15.133:0/2629251796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87005c130 0x7fa8701431a0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7fa86c0032b0 tx=0x7fa86c016000).stop 2021-01-03T13:05:52.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.641+0000 7fa8769d2700 1 -- 172.21.15.133:0/2629251796 shutdown_connections 2021-01-03T13:05:52.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.641+0000 7fa8769d2700 1 --2- 172.21.15.133:0/2629251796 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa8500553b0 0x7fa850057870 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:52.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.641+0000 7fa8769d2700 1 --2- 172.21.15.133:0/2629251796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa8700b02b0 0x7fa870151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:52.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.641+0000 7fa8769d2700 1 --2- 172.21.15.133:0/2629251796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87005c130 0x7fa8701431a0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:52.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.641+0000 7fa8769d2700 1 --2- 172.21.15.133:0/2629251796 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa8700622f0 0x7fa870155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:52.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.641+0000 7fa8769d2700 1 -- 172.21.15.133:0/2629251796 >> 172.21.15.133:0/2629251796 conn(0x7fa8700b6110 msgr2=0x7fa8700ae040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:52.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.641+0000 7fa8769d2700 1 -- 172.21.15.133:0/2629251796 shutdown_connections 2021-01-03T13:05:52.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.641+0000 7fa8769d2700 1 -- 172.21.15.133:0/2629251796 wait complete. 2021-01-03T13:05:52.654 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2021-01-03T13:05:52.663 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-01-03T13:05:52.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f3804c85700 1 Processor -- start 2021-01-03T13:05:52.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f3804c85700 1 -- start start 2021-01-03T13:05:52.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f3804c85700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38000b9b60 0x7f38000b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:52.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f3804c85700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f38000b4980 0x7f3800146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:52.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f3804c85700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f38000b4e10 0x7f3800146920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:52.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f3804c85700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38000aed30 con 0x7f38000b4980 2021-01-03T13:05:52.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f3804c85700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38000605f0 con 0x7f38000b9b60 2021-01-03T13:05:52.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f3804c85700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38000600b0 con 0x7f38000b4e10 2021-01-03T13:05:52.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f37ff7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38000b9b60 0x7f38000b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:52.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f37ff7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38000b9b60 0x7f38000b9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37656/0 (socket says 172.21.15.133:37656) 2021-01-03T13:05:52.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f37ff7fe700 1 -- 172.21.15.133:0/2077986773 learned_addr learned my addr 172.21.15.133:0/2077986773 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:52.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f37feffd700 1 --2- 172.21.15.133:0/2077986773 >> v2:172.21.15.16:3300/0 conn(0x7f38000b4980 0x7f3800146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:52.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f37fffff700 1 --2- 172.21.15.133:0/2077986773 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f38000b4e10 0x7f3800146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:52.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f37ff7fe700 1 -- 172.21.15.133:0/2077986773 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f38000b4e10 msgr2=0x7f3800146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:52.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f37ff7fe700 1 --2- 172.21.15.133:0/2077986773 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f38000b4e10 0x7f3800146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:52.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f37ff7fe700 1 -- 172.21.15.133:0/2077986773 >> v2:172.21.15.16:3300/0 conn(0x7f38000b4980 msgr2=0x7f3800146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:52.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f37ff7fe700 1 --2- 172.21.15.133:0/2077986773 >> v2:172.21.15.16:3300/0 conn(0x7f38000b4980 0x7f3800146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:52.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f37ff7fe700 1 -- 172.21.15.133:0/2077986773 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3800060350 con 0x7f38000b9b60 2021-01-03T13:05:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f37ff7fe700 1 --2- 172.21.15.133:0/2077986773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38000b9b60 0x7f38000b9f40 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f37f0002f30 tx=0x7f37f0006e80).ready entity=mon.1 client_cookie=77aaea540d527b46 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f37fe7fc700 1 -- 172.21.15.133:0/2077986773 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37f0009640 con 0x7f38000b9b60 2021-01-03T13:05:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f37fe7fc700 1 -- 172.21.15.133:0/2077986773 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f00097a0 con 0x7f38000b9b60 2021-01-03T13:05:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f37fe7fc700 1 -- 172.21.15.133:0/2077986773 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37f0009b00 con 0x7f38000b9b60 2021-01-03T13:05:52.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f3804c85700 1 -- 172.21.15.133:0/2077986773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38000b9b60 msgr2=0x7f38000b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:52.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.777+0000 7f3804c85700 1 --2- 172.21.15.133:0/2077986773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38000b9b60 0x7f38000b9f40 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f37f0002f30 tx=0x7f37f0006e80).stop 2021-01-03T13:05:52.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f3804c85700 1 -- 172.21.15.133:0/2077986773 shutdown_connections 2021-01-03T13:05:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f3804c85700 1 --2- 172.21.15.133:0/2077986773 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f38000b4e10 0x7f3800146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:52.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f3804c85700 1 --2- 172.21.15.133:0/2077986773 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38000b9b60 0x7f38000b9f40 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:52.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f3804c85700 1 --2- 172.21.15.133:0/2077986773 >> v2:172.21.15.16:3300/0 conn(0x7f38000b4980 0x7f3800146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:52.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f3804c85700 1 -- 172.21.15.133:0/2077986773 >> 172.21.15.133:0/2077986773 conn(0x7f38000b69e0 msgr2=0x7f38000b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:52.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f3804c85700 1 -- 172.21.15.133:0/2077986773 shutdown_connections 2021-01-03T13:05:52.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f3804c85700 1 -- 172.21.15.133:0/2077986773 wait complete. 2021-01-03T13:05:52.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f3804c85700 1 Processor -- start 2021-01-03T13:05:52.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f3804c85700 1 -- start start 2021-01-03T13:05:52.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f3804c85700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38000b4980 0x7f38000b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:52.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f3804c85700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f38000b4e10 0x7f38000b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:52.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f3804c85700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38000b9b60 0x7f3800154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:52.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f3804c85700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000b2e50 con 0x7f38000b4980 2021-01-03T13:05:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f3804c85700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000b2bb0 con 0x7f38000b9b60 2021-01-03T13:05:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f3804c85700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3800090a20 con 0x7f38000b4e10 2021-01-03T13:05:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f37fffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38000b9b60 0x7f3800154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:52.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f37fffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38000b9b60 0x7f3800154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37666/0 (socket says 172.21.15.133:37666) 2021-01-03T13:05:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f37fffff700 1 -- 172.21.15.133:0/3379342873 learned_addr learned my addr 172.21.15.133:0/3379342873 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f37ff7fe700 1 --2- 172.21.15.133:0/3379342873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38000b4980 0x7f38000b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:52.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f37feffd700 1 --2- 172.21.15.133:0/3379342873 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f38000b4e10 0x7f38000b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f37fffff700 1 -- 172.21.15.133:0/3379342873 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f38000b4e10 msgr2=0x7f38000b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f37fffff700 1 --2- 172.21.15.133:0/3379342873 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f38000b4e10 0x7f38000b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f37fffff700 1 -- 172.21.15.133:0/3379342873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38000b4980 msgr2=0x7f38000b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:52.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f37fffff700 1 --2- 172.21.15.133:0/3379342873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38000b4980 0x7f38000b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f37fffff700 1 -- 172.21.15.133:0/3379342873 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3800090cc0 con 0x7f38000b9b60 2021-01-03T13:05:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f37fffff700 1 --2- 172.21.15.133:0/3379342873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38000b9b60 0x7f3800154ec0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f37f800c000 tx=0x7f37f80091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f37fcff9700 1 -- 172.21.15.133:0/3379342873 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37f800c980 con 0x7f38000b9b60 2021-01-03T13:05:52.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f37fcff9700 1 -- 172.21.15.133:0/3379342873 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f800cae0 con 0x7f38000b9b60 2021-01-03T13:05:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f3804c85700 1 -- 172.21.15.133:0/3379342873 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3800146e30 con 0x7f38000b9b60 2021-01-03T13:05:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.781+0000 7f37fcff9700 1 -- 172.21.15.133:0/3379342873 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37f800ce40 con 0x7f38000b9b60 2021-01-03T13:05:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.785+0000 7f3804c85700 1 -- 172.21.15.133:0/3379342873 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3800091160 con 0x7f38000b9b60 2021-01-03T13:05:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.785+0000 7f3804c85700 1 -- 172.21.15.133:0/3379342873 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3800057300 con 0x7f38000b9b60 2021-01-03T13:05:52.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.785+0000 7f37fcff9700 1 -- 172.21.15.133:0/3379342873 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f37f8022070 con 0x7f38000b9b60 2021-01-03T13:05:52.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.785+0000 7f37fcff9700 1 --2- 172.21.15.133:0/3379342873 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f37e00553b0 0x7f37e0057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:52.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.785+0000 7f37fcff9700 1 -- 172.21.15.133:0/3379342873 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f37f806e480 con 0x7f38000b9b60 2021-01-03T13:05:52.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.785+0000 7f37ff7fe700 1 --2- 172.21.15.133:0/3379342873 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f37e00553b0 0x7f37e0057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:52.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.785+0000 7f37ff7fe700 1 --2- 172.21.15.133:0/3379342873 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f37e00553b0 0x7f37e0057870 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f37f001b000 tx=0x7f37f0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:52.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.793+0000 7f37fcff9700 1 -- 172.21.15.133:0/3379342873 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f37f80448e0 con 0x7f38000b9b60 2021-01-03T13:05:52.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:52.929+0000 7f3804c85700 1 -- 172.21.15.133:0/3379342873 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f38001556f0 con 0x7f38000b9b60 2021-01-03T13:05:53.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.645+0000 7f37fcff9700 1 -- 172.21.15.133:0/3379342873 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v105) v1 ==== 173+0+0 (secure 0 0 0) 0x7f37f8016020 con 0x7f38000b9b60 2021-01-03T13:05:53.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.649+0000 7f3804c85700 1 -- 172.21.15.133:0/3379342873 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f37e00553b0 msgr2=0x7f37e0057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:53.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.649+0000 7f3804c85700 1 --2- 172.21.15.133:0/3379342873 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f37e00553b0 0x7f37e0057870 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f37f001b000 tx=0x7f37f0015000).stop 2021-01-03T13:05:53.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.649+0000 7f3804c85700 1 -- 172.21.15.133:0/3379342873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38000b9b60 msgr2=0x7f3800154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:53.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.649+0000 7f3804c85700 1 --2- 172.21.15.133:0/3379342873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38000b9b60 0x7f3800154ec0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f37f800c000 tx=0x7f37f80091a0).stop 2021-01-03T13:05:53.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.649+0000 7f3804c85700 1 -- 172.21.15.133:0/3379342873 shutdown_connections 2021-01-03T13:05:53.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.649+0000 7f3804c85700 1 --2- 172.21.15.133:0/3379342873 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f37e00553b0 0x7f37e0057870 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:53.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.649+0000 7f3804c85700 1 --2- 172.21.15.133:0/3379342873 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f38000b4980 0x7f38000b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:53.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.649+0000 7f3804c85700 1 --2- 172.21.15.133:0/3379342873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38000b9b60 0x7f3800154ec0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:53.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.649+0000 7f3804c85700 1 --2- 172.21.15.133:0/3379342873 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f38000b4e10 0x7f38000b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:53.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.649+0000 7f3804c85700 1 -- 172.21.15.133:0/3379342873 >> 172.21.15.133:0/3379342873 conn(0x7f38000b69e0 msgr2=0x7f3800140cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:53.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.649+0000 7f3804c85700 1 -- 172.21.15.133:0/3379342873 shutdown_connections 2021-01-03T13:05:53.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.649+0000 7f3804c85700 1 -- 172.21.15.133:0/3379342873 wait complete. 2021-01-03T13:05:53.661 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2021-01-03T13:05:53.671 INFO:tasks.ceph.mds.a:Restarting daemon 2021-01-03T13:05:53.671 INFO:tasks.ceph.mds.a:Stopping old one... 2021-01-03T13:05:53.672 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-01-03T13:05:53.672 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:05:53.672 INFO:tasks.ceph.mds.c:Restarting daemon 2021-01-03T13:05:53.673 INFO:tasks.ceph.mds.c:Stopping old one... 2021-01-03T13:05:53.673 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-01-03T13:05:53.673 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:05:53.673 INFO:tasks.ceph.mds.b:Restarting daemon 2021-01-03T13:05:53.674 INFO:tasks.ceph.mds.b:Stopping old one... 2021-01-03T13:05:53.674 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-01-03T13:05:53.675 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:05:53.682 INFO:tasks.ceph.mds.a:Stopped 2021-01-03T13:05:53.683 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-01-03T13:05:53.685 INFO:tasks.ceph.mds.c:Stopped 2021-01-03T13:05:53.686 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-01-03T13:05:53.687 INFO:tasks.ceph.mds.b:Stopped 2021-01-03T13:05:53.688 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-01-03T13:05:53.729 INFO:tasks.ceph.mds.a:Started 2021-01-03T13:05:53.730 DEBUG:teuthology.parallel:result is None 2021-01-03T13:05:53.732 INFO:tasks.ceph.mds.c:Started 2021-01-03T13:05:53.732 DEBUG:teuthology.parallel:result is None 2021-01-03T13:05:53.733 INFO:tasks.ceph.mds.b:Started 2021-01-03T13:05:53.734 DEBUG:teuthology.parallel:result is None 2021-01-03T13:05:53.734 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-01-03T13:05:53.800 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T13:05:53.805 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T13:05:53.806 INFO:tasks.ceph.mds.b.smithi016.stdout:starting mds.b at 2021-01-03T13:05:53.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.845+0000 7f937b4d7700 1 Processor -- start 2021-01-03T13:05:53.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.845+0000 7f937b4d7700 1 -- start start 2021-01-03T13:05:53.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f937b4d7700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f93740b6d50 0x7f93740af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:53.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f937b4d7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93740afba0 0x7f937405fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:53.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f937b4d7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93740b7130 con 0x7f93740b16d0 2021-01-03T13:05:53.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f937b4d7700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93740b0690 con 0x7f93740b6d50 2021-01-03T13:05:53.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f937b4d7700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93740b0dc0 con 0x7f93740afba0 2021-01-03T13:05:53.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9378a72700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f93740b16d0 0x7f937405f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58728/0 (socket says 172.21.15.133:58728) 2021-01-03T13:05:53.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9378a72700 1 -- 172.21.15.133:0/2284425512 learned_addr learned my addr 172.21.15.133:0/2284425512 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:53.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9379273700 1 --2- 172.21.15.133:0/2284425512 >> v2:172.21.15.16:3300/0 conn(0x7f93740b6d50 0x7f93740af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9379a74700 1 --2- 172.21.15.133:0/2284425512 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93740afba0 0x7f937405fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 -- 172.21.15.133:0/2284425512 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355249694 0 0) 0x7f93740b7130 con 0x7f93740b16d0 2021-01-03T13:05:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 -- 172.21.15.133:0/2284425512 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f935c003230 con 0x7f93740b16d0 2021-01-03T13:05:53.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 -- 172.21.15.133:0/2284425512 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 282031920 0 0) 0x7f935c003230 con 0x7f93740b16d0 2021-01-03T13:05:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 -- 172.21.15.133:0/2284425512 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93740afba0 msgr2=0x7f937405fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 --2- 172.21.15.133:0/2284425512 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93740afba0 0x7f937405fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 -- 172.21.15.133:0/2284425512 >> v2:172.21.15.16:3300/0 conn(0x7f93740b6d50 msgr2=0x7f93740af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:53.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 --2- 172.21.15.133:0/2284425512 >> v2:172.21.15.16:3300/0 conn(0x7f93740b6d50 0x7f93740af6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 -- 172.21.15.133:0/2284425512 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93740b1060 con 0x7f93740b16d0 2021-01-03T13:05:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 -- 172.21.15.133:0/2284425512 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f93640016d0 con 0x7f93740b16d0 2021-01-03T13:05:53.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9379273700 1 --2- 172.21.15.133:0/2284425512 >> v2:172.21.15.16:3300/0 conn(0x7f93740b6d50 0x7f93740af6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 -- 172.21.15.133:0/2284425512 >> v1:172.21.15.133:6789/0 conn(0x7f93740b16d0 legacy=0x7f937405f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 --2- 172.21.15.133:0/2284425512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f935c003720 0x7f935c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 --2- 172.21.15.133:0/2284425512 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93740afba0 0x7f935c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:53.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 --2- 172.21.15.133:0/2284425512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f935c0049c0 0x7f935c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 -- 172.21.15.133:0/2284425512 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93740b0690 con 0x7f935c0049c0 2021-01-03T13:05:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 -- 172.21.15.133:0/2284425512 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93740b0dc0 con 0x7f935c003720 2021-01-03T13:05:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 -- 172.21.15.133:0/2284425512 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935c0041c0 con 0x7f93740afba0 2021-01-03T13:05:53.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9379273700 1 --2- 172.21.15.133:0/2284425512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f935c003720 0x7f935c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:53.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9379a74700 1 --2- 172.21.15.133:0/2284425512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f935c0049c0 0x7f935c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:53.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9378a72700 1 --2- 172.21.15.133:0/2284425512 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93740afba0 0x7f935c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:53.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9379273700 1 -- 172.21.15.133:0/2284425512 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93740afba0 msgr2=0x7f935c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:53.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9379273700 1 --2- 172.21.15.133:0/2284425512 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93740afba0 0x7f935c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:53.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9379273700 1 -- 172.21.15.133:0/2284425512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f935c0049c0 msgr2=0x7f935c004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:53.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9379273700 1 --2- 172.21.15.133:0/2284425512 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f935c0049c0 0x7f935c004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:53.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9379273700 1 -- 172.21.15.133:0/2284425512 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c003230 con 0x7f935c003720 2021-01-03T13:05:53.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9379273700 1 --2- 172.21.15.133:0/2284425512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f935c003720 0x7f935c003b40 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f937000c000 tx=0x7f9370008040).ready entity=mon.1 client_cookie=403e8971926a17ce server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:53.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 -- 172.21.15.133:0/2284425512 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f937000ec30 con 0x7f935c003720 2021-01-03T13:05:53.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 -- 172.21.15.133:0/2284425512 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937000ed90 con 0x7f935c003720 2021-01-03T13:05:53.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9363fff700 1 -- 172.21.15.133:0/2284425512 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93700125e0 con 0x7f935c003720 2021-01-03T13:05:53.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f937b4d7700 1 -- 172.21.15.133:0/2284425512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f935c003720 msgr2=0x7f935c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:53.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f937b4d7700 1 --2- 172.21.15.133:0/2284425512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f935c003720 0x7f935c003b40 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7f937000c000 tx=0x7f9370008040).stop 2021-01-03T13:05:53.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f9379a74700 1 -- 172.21.15.133:0/2284425512 reap_dead start 2021-01-03T13:05:53.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f937b4d7700 1 -- 172.21.15.133:0/2284425512 shutdown_connections 2021-01-03T13:05:53.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f937b4d7700 1 -- 172.21.15.133:0/2284425512 >> 172.21.15.133:0/2284425512 conn(0x7f93740622f0 msgr2=0x7f93740b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:53.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f937b4d7700 1 -- 172.21.15.133:0/2284425512 shutdown_connections 2021-01-03T13:05:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.849+0000 7f937b4d7700 1 -- 172.21.15.133:0/2284425512 wait complete. 2021-01-03T13:05:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f937b4d7700 1 Processor -- start 2021-01-03T13:05:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f937b4d7700 1 -- start start 2021-01-03T13:05:53.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f937b4d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9374142430 0x7f937413f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:53.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f937b4d7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93740b5ad0 0x7f937414dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:53.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f937b4d7700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f937414e140 0x7f93740672a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:53.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f937b4d7700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9374139770 con 0x7f937414e140 2021-01-03T13:05:53.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f937b4d7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9374142810 con 0x7f9374142430 2021-01-03T13:05:53.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f937b4d7700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9374139230 con 0x7f93740b5ad0 2021-01-03T13:05:53.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f9379273700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9374142430 0x7f937413f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:53.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f9379273700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9374142430 0x7f937413f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37706/0 (socket says 172.21.15.133:37706) 2021-01-03T13:05:53.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f9379273700 1 -- 172.21.15.133:0/3631897169 learned_addr learned my addr 172.21.15.133:0/3631897169 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:53.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f9378a72700 1 --2- 172.21.15.133:0/3631897169 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93740b5ad0 0x7f937414dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:53.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f9379a74700 1 --2- 172.21.15.133:0/3631897169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f937414e140 0x7f93740672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:53.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f9379273700 1 -- 172.21.15.133:0/3631897169 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93740b5ad0 msgr2=0x7f937414dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:53.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f9379273700 1 --2- 172.21.15.133:0/3631897169 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93740b5ad0 0x7f937414dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:53.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f9379273700 1 -- 172.21.15.133:0/3631897169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f937414e140 msgr2=0x7f93740672a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:53.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f9379273700 1 --2- 172.21.15.133:0/3631897169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f937414e140 0x7f93740672a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:53.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f9379273700 1 -- 172.21.15.133:0/3631897169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93741394d0 con 0x7f9374142430 2021-01-03T13:05:53.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f9379273700 1 --2- 172.21.15.133:0/3631897169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9374142430 0x7f937413f330 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f937414e540 tx=0x7f937001a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:53.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f93627fc700 1 -- 172.21.15.133:0/3631897169 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93700128c0 con 0x7f9374142430 2021-01-03T13:05:53.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f93627fc700 1 -- 172.21.15.133:0/3631897169 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9370012a20 con 0x7f9374142430 2021-01-03T13:05:53.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f937b4d7700 1 -- 172.21.15.133:0/3631897169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93740b4800 con 0x7f9374142430 2021-01-03T13:05:53.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f93627fc700 1 -- 172.21.15.133:0/3631897169 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9370012d80 con 0x7f9374142430 2021-01-03T13:05:53.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.853+0000 7f937b4d7700 1 -- 172.21.15.133:0/3631897169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9374063c90 con 0x7f9374142430 2021-01-03T13:05:53.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.857+0000 7f937b4d7700 1 -- 172.21.15.133:0/3631897169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9374057300 con 0x7f9374142430 2021-01-03T13:05:53.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.857+0000 7f93627fc700 1 -- 172.21.15.133:0/3631897169 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f937001a3b0 con 0x7f9374142430 2021-01-03T13:05:53.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.857+0000 7f93627fc700 1 --2- 172.21.15.133:0/3631897169 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f93540554e0 0x7f93540579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:53.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.857+0000 7f93627fc700 1 -- 172.21.15.133:0/3631897169 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f937006f4b0 con 0x7f9374142430 2021-01-03T13:05:53.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.857+0000 7f9378a72700 1 --2- 172.21.15.133:0/3631897169 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f93540554e0 0x7f93540579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:53.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.857+0000 7f9378a72700 1 --2- 172.21.15.133:0/3631897169 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f93540554e0 0x7f93540579a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f936400d000 tx=0x7f9364009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:53.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:53.861+0000 7f93627fc700 1 -- 172.21.15.133:0/3631897169 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9370045ae0 con 0x7f9374142430 2021-01-03T13:05:54.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.013+0000 7f937b4d7700 1 -- 172.21.15.133:0/3631897169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f937413f000 con 0x7f9374142430 2021-01-03T13:05:54.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.849+0000 7f93627fc700 1 -- 172.21.15.133:0/3631897169 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v107) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9370016020 con 0x7f9374142430 2021-01-03T13:05:54.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.853+0000 7f937b4d7700 1 -- 172.21.15.133:0/3631897169 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f93540554e0 msgr2=0x7f93540579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:54.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.853+0000 7f937b4d7700 1 --2- 172.21.15.133:0/3631897169 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f93540554e0 0x7f93540579a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f936400d000 tx=0x7f9364009040).stop 2021-01-03T13:05:54.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.853+0000 7f937b4d7700 1 -- 172.21.15.133:0/3631897169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9374142430 msgr2=0x7f937413f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:54.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.853+0000 7f937b4d7700 1 --2- 172.21.15.133:0/3631897169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9374142430 0x7f937413f330 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f937414e540 tx=0x7f937001a000).stop 2021-01-03T13:05:54.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.853+0000 7f937b4d7700 1 -- 172.21.15.133:0/3631897169 shutdown_connections 2021-01-03T13:05:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.853+0000 7f937b4d7700 1 --2- 172.21.15.133:0/3631897169 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f93540554e0 0x7f93540579a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:54.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.853+0000 7f937b4d7700 1 --2- 172.21.15.133:0/3631897169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f937414e140 0x7f93740672a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:54.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.853+0000 7f937b4d7700 1 --2- 172.21.15.133:0/3631897169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9374142430 0x7f937413f330 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:54.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.853+0000 7f937b4d7700 1 --2- 172.21.15.133:0/3631897169 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93740b5ad0 0x7f937414dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:54.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.853+0000 7f937b4d7700 1 -- 172.21.15.133:0/3631897169 >> 172.21.15.133:0/3631897169 conn(0x7f93740622f0 msgr2=0x7f93740b62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:54.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.853+0000 7f937b4d7700 1 -- 172.21.15.133:0/3631897169 shutdown_connections 2021-01-03T13:05:54.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.853+0000 7f937b4d7700 1 -- 172.21.15.133:0/3631897169 wait complete. 2021-01-03T13:05:54.865 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blacklist entries 2021-01-03T13:05:54.878 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-01-03T13:05:54.879 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-01-03T13:05:54.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef91c01700 1 Processor -- start 2021-01-03T13:05:54.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef91c01700 1 -- start start 2021-01-03T13:05:54.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef91c01700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef8c067350 0x7fef8c05fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:54.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef91c01700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fef8c0b2750 0x7fef8c144260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:54.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef91c01700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8c0afe70 con 0x7fef8c066f70 2021-01-03T13:05:54.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef91c01700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8c060310 con 0x7fef8c0b2750 2021-01-03T13:05:54.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef91c01700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8c0605a0 con 0x7fef8c067350 2021-01-03T13:05:54.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef90bff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fef8c066f70 0x7fef8c0af760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58746/0 (socket says 172.21.15.133:58746) 2021-01-03T13:05:54.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef90bff700 1 -- 172.21.15.133:0/651474966 learned_addr learned my addr 172.21.15.133:0/651474966 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:55.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef8bfff700 1 --2- 172.21.15.133:0/651474966 >> v2:172.21.15.133:3300/0 conn(0x7fef8c067350 0x7fef8c05fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:55.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef91400700 1 --2- 172.21.15.133:0/651474966 >> v2:172.21.15.16:3300/0 conn(0x7fef8c0b2750 0x7fef8c144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:55.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef8b7fe700 1 -- 172.21.15.133:0/651474966 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194273532 0 0) 0x7fef8c0afe70 con 0x7fef8c066f70 2021-01-03T13:05:55.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef8b7fe700 1 -- 172.21.15.133:0/651474966 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef70003230 con 0x7fef8c066f70 2021-01-03T13:05:55.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef8b7fe700 1 -- 172.21.15.133:0/651474966 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4117628319 0 0) 0x7fef70003230 con 0x7fef8c066f70 2021-01-03T13:05:55.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef8bfff700 1 -- 172.21.15.133:0/651474966 >> v2:172.21.15.16:3300/0 conn(0x7fef8c0b2750 msgr2=0x7fef8c144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:55.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef8bfff700 1 --2- 172.21.15.133:0/651474966 >> v2:172.21.15.16:3300/0 conn(0x7fef8c0b2750 0x7fef8c144260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef8bfff700 1 -- 172.21.15.133:0/651474966 >> v1:172.21.15.133:6789/0 conn(0x7fef8c066f70 legacy=0x7fef8c0af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef8bfff700 1 -- 172.21.15.133:0/651474966 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c0b0b50 con 0x7fef8c067350 2021-01-03T13:05:55.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef8bfff700 1 --2- 172.21.15.133:0/651474966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef8c067350 0x7fef8c05fe20 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7fef80001870 tx=0x7fef78006dc0).ready entity=mon.1 client_cookie=e0d890bbd0ad8178 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:55.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef8b7fe700 1 -- 172.21.15.133:0/651474966 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef800016d0 con 0x7fef8c067350 2021-01-03T13:05:55.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef8b7fe700 1 -- 172.21.15.133:0/651474966 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7800d5c0 con 0x7fef8c067350 2021-01-03T13:05:55.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef8b7fe700 1 -- 172.21.15.133:0/651474966 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef7800d730 con 0x7fef8c067350 2021-01-03T13:05:55.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef91c01700 1 -- 172.21.15.133:0/651474966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef8c067350 msgr2=0x7fef8c05fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.993+0000 7fef91c01700 1 --2- 172.21.15.133:0/651474966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef8c067350 0x7fef8c05fe20 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7fef80001870 tx=0x7fef78006dc0).stop 2021-01-03T13:05:55.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef91c01700 1 -- 172.21.15.133:0/651474966 shutdown_connections 2021-01-03T13:05:55.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef91c01700 1 --2- 172.21.15.133:0/651474966 >> v2:172.21.15.16:3300/0 conn(0x7fef8c0b2750 0x7fef8c144260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef91c01700 1 --2- 172.21.15.133:0/651474966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef8c067350 0x7fef8c05fe20 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef91c01700 1 -- 172.21.15.133:0/651474966 >> 172.21.15.133:0/651474966 conn(0x7fef8c0b6110 msgr2=0x7fef8c0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:55.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef91c01700 1 -- 172.21.15.133:0/651474966 shutdown_connections 2021-01-03T13:05:55.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef91c01700 1 -- 172.21.15.133:0/651474966 wait complete. 2021-01-03T13:05:55.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef91c01700 1 Processor -- start 2021-01-03T13:05:55.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef91c01700 1 -- start start 2021-01-03T13:05:55.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef91c01700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef8c066f70 0x7fef8c140980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:55.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef91c01700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef8c067350 0x7fef8c064b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:55.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef91c01700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef8c0b2750 0x7fef8c063870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:55.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef91c01700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c065b60 con 0x7fef8c066f70 2021-01-03T13:05:55.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef91c01700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c065ef0 con 0x7fef8c067350 2021-01-03T13:05:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef91c01700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c066480 con 0x7fef8c0b2750 2021-01-03T13:05:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef8bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef8c067350 0x7fef8c064b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef8bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef8c067350 0x7fef8c064b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37724/0 (socket says 172.21.15.133:37724) 2021-01-03T13:05:55.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef8bfff700 1 -- 172.21.15.133:0/2187356548 learned_addr learned my addr 172.21.15.133:0/2187356548 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:55.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef91400700 1 --2- 172.21.15.133:0/2187356548 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef8c0b2750 0x7fef8c063870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:55.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef90bff700 1 --2- 172.21.15.133:0/2187356548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef8c066f70 0x7fef8c140980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:55.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef8bfff700 1 -- 172.21.15.133:0/2187356548 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef8c0b2750 msgr2=0x7fef8c063870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:54.997+0000 7fef8bfff700 1 --2- 172.21.15.133:0/2187356548 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef8c0b2750 0x7fef8c063870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.001+0000 7fef8bfff700 1 -- 172.21.15.133:0/2187356548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef8c066f70 msgr2=0x7fef8c140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.001+0000 7fef8bfff700 1 --2- 172.21.15.133:0/2187356548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef8c066f70 0x7fef8c140980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.001+0000 7fef8bfff700 1 -- 172.21.15.133:0/2187356548 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c066120 con 0x7fef8c067350 2021-01-03T13:05:55.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.001+0000 7fef91400700 1 --2- 172.21.15.133:0/2187356548 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef8c0b2750 0x7fef8c063870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:55.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.001+0000 7fef8bfff700 1 --2- 172.21.15.133:0/2187356548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef8c067350 0x7fef8c064b60 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7fef80001870 tx=0x7fef78015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:55.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.001+0000 7fef89ffb700 1 -- 172.21.15.133:0/2187356548 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef78011900 con 0x7fef8c067350 2021-01-03T13:05:55.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.001+0000 7fef89ffb700 1 -- 172.21.15.133:0/2187356548 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef78011a60 con 0x7fef8c067350 2021-01-03T13:05:55.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.001+0000 7fef91c01700 1 -- 172.21.15.133:0/2187356548 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8c0655a0 con 0x7fef8c067350 2021-01-03T13:05:55.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.001+0000 7fef89ffb700 1 -- 172.21.15.133:0/2187356548 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef78011dc0 con 0x7fef8c067350 2021-01-03T13:05:55.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.001+0000 7fef91c01700 1 -- 172.21.15.133:0/2187356548 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8c146c80 con 0x7fef8c067350 2021-01-03T13:05:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.001+0000 7fef91c01700 1 -- 172.21.15.133:0/2187356548 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8c0665f0 con 0x7fef8c067350 2021-01-03T13:05:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.001+0000 7fef89ffb700 1 -- 172.21.15.133:0/2187356548 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fef78017030 con 0x7fef8c067350 2021-01-03T13:05:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.001+0000 7fef89ffb700 1 --2- 172.21.15.133:0/2187356548 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef740553b0 0x7fef74057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:55.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.001+0000 7fef89ffb700 1 -- 172.21.15.133:0/2187356548 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fef7806e750 con 0x7fef8c067350 2021-01-03T13:05:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.001+0000 7fef90bff700 1 --2- 172.21.15.133:0/2187356548 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef740553b0 0x7fef74057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.005+0000 7fef90bff700 1 --2- 172.21.15.133:0/2187356548 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef740553b0 0x7fef74057870 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fef8000d000 tx=0x7fef80000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:55.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.009+0000 7fef89ffb700 1 -- 172.21.15.133:0/2187356548 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fef8c0665f0 con 0x7fef8c067350 2021-01-03T13:05:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.193+0000 7fef91c01700 1 -- 172.21.15.133:0/2187356548 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fef8c0665f0 con 0x7fef8c067350 2021-01-03T13:05:55.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.193+0000 7fef89ffb700 1 -- 172.21.15.133:0/2187356548 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fef8c0665f0 con 0x7fef8c067350 2021-01-03T13:05:55.200 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:55.202 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:05:55.202 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2021-01-03T13:05:55.202 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:55.203 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2021-01-03T13:05:55.203 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Fflox9BxAA6coLDFV/FaQ/G/cvtonWgg==", 2021-01-03T13:05:55.203 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:55.204 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:05:55.204 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:55.205 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:55.206 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:55.206 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:55.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:55.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:55.207 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2021-01-03T13:05:55.207 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfrnWWFRAA3PHH/FJOvDozCChrb1T8Dg==", 2021-01-03T13:05:55.207 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:55.207 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:05:55.207 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:55.208 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:55.208 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:55.208 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:55.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:55.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:55.209 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2021-01-03T13:05:55.209 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfpPPLDxAAVvg80vLejYKDH485/L1gSQ==", 2021-01-03T13:05:55.209 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:55.209 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:05:55.209 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:55.210 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:55.210 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:55.210 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:55.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:55.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:55.211 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2021-01-03T13:05:55.213 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAnv/FfQ+CcDRAAUkTDLby5scMkNzxa0lVdAQ==", 2021-01-03T13:05:55.213 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:55.213 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:55.214 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:55.214 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:55.214 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:55.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:55.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:55.215 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2021-01-03T13:05:55.215 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApv/Ff1iilLhAAbK9hZmL772nNKAEJ4i+pkw==", 2021-01-03T13:05:55.215 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:55.215 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:55.215 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:55.216 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:55.216 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:55.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:55.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:55.216 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2021-01-03T13:05:55.217 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAsv/Ffmoe2FhAA1EbxU5yHncN+pbC/EX6d9A==", 2021-01-03T13:05:55.217 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:55.217 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:55.217 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:55.217 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:55.218 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:55.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:55.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:55.218 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2021-01-03T13:05:55.218 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAuv/FfJh/VORAAG9aCOh5s/2Lw+yN9hBFWLw==", 2021-01-03T13:05:55.219 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:55.220 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:55.220 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:55.220 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:55.221 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2021-01-03T13:05:55.222 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyv/Ffus0NJhAALX1TIqQ9EIupaX8KtRu7rQ==", 2021-01-03T13:05:55.222 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:55.222 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:55.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2021-01-03T13:05:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1v/FfoL6kDBAAggoRy/o0qas/41yLYqDVgA==", 2021-01-03T13:05:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:55.224 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:55.225 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:55.225 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:55.225 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:55.226 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2021-01-03T13:05:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA3v/FfwOPCMBAAGOt8ShPQ/szNbCfaP/uZEQ==", 2021-01-03T13:05:55.227 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:55.228 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:55.229 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:55.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2021-01-03T13:05:55.230 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA6v/Ffoz5xFxAAn3xvUDSeNSWrBJTa1Nsb6w==", 2021-01-03T13:05:55.231 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:55.231 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:55.232 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:55.233 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:55.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:55.234 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2021-01-03T13:05:55.234 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfyGlbGxAALm0NezvPiTAnlwu8iPEuCw==", 2021-01-03T13:05:55.234 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:55.235 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:05:55.235 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:05:55.235 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:05:55.236 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:55.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2021-01-03T13:05:55.237 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Ffa2AFHhAAD4Pq5zMJ28SqqEosBA9vnQ==", 2021-01-03T13:05:55.238 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:55.238 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:05:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:05:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:05:55.239 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:55.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:55.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2021-01-03T13:05:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjv/FfjxN8JxAAkV2Ia66fh21QYMX5fr1gTw==", 2021-01-03T13:05:55.241 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:55.242 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:05:55.242 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:05:55.243 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:05:55.243 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:55.243 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:55.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:55.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2021-01-03T13:05:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAU/DBBAASi+hx05pZEsP+dV9iwbz4g==", 2021-01-03T13:05:55.245 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:55.246 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:05:55.246 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:05:55.247 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:55.247 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:55.247 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2021-01-03T13:05:55.248 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAOFAAhAAPQOSkofyJoEYvcAqKK2+Mg==", 2021-01-03T13:05:55.249 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:05:55.249 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:05:55.250 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:05:55.250 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:05:55.250 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:55.251 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:55.251 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:05:55.252 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:05:55.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.193+0000 7fef91c01700 1 -- 172.21.15.133:0/2187356548 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef740553b0 msgr2=0x7fef74057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.193+0000 7fef91c01700 1 --2- 172.21.15.133:0/2187356548 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef740553b0 0x7fef74057870 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7fef8000d000 tx=0x7fef80000b80).stop 2021-01-03T13:05:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.193+0000 7fef91c01700 1 -- 172.21.15.133:0/2187356548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef8c067350 msgr2=0x7fef8c064b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.193+0000 7fef91c01700 1 --2- 172.21.15.133:0/2187356548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef8c067350 0x7fef8c064b60 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7fef80001870 tx=0x7fef78015000).stop 2021-01-03T13:05:55.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.193+0000 7fef91c01700 1 -- 172.21.15.133:0/2187356548 shutdown_connections 2021-01-03T13:05:55.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.193+0000 7fef91c01700 1 --2- 172.21.15.133:0/2187356548 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef740553b0 0x7fef74057870 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.193+0000 7fef91c01700 1 --2- 172.21.15.133:0/2187356548 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef8c066f70 0x7fef8c140980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.193+0000 7fef91c01700 1 --2- 172.21.15.133:0/2187356548 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef8c0b2750 0x7fef8c063870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.193+0000 7fef91c01700 1 --2- 172.21.15.133:0/2187356548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef8c067350 0x7fef8c064b60 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.193+0000 7fef91c01700 1 -- 172.21.15.133:0/2187356548 >> 172.21.15.133:0/2187356548 conn(0x7fef8c0b6110 msgr2=0x7fef8c0afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:55.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.197+0000 7fef91c01700 1 -- 172.21.15.133:0/2187356548 shutdown_connections 2021-01-03T13:05:55.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.197+0000 7fef91c01700 1 -- 172.21.15.133:0/2187356548 wait complete. 2021-01-03T13:05:55.263 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:05:55.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac6fa9700 1 Processor -- start 2021-01-03T13:05:55.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac6fa9700 1 -- start start 2021-01-03T13:05:55.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac6fa9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ac00b5c10 0x7f7ac00aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:55.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac6fa9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ac014aee0 0x7f7ac0144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:55.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac6fa9700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac0098550 con 0x7f7ac00b0670 2021-01-03T13:05:55.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac6fa9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac00b5ff0 con 0x7f7ac014aee0 2021-01-03T13:05:55.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac6fa9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac00b0b10 con 0x7f7ac00b5c10 2021-01-03T13:05:55.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac5546700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ac014aee0 0x7f7ac0144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:55.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac5546700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ac014aee0 0x7f7ac0144470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37732/0 (socket says 172.21.15.133:37732) 2021-01-03T13:05:55.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac5546700 1 -- 172.21.15.133:0/3131279995 learned_addr learned my addr 172.21.15.133:0/3131279995 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:55.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac4d45700 1 --2- 172.21.15.133:0/3131279995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ac00b5c10 0x7f7ac00aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:55.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac5546700 1 -- 172.21.15.133:0/3131279995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ac00b5c10 msgr2=0x7f7ac00aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:55.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac5546700 1 --2- 172.21.15.133:0/3131279995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ac00b5c10 0x7f7ac00aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac5546700 1 -- 172.21.15.133:0/3131279995 >> v1:172.21.15.16:6789/0 conn(0x7f7ac00b0670 legacy=0x7f7ac014a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac5546700 1 -- 172.21.15.133:0/3131279995 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac0098780 con 0x7f7ac014aee0 2021-01-03T13:05:55.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac5546700 1 --2- 172.21.15.133:0/3131279995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ac014aee0 0x7f7ac0144470 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f7ab8002f30 tx=0x7f7ab8006e80).ready entity=mon.1 client_cookie=b56202b795bb76c9 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:55.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7abf7fe700 1 -- 172.21.15.133:0/3131279995 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ab80097f0 con 0x7f7ac014aee0 2021-01-03T13:05:55.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7abf7fe700 1 -- 172.21.15.133:0/3131279995 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab8009950 con 0x7f7ac014aee0 2021-01-03T13:05:55.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7abf7fe700 1 -- 172.21.15.133:0/3131279995 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ab8009cb0 con 0x7f7ac014aee0 2021-01-03T13:05:55.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac6fa9700 1 -- 172.21.15.133:0/3131279995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ac014aee0 msgr2=0x7f7ac0144470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.381+0000 7f7ac6fa9700 1 --2- 172.21.15.133:0/3131279995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ac014aee0 0x7f7ac0144470 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f7ab8002f30 tx=0x7f7ab8006e80).stop 2021-01-03T13:05:55.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.385+0000 7f7ac6fa9700 1 -- 172.21.15.133:0/3131279995 shutdown_connections 2021-01-03T13:05:55.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.385+0000 7f7ac6fa9700 1 --2- 172.21.15.133:0/3131279995 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ac00b5c10 0x7f7ac00aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.385+0000 7f7ac6fa9700 1 --2- 172.21.15.133:0/3131279995 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ac014aee0 0x7f7ac0144470 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.385+0000 7f7ac6fa9700 1 -- 172.21.15.133:0/3131279995 >> 172.21.15.133:0/3131279995 conn(0x7f7ac005c8c0 msgr2=0x7f7ac00b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:55.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.385+0000 7f7ac6fa9700 1 -- 172.21.15.133:0/3131279995 shutdown_connections 2021-01-03T13:05:55.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.385+0000 7f7ac6fa9700 1 -- 172.21.15.133:0/3131279995 wait complete. 2021-01-03T13:05:55.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.385+0000 7f7ac6fa9700 1 Processor -- start 2021-01-03T13:05:55.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.385+0000 7f7ac6fa9700 1 -- start start 2021-01-03T13:05:55.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7ac6fa9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac00b0670 0x7f7ac00ada10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:55.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7ac6fa9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ac00b5c10 0x7f7ac0159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:55.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7ac6fa9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ac014aee0 0x7f7ac0159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7ac6fa9700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac00637d0 con 0x7f7ac00b0670 2021-01-03T13:05:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7ac6fa9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac01593d0 con 0x7f7ac00b5c10 2021-01-03T13:05:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7ac6fa9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac015a210 con 0x7f7ac014aee0 2021-01-03T13:05:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7abffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ac00b5c10 0x7f7ac0159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7abffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ac00b5c10 0x7f7ac0159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37734/0 (socket says 172.21.15.133:37734) 2021-01-03T13:05:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7abffff700 1 -- 172.21.15.133:0/2133796430 learned_addr learned my addr 172.21.15.133:0/2133796430 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:55.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7ac5546700 1 --2- 172.21.15.133:0/2133796430 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ac014aee0 0x7f7ac0159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:55.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7ac4d45700 1 --2- 172.21.15.133:0/2133796430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac00b0670 0x7f7ac00ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:55.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7abffff700 1 -- 172.21.15.133:0/2133796430 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ac014aee0 msgr2=0x7f7ac0159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7abffff700 1 --2- 172.21.15.133:0/2133796430 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ac014aee0 0x7f7ac0159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7abffff700 1 -- 172.21.15.133:0/2133796430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac00b0670 msgr2=0x7f7ac00ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7abffff700 1 --2- 172.21.15.133:0/2133796430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac00b0670 0x7f7ac00ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7abffff700 1 -- 172.21.15.133:0/2133796430 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac0063210 con 0x7f7ac00b5c10 2021-01-03T13:05:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7abffff700 1 --2- 172.21.15.133:0/2133796430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ac00b5c10 0x7f7ac0159830 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f7ac0066900 tx=0x7f7aa8007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7abdffb700 1 -- 172.21.15.133:0/2133796430 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aa80072a0 con 0x7f7ac00b5c10 2021-01-03T13:05:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7abdffb700 1 -- 172.21.15.133:0/2133796430 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa80064e0 con 0x7f7ac00b5c10 2021-01-03T13:05:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7ac6fa9700 1 -- 172.21.15.133:0/2133796430 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac0063a00 con 0x7f7ac00b5c10 2021-01-03T13:05:55.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7abdffb700 1 -- 172.21.15.133:0/2133796430 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7aa8006840 con 0x7f7ac00b5c10 2021-01-03T13:05:55.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.389+0000 7f7ac6fa9700 1 -- 172.21.15.133:0/2133796430 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac0155e80 con 0x7f7ac00b5c10 2021-01-03T13:05:55.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.393+0000 7f7abdffb700 1 -- 172.21.15.133:0/2133796430 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7aa8019020 con 0x7f7ac00b5c10 2021-01-03T13:05:55.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.393+0000 7f7ac6fa9700 1 -- 172.21.15.133:0/2133796430 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac0159540 con 0x7f7ac00b5c10 2021-01-03T13:05:55.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.393+0000 7f7abdffb700 1 --2- 172.21.15.133:0/2133796430 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7aa40554e0 0x7f7aa40579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:55.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.393+0000 7f7abdffb700 1 -- 172.21.15.133:0/2133796430 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7aa806d4f0 con 0x7f7ac00b5c10 2021-01-03T13:05:55.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.393+0000 7f7ac4d45700 1 --2- 172.21.15.133:0/2133796430 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7aa40554e0 0x7f7aa40579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:55.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.393+0000 7f7ac4d45700 1 --2- 172.21.15.133:0/2133796430 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7aa40554e0 0x7f7aa40579a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f7ab000b000 tx=0x7f7ab0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:55.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.397+0000 7f7abdffb700 1 -- 172.21.15.133:0/2133796430 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7aa8043a10 con 0x7f7ac00b5c10 2021-01-03T13:05:55.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.537+0000 7f7ac6fa9700 1 -- 172.21.15.133:0/2133796430 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ac0057300 con 0x7f7ac00b5c10 2021-01-03T13:05:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.537+0000 7f7abdffb700 1 -- 172.21.15.133:0/2133796430 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+13232 (secure 0 0 0) 0x7f7aa8047030 con 0x7f7ac00b5c10 2021-01-03T13:05:55.545 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:55.545 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":107,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:05:54.843183+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":100,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:05:55.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.541+0000 7f7ac6fa9700 1 -- 172.21.15.133:0/2133796430 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7aa40554e0 msgr2=0x7f7aa40579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.541+0000 7f7ac6fa9700 1 --2- 172.21.15.133:0/2133796430 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7aa40554e0 0x7f7aa40579a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f7ab000b000 tx=0x7f7ab0008040).stop 2021-01-03T13:05:55.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.541+0000 7f7ac6fa9700 1 -- 172.21.15.133:0/2133796430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ac00b5c10 msgr2=0x7f7ac0159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.541+0000 7f7ac6fa9700 1 --2- 172.21.15.133:0/2133796430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ac00b5c10 0x7f7ac0159830 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f7ac0066900 tx=0x7f7aa8007be0).stop 2021-01-03T13:05:55.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.541+0000 7f7ac6fa9700 1 -- 172.21.15.133:0/2133796430 shutdown_connections 2021-01-03T13:05:55.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.541+0000 7f7ac6fa9700 1 --2- 172.21.15.133:0/2133796430 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7aa40554e0 0x7f7aa40579a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.541+0000 7f7ac6fa9700 1 --2- 172.21.15.133:0/2133796430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ac00b0670 0x7f7ac00ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.541+0000 7f7ac6fa9700 1 --2- 172.21.15.133:0/2133796430 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7ac014aee0 0x7f7ac0159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.541+0000 7f7ac6fa9700 1 --2- 172.21.15.133:0/2133796430 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ac00b5c10 0x7f7ac0159830 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.541+0000 7f7ac6fa9700 1 -- 172.21.15.133:0/2133796430 >> 172.21.15.133:0/2133796430 conn(0x7f7ac005c8c0 msgr2=0x7f7ac014d880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:55.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.541+0000 7f7ac6fa9700 1 -- 172.21.15.133:0/2133796430 shutdown_connections 2021-01-03T13:05:55.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.541+0000 7f7ac6fa9700 1 -- 172.21.15.133:0/2133796430 wait complete. 2021-01-03T13:05:55.558 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-01-03T13:05:55.559 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:05:55.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.669+0000 7fbbb6045700 1 Processor -- start 2021-01-03T13:05:55.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.669+0000 7fbbb6045700 1 -- start start 2021-01-03T13:05:55.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb6045700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbbb00afa80 0x7fbbb00b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:55.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb6045700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb00aaa10 con 0x7fbbb0060890 2021-01-03T13:05:55.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb6045700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb00b0ab0 con 0x7fbbb00ae900 2021-01-03T13:05:55.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb6045700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb00ab280 con 0x7fbbb00afa80 2021-01-03T13:05:55.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb5844700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbbb00ae900 0x7fbbb00aed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58778/0 (socket says 172.21.15.133:58778) 2021-01-03T13:05:55.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb5844700 1 -- 172.21.15.133:0/973067223 learned_addr learned my addr 172.21.15.133:0/973067223 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:55.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb4842700 1 --2- 172.21.15.133:0/973067223 >> v2:172.21.15.16:3300/0 conn(0x7fbbb00afa80 0x7fbbb00b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:55.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbaffff700 1 -- 172.21.15.133:0/973067223 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3803921100 0 0) 0x7fbbb00b0ab0 con 0x7fbbb00ae900 2021-01-03T13:05:55.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbaffff700 1 -- 172.21.15.133:0/973067223 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb90003230 con 0x7fbbb00ae900 2021-01-03T13:05:55.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb4842700 1 -- 172.21.15.133:0/973067223 >> v1:172.21.15.133:6789/0 conn(0x7fbbb00ae900 legacy=0x7fbbb00aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb4842700 1 -- 172.21.15.133:0/973067223 >> v1:172.21.15.16:6789/0 conn(0x7fbbb0060890 legacy=0x7fbbb00abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb4842700 1 -- 172.21.15.133:0/973067223 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb00b1240 con 0x7fbbb00afa80 2021-01-03T13:05:55.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb4842700 1 --2- 172.21.15.133:0/973067223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb00afa80 0x7fbbb00b4f40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fbb980032b0 tx=0x7fbb980091a0).ready entity=mon.0 client_cookie=9cfb5f6a027f3f35 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:55.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbaffff700 1 -- 172.21.15.133:0/973067223 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb9800b9a0 con 0x7fbbb00afa80 2021-01-03T13:05:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbaffff700 1 -- 172.21.15.133:0/973067223 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9800bb00 con 0x7fbbb00afa80 2021-01-03T13:05:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb6045700 1 -- 172.21.15.133:0/973067223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb00afa80 msgr2=0x7fbbb00b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbaffff700 1 -- 172.21.15.133:0/973067223 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb9800bc70 con 0x7fbbb00afa80 2021-01-03T13:05:55.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb6045700 1 --2- 172.21.15.133:0/973067223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb00afa80 0x7fbbb00b4f40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fbb980032b0 tx=0x7fbb980091a0).stop 2021-01-03T13:05:55.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb6045700 1 -- 172.21.15.133:0/973067223 shutdown_connections 2021-01-03T13:05:55.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb6045700 1 --2- 172.21.15.133:0/973067223 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb00afa80 0x7fbbb00b4f40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb6045700 1 -- 172.21.15.133:0/973067223 >> 172.21.15.133:0/973067223 conn(0x7fbbb005bdf0 msgr2=0x7fbbb005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:55.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb6045700 1 -- 172.21.15.133:0/973067223 shutdown_connections 2021-01-03T13:05:55.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.673+0000 7fbbb6045700 1 -- 172.21.15.133:0/973067223 wait complete. 2021-01-03T13:05:55.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb6045700 1 Processor -- start 2021-01-03T13:05:55.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb6045700 1 -- start start 2021-01-03T13:05:55.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb6045700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb0060890 0x7fbbb005f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:55.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb6045700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb00ae900 0x7fbbb014f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:55.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb6045700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbbb00afa80 0x7fbbb0153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:55.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb6045700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb0066e00 con 0x7fbbb0060890 2021-01-03T13:05:55.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb6045700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb0152e50 con 0x7fbbb00ae900 2021-01-03T13:05:55.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb6045700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb01530f0 con 0x7fbbb00afa80 2021-01-03T13:05:55.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb4842700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb00ae900 0x7fbbb014f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:55.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb4842700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb00ae900 0x7fbbb014f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37750/0 (socket says 172.21.15.133:37750) 2021-01-03T13:05:55.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb4842700 1 -- 172.21.15.133:0/3714012974 learned_addr learned my addr 172.21.15.133:0/3714012974 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:55.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb5043700 1 --2- 172.21.15.133:0/3714012974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb0060890 0x7fbbb005f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:55.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb5844700 1 --2- 172.21.15.133:0/3714012974 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbbb00afa80 0x7fbbb0153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:55.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb4842700 1 -- 172.21.15.133:0/3714012974 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbbb00afa80 msgr2=0x7fbbb0153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb4842700 1 --2- 172.21.15.133:0/3714012974 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbbb00afa80 0x7fbbb0153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb4842700 1 -- 172.21.15.133:0/3714012974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb0060890 msgr2=0x7fbbb005f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb4842700 1 --2- 172.21.15.133:0/3714012974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb0060890 0x7fbbb005f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb4842700 1 -- 172.21.15.133:0/3714012974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb014fc70 con 0x7fbbb00ae900 2021-01-03T13:05:55.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb5043700 1 --2- 172.21.15.133:0/3714012974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb0060890 0x7fbbb005f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:55.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb5844700 1 --2- 172.21.15.133:0/3714012974 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbbb00afa80 0x7fbbb0153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:55.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb4842700 1 --2- 172.21.15.133:0/3714012974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb00ae900 0x7fbbb014f780 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fbb980032b0 tx=0x7fbb98016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:55.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbae7fc700 1 -- 172.21.15.133:0/3714012974 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb980107a0 con 0x7fbbb00ae900 2021-01-03T13:05:55.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbae7fc700 1 -- 172.21.15.133:0/3714012974 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb98010900 con 0x7fbbb00ae900 2021-01-03T13:05:55.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb6045700 1 -- 172.21.15.133:0/3714012974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb0093260 con 0x7fbbb00ae900 2021-01-03T13:05:55.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbae7fc700 1 -- 172.21.15.133:0/3714012974 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb98010c60 con 0x7fbbb00ae900 2021-01-03T13:05:55.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb6045700 1 -- 172.21.15.133:0/3714012974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb0066960 con 0x7fbbb00ae900 2021-01-03T13:05:55.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.677+0000 7fbbb6045700 1 -- 172.21.15.133:0/3714012974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb0067860 con 0x7fbbb00ae900 2021-01-03T13:05:55.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.681+0000 7fbbae7fc700 1 -- 172.21.15.133:0/3714012974 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fbb98027030 con 0x7fbbb00ae900 2021-01-03T13:05:55.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.681+0000 7fbbae7fc700 1 --2- 172.21.15.133:0/3714012974 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbb940553b0 0x7fbb94057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:55.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.681+0000 7fbbb5043700 1 --2- 172.21.15.133:0/3714012974 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbb940553b0 0x7fbb94057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:55.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.681+0000 7fbbae7fc700 1 -- 172.21.15.133:0/3714012974 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fbb9806ed00 con 0x7fbbb00ae900 2021-01-03T13:05:55.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.681+0000 7fbbb5043700 1 --2- 172.21.15.133:0/3714012974 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbb940553b0 0x7fbb94057870 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fbba0008000 tx=0x7fbba0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:55.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.685+0000 7fbbae7fc700 1 -- 172.21.15.133:0/3714012974 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbbb0067860 con 0x7fbbb00ae900 2021-01-03T13:05:55.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.833+0000 7fbbb6045700 1 -- 172.21.15.133:0/3714012974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbbb0067860 con 0x7fbbb00ae900 2021-01-03T13:05:55.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.833+0000 7fbbae7fc700 1 -- 172.21.15.133:0/3714012974 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v107) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbbb0067860 con 0x7fbbb00ae900 2021-01-03T13:05:55.838 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:05:55.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.833+0000 7fbbb6045700 1 -- 172.21.15.133:0/3714012974 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbb940553b0 msgr2=0x7fbb94057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.833+0000 7fbbb6045700 1 --2- 172.21.15.133:0/3714012974 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbb940553b0 0x7fbb94057870 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fbba0008000 tx=0x7fbba0009040).stop 2021-01-03T13:05:55.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.833+0000 7fbbb6045700 1 -- 172.21.15.133:0/3714012974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb00ae900 msgr2=0x7fbbb014f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:55.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.833+0000 7fbbb6045700 1 --2- 172.21.15.133:0/3714012974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb00ae900 0x7fbbb014f780 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fbb980032b0 tx=0x7fbb98016000).stop 2021-01-03T13:05:55.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.833+0000 7fbbb6045700 1 -- 172.21.15.133:0/3714012974 shutdown_connections 2021-01-03T13:05:55.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.833+0000 7fbbb6045700 1 --2- 172.21.15.133:0/3714012974 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbb940553b0 0x7fbb94057870 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.833+0000 7fbbb6045700 1 --2- 172.21.15.133:0/3714012974 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbbb0060890 0x7fbbb005f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.833+0000 7fbbb6045700 1 --2- 172.21.15.133:0/3714012974 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbbb00afa80 0x7fbbb0153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.833+0000 7fbbb6045700 1 --2- 172.21.15.133:0/3714012974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbbb00ae900 0x7fbbb014f780 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:55.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.833+0000 7fbbb6045700 1 -- 172.21.15.133:0/3714012974 >> 172.21.15.133:0/3714012974 conn(0x7fbbb005bdf0 msgr2=0x7fbbb0141cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:55.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.837+0000 7fbbb6045700 1 -- 172.21.15.133:0/3714012974 shutdown_connections 2021-01-03T13:05:55.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.837+0000 7fbbb6045700 1 -- 172.21.15.133:0/3714012974 wait complete. 2021-01-03T13:05:55.871 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:05:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fc5641700 1 Processor -- start 2021-01-03T13:05:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fc5641700 1 -- start start 2021-01-03T13:05:56.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fc5641700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3fc0140410 0x7f3fc0146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fc5641700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3fc01407f0 0x7f3fc0142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fc5641700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc005c500 con 0x7f3fc00b0470 2021-01-03T13:05:56.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fc5641700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc00b02d0 con 0x7f3fc01407f0 2021-01-03T13:05:56.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fc5641700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc0146390 con 0x7f3fc0140410 2021-01-03T13:05:56.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fbf7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3fc00b0470 0x7f3fc005bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58790/0 (socket says 172.21.15.133:58790) 2021-01-03T13:05:56.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fbeffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3fc0140410 0x7f3fc0146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fbf7fe700 1 -- 172.21.15.133:0/2506051114 learned_addr learned my addr 172.21.15.133:0/2506051114 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:56.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fbe7fc700 1 --2- 172.21.15.133:0/2506051114 >> v2:172.21.15.16:3300/0 conn(0x7f3fc01407f0 0x7f3fc0142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fbeffd700 1 -- 172.21.15.133:0/2506051114 >> v2:172.21.15.16:3300/0 conn(0x7f3fc01407f0 msgr2=0x7f3fc0142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:56.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fbeffd700 1 --2- 172.21.15.133:0/2506051114 >> v2:172.21.15.16:3300/0 conn(0x7f3fc01407f0 0x7f3fc0142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fbeffd700 1 -- 172.21.15.133:0/2506051114 >> v1:172.21.15.133:6789/0 conn(0x7f3fc00b0470 legacy=0x7f3fc005bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:56.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fbdffb700 1 -- 172.21.15.133:0/2506051114 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030635202 0 0) 0x7f3fc005c500 con 0x7f3fc00b0470 2021-01-03T13:05:56.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fbeffd700 1 -- 172.21.15.133:0/2506051114 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc005cf20 con 0x7f3fc0140410 2021-01-03T13:05:56.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fbe7fc700 1 --2- 172.21.15.133:0/2506051114 >> v2:172.21.15.16:3300/0 conn(0x7f3fc01407f0 0x7f3fc0142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:56.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fbeffd700 1 --2- 172.21.15.133:0/2506051114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc0140410 0x7f3fc0146cc0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f3fb0002f30 tx=0x7f3fb0006dc0).ready entity=mon.1 client_cookie=518c552de228838b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:56.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fbdffb700 1 -- 172.21.15.133:0/2506051114 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb00097f0 con 0x7f3fc0140410 2021-01-03T13:05:56.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fbdffb700 1 -- 172.21.15.133:0/2506051114 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb0009950 con 0x7f3fc0140410 2021-01-03T13:05:56.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fbdffb700 1 -- 172.21.15.133:0/2506051114 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb0009cb0 con 0x7f3fc0140410 2021-01-03T13:05:56.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fc5641700 1 -- 172.21.15.133:0/2506051114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc0140410 msgr2=0x7f3fc0146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:56.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fc5641700 1 --2- 172.21.15.133:0/2506051114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc0140410 0x7f3fc0146cc0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f3fb0002f30 tx=0x7f3fb0006dc0).stop 2021-01-03T13:05:56.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fc5641700 1 -- 172.21.15.133:0/2506051114 shutdown_connections 2021-01-03T13:05:56.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fc5641700 1 --2- 172.21.15.133:0/2506051114 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc0140410 0x7f3fc0146cc0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fc5641700 1 --2- 172.21.15.133:0/2506051114 >> v2:172.21.15.16:3300/0 conn(0x7f3fc01407f0 0x7f3fc0142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fc5641700 1 -- 172.21.15.133:0/2506051114 >> 172.21.15.133:0/2506051114 conn(0x7f3fc00b95d0 msgr2=0x7f3fc00b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:56.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fc5641700 1 -- 172.21.15.133:0/2506051114 shutdown_connections 2021-01-03T13:05:56.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.989+0000 7f3fc5641700 1 -- 172.21.15.133:0/2506051114 wait complete. 2021-01-03T13:05:56.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fc5641700 1 Processor -- start 2021-01-03T13:05:56.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fc5641700 1 -- start start 2021-01-03T13:05:56.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fc5641700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc00b0470 0x7f3fc0151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fc5641700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3fc0140410 0x7f3fc0141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fc5641700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fc01407f0 0x7f3fc0142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fc5641700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc01413f0 con 0x7f3fc01407f0 2021-01-03T13:05:56.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fc5641700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc009c190 con 0x7f3fc00b0470 2021-01-03T13:05:56.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fc5641700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc0141f20 con 0x7f3fc0140410 2021-01-03T13:05:56.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fbeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc00b0470 0x7f3fc0151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fbeffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc00b0470 0x7f3fc0151aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37762/0 (socket says 172.21.15.133:37762) 2021-01-03T13:05:56.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fbeffd700 1 -- 172.21.15.133:0/208546681 learned_addr learned my addr 172.21.15.133:0/208546681 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:56.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fbf7fe700 1 --2- 172.21.15.133:0/208546681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fc01407f0 0x7f3fc0142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fbe7fc700 1 --2- 172.21.15.133:0/208546681 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3fc0140410 0x7f3fc0141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fbeffd700 1 -- 172.21.15.133:0/208546681 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3fc0140410 msgr2=0x7f3fc0141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:56.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fbeffd700 1 --2- 172.21.15.133:0/208546681 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3fc0140410 0x7f3fc0141a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fbeffd700 1 -- 172.21.15.133:0/208546681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fc01407f0 msgr2=0x7f3fc0142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:56.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fbeffd700 1 --2- 172.21.15.133:0/208546681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fc01407f0 0x7f3fc0142b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fbeffd700 1 -- 172.21.15.133:0/208546681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc0149d60 con 0x7f3fc00b0470 2021-01-03T13:05:56.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.993+0000 7f3fbeffd700 1 --2- 172.21.15.133:0/208546681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc00b0470 0x7f3fc0151aa0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f3fb0002f30 tx=0x7f3fb0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:56.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.997+0000 7f3faffff700 1 -- 172.21.15.133:0/208546681 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb0011e30 con 0x7f3fc00b0470 2021-01-03T13:05:56.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.997+0000 7f3faffff700 1 -- 172.21.15.133:0/208546681 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb0009c50 con 0x7f3fc00b0470 2021-01-03T13:05:56.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.997+0000 7f3faffff700 1 -- 172.21.15.133:0/208546681 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fb001d640 con 0x7f3fc00b0470 2021-01-03T13:05:56.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.997+0000 7f3fc5641700 1 -- 172.21.15.133:0/208546681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc0140f80 con 0x7f3fc00b0470 2021-01-03T13:05:56.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.997+0000 7f3fc5641700 1 -- 172.21.15.133:0/208546681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc01432a0 con 0x7f3fc00b0470 2021-01-03T13:05:56.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.997+0000 7f3faffff700 1 -- 172.21.15.133:0/208546681 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3fb0024030 con 0x7f3fc00b0470 2021-01-03T13:05:56.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.997+0000 7f3fc5641700 1 -- 172.21.15.133:0/208546681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc0057300 con 0x7f3fc00b0470 2021-01-03T13:05:56.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.997+0000 7f3faffff700 1 --2- 172.21.15.133:0/208546681 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3f9c0553b0 0x7f3f9c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.997+0000 7f3faffff700 1 -- 172.21.15.133:0/208546681 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3fb006ef70 con 0x7f3fc00b0470 2021-01-03T13:05:56.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.997+0000 7f3fbe7fc700 1 --2- 172.21.15.133:0/208546681 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3f9c0553b0 0x7f3f9c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:55.997+0000 7f3fbe7fc700 1 --2- 172.21.15.133:0/208546681 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3f9c0553b0 0x7f3f9c057870 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f3fb400d000 tx=0x7f3fb4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:56.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.001+0000 7f3faffff700 1 -- 172.21.15.133:0/208546681 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3fb00455a0 con 0x7f3fc00b0470 2021-01-03T13:05:56.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.141+0000 7f3fc5641700 1 -- 172.21.15.133:0/208546681 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3fc005d270 con 0x7f3fc00b0470 2021-01-03T13:05:56.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.145+0000 7f3faffff700 1 -- 172.21.15.133:0/208546681 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v107) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3fb0022070 con 0x7f3fc00b0470 2021-01-03T13:05:56.149 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:05:56.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.145+0000 7f3fc5641700 1 -- 172.21.15.133:0/208546681 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3f9c0553b0 msgr2=0x7f3f9c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:56.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.145+0000 7f3fc5641700 1 --2- 172.21.15.133:0/208546681 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3f9c0553b0 0x7f3f9c057870 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f3fb400d000 tx=0x7f3fb4008040).stop 2021-01-03T13:05:56.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.145+0000 7f3fc5641700 1 -- 172.21.15.133:0/208546681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc00b0470 msgr2=0x7f3fc0151aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:56.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.145+0000 7f3fc5641700 1 --2- 172.21.15.133:0/208546681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc00b0470 0x7f3fc0151aa0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f3fb0002f30 tx=0x7f3fb0015000).stop 2021-01-03T13:05:56.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.145+0000 7f3fc5641700 1 -- 172.21.15.133:0/208546681 shutdown_connections 2021-01-03T13:05:56.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.145+0000 7f3fc5641700 1 --2- 172.21.15.133:0/208546681 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3f9c0553b0 0x7f3f9c057870 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.145+0000 7f3fc5641700 1 --2- 172.21.15.133:0/208546681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fc01407f0 0x7f3fc0142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.145+0000 7f3fc5641700 1 --2- 172.21.15.133:0/208546681 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3fc00b0470 0x7f3fc0151aa0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.145+0000 7f3fc5641700 1 --2- 172.21.15.133:0/208546681 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3fc0140410 0x7f3fc0141a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.145+0000 7f3fc5641700 1 -- 172.21.15.133:0/208546681 >> 172.21.15.133:0/208546681 conn(0x7f3fc00b95d0 msgr2=0x7f3fc00b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:56.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.145+0000 7f3fc5641700 1 -- 172.21.15.133:0/208546681 shutdown_connections 2021-01-03T13:05:56.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.145+0000 7f3fc5641700 1 -- 172.21.15.133:0/208546681 wait complete. 2021-01-03T13:05:56.170 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-01-03T13:05:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6cecf2a700 1 Processor -- start 2021-01-03T13:05:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6cecf2a700 1 -- start start 2021-01-03T13:05:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6cecf2a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6ce80b5c10 0x7f6ce80aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6cecf2a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6ce814aee0 0x7f6ce8144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6cecf2a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce8098550 con 0x7f6ce80b0670 2021-01-03T13:05:56.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6cecf2a700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce80b5ff0 con 0x7f6ce814aee0 2021-01-03T13:05:56.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6cecf2a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce80b0b10 con 0x7f6ce80b5c10 2021-01-03T13:05:56.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6ce659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6ce80b5c10 0x7f6ce80aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6ce5d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6ce80b0670 0x7f6ce814a7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58802/0 (socket says 172.21.15.133:58802) 2021-01-03T13:05:56.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6ce5d9b700 1 -- 172.21.15.133:0/827802620 learned_addr learned my addr 172.21.15.133:0/827802620 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:56.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6ce6d9d700 1 --2- 172.21.15.133:0/827802620 >> v2:172.21.15.16:3300/0 conn(0x7f6ce814aee0 0x7f6ce8144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6ce559a700 1 -- 172.21.15.133:0/827802620 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048012803 0 0) 0x7f6ce8098550 con 0x7f6ce80b0670 2021-01-03T13:05:56.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6ce559a700 1 -- 172.21.15.133:0/827802620 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ccc003230 con 0x7f6ce80b0670 2021-01-03T13:05:56.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6ce659c700 1 -- 172.21.15.133:0/827802620 >> v2:172.21.15.16:3300/0 conn(0x7f6ce814aee0 msgr2=0x7f6ce8144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:56.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6ce659c700 1 --2- 172.21.15.133:0/827802620 >> v2:172.21.15.16:3300/0 conn(0x7f6ce814aee0 0x7f6ce8144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6ce659c700 1 -- 172.21.15.133:0/827802620 >> v1:172.21.15.133:6789/0 conn(0x7f6ce80b0670 legacy=0x7f6ce814a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:56.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6ce659c700 1 -- 172.21.15.133:0/827802620 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce8098780 con 0x7f6ce80b5c10 2021-01-03T13:05:56.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6ce659c700 1 --2- 172.21.15.133:0/827802620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ce80b5c10 0x7f6ce80aae70 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f6cd8002f30 tx=0x7f6cd8006dc0).ready entity=mon.1 client_cookie=7b5edc4b3428171e server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:56.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6ce559a700 1 -- 172.21.15.133:0/827802620 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cd80097b0 con 0x7f6ce80b5c10 2021-01-03T13:05:56.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6ce559a700 1 -- 172.21.15.133:0/827802620 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd8009910 con 0x7f6ce80b5c10 2021-01-03T13:05:56.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6ce559a700 1 -- 172.21.15.133:0/827802620 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cd8009c70 con 0x7f6ce80b5c10 2021-01-03T13:05:56.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6cecf2a700 1 -- 172.21.15.133:0/827802620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ce80b5c10 msgr2=0x7f6ce80aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:56.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.277+0000 7f6cecf2a700 1 --2- 172.21.15.133:0/827802620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ce80b5c10 0x7f6ce80aae70 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f6cd8002f30 tx=0x7f6cd8006dc0).stop 2021-01-03T13:05:56.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.281+0000 7f6cecf2a700 1 -- 172.21.15.133:0/827802620 shutdown_connections 2021-01-03T13:05:56.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.281+0000 7f6cecf2a700 1 --2- 172.21.15.133:0/827802620 >> v2:172.21.15.16:3300/0 conn(0x7f6ce814aee0 0x7f6ce8144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.281+0000 7f6cecf2a700 1 --2- 172.21.15.133:0/827802620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ce80b5c10 0x7f6ce80aae70 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.281+0000 7f6cecf2a700 1 -- 172.21.15.133:0/827802620 >> 172.21.15.133:0/827802620 conn(0x7f6ce805c8c0 msgr2=0x7f6ce80b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:56.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.281+0000 7f6cecf2a700 1 -- 172.21.15.133:0/827802620 shutdown_connections 2021-01-03T13:05:56.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.281+0000 7f6cecf2a700 1 -- 172.21.15.133:0/827802620 wait complete. 2021-01-03T13:05:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.281+0000 7f6cecf2a700 1 Processor -- start 2021-01-03T13:05:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.281+0000 7f6cecf2a700 1 -- start start 2021-01-03T13:05:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.281+0000 7f6cecf2a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ce80b0670 0x7f6ce8146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.281+0000 7f6cecf2a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6ce80b5c10 0x7f6ce81592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.281+0000 7f6cecf2a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ce814aee0 0x7f6ce814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.281+0000 7f6cecf2a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80ad5d0 con 0x7f6ce814aee0 2021-01-03T13:05:56.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.281+0000 7f6cecf2a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce814da00 con 0x7f6ce80b0670 2021-01-03T13:05:56.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.281+0000 7f6cecf2a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80ad800 con 0x7f6ce80b5c10 2021-01-03T13:05:56.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.281+0000 7f6ce659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ce80b0670 0x7f6ce8146710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.281+0000 7f6ce659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ce80b0670 0x7f6ce8146710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37776/0 (socket says 172.21.15.133:37776) 2021-01-03T13:05:56.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.281+0000 7f6ce659c700 1 -- 172.21.15.133:0/1858348016 learned_addr learned my addr 172.21.15.133:0/1858348016 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:56.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6ce5d9b700 1 --2- 172.21.15.133:0/1858348016 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6ce80b5c10 0x7f6ce81592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6ce6d9d700 1 --2- 172.21.15.133:0/1858348016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ce814aee0 0x7f6ce814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6ce659c700 1 -- 172.21.15.133:0/1858348016 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6ce80b5c10 msgr2=0x7f6ce81592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:56.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6ce659c700 1 --2- 172.21.15.133:0/1858348016 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6ce80b5c10 0x7f6ce81592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6ce659c700 1 -- 172.21.15.133:0/1858348016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ce814aee0 msgr2=0x7f6ce814e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:56.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6ce659c700 1 --2- 172.21.15.133:0/1858348016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ce814aee0 0x7f6ce814e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6ce659c700 1 -- 172.21.15.133:0/1858348016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce80adaa0 con 0x7f6ce80b0670 2021-01-03T13:05:56.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6ce6d9d700 1 --2- 172.21.15.133:0/1858348016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ce814aee0 0x7f6ce814e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:56.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6ce659c700 1 --2- 172.21.15.133:0/1858348016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ce80b0670 0x7f6ce8146710 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f6cd8002f30 tx=0x7f6cd8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:56.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6cdf7fe700 1 -- 172.21.15.133:0/1858348016 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cd8011a50 con 0x7f6ce80b0670 2021-01-03T13:05:56.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6cdf7fe700 1 -- 172.21.15.133:0/1858348016 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd8011bb0 con 0x7f6ce80b0670 2021-01-03T13:05:56.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6cdf7fe700 1 -- 172.21.15.133:0/1858348016 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6cd801d440 con 0x7f6ce80b0670 2021-01-03T13:05:56.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6cecf2a700 1 -- 172.21.15.133:0/1858348016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce814dc50 con 0x7f6ce80b0670 2021-01-03T13:05:56.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6cecf2a700 1 -- 172.21.15.133:0/1858348016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce814a400 con 0x7f6ce80b0670 2021-01-03T13:05:56.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6cdf7fe700 1 -- 172.21.15.133:0/1858348016 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6cd8017070 con 0x7f6ce80b0670 2021-01-03T13:05:56.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6cecf2a700 1 -- 172.21.15.133:0/1858348016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce8057300 con 0x7f6ce80b0670 2021-01-03T13:05:56.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6cdf7fe700 1 --2- 172.21.15.133:0/1858348016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6cc00553b0 0x7f6cc0057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6cdf7fe700 1 -- 172.21.15.133:0/1858348016 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6cd806e7c0 con 0x7f6ce80b0670 2021-01-03T13:05:56.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.285+0000 7f6ce5d9b700 1 --2- 172.21.15.133:0/1858348016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6cc00553b0 0x7f6cc0057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.289+0000 7f6ce5d9b700 1 --2- 172.21.15.133:0/1858348016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6cc00553b0 0x7f6cc0057870 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f6cd000d000 tx=0x7f6cd0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:56.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.293+0000 7f6cdf7fe700 1 -- 172.21.15.133:0/1858348016 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6cd8044df0 con 0x7f6ce80b0670 2021-01-03T13:05:56.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.433+0000 7f6cecf2a700 1 -- 172.21.15.133:0/1858348016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6ce805ce00 con 0x7f6ce80b0670 2021-01-03T13:05:56.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.433+0000 7f6cdf7fe700 1 -- 172.21.15.133:0/1858348016 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v107) v1 ==== 84+0+143 (secure 0 0 0) 0x7f6cd8022070 con 0x7f6ce80b0670 2021-01-03T13:05:56.438 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:56.439 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2021-01-03T13:05:56.439 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:56.439 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2021-01-03T13:05:56.439 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2021-01-03T13:05:56.440 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:05:56.440 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:05:56.440 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2021-01-03T13:05:56.441 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2021-01-03T13:05:56.441 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:05:56.441 INFO:teuthology.orchestra.run.smithi133.stdout:] 2021-01-03T13:05:56.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.433+0000 7f6cecf2a700 1 -- 172.21.15.133:0/1858348016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6cc00553b0 msgr2=0x7f6cc0057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.433+0000 7f6cecf2a700 1 --2- 172.21.15.133:0/1858348016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6cc00553b0 0x7f6cc0057870 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f6cd000d000 tx=0x7f6cd0009040).stop 2021-01-03T13:05:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.433+0000 7f6cecf2a700 1 -- 172.21.15.133:0/1858348016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ce80b0670 msgr2=0x7f6ce8146710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:56.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.433+0000 7f6cecf2a700 1 --2- 172.21.15.133:0/1858348016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ce80b0670 0x7f6ce8146710 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f6cd8002f30 tx=0x7f6cd8015000).stop 2021-01-03T13:05:56.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.433+0000 7f6cecf2a700 1 -- 172.21.15.133:0/1858348016 shutdown_connections 2021-01-03T13:05:56.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.433+0000 7f6cecf2a700 1 --2- 172.21.15.133:0/1858348016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6cc00553b0 0x7f6cc0057870 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.433+0000 7f6cecf2a700 1 --2- 172.21.15.133:0/1858348016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ce814aee0 0x7f6ce814e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.433+0000 7f6cecf2a700 1 --2- 172.21.15.133:0/1858348016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6ce80b0670 0x7f6ce8146710 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.433+0000 7f6cecf2a700 1 --2- 172.21.15.133:0/1858348016 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6ce80b5c10 0x7f6ce81592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.433+0000 7f6cecf2a700 1 -- 172.21.15.133:0/1858348016 >> 172.21.15.133:0/1858348016 conn(0x7f6ce805c8c0 msgr2=0x7f6ce80ab0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:56.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.433+0000 7f6cecf2a700 1 -- 172.21.15.133:0/1858348016 shutdown_connections 2021-01-03T13:05:56.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.433+0000 7f6cecf2a700 1 -- 172.21.15.133:0/1858348016 wait complete. 2021-01-03T13:05:56.457 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-01-03T13:05:56.458 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-01-03T13:05:56.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc9a0e700 1 Processor -- start 2021-01-03T13:05:56.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc9a0e700 1 -- start start 2021-01-03T13:05:56.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc9a0e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1bc40b5c00 0x7f1bc41477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc9a0e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc40b0c10 con 0x7f1bc41442a0 2021-01-03T13:05:56.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc9a0e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc40b5640 con 0x7f1bc40b5260 2021-01-03T13:05:56.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc9a0e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc4144e00 con 0x7f1bc40b5c00 2021-01-03T13:05:56.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc8a0c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1bc40b5260 0x7f1bc41470b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58816/0 (socket says 172.21.15.133:58816) 2021-01-03T13:05:56.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc8a0c700 1 -- 172.21.15.133:0/3835226150 learned_addr learned my addr 172.21.15.133:0/3835226150 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:56.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc3fff700 1 --2- 172.21.15.133:0/3835226150 >> v2:172.21.15.16:3300/0 conn(0x7f1bc40b5c00 0x7f1bc41477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc37fe700 1 -- 172.21.15.133:0/3835226150 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626070769 0 0) 0x7f1bc40b5640 con 0x7f1bc40b5260 2021-01-03T13:05:56.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc37fe700 1 -- 172.21.15.133:0/3835226150 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ba8003230 con 0x7f1bc40b5260 2021-01-03T13:05:56.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc37fe700 1 -- 172.21.15.133:0/3835226150 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584942329 0 0) 0x7f1bc40b0c10 con 0x7f1bc41442a0 2021-01-03T13:05:56.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc37fe700 1 -- 172.21.15.133:0/3835226150 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bc40b5640 con 0x7f1bc41442a0 2021-01-03T13:05:56.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc37fe700 1 -- 172.21.15.133:0/3835226150 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 211961985 0 0) 0x7f1ba8003230 con 0x7f1bc40b5260 2021-01-03T13:05:56.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc37fe700 1 -- 172.21.15.133:0/3835226150 >> v2:172.21.15.16:3300/0 conn(0x7f1bc40b5c00 msgr2=0x7f1bc41477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:56.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc37fe700 1 --2- 172.21.15.133:0/3835226150 >> v2:172.21.15.16:3300/0 conn(0x7f1bc40b5c00 0x7f1bc41477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc37fe700 1 -- 172.21.15.133:0/3835226150 >> v1:172.21.15.16:6789/0 conn(0x7f1bc41442a0 legacy=0x7f1bc41446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:56.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc37fe700 1 -- 172.21.15.133:0/3835226150 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc409a4f0 con 0x7f1bc40b5260 2021-01-03T13:05:56.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc37fe700 1 -- 172.21.15.133:0/3835226150 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f1bb8001710 con 0x7f1bc40b5260 2021-01-03T13:05:56.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc3fff700 1 --2- 172.21.15.133:0/3835226150 >> v2:172.21.15.16:3300/0 conn(0x7f1bc40b5c00 0x7f1bc41477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:56.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc37fe700 1 -- 172.21.15.133:0/3835226150 >> v1:172.21.15.133:6789/0 conn(0x7f1bc40b5260 legacy=0x7f1bc41470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:56.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc37fe700 1 --2- 172.21.15.133:0/3835226150 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ba8003900 0x7f1ba8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc37fe700 1 --2- 172.21.15.133:0/3835226150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ba80044d0 0x7f1ba8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc37fe700 1 --2- 172.21.15.133:0/3835226150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ba8004e40 0x7f1ba800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc37fe700 1 -- 172.21.15.133:0/3835226150 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba800bc10 con 0x7f1ba80044d0 2021-01-03T13:05:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc37fe700 1 -- 172.21.15.133:0/3835226150 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba800bd50 con 0x7f1ba8004e40 2021-01-03T13:05:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.573+0000 7f1bc37fe700 1 -- 172.21.15.133:0/3835226150 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba800be90 con 0x7f1ba8003900 2021-01-03T13:05:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc920d700 1 --2- 172.21.15.133:0/3835226150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ba8004e40 0x7f1ba800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc8a0c700 1 --2- 172.21.15.133:0/3835226150 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ba8003900 0x7f1ba8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc3fff700 1 --2- 172.21.15.133:0/3835226150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ba80044d0 0x7f1ba8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc920d700 1 -- 172.21.15.133:0/3835226150 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ba8003900 msgr2=0x7f1ba8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc920d700 1 --2- 172.21.15.133:0/3835226150 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ba8003900 0x7f1ba8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc920d700 1 -- 172.21.15.133:0/3835226150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ba80044d0 msgr2=0x7f1ba8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc920d700 1 --2- 172.21.15.133:0/3835226150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ba80044d0 0x7f1ba8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc920d700 1 -- 172.21.15.133:0/3835226150 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba8003230 con 0x7f1ba8004e40 2021-01-03T13:05:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc920d700 1 -- 172.21.15.133:0/3835226150 reap_dead start 2021-01-03T13:05:56.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc920d700 1 --2- 172.21.15.133:0/3835226150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ba8004e40 0x7f1ba800b720 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f1bbc001450 tx=0x7f1bbc007ee0).ready entity=mon.1 client_cookie=3588f9e09176d69b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:56.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc37fe700 1 -- 172.21.15.133:0/3835226150 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bbc00cc00 con 0x7f1ba8004e40 2021-01-03T13:05:56.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc37fe700 1 -- 172.21.15.133:0/3835226150 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc00cd60 con 0x7f1ba8004e40 2021-01-03T13:05:56.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc37fe700 1 -- 172.21.15.133:0/3835226150 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bbc0125f0 con 0x7f1ba8004e40 2021-01-03T13:05:56.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc9a0e700 1 -- 172.21.15.133:0/3835226150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ba8004e40 msgr2=0x7f1ba800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:56.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc9a0e700 1 --2- 172.21.15.133:0/3835226150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ba8004e40 0x7f1ba800b720 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f1bbc001450 tx=0x7f1bbc007ee0).stop 2021-01-03T13:05:56.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc9a0e700 1 -- 172.21.15.133:0/3835226150 shutdown_connections 2021-01-03T13:05:56.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc9a0e700 1 --2- 172.21.15.133:0/3835226150 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ba8004e40 0x7f1ba800b720 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc9a0e700 1 -- 172.21.15.133:0/3835226150 >> 172.21.15.133:0/3835226150 conn(0x7f1bc405bdf0 msgr2=0x7f1bc405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:56.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc9a0e700 1 -- 172.21.15.133:0/3835226150 shutdown_connections 2021-01-03T13:05:56.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc9a0e700 1 -- 172.21.15.133:0/3835226150 wait complete. 2021-01-03T13:05:56.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc9a0e700 1 Processor -- start 2021-01-03T13:05:56.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.577+0000 7f1bc9a0e700 1 -- start start 2021-01-03T13:05:56.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc9a0e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ba8004e40 0x7f1bc4067140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc9a0e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bc40ad0f0 0x7f1bc41563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc9a0e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc40ac5d0 0x7f1bc4159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc9a0e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc4155a90 con 0x7f1bc40ad0f0 2021-01-03T13:05:56.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc9a0e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc40ad600 con 0x7f1bc40ac5d0 2021-01-03T13:05:56.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc9a0e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc4155c80 con 0x7f1ba8004e40 2021-01-03T13:05:56.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc920d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc40ac5d0 0x7f1bc4159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc920d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc40ac5d0 0x7f1bc4159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37800/0 (socket says 172.21.15.133:37800) 2021-01-03T13:05:56.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc920d700 1 -- 172.21.15.133:0/1539153624 learned_addr learned my addr 172.21.15.133:0/1539153624 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:56.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc8a0c700 1 --2- 172.21.15.133:0/1539153624 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ba8004e40 0x7f1bc4067140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc3fff700 1 --2- 172.21.15.133:0/1539153624 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bc40ad0f0 0x7f1bc41563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc920d700 1 -- 172.21.15.133:0/1539153624 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ba8004e40 msgr2=0x7f1bc4067140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:56.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc920d700 1 --2- 172.21.15.133:0/1539153624 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ba8004e40 0x7f1bc4067140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc920d700 1 -- 172.21.15.133:0/1539153624 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bc40ad0f0 msgr2=0x7f1bc41563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:56.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc920d700 1 --2- 172.21.15.133:0/1539153624 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bc40ad0f0 0x7f1bc41563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:56.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc920d700 1 -- 172.21.15.133:0/1539153624 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc4155f20 con 0x7f1bc40ac5d0 2021-01-03T13:05:56.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc3fff700 1 --2- 172.21.15.133:0/1539153624 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bc40ad0f0 0x7f1bc41563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:05:56.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc920d700 1 --2- 172.21.15.133:0/1539153624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc40ac5d0 0x7f1bc4159060 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f1bbc001450 tx=0x7f1bbc017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:56.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc1ffb700 1 -- 172.21.15.133:0/1539153624 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bbc007610 con 0x7f1bc40ac5d0 2021-01-03T13:05:56.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc1ffb700 1 -- 172.21.15.133:0/1539153624 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc007770 con 0x7f1bc40ac5d0 2021-01-03T13:05:56.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc1ffb700 1 -- 172.21.15.133:0/1539153624 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bbc01c630 con 0x7f1bc40ac5d0 2021-01-03T13:05:56.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc9a0e700 1 -- 172.21.15.133:0/1539153624 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc4067630 con 0x7f1bc40ac5d0 2021-01-03T13:05:56.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc9a0e700 1 -- 172.21.15.133:0/1539153624 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc41568b0 con 0x7f1bc40ac5d0 2021-01-03T13:05:56.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc9a0e700 1 -- 172.21.15.133:0/1539153624 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc40ad7c0 con 0x7f1bc40ac5d0 2021-01-03T13:05:56.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.581+0000 7f1bc1ffb700 1 -- 172.21.15.133:0/1539153624 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1bbc023030 con 0x7f1bc40ac5d0 2021-01-03T13:05:56.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.585+0000 7f1bc1ffb700 1 --2- 172.21.15.133:0/1539153624 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bac0553f0 0x7f1bac0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:56.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.585+0000 7f1bc1ffb700 1 -- 172.21.15.133:0/1539153624 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1bbc06e9b0 con 0x7f1bc40ac5d0 2021-01-03T13:05:56.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.585+0000 7f1bc8a0c700 1 --2- 172.21.15.133:0/1539153624 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bac0553f0 0x7f1bac0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:56.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.585+0000 7f1bc8a0c700 1 --2- 172.21.15.133:0/1539153624 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bac0553f0 0x7f1bac0578b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f1bb800d000 tx=0x7f1bb8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:56.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.589+0000 7f1bc1ffb700 1 -- 172.21.15.133:0/1539153624 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1bbc044fe0 con 0x7f1bc40ac5d0 2021-01-03T13:05:56.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:56.733+0000 7f1bc9a0e700 1 -- 172.21.15.133:0/1539153624 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f1bc41560b0 con 0x7f1bc40ac5d0 2021-01-03T13:05:57.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.677+0000 7f1bc1ffb700 1 -- 172.21.15.133:0/1539153624 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v108) v1 ==== 133+0+0 (secure 0 0 0) 0x7f1bbc048600 con 0x7f1bc40ac5d0 2021-01-03T13:05:57.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.681+0000 7f1bc9a0e700 1 -- 172.21.15.133:0/1539153624 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bac0553f0 msgr2=0x7f1bac0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:57.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.681+0000 7f1bc9a0e700 1 --2- 172.21.15.133:0/1539153624 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bac0553f0 0x7f1bac0578b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f1bb800d000 tx=0x7f1bb8009040).stop 2021-01-03T13:05:57.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.681+0000 7f1bc9a0e700 1 -- 172.21.15.133:0/1539153624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc40ac5d0 msgr2=0x7f1bc4159060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:57.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.681+0000 7f1bc9a0e700 1 --2- 172.21.15.133:0/1539153624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc40ac5d0 0x7f1bc4159060 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f1bbc001450 tx=0x7f1bbc017000).stop 2021-01-03T13:05:57.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.681+0000 7f1bc9a0e700 1 -- 172.21.15.133:0/1539153624 shutdown_connections 2021-01-03T13:05:57.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.681+0000 7f1bc9a0e700 1 --2- 172.21.15.133:0/1539153624 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1bac0553f0 0x7f1bac0578b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:57.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.681+0000 7f1bc9a0e700 1 --2- 172.21.15.133:0/1539153624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1bc40ac5d0 0x7f1bc4159060 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:57.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.681+0000 7f1bc9a0e700 1 --2- 172.21.15.133:0/1539153624 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ba8004e40 0x7f1bc4067140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:57.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.681+0000 7f1bc9a0e700 1 --2- 172.21.15.133:0/1539153624 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1bc40ad0f0 0x7f1bc41563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:57.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.681+0000 7f1bc9a0e700 1 -- 172.21.15.133:0/1539153624 >> 172.21.15.133:0/1539153624 conn(0x7f1bc405bdf0 msgr2=0x7f1bc40b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:57.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.681+0000 7f1bc9a0e700 1 -- 172.21.15.133:0/1539153624 shutdown_connections 2021-01-03T13:05:57.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.681+0000 7f1bc9a0e700 1 -- 172.21.15.133:0/1539153624 wait complete. 2021-01-03T13:05:57.687 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2021-01-03T13:05:57.700 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-01-03T13:05:57.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.821+0000 7f4945ad9700 1 Processor -- start 2021-01-03T13:05:57.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.821+0000 7f4945ad9700 1 -- start start 2021-01-03T13:05:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.821+0000 7f4945ad9700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f49400b0a60 0x7f49400a9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:57.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.821+0000 7f4945ad9700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49400b16a0 con 0x7f49400a8850 2021-01-03T13:05:57.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.821+0000 7f4945ad9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49400b2840 con 0x7f49400b2460 2021-01-03T13:05:57.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.821+0000 7f4945ad9700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49400aeae0 con 0x7f49400b0a60 2021-01-03T13:05:57.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.821+0000 7f4944ad7700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f49400b2460 0x7f49400ad490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58836/0 (socket says 172.21.15.133:58836) 2021-01-03T13:05:57.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.821+0000 7f4944ad7700 1 -- 172.21.15.133:0/2544993734 learned_addr learned my addr 172.21.15.133:0/2544993734 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:57.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.821+0000 7f493ffff700 1 --2- 172.21.15.133:0/2544993734 >> v2:172.21.15.16:3300/0 conn(0x7f49400b0a60 0x7f49400a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:57.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.821+0000 7f493f7fe700 1 -- 172.21.15.133:0/2544993734 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900525217 0 0) 0x7f49400b16a0 con 0x7f49400a8850 2021-01-03T13:05:57.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.821+0000 7f493f7fe700 1 -- 172.21.15.133:0/2544993734 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4924003230 con 0x7f49400a8850 2021-01-03T13:05:57.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.825+0000 7f493ffff700 1 -- 172.21.15.133:0/2544993734 >> v1:172.21.15.133:6789/0 conn(0x7f49400b2460 legacy=0x7f49400ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:57.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.825+0000 7f493ffff700 1 -- 172.21.15.133:0/2544993734 >> v1:172.21.15.16:6789/0 conn(0x7f49400a8850 legacy=0x7f49400a8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:57.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.825+0000 7f493ffff700 1 -- 172.21.15.133:0/2544993734 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49400b1160 con 0x7f49400b0a60 2021-01-03T13:05:57.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.825+0000 7f493ffff700 1 --2- 172.21.15.133:0/2544993734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49400b0a60 0x7f49400a9750 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f492c002f30 tx=0x7f492c006dc0).ready entity=mon.0 client_cookie=80f08a0edc2fa37e server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:57.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f493f7fe700 1 -- 172.21.15.133:0/2544993734 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f492c009800 con 0x7f49400b0a60 2021-01-03T13:05:57.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f493f7fe700 1 -- 172.21.15.133:0/2544993734 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c009960 con 0x7f49400b0a60 2021-01-03T13:05:57.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f493f7fe700 1 -- 172.21.15.133:0/2544993734 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f492c009cc0 con 0x7f49400b0a60 2021-01-03T13:05:57.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f4945ad9700 1 -- 172.21.15.133:0/2544993734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49400b0a60 msgr2=0x7f49400a9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:57.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f4945ad9700 1 --2- 172.21.15.133:0/2544993734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49400b0a60 0x7f49400a9750 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f492c002f30 tx=0x7f492c006dc0).stop 2021-01-03T13:05:57.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f4945ad9700 1 -- 172.21.15.133:0/2544993734 shutdown_connections 2021-01-03T13:05:57.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f4945ad9700 1 --2- 172.21.15.133:0/2544993734 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49400b0a60 0x7f49400a9750 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:57.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f4945ad9700 1 -- 172.21.15.133:0/2544993734 >> 172.21.15.133:0/2544993734 conn(0x7f494006b050 msgr2=0x7f4940060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:57.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f4945ad9700 1 -- 172.21.15.133:0/2544993734 shutdown_connections 2021-01-03T13:05:57.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f4945ad9700 1 -- 172.21.15.133:0/2544993734 wait complete. 2021-01-03T13:05:57.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f4945ad9700 1 Processor -- start 2021-01-03T13:05:57.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f4945ad9700 1 -- start start 2021-01-03T13:05:57.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f4945ad9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49400a8850 0x7f49400a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:57.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f4945ad9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49400b0a60 0x7f49400a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:57.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f4945ad9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49400b2460 0x7f49400a7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:57.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f4945ad9700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49400a2e60 con 0x7f49400a8850 2021-01-03T13:05:57.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f4945ad9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4940152740 con 0x7f49400b2460 2021-01-03T13:05:57.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f4945ad9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4940066750 con 0x7f49400b0a60 2021-01-03T13:05:57.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f49452d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49400b2460 0x7f49400a7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:57.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f4944ad7700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49400a8850 0x7f49400a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:57.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f49452d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49400b2460 0x7f49400a7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37814/0 (socket says 172.21.15.133:37814) 2021-01-03T13:05:57.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f493ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49400b0a60 0x7f49400a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:57.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.829+0000 7f49452d8700 1 -- 172.21.15.133:0/845242452 learned_addr learned my addr 172.21.15.133:0/845242452 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:57.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f49452d8700 1 -- 172.21.15.133:0/845242452 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49400b0a60 msgr2=0x7f49400a7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:57.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f49452d8700 1 --2- 172.21.15.133:0/845242452 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49400b0a60 0x7f49400a7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:57.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f49452d8700 1 -- 172.21.15.133:0/845242452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49400a8850 msgr2=0x7f49400a5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:57.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f49452d8700 1 --2- 172.21.15.133:0/845242452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49400a8850 0x7f49400a5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:57.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f49452d8700 1 -- 172.21.15.133:0/845242452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49400a2bc0 con 0x7f49400b2460 2021-01-03T13:05:57.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f493ffff700 1 --2- 172.21.15.133:0/845242452 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49400b0a60 0x7f49400a7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:05:57.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f49452d8700 1 --2- 172.21.15.133:0/845242452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49400b2460 0x7f49400a7fe0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f49380014a0 tx=0x7f4938007d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:57.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f493dffb700 1 -- 172.21.15.133:0/845242452 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f493800a5a0 con 0x7f49400b2460 2021-01-03T13:05:57.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f493dffb700 1 -- 172.21.15.133:0/845242452 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493800a700 con 0x7f49400b2460 2021-01-03T13:05:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f4945ad9700 1 -- 172.21.15.133:0/845242452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4940152990 con 0x7f49400b2460 2021-01-03T13:05:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f493dffb700 1 -- 172.21.15.133:0/845242452 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f493800a870 con 0x7f49400b2460 2021-01-03T13:05:57.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f4945ad9700 1 -- 172.21.15.133:0/845242452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49400b40b0 con 0x7f49400b2460 2021-01-03T13:05:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f4945ad9700 1 -- 172.21.15.133:0/845242452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4940066910 con 0x7f49400b2460 2021-01-03T13:05:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f493dffb700 1 -- 172.21.15.133:0/845242452 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4938010070 con 0x7f49400b2460 2021-01-03T13:05:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f493dffb700 1 --2- 172.21.15.133:0/845242452 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4928055440 0x7f4928057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:57.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f493dffb700 1 -- 172.21.15.133:0/845242452 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f493806d550 con 0x7f49400b2460 2021-01-03T13:05:57.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f4944ad7700 1 --2- 172.21.15.133:0/845242452 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4928055440 0x7f4928057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:57.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.833+0000 7f4944ad7700 1 --2- 172.21.15.133:0/845242452 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4928055440 0x7f4928057900 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f493400d000 tx=0x7f4934007bf0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:57.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.837+0000 7f493dffb700 1 -- 172.21.15.133:0/845242452 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4938041df0 con 0x7f49400b2460 2021-01-03T13:05:57.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:57.977+0000 7f4945ad9700 1 -- 172.21.15.133:0/845242452 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f4940057300 con 0x7f49400b2460 2021-01-03T13:05:58.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.833+0000 7f493dffb700 1 -- 172.21.15.133:0/845242452 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v111) v1 ==== 125+0+0 (secure 0 0 0) 0x7f4938043980 con 0x7f49400b2460 2021-01-03T13:05:58.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.841+0000 7f4945ad9700 1 -- 172.21.15.133:0/845242452 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4928055440 msgr2=0x7f4928057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:58.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.841+0000 7f4945ad9700 1 --2- 172.21.15.133:0/845242452 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4928055440 0x7f4928057900 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f493400d000 tx=0x7f4934007bf0).stop 2021-01-03T13:05:58.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.841+0000 7f4945ad9700 1 -- 172.21.15.133:0/845242452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49400b2460 msgr2=0x7f49400a7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:58.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.841+0000 7f4945ad9700 1 --2- 172.21.15.133:0/845242452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49400b2460 0x7f49400a7fe0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f49380014a0 tx=0x7f4938007d50).stop 2021-01-03T13:05:58.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.841+0000 7f4945ad9700 1 -- 172.21.15.133:0/845242452 shutdown_connections 2021-01-03T13:05:58.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.841+0000 7f4945ad9700 1 --2- 172.21.15.133:0/845242452 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4928055440 0x7f4928057900 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:58.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.841+0000 7f4945ad9700 1 --2- 172.21.15.133:0/845242452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f49400a8850 0x7f49400a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:58.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.841+0000 7f4945ad9700 1 --2- 172.21.15.133:0/845242452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49400b2460 0x7f49400a7fe0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:58.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.841+0000 7f4945ad9700 1 --2- 172.21.15.133:0/845242452 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f49400b0a60 0x7f49400a7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:58.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.841+0000 7f4945ad9700 1 -- 172.21.15.133:0/845242452 >> 172.21.15.133:0/845242452 conn(0x7f494006b050 msgr2=0x7f49400ab690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:58.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.841+0000 7f4945ad9700 1 -- 172.21.15.133:0/845242452 shutdown_connections 2021-01-03T13:05:58.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.841+0000 7f4945ad9700 1 -- 172.21.15.133:0/845242452 wait complete. 2021-01-03T13:05:58.849 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2021-01-03T13:05:58.860 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-01-03T13:05:58.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32f59e700 1 Processor -- start 2021-01-03T13:05:58.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32f59e700 1 -- start start 2021-01-03T13:05:58.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32f59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa3300b3670 0x7fa3300b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:58.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32f59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa3300b1f30 0x7fa3300b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:58.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32f59e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3300ac200 con 0x7fa3300b7910 2021-01-03T13:05:58.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32f59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3300ad720 con 0x7fa3300b1f30 2021-01-03T13:05:58.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32f59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3300acc10 con 0x7fa3300b3670 2021-01-03T13:05:58.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32dd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa3300b3670 0x7fa3300b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:58.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32dd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa3300b3670 0x7fa3300b7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37826/0 (socket says 172.21.15.133:37826) 2021-01-03T13:05:58.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32dd9b700 1 -- 172.21.15.133:0/2876003285 learned_addr learned my addr 172.21.15.133:0/2876003285 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:58.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32ed9d700 1 --2- 172.21.15.133:0/2876003285 >> v2:172.21.15.16:3300/0 conn(0x7fa3300b1f30 0x7fa3300b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:58.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32dd9b700 1 -- 172.21.15.133:0/2876003285 >> v2:172.21.15.16:3300/0 conn(0x7fa3300b1f30 msgr2=0x7fa3300b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:58.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32dd9b700 1 --2- 172.21.15.133:0/2876003285 >> v2:172.21.15.16:3300/0 conn(0x7fa3300b1f30 0x7fa3300b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:58.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32dd9b700 1 -- 172.21.15.133:0/2876003285 >> v1:172.21.15.16:6789/0 conn(0x7fa3300b7910 legacy=0x7fa33013e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:58.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32dd9b700 1 -- 172.21.15.133:0/2876003285 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3300ac430 con 0x7fa3300b3670 2021-01-03T13:05:58.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32dd9b700 1 --2- 172.21.15.133:0/2876003285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3300b3670 0x7fa3300b7cf0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7fa324002f30 tx=0x7fa324006e20).ready entity=mon.1 client_cookie=22174b5a464b7c48 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:58.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32d59a700 1 -- 172.21.15.133:0/2876003285 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3240097f0 con 0x7fa3300b3670 2021-01-03T13:05:58.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32d59a700 1 -- 172.21.15.133:0/2876003285 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa324009950 con 0x7fa3300b3670 2021-01-03T13:05:58.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32d59a700 1 -- 172.21.15.133:0/2876003285 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa324009cb0 con 0x7fa3300b3670 2021-01-03T13:05:58.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32f59e700 1 -- 172.21.15.133:0/2876003285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3300b3670 msgr2=0x7fa3300b7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:58.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.969+0000 7fa32f59e700 1 --2- 172.21.15.133:0/2876003285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3300b3670 0x7fa3300b7cf0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7fa324002f30 tx=0x7fa324006e20).stop 2021-01-03T13:05:58.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.973+0000 7fa32f59e700 1 -- 172.21.15.133:0/2876003285 shutdown_connections 2021-01-03T13:05:58.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.973+0000 7fa32f59e700 1 --2- 172.21.15.133:0/2876003285 >> v2:172.21.15.16:3300/0 conn(0x7fa3300b1f30 0x7fa3300b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:58.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.973+0000 7fa32f59e700 1 --2- 172.21.15.133:0/2876003285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3300b3670 0x7fa3300b7cf0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:58.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.973+0000 7fa32f59e700 1 -- 172.21.15.133:0/2876003285 >> 172.21.15.133:0/2876003285 conn(0x7fa33005c8c0 msgr2=0x7fa3300b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:58.987 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.973+0000 7fa32f59e700 1 -- 172.21.15.133:0/2876003285 shutdown_connections 2021-01-03T13:05:58.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.973+0000 7fa32f59e700 1 -- 172.21.15.133:0/2876003285 wait complete. 2021-01-03T13:05:58.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.973+0000 7fa32f59e700 1 Processor -- start 2021-01-03T13:05:58.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.973+0000 7fa32f59e700 1 -- start start 2021-01-03T13:05:58.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.973+0000 7fa32f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3300b1f30 0x7fa330065e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:58.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.973+0000 7fa32f59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3300b3670 0x7fa330066f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32f59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3300b7910 0x7fa330067420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32f59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa330139fe0 con 0x7fa3300b7910 2021-01-03T13:05:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa330066860 con 0x7fa3300b1f30 2021-01-03T13:05:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32f59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa330066a90 con 0x7fa3300b3670 2021-01-03T13:05:58.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3300b1f30 0x7fa330065e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:58.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3300b1f30 0x7fa330065e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37828/0 (socket says 172.21.15.133:37828) 2021-01-03T13:05:58.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32e59c700 1 -- 172.21.15.133:0/612437277 learned_addr learned my addr 172.21.15.133:0/612437277 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:58.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32ed9d700 1 --2- 172.21.15.133:0/612437277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3300b7910 0x7fa330067420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:58.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32dd9b700 1 --2- 172.21.15.133:0/612437277 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3300b3670 0x7fa330066f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:58.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32e59c700 1 -- 172.21.15.133:0/612437277 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3300b3670 msgr2=0x7fa330066f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:58.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32e59c700 1 --2- 172.21.15.133:0/612437277 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3300b3670 0x7fa330066f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:58.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32e59c700 1 -- 172.21.15.133:0/612437277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3300b7910 msgr2=0x7fa330067420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:58.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32e59c700 1 --2- 172.21.15.133:0/612437277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3300b7910 0x7fa330067420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:58.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32e59c700 1 -- 172.21.15.133:0/612437277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33014fa80 con 0x7fa3300b1f30 2021-01-03T13:05:58.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32e59c700 1 --2- 172.21.15.133:0/612437277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3300b1f30 0x7fa330065e00 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7fa3300608e0 tx=0x7fa320007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:58.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa31f7fe700 1 -- 172.21.15.133:0/612437277 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa320007240 con 0x7fa3300b1f30 2021-01-03T13:05:58.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa31f7fe700 1 -- 172.21.15.133:0/612437277 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3200073a0 con 0x7fa3300b1f30 2021-01-03T13:05:58.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32f59e700 1 -- 172.21.15.133:0/612437277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33014fd90 con 0x7fa3300b1f30 2021-01-03T13:05:58.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa31f7fe700 1 -- 172.21.15.133:0/612437277 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3200066d0 con 0x7fa3300b1f30 2021-01-03T13:05:58.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32f59e700 1 -- 172.21.15.133:0/612437277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3300ae940 con 0x7fa3300b1f30 2021-01-03T13:05:58.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa32f59e700 1 -- 172.21.15.133:0/612437277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa330057300 con 0x7fa3300b1f30 2021-01-03T13:05:58.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.977+0000 7fa31f7fe700 1 -- 172.21.15.133:0/612437277 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa320010030 con 0x7fa3300b1f30 2021-01-03T13:05:58.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.981+0000 7fa31f7fe700 1 --2- 172.21.15.133:0/612437277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa30c0553b0 0x7fa30c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:58.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.981+0000 7fa31f7fe700 1 -- 172.21.15.133:0/612437277 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fa32006dab0 con 0x7fa3300b1f30 2021-01-03T13:05:58.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.981+0000 7fa32dd9b700 1 --2- 172.21.15.133:0/612437277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa30c0553b0 0x7fa30c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:58.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.981+0000 7fa32dd9b700 1 --2- 172.21.15.133:0/612437277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa30c0553b0 0x7fa30c057870 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fa324019000 tx=0x7fa324015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:59.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:58.989+0000 7fa31f7fe700 1 -- 172.21.15.133:0/612437277 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa320043e20 con 0x7fa3300b1f30 2021-01-03T13:05:59.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.169+0000 7fa32f59e700 1 -- 172.21.15.133:0/612437277 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fa33005ce00 con 0x7fa3300b1f30 2021-01-03T13:05:59.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.185+0000 7fa31f7fe700 1 -- 172.21.15.133:0/612437277 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 19 and data pool 20 v48) v1 ==== 189+0+0 (secure 0 0 0) 0x7fa320047440 con 0x7fa3300b1f30 2021-01-03T13:05:59.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.193+0000 7fa32f59e700 1 -- 172.21.15.133:0/612437277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa30c0553b0 msgr2=0x7fa30c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.193+0000 7fa32f59e700 1 --2- 172.21.15.133:0/612437277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa30c0553b0 0x7fa30c057870 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fa324019000 tx=0x7fa324015000).stop 2021-01-03T13:05:59.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.193+0000 7fa32f59e700 1 -- 172.21.15.133:0/612437277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3300b1f30 msgr2=0x7fa330065e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.193+0000 7fa32f59e700 1 --2- 172.21.15.133:0/612437277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3300b1f30 0x7fa330065e00 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7fa3300608e0 tx=0x7fa320007bd0).stop 2021-01-03T13:05:59.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.193+0000 7fa32f59e700 1 -- 172.21.15.133:0/612437277 shutdown_connections 2021-01-03T13:05:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.193+0000 7fa32f59e700 1 --2- 172.21.15.133:0/612437277 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa30c0553b0 0x7fa30c057870 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.193+0000 7fa32f59e700 1 --2- 172.21.15.133:0/612437277 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3300b7910 0x7fa330067420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.193+0000 7fa32f59e700 1 --2- 172.21.15.133:0/612437277 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3300b1f30 0x7fa330065e00 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.193+0000 7fa32f59e700 1 --2- 172.21.15.133:0/612437277 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3300b3670 0x7fa330066f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.193+0000 7fa32f59e700 1 -- 172.21.15.133:0/612437277 >> 172.21.15.133:0/612437277 conn(0x7fa33005c8c0 msgr2=0x7fa3300b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.197+0000 7fa32f59e700 1 -- 172.21.15.133:0/612437277 shutdown_connections 2021-01-03T13:05:59.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.197+0000 7fa32f59e700 1 -- 172.21.15.133:0/612437277 wait complete. 2021-01-03T13:05:59.206 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 19 and data pool 20 2021-01-03T13:05:59.212 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:05:59.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.309+0000 7fe8562e9700 1 Processor -- start 2021-01-03T13:05:59.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.309+0000 7fe8562e9700 1 -- start start 2021-01-03T13:05:59.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe8562e9700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe850060510 0x7fe85005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:59.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe8562e9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe85005fd10 0x7fe8500b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:59.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe8562e9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe85005bf00 con 0x7fe8500b4c20 2021-01-03T13:05:59.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe8562e9700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85005c1a0 con 0x7fe850060510 2021-01-03T13:05:59.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe8562e9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85005c440 con 0x7fe85005fd10 2021-01-03T13:05:59.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe855ae8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe85005fd10 0x7fe8500b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:59.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe8552e7700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe8500b4c20 0x7fe8500b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58870/0 (socket says 172.21.15.133:58870) 2021-01-03T13:05:59.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe855ae8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe85005fd10 0x7fe8500b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37840/0 (socket says 172.21.15.133:37840) 2021-01-03T13:05:59.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe8552e7700 1 -- 172.21.15.133:0/4061239024 learned_addr learned my addr 172.21.15.133:0/4061239024 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:59.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe854ae6700 1 --2- 172.21.15.133:0/4061239024 >> v2:172.21.15.16:3300/0 conn(0x7fe850060510 0x7fe85005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:59.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe855ae8700 1 -- 172.21.15.133:0/4061239024 >> v2:172.21.15.16:3300/0 conn(0x7fe850060510 msgr2=0x7fe85005c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:59.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe855ae8700 1 --2- 172.21.15.133:0/4061239024 >> v2:172.21.15.16:3300/0 conn(0x7fe850060510 0x7fe85005c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe855ae8700 1 -- 172.21.15.133:0/4061239024 >> v1:172.21.15.133:6789/0 conn(0x7fe8500b4c20 legacy=0x7fe8500b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe847fff700 1 -- 172.21.15.133:0/4061239024 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338644324 0 0) 0x7fe85005bf00 con 0x7fe8500b4c20 2021-01-03T13:05:59.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe855ae8700 1 -- 172.21.15.133:0/4061239024 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8500b6ad0 con 0x7fe85005fd10 2021-01-03T13:05:59.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe855ae8700 1 --2- 172.21.15.133:0/4061239024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe85005fd10 0x7fe8500b65e0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7fe8480032b0 tx=0x7fe8480091a0).ready entity=mon.1 client_cookie=5392078662115cb3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:59.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe847fff700 1 -- 172.21.15.133:0/4061239024 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe84800ba50 con 0x7fe85005fd10 2021-01-03T13:05:59.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe847fff700 1 -- 172.21.15.133:0/4061239024 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84800bbb0 con 0x7fe85005fd10 2021-01-03T13:05:59.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe847fff700 1 -- 172.21.15.133:0/4061239024 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe84800bd20 con 0x7fe85005fd10 2021-01-03T13:05:59.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe8562e9700 1 -- 172.21.15.133:0/4061239024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe85005fd10 msgr2=0x7fe8500b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe8562e9700 1 --2- 172.21.15.133:0/4061239024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe85005fd10 0x7fe8500b65e0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7fe8480032b0 tx=0x7fe8480091a0).stop 2021-01-03T13:05:59.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe8562e9700 1 -- 172.21.15.133:0/4061239024 shutdown_connections 2021-01-03T13:05:59.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe8562e9700 1 --2- 172.21.15.133:0/4061239024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe85005fd10 0x7fe8500b65e0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe8562e9700 1 --2- 172.21.15.133:0/4061239024 >> v2:172.21.15.16:3300/0 conn(0x7fe850060510 0x7fe85005c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe8562e9700 1 -- 172.21.15.133:0/4061239024 >> 172.21.15.133:0/4061239024 conn(0x7fe8500b9f00 msgr2=0x7fe8500b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:59.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe8562e9700 1 -- 172.21.15.133:0/4061239024 shutdown_connections 2021-01-03T13:05:59.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.313+0000 7fe8562e9700 1 -- 172.21.15.133:0/4061239024 wait complete. 2021-01-03T13:05:59.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8562e9700 1 Processor -- start 2021-01-03T13:05:59.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8562e9700 1 -- start start 2021-01-03T13:05:59.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8562e9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe85005fd10 0x7fe85009e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:59.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8562e9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe850060510 0x7fe8500b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:59.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8562e9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe8500b4c20 0x7fe8500b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:59.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8562e9700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500b3fc0 con 0x7fe850060510 2021-01-03T13:05:59.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8562e9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500b0c90 con 0x7fe85005fd10 2021-01-03T13:05:59.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8562e9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8501431b0 con 0x7fe8500b4c20 2021-01-03T13:05:59.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8552e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe85005fd10 0x7fe85009e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:59.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8552e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe85005fd10 0x7fe85009e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37842/0 (socket says 172.21.15.133:37842) 2021-01-03T13:05:59.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8552e7700 1 -- 172.21.15.133:0/1197444944 learned_addr learned my addr 172.21.15.133:0/1197444944 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:59.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe854ae6700 1 --2- 172.21.15.133:0/1197444944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe850060510 0x7fe8500b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:59.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe855ae8700 1 --2- 172.21.15.133:0/1197444944 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe8500b4c20 0x7fe8500b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:59.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8552e7700 1 -- 172.21.15.133:0/1197444944 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe8500b4c20 msgr2=0x7fe8500b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8552e7700 1 --2- 172.21.15.133:0/1197444944 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe8500b4c20 0x7fe8500b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8552e7700 1 -- 172.21.15.133:0/1197444944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe850060510 msgr2=0x7fe8500b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8552e7700 1 --2- 172.21.15.133:0/1197444944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe850060510 0x7fe8500b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8552e7700 1 -- 172.21.15.133:0/1197444944 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe850143450 con 0x7fe85005fd10 2021-01-03T13:05:59.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe854ae6700 1 --2- 172.21.15.133:0/1197444944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe850060510 0x7fe8500b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:59.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8552e7700 1 --2- 172.21.15.133:0/1197444944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe85005fd10 0x7fe85009e4c0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7fe84c000e90 tx=0x7fe84c007cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:59.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8467fc700 1 -- 172.21.15.133:0/1197444944 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe84c0072e0 con 0x7fe85005fd10 2021-01-03T13:05:59.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8562e9700 1 -- 172.21.15.133:0/1197444944 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8501436f0 con 0x7fe85005fd10 2021-01-03T13:05:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8467fc700 1 -- 172.21.15.133:0/1197444944 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84c007440 con 0x7fe85005fd10 2021-01-03T13:05:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8562e9700 1 -- 172.21.15.133:0/1197444944 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8500b3200 con 0x7fe85005fd10 2021-01-03T13:05:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.317+0000 7fe8467fc700 1 -- 172.21.15.133:0/1197444944 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe84c0057d0 con 0x7fe85005fd10 2021-01-03T13:05:59.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.321+0000 7fe8562e9700 1 -- 172.21.15.133:0/1197444944 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe850057300 con 0x7fe85005fd10 2021-01-03T13:05:59.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.321+0000 7fe8467fc700 1 -- 172.21.15.133:0/1197444944 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe84c010070 con 0x7fe85005fd10 2021-01-03T13:05:59.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.321+0000 7fe8467fc700 1 --2- 172.21.15.133:0/1197444944 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe8380553b0 0x7fe838057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:59.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.321+0000 7fe854ae6700 1 --2- 172.21.15.133:0/1197444944 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe8380553b0 0x7fe838057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.321+0000 7fe8467fc700 1 -- 172.21.15.133:0/1197444944 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe84c06d720 con 0x7fe85005fd10 2021-01-03T13:05:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.321+0000 7fe854ae6700 1 --2- 172.21.15.133:0/1197444944 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe8380553b0 0x7fe838057870 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fe84000c000 tx=0x7fe840008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.329+0000 7fe8467fc700 1 -- 172.21.15.133:0/1197444944 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe84c043980 con 0x7fe85005fd10 2021-01-03T13:05:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.469+0000 7fe8562e9700 1 -- 172.21.15.133:0/1197444944 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8500b5510 con 0x7fe85005fd10 2021-01-03T13:05:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.469+0000 7fe8467fc700 1 -- 172.21.15.133:0/1197444944 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16113 (secure 0 0 0) 0x7fe84c046fa0 con 0x7fe85005fd10 2021-01-03T13:05:59.477 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:59.477 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":112,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:05:59.177761+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:05:56.797390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-01-03T13:05:58.040406+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:05:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.473+0000 7fe8562e9700 1 -- 172.21.15.133:0/1197444944 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe8380553b0 msgr2=0x7fe838057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.473+0000 7fe8562e9700 1 --2- 172.21.15.133:0/1197444944 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe8380553b0 0x7fe838057870 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fe84000c000 tx=0x7fe840008040).stop 2021-01-03T13:05:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.473+0000 7fe8562e9700 1 -- 172.21.15.133:0/1197444944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe85005fd10 msgr2=0x7fe85009e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.473+0000 7fe8562e9700 1 --2- 172.21.15.133:0/1197444944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe85005fd10 0x7fe85009e4c0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7fe84c000e90 tx=0x7fe84c007cb0).stop 2021-01-03T13:05:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.473+0000 7fe8562e9700 1 -- 172.21.15.133:0/1197444944 shutdown_connections 2021-01-03T13:05:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.473+0000 7fe8562e9700 1 --2- 172.21.15.133:0/1197444944 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe8380553b0 0x7fe838057870 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.473+0000 7fe8562e9700 1 --2- 172.21.15.133:0/1197444944 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe8500b4c20 0x7fe8500b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.473+0000 7fe8562e9700 1 --2- 172.21.15.133:0/1197444944 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe85005fd10 0x7fe85009e4c0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.473+0000 7fe8562e9700 1 --2- 172.21.15.133:0/1197444944 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe850060510 0x7fe8500b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.473+0000 7fe8562e9700 1 -- 172.21.15.133:0/1197444944 >> 172.21.15.133:0/1197444944 conn(0x7fe8500b9f00 msgr2=0x7fe8500b7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.473+0000 7fe8562e9700 1 -- 172.21.15.133:0/1197444944 shutdown_connections 2021-01-03T13:05:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.473+0000 7fe8562e9700 1 -- 172.21.15.133:0/1197444944 wait complete. 2021-01-03T13:05:59.491 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:05:59.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0c04c0700 1 Processor -- start 2021-01-03T13:05:59.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0c04c0700 1 -- start start 2021-01-03T13:05:59.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0c04c0700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa0b814aee0 0x7fa0b80aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:59.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0c04c0700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b8098550 con 0x7fa0b80b0670 2021-01-03T13:05:59.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0c04c0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b80b5ff0 con 0x7fa0b80b5c10 2021-01-03T13:05:59.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0c04c0700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b80b0b10 con 0x7fa0b814aee0 2021-01-03T13:05:59.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0be25c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa0b80b5c10 0x7fa0b814a7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58882/0 (socket says 172.21.15.133:58882) 2021-01-03T13:05:59.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0be25c700 1 -- 172.21.15.133:0/2693883744 learned_addr learned my addr 172.21.15.133:0/2693883744 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:05:59.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0bea5d700 1 --2- 172.21.15.133:0/2693883744 >> v2:172.21.15.16:3300/0 conn(0x7fa0b814aee0 0x7fa0b80aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:59.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0bd25a700 1 -- 172.21.15.133:0/2693883744 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718728416 0 0) 0x7fa0b80b5ff0 con 0x7fa0b80b5c10 2021-01-03T13:05:59.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0bd25a700 1 -- 172.21.15.133:0/2693883744 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0a4003230 con 0x7fa0b80b5c10 2021-01-03T13:05:59.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0bea5d700 1 -- 172.21.15.133:0/2693883744 >> v1:172.21.15.133:6789/0 conn(0x7fa0b80b5c10 legacy=0x7fa0b814a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0bea5d700 1 -- 172.21.15.133:0/2693883744 >> v1:172.21.15.16:6789/0 conn(0x7fa0b80b0670 legacy=0x7fa0b8144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0bea5d700 1 -- 172.21.15.133:0/2693883744 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b8098780 con 0x7fa0b814aee0 2021-01-03T13:05:59.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0bea5d700 1 --2- 172.21.15.133:0/2693883744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0b814aee0 0x7fa0b80aae70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fa0b00032b0 tx=0x7fa0b00091a0).ready entity=mon.0 client_cookie=f58f7a9b673ad178 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:59.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0bd25a700 1 -- 172.21.15.133:0/2693883744 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0b000b9f0 con 0x7fa0b814aee0 2021-01-03T13:05:59.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0bd25a700 1 -- 172.21.15.133:0/2693883744 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b000bb50 con 0x7fa0b814aee0 2021-01-03T13:05:59.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0bd25a700 1 -- 172.21.15.133:0/2693883744 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0b000bcc0 con 0x7fa0b814aee0 2021-01-03T13:05:59.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0c04c0700 1 -- 172.21.15.133:0/2693883744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0b814aee0 msgr2=0x7fa0b80aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.597+0000 7fa0c04c0700 1 --2- 172.21.15.133:0/2693883744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0b814aee0 0x7fa0b80aae70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fa0b00032b0 tx=0x7fa0b00091a0).stop 2021-01-03T13:05:59.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.601+0000 7fa0c04c0700 1 -- 172.21.15.133:0/2693883744 shutdown_connections 2021-01-03T13:05:59.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.601+0000 7fa0c04c0700 1 --2- 172.21.15.133:0/2693883744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0b814aee0 0x7fa0b80aae70 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.601+0000 7fa0c04c0700 1 -- 172.21.15.133:0/2693883744 >> 172.21.15.133:0/2693883744 conn(0x7fa0b805c8c0 msgr2=0x7fa0b80b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:59.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.601+0000 7fa0c04c0700 1 -- 172.21.15.133:0/2693883744 shutdown_connections 2021-01-03T13:05:59.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.601+0000 7fa0c04c0700 1 -- 172.21.15.133:0/2693883744 wait complete. 2021-01-03T13:05:59.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.601+0000 7fa0c04c0700 1 Processor -- start 2021-01-03T13:05:59.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.601+0000 7fa0c04c0700 1 -- start start 2021-01-03T13:05:59.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.601+0000 7fa0c04c0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0b80b0670 0x7fa0b80b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:59.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.601+0000 7fa0c04c0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0b80b5c10 0x7fa0b8149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:59.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.601+0000 7fa0c04c0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0b814aee0 0x7fa0b814a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:59.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.601+0000 7fa0c04c0700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b8149290 con 0x7fa0b80b0670 2021-01-03T13:05:59.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.601+0000 7fa0c04c0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b81494c0 con 0x7fa0b80b5c10 2021-01-03T13:05:59.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.601+0000 7fa0c04c0700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b815a190 con 0x7fa0b814aee0 2021-01-03T13:05:59.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0bda5b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0b80b5c10 0x7fa0b8149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:59.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0bda5b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0b80b5c10 0x7fa0b8149e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37860/0 (socket says 172.21.15.133:37860) 2021-01-03T13:05:59.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0bda5b700 1 -- 172.21.15.133:0/1651057928 learned_addr learned my addr 172.21.15.133:0/1651057928 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:59.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0be25c700 1 --2- 172.21.15.133:0/1651057928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0b80b0670 0x7fa0b80b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:59.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0bea5d700 1 --2- 172.21.15.133:0/1651057928 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0b814aee0 0x7fa0b814a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:59.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0bda5b700 1 -- 172.21.15.133:0/1651057928 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0b814aee0 msgr2=0x7fa0b814a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0bda5b700 1 --2- 172.21.15.133:0/1651057928 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0b814aee0 0x7fa0b814a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0bda5b700 1 -- 172.21.15.133:0/1651057928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0b80b0670 msgr2=0x7fa0b80b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0bda5b700 1 --2- 172.21.15.133:0/1651057928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0b80b0670 0x7fa0b80b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0bda5b700 1 -- 172.21.15.133:0/1651057928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b815a430 con 0x7fa0b80b5c10 2021-01-03T13:05:59.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0bea5d700 1 --2- 172.21.15.133:0/1651057928 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0b814aee0 0x7fa0b814a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:05:59.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0bda5b700 1 --2- 172.21.15.133:0/1651057928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0b80b5c10 0x7fa0b8149e60 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7fa0b806b250 tx=0x7fa0ac007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:59.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0b77fe700 1 -- 172.21.15.133:0/1651057928 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0ac007240 con 0x7fa0b80b5c10 2021-01-03T13:05:59.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0b77fe700 1 -- 172.21.15.133:0/1651057928 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ac0073a0 con 0x7fa0b80b5c10 2021-01-03T13:05:59.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0c04c0700 1 -- 172.21.15.133:0/1651057928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b8148b50 con 0x7fa0b80b5c10 2021-01-03T13:05:59.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0b77fe700 1 -- 172.21.15.133:0/1651057928 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0ac0064e0 con 0x7fa0b80b5c10 2021-01-03T13:05:59.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0c04c0700 1 -- 172.21.15.133:0/1651057928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b8148910 con 0x7fa0b80b5c10 2021-01-03T13:05:59.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0c04c0700 1 -- 172.21.15.133:0/1651057928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b815a5c0 con 0x7fa0b80b5c10 2021-01-03T13:05:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0b77fe700 1 -- 172.21.15.133:0/1651057928 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa0ac010070 con 0x7fa0b80b5c10 2021-01-03T13:05:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0b77fe700 1 --2- 172.21.15.133:0/1651057928 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa0980553b0 0x7fa098057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0b77fe700 1 -- 172.21.15.133:0/1651057928 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa0ac06d6a0 con 0x7fa0b80b5c10 2021-01-03T13:05:59.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.605+0000 7fa0be25c700 1 --2- 172.21.15.133:0/1651057928 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa0980553b0 0x7fa098057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:59.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.609+0000 7fa0be25c700 1 --2- 172.21.15.133:0/1651057928 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa0980553b0 0x7fa098057870 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fa0a800d000 tx=0x7fa0a8009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:59.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.613+0000 7fa0b77fe700 1 -- 172.21.15.133:0/1651057928 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa0ac0437b0 con 0x7fa0b80b5c10 2021-01-03T13:05:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.757+0000 7fa0c04c0700 1 -- 172.21.15.133:0/1651057928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0b8057300 con 0x7fa0b80b5c10 2021-01-03T13:05:59.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.761+0000 7fa0b77fe700 1 -- 172.21.15.133:0/1651057928 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16113 (secure 0 0 0) 0x7fa0ac018030 con 0x7fa0b80b5c10 2021-01-03T13:05:59.765 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:05:59.766 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":112,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:05:59.177761+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:05:56.797390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-01-03T13:05:58.040406+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:05:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.761+0000 7fa0c04c0700 1 -- 172.21.15.133:0/1651057928 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa0980553b0 msgr2=0x7fa098057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.761+0000 7fa0c04c0700 1 --2- 172.21.15.133:0/1651057928 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa0980553b0 0x7fa098057870 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fa0a800d000 tx=0x7fa0a8009040).stop 2021-01-03T13:05:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.761+0000 7fa0c04c0700 1 -- 172.21.15.133:0/1651057928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0b80b5c10 msgr2=0x7fa0b8149e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.761+0000 7fa0c04c0700 1 --2- 172.21.15.133:0/1651057928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0b80b5c10 0x7fa0b8149e60 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7fa0b806b250 tx=0x7fa0ac007be0).stop 2021-01-03T13:05:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.761+0000 7fa0c04c0700 1 -- 172.21.15.133:0/1651057928 shutdown_connections 2021-01-03T13:05:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.761+0000 7fa0c04c0700 1 --2- 172.21.15.133:0/1651057928 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa0980553b0 0x7fa098057870 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.761+0000 7fa0c04c0700 1 --2- 172.21.15.133:0/1651057928 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0b80b0670 0x7fa0b80b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.761+0000 7fa0c04c0700 1 --2- 172.21.15.133:0/1651057928 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0b814aee0 0x7fa0b814a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.761+0000 7fa0c04c0700 1 --2- 172.21.15.133:0/1651057928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0b80b5c10 0x7fa0b8149e60 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.761+0000 7fa0c04c0700 1 -- 172.21.15.133:0/1651057928 >> 172.21.15.133:0/1651057928 conn(0x7fa0b805c8c0 msgr2=0x7fa0b8144240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:59.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.761+0000 7fa0c04c0700 1 -- 172.21.15.133:0/1651057928 shutdown_connections 2021-01-03T13:05:59.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.761+0000 7fa0c04c0700 1 -- 172.21.15.133:0/1651057928 wait complete. 2021-01-03T13:05:59.779 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-01-03T13:05:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f73a01f8700 1 Processor -- start 2021-01-03T13:05:59.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f73a01f8700 1 -- start start 2021-01-03T13:05:59.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f73a01f8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73980b3f50 0x7f73980b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:59.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f73a01f8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73980b3850 0x7f73981444d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:59.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f73a01f8700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7398140c00 con 0x7f73980b3240 2021-01-03T13:05:59.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f73a01f8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73980ade70 con 0x7f73980b3f50 2021-01-03T13:05:59.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f73a01f8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739809ab30 con 0x7f73980b3850 2021-01-03T13:05:59.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f739df94700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73980b3f50 0x7f73980b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:59.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f739df94700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73980b3f50 0x7f73980b4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37864/0 (socket says 172.21.15.133:37864) 2021-01-03T13:05:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f739df94700 1 -- 172.21.15.133:0/496969971 learned_addr learned my addr 172.21.15.133:0/496969971 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f739e795700 1 --2- 172.21.15.133:0/496969971 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73980b3850 0x7f73981444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f739df94700 1 -- 172.21.15.133:0/496969971 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73980b3850 msgr2=0x7f73981444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:05:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f739df94700 1 --2- 172.21.15.133:0/496969971 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73980b3850 0x7f73981444d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f739df94700 1 -- 172.21.15.133:0/496969971 >> v1:172.21.15.16:6789/0 conn(0x7f73980b3240 legacy=0x7f7398141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f739df94700 1 -- 172.21.15.133:0/496969971 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739809add0 con 0x7f73980b3f50 2021-01-03T13:05:59.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f739df94700 1 --2- 172.21.15.133:0/496969971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73980b3f50 0x7f73980b4330 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f7394002f30 tx=0x7f7394006e80).ready entity=mon.1 client_cookie=76ac1dd96108af58 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:59.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f739cf92700 1 -- 172.21.15.133:0/496969971 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73940097f0 con 0x7f73980b3f50 2021-01-03T13:05:59.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f739cf92700 1 -- 172.21.15.133:0/496969971 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7394009950 con 0x7f73980b3f50 2021-01-03T13:05:59.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f739cf92700 1 -- 172.21.15.133:0/496969971 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7394009cb0 con 0x7f73980b3f50 2021-01-03T13:05:59.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f73a01f8700 1 -- 172.21.15.133:0/496969971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73980b3f50 msgr2=0x7f73980b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f73a01f8700 1 --2- 172.21.15.133:0/496969971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73980b3f50 0x7f73980b4330 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f7394002f30 tx=0x7f7394006e80).stop 2021-01-03T13:05:59.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f73a01f8700 1 -- 172.21.15.133:0/496969971 shutdown_connections 2021-01-03T13:05:59.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f73a01f8700 1 --2- 172.21.15.133:0/496969971 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73980b3850 0x7f73981444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f73a01f8700 1 --2- 172.21.15.133:0/496969971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73980b3f50 0x7f73980b4330 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f73a01f8700 1 -- 172.21.15.133:0/496969971 >> 172.21.15.133:0/496969971 conn(0x7f739805bdf0 msgr2=0x7f739805c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:05:59.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f73a01f8700 1 -- 172.21.15.133:0/496969971 shutdown_connections 2021-01-03T13:05:59.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.897+0000 7f73a01f8700 1 -- 172.21.15.133:0/496969971 wait complete. 2021-01-03T13:05:59.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f73a01f8700 1 Processor -- start 2021-01-03T13:05:59.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f73a01f8700 1 -- start start 2021-01-03T13:05:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f73a01f8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73980b3240 0x7f739814f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f73a01f8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73980b3850 0x7f73980b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f73a01f8700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f73980b3f50 0x7f73980af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f73a01f8700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73980b6590 con 0x7f73980b3f50 2021-01-03T13:05:59.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f73a01f8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73980b6830 con 0x7f73980b3850 2021-01-03T13:05:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f73a01f8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73980b6ad0 con 0x7f73980b3240 2021-01-03T13:05:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f739d793700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73980b3850 0x7f73980b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f739d793700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73980b3850 0x7f73980b5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37874/0 (socket says 172.21.15.133:37874) 2021-01-03T13:05:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f739d793700 1 -- 172.21.15.133:0/3275083049 learned_addr learned my addr 172.21.15.133:0/3275083049 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:05:59.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f739e795700 1 --2- 172.21.15.133:0/3275083049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f73980b3f50 0x7f73980af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:59.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f739df94700 1 --2- 172.21.15.133:0/3275083049 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73980b3240 0x7f739814f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:59.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f739d793700 1 -- 172.21.15.133:0/3275083049 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73980b3240 msgr2=0x7f739814f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f739d793700 1 --2- 172.21.15.133:0/3275083049 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73980b3240 0x7f739814f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f739d793700 1 -- 172.21.15.133:0/3275083049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f73980b3f50 msgr2=0x7f73980af8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:05:59.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f739d793700 1 --2- 172.21.15.133:0/3275083049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f73980b3f50 0x7f73980af8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:05:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f739d793700 1 -- 172.21.15.133:0/3275083049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73980b6d70 con 0x7f73980b3850 2021-01-03T13:05:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.901+0000 7f739d793700 1 --2- 172.21.15.133:0/3275083049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73980b3850 0x7f73980b5920 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7f7398060f80 tx=0x7f7388007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.905+0000 7f7386ffd700 1 -- 172.21.15.133:0/3275083049 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7388007240 con 0x7f73980b3850 2021-01-03T13:05:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.905+0000 7f7386ffd700 1 -- 172.21.15.133:0/3275083049 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73880073a0 con 0x7f73980b3850 2021-01-03T13:05:59.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.905+0000 7f73a01f8700 1 -- 172.21.15.133:0/3275083049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73980b1580 con 0x7f73980b3850 2021-01-03T13:05:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.905+0000 7f7386ffd700 1 -- 172.21.15.133:0/3275083049 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73880066d0 con 0x7f73980b3850 2021-01-03T13:05:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.905+0000 7f73a01f8700 1 -- 172.21.15.133:0/3275083049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73980b7dc0 con 0x7f73980b3850 2021-01-03T13:05:59.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.905+0000 7f73a01f8700 1 -- 172.21.15.133:0/3275083049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73980b6f00 con 0x7f73980b3850 2021-01-03T13:05:59.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.905+0000 7f7386ffd700 1 -- 172.21.15.133:0/3275083049 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7388010070 con 0x7f73980b3850 2021-01-03T13:05:59.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.905+0000 7f7386ffd700 1 --2- 172.21.15.133:0/3275083049 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f73780553b0 0x7f7378057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:05:59.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.905+0000 7f7386ffd700 1 -- 172.21.15.133:0/3275083049 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f738806d5b0 con 0x7f73980b3850 2021-01-03T13:05:59.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.905+0000 7f739df94700 1 --2- 172.21.15.133:0/3275083049 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f73780553b0 0x7f7378057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:05:59.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.905+0000 7f739df94700 1 --2- 172.21.15.133:0/3275083049 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f73780553b0 0x7f7378057870 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f739401c000 tx=0x7f7394015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:05:59.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:05:59.913+0000 7f7386ffd700 1 -- 172.21.15.133:0/3275083049 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f73880438b0 con 0x7f73980b3850 2021-01-03T13:06:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.097+0000 7f73a01f8700 1 -- 172.21.15.133:0/3275083049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7398057300 con 0x7f73980b3850 2021-01-03T13:06:00.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.193+0000 7f7386ffd700 1 -- 172.21.15.133:0/3275083049 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v49) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7388046ed0 con 0x7f73980b3850 2021-01-03T13:06:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.197+0000 7f73a01f8700 1 -- 172.21.15.133:0/3275083049 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f73780553b0 msgr2=0x7f7378057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.197+0000 7f73a01f8700 1 --2- 172.21.15.133:0/3275083049 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f73780553b0 0x7f7378057870 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f739401c000 tx=0x7f7394015000).stop 2021-01-03T13:06:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.197+0000 7f73a01f8700 1 -- 172.21.15.133:0/3275083049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73980b3850 msgr2=0x7f73980b5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.197+0000 7f73a01f8700 1 --2- 172.21.15.133:0/3275083049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73980b3850 0x7f73980b5920 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7f7398060f80 tx=0x7f7388007be0).stop 2021-01-03T13:06:00.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.197+0000 7f73a01f8700 1 -- 172.21.15.133:0/3275083049 shutdown_connections 2021-01-03T13:06:00.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.197+0000 7f73a01f8700 1 --2- 172.21.15.133:0/3275083049 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f73780553b0 0x7f7378057870 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.197+0000 7f73a01f8700 1 --2- 172.21.15.133:0/3275083049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f73980b3f50 0x7f73980af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.197+0000 7f73a01f8700 1 --2- 172.21.15.133:0/3275083049 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73980b3240 0x7f739814f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.197+0000 7f73a01f8700 1 --2- 172.21.15.133:0/3275083049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73980b3850 0x7f73980b5920 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.197+0000 7f73a01f8700 1 -- 172.21.15.133:0/3275083049 >> 172.21.15.133:0/3275083049 conn(0x7f739805bdf0 msgr2=0x7f739813dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:00.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.197+0000 7f73a01f8700 1 -- 172.21.15.133:0/3275083049 shutdown_connections 2021-01-03T13:06:00.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.197+0000 7f73a01f8700 1 -- 172.21.15.133:0/3275083049 wait complete. 2021-01-03T13:06:00.220 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:06:00.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d7fff700 1 Processor -- start 2021-01-03T13:06:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d7fff700 1 -- start start 2021-01-03T13:06:00.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d7fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23d80b2350 0x7f23d814a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f23d80a7570 0x7f23d814adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d7fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d80b1110 con 0x7f23d80b1b20 2021-01-03T13:06:00.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d7fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d80a7cb0 con 0x7f23d80a7570 2021-01-03T13:06:00.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d7fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80b0520 con 0x7f23d80b2350 2021-01-03T13:06:00.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d67fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f23d80a7570 0x7f23d814adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d67fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f23d80a7570 0x7f23d814adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37878/0 (socket says 172.21.15.133:37878) 2021-01-03T13:06:00.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d67fc700 1 -- 172.21.15.133:0/3735796073 learned_addr learned my addr 172.21.15.133:0/3735796073 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:00.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d6ffd700 1 --2- 172.21.15.133:0/3735796073 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23d80b2350 0x7f23d814a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d67fc700 1 -- 172.21.15.133:0/3735796073 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23d80b2350 msgr2=0x7f23d814a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:00.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d67fc700 1 --2- 172.21.15.133:0/3735796073 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23d80b2350 0x7f23d814a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d67fc700 1 -- 172.21.15.133:0/3735796073 >> v1:172.21.15.16:6789/0 conn(0x7f23d80b1b20 legacy=0x7f23d80671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:00.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d67fc700 1 -- 172.21.15.133:0/3735796073 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d80b0bd0 con 0x7f23d80a7570 2021-01-03T13:06:00.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d6ffd700 1 --2- 172.21.15.133:0/3735796073 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23d80b2350 0x7f23d814a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:06:00.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d67fc700 1 --2- 172.21.15.133:0/3735796073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23d80a7570 0x7f23d814adc0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f23d80a8480 tx=0x7f23cc006e80).ready entity=mon.1 client_cookie=cb667d253dad7cd2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:00.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d5ffb700 1 -- 172.21.15.133:0/3735796073 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23cc0097b0 con 0x7f23d80a7570 2021-01-03T13:06:00.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d5ffb700 1 -- 172.21.15.133:0/3735796073 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23cc009910 con 0x7f23d80a7570 2021-01-03T13:06:00.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d5ffb700 1 -- 172.21.15.133:0/3735796073 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23cc009ac0 con 0x7f23d80a7570 2021-01-03T13:06:00.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d7fff700 1 -- 172.21.15.133:0/3735796073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23d80a7570 msgr2=0x7f23d814adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:00.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d7fff700 1 --2- 172.21.15.133:0/3735796073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23d80a7570 0x7f23d814adc0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f23d80a8480 tx=0x7f23cc006e80).stop 2021-01-03T13:06:00.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d7fff700 1 -- 172.21.15.133:0/3735796073 shutdown_connections 2021-01-03T13:06:00.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d7fff700 1 --2- 172.21.15.133:0/3735796073 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23d80b2350 0x7f23d814a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d7fff700 1 --2- 172.21.15.133:0/3735796073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23d80a7570 0x7f23d814adc0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d7fff700 1 -- 172.21.15.133:0/3735796073 >> 172.21.15.133:0/3735796073 conn(0x7f23d806b050 msgr2=0x7f23d8060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:00.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d7fff700 1 -- 172.21.15.133:0/3735796073 shutdown_connections 2021-01-03T13:06:00.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.333+0000 7f23d7fff700 1 -- 172.21.15.133:0/3735796073 wait complete. 2021-01-03T13:06:00.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d7fff700 1 Processor -- start 2021-01-03T13:06:00.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d7fff700 1 -- start start 2021-01-03T13:06:00.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d7fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23d80a7570 0x7f23d8144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d7fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23d80b1b20 0x7f23d8144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23d80b2350 0x7f23d8149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d7fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d81570d0 con 0x7f23d80a7570 2021-01-03T13:06:00.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d7fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80aa6a0 con 0x7f23d80b2350 2021-01-03T13:06:00.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d7fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80aa940 con 0x7f23d80b1b20 2021-01-03T13:06:00.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23d80b2350 0x7f23d8149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23d80b2350 0x7f23d8149be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37886/0 (socket says 172.21.15.133:37886) 2021-01-03T13:06:00.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d77fe700 1 -- 172.21.15.133:0/653736374 learned_addr learned my addr 172.21.15.133:0/653736374 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:00.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d67fc700 1 --2- 172.21.15.133:0/653736374 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23d80b1b20 0x7f23d8144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d6ffd700 1 --2- 172.21.15.133:0/653736374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23d80a7570 0x7f23d8144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d77fe700 1 -- 172.21.15.133:0/653736374 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23d80b1b20 msgr2=0x7f23d8144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:00.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d77fe700 1 --2- 172.21.15.133:0/653736374 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23d80b1b20 0x7f23d8144c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d77fe700 1 -- 172.21.15.133:0/653736374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23d80a7570 msgr2=0x7f23d8144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:00.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d77fe700 1 --2- 172.21.15.133:0/653736374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23d80a7570 0x7f23d8144730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d77fe700 1 -- 172.21.15.133:0/653736374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d8156bd0 con 0x7f23d80b2350 2021-01-03T13:06:00.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d6ffd700 1 --2- 172.21.15.133:0/653736374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23d80a7570 0x7f23d8144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:06:00.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d77fe700 1 --2- 172.21.15.133:0/653736374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23d80b2350 0x7f23d8149be0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f23d00022e0 tx=0x7f23d000cbf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:00.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23c7fff700 1 -- 172.21.15.133:0/653736374 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23d000a640 con 0x7f23d80b2350 2021-01-03T13:06:00.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23c7fff700 1 -- 172.21.15.133:0/653736374 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d000a7a0 con 0x7f23d80b2350 2021-01-03T13:06:00.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d7fff700 1 -- 172.21.15.133:0/653736374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d8156e80 con 0x7f23d80b2350 2021-01-03T13:06:00.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23c7fff700 1 -- 172.21.15.133:0/653736374 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23d000a910 con 0x7f23d80b2350 2021-01-03T13:06:00.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d7fff700 1 -- 172.21.15.133:0/653736374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d80aa200 con 0x7f23d80b2350 2021-01-03T13:06:00.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.337+0000 7f23d7fff700 1 -- 172.21.15.133:0/653736374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d80aab00 con 0x7f23d80b2350 2021-01-03T13:06:00.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.341+0000 7f23c7fff700 1 -- 172.21.15.133:0/653736374 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f23d0010070 con 0x7f23d80b2350 2021-01-03T13:06:00.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.341+0000 7f23c7fff700 1 --2- 172.21.15.133:0/653736374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f23b4055330 0x7f23b40577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.341+0000 7f23c7fff700 1 -- 172.21.15.133:0/653736374 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f23d006dcc0 con 0x7f23d80b2350 2021-01-03T13:06:00.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.341+0000 7f23d6ffd700 1 --2- 172.21.15.133:0/653736374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f23b4055330 0x7f23b40577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.341+0000 7f23d6ffd700 1 --2- 172.21.15.133:0/653736374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f23b4055330 0x7f23b40577f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f23c8008000 tx=0x7f23c8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:00.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.345+0000 7f23c7fff700 1 -- 172.21.15.133:0/653736374 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f23d0043f20 con 0x7f23d80b2350 2021-01-03T13:06:00.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.529+0000 7f23d7fff700 1 -- 172.21.15.133:0/653736374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23d8057300 con 0x7f23d80b2350 2021-01-03T13:06:00.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.529+0000 7f23c7fff700 1 -- 172.21.15.133:0/653736374 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+2499 (secure 0 0 0) 0x7f23d0047540 con 0x7f23d80b2350 2021-01-03T13:06:00.536 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:00.536 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":49,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7108,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/2670125727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2670125727},{"type":"v1","addr":"172.21.15.133:6835","nonce":2670125727}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47},{"gid":7120,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6837/3964151526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3964151526},{"type":"v1","addr":"172.21.15.133:6837","nonce":3964151526}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:59.178144+0000","modified":"2021-01-03T13:06:00.181997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7123},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7123":{"gid":7123,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/1643460453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1643460453},{"type":"v1","addr":"172.21.15.16:6833","nonce":1643460453}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-01-03T13:06:00.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.533+0000 7f23d7fff700 1 -- 172.21.15.133:0/653736374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f23b4055330 msgr2=0x7f23b40577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:00.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.533+0000 7f23d7fff700 1 --2- 172.21.15.133:0/653736374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f23b4055330 0x7f23b40577f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f23c8008000 tx=0x7f23c8008040).stop 2021-01-03T13:06:00.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.533+0000 7f23d7fff700 1 -- 172.21.15.133:0/653736374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23d80b2350 msgr2=0x7f23d8149be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:00.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.533+0000 7f23d7fff700 1 --2- 172.21.15.133:0/653736374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23d80b2350 0x7f23d8149be0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f23d00022e0 tx=0x7f23d000cbf0).stop 2021-01-03T13:06:00.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.533+0000 7f23d7fff700 1 -- 172.21.15.133:0/653736374 shutdown_connections 2021-01-03T13:06:00.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.533+0000 7f23d7fff700 1 --2- 172.21.15.133:0/653736374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f23b4055330 0x7f23b40577f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.533+0000 7f23d7fff700 1 --2- 172.21.15.133:0/653736374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23d80a7570 0x7f23d8144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.533+0000 7f23d7fff700 1 --2- 172.21.15.133:0/653736374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23d80b2350 0x7f23d8149be0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.533+0000 7f23d7fff700 1 --2- 172.21.15.133:0/653736374 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f23d80b1b20 0x7f23d8144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.533+0000 7f23d7fff700 1 -- 172.21.15.133:0/653736374 >> 172.21.15.133:0/653736374 conn(0x7f23d806b050 msgr2=0x7f23d80b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:00.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.533+0000 7f23d7fff700 1 -- 172.21.15.133:0/653736374 shutdown_connections 2021-01-03T13:06:00.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.533+0000 7f23d7fff700 1 -- 172.21.15.133:0/653736374 wait complete. 2021-01-03T13:06:00.541 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 49 2021-01-03T13:06:00.550 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:06:00.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f748759e700 1 Processor -- start 2021-01-03T13:06:00.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f748759e700 1 -- start start 2021-01-03T13:06:00.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f748759e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f74880b2e00 0x7f7488144020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f748759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f74880b7eb0 0x7f748813e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f748759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748809c0b0 con 0x7f74880b72b0 2021-01-03T13:06:00.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f748759e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74880ae480 con 0x7f74880b2e00 2021-01-03T13:06:00.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f748759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f748809c2e0 con 0x7f74880b7eb0 2021-01-03T13:06:00.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f7486d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f74880b7eb0 0x7f748813e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f748659c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f74880b72b0 0x7f74880ad160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58924/0 (socket says 172.21.15.133:58924) 2021-01-03T13:06:00.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f7486d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f74880b7eb0 0x7f748813e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37894/0 (socket says 172.21.15.133:37894) 2021-01-03T13:06:00.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f748659c700 1 -- 172.21.15.133:0/3035818981 learned_addr learned my addr 172.21.15.133:0/3035818981 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:00.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f7485d9b700 1 --2- 172.21.15.133:0/3035818981 >> v2:172.21.15.16:3300/0 conn(0x7f74880b2e00 0x7f7488144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f7486d9d700 1 -- 172.21.15.133:0/3035818981 >> v2:172.21.15.16:3300/0 conn(0x7f74880b2e00 msgr2=0x7f7488144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:00.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f7486d9d700 1 --2- 172.21.15.133:0/3035818981 >> v2:172.21.15.16:3300/0 conn(0x7f74880b2e00 0x7f7488144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f7486d9d700 1 -- 172.21.15.133:0/3035818981 >> v1:172.21.15.133:6789/0 conn(0x7f74880b72b0 legacy=0x7f74880ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:00.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f7486d9d700 1 -- 172.21.15.133:0/3035818981 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748809c580 con 0x7f74880b7eb0 2021-01-03T13:06:00.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f7486d9d700 1 --2- 172.21.15.133:0/3035818981 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74880b7eb0 0x7f748813e040 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f74800032b0 tx=0x7f74800091a0).ready entity=mon.1 client_cookie=86b699eae18dd302 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:00.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.653+0000 7f748559a700 1 -- 172.21.15.133:0/3035818981 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f748000ba50 con 0x7f74880b7eb0 2021-01-03T13:06:00.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.657+0000 7f748559a700 1 -- 172.21.15.133:0/3035818981 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748000bbb0 con 0x7f74880b7eb0 2021-01-03T13:06:00.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.657+0000 7f748559a700 1 -- 172.21.15.133:0/3035818981 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f748000bd20 con 0x7f74880b7eb0 2021-01-03T13:06:00.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.657+0000 7f748759e700 1 -- 172.21.15.133:0/3035818981 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74880b7eb0 msgr2=0x7f748813e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:00.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.657+0000 7f748759e700 1 --2- 172.21.15.133:0/3035818981 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74880b7eb0 0x7f748813e040 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f74800032b0 tx=0x7f74800091a0).stop 2021-01-03T13:06:00.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.657+0000 7f748759e700 1 -- 172.21.15.133:0/3035818981 shutdown_connections 2021-01-03T13:06:00.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.657+0000 7f748759e700 1 --2- 172.21.15.133:0/3035818981 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74880b7eb0 0x7f748813e040 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.657+0000 7f748759e700 1 --2- 172.21.15.133:0/3035818981 >> v2:172.21.15.16:3300/0 conn(0x7f74880b2e00 0x7f7488144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.657+0000 7f748759e700 1 -- 172.21.15.133:0/3035818981 >> 172.21.15.133:0/3035818981 conn(0x7f748805bdf0 msgr2=0x7f748805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:00.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.657+0000 7f748759e700 1 -- 172.21.15.133:0/3035818981 shutdown_connections 2021-01-03T13:06:00.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.657+0000 7f748759e700 1 -- 172.21.15.133:0/3035818981 wait complete. 2021-01-03T13:06:00.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.657+0000 7f748759e700 1 Processor -- start 2021-01-03T13:06:00.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.657+0000 7f748759e700 1 -- start start 2021-01-03T13:06:00.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f748759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74880b2e00 0x7f7488142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f748759e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74880b72b0 0x7f7488131b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f748759e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7488141e10 0x7f74880b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f748759e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7488062c60 con 0x7f74880b72b0 2021-01-03T13:06:00.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f748759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7488143610 con 0x7f74880b2e00 2021-01-03T13:06:00.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f748759e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74881438b0 con 0x7f7488141e10 2021-01-03T13:06:00.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f748659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74880b2e00 0x7f7488142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f748659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74880b2e00 0x7f7488142530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37898/0 (socket says 172.21.15.133:37898) 2021-01-03T13:06:00.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f748659c700 1 -- 172.21.15.133:0/1617252362 learned_addr learned my addr 172.21.15.133:0/1617252362 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:00.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f7486d9d700 1 --2- 172.21.15.133:0/1617252362 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7488141e10 0x7f74880b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f7485d9b700 1 --2- 172.21.15.133:0/1617252362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74880b72b0 0x7f7488131b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f748659c700 1 -- 172.21.15.133:0/1617252362 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7488141e10 msgr2=0x7f74880b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:00.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f748659c700 1 --2- 172.21.15.133:0/1617252362 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7488141e10 0x7f74880b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f748659c700 1 -- 172.21.15.133:0/1617252362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74880b72b0 msgr2=0x7f7488131b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:00.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f748659c700 1 --2- 172.21.15.133:0/1617252362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74880b72b0 0x7f7488131b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f748659c700 1 -- 172.21.15.133:0/1617252362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7488062e90 con 0x7f74880b2e00 2021-01-03T13:06:00.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f748659c700 1 --2- 172.21.15.133:0/1617252362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74880b2e00 0x7f7488142530 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f7488063f40 tx=0x7f7470007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:00.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f747f7fe700 1 -- 172.21.15.133:0/1617252362 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74700072e0 con 0x7f74880b2e00 2021-01-03T13:06:00.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f747f7fe700 1 -- 172.21.15.133:0/1617252362 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7470007440 con 0x7f74880b2e00 2021-01-03T13:06:00.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f748759e700 1 -- 172.21.15.133:0/1617252362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7488132040 con 0x7f74880b2e00 2021-01-03T13:06:00.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f747f7fe700 1 -- 172.21.15.133:0/1617252362 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74700057d0 con 0x7f74880b2e00 2021-01-03T13:06:00.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.661+0000 7f748759e700 1 -- 172.21.15.133:0/1617252362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7488132360 con 0x7f74880b2e00 2021-01-03T13:06:00.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.665+0000 7f748759e700 1 -- 172.21.15.133:0/1617252362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7488057300 con 0x7f74880b2e00 2021-01-03T13:06:00.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.665+0000 7f747f7fe700 1 -- 172.21.15.133:0/1617252362 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f747001a060 con 0x7f74880b2e00 2021-01-03T13:06:00.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.665+0000 7f747f7fe700 1 --2- 172.21.15.133:0/1617252362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f746c0554e0 0x7f746c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.665+0000 7f747f7fe700 1 -- 172.21.15.133:0/1617252362 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f747006d270 con 0x7f74880b2e00 2021-01-03T13:06:00.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.665+0000 7f7485d9b700 1 --2- 172.21.15.133:0/1617252362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f746c0554e0 0x7f746c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.665+0000 7f7485d9b700 1 --2- 172.21.15.133:0/1617252362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f746c0554e0 0x7f746c0579a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f747800c000 tx=0x7f7478008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:00.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.669+0000 7f747f7fe700 1 -- 172.21.15.133:0/1617252362 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7470043570 con 0x7f74880b2e00 2021-01-03T13:06:00.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.809+0000 7f748759e700 1 -- 172.21.15.133:0/1617252362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f748805ce00 con 0x7f74880b2e00 2021-01-03T13:06:00.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.813+0000 7f747f7fe700 1 -- 172.21.15.133:0/1617252362 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16113 (secure 0 0 0) 0x7f7470018020 con 0x7f74880b2e00 2021-01-03T13:06:00.820 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:00.820 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":113,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:06:00.180978+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:05:56.797390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-01-03T13:05:58.040406+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:06:00.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.813+0000 7f748759e700 1 -- 172.21.15.133:0/1617252362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f746c0554e0 msgr2=0x7f746c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:00.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.813+0000 7f748759e700 1 --2- 172.21.15.133:0/1617252362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f746c0554e0 0x7f746c0579a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f747800c000 tx=0x7f7478008040).stop 2021-01-03T13:06:00.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.813+0000 7f748759e700 1 -- 172.21.15.133:0/1617252362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74880b2e00 msgr2=0x7f7488142530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:00.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.813+0000 7f748759e700 1 --2- 172.21.15.133:0/1617252362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74880b2e00 0x7f7488142530 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f7488063f40 tx=0x7f7470007bd0).stop 2021-01-03T13:06:00.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.813+0000 7f748759e700 1 -- 172.21.15.133:0/1617252362 shutdown_connections 2021-01-03T13:06:00.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.813+0000 7f748759e700 1 --2- 172.21.15.133:0/1617252362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f746c0554e0 0x7f746c0579a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.813+0000 7f748759e700 1 --2- 172.21.15.133:0/1617252362 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7488141e10 0x7f74880b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.813+0000 7f748759e700 1 --2- 172.21.15.133:0/1617252362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74880b2e00 0x7f7488142530 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.813+0000 7f748759e700 1 --2- 172.21.15.133:0/1617252362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74880b72b0 0x7f7488131b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.813+0000 7f748759e700 1 -- 172.21.15.133:0/1617252362 >> 172.21.15.133:0/1617252362 conn(0x7f748805bdf0 msgr2=0x7f74880b62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:00.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.817+0000 7f748759e700 1 -- 172.21.15.133:0/1617252362 shutdown_connections 2021-01-03T13:06:00.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.817+0000 7f748759e700 1 -- 172.21.15.133:0/1617252362 wait complete. 2021-01-03T13:06:00.840 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:06:00.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.957+0000 7f040049e700 1 Processor -- start 2021-01-03T13:06:00.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.957+0000 7f040049e700 1 -- start start 2021-01-03T13:06:00.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.957+0000 7f040049e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03f8060b00 0x7f03f80af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.957+0000 7f040049e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f03f80abff0 0x7f03f80afee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.957+0000 7f040049e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f809a380 con 0x7f03f80b5120 2021-01-03T13:06:00.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.957+0000 7f040049e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f8062340 con 0x7f03f80abff0 2021-01-03T13:06:00.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.957+0000 7f040049e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f8060090 con 0x7f03f8060b00 2021-01-03T13:06:00.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f03fe23a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03f8060b00 0x7f03f80af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f03fe23a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03f8060b00 0x7f03f80af9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37908/0 (socket says 172.21.15.133:37908) 2021-01-03T13:06:00.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f03fe23a700 1 -- 172.21.15.133:0/3000971387 learned_addr learned my addr 172.21.15.133:0/3000971387 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:00.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f03ff23c700 1 --2- 172.21.15.133:0/3000971387 >> v2:172.21.15.16:3300/0 conn(0x7f03f80abff0 0x7f03f80afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f03fe23a700 1 -- 172.21.15.133:0/3000971387 >> v2:172.21.15.16:3300/0 conn(0x7f03f80abff0 msgr2=0x7f03f80afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:00.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f03fe23a700 1 --2- 172.21.15.133:0/3000971387 >> v2:172.21.15.16:3300/0 conn(0x7f03f80abff0 0x7f03f80afee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f03fe23a700 1 -- 172.21.15.133:0/3000971387 >> v1:172.21.15.16:6789/0 conn(0x7f03f80b5120 legacy=0x7f03f80ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:00.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f03fe23a700 1 -- 172.21.15.133:0/3000971387 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f8060330 con 0x7f03f8060b00 2021-01-03T13:06:00.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f03fe23a700 1 --2- 172.21.15.133:0/3000971387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8060b00 0x7f03f80af9f0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f03e8002f30 tx=0x7f03e8006e80).ready entity=mon.1 client_cookie=3e2e7addc24fe141 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:00.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f03fda39700 1 -- 172.21.15.133:0/3000971387 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03e80097f0 con 0x7f03f8060b00 2021-01-03T13:06:00.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f03fda39700 1 -- 172.21.15.133:0/3000971387 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e8009950 con 0x7f03f8060b00 2021-01-03T13:06:00.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f03fda39700 1 -- 172.21.15.133:0/3000971387 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03e8009cb0 con 0x7f03f8060b00 2021-01-03T13:06:00.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f040049e700 1 -- 172.21.15.133:0/3000971387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8060b00 msgr2=0x7f03f80af9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:00.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f040049e700 1 --2- 172.21.15.133:0/3000971387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8060b00 0x7f03f80af9f0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f03e8002f30 tx=0x7f03e8006e80).stop 2021-01-03T13:06:00.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f040049e700 1 -- 172.21.15.133:0/3000971387 shutdown_connections 2021-01-03T13:06:00.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f040049e700 1 --2- 172.21.15.133:0/3000971387 >> v2:172.21.15.16:3300/0 conn(0x7f03f80abff0 0x7f03f80afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f040049e700 1 --2- 172.21.15.133:0/3000971387 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8060b00 0x7f03f80af9f0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f040049e700 1 -- 172.21.15.133:0/3000971387 >> 172.21.15.133:0/3000971387 conn(0x7f03f805bdf0 msgr2=0x7f03f805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:00.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f040049e700 1 -- 172.21.15.133:0/3000971387 shutdown_connections 2021-01-03T13:06:00.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.961+0000 7f040049e700 1 -- 172.21.15.133:0/3000971387 wait complete. 2021-01-03T13:06:00.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f040049e700 1 Processor -- start 2021-01-03T13:06:00.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f040049e700 1 -- start start 2021-01-03T13:06:00.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f040049e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8060b00 0x7f03f8133f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f040049e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f03f80abff0 0x7f03f813ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f040049e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f80b5120 0x7f03f813efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f040049e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f812f870 con 0x7f03f80b5120 2021-01-03T13:06:00.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f040049e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f812fb10 con 0x7f03f8060b00 2021-01-03T13:06:00.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f040049e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f812fdb0 con 0x7f03f80abff0 2021-01-03T13:06:00.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f03fea3b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8060b00 0x7f03f8133f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f03fea3b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8060b00 0x7f03f8133f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37912/0 (socket says 172.21.15.133:37912) 2021-01-03T13:06:00.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f03fea3b700 1 -- 172.21.15.133:0/989028328 learned_addr learned my addr 172.21.15.133:0/989028328 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:00.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f03fe23a700 1 --2- 172.21.15.133:0/989028328 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f03f80abff0 0x7f03f813ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f03ff23c700 1 --2- 172.21.15.133:0/989028328 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f80b5120 0x7f03f813efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f03fea3b700 1 -- 172.21.15.133:0/989028328 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f03f80abff0 msgr2=0x7f03f813ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:00.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f03fea3b700 1 --2- 172.21.15.133:0/989028328 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f03f80abff0 0x7f03f813ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f03fea3b700 1 -- 172.21.15.133:0/989028328 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f80b5120 msgr2=0x7f03f813efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:00.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f03fea3b700 1 --2- 172.21.15.133:0/989028328 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f80b5120 0x7f03f813efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:00.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f03fea3b700 1 -- 172.21.15.133:0/989028328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f8130050 con 0x7f03f8060b00 2021-01-03T13:06:00.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f03fea3b700 1 --2- 172.21.15.133:0/989028328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8060b00 0x7f03f8133f20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f03f80aa890 tx=0x7f03f40013c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:00.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f03ef7fe700 1 -- 172.21.15.133:0/989028328 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f400a5a0 con 0x7f03f8060b00 2021-01-03T13:06:00.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.965+0000 7f03ef7fe700 1 -- 172.21.15.133:0/989028328 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f400a700 con 0x7f03f8060b00 2021-01-03T13:06:00.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.969+0000 7f040049e700 1 -- 172.21.15.133:0/989028328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f80afe30 con 0x7f03f8060b00 2021-01-03T13:06:00.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.969+0000 7f03ef7fe700 1 -- 172.21.15.133:0/989028328 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f400aa60 con 0x7f03f8060b00 2021-01-03T13:06:00.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.969+0000 7f040049e700 1 -- 172.21.15.133:0/989028328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f813f4b0 con 0x7f03f8060b00 2021-01-03T13:06:00.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.969+0000 7f040049e700 1 -- 172.21.15.133:0/989028328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f8130410 con 0x7f03f8060b00 2021-01-03T13:06:00.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.969+0000 7f03ef7fe700 1 -- 172.21.15.133:0/989028328 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f03f4019030 con 0x7f03f8060b00 2021-01-03T13:06:00.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.969+0000 7f03ef7fe700 1 --2- 172.21.15.133:0/989028328 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f03e0055470 0x7f03e0057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:00.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.969+0000 7f03fe23a700 1 --2- 172.21.15.133:0/989028328 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f03e0055470 0x7f03e0057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:00.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.969+0000 7f03ef7fe700 1 -- 172.21.15.133:0/989028328 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f03f406d730 con 0x7f03f8060b00 2021-01-03T13:06:00.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.969+0000 7f03fe23a700 1 --2- 172.21.15.133:0/989028328 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f03e0055470 0x7f03e0057930 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f03e801c000 tx=0x7f03e8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:00.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:00.977+0000 7f03ef7fe700 1 -- 172.21.15.133:0/989028328 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f03f4043a30 con 0x7f03f8060b00 2021-01-03T13:06:01.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.169+0000 7f040049e700 1 -- 172.21.15.133:0/989028328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f03f81301e0 con 0x7f03f8060b00 2021-01-03T13:06:01.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.177+0000 7f03ef7fe700 1 -- 172.21.15.133:0/989028328 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v25) v1 ==== 184+0+0 (secure 0 0 0) 0x7f03f4047050 con 0x7f03f8060b00 2021-01-03T13:06:01.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.181+0000 7f040049e700 1 -- 172.21.15.133:0/989028328 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f03e0055470 msgr2=0x7f03e0057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:01.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.181+0000 7f040049e700 1 --2- 172.21.15.133:0/989028328 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f03e0055470 0x7f03e0057930 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f03e801c000 tx=0x7f03e8015000).stop 2021-01-03T13:06:01.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.181+0000 7f040049e700 1 -- 172.21.15.133:0/989028328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8060b00 msgr2=0x7f03f8133f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:01.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.181+0000 7f040049e700 1 --2- 172.21.15.133:0/989028328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8060b00 0x7f03f8133f20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f03f80aa890 tx=0x7f03f40013c0).stop 2021-01-03T13:06:01.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.181+0000 7f040049e700 1 -- 172.21.15.133:0/989028328 shutdown_connections 2021-01-03T13:06:01.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.181+0000 7f040049e700 1 --2- 172.21.15.133:0/989028328 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f03e0055470 0x7f03e0057930 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.181+0000 7f040049e700 1 --2- 172.21.15.133:0/989028328 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03f80b5120 0x7f03f813efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.181+0000 7f040049e700 1 --2- 172.21.15.133:0/989028328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03f8060b00 0x7f03f8133f20 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.181+0000 7f040049e700 1 --2- 172.21.15.133:0/989028328 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f03f80abff0 0x7f03f813ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.181+0000 7f040049e700 1 -- 172.21.15.133:0/989028328 >> 172.21.15.133:0/989028328 conn(0x7f03f805bdf0 msgr2=0x7f03f80b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.181+0000 7f040049e700 1 -- 172.21.15.133:0/989028328 shutdown_connections 2021-01-03T13:06:01.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.181+0000 7f040049e700 1 -- 172.21.15.133:0/989028328 wait complete. 2021-01-03T13:06:01.191 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2021-01-03T13:06:01.201 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:06:01.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.325+0000 7f73e8d9a700 1 Processor -- start 2021-01-03T13:06:01.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.325+0000 7f73e8d9a700 1 -- start start 2021-01-03T13:06:01.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.325+0000 7f73e8d9a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73e4062450 0x7f73e4067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:01.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.325+0000 7f73e8d9a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e40adff0 con 0x7f73e40b33b0 2021-01-03T13:06:01.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.325+0000 7f73e8d9a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e405fb80 con 0x7f73e40adc10 2021-01-03T13:06:01.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.325+0000 7f73e8d9a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e40b1930 con 0x7f73e4062450 2021-01-03T13:06:01.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.325+0000 7f73e3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f73e40adc10 0x7f73e40b2ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58952/0 (socket says 172.21.15.133:58952) 2021-01-03T13:06:01.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.325+0000 7f73e3fff700 1 -- 172.21.15.133:0/202212400 learned_addr learned my addr 172.21.15.133:0/202212400 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:01.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.325+0000 7f73e37fe700 1 --2- 172.21.15.133:0/202212400 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73e4062450 0x7f73e4067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:01.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e2ffd700 1 -- 172.21.15.133:0/202212400 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 31486538 0 0) 0x7f73e405fb80 con 0x7f73e40adc10 2021-01-03T13:06:01.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e2ffd700 1 -- 172.21.15.133:0/202212400 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73cc003230 con 0x7f73e40adc10 2021-01-03T13:06:01.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e2ffd700 1 -- 172.21.15.133:0/202212400 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802728056 0 0) 0x7f73e40adff0 con 0x7f73e40b33b0 2021-01-03T13:06:01.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e2ffd700 1 -- 172.21.15.133:0/202212400 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73e405fb80 con 0x7f73e40b33b0 2021-01-03T13:06:01.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e37fe700 1 -- 172.21.15.133:0/202212400 >> v1:172.21.15.133:6789/0 conn(0x7f73e40adc10 legacy=0x7f73e40b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:01.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e2ffd700 1 -- 172.21.15.133:0/202212400 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 345004570 0 0) 0x7f73cc003230 con 0x7f73e40adc10 2021-01-03T13:06:01.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e37fe700 1 -- 172.21.15.133:0/202212400 >> v1:172.21.15.16:6789/0 conn(0x7f73e40b33b0 legacy=0x7f73e414f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:01.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e37fe700 1 -- 172.21.15.133:0/202212400 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e405fed0 con 0x7f73e4062450 2021-01-03T13:06:01.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e37fe700 1 --2- 172.21.15.133:0/202212400 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73e4062450 0x7f73e4067cb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f73d40010d0 tx=0x7f73d8006dc0).ready entity=mon.2 client_cookie=2235688c37f082db server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:01.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e2ffd700 1 -- 172.21.15.133:0/202212400 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d40016f0 con 0x7f73e4062450 2021-01-03T13:06:01.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e2ffd700 1 -- 172.21.15.133:0/202212400 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d800d5c0 con 0x7f73e4062450 2021-01-03T13:06:01.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e2ffd700 1 -- 172.21.15.133:0/202212400 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d800d730 con 0x7f73e4062450 2021-01-03T13:06:01.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e8d9a700 1 -- 172.21.15.133:0/202212400 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73e4062450 msgr2=0x7f73e4067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:01.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e8d9a700 1 --2- 172.21.15.133:0/202212400 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73e4062450 0x7f73e4067cb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f73d40010d0 tx=0x7f73d8006dc0).stop 2021-01-03T13:06:01.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e8d9a700 1 -- 172.21.15.133:0/202212400 shutdown_connections 2021-01-03T13:06:01.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e8d9a700 1 --2- 172.21.15.133:0/202212400 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73e4062450 0x7f73e4067cb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e8d9a700 1 -- 172.21.15.133:0/202212400 >> 172.21.15.133:0/202212400 conn(0x7f73e4060d10 msgr2=0x7f73e4061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:01.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e8d9a700 1 -- 172.21.15.133:0/202212400 shutdown_connections 2021-01-03T13:06:01.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.329+0000 7f73e8d9a700 1 -- 172.21.15.133:0/202212400 wait complete. 2021-01-03T13:06:01.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e8d9a700 1 Processor -- start 2021-01-03T13:06:01.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e8d9a700 1 -- start start 2021-01-03T13:06:01.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e8d9a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73e4062450 0x7f73e4131e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:01.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e8d9a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73e40adc10 0x7f73e4070520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:01.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e8d9a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f73e40b33b0 0x7f73e4070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:01.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e8d9a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e4153aa0 con 0x7f73e40b33b0 2021-01-03T13:06:01.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e8d9a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e4070f00 con 0x7f73e40adc10 2021-01-03T13:06:01.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e8d9a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e40669a0 con 0x7f73e4062450 2021-01-03T13:06:01.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73e40adc10 0x7f73e4070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:01.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73e40adc10 0x7f73e4070520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37926/0 (socket says 172.21.15.133:37926) 2021-01-03T13:06:01.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e37fe700 1 -- 172.21.15.133:0/209976049 learned_addr learned my addr 172.21.15.133:0/209976049 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:01.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e3fff700 1 --2- 172.21.15.133:0/209976049 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73e4062450 0x7f73e4131e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:01.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e9ffc700 1 --2- 172.21.15.133:0/209976049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f73e40b33b0 0x7f73e4070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:01.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e37fe700 1 -- 172.21.15.133:0/209976049 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73e4062450 msgr2=0x7f73e4131e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:01.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e37fe700 1 --2- 172.21.15.133:0/209976049 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73e4062450 0x7f73e4131e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e37fe700 1 -- 172.21.15.133:0/209976049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f73e40b33b0 msgr2=0x7f73e4070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:01.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e37fe700 1 --2- 172.21.15.133:0/209976049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f73e40b33b0 0x7f73e4070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e37fe700 1 -- 172.21.15.133:0/209976049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e4065080 con 0x7f73e40adc10 2021-01-03T13:06:01.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e3fff700 1 --2- 172.21.15.133:0/209976049 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73e4062450 0x7f73e4131e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:01.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e37fe700 1 --2- 172.21.15.133:0/209976049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73e40adc10 0x7f73e4070520 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f73e4064fa0 tx=0x7f73d8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:01.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e0ff9700 1 -- 172.21.15.133:0/209976049 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d8011c20 con 0x7f73e40adc10 2021-01-03T13:06:01.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e8d9a700 1 -- 172.21.15.133:0/209976049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e4065320 con 0x7f73e40adc10 2021-01-03T13:06:01.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e0ff9700 1 -- 172.21.15.133:0/209976049 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d8011d80 con 0x7f73e40adc10 2021-01-03T13:06:01.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e8d9a700 1 -- 172.21.15.133:0/209976049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e40655c0 con 0x7f73e40adc10 2021-01-03T13:06:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.333+0000 7f73e0ff9700 1 -- 172.21.15.133:0/209976049 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d801d640 con 0x7f73e40adc10 2021-01-03T13:06:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.337+0000 7f73e0ff9700 1 -- 172.21.15.133:0/209976049 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f73d8024030 con 0x7f73e40adc10 2021-01-03T13:06:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.337+0000 7f73e0ff9700 1 --2- 172.21.15.133:0/209976049 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f73c40554d0 0x7f73c4057990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.337+0000 7f73e8d9a700 1 -- 172.21.15.133:0/209976049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e4057300 con 0x7f73e40adc10 2021-01-03T13:06:01.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.337+0000 7f73e3fff700 1 --2- 172.21.15.133:0/209976049 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f73c40554d0 0x7f73c4057990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:01.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.337+0000 7f73e0ff9700 1 -- 172.21.15.133:0/209976049 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f73d806efe0 con 0x7f73e40adc10 2021-01-03T13:06:01.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.337+0000 7f73e3fff700 1 --2- 172.21.15.133:0/209976049 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f73c40554d0 0x7f73c4057990 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f73d400b000 tx=0x7f73d4001e50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:01.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.341+0000 7f73e0ff9700 1 -- 172.21.15.133:0/209976049 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f73d8022030 con 0x7f73e40adc10 2021-01-03T13:06:01.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.529+0000 7f73e8d9a700 1 -- 172.21.15.133:0/209976049 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f73e40702c0 con 0x7f73e40adc10 2021-01-03T13:06:01.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.537+0000 7f73e0ff9700 1 -- 172.21.15.133:0/209976049 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v26) v1 ==== 184+0+0 (secure 0 0 0) 0x7f73d802c020 con 0x7f73e40adc10 2021-01-03T13:06:01.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.537+0000 7f73e8d9a700 1 -- 172.21.15.133:0/209976049 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f73c40554d0 msgr2=0x7f73c4057990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:01.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.537+0000 7f73e8d9a700 1 --2- 172.21.15.133:0/209976049 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f73c40554d0 0x7f73c4057990 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f73d400b000 tx=0x7f73d4001e50).stop 2021-01-03T13:06:01.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.541+0000 7f73e8d9a700 1 -- 172.21.15.133:0/209976049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73e40adc10 msgr2=0x7f73e4070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:01.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.541+0000 7f73e8d9a700 1 --2- 172.21.15.133:0/209976049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73e40adc10 0x7f73e4070520 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f73e4064fa0 tx=0x7f73d8015000).stop 2021-01-03T13:06:01.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.541+0000 7f73e8d9a700 1 -- 172.21.15.133:0/209976049 shutdown_connections 2021-01-03T13:06:01.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.541+0000 7f73e8d9a700 1 --2- 172.21.15.133:0/209976049 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f73c40554d0 0x7f73c4057990 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.541+0000 7f73e8d9a700 1 --2- 172.21.15.133:0/209976049 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f73e40b33b0 0x7f73e4070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.541+0000 7f73e8d9a700 1 --2- 172.21.15.133:0/209976049 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f73e4062450 0x7f73e4131e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.541+0000 7f73e8d9a700 1 --2- 172.21.15.133:0/209976049 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73e40adc10 0x7f73e4070520 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.541+0000 7f73e8d9a700 1 -- 172.21.15.133:0/209976049 >> 172.21.15.133:0/209976049 conn(0x7f73e4060d10 msgr2=0x7f73e40ae3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:01.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.541+0000 7f73e8d9a700 1 -- 172.21.15.133:0/209976049 shutdown_connections 2021-01-03T13:06:01.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.541+0000 7f73e8d9a700 1 -- 172.21.15.133:0/209976049 wait complete. 2021-01-03T13:06:01.556 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.1 2021-01-03T13:06:01.560 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:06:01.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7af7ff700 1 Processor -- start 2021-01-03T13:06:01.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7af7ff700 1 -- start start 2021-01-03T13:06:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7af7ff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb7a805cc10 0x7fb7a81437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7af7ff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb7a80b02d0 0x7fb7a8146a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:01.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7af7ff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a805c510 con 0x7fb7a805c130 2021-01-03T13:06:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7af7ff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a80b0780 con 0x7fb7a80b02d0 2021-01-03T13:06:01.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7af7ff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80b5c10 con 0x7fb7a805cc10 2021-01-03T13:06:01.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7ad59b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb7a805c130 0x7fb7a8146370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58966/0 (socket says 172.21.15.133:58966) 2021-01-03T13:06:01.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7ad59b700 1 -- 172.21.15.133:0/58290661 learned_addr learned my addr 172.21.15.133:0/58290661 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:01.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7add9c700 1 --2- 172.21.15.133:0/58290661 >> v2:172.21.15.16:3300/0 conn(0x7fb7a80b02d0 0x7fb7a8146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:01.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7acd9a700 1 --2- 172.21.15.133:0/58290661 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb7a805cc10 0x7fb7a81437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:01.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb79ffff700 1 -- 172.21.15.133:0/58290661 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863462127 0 0) 0x7fb7a805c510 con 0x7fb7a805c130 2021-01-03T13:06:01.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb79ffff700 1 -- 172.21.15.133:0/58290661 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb78c003230 con 0x7fb7a805c130 2021-01-03T13:06:01.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7add9c700 1 -- 172.21.15.133:0/58290661 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb7a805cc10 msgr2=0x7fb7a81437e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:01.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7add9c700 1 --2- 172.21.15.133:0/58290661 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb7a805cc10 0x7fb7a81437e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7add9c700 1 -- 172.21.15.133:0/58290661 >> v1:172.21.15.133:6789/0 conn(0x7fb7a805c130 legacy=0x7fb7a8146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:01.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7add9c700 1 -- 172.21.15.133:0/58290661 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a80af8f0 con 0x7fb7a80b02d0 2021-01-03T13:06:01.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7add9c700 1 --2- 172.21.15.133:0/58290661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7a80b02d0 0x7fb7a8146a80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fb7a0002f30 tx=0x7fb7a0006dc0).ready entity=mon.0 client_cookie=a6cf7ad5e3d77a82 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:01.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb79ffff700 1 -- 172.21.15.133:0/58290661 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7a00096a0 con 0x7fb7a80b02d0 2021-01-03T13:06:01.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb79ffff700 1 -- 172.21.15.133:0/58290661 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a0009800 con 0x7fb7a80b02d0 2021-01-03T13:06:01.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7af7ff700 1 -- 172.21.15.133:0/58290661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7a80b02d0 msgr2=0x7fb7a8146a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:01.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb79ffff700 1 -- 172.21.15.133:0/58290661 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7a0009b60 con 0x7fb7a80b02d0 2021-01-03T13:06:01.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.669+0000 7fb7af7ff700 1 --2- 172.21.15.133:0/58290661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7a80b02d0 0x7fb7a8146a80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fb7a0002f30 tx=0x7fb7a0006dc0).stop 2021-01-03T13:06:01.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.673+0000 7fb7af7ff700 1 -- 172.21.15.133:0/58290661 shutdown_connections 2021-01-03T13:06:01.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.673+0000 7fb7af7ff700 1 --2- 172.21.15.133:0/58290661 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7a80b02d0 0x7fb7a8146a80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.673+0000 7fb7af7ff700 1 --2- 172.21.15.133:0/58290661 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb7a805cc10 0x7fb7a81437e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.673+0000 7fb7af7ff700 1 -- 172.21.15.133:0/58290661 >> 172.21.15.133:0/58290661 conn(0x7fb7a80b95d0 msgr2=0x7fb7a80b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:01.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.673+0000 7fb7af7ff700 1 -- 172.21.15.133:0/58290661 shutdown_connections 2021-01-03T13:06:01.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.673+0000 7fb7af7ff700 1 -- 172.21.15.133:0/58290661 wait complete. 2021-01-03T13:06:01.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.673+0000 7fb7af7ff700 1 Processor -- start 2021-01-03T13:06:01.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.673+0000 7fb7af7ff700 1 -- start start 2021-01-03T13:06:01.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.673+0000 7fb7af7ff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7a805c130 0x7fb7a80b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:01.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.673+0000 7fb7af7ff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a805cc10 0x7fb7a8155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:01.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.673+0000 7fb7af7ff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb7a80b02d0 0x7fb7a8155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:01.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.673+0000 7fb7af7ff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80b7ce0 con 0x7fb7a805c130 2021-01-03T13:06:01.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.673+0000 7fb7af7ff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80b8f50 con 0x7fb7a805cc10 2021-01-03T13:06:01.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.673+0000 7fb7af7ff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a809f420 con 0x7fb7a80b02d0 2021-01-03T13:06:01.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.673+0000 7fb7acd9a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a805cc10 0x7fb7a8155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:01.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.677+0000 7fb7ad59b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7a805c130 0x7fb7a80b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:01.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.677+0000 7fb7acd9a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a805cc10 0x7fb7a8155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37944/0 (socket says 172.21.15.133:37944) 2021-01-03T13:06:01.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.677+0000 7fb7acd9a700 1 -- 172.21.15.133:0/2362719288 learned_addr learned my addr 172.21.15.133:0/2362719288 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:01.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.677+0000 7fb7add9c700 1 --2- 172.21.15.133:0/2362719288 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb7a80b02d0 0x7fb7a8155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:01.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.677+0000 7fb7acd9a700 1 -- 172.21.15.133:0/2362719288 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb7a80b02d0 msgr2=0x7fb7a8155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:01.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.677+0000 7fb7acd9a700 1 --2- 172.21.15.133:0/2362719288 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb7a80b02d0 0x7fb7a8155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.706 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.677+0000 7fb7acd9a700 1 -- 172.21.15.133:0/2362719288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7a805c130 msgr2=0x7fb7a80b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:01.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.677+0000 7fb7acd9a700 1 --2- 172.21.15.133:0/2362719288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7a805c130 0x7fb7a80b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.677+0000 7fb7acd9a700 1 -- 172.21.15.133:0/2362719288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a809f6c0 con 0x7fb7a805cc10 2021-01-03T13:06:01.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.677+0000 7fb7acd9a700 1 --2- 172.21.15.133:0/2362719288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a805cc10 0x7fb7a8155780 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fb79800c000 tx=0x7fb798008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:01.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.677+0000 7fb79e7fc700 1 -- 172.21.15.133:0/2362719288 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb79800ca10 con 0x7fb7a805cc10 2021-01-03T13:06:01.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.677+0000 7fb7af7ff700 1 -- 172.21.15.133:0/2362719288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a80b76e0 con 0x7fb7a805cc10 2021-01-03T13:06:01.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.677+0000 7fb79e7fc700 1 -- 172.21.15.133:0/2362719288 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79800cb70 con 0x7fb7a805cc10 2021-01-03T13:06:01.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.677+0000 7fb79e7fc700 1 -- 172.21.15.133:0/2362719288 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb79800ee80 con 0x7fb7a805cc10 2021-01-03T13:06:01.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.677+0000 7fb7af7ff700 1 -- 172.21.15.133:0/2362719288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a80b8cc0 con 0x7fb7a805cc10 2021-01-03T13:06:01.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.677+0000 7fb7af7ff700 1 -- 172.21.15.133:0/2362719288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a8057300 con 0x7fb7a805cc10 2021-01-03T13:06:01.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.677+0000 7fb79e7fc700 1 -- 172.21.15.133:0/2362719288 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb79801c460 con 0x7fb7a805cc10 2021-01-03T13:06:01.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.681+0000 7fb79e7fc700 1 --2- 172.21.15.133:0/2362719288 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb7900553f0 0x7fb7900578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:01.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.681+0000 7fb79e7fc700 1 -- 172.21.15.133:0/2362719288 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb79806e4b0 con 0x7fb7a805cc10 2021-01-03T13:06:01.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.681+0000 7fb7ad59b700 1 --2- 172.21.15.133:0/2362719288 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb7900553f0 0x7fb7900578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:01.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.681+0000 7fb7ad59b700 1 --2- 172.21.15.133:0/2362719288 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb7900553f0 0x7fb7900578b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fb7a400d000 tx=0x7fb7a4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:01.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.685+0000 7fb79e7fc700 1 -- 172.21.15.133:0/2362719288 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb7980446b0 con 0x7fb7a805cc10 2021-01-03T13:06:01.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.873+0000 7fb7af7ff700 1 -- 172.21.15.133:0/2362719288 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7a80b6f10 con 0x7fb7a805cc10 2021-01-03T13:06:01.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.873+0000 7fb79e7fc700 1 -- 172.21.15.133:0/2362719288 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+2499 (secure 0 0 0) 0x7fb798047cd0 con 0x7fb7a805cc10 2021-01-03T13:06:01.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.873+0000 7fb7af7ff700 1 -- 172.21.15.133:0/2362719288 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb7900553f0 msgr2=0x7fb7900578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:01.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.873+0000 7fb7af7ff700 1 --2- 172.21.15.133:0/2362719288 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb7900553f0 0x7fb7900578b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fb7a400d000 tx=0x7fb7a4009040).stop 2021-01-03T13:06:01.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.873+0000 7fb7af7ff700 1 -- 172.21.15.133:0/2362719288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a805cc10 msgr2=0x7fb7a8155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:01.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.873+0000 7fb7af7ff700 1 --2- 172.21.15.133:0/2362719288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a805cc10 0x7fb7a8155780 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fb79800c000 tx=0x7fb798008040).stop 2021-01-03T13:06:01.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.873+0000 7fb7af7ff700 1 -- 172.21.15.133:0/2362719288 shutdown_connections 2021-01-03T13:06:01.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.873+0000 7fb7af7ff700 1 --2- 172.21.15.133:0/2362719288 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb7900553f0 0x7fb7900578b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.873+0000 7fb7af7ff700 1 --2- 172.21.15.133:0/2362719288 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7a805c130 0x7fb7a80b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.873+0000 7fb7af7ff700 1 --2- 172.21.15.133:0/2362719288 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb7a80b02d0 0x7fb7a8155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.873+0000 7fb7af7ff700 1 --2- 172.21.15.133:0/2362719288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7a805cc10 0x7fb7a8155780 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:01.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.873+0000 7fb7af7ff700 1 -- 172.21.15.133:0/2362719288 >> 172.21.15.133:0/2362719288 conn(0x7fb7a80b95d0 msgr2=0x7fb7a81441a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:01.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.873+0000 7fb7af7ff700 1 -- 172.21.15.133:0/2362719288 shutdown_connections 2021-01-03T13:06:01.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:01.873+0000 7fb7af7ff700 1 -- 172.21.15.133:0/2362719288 wait complete. 2021-01-03T13:06:01.888 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:01.888 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":49,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7108,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/2670125727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2670125727},{"type":"v1","addr":"172.21.15.133:6835","nonce":2670125727}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47},{"gid":7120,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6837/3964151526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3964151526},{"type":"v1","addr":"172.21.15.133:6837","nonce":3964151526}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:59.178144+0000","modified":"2021-01-03T13:06:00.181997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7123},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7123":{"gid":7123,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/1643460453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1643460453},{"type":"v1","addr":"172.21.15.16:6833","nonce":1643460453}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-01-03T13:06:01.889 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 49 2021-01-03T13:06:02.195 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:05:59.178144+0000', 'modified': '2021-01-03T13:06:00.181997+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7123}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7123': {'gid': 7123, 'name': 'b', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.16:6833/1643460453', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6832', 'nonce': 1643460453}, {'type': 'v1', 'addr': '172.21.15.16:6833', 'nonce': 1643460453}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:06:02.196 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:06:02.197 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-01-03T13:06:02.328 INFO:teuthology.orchestra.run.smithi016.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":7123,"want_state":"up:active","state":"up:active","rank_uptime":3.1353165569999999,"mdsmap_epoch":49,"osdmap_epoch":114,"osdmap_epoch_barrier":113,"uptime":8.5088668720000005} 2021-01-03T13:06:02.328 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 7123, "mdsmap_epoch": 49, "osdmap_epoch": 114, "osdmap_epoch_barrier": 113, "rank_uptime": 3.135316557, "state": "up:active", "uptime": 8.508866872, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:06:02.329 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:06:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.441+0000 7ff22f0dc700 1 Processor -- start 2021-01-03T13:06:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.441+0000 7ff22f0dc700 1 -- start start 2021-01-03T13:06:02.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.441+0000 7ff22f0dc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff228060510 0x7ff22805c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:02.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.441+0000 7ff22f0dc700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2280b6cf0 con 0x7ff22805fd10 2021-01-03T13:06:02.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.441+0000 7ff22f0dc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22805bf00 con 0x7ff2280b4c20 2021-01-03T13:06:02.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.441+0000 7ff22f0dc700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22805c1a0 con 0x7ff228060510 2021-01-03T13:06:02.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.441+0000 7ff22e0da700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff2280b4c20 0x7ff2280b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58980/0 (socket says 172.21.15.133:58980) 2021-01-03T13:06:02.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.441+0000 7ff22e0da700 1 -- 172.21.15.133:0/2265972655 learned_addr learned my addr 172.21.15.133:0/2265972655 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:02.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.441+0000 7ff22d8d9700 1 --2- 172.21.15.133:0/2265972655 >> v2:172.21.15.16:3300/0 conn(0x7ff228060510 0x7ff22805c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:02.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.441+0000 7ff22d0d8700 1 -- 172.21.15.133:0/2265972655 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279368711 0 0) 0x7ff22805bf00 con 0x7ff2280b4c20 2021-01-03T13:06:02.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.441+0000 7ff22d0d8700 1 -- 172.21.15.133:0/2265972655 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff210003230 con 0x7ff2280b4c20 2021-01-03T13:06:02.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 -- 172.21.15.133:0/2265972655 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005097967 0 0) 0x7ff2280b6cf0 con 0x7ff22805fd10 2021-01-03T13:06:02.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 -- 172.21.15.133:0/2265972655 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff22805bf00 con 0x7ff22805fd10 2021-01-03T13:06:02.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 -- 172.21.15.133:0/2265972655 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 182000475 0 0) 0x7ff210003230 con 0x7ff2280b4c20 2021-01-03T13:06:02.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 -- 172.21.15.133:0/2265972655 >> v2:172.21.15.16:3300/0 conn(0x7ff228060510 msgr2=0x7ff22805c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:02.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 --2- 172.21.15.133:0/2265972655 >> v2:172.21.15.16:3300/0 conn(0x7ff228060510 0x7ff22805c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:02.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 -- 172.21.15.133:0/2265972655 >> v1:172.21.15.16:6789/0 conn(0x7ff22805fd10 legacy=0x7ff2280b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:02.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 -- 172.21.15.133:0/2265972655 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22805c440 con 0x7ff2280b4c20 2021-01-03T13:06:02.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 -- 172.21.15.133:0/2265972655 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7ff2240016d0 con 0x7ff2280b4c20 2021-01-03T13:06:02.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 -- 172.21.15.133:0/2265972655 >> v1:172.21.15.133:6789/0 conn(0x7ff2280b4c20 legacy=0x7ff2280b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:02.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 --2- 172.21.15.133:0/2265972655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100038b0 0x7ff210003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:02.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 --2- 172.21.15.133:0/2265972655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2100044d0 0x7ff210004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:02.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 --2- 172.21.15.133:0/2265972655 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff210004e40 0x7ff21000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:02.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 -- 172.21.15.133:0/2265972655 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22805c1a0 con 0x7ff2100038b0 2021-01-03T13:06:02.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 -- 172.21.15.133:0/2265972655 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2100053a0 con 0x7ff2100044d0 2021-01-03T13:06:02.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 -- 172.21.15.133:0/2265972655 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21000bc90 con 0x7ff210004e40 2021-01-03T13:06:02.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d8d9700 1 --2- 172.21.15.133:0/2265972655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2100044d0 0x7ff210004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:02.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22e0da700 1 --2- 172.21.15.133:0/2265972655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100038b0 0x7ff210003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:02.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22e8db700 1 --2- 172.21.15.133:0/2265972655 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff210004e40 0x7ff21000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:02.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d8d9700 1 -- 172.21.15.133:0/2265972655 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff210004e40 msgr2=0x7ff21000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:02.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d8d9700 1 --2- 172.21.15.133:0/2265972655 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff210004e40 0x7ff21000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:02.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d8d9700 1 -- 172.21.15.133:0/2265972655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100038b0 msgr2=0x7ff210003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:02.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d8d9700 1 --2- 172.21.15.133:0/2265972655 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100038b0 0x7ff210003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:02.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d8d9700 1 -- 172.21.15.133:0/2265972655 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff210003230 con 0x7ff2100044d0 2021-01-03T13:06:02.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22e8db700 1 --2- 172.21.15.133:0/2265972655 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff210004e40 0x7ff21000b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:06:02.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22e8db700 1 -- 172.21.15.133:0/2265972655 reap_dead start 2021-01-03T13:06:02.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d8d9700 1 --2- 172.21.15.133:0/2265972655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2100044d0 0x7ff210004950 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7ff21800c000 tx=0x7ff218008040).ready entity=mon.1 client_cookie=15d1e915b8f3fa65 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:02.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 -- 172.21.15.133:0/2265972655 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff21800e9d0 con 0x7ff2100044d0 2021-01-03T13:06:02.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 -- 172.21.15.133:0/2265972655 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21800eb30 con 0x7ff2100044d0 2021-01-03T13:06:02.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22d0d8700 1 -- 172.21.15.133:0/2265972655 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff21800ee90 con 0x7ff2100044d0 2021-01-03T13:06:02.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22f0dc700 1 -- 172.21.15.133:0/2265972655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2100044d0 msgr2=0x7ff210004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:02.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22f0dc700 1 --2- 172.21.15.133:0/2265972655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2100044d0 0x7ff210004950 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7ff21800c000 tx=0x7ff218008040).stop 2021-01-03T13:06:02.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22f0dc700 1 -- 172.21.15.133:0/2265972655 shutdown_connections 2021-01-03T13:06:02.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22f0dc700 1 --2- 172.21.15.133:0/2265972655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2100044d0 0x7ff210004950 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:02.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22f0dc700 1 -- 172.21.15.133:0/2265972655 >> 172.21.15.133:0/2265972655 conn(0x7ff2280b9f00 msgr2=0x7ff2280b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:02.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22f0dc700 1 -- 172.21.15.133:0/2265972655 shutdown_connections 2021-01-03T13:06:02.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.445+0000 7ff22f0dc700 1 -- 172.21.15.133:0/2265972655 wait complete. 2021-01-03T13:06:02.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22f0dc700 1 Processor -- start 2021-01-03T13:06:02.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22f0dc700 1 -- start start 2021-01-03T13:06:02.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22f0dc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100044d0 0x7ff22813c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:02.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22f0dc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2280b22b0 0x7ff22813a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:02.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22f0dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff22813aaf0 0x7ff228155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:02.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22f0dc700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2280b28c0 con 0x7ff2100044d0 2021-01-03T13:06:02.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22f0dc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2280b2af0 con 0x7ff22813aaf0 2021-01-03T13:06:02.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22f0dc700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2280b2d90 con 0x7ff2280b22b0 2021-01-03T13:06:02.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22e8db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff22813aaf0 0x7ff228155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:02.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22e8db700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff22813aaf0 0x7ff228155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37964/0 (socket says 172.21.15.133:37964) 2021-01-03T13:06:02.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22e8db700 1 -- 172.21.15.133:0/3084965530 learned_addr learned my addr 172.21.15.133:0/3084965530 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:02.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22e0da700 1 --2- 172.21.15.133:0/3084965530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100044d0 0x7ff22813c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:02.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22d8d9700 1 --2- 172.21.15.133:0/3084965530 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2280b22b0 0x7ff22813a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:02.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22e8db700 1 -- 172.21.15.133:0/3084965530 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2280b22b0 msgr2=0x7ff22813a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:02.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22e8db700 1 --2- 172.21.15.133:0/3084965530 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2280b22b0 0x7ff22813a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:02.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22e8db700 1 -- 172.21.15.133:0/3084965530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100044d0 msgr2=0x7ff22813c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:02.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22e8db700 1 --2- 172.21.15.133:0/3084965530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100044d0 0x7ff22813c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:02.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22e8db700 1 -- 172.21.15.133:0/3084965530 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2280b3030 con 0x7ff22813aaf0 2021-01-03T13:06:02.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22e8db700 1 --2- 172.21.15.133:0/3084965530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff22813aaf0 0x7ff228155240 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7ff2280b7900 tx=0x7ff220009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:02.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff2177fe700 1 -- 172.21.15.133:0/3084965530 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2200032e0 con 0x7ff22813aaf0 2021-01-03T13:06:02.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22f0dc700 1 -- 172.21.15.133:0/3084965530 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2280b32d0 con 0x7ff22813aaf0 2021-01-03T13:06:02.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22f0dc700 1 -- 172.21.15.133:0/3084965530 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22813af70 con 0x7ff22813aaf0 2021-01-03T13:06:02.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff2177fe700 1 -- 172.21.15.133:0/3084965530 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff220003440 con 0x7ff22813aaf0 2021-01-03T13:06:02.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff2177fe700 1 -- 172.21.15.133:0/3084965530 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff220001890 con 0x7ff22813aaf0 2021-01-03T13:06:02.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.449+0000 7ff22f0dc700 1 -- 172.21.15.133:0/3084965530 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff228057300 con 0x7ff22813aaf0 2021-01-03T13:06:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.453+0000 7ff2177fe700 1 -- 172.21.15.133:0/3084965530 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff2200019f0 con 0x7ff22813aaf0 2021-01-03T13:06:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.453+0000 7ff2177fe700 1 --2- 172.21.15.133:0/3084965530 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff208055500 0x7ff2080579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.453+0000 7ff2177fe700 1 -- 172.21.15.133:0/3084965530 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff22006d920 con 0x7ff22813aaf0 2021-01-03T13:06:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.453+0000 7ff22e0da700 1 --2- 172.21.15.133:0/3084965530 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff208055500 0x7ff2080579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.453+0000 7ff22e0da700 1 --2- 172.21.15.133:0/3084965530 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff208055500 0x7ff2080579c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7ff22400d000 tx=0x7ff224007040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.457+0000 7ff2177fe700 1 -- 172.21.15.133:0/3084965530 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff220043c20 con 0x7ff22813aaf0 2021-01-03T13:06:02.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.601+0000 7ff22f0dc700 1 -- 172.21.15.133:0/3084965530 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2280b02b0 con 0x7ff22813aaf0 2021-01-03T13:06:02.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.605+0000 7ff2177fe700 1 -- 172.21.15.133:0/3084965530 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+16100 (secure 0 0 0) 0x7ff22001b070 con 0x7ff22813aaf0 2021-01-03T13:06:02.609 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:02.609 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":114,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:06:01.689575+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:05:56.797390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-01-03T13:05:58.040406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:06:02.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.605+0000 7ff22f0dc700 1 -- 172.21.15.133:0/3084965530 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff208055500 msgr2=0x7ff2080579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:02.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.605+0000 7ff22f0dc700 1 --2- 172.21.15.133:0/3084965530 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff208055500 0x7ff2080579c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7ff22400d000 tx=0x7ff224007040).stop 2021-01-03T13:06:02.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.605+0000 7ff22f0dc700 1 -- 172.21.15.133:0/3084965530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff22813aaf0 msgr2=0x7ff228155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:02.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.605+0000 7ff22f0dc700 1 --2- 172.21.15.133:0/3084965530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff22813aaf0 0x7ff228155240 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7ff2280b7900 tx=0x7ff220009040).stop 2021-01-03T13:06:02.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.605+0000 7ff22f0dc700 1 -- 172.21.15.133:0/3084965530 shutdown_connections 2021-01-03T13:06:02.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.605+0000 7ff22f0dc700 1 --2- 172.21.15.133:0/3084965530 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff208055500 0x7ff2080579c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:02.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.605+0000 7ff22f0dc700 1 --2- 172.21.15.133:0/3084965530 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2100044d0 0x7ff22813c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:02.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.605+0000 7ff22f0dc700 1 --2- 172.21.15.133:0/3084965530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff22813aaf0 0x7ff228155240 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:02.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.605+0000 7ff22f0dc700 1 --2- 172.21.15.133:0/3084965530 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2280b22b0 0x7ff22813a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:02.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.605+0000 7ff22f0dc700 1 -- 172.21.15.133:0/3084965530 >> 172.21.15.133:0/3084965530 conn(0x7ff2280b9f00 msgr2=0x7ff2280b5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:02.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.605+0000 7ff22f0dc700 1 -- 172.21.15.133:0/3084965530 shutdown_connections 2021-01-03T13:06:02.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.605+0000 7ff22f0dc700 1 -- 172.21.15.133:0/3084965530 wait complete. 2021-01-03T13:06:02.624 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:05:56.797390+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:05:58.040406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:06:02.625 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:06:02.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.737+0000 7f686da1f700 1 Processor -- start 2021-01-03T13:06:02.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.737+0000 7f686da1f700 1 -- start start 2021-01-03T13:06:02.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.737+0000 7f686da1f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6868146b40 0x7f686814e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:02.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.737+0000 7f686da1f700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68680605f0 con 0x7f68680b9f40 2021-01-03T13:06:02.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.737+0000 7f686da1f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68680600b0 con 0x7f68680b9b60 2021-01-03T13:06:02.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.737+0000 7f686da1f700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68680aed30 con 0x7f6868146b40 2021-01-03T13:06:02.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f686ca1d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f68680b9b60 0x7f68680b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59000/0 (socket says 172.21.15.133:59000) 2021-01-03T13:06:02.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f686ca1d700 1 -- 172.21.15.133:0/1365653107 learned_addr learned my addr 172.21.15.133:0/1365653107 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:02.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f686d21e700 1 --2- 172.21.15.133:0/1365653107 >> v2:172.21.15.16:3300/0 conn(0x7f6868146b40 0x7f686814e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:02.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f68677fe700 1 -- 172.21.15.133:0/1365653107 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625791863 0 0) 0x7f68680600b0 con 0x7f68680b9b60 2021-01-03T13:06:02.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f68677fe700 1 -- 172.21.15.133:0/1365653107 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6848003230 con 0x7f68680b9b60 2021-01-03T13:06:02.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f686d21e700 1 -- 172.21.15.133:0/1365653107 >> v1:172.21.15.133:6789/0 conn(0x7f68680b9b60 legacy=0x7f68680b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:02.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f686d21e700 1 -- 172.21.15.133:0/1365653107 >> v1:172.21.15.16:6789/0 conn(0x7f68680b9f40 legacy=0x7f6868146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:02.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f686d21e700 1 -- 172.21.15.133:0/1365653107 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6868060350 con 0x7f6868146b40 2021-01-03T13:06:02.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f686d21e700 1 --2- 172.21.15.133:0/1365653107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6868146b40 0x7f686814e510 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f68600032b0 tx=0x7f68600091a0).ready entity=mon.0 client_cookie=dbfb10168fd19c23 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:02.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f68677fe700 1 -- 172.21.15.133:0/1365653107 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f686000b9a0 con 0x7f6868146b40 2021-01-03T13:06:02.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f68677fe700 1 -- 172.21.15.133:0/1365653107 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686000bb00 con 0x7f6868146b40 2021-01-03T13:06:02.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f68677fe700 1 -- 172.21.15.133:0/1365653107 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f686000bc70 con 0x7f6868146b40 2021-01-03T13:06:02.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f686da1f700 1 -- 172.21.15.133:0/1365653107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6868146b40 msgr2=0x7f686814e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:02.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f686da1f700 1 --2- 172.21.15.133:0/1365653107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6868146b40 0x7f686814e510 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f68600032b0 tx=0x7f68600091a0).stop 2021-01-03T13:06:02.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f686da1f700 1 -- 172.21.15.133:0/1365653107 shutdown_connections 2021-01-03T13:06:02.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f686da1f700 1 --2- 172.21.15.133:0/1365653107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6868146b40 0x7f686814e510 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:02.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f686da1f700 1 -- 172.21.15.133:0/1365653107 >> 172.21.15.133:0/1365653107 conn(0x7f68680b69e0 msgr2=0x7f68680b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:02.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f686da1f700 1 -- 172.21.15.133:0/1365653107 shutdown_connections 2021-01-03T13:06:02.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f686da1f700 1 -- 172.21.15.133:0/1365653107 wait complete. 2021-01-03T13:06:02.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f686da1f700 1 Processor -- start 2021-01-03T13:06:02.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.741+0000 7f686da1f700 1 -- start start 2021-01-03T13:06:02.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686da1f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68680b9b60 0x7f686809ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:02.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686da1f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68680b9f40 0x7f68680b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:02.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686da1f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6868146b40 0x7f68680b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:02.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686da1f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686809ca40 con 0x7f68680b9f40 2021-01-03T13:06:02.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686da1f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68680b1c80 con 0x7f68680b9b60 2021-01-03T13:06:02.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686da1f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68680b3790 con 0x7f6868146b40 2021-01-03T13:06:02.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686ca1d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68680b9b60 0x7f686809ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:02.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686ca1d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68680b9b60 0x7f686809ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37972/0 (socket says 172.21.15.133:37972) 2021-01-03T13:06:02.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686ca1d700 1 -- 172.21.15.133:0/3456857352 learned_addr learned my addr 172.21.15.133:0/3456857352 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:02.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686d21e700 1 --2- 172.21.15.133:0/3456857352 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6868146b40 0x7f68680b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:02.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f6867fff700 1 --2- 172.21.15.133:0/3456857352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68680b9f40 0x7f68680b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:02.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686ca1d700 1 -- 172.21.15.133:0/3456857352 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6868146b40 msgr2=0x7f68680b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:02.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686ca1d700 1 --2- 172.21.15.133:0/3456857352 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6868146b40 0x7f68680b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:02.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686ca1d700 1 -- 172.21.15.133:0/3456857352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68680b9f40 msgr2=0x7f68680b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:02.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686ca1d700 1 --2- 172.21.15.133:0/3456857352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68680b9f40 0x7f68680b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:02.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686ca1d700 1 -- 172.21.15.133:0/3456857352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686809d350 con 0x7f68680b9b60 2021-01-03T13:06:02.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686ca1d700 1 --2- 172.21.15.133:0/3456857352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68680b9b60 0x7f686809ce60 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f68580010d0 tx=0x7f6858007a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:02.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f6865ffb700 1 -- 172.21.15.133:0/3456857352 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68580072e0 con 0x7f68680b9b60 2021-01-03T13:06:02.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686da1f700 1 -- 172.21.15.133:0/3456857352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686814a110 con 0x7f68680b9b60 2021-01-03T13:06:02.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f6865ffb700 1 -- 172.21.15.133:0/3456857352 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6858007440 con 0x7f68680b9b60 2021-01-03T13:06:02.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686da1f700 1 -- 172.21.15.133:0/3456857352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68680b34f0 con 0x7f68680b9b60 2021-01-03T13:06:02.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f6865ffb700 1 -- 172.21.15.133:0/3456857352 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68580055c0 con 0x7f68680b9b60 2021-01-03T13:06:02.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f686da1f700 1 -- 172.21.15.133:0/3456857352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686809c830 con 0x7f68680b9b60 2021-01-03T13:06:02.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f6865ffb700 1 -- 172.21.15.133:0/3456857352 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6858010070 con 0x7f68680b9b60 2021-01-03T13:06:02.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f6865ffb700 1 --2- 172.21.15.133:0/3456857352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f684c055440 0x7f684c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:02.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f6865ffb700 1 -- 172.21.15.133:0/3456857352 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f685806d370 con 0x7f68680b9b60 2021-01-03T13:06:02.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.745+0000 7f6867fff700 1 --2- 172.21.15.133:0/3456857352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f684c055440 0x7f684c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:02.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.749+0000 7f6867fff700 1 --2- 172.21.15.133:0/3456857352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f684c055440 0x7f684c057900 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f685000b000 tx=0x7f6850009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:02.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.753+0000 7f6865ffb700 1 -- 172.21.15.133:0/3456857352 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6858043570 con 0x7f68680b9b60 2021-01-03T13:06:02.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.897+0000 7f686da1f700 1 -- 172.21.15.133:0/3456857352 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f686809d350 con 0x7f68680b9b60 2021-01-03T13:06:02.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.897+0000 7f6865ffb700 1 -- 172.21.15.133:0/3456857352 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v114) v1 ==== 110+0+10 (secure 0 0 0) 0x7f686809d350 con 0x7f68680b9b60 2021-01-03T13:06:02.902 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:06:02.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.901+0000 7f686da1f700 1 -- 172.21.15.133:0/3456857352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f684c055440 msgr2=0x7f684c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:02.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.901+0000 7f686da1f700 1 --2- 172.21.15.133:0/3456857352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f684c055440 0x7f684c057900 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f685000b000 tx=0x7f6850009040).stop 2021-01-03T13:06:02.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.901+0000 7f686da1f700 1 -- 172.21.15.133:0/3456857352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68680b9b60 msgr2=0x7f686809ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:02.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.901+0000 7f686da1f700 1 --2- 172.21.15.133:0/3456857352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68680b9b60 0x7f686809ce60 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f68580010d0 tx=0x7f6858007a70).stop 2021-01-03T13:06:02.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.901+0000 7f686da1f700 1 -- 172.21.15.133:0/3456857352 shutdown_connections 2021-01-03T13:06:02.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.901+0000 7f686da1f700 1 --2- 172.21.15.133:0/3456857352 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f684c055440 0x7f684c057900 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:02.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.901+0000 7f686da1f700 1 --2- 172.21.15.133:0/3456857352 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6868146b40 0x7f68680b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:02.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.901+0000 7f686da1f700 1 --2- 172.21.15.133:0/3456857352 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68680b9b60 0x7f686809ce60 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:02.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.901+0000 7f686da1f700 1 --2- 172.21.15.133:0/3456857352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68680b9f40 0x7f68680b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:02.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.901+0000 7f686da1f700 1 -- 172.21.15.133:0/3456857352 >> 172.21.15.133:0/3456857352 conn(0x7f68680b69e0 msgr2=0x7f68680b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:02.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.901+0000 7f686da1f700 1 -- 172.21.15.133:0/3456857352 shutdown_connections 2021-01-03T13:06:02.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:02.901+0000 7f686da1f700 1 -- 172.21.15.133:0/3456857352 wait complete. 2021-01-03T13:06:02.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:06:03.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.033+0000 7f190b534700 1 Processor -- start 2021-01-03T13:06:03.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.033+0000 7f190b534700 1 -- start start 2021-01-03T13:06:03.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.033+0000 7f190b534700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f19040b0470 0x7f190405bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.033+0000 7f190b534700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f190405cf20 con 0x7f19041407f0 2021-01-03T13:06:03.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.033+0000 7f190b534700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1904146580 con 0x7f1904140410 2021-01-03T13:06:03.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.033+0000 7f190b534700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19040b02d0 con 0x7f19040b0470 2021-01-03T13:06:03.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.033+0000 7f19092d0700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1904140410 0x7f1904146cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59012/0 (socket says 172.21.15.133:59012) 2021-01-03T13:06:03.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.033+0000 7f19092d0700 1 -- 172.21.15.133:0/3259122724 learned_addr learned my addr 172.21.15.133:0/3259122724 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:03.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.037+0000 7f1909ad1700 1 --2- 172.21.15.133:0/3259122724 >> v2:172.21.15.16:3300/0 conn(0x7f19040b0470 0x7f190405bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.037+0000 7f18effff700 1 -- 172.21.15.133:0/3259122724 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509094801 0 0) 0x7f1904146580 con 0x7f1904140410 2021-01-03T13:06:03.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.037+0000 7f18effff700 1 -- 172.21.15.133:0/3259122724 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18e8003230 con 0x7f1904140410 2021-01-03T13:06:03.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.037+0000 7f1909ad1700 1 -- 172.21.15.133:0/3259122724 >> v1:172.21.15.133:6789/0 conn(0x7f1904140410 legacy=0x7f1904146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.037+0000 7f1909ad1700 1 -- 172.21.15.133:0/3259122724 >> v1:172.21.15.16:6789/0 conn(0x7f19041407f0 legacy=0x7f1904142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.037+0000 7f1909ad1700 1 -- 172.21.15.133:0/3259122724 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1904146820 con 0x7f19040b0470 2021-01-03T13:06:03.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.037+0000 7f1909ad1700 1 --2- 172.21.15.133:0/3259122724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19040b0470 0x7f190405bdf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f18fc0032b0 tx=0x7f18fc0091a0).ready entity=mon.0 client_cookie=b6e7e89e0b14e07a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:03.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.037+0000 7f18effff700 1 -- 172.21.15.133:0/3259122724 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18fc00b9a0 con 0x7f19040b0470 2021-01-03T13:06:03.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.037+0000 7f18effff700 1 -- 172.21.15.133:0/3259122724 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18fc00bb00 con 0x7f19040b0470 2021-01-03T13:06:03.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.037+0000 7f18effff700 1 -- 172.21.15.133:0/3259122724 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18fc00bc70 con 0x7f19040b0470 2021-01-03T13:06:03.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.037+0000 7f190b534700 1 -- 172.21.15.133:0/3259122724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19040b0470 msgr2=0x7f190405bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.037+0000 7f190b534700 1 --2- 172.21.15.133:0/3259122724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19040b0470 0x7f190405bdf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f18fc0032b0 tx=0x7f18fc0091a0).stop 2021-01-03T13:06:03.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.037+0000 7f190b534700 1 -- 172.21.15.133:0/3259122724 shutdown_connections 2021-01-03T13:06:03.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.037+0000 7f190b534700 1 --2- 172.21.15.133:0/3259122724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19040b0470 0x7f190405bdf0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.037+0000 7f190b534700 1 -- 172.21.15.133:0/3259122724 >> 172.21.15.133:0/3259122724 conn(0x7f19040b95d0 msgr2=0x7f19040b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:03.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.037+0000 7f190b534700 1 -- 172.21.15.133:0/3259122724 shutdown_connections 2021-01-03T13:06:03.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.037+0000 7f190b534700 1 -- 172.21.15.133:0/3259122724 wait complete. 2021-01-03T13:06:03.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f190b534700 1 Processor -- start 2021-01-03T13:06:03.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f190b534700 1 -- start start 2021-01-03T13:06:03.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f190b534700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19040b0470 0x7f19040b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f190b534700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1904140410 0x7f1904142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f190b534700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19041407f0 0x7f1904142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f190b534700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190409f6e0 con 0x7f19041407f0 2021-01-03T13:06:03.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f190b534700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1904152730 con 0x7f19040b0470 2021-01-03T13:06:03.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f190b534700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1904152960 con 0x7f1904140410 2021-01-03T13:06:03.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f19092d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19040b0470 0x7f19040b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f19092d0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19040b0470 0x7f19040b14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37988/0 (socket says 172.21.15.133:37988) 2021-01-03T13:06:03.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f19092d0700 1 -- 172.21.15.133:0/2926375626 learned_addr learned my addr 172.21.15.133:0/2926375626 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:03.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f1909ad1700 1 --2- 172.21.15.133:0/2926375626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19041407f0 0x7f1904142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f1908acf700 1 --2- 172.21.15.133:0/2926375626 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1904140410 0x7f1904142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f19092d0700 1 -- 172.21.15.133:0/2926375626 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1904140410 msgr2=0x7f1904142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f19092d0700 1 --2- 172.21.15.133:0/2926375626 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1904140410 0x7f1904142170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f19092d0700 1 -- 172.21.15.133:0/2926375626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19041407f0 msgr2=0x7f1904142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f19092d0700 1 --2- 172.21.15.133:0/2926375626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19041407f0 0x7f1904142660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f19092d0700 1 -- 172.21.15.133:0/2926375626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19041414d0 con 0x7f19040b0470 2021-01-03T13:06:03.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f19092d0700 1 --2- 172.21.15.133:0/2926375626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19040b0470 0x7f19040b14c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f18f80010d0 tx=0x7f18f8007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:03.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.041+0000 7f18f6ffd700 1 -- 172.21.15.133:0/2926375626 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18f80072e0 con 0x7f19040b0470 2021-01-03T13:06:03.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.045+0000 7f18f6ffd700 1 -- 172.21.15.133:0/2926375626 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f8007440 con 0x7f19040b0470 2021-01-03T13:06:03.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.045+0000 7f190b534700 1 -- 172.21.15.133:0/2926375626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1904141770 con 0x7f19040b0470 2021-01-03T13:06:03.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.045+0000 7f18f6ffd700 1 -- 172.21.15.133:0/2926375626 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18f80057d0 con 0x7f19040b0470 2021-01-03T13:06:03.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.045+0000 7f190b534700 1 -- 172.21.15.133:0/2926375626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1904142cf0 con 0x7f19040b0470 2021-01-03T13:06:03.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.045+0000 7f190b534700 1 -- 172.21.15.133:0/2926375626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1904141900 con 0x7f19040b0470 2021-01-03T13:06:03.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.045+0000 7f18f6ffd700 1 -- 172.21.15.133:0/2926375626 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f18f801a060 con 0x7f19040b0470 2021-01-03T13:06:03.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.045+0000 7f18f6ffd700 1 --2- 172.21.15.133:0/2926375626 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18e0055440 0x7f18e0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.045+0000 7f18f6ffd700 1 -- 172.21.15.133:0/2926375626 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f18f806d2f0 con 0x7f19040b0470 2021-01-03T13:06:03.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.045+0000 7f1908acf700 1 --2- 172.21.15.133:0/2926375626 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18e0055440 0x7f18e0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.049+0000 7f1908acf700 1 --2- 172.21.15.133:0/2926375626 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18e0055440 0x7f18e0057900 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f190000d000 tx=0x7f1900007b40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:03.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.053+0000 7f18f6ffd700 1 -- 172.21.15.133:0/2926375626 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f18f80435f0 con 0x7f19040b0470 2021-01-03T13:06:03.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.193+0000 7f190b534700 1 -- 172.21.15.133:0/2926375626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1904152b20 con 0x7f19040b0470 2021-01-03T13:06:03.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.193+0000 7f18f6ffd700 1 -- 172.21.15.133:0/2926375626 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v114) v1 ==== 92+0+10 (secure 0 0 0) 0x7f18f8018020 con 0x7f19040b0470 2021-01-03T13:06:03.197 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:06:03.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.193+0000 7f190b534700 1 -- 172.21.15.133:0/2926375626 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18e0055440 msgr2=0x7f18e0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.193+0000 7f190b534700 1 --2- 172.21.15.133:0/2926375626 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18e0055440 0x7f18e0057900 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f190000d000 tx=0x7f1900007b40).stop 2021-01-03T13:06:03.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.193+0000 7f190b534700 1 -- 172.21.15.133:0/2926375626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19040b0470 msgr2=0x7f19040b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.193+0000 7f190b534700 1 --2- 172.21.15.133:0/2926375626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19040b0470 0x7f19040b14c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f18f80010d0 tx=0x7f18f8007aa0).stop 2021-01-03T13:06:03.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.193+0000 7f190b534700 1 -- 172.21.15.133:0/2926375626 shutdown_connections 2021-01-03T13:06:03.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.193+0000 7f190b534700 1 --2- 172.21.15.133:0/2926375626 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f18e0055440 0x7f18e0057900 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.193+0000 7f190b534700 1 --2- 172.21.15.133:0/2926375626 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19041407f0 0x7f1904142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.193+0000 7f190b534700 1 --2- 172.21.15.133:0/2926375626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19040b0470 0x7f19040b14c0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.193+0000 7f190b534700 1 --2- 172.21.15.133:0/2926375626 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1904140410 0x7f1904142170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.193+0000 7f190b534700 1 -- 172.21.15.133:0/2926375626 >> 172.21.15.133:0/2926375626 conn(0x7f19040b95d0 msgr2=0x7f19040b71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:03.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.193+0000 7f190b534700 1 -- 172.21.15.133:0/2926375626 shutdown_connections 2021-01-03T13:06:03.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.193+0000 7f190b534700 1 -- 172.21.15.133:0/2926375626 wait complete. 2021-01-03T13:06:03.214 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:06:03.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.333+0000 7f9013af3700 1 Processor -- start 2021-01-03T13:06:03.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.333+0000 7f9013af3700 1 -- start start 2021-01-03T13:06:03.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.333+0000 7f9013af3700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f900c1407f0 0x7f900c142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.333+0000 7f9013af3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f900c0b0470 0x7f900c05bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.333+0000 7f9013af3700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900c05cf20 con 0x7f900c140410 2021-01-03T13:06:03.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.333+0000 7f9013af3700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f900c0b02d0 con 0x7f900c1407f0 2021-01-03T13:06:03.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.333+0000 7f9013af3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900c146390 con 0x7f900c0b0470 2021-01-03T13:06:03.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.333+0000 7f9012090700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f900c0b0470 0x7f900c05bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.333+0000 7f901108e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f900c1407f0 0x7f900c142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.333+0000 7f901188f700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f900c140410 0x7f900c146cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:37754/0 (socket says 172.21.15.133:37754) 2021-01-03T13:06:03.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.333+0000 7f901188f700 1 -- 172.21.15.133:0/4254159159 learned_addr learned my addr 172.21.15.133:0/4254159159 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:03.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.333+0000 7f9012090700 1 -- 172.21.15.133:0/4254159159 >> v2:172.21.15.16:3300/0 conn(0x7f900c1407f0 msgr2=0x7f900c142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:03.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.333+0000 7f9012090700 1 --2- 172.21.15.133:0/4254159159 >> v2:172.21.15.16:3300/0 conn(0x7f900c1407f0 0x7f900c142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.333+0000 7f9012090700 1 -- 172.21.15.133:0/4254159159 >> v1:172.21.15.16:6789/0 conn(0x7f900c140410 legacy=0x7f900c146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.333+0000 7f9012090700 1 -- 172.21.15.133:0/4254159159 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c146580 con 0x7f900c0b0470 2021-01-03T13:06:03.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.333+0000 7f901108e700 1 --2- 172.21.15.133:0/4254159159 >> v2:172.21.15.16:3300/0 conn(0x7f900c1407f0 0x7f900c142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:06:03.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.333+0000 7f9012090700 1 --2- 172.21.15.133:0/4254159159 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f900c0b0470 0x7f900c05bdf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f90040032b0 tx=0x7f90040091a0).ready entity=mon.2 client_cookie=3ff33fbbf5ee653d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:03.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.337+0000 7f901088d700 1 -- 172.21.15.133:0/4254159159 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f900400b9a0 con 0x7f900c0b0470 2021-01-03T13:06:03.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.337+0000 7f901088d700 1 -- 172.21.15.133:0/4254159159 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900400bb00 con 0x7f900c0b0470 2021-01-03T13:06:03.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.337+0000 7f901088d700 1 -- 172.21.15.133:0/4254159159 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f900400bc70 con 0x7f900c0b0470 2021-01-03T13:06:03.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.337+0000 7f9013af3700 1 -- 172.21.15.133:0/4254159159 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f900c0b0470 msgr2=0x7f900c05bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.337+0000 7f9013af3700 1 --2- 172.21.15.133:0/4254159159 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f900c0b0470 0x7f900c05bdf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f90040032b0 tx=0x7f90040091a0).stop 2021-01-03T13:06:03.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.337+0000 7f9013af3700 1 -- 172.21.15.133:0/4254159159 shutdown_connections 2021-01-03T13:06:03.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.337+0000 7f9013af3700 1 --2- 172.21.15.133:0/4254159159 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f900c0b0470 0x7f900c05bdf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.337+0000 7f9013af3700 1 --2- 172.21.15.133:0/4254159159 >> v2:172.21.15.16:3300/0 conn(0x7f900c1407f0 0x7f900c142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.337+0000 7f9013af3700 1 -- 172.21.15.133:0/4254159159 >> 172.21.15.133:0/4254159159 conn(0x7f900c0b95d0 msgr2=0x7f900c0b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:03.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.337+0000 7f9013af3700 1 -- 172.21.15.133:0/4254159159 shutdown_connections 2021-01-03T13:06:03.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.337+0000 7f9013af3700 1 -- 172.21.15.133:0/4254159159 wait complete. 2021-01-03T13:06:03.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.337+0000 7f9013af3700 1 Processor -- start 2021-01-03T13:06:03.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.337+0000 7f9013af3700 1 -- start start 2021-01-03T13:06:03.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9013af3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f900c0b0470 0x7f900c149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9013af3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f900c140410 0x7f900c1551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9013af3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f900c1407f0 0x7f900c1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9013af3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c0b3240 con 0x7f900c140410 2021-01-03T13:06:03.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9013af3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c0b2470 con 0x7f900c1407f0 2021-01-03T13:06:03.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9013af3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900c0b2710 con 0x7f900c0b0470 2021-01-03T13:06:03.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9012090700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f900c1407f0 0x7f900c1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9012090700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f900c1407f0 0x7f900c1556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38002/0 (socket says 172.21.15.133:38002) 2021-01-03T13:06:03.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9012090700 1 -- 172.21.15.133:0/2014087813 learned_addr learned my addr 172.21.15.133:0/2014087813 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:03.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f901188f700 1 --2- 172.21.15.133:0/2014087813 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f900c0b0470 0x7f900c149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f901108e700 1 --2- 172.21.15.133:0/2014087813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f900c140410 0x7f900c1551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9012090700 1 -- 172.21.15.133:0/2014087813 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f900c0b0470 msgr2=0x7f900c149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9012090700 1 --2- 172.21.15.133:0/2014087813 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f900c0b0470 0x7f900c149ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9012090700 1 -- 172.21.15.133:0/2014087813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f900c140410 msgr2=0x7f900c1551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9012090700 1 --2- 172.21.15.133:0/2014087813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f900c140410 0x7f900c1551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9012090700 1 -- 172.21.15.133:0/2014087813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c0b29b0 con 0x7f900c1407f0 2021-01-03T13:06:03.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9012090700 1 --2- 172.21.15.133:0/2014087813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f900c1407f0 0x7f900c1556e0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f90040032b0 tx=0x7f9004016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:03.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f8ffaffd700 1 -- 172.21.15.133:0/2014087813 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f900401f3f0 con 0x7f900c1407f0 2021-01-03T13:06:03.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f8ffaffd700 1 -- 172.21.15.133:0/2014087813 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900401f550 con 0x7f900c1407f0 2021-01-03T13:06:03.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9013af3700 1 -- 172.21.15.133:0/2014087813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900c0b2f30 con 0x7f900c1407f0 2021-01-03T13:06:03.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f8ffaffd700 1 -- 172.21.15.133:0/2014087813 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f900401f8b0 con 0x7f900c1407f0 2021-01-03T13:06:03.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9013af3700 1 -- 172.21.15.133:0/2014087813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900c0b2170 con 0x7f900c1407f0 2021-01-03T13:06:03.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f9013af3700 1 -- 172.21.15.133:0/2014087813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900c0b2b40 con 0x7f900c1407f0 2021-01-03T13:06:03.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.341+0000 7f8ffaffd700 1 -- 172.21.15.133:0/2014087813 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9004026030 con 0x7f900c1407f0 2021-01-03T13:06:03.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.345+0000 7f8ffaffd700 1 --2- 172.21.15.133:0/2014087813 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8fec055350 0x7f8fec057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.345+0000 7f8ffaffd700 1 -- 172.21.15.133:0/2014087813 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f900406ea60 con 0x7f900c1407f0 2021-01-03T13:06:03.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.345+0000 7f901188f700 1 --2- 172.21.15.133:0/2014087813 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8fec055350 0x7f8fec057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.345+0000 7f901188f700 1 --2- 172.21.15.133:0/2014087813 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8fec055350 0x7f8fec057810 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f900800b000 tx=0x7f9008009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:03.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.349+0000 7f8ffaffd700 1 -- 172.21.15.133:0/2014087813 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9004044cc0 con 0x7f900c1407f0 2021-01-03T13:06:03.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.509+0000 7f9013af3700 1 -- 172.21.15.133:0/2014087813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f900c057300 con 0x7f900c1407f0 2021-01-03T13:06:03.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.509+0000 7f8ffaffd700 1 -- 172.21.15.133:0/2014087813 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v114) v1 ==== 104+0+10 (secure 0 0 0) 0x7f90040150a0 con 0x7f900c1407f0 2021-01-03T13:06:03.516 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:06:03.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.513+0000 7f9013af3700 1 -- 172.21.15.133:0/2014087813 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8fec055350 msgr2=0x7f8fec057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.513+0000 7f9013af3700 1 --2- 172.21.15.133:0/2014087813 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8fec055350 0x7f8fec057810 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f900800b000 tx=0x7f9008009040).stop 2021-01-03T13:06:03.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.513+0000 7f9013af3700 1 -- 172.21.15.133:0/2014087813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f900c1407f0 msgr2=0x7f900c1556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.513+0000 7f9013af3700 1 --2- 172.21.15.133:0/2014087813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f900c1407f0 0x7f900c1556e0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f90040032b0 tx=0x7f9004016000).stop 2021-01-03T13:06:03.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.513+0000 7f9013af3700 1 -- 172.21.15.133:0/2014087813 shutdown_connections 2021-01-03T13:06:03.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.513+0000 7f9013af3700 1 --2- 172.21.15.133:0/2014087813 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8fec055350 0x7f8fec057810 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.513+0000 7f9013af3700 1 --2- 172.21.15.133:0/2014087813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f900c1407f0 0x7f900c1556e0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.513+0000 7f9013af3700 1 --2- 172.21.15.133:0/2014087813 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f900c0b0470 0x7f900c149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.513+0000 7f9013af3700 1 --2- 172.21.15.133:0/2014087813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f900c140410 0x7f900c1551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.513+0000 7f9013af3700 1 -- 172.21.15.133:0/2014087813 >> 172.21.15.133:0/2014087813 conn(0x7f900c0b95d0 msgr2=0x7f900c1441c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:03.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.513+0000 7f9013af3700 1 -- 172.21.15.133:0/2014087813 shutdown_connections 2021-01-03T13:06:03.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.513+0000 7f9013af3700 1 -- 172.21.15.133:0/2014087813 wait complete. 2021-01-03T13:06:03.530 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:06:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.645+0000 7f5029080700 1 Processor -- start 2021-01-03T13:06:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.645+0000 7f5029080700 1 -- start start 2021-01-03T13:06:03.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.645+0000 7f5029080700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f50241407f0 0x7f5024142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.645+0000 7f5029080700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502405c500 con 0x7f5024140410 2021-01-03T13:06:03.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.645+0000 7f5029080700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502405cf20 con 0x7f50240b0470 2021-01-03T13:06:03.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.645+0000 7f5029080700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50240b02d0 con 0x7f50241407f0 2021-01-03T13:06:03.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.645+0000 7f502259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f50241407f0 0x7f5024142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.645+0000 7f502359e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f50240b0470 0x7f502405bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59044/0 (socket says 172.21.15.133:59044) 2021-01-03T13:06:03.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.645+0000 7f502359e700 1 -- 172.21.15.133:0/1227456787 learned_addr learned my addr 172.21.15.133:0/1227456787 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:03.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f5021d9b700 1 -- 172.21.15.133:0/1227456787 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670737118 0 0) 0x7f502405cf20 con 0x7f50240b0470 2021-01-03T13:06:03.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f5021d9b700 1 -- 172.21.15.133:0/1227456787 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5008003230 con 0x7f50240b0470 2021-01-03T13:06:03.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f502259c700 1 -- 172.21.15.133:0/1227456787 >> v1:172.21.15.133:6789/0 conn(0x7f50240b0470 legacy=0x7f502405bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f502259c700 1 -- 172.21.15.133:0/1227456787 >> v1:172.21.15.16:6789/0 conn(0x7f5024140410 legacy=0x7f5024146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f502259c700 1 -- 172.21.15.133:0/1227456787 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5024146580 con 0x7f50241407f0 2021-01-03T13:06:03.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f502259c700 1 --2- 172.21.15.133:0/1227456787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50241407f0 0x7f5024142dc0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f5018002f30 tx=0x7f5018006dc0).ready entity=mon.1 client_cookie=73ef76d58d095961 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:03.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f5021d9b700 1 -- 172.21.15.133:0/1227456787 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5018009800 con 0x7f50241407f0 2021-01-03T13:06:03.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f5021d9b700 1 -- 172.21.15.133:0/1227456787 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5018009960 con 0x7f50241407f0 2021-01-03T13:06:03.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f5021d9b700 1 -- 172.21.15.133:0/1227456787 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5018009cc0 con 0x7f50241407f0 2021-01-03T13:06:03.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f5029080700 1 -- 172.21.15.133:0/1227456787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50241407f0 msgr2=0x7f5024142dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f5029080700 1 --2- 172.21.15.133:0/1227456787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50241407f0 0x7f5024142dc0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f5018002f30 tx=0x7f5018006dc0).stop 2021-01-03T13:06:03.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f5029080700 1 -- 172.21.15.133:0/1227456787 shutdown_connections 2021-01-03T13:06:03.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f5029080700 1 --2- 172.21.15.133:0/1227456787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50241407f0 0x7f5024142dc0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f5029080700 1 -- 172.21.15.133:0/1227456787 >> 172.21.15.133:0/1227456787 conn(0x7f50240b95d0 msgr2=0x7f50240b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:03.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f5029080700 1 -- 172.21.15.133:0/1227456787 shutdown_connections 2021-01-03T13:06:03.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f5029080700 1 -- 172.21.15.133:0/1227456787 wait complete. 2021-01-03T13:06:03.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f5029080700 1 Processor -- start 2021-01-03T13:06:03.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.649+0000 7f5029080700 1 -- start start 2021-01-03T13:06:03.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f5029080700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f50240b0470 0x7f5024141b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f5029080700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5024140410 0x7f50240b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f5029080700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50241407f0 0x7f50240b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f5029080700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50240b1d60 con 0x7f5024140410 2021-01-03T13:06:03.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f5029080700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50240b2380 con 0x7f50241407f0 2021-01-03T13:06:03.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f5029080700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50240b0ce0 con 0x7f50240b0470 2021-01-03T13:06:03.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f502359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50241407f0 0x7f50240b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f502359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50241407f0 0x7f50240b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38018/0 (socket says 172.21.15.133:38018) 2021-01-03T13:06:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f502359e700 1 -- 172.21.15.133:0/1096085602 learned_addr learned my addr 172.21.15.133:0/1096085602 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f5022d9d700 1 --2- 172.21.15.133:0/1096085602 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f50240b0470 0x7f5024141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f502259c700 1 --2- 172.21.15.133:0/1096085602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5024140410 0x7f50240b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f502359e700 1 -- 172.21.15.133:0/1096085602 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f50240b0470 msgr2=0x7f5024141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f502359e700 1 --2- 172.21.15.133:0/1096085602 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f50240b0470 0x7f5024141b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f502359e700 1 -- 172.21.15.133:0/1096085602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5024140410 msgr2=0x7f50240b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f502359e700 1 --2- 172.21.15.133:0/1096085602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5024140410 0x7f50240b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f502359e700 1 -- 172.21.15.133:0/1096085602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50240b1f90 con 0x7f50241407f0 2021-01-03T13:06:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f5022d9d700 1 --2- 172.21.15.133:0/1096085602 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f50240b0470 0x7f5024141b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f502259c700 1 --2- 172.21.15.133:0/1096085602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5024140410 0x7f50240b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f502359e700 1 --2- 172.21.15.133:0/1096085602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50241407f0 0x7f50240b2cd0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f5024141710 tx=0x7f501c007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f5013fff700 1 -- 172.21.15.133:0/1096085602 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f501c005b70 con 0x7f50241407f0 2021-01-03T13:06:03.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f5013fff700 1 -- 172.21.15.133:0/1096085602 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c005cd0 con 0x7f50241407f0 2021-01-03T13:06:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f5029080700 1 -- 172.21.15.133:0/1096085602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50240b0a40 con 0x7f50241407f0 2021-01-03T13:06:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f5013fff700 1 -- 172.21.15.133:0/1096085602 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f501c007300 con 0x7f50241407f0 2021-01-03T13:06:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.653+0000 7f5029080700 1 -- 172.21.15.133:0/1096085602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5024143aa0 con 0x7f50241407f0 2021-01-03T13:06:03.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.657+0000 7f5029080700 1 -- 172.21.15.133:0/1096085602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50240b24f0 con 0x7f50241407f0 2021-01-03T13:06:03.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.657+0000 7f5013fff700 1 -- 172.21.15.133:0/1096085602 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f501c010030 con 0x7f50241407f0 2021-01-03T13:06:03.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.657+0000 7f5013fff700 1 --2- 172.21.15.133:0/1096085602 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f50000554e0 0x7f50000579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.657+0000 7f5013fff700 1 -- 172.21.15.133:0/1096085602 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f501c06e0e0 con 0x7f50241407f0 2021-01-03T13:06:03.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.657+0000 7f5022d9d700 1 --2- 172.21.15.133:0/1096085602 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f50000554e0 0x7f50000579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.657+0000 7f5022d9d700 1 --2- 172.21.15.133:0/1096085602 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f50000554e0 0x7f50000579a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f501400b000 tx=0x7f5014009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:03.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.665+0000 7f5013fff700 1 -- 172.21.15.133:0/1096085602 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f501c0442d0 con 0x7f50241407f0 2021-01-03T13:06:03.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.809+0000 7f5029080700 1 -- 172.21.15.133:0/1096085602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5024057300 con 0x7f50241407f0 2021-01-03T13:06:03.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.809+0000 7f5013fff700 1 -- 172.21.15.133:0/1096085602 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v114) v1 ==== 100+0+10 (secure 0 0 0) 0x7f501c0478f0 con 0x7f50241407f0 2021-01-03T13:06:03.814 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:06:03.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.813+0000 7f5029080700 1 -- 172.21.15.133:0/1096085602 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f50000554e0 msgr2=0x7f50000579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.813+0000 7f5029080700 1 --2- 172.21.15.133:0/1096085602 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f50000554e0 0x7f50000579a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f501400b000 tx=0x7f5014009040).stop 2021-01-03T13:06:03.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.813+0000 7f5029080700 1 -- 172.21.15.133:0/1096085602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50241407f0 msgr2=0x7f50240b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.813+0000 7f5029080700 1 --2- 172.21.15.133:0/1096085602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50241407f0 0x7f50240b2cd0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f5024141710 tx=0x7f501c007dd0).stop 2021-01-03T13:06:03.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.813+0000 7f5029080700 1 -- 172.21.15.133:0/1096085602 shutdown_connections 2021-01-03T13:06:03.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.813+0000 7f5029080700 1 --2- 172.21.15.133:0/1096085602 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f50000554e0 0x7f50000579a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.813+0000 7f5029080700 1 --2- 172.21.15.133:0/1096085602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50241407f0 0x7f50240b2cd0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.813+0000 7f5029080700 1 --2- 172.21.15.133:0/1096085602 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f50240b0470 0x7f5024141b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.813+0000 7f5029080700 1 --2- 172.21.15.133:0/1096085602 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5024140410 0x7f50240b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.813+0000 7f5029080700 1 -- 172.21.15.133:0/1096085602 >> 172.21.15.133:0/1096085602 conn(0x7f50240b95d0 msgr2=0x7f50240b7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:03.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.813+0000 7f5029080700 1 -- 172.21.15.133:0/1096085602 shutdown_connections 2021-01-03T13:06:03.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.813+0000 7f5029080700 1 -- 172.21.15.133:0/1096085602 wait complete. 2021-01-03T13:06:03.833 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:06:03.833 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:06:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627b59e700 1 Processor -- start 2021-01-03T13:06:03.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627b59e700 1 -- start start 2021-01-03T13:06:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627b59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f627c0b0c90 0x7f627c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627b59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f627c0b5c00 0x7f627c143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627b59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627c060da0 con 0x7f627c0b52c0 2021-01-03T13:06:03.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627b59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627c067a90 con 0x7f627c0b5c00 2021-01-03T13:06:03.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627b59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0b0ad0 con 0x7f627c0b0c90 2021-01-03T13:06:03.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627a59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f627c0b52c0 0x7f627c098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59054/0 (socket says 172.21.15.133:59054) 2021-01-03T13:06:03.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627a59c700 1 -- 172.21.15.133:0/3613680895 learned_addr learned my addr 172.21.15.133:0/3613680895 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:03.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f6279d9b700 1 --2- 172.21.15.133:0/3613680895 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f627c0b0c90 0x7f627c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627ad9d700 1 --2- 172.21.15.133:0/3613680895 >> v2:172.21.15.16:3300/0 conn(0x7f627c0b5c00 0x7f627c143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627959a700 1 -- 172.21.15.133:0/3613680895 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826952086 0 0) 0x7f627c060da0 con 0x7f627c0b52c0 2021-01-03T13:06:03.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627959a700 1 -- 172.21.15.133:0/3613680895 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6260003230 con 0x7f627c0b52c0 2021-01-03T13:06:03.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627959a700 1 -- 172.21.15.133:0/3613680895 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 341512466 0 0) 0x7f6260003230 con 0x7f627c0b52c0 2021-01-03T13:06:03.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627959a700 1 -- 172.21.15.133:0/3613680895 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f627c0b0c90 msgr2=0x7f627c0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:03.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627959a700 1 --2- 172.21.15.133:0/3613680895 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f627c0b0c90 0x7f627c0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627959a700 1 -- 172.21.15.133:0/3613680895 >> v2:172.21.15.16:3300/0 conn(0x7f627c0b5c00 msgr2=0x7f627c143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:03.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627959a700 1 --2- 172.21.15.133:0/3613680895 >> v2:172.21.15.16:3300/0 conn(0x7f627c0b5c00 0x7f627c143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627959a700 1 -- 172.21.15.133:0/3613680895 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c0b56a0 con 0x7f627c0b52c0 2021-01-03T13:06:03.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627959a700 1 -- 172.21.15.133:0/3613680895 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f626c0016d0 con 0x7f627c0b52c0 2021-01-03T13:06:03.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627ad9d700 1 --2- 172.21.15.133:0/3613680895 >> v2:172.21.15.16:3300/0 conn(0x7f627c0b5c00 0x7f627c143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:03.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627959a700 1 -- 172.21.15.133:0/3613680895 >> v1:172.21.15.133:6789/0 conn(0x7f627c0b52c0 legacy=0x7f627c098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627959a700 1 --2- 172.21.15.133:0/3613680895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6260003720 0x7f6260003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627959a700 1 --2- 172.21.15.133:0/3613680895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62600044d0 0x7f6260004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627959a700 1 --2- 172.21.15.133:0/3613680895 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f627c0b0c90 0x7f6260004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627959a700 1 -- 172.21.15.133:0/3613680895 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c067a90 con 0x7f6260003720 2021-01-03T13:06:03.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627959a700 1 -- 172.21.15.133:0/3613680895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0b0ad0 con 0x7f62600044d0 2021-01-03T13:06:03.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627959a700 1 -- 172.21.15.133:0/3613680895 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6260004260 con 0x7f627c0b0c90 2021-01-03T13:06:03.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f6279d9b700 1 --2- 172.21.15.133:0/3613680895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62600044d0 0x7f6260004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627ad9d700 1 --2- 172.21.15.133:0/3613680895 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f627c0b0c90 0x7f6260004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f627a59c700 1 --2- 172.21.15.133:0/3613680895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6260003720 0x7f6260003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f6279d9b700 1 -- 172.21.15.133:0/3613680895 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f627c0b0c90 msgr2=0x7f6260004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:03.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f6279d9b700 1 --2- 172.21.15.133:0/3613680895 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f627c0b0c90 0x7f6260004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f6279d9b700 1 -- 172.21.15.133:0/3613680895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6260003720 msgr2=0x7f6260003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:03.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f6279d9b700 1 --2- 172.21.15.133:0/3613680895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6260003720 0x7f6260003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.941+0000 7f6279d9b700 1 -- 172.21.15.133:0/3613680895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6260003230 con 0x7f62600044d0 2021-01-03T13:06:03.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f6279d9b700 1 --2- 172.21.15.133:0/3613680895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62600044d0 0x7f6260004950 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f627000c000 tx=0x7f6270008040).ready entity=mon.1 client_cookie=ef3b6ae78ee524f2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:03.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627959a700 1 -- 172.21.15.133:0/3613680895 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f627000e8a0 con 0x7f62600044d0 2021-01-03T13:06:03.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627959a700 1 -- 172.21.15.133:0/3613680895 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627000ea00 con 0x7f62600044d0 2021-01-03T13:06:03.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627959a700 1 -- 172.21.15.133:0/3613680895 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f627000ed60 con 0x7f62600044d0 2021-01-03T13:06:03.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627b59e700 1 -- 172.21.15.133:0/3613680895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62600044d0 msgr2=0x7f6260004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627b59e700 1 --2- 172.21.15.133:0/3613680895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62600044d0 0x7f6260004950 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f627000c000 tx=0x7f6270008040).stop 2021-01-03T13:06:03.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627ad9d700 1 -- 172.21.15.133:0/3613680895 reap_dead start 2021-01-03T13:06:03.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627b59e700 1 -- 172.21.15.133:0/3613680895 shutdown_connections 2021-01-03T13:06:03.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627b59e700 1 -- 172.21.15.133:0/3613680895 >> 172.21.15.133:0/3613680895 conn(0x7f627c05bdf0 msgr2=0x7f627c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:03.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627b59e700 1 -- 172.21.15.133:0/3613680895 shutdown_connections 2021-01-03T13:06:03.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627b59e700 1 -- 172.21.15.133:0/3613680895 wait complete. 2021-01-03T13:06:03.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627b59e700 1 Processor -- start 2021-01-03T13:06:03.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627b59e700 1 -- start start 2021-01-03T13:06:03.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627b59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f627c147420 0x7f627c066490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627b59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f627c0673c0 0x7f627c0aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f627c0ab090 0x7f627c156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627b59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0ab540 con 0x7f627c147420 2021-01-03T13:06:03.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c143040 con 0x7f627c0ab090 2021-01-03T13:06:03.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627b59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c066980 con 0x7f627c0673c0 2021-01-03T13:06:03.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f627c0ab090 0x7f627c156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627ad9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f627c0ab090 0x7f627c156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38038/0 (socket says 172.21.15.133:38038) 2021-01-03T13:06:03.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627ad9d700 1 -- 172.21.15.133:0/2000742790 learned_addr learned my addr 172.21.15.133:0/2000742790 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:03.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f627a59c700 1 --2- 172.21.15.133:0/2000742790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f627c147420 0x7f627c066490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.945+0000 7f6279d9b700 1 --2- 172.21.15.133:0/2000742790 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f627c0673c0 0x7f627c0aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.949+0000 7f627ad9d700 1 -- 172.21.15.133:0/2000742790 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f627c0673c0 msgr2=0x7f627c0aaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.949+0000 7f627ad9d700 1 --2- 172.21.15.133:0/2000742790 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f627c0673c0 0x7f627c0aaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.949+0000 7f627ad9d700 1 -- 172.21.15.133:0/2000742790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f627c147420 msgr2=0x7f627c066490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:03.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.949+0000 7f627ad9d700 1 --2- 172.21.15.133:0/2000742790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f627c147420 0x7f627c066490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:03.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.949+0000 7f627ad9d700 1 -- 172.21.15.133:0/2000742790 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c147800 con 0x7f627c0ab090 2021-01-03T13:06:03.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.949+0000 7f627ad9d700 1 --2- 172.21.15.133:0/2000742790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f627c0ab090 0x7f627c156670 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f627c066ac0 tx=0x7f6274008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:03.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.949+0000 7f626b7fe700 1 -- 172.21.15.133:0/2000742790 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6274019070 con 0x7f627c0ab090 2021-01-03T13:06:03.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.949+0000 7f626b7fe700 1 -- 172.21.15.133:0/2000742790 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6274013810 con 0x7f627c0ab090 2021-01-03T13:06:03.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.949+0000 7f627b59e700 1 -- 172.21.15.133:0/2000742790 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627c066240 con 0x7f627c0ab090 2021-01-03T13:06:03.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.949+0000 7f626b7fe700 1 -- 172.21.15.133:0/2000742790 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f627400c070 con 0x7f627c0ab090 2021-01-03T13:06:03.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.949+0000 7f627b59e700 1 -- 172.21.15.133:0/2000742790 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627c065fa0 con 0x7f627c0ab090 2021-01-03T13:06:03.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.949+0000 7f626b7fe700 1 -- 172.21.15.133:0/2000742790 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6274012040 con 0x7f627c0ab090 2021-01-03T13:06:03.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.949+0000 7f627b59e700 1 -- 172.21.15.133:0/2000742790 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627c057300 con 0x7f627c0ab090 2021-01-03T13:06:03.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.949+0000 7f626b7fe700 1 --2- 172.21.15.133:0/2000742790 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62580553b0 0x7f6258057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:03.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.949+0000 7f626b7fe700 1 -- 172.21.15.133:0/2000742790 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f627406e0c0 con 0x7f627c0ab090 2021-01-03T13:06:03.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.949+0000 7f627a59c700 1 --2- 172.21.15.133:0/2000742790 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62580553b0 0x7f6258057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:03.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.949+0000 7f627a59c700 1 --2- 172.21.15.133:0/2000742790 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62580553b0 0x7f6258057870 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f626c005000 tx=0x7f627c0b0070).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:03.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:03.957+0000 7f626b7fe700 1 -- 172.21.15.133:0/2000742790 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6274044320 con 0x7f627c0ab090 2021-01-03T13:06:04.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:04.141+0000 7f627b59e700 1 -- 172.21.15.133:0/2000742790 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f627c0aa940 con 0x7f627c0ab090 2021-01-03T13:06:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:04.141+0000 7f626b7fe700 1 -- 172.21.15.133:0/2000742790 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+2499 (secure 0 0 0) 0x7f6274047940 con 0x7f627c0ab090 2021-01-03T13:06:04.146 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:04.146 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":49,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7108,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/2670125727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2670125727},{"type":"v1","addr":"172.21.15.133:6835","nonce":2670125727}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47},{"gid":7120,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6837/3964151526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3964151526},{"type":"v1","addr":"172.21.15.133:6837","nonce":3964151526}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:59.178144+0000","modified":"2021-01-03T13:06:00.181997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7123},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7123":{"gid":7123,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/1643460453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1643460453},{"type":"v1","addr":"172.21.15.16:6833","nonce":1643460453}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-01-03T13:06:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:04.141+0000 7f627b59e700 1 -- 172.21.15.133:0/2000742790 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62580553b0 msgr2=0x7f6258057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:04.141+0000 7f627b59e700 1 --2- 172.21.15.133:0/2000742790 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62580553b0 0x7f6258057870 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f626c005000 tx=0x7f627c0b0070).stop 2021-01-03T13:06:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:04.141+0000 7f627b59e700 1 -- 172.21.15.133:0/2000742790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f627c0ab090 msgr2=0x7f627c156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:04.141+0000 7f627b59e700 1 --2- 172.21.15.133:0/2000742790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f627c0ab090 0x7f627c156670 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f627c066ac0 tx=0x7f6274008040).stop 2021-01-03T13:06:04.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:04.141+0000 7f627b59e700 1 -- 172.21.15.133:0/2000742790 shutdown_connections 2021-01-03T13:06:04.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:04.141+0000 7f627b59e700 1 --2- 172.21.15.133:0/2000742790 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f62580553b0 0x7f6258057870 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:04.145+0000 7f627b59e700 1 --2- 172.21.15.133:0/2000742790 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f627c147420 0x7f627c066490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:04.145+0000 7f627b59e700 1 --2- 172.21.15.133:0/2000742790 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f627c0ab090 0x7f627c156670 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:04.145+0000 7f627b59e700 1 --2- 172.21.15.133:0/2000742790 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f627c0673c0 0x7f627c0aaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:04.145+0000 7f627b59e700 1 -- 172.21.15.133:0/2000742790 >> 172.21.15.133:0/2000742790 conn(0x7f627c05bdf0 msgr2=0x7f627c0b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:04.145+0000 7f627b59e700 1 -- 172.21.15.133:0/2000742790 shutdown_connections 2021-01-03T13:06:04.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:04.145+0000 7f627b59e700 1 -- 172.21.15.133:0/2000742790 wait complete. 2021-01-03T13:06:04.151 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 49 2021-01-03T13:06:04.462 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:05:59.178144+0000', 'modified': '2021-01-03T13:06:00.181997+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7123}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7123': {'gid': 7123, 'name': 'b', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.16:6833/1643460453', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6832', 'nonce': 1643460453}, {'type': 'v1', 'addr': '172.21.15.16:6833', 'nonce': 1643460453}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:06:04.463 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:06:04.464 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-01-03T13:06:04.592 INFO:teuthology.orchestra.run.smithi016.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":7123,"want_state":"up:active","state":"up:active","rank_uptime":5.3999138110000002,"mdsmap_epoch":49,"osdmap_epoch":114,"osdmap_epoch_barrier":113,"uptime":10.773461123000001} 2021-01-03T13:06:04.593 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 7123, "mdsmap_epoch": 49, "osdmap_epoch": 114, "osdmap_epoch_barrier": 113, "rank_uptime": 5.399913811, "state": "up:active", "uptime": 10.773461123, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:06:04.593 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:06:04.594 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-01-03T13:06:04.594 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi007.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-01-03T13:06:04.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:04.596 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:04.604 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:06:04.661 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:06:04.662 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:06:04.716 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:06:04.717 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:06:04.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:04.718 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:06:04.764 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:06:04.764 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:04.807 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:06:04.827 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:06:04.828 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:06:04.884 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2021-01-03T13:06:04.879+0000 7f22074bd0c0 -1 init, newargv = 0x56411aaa5c30 newargc=9ceph-fuse[ 2021-01-03T13:06:04.885 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:12538]: starting ceph client 2021-01-03T13:06:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:06:04.888 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:06:04.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:04.889 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:06:04.898 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12538]: starting fuse 2021-01-03T13:06:04.904 INFO:teuthology.orchestra.run.smithi007.stdout:50 2021-01-03T13:06:04.905 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:06:04.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:04.906 DEBUG:teuthology.orchestra.run.smithi007:> sudo python3 -c ' 2021-01-03T13:06:04.906 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2021-01-03T13:06:04.907 DEBUG:teuthology.orchestra.run.smithi007:> import re 2021-01-03T13:06:04.907 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:06:04.907 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2021-01-03T13:06:04.908 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:06:04.908 DEBUG:teuthology.orchestra.run.smithi007:> def find_socket(client_name): 2021-01-03T13:06:04.908 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-01-03T13:06:04.909 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2021-01-03T13:06:04.909 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:06:04.910 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2021-01-03T13:06:04.910 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2021-01-03T13:06:04.910 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2021-01-03T13:06:04.911 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2021-01-03T13:06:04.911 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:06:04.911 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2021-01-03T13:06:04.912 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:06:04.912 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:06:04.913 DEBUG:teuthology.orchestra.run.smithi007:> return f 2021-01-03T13:06:04.913 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:06:04.913 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:06:04.914 DEBUG:teuthology.orchestra.run.smithi007:> print(find_socket("client.0")) 2021-01-03T13:06:04.914 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:06:04.997 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.12538.asok 2021-01-03T13:06:05.002 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12538.asok 2021-01-03T13:06:05.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:05.004 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12538.asok status 2021-01-03T13:06:05.106 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2021-01-03T13:06:05.106 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2021-01-03T13:06:05.107 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:06:05.107 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:06:05.107 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2021-01-03T13:06:05.107 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2021-01-03T13:06:05.108 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-01-03T13:06:05.108 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "12538", 2021-01-03T13:06:05.108 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2021-01-03T13:06:05.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:06:05.108 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2021-01-03T13:06:05.109 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2021-01-03T13:06:05.109 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 7279, 2021-01-03T13:06:05.109 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2021-01-03T13:06:05.109 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2021-01-03T13:06:05.109 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2021-01-03T13:06:05.110 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 7279 2021-01-03T13:06:05.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:06:05.110 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:06:05.110 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:06:05.111 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:06:05.111 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2053231263 2021-01-03T13:06:05.111 INFO:teuthology.orchestra.run.smithi007.stdout: } 2021-01-03T13:06:05.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:06:05.111 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:06:05.113 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:06:05.113 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:06:05.114 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2053231263 2021-01-03T13:06:05.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:06:05.114 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.7279 172.21.15.7:0/2053231263", 2021-01-03T13:06:05.115 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "172.21.15.7:0/2053231263", 2021-01-03T13:06:05.115 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2021-01-03T13:06:05.115 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 49, 2021-01-03T13:06:05.115 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 114, 2021-01-03T13:06:05.116 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:06:05.116 INFO:teuthology.orchestra.run.smithi007.stdout: "blacklisted": false, 2021-01-03T13:06:05.116 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2021-01-03T13:06:05.116 INFO:teuthology.orchestra.run.smithi007.stdout:} 2021-01-03T13:06:05.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:05.118 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:05.119 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:05.126 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:06:05.127 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:06:05.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:05.128 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:05.187 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:06:05.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.301+0000 7f51f2f2c700 1 Processor -- start 2021-01-03T13:06:05.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.301+0000 7f51f2f2c700 1 -- start start 2021-01-03T13:06:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.301+0000 7f51f2f2c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f51ec0b72b0 0x7f51ec144020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.301+0000 7f51f2f2c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f51ec0b7eb0 0x7f51ec13e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.301+0000 7f51f2f2c700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec09c0b0 con 0x7f51ec0b2e00 2021-01-03T13:06:05.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.301+0000 7f51f2f2c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec0ae480 con 0x7f51ec0b72b0 2021-01-03T13:06:05.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.301+0000 7f51f2f2c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec09c2e0 con 0x7f51ec0b7eb0 2021-01-03T13:06:05.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.301+0000 7f51f272b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f51ec0b7eb0 0x7f51ec13e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f272b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f51ec0b7eb0 0x7f51ec13e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38046/0 (socket says 172.21.15.133:38046) 2021-01-03T13:06:05.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f272b700 1 -- 172.21.15.133:0/1526907455 learned_addr learned my addr 172.21.15.133:0/1526907455 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:05.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f1f2a700 1 --2- 172.21.15.133:0/1526907455 >> v2:172.21.15.16:3300/0 conn(0x7f51ec0b72b0 0x7f51ec144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f272b700 1 -- 172.21.15.133:0/1526907455 >> v2:172.21.15.16:3300/0 conn(0x7f51ec0b72b0 msgr2=0x7f51ec144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:05.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f272b700 1 --2- 172.21.15.133:0/1526907455 >> v2:172.21.15.16:3300/0 conn(0x7f51ec0b72b0 0x7f51ec144020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f272b700 1 -- 172.21.15.133:0/1526907455 >> v1:172.21.15.16:6789/0 conn(0x7f51ec0b2e00 legacy=0x7f51ec0ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:05.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f272b700 1 -- 172.21.15.133:0/1526907455 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec09c580 con 0x7f51ec0b7eb0 2021-01-03T13:06:05.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f272b700 1 --2- 172.21.15.133:0/1526907455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ec0b7eb0 0x7f51ec13e040 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f51e40032b0 tx=0x7f51e4009270).ready entity=mon.1 client_cookie=da0eb0ac8caac786 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:05.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f0f28700 1 -- 172.21.15.133:0/1526907455 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e4009e60 con 0x7f51ec0b7eb0 2021-01-03T13:06:05.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f0f28700 1 -- 172.21.15.133:0/1526907455 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e400bc00 con 0x7f51ec0b7eb0 2021-01-03T13:06:05.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f0f28700 1 -- 172.21.15.133:0/1526907455 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e400bd70 con 0x7f51ec0b7eb0 2021-01-03T13:06:05.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f2f2c700 1 -- 172.21.15.133:0/1526907455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ec0b7eb0 msgr2=0x7f51ec13e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:05.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f2f2c700 1 --2- 172.21.15.133:0/1526907455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ec0b7eb0 0x7f51ec13e040 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f51e40032b0 tx=0x7f51e4009270).stop 2021-01-03T13:06:05.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f2f2c700 1 -- 172.21.15.133:0/1526907455 shutdown_connections 2021-01-03T13:06:05.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f2f2c700 1 --2- 172.21.15.133:0/1526907455 >> v2:172.21.15.16:3300/0 conn(0x7f51ec0b72b0 0x7f51ec144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f2f2c700 1 --2- 172.21.15.133:0/1526907455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ec0b7eb0 0x7f51ec13e040 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f2f2c700 1 -- 172.21.15.133:0/1526907455 >> 172.21.15.133:0/1526907455 conn(0x7f51ec05bdf0 msgr2=0x7f51ec05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:05.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f2f2c700 1 -- 172.21.15.133:0/1526907455 shutdown_connections 2021-01-03T13:06:05.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f2f2c700 1 -- 172.21.15.133:0/1526907455 wait complete. 2021-01-03T13:06:05.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f2f2c700 1 Processor -- start 2021-01-03T13:06:05.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.305+0000 7f51f2f2c700 1 -- start start 2021-01-03T13:06:05.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f2f2c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f51ec0b2e00 0x7f51ec13c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f2f2c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ec0b72b0 0x7f51ec0b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f2f2c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51ec13eda0 0x7f51ec152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f2f2c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0b22d0 con 0x7f51ec13eda0 2021-01-03T13:06:05.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f2f2c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0b2570 con 0x7f51ec0b72b0 2021-01-03T13:06:05.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f2f2c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0b2810 con 0x7f51ec0b2e00 2021-01-03T13:06:05.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f1729700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ec0b72b0 0x7f51ec0b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f1f2a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f51ec0b2e00 0x7f51ec13c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f272b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51ec13eda0 0x7f51ec152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f1f2a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f51ec0b2e00 0x7f51ec13c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:46350/0 (socket says 172.21.15.133:46350) 2021-01-03T13:06:05.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f1f2a700 1 -- 172.21.15.133:0/4168738162 learned_addr learned my addr 172.21.15.133:0/4168738162 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:05.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f1729700 1 -- 172.21.15.133:0/4168738162 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f51ec0b2e00 msgr2=0x7f51ec13c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:05.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f1729700 1 --2- 172.21.15.133:0/4168738162 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f51ec0b2e00 0x7f51ec13c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f1729700 1 -- 172.21.15.133:0/4168738162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51ec13eda0 msgr2=0x7f51ec152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:05.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f1729700 1 --2- 172.21.15.133:0/4168738162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51ec13eda0 0x7f51ec152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f1729700 1 -- 172.21.15.133:0/4168738162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec13e900 con 0x7f51ec0b72b0 2021-01-03T13:06:05.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f1729700 1 --2- 172.21.15.133:0/4168738162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ec0b72b0 0x7f51ec0b1090 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f51ec063f40 tx=0x7f51e8007b60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:05.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51daffd700 1 -- 172.21.15.133:0/4168738162 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e800f470 con 0x7f51ec0b72b0 2021-01-03T13:06:05.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f2f2c700 1 -- 172.21.15.133:0/4168738162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec141250 con 0x7f51ec0b72b0 2021-01-03T13:06:05.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51daffd700 1 -- 172.21.15.133:0/4168738162 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e800f5d0 con 0x7f51ec0b72b0 2021-01-03T13:06:05.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51daffd700 1 -- 172.21.15.133:0/4168738162 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e800f930 con 0x7f51ec0b72b0 2021-01-03T13:06:05.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f2f2c700 1 -- 172.21.15.133:0/4168738162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec13f230 con 0x7f51ec0b72b0 2021-01-03T13:06:05.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.309+0000 7f51f2f2c700 1 -- 172.21.15.133:0/4168738162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec13ea90 con 0x7f51ec0b72b0 2021-01-03T13:06:05.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.313+0000 7f51daffd700 1 -- 172.21.15.133:0/4168738162 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f51e8019030 con 0x7f51ec0b72b0 2021-01-03T13:06:05.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.313+0000 7f51daffd700 1 --2- 172.21.15.133:0/4168738162 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f51cc0554e0 0x7f51cc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.313+0000 7f51daffd700 1 -- 172.21.15.133:0/4168738162 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f51e806d380 con 0x7f51ec0b72b0 2021-01-03T13:06:05.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.313+0000 7f51f1f2a700 1 --2- 172.21.15.133:0/4168738162 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f51cc0554e0 0x7f51cc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.313+0000 7f51f1f2a700 1 --2- 172.21.15.133:0/4168738162 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f51cc0554e0 0x7f51cc0579a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f51dc00b000 tx=0x7f51dc006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:05.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.321+0000 7f51daffd700 1 -- 172.21.15.133:0/4168738162 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f51e80434f0 con 0x7f51ec0b72b0 2021-01-03T13:06:05.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.461+0000 7f51f2f2c700 1 -- 172.21.15.133:0/4168738162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51ec1413e0 con 0x7f51ec0b72b0 2021-01-03T13:06:05.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.465+0000 7f51daffd700 1 -- 172.21.15.133:0/4168738162 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f51e8046b10 con 0x7f51ec0b72b0 2021-01-03T13:06:05.468 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:05.469 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":114,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:06:01.689575+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:05:56.797390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2021-01-03T13:05:58.040406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:06:05.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.465+0000 7f51f2f2c700 1 -- 172.21.15.133:0/4168738162 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f51cc0554e0 msgr2=0x7f51cc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:05.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.465+0000 7f51f2f2c700 1 --2- 172.21.15.133:0/4168738162 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f51cc0554e0 0x7f51cc0579a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f51dc00b000 tx=0x7f51dc006dc0).stop 2021-01-03T13:06:05.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.465+0000 7f51f2f2c700 1 -- 172.21.15.133:0/4168738162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ec0b72b0 msgr2=0x7f51ec0b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:05.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.465+0000 7f51f2f2c700 1 --2- 172.21.15.133:0/4168738162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ec0b72b0 0x7f51ec0b1090 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f51ec063f40 tx=0x7f51e8007b60).stop 2021-01-03T13:06:05.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.465+0000 7f51f2f2c700 1 -- 172.21.15.133:0/4168738162 shutdown_connections 2021-01-03T13:06:05.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.465+0000 7f51f2f2c700 1 --2- 172.21.15.133:0/4168738162 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f51cc0554e0 0x7f51cc0579a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.465+0000 7f51f2f2c700 1 --2- 172.21.15.133:0/4168738162 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f51ec13eda0 0x7f51ec152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.465+0000 7f51f2f2c700 1 --2- 172.21.15.133:0/4168738162 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f51ec0b2e00 0x7f51ec13c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.465+0000 7f51f2f2c700 1 --2- 172.21.15.133:0/4168738162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f51ec0b72b0 0x7f51ec0b1090 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.465+0000 7f51f2f2c700 1 -- 172.21.15.133:0/4168738162 >> 172.21.15.133:0/4168738162 conn(0x7f51ec05bdf0 msgr2=0x7f51ec060710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:05.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.465+0000 7f51f2f2c700 1 -- 172.21.15.133:0/4168738162 shutdown_connections 2021-01-03T13:06:05.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.465+0000 7f51f2f2c700 1 -- 172.21.15.133:0/4168738162 wait complete. 2021-01-03T13:06:05.483 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:05:56.797390+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:05:58.040406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:06:05.484 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:06:05.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.609+0000 7fd704abe700 1 Processor -- start 2021-01-03T13:06:05.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.609+0000 7fd704abe700 1 -- start start 2021-01-03T13:06:05.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd704abe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd7000b0a60 0x7fd7000a9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd704abe700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7000b16a0 con 0x7fd7000a8850 2021-01-03T13:06:05.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd704abe700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7000b2840 con 0x7fd7000b2460 2021-01-03T13:06:05.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd704abe700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000aeae0 con 0x7fd7000b0a60 2021-01-03T13:06:05.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6ff7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd7000b2460 0x7fd7000ad490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59088/0 (socket says 172.21.15.133:59088) 2021-01-03T13:06:05.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6ff7fe700 1 -- 172.21.15.133:0/2944696831 learned_addr learned my addr 172.21.15.133:0/2944696831 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:05.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6feffd700 1 --2- 172.21.15.133:0/2944696831 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd7000b0a60 0x7fd7000a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fe7fc700 1 -- 172.21.15.133:0/2944696831 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155111397 0 0) 0x7fd7000b2840 con 0x7fd7000b2460 2021-01-03T13:06:05.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fe7fc700 1 -- 172.21.15.133:0/2944696831 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6ec004340 con 0x7fd7000b2460 2021-01-03T13:06:05.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fe7fc700 1 -- 172.21.15.133:0/2944696831 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416252916 0 0) 0x7fd7000b16a0 con 0x7fd7000a8850 2021-01-03T13:06:05.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fe7fc700 1 -- 172.21.15.133:0/2944696831 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7000b2840 con 0x7fd7000a8850 2021-01-03T13:06:05.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fe7fc700 1 -- 172.21.15.133:0/2944696831 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3191775456 0 0) 0x7fd6ec004340 con 0x7fd7000b2460 2021-01-03T13:06:05.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fe7fc700 1 -- 172.21.15.133:0/2944696831 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd7000b0a60 msgr2=0x7fd7000a9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:05.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fe7fc700 1 --2- 172.21.15.133:0/2944696831 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd7000b0a60 0x7fd7000a9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fe7fc700 1 -- 172.21.15.133:0/2944696831 >> v1:172.21.15.16:6789/0 conn(0x7fd7000a8850 legacy=0x7fd7000a8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:05.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fe7fc700 1 -- 172.21.15.133:0/2944696831 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7000b1160 con 0x7fd7000b2460 2021-01-03T13:06:05.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fe7fc700 1 -- 172.21.15.133:0/2944696831 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fd6f0001a90 con 0x7fd7000b2460 2021-01-03T13:06:05.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fe7fc700 1 -- 172.21.15.133:0/2944696831 >> v1:172.21.15.133:6789/0 conn(0x7fd7000b2460 legacy=0x7fd7000ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:05.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fe7fc700 1 --2- 172.21.15.133:0/2944696831 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6ec0049c0 0x7fd6ec004dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fe7fc700 1 --2- 172.21.15.133:0/2944696831 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd7000b0a60 0x7fd6ec0055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fe7fc700 1 --2- 172.21.15.133:0/2944696831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6ec005ad0 0x7fd6ec005f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fe7fc700 1 -- 172.21.15.133:0/2944696831 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000aeae0 con 0x7fd6ec0049c0 2021-01-03T13:06:05.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fe7fc700 1 -- 172.21.15.133:0/2944696831 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec0052b0 con 0x7fd6ec005ad0 2021-01-03T13:06:05.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fe7fc700 1 -- 172.21.15.133:0/2944696831 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec003230 con 0x7fd7000b0a60 2021-01-03T13:06:05.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fffff700 1 --2- 172.21.15.133:0/2944696831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6ec005ad0 0x7fd6ec005f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6ff7fe700 1 --2- 172.21.15.133:0/2944696831 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6ec0049c0 0x7fd6ec004dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fffff700 1 -- 172.21.15.133:0/2944696831 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd7000b0a60 msgr2=0x7fd6ec0055e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:05.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fffff700 1 --2- 172.21.15.133:0/2944696831 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd7000b0a60 0x7fd6ec0055e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-03T13:06:05.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fffff700 1 -- 172.21.15.133:0/2944696831 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6ec0049c0 msgr2=0x7fd6ec004dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:05.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fffff700 1 --2- 172.21.15.133:0/2944696831 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd6ec0049c0 0x7fd6ec004dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fffff700 1 -- 172.21.15.133:0/2944696831 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec004340 con 0x7fd6ec005ad0 2021-01-03T13:06:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.613+0000 7fd6fffff700 1 --2- 172.21.15.133:0/2944696831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6ec005ad0 0x7fd6ec005f50 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7fd6f8001120 tx=0x7fd6f8007bb0).ready entity=mon.1 client_cookie=4089d60cb0618de9 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:05.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd6fe7fc700 1 -- 172.21.15.133:0/2944696831 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f800c830 con 0x7fd6ec005ad0 2021-01-03T13:06:05.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd6fe7fc700 1 -- 172.21.15.133:0/2944696831 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f800c990 con 0x7fd6ec005ad0 2021-01-03T13:06:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd6fe7fc700 1 -- 172.21.15.133:0/2944696831 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f800ccf0 con 0x7fd6ec005ad0 2021-01-03T13:06:05.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd704abe700 1 -- 172.21.15.133:0/2944696831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6ec005ad0 msgr2=0x7fd6ec005f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd704abe700 1 --2- 172.21.15.133:0/2944696831 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd6ec005ad0 0x7fd6ec005f50 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7fd6f8001120 tx=0x7fd6f8007bb0).stop 2021-01-03T13:06:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd6fffff700 1 -- 172.21.15.133:0/2944696831 reap_dead start 2021-01-03T13:06:05.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd704abe700 1 -- 172.21.15.133:0/2944696831 shutdown_connections 2021-01-03T13:06:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd704abe700 1 -- 172.21.15.133:0/2944696831 >> 172.21.15.133:0/2944696831 conn(0x7fd70006b050 msgr2=0x7fd700060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:05.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd704abe700 1 -- 172.21.15.133:0/2944696831 shutdown_connections 2021-01-03T13:06:05.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd704abe700 1 -- 172.21.15.133:0/2944696831 wait complete. 2021-01-03T13:06:05.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd704abe700 1 Processor -- start 2021-01-03T13:06:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd704abe700 1 -- start start 2021-01-03T13:06:05.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd704abe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7000aa3f0 0x7fd7000a7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd704abe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7000a81c0 0x7fd70014db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd704abe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd70014e020 0x7fd70014e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd704abe700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd700151fc0 con 0x7fd7000a81c0 2021-01-03T13:06:05.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd704abe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7001510e0 con 0x7fd7000aa3f0 2021-01-03T13:06:05.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd704abe700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd700151340 con 0x7fd70014e020 2021-01-03T13:06:05.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd6ff7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7000aa3f0 0x7fd7000a7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd6ff7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7000aa3f0 0x7fd7000a7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38068/0 (socket says 172.21.15.133:38068) 2021-01-03T13:06:05.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd6ff7fe700 1 -- 172.21.15.133:0/1475717361 learned_addr learned my addr 172.21.15.133:0/1475717361 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:05.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd6fffff700 1 --2- 172.21.15.133:0/1475717361 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd70014e020 0x7fd70014e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.617+0000 7fd6feffd700 1 --2- 172.21.15.133:0/1475717361 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7000a81c0 0x7fd70014db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.621+0000 7fd6ff7fe700 1 -- 172.21.15.133:0/1475717361 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd70014e020 msgr2=0x7fd70014e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:05.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.621+0000 7fd6ff7fe700 1 --2- 172.21.15.133:0/1475717361 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd70014e020 0x7fd70014e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.621+0000 7fd6ff7fe700 1 -- 172.21.15.133:0/1475717361 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7000a81c0 msgr2=0x7fd70014db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:05.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.621+0000 7fd6ff7fe700 1 --2- 172.21.15.133:0/1475717361 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7000a81c0 0x7fd70014db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.621+0000 7fd6ff7fe700 1 -- 172.21.15.133:0/1475717361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7001515e0 con 0x7fd7000aa3f0 2021-01-03T13:06:05.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.621+0000 7fd6ff7fe700 1 --2- 172.21.15.133:0/1475717361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7000aa3f0 0x7fd7000a7cd0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7fd6f000b000 tx=0x7fd7000b32f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:05.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.621+0000 7fd6fcff9700 1 -- 172.21.15.133:0/1475717361 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f000acf0 con 0x7fd7000aa3f0 2021-01-03T13:06:05.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.621+0000 7fd6fcff9700 1 -- 172.21.15.133:0/1475717361 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f0010040 con 0x7fd7000aa3f0 2021-01-03T13:06:05.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.621+0000 7fd704abe700 1 -- 172.21.15.133:0/1475717361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd700151880 con 0x7fd7000aa3f0 2021-01-03T13:06:05.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.621+0000 7fd6fcff9700 1 -- 172.21.15.133:0/1475717361 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6f00155f0 con 0x7fd7000aa3f0 2021-01-03T13:06:05.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.621+0000 7fd704abe700 1 -- 172.21.15.133:0/1475717361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7000a8640 con 0x7fd7000aa3f0 2021-01-03T13:06:05.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.621+0000 7fd704abe700 1 -- 172.21.15.133:0/1475717361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd700057300 con 0x7fd7000aa3f0 2021-01-03T13:06:05.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.621+0000 7fd6fcff9700 1 -- 172.21.15.133:0/1475717361 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd6f001b020 con 0x7fd7000aa3f0 2021-01-03T13:06:05.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.621+0000 7fd6fcff9700 1 --2- 172.21.15.133:0/1475717361 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd6e00553b0 0x7fd6e0057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.621+0000 7fd6fcff9700 1 -- 172.21.15.133:0/1475717361 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd6f006db60 con 0x7fd7000aa3f0 2021-01-03T13:06:05.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.621+0000 7fd6feffd700 1 --2- 172.21.15.133:0/1475717361 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd6e00553b0 0x7fd6e0057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.621+0000 7fd6feffd700 1 --2- 172.21.15.133:0/1475717361 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd6e00553b0 0x7fd6e0057870 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fd6f4002000 tx=0x7fd6f4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:05.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.629+0000 7fd6fcff9700 1 -- 172.21.15.133:0/1475717361 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd6f0043e60 con 0x7fd7000aa3f0 2021-01-03T13:06:05.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.769+0000 7fd704abe700 1 -- 172.21.15.133:0/1475717361 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd70005f080 con 0x7fd7000aa3f0 2021-01-03T13:06:05.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.769+0000 7fd6fcff9700 1 -- 172.21.15.133:0/1475717361 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v114) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd6f0047480 con 0x7fd7000aa3f0 2021-01-03T13:06:05.776 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:06:05.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.773+0000 7fd704abe700 1 -- 172.21.15.133:0/1475717361 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd6e00553b0 msgr2=0x7fd6e0057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:05.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.773+0000 7fd704abe700 1 --2- 172.21.15.133:0/1475717361 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd6e00553b0 0x7fd6e0057870 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fd6f4002000 tx=0x7fd6f4008040).stop 2021-01-03T13:06:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.773+0000 7fd704abe700 1 -- 172.21.15.133:0/1475717361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7000aa3f0 msgr2=0x7fd7000a7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.773+0000 7fd704abe700 1 --2- 172.21.15.133:0/1475717361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7000aa3f0 0x7fd7000a7cd0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7fd6f000b000 tx=0x7fd7000b32f0).stop 2021-01-03T13:06:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.773+0000 7fd704abe700 1 -- 172.21.15.133:0/1475717361 shutdown_connections 2021-01-03T13:06:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.773+0000 7fd704abe700 1 --2- 172.21.15.133:0/1475717361 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd6e00553b0 0x7fd6e0057870 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.773+0000 7fd704abe700 1 --2- 172.21.15.133:0/1475717361 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd70014e020 0x7fd70014e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.773+0000 7fd704abe700 1 --2- 172.21.15.133:0/1475717361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd7000aa3f0 0x7fd7000a7cd0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.773+0000 7fd704abe700 1 --2- 172.21.15.133:0/1475717361 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd7000a81c0 0x7fd70014db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.773+0000 7fd704abe700 1 -- 172.21.15.133:0/1475717361 >> 172.21.15.133:0/1475717361 conn(0x7fd70006b050 msgr2=0x7fd7000aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.773+0000 7fd704abe700 1 -- 172.21.15.133:0/1475717361 shutdown_connections 2021-01-03T13:06:05.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.773+0000 7fd704abe700 1 -- 172.21.15.133:0/1475717361 wait complete. 2021-01-03T13:06:05.799 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:06:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f34ef2700 1 Processor -- start 2021-01-03T13:06:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f34ef2700 1 -- start start 2021-01-03T13:06:05.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f34ef2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7f30140410 0x7f7f30146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f34ef2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f301407f0 0x7f7f30142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f34ef2700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7f300b0470 0x7f7f3005bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f34ef2700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f300b02d0 con 0x7f7f300b0470 2021-01-03T13:06:05.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f34ef2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f30146390 con 0x7f7f30140410 2021-01-03T13:06:05.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f34ef2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3005cf20 con 0x7f7f301407f0 2021-01-03T13:06:05.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f2e59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7f30140410 0x7f7f30146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f2e59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7f30140410 0x7f7f30146cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38076/0 (socket says 172.21.15.133:38076) 2021-01-03T13:06:05.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f2e59c700 1 -- 172.21.15.133:0/2051528748 learned_addr learned my addr 172.21.15.133:0/2051528748 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:05.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f2ed9d700 1 --2- 172.21.15.133:0/2051528748 >> v2:172.21.15.16:3300/0 conn(0x7f7f300b0470 0x7f7f3005bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f2dd9b700 1 --2- 172.21.15.133:0/2051528748 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f301407f0 0x7f7f30142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f2e59c700 1 -- 172.21.15.133:0/2051528748 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f301407f0 msgr2=0x7f7f30142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:05.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f2e59c700 1 --2- 172.21.15.133:0/2051528748 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f301407f0 0x7f7f30142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f2e59c700 1 -- 172.21.15.133:0/2051528748 >> v2:172.21.15.16:3300/0 conn(0x7f7f300b0470 msgr2=0x7f7f3005bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:05.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f2e59c700 1 --2- 172.21.15.133:0/2051528748 >> v2:172.21.15.16:3300/0 conn(0x7f7f300b0470 0x7f7f3005bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f2e59c700 1 -- 172.21.15.133:0/2051528748 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f30146580 con 0x7f7f30140410 2021-01-03T13:06:05.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f2ed9d700 1 --2- 172.21.15.133:0/2051528748 >> v2:172.21.15.16:3300/0 conn(0x7f7f300b0470 0x7f7f3005bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:05.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f2e59c700 1 --2- 172.21.15.133:0/2051528748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f30140410 0x7f7f30146cc0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f7f20002f30 tx=0x7f7f20006e80).ready entity=mon.1 client_cookie=96c9ef5aebdd2785 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:05.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f2d59a700 1 -- 172.21.15.133:0/2051528748 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f200097f0 con 0x7f7f30140410 2021-01-03T13:06:05.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f2d59a700 1 -- 172.21.15.133:0/2051528748 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f20009950 con 0x7f7f30140410 2021-01-03T13:06:05.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f2d59a700 1 -- 172.21.15.133:0/2051528748 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f20009cb0 con 0x7f7f30140410 2021-01-03T13:06:05.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f34ef2700 1 -- 172.21.15.133:0/2051528748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f30140410 msgr2=0x7f7f30146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:05.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f34ef2700 1 --2- 172.21.15.133:0/2051528748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f30140410 0x7f7f30146cc0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f7f20002f30 tx=0x7f7f20006e80).stop 2021-01-03T13:06:05.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f34ef2700 1 -- 172.21.15.133:0/2051528748 shutdown_connections 2021-01-03T13:06:05.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f34ef2700 1 --2- 172.21.15.133:0/2051528748 >> v2:172.21.15.16:3300/0 conn(0x7f7f300b0470 0x7f7f3005bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f34ef2700 1 --2- 172.21.15.133:0/2051528748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f30140410 0x7f7f30146cc0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f34ef2700 1 --2- 172.21.15.133:0/2051528748 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f301407f0 0x7f7f30142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f34ef2700 1 -- 172.21.15.133:0/2051528748 >> 172.21.15.133:0/2051528748 conn(0x7f7f300b95d0 msgr2=0x7f7f300b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:05.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f34ef2700 1 -- 172.21.15.133:0/2051528748 shutdown_connections 2021-01-03T13:06:05.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.921+0000 7f7f34ef2700 1 -- 172.21.15.133:0/2051528748 wait complete. 2021-01-03T13:06:05.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f34ef2700 1 Processor -- start 2021-01-03T13:06:05.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f34ef2700 1 -- start start 2021-01-03T13:06:05.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f34ef2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f300b0470 0x7f7f301434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f34ef2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f30140410 0x7f7f300b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f34ef2700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f301407f0 0x7f7f30155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f34ef2700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f301439c0 con 0x7f7f301407f0 2021-01-03T13:06:05.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f34ef2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f30155310 con 0x7f7f30140410 2021-01-03T13:06:05.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f34ef2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f300b3d90 con 0x7f7f300b0470 2021-01-03T13:06:05.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f2dd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f30140410 0x7f7f300b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f2dd9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f30140410 0x7f7f300b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38086/0 (socket says 172.21.15.133:38086) 2021-01-03T13:06:05.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f2dd9b700 1 -- 172.21.15.133:0/3614572910 learned_addr learned my addr 172.21.15.133:0/3614572910 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:05.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f2ed9d700 1 --2- 172.21.15.133:0/3614572910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f301407f0 0x7f7f30155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f2e59c700 1 --2- 172.21.15.133:0/3614572910 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f300b0470 0x7f7f301434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f2dd9b700 1 -- 172.21.15.133:0/3614572910 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f300b0470 msgr2=0x7f7f301434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:05.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f2dd9b700 1 --2- 172.21.15.133:0/3614572910 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f300b0470 0x7f7f301434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f2dd9b700 1 -- 172.21.15.133:0/3614572910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f301407f0 msgr2=0x7f7f30155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:05.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f2dd9b700 1 --2- 172.21.15.133:0/3614572910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f301407f0 0x7f7f30155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:05.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f2dd9b700 1 -- 172.21.15.133:0/3614572910 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f30141140 con 0x7f7f30140410 2021-01-03T13:06:05.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f2e59c700 1 --2- 172.21.15.133:0/3614572910 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f300b0470 0x7f7f301434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:05.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f2dd9b700 1 --2- 172.21.15.133:0/3614572910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f30140410 0x7f7f300b1ca0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f7f2400a000 tx=0x7f7f24008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:05.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f1f7fe700 1 -- 172.21.15.133:0/3614572910 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f24011780 con 0x7f7f30140410 2021-01-03T13:06:05.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f1f7fe700 1 -- 172.21.15.133:0/3614572910 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f240118e0 con 0x7f7f30140410 2021-01-03T13:06:05.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f34ef2700 1 -- 172.21.15.133:0/3614572910 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f301413e0 con 0x7f7f30140410 2021-01-03T13:06:05.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f1f7fe700 1 -- 172.21.15.133:0/3614572910 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f24011c40 con 0x7f7f30140410 2021-01-03T13:06:05.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.925+0000 7f7f34ef2700 1 -- 172.21.15.133:0/3614572910 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f30151d60 con 0x7f7f30140410 2021-01-03T13:06:05.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.929+0000 7f7f34ef2700 1 -- 172.21.15.133:0/3614572910 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f30151f20 con 0x7f7f30140410 2021-01-03T13:06:05.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.929+0000 7f7f1f7fe700 1 -- 172.21.15.133:0/3614572910 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7f2401c460 con 0x7f7f30140410 2021-01-03T13:06:05.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.929+0000 7f7f1f7fe700 1 --2- 172.21.15.133:0/3614572910 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7f0c055440 0x7f7f0c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:05.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.929+0000 7f7f2e59c700 1 --2- 172.21.15.133:0/3614572910 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7f0c055440 0x7f7f0c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:05.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.929+0000 7f7f1f7fe700 1 -- 172.21.15.133:0/3614572910 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7f2406e330 con 0x7f7f30140410 2021-01-03T13:06:05.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.929+0000 7f7f2e59c700 1 --2- 172.21.15.133:0/3614572910 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7f0c055440 0x7f7f0c057900 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f7f2001a000 tx=0x7f7f20015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:05.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:05.937+0000 7f7f1f7fe700 1 -- 172.21.15.133:0/3614572910 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7f240445d0 con 0x7f7f30140410 2021-01-03T13:06:06.083 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.077+0000 7f7f34ef2700 1 -- 172.21.15.133:0/3614572910 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7f30057300 con 0x7f7f30140410 2021-01-03T13:06:06.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.077+0000 7f7f1f7fe700 1 -- 172.21.15.133:0/3614572910 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v114) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7f24047bf0 con 0x7f7f30140410 2021-01-03T13:06:06.084 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:06:06.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.081+0000 7f7f34ef2700 1 -- 172.21.15.133:0/3614572910 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7f0c055440 msgr2=0x7f7f0c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.081+0000 7f7f34ef2700 1 --2- 172.21.15.133:0/3614572910 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7f0c055440 0x7f7f0c057900 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f7f2001a000 tx=0x7f7f20015000).stop 2021-01-03T13:06:06.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.081+0000 7f7f34ef2700 1 -- 172.21.15.133:0/3614572910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f30140410 msgr2=0x7f7f300b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.081+0000 7f7f34ef2700 1 --2- 172.21.15.133:0/3614572910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f30140410 0x7f7f300b1ca0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f7f2400a000 tx=0x7f7f24008040).stop 2021-01-03T13:06:06.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.081+0000 7f7f34ef2700 1 -- 172.21.15.133:0/3614572910 shutdown_connections 2021-01-03T13:06:06.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.081+0000 7f7f34ef2700 1 --2- 172.21.15.133:0/3614572910 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7f0c055440 0x7f7f0c057900 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.081+0000 7f7f34ef2700 1 --2- 172.21.15.133:0/3614572910 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7f301407f0 0x7f7f30155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.081+0000 7f7f34ef2700 1 --2- 172.21.15.133:0/3614572910 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7f300b0470 0x7f7f301434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.081+0000 7f7f34ef2700 1 --2- 172.21.15.133:0/3614572910 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f30140410 0x7f7f300b1ca0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.081+0000 7f7f34ef2700 1 -- 172.21.15.133:0/3614572910 >> 172.21.15.133:0/3614572910 conn(0x7f7f300b95d0 msgr2=0x7f7f300b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:06.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.081+0000 7f7f34ef2700 1 -- 172.21.15.133:0/3614572910 shutdown_connections 2021-01-03T13:06:06.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.081+0000 7f7f34ef2700 1 -- 172.21.15.133:0/3614572910 wait complete. 2021-01-03T13:06:06.104 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:06:06.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64820bc700 1 Processor -- start 2021-01-03T13:06:06.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64820bc700 1 -- start start 2021-01-03T13:06:06.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64820bc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b5260 0x7f647c1470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:06.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64820bc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f647c0b5c00 0x7f647c1475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:06.226 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64820bc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c0b0c10 con 0x7f647c1442a0 2021-01-03T13:06:06.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64820bc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647c0b5640 con 0x7f647c0b5c00 2021-01-03T13:06:06.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64820bc700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c09a4f0 con 0x7f647c0b5260 2021-01-03T13:06:06.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64808b9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f647c0b5c00 0x7f647c1475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:06.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64808b9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f647c0b5c00 0x7f647c1475a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38092/0 (socket says 172.21.15.133:38092) 2021-01-03T13:06:06.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64808b9700 1 -- 172.21.15.133:0/937699683 learned_addr learned my addr 172.21.15.133:0/937699683 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:06.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64810ba700 1 --2- 172.21.15.133:0/937699683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b5260 0x7f647c1470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:06.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f6473fff700 1 -- 172.21.15.133:0/937699683 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512900073 0 0) 0x7f647c0b0c10 con 0x7f647c1442a0 2021-01-03T13:06:06.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64808b9700 1 -- 172.21.15.133:0/937699683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b5260 msgr2=0x7f647c1470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:06.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64808b9700 1 --2- 172.21.15.133:0/937699683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b5260 0x7f647c1470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64808b9700 1 -- 172.21.15.133:0/937699683 >> v1:172.21.15.133:6789/0 conn(0x7f647c1442a0 legacy=0x7f647c144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64808b9700 1 -- 172.21.15.133:0/937699683 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c0b0e40 con 0x7f647c0b5c00 2021-01-03T13:06:06.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64808b9700 1 --2- 172.21.15.133:0/937699683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c0b5c00 0x7f647c1475a0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f646c002f30 tx=0x7f646c006e80).ready entity=mon.1 client_cookie=e0ee151fd9a4f276 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:06.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f6473fff700 1 -- 172.21.15.133:0/937699683 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f646c0097f0 con 0x7f647c0b5c00 2021-01-03T13:06:06.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f6473fff700 1 -- 172.21.15.133:0/937699683 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c009950 con 0x7f647c0b5c00 2021-01-03T13:06:06.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f6473fff700 1 -- 172.21.15.133:0/937699683 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f646c009cb0 con 0x7f647c0b5c00 2021-01-03T13:06:06.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64820bc700 1 -- 172.21.15.133:0/937699683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c0b5c00 msgr2=0x7f647c1475a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.217+0000 7f64820bc700 1 --2- 172.21.15.133:0/937699683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c0b5c00 0x7f647c1475a0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f646c002f30 tx=0x7f646c006e80).stop 2021-01-03T13:06:06.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.221+0000 7f64820bc700 1 -- 172.21.15.133:0/937699683 shutdown_connections 2021-01-03T13:06:06.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.221+0000 7f64820bc700 1 --2- 172.21.15.133:0/937699683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b5260 0x7f647c1470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.221+0000 7f64820bc700 1 --2- 172.21.15.133:0/937699683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c0b5c00 0x7f647c1475a0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.221+0000 7f64820bc700 1 -- 172.21.15.133:0/937699683 >> 172.21.15.133:0/937699683 conn(0x7f647c05bdf0 msgr2=0x7f647c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:06.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.221+0000 7f64820bc700 1 -- 172.21.15.133:0/937699683 shutdown_connections 2021-01-03T13:06:06.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.221+0000 7f64820bc700 1 -- 172.21.15.133:0/937699683 wait complete. 2021-01-03T13:06:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.221+0000 7f64820bc700 1 Processor -- start 2021-01-03T13:06:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.221+0000 7f64820bc700 1 -- start start 2021-01-03T13:06:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64820bc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b5260 0x7f647c065880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64820bc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c0b5c00 0x7f647c066060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64820bc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c1442a0 0x7f647c146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64820bc700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c145ab0 con 0x7f647c0b5c00 2021-01-03T13:06:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64820bc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c066550 con 0x7f647c1442a0 2021-01-03T13:06:06.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64820bc700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c066c60 con 0x7f647c0b5260 2021-01-03T13:06:06.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64818bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c1442a0 0x7f647c146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:06.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64818bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c1442a0 0x7f647c146a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38100/0 (socket says 172.21.15.133:38100) 2021-01-03T13:06:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64818bb700 1 -- 172.21.15.133:0/3402011131 learned_addr learned my addr 172.21.15.133:0/3402011131 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64810ba700 1 --2- 172.21.15.133:0/3402011131 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b5260 0x7f647c065880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64808b9700 1 --2- 172.21.15.133:0/3402011131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c0b5c00 0x7f647c066060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64818bb700 1 -- 172.21.15.133:0/3402011131 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b5260 msgr2=0x7f647c065880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64818bb700 1 --2- 172.21.15.133:0/3402011131 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b5260 0x7f647c065880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64818bb700 1 -- 172.21.15.133:0/3402011131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c0b5c00 msgr2=0x7f647c066060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64818bb700 1 --2- 172.21.15.133:0/3402011131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c0b5c00 0x7f647c066060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64818bb700 1 -- 172.21.15.133:0/3402011131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c066ec0 con 0x7f647c1442a0 2021-01-03T13:06:06.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64808b9700 1 --2- 172.21.15.133:0/3402011131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c0b5c00 0x7f647c066060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:06.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64818bb700 1 --2- 172.21.15.133:0/3402011131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c1442a0 0x7f647c146a10 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f647c1467d0 tx=0x7f6474007f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:06.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64727fc700 1 -- 172.21.15.133:0/3402011131 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64740030c0 con 0x7f647c1442a0 2021-01-03T13:06:06.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64727fc700 1 -- 172.21.15.133:0/3402011131 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6474006a70 con 0x7f647c1442a0 2021-01-03T13:06:06.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64820bc700 1 -- 172.21.15.133:0/3402011131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647c0aa6a0 con 0x7f647c1442a0 2021-01-03T13:06:06.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64727fc700 1 -- 172.21.15.133:0/3402011131 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6474006dd0 con 0x7f647c1442a0 2021-01-03T13:06:06.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64820bc700 1 -- 172.21.15.133:0/3402011131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647c0aabe0 con 0x7f647c1442a0 2021-01-03T13:06:06.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64820bc700 1 -- 172.21.15.133:0/3402011131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647c057300 con 0x7f647c1442a0 2021-01-03T13:06:06.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.225+0000 7f64727fc700 1 -- 172.21.15.133:0/3402011131 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6474010030 con 0x7f647c1442a0 2021-01-03T13:06:06.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.229+0000 7f64727fc700 1 --2- 172.21.15.133:0/3402011131 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64640553b0 0x7f6464057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:06.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.229+0000 7f64727fc700 1 -- 172.21.15.133:0/3402011131 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f647406ddf0 con 0x7f647c1442a0 2021-01-03T13:06:06.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.229+0000 7f64810ba700 1 --2- 172.21.15.133:0/3402011131 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64640553b0 0x7f6464057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:06.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.229+0000 7f64810ba700 1 --2- 172.21.15.133:0/3402011131 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64640553b0 0x7f6464057870 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f647800c000 tx=0x7f6478008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:06.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.233+0000 7f64727fc700 1 -- 172.21.15.133:0/3402011131 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f64740440f0 con 0x7f647c1442a0 2021-01-03T13:06:06.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.373+0000 7f64820bc700 1 -- 172.21.15.133:0/3402011131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f647c155fb0 con 0x7f647c1442a0 2021-01-03T13:06:06.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.373+0000 7f64727fc700 1 -- 172.21.15.133:0/3402011131 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v114) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6474047710 con 0x7f647c1442a0 2021-01-03T13:06:06.380 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:06:06.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.377+0000 7f64820bc700 1 -- 172.21.15.133:0/3402011131 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64640553b0 msgr2=0x7f6464057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.377+0000 7f64820bc700 1 --2- 172.21.15.133:0/3402011131 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64640553b0 0x7f6464057870 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f647800c000 tx=0x7f6478008040).stop 2021-01-03T13:06:06.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.377+0000 7f64820bc700 1 -- 172.21.15.133:0/3402011131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c1442a0 msgr2=0x7f647c146a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.377+0000 7f64820bc700 1 --2- 172.21.15.133:0/3402011131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c1442a0 0x7f647c146a10 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f647c1467d0 tx=0x7f6474007f60).stop 2021-01-03T13:06:06.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.377+0000 7f64820bc700 1 -- 172.21.15.133:0/3402011131 shutdown_connections 2021-01-03T13:06:06.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.377+0000 7f64820bc700 1 --2- 172.21.15.133:0/3402011131 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64640553b0 0x7f6464057870 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.377+0000 7f64820bc700 1 --2- 172.21.15.133:0/3402011131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c1442a0 0x7f647c146a10 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.377+0000 7f64820bc700 1 --2- 172.21.15.133:0/3402011131 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b5260 0x7f647c065880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.377+0000 7f64820bc700 1 --2- 172.21.15.133:0/3402011131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c0b5c00 0x7f647c066060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.377+0000 7f64820bc700 1 -- 172.21.15.133:0/3402011131 >> 172.21.15.133:0/3402011131 conn(0x7f647c05bdf0 msgr2=0x7f647c0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:06.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.377+0000 7f64820bc700 1 -- 172.21.15.133:0/3402011131 shutdown_connections 2021-01-03T13:06:06.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.377+0000 7f64820bc700 1 -- 172.21.15.133:0/3402011131 wait complete. 2021-01-03T13:06:06.393 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:06:06.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.505+0000 7f4aab291700 1 Processor -- start 2021-01-03T13:06:06.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.505+0000 7f4aab291700 1 -- start start 2021-01-03T13:06:06.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.505+0000 7f4aab291700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4aa4060890 0x7f4aa40abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:06.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.505+0000 7f4aab291700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa40aaa10 con 0x7f4aa40ae900 2021-01-03T13:06:06.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.505+0000 7f4aab291700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa40b0ab0 con 0x7f4aa40afa80 2021-01-03T13:06:06.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.505+0000 7f4aab291700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa40ab280 con 0x7f4aa4060890 2021-01-03T13:06:06.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aaa28f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4aa4060890 0x7f4aa40abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:06.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aa9a8e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4aa40afa80 0x7f4aa40b4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59136/0 (socket says 172.21.15.133:59136) 2021-01-03T13:06:06.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aa9a8e700 1 -- 172.21.15.133:0/353704806 learned_addr learned my addr 172.21.15.133:0/353704806 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:06.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aa928d700 1 -- 172.21.15.133:0/353704806 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973813205 0 0) 0x7f4aa40b0ab0 con 0x7f4aa40afa80 2021-01-03T13:06:06.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aa928d700 1 -- 172.21.15.133:0/353704806 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a8c003230 con 0x7f4aa40afa80 2021-01-03T13:06:06.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aaa28f700 1 -- 172.21.15.133:0/353704806 >> v1:172.21.15.133:6789/0 conn(0x7f4aa40afa80 legacy=0x7f4aa40b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aaa28f700 1 -- 172.21.15.133:0/353704806 >> v1:172.21.15.16:6789/0 conn(0x7f4aa40ae900 legacy=0x7f4aa40aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aaa28f700 1 -- 172.21.15.133:0/353704806 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa40b1240 con 0x7f4aa4060890 2021-01-03T13:06:06.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aaa28f700 1 --2- 172.21.15.133:0/353704806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa4060890 0x7f4aa40abcc0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f4aa0002f30 tx=0x7f4aa0006dc0).ready entity=mon.1 client_cookie=794617236c1b9f67 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aa928d700 1 -- 172.21.15.133:0/353704806 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa0009800 con 0x7f4aa4060890 2021-01-03T13:06:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aa928d700 1 -- 172.21.15.133:0/353704806 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa0009960 con 0x7f4aa4060890 2021-01-03T13:06:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aa928d700 1 -- 172.21.15.133:0/353704806 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa0009cc0 con 0x7f4aa4060890 2021-01-03T13:06:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aab291700 1 -- 172.21.15.133:0/353704806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa4060890 msgr2=0x7f4aa40abcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aab291700 1 --2- 172.21.15.133:0/353704806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa4060890 0x7f4aa40abcc0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f4aa0002f30 tx=0x7f4aa0006dc0).stop 2021-01-03T13:06:06.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aab291700 1 -- 172.21.15.133:0/353704806 shutdown_connections 2021-01-03T13:06:06.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aab291700 1 --2- 172.21.15.133:0/353704806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa4060890 0x7f4aa40abcc0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aab291700 1 -- 172.21.15.133:0/353704806 >> 172.21.15.133:0/353704806 conn(0x7f4aa405bdf0 msgr2=0x7f4aa405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:06.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aab291700 1 -- 172.21.15.133:0/353704806 shutdown_connections 2021-01-03T13:06:06.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aab291700 1 -- 172.21.15.133:0/353704806 wait complete. 2021-01-03T13:06:06.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aab291700 1 Processor -- start 2021-01-03T13:06:06.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aab291700 1 -- start start 2021-01-03T13:06:06.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aab291700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa4060890 0x7f4aa4091fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:06.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aab291700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4aa40ae900 0x7f4aa40960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:06.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aab291700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4aa40afa80 0x7f4aa4150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:06.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aab291700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa4093b70 con 0x7f4aa40afa80 2021-01-03T13:06:06.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aab291700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa40959a0 con 0x7f4aa4060890 2021-01-03T13:06:06.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aab291700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa4092790 con 0x7f4aa40ae900 2021-01-03T13:06:06.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aaa28f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa4060890 0x7f4aa4091fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:06.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aaa28f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa4060890 0x7f4aa4091fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38112/0 (socket says 172.21.15.133:38112) 2021-01-03T13:06:06.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.509+0000 7f4aaa28f700 1 -- 172.21.15.133:0/3343894303 learned_addr learned my addr 172.21.15.133:0/3343894303 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:06.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.513+0000 7f4aa9a8e700 1 --2- 172.21.15.133:0/3343894303 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4aa40ae900 0x7f4aa40960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:06.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.513+0000 7f4aaaa90700 1 --2- 172.21.15.133:0/3343894303 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4aa40afa80 0x7f4aa4150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:06.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.513+0000 7f4aaa28f700 1 -- 172.21.15.133:0/3343894303 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4aa40ae900 msgr2=0x7f4aa40960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.513+0000 7f4aaa28f700 1 --2- 172.21.15.133:0/3343894303 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4aa40ae900 0x7f4aa40960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.513+0000 7f4aaa28f700 1 -- 172.21.15.133:0/3343894303 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4aa40afa80 msgr2=0x7f4aa4150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.513+0000 7f4aaa28f700 1 --2- 172.21.15.133:0/3343894303 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4aa40afa80 0x7f4aa4150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.513+0000 7f4aaa28f700 1 -- 172.21.15.133:0/3343894303 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa4092a30 con 0x7f4aa4060890 2021-01-03T13:06:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.513+0000 7f4aaa28f700 1 --2- 172.21.15.133:0/3343894303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa4060890 0x7f4aa4091fb0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f4aa0002f30 tx=0x7f4aa0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:06.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.513+0000 7f4a937fe700 1 -- 172.21.15.133:0/3343894303 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa0011b60 con 0x7f4aa4060890 2021-01-03T13:06:06.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.513+0000 7f4a937fe700 1 -- 172.21.15.133:0/3343894303 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa0011cc0 con 0x7f4aa4060890 2021-01-03T13:06:06.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.513+0000 7f4aab291700 1 -- 172.21.15.133:0/3343894303 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa4092cd0 con 0x7f4aa4060890 2021-01-03T13:06:06.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.513+0000 7f4a937fe700 1 -- 172.21.15.133:0/3343894303 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa001d630 con 0x7f4aa4060890 2021-01-03T13:06:06.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.513+0000 7f4aab291700 1 -- 172.21.15.133:0/3343894303 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa40b3c90 con 0x7f4aa4060890 2021-01-03T13:06:06.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.513+0000 7f4a937fe700 1 -- 172.21.15.133:0/3343894303 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4aa0017070 con 0x7f4aa4060890 2021-01-03T13:06:06.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.513+0000 7f4aab291700 1 -- 172.21.15.133:0/3343894303 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa4057300 con 0x7f4aa4060890 2021-01-03T13:06:06.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.513+0000 7f4a937fe700 1 --2- 172.21.15.133:0/3343894303 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a84055440 0x7f4a84057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:06.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.517+0000 7f4a937fe700 1 -- 172.21.15.133:0/3343894303 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4aa006ec10 con 0x7f4aa4060890 2021-01-03T13:06:06.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.517+0000 7f4aa9a8e700 1 --2- 172.21.15.133:0/3343894303 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a84055440 0x7f4a84057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:06.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.517+0000 7f4aa9a8e700 1 --2- 172.21.15.133:0/3343894303 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a84055440 0x7f4a84057900 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f4a9400d000 tx=0x7f4a94009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:06.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.517+0000 7f4a937fe700 1 -- 172.21.15.133:0/3343894303 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4aa0044f10 con 0x7f4aa4060890 2021-01-03T13:06:06.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.653+0000 7f4aab291700 1 -- 172.21.15.133:0/3343894303 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4aa406b100 con 0x7f4aa4060890 2021-01-03T13:06:06.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.657+0000 7f4a937fe700 1 -- 172.21.15.133:0/3343894303 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v114) v1 ==== 100+0+10 (secure 0 0 0) 0x7f4aa0006950 con 0x7f4aa4060890 2021-01-03T13:06:06.661 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:06:06.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.657+0000 7f4aab291700 1 -- 172.21.15.133:0/3343894303 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a84055440 msgr2=0x7f4a84057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.657+0000 7f4aab291700 1 --2- 172.21.15.133:0/3343894303 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a84055440 0x7f4a84057900 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f4a9400d000 tx=0x7f4a94009040).stop 2021-01-03T13:06:06.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.657+0000 7f4aab291700 1 -- 172.21.15.133:0/3343894303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa4060890 msgr2=0x7f4aa4091fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.657+0000 7f4aab291700 1 --2- 172.21.15.133:0/3343894303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa4060890 0x7f4aa4091fb0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f4aa0002f30 tx=0x7f4aa0015000).stop 2021-01-03T13:06:06.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.657+0000 7f4aab291700 1 -- 172.21.15.133:0/3343894303 shutdown_connections 2021-01-03T13:06:06.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.657+0000 7f4aab291700 1 --2- 172.21.15.133:0/3343894303 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a84055440 0x7f4a84057900 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.657+0000 7f4aab291700 1 --2- 172.21.15.133:0/3343894303 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4aa40afa80 0x7f4aa4150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.657+0000 7f4aab291700 1 --2- 172.21.15.133:0/3343894303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4aa4060890 0x7f4aa4091fb0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.657+0000 7f4aab291700 1 --2- 172.21.15.133:0/3343894303 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4aa40ae900 0x7f4aa40960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.657+0000 7f4aab291700 1 -- 172.21.15.133:0/3343894303 >> 172.21.15.133:0/3343894303 conn(0x7f4aa405bdf0 msgr2=0x7f4aa405c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:06.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.657+0000 7f4aab291700 1 -- 172.21.15.133:0/3343894303 shutdown_connections 2021-01-03T13:06:06.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.657+0000 7f4aab291700 1 -- 172.21.15.133:0/3343894303 wait complete. 2021-01-03T13:06:06.677 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:06:06.678 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:06:06.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dd12cb700 1 Processor -- start 2021-01-03T13:06:06.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dd12cb700 1 -- start start 2021-01-03T13:06:06.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dd12cb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4dcc0b5ae0 0x7f4dcc0abd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:06.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dd12cb700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4dcc099ff0 0x7f4dcc13fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:06.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dd12cb700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dcc0b5710 con 0x7f4dcc0b5330 2021-01-03T13:06:06.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dd12cb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dcc0b10f0 con 0x7f4dcc0b5ae0 2021-01-03T13:06:06.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dd12cb700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc0ac270 con 0x7f4dcc099ff0 2021-01-03T13:06:06.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dcb7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4dcc0b5ae0 0x7f4dcc0abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:06.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dcb7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4dcc0b5ae0 0x7f4dcc0abd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38120/0 (socket says 172.21.15.133:38120) 2021-01-03T13:06:06.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dcb7fe700 1 -- 172.21.15.133:0/1753680924 learned_addr learned my addr 172.21.15.133:0/1753680924 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:06.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dd0aca700 1 --2- 172.21.15.133:0/1753680924 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4dcc099ff0 0x7f4dcc13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dcb7fe700 1 -- 172.21.15.133:0/1753680924 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4dcc099ff0 msgr2=0x7f4dcc13fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dcb7fe700 1 --2- 172.21.15.133:0/1753680924 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4dcc099ff0 0x7f4dcc13fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dcb7fe700 1 -- 172.21.15.133:0/1753680924 >> v1:172.21.15.16:6789/0 conn(0x7f4dcc0b5330 legacy=0x7f4dcc142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dcb7fe700 1 -- 172.21.15.133:0/1753680924 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc0ab280 con 0x7f4dcc0b5ae0 2021-01-03T13:06:06.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dcb7fe700 1 --2- 172.21.15.133:0/1753680924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dcc0b5ae0 0x7f4dcc0abd80 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f4db4002f30 tx=0x7f4db4006e80).ready entity=mon.1 client_cookie=5bb55cbed0e3f0e1 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dcaffd700 1 -- 172.21.15.133:0/1753680924 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4db4009910 con 0x7f4dcc0b5ae0 2021-01-03T13:06:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dcaffd700 1 -- 172.21.15.133:0/1753680924 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db4009a70 con 0x7f4dcc0b5ae0 2021-01-03T13:06:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dcaffd700 1 -- 172.21.15.133:0/1753680924 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4db4009dd0 con 0x7f4dcc0b5ae0 2021-01-03T13:06:06.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dd12cb700 1 -- 172.21.15.133:0/1753680924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dcc0b5ae0 msgr2=0x7f4dcc0abd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.785+0000 7f4dd12cb700 1 --2- 172.21.15.133:0/1753680924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dcc0b5ae0 0x7f4dcc0abd80 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f4db4002f30 tx=0x7f4db4006e80).stop 2021-01-03T13:06:06.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dd12cb700 1 -- 172.21.15.133:0/1753680924 shutdown_connections 2021-01-03T13:06:06.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dd12cb700 1 --2- 172.21.15.133:0/1753680924 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4dcc099ff0 0x7f4dcc13fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dd12cb700 1 --2- 172.21.15.133:0/1753680924 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dcc0b5ae0 0x7f4dcc0abd80 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dd12cb700 1 -- 172.21.15.133:0/1753680924 >> 172.21.15.133:0/1753680924 conn(0x7f4dcc05bdf0 msgr2=0x7f4dcc05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:06.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dd12cb700 1 -- 172.21.15.133:0/1753680924 shutdown_connections 2021-01-03T13:06:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dd12cb700 1 -- 172.21.15.133:0/1753680924 wait complete. 2021-01-03T13:06:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dd12cb700 1 Processor -- start 2021-01-03T13:06:06.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dd12cb700 1 -- start start 2021-01-03T13:06:06.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dd12cb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dcc099ff0 0x7f4dcc1415d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:06.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dd12cb700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4dcc0b5330 0x7f4dcc155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:06.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dd12cb700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dcc0b5ae0 0x7f4dcc155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:06.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dd12cb700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc155c70 con 0x7f4dcc0b5ae0 2021-01-03T13:06:06.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dd12cb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc142d30 con 0x7f4dcc099ff0 2021-01-03T13:06:06.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dd12cb700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc141ff0 con 0x7f4dcc0b5330 2021-01-03T13:06:06.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dcbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dcc099ff0 0x7f4dcc1415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:06.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dcbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dcc099ff0 0x7f4dcc1415d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38124/0 (socket says 172.21.15.133:38124) 2021-01-03T13:06:06.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dcbfff700 1 -- 172.21.15.133:0/1105427163 learned_addr learned my addr 172.21.15.133:0/1105427163 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:06.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dcb7fe700 1 --2- 172.21.15.133:0/1105427163 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4dcc0b5330 0x7f4dcc155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:06.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dd0aca700 1 --2- 172.21.15.133:0/1105427163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dcc0b5ae0 0x7f4dcc155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:06.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dcbfff700 1 -- 172.21.15.133:0/1105427163 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4dcc0b5330 msgr2=0x7f4dcc155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dcbfff700 1 --2- 172.21.15.133:0/1105427163 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4dcc0b5330 0x7f4dcc155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dcbfff700 1 -- 172.21.15.133:0/1105427163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dcc0b5ae0 msgr2=0x7f4dcc155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dcbfff700 1 --2- 172.21.15.133:0/1105427163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dcc0b5ae0 0x7f4dcc155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.789+0000 7f4dcbfff700 1 -- 172.21.15.133:0/1105427163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc142290 con 0x7f4dcc099ff0 2021-01-03T13:06:06.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.793+0000 7f4dcbfff700 1 --2- 172.21.15.133:0/1105427163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dcc099ff0 0x7f4dcc1415d0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f4dcc155db0 tx=0x7f4dbc007c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:06.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.793+0000 7f4dc97fa700 1 -- 172.21.15.133:0/1105427163 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dbc00e4a0 con 0x7f4dcc099ff0 2021-01-03T13:06:06.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.793+0000 7f4dc97fa700 1 -- 172.21.15.133:0/1105427163 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc00e600 con 0x7f4dcc099ff0 2021-01-03T13:06:06.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.793+0000 7f4dc97fa700 1 -- 172.21.15.133:0/1105427163 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dbc00e960 con 0x7f4dcc099ff0 2021-01-03T13:06:06.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.793+0000 7f4dd12cb700 1 -- 172.21.15.133:0/1105427163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dcc142530 con 0x7f4dcc099ff0 2021-01-03T13:06:06.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.793+0000 7f4dd12cb700 1 -- 172.21.15.133:0/1105427163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dcc145f90 con 0x7f4dcc099ff0 2021-01-03T13:06:06.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.793+0000 7f4dd12cb700 1 -- 172.21.15.133:0/1105427163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dcc057300 con 0x7f4dcc099ff0 2021-01-03T13:06:06.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.793+0000 7f4dc97fa700 1 -- 172.21.15.133:0/1105427163 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4dbc010030 con 0x7f4dcc099ff0 2021-01-03T13:06:06.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.793+0000 7f4dc97fa700 1 --2- 172.21.15.133:0/1105427163 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4db0055440 0x7f4db0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:06.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.793+0000 7f4dcb7fe700 1 --2- 172.21.15.133:0/1105427163 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4db0055440 0x7f4db0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:06.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.793+0000 7f4dc97fa700 1 -- 172.21.15.133:0/1105427163 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4dbc06de40 con 0x7f4dcc099ff0 2021-01-03T13:06:06.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.793+0000 7f4dcb7fe700 1 --2- 172.21.15.133:0/1105427163 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4db0055440 0x7f4db0057900 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f4db401c000 tx=0x7f4db4015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:06.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.797+0000 7f4dc97fa700 1 -- 172.21.15.133:0/1105427163 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4dbc044140 con 0x7f4dcc099ff0 2021-01-03T13:06:06.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.985+0000 7f4dd12cb700 1 -- 172.21.15.133:0/1105427163 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4dcc0af400 con 0x7f4dcc099ff0 2021-01-03T13:06:06.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.985+0000 7f4dc97fa700 1 -- 172.21.15.133:0/1105427163 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+2499 (secure 0 0 0) 0x7f4dbc047760 con 0x7f4dcc099ff0 2021-01-03T13:06:06.990 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:06.990 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":49,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7108,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/2670125727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2670125727},{"type":"v1","addr":"172.21.15.133:6835","nonce":2670125727}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47},{"gid":7120,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6837/3964151526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3964151526},{"type":"v1","addr":"172.21.15.133:6837","nonce":3964151526}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:59.178144+0000","modified":"2021-01-03T13:06:00.181997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7123},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7123":{"gid":7123,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/1643460453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1643460453},{"type":"v1","addr":"172.21.15.16:6833","nonce":1643460453}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-01-03T13:06:06.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.985+0000 7f4dd12cb700 1 -- 172.21.15.133:0/1105427163 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4db0055440 msgr2=0x7f4db0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.985+0000 7f4dd12cb700 1 --2- 172.21.15.133:0/1105427163 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4db0055440 0x7f4db0057900 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f4db401c000 tx=0x7f4db4015000).stop 2021-01-03T13:06:06.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.985+0000 7f4dd12cb700 1 -- 172.21.15.133:0/1105427163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dcc099ff0 msgr2=0x7f4dcc1415d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:06.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.985+0000 7f4dd12cb700 1 --2- 172.21.15.133:0/1105427163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dcc099ff0 0x7f4dcc1415d0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f4dcc155db0 tx=0x7f4dbc007c20).stop 2021-01-03T13:06:06.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.985+0000 7f4dd12cb700 1 -- 172.21.15.133:0/1105427163 shutdown_connections 2021-01-03T13:06:06.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.985+0000 7f4dd12cb700 1 --2- 172.21.15.133:0/1105427163 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4db0055440 0x7f4db0057900 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.985+0000 7f4dd12cb700 1 --2- 172.21.15.133:0/1105427163 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4dcc0b5ae0 0x7f4dcc155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.985+0000 7f4dd12cb700 1 --2- 172.21.15.133:0/1105427163 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4dcc099ff0 0x7f4dcc1415d0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.985+0000 7f4dd12cb700 1 --2- 172.21.15.133:0/1105427163 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4dcc0b5330 0x7f4dcc155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:06.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.985+0000 7f4dd12cb700 1 -- 172.21.15.133:0/1105427163 >> 172.21.15.133:0/1105427163 conn(0x7f4dcc05bdf0 msgr2=0x7f4dcc0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:06.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.985+0000 7f4dd12cb700 1 -- 172.21.15.133:0/1105427163 shutdown_connections 2021-01-03T13:06:06.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:06.985+0000 7f4dd12cb700 1 -- 172.21.15.133:0/1105427163 wait complete. 2021-01-03T13:06:06.996 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 49 2021-01-03T13:06:07.307 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:05:59.178144+0000', 'modified': '2021-01-03T13:06:00.181997+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7123}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7123': {'gid': 7123, 'name': 'b', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.16:6833/1643460453', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.16:6832', 'nonce': 1643460453}, {'type': 'v1', 'addr': '172.21.15.16:6833', 'nonce': 1643460453}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:06:07.309 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:06:07.310 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2021-01-03T13:06:07.441 INFO:teuthology.orchestra.run.smithi016.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":7123,"want_state":"up:active","state":"up:active","rank_uptime":8.2489218550000007,"mdsmap_epoch":49,"osdmap_epoch":114,"osdmap_epoch_barrier":113,"uptime":13.622461661000001} 2021-01-03T13:06:07.442 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 7123, "mdsmap_epoch": 49, "osdmap_epoch": 114, "osdmap_epoch_barrier": 113, "rank_uptime": 8.248921855, "state": "up:active", "uptime": 13.622461661, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:06:07.442 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:06:07.442 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-01-03T13:06:07.443 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi036.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-01-03T13:06:07.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:07.444 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:07.452 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:06:07.509 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:06:07.510 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:06:07.569 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:06:07.571 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:06:07.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:07.573 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:06:07.620 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:06:07.621 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:07.664 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:06:07.681 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:06:07.682 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:06:07.737 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:06:07.739 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:06:07.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:07.740 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:06:07.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:2021-01-03T13:06:07.739+0000 7f58cdcc60c0 -1 init, newargv = 0x5623ad0680a0 newargc=9 2021-01-03T13:06:07.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[12049]: starting ceph client 2021-01-03T13:06:07.754 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[12049]: starting fuse 2021-01-03T13:06:08.016 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:06:08.023 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:06:08.026 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:06:08.028 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:06:08.849 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:06:08.869 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:06:08.870 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:06:08.925 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:06:08.926 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:06:08.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:08.928 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:06:08.980 INFO:teuthology.orchestra.run.smithi036.stdout:50 2021-01-03T13:06:08.981 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:06:08.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:08.982 DEBUG:teuthology.orchestra.run.smithi036:> sudo python3 -c ' 2021-01-03T13:06:08.982 DEBUG:teuthology.orchestra.run.smithi036:> import glob 2021-01-03T13:06:08.983 DEBUG:teuthology.orchestra.run.smithi036:> import re 2021-01-03T13:06:08.984 DEBUG:teuthology.orchestra.run.smithi036:> import os 2021-01-03T13:06:08.984 DEBUG:teuthology.orchestra.run.smithi036:> import subprocess 2021-01-03T13:06:08.985 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:06:08.985 DEBUG:teuthology.orchestra.run.smithi036:> def find_socket(client_name): 2021-01-03T13:06:08.986 DEBUG:teuthology.orchestra.run.smithi036:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-01-03T13:06:08.987 DEBUG:teuthology.orchestra.run.smithi036:> files = glob.glob(asok_path) 2021-01-03T13:06:08.987 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:06:08.988 DEBUG:teuthology.orchestra.run.smithi036:> # Given a non-glob path, it better be there 2021-01-03T13:06:08.988 DEBUG:teuthology.orchestra.run.smithi036:> if "*" not in asok_path: 2021-01-03T13:06:08.988 DEBUG:teuthology.orchestra.run.smithi036:> assert(len(files) == 1) 2021-01-03T13:06:08.989 DEBUG:teuthology.orchestra.run.smithi036:> return files[0] 2021-01-03T13:06:08.989 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:06:08.989 DEBUG:teuthology.orchestra.run.smithi036:> for f in files: 2021-01-03T13:06:08.990 DEBUG:teuthology.orchestra.run.smithi036:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:06:08.990 DEBUG:teuthology.orchestra.run.smithi036:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:06:08.991 DEBUG:teuthology.orchestra.run.smithi036:> return f 2021-01-03T13:06:08.991 DEBUG:teuthology.orchestra.run.smithi036:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:06:08.991 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:06:08.992 DEBUG:teuthology.orchestra.run.smithi036:> print(find_socket("client.1")) 2021-01-03T13:06:08.992 DEBUG:teuthology.orchestra.run.smithi036:> ' 2021-01-03T13:06:09.070 INFO:teuthology.orchestra.run.smithi036.stdout:/var/run/ceph/ceph-client.1.12049.asok 2021-01-03T13:06:09.075 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.12049.asok 2021-01-03T13:06:09.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:09.076 DEBUG:teuthology.orchestra.run.smithi036:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.12049.asok status 2021-01-03T13:06:09.175 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2021-01-03T13:06:09.176 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": { 2021-01-03T13:06:09.176 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:06:09.176 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:06:09.176 INFO:teuthology.orchestra.run.smithi036.stdout: "entity_id": "1", 2021-01-03T13:06:09.177 INFO:teuthology.orchestra.run.smithi036.stdout: "hostname": "smithi036", 2021-01-03T13:06:09.177 INFO:teuthology.orchestra.run.smithi036.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-01-03T13:06:09.177 INFO:teuthology.orchestra.run.smithi036.stdout: "pid": "12049", 2021-01-03T13:06:09.178 INFO:teuthology.orchestra.run.smithi036.stdout: "root": "/" 2021-01-03T13:06:09.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:06:09.178 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_count": 0, 2021-01-03T13:06:09.178 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_pinned_count": 0, 2021-01-03T13:06:09.179 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 7227, 2021-01-03T13:06:09.179 INFO:teuthology.orchestra.run.smithi036.stdout: "inst": { 2021-01-03T13:06:09.179 INFO:teuthology.orchestra.run.smithi036.stdout: "name": { 2021-01-03T13:06:09.179 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "client", 2021-01-03T13:06:09.180 INFO:teuthology.orchestra.run.smithi036.stdout: "num": 7227 2021-01-03T13:06:09.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:06:09.181 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:06:09.181 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:06:09.182 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:06:09.182 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 444356681 2021-01-03T13:06:09.182 INFO:teuthology.orchestra.run.smithi036.stdout: } 2021-01-03T13:06:09.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:06:09.182 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:06:09.183 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:06:09.183 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:06:09.183 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 444356681 2021-01-03T13:06:09.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:06:09.183 INFO:teuthology.orchestra.run.smithi036.stdout: "inst_str": "client.7227 172.21.15.36:0/444356681", 2021-01-03T13:06:09.184 INFO:teuthology.orchestra.run.smithi036.stdout: "addr_str": "172.21.15.36:0/444356681", 2021-01-03T13:06:09.184 INFO:teuthology.orchestra.run.smithi036.stdout: "inode_count": 1, 2021-01-03T13:06:09.184 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_epoch": 49, 2021-01-03T13:06:09.185 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch": 114, 2021-01-03T13:06:09.185 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:06:09.185 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklisted": false, 2021-01-03T13:06:09.185 INFO:teuthology.orchestra.run.smithi036.stdout: "fs_name": "cephfs" 2021-01-03T13:06:09.186 INFO:teuthology.orchestra.run.smithi036.stdout:} 2021-01-03T13:06:09.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:09.187 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:09.188 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:09.195 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:06:09.196 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:06:09.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:09.197 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:09.255 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early df --format=json-pretty 2021-01-03T13:06:09.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.369+0000 7f54664cd700 1 Processor -- start 2021-01-03T13:06:09.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.369+0000 7f54664cd700 1 -- start start 2021-01-03T13:06:09.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.369+0000 7f54664cd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f54600b5c10 0x7f54600aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:09.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.369+0000 7f54664cd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f546014aee0 0x7f5460144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:09.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.369+0000 7f54664cd700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5460098550 con 0x7f54600b0670 2021-01-03T13:06:09.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.369+0000 7f54664cd700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54600b5ff0 con 0x7f54600b5c10 2021-01-03T13:06:09.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.369+0000 7f54664cd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54600b0b10 con 0x7f546014aee0 2021-01-03T13:06:09.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.369+0000 7f5464a6a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f546014aee0 0x7f5460144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:09.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.369+0000 7f5464a6a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f546014aee0 0x7f5460144470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38136/0 (socket says 172.21.15.133:38136) 2021-01-03T13:06:09.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.369+0000 7f5464a6a700 1 -- 172.21.15.133:0/3034440362 learned_addr learned my addr 172.21.15.133:0/3034440362 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:09.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.369+0000 7f545ffff700 1 --2- 172.21.15.133:0/3034440362 >> v2:172.21.15.16:3300/0 conn(0x7f54600b5c10 0x7f54600aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:09.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.369+0000 7f5464a6a700 1 -- 172.21.15.133:0/3034440362 >> v2:172.21.15.16:3300/0 conn(0x7f54600b5c10 msgr2=0x7f54600aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:09.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.369+0000 7f5464a6a700 1 --2- 172.21.15.133:0/3034440362 >> v2:172.21.15.16:3300/0 conn(0x7f54600b5c10 0x7f54600aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:09.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.369+0000 7f5464a6a700 1 -- 172.21.15.133:0/3034440362 >> v1:172.21.15.16:6789/0 conn(0x7f54600b0670 legacy=0x7f546014a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:09.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.369+0000 7f5464a6a700 1 -- 172.21.15.133:0/3034440362 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5460098780 con 0x7f546014aee0 2021-01-03T13:06:09.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f5464a6a700 1 --2- 172.21.15.133:0/3034440362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f546014aee0 0x7f5460144470 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f5450002f30 tx=0x7f5450006e80).ready entity=mon.1 client_cookie=dc512d73b9bcf203 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:09.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f545effd700 1 -- 172.21.15.133:0/3034440362 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54500097f0 con 0x7f546014aee0 2021-01-03T13:06:09.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f545effd700 1 -- 172.21.15.133:0/3034440362 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5450009950 con 0x7f546014aee0 2021-01-03T13:06:09.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f54664cd700 1 -- 172.21.15.133:0/3034440362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f546014aee0 msgr2=0x7f5460144470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:09.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f545effd700 1 -- 172.21.15.133:0/3034440362 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5450009cb0 con 0x7f546014aee0 2021-01-03T13:06:09.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f54664cd700 1 --2- 172.21.15.133:0/3034440362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f546014aee0 0x7f5460144470 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f5450002f30 tx=0x7f5450006e80).stop 2021-01-03T13:06:09.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f54664cd700 1 -- 172.21.15.133:0/3034440362 shutdown_connections 2021-01-03T13:06:09.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f54664cd700 1 --2- 172.21.15.133:0/3034440362 >> v2:172.21.15.16:3300/0 conn(0x7f54600b5c10 0x7f54600aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:09.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f54664cd700 1 --2- 172.21.15.133:0/3034440362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f546014aee0 0x7f5460144470 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:09.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f54664cd700 1 -- 172.21.15.133:0/3034440362 >> 172.21.15.133:0/3034440362 conn(0x7f546005c8c0 msgr2=0x7f54600b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:09.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f54664cd700 1 -- 172.21.15.133:0/3034440362 shutdown_connections 2021-01-03T13:06:09.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f54664cd700 1 -- 172.21.15.133:0/3034440362 wait complete. 2021-01-03T13:06:09.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f54664cd700 1 Processor -- start 2021-01-03T13:06:09.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f54664cd700 1 -- start start 2021-01-03T13:06:09.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f54664cd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f54600b0670 0x7f546014cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:09.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f54664cd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54600b5c10 0x7f54600b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:09.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f54664cd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f546014aee0 0x7f54600b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:09.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f54664cd700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5460142150 con 0x7f546014aee0 2021-01-03T13:06:09.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f54664cd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546014a170 con 0x7f54600b5c10 2021-01-03T13:06:09.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f54664cd700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546014ab80 con 0x7f54600b0670 2021-01-03T13:06:09.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f545f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54600b5c10 0x7f54600b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:09.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f545f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54600b5c10 0x7f54600b3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38140/0 (socket says 172.21.15.133:38140) 2021-01-03T13:06:09.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f545f7fe700 1 -- 172.21.15.133:0/737358687 learned_addr learned my addr 172.21.15.133:0/737358687 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:09.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f5464a6a700 1 --2- 172.21.15.133:0/737358687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f546014aee0 0x7f54600b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:09.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.373+0000 7f545ffff700 1 --2- 172.21.15.133:0/737358687 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f54600b0670 0x7f546014cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:09.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.377+0000 7f545f7fe700 1 -- 172.21.15.133:0/737358687 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f54600b0670 msgr2=0x7f546014cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:09.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.377+0000 7f545f7fe700 1 --2- 172.21.15.133:0/737358687 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f54600b0670 0x7f546014cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:09.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.377+0000 7f545f7fe700 1 -- 172.21.15.133:0/737358687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f546014aee0 msgr2=0x7f54600b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:09.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.377+0000 7f545f7fe700 1 --2- 172.21.15.133:0/737358687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f546014aee0 0x7f54600b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:09.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.377+0000 7f545f7fe700 1 -- 172.21.15.133:0/737358687 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5460142380 con 0x7f54600b5c10 2021-01-03T13:06:09.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.377+0000 7f5464a6a700 1 --2- 172.21.15.133:0/737358687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f546014aee0 0x7f54600b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:06:09.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.377+0000 7f545f7fe700 1 --2- 172.21.15.133:0/737358687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54600b5c10 0x7f54600b3370 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f546006b250 tx=0x7f5458001460).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:09.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.377+0000 7f545d7fa700 1 -- 172.21.15.133:0/737358687 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f545800a7b0 con 0x7f54600b5c10 2021-01-03T13:06:09.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.377+0000 7f545d7fa700 1 -- 172.21.15.133:0/737358687 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545800a910 con 0x7f54600b5c10 2021-01-03T13:06:09.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.377+0000 7f54664cd700 1 -- 172.21.15.133:0/737358687 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5460142620 con 0x7f54600b5c10 2021-01-03T13:06:09.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.377+0000 7f545d7fa700 1 -- 172.21.15.133:0/737358687 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f545800ac70 con 0x7f54600b5c10 2021-01-03T13:06:09.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.377+0000 7f54664cd700 1 -- 172.21.15.133:0/737358687 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546014d420 con 0x7f54600b5c10 2021-01-03T13:06:09.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.377+0000 7f54664cd700 1 -- 172.21.15.133:0/737358687 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54600b31b0 con 0x7f54600b5c10 2021-01-03T13:06:09.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.377+0000 7f545d7fa700 1 -- 172.21.15.133:0/737358687 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5458019030 con 0x7f54600b5c10 2021-01-03T13:06:09.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.381+0000 7f545d7fa700 1 --2- 172.21.15.133:0/737358687 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f54380554e0 0x7f54380579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:09.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.381+0000 7f545d7fa700 1 -- 172.21.15.133:0/737358687 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f545806d8b0 con 0x7f54600b5c10 2021-01-03T13:06:09.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.381+0000 7f545ffff700 1 --2- 172.21.15.133:0/737358687 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f54380554e0 0x7f54380579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:09.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.381+0000 7f545ffff700 1 --2- 172.21.15.133:0/737358687 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f54380554e0 0x7f54380579a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f544800b000 tx=0x7f5448006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:09.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.385+0000 7f545d7fa700 1 -- 172.21.15.133:0/737358687 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5458043bb0 con 0x7f54600b5c10 2021-01-03T13:06:09.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.573+0000 7f54664cd700 1 -- 172.21.15.133:0/737358687 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f54601427b0 con 0x7f54600b5c10 2021-01-03T13:06:09.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.573+0000 7f545d7fa700 1 -- 172.21.15.133:0/737358687 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1936 (secure 0 0 0) 0x7f54580471d0 con 0x7f54600b5c10 2021-01-03T13:06:09.579 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:09.579 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:06:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "stats": { 2021-01-03T13:06:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "total_bytes": 773094113280, 2021-01-03T13:06:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "total_avail_bytes": 764492677120, 2021-01-03T13:06:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_bytes": 11501568, 2021-01-03T13:06:09.580 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_raw_bytes": 8601436160, 2021-01-03T13:06:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_raw_ratio": 0.011125988326966763, 2021-01-03T13:06:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "num_osds": 8, 2021-01-03T13:06:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "num_per_pool_osds": 8, 2021-01-03T13:06:09.581 INFO:teuthology.orchestra.run.smithi133.stdout: "num_per_pool_omap_osds": 8 2021-01-03T13:06:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "stats_by_class": { 2021-01-03T13:06:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "ssd": { 2021-01-03T13:06:09.582 INFO:teuthology.orchestra.run.smithi133.stdout: "total_bytes": 773094113280, 2021-01-03T13:06:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "total_avail_bytes": 764492677120, 2021-01-03T13:06:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_bytes": 11501568, 2021-01-03T13:06:09.583 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_raw_bytes": 8601436160, 2021-01-03T13:06:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_raw_ratio": 0.011125988326966763 2021-01-03T13:06:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: "pools": [ 2021-01-03T13:06:09.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:09.585 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "device_health_metrics", 2021-01-03T13:06:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 1, 2021-01-03T13:06:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "stats": { 2021-01-03T13:06:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "stored": 0, 2021-01-03T13:06:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "objects": 2, 2021-01-03T13:06:09.586 INFO:teuthology.orchestra.run.smithi133.stdout: "kb_used": 0, 2021-01-03T13:06:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: "bytes_used": 0, 2021-01-03T13:06:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: "percent_used": 0, 2021-01-03T13:06:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: "max_avail": 362918936576 2021-01-03T13:06:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:09.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rbd", 2021-01-03T13:06:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 2, 2021-01-03T13:06:09.588 INFO:teuthology.orchestra.run.smithi133.stdout: "stats": { 2021-01-03T13:06:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "stored": 0, 2021-01-03T13:06:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "objects": 0, 2021-01-03T13:06:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "kb_used": 0, 2021-01-03T13:06:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "bytes_used": 0, 2021-01-03T13:06:09.589 INFO:teuthology.orchestra.run.smithi133.stdout: "percent_used": 0, 2021-01-03T13:06:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: "max_avail": 362918936576 2021-01-03T13:06:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:09.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephfs_metadata", 2021-01-03T13:06:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 19, 2021-01-03T13:06:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "stats": { 2021-01-03T13:06:09.591 INFO:teuthology.orchestra.run.smithi133.stdout: "stored": 2740, 2021-01-03T13:06:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "objects": 22, 2021-01-03T13:06:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "kb_used": 64, 2021-01-03T13:06:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "bytes_used": 65536, 2021-01-03T13:06:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "percent_used": 9.0290129151071596e-08, 2021-01-03T13:06:09.592 INFO:teuthology.orchestra.run.smithi133.stdout: "max_avail": 362918936576 2021-01-03T13:06:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:09.593 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephfs_data", 2021-01-03T13:06:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 20, 2021-01-03T13:06:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "stats": { 2021-01-03T13:06:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "stored": 0, 2021-01-03T13:06:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "objects": 0, 2021-01-03T13:06:09.594 INFO:teuthology.orchestra.run.smithi133.stdout: "kb_used": 0, 2021-01-03T13:06:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "bytes_used": 0, 2021-01-03T13:06:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "percent_used": 0, 2021-01-03T13:06:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: "max_avail": 362918936576 2021-01-03T13:06:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:09.595 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:09.596 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:06:09.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.577+0000 7f54664cd700 1 -- 172.21.15.133:0/737358687 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f54380554e0 msgr2=0x7f54380579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:09.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.577+0000 7f54664cd700 1 --2- 172.21.15.133:0/737358687 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f54380554e0 0x7f54380579a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f544800b000 tx=0x7f5448006dc0).stop 2021-01-03T13:06:09.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.577+0000 7f54664cd700 1 -- 172.21.15.133:0/737358687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54600b5c10 msgr2=0x7f54600b3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:09.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.577+0000 7f54664cd700 1 --2- 172.21.15.133:0/737358687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54600b5c10 0x7f54600b3370 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f546006b250 tx=0x7f5458001460).stop 2021-01-03T13:06:09.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.577+0000 7f54664cd700 1 -- 172.21.15.133:0/737358687 shutdown_connections 2021-01-03T13:06:09.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.577+0000 7f54664cd700 1 --2- 172.21.15.133:0/737358687 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f54380554e0 0x7f54380579a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:09.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.577+0000 7f54664cd700 1 --2- 172.21.15.133:0/737358687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f546014aee0 0x7f54600b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:09.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.577+0000 7f54664cd700 1 --2- 172.21.15.133:0/737358687 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f54600b0670 0x7f546014cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:09.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.577+0000 7f54664cd700 1 --2- 172.21.15.133:0/737358687 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54600b5c10 0x7f54600b3370 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:09.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.577+0000 7f54664cd700 1 -- 172.21.15.133:0/737358687 >> 172.21.15.133:0/737358687 conn(0x7f546005c8c0 msgr2=0x7f54601461a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:09.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.577+0000 7f54664cd700 1 -- 172.21.15.133:0/737358687 shutdown_connections 2021-01-03T13:06:09.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.577+0000 7f54664cd700 1 -- 172.21.15.133:0/737358687 wait complete. 2021-01-03T13:06:09.600 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data size -f json-pretty 2021-01-03T13:06:09.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5d5df7700 1 Processor -- start 2021-01-03T13:06:09.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5d5df7700 1 -- start start 2021-01-03T13:06:09.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5d5df7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5d013fb40 0x7ff5d013fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:09.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5d5df7700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d005cc20 con 0x7ff5d013c890 2021-01-03T13:06:09.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5d5df7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d0143df0 con 0x7ff5d005c840 2021-01-03T13:06:09.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5d5df7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d00aa1f0 con 0x7ff5d013fb40 2021-01-03T13:06:09.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5ceffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5d013fb40 0x7ff5d013fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:09.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5cf7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff5d005c840 0x7ff5d00b16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59178/0 (socket says 172.21.15.133:59178) 2021-01-03T13:06:09.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5cf7fe700 1 -- 172.21.15.133:0/3128685069 learned_addr learned my addr 172.21.15.133:0/3128685069 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:09.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5ceffd700 1 -- 172.21.15.133:0/3128685069 >> v1:172.21.15.133:6789/0 conn(0x7ff5d005c840 legacy=0x7ff5d00b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:09.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5ceffd700 1 -- 172.21.15.133:0/3128685069 >> v1:172.21.15.16:6789/0 conn(0x7ff5d013c890 legacy=0x7ff5d013cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:09.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5ceffd700 1 -- 172.21.15.133:0/3128685069 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d00a9ab0 con 0x7ff5d013fb40 2021-01-03T13:06:09.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5ceffd700 1 --2- 172.21.15.133:0/3128685069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d013fb40 0x7ff5d013fff0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7ff5d00af650 tx=0x7ff5c4006e50).ready entity=mon.1 client_cookie=9a012b541d852d71 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:09.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5ce7fc700 1 -- 172.21.15.133:0/3128685069 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5c4010470 con 0x7ff5d013fb40 2021-01-03T13:06:09.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5ce7fc700 1 -- 172.21.15.133:0/3128685069 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c40105d0 con 0x7ff5d013fb40 2021-01-03T13:06:09.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5ce7fc700 1 -- 172.21.15.133:0/3128685069 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5c4010930 con 0x7ff5d013fb40 2021-01-03T13:06:09.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5d5df7700 1 -- 172.21.15.133:0/3128685069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d013fb40 msgr2=0x7ff5d013fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:09.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5d5df7700 1 --2- 172.21.15.133:0/3128685069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d013fb40 0x7ff5d013fff0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7ff5d00af650 tx=0x7ff5c4006e50).stop 2021-01-03T13:06:09.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5d5df7700 1 -- 172.21.15.133:0/3128685069 shutdown_connections 2021-01-03T13:06:09.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5d5df7700 1 --2- 172.21.15.133:0/3128685069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d013fb40 0x7ff5d013fff0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:09.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5d5df7700 1 -- 172.21.15.133:0/3128685069 >> 172.21.15.133:0/3128685069 conn(0x7ff5d006aeb0 msgr2=0x7ff5d005bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:09.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.713+0000 7ff5d5df7700 1 -- 172.21.15.133:0/3128685069 shutdown_connections 2021-01-03T13:06:09.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.717+0000 7ff5d5df7700 1 -- 172.21.15.133:0/3128685069 wait complete. 2021-01-03T13:06:09.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.717+0000 7ff5d5df7700 1 Processor -- start 2021-01-03T13:06:09.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.717+0000 7ff5d5df7700 1 -- start start 2021-01-03T13:06:09.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.717+0000 7ff5d5df7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5d005c840 0x7ff5d00aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:09.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.717+0000 7ff5d5df7700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5d013c890 0x7ff5d014df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:09.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.717+0000 7ff5d5df7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d013fb40 0x7ff5d014e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:09.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.717+0000 7ff5d5df7700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d014e950 con 0x7ff5d013c890 2021-01-03T13:06:09.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.717+0000 7ff5d5df7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d014db10 con 0x7ff5d013fb40 2021-01-03T13:06:09.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.717+0000 7ff5d5df7700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d0142810 con 0x7ff5d005c840 2021-01-03T13:06:09.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.717+0000 7ff5cffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d013fb40 0x7ff5d014e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:09.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.717+0000 7ff5cffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d013fb40 0x7ff5d014e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38156/0 (socket says 172.21.15.133:38156) 2021-01-03T13:06:09.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.717+0000 7ff5cffff700 1 -- 172.21.15.133:0/3358003411 learned_addr learned my addr 172.21.15.133:0/3358003411 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:09.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.717+0000 7ff5cf7fe700 1 --2- 172.21.15.133:0/3358003411 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5d005c840 0x7ff5d00aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:09.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.717+0000 7ff5ceffd700 1 --2- 172.21.15.133:0/3358003411 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5d013c890 0x7ff5d014df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:09.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.721+0000 7ff5cffff700 1 -- 172.21.15.133:0/3358003411 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5d005c840 msgr2=0x7ff5d00aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:09.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.721+0000 7ff5cffff700 1 --2- 172.21.15.133:0/3358003411 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5d005c840 0x7ff5d00aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:09.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.721+0000 7ff5cffff700 1 -- 172.21.15.133:0/3358003411 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5d013c890 msgr2=0x7ff5d014df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:09.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.721+0000 7ff5cffff700 1 --2- 172.21.15.133:0/3358003411 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5d013c890 0x7ff5d014df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:09.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.721+0000 7ff5cffff700 1 -- 172.21.15.133:0/3358003411 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d01422d0 con 0x7ff5d013fb40 2021-01-03T13:06:09.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.721+0000 7ff5cffff700 1 --2- 172.21.15.133:0/3358003411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d013fb40 0x7ff5d014e460 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7ff5d014ea90 tx=0x7ff5c8007f10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:09.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.721+0000 7ff5ccff9700 1 -- 172.21.15.133:0/3358003411 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5c800a520 con 0x7ff5d013fb40 2021-01-03T13:06:09.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.721+0000 7ff5ccff9700 1 -- 172.21.15.133:0/3358003411 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c800a680 con 0x7ff5d013fb40 2021-01-03T13:06:09.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.721+0000 7ff5ccff9700 1 -- 172.21.15.133:0/3358003411 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5c800a9e0 con 0x7ff5d013fb40 2021-01-03T13:06:09.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.721+0000 7ff5d5df7700 1 -- 172.21.15.133:0/3358003411 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d0142570 con 0x7ff5d013fb40 2021-01-03T13:06:09.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.721+0000 7ff5d5df7700 1 -- 172.21.15.133:0/3358003411 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d00aa330 con 0x7ff5d013fb40 2021-01-03T13:06:09.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.721+0000 7ff5d5df7700 1 -- 172.21.15.133:0/3358003411 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d014dcd0 con 0x7ff5d013fb40 2021-01-03T13:06:09.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.721+0000 7ff5ccff9700 1 -- 172.21.15.133:0/3358003411 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff5c8019030 con 0x7ff5d013fb40 2021-01-03T13:06:09.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.721+0000 7ff5ccff9700 1 --2- 172.21.15.133:0/3358003411 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5b0055350 0x7ff5b0057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:09.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.721+0000 7ff5cf7fe700 1 --2- 172.21.15.133:0/3358003411 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5b0055350 0x7ff5b0057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:09.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.721+0000 7ff5ccff9700 1 -- 172.21.15.133:0/3358003411 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff5c806d7b0 con 0x7ff5d013fb40 2021-01-03T13:06:09.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.725+0000 7ff5cf7fe700 1 --2- 172.21.15.133:0/3358003411 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5b0055350 0x7ff5b0057810 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7ff5c000d000 tx=0x7ff5c0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:09.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.729+0000 7ff5ccff9700 1 -- 172.21.15.133:0/3358003411 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff5d014dcd0 con 0x7ff5d013fb40 2021-01-03T13:06:09.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.865+0000 7ff5d5df7700 1 -- 172.21.15.133:0/3358003411 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"} v 0) v1 -- 0x7ff5d0057300 con 0x7ff5d013fb40 2021-01-03T13:06:09.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.869+0000 7ff5ccff9700 1 -- 172.21.15.133:0/3358003411 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"}]=0 v114) v1 ==== 123+0+64 (secure 0 0 0) 0x7ff5c8043ab0 con 0x7ff5d013fb40 2021-01-03T13:06:09.873 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:09.873 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:06:09.873 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": "cephfs_data", 2021-01-03T13:06:09.873 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_id": 20, 2021-01-03T13:06:09.874 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2 2021-01-03T13:06:09.874 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:06:09.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.869+0000 7ff5d5df7700 1 -- 172.21.15.133:0/3358003411 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5b0055350 msgr2=0x7ff5b0057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:09.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.869+0000 7ff5d5df7700 1 --2- 172.21.15.133:0/3358003411 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5b0055350 0x7ff5b0057810 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7ff5c000d000 tx=0x7ff5c0009040).stop 2021-01-03T13:06:09.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.869+0000 7ff5d5df7700 1 -- 172.21.15.133:0/3358003411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d013fb40 msgr2=0x7ff5d014e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:09.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.869+0000 7ff5d5df7700 1 --2- 172.21.15.133:0/3358003411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d013fb40 0x7ff5d014e460 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7ff5d014ea90 tx=0x7ff5c8007f10).stop 2021-01-03T13:06:09.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.869+0000 7ff5d5df7700 1 -- 172.21.15.133:0/3358003411 shutdown_connections 2021-01-03T13:06:09.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.869+0000 7ff5d5df7700 1 --2- 172.21.15.133:0/3358003411 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff5b0055350 0x7ff5b0057810 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:09.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.869+0000 7ff5d5df7700 1 --2- 172.21.15.133:0/3358003411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d013fb40 0x7ff5d014e460 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:09.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.869+0000 7ff5d5df7700 1 --2- 172.21.15.133:0/3358003411 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff5d005c840 0x7ff5d00aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:09.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.869+0000 7ff5d5df7700 1 --2- 172.21.15.133:0/3358003411 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5d013c890 0x7ff5d014df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:09.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.869+0000 7ff5d5df7700 1 -- 172.21.15.133:0/3358003411 >> 172.21.15.133:0/3358003411 conn(0x7ff5d006aeb0 msgr2=0x7ff5d013d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:09.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.869+0000 7ff5d5df7700 1 -- 172.21.15.133:0/3358003411 shutdown_connections 2021-01-03T13:06:09.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:09.869+0000 7ff5d5df7700 1 -- 172.21.15.133:0/3358003411 wait complete. 2021-01-03T13:06:09.894 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-01-03T13:06:09.895 DEBUG:teuthology.orchestra.run.smithi007:> cd /home/ubuntu/cephtest/mnt.0 && sudo df . 2021-01-03T13:06:09.917 INFO:teuthology.orchestra.run.smithi007.stdout:Filesystem 1K-blocks Used Available Use% Mounted on 2021-01-03T13:06:09.918 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-fuse 354410496 0 354410496 0% /home/ubuntu/cephtest/mnt.0 2021-01-03T13:06:09.919 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:06:09.919 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:06:09.979 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:06:09.998 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:06:10.017 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:06:10.037 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:06:10.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:10.039 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:10.039 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:10.047 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:06:10.048 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:06:10.048 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T13:06:10.049 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:06:10.049 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:10.138 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12538]: fuse finished with error 0 and tester_r 0 2021-01-03T13:06:10.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:10.140 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:10.141 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:10.150 INFO:teuthology.orchestra.run.smithi007.stdout:ext2/ext3 2021-01-03T13:06:10.150 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:06:10.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:06:10.268 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:10.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:10.317 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:10.317 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:10.325 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:06:10.326 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:06:10.326 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi036.front.sepia.ceph.com... 2021-01-03T13:06:10.327 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:06:10.327 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:10.407 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[12049]: fuse finished with error 0 and tester_r 0 2021-01-03T13:06:10.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:10.409 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:10.409 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:10.456 INFO:teuthology.orchestra.run.smithi036.stdout:ext2/ext3 2021-01-03T13:06:10.457 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:06:10.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:06:10.538 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:10.547 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-01-03T13:06:10.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.665+0000 7f979f5ce700 1 Processor -- start 2021-01-03T13:06:10.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.665+0000 7f979f5ce700 1 -- start start 2021-01-03T13:06:10.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.665+0000 7f979f5ce700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f97980b6d50 0x7f9798146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:10.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f979f5ce700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97980b7130 con 0x7f979813fbc0 2021-01-03T13:06:10.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f979f5ce700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97980ae600 con 0x7f9798142e90 2021-01-03T13:06:10.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f979f5ce700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97980ae8a0 con 0x7f97980b6d50 2021-01-03T13:06:10.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f979d36a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f97980b6d50 0x7f9798146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:10.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f979cb69700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9798142e90 0x7f9798143320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59194/0 (socket says 172.21.15.133:59194) 2021-01-03T13:06:10.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f979cb69700 1 -- 172.21.15.133:0/1033830704 learned_addr learned my addr 172.21.15.133:0/1033830704 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:10.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f979d36a700 1 -- 172.21.15.133:0/1033830704 >> v1:172.21.15.133:6789/0 conn(0x7f9798142e90 legacy=0x7f9798143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:10.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f979d36a700 1 -- 172.21.15.133:0/1033830704 >> v1:172.21.15.16:6789/0 conn(0x7f979813fbc0 legacy=0x7f9798140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:10.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f979d36a700 1 -- 172.21.15.133:0/1033830704 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97980aeb40 con 0x7f97980b6d50 2021-01-03T13:06:10.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f978ffff700 1 -- 172.21.15.133:0/1033830704 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919530503 0 0) 0x7f97980ae600 con 0x7f9798142e90 2021-01-03T13:06:10.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f979d36a700 1 --2- 172.21.15.133:0/1033830704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97980b6d50 0x7f9798146bf0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f9794002f30 tx=0x7f9794006dc0).ready entity=mon.1 client_cookie=d15e5a104d5fe185 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:10.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f978ffff700 1 -- 172.21.15.133:0/1033830704 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97940097f0 con 0x7f97980b6d50 2021-01-03T13:06:10.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f978ffff700 1 -- 172.21.15.133:0/1033830704 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9794009950 con 0x7f97980b6d50 2021-01-03T13:06:10.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f978ffff700 1 -- 172.21.15.133:0/1033830704 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9794009cb0 con 0x7f97980b6d50 2021-01-03T13:06:10.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f979f5ce700 1 -- 172.21.15.133:0/1033830704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97980b6d50 msgr2=0x7f9798146bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:10.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f979f5ce700 1 --2- 172.21.15.133:0/1033830704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97980b6d50 0x7f9798146bf0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f9794002f30 tx=0x7f9794006dc0).stop 2021-01-03T13:06:10.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f979f5ce700 1 -- 172.21.15.133:0/1033830704 shutdown_connections 2021-01-03T13:06:10.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f979f5ce700 1 --2- 172.21.15.133:0/1033830704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97980b6d50 0x7f9798146bf0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:10.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f979f5ce700 1 -- 172.21.15.133:0/1033830704 >> 172.21.15.133:0/1033830704 conn(0x7f97980622f0 msgr2=0x7f97980b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:10.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f979f5ce700 1 -- 172.21.15.133:0/1033830704 shutdown_connections 2021-01-03T13:06:10.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.669+0000 7f979f5ce700 1 -- 172.21.15.133:0/1033830704 wait complete. 2021-01-03T13:06:10.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979f5ce700 1 Processor -- start 2021-01-03T13:06:10.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979f5ce700 1 -- start start 2021-01-03T13:06:10.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979f5ce700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97980b6d50 0x7f9798149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:10.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979f5ce700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979813fbc0 0x7f9798145af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:10.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979f5ce700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9798142e90 0x7f97980b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:10.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979f5ce700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97981412f0 con 0x7f97980b6d50 2021-01-03T13:06:10.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979f5ce700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9798140be0 con 0x7f979813fbc0 2021-01-03T13:06:10.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979f5ce700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9798142750 con 0x7f9798142e90 2021-01-03T13:06:10.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979cb69700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979813fbc0 0x7f9798145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:10.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979cb69700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979813fbc0 0x7f9798145af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38168/0 (socket says 172.21.15.133:38168) 2021-01-03T13:06:10.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979cb69700 1 -- 172.21.15.133:0/121168704 learned_addr learned my addr 172.21.15.133:0/121168704 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:10.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979d36a700 1 --2- 172.21.15.133:0/121168704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97980b6d50 0x7f9798149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:10.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979db6b700 1 --2- 172.21.15.133:0/121168704 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9798142e90 0x7f97980b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:10.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979cb69700 1 -- 172.21.15.133:0/121168704 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9798142e90 msgr2=0x7f97980b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:10.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979cb69700 1 --2- 172.21.15.133:0/121168704 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9798142e90 0x7f97980b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:10.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979cb69700 1 -- 172.21.15.133:0/121168704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97980b6d50 msgr2=0x7f9798149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:10.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979cb69700 1 --2- 172.21.15.133:0/121168704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97980b6d50 0x7f9798149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:10.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979cb69700 1 -- 172.21.15.133:0/121168704 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9798141520 con 0x7f979813fbc0 2021-01-03T13:06:10.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979cb69700 1 --2- 172.21.15.133:0/121168704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979813fbc0 0x7f9798145af0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f9788000b80 tx=0x7f9788007c60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:10.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f978e7fc700 1 -- 172.21.15.133:0/121168704 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97880072e0 con 0x7f979813fbc0 2021-01-03T13:06:10.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f978e7fc700 1 -- 172.21.15.133:0/121168704 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9788007440 con 0x7f979813fbc0 2021-01-03T13:06:10.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979f5ce700 1 -- 172.21.15.133:0/121168704 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9798141040 con 0x7f979813fbc0 2021-01-03T13:06:10.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f978e7fc700 1 -- 172.21.15.133:0/121168704 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97880057d0 con 0x7f979813fbc0 2021-01-03T13:06:10.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.673+0000 7f979f5ce700 1 -- 172.21.15.133:0/121168704 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9798145fe0 con 0x7f979813fbc0 2021-01-03T13:06:10.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.677+0000 7f979f5ce700 1 -- 172.21.15.133:0/121168704 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9798057300 con 0x7f979813fbc0 2021-01-03T13:06:10.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.677+0000 7f978e7fc700 1 -- 172.21.15.133:0/121168704 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9788010070 con 0x7f979813fbc0 2021-01-03T13:06:10.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.677+0000 7f978e7fc700 1 --2- 172.21.15.133:0/121168704 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f97800554e0 0x7f97800579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:10.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.677+0000 7f978e7fc700 1 -- 172.21.15.133:0/121168704 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f978806dc40 con 0x7f979813fbc0 2021-01-03T13:06:10.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.677+0000 7f979d36a700 1 --2- 172.21.15.133:0/121168704 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f97800554e0 0x7f97800579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:10.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.677+0000 7f979d36a700 1 --2- 172.21.15.133:0/121168704 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f97800554e0 0x7f97800579a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f979401b000 tx=0x7f9794015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:10.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.681+0000 7f978e7fc700 1 -- 172.21.15.133:0/121168704 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9788043e30 con 0x7f979813fbc0 2021-01-03T13:06:10.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.821+0000 7f979f5ce700 1 -- 172.21.15.133:0/121168704 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9798142020 con 0x7f979813fbc0 2021-01-03T13:06:10.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.833+0000 7f978e7fc700 1 -- 172.21.15.133:0/121168704 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9788007d80 con 0x7f979813fbc0 2021-01-03T13:06:10.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.833+0000 7f979f5ce700 1 -- 172.21.15.133:0/121168704 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f97800554e0 msgr2=0x7f97800579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:10.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.833+0000 7f979f5ce700 1 --2- 172.21.15.133:0/121168704 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f97800554e0 0x7f97800579a0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f979401b000 tx=0x7f9794015000).stop 2021-01-03T13:06:10.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.833+0000 7f979f5ce700 1 -- 172.21.15.133:0/121168704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979813fbc0 msgr2=0x7f9798145af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:10.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.833+0000 7f979f5ce700 1 --2- 172.21.15.133:0/121168704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979813fbc0 0x7f9798145af0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f9788000b80 tx=0x7f9788007c60).stop 2021-01-03T13:06:10.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.833+0000 7f979f5ce700 1 -- 172.21.15.133:0/121168704 shutdown_connections 2021-01-03T13:06:10.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.833+0000 7f979f5ce700 1 --2- 172.21.15.133:0/121168704 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f97800554e0 0x7f97800579a0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:10.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.833+0000 7f979f5ce700 1 --2- 172.21.15.133:0/121168704 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97980b6d50 0x7f9798149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:10.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.833+0000 7f979f5ce700 1 --2- 172.21.15.133:0/121168704 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9798142e90 0x7f97980b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:10.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.833+0000 7f979f5ce700 1 --2- 172.21.15.133:0/121168704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f979813fbc0 0x7f9798145af0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:10.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.833+0000 7f979f5ce700 1 -- 172.21.15.133:0/121168704 >> 172.21.15.133:0/121168704 conn(0x7f97980622f0 msgr2=0x7f97980b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:10.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.833+0000 7f979f5ce700 1 -- 172.21.15.133:0/121168704 shutdown_connections 2021-01-03T13:06:10.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.833+0000 7f979f5ce700 1 -- 172.21.15.133:0/121168704 wait complete. 2021-01-03T13:06:10.852 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2021-01-03T13:06:10.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.953+0000 7f9c6e4e7700 1 Processor -- start 2021-01-03T13:06:10.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.953+0000 7f9c6e4e7700 1 -- start start 2021-01-03T13:06:10.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.953+0000 7f9c6e4e7700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9c680b0c90 0x7f9c680b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:10.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.953+0000 7f9c6e4e7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c680b5c00 0x7f9c68143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:10.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.953+0000 7f9c6e4e7700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c68060da0 con 0x7f9c680b52c0 2021-01-03T13:06:10.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.953+0000 7f9c6e4e7700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c68067a90 con 0x7f9c680b0c90 2021-01-03T13:06:10.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.953+0000 7f9c6e4e7700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680b0ad0 con 0x7f9c680b5c00 2021-01-03T13:06:10.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.953+0000 7f9c6cce4700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9c680b0c90 0x7f9c680b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:10.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.953+0000 7f9c6dce6700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c680b5c00 0x7f9c68143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:10.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.953+0000 7f9c6cce4700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9c680b0c90 0x7f9c680b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:36714/0 (socket says 172.21.15.133:36714) 2021-01-03T13:06:10.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.953+0000 7f9c6d4e5700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9c680b52c0 0x7f9c68098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:37934/0 (socket says 172.21.15.133:37934) 2021-01-03T13:06:10.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.953+0000 7f9c6cce4700 1 -- 172.21.15.133:0/2493943945 learned_addr learned my addr 172.21.15.133:0/2493943945 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:10.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.953+0000 7f9c6cce4700 1 -- 172.21.15.133:0/2493943945 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c680b5c00 msgr2=0x7f9c68143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:10.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.953+0000 7f9c6cce4700 1 --2- 172.21.15.133:0/2493943945 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c680b5c00 0x7f9c68143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:10.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.953+0000 7f9c6cce4700 1 -- 172.21.15.133:0/2493943945 >> v1:172.21.15.16:6789/0 conn(0x7f9c680b52c0 legacy=0x7f9c68098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:10.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.953+0000 7f9c6cce4700 1 -- 172.21.15.133:0/2493943945 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c680b56a0 con 0x7f9c680b0c90 2021-01-03T13:06:10.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.953+0000 7f9c5ffff700 1 -- 172.21.15.133:0/2493943945 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625781134 0 0) 0x7f9c68060da0 con 0x7f9c680b52c0 2021-01-03T13:06:10.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6cce4700 1 --2- 172.21.15.133:0/2493943945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c680b0c90 0x7f9c680b05e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f9c64002f30 tx=0x7f9c64006e80).ready entity=mon.0 client_cookie=c659f37add9b6cdb server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:10.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c5ffff700 1 -- 172.21.15.133:0/2493943945 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c640097f0 con 0x7f9c680b0c90 2021-01-03T13:06:10.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c5ffff700 1 -- 172.21.15.133:0/2493943945 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c64009950 con 0x7f9c680b0c90 2021-01-03T13:06:10.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c5ffff700 1 -- 172.21.15.133:0/2493943945 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c64009cb0 con 0x7f9c680b0c90 2021-01-03T13:06:10.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6e4e7700 1 -- 172.21.15.133:0/2493943945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c680b0c90 msgr2=0x7f9c680b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:10.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6e4e7700 1 --2- 172.21.15.133:0/2493943945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c680b0c90 0x7f9c680b05e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f9c64002f30 tx=0x7f9c64006e80).stop 2021-01-03T13:06:10.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6e4e7700 1 -- 172.21.15.133:0/2493943945 shutdown_connections 2021-01-03T13:06:10.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6e4e7700 1 --2- 172.21.15.133:0/2493943945 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c680b5c00 0x7f9c68143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:10.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6e4e7700 1 --2- 172.21.15.133:0/2493943945 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c680b0c90 0x7f9c680b05e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:10.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6e4e7700 1 -- 172.21.15.133:0/2493943945 >> 172.21.15.133:0/2493943945 conn(0x7f9c6805bdf0 msgr2=0x7f9c6805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:10.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6e4e7700 1 -- 172.21.15.133:0/2493943945 shutdown_connections 2021-01-03T13:06:10.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6e4e7700 1 -- 172.21.15.133:0/2493943945 wait complete. 2021-01-03T13:06:10.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6e4e7700 1 Processor -- start 2021-01-03T13:06:10.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6e4e7700 1 -- start start 2021-01-03T13:06:10.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6e4e7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c680b0c90 0x7f9c680b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:10.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6e4e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c680b52c0 0x7f9c68155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:10.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6e4e7700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c680b5c00 0x7f9c68064bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:10.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6e4e7700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680647d0 con 0x7f9c680b5c00 2021-01-03T13:06:10.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6e4e7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680af6d0 con 0x7f9c680b52c0 2021-01-03T13:06:10.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6e4e7700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680adcd0 con 0x7f9c680b0c90 2021-01-03T13:06:10.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6cce4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c680b52c0 0x7f9c68155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:10.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6cce4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c680b52c0 0x7f9c68155d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38182/0 (socket says 172.21.15.133:38182) 2021-01-03T13:06:10.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6cce4700 1 -- 172.21.15.133:0/1818807706 learned_addr learned my addr 172.21.15.133:0/1818807706 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:10.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6dce6700 1 --2- 172.21.15.133:0/1818807706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c680b5c00 0x7f9c68064bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:10.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.957+0000 7f9c6d4e5700 1 --2- 172.21.15.133:0/1818807706 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c680b0c90 0x7f9c680b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:10.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c6cce4700 1 -- 172.21.15.133:0/1818807706 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c680b0c90 msgr2=0x7f9c680b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:10.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c6cce4700 1 --2- 172.21.15.133:0/1818807706 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c680b0c90 0x7f9c680b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:10.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c6cce4700 1 -- 172.21.15.133:0/1818807706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c680b5c00 msgr2=0x7f9c68064bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:10.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c6cce4700 1 --2- 172.21.15.133:0/1818807706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c680b5c00 0x7f9c68064bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:10.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c6cce4700 1 -- 172.21.15.133:0/1818807706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c680b3fc0 con 0x7f9c680b52c0 2021-01-03T13:06:10.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c6dce6700 1 --2- 172.21.15.133:0/1818807706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c680b5c00 0x7f9c68064bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:10.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c6cce4700 1 --2- 172.21.15.133:0/1818807706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c680b52c0 0x7f9c68155d40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f9c64002f30 tx=0x7f9c64015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:10.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c5e7fc700 1 -- 172.21.15.133:0/1818807706 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c64011ca0 con 0x7f9c680b52c0 2021-01-03T13:06:10.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c6e4e7700 1 -- 172.21.15.133:0/1818807706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c680b4c60 con 0x7f9c680b52c0 2021-01-03T13:06:10.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c6e4e7700 1 -- 172.21.15.133:0/1818807706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c680af240 con 0x7f9c680b52c0 2021-01-03T13:06:10.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c5e7fc700 1 -- 172.21.15.133:0/1818807706 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c64011e00 con 0x7f9c680b52c0 2021-01-03T13:06:10.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c5e7fc700 1 -- 172.21.15.133:0/1818807706 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c6401e650 con 0x7f9c680b52c0 2021-01-03T13:06:10.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c6e4e7700 1 -- 172.21.15.133:0/1818807706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c680af8d0 con 0x7f9c680b52c0 2021-01-03T13:06:10.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c5e7fc700 1 -- 172.21.15.133:0/1818807706 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9c6401a040 con 0x7f9c680b52c0 2021-01-03T13:06:10.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c5e7fc700 1 --2- 172.21.15.133:0/1818807706 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9c500554e0 0x7f9c500579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:10.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c5e7fc700 1 -- 172.21.15.133:0/1818807706 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9c6406f160 con 0x7f9c680b52c0 2021-01-03T13:06:10.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c6d4e5700 1 --2- 172.21.15.133:0/1818807706 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9c500554e0 0x7f9c500579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:10.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.961+0000 7f9c6d4e5700 1 --2- 172.21.15.133:0/1818807706 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9c500554e0 0x7f9c500579a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f9c5800b000 tx=0x7f9c58007160).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:10.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:10.969+0000 7f9c5e7fc700 1 -- 172.21.15.133:0/1818807706 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9c640453c0 con 0x7f9c680b52c0 2021-01-03T13:06:11.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.157+0000 7f9c6e4e7700 1 -- 172.21.15.133:0/1818807706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7f9c68057300 con 0x7f9c680b52c0 2021-01-03T13:06:11.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.229+0000 7f9c5e7fc700 1 -- 172.21.15.133:0/1818807706 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v367) v1 ==== 127+0+0 (secure 0 0 0) 0x7f9c64023020 con 0x7f9c680b52c0 2021-01-03T13:06:11.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.233+0000 7f9c6e4e7700 1 -- 172.21.15.133:0/1818807706 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9c500554e0 msgr2=0x7f9c500579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:11.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.233+0000 7f9c6e4e7700 1 --2- 172.21.15.133:0/1818807706 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9c500554e0 0x7f9c500579a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f9c5800b000 tx=0x7f9c58007160).stop 2021-01-03T13:06:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.233+0000 7f9c6e4e7700 1 -- 172.21.15.133:0/1818807706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c680b52c0 msgr2=0x7f9c68155d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.233+0000 7f9c6e4e7700 1 --2- 172.21.15.133:0/1818807706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c680b52c0 0x7f9c68155d40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f9c64002f30 tx=0x7f9c64015000).stop 2021-01-03T13:06:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.233+0000 7f9c6e4e7700 1 -- 172.21.15.133:0/1818807706 shutdown_connections 2021-01-03T13:06:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.233+0000 7f9c6e4e7700 1 --2- 172.21.15.133:0/1818807706 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9c500554e0 0x7f9c500579a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:11.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.233+0000 7f9c6e4e7700 1 --2- 172.21.15.133:0/1818807706 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c680b5c00 0x7f9c68064bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:11.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.233+0000 7f9c6e4e7700 1 --2- 172.21.15.133:0/1818807706 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c680b0c90 0x7f9c680b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:11.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.233+0000 7f9c6e4e7700 1 --2- 172.21.15.133:0/1818807706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c680b52c0 0x7f9c68155d40 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:11.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.233+0000 7f9c6e4e7700 1 -- 172.21.15.133:0/1818807706 >> 172.21.15.133:0/1818807706 conn(0x7f9c6805bdf0 msgr2=0x7f9c681435d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:11.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.233+0000 7f9c6e4e7700 1 -- 172.21.15.133:0/1818807706 shutdown_connections 2021-01-03T13:06:11.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.233+0000 7f9c6e4e7700 1 -- 172.21.15.133:0/1818807706 wait complete. 2021-01-03T13:06:11.254 INFO:tasks.cephfs_test_runner:test_filtered_df (tasks.cephfs.test_misc.TestMisc) ... ok 2021-01-03T13:06:11.254 INFO:tasks.cephfs_test_runner:Starting test: test_fs_new (tasks.cephfs.test_misc.TestMisc) 2021-01-03T13:06:11.255 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-01-03T13:06:11.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ceacbd700 1 Processor -- start 2021-01-03T13:06:11.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ceacbd700 1 -- start start 2021-01-03T13:06:11.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ceacbd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2ce41437e0 0x7f2ce40b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:11.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ceacbd700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce405c510 con 0x7f2ce405cc10 2021-01-03T13:06:11.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ceacbd700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce4147190 con 0x7f2ce405c130 2021-01-03T13:06:11.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ceacbd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce40b5c10 con 0x7f2ce41437e0 2021-01-03T13:06:11.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ce8a59700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2ce405c130 0x7f2ce4146370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59220/0 (socket says 172.21.15.133:59220) 2021-01-03T13:06:11.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ce8a59700 1 -- 172.21.15.133:0/833537388 learned_addr learned my addr 172.21.15.133:0/833537388 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:11.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ce925a700 1 --2- 172.21.15.133:0/833537388 >> v2:172.21.15.133:3300/0 conn(0x7f2ce41437e0 0x7f2ce40b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:11.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ce37fe700 1 -- 172.21.15.133:0/833537388 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736758845 0 0) 0x7f2ce4147190 con 0x7f2ce405c130 2021-01-03T13:06:11.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ce37fe700 1 -- 172.21.15.133:0/833537388 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cd0003230 con 0x7f2ce405c130 2021-01-03T13:06:11.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ce925a700 1 -- 172.21.15.133:0/833537388 >> v1:172.21.15.133:6789/0 conn(0x7f2ce405c130 legacy=0x7f2ce4146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:11.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ce925a700 1 -- 172.21.15.133:0/833537388 >> v1:172.21.15.16:6789/0 conn(0x7f2ce405cc10 legacy=0x7f2ce4146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:11.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ce925a700 1 -- 172.21.15.133:0/833537388 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce40af8f0 con 0x7f2ce41437e0 2021-01-03T13:06:11.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ce925a700 1 --2- 172.21.15.133:0/833537388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce41437e0 0x7f2ce40b02d0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f2cdc002f30 tx=0x7f2cdc006dc0).ready entity=mon.1 client_cookie=87a063d7477637cf server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:11.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ce37fe700 1 -- 172.21.15.133:0/833537388 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cdc009800 con 0x7f2ce41437e0 2021-01-03T13:06:11.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ce37fe700 1 -- 172.21.15.133:0/833537388 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc009960 con 0x7f2ce41437e0 2021-01-03T13:06:11.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ce37fe700 1 -- 172.21.15.133:0/833537388 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cdc009cc0 con 0x7f2ce41437e0 2021-01-03T13:06:11.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ceacbd700 1 -- 172.21.15.133:0/833537388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce41437e0 msgr2=0x7f2ce40b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:11.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.369+0000 7f2ceacbd700 1 --2- 172.21.15.133:0/833537388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce41437e0 0x7f2ce40b02d0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f2cdc002f30 tx=0x7f2cdc006dc0).stop 2021-01-03T13:06:11.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ceacbd700 1 -- 172.21.15.133:0/833537388 shutdown_connections 2021-01-03T13:06:11.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ceacbd700 1 --2- 172.21.15.133:0/833537388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce41437e0 0x7f2ce40b02d0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:11.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ceacbd700 1 -- 172.21.15.133:0/833537388 >> 172.21.15.133:0/833537388 conn(0x7f2ce40b95d0 msgr2=0x7f2ce40b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:11.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ceacbd700 1 -- 172.21.15.133:0/833537388 shutdown_connections 2021-01-03T13:06:11.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ceacbd700 1 -- 172.21.15.133:0/833537388 wait complete. 2021-01-03T13:06:11.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ceacbd700 1 Processor -- start 2021-01-03T13:06:11.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ceacbd700 1 -- start start 2021-01-03T13:06:11.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ceacbd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ce405c130 0x7f2ce40b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:11.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ceacbd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce405cc10 0x7f2ce4144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:11.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ceacbd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2ce41437e0 0x7f2ce4140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:11.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ceacbd700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce409caa0 con 0x7f2ce405c130 2021-01-03T13:06:11.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ceacbd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce4142200 con 0x7f2ce405cc10 2021-01-03T13:06:11.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ceacbd700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce409f200 con 0x7f2ce41437e0 2021-01-03T13:06:11.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ce3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce405cc10 0x7f2ce4144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:11.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ce3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce405cc10 0x7f2ce4144780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38198/0 (socket says 172.21.15.133:38198) 2021-01-03T13:06:11.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ce3fff700 1 -- 172.21.15.133:0/3910349812 learned_addr learned my addr 172.21.15.133:0/3910349812 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:11.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ce8a59700 1 --2- 172.21.15.133:0/3910349812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ce405c130 0x7f2ce40b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:11.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ce925a700 1 --2- 172.21.15.133:0/3910349812 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2ce41437e0 0x7f2ce4140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:11.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ce3fff700 1 -- 172.21.15.133:0/3910349812 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2ce41437e0 msgr2=0x7f2ce4140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:11.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ce3fff700 1 --2- 172.21.15.133:0/3910349812 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2ce41437e0 0x7f2ce4140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:11.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ce3fff700 1 -- 172.21.15.133:0/3910349812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ce405c130 msgr2=0x7f2ce40b7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:11.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ce3fff700 1 --2- 172.21.15.133:0/3910349812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ce405c130 0x7f2ce40b7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:11.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ce3fff700 1 -- 172.21.15.133:0/3910349812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce4148c80 con 0x7f2ce405cc10 2021-01-03T13:06:11.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ce3fff700 1 --2- 172.21.15.133:0/3910349812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce405cc10 0x7f2ce4144780 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f2ce40b01b0 tx=0x7f2cd8007c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:11.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ce1ffb700 1 -- 172.21.15.133:0/3910349812 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cd8013410 con 0x7f2ce405cc10 2021-01-03T13:06:11.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ce1ffb700 1 -- 172.21.15.133:0/3910349812 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd8013570 con 0x7f2ce405cc10 2021-01-03T13:06:11.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ce1ffb700 1 -- 172.21.15.133:0/3910349812 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cd80138d0 con 0x7f2ce405cc10 2021-01-03T13:06:11.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ceacbd700 1 -- 172.21.15.133:0/3910349812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce4142430 con 0x7f2ce405cc10 2021-01-03T13:06:11.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.373+0000 7f2ceacbd700 1 -- 172.21.15.133:0/3910349812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce40b8890 con 0x7f2ce405cc10 2021-01-03T13:06:11.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.377+0000 7f2ceacbd700 1 -- 172.21.15.133:0/3910349812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce4057300 con 0x7f2ce405cc10 2021-01-03T13:06:11.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.377+0000 7f2ce1ffb700 1 -- 172.21.15.133:0/3910349812 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2cd8010030 con 0x7f2ce405cc10 2021-01-03T13:06:11.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.377+0000 7f2ce1ffb700 1 --2- 172.21.15.133:0/3910349812 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2cc4055440 0x7f2cc4057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:11.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.377+0000 7f2ce1ffb700 1 -- 172.21.15.133:0/3910349812 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2cd806de20 con 0x7f2ce405cc10 2021-01-03T13:06:11.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.377+0000 7f2ce8a59700 1 --2- 172.21.15.133:0/3910349812 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2cc4055440 0x7f2cc4057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:11.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.381+0000 7f2ce8a59700 1 --2- 172.21.15.133:0/3910349812 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2cc4055440 0x7f2cc4057900 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f2cd400d000 tx=0x7f2cd4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:11.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.385+0000 7f2ce1ffb700 1 -- 172.21.15.133:0/3910349812 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2cd8044010 con 0x7f2ce405cc10 2021-01-03T13:06:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:11.569+0000 7f2ceacbd700 1 -- 172.21.15.133:0/3910349812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7f2ce409f750 con 0x7f2ce405cc10 2021-01-03T13:06:12.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.233+0000 7f2ce1ffb700 1 -- 172.21.15.133:0/3910349812 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v368) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2cd8047630 con 0x7f2ce405cc10 2021-01-03T13:06:12.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.237+0000 7f2ceacbd700 1 -- 172.21.15.133:0/3910349812 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2cc4055440 msgr2=0x7f2cc4057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:12.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.237+0000 7f2ceacbd700 1 --2- 172.21.15.133:0/3910349812 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2cc4055440 0x7f2cc4057900 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f2cd400d000 tx=0x7f2cd4009040).stop 2021-01-03T13:06:12.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.237+0000 7f2ceacbd700 1 -- 172.21.15.133:0/3910349812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce405cc10 msgr2=0x7f2ce4144780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:12.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.237+0000 7f2ceacbd700 1 --2- 172.21.15.133:0/3910349812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce405cc10 0x7f2ce4144780 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f2ce40b01b0 tx=0x7f2cd8007c20).stop 2021-01-03T13:06:12.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.237+0000 7f2ceacbd700 1 -- 172.21.15.133:0/3910349812 shutdown_connections 2021-01-03T13:06:12.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.237+0000 7f2ceacbd700 1 --2- 172.21.15.133:0/3910349812 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2cc4055440 0x7f2cc4057900 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:12.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.237+0000 7f2ceacbd700 1 --2- 172.21.15.133:0/3910349812 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2ce405c130 0x7f2ce40b7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:12.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.237+0000 7f2ceacbd700 1 --2- 172.21.15.133:0/3910349812 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2ce41437e0 0x7f2ce4140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:12.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.237+0000 7f2ceacbd700 1 --2- 172.21.15.133:0/3910349812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ce405cc10 0x7f2ce4144780 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:12.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.237+0000 7f2ceacbd700 1 -- 172.21.15.133:0/3910349812 >> 172.21.15.133:0/3910349812 conn(0x7f2ce40b95d0 msgr2=0x7f2ce4145c20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:12.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.237+0000 7f2ceacbd700 1 -- 172.21.15.133:0/3910349812 shutdown_connections 2021-01-03T13:06:12.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.237+0000 7f2ceacbd700 1 -- 172.21.15.133:0/3910349812 wait complete. 2021-01-03T13:06:12.260 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-01-03T13:06:12.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.381+0000 7f2a24ec5700 1 Processor -- start 2021-01-03T13:06:12.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.381+0000 7f2a24ec5700 1 -- start start 2021-01-03T13:06:12.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.381+0000 7f2a24ec5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2a200b4c20 0x7f2a2005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:12.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.381+0000 7f2a24ec5700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a20060510 0x7f2a200b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:12.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.381+0000 7f2a24ec5700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a200b6cf0 con 0x7f2a2005fd10 2021-01-03T13:06:12.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.381+0000 7f2a24ec5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2005bf00 con 0x7f2a200b4c20 2021-01-03T13:06:12.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.381+0000 7f2a24ec5700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2005c1a0 con 0x7f2a20060510 2021-01-03T13:06:12.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.381+0000 7f2a1f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2a200b4c20 0x7f2a2005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:12.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.381+0000 7f2a1f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2a200b4c20 0x7f2a2005c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38204/0 (socket says 172.21.15.133:38204) 2021-01-03T13:06:12.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.381+0000 7f2a1f7fe700 1 -- 172.21.15.133:0/4256304758 learned_addr learned my addr 172.21.15.133:0/4256304758 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:12.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.381+0000 7f2a1effd700 1 --2- 172.21.15.133:0/4256304758 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a20060510 0x7f2a200b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:12.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a1f7fe700 1 -- 172.21.15.133:0/4256304758 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a20060510 msgr2=0x7f2a200b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:12.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a1f7fe700 1 --2- 172.21.15.133:0/4256304758 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a20060510 0x7f2a200b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:12.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a1f7fe700 1 -- 172.21.15.133:0/4256304758 >> v1:172.21.15.16:6789/0 conn(0x7f2a2005fd10 legacy=0x7f2a200b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:12.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a1f7fe700 1 -- 172.21.15.133:0/4256304758 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2005c440 con 0x7f2a200b4c20 2021-01-03T13:06:12.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a1f7fe700 1 --2- 172.21.15.133:0/4256304758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a200b4c20 0x7f2a2005c8e0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f2a10002f30 tx=0x7f2a10006e80).ready entity=mon.1 client_cookie=db0274ac106d2edb server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:12.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a1e7fc700 1 -- 172.21.15.133:0/4256304758 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a100097f0 con 0x7f2a200b4c20 2021-01-03T13:06:12.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a1e7fc700 1 -- 172.21.15.133:0/4256304758 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a10009950 con 0x7f2a200b4c20 2021-01-03T13:06:12.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a1e7fc700 1 -- 172.21.15.133:0/4256304758 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a10009cb0 con 0x7f2a200b4c20 2021-01-03T13:06:12.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a24ec5700 1 -- 172.21.15.133:0/4256304758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a200b4c20 msgr2=0x7f2a2005c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:12.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a24ec5700 1 --2- 172.21.15.133:0/4256304758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a200b4c20 0x7f2a2005c8e0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f2a10002f30 tx=0x7f2a10006e80).stop 2021-01-03T13:06:12.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a24ec5700 1 -- 172.21.15.133:0/4256304758 shutdown_connections 2021-01-03T13:06:12.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a24ec5700 1 --2- 172.21.15.133:0/4256304758 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a200b4c20 0x7f2a2005c8e0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:12.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a24ec5700 1 --2- 172.21.15.133:0/4256304758 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a20060510 0x7f2a200b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:12.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a24ec5700 1 -- 172.21.15.133:0/4256304758 >> 172.21.15.133:0/4256304758 conn(0x7f2a200b9f00 msgr2=0x7f2a200b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:12.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a24ec5700 1 -- 172.21.15.133:0/4256304758 shutdown_connections 2021-01-03T13:06:12.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a24ec5700 1 -- 172.21.15.133:0/4256304758 wait complete. 2021-01-03T13:06:12.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a24ec5700 1 Processor -- start 2021-01-03T13:06:12.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a24ec5700 1 -- start start 2021-01-03T13:06:12.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a24ec5700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a2005fd10 0x7f2a2009e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:12.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a24ec5700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a20060510 0x7f2a2013a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:12.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a24ec5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a200b4c20 0x7f2a2013aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:12.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a24ec5700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a201423d0 con 0x7f2a20060510 2021-01-03T13:06:12.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a24ec5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a201431f0 con 0x7f2a200b4c20 2021-01-03T13:06:12.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.385+0000 7f2a24ec5700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a20142600 con 0x7f2a2005fd10 2021-01-03T13:06:12.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a200b4c20 0x7f2a2013aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:12.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a200b4c20 0x7f2a2013aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38212/0 (socket says 172.21.15.133:38212) 2021-01-03T13:06:12.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1ffff700 1 -- 172.21.15.133:0/1588291099 learned_addr learned my addr 172.21.15.133:0/1588291099 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:12.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1effd700 1 --2- 172.21.15.133:0/1588291099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a20060510 0x7f2a2013a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:12.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1f7fe700 1 --2- 172.21.15.133:0/1588291099 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a2005fd10 0x7f2a2009e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:12.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1ffff700 1 -- 172.21.15.133:0/1588291099 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a2005fd10 msgr2=0x7f2a2009e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:12.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1ffff700 1 --2- 172.21.15.133:0/1588291099 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a2005fd10 0x7f2a2009e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:12.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1ffff700 1 -- 172.21.15.133:0/1588291099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a20060510 msgr2=0x7f2a2013a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:12.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1ffff700 1 --2- 172.21.15.133:0/1588291099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a20060510 0x7f2a2013a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:12.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1ffff700 1 -- 172.21.15.133:0/1588291099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a201428a0 con 0x7f2a200b4c20 2021-01-03T13:06:12.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1effd700 1 --2- 172.21.15.133:0/1588291099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a20060510 0x7f2a2013a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:06:12.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1ffff700 1 --2- 172.21.15.133:0/1588291099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a200b4c20 0x7f2a2013aa60 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f2a20145c30 tx=0x7f2a18007f10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:12.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1cff9700 1 -- 172.21.15.133:0/1588291099 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a1800ce50 con 0x7f2a200b4c20 2021-01-03T13:06:12.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1cff9700 1 -- 172.21.15.133:0/1588291099 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1800a770 con 0x7f2a200b4c20 2021-01-03T13:06:12.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1cff9700 1 -- 172.21.15.133:0/1588291099 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a1800aad0 con 0x7f2a200b4c20 2021-01-03T13:06:12.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a24ec5700 1 -- 172.21.15.133:0/1588291099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2009f040 con 0x7f2a200b4c20 2021-01-03T13:06:12.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a24ec5700 1 -- 172.21.15.133:0/1588291099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2013b0f0 con 0x7f2a200b4c20 2021-01-03T13:06:12.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a24ec5700 1 -- 172.21.15.133:0/1588291099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a20057300 con 0x7f2a200b4c20 2021-01-03T13:06:12.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1cff9700 1 -- 172.21.15.133:0/1588291099 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2a18019030 con 0x7f2a200b4c20 2021-01-03T13:06:12.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1cff9700 1 --2- 172.21.15.133:0/1588291099 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a000554e0 0x7f2a000579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:12.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.389+0000 7f2a1cff9700 1 -- 172.21.15.133:0/1588291099 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2a1806d750 con 0x7f2a200b4c20 2021-01-03T13:06:12.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.393+0000 7f2a1f7fe700 1 --2- 172.21.15.133:0/1588291099 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a000554e0 0x7f2a000579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:12.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.393+0000 7f2a1f7fe700 1 --2- 172.21.15.133:0/1588291099 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a000554e0 0x7f2a000579a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f2a1001c000 tx=0x7f2a10015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:12.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.397+0000 7f2a1cff9700 1 -- 172.21.15.133:0/1588291099 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2a18043940 con 0x7f2a200b4c20 2021-01-03T13:06:12.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.537+0000 7f2a24ec5700 1 -- 172.21.15.133:0/1588291099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7f2a2013b0f0 con 0x7f2a200b4c20 2021-01-03T13:06:12.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.545+0000 7f2a1cff9700 1 -- 172.21.15.133:0/1588291099 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2a2013b0f0 con 0x7f2a200b4c20 2021-01-03T13:06:12.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.549+0000 7f2a24ec5700 1 -- 172.21.15.133:0/1588291099 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a000554e0 msgr2=0x7f2a000579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:12.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.549+0000 7f2a24ec5700 1 --2- 172.21.15.133:0/1588291099 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a000554e0 0x7f2a000579a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f2a1001c000 tx=0x7f2a10015000).stop 2021-01-03T13:06:12.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.549+0000 7f2a24ec5700 1 -- 172.21.15.133:0/1588291099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a200b4c20 msgr2=0x7f2a2013aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:12.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.549+0000 7f2a24ec5700 1 --2- 172.21.15.133:0/1588291099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a200b4c20 0x7f2a2013aa60 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f2a20145c30 tx=0x7f2a18007f10).stop 2021-01-03T13:06:12.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.549+0000 7f2a24ec5700 1 -- 172.21.15.133:0/1588291099 shutdown_connections 2021-01-03T13:06:12.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.549+0000 7f2a24ec5700 1 --2- 172.21.15.133:0/1588291099 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a000554e0 0x7f2a000579a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:12.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.549+0000 7f2a24ec5700 1 --2- 172.21.15.133:0/1588291099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a200b4c20 0x7f2a2013aa60 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:12.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.549+0000 7f2a24ec5700 1 --2- 172.21.15.133:0/1588291099 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a2005fd10 0x7f2a2009e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:12.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.549+0000 7f2a24ec5700 1 --2- 172.21.15.133:0/1588291099 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a20060510 0x7f2a2013a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:12.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.549+0000 7f2a24ec5700 1 -- 172.21.15.133:0/1588291099 >> 172.21.15.133:0/1588291099 conn(0x7f2a200b9f00 msgr2=0x7f2a2013ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:12.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.549+0000 7f2a24ec5700 1 -- 172.21.15.133:0/1588291099 shutdown_connections 2021-01-03T13:06:12.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.549+0000 7f2a24ec5700 1 -- 172.21.15.133:0/1588291099 wait complete. 2021-01-03T13:06:12.568 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:06:12.568 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:06:12.587 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:06:12.605 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:06:12.624 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:06:12.642 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:06:12.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:12.643 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:12.644 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:12.651 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-03T13:06:12.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:06:12.652 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-01-03T13:06:12.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:12.653 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:12.653 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:12.673 INFO:teuthology.orchestra.run.smithi036.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:06:12.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:06:12.674 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-01-03T13:06:12.675 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-01-03T13:06:12.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.797+0000 7fbe23fff700 1 Processor -- start 2021-01-03T13:06:12.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.797+0000 7fbe23fff700 1 -- start start 2021-01-03T13:06:12.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.797+0000 7fbe23fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbe2405c2a0 0x7fbe24146d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:12.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.797+0000 7fbe23fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe24147200 con 0x7fbe24067600 2021-01-03T13:06:12.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.797+0000 7fbe23fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe240ae620 con 0x7fbe240b1a50 2021-01-03T13:06:12.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.797+0000 7fbe23fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe240acdf0 con 0x7fbe2405c2a0 2021-01-03T13:06:12.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.797+0000 7fbe227fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbe240b1a50 0x7fbe2413c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59250/0 (socket says 172.21.15.133:59250) 2021-01-03T13:06:12.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.797+0000 7fbe227fc700 1 -- 172.21.15.133:0/3546341744 learned_addr learned my addr 172.21.15.133:0/3546341744 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:12.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.797+0000 7fbe237fe700 1 --2- 172.21.15.133:0/3546341744 >> v2:172.21.15.16:3300/0 conn(0x7fbe2405c2a0 0x7fbe24146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:12.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.797+0000 7fbe21ffb700 1 -- 172.21.15.133:0/3546341744 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422587844 0 0) 0x7fbe240ae620 con 0x7fbe240b1a50 2021-01-03T13:06:12.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.797+0000 7fbe21ffb700 1 -- 172.21.15.133:0/3546341744 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe08003230 con 0x7fbe240b1a50 2021-01-03T13:06:12.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.797+0000 7fbe21ffb700 1 -- 172.21.15.133:0/3546341744 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959997237 0 0) 0x7fbe24147200 con 0x7fbe24067600 2021-01-03T13:06:12.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.797+0000 7fbe21ffb700 1 -- 172.21.15.133:0/3546341744 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe240ae620 con 0x7fbe24067600 2021-01-03T13:06:12.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.797+0000 7fbe237fe700 1 -- 172.21.15.133:0/3546341744 >> v1:172.21.15.133:6789/0 conn(0x7fbe240b1a50 legacy=0x7fbe2413c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:12.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.797+0000 7fbe237fe700 1 -- 172.21.15.133:0/3546341744 >> v1:172.21.15.16:6789/0 conn(0x7fbe24067600 legacy=0x7fbe24142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:12.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.797+0000 7fbe237fe700 1 -- 172.21.15.133:0/3546341744 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2405c8d0 con 0x7fbe2405c2a0 2021-01-03T13:06:12.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.801+0000 7fbe237fe700 1 --2- 172.21.15.133:0/3546341744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe2405c2a0 0x7fbe24146d10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fbe1c002f30 tx=0x7fbe1c006dc0).ready entity=mon.0 client_cookie=5c46f652fc929c3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:12.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.801+0000 7fbe21ffb700 1 -- 172.21.15.133:0/3546341744 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe1c009740 con 0x7fbe2405c2a0 2021-01-03T13:06:12.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.801+0000 7fbe21ffb700 1 -- 172.21.15.133:0/3546341744 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c0098a0 con 0x7fbe2405c2a0 2021-01-03T13:06:12.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.801+0000 7fbe21ffb700 1 -- 172.21.15.133:0/3546341744 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe1c009c00 con 0x7fbe2405c2a0 2021-01-03T13:06:12.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.801+0000 7fbe23fff700 1 -- 172.21.15.133:0/3546341744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe2405c2a0 msgr2=0x7fbe24146d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:12.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.801+0000 7fbe23fff700 1 --2- 172.21.15.133:0/3546341744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe2405c2a0 0x7fbe24146d10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fbe1c002f30 tx=0x7fbe1c006dc0).stop 2021-01-03T13:06:12.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.801+0000 7fbe23fff700 1 -- 172.21.15.133:0/3546341744 shutdown_connections 2021-01-03T13:06:12.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.801+0000 7fbe23fff700 1 --2- 172.21.15.133:0/3546341744 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe2405c2a0 0x7fbe24146d10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:12.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.801+0000 7fbe23fff700 1 -- 172.21.15.133:0/3546341744 >> 172.21.15.133:0/3546341744 conn(0x7fbe2406b050 msgr2=0x7fbe24060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:12.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.801+0000 7fbe23fff700 1 -- 172.21.15.133:0/3546341744 shutdown_connections 2021-01-03T13:06:12.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.801+0000 7fbe23fff700 1 -- 172.21.15.133:0/3546341744 wait complete. 2021-01-03T13:06:12.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.801+0000 7fbe23fff700 1 Processor -- start 2021-01-03T13:06:12.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.801+0000 7fbe23fff700 1 -- start start 2021-01-03T13:06:12.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe23fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe2405c2a0 0x7fbe24151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:12.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe23fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbe24067600 0x7fbe24140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:12.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe23fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe240b1a50 0x7fbe24155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:12.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe23fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2413ea80 con 0x7fbe240b1a50 2021-01-03T13:06:12.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe23fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2413e7e0 con 0x7fbe2405c2a0 2021-01-03T13:06:12.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe23fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe241555a0 con 0x7fbe24067600 2021-01-03T13:06:12.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe22ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe2405c2a0 0x7fbe24151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:12.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe22ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe2405c2a0 0x7fbe24151e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38222/0 (socket says 172.21.15.133:38222) 2021-01-03T13:06:12.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe22ffd700 1 -- 172.21.15.133:0/1620783671 learned_addr learned my addr 172.21.15.133:0/1620783671 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:12.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe237fe700 1 --2- 172.21.15.133:0/1620783671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe240b1a50 0x7fbe24155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:12.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe227fc700 1 --2- 172.21.15.133:0/1620783671 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbe24067600 0x7fbe24140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:12.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe22ffd700 1 -- 172.21.15.133:0/1620783671 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbe24067600 msgr2=0x7fbe24140d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:12.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe22ffd700 1 --2- 172.21.15.133:0/1620783671 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbe24067600 0x7fbe24140d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:12.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe22ffd700 1 -- 172.21.15.133:0/1620783671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe240b1a50 msgr2=0x7fbe24155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:12.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe22ffd700 1 --2- 172.21.15.133:0/1620783671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe240b1a50 0x7fbe24155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:12.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe22ffd700 1 -- 172.21.15.133:0/1620783671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe24155840 con 0x7fbe2405c2a0 2021-01-03T13:06:12.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe227fc700 1 --2- 172.21.15.133:0/1620783671 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbe24067600 0x7fbe24140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:12.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe22ffd700 1 --2- 172.21.15.133:0/1620783671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe2405c2a0 0x7fbe24151e50 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fbe14001450 tx=0x7fbe14007e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:12.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe13fff700 1 -- 172.21.15.133:0/1620783671 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe14002240 con 0x7fbe2405c2a0 2021-01-03T13:06:12.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe13fff700 1 -- 172.21.15.133:0/1620783671 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe140023a0 con 0x7fbe2405c2a0 2021-01-03T13:06:12.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe23fff700 1 -- 172.21.15.133:0/1620783671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe24152340 con 0x7fbe2405c2a0 2021-01-03T13:06:12.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe13fff700 1 -- 172.21.15.133:0/1620783671 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe14001610 con 0x7fbe2405c2a0 2021-01-03T13:06:12.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe23fff700 1 -- 172.21.15.133:0/1620783671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe241561d0 con 0x7fbe2405c2a0 2021-01-03T13:06:12.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.805+0000 7fbe23fff700 1 -- 172.21.15.133:0/1620783671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe24057300 con 0x7fbe2405c2a0 2021-01-03T13:06:12.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.809+0000 7fbe13fff700 1 -- 172.21.15.133:0/1620783671 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fbe14019030 con 0x7fbe2405c2a0 2021-01-03T13:06:12.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.809+0000 7fbe13fff700 1 --2- 172.21.15.133:0/1620783671 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbe000553b0 0x7fbe00057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:12.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.809+0000 7fbe13fff700 1 -- 172.21.15.133:0/1620783671 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbe1406d740 con 0x7fbe2405c2a0 2021-01-03T13:06:12.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.809+0000 7fbe227fc700 1 --2- 172.21.15.133:0/1620783671 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbe000553b0 0x7fbe00057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:12.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.809+0000 7fbe227fc700 1 --2- 172.21.15.133:0/1620783671 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbe000553b0 0x7fbe00057870 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fbe1800b000 tx=0x7fbe18009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:12.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.817+0000 7fbe13fff700 1 -- 172.21.15.133:0/1620783671 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbe14043a40 con 0x7fbe2405c2a0 2021-01-03T13:06:12.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.957+0000 7fbe23fff700 1 -- 172.21.15.133:0/1620783671 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fbe240afc30 con 0x7fbe2405c2a0 2021-01-03T13:06:12.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.957+0000 7fbe13fff700 1 -- 172.21.15.133:0/1620783671 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v114) v1 ==== 81+0+33707 (secure 0 0 0) 0x7fbe14047060 con 0x7fbe2405c2a0 2021-01-03T13:06:12.965 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:12.965 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:06:12.965 INFO:teuthology.orchestra.run.smithi133.stdout: "epoch": 114, 2021-01-03T13:06:12.965 INFO:teuthology.orchestra.run.smithi133.stdout: "fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", 2021-01-03T13:06:12.966 INFO:teuthology.orchestra.run.smithi133.stdout: "created": "2021-01-03T12:57:43.298835+0000", 2021-01-03T13:06:12.966 INFO:teuthology.orchestra.run.smithi133.stdout: "modified": "2021-01-03T13:06:01.689575+0000", 2021-01-03T13:06:12.966 INFO:teuthology.orchestra.run.smithi133.stdout: "last_up_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:06:12.966 INFO:teuthology.orchestra.run.smithi133.stdout: "last_in_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:06:12.966 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-01-03T13:06:12.967 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_num": 5799936, 2021-01-03T13:06:12.967 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_set": [ 2021-01-03T13:06:12.967 INFO:teuthology.orchestra.run.smithi133.stdout: "pglog_hardlimit", 2021-01-03T13:06:12.967 INFO:teuthology.orchestra.run.smithi133.stdout: "purged_snapdirs", 2021-01-03T13:06:12.967 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_deletes", 2021-01-03T13:06:12.968 INFO:teuthology.orchestra.run.smithi133.stdout: "sortbitwise" 2021-01-03T13:06:12.968 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:06:12.968 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_version": 4, 2021-01-03T13:06:12.968 INFO:teuthology.orchestra.run.smithi133.stdout: "full_ratio": 0.94999998807907104, 2021-01-03T13:06:12.968 INFO:teuthology.orchestra.run.smithi133.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-01-03T13:06:12.969 INFO:teuthology.orchestra.run.smithi133.stdout: "nearfull_ratio": 0.85000002384185791, 2021-01-03T13:06:12.969 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_snapshot": "", 2021-01-03T13:06:12.970 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_max": 20, 2021-01-03T13:06:12.970 INFO:teuthology.orchestra.run.smithi133.stdout: "max_osd": 8, 2021-01-03T13:06:12.970 INFO:teuthology.orchestra.run.smithi133.stdout: "require_min_compat_client": "jewel", 2021-01-03T13:06:12.971 INFO:teuthology.orchestra.run.smithi133.stdout: "min_compat_client": "jewel", 2021-01-03T13:06:12.971 INFO:teuthology.orchestra.run.smithi133.stdout: "require_osd_release": "octopus", 2021-01-03T13:06:12.971 INFO:teuthology.orchestra.run.smithi133.stdout: "pools": [ 2021-01-03T13:06:12.971 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:12.971 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 1, 2021-01-03T13:06:12.972 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "device_health_metrics", 2021-01-03T13:06:12.972 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:47.102954+0000", 2021-01-03T13:06:12.972 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:06:12.972 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:06:12.973 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:06:12.973 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:06:12.973 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:06:12.973 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:06:12.974 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:06:12.974 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:06:12.975 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 1, 2021-01-03T13:06:12.975 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 1, 2021-01-03T13:06:12.975 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 1, 2021-01-03T13:06:12.976 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 1, 2021-01-03T13:06:12.976 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 1, 2021-01-03T13:06:12.976 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:06:12.976 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:06:12.977 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:06:12.977 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:06:12.977 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:06:12.977 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:06:12.978 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:06:12.978 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:12.978 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "16", 2021-01-03T13:06:12.978 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:06:12.979 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:06:12.979 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:06:12.979 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:06:12.979 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:06:12.979 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:06:12.980 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:06:12.980 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:06:12.980 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:06:12.980 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:06:12.981 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:06:12.981 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:06:12.981 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:06:12.981 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:06:12.981 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:06:12.982 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:06:12.982 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:06:12.982 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:06:12.982 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:06:12.982 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:06:12.983 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:06:12.983 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:06:12.983 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:06:12.983 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:06:12.983 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:06:12.984 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:06:12.984 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:12.984 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:06:12.984 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:06:12.985 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:06:12.985 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:06:12.985 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:06:12.985 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:06:12.985 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:06:12.986 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:06:12.986 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:06:12.986 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:06:12.986 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:06:12.986 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:06:12.987 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 1 2021-01-03T13:06:12.987 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:12.987 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:06:12.987 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr_devicehealth": {} 2021-01-03T13:06:12.987 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:12.988 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:12.988 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:12.988 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 2, 2021-01-03T13:06:12.988 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "rbd", 2021-01-03T13:06:12.988 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:55.472799+0000", 2021-01-03T13:06:12.989 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:06:12.989 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:06:12.989 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:06:12.989 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:06:12.989 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:06:12.990 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:06:12.990 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:06:12.990 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:06:12.990 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:06:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:06:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:06:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:06:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:06:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:06:12.991 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:06:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:06:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:06:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:06:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:06:12.992 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:06:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "19", 2021-01-03T13:06:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:06:12.993 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:06:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:06:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:06:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:06:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:06:12.994 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:06:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:06:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:06:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:06:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:06:12.995 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:06:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:06:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:06:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:06:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:06:12.996 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:06:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:06:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:06:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:06:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:06:12.997 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:06:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:06:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:06:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:06:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:06:12.998 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:06:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:06:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:06:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:06:12.999 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:06:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:06:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:06:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:06:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:06:13.000 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:06:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:06:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:06:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:06:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd": {} 2021-01-03T13:06:13.001 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 19, 2021-01-03T13:06:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_metadata", 2021-01-03T13:06:13.002 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:05:56.797390+0000", 2021-01-03T13:06:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:06:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:06:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:06:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:06:13.003 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:06:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:06:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:06:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:06:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:06:13.004 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:06:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:06:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:06:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:06:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:06:13.005 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:06:13.006 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:06:13.006 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:06:13.006 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:06:13.006 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:06:13.006 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:06:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "112", 2021-01-03T13:06:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:06:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:06:13.007 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:06:13.008 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:06:13.008 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:06:13.008 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:06:13.008 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:06:13.008 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:06:13.009 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:06:13.009 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:06:13.009 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:06:13.009 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:06:13.009 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:06:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:06:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:06:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:06:13.010 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:06:13.011 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:06:13.011 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:06:13.011 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:06:13.011 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:06:13.011 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:06:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:06:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:06:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:06:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:06:13.012 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.013 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:06:13.013 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:06:13.013 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:06:13.013 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:06:13.013 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:06:13.014 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:06:13.014 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:06:13.014 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:06:13.014 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:06:13.014 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:06:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:06:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:06:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_bias": 4, 2021-01-03T13:06:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 16, 2021-01-03T13:06:13.015 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_priority": 5 2021-01-03T13:06:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:06:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:06:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": "cephfs" 2021-01-03T13:06:13.016 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 20, 2021-01-03T13:06:13.017 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_data", 2021-01-03T13:06:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:05:58.040406+0000", 2021-01-03T13:06:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:06:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:06:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:06:13.018 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:06:13.019 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:06:13.019 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:06:13.019 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:06:13.019 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:06:13.019 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:06:13.020 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:06:13.020 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:06:13.020 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:06:13.020 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:06:13.020 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:06:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:06:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:06:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:06:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:06:13.021 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:06:13.022 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:06:13.022 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.022 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "114", 2021-01-03T13:06:13.022 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:06:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:06:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:06:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:06:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:06:13.023 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:06:13.024 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:06:13.024 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:06:13.024 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:06:13.024 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:06:13.024 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:06:13.025 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:06:13.025 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:06:13.025 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:06:13.025 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:06:13.025 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:06:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:06:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:06:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:06:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:06:13.026 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:06:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:06:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:06:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:06:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:06:13.027 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:06:13.028 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.028 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:06:13.028 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:06:13.028 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:06:13.028 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:06:13.029 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:06:13.029 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:06:13.029 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:06:13.029 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:06:13.030 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:06:13.030 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:06:13.030 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:06:13.030 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:06:13.030 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:06:13.031 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:06:13.031 INFO:teuthology.orchestra.run.smithi133.stdout: "data": "cephfs" 2021-01-03T13:06:13.031 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.031 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.031 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.032 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:06:13.032 INFO:teuthology.orchestra.run.smithi133.stdout: "osds": [ 2021-01-03T13:06:13.032 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.032 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:06:13.032 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a", 2021-01-03T13:06:13.033 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:06:13.033 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:06:13.033 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:06:13.033 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:06:13.033 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:06:13.034 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:06:13.034 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:06:13.034 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 111, 2021-01-03T13:06:13.034 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:06:13.034 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.035 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6810", 2021-01-03T13:06:13.036 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:06:13.036 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.036 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.036 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.036 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6811", 2021-01-03T13:06:13.037 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:06:13.037 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.037 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.037 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.037 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:06:13.038 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.038 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.038 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.038 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6812", 2021-01-03T13:06:13.039 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:06:13.039 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.039 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.039 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.039 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6813", 2021-01-03T13:06:13.040 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:06:13.040 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.040 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.040 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.040 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:06:13.041 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.041 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.041 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.041 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6816", 2021-01-03T13:06:13.041 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:06:13.042 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.042 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.042 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.042 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6817", 2021-01-03T13:06:13.042 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:06:13.043 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.043 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.043 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.043 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:06:13.043 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.044 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.044 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.044 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6814", 2021-01-03T13:06:13.044 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:06:13.044 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.045 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.045 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.045 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6815", 2021-01-03T13:06:13.045 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:06:13.045 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.046 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.046 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.046 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6811/12124", 2021-01-03T13:06:13.046 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6813/12124", 2021-01-03T13:06:13.046 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6817/12124", 2021-01-03T13:06:13.047 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6815/12124", 2021-01-03T13:06:13.047 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:06:13.047 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:06:13.047 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:06:13.047 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.048 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.048 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.048 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:06:13.048 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9170d1de-58d4-4dfd-b9de-80dc15ca9e60", 2021-01-03T13:06:13.048 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:06:13.049 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:06:13.049 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:06:13.049 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:06:13.049 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:06:13.049 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:06:13.050 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:06:13.050 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 111, 2021-01-03T13:06:13.050 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:06:13.050 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:06:13.051 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:06:13.051 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.051 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.051 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.051 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6818", 2021-01-03T13:06:13.052 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:06:13.052 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.052 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.052 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.052 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6819", 2021-01-03T13:06:13.053 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:06:13.053 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.053 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.053 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.053 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:06:13.054 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.054 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.054 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.054 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6820", 2021-01-03T13:06:13.054 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:06:13.055 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.055 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.055 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.055 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6821", 2021-01-03T13:06:13.055 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:06:13.056 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.056 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.056 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.056 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:06:13.056 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.057 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.057 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.057 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6824", 2021-01-03T13:06:13.057 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:06:13.057 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.058 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.058 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.058 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6825", 2021-01-03T13:06:13.058 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:06:13.059 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.059 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.059 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.059 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:06:13.059 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.059 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.060 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.060 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6822", 2021-01-03T13:06:13.060 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:06:13.060 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.060 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.061 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.061 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6823", 2021-01-03T13:06:13.061 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:06:13.061 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.061 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.062 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.062 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6819/12123", 2021-01-03T13:06:13.062 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6821/12123", 2021-01-03T13:06:13.062 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6825/12123", 2021-01-03T13:06:13.062 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6823/12123", 2021-01-03T13:06:13.063 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:06:13.063 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:06:13.063 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:06:13.063 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.063 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.064 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.064 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:06:13.064 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9fc5adf9-3537-4953-9c65-0c67ecb53776", 2021-01-03T13:06:13.064 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:06:13.064 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:06:13.065 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:06:13.065 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:06:13.065 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:06:13.065 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:06:13.065 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:06:13.066 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 108, 2021-01-03T13:06:13.066 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:06:13.066 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:06:13.066 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:06:13.066 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.067 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.067 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.067 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6802", 2021-01-03T13:06:13.067 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:06:13.067 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.068 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.068 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.068 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6803", 2021-01-03T13:06:13.068 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:06:13.069 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.069 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.069 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.069 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:06:13.069 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.070 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.070 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.070 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6804", 2021-01-03T13:06:13.070 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:06:13.070 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.071 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.071 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.071 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6805", 2021-01-03T13:06:13.071 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:06:13.071 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.072 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.072 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.072 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:06:13.072 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.072 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.073 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.073 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6808", 2021-01-03T13:06:13.073 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:06:13.073 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.073 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.074 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.074 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6809", 2021-01-03T13:06:13.074 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:06:13.074 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.074 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.075 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.075 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:06:13.075 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.075 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.075 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.076 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6806", 2021-01-03T13:06:13.076 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:06:13.076 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.076 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.076 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.077 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6807", 2021-01-03T13:06:13.077 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:06:13.077 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.077 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.078 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6803/12122", 2021-01-03T13:06:13.078 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6805/12122", 2021-01-03T13:06:13.078 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6809/12122", 2021-01-03T13:06:13.078 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6807/12122", 2021-01-03T13:06:13.078 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:06:13.079 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:06:13.079 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:06:13.079 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.079 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.079 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.080 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:06:13.080 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "0ad45ce5-6635-4089-bbf8-c966d0fe5338", 2021-01-03T13:06:13.080 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:06:13.080 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:06:13.081 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:06:13.081 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:06:13.081 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:06:13.081 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:06:13.081 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:06:13.082 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 112, 2021-01-03T13:06:13.082 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:06:13.082 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:06:13.082 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:06:13.083 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.083 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.083 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.083 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6826", 2021-01-03T13:06:13.083 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:06:13.084 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.084 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.084 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.084 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6827", 2021-01-03T13:06:13.084 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:06:13.085 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.085 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.085 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.085 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:06:13.085 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.086 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.086 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.086 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6828", 2021-01-03T13:06:13.086 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:06:13.086 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.087 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.087 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.087 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6829", 2021-01-03T13:06:13.087 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:06:13.087 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.088 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.088 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.088 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:06:13.088 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.088 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.089 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.089 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6832", 2021-01-03T13:06:13.089 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:06:13.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.089 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.090 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.090 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6833", 2021-01-03T13:06:13.090 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:06:13.090 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.091 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.091 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.091 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:06:13.091 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.091 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.092 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.092 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6830", 2021-01-03T13:06:13.092 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:06:13.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.093 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.093 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6831", 2021-01-03T13:06:13.093 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:06:13.093 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.093 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.094 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.094 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6827/12136", 2021-01-03T13:06:13.094 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6829/12136", 2021-01-03T13:06:13.094 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6833/12136", 2021-01-03T13:06:13.094 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6831/12136", 2021-01-03T13:06:13.095 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:06:13.095 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:06:13.095 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:06:13.095 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.095 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.096 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.096 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:06:13.096 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "86b8d6d5-271b-4a70-ae7b-a227afb38d7c", 2021-01-03T13:06:13.096 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:06:13.097 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:06:13.097 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:06:13.097 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:06:13.097 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:06:13.097 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:06:13.097 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:06:13.098 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 108, 2021-01-03T13:06:13.098 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:06:13.098 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:06:13.098 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:06:13.099 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.099 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.099 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.099 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6808", 2021-01-03T13:06:13.099 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:06:13.100 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.100 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.100 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.100 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6809", 2021-01-03T13:06:13.100 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:06:13.101 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.101 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.101 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.101 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:06:13.101 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.102 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.102 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.102 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6810", 2021-01-03T13:06:13.102 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:06:13.102 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.103 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.103 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.103 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6811", 2021-01-03T13:06:13.103 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:06:13.103 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.104 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.104 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.104 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:06:13.104 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.104 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.105 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.105 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6814", 2021-01-03T13:06:13.105 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:06:13.105 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.106 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.106 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6815", 2021-01-03T13:06:13.106 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:06:13.106 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.106 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.107 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:06:13.107 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.107 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.108 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6812", 2021-01-03T13:06:13.108 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:06:13.108 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.108 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.108 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.109 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6813", 2021-01-03T13:06:13.109 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:06:13.109 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.109 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.109 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.110 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6809/12672", 2021-01-03T13:06:13.110 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6811/12672", 2021-01-03T13:06:13.110 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6815/12672", 2021-01-03T13:06:13.110 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6813/12672", 2021-01-03T13:06:13.111 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:06:13.111 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:06:13.111 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:06:13.111 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.111 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.112 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.112 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:06:13.112 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "173feb9d-f596-4030-85d8-1f4b46a9ffe5", 2021-01-03T13:06:13.112 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:06:13.112 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:06:13.113 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:06:13.113 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:06:13.113 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:06:13.113 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:06:13.113 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:06:13.114 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 108, 2021-01-03T13:06:13.114 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:06:13.114 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:06:13.114 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:06:13.115 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.115 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.115 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.115 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6817", 2021-01-03T13:06:13.116 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:06:13.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.116 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.116 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.117 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6819", 2021-01-03T13:06:13.117 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:06:13.117 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.117 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.117 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.118 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:06:13.118 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.118 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.118 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.118 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6820", 2021-01-03T13:06:13.119 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:06:13.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.119 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.119 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.119 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6822", 2021-01-03T13:06:13.120 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:06:13.120 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.120 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.120 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:06:13.121 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.121 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.121 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.121 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6828", 2021-01-03T13:06:13.121 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:06:13.122 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.122 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.122 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.122 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6830", 2021-01-03T13:06:13.122 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:06:13.123 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.123 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.123 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.123 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:06:13.123 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.124 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.124 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.124 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6824", 2021-01-03T13:06:13.124 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:06:13.124 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.125 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.125 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.125 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6826", 2021-01-03T13:06:13.125 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:06:13.125 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.126 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.126 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6819/12673", 2021-01-03T13:06:13.126 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6822/12673", 2021-01-03T13:06:13.126 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6830/12673", 2021-01-03T13:06:13.127 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6826/12673", 2021-01-03T13:06:13.127 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:06:13.127 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:06:13.127 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:06:13.127 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.128 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.128 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:06:13.128 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "b487980e-ad4d-43c1-91fa-4845f7af3d4d", 2021-01-03T13:06:13.128 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:06:13.129 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:06:13.129 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:06:13.129 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:06:13.129 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:06:13.129 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:06:13.130 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:06:13.130 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 111, 2021-01-03T13:06:13.130 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:06:13.130 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:06:13.130 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:06:13.131 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.131 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.131 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6800", 2021-01-03T13:06:13.131 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:06:13.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.132 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.132 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6801", 2021-01-03T13:06:13.132 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:06:13.133 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.133 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.133 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.133 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:06:13.133 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.134 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.134 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6802", 2021-01-03T13:06:13.134 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:06:13.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.135 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.135 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6803", 2021-01-03T13:06:13.135 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:06:13.135 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.136 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.136 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:06:13.136 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.137 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.137 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6806", 2021-01-03T13:06:13.137 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:06:13.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.138 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.138 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6807", 2021-01-03T13:06:13.138 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:06:13.138 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.138 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.139 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:06:13.139 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.139 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.140 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6804", 2021-01-03T13:06:13.140 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:06:13.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.140 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.141 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6805", 2021-01-03T13:06:13.141 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:06:13.141 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.141 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.142 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6801/12662", 2021-01-03T13:06:13.142 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6803/12662", 2021-01-03T13:06:13.142 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6807/12662", 2021-01-03T13:06:13.142 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6805/12662", 2021-01-03T13:06:13.142 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:06:13.143 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:06:13.143 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:06:13.143 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.144 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:06:13.144 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "38ea839a-451f-4c09-a545-4514e049b178", 2021-01-03T13:06:13.144 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:06:13.144 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:06:13.144 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:06:13.145 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:06:13.145 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:06:13.145 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:06:13.145 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:06:13.145 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 111, 2021-01-03T13:06:13.146 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:06:13.146 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:06:13.146 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:06:13.146 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.147 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.147 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6816", 2021-01-03T13:06:13.147 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:06:13.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.147 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.148 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6818", 2021-01-03T13:06:13.148 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:06:13.148 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.148 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.149 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:06:13.149 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.149 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.149 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6821", 2021-01-03T13:06:13.150 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:06:13.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.150 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.150 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6823", 2021-01-03T13:06:13.151 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:06:13.151 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.151 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.151 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:06:13.152 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.152 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.152 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6829", 2021-01-03T13:06:13.152 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:06:13.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.153 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.153 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6831", 2021-01-03T13:06:13.153 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:06:13.154 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.154 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.154 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:06:13.154 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:13.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.155 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:13.155 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6825", 2021-01-03T13:06:13.155 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:06:13.155 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.156 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.156 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:13.156 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6827", 2021-01-03T13:06:13.156 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:06:13.156 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.157 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.157 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6818/12674", 2021-01-03T13:06:13.157 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6823/12674", 2021-01-03T13:06:13.157 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6831/12674", 2021-01-03T13:06:13.158 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6827/12674", 2021-01-03T13:06:13.158 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:06:13.158 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:06:13.158 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:06:13.158 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:13.159 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.159 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:06:13.159 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_xinfo": [ 2021-01-03T13:06:13.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.159 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:06:13.160 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:06:13.160 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:06:13.160 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:06:13.160 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:06:13.160 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:06:13.161 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.659942+0000", 2021-01-03T13:06:13.161 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:06:13.161 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.161 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.161 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:06:13.162 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:06:13.162 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:06:13.162 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:06:13.162 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:06:13.162 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:06:13.163 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.750326+0000", 2021-01-03T13:06:13.163 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:06:13.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.163 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:06:13.164 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:06:13.164 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:06:13.164 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:06:13.164 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:06:13.164 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:06:13.165 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.587742+0000", 2021-01-03T13:06:13.165 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:06:13.165 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.165 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:06:13.166 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:06:13.166 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:06:13.166 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:06:13.166 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:06:13.166 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:06:13.167 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.855073+0000", 2021-01-03T13:06:13.167 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:06:13.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.167 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.167 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:06:13.168 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:06:13.168 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:06:13.168 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:06:13.168 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:06:13.168 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:06:13.169 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.565030+0000", 2021-01-03T13:06:13.169 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:06:13.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.169 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:06:13.170 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:06:13.170 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:06:13.170 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:06:13.170 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:06:13.170 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:06:13.171 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.786206+0000", 2021-01-03T13:06:13.171 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:06:13.171 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.171 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.171 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:06:13.172 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:06:13.172 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:06:13.172 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:06:13.172 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:06:13.172 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:06:13.173 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.576185+0000", 2021-01-03T13:06:13.173 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:06:13.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:13.173 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:06:13.174 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:06:13.174 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:06:13.174 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:06:13.174 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:06:13.174 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:06:13.175 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.823786+0000", 2021-01-03T13:06:13.175 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:06:13.175 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.175 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:06:13.175 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap": [], 2021-01-03T13:06:13.176 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap_items": [], 2021-01-03T13:06:13.176 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_temp": [], 2021-01-03T13:06:13.176 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_temp": [], 2021-01-03T13:06:13.176 INFO:teuthology.orchestra.run.smithi133.stdout: "blacklist": {}, 2021-01-03T13:06:13.176 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profiles": { 2021-01-03T13:06:13.177 INFO:teuthology.orchestra.run.smithi133.stdout: "default": { 2021-01-03T13:06:13.177 INFO:teuthology.orchestra.run.smithi133.stdout: "crush-failure-domain": "osd", 2021-01-03T13:06:13.177 INFO:teuthology.orchestra.run.smithi133.stdout: "k": "2", 2021-01-03T13:06:13.177 INFO:teuthology.orchestra.run.smithi133.stdout: "m": "1", 2021-01-03T13:06:13.177 INFO:teuthology.orchestra.run.smithi133.stdout: "plugin": "jerasure", 2021-01-03T13:06:13.178 INFO:teuthology.orchestra.run.smithi133.stdout: "ruleset-failure-domain": "osd", 2021-01-03T13:06:13.178 INFO:teuthology.orchestra.run.smithi133.stdout: "technique": "reed_sol_van" 2021-01-03T13:06:13.178 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:13.178 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:13.178 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps_queue": [], 2021-01-03T13:06:13.179 INFO:teuthology.orchestra.run.smithi133.stdout: "new_removed_snaps": [], 2021-01-03T13:06:13.179 INFO:teuthology.orchestra.run.smithi133.stdout: "new_purged_snaps": [], 2021-01-03T13:06:13.179 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_node_flags": {}, 2021-01-03T13:06:13.179 INFO:teuthology.orchestra.run.smithi133.stdout: "device_class_flags": {} 2021-01-03T13:06:13.179 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:06:13.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.961+0000 7fbe23fff700 1 -- 172.21.15.133:0/1620783671 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbe000553b0 msgr2=0x7fbe00057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:13.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.961+0000 7fbe23fff700 1 --2- 172.21.15.133:0/1620783671 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbe000553b0 0x7fbe00057870 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fbe1800b000 tx=0x7fbe18009040).stop 2021-01-03T13:06:13.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.961+0000 7fbe23fff700 1 -- 172.21.15.133:0/1620783671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe2405c2a0 msgr2=0x7fbe24151e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:13.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.961+0000 7fbe23fff700 1 --2- 172.21.15.133:0/1620783671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe2405c2a0 0x7fbe24151e50 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fbe14001450 tx=0x7fbe14007e30).stop 2021-01-03T13:06:13.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.961+0000 7fbe23fff700 1 -- 172.21.15.133:0/1620783671 shutdown_connections 2021-01-03T13:06:13.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.961+0000 7fbe23fff700 1 --2- 172.21.15.133:0/1620783671 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbe000553b0 0x7fbe00057870 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.961+0000 7fbe23fff700 1 --2- 172.21.15.133:0/1620783671 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe240b1a50 0x7fbe24155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.961+0000 7fbe23fff700 1 --2- 172.21.15.133:0/1620783671 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe2405c2a0 0x7fbe24151e50 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.961+0000 7fbe23fff700 1 --2- 172.21.15.133:0/1620783671 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbe24067600 0x7fbe24140d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.961+0000 7fbe23fff700 1 -- 172.21.15.133:0/1620783671 >> 172.21.15.133:0/1620783671 conn(0x7fbe2406b050 msgr2=0x7fbe24146c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:13.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.961+0000 7fbe23fff700 1 -- 172.21.15.133:0/1620783671 shutdown_connections 2021-01-03T13:06:13.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:12.961+0000 7fbe23fff700 1 -- 172.21.15.133:0/1620783671 wait complete. 2021-01-03T13:06:13.184 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:06:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.297+0000 7f5bcb59e700 1 Processor -- start 2021-01-03T13:06:13.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.297+0000 7f5bcb59e700 1 -- start start 2021-01-03T13:06:13.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bcb59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5bcc060510 0x7f5bcc05c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:13.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bcb59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5bcc05fd10 0x7f5bcc0b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:13.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bcb59e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bcc05bf00 con 0x7f5bcc0b4c20 2021-01-03T13:06:13.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bcb59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bcc05c1a0 con 0x7f5bcc060510 2021-01-03T13:06:13.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bcb59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc05c440 con 0x7f5bcc05fd10 2021-01-03T13:06:13.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bca59c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5bcc0b4c20 0x7f5bcc0b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:37990/0 (socket says 172.21.15.133:37990) 2021-01-03T13:06:13.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bc3fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5bcc060510 0x7f5bcc05c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:13.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bcad9d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5bcc05fd10 0x7f5bcc0b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:13.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bca59c700 1 -- 172.21.15.133:0/3042545998 learned_addr learned my addr 172.21.15.133:0/3042545998 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:13.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bc3fff700 1 -- 172.21.15.133:0/3042545998 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5bcc05fd10 msgr2=0x7f5bcc0b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:13.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bc3fff700 1 --2- 172.21.15.133:0/3042545998 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5bcc05fd10 0x7f5bcc0b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bc3fff700 1 -- 172.21.15.133:0/3042545998 >> v1:172.21.15.16:6789/0 conn(0x7f5bcc0b4c20 legacy=0x7f5bcc0b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:13.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bc3fff700 1 -- 172.21.15.133:0/3042545998 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc0b6ad0 con 0x7f5bcc060510 2021-01-03T13:06:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bc3fff700 1 --2- 172.21.15.133:0/3042545998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bcc060510 0x7f5bcc05c8e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f5bbc002f30 tx=0x7f5bbc006dc0).ready entity=mon.0 client_cookie=753943adb0315ac9 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bc9d9b700 1 -- 172.21.15.133:0/3042545998 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bbc009760 con 0x7f5bcc060510 2021-01-03T13:06:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bc9d9b700 1 -- 172.21.15.133:0/3042545998 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc0098c0 con 0x7f5bcc060510 2021-01-03T13:06:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bc9d9b700 1 -- 172.21.15.133:0/3042545998 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bbc009c20 con 0x7f5bcc060510 2021-01-03T13:06:13.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bcb59e700 1 -- 172.21.15.133:0/3042545998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bcc060510 msgr2=0x7f5bcc05c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bcb59e700 1 --2- 172.21.15.133:0/3042545998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bcc060510 0x7f5bcc05c8e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f5bbc002f30 tx=0x7f5bbc006dc0).stop 2021-01-03T13:06:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bcb59e700 1 -- 172.21.15.133:0/3042545998 shutdown_connections 2021-01-03T13:06:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bcb59e700 1 --2- 172.21.15.133:0/3042545998 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5bcc05fd10 0x7f5bcc0b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bcb59e700 1 --2- 172.21.15.133:0/3042545998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bcc060510 0x7f5bcc05c8e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bcb59e700 1 -- 172.21.15.133:0/3042545998 >> 172.21.15.133:0/3042545998 conn(0x7f5bcc0b9f00 msgr2=0x7f5bcc0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:13.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bcb59e700 1 -- 172.21.15.133:0/3042545998 shutdown_connections 2021-01-03T13:06:13.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.301+0000 7f5bcb59e700 1 -- 172.21.15.133:0/3042545998 wait complete. 2021-01-03T13:06:13.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bcb59e700 1 Processor -- start 2021-01-03T13:06:13.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bcb59e700 1 -- start start 2021-01-03T13:06:13.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bcb59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5bcc05fd10 0x7f5bcc09e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:13.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bcb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bcc060510 0x7f5bcc143510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:13.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bcb59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bcc0b4c20 0x7f5bcc155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:13.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bcb59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc143390 con 0x7f5bcc0b4c20 2021-01-03T13:06:13.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bcb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc0b3940 con 0x7f5bcc060510 2021-01-03T13:06:13.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bcb59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc143a00 con 0x7f5bcc05fd10 2021-01-03T13:06:13.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bc3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bcc060510 0x7f5bcc143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:13.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bc3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bcc060510 0x7f5bcc143510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38238/0 (socket says 172.21.15.133:38238) 2021-01-03T13:06:13.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bc3fff700 1 -- 172.21.15.133:0/1718717886 learned_addr learned my addr 172.21.15.133:0/1718717886 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:13.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bcad9d700 1 --2- 172.21.15.133:0/1718717886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bcc0b4c20 0x7f5bcc155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:13.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bca59c700 1 --2- 172.21.15.133:0/1718717886 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5bcc05fd10 0x7f5bcc09e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:13.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bc3fff700 1 -- 172.21.15.133:0/1718717886 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5bcc05fd10 msgr2=0x7f5bcc09e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:13.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bc3fff700 1 --2- 172.21.15.133:0/1718717886 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5bcc05fd10 0x7f5bcc09e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bc3fff700 1 -- 172.21.15.133:0/1718717886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bcc0b4c20 msgr2=0x7f5bcc155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:13.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bc3fff700 1 --2- 172.21.15.133:0/1718717886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bcc0b4c20 0x7f5bcc155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bc3fff700 1 -- 172.21.15.133:0/1718717886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc0b2f60 con 0x7f5bcc060510 2021-01-03T13:06:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bc3fff700 1 --2- 172.21.15.133:0/1718717886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bcc060510 0x7f5bcc143510 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f5bbc002f30 tx=0x7f5bbc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bc37fe700 1 -- 172.21.15.133:0/1718717886 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bbc011940 con 0x7f5bcc060510 2021-01-03T13:06:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bcb59e700 1 -- 172.21.15.133:0/1718717886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bcc0b3200 con 0x7f5bcc060510 2021-01-03T13:06:13.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bc37fe700 1 -- 172.21.15.133:0/1718717886 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc011aa0 con 0x7f5bcc060510 2021-01-03T13:06:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bc37fe700 1 -- 172.21.15.133:0/1718717886 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bbc011e00 con 0x7f5bcc060510 2021-01-03T13:06:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.305+0000 7f5bcb59e700 1 -- 172.21.15.133:0/1718717886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bcc1424b0 con 0x7f5bcc060510 2021-01-03T13:06:13.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.309+0000 7f5bc37fe700 1 -- 172.21.15.133:0/1718717886 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5bbc024030 con 0x7f5bcc060510 2021-01-03T13:06:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.309+0000 7f5bcb59e700 1 -- 172.21.15.133:0/1718717886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bcc057300 con 0x7f5bcc060510 2021-01-03T13:06:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.309+0000 7f5bc37fe700 1 --2- 172.21.15.133:0/1718717886 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ba40554e0 0x7f5ba40579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:13.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.309+0000 7f5bc37fe700 1 -- 172.21.15.133:0/1718717886 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5bbc06eff0 con 0x7f5bcc060510 2021-01-03T13:06:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.309+0000 7f5bca59c700 1 --2- 172.21.15.133:0/1718717886 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ba40554e0 0x7f5ba40579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:13.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.309+0000 7f5bca59c700 1 --2- 172.21.15.133:0/1718717886 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ba40554e0 0x7f5ba40579a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f5bb400b000 tx=0x7f5bb4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:13.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.317+0000 7f5bc37fe700 1 -- 172.21.15.133:0/1718717886 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5bbc045160 con 0x7f5bcc060510 2021-01-03T13:06:13.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.505+0000 7f5bcb59e700 1 -- 172.21.15.133:0/1718717886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5bcc067a00 con 0x7f5bcc060510 2021-01-03T13:06:13.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.505+0000 7f5bc37fe700 1 -- 172.21.15.133:0/1718717886 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+2499 (secure 0 0 0) 0x7f5bbc022020 con 0x7f5bcc060510 2021-01-03T13:06:13.509 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:13.510 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":49,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7108,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/2670125727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2670125727},{"type":"v1","addr":"172.21.15.133:6835","nonce":2670125727}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47},{"gid":7120,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6837/3964151526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3964151526},{"type":"v1","addr":"172.21.15.133:6837","nonce":3964151526}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:59.178144+0000","modified":"2021-01-03T13:06:00.181997+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7123},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7123":{"gid":7123,"name":"b","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.16:6833/1643460453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1643460453},{"type":"v1","addr":"172.21.15.16:6833","nonce":1643460453}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-01-03T13:06:13.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.505+0000 7f5bcb59e700 1 -- 172.21.15.133:0/1718717886 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ba40554e0 msgr2=0x7f5ba40579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:13.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.505+0000 7f5bcb59e700 1 --2- 172.21.15.133:0/1718717886 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ba40554e0 0x7f5ba40579a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f5bb400b000 tx=0x7f5bb4009040).stop 2021-01-03T13:06:13.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.505+0000 7f5bcb59e700 1 -- 172.21.15.133:0/1718717886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bcc060510 msgr2=0x7f5bcc143510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:13.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.505+0000 7f5bcb59e700 1 --2- 172.21.15.133:0/1718717886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bcc060510 0x7f5bcc143510 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f5bbc002f30 tx=0x7f5bbc015000).stop 2021-01-03T13:06:13.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.505+0000 7f5bcb59e700 1 -- 172.21.15.133:0/1718717886 shutdown_connections 2021-01-03T13:06:13.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.505+0000 7f5bcb59e700 1 --2- 172.21.15.133:0/1718717886 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ba40554e0 0x7f5ba40579a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.505+0000 7f5bcb59e700 1 --2- 172.21.15.133:0/1718717886 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5bcc0b4c20 0x7f5bcc155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.505+0000 7f5bcb59e700 1 --2- 172.21.15.133:0/1718717886 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5bcc05fd10 0x7f5bcc09e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.505+0000 7f5bcb59e700 1 --2- 172.21.15.133:0/1718717886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bcc060510 0x7f5bcc143510 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.505+0000 7f5bcb59e700 1 -- 172.21.15.133:0/1718717886 >> 172.21.15.133:0/1718717886 conn(0x7f5bcc0b9f00 msgr2=0x7f5bcc09c690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:13.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.505+0000 7f5bcb59e700 1 -- 172.21.15.133:0/1718717886 shutdown_connections 2021-01-03T13:06:13.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.505+0000 7f5bcb59e700 1 -- 172.21.15.133:0/1718717886 wait complete. 2021-01-03T13:06:13.514 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 49 2021-01-03T13:06:13.527 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-01-03T13:06:13.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aaffff700 1 Processor -- start 2021-01-03T13:06:13.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aaffff700 1 -- start start 2021-01-03T13:06:13.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aaffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ab00b52c0 0x7f1ab00b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:13.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aaffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ab00b0c90 0x7f1ab0098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aaffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab0060da0 con 0x7f1ab00b5c00 2021-01-03T13:06:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aaffff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab0067a90 con 0x7f1ab00b52c0 2021-01-03T13:06:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aaffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab00b0ad0 con 0x7f1ab00b0c90 2021-01-03T13:06:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aaeffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ab00b52c0 0x7f1ab00b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:13.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aaf7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1ab00b5c00 0x7f1ab014a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59278/0 (socket says 172.21.15.133:59278) 2021-01-03T13:06:13.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aaf7fe700 1 -- 172.21.15.133:0/603323120 learned_addr learned my addr 172.21.15.133:0/603323120 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:13.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aa7fff700 1 --2- 172.21.15.133:0/603323120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ab00b0c90 0x7f1ab0098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:13.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aaeffd700 1 -- 172.21.15.133:0/603323120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ab00b0c90 msgr2=0x7f1ab0098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:13.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aaeffd700 1 --2- 172.21.15.133:0/603323120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ab00b0c90 0x7f1ab0098ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aaeffd700 1 -- 172.21.15.133:0/603323120 >> v1:172.21.15.133:6789/0 conn(0x7f1ab00b5c00 legacy=0x7f1ab014a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:13.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aaeffd700 1 -- 172.21.15.133:0/603323120 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab00b56a0 con 0x7f1ab00b52c0 2021-01-03T13:06:13.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aaeffd700 1 --2- 172.21.15.133:0/603323120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab00b52c0 0x7f1ab00b05e0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f1aa0002f30 tx=0x7f1aa0006dc0).ready entity=mon.1 client_cookie=ca62f50aa402949f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:13.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aae7fc700 1 -- 172.21.15.133:0/603323120 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aa0009760 con 0x7f1ab00b52c0 2021-01-03T13:06:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aae7fc700 1 -- 172.21.15.133:0/603323120 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa00098c0 con 0x7f1ab00b52c0 2021-01-03T13:06:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aaffff700 1 -- 172.21.15.133:0/603323120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab00b52c0 msgr2=0x7f1ab00b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aae7fc700 1 -- 172.21.15.133:0/603323120 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aa0009c20 con 0x7f1ab00b52c0 2021-01-03T13:06:13.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.637+0000 7f1aaffff700 1 --2- 172.21.15.133:0/603323120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab00b52c0 0x7f1ab00b05e0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f1aa0002f30 tx=0x7f1aa0006dc0).stop 2021-01-03T13:06:13.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aaffff700 1 -- 172.21.15.133:0/603323120 shutdown_connections 2021-01-03T13:06:13.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aaffff700 1 --2- 172.21.15.133:0/603323120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab00b52c0 0x7f1ab00b05e0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aaffff700 1 --2- 172.21.15.133:0/603323120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ab00b0c90 0x7f1ab0098ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aaffff700 1 -- 172.21.15.133:0/603323120 >> 172.21.15.133:0/603323120 conn(0x7f1ab005bdf0 msgr2=0x7f1ab005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:13.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aaffff700 1 -- 172.21.15.133:0/603323120 shutdown_connections 2021-01-03T13:06:13.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aaffff700 1 -- 172.21.15.133:0/603323120 wait complete. 2021-01-03T13:06:13.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aaffff700 1 Processor -- start 2021-01-03T13:06:13.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aaffff700 1 -- start start 2021-01-03T13:06:13.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aaffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ab00b0c90 0x7f1ab014cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:13.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aaffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab00b52c0 0x7f1ab014a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:13.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aaffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ab00b5c00 0x7f1ab01593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:13.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aaffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab0149140 con 0x7f1ab00b5c00 2021-01-03T13:06:13.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aaffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab0067240 con 0x7f1ab00b52c0 2021-01-03T13:06:13.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aaffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab0149c40 con 0x7f1ab00b0c90 2021-01-03T13:06:13.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aa7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab00b52c0 0x7f1ab014a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:13.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aa7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab00b52c0 0x7f1ab014a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38250/0 (socket says 172.21.15.133:38250) 2021-01-03T13:06:13.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aa7fff700 1 -- 172.21.15.133:0/3396499407 learned_addr learned my addr 172.21.15.133:0/3396499407 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:13.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aaf7fe700 1 --2- 172.21.15.133:0/3396499407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ab00b5c00 0x7f1ab01593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:13.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aaeffd700 1 --2- 172.21.15.133:0/3396499407 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ab00b0c90 0x7f1ab014cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:13.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aa7fff700 1 -- 172.21.15.133:0/3396499407 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ab00b0c90 msgr2=0x7f1ab014cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:13.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aa7fff700 1 --2- 172.21.15.133:0/3396499407 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ab00b0c90 0x7f1ab014cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aa7fff700 1 -- 172.21.15.133:0/3396499407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ab00b5c00 msgr2=0x7f1ab01593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:13.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aa7fff700 1 --2- 172.21.15.133:0/3396499407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ab00b5c00 0x7f1ab01593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.641+0000 7f1aa7fff700 1 -- 172.21.15.133:0/3396499407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab0149370 con 0x7f1ab00b52c0 2021-01-03T13:06:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.645+0000 7f1aa7fff700 1 --2- 172.21.15.133:0/3396499407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab00b52c0 0x7f1ab014a880 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f1a9800c000 tx=0x7f1a98006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.645+0000 7f1aacff9700 1 -- 172.21.15.133:0/3396499407 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a9800cae0 con 0x7f1ab00b52c0 2021-01-03T13:06:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.645+0000 7f1aacff9700 1 -- 172.21.15.133:0/3396499407 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9800cc40 con 0x7f1ab00b52c0 2021-01-03T13:06:13.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.645+0000 7f1aaffff700 1 -- 172.21.15.133:0/3396499407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab0067470 con 0x7f1ab00b52c0 2021-01-03T13:06:13.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.645+0000 7f1aacff9700 1 -- 172.21.15.133:0/3396499407 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a98013450 con 0x7f1ab00b52c0 2021-01-03T13:06:13.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.645+0000 7f1aaffff700 1 -- 172.21.15.133:0/3396499407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab014d480 con 0x7f1ab00b52c0 2021-01-03T13:06:13.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.645+0000 7f1aacff9700 1 -- 172.21.15.133:0/3396499407 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1a9801a030 con 0x7f1ab00b52c0 2021-01-03T13:06:13.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.645+0000 7f1aacff9700 1 --2- 172.21.15.133:0/3396499407 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1a94055330 0x7f1a940577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:13.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.645+0000 7f1aacff9700 1 -- 172.21.15.133:0/3396499407 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1a9806dd50 con 0x7f1ab00b52c0 2021-01-03T13:06:13.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.645+0000 7f1aaffff700 1 -- 172.21.15.133:0/3396499407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab0057300 con 0x7f1ab00b52c0 2021-01-03T13:06:13.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.645+0000 7f1aaeffd700 1 --2- 172.21.15.133:0/3396499407 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1a94055330 0x7f1a940577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:13.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.645+0000 7f1aaeffd700 1 --2- 172.21.15.133:0/3396499407 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1a94055330 0x7f1a940577f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f1aa0018000 tx=0x7f1aa0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:13.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.653+0000 7f1aacff9700 1 -- 172.21.15.133:0/3396499407 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1a98042df0 con 0x7f1ab00b52c0 2021-01-03T13:06:13.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:13.841+0000 7f1aaffff700 1 -- 172.21.15.133:0/3396499407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1ab00008d0 con 0x7f1ab00b52c0 2021-01-03T13:06:14.548 INFO:tasks.ceph.mon.b.smithi016.stderr:2021-01-03T13:06:14.545+0000 7fba5c9c4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-01-03T13:06:14.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.553+0000 7f1aacff9700 1 -- 172.21.15.133:0/3396499407 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1a98022030 con 0x7f1ab00b52c0 2021-01-03T13:06:14.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.557+0000 7f1aaffff700 1 -- 172.21.15.133:0/3396499407 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1a94055330 msgr2=0x7f1a940577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:14.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.557+0000 7f1aaffff700 1 --2- 172.21.15.133:0/3396499407 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1a94055330 0x7f1a940577f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f1aa0018000 tx=0x7f1aa0015000).stop 2021-01-03T13:06:14.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.557+0000 7f1aaffff700 1 -- 172.21.15.133:0/3396499407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab00b52c0 msgr2=0x7f1ab014a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:14.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.557+0000 7f1aaffff700 1 --2- 172.21.15.133:0/3396499407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab00b52c0 0x7f1ab014a880 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f1a9800c000 tx=0x7f1a98006dc0).stop 2021-01-03T13:06:14.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.557+0000 7f1aaffff700 1 -- 172.21.15.133:0/3396499407 shutdown_connections 2021-01-03T13:06:14.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.557+0000 7f1aaffff700 1 --2- 172.21.15.133:0/3396499407 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1a94055330 0x7f1a940577f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:14.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.557+0000 7f1aaffff700 1 --2- 172.21.15.133:0/3396499407 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ab00b5c00 0x7f1ab01593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:14.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.557+0000 7f1aaffff700 1 --2- 172.21.15.133:0/3396499407 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1ab00b0c90 0x7f1ab014cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:14.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.557+0000 7f1aaffff700 1 --2- 172.21.15.133:0/3396499407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab00b52c0 0x7f1ab014a880 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:14.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.557+0000 7f1aaffff700 1 -- 172.21.15.133:0/3396499407 >> 172.21.15.133:0/3396499407 conn(0x7f1ab005bdf0 msgr2=0x7f1ab0145b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:14.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.557+0000 7f1aaffff700 1 -- 172.21.15.133:0/3396499407 shutdown_connections 2021-01-03T13:06:14.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.557+0000 7f1aaffff700 1 -- 172.21.15.133:0/3396499407 wait complete. 2021-01-03T13:06:14.564 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-01-03T13:06:14.578 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:06:14.581 INFO:tasks.ceph.mds.b.smithi016.stdout:starting mds.b at 2021-01-03T13:06:14.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.689+0000 7fc335b8c700 1 Processor -- start 2021-01-03T13:06:14.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.689+0000 7fc335b8c700 1 -- start start 2021-01-03T13:06:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc335b8c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc330063270 0x7fc3300ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc335b8c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3300accf0 0x7fc33013bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc335b8c700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc330063650 con 0x7fc3300b0250 2021-01-03T13:06:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc335b8c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3300afd30 con 0x7fc330063270 2021-01-03T13:06:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc335b8c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300b30e0 con 0x7fc3300accf0 2021-01-03T13:06:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc33538b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3300accf0 0x7fc33013bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc334b8a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc330063270 0x7fc3300ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc33538b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3300accf0 0x7fc33013bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:46564/0 (socket says 172.21.15.133:46564) 2021-01-03T13:06:14.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc334b8a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc330063270 0x7fc3300ae3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:36800/0 (socket says 172.21.15.133:36800) 2021-01-03T13:06:14.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc33538b700 1 -- 172.21.15.133:0/2621678377 learned_addr learned my addr 172.21.15.133:0/2621678377 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:14.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc33538b700 1 -- 172.21.15.133:0/2621678377 >> v2:172.21.15.16:3300/0 conn(0x7fc330063270 msgr2=0x7fc3300ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:14.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc33538b700 1 --2- 172.21.15.133:0/2621678377 >> v2:172.21.15.16:3300/0 conn(0x7fc330063270 0x7fc3300ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:14.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc33538b700 1 -- 172.21.15.133:0/2621678377 >> v1:172.21.15.16:6789/0 conn(0x7fc3300b0250 legacy=0x7fc3300ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc33538b700 1 -- 172.21.15.133:0/2621678377 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3300af5f0 con 0x7fc3300accf0 2021-01-03T13:06:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc33538b700 1 --2- 172.21.15.133:0/2621678377 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3300accf0 0x7fc33013bd80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fc3300b22a0 tx=0x7fc328009270).ready entity=mon.2 client_cookie=3b8323a7cf2806e8 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc32f7fe700 1 -- 172.21.15.133:0/2621678377 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc328009e90 con 0x7fc3300accf0 2021-01-03T13:06:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc32f7fe700 1 -- 172.21.15.133:0/2621678377 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32800bbc0 con 0x7fc3300accf0 2021-01-03T13:06:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc32f7fe700 1 -- 172.21.15.133:0/2621678377 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc32800bd30 con 0x7fc3300accf0 2021-01-03T13:06:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc335b8c700 1 -- 172.21.15.133:0/2621678377 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3300accf0 msgr2=0x7fc33013bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc335b8c700 1 --2- 172.21.15.133:0/2621678377 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3300accf0 0x7fc33013bd80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fc3300b22a0 tx=0x7fc328009270).stop 2021-01-03T13:06:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc335b8c700 1 -- 172.21.15.133:0/2621678377 shutdown_connections 2021-01-03T13:06:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc335b8c700 1 --2- 172.21.15.133:0/2621678377 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3300accf0 0x7fc33013bd80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc335b8c700 1 --2- 172.21.15.133:0/2621678377 >> v2:172.21.15.16:3300/0 conn(0x7fc330063270 0x7fc3300ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc335b8c700 1 -- 172.21.15.133:0/2621678377 >> 172.21.15.133:0/2621678377 conn(0x7fc3300617b0 msgr2=0x7fc33006aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc335b8c700 1 -- 172.21.15.133:0/2621678377 shutdown_connections 2021-01-03T13:06:14.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.693+0000 7fc335b8c700 1 -- 172.21.15.133:0/2621678377 wait complete. 2021-01-03T13:06:14.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.697+0000 7fc335b8c700 1 Processor -- start 2021-01-03T13:06:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.697+0000 7fc335b8c700 1 -- start start 2021-01-03T13:06:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.697+0000 7fc335b8c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc330063270 0x7fc3300b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.697+0000 7fc335b8c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3300accf0 0x7fc3300ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.697+0000 7fc335b8c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3300b0250 0x7fc3300a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.697+0000 7fc335b8c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33014a830 con 0x7fc3300accf0 2021-01-03T13:06:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.697+0000 7fc335b8c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33014aa60 con 0x7fc3300b0250 2021-01-03T13:06:14.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.697+0000 7fc335b8c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300aaea0 con 0x7fc330063270 2021-01-03T13:06:14.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.697+0000 7fc33538b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3300b0250 0x7fc3300a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:14.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.697+0000 7fc33538b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3300b0250 0x7fc3300a8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38268/0 (socket says 172.21.15.133:38268) 2021-01-03T13:06:14.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.697+0000 7fc33538b700 1 -- 172.21.15.133:0/3554411078 learned_addr learned my addr 172.21.15.133:0/3554411078 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:14.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.697+0000 7fc32ffff700 1 --2- 172.21.15.133:0/3554411078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3300accf0 0x7fc3300ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:14.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.697+0000 7fc334b8a700 1 --2- 172.21.15.133:0/3554411078 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc330063270 0x7fc3300b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:14.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.701+0000 7fc33538b700 1 -- 172.21.15.133:0/3554411078 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc330063270 msgr2=0x7fc3300b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:14.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.701+0000 7fc33538b700 1 --2- 172.21.15.133:0/3554411078 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc330063270 0x7fc3300b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:14.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.701+0000 7fc33538b700 1 -- 172.21.15.133:0/3554411078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3300accf0 msgr2=0x7fc3300ab110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:14.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.701+0000 7fc33538b700 1 --2- 172.21.15.133:0/3554411078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3300accf0 0x7fc3300ab110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:14.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.701+0000 7fc33538b700 1 -- 172.21.15.133:0/3554411078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3300aac00 con 0x7fc3300b0250 2021-01-03T13:06:14.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.701+0000 7fc32ffff700 1 --2- 172.21.15.133:0/3554411078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3300accf0 0x7fc3300ab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:14.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.701+0000 7fc334b8a700 1 --2- 172.21.15.133:0/3554411078 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc330063270 0x7fc3300b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:14.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.701+0000 7fc33538b700 1 --2- 172.21.15.133:0/3554411078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3300b0250 0x7fc3300a8a60 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7fc330065680 tx=0x7fc328016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:14.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.701+0000 7fc32dffb700 1 -- 172.21.15.133:0/3554411078 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3280107a0 con 0x7fc3300b0250 2021-01-03T13:06:14.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.701+0000 7fc32dffb700 1 -- 172.21.15.133:0/3554411078 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc328009e90 con 0x7fc3300b0250 2021-01-03T13:06:14.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.701+0000 7fc32dffb700 1 -- 172.21.15.133:0/3554411078 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc328010af0 con 0x7fc3300b0250 2021-01-03T13:06:14.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.701+0000 7fc335b8c700 1 -- 172.21.15.133:0/3554411078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3300a9c10 con 0x7fc3300b0250 2021-01-03T13:06:14.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.701+0000 7fc335b8c700 1 -- 172.21.15.133:0/3554411078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3300673e0 con 0x7fc3300b0250 2021-01-03T13:06:14.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.701+0000 7fc335b8c700 1 -- 172.21.15.133:0/3554411078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc330064b70 con 0x7fc3300b0250 2021-01-03T13:06:14.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.701+0000 7fc32dffb700 1 -- 172.21.15.133:0/3554411078 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc328026030 con 0x7fc3300b0250 2021-01-03T13:06:14.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.705+0000 7fc32dffb700 1 --2- 172.21.15.133:0/3554411078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3140553b0 0x7fc314057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:14.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.705+0000 7fc334b8a700 1 --2- 172.21.15.133:0/3554411078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3140553b0 0x7fc314057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:14.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.705+0000 7fc32dffb700 1 -- 172.21.15.133:0/3554411078 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc32806f100 con 0x7fc3300b0250 2021-01-03T13:06:14.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.705+0000 7fc334b8a700 1 --2- 172.21.15.133:0/3554411078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3140553b0 0x7fc314057870 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fc31800b000 tx=0x7fc318008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:14.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.709+0000 7fc32dffb700 1 -- 172.21.15.133:0/3554411078 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc3280453b0 con 0x7fc3300b0250 2021-01-03T13:06:14.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.893+0000 7fc335b8c700 1 -- 172.21.15.133:0/3554411078 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc330057300 con 0x7fc3300b0250 2021-01-03T13:06:14.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.893+0000 7fc32dffb700 1 -- 172.21.15.133:0/3554411078 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+2139 (secure 0 0 0) 0x7fc328024090 con 0x7fc3300b0250 2021-01-03T13:06:14.898 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:14.898 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":50,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7108,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6835/2670125727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2670125727},{"type":"v1","addr":"172.21.15.133:6835","nonce":2670125727}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47},{"gid":7120,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6837/3964151526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3964151526},{"type":"v1","addr":"172.21.15.133:6837","nonce":3964151526}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":47}],"filesystems":[{"mdsmap":{"epoch":50,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:05:59.178144+0000","modified":"2021-01-03T13:06:14.548410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2021-01-03T13:06:14.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.893+0000 7fc335b8c700 1 -- 172.21.15.133:0/3554411078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3140553b0 msgr2=0x7fc314057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:14.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.893+0000 7fc335b8c700 1 --2- 172.21.15.133:0/3554411078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3140553b0 0x7fc314057870 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fc31800b000 tx=0x7fc318008040).stop 2021-01-03T13:06:14.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.893+0000 7fc335b8c700 1 -- 172.21.15.133:0/3554411078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3300b0250 msgr2=0x7fc3300a8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:14.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.893+0000 7fc335b8c700 1 --2- 172.21.15.133:0/3554411078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3300b0250 0x7fc3300a8a60 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7fc330065680 tx=0x7fc328016000).stop 2021-01-03T13:06:14.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.893+0000 7fc335b8c700 1 -- 172.21.15.133:0/3554411078 shutdown_connections 2021-01-03T13:06:14.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.893+0000 7fc335b8c700 1 --2- 172.21.15.133:0/3554411078 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc3140553b0 0x7fc314057870 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:14.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.893+0000 7fc335b8c700 1 --2- 172.21.15.133:0/3554411078 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3300b0250 0x7fc3300a8a60 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:14.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.893+0000 7fc335b8c700 1 --2- 172.21.15.133:0/3554411078 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc330063270 0x7fc3300b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:14.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.893+0000 7fc335b8c700 1 --2- 172.21.15.133:0/3554411078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3300accf0 0x7fc3300ab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:14.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.893+0000 7fc335b8c700 1 -- 172.21.15.133:0/3554411078 >> 172.21.15.133:0/3554411078 conn(0x7fc3300617b0 msgr2=0x7fc3300b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:14.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.893+0000 7fc335b8c700 1 -- 172.21.15.133:0/3554411078 shutdown_connections 2021-01-03T13:06:14.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:14.893+0000 7fc335b8c700 1 -- 172.21.15.133:0/3554411078 wait complete. 2021-01-03T13:06:14.905 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 50 2021-01-03T13:06:14.912 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-01-03T13:06:15.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.025+0000 7f000f455700 1 Processor -- start 2021-01-03T13:06:15.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000f455700 1 -- start start 2021-01-03T13:06:15.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000f455700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f00080b52c0 0x7f00080b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:15.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000f455700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f00080b5c00 0x7f0008143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:15.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000f455700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0008060da0 con 0x7f00080b0c90 2021-01-03T13:06:15.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000f455700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0008067a90 con 0x7f00080b5c00 2021-01-03T13:06:15.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000f455700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00080b0ad0 con 0x7f00080b52c0 2021-01-03T13:06:15.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000ec54700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f00080b5c00 0x7f0008143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:15.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000ec54700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f00080b5c00 0x7f0008143eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38276/0 (socket says 172.21.15.133:38276) 2021-01-03T13:06:15.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000ec54700 1 -- 172.21.15.133:0/1583753007 learned_addr learned my addr 172.21.15.133:0/1583753007 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:15.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000e453700 1 --2- 172.21.15.133:0/1583753007 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f00080b52c0 0x7f00080b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:15.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000ec54700 1 -- 172.21.15.133:0/1583753007 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f00080b52c0 msgr2=0x7f00080b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:15.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000ec54700 1 --2- 172.21.15.133:0/1583753007 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f00080b52c0 0x7f00080b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:15.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000ec54700 1 -- 172.21.15.133:0/1583753007 >> v1:172.21.15.16:6789/0 conn(0x7f00080b0c90 legacy=0x7f0008098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:15.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000ec54700 1 -- 172.21.15.133:0/1583753007 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00080b56a0 con 0x7f00080b5c00 2021-01-03T13:06:15.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000ec54700 1 --2- 172.21.15.133:0/1583753007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00080b5c00 0x7f0008143eb0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7efff8002f30 tx=0x7efff8006e80).ready entity=mon.1 client_cookie=ba1187f141a4ac5c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:15.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000d451700 1 -- 172.21.15.133:0/1583753007 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efff80097f0 con 0x7f00080b5c00 2021-01-03T13:06:15.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000d451700 1 -- 172.21.15.133:0/1583753007 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff8009950 con 0x7f00080b5c00 2021-01-03T13:06:15.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000f455700 1 -- 172.21.15.133:0/1583753007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00080b5c00 msgr2=0x7f0008143eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:15.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000f455700 1 --2- 172.21.15.133:0/1583753007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00080b5c00 0x7f0008143eb0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7efff8002f30 tx=0x7efff8006e80).stop 2021-01-03T13:06:15.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000f455700 1 -- 172.21.15.133:0/1583753007 shutdown_connections 2021-01-03T13:06:15.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000f455700 1 --2- 172.21.15.133:0/1583753007 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f00080b52c0 0x7f00080b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:15.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000f455700 1 --2- 172.21.15.133:0/1583753007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00080b5c00 0x7f0008143eb0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:15.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000f455700 1 -- 172.21.15.133:0/1583753007 >> 172.21.15.133:0/1583753007 conn(0x7f000805bdf0 msgr2=0x7f000805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:15.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000f455700 1 -- 172.21.15.133:0/1583753007 shutdown_connections 2021-01-03T13:06:15.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.029+0000 7f000f455700 1 -- 172.21.15.133:0/1583753007 wait complete. 2021-01-03T13:06:15.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000f455700 1 Processor -- start 2021-01-03T13:06:15.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000f455700 1 -- start start 2021-01-03T13:06:15.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000f455700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00080b0c90 0x7f0008067420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:15.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000f455700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00080b52c0 0x7f00081423c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:15.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000f455700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f00080b5c00 0x7f00081428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:15.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000f455700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0008142da0 con 0x7f00080b52c0 2021-01-03T13:06:15.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000f455700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0008066b90 con 0x7f00080b0c90 2021-01-03T13:06:15.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000f455700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00080ade00 con 0x7f00080b5c00 2021-01-03T13:06:15.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000e453700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00080b0c90 0x7f0008067420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:15.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000e453700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00080b0c90 0x7f0008067420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38278/0 (socket says 172.21.15.133:38278) 2021-01-03T13:06:15.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000e453700 1 -- 172.21.15.133:0/3431583923 learned_addr learned my addr 172.21.15.133:0/3431583923 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:15.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000ec54700 1 --2- 172.21.15.133:0/3431583923 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f00080b5c00 0x7f00081428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:15.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000dc52700 1 --2- 172.21.15.133:0/3431583923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00080b52c0 0x7f00081423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:15.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000e453700 1 -- 172.21.15.133:0/3431583923 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f00080b5c00 msgr2=0x7f00081428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:15.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000e453700 1 --2- 172.21.15.133:0/3431583923 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f00080b5c00 0x7f00081428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:15.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000e453700 1 -- 172.21.15.133:0/3431583923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00080b52c0 msgr2=0x7f00081423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:15.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000e453700 1 --2- 172.21.15.133:0/3431583923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00080b52c0 0x7f00081423c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:15.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000e453700 1 -- 172.21.15.133:0/3431583923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00080ae060 con 0x7f00080b0c90 2021-01-03T13:06:15.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000e453700 1 --2- 172.21.15.133:0/3431583923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00080b0c90 0x7f0008067420 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f000000c000 tx=0x7f00000091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:15.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f00077fe700 1 -- 172.21.15.133:0/3431583923 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f000000cbb0 con 0x7f00080b0c90 2021-01-03T13:06:15.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f00077fe700 1 -- 172.21.15.133:0/3431583923 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000000cd10 con 0x7f00080b0c90 2021-01-03T13:06:15.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000f455700 1 -- 172.21.15.133:0/3431583923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00080ae300 con 0x7f00080b0c90 2021-01-03T13:06:15.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f00077fe700 1 -- 172.21.15.133:0/3431583923 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00000125e0 con 0x7f00080b0c90 2021-01-03T13:06:15.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.033+0000 7f000f455700 1 -- 172.21.15.133:0/3431583923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0008066520 con 0x7f00080b0c90 2021-01-03T13:06:15.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.037+0000 7f000f455700 1 -- 172.21.15.133:0/3431583923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0008057300 con 0x7f00080b0c90 2021-01-03T13:06:15.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.037+0000 7f00077fe700 1 -- 172.21.15.133:0/3431583923 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0000022070 con 0x7f00080b0c90 2021-01-03T13:06:15.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.037+0000 7f00077fe700 1 --2- 172.21.15.133:0/3431583923 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7effe8055440 0x7effe8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:15.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.037+0000 7f00077fe700 1 -- 172.21.15.133:0/3431583923 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f000006e7b0 con 0x7f00080b0c90 2021-01-03T13:06:15.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.037+0000 7f000dc52700 1 --2- 172.21.15.133:0/3431583923 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7effe8055440 0x7effe8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:15.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.037+0000 7f000dc52700 1 --2- 172.21.15.133:0/3431583923 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7effe8055440 0x7effe8057900 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7efffc00b000 tx=0x7efffc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:15.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.045+0000 7f00077fe700 1 -- 172.21.15.133:0/3431583923 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0000044a60 con 0x7f00080b0c90 2021-01-03T13:06:15.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.229+0000 7f000f455700 1 -- 172.21.15.133:0/3431583923 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f000805ce00 con 0x7f00080b0c90 2021-01-03T13:06:15.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.561+0000 7f00077fe700 1 -- 172.21.15.133:0/3431583923 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0000048080 con 0x7f00080b0c90 2021-01-03T13:06:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.561+0000 7f000f455700 1 -- 172.21.15.133:0/3431583923 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7effe8055440 msgr2=0x7effe8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.561+0000 7f000f455700 1 --2- 172.21.15.133:0/3431583923 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7effe8055440 0x7effe8057900 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7efffc00b000 tx=0x7efffc009040).stop 2021-01-03T13:06:15.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.561+0000 7f000f455700 1 -- 172.21.15.133:0/3431583923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00080b0c90 msgr2=0x7f0008067420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.561+0000 7f000f455700 1 --2- 172.21.15.133:0/3431583923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00080b0c90 0x7f0008067420 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f000000c000 tx=0x7f00000091a0).stop 2021-01-03T13:06:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.561+0000 7f000f455700 1 -- 172.21.15.133:0/3431583923 shutdown_connections 2021-01-03T13:06:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.561+0000 7f000f455700 1 --2- 172.21.15.133:0/3431583923 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7effe8055440 0x7effe8057900 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:15.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.561+0000 7f000f455700 1 --2- 172.21.15.133:0/3431583923 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f00080b5c00 0x7f00081428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:15.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.561+0000 7f000f455700 1 --2- 172.21.15.133:0/3431583923 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00080b0c90 0x7f0008067420 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:15.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.561+0000 7f000f455700 1 --2- 172.21.15.133:0/3431583923 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00080b52c0 0x7f00081423c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:15.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.561+0000 7f000f455700 1 -- 172.21.15.133:0/3431583923 >> 172.21.15.133:0/3431583923 conn(0x7f000805bdf0 msgr2=0x7f000805f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:15.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.561+0000 7f000f455700 1 -- 172.21.15.133:0/3431583923 shutdown_connections 2021-01-03T13:06:15.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.561+0000 7f000f455700 1 -- 172.21.15.133:0/3431583923 wait complete. 2021-01-03T13:06:15.583 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-01-03T13:06:15.708 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49de55700 1 Processor -- start 2021-01-03T13:06:15.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49de55700 1 -- start start 2021-01-03T13:06:15.709 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49de55700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4980b7ab0 0x7fc498146300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:15.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49de55700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4980b2990 0x7fc4980b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:15.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49de55700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4981467f0 con 0x7fc4980b34e0 2021-01-03T13:06:15.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49de55700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4980b30f0 con 0x7fc4980b7ab0 2021-01-03T13:06:15.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49de55700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc498061480 con 0x7fc4980b2990 2021-01-03T13:06:15.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49ce53700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4980b7ab0 0x7fc498146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:15.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49ce53700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4980b7ab0 0x7fc498146300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38290/0 (socket says 172.21.15.133:38290) 2021-01-03T13:06:15.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49ce53700 1 -- 172.21.15.133:0/288497209 learned_addr learned my addr 172.21.15.133:0/288497209 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:15.711 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc497fff700 1 --2- 172.21.15.133:0/288497209 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4980b2990 0x7fc4980b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:15.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49ce53700 1 -- 172.21.15.133:0/288497209 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4980b2990 msgr2=0x7fc4980b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:15.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49ce53700 1 --2- 172.21.15.133:0/288497209 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4980b2990 0x7fc4980b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:15.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49ce53700 1 -- 172.21.15.133:0/288497209 >> v1:172.21.15.16:6789/0 conn(0x7fc4980b34e0 legacy=0x7fc498140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:15.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49ce53700 1 -- 172.21.15.133:0/288497209 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc498061720 con 0x7fc4980b7ab0 2021-01-03T13:06:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc497fff700 1 --2- 172.21.15.133:0/288497209 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4980b2990 0x7fc4980b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49ce53700 1 --2- 172.21.15.133:0/288497209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4980b7ab0 0x7fc498146300 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7fc488002f30 tx=0x7fc488006e80).ready entity=mon.1 client_cookie=c8af26ae236f96a3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc4977fe700 1 -- 172.21.15.133:0/288497209 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4880097f0 con 0x7fc4980b7ab0 2021-01-03T13:06:15.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc4977fe700 1 -- 172.21.15.133:0/288497209 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc488009950 con 0x7fc4980b7ab0 2021-01-03T13:06:15.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc4977fe700 1 -- 172.21.15.133:0/288497209 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc488009cb0 con 0x7fc4980b7ab0 2021-01-03T13:06:15.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49de55700 1 -- 172.21.15.133:0/288497209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4980b7ab0 msgr2=0x7fc498146300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:15.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49de55700 1 --2- 172.21.15.133:0/288497209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4980b7ab0 0x7fc498146300 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7fc488002f30 tx=0x7fc488006e80).stop 2021-01-03T13:06:15.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49de55700 1 -- 172.21.15.133:0/288497209 shutdown_connections 2021-01-03T13:06:15.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49de55700 1 --2- 172.21.15.133:0/288497209 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4980b7ab0 0x7fc498146300 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:15.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49de55700 1 --2- 172.21.15.133:0/288497209 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4980b2990 0x7fc4980b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:15.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49de55700 1 -- 172.21.15.133:0/288497209 >> 172.21.15.133:0/288497209 conn(0x7fc49805c8c0 msgr2=0x7fc4980b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:15.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49de55700 1 -- 172.21.15.133:0/288497209 shutdown_connections 2021-01-03T13:06:15.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.705+0000 7fc49de55700 1 -- 172.21.15.133:0/288497209 wait complete. 2021-01-03T13:06:15.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc49de55700 1 Processor -- start 2021-01-03T13:06:15.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc49de55700 1 -- start start 2021-01-03T13:06:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc49de55700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4980b2990 0x7fc498152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:15.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc49de55700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4980b34e0 0x7fc49813e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc49de55700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4980b7ab0 0x7fc498154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc49de55700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49813f090 con 0x7fc4980b7ab0 2021-01-03T13:06:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc49de55700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc498147700 con 0x7fc4980b34e0 2021-01-03T13:06:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc49de55700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc498151b90 con 0x7fc4980b2990 2021-01-03T13:06:15.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc497fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4980b34e0 0x7fc49813e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:15.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc497fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4980b34e0 0x7fc49813e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38296/0 (socket says 172.21.15.133:38296) 2021-01-03T13:06:15.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc497fff700 1 -- 172.21.15.133:0/2201559246 learned_addr learned my addr 172.21.15.133:0/2201559246 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:15.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc49ce53700 1 --2- 172.21.15.133:0/2201559246 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4980b2990 0x7fc498152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:15.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc49d654700 1 --2- 172.21.15.133:0/2201559246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4980b7ab0 0x7fc498154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:15.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc497fff700 1 -- 172.21.15.133:0/2201559246 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4980b2990 msgr2=0x7fc498152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:15.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc497fff700 1 --2- 172.21.15.133:0/2201559246 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4980b2990 0x7fc498152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:15.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc497fff700 1 -- 172.21.15.133:0/2201559246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4980b7ab0 msgr2=0x7fc498154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:15.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc497fff700 1 --2- 172.21.15.133:0/2201559246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4980b7ab0 0x7fc498154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:15.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc497fff700 1 -- 172.21.15.133:0/2201559246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc498151e30 con 0x7fc4980b34e0 2021-01-03T13:06:15.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc49ce53700 1 --2- 172.21.15.133:0/2201559246 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4980b2990 0x7fc498152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:15.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc497fff700 1 --2- 172.21.15.133:0/2201559246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4980b34e0 0x7fc49813e460 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7fc48c0068b0 tx=0x7fc48c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:15.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc495ffb700 1 -- 172.21.15.133:0/2201559246 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc48c009920 con 0x7fc4980b34e0 2021-01-03T13:06:15.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc495ffb700 1 -- 172.21.15.133:0/2201559246 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48c009a80 con 0x7fc4980b34e0 2021-01-03T13:06:15.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc495ffb700 1 -- 172.21.15.133:0/2201559246 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc48c009de0 con 0x7fc4980b34e0 2021-01-03T13:06:15.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc49de55700 1 -- 172.21.15.133:0/2201559246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4981520d0 con 0x7fc4980b34e0 2021-01-03T13:06:15.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.709+0000 7fc49de55700 1 -- 172.21.15.133:0/2201559246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4980af490 con 0x7fc4980b34e0 2021-01-03T13:06:15.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.713+0000 7fc49de55700 1 -- 172.21.15.133:0/2201559246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc498152260 con 0x7fc4980b34e0 2021-01-03T13:06:15.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.713+0000 7fc495ffb700 1 -- 172.21.15.133:0/2201559246 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc48c013480 con 0x7fc4980b34e0 2021-01-03T13:06:15.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.713+0000 7fc495ffb700 1 --2- 172.21.15.133:0/2201559246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc478055330 0x7fc4780577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:15.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.713+0000 7fc49ce53700 1 --2- 172.21.15.133:0/2201559246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc478055330 0x7fc4780577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:15.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.713+0000 7fc495ffb700 1 -- 172.21.15.133:0/2201559246 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc48c06e810 con 0x7fc4980b34e0 2021-01-03T13:06:15.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.713+0000 7fc49ce53700 1 --2- 172.21.15.133:0/2201559246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc478055330 0x7fc4780577f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fc48801a000 tx=0x7fc488015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:15.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.721+0000 7fc495ffb700 1 -- 172.21.15.133:0/2201559246 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc48c044950 con 0x7fc4980b34e0 2021-01-03T13:06:15.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:15.861+0000 7fc49de55700 1 -- 172.21.15.133:0/2201559246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc498057300 con 0x7fc4980b34e0 2021-01-03T13:06:16.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.565+0000 7fc495ffb700 1 -- 172.21.15.133:0/2201559246 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v116) v1 ==== 185+0+0 (secure 0 0 0) 0x7fc48c047f70 con 0x7fc4980b34e0 2021-01-03T13:06:16.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.569+0000 7fc49de55700 1 -- 172.21.15.133:0/2201559246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc478055330 msgr2=0x7fc4780577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:16.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.569+0000 7fc49de55700 1 --2- 172.21.15.133:0/2201559246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc478055330 0x7fc4780577f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fc48801a000 tx=0x7fc488015000).stop 2021-01-03T13:06:16.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.569+0000 7fc49de55700 1 -- 172.21.15.133:0/2201559246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4980b34e0 msgr2=0x7fc49813e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:16.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.569+0000 7fc49de55700 1 --2- 172.21.15.133:0/2201559246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4980b34e0 0x7fc49813e460 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7fc48c0068b0 tx=0x7fc48c008040).stop 2021-01-03T13:06:16.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.569+0000 7fc49de55700 1 -- 172.21.15.133:0/2201559246 shutdown_connections 2021-01-03T13:06:16.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.569+0000 7fc49de55700 1 --2- 172.21.15.133:0/2201559246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc478055330 0x7fc4780577f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:16.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.569+0000 7fc49de55700 1 --2- 172.21.15.133:0/2201559246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4980b7ab0 0x7fc498154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:16.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.569+0000 7fc49de55700 1 --2- 172.21.15.133:0/2201559246 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4980b2990 0x7fc498152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:16.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.569+0000 7fc49de55700 1 --2- 172.21.15.133:0/2201559246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4980b34e0 0x7fc49813e460 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:16.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.569+0000 7fc49de55700 1 -- 172.21.15.133:0/2201559246 >> 172.21.15.133:0/2201559246 conn(0x7fc49805c8c0 msgr2=0x7fc498146070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:16.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.569+0000 7fc49de55700 1 -- 172.21.15.133:0/2201559246 shutdown_connections 2021-01-03T13:06:16.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.569+0000 7fc49de55700 1 -- 172.21.15.133:0/2201559246 wait complete. 2021-01-03T13:06:16.578 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2021-01-03T13:06:16.589 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-01-03T13:06:16.707 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.700+0000 7effff9d6700 1 Processor -- start 2021-01-03T13:06:16.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.700+0000 7effff9d6700 1 -- start start 2021-01-03T13:06:16.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efff81407f0 0x7efff8142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:16.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efff80b0470 0x7efff805bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:16.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff805cf20 con 0x7efff8140410 2021-01-03T13:06:16.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff80b02d0 con 0x7efff81407f0 2021-01-03T13:06:16.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff8146390 con 0x7efff80b0470 2021-01-03T13:06:16.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7efffcf71700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efff81407f0 0x7efff8142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:16.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7efffcf71700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efff81407f0 0x7efff8142dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38304/0 (socket says 172.21.15.133:38304) 2021-01-03T13:06:16.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7efffcf71700 1 -- 172.21.15.133:0/1808445572 learned_addr learned my addr 172.21.15.133:0/1808445572 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:16.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7efffdf73700 1 --2- 172.21.15.133:0/1808445572 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efff80b0470 0x7efff805bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:16.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7efffcf71700 1 -- 172.21.15.133:0/1808445572 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efff80b0470 msgr2=0x7efff805bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:16.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7efffcf71700 1 --2- 172.21.15.133:0/1808445572 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efff80b0470 0x7efff805bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:16.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7efffcf71700 1 -- 172.21.15.133:0/1808445572 >> v1:172.21.15.16:6789/0 conn(0x7efff8140410 legacy=0x7efff8146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:16.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7efffcf71700 1 -- 172.21.15.133:0/1808445572 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff8146580 con 0x7efff81407f0 2021-01-03T13:06:16.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7efffcf71700 1 --2- 172.21.15.133:0/1808445572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff81407f0 0x7efff8142dc0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7efff80ba120 tx=0x7effec006e80).ready entity=mon.1 client_cookie=9bb56a3957ce8c62 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:16.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effe3fff700 1 -- 172.21.15.133:0/1808445572 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effec0097b0 con 0x7efff81407f0 2021-01-03T13:06:16.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effe3fff700 1 -- 172.21.15.133:0/1808445572 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec009910 con 0x7efff81407f0 2021-01-03T13:06:16.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 -- 172.21.15.133:0/1808445572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff81407f0 msgr2=0x7efff8142dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:16.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 --2- 172.21.15.133:0/1808445572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff81407f0 0x7efff8142dc0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7efff80ba120 tx=0x7effec006e80).stop 2021-01-03T13:06:16.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 -- 172.21.15.133:0/1808445572 shutdown_connections 2021-01-03T13:06:16.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 --2- 172.21.15.133:0/1808445572 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efff80b0470 0x7efff805bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:16.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 --2- 172.21.15.133:0/1808445572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff81407f0 0x7efff8142dc0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:16.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 -- 172.21.15.133:0/1808445572 >> 172.21.15.133:0/1808445572 conn(0x7efff80b95d0 msgr2=0x7efff80b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:16.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 -- 172.21.15.133:0/1808445572 shutdown_connections 2021-01-03T13:06:16.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 -- 172.21.15.133:0/1808445572 wait complete. 2021-01-03T13:06:16.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 Processor -- start 2021-01-03T13:06:16.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 -- start start 2021-01-03T13:06:16.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efff80b0470 0x7efff809e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:16.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff8140410 0x7efff8141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:16.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efff81407f0 0x7efff80b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:16.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff80b7410 con 0x7efff81407f0 2021-01-03T13:06:16.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff809c780 con 0x7efff8140410 2021-01-03T13:06:16.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.704+0000 7effff9d6700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff809ca20 con 0x7efff80b0470 2021-01-03T13:06:16.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7efffcf71700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff8140410 0x7efff8141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:16.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7efffcf71700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff8140410 0x7efff8141800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38308/0 (socket says 172.21.15.133:38308) 2021-01-03T13:06:16.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7efffcf71700 1 -- 172.21.15.133:0/3895543728 learned_addr learned my addr 172.21.15.133:0/3895543728 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:16.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7efffdf73700 1 --2- 172.21.15.133:0/3895543728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efff81407f0 0x7efff80b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:16.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7efffd772700 1 --2- 172.21.15.133:0/3895543728 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efff80b0470 0x7efff809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:16.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7efffcf71700 1 -- 172.21.15.133:0/3895543728 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efff80b0470 msgr2=0x7efff809e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:16.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7efffcf71700 1 --2- 172.21.15.133:0/3895543728 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efff80b0470 0x7efff809e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:16.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7efffcf71700 1 -- 172.21.15.133:0/3895543728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efff81407f0 msgr2=0x7efff80b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:16.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7efffcf71700 1 --2- 172.21.15.133:0/3895543728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efff81407f0 0x7efff80b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:16.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7efffcf71700 1 -- 172.21.15.133:0/3895543728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff809ccc0 con 0x7efff8140410 2021-01-03T13:06:16.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7efffcf71700 1 --2- 172.21.15.133:0/3895543728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff8140410 0x7efff8141800 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7efff80ba120 tx=0x7effec016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:16.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7effeaffd700 1 -- 172.21.15.133:0/3895543728 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effec011b40 con 0x7efff8140410 2021-01-03T13:06:16.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7effeaffd700 1 -- 172.21.15.133:0/3895543728 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec011ca0 con 0x7efff8140410 2021-01-03T13:06:16.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7effff9d6700 1 -- 172.21.15.133:0/3895543728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff809e800 con 0x7efff8140410 2021-01-03T13:06:16.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7effeaffd700 1 -- 172.21.15.133:0/3895543728 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effec020400 con 0x7efff8140410 2021-01-03T13:06:16.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7effff9d6700 1 -- 172.21.15.133:0/3895543728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff814a230 con 0x7efff8140410 2021-01-03T13:06:16.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7effeaffd700 1 -- 172.21.15.133:0/3895543728 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7effec027030 con 0x7efff8140410 2021-01-03T13:06:16.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7effff9d6700 1 -- 172.21.15.133:0/3895543728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff809e990 con 0x7efff8140410 2021-01-03T13:06:16.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.708+0000 7effeaffd700 1 --2- 172.21.15.133:0/3895543728 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7effd4055440 0x7effd4057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:16.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.712+0000 7efffd772700 1 --2- 172.21.15.133:0/3895543728 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7effd4055440 0x7effd4057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:16.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.712+0000 7effeaffd700 1 -- 172.21.15.133:0/3895543728 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5721+0+0 (secure 0 0 0) 0x7effec06ea70 con 0x7efff8140410 2021-01-03T13:06:16.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.712+0000 7efffd772700 1 --2- 172.21.15.133:0/3895543728 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7effd4055440 0x7effd4057900 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7efff400d000 tx=0x7efff4007b40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:16.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.716+0000 7effeaffd700 1 -- 172.21.15.133:0/3895543728 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7effec044d60 con 0x7efff8140410 2021-01-03T13:06:16.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:16.860+0000 7effff9d6700 1 -- 172.21.15.133:0/3895543728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efff8057300 con 0x7efff8140410 2021-01-03T13:06:17.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.576+0000 7effeaffd700 1 -- 172.21.15.133:0/3895543728 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v117) v1 ==== 173+0+0 (secure 0 0 0) 0x7effec015020 con 0x7efff8140410 2021-01-03T13:06:17.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.576+0000 7effff9d6700 1 -- 172.21.15.133:0/3895543728 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7effd4055440 msgr2=0x7effd4057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:17.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.576+0000 7effff9d6700 1 --2- 172.21.15.133:0/3895543728 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7effd4055440 0x7effd4057900 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7efff400d000 tx=0x7efff4007b40).stop 2021-01-03T13:06:17.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.576+0000 7effff9d6700 1 -- 172.21.15.133:0/3895543728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff8140410 msgr2=0x7efff8141800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:17.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.576+0000 7effff9d6700 1 --2- 172.21.15.133:0/3895543728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff8140410 0x7efff8141800 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7efff80ba120 tx=0x7effec016000).stop 2021-01-03T13:06:17.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.576+0000 7effff9d6700 1 -- 172.21.15.133:0/3895543728 shutdown_connections 2021-01-03T13:06:17.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.576+0000 7effff9d6700 1 --2- 172.21.15.133:0/3895543728 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7effd4055440 0x7effd4057900 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:17.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.576+0000 7effff9d6700 1 --2- 172.21.15.133:0/3895543728 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efff81407f0 0x7efff80b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:17.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.576+0000 7effff9d6700 1 --2- 172.21.15.133:0/3895543728 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efff80b0470 0x7efff809e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:17.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.576+0000 7effff9d6700 1 --2- 172.21.15.133:0/3895543728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efff8140410 0x7efff8141800 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:17.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.576+0000 7effff9d6700 1 -- 172.21.15.133:0/3895543728 >> 172.21.15.133:0/3895543728 conn(0x7efff80b95d0 msgr2=0x7efff80b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:17.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.576+0000 7effff9d6700 1 -- 172.21.15.133:0/3895543728 shutdown_connections 2021-01-03T13:06:17.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.576+0000 7effff9d6700 1 -- 172.21.15.133:0/3895543728 wait complete. 2021-01-03T13:06:17.587 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2021-01-03T13:06:17.598 INFO:tasks.ceph.mds.a:Restarting daemon 2021-01-03T13:06:17.599 INFO:tasks.ceph.mds.a:Stopping old one... 2021-01-03T13:06:17.599 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-01-03T13:06:17.599 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:06:17.600 INFO:tasks.ceph.mds.c:Restarting daemon 2021-01-03T13:06:17.600 INFO:tasks.ceph.mds.c:Stopping old one... 2021-01-03T13:06:17.601 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-01-03T13:06:17.601 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:06:17.602 INFO:tasks.ceph.mds.b:Restarting daemon 2021-01-03T13:06:17.602 INFO:tasks.ceph.mds.b:Stopping old one... 2021-01-03T13:06:17.602 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-01-03T13:06:17.603 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:06:17.615 INFO:tasks.ceph.mds.a:Stopped 2021-01-03T13:06:17.615 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-01-03T13:06:17.617 INFO:tasks.ceph.mds.b:Stopped 2021-01-03T13:06:17.617 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-01-03T13:06:17.618 INFO:tasks.ceph.mds.c:Stopped 2021-01-03T13:06:17.618 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-01-03T13:06:17.661 INFO:tasks.ceph.mds.a:Started 2021-01-03T13:06:17.662 DEBUG:teuthology.parallel:result is None 2021-01-03T13:06:17.663 INFO:tasks.ceph.mds.b:Started 2021-01-03T13:06:17.663 INFO:tasks.ceph.mds.c:Started 2021-01-03T13:06:17.664 DEBUG:teuthology.parallel:result is None 2021-01-03T13:06:17.664 DEBUG:teuthology.parallel:result is None 2021-01-03T13:06:17.665 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-01-03T13:06:17.732 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T13:06:17.733 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T13:06:17.742 INFO:tasks.ceph.mds.b.smithi016.stdout:starting mds.b at 2021-01-03T13:06:17.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.776+0000 7f25f9644700 1 Processor -- start 2021-01-03T13:06:17.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.776+0000 7f25f9644700 1 -- start start 2021-01-03T13:06:17.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.776+0000 7f25f9644700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f25f405c840 0x7f25f40af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:17.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.776+0000 7f25f9644700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f25f413f250 0x7f25f413f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:17.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.776+0000 7f25f9644700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f405cc20 con 0x7f25f40afa70 2021-01-03T13:06:17.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.776+0000 7f25f9644700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f40b18e0 con 0x7f25f405c840 2021-01-03T13:06:17.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.776+0000 7f25f9644700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f406ad30 con 0x7f25f413f250 2021-01-03T13:06:17.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.776+0000 7f25f2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f25f405c840 0x7f25f40af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:17.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.776+0000 7f25f2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f25f405c840 0x7f25f40af440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38344/0 (socket says 172.21.15.133:38344) 2021-01-03T13:06:17.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.776+0000 7f25f2ffd700 1 -- 172.21.15.133:0/2516906755 learned_addr learned my addr 172.21.15.133:0/2516906755 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:17.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.776+0000 7f25f37fe700 1 --2- 172.21.15.133:0/2516906755 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f25f413f250 0x7f25f413f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:17.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.776+0000 7f25f2ffd700 1 -- 172.21.15.133:0/2516906755 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f25f413f250 msgr2=0x7f25f413f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:17.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.776+0000 7f25f2ffd700 1 --2- 172.21.15.133:0/2516906755 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f25f413f250 0x7f25f413f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:17.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.776+0000 7f25f2ffd700 1 -- 172.21.15.133:0/2516906755 >> v1:172.21.15.16:6789/0 conn(0x7f25f40afa70 legacy=0x7f25f406a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:17.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.776+0000 7f25f2ffd700 1 -- 172.21.15.133:0/2516906755 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f40ad2d0 con 0x7f25f405c840 2021-01-03T13:06:17.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.776+0000 7f25f2ffd700 1 --2- 172.21.15.133:0/2516906755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25f405c840 0x7f25f40af440 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f25f40af390 tx=0x7f25e4006e80).ready entity=mon.1 client_cookie=9ad47287f8071dac server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:17.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f1ffb700 1 -- 172.21.15.133:0/2516906755 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e40097b0 con 0x7f25f405c840 2021-01-03T13:06:17.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f1ffb700 1 -- 172.21.15.133:0/2516906755 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e4009910 con 0x7f25f405c840 2021-01-03T13:06:17.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f1ffb700 1 -- 172.21.15.133:0/2516906755 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e4009c70 con 0x7f25f405c840 2021-01-03T13:06:17.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f9644700 1 -- 172.21.15.133:0/2516906755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25f405c840 msgr2=0x7f25f40af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:17.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f9644700 1 --2- 172.21.15.133:0/2516906755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25f405c840 0x7f25f40af440 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f25f40af390 tx=0x7f25e4006e80).stop 2021-01-03T13:06:17.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f9644700 1 -- 172.21.15.133:0/2516906755 shutdown_connections 2021-01-03T13:06:17.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f9644700 1 --2- 172.21.15.133:0/2516906755 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f25f413f250 0x7f25f413f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:17.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f9644700 1 --2- 172.21.15.133:0/2516906755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25f405c840 0x7f25f40af440 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:17.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f9644700 1 -- 172.21.15.133:0/2516906755 >> 172.21.15.133:0/2516906755 conn(0x7f25f406aeb0 msgr2=0x7f25f405bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:17.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f9644700 1 -- 172.21.15.133:0/2516906755 shutdown_connections 2021-01-03T13:06:17.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f9644700 1 -- 172.21.15.133:0/2516906755 wait complete. 2021-01-03T13:06:17.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f9644700 1 Processor -- start 2021-01-03T13:06:17.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f9644700 1 -- start start 2021-01-03T13:06:17.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f9644700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f25f405c840 0x7f25f4142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:17.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f9644700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25f40afa70 0x7f25f4135c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:17.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f9644700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25f413f250 0x7f25f4134b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:17.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f9644700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f413c990 con 0x7f25f413f250 2021-01-03T13:06:17.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f9644700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4139ee0 con 0x7f25f40afa70 2021-01-03T13:06:17.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f9644700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4152cd0 con 0x7f25f405c840 2021-01-03T13:06:17.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25f40afa70 0x7f25f4135c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:17.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25f40afa70 0x7f25f4135c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38352/0 (socket says 172.21.15.133:38352) 2021-01-03T13:06:17.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f27fc700 1 -- 172.21.15.133:0/456449214 learned_addr learned my addr 172.21.15.133:0/456449214 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:17.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f2ffd700 1 --2- 172.21.15.133:0/456449214 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f25f405c840 0x7f25f4142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:17.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.780+0000 7f25f37fe700 1 --2- 172.21.15.133:0/456449214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25f413f250 0x7f25f4134b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:17.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.784+0000 7f25f37fe700 1 -- 172.21.15.133:0/456449214 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f25f405c840 msgr2=0x7f25f4142f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:17.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.784+0000 7f25f37fe700 1 --2- 172.21.15.133:0/456449214 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f25f405c840 0x7f25f4142f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:17.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.784+0000 7f25f37fe700 1 -- 172.21.15.133:0/456449214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25f40afa70 msgr2=0x7f25f4135c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:17.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.784+0000 7f25f37fe700 1 --2- 172.21.15.133:0/456449214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25f40afa70 0x7f25f4135c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:17.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.784+0000 7f25f37fe700 1 -- 172.21.15.133:0/456449214 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f4152f70 con 0x7f25f413f250 2021-01-03T13:06:17.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.784+0000 7f25f2ffd700 1 --2- 172.21.15.133:0/456449214 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f25f405c840 0x7f25f4142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:06:17.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.784+0000 7f25f37fe700 1 --2- 172.21.15.133:0/456449214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25f413f250 0x7f25f4134b70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f25ec00a000 tx=0x7f25ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:17.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.784+0000 7f25e3fff700 1 -- 172.21.15.133:0/456449214 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25ec00b9e0 con 0x7f25f413f250 2021-01-03T13:06:17.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.784+0000 7f25e3fff700 1 -- 172.21.15.133:0/456449214 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec00bb40 con 0x7f25f413f250 2021-01-03T13:06:17.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.784+0000 7f25f9644700 1 -- 172.21.15.133:0/456449214 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f413c610 con 0x7f25f413f250 2021-01-03T13:06:17.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.784+0000 7f25f9644700 1 -- 172.21.15.133:0/456449214 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f413cdb0 con 0x7f25f413f250 2021-01-03T13:06:17.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.784+0000 7f25e3fff700 1 -- 172.21.15.133:0/456449214 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25ec00bea0 con 0x7f25f413f250 2021-01-03T13:06:17.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.784+0000 7f25f9644700 1 -- 172.21.15.133:0/456449214 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f4057300 con 0x7f25f413f250 2021-01-03T13:06:17.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.784+0000 7f25e3fff700 1 -- 172.21.15.133:0/456449214 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f25ec025430 con 0x7f25f413f250 2021-01-03T13:06:17.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.784+0000 7f25e3fff700 1 --2- 172.21.15.133:0/456449214 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f25d00553a0 0x7f25d0057860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:17.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.788+0000 7f25e3fff700 1 -- 172.21.15.133:0/456449214 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f25ec06eb20 con 0x7f25f413f250 2021-01-03T13:06:17.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.788+0000 7f25f2ffd700 1 --2- 172.21.15.133:0/456449214 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f25d00553a0 0x7f25d0057860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:17.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.788+0000 7f25f2ffd700 1 --2- 172.21.15.133:0/456449214 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f25d00553a0 0x7f25d0057860 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f25e401c000 tx=0x7f25e4015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:17.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.796+0000 7f25e3fff700 1 -- 172.21.15.133:0/456449214 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f25ec0450a0 con 0x7f25f413f250 2021-01-03T13:06:17.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:17.952+0000 7f25f9644700 1 -- 172.21.15.133:0/456449214 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f25f4143680 con 0x7f25f413f250 2021-01-03T13:06:18.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.776+0000 7f25e3fff700 1 -- 172.21.15.133:0/456449214 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v119) v1 ==== 97+0+0 (secure 0 0 0) 0x7f25ec0486c0 con 0x7f25f413f250 2021-01-03T13:06:18.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.780+0000 7f25f9644700 1 -- 172.21.15.133:0/456449214 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f25d00553a0 msgr2=0x7f25d0057860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:18.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.780+0000 7f25f9644700 1 --2- 172.21.15.133:0/456449214 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f25d00553a0 0x7f25d0057860 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f25e401c000 tx=0x7f25e4015000).stop 2021-01-03T13:06:18.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.780+0000 7f25f9644700 1 -- 172.21.15.133:0/456449214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25f413f250 msgr2=0x7f25f4134b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:18.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.780+0000 7f25f9644700 1 --2- 172.21.15.133:0/456449214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25f413f250 0x7f25f4134b70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f25ec00a000 tx=0x7f25ec008040).stop 2021-01-03T13:06:18.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.780+0000 7f25f9644700 1 -- 172.21.15.133:0/456449214 shutdown_connections 2021-01-03T13:06:18.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.780+0000 7f25f9644700 1 --2- 172.21.15.133:0/456449214 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f25d00553a0 0x7f25d0057860 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:18.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.780+0000 7f25f9644700 1 --2- 172.21.15.133:0/456449214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f25f413f250 0x7f25f4134b70 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:18.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.780+0000 7f25f9644700 1 --2- 172.21.15.133:0/456449214 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f25f405c840 0x7f25f4142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:18.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.780+0000 7f25f9644700 1 --2- 172.21.15.133:0/456449214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25f40afa70 0x7f25f4135c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:18.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.780+0000 7f25f9644700 1 -- 172.21.15.133:0/456449214 >> 172.21.15.133:0/456449214 conn(0x7f25f406aeb0 msgr2=0x7f25f4138190 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:18.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.780+0000 7f25f9644700 1 -- 172.21.15.133:0/456449214 shutdown_connections 2021-01-03T13:06:18.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.780+0000 7f25f9644700 1 -- 172.21.15.133:0/456449214 wait complete. 2021-01-03T13:06:18.789 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blacklist entries 2021-01-03T13:06:18.801 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-01-03T13:06:18.802 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-01-03T13:06:18.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc44d379700 1 Processor -- start 2021-01-03T13:06:18.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc44d379700 1 -- start start 2021-01-03T13:06:18.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc44d379700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4480b5c00 0x7fc4480b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:18.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc44d379700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc448060da0 con 0x7fc4480b0c90 2021-01-03T13:06:18.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc44d379700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4480b0ad0 con 0x7fc4480b52c0 2021-01-03T13:06:18.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc44d379700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc448067a90 con 0x7fc4480b5c00 2021-01-03T13:06:18.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc447fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc4480b52c0 0x7fc448098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59392/0 (socket says 172.21.15.133:59392) 2021-01-03T13:06:18.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc447fff700 1 -- 172.21.15.133:0/1397430843 learned_addr learned my addr 172.21.15.133:0/1397430843 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:18.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc44cb78700 1 --2- 172.21.15.133:0/1397430843 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4480b5c00 0x7fc4480b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:18.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 -- 172.21.15.133:0/1397430843 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072463423 0 0) 0x7fc4380010d0 con 0x7fc4480b52c0 2021-01-03T13:06:18.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 -- 172.21.15.133:0/1397430843 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc434003230 con 0x7fc4480b52c0 2021-01-03T13:06:18.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 -- 172.21.15.133:0/1397430843 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2537466023 0 0) 0x7fc434003230 con 0x7fc4480b52c0 2021-01-03T13:06:18.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 -- 172.21.15.133:0/1397430843 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4480b5c00 msgr2=0x7fc4480b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:18.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 --2- 172.21.15.133:0/1397430843 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4480b5c00 0x7fc4480b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:18.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 -- 172.21.15.133:0/1397430843 >> v1:172.21.15.16:6789/0 conn(0x7fc4480b0c90 legacy=0x7fc448143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:18.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 -- 172.21.15.133:0/1397430843 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4480b56a0 con 0x7fc4480b52c0 2021-01-03T13:06:18.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 -- 172.21.15.133:0/1397430843 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fc438001860 con 0x7fc4480b52c0 2021-01-03T13:06:18.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 -- 172.21.15.133:0/1397430843 >> v1:172.21.15.133:6789/0 conn(0x7fc4480b52c0 legacy=0x7fc448098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:18.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 --2- 172.21.15.133:0/1397430843 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4480b5c00 0x7fc434003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:18.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 --2- 172.21.15.133:0/1397430843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc434003c10 0x7fc4340044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:18.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 --2- 172.21.15.133:0/1397430843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4340049c0 0x7fc434004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:18.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 -- 172.21.15.133:0/1397430843 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc448067a90 con 0x7fc434003c10 2021-01-03T13:06:18.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 -- 172.21.15.133:0/1397430843 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc434004130 con 0x7fc4340049c0 2021-01-03T13:06:18.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 -- 172.21.15.133:0/1397430843 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4340042f0 con 0x7fc4480b5c00 2021-01-03T13:06:18.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc447fff700 1 --2- 172.21.15.133:0/1397430843 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4480b5c00 0x7fc434003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc44cb78700 1 --2- 172.21.15.133:0/1397430843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4340049c0 0x7fc434004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc4477fe700 1 --2- 172.21.15.133:0/1397430843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc434003c10 0x7fc4340044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc44cb78700 1 -- 172.21.15.133:0/1397430843 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4480b5c00 msgr2=0x7fc434003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc44cb78700 1 --2- 172.21.15.133:0/1397430843 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4480b5c00 0x7fc434003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc44cb78700 1 -- 172.21.15.133:0/1397430843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc434003c10 msgr2=0x7fc4340044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:18.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc44cb78700 1 --2- 172.21.15.133:0/1397430843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc434003c10 0x7fc4340044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:18.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc44cb78700 1 -- 172.21.15.133:0/1397430843 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc434003230 con 0x7fc4340049c0 2021-01-03T13:06:18.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc44cb78700 1 --2- 172.21.15.133:0/1397430843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4340049c0 0x7fc434004e40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7fc44000c000 tx=0x7fc4400091a0).ready entity=mon.1 client_cookie=ee312eb005209da server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:18.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 -- 172.21.15.133:0/1397430843 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc44000eb80 con 0x7fc4340049c0 2021-01-03T13:06:18.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 -- 172.21.15.133:0/1397430843 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44000ece0 con 0x7fc4340049c0 2021-01-03T13:06:18.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc446ffd700 1 -- 172.21.15.133:0/1397430843 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4400125e0 con 0x7fc4340049c0 2021-01-03T13:06:18.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc44d379700 1 -- 172.21.15.133:0/1397430843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4340049c0 msgr2=0x7fc434004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:18.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc44d379700 1 --2- 172.21.15.133:0/1397430843 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4340049c0 0x7fc434004e40 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7fc44000c000 tx=0x7fc4400091a0).stop 2021-01-03T13:06:18.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.912+0000 7fc44cb78700 1 -- 172.21.15.133:0/1397430843 reap_dead start 2021-01-03T13:06:18.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.916+0000 7fc44d379700 1 -- 172.21.15.133:0/1397430843 shutdown_connections 2021-01-03T13:06:18.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.916+0000 7fc44d379700 1 -- 172.21.15.133:0/1397430843 >> 172.21.15.133:0/1397430843 conn(0x7fc44805bdf0 msgr2=0x7fc44805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:18.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.916+0000 7fc44d379700 1 -- 172.21.15.133:0/1397430843 shutdown_connections 2021-01-03T13:06:18.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.916+0000 7fc44d379700 1 -- 172.21.15.133:0/1397430843 wait complete. 2021-01-03T13:06:18.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.916+0000 7fc44d379700 1 Processor -- start 2021-01-03T13:06:18.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.916+0000 7fc44d379700 1 -- start start 2021-01-03T13:06:18.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.916+0000 7fc44d379700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4480aeb60 0x7fc448066c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:18.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.916+0000 7fc44d379700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4481599e0 0x7fc448159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:18.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.916+0000 7fc44d379700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4480644b0 0x7fc448064960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:18.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.916+0000 7fc44d379700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4480659a0 con 0x7fc4481599e0 2021-01-03T13:06:18.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.916+0000 7fc44d379700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44815a350 con 0x7fc4480644b0 2021-01-03T13:06:18.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.916+0000 7fc44d379700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc448063540 con 0x7fc4480aeb60 2021-01-03T13:06:18.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.920+0000 7fc44cb78700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4480644b0 0x7fc448064960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:18.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.920+0000 7fc447fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4480aeb60 0x7fc448066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:18.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.920+0000 7fc44cb78700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4480644b0 0x7fc448064960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38376/0 (socket says 172.21.15.133:38376) 2021-01-03T13:06:18.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.920+0000 7fc447fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4480aeb60 0x7fc448066c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:46674/0 (socket says 172.21.15.133:46674) 2021-01-03T13:06:18.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.920+0000 7fc44cb78700 1 -- 172.21.15.133:0/1844862947 learned_addr learned my addr 172.21.15.133:0/1844862947 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:18.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.920+0000 7fc4477fe700 1 --2- 172.21.15.133:0/1844862947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4481599e0 0x7fc448159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:18.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.920+0000 7fc44cb78700 1 -- 172.21.15.133:0/1844862947 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4480aeb60 msgr2=0x7fc448066c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:18.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.920+0000 7fc44cb78700 1 --2- 172.21.15.133:0/1844862947 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4480aeb60 0x7fc448066c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:18.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.920+0000 7fc44cb78700 1 -- 172.21.15.133:0/1844862947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4481599e0 msgr2=0x7fc448159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:18.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.920+0000 7fc44cb78700 1 --2- 172.21.15.133:0/1844862947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4481599e0 0x7fc448159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:18.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.920+0000 7fc44cb78700 1 -- 172.21.15.133:0/1844862947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc448063cb0 con 0x7fc4480644b0 2021-01-03T13:06:18.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.920+0000 7fc44cb78700 1 --2- 172.21.15.133:0/1844862947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4480644b0 0x7fc448064960 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fc4481598c0 tx=0x7fc44001a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:18.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.920+0000 7fc4457fa700 1 -- 172.21.15.133:0/1844862947 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4400127f0 con 0x7fc4480644b0 2021-01-03T13:06:18.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.920+0000 7fc4457fa700 1 -- 172.21.15.133:0/1844862947 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4400095c0 con 0x7fc4480644b0 2021-01-03T13:06:18.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.920+0000 7fc44d379700 1 -- 172.21.15.133:0/1844862947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc448064e50 con 0x7fc4480644b0 2021-01-03T13:06:18.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.920+0000 7fc4457fa700 1 -- 172.21.15.133:0/1844862947 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc440012b40 con 0x7fc4480644b0 2021-01-03T13:06:18.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.920+0000 7fc44d379700 1 -- 172.21.15.133:0/1844862947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc448063a10 con 0x7fc4480644b0 2021-01-03T13:06:18.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.924+0000 7fc4457fa700 1 -- 172.21.15.133:0/1844862947 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc440012ca0 con 0x7fc4480644b0 2021-01-03T13:06:18.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.924+0000 7fc44d379700 1 -- 172.21.15.133:0/1844862947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc448057300 con 0x7fc4480644b0 2021-01-03T13:06:18.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.924+0000 7fc4457fa700 1 --2- 172.21.15.133:0/1844862947 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc428055440 0x7fc428057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:18.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.924+0000 7fc4457fa700 1 -- 172.21.15.133:0/1844862947 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc440002020 con 0x7fc4480644b0 2021-01-03T13:06:18.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.924+0000 7fc447fff700 1 --2- 172.21.15.133:0/1844862947 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc428055440 0x7fc428057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:18.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.924+0000 7fc447fff700 1 --2- 172.21.15.133:0/1844862947 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc428055440 0x7fc428057900 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fc438005000 tx=0x7fc4480b0070).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:18.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:18.928+0000 7fc4457fa700 1 -- 172.21.15.133:0/1844862947 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc440045560 con 0x7fc4480644b0 2021-01-03T13:06:19.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.120+0000 7fc44d379700 1 -- 172.21.15.133:0/1844862947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc448064e50 con 0x7fc4480644b0 2021-01-03T13:06:19.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.124+0000 7fc4457fa700 1 -- 172.21.15.133:0/1844862947 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fc448064e50 con 0x7fc4480644b0 2021-01-03T13:06:19.129 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:19.129 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:06:19.129 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2021-01-03T13:06:19.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:19.130 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2021-01-03T13:06:19.130 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Fflox9BxAA6coLDFV/FaQ/G/cvtonWgg==", 2021-01-03T13:06:19.130 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:19.130 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:06:19.131 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:19.131 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:19.131 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:19.131 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:19.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:19.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:19.132 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2021-01-03T13:06:19.132 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfrnWWFRAA3PHH/FJOvDozCChrb1T8Dg==", 2021-01-03T13:06:19.132 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:19.132 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:06:19.133 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:19.133 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:19.133 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:19.134 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:19.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:19.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:19.135 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2021-01-03T13:06:19.135 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfpPPLDxAAVvg80vLejYKDH485/L1gSQ==", 2021-01-03T13:06:19.135 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:19.135 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:06:19.136 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:19.136 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:19.136 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:19.136 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:19.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:19.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:19.137 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2021-01-03T13:06:19.137 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAnv/FfQ+CcDRAAUkTDLby5scMkNzxa0lVdAQ==", 2021-01-03T13:06:19.137 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:19.137 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:19.138 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:19.138 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:19.138 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:19.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:19.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:19.139 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2021-01-03T13:06:19.139 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApv/Ff1iilLhAAbK9hZmL772nNKAEJ4i+pkw==", 2021-01-03T13:06:19.139 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:19.139 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:19.139 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:19.140 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:19.140 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:19.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:19.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:19.140 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2021-01-03T13:06:19.141 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAsv/Ffmoe2FhAA1EbxU5yHncN+pbC/EX6d9A==", 2021-01-03T13:06:19.141 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:19.141 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:19.141 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:19.141 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:19.142 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:19.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:19.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:19.142 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2021-01-03T13:06:19.142 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAuv/FfJh/VORAAG9aCOh5s/2Lw+yN9hBFWLw==", 2021-01-03T13:06:19.143 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:19.143 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:19.143 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:19.143 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:19.143 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:19.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:19.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:19.144 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2021-01-03T13:06:19.144 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyv/Ffus0NJhAALX1TIqQ9EIupaX8KtRu7rQ==", 2021-01-03T13:06:19.144 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:19.145 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:19.145 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:19.145 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:19.145 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:19.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:19.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:19.146 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2021-01-03T13:06:19.146 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1v/FfoL6kDBAAggoRy/o0qas/41yLYqDVgA==", 2021-01-03T13:06:19.146 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:19.146 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:19.147 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:19.147 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:19.147 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:19.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:19.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:19.148 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2021-01-03T13:06:19.148 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA3v/FfwOPCMBAAGOt8ShPQ/szNbCfaP/uZEQ==", 2021-01-03T13:06:19.148 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:19.148 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:19.148 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:19.149 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:19.149 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:19.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:19.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:19.149 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2021-01-03T13:06:19.150 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA6v/Ffoz5xFxAAn3xvUDSeNSWrBJTa1Nsb6w==", 2021-01-03T13:06:19.150 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:19.150 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:19.150 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:19.150 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:19.151 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:19.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:19.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:19.151 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2021-01-03T13:06:19.151 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfyGlbGxAALm0NezvPiTAnlwu8iPEuCw==", 2021-01-03T13:06:19.152 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:19.152 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:06:19.152 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:06:19.152 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:06:19.152 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:19.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:19.153 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:19.153 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2021-01-03T13:06:19.153 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Ffa2AFHhAAD4Pq5zMJ28SqqEosBA9vnQ==", 2021-01-03T13:06:19.153 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:19.154 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:06:19.154 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:06:19.154 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:06:19.154 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:19.154 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:19.155 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:19.155 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2021-01-03T13:06:19.155 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjv/FfjxN8JxAAkV2Ia66fh21QYMX5fr1gTw==", 2021-01-03T13:06:19.155 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:19.155 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:06:19.156 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:19.156 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:19.156 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:19.156 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:19.156 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:19.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:19.157 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2021-01-03T13:06:19.157 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAU/DBBAASi+hx05pZEsP+dV9iwbz4g==", 2021-01-03T13:06:19.157 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:19.157 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:06:19.158 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:06:19.158 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:19.158 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:19.158 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:19.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:19.159 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2021-01-03T13:06:19.159 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAOFAAhAAPQOSkofyJoEYvcAqKK2+Mg==", 2021-01-03T13:06:19.159 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:19.159 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:06:19.159 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:06:19.160 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:19.160 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:19.160 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:19.160 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:19.160 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:06:19.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.124+0000 7fc44d379700 1 -- 172.21.15.133:0/1844862947 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc428055440 msgr2=0x7fc428057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.124+0000 7fc44d379700 1 --2- 172.21.15.133:0/1844862947 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc428055440 0x7fc428057900 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fc438005000 tx=0x7fc4480b0070).stop 2021-01-03T13:06:19.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.124+0000 7fc44d379700 1 -- 172.21.15.133:0/1844862947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4480644b0 msgr2=0x7fc448064960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.124+0000 7fc44d379700 1 --2- 172.21.15.133:0/1844862947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4480644b0 0x7fc448064960 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7fc4481598c0 tx=0x7fc44001a000).stop 2021-01-03T13:06:19.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.124+0000 7fc44d379700 1 -- 172.21.15.133:0/1844862947 shutdown_connections 2021-01-03T13:06:19.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.124+0000 7fc44d379700 1 --2- 172.21.15.133:0/1844862947 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc428055440 0x7fc428057900 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.124+0000 7fc44d379700 1 --2- 172.21.15.133:0/1844862947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4480644b0 0x7fc448064960 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.124+0000 7fc44d379700 1 --2- 172.21.15.133:0/1844862947 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc4480aeb60 0x7fc448066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.124+0000 7fc44d379700 1 --2- 172.21.15.133:0/1844862947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc4481599e0 0x7fc448159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.124+0000 7fc44d379700 1 -- 172.21.15.133:0/1844862947 >> 172.21.15.133:0/1844862947 conn(0x7fc44805bdf0 msgr2=0x7fc448144f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:19.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.124+0000 7fc44d379700 1 -- 172.21.15.133:0/1844862947 shutdown_connections 2021-01-03T13:06:19.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.124+0000 7fc44d379700 1 -- 172.21.15.133:0/1844862947 wait complete. 2021-01-03T13:06:19.165 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:06:19.278 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.272+0000 7fd57759e700 1 Processor -- start 2021-01-03T13:06:19.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.272+0000 7fd57759e700 1 -- start start 2021-01-03T13:06:19.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.272+0000 7fd57759e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5780b5ae0 0x7fd5780abd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:19.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.272+0000 7fd57759e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd578099ff0 0x7fd57813fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:19.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.272+0000 7fd57759e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5780b5710 con 0x7fd5780b5330 2021-01-03T13:06:19.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.272+0000 7fd57759e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5780b10f0 con 0x7fd578099ff0 2021-01-03T13:06:19.281 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.272+0000 7fd57759e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5780ac270 con 0x7fd5780b5ae0 2021-01-03T13:06:19.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.272+0000 7fd576d9d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd578099ff0 0x7fd57813fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:19.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.272+0000 7fd575d9b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5780b5ae0 0x7fd5780abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:19.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.272+0000 7fd57659c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd5780b5330 0x7fd578142c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:38140/0 (socket says 172.21.15.133:38140) 2021-01-03T13:06:19.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.272+0000 7fd57659c700 1 -- 172.21.15.133:0/304429291 learned_addr learned my addr 172.21.15.133:0/304429291 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:19.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.272+0000 7fd575d9b700 1 -- 172.21.15.133:0/304429291 >> v2:172.21.15.16:3300/0 conn(0x7fd578099ff0 msgr2=0x7fd57813fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:19.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.272+0000 7fd575d9b700 1 --2- 172.21.15.133:0/304429291 >> v2:172.21.15.16:3300/0 conn(0x7fd578099ff0 0x7fd57813fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.272+0000 7fd575d9b700 1 -- 172.21.15.133:0/304429291 >> v1:172.21.15.16:6789/0 conn(0x7fd5780b5330 legacy=0x7fd578142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.272+0000 7fd575d9b700 1 -- 172.21.15.133:0/304429291 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5780ab280 con 0x7fd5780b5ae0 2021-01-03T13:06:19.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.272+0000 7fd575d9b700 1 --2- 172.21.15.133:0/304429291 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5780b5ae0 0x7fd5780abd80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fd5680032b0 tx=0x7fd5680091a0).ready entity=mon.2 client_cookie=8d84452f17a5694a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:19.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57559a700 1 -- 172.21.15.133:0/304429291 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd56800b9a0 con 0x7fd5780b5ae0 2021-01-03T13:06:19.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57559a700 1 -- 172.21.15.133:0/304429291 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56800bb00 con 0x7fd5780b5ae0 2021-01-03T13:06:19.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57559a700 1 -- 172.21.15.133:0/304429291 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd56800bc70 con 0x7fd5780b5ae0 2021-01-03T13:06:19.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57759e700 1 -- 172.21.15.133:0/304429291 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5780b5ae0 msgr2=0x7fd5780abd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57759e700 1 --2- 172.21.15.133:0/304429291 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5780b5ae0 0x7fd5780abd80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fd5680032b0 tx=0x7fd5680091a0).stop 2021-01-03T13:06:19.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57759e700 1 -- 172.21.15.133:0/304429291 shutdown_connections 2021-01-03T13:06:19.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57759e700 1 --2- 172.21.15.133:0/304429291 >> v2:172.21.15.16:3300/0 conn(0x7fd578099ff0 0x7fd57813fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57759e700 1 --2- 172.21.15.133:0/304429291 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd5780b5ae0 0x7fd5780abd80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57759e700 1 -- 172.21.15.133:0/304429291 >> 172.21.15.133:0/304429291 conn(0x7fd57805bdf0 msgr2=0x7fd57805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:19.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57759e700 1 -- 172.21.15.133:0/304429291 shutdown_connections 2021-01-03T13:06:19.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57759e700 1 -- 172.21.15.133:0/304429291 wait complete. 2021-01-03T13:06:19.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57759e700 1 Processor -- start 2021-01-03T13:06:19.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57759e700 1 -- start start 2021-01-03T13:06:19.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57759e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd578099ff0 0x7fd57813ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:19.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57759e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5780b5330 0x7fd5781423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:19.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5780b5ae0 0x7fd5780ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:19.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57759e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5781397f0 con 0x7fd5780b5330 2021-01-03T13:06:19.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5780ae4f0 con 0x7fd5780b5ae0 2021-01-03T13:06:19.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57759e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5780adbd0 con 0x7fd578099ff0 2021-01-03T13:06:19.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd576d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5780b5ae0 0x7fd5780ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:19.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd575d9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5780b5330 0x7fd5781423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:19.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd576d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5780b5ae0 0x7fd5780ae700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38390/0 (socket says 172.21.15.133:38390) 2021-01-03T13:06:19.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd57659c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd578099ff0 0x7fd57813ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:19.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.276+0000 7fd576d9d700 1 -- 172.21.15.133:0/2052151068 learned_addr learned my addr 172.21.15.133:0/2052151068 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:19.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.280+0000 7fd576d9d700 1 -- 172.21.15.133:0/2052151068 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd578099ff0 msgr2=0x7fd57813ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.280+0000 7fd576d9d700 1 --2- 172.21.15.133:0/2052151068 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd578099ff0 0x7fd57813ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.280+0000 7fd576d9d700 1 -- 172.21.15.133:0/2052151068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5780b5330 msgr2=0x7fd5781423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.280+0000 7fd576d9d700 1 --2- 172.21.15.133:0/2052151068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5780b5330 0x7fd5781423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.280+0000 7fd576d9d700 1 -- 172.21.15.133:0/2052151068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd578142f20 con 0x7fd5780b5ae0 2021-01-03T13:06:19.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.280+0000 7fd575d9b700 1 --2- 172.21.15.133:0/2052151068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5780b5330 0x7fd5781423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:06:19.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.280+0000 7fd576d9d700 1 --2- 172.21.15.133:0/2052151068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5780b5ae0 0x7fd5780ae700 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fd570006a50 tx=0x7fd570006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:19.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.280+0000 7fd56f7fe700 1 -- 172.21.15.133:0/2052151068 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd57000ca10 con 0x7fd5780b5ae0 2021-01-03T13:06:19.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.280+0000 7fd56f7fe700 1 -- 172.21.15.133:0/2052151068 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57000be90 con 0x7fd5780b5ae0 2021-01-03T13:06:19.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.280+0000 7fd57759e700 1 -- 172.21.15.133:0/2052151068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5781428d0 con 0x7fd5780b5ae0 2021-01-03T13:06:19.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.280+0000 7fd56f7fe700 1 -- 172.21.15.133:0/2052151068 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd57000cd60 con 0x7fd5780b5ae0 2021-01-03T13:06:19.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.280+0000 7fd57759e700 1 -- 172.21.15.133:0/2052151068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd57813b680 con 0x7fd5780b5ae0 2021-01-03T13:06:19.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.280+0000 7fd56f7fe700 1 -- 172.21.15.133:0/2052151068 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd57001c460 con 0x7fd5780b5ae0 2021-01-03T13:06:19.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.280+0000 7fd57759e700 1 -- 172.21.15.133:0/2052151068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd578057300 con 0x7fd5780b5ae0 2021-01-03T13:06:19.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.280+0000 7fd56f7fe700 1 --2- 172.21.15.133:0/2052151068 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd55c0554e0 0x7fd55c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:19.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.284+0000 7fd56f7fe700 1 -- 172.21.15.133:0/2052151068 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd57006dff0 con 0x7fd5780b5ae0 2021-01-03T13:06:19.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.284+0000 7fd57659c700 1 --2- 172.21.15.133:0/2052151068 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd55c0554e0 0x7fd55c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:19.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.284+0000 7fd57659c700 1 --2- 172.21.15.133:0/2052151068 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd55c0554e0 0x7fd55c0579a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fd56000d000 tx=0x7fd560009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:19.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.288+0000 7fd56f7fe700 1 -- 172.21.15.133:0/2052151068 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd5700445c0 con 0x7fd5780b5ae0 2021-01-03T13:06:19.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.428+0000 7fd57759e700 1 -- 172.21.15.133:0/2052151068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd57805ce00 con 0x7fd5780b5ae0 2021-01-03T13:06:19.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.428+0000 7fd56f7fe700 1 -- 172.21.15.133:0/2052151068 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+13239 (secure 0 0 0) 0x7fd570047be0 con 0x7fd5780b5ae0 2021-01-03T13:06:19.436 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:19.437 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":119,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:06:18.774032+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:06:19.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.432+0000 7fd57759e700 1 -- 172.21.15.133:0/2052151068 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd55c0554e0 msgr2=0x7fd55c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.432+0000 7fd57759e700 1 --2- 172.21.15.133:0/2052151068 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd55c0554e0 0x7fd55c0579a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fd56000d000 tx=0x7fd560009040).stop 2021-01-03T13:06:19.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.432+0000 7fd57759e700 1 -- 172.21.15.133:0/2052151068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5780b5ae0 msgr2=0x7fd5780ae700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.432+0000 7fd57759e700 1 --2- 172.21.15.133:0/2052151068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5780b5ae0 0x7fd5780ae700 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7fd570006a50 tx=0x7fd570006dc0).stop 2021-01-03T13:06:19.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.432+0000 7fd57759e700 1 -- 172.21.15.133:0/2052151068 shutdown_connections 2021-01-03T13:06:19.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.432+0000 7fd57759e700 1 --2- 172.21.15.133:0/2052151068 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd55c0554e0 0x7fd55c0579a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.432+0000 7fd57759e700 1 --2- 172.21.15.133:0/2052151068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5780b5ae0 0x7fd5780ae700 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.432+0000 7fd57759e700 1 --2- 172.21.15.133:0/2052151068 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd578099ff0 0x7fd57813ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.432+0000 7fd57759e700 1 --2- 172.21.15.133:0/2052151068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd5780b5330 0x7fd5781423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.432+0000 7fd57759e700 1 -- 172.21.15.133:0/2052151068 >> 172.21.15.133:0/2052151068 conn(0x7fd57805bdf0 msgr2=0x7fd57813f200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:19.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.432+0000 7fd57759e700 1 -- 172.21.15.133:0/2052151068 shutdown_connections 2021-01-03T13:06:19.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.432+0000 7fd57759e700 1 -- 172.21.15.133:0/2052151068 wait complete. 2021-01-03T13:06:19.455 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-01-03T13:06:19.456 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:06:19.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.568+0000 7ffbdcb44700 1 Processor -- start 2021-01-03T13:06:19.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.568+0000 7ffbdcb44700 1 -- start start 2021-01-03T13:06:19.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbdcb44700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffbd80b2750 0x7ffbd805fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:19.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbdcb44700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd80afe70 con 0x7ffbd8066f70 2021-01-03T13:06:19.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbdcb44700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd8060310 con 0x7ffbd8067350 2021-01-03T13:06:19.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbdcb44700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd80605a0 con 0x7ffbd80b2750 2021-01-03T13:06:19.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbd6ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ffbd8067350 0x7ffbd8144260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59428/0 (socket says 172.21.15.133:59428) 2021-01-03T13:06:19.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbd7fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ffbd80b2750 0x7ffbd805fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:19.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbd6ffd700 1 -- 172.21.15.133:0/1684899773 learned_addr learned my addr 172.21.15.133:0/1684899773 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:19.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbd67fc700 1 -- 172.21.15.133:0/1684899773 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289458616 0 0) 0x7ffbd8060310 con 0x7ffbd8067350 2021-01-03T13:06:19.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbd67fc700 1 -- 172.21.15.133:0/1684899773 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbb8003230 con 0x7ffbd8067350 2021-01-03T13:06:19.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbd7fff700 1 -- 172.21.15.133:0/1684899773 >> v1:172.21.15.133:6789/0 conn(0x7ffbd8067350 legacy=0x7ffbd8144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbd7fff700 1 -- 172.21.15.133:0/1684899773 >> v1:172.21.15.16:6789/0 conn(0x7ffbd8066f70 legacy=0x7ffbd80af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbd7fff700 1 -- 172.21.15.133:0/1684899773 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd80b0b50 con 0x7ffbd80b2750 2021-01-03T13:06:19.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbd7fff700 1 --2- 172.21.15.133:0/1684899773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbd80b2750 0x7ffbd805fe20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7ffbd00032b0 tx=0x7ffbd00091a0).ready entity=mon.0 client_cookie=cb5ba78caf3eb532 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:19.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbd67fc700 1 -- 172.21.15.133:0/1684899773 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbd000b9a0 con 0x7ffbd80b2750 2021-01-03T13:06:19.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbd67fc700 1 -- 172.21.15.133:0/1684899773 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd000bb00 con 0x7ffbd80b2750 2021-01-03T13:06:19.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbd67fc700 1 -- 172.21.15.133:0/1684899773 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbd000bc70 con 0x7ffbd80b2750 2021-01-03T13:06:19.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbdcb44700 1 -- 172.21.15.133:0/1684899773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbd80b2750 msgr2=0x7ffbd805fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbdcb44700 1 --2- 172.21.15.133:0/1684899773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbd80b2750 0x7ffbd805fe20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7ffbd00032b0 tx=0x7ffbd00091a0).stop 2021-01-03T13:06:19.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbdcb44700 1 -- 172.21.15.133:0/1684899773 shutdown_connections 2021-01-03T13:06:19.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbdcb44700 1 --2- 172.21.15.133:0/1684899773 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbd80b2750 0x7ffbd805fe20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbdcb44700 1 -- 172.21.15.133:0/1684899773 >> 172.21.15.133:0/1684899773 conn(0x7ffbd80b6110 msgr2=0x7ffbd80b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:19.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbdcb44700 1 -- 172.21.15.133:0/1684899773 shutdown_connections 2021-01-03T13:06:19.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.572+0000 7ffbdcb44700 1 -- 172.21.15.133:0/1684899773 wait complete. 2021-01-03T13:06:19.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbdcb44700 1 Processor -- start 2021-01-03T13:06:19.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbdcb44700 1 -- start start 2021-01-03T13:06:19.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbdcb44700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffbd8066f70 0x7ffbd8153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:19.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbdcb44700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbd8067350 0x7ffbd8153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:19.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbdcb44700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbd80b2750 0x7ffbd8064800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:19.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbdcb44700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd80667d0 con 0x7ffbd8067350 2021-01-03T13:06:19.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbdcb44700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd81406c0 con 0x7ffbd80b2750 2021-01-03T13:06:19.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbdcb44700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd813ed60 con 0x7ffbd8066f70 2021-01-03T13:06:19.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbd7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbd80b2750 0x7ffbd8064800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:19.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbd7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbd80b2750 0x7ffbd8064800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38404/0 (socket says 172.21.15.133:38404) 2021-01-03T13:06:19.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbd7fff700 1 -- 172.21.15.133:0/1095052416 learned_addr learned my addr 172.21.15.133:0/1095052416 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:19.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbd77fe700 1 --2- 172.21.15.133:0/1095052416 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffbd8066f70 0x7ffbd8153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:19.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbd6ffd700 1 --2- 172.21.15.133:0/1095052416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbd8067350 0x7ffbd8153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:19.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbd7fff700 1 -- 172.21.15.133:0/1095052416 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffbd8066f70 msgr2=0x7ffbd8153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbd7fff700 1 --2- 172.21.15.133:0/1095052416 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffbd8066f70 0x7ffbd8153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbd7fff700 1 -- 172.21.15.133:0/1095052416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbd8067350 msgr2=0x7ffbd8153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbd7fff700 1 --2- 172.21.15.133:0/1095052416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbd8067350 0x7ffbd8153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbd7fff700 1 -- 172.21.15.133:0/1095052416 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd8140180 con 0x7ffbd80b2750 2021-01-03T13:06:19.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.576+0000 7ffbd77fe700 1 --2- 172.21.15.133:0/1095052416 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffbd8066f70 0x7ffbd8153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:06:19.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.580+0000 7ffbd7fff700 1 --2- 172.21.15.133:0/1095052416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbd80b2750 0x7ffbd8064800 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7ffbd00032b0 tx=0x7ffbd0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:19.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.580+0000 7ffbd4ff9700 1 -- 172.21.15.133:0/1095052416 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbd00205f0 con 0x7ffbd80b2750 2021-01-03T13:06:19.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.580+0000 7ffbd4ff9700 1 -- 172.21.15.133:0/1095052416 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd0020750 con 0x7ffbd80b2750 2021-01-03T13:06:19.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.580+0000 7ffbdcb44700 1 -- 172.21.15.133:0/1095052416 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd8140420 con 0x7ffbd80b2750 2021-01-03T13:06:19.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.580+0000 7ffbd4ff9700 1 -- 172.21.15.133:0/1095052416 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbd0020ab0 con 0x7ffbd80b2750 2021-01-03T13:06:19.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.580+0000 7ffbdcb44700 1 -- 172.21.15.133:0/1095052416 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd813f330 con 0x7ffbd80b2750 2021-01-03T13:06:19.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.580+0000 7ffbdcb44700 1 -- 172.21.15.133:0/1095052416 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd8057300 con 0x7ffbd80b2750 2021-01-03T13:06:19.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.580+0000 7ffbd4ff9700 1 -- 172.21.15.133:0/1095052416 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ffbd0027030 con 0x7ffbd80b2750 2021-01-03T13:06:19.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.584+0000 7ffbd4ff9700 1 --2- 172.21.15.133:0/1095052416 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ffbbc0553f0 0x7ffbbc0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:19.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.584+0000 7ffbd4ff9700 1 -- 172.21.15.133:0/1095052416 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ffbd006eff0 con 0x7ffbd80b2750 2021-01-03T13:06:19.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.584+0000 7ffbd77fe700 1 --2- 172.21.15.133:0/1095052416 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ffbbc0553f0 0x7ffbbc0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:19.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.584+0000 7ffbd77fe700 1 --2- 172.21.15.133:0/1095052416 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ffbbc0553f0 0x7ffbbc0578b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7ffbc000d000 tx=0x7ffbc0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:19.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.588+0000 7ffbd4ff9700 1 -- 172.21.15.133:0/1095052416 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ffbd0045510 con 0x7ffbd80b2750 2021-01-03T13:06:19.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.728+0000 7ffbdcb44700 1 -- 172.21.15.133:0/1095052416 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ffbd8061020 con 0x7ffbd80b2750 2021-01-03T13:06:19.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.728+0000 7ffbd4ff9700 1 -- 172.21.15.133:0/1095052416 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v119) v1 ==== 110+0+10 (secure 0 0 0) 0x7ffbd0015020 con 0x7ffbd80b2750 2021-01-03T13:06:19.736 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:06:19.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.732+0000 7ffbdcb44700 1 -- 172.21.15.133:0/1095052416 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ffbbc0553f0 msgr2=0x7ffbbc0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.732+0000 7ffbdcb44700 1 --2- 172.21.15.133:0/1095052416 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ffbbc0553f0 0x7ffbbc0578b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7ffbc000d000 tx=0x7ffbc0009040).stop 2021-01-03T13:06:19.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.732+0000 7ffbdcb44700 1 -- 172.21.15.133:0/1095052416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbd80b2750 msgr2=0x7ffbd8064800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.732+0000 7ffbdcb44700 1 --2- 172.21.15.133:0/1095052416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbd80b2750 0x7ffbd8064800 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7ffbd00032b0 tx=0x7ffbd0016000).stop 2021-01-03T13:06:19.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.732+0000 7ffbdcb44700 1 -- 172.21.15.133:0/1095052416 shutdown_connections 2021-01-03T13:06:19.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.732+0000 7ffbdcb44700 1 --2- 172.21.15.133:0/1095052416 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ffbbc0553f0 0x7ffbbc0578b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.732+0000 7ffbdcb44700 1 --2- 172.21.15.133:0/1095052416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ffbd80b2750 0x7ffbd8064800 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.732+0000 7ffbdcb44700 1 --2- 172.21.15.133:0/1095052416 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ffbd8066f70 0x7ffbd8153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.732+0000 7ffbdcb44700 1 --2- 172.21.15.133:0/1095052416 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbd8067350 0x7ffbd8153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.732+0000 7ffbdcb44700 1 -- 172.21.15.133:0/1095052416 >> 172.21.15.133:0/1095052416 conn(0x7ffbd80b6110 msgr2=0x7ffbd80b5940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:19.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.732+0000 7ffbdcb44700 1 -- 172.21.15.133:0/1095052416 shutdown_connections 2021-01-03T13:06:19.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.732+0000 7ffbdcb44700 1 -- 172.21.15.133:0/1095052416 wait complete. 2021-01-03T13:06:19.749 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:06:19.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.860+0000 7fc28d71d700 1 Processor -- start 2021-01-03T13:06:19.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.860+0000 7fc28d71d700 1 -- start start 2021-01-03T13:06:19.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc28d71d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc28805f920 0x7fc2880b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:19.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc28d71d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2880b1590 0x7fc28813ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:19.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc28d71d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc28805fd00 con 0x7fc288066f30 2021-01-03T13:06:19.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc28d71d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2880b2980 con 0x7fc28805f920 2021-01-03T13:06:19.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc28d71d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2880ae700 con 0x7fc2880b1590 2021-01-03T13:06:19.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc287fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc28805f920 0x7fc2880b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:19.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc28cf1c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2880b1590 0x7fc28813ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:19.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc2877fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc288066f30 0x7fc2880b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:38170/0 (socket says 172.21.15.133:38170) 2021-01-03T13:06:19.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc28cf1c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2880b1590 0x7fc28813ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:46714/0 (socket says 172.21.15.133:46714) 2021-01-03T13:06:19.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc287fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc28805f920 0x7fc2880b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:36948/0 (socket says 172.21.15.133:36948) 2021-01-03T13:06:19.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc28cf1c700 1 -- 172.21.15.133:0/1924237719 learned_addr learned my addr 172.21.15.133:0/1924237719 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:19.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc28cf1c700 1 -- 172.21.15.133:0/1924237719 >> v2:172.21.15.16:3300/0 conn(0x7fc28805f920 msgr2=0x7fc2880b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:19.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc28cf1c700 1 --2- 172.21.15.133:0/1924237719 >> v2:172.21.15.16:3300/0 conn(0x7fc28805f920 0x7fc2880b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc28cf1c700 1 -- 172.21.15.133:0/1924237719 >> v1:172.21.15.16:6789/0 conn(0x7fc288066f30 legacy=0x7fc2880b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc28cf1c700 1 -- 172.21.15.133:0/1924237719 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880accd0 con 0x7fc2880b1590 2021-01-03T13:06:19.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc28cf1c700 1 --2- 172.21.15.133:0/1924237719 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2880b1590 0x7fc28813ff80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc280002f30 tx=0x7fc280006e80).ready entity=mon.2 client_cookie=a23a26b2269ef90c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:19.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc286ffd700 1 -- 172.21.15.133:0/1924237719 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2800097f0 con 0x7fc2880b1590 2021-01-03T13:06:19.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc286ffd700 1 -- 172.21.15.133:0/1924237719 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc280009950 con 0x7fc2880b1590 2021-01-03T13:06:19.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc286ffd700 1 -- 172.21.15.133:0/1924237719 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc280009cb0 con 0x7fc2880b1590 2021-01-03T13:06:19.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc28d71d700 1 -- 172.21.15.133:0/1924237719 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2880b1590 msgr2=0x7fc28813ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.864+0000 7fc28d71d700 1 --2- 172.21.15.133:0/1924237719 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2880b1590 0x7fc28813ff80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc280002f30 tx=0x7fc280006e80).stop 2021-01-03T13:06:19.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc28d71d700 1 -- 172.21.15.133:0/1924237719 shutdown_connections 2021-01-03T13:06:19.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc28d71d700 1 --2- 172.21.15.133:0/1924237719 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2880b1590 0x7fc28813ff80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc28d71d700 1 --2- 172.21.15.133:0/1924237719 >> v2:172.21.15.16:3300/0 conn(0x7fc28805f920 0x7fc2880b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc28d71d700 1 -- 172.21.15.133:0/1924237719 >> 172.21.15.133:0/1924237719 conn(0x7fc2880b6110 msgr2=0x7fc2880b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:19.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc28d71d700 1 -- 172.21.15.133:0/1924237719 shutdown_connections 2021-01-03T13:06:19.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc28d71d700 1 -- 172.21.15.133:0/1924237719 wait complete. 2021-01-03T13:06:19.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc28d71d700 1 Processor -- start 2021-01-03T13:06:19.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc28d71d700 1 -- start start 2021-01-03T13:06:19.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc28d71d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc28805f920 0x7fc288141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:19.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc28d71d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc288066f30 0x7fc288146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:19.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc28d71d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2880b1590 0x7fc288146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:19.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc28d71d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc288145af0 con 0x7fc288066f30 2021-01-03T13:06:19.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc28d71d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc288147120 con 0x7fc28805f920 2021-01-03T13:06:19.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc28d71d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2881447f0 con 0x7fc2880b1590 2021-01-03T13:06:19.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc287fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc28805f920 0x7fc288141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:19.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc287fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc28805f920 0x7fc288141c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38414/0 (socket says 172.21.15.133:38414) 2021-01-03T13:06:19.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc287fff700 1 -- 172.21.15.133:0/286947123 learned_addr learned my addr 172.21.15.133:0/286947123 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:19.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc2877fe700 1 --2- 172.21.15.133:0/286947123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc288066f30 0x7fc288146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:19.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.868+0000 7fc28cf1c700 1 --2- 172.21.15.133:0/286947123 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2880b1590 0x7fc288146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:19.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc287fff700 1 -- 172.21.15.133:0/286947123 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2880b1590 msgr2=0x7fc288146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc287fff700 1 --2- 172.21.15.133:0/286947123 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2880b1590 0x7fc288146c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc287fff700 1 -- 172.21.15.133:0/286947123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc288066f30 msgr2=0x7fc288146740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:19.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc287fff700 1 --2- 172.21.15.133:0/286947123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc288066f30 0x7fc288146740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:19.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc287fff700 1 -- 172.21.15.133:0/286947123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc288144a20 con 0x7fc28805f920 2021-01-03T13:06:19.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc28cf1c700 1 --2- 172.21.15.133:0/286947123 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2880b1590 0x7fc288146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:19.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc287fff700 1 --2- 172.21.15.133:0/286947123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc28805f920 0x7fc288141c70 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7fc288147260 tx=0x7fc2780091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:19.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc2857fa700 1 -- 172.21.15.133:0/286947123 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc27800cb30 con 0x7fc28805f920 2021-01-03T13:06:19.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc2857fa700 1 -- 172.21.15.133:0/286947123 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27800cc90 con 0x7fc28805f920 2021-01-03T13:06:19.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc28d71d700 1 -- 172.21.15.133:0/286947123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc288144cc0 con 0x7fc28805f920 2021-01-03T13:06:19.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc2857fa700 1 -- 172.21.15.133:0/286947123 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2780123f0 con 0x7fc28805f920 2021-01-03T13:06:19.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc28d71d700 1 -- 172.21.15.133:0/286947123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc288151f10 con 0x7fc28805f920 2021-01-03T13:06:19.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc28d71d700 1 -- 172.21.15.133:0/286947123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc288057300 con 0x7fc28805f920 2021-01-03T13:06:19.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc2857fa700 1 -- 172.21.15.133:0/286947123 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc278022070 con 0x7fc28805f920 2021-01-03T13:06:19.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc2857fa700 1 --2- 172.21.15.133:0/286947123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc268055500 0x7fc2680579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:19.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc2857fa700 1 -- 172.21.15.133:0/286947123 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc27806e2f0 con 0x7fc28805f920 2021-01-03T13:06:19.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc2877fe700 1 --2- 172.21.15.133:0/286947123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc268055500 0x7fc2680579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:19.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.872+0000 7fc2877fe700 1 --2- 172.21.15.133:0/286947123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc268055500 0x7fc2680579c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fc27c00d000 tx=0x7fc27c007b10).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:19.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:19.880+0000 7fc2857fa700 1 -- 172.21.15.133:0/286947123 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc278044920 con 0x7fc28805f920 2021-01-03T13:06:20.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.020+0000 7fc28d71d700 1 -- 172.21.15.133:0/286947123 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc288061020 con 0x7fc28805f920 2021-01-03T13:06:20.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.020+0000 7fc2857fa700 1 -- 172.21.15.133:0/286947123 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v119) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc278047f40 con 0x7fc28805f920 2021-01-03T13:06:20.027 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:06:20.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.024+0000 7fc28d71d700 1 -- 172.21.15.133:0/286947123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc268055500 msgr2=0x7fc2680579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:20.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.024+0000 7fc28d71d700 1 --2- 172.21.15.133:0/286947123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc268055500 0x7fc2680579c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7fc27c00d000 tx=0x7fc27c007b10).stop 2021-01-03T13:06:20.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.024+0000 7fc28d71d700 1 -- 172.21.15.133:0/286947123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc28805f920 msgr2=0x7fc288141c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:20.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.024+0000 7fc28d71d700 1 --2- 172.21.15.133:0/286947123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc28805f920 0x7fc288141c70 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7fc288147260 tx=0x7fc2780091a0).stop 2021-01-03T13:06:20.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.024+0000 7fc28d71d700 1 -- 172.21.15.133:0/286947123 shutdown_connections 2021-01-03T13:06:20.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.024+0000 7fc28d71d700 1 --2- 172.21.15.133:0/286947123 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc268055500 0x7fc2680579c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.024+0000 7fc28d71d700 1 --2- 172.21.15.133:0/286947123 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc2880b1590 0x7fc288146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.024+0000 7fc28d71d700 1 --2- 172.21.15.133:0/286947123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc28805f920 0x7fc288141c70 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.024+0000 7fc28d71d700 1 --2- 172.21.15.133:0/286947123 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc288066f30 0x7fc288146740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.024+0000 7fc28d71d700 1 -- 172.21.15.133:0/286947123 >> 172.21.15.133:0/286947123 conn(0x7fc2880b6110 msgr2=0x7fc2880b52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:20.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.024+0000 7fc28d71d700 1 -- 172.21.15.133:0/286947123 shutdown_connections 2021-01-03T13:06:20.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.024+0000 7fc28d71d700 1 -- 172.21.15.133:0/286947123 wait complete. 2021-01-03T13:06:20.044 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-01-03T13:06:20.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.152+0000 7fa1eb1e7700 1 Processor -- start 2021-01-03T13:06:20.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.152+0000 7fa1eb1e7700 1 -- start start 2021-01-03T13:06:20.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1eb1e7700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa1e40b5c10 0x7fa1e40aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:20.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1eb1e7700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e4098550 con 0x7fa1e40b0670 2021-01-03T13:06:20.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1eb1e7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1e40b5ff0 con 0x7fa1e414aee0 2021-01-03T13:06:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1eb1e7700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1e40b0b10 con 0x7fa1e40b5c10 2021-01-03T13:06:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e9784700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa1e414aee0 0x7fa1e4144470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59456/0 (socket says 172.21.15.133:59456) 2021-01-03T13:06:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e9784700 1 -- 172.21.15.133:0/3651069259 learned_addr learned my addr 172.21.15.133:0/3651069259 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:20.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e8f83700 1 --2- 172.21.15.133:0/3651069259 >> v2:172.21.15.16:3300/0 conn(0x7fa1e40b5c10 0x7fa1e40aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:20.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 -- 172.21.15.133:0/3651069259 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208034727 0 0) 0x7fa1e40b5ff0 con 0x7fa1e414aee0 2021-01-03T13:06:20.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 -- 172.21.15.133:0/3651069259 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1c4003230 con 0x7fa1e414aee0 2021-01-03T13:06:20.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 -- 172.21.15.133:0/3651069259 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 899291224 0 0) 0x7fa1c4003230 con 0x7fa1e414aee0 2021-01-03T13:06:20.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 -- 172.21.15.133:0/3651069259 >> v2:172.21.15.16:3300/0 conn(0x7fa1e40b5c10 msgr2=0x7fa1e40aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:20.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 --2- 172.21.15.133:0/3651069259 >> v2:172.21.15.16:3300/0 conn(0x7fa1e40b5c10 0x7fa1e40aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 -- 172.21.15.133:0/3651069259 >> v1:172.21.15.16:6789/0 conn(0x7fa1e40b0670 legacy=0x7fa1e414a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:20.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 -- 172.21.15.133:0/3651069259 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e4098780 con 0x7fa1e414aee0 2021-01-03T13:06:20.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 -- 172.21.15.133:0/3651069259 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fa1d40016d0 con 0x7fa1e414aee0 2021-01-03T13:06:20.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 -- 172.21.15.133:0/3651069259 >> v1:172.21.15.133:6789/0 conn(0x7fa1e414aee0 legacy=0x7fa1e4144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:20.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 --2- 172.21.15.133:0/3651069259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1c4003720 0x7fa1c4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:20.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 --2- 172.21.15.133:0/3651069259 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1c40044d0 0x7fa1c4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:20.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 --2- 172.21.15.133:0/3651069259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1c4004e40 0x7fa1c400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:20.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 -- 172.21.15.133:0/3651069259 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e40b0b10 con 0x7fa1c4003720 2021-01-03T13:06:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 -- 172.21.15.133:0/3651069259 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c4004250 con 0x7fa1c4004e40 2021-01-03T13:06:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 -- 172.21.15.133:0/3651069259 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c400bc10 con 0x7fa1c40044d0 2021-01-03T13:06:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e9784700 1 --2- 172.21.15.133:0/3651069259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1c4004e40 0x7fa1c400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:20.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e8f83700 1 --2- 172.21.15.133:0/3651069259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1c4003720 0x7fa1c4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e3fff700 1 --2- 172.21.15.133:0/3651069259 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1c40044d0 0x7fa1c4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e9784700 1 -- 172.21.15.133:0/3651069259 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1c40044d0 msgr2=0x7fa1c4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e9784700 1 --2- 172.21.15.133:0/3651069259 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1c40044d0 0x7fa1c4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e9784700 1 -- 172.21.15.133:0/3651069259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1c4003720 msgr2=0x7fa1c4003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:20.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e9784700 1 --2- 172.21.15.133:0/3651069259 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1c4003720 0x7fa1c4003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e9784700 1 -- 172.21.15.133:0/3651069259 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c4003230 con 0x7fa1c4004e40 2021-01-03T13:06:20.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e9784700 1 -- 172.21.15.133:0/3651069259 reap_dead start 2021-01-03T13:06:20.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e9784700 1 --2- 172.21.15.133:0/3651069259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1c4004e40 0x7fa1c400b720 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fa1d40013e0 tx=0x7fa1e40b0db0).ready entity=mon.1 client_cookie=d7f956130522089 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:20.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 -- 172.21.15.133:0/3651069259 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1d40070d0 con 0x7fa1c4004e40 2021-01-03T13:06:20.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 -- 172.21.15.133:0/3651069259 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d4007230 con 0x7fa1c4004e40 2021-01-03T13:06:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1e37fe700 1 -- 172.21.15.133:0/3651069259 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1d40055e0 con 0x7fa1c4004e40 2021-01-03T13:06:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1eb1e7700 1 -- 172.21.15.133:0/3651069259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1c4004e40 msgr2=0x7fa1c400b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1eb1e7700 1 --2- 172.21.15.133:0/3651069259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1c4004e40 0x7fa1c400b720 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fa1d40013e0 tx=0x7fa1e40b0db0).stop 2021-01-03T13:06:20.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.156+0000 7fa1eb1e7700 1 -- 172.21.15.133:0/3651069259 shutdown_connections 2021-01-03T13:06:20.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.160+0000 7fa1eb1e7700 1 --2- 172.21.15.133:0/3651069259 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1c4004e40 0x7fa1c400b720 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.160+0000 7fa1eb1e7700 1 -- 172.21.15.133:0/3651069259 >> 172.21.15.133:0/3651069259 conn(0x7fa1e405c8c0 msgr2=0x7fa1e40b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:20.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.160+0000 7fa1eb1e7700 1 -- 172.21.15.133:0/3651069259 shutdown_connections 2021-01-03T13:06:20.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.160+0000 7fa1eb1e7700 1 -- 172.21.15.133:0/3651069259 wait complete. 2021-01-03T13:06:20.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.160+0000 7fa1eb1e7700 1 Processor -- start 2021-01-03T13:06:20.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.160+0000 7fa1eb1e7700 1 -- start start 2021-01-03T13:06:20.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1eb1e7700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1c4004e40 0x7fa1e40ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:20.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1eb1e7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1e40ad850 0x7fa1e4066c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:20.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1eb1e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1e4067170 0x7fa1e40ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:20.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1eb1e7700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e4159650 con 0x7fa1c4004e40 2021-01-03T13:06:20.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1eb1e7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e41598f0 con 0x7fa1e4067170 2021-01-03T13:06:20.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1eb1e7700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e4159b90 con 0x7fa1e40ad850 2021-01-03T13:06:20.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e9784700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1e4067170 0x7fa1e40ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:20.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e9784700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1e4067170 0x7fa1e40ae470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38436/0 (socket says 172.21.15.133:38436) 2021-01-03T13:06:20.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e9784700 1 -- 172.21.15.133:0/697328551 learned_addr learned my addr 172.21.15.133:0/697328551 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:20.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e3fff700 1 --2- 172.21.15.133:0/697328551 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1e40ad850 0x7fa1e4066c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:20.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e8f83700 1 --2- 172.21.15.133:0/697328551 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1c4004e40 0x7fa1e40ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:20.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e9784700 1 -- 172.21.15.133:0/697328551 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1e40ad850 msgr2=0x7fa1e4066c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:20.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e9784700 1 --2- 172.21.15.133:0/697328551 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1e40ad850 0x7fa1e4066c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e9784700 1 -- 172.21.15.133:0/697328551 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1c4004e40 msgr2=0x7fa1e40ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:20.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e9784700 1 --2- 172.21.15.133:0/697328551 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1c4004e40 0x7fa1e40ad070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e9784700 1 -- 172.21.15.133:0/697328551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e4159e30 con 0x7fa1e4067170 2021-01-03T13:06:20.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e3fff700 1 --2- 172.21.15.133:0/697328551 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1e40ad850 0x7fa1e4066c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:20.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e9784700 1 --2- 172.21.15.133:0/697328551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1e4067170 0x7fa1e40ae470 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fa1d40013e0 tx=0x7fa1d4013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:20.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e1ffb700 1 -- 172.21.15.133:0/697328551 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1d4005ad0 con 0x7fa1e4067170 2021-01-03T13:06:20.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e1ffb700 1 -- 172.21.15.133:0/697328551 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d4005c30 con 0x7fa1e4067170 2021-01-03T13:06:20.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1eb1e7700 1 -- 172.21.15.133:0/697328551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e40ade70 con 0x7fa1e4067170 2021-01-03T13:06:20.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e1ffb700 1 -- 172.21.15.133:0/697328551 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1d4013450 con 0x7fa1e4067170 2021-01-03T13:06:20.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1eb1e7700 1 -- 172.21.15.133:0/697328551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e4067600 con 0x7fa1e4067170 2021-01-03T13:06:20.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1eb1e7700 1 -- 172.21.15.133:0/697328551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e4057300 con 0x7fa1e4067170 2021-01-03T13:06:20.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e1ffb700 1 -- 172.21.15.133:0/697328551 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa1d4026070 con 0x7fa1e4067170 2021-01-03T13:06:20.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e1ffb700 1 --2- 172.21.15.133:0/697328551 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa1c80553b0 0x7fa1c8057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:20.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e1ffb700 1 -- 172.21.15.133:0/697328551 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa1d406e2c0 con 0x7fa1e4067170 2021-01-03T13:06:20.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.164+0000 7fa1e8f83700 1 --2- 172.21.15.133:0/697328551 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa1c80553b0 0x7fa1c8057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:20.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.168+0000 7fa1e8f83700 1 --2- 172.21.15.133:0/697328551 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa1c80553b0 0x7fa1c8057870 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fa1cc008000 tx=0x7fa1cc008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:20.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.168+0000 7fa1e1ffb700 1 -- 172.21.15.133:0/697328551 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa1d40448f0 con 0x7fa1e4067170 2021-01-03T13:06:20.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.308+0000 7fa1eb1e7700 1 -- 172.21.15.133:0/697328551 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa1e405ce00 con 0x7fa1e4067170 2021-01-03T13:06:20.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.308+0000 7fa1e1ffb700 1 -- 172.21.15.133:0/697328551 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v119) v1 ==== 84+0+143 (secure 0 0 0) 0x7fa1d4047f10 con 0x7fa1e4067170 2021-01-03T13:06:20.316 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:20.317 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2021-01-03T13:06:20.317 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:20.318 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2021-01-03T13:06:20.319 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2021-01-03T13:06:20.319 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:20.320 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:20.320 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2021-01-03T13:06:20.320 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2021-01-03T13:06:20.321 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:20.321 INFO:teuthology.orchestra.run.smithi133.stdout:] 2021-01-03T13:06:20.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.312+0000 7fa1eb1e7700 1 -- 172.21.15.133:0/697328551 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa1c80553b0 msgr2=0x7fa1c8057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:20.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.312+0000 7fa1eb1e7700 1 --2- 172.21.15.133:0/697328551 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa1c80553b0 0x7fa1c8057870 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fa1cc008000 tx=0x7fa1cc008040).stop 2021-01-03T13:06:20.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.312+0000 7fa1eb1e7700 1 -- 172.21.15.133:0/697328551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1e4067170 msgr2=0x7fa1e40ae470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:20.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.312+0000 7fa1eb1e7700 1 --2- 172.21.15.133:0/697328551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1e4067170 0x7fa1e40ae470 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fa1d40013e0 tx=0x7fa1d4013000).stop 2021-01-03T13:06:20.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.312+0000 7fa1eb1e7700 1 -- 172.21.15.133:0/697328551 shutdown_connections 2021-01-03T13:06:20.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.312+0000 7fa1eb1e7700 1 --2- 172.21.15.133:0/697328551 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa1c80553b0 0x7fa1c8057870 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.312+0000 7fa1eb1e7700 1 --2- 172.21.15.133:0/697328551 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1c4004e40 0x7fa1e40ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.312+0000 7fa1eb1e7700 1 --2- 172.21.15.133:0/697328551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1e4067170 0x7fa1e40ae470 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.312+0000 7fa1eb1e7700 1 --2- 172.21.15.133:0/697328551 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1e40ad850 0x7fa1e4066c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.312+0000 7fa1eb1e7700 1 -- 172.21.15.133:0/697328551 >> 172.21.15.133:0/697328551 conn(0x7fa1e405c8c0 msgr2=0x7fa1e40b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:20.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.312+0000 7fa1eb1e7700 1 -- 172.21.15.133:0/697328551 shutdown_connections 2021-01-03T13:06:20.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.312+0000 7fa1eb1e7700 1 -- 172.21.15.133:0/697328551 wait complete. 2021-01-03T13:06:20.331 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-01-03T13:06:20.332 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-01-03T13:06:20.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1592aa700 1 Processor -- start 2021-01-03T13:06:20.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1592aa700 1 -- start start 2021-01-03T13:06:20.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1592aa700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd15409cea0 0x7fd1540b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:20.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1592aa700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1540b40d0 0x7fd1541442f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:20.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1592aa700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd1540b36a0 0x7fd1541447e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:20.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1592aa700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1540adf30 con 0x7fd1540b36a0 2021-01-03T13:06:20.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1592aa700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1540b2c90 con 0x7fd15409cea0 2021-01-03T13:06:20.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1592aa700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd154060490 con 0x7fd1540b40d0 2021-01-03T13:06:20.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd152ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd15409cea0 0x7fd1540b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:20.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd152ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd15409cea0 0x7fd1540b3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38440/0 (socket says 172.21.15.133:38440) 2021-01-03T13:06:20.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1537fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd1540b36a0 0x7fd1541447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:20.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1527fc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1540b40d0 0x7fd1541442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:20.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd152ffd700 1 -- 172.21.15.133:0/2731697126 learned_addr learned my addr 172.21.15.133:0/2731697126 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:20.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd152ffd700 1 -- 172.21.15.133:0/2731697126 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1540b40d0 msgr2=0x7fd1541442f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:20.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd152ffd700 1 --2- 172.21.15.133:0/2731697126 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1540b40d0 0x7fd1541442f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd152ffd700 1 -- 172.21.15.133:0/2731697126 >> v2:172.21.15.16:3300/0 conn(0x7fd1540b36a0 msgr2=0x7fd1541447e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:20.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd152ffd700 1 --2- 172.21.15.133:0/2731697126 >> v2:172.21.15.16:3300/0 conn(0x7fd1540b36a0 0x7fd1541447e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd152ffd700 1 -- 172.21.15.133:0/2731697126 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1540b2ec0 con 0x7fd15409cea0 2021-01-03T13:06:20.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd152ffd700 1 --2- 172.21.15.133:0/2731697126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd15409cea0 0x7fd1540b3be0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fd13c002f30 tx=0x7fd13c006e80).ready entity=mon.1 client_cookie=8935f41fc58707e4 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:20.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd151ffb700 1 -- 172.21.15.133:0/2731697126 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd13c009640 con 0x7fd15409cea0 2021-01-03T13:06:20.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd151ffb700 1 -- 172.21.15.133:0/2731697126 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13c0097a0 con 0x7fd15409cea0 2021-01-03T13:06:20.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd151ffb700 1 -- 172.21.15.133:0/2731697126 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd13c009b00 con 0x7fd15409cea0 2021-01-03T13:06:20.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1592aa700 1 -- 172.21.15.133:0/2731697126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd15409cea0 msgr2=0x7fd1540b3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:20.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1592aa700 1 --2- 172.21.15.133:0/2731697126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd15409cea0 0x7fd1540b3be0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fd13c002f30 tx=0x7fd13c006e80).stop 2021-01-03T13:06:20.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1592aa700 1 -- 172.21.15.133:0/2731697126 shutdown_connections 2021-01-03T13:06:20.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1592aa700 1 --2- 172.21.15.133:0/2731697126 >> v2:172.21.15.16:3300/0 conn(0x7fd1540b36a0 0x7fd1541447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1592aa700 1 --2- 172.21.15.133:0/2731697126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd15409cea0 0x7fd1540b3be0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1592aa700 1 --2- 172.21.15.133:0/2731697126 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1540b40d0 0x7fd1541442f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1592aa700 1 -- 172.21.15.133:0/2731697126 >> 172.21.15.133:0/2731697126 conn(0x7fd15405bdf0 msgr2=0x7fd15405c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:20.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1592aa700 1 -- 172.21.15.133:0/2731697126 shutdown_connections 2021-01-03T13:06:20.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.448+0000 7fd1592aa700 1 -- 172.21.15.133:0/2731697126 wait complete. 2021-01-03T13:06:20.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1592aa700 1 Processor -- start 2021-01-03T13:06:20.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1592aa700 1 -- start start 2021-01-03T13:06:20.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1592aa700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd15409cea0 0x7fd154064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:20.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1592aa700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1540b36a0 0x7fd1540b6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:20.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1592aa700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1540624b0 0x7fd15409a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:20.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1592aa700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15409c740 con 0x7fd15409cea0 2021-01-03T13:06:20.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1592aa700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd154099b20 con 0x7fd1540b36a0 2021-01-03T13:06:20.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1592aa700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1540632d0 con 0x7fd1540624b0 2021-01-03T13:06:20.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1527fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1540b36a0 0x7fd1540b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:20.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1527fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1540b36a0 0x7fd1540b6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38448/0 (socket says 172.21.15.133:38448) 2021-01-03T13:06:20.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1527fc700 1 -- 172.21.15.133:0/3262598120 learned_addr learned my addr 172.21.15.133:0/3262598120 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:20.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd152ffd700 1 --2- 172.21.15.133:0/3262598120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd15409cea0 0x7fd154064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:20.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1537fe700 1 --2- 172.21.15.133:0/3262598120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1540624b0 0x7fd15409a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:20.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1527fc700 1 -- 172.21.15.133:0/3262598120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1540624b0 msgr2=0x7fd15409a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:20.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1527fc700 1 --2- 172.21.15.133:0/3262598120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1540624b0 0x7fd15409a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1527fc700 1 -- 172.21.15.133:0/3262598120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd15409cea0 msgr2=0x7fd154064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:20.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1527fc700 1 --2- 172.21.15.133:0/3262598120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd15409cea0 0x7fd154064ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:20.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1527fc700 1 -- 172.21.15.133:0/3262598120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15409c4a0 con 0x7fd1540b36a0 2021-01-03T13:06:20.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1527fc700 1 --2- 172.21.15.133:0/3262598120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1540b36a0 0x7fd1540b6810 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fd154063460 tx=0x7fd144006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:20.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd14bfff700 1 -- 172.21.15.133:0/3262598120 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd14400ca10 con 0x7fd1540b36a0 2021-01-03T13:06:20.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd14bfff700 1 -- 172.21.15.133:0/3262598120 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14400cb70 con 0x7fd1540b36a0 2021-01-03T13:06:20.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1592aa700 1 -- 172.21.15.133:0/3262598120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd154063030 con 0x7fd1540b36a0 2021-01-03T13:06:20.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd14bfff700 1 -- 172.21.15.133:0/3262598120 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1440123f0 con 0x7fd1540b36a0 2021-01-03T13:06:20.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.452+0000 7fd1592aa700 1 -- 172.21.15.133:0/3262598120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd154141610 con 0x7fd1540b36a0 2021-01-03T13:06:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.456+0000 7fd1592aa700 1 -- 172.21.15.133:0/3262598120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd154099ea0 con 0x7fd1540b36a0 2021-01-03T13:06:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.456+0000 7fd14bfff700 1 -- 172.21.15.133:0/3262598120 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd144012550 con 0x7fd1540b36a0 2021-01-03T13:06:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.456+0000 7fd14bfff700 1 --2- 172.21.15.133:0/3262598120 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd138055440 0x7fd138057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.456+0000 7fd152ffd700 1 --2- 172.21.15.133:0/3262598120 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd138055440 0x7fd138057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.456+0000 7fd14bfff700 1 -- 172.21.15.133:0/3262598120 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd14406e110 con 0x7fd1540b36a0 2021-01-03T13:06:20.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.456+0000 7fd152ffd700 1 --2- 172.21.15.133:0/3262598120 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd138055440 0x7fd138057900 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fd13c01b000 tx=0x7fd13c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:20.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.464+0000 7fd14bfff700 1 -- 172.21.15.133:0/3262598120 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd1440445d0 con 0x7fd1540b36a0 2021-01-03T13:06:20.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:20.600+0000 7fd1592aa700 1 -- 172.21.15.133:0/3262598120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fd154099c60 con 0x7fd1540b36a0 2021-01-03T13:06:21.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.604+0000 7fd14bfff700 1 -- 172.21.15.133:0/3262598120 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v120) v1 ==== 133+0+0 (secure 0 0 0) 0x7fd144047bf0 con 0x7fd1540b36a0 2021-01-03T13:06:21.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.604+0000 7fd1592aa700 1 -- 172.21.15.133:0/3262598120 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd138055440 msgr2=0x7fd138057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:21.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.604+0000 7fd1592aa700 1 --2- 172.21.15.133:0/3262598120 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd138055440 0x7fd138057900 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fd13c01b000 tx=0x7fd13c015000).stop 2021-01-03T13:06:21.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.604+0000 7fd1592aa700 1 -- 172.21.15.133:0/3262598120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1540b36a0 msgr2=0x7fd1540b6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:21.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.604+0000 7fd1592aa700 1 --2- 172.21.15.133:0/3262598120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1540b36a0 0x7fd1540b6810 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7fd154063460 tx=0x7fd144006dc0).stop 2021-01-03T13:06:21.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.608+0000 7fd1592aa700 1 -- 172.21.15.133:0/3262598120 shutdown_connections 2021-01-03T13:06:21.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.608+0000 7fd1592aa700 1 --2- 172.21.15.133:0/3262598120 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd138055440 0x7fd138057900 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:21.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.608+0000 7fd1592aa700 1 --2- 172.21.15.133:0/3262598120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd15409cea0 0x7fd154064ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:21.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.608+0000 7fd1592aa700 1 --2- 172.21.15.133:0/3262598120 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1540624b0 0x7fd15409a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:21.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.608+0000 7fd1592aa700 1 --2- 172.21.15.133:0/3262598120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1540b36a0 0x7fd1540b6810 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:21.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.608+0000 7fd1592aa700 1 -- 172.21.15.133:0/3262598120 >> 172.21.15.133:0/3262598120 conn(0x7fd15405bdf0 msgr2=0x7fd15405fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:21.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.608+0000 7fd1592aa700 1 -- 172.21.15.133:0/3262598120 shutdown_connections 2021-01-03T13:06:21.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.608+0000 7fd1592aa700 1 -- 172.21.15.133:0/3262598120 wait complete. 2021-01-03T13:06:21.619 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2021-01-03T13:06:21.629 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-01-03T13:06:21.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a9522e700 1 Processor -- start 2021-01-03T13:06:21.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a9522e700 1 -- start start 2021-01-03T13:06:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a9522e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6a900b5c10 0x7f6a900aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a9522e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a900b0670 0x7f6a9014a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:21.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a9522e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a9014acc0 0x7f6a90144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a9522e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a90098550 con 0x7f6a900b5c10 2021-01-03T13:06:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a9522e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a900b5ff0 con 0x7f6a900b0670 2021-01-03T13:06:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a9522e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a900b0b10 con 0x7f6a9014acc0 2021-01-03T13:06:21.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a87fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a900b0670 0x7f6a9014a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a87fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a900b0670 0x7f6a9014a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38458/0 (socket says 172.21.15.133:38458) 2021-01-03T13:06:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a87fff700 1 -- 172.21.15.133:0/3196362942 learned_addr learned my addr 172.21.15.133:0/3196362942 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a8f59e700 1 --2- 172.21.15.133:0/3196362942 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a9014acc0 0x7f6a90144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a8ed9d700 1 --2- 172.21.15.133:0/3196362942 >> v2:172.21.15.16:3300/0 conn(0x7f6a900b5c10 0x7f6a900aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:21.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a87fff700 1 -- 172.21.15.133:0/3196362942 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a9014acc0 msgr2=0x7f6a90144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a87fff700 1 --2- 172.21.15.133:0/3196362942 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a9014acc0 0x7f6a90144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a87fff700 1 -- 172.21.15.133:0/3196362942 >> v2:172.21.15.16:3300/0 conn(0x7f6a900b5c10 msgr2=0x7f6a900aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a87fff700 1 --2- 172.21.15.133:0/3196362942 >> v2:172.21.15.16:3300/0 conn(0x7f6a900b5c10 0x7f6a900aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a87fff700 1 -- 172.21.15.133:0/3196362942 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a90098780 con 0x7f6a900b0670 2021-01-03T13:06:21.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a87fff700 1 --2- 172.21.15.133:0/3196362942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a900b0670 0x7f6a9014a7d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f6a78002f30 tx=0x7f6a78006e80).ready entity=mon.1 client_cookie=2dd92753dfe60c9c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a8e59c700 1 -- 172.21.15.133:0/3196362942 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a78009640 con 0x7f6a900b0670 2021-01-03T13:06:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a8e59c700 1 -- 172.21.15.133:0/3196362942 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a780097a0 con 0x7f6a900b0670 2021-01-03T13:06:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a8e59c700 1 -- 172.21.15.133:0/3196362942 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a78009b00 con 0x7f6a900b0670 2021-01-03T13:06:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a9522e700 1 -- 172.21.15.133:0/3196362942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a900b0670 msgr2=0x7f6a9014a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:21.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.748+0000 7f6a9522e700 1 --2- 172.21.15.133:0/3196362942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a900b0670 0x7f6a9014a7d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f6a78002f30 tx=0x7f6a78006e80).stop 2021-01-03T13:06:21.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a9522e700 1 -- 172.21.15.133:0/3196362942 shutdown_connections 2021-01-03T13:06:21.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a9522e700 1 --2- 172.21.15.133:0/3196362942 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a9014acc0 0x7f6a90144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:21.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a9522e700 1 --2- 172.21.15.133:0/3196362942 >> v2:172.21.15.16:3300/0 conn(0x7f6a900b5c10 0x7f6a900aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:21.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a9522e700 1 --2- 172.21.15.133:0/3196362942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a900b0670 0x7f6a9014a7d0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:21.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a9522e700 1 -- 172.21.15.133:0/3196362942 >> 172.21.15.133:0/3196362942 conn(0x7f6a9005c8c0 msgr2=0x7f6a900b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:21.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a9522e700 1 -- 172.21.15.133:0/3196362942 shutdown_connections 2021-01-03T13:06:21.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a9522e700 1 -- 172.21.15.133:0/3196362942 wait complete. 2021-01-03T13:06:21.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a9522e700 1 Processor -- start 2021-01-03T13:06:21.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a9522e700 1 -- start start 2021-01-03T13:06:21.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a9522e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a900b0670 0x7f6a900ac950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:21.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a9522e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a900b5c10 0x7f6a900ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:21.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a9522e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a9014acc0 0x7f6a900ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:21.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a9522e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a90146dd0 con 0x7f6a9014acc0 2021-01-03T13:06:21.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a9522e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a901477f0 con 0x7f6a900b0670 2021-01-03T13:06:21.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a9522e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a901466f0 con 0x7f6a900b5c10 2021-01-03T13:06:21.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a8ed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a900b0670 0x7f6a900ac950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:21.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a8ed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a900b0670 0x7f6a900ac950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38460/0 (socket says 172.21.15.133:38460) 2021-01-03T13:06:21.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a8ed9d700 1 -- 172.21.15.133:0/1234610769 learned_addr learned my addr 172.21.15.133:0/1234610769 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:21.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a87fff700 1 --2- 172.21.15.133:0/1234610769 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a900b5c10 0x7f6a900ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:21.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a8f59e700 1 --2- 172.21.15.133:0/1234610769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a9014acc0 0x7f6a900ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:21.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a8ed9d700 1 -- 172.21.15.133:0/1234610769 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a900b5c10 msgr2=0x7f6a900ae360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:21.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a8ed9d700 1 --2- 172.21.15.133:0/1234610769 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a900b5c10 0x7f6a900ae360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:21.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a8ed9d700 1 -- 172.21.15.133:0/1234610769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a9014acc0 msgr2=0x7f6a900ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a8ed9d700 1 --2- 172.21.15.133:0/1234610769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a9014acc0 0x7f6a900ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a8ed9d700 1 -- 172.21.15.133:0/1234610769 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9014dfd0 con 0x7f6a900b0670 2021-01-03T13:06:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a8f59e700 1 --2- 172.21.15.133:0/1234610769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a9014acc0 0x7f6a900ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a8ed9d700 1 --2- 172.21.15.133:0/1234610769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a900b0670 0x7f6a900ac950 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f6a8000c000 tx=0x7f6a80006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:21.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a8cd99700 1 -- 172.21.15.133:0/1234610769 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8000ca10 con 0x7f6a900b0670 2021-01-03T13:06:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a8cd99700 1 -- 172.21.15.133:0/1234610769 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8000cb70 con 0x7f6a900b0670 2021-01-03T13:06:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a9522e700 1 -- 172.21.15.133:0/1234610769 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a900aed40 con 0x7f6a900b0670 2021-01-03T13:06:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.752+0000 7f6a8cd99700 1 -- 172.21.15.133:0/1234610769 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a800123f0 con 0x7f6a900b0670 2021-01-03T13:06:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.756+0000 7f6a9522e700 1 -- 172.21.15.133:0/1234610769 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a90146190 con 0x7f6a900b0670 2021-01-03T13:06:21.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.756+0000 7f6a9522e700 1 -- 172.21.15.133:0/1234610769 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a90146f40 con 0x7f6a900b0670 2021-01-03T13:06:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.756+0000 7f6a8cd99700 1 -- 172.21.15.133:0/1234610769 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6a80012550 con 0x7f6a900b0670 2021-01-03T13:06:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.756+0000 7f6a8cd99700 1 --2- 172.21.15.133:0/1234610769 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a740553b0 0x7f6a74057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.756+0000 7f6a8cd99700 1 -- 172.21.15.133:0/1234610769 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f6a8006e240 con 0x7f6a900b0670 2021-01-03T13:06:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.756+0000 7f6a87fff700 1 --2- 172.21.15.133:0/1234610769 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a740553b0 0x7f6a74057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.756+0000 7f6a87fff700 1 --2- 172.21.15.133:0/1234610769 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a740553b0 0x7f6a74057870 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f6a7801b000 tx=0x7f6a78015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.764+0000 7f6a8cd99700 1 -- 172.21.15.133:0/1234610769 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6a800445a0 con 0x7f6a900b0670 2021-01-03T13:06:21.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:21.908+0000 7f6a9522e700 1 -- 172.21.15.133:0/1234610769 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f6a90147120 con 0x7f6a900b0670 2021-01-03T13:06:22.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.796+0000 7f6a8cd99700 1 -- 172.21.15.133:0/1234610769 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v122) v1 ==== 125+0+0 (secure 0 0 0) 0x7f6a80047bc0 con 0x7f6a900b0670 2021-01-03T13:06:22.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.800+0000 7f6a9522e700 1 -- 172.21.15.133:0/1234610769 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a740553b0 msgr2=0x7f6a74057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:22.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.800+0000 7f6a9522e700 1 --2- 172.21.15.133:0/1234610769 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a740553b0 0x7f6a74057870 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f6a7801b000 tx=0x7f6a78015000).stop 2021-01-03T13:06:22.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.800+0000 7f6a9522e700 1 -- 172.21.15.133:0/1234610769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a900b0670 msgr2=0x7f6a900ac950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:22.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.800+0000 7f6a9522e700 1 --2- 172.21.15.133:0/1234610769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a900b0670 0x7f6a900ac950 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f6a8000c000 tx=0x7f6a80006dc0).stop 2021-01-03T13:06:22.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.804+0000 7f6a9522e700 1 -- 172.21.15.133:0/1234610769 shutdown_connections 2021-01-03T13:06:22.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.804+0000 7f6a9522e700 1 --2- 172.21.15.133:0/1234610769 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6a740553b0 0x7f6a74057870 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:22.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.804+0000 7f6a9522e700 1 --2- 172.21.15.133:0/1234610769 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6a9014acc0 0x7f6a900ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:22.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.804+0000 7f6a9522e700 1 --2- 172.21.15.133:0/1234610769 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a900b0670 0x7f6a900ac950 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:22.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.804+0000 7f6a9522e700 1 --2- 172.21.15.133:0/1234610769 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6a900b5c10 0x7f6a900ae360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:22.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.804+0000 7f6a9522e700 1 -- 172.21.15.133:0/1234610769 >> 172.21.15.133:0/1234610769 conn(0x7f6a9005c8c0 msgr2=0x7f6a900b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:22.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.804+0000 7f6a9522e700 1 -- 172.21.15.133:0/1234610769 shutdown_connections 2021-01-03T13:06:22.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.804+0000 7f6a9522e700 1 -- 172.21.15.133:0/1234610769 wait complete. 2021-01-03T13:06:22.811 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2021-01-03T13:06:22.825 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-01-03T13:06:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.936+0000 7fd9411a7700 1 Processor -- start 2021-01-03T13:06:22.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.936+0000 7fd9411a7700 1 -- start start 2021-01-03T13:06:22.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9411a7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd93c0b4c20 0x7fd93c05c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9411a7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd93c05fd10 0x7fd93c0b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9411a7700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93c05bf00 con 0x7fd93c060510 2021-01-03T13:06:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9411a7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd93c05c1a0 con 0x7fd93c05fd10 2021-01-03T13:06:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9411a7700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c05c440 con 0x7fd93c0b4c20 2021-01-03T13:06:22.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9409a6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd93c05fd10 0x7fd93c0b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9409a6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd93c05fd10 0x7fd93c0b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38474/0 (socket says 172.21.15.133:38474) 2021-01-03T13:06:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9409a6700 1 -- 172.21.15.133:0/1108126179 learned_addr learned my addr 172.21.15.133:0/1108126179 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd93bfff700 1 --2- 172.21.15.133:0/1108126179 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd93c0b4c20 0x7fd93c05c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:22.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9409a6700 1 -- 172.21.15.133:0/1108126179 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd93c0b4c20 msgr2=0x7fd93c05c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:22.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9409a6700 1 --2- 172.21.15.133:0/1108126179 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd93c0b4c20 0x7fd93c05c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:22.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9409a6700 1 -- 172.21.15.133:0/1108126179 >> v1:172.21.15.16:6789/0 conn(0x7fd93c060510 legacy=0x7fd93c0b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:22.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9409a6700 1 -- 172.21.15.133:0/1108126179 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c0b6ad0 con 0x7fd93c05fd10 2021-01-03T13:06:22.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9409a6700 1 --2- 172.21.15.133:0/1108126179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd93c05fd10 0x7fd93c0b65e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fd9340032b0 tx=0x7fd934009270).ready entity=mon.1 client_cookie=3f4402e29723c2d0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:22.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd93affd700 1 -- 172.21.15.133:0/1108126179 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd934009e60 con 0x7fd93c05fd10 2021-01-03T13:06:22.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd93affd700 1 -- 172.21.15.133:0/1108126179 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93400bc00 con 0x7fd93c05fd10 2021-01-03T13:06:22.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd93affd700 1 -- 172.21.15.133:0/1108126179 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd93400bd70 con 0x7fd93c05fd10 2021-01-03T13:06:22.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9411a7700 1 -- 172.21.15.133:0/1108126179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd93c05fd10 msgr2=0x7fd93c0b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:22.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9411a7700 1 --2- 172.21.15.133:0/1108126179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd93c05fd10 0x7fd93c0b65e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fd9340032b0 tx=0x7fd934009270).stop 2021-01-03T13:06:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9411a7700 1 -- 172.21.15.133:0/1108126179 shutdown_connections 2021-01-03T13:06:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9411a7700 1 --2- 172.21.15.133:0/1108126179 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd93c0b4c20 0x7fd93c05c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9411a7700 1 --2- 172.21.15.133:0/1108126179 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd93c05fd10 0x7fd93c0b65e0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9411a7700 1 -- 172.21.15.133:0/1108126179 >> 172.21.15.133:0/1108126179 conn(0x7fd93c0b9f00 msgr2=0x7fd93c0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9411a7700 1 -- 172.21.15.133:0/1108126179 shutdown_connections 2021-01-03T13:06:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.940+0000 7fd9411a7700 1 -- 172.21.15.133:0/1108126179 wait complete. 2021-01-03T13:06:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd9411a7700 1 Processor -- start 2021-01-03T13:06:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd9411a7700 1 -- start start 2021-01-03T13:06:22.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd9411a7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd93c05fd10 0x7fd93c0b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:22.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd9411a7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd93c060510 0x7fd93c09e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:22.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd9411a7700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd93c0b4c20 0x7fd93c142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd9411a7700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c0b3fb0 con 0x7fd93c0b4c20 2021-01-03T13:06:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd9411a7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c146f90 con 0x7fd93c05fd10 2021-01-03T13:06:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd9411a7700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c0b3840 con 0x7fd93c060510 2021-01-03T13:06:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd93bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd93c05fd10 0x7fd93c0b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd93bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd93c05fd10 0x7fd93c0b2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38476/0 (socket says 172.21.15.133:38476) 2021-01-03T13:06:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd93bfff700 1 -- 172.21.15.133:0/4160903235 learned_addr learned my addr 172.21.15.133:0/4160903235 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd9409a6700 1 --2- 172.21.15.133:0/4160903235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd93c0b4c20 0x7fd93c142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd93b7fe700 1 --2- 172.21.15.133:0/4160903235 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd93c060510 0x7fd93c09e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd93bfff700 1 -- 172.21.15.133:0/4160903235 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd93c060510 msgr2=0x7fd93c09e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:22.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd93bfff700 1 --2- 172.21.15.133:0/4160903235 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd93c060510 0x7fd93c09e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:22.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd93bfff700 1 -- 172.21.15.133:0/4160903235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd93c0b4c20 msgr2=0x7fd93c142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:22.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd93bfff700 1 --2- 172.21.15.133:0/4160903235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd93c0b4c20 0x7fd93c142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:22.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd93bfff700 1 -- 172.21.15.133:0/4160903235 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c0b2f60 con 0x7fd93c05fd10 2021-01-03T13:06:22.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd93b7fe700 1 --2- 172.21.15.133:0/4160903235 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd93c060510 0x7fd93c09e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:22.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd9409a6700 1 --2- 172.21.15.133:0/4160903235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd93c0b4c20 0x7fd93c142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:22.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd93bfff700 1 --2- 172.21.15.133:0/4160903235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd93c05fd10 0x7fd93c0b2a70 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fd92c00c000 tx=0x7fd92c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:22.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd9397fa700 1 -- 172.21.15.133:0/4160903235 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd92c00c820 con 0x7fd93c05fd10 2021-01-03T13:06:22.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd9397fa700 1 -- 172.21.15.133:0/4160903235 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c00c980 con 0x7fd93c05fd10 2021-01-03T13:06:22.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd9411a7700 1 -- 172.21.15.133:0/4160903235 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd93c0b3a70 con 0x7fd93c05fd10 2021-01-03T13:06:22.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd9397fa700 1 -- 172.21.15.133:0/4160903235 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd92c00cce0 con 0x7fd93c05fd10 2021-01-03T13:06:22.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.944+0000 7fd9411a7700 1 -- 172.21.15.133:0/4160903235 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93c09ec00 con 0x7fd93c05fd10 2021-01-03T13:06:22.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.948+0000 7fd9411a7700 1 -- 172.21.15.133:0/4160903235 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd93c057300 con 0x7fd93c05fd10 2021-01-03T13:06:22.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.948+0000 7fd9397fa700 1 -- 172.21.15.133:0/4160903235 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd92c022070 con 0x7fd93c05fd10 2021-01-03T13:06:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.948+0000 7fd9397fa700 1 --2- 172.21.15.133:0/4160903235 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd91c0554e0 0x7fd91c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.948+0000 7fd9397fa700 1 -- 172.21.15.133:0/4160903235 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fd92c06e890 con 0x7fd93c05fd10 2021-01-03T13:06:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.948+0000 7fd93b7fe700 1 --2- 172.21.15.133:0/4160903235 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd91c0554e0 0x7fd91c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.948+0000 7fd93b7fe700 1 --2- 172.21.15.133:0/4160903235 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd91c0554e0 0x7fd91c0579a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fd93000b000 tx=0x7fd930009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:22.956+0000 7fd9397fa700 1 -- 172.21.15.133:0/4160903235 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd92c044c00 con 0x7fd93c05fd10 2021-01-03T13:06:23.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.144+0000 7fd9411a7700 1 -- 172.21.15.133:0/4160903235 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fd93c142910 con 0x7fd93c05fd10 2021-01-03T13:06:23.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.156+0000 7fd9397fa700 1 -- 172.21.15.133:0/4160903235 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 21 and data pool 22 v54) v1 ==== 189+0+0 (secure 0 0 0) 0x7fd92c048220 con 0x7fd93c05fd10 2021-01-03T13:06:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.160+0000 7fd9411a7700 1 -- 172.21.15.133:0/4160903235 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd91c0554e0 msgr2=0x7fd91c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.160+0000 7fd9411a7700 1 --2- 172.21.15.133:0/4160903235 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd91c0554e0 0x7fd91c0579a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fd93000b000 tx=0x7fd930009040).stop 2021-01-03T13:06:23.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.160+0000 7fd9411a7700 1 -- 172.21.15.133:0/4160903235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd93c05fd10 msgr2=0x7fd93c0b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.160+0000 7fd9411a7700 1 --2- 172.21.15.133:0/4160903235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd93c05fd10 0x7fd93c0b2a70 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fd92c00c000 tx=0x7fd92c008040).stop 2021-01-03T13:06:23.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.164+0000 7fd9411a7700 1 -- 172.21.15.133:0/4160903235 shutdown_connections 2021-01-03T13:06:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.164+0000 7fd9411a7700 1 --2- 172.21.15.133:0/4160903235 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd91c0554e0 0x7fd91c0579a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.164+0000 7fd9411a7700 1 --2- 172.21.15.133:0/4160903235 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd93c0b4c20 0x7fd93c142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.164+0000 7fd9411a7700 1 --2- 172.21.15.133:0/4160903235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd93c05fd10 0x7fd93c0b2a70 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.164+0000 7fd9411a7700 1 --2- 172.21.15.133:0/4160903235 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd93c060510 0x7fd93c09e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.164+0000 7fd9411a7700 1 -- 172.21.15.133:0/4160903235 >> 172.21.15.133:0/4160903235 conn(0x7fd93c0b9f00 msgr2=0x7fd93c0ae670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.164+0000 7fd9411a7700 1 -- 172.21.15.133:0/4160903235 shutdown_connections 2021-01-03T13:06:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.164+0000 7fd9411a7700 1 -- 172.21.15.133:0/4160903235 wait complete. 2021-01-03T13:06:23.172 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 21 and data pool 22 2021-01-03T13:06:23.186 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:06:23.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.280+0000 7f57a2cdc700 1 Processor -- start 2021-01-03T13:06:23.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.280+0000 7f57a2cdc700 1 -- start start 2021-01-03T13:06:23.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.280+0000 7f57a2cdc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f579c067710 0x7f579c143940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:23.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.280+0000 7f57a2cdc700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579c05cc20 con 0x7f579c05c840 2021-01-03T13:06:23.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.280+0000 7f57a2cdc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579c142f60 con 0x7f579c146dc0 2021-01-03T13:06:23.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.280+0000 7f57a2cdc700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c0ad5a0 con 0x7f579c067710 2021-01-03T13:06:23.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.280+0000 7f579bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f579c146dc0 0x7f579c13c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59530/0 (socket says 172.21.15.133:59530) 2021-01-03T13:06:23.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.280+0000 7f579bfff700 1 -- 172.21.15.133:0/3543553176 learned_addr learned my addr 172.21.15.133:0/3543553176 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:23.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.280+0000 7f57a1279700 1 --2- 172.21.15.133:0/3543553176 >> v2:172.21.15.16:3300/0 conn(0x7f579c067710 0x7f579c143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:23.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.280+0000 7f579b7fe700 1 -- 172.21.15.133:0/3543553176 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567206816 0 0) 0x7f579c142f60 con 0x7f579c146dc0 2021-01-03T13:06:23.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.280+0000 7f579b7fe700 1 -- 172.21.15.133:0/3543553176 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5780003230 con 0x7f579c146dc0 2021-01-03T13:06:23.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.280+0000 7f57a1279700 1 -- 172.21.15.133:0/3543553176 >> v1:172.21.15.133:6789/0 conn(0x7f579c146dc0 legacy=0x7f579c13c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.280+0000 7f57a1279700 1 -- 172.21.15.133:0/3543553176 >> v1:172.21.15.16:6789/0 conn(0x7f579c05c840 legacy=0x7f579c0b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.280+0000 7f57a1279700 1 -- 172.21.15.133:0/3543553176 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c143200 con 0x7f579c067710 2021-01-03T13:06:23.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.280+0000 7f57a1279700 1 --2- 172.21.15.133:0/3543553176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f579c067710 0x7f579c143940 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f579c06ad30 tx=0x7f57940091a0).ready entity=mon.0 client_cookie=7f31280a6bb4bd3f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:23.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.280+0000 7f579b7fe700 1 -- 172.21.15.133:0/3543553176 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f579400b9b0 con 0x7f579c067710 2021-01-03T13:06:23.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f579b7fe700 1 -- 172.21.15.133:0/3543553176 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579400bb10 con 0x7f579c067710 2021-01-03T13:06:23.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f579b7fe700 1 -- 172.21.15.133:0/3543553176 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f579400bc80 con 0x7f579c067710 2021-01-03T13:06:23.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f57a2cdc700 1 -- 172.21.15.133:0/3543553176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f579c067710 msgr2=0x7f579c143940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f57a2cdc700 1 --2- 172.21.15.133:0/3543553176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f579c067710 0x7f579c143940 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f579c06ad30 tx=0x7f57940091a0).stop 2021-01-03T13:06:23.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f57a2cdc700 1 -- 172.21.15.133:0/3543553176 shutdown_connections 2021-01-03T13:06:23.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f57a2cdc700 1 --2- 172.21.15.133:0/3543553176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f579c067710 0x7f579c143940 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f57a2cdc700 1 -- 172.21.15.133:0/3543553176 >> 172.21.15.133:0/3543553176 conn(0x7f579c06aeb0 msgr2=0x7f579c05bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:23.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f57a2cdc700 1 -- 172.21.15.133:0/3543553176 shutdown_connections 2021-01-03T13:06:23.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f57a2cdc700 1 -- 172.21.15.133:0/3543553176 wait complete. 2021-01-03T13:06:23.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f57a2cdc700 1 Processor -- start 2021-01-03T13:06:23.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f57a2cdc700 1 -- start start 2021-01-03T13:06:23.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f57a2cdc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f579c05c840 0x7f579c13e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:23.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f57a2cdc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579c067710 0x7f579c141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:23.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f57a2cdc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f579c146dc0 0x7f579c1423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:23.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f57a2cdc700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c0b10b0 con 0x7f579c05c840 2021-01-03T13:06:23.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f57a2cdc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c13f080 con 0x7f579c067710 2021-01-03T13:06:23.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f57a2cdc700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c152f70 con 0x7f579c146dc0 2021-01-03T13:06:23.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.284+0000 7f579bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579c067710 0x7f579c141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:23.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f579bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579c067710 0x7f579c141ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38502/0 (socket says 172.21.15.133:38502) 2021-01-03T13:06:23.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f579bfff700 1 -- 172.21.15.133:0/2002815090 learned_addr learned my addr 172.21.15.133:0/2002815090 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:23.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f57a1279700 1 --2- 172.21.15.133:0/2002815090 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f579c146dc0 0x7f579c1423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:23.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f57a0a78700 1 --2- 172.21.15.133:0/2002815090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f579c05c840 0x7f579c13e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:23.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f579bfff700 1 -- 172.21.15.133:0/2002815090 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f579c146dc0 msgr2=0x7f579c1423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f579bfff700 1 --2- 172.21.15.133:0/2002815090 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f579c146dc0 0x7f579c1423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f579bfff700 1 -- 172.21.15.133:0/2002815090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f579c05c840 msgr2=0x7f579c13e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f579bfff700 1 --2- 172.21.15.133:0/2002815090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f579c05c840 0x7f579c13e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f579bfff700 1 -- 172.21.15.133:0/2002815090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c13f2b0 con 0x7f579c067710 2021-01-03T13:06:23.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f579bfff700 1 --2- 172.21.15.133:0/2002815090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579c067710 0x7f579c141ec0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f57880010d0 tx=0x7f5788007a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:23.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f5799ffb700 1 -- 172.21.15.133:0/2002815090 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57880072e0 con 0x7f579c067710 2021-01-03T13:06:23.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f5799ffb700 1 -- 172.21.15.133:0/2002815090 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5788007440 con 0x7f579c067710 2021-01-03T13:06:23.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f5799ffb700 1 -- 172.21.15.133:0/2002815090 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57880057d0 con 0x7f579c067710 2021-01-03T13:06:23.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f57a2cdc700 1 -- 172.21.15.133:0/2002815090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579c13f550 con 0x7f579c067710 2021-01-03T13:06:23.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f57a2cdc700 1 -- 172.21.15.133:0/2002815090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579c1428a0 con 0x7f579c067710 2021-01-03T13:06:23.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f57a2cdc700 1 -- 172.21.15.133:0/2002815090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579c057300 con 0x7f579c067710 2021-01-03T13:06:23.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f5799ffb700 1 -- 172.21.15.133:0/2002815090 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5788010070 con 0x7f579c067710 2021-01-03T13:06:23.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f5799ffb700 1 --2- 172.21.15.133:0/2002815090 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57840554e0 0x7f57840579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:23.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f5799ffb700 1 -- 172.21.15.133:0/2002815090 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f578806d3c0 con 0x7f579c067710 2021-01-03T13:06:23.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.288+0000 7f57a0a78700 1 --2- 172.21.15.133:0/2002815090 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57840554e0 0x7f57840579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:23.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.292+0000 7f57a0a78700 1 --2- 172.21.15.133:0/2002815090 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57840554e0 0x7f57840579a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f579000d000 tx=0x7f5790009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:23.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.296+0000 7f5799ffb700 1 -- 172.21.15.133:0/2002815090 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f57880436c0 con 0x7f579c067710 2021-01-03T13:06:23.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.440+0000 7f57a2cdc700 1 -- 172.21.15.133:0/2002815090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f579c05ce00 con 0x7f579c067710 2021-01-03T13:06:23.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.440+0000 7f5799ffb700 1 -- 172.21.15.133:0/2002815090 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16113 (secure 0 0 0) 0x7f5788018070 con 0x7f579c067710 2021-01-03T13:06:23.447 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:23.447 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":123,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:06:23.150299+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:06:20.666416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-01-03T13:06:21.971060+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:06:23.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.444+0000 7f57a2cdc700 1 -- 172.21.15.133:0/2002815090 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57840554e0 msgr2=0x7f57840579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.444+0000 7f57a2cdc700 1 --2- 172.21.15.133:0/2002815090 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57840554e0 0x7f57840579a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f579000d000 tx=0x7f5790009040).stop 2021-01-03T13:06:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.444+0000 7f57a2cdc700 1 -- 172.21.15.133:0/2002815090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579c067710 msgr2=0x7f579c141ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.444+0000 7f57a2cdc700 1 --2- 172.21.15.133:0/2002815090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579c067710 0x7f579c141ec0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f57880010d0 tx=0x7f5788007a70).stop 2021-01-03T13:06:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.444+0000 7f57a2cdc700 1 -- 172.21.15.133:0/2002815090 shutdown_connections 2021-01-03T13:06:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.444+0000 7f57a2cdc700 1 --2- 172.21.15.133:0/2002815090 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f57840554e0 0x7f57840579a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.444+0000 7f57a2cdc700 1 --2- 172.21.15.133:0/2002815090 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f579c05c840 0x7f579c13e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.444+0000 7f57a2cdc700 1 --2- 172.21.15.133:0/2002815090 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f579c146dc0 0x7f579c1423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.444+0000 7f57a2cdc700 1 --2- 172.21.15.133:0/2002815090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579c067710 0x7f579c141ec0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.444+0000 7f57a2cdc700 1 -- 172.21.15.133:0/2002815090 >> 172.21.15.133:0/2002815090 conn(0x7f579c06aeb0 msgr2=0x7f579c1489e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:23.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.444+0000 7f57a2cdc700 1 -- 172.21.15.133:0/2002815090 shutdown_connections 2021-01-03T13:06:23.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.444+0000 7f57a2cdc700 1 -- 172.21.15.133:0/2002815090 wait complete. 2021-01-03T13:06:23.461 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:06:23.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe751041700 1 Processor -- start 2021-01-03T13:06:23.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe751041700 1 -- start start 2021-01-03T13:06:23.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe751041700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe74c0b5c10 0x7fe74c0aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:23.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe751041700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe74c14aee0 0x7fe74c144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:23.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe751041700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74c098550 con 0x7fe74c0b0670 2021-01-03T13:06:23.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe751041700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74c0b5ff0 con 0x7fe74c0b5c10 2021-01-03T13:06:23.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe751041700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74c0b0b10 con 0x7fe74c14aee0 2021-01-03T13:06:23.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe74b59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe74c14aee0 0x7fe74c144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:23.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe74a59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe74c0b0670 0x7fe74c14a7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59544/0 (socket says 172.21.15.133:59544) 2021-01-03T13:06:23.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe74a59c700 1 -- 172.21.15.133:0/4180545109 learned_addr learned my addr 172.21.15.133:0/4180545109 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:23.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe74ad9d700 1 --2- 172.21.15.133:0/4180545109 >> v2:172.21.15.16:3300/0 conn(0x7fe74c0b5c10 0x7fe74c0aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:23.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe74b59e700 1 -- 172.21.15.133:0/4180545109 >> v2:172.21.15.16:3300/0 conn(0x7fe74c0b5c10 msgr2=0x7fe74c0aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:23.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe74b59e700 1 --2- 172.21.15.133:0/4180545109 >> v2:172.21.15.16:3300/0 conn(0x7fe74c0b5c10 0x7fe74c0aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe74b59e700 1 -- 172.21.15.133:0/4180545109 >> v1:172.21.15.133:6789/0 conn(0x7fe74c0b0670 legacy=0x7fe74c14a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe74b59e700 1 -- 172.21.15.133:0/4180545109 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c098780 con 0x7fe74c14aee0 2021-01-03T13:06:23.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe74b59e700 1 --2- 172.21.15.133:0/4180545109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c14aee0 0x7fe74c144470 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7fe7440032b0 tx=0x7fe7440091a0).ready entity=mon.1 client_cookie=51023d5210080965 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:23.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe749d9b700 1 -- 172.21.15.133:0/4180545109 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe74400ba50 con 0x7fe74c14aee0 2021-01-03T13:06:23.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe749d9b700 1 -- 172.21.15.133:0/4180545109 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74400bbb0 con 0x7fe74c14aee0 2021-01-03T13:06:23.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe749d9b700 1 -- 172.21.15.133:0/4180545109 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe74400bd20 con 0x7fe74c14aee0 2021-01-03T13:06:23.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe751041700 1 -- 172.21.15.133:0/4180545109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c14aee0 msgr2=0x7fe74c144470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe751041700 1 --2- 172.21.15.133:0/4180545109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c14aee0 0x7fe74c144470 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7fe7440032b0 tx=0x7fe7440091a0).stop 2021-01-03T13:06:23.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe751041700 1 -- 172.21.15.133:0/4180545109 shutdown_connections 2021-01-03T13:06:23.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe751041700 1 --2- 172.21.15.133:0/4180545109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c14aee0 0x7fe74c144470 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe751041700 1 --2- 172.21.15.133:0/4180545109 >> v2:172.21.15.16:3300/0 conn(0x7fe74c0b5c10 0x7fe74c0aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe751041700 1 -- 172.21.15.133:0/4180545109 >> 172.21.15.133:0/4180545109 conn(0x7fe74c05c8c0 msgr2=0x7fe74c0b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:23.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe751041700 1 -- 172.21.15.133:0/4180545109 shutdown_connections 2021-01-03T13:06:23.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.568+0000 7fe751041700 1 -- 172.21.15.133:0/4180545109 wait complete. 2021-01-03T13:06:23.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe751041700 1 Processor -- start 2021-01-03T13:06:23.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe751041700 1 -- start start 2021-01-03T13:06:23.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe751041700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe74c0b0670 0x7fe74c1498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:23.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe751041700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0b5c10 0x7fe74c14cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:23.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe751041700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74c14aee0 0x7fe74c14d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:23.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe751041700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c14d640 con 0x7fe74c14aee0 2021-01-03T13:06:23.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe751041700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c0af280 con 0x7fe74c0b5c10 2021-01-03T13:06:23.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe751041700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c0af520 con 0x7fe74c0b0670 2021-01-03T13:06:23.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe74a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0b5c10 0x7fe74c14cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:23.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe74a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0b5c10 0x7fe74c14cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38516/0 (socket says 172.21.15.133:38516) 2021-01-03T13:06:23.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe74a59c700 1 -- 172.21.15.133:0/3451816450 learned_addr learned my addr 172.21.15.133:0/3451816450 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:23.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe74b59e700 1 --2- 172.21.15.133:0/3451816450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74c14aee0 0x7fe74c14d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:23.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe74ad9d700 1 --2- 172.21.15.133:0/3451816450 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe74c0b0670 0x7fe74c1498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:23.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe74a59c700 1 -- 172.21.15.133:0/3451816450 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe74c0b0670 msgr2=0x7fe74c1498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe74a59c700 1 --2- 172.21.15.133:0/3451816450 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe74c0b0670 0x7fe74c1498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe74a59c700 1 -- 172.21.15.133:0/3451816450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74c14aee0 msgr2=0x7fe74c14d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe74a59c700 1 --2- 172.21.15.133:0/3451816450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74c14aee0 0x7fe74c14d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe74a59c700 1 -- 172.21.15.133:0/3451816450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c0af7c0 con 0x7fe74c0b5c10 2021-01-03T13:06:23.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe74b59e700 1 --2- 172.21.15.133:0/3451816450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74c14aee0 0x7fe74c14d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:23.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe74a59c700 1 --2- 172.21.15.133:0/3451816450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0b5c10 0x7fe74c14cc60 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7fe74c06b250 tx=0x7fe740007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:23.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe73bfff700 1 -- 172.21.15.133:0/3451816450 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe740007320 con 0x7fe74c0b5c10 2021-01-03T13:06:23.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe73bfff700 1 -- 172.21.15.133:0/3451816450 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe740007480 con 0x7fe74c0b5c10 2021-01-03T13:06:23.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe751041700 1 -- 172.21.15.133:0/3451816450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74c0acfe0 con 0x7fe74c0b5c10 2021-01-03T13:06:23.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe73bfff700 1 -- 172.21.15.133:0/3451816450 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7400057d0 con 0x7fe74c0b5c10 2021-01-03T13:06:23.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe751041700 1 -- 172.21.15.133:0/3451816450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74c14a450 con 0x7fe74c0b5c10 2021-01-03T13:06:23.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe751041700 1 -- 172.21.15.133:0/3451816450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74c14da20 con 0x7fe74c0b5c10 2021-01-03T13:06:23.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.572+0000 7fe73bfff700 1 -- 172.21.15.133:0/3451816450 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe740010030 con 0x7fe74c0b5c10 2021-01-03T13:06:23.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.576+0000 7fe73bfff700 1 --2- 172.21.15.133:0/3451816450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe728055440 0x7fe728057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:23.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.576+0000 7fe74ad9d700 1 --2- 172.21.15.133:0/3451816450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe728055440 0x7fe728057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:23.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.576+0000 7fe73bfff700 1 -- 172.21.15.133:0/3451816450 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe74006dbd0 con 0x7fe74c0b5c10 2021-01-03T13:06:23.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.576+0000 7fe74ad9d700 1 --2- 172.21.15.133:0/3451816450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe728055440 0x7fe728057900 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7fe73c00c000 tx=0x7fe73c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:23.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.580+0000 7fe73bfff700 1 -- 172.21.15.133:0/3451816450 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe740043ed0 con 0x7fe74c0b5c10 2021-01-03T13:06:23.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.720+0000 7fe751041700 1 -- 172.21.15.133:0/3451816450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe74c057300 con 0x7fe74c0b5c10 2021-01-03T13:06:23.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.724+0000 7fe73bfff700 1 -- 172.21.15.133:0/3451816450 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16113 (secure 0 0 0) 0x7fe7400474f0 con 0x7fe74c0b5c10 2021-01-03T13:06:23.729 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:23.729 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":123,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:06:23.150299+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:06:20.666416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-01-03T13:06:21.971060+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:06:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.724+0000 7fe751041700 1 -- 172.21.15.133:0/3451816450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe728055440 msgr2=0x7fe728057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.724+0000 7fe751041700 1 --2- 172.21.15.133:0/3451816450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe728055440 0x7fe728057900 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7fe73c00c000 tx=0x7fe73c008040).stop 2021-01-03T13:06:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.724+0000 7fe751041700 1 -- 172.21.15.133:0/3451816450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0b5c10 msgr2=0x7fe74c14cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.724+0000 7fe751041700 1 --2- 172.21.15.133:0/3451816450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0b5c10 0x7fe74c14cc60 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7fe74c06b250 tx=0x7fe740007c10).stop 2021-01-03T13:06:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.724+0000 7fe751041700 1 -- 172.21.15.133:0/3451816450 shutdown_connections 2021-01-03T13:06:23.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.724+0000 7fe751041700 1 --2- 172.21.15.133:0/3451816450 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe728055440 0x7fe728057900 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.724+0000 7fe751041700 1 --2- 172.21.15.133:0/3451816450 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe74c14aee0 0x7fe74c14d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.724+0000 7fe751041700 1 --2- 172.21.15.133:0/3451816450 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe74c0b0670 0x7fe74c1498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.724+0000 7fe751041700 1 --2- 172.21.15.133:0/3451816450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe74c0b5c10 0x7fe74c14cc60 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.724+0000 7fe751041700 1 -- 172.21.15.133:0/3451816450 >> 172.21.15.133:0/3451816450 conn(0x7fe74c05c8c0 msgr2=0x7fe74c145030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:23.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.724+0000 7fe751041700 1 -- 172.21.15.133:0/3451816450 shutdown_connections 2021-01-03T13:06:23.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.724+0000 7fe751041700 1 -- 172.21.15.133:0/3451816450 wait complete. 2021-01-03T13:06:23.743 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-01-03T13:06:23.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.860+0000 7f68755ea700 1 Processor -- start 2021-01-03T13:06:23.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.860+0000 7f68755ea700 1 -- start start 2021-01-03T13:06:23.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.860+0000 7f68755ea700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f687009a090 0x7f6870140580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:23.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.860+0000 7f68755ea700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6870060d10 0x7f687005fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:23.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.860+0000 7f68755ea700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687005f5e0 con 0x7f68700b5330 2021-01-03T13:06:23.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.860+0000 7f68755ea700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6870143730 con 0x7f687009a090 2021-01-03T13:06:23.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.860+0000 7f68755ea700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6870140a70 con 0x7f6870060d10 2021-01-03T13:06:23.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.860+0000 7f6874de9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6870060d10 0x7f687005fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:23.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.860+0000 7f686f7fe700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f687009a090 0x7f6870140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:23.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.860+0000 7f6874de9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6870060d10 0x7f687005fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:46828/0 (socket says 172.21.15.133:46828) 2021-01-03T13:06:23.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.860+0000 7f6874de9700 1 -- 172.21.15.133:0/1954972858 learned_addr learned my addr 172.21.15.133:0/1954972858 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:23.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.860+0000 7f686ffff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f68700b5330 0x7f687013fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:38282/0 (socket says 172.21.15.133:38282) 2021-01-03T13:06:23.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.864+0000 7f6874de9700 1 -- 172.21.15.133:0/1954972858 >> v2:172.21.15.16:3300/0 conn(0x7f687009a090 msgr2=0x7f6870140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:23.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.864+0000 7f6874de9700 1 --2- 172.21.15.133:0/1954972858 >> v2:172.21.15.16:3300/0 conn(0x7f687009a090 0x7f6870140580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.864+0000 7f6874de9700 1 -- 172.21.15.133:0/1954972858 >> v1:172.21.15.16:6789/0 conn(0x7f68700b5330 legacy=0x7f687013fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.864+0000 7f6874de9700 1 -- 172.21.15.133:0/1954972858 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68700b5710 con 0x7f6870060d10 2021-01-03T13:06:23.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.864+0000 7f686f7fe700 1 --2- 172.21.15.133:0/1954972858 >> v2:172.21.15.16:3300/0 conn(0x7f687009a090 0x7f6870140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:06:23.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.864+0000 7f6874de9700 1 --2- 172.21.15.133:0/1954972858 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6870060d10 0x7f687005fa10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f68680032b0 tx=0x7f6868009270).ready entity=mon.2 client_cookie=3b89948b1cc91332 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:23.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.864+0000 7f686effd700 1 -- 172.21.15.133:0/1954972858 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6868009e60 con 0x7f6870060d10 2021-01-03T13:06:23.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.864+0000 7f686effd700 1 -- 172.21.15.133:0/1954972858 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686800bc00 con 0x7f6870060d10 2021-01-03T13:06:23.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.864+0000 7f686effd700 1 -- 172.21.15.133:0/1954972858 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f686800bd70 con 0x7f6870060d10 2021-01-03T13:06:23.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.864+0000 7f68755ea700 1 -- 172.21.15.133:0/1954972858 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6870060d10 msgr2=0x7f687005fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.864+0000 7f68755ea700 1 --2- 172.21.15.133:0/1954972858 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6870060d10 0x7f687005fa10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f68680032b0 tx=0x7f6868009270).stop 2021-01-03T13:06:23.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.864+0000 7f68755ea700 1 -- 172.21.15.133:0/1954972858 shutdown_connections 2021-01-03T13:06:23.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.864+0000 7f68755ea700 1 --2- 172.21.15.133:0/1954972858 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6870060d10 0x7f687005fa10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.864+0000 7f68755ea700 1 --2- 172.21.15.133:0/1954972858 >> v2:172.21.15.16:3300/0 conn(0x7f687009a090 0x7f6870140580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.864+0000 7f68755ea700 1 -- 172.21.15.133:0/1954972858 >> 172.21.15.133:0/1954972858 conn(0x7f687005bdf0 msgr2=0x7f687005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:23.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.864+0000 7f68755ea700 1 -- 172.21.15.133:0/1954972858 shutdown_connections 2021-01-03T13:06:23.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.864+0000 7f68755ea700 1 -- 172.21.15.133:0/1954972858 wait complete. 2021-01-03T13:06:23.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f68755ea700 1 Processor -- start 2021-01-03T13:06:23.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f68755ea700 1 -- start start 2021-01-03T13:06:23.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f68755ea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6870060d10 0x7f6870149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:23.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f68755ea700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f687009a090 0x7f6870155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:23.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f68755ea700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68700b5330 0x7f6870151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:23.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f68755ea700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68701552a0 con 0x7f68700b5330 2021-01-03T13:06:23.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f68755ea700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6870156100 con 0x7f6870060d10 2021-01-03T13:06:23.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f686ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6870060d10 0x7f6870149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:23.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f686ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6870060d10 0x7f6870149d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38528/0 (socket says 172.21.15.133:38528) 2021-01-03T13:06:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f68755ea700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6870146e30 con 0x7f687009a090 2021-01-03T13:06:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f686ffff700 1 -- 172.21.15.133:0/2018583952 learned_addr learned my addr 172.21.15.133:0/2018583952 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f686f7fe700 1 --2- 172.21.15.133:0/2018583952 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f687009a090 0x7f6870155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f6874de9700 1 --2- 172.21.15.133:0/2018583952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68700b5330 0x7f6870151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:23.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f686ffff700 1 -- 172.21.15.133:0/2018583952 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f687009a090 msgr2=0x7f6870155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f686ffff700 1 --2- 172.21.15.133:0/2018583952 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f687009a090 0x7f6870155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f686ffff700 1 -- 172.21.15.133:0/2018583952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68700b5330 msgr2=0x7f6870151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:23.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f686ffff700 1 --2- 172.21.15.133:0/2018583952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68700b5330 0x7f6870151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:23.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f686ffff700 1 -- 172.21.15.133:0/2018583952 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68701554d0 con 0x7f6870060d10 2021-01-03T13:06:23.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f6874de9700 1 --2- 172.21.15.133:0/2018583952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68700b5330 0x7f6870151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:23.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f686ffff700 1 --2- 172.21.15.133:0/2018583952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6870060d10 0x7f6870149d50 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f6870061ec0 tx=0x7f6858007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:23.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f686d7fa700 1 -- 172.21.15.133:0/2018583952 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68580072e0 con 0x7f6870060d10 2021-01-03T13:06:23.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f686d7fa700 1 -- 172.21.15.133:0/2018583952 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6858005520 con 0x7f6870060d10 2021-01-03T13:06:23.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f686d7fa700 1 -- 172.21.15.133:0/2018583952 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6858007440 con 0x7f6870060d10 2021-01-03T13:06:23.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f68755ea700 1 -- 172.21.15.133:0/2018583952 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6870155770 con 0x7f6870060d10 2021-01-03T13:06:23.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.868+0000 7f68755ea700 1 -- 172.21.15.133:0/2018583952 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6870152240 con 0x7f6870060d10 2021-01-03T13:06:23.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.872+0000 7f686d7fa700 1 -- 172.21.15.133:0/2018583952 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6858010070 con 0x7f6870060d10 2021-01-03T13:06:23.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.872+0000 7f68755ea700 1 -- 172.21.15.133:0/2018583952 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6870146bf0 con 0x7f6870060d10 2021-01-03T13:06:23.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.872+0000 7f686d7fa700 1 --2- 172.21.15.133:0/2018583952 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f68540554e0 0x7f68540579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:23.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.872+0000 7f686d7fa700 1 -- 172.21.15.133:0/2018583952 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f685806d510 con 0x7f6870060d10 2021-01-03T13:06:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.872+0000 7f686f7fe700 1 --2- 172.21.15.133:0/2018583952 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f68540554e0 0x7f68540579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.872+0000 7f686f7fe700 1 --2- 172.21.15.133:0/2018583952 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f68540554e0 0x7f68540579a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f686000b000 tx=0x7f6860006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:23.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:23.876+0000 7f686d7fa700 1 -- 172.21.15.133:0/2018583952 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6870146bf0 con 0x7f6870060d10 2021-01-03T13:06:24.065 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.060+0000 7f68755ea700 1 -- 172.21.15.133:0/2018583952 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6870146bf0 con 0x7f6870060d10 2021-01-03T13:06:24.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.616+0000 7f686d7fa700 1 -- 172.21.15.133:0/2018583952 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v56) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6870146bf0 con 0x7f6870060d10 2021-01-03T13:06:24.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.620+0000 7f68755ea700 1 -- 172.21.15.133:0/2018583952 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f68540554e0 msgr2=0x7f68540579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:24.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.620+0000 7f68755ea700 1 --2- 172.21.15.133:0/2018583952 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f68540554e0 0x7f68540579a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f686000b000 tx=0x7f6860006dc0).stop 2021-01-03T13:06:24.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.620+0000 7f68755ea700 1 -- 172.21.15.133:0/2018583952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6870060d10 msgr2=0x7f6870149d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:24.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.620+0000 7f68755ea700 1 --2- 172.21.15.133:0/2018583952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6870060d10 0x7f6870149d50 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f6870061ec0 tx=0x7f6858007c30).stop 2021-01-03T13:06:24.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.620+0000 7f68755ea700 1 -- 172.21.15.133:0/2018583952 shutdown_connections 2021-01-03T13:06:24.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.620+0000 7f68755ea700 1 --2- 172.21.15.133:0/2018583952 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f68540554e0 0x7f68540579a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:24.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.620+0000 7f68755ea700 1 --2- 172.21.15.133:0/2018583952 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68700b5330 0x7f6870151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:24.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.620+0000 7f68755ea700 1 --2- 172.21.15.133:0/2018583952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6870060d10 0x7f6870149d50 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:24.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.620+0000 7f68755ea700 1 --2- 172.21.15.133:0/2018583952 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f687009a090 0x7f6870155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:24.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.620+0000 7f68755ea700 1 -- 172.21.15.133:0/2018583952 >> 172.21.15.133:0/2018583952 conn(0x7f687005bdf0 msgr2=0x7f6870140bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:24.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.620+0000 7f68755ea700 1 -- 172.21.15.133:0/2018583952 shutdown_connections 2021-01-03T13:06:24.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.620+0000 7f68755ea700 1 -- 172.21.15.133:0/2018583952 wait complete. 2021-01-03T13:06:24.643 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:06:24.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f3277fff700 1 Processor -- start 2021-01-03T13:06:24.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f3277fff700 1 -- start start 2021-01-03T13:06:24.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f3277fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f32780b52c0 0x7f32780b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:24.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f3277fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3278060da0 con 0x7f32780b0c90 2021-01-03T13:06:24.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f3277fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32780b0ad0 con 0x7f32780b5c00 2021-01-03T13:06:24.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f3277fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3278067a90 con 0x7f32780b52c0 2021-01-03T13:06:24.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f32777fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f32780b5c00 0x7f3278143eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59572/0 (socket says 172.21.15.133:59572) 2021-01-03T13:06:24.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f32777fe700 1 -- 172.21.15.133:0/423890725 learned_addr learned my addr 172.21.15.133:0/423890725 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:24.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f3276ffd700 1 --2- 172.21.15.133:0/423890725 >> v2:172.21.15.16:3300/0 conn(0x7f32780b52c0 0x7f32780b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:24.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f32767fc700 1 -- 172.21.15.133:0/423890725 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748527201 0 0) 0x7f3270001450 con 0x7f32780b5c00 2021-01-03T13:06:24.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f32767fc700 1 -- 172.21.15.133:0/423890725 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3258003230 con 0x7f32780b5c00 2021-01-03T13:06:24.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f3276ffd700 1 -- 172.21.15.133:0/423890725 >> v1:172.21.15.133:6789/0 conn(0x7f32780b5c00 legacy=0x7f3278143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:24.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f3276ffd700 1 -- 172.21.15.133:0/423890725 >> v1:172.21.15.16:6789/0 conn(0x7f32780b0c90 legacy=0x7f3278098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:24.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f3276ffd700 1 -- 172.21.15.133:0/423890725 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32780b56a0 con 0x7f32780b52c0 2021-01-03T13:06:24.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f3276ffd700 1 --2- 172.21.15.133:0/423890725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f32780b52c0 0x7f32780b05e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f3268002f30 tx=0x7f3268006dc0).ready entity=mon.0 client_cookie=e86d5b76a56dd44d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:24.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f32767fc700 1 -- 172.21.15.133:0/423890725 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3268009800 con 0x7f32780b52c0 2021-01-03T13:06:24.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f32767fc700 1 -- 172.21.15.133:0/423890725 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3268009960 con 0x7f32780b52c0 2021-01-03T13:06:24.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f3277fff700 1 -- 172.21.15.133:0/423890725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f32780b52c0 msgr2=0x7f32780b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:24.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f32767fc700 1 -- 172.21.15.133:0/423890725 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3268009cc0 con 0x7f32780b52c0 2021-01-03T13:06:24.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.756+0000 7f3277fff700 1 --2- 172.21.15.133:0/423890725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f32780b52c0 0x7f32780b05e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f3268002f30 tx=0x7f3268006dc0).stop 2021-01-03T13:06:24.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f3277fff700 1 -- 172.21.15.133:0/423890725 shutdown_connections 2021-01-03T13:06:24.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f3277fff700 1 --2- 172.21.15.133:0/423890725 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f32780b52c0 0x7f32780b05e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:24.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f3277fff700 1 -- 172.21.15.133:0/423890725 >> 172.21.15.133:0/423890725 conn(0x7f327805bdf0 msgr2=0x7f327805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:24.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f3277fff700 1 -- 172.21.15.133:0/423890725 shutdown_connections 2021-01-03T13:06:24.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f3277fff700 1 -- 172.21.15.133:0/423890725 wait complete. 2021-01-03T13:06:24.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f3277fff700 1 Processor -- start 2021-01-03T13:06:24.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f3277fff700 1 -- start start 2021-01-03T13:06:24.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f3277fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f32780b0c90 0x7f32780b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:24.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f3277fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f32780b52c0 0x7f32780ae310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:24.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f3277fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32780b5c00 0x7f32781421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:24.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f3277fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32780671e0 con 0x7f32780b52c0 2021-01-03T13:06:24.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f3277fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32780aefb0 con 0x7f32780b5c00 2021-01-03T13:06:24.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f3277fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3278066f40 con 0x7f32780b0c90 2021-01-03T13:06:24.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f32777fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32780b5c00 0x7f32781421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:24.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f32777fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32780b5c00 0x7f32781421f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38546/0 (socket says 172.21.15.133:38546) 2021-01-03T13:06:24.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f32777fe700 1 -- 172.21.15.133:0/2755346084 learned_addr learned my addr 172.21.15.133:0/2755346084 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:24.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f326e7fc700 1 --2- 172.21.15.133:0/2755346084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f32780b52c0 0x7f32780ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:24.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f3276ffd700 1 --2- 172.21.15.133:0/2755346084 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f32780b0c90 0x7f32780b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:24.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f32777fe700 1 -- 172.21.15.133:0/2755346084 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f32780b0c90 msgr2=0x7f32780b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:24.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f32777fe700 1 --2- 172.21.15.133:0/2755346084 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f32780b0c90 0x7f32780b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:24.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f32777fe700 1 -- 172.21.15.133:0/2755346084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f32780b52c0 msgr2=0x7f32780ae310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:24.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f32777fe700 1 --2- 172.21.15.133:0/2755346084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f32780b52c0 0x7f32780ae310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:24.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f32777fe700 1 -- 172.21.15.133:0/2755346084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3278066bb0 con 0x7f32780b5c00 2021-01-03T13:06:24.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.760+0000 7f32777fe700 1 --2- 172.21.15.133:0/2755346084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32780b5c00 0x7f32781421f0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f32700015e0 tx=0x7f3270007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:24.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.764+0000 7f3274ff9700 1 -- 172.21.15.133:0/2755346084 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3270005960 con 0x7f32780b5c00 2021-01-03T13:06:24.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.764+0000 7f3274ff9700 1 -- 172.21.15.133:0/2755346084 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270005ac0 con 0x7f32780b5c00 2021-01-03T13:06:24.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.764+0000 7f3277fff700 1 -- 172.21.15.133:0/2755346084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3278064d40 con 0x7f32780b5c00 2021-01-03T13:06:24.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.764+0000 7f3274ff9700 1 -- 172.21.15.133:0/2755346084 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3270005e20 con 0x7f32780b5c00 2021-01-03T13:06:24.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.764+0000 7f3277fff700 1 -- 172.21.15.133:0/2755346084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3278064a30 con 0x7f32780b5c00 2021-01-03T13:06:24.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.764+0000 7f3277fff700 1 -- 172.21.15.133:0/2755346084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32780ae9a0 con 0x7f32780b5c00 2021-01-03T13:06:24.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.764+0000 7f3274ff9700 1 -- 172.21.15.133:0/2755346084 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3270010030 con 0x7f32780b5c00 2021-01-03T13:06:24.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.764+0000 7f3274ff9700 1 --2- 172.21.15.133:0/2755346084 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f325c0553b0 0x7f325c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:24.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.764+0000 7f3274ff9700 1 -- 172.21.15.133:0/2755346084 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f327006dd50 con 0x7f32780b5c00 2021-01-03T13:06:24.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.764+0000 7f3276ffd700 1 --2- 172.21.15.133:0/2755346084 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f325c0553b0 0x7f325c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:24.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.768+0000 7f3276ffd700 1 --2- 172.21.15.133:0/2755346084 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f325c0553b0 0x7f325c057870 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f326801a000 tx=0x7f3268015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:24.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.772+0000 7f3274ff9700 1 -- 172.21.15.133:0/2755346084 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3270043ec0 con 0x7f32780b5c00 2021-01-03T13:06:24.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.960+0000 7f3277fff700 1 -- 172.21.15.133:0/2755346084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32780b0ad0 con 0x7f32780b5c00 2021-01-03T13:06:24.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.960+0000 7f3274ff9700 1 -- 172.21.15.133:0/2755346084 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f32780b0ad0 con 0x7f32780b5c00 2021-01-03T13:06:24.967 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:24.967 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":56,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/34326903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":34326903},{"type":"v1","addr":"172.21.15.16:6833","nonce":34326903}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7426,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6836/1683013797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1683013797},{"type":"v1","addr":"172.21.15.133:6836","nonce":1683013797}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:06:23.150709+0000","modified":"2021-01-03T13:06:24.614525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7429},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7429":{"gid":7429,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1725513894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1725513894},{"type":"v1","addr":"172.21.15.133:6837","nonce":1725513894}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-01-03T13:06:24.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.964+0000 7f3277fff700 1 -- 172.21.15.133:0/2755346084 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f325c0553b0 msgr2=0x7f325c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:24.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.964+0000 7f3277fff700 1 --2- 172.21.15.133:0/2755346084 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f325c0553b0 0x7f325c057870 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f326801a000 tx=0x7f3268015000).stop 2021-01-03T13:06:24.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.964+0000 7f3277fff700 1 -- 172.21.15.133:0/2755346084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32780b5c00 msgr2=0x7f32781421f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:24.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.964+0000 7f3277fff700 1 --2- 172.21.15.133:0/2755346084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32780b5c00 0x7f32781421f0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f32700015e0 tx=0x7f3270007bd0).stop 2021-01-03T13:06:24.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.964+0000 7f3277fff700 1 -- 172.21.15.133:0/2755346084 shutdown_connections 2021-01-03T13:06:24.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.964+0000 7f3277fff700 1 --2- 172.21.15.133:0/2755346084 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f325c0553b0 0x7f325c057870 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:24.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.964+0000 7f3277fff700 1 --2- 172.21.15.133:0/2755346084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32780b5c00 0x7f32781421f0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:24.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.964+0000 7f3277fff700 1 --2- 172.21.15.133:0/2755346084 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f32780b0c90 0x7f32780b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:24.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.964+0000 7f3277fff700 1 --2- 172.21.15.133:0/2755346084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f32780b52c0 0x7f32780ae310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:24.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.964+0000 7f3277fff700 1 -- 172.21.15.133:0/2755346084 >> 172.21.15.133:0/2755346084 conn(0x7f327805bdf0 msgr2=0x7f3278146b40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:24.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.964+0000 7f3277fff700 1 -- 172.21.15.133:0/2755346084 shutdown_connections 2021-01-03T13:06:24.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:24.964+0000 7f3277fff700 1 -- 172.21.15.133:0/2755346084 wait complete. 2021-01-03T13:06:24.972 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 56 2021-01-03T13:06:24.980 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:06:25.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.084+0000 7f60165ab700 1 Processor -- start 2021-01-03T13:06:25.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.084+0000 7f60165ab700 1 -- start start 2021-01-03T13:06:25.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.084+0000 7f60165ab700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6010063270 0x7f60100ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:25.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.084+0000 7f60165ab700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60100b0250 0x7f60100ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:25.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.084+0000 7f60165ab700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6010063650 con 0x7f60100accf0 2021-01-03T13:06:25.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.084+0000 7f60165ab700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60100afd30 con 0x7f6010063270 2021-01-03T13:06:25.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.084+0000 7f60165ab700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60100b30e0 con 0x7f60100b0250 2021-01-03T13:06:25.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.084+0000 7f6015daa700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f60100accf0 0x7f60100b5820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59586/0 (socket says 172.21.15.133:59586) 2021-01-03T13:06:25.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.084+0000 7f6015daa700 1 -- 172.21.15.133:0/1358188190 learned_addr learned my addr 172.21.15.133:0/1358188190 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:25.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.084+0000 7f60155a9700 1 --2- 172.21.15.133:0/1358188190 >> v2:172.21.15.16:3300/0 conn(0x7f6010063270 0x7f60100ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:25.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.084+0000 7f6014da8700 1 --2- 172.21.15.133:0/1358188190 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60100b0250 0x7f60100ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:25.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.084+0000 7f6003fff700 1 -- 172.21.15.133:0/1358188190 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511468104 0 0) 0x7f6010063650 con 0x7f60100accf0 2021-01-03T13:06:25.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.084+0000 7f6003fff700 1 -- 172.21.15.133:0/1358188190 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff4003230 con 0x7f60100accf0 2021-01-03T13:06:25.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.084+0000 7f60155a9700 1 -- 172.21.15.133:0/1358188190 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60100b0250 msgr2=0x7f60100ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:25.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.084+0000 7f60155a9700 1 --2- 172.21.15.133:0/1358188190 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60100b0250 0x7f60100ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.084+0000 7f60155a9700 1 -- 172.21.15.133:0/1358188190 >> v1:172.21.15.133:6789/0 conn(0x7f60100accf0 legacy=0x7f60100b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.084+0000 7f60155a9700 1 -- 172.21.15.133:0/1358188190 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60100af5f0 con 0x7f6010063270 2021-01-03T13:06:25.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60155a9700 1 --2- 172.21.15.133:0/1358188190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6010063270 0x7f60100ae3f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f6004002f30 tx=0x7f6004006dc0).ready entity=mon.0 client_cookie=84a3d4d22d454e4d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:25.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f6003fff700 1 -- 172.21.15.133:0/1358188190 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f600400f9c0 con 0x7f6010063270 2021-01-03T13:06:25.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f6003fff700 1 -- 172.21.15.133:0/1358188190 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600400fb20 con 0x7f6010063270 2021-01-03T13:06:25.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60165ab700 1 -- 172.21.15.133:0/1358188190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6010063270 msgr2=0x7f60100ae3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60165ab700 1 --2- 172.21.15.133:0/1358188190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6010063270 0x7f60100ae3f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f6004002f30 tx=0x7f6004006dc0).stop 2021-01-03T13:06:25.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f6003fff700 1 -- 172.21.15.133:0/1358188190 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f600400fe80 con 0x7f6010063270 2021-01-03T13:06:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60165ab700 1 -- 172.21.15.133:0/1358188190 shutdown_connections 2021-01-03T13:06:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60165ab700 1 --2- 172.21.15.133:0/1358188190 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6010063270 0x7f60100ae3f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60165ab700 1 --2- 172.21.15.133:0/1358188190 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60100b0250 0x7f60100ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60165ab700 1 -- 172.21.15.133:0/1358188190 >> 172.21.15.133:0/1358188190 conn(0x7f60100617b0 msgr2=0x7f601006aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:25.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60165ab700 1 -- 172.21.15.133:0/1358188190 shutdown_connections 2021-01-03T13:06:25.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60165ab700 1 -- 172.21.15.133:0/1358188190 wait complete. 2021-01-03T13:06:25.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60165ab700 1 Processor -- start 2021-01-03T13:06:25.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60165ab700 1 -- start start 2021-01-03T13:06:25.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60165ab700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6010063270 0x7f60100aa620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:25.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60165ab700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60100accf0 0x7f60100abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:25.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60165ab700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60100b0250 0x7f6010141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:25.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60165ab700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60100aac10 con 0x7f60100b0250 2021-01-03T13:06:25.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60165ab700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60100ab550 con 0x7f60100accf0 2021-01-03T13:06:25.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60165ab700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60100ab7f0 con 0x7f6010063270 2021-01-03T13:06:25.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f6014da8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60100accf0 0x7f60100abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:25.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f6014da8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60100accf0 0x7f60100abc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38556/0 (socket says 172.21.15.133:38556) 2021-01-03T13:06:25.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f6014da8700 1 -- 172.21.15.133:0/227614176 learned_addr learned my addr 172.21.15.133:0/227614176 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:25.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f6015daa700 1 --2- 172.21.15.133:0/227614176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60100b0250 0x7f6010141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:25.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.088+0000 7f60155a9700 1 --2- 172.21.15.133:0/227614176 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6010063270 0x7f60100aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:25.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f6014da8700 1 -- 172.21.15.133:0/227614176 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6010063270 msgr2=0x7f60100aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f6014da8700 1 --2- 172.21.15.133:0/227614176 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6010063270 0x7f60100aa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f6014da8700 1 -- 172.21.15.133:0/227614176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60100b0250 msgr2=0x7f6010141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f6014da8700 1 --2- 172.21.15.133:0/227614176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60100b0250 0x7f6010141770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f6014da8700 1 -- 172.21.15.133:0/227614176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60100ab150 con 0x7f60100accf0 2021-01-03T13:06:25.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f6015daa700 1 --2- 172.21.15.133:0/227614176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60100b0250 0x7f6010141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:25.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f6014da8700 1 --2- 172.21.15.133:0/227614176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60100accf0 0x7f60100abc90 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f600c00c000 tx=0x7f600c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:25.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f60027fc700 1 -- 172.21.15.133:0/227614176 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f600c00ca00 con 0x7f60100accf0 2021-01-03T13:06:25.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f60027fc700 1 -- 172.21.15.133:0/227614176 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600c00cb60 con 0x7f60100accf0 2021-01-03T13:06:25.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f60165ab700 1 -- 172.21.15.133:0/227614176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6010141c60 con 0x7f60100accf0 2021-01-03T13:06:25.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f60027fc700 1 -- 172.21.15.133:0/227614176 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f600c0123f0 con 0x7f60100accf0 2021-01-03T13:06:25.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f60165ab700 1 -- 172.21.15.133:0/227614176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60101550c0 con 0x7f60100accf0 2021-01-03T13:06:25.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f60165ab700 1 -- 172.21.15.133:0/227614176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60100aae10 con 0x7f60100accf0 2021-01-03T13:06:25.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f60027fc700 1 -- 172.21.15.133:0/227614176 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f600c022070 con 0x7f60100accf0 2021-01-03T13:06:25.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f60027fc700 1 --2- 172.21.15.133:0/227614176 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ff80553b0 0x7f5ff8057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:25.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f60027fc700 1 -- 172.21.15.133:0/227614176 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f600c06e560 con 0x7f60100accf0 2021-01-03T13:06:25.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f60155a9700 1 --2- 172.21.15.133:0/227614176 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ff80553b0 0x7f5ff8057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:25.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.092+0000 7f60155a9700 1 --2- 172.21.15.133:0/227614176 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ff80553b0 0x7f5ff8057870 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f6004019000 tx=0x7f6004017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:25.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.100+0000 7f60027fc700 1 -- 172.21.15.133:0/227614176 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f600c044800 con 0x7f60100accf0 2021-01-03T13:06:25.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.244+0000 7f60165ab700 1 -- 172.21.15.133:0/227614176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60100ab9b0 con 0x7f60100accf0 2021-01-03T13:06:25.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.244+0000 7f60027fc700 1 -- 172.21.15.133:0/227614176 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f600c047e20 con 0x7f60100accf0 2021-01-03T13:06:25.252 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:25.253 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":124,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:06:24.154062+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:06:20.666416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-01-03T13:06:21.971060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:06:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.248+0000 7f60165ab700 1 -- 172.21.15.133:0/227614176 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ff80553b0 msgr2=0x7f5ff8057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.248+0000 7f60165ab700 1 --2- 172.21.15.133:0/227614176 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ff80553b0 0x7f5ff8057870 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f6004019000 tx=0x7f6004017000).stop 2021-01-03T13:06:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.248+0000 7f60165ab700 1 -- 172.21.15.133:0/227614176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60100accf0 msgr2=0x7f60100abc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.248+0000 7f60165ab700 1 --2- 172.21.15.133:0/227614176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60100accf0 0x7f60100abc90 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f600c00c000 tx=0x7f600c0091a0).stop 2021-01-03T13:06:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.248+0000 7f60165ab700 1 -- 172.21.15.133:0/227614176 shutdown_connections 2021-01-03T13:06:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.248+0000 7f60165ab700 1 --2- 172.21.15.133:0/227614176 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5ff80553b0 0x7f5ff8057870 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.248+0000 7f60165ab700 1 --2- 172.21.15.133:0/227614176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60100b0250 0x7f6010141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.248+0000 7f60165ab700 1 --2- 172.21.15.133:0/227614176 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6010063270 0x7f60100aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.248+0000 7f60165ab700 1 --2- 172.21.15.133:0/227614176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60100accf0 0x7f60100abc90 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.248+0000 7f60165ab700 1 -- 172.21.15.133:0/227614176 >> 172.21.15.133:0/227614176 conn(0x7f60100617b0 msgr2=0x7f6010143900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.248+0000 7f60165ab700 1 -- 172.21.15.133:0/227614176 shutdown_connections 2021-01-03T13:06:25.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.248+0000 7f60165ab700 1 -- 172.21.15.133:0/227614176 wait complete. 2021-01-03T13:06:25.266 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:06:25.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.380+0000 7fda5e023700 1 Processor -- start 2021-01-03T13:06:25.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.380+0000 7fda5e023700 1 -- start start 2021-01-03T13:06:25.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.380+0000 7fda5e023700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda580abff0 0x7fda580b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:25.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.380+0000 7fda5e023700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5809a380 con 0x7fda580b5120 2021-01-03T13:06:25.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.380+0000 7fda5e023700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda58060090 con 0x7fda58060b00 2021-01-03T13:06:25.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.380+0000 7fda5e023700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda58062340 con 0x7fda580abff0 2021-01-03T13:06:25.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.380+0000 7fda5cdc1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fda580abff0 0x7fda580b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:25.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.380+0000 7fda4ffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fda58060b00 0x7fda580af9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59598/0 (socket says 172.21.15.133:59598) 2021-01-03T13:06:25.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.380+0000 7fda4ffff700 1 -- 172.21.15.133:0/192841962 learned_addr learned my addr 172.21.15.133:0/192841962 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:25.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.380+0000 7fda5cdc1700 1 -- 172.21.15.133:0/192841962 >> v1:172.21.15.133:6789/0 conn(0x7fda58060b00 legacy=0x7fda580af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.380+0000 7fda5cdc1700 1 -- 172.21.15.133:0/192841962 >> v1:172.21.15.16:6789/0 conn(0x7fda580b5120 legacy=0x7fda580ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.380+0000 7fda577fe700 1 -- 172.21.15.133:0/192841962 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108058013 0 0) 0x7fda58060090 con 0x7fda58060b00 2021-01-03T13:06:25.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.380+0000 7fda5cdc1700 1 -- 172.21.15.133:0/192841962 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda58060330 con 0x7fda580abff0 2021-01-03T13:06:25.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.384+0000 7fda5cdc1700 1 --2- 172.21.15.133:0/192841962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda580abff0 0x7fda580b0100 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7fda500032b0 tx=0x7fda500091a0).ready entity=mon.1 client_cookie=1fdcfd24cb6b7e08 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:25.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.384+0000 7fda577fe700 1 -- 172.21.15.133:0/192841962 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda5000ba50 con 0x7fda580abff0 2021-01-03T13:06:25.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.384+0000 7fda577fe700 1 -- 172.21.15.133:0/192841962 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5000bbb0 con 0x7fda580abff0 2021-01-03T13:06:25.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.384+0000 7fda577fe700 1 -- 172.21.15.133:0/192841962 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda5000bd20 con 0x7fda580abff0 2021-01-03T13:06:25.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.384+0000 7fda5e023700 1 -- 172.21.15.133:0/192841962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda580abff0 msgr2=0x7fda580b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.384+0000 7fda5e023700 1 --2- 172.21.15.133:0/192841962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda580abff0 0x7fda580b0100 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7fda500032b0 tx=0x7fda500091a0).stop 2021-01-03T13:06:25.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.384+0000 7fda5e023700 1 -- 172.21.15.133:0/192841962 shutdown_connections 2021-01-03T13:06:25.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.384+0000 7fda5e023700 1 --2- 172.21.15.133:0/192841962 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda580abff0 0x7fda580b0100 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.384+0000 7fda5e023700 1 -- 172.21.15.133:0/192841962 >> 172.21.15.133:0/192841962 conn(0x7fda5805bdf0 msgr2=0x7fda5805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:25.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.384+0000 7fda5e023700 1 -- 172.21.15.133:0/192841962 shutdown_connections 2021-01-03T13:06:25.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.384+0000 7fda5e023700 1 -- 172.21.15.133:0/192841962 wait complete. 2021-01-03T13:06:25.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.384+0000 7fda5e023700 1 Processor -- start 2021-01-03T13:06:25.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.384+0000 7fda5e023700 1 -- start start 2021-01-03T13:06:25.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5e023700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fda58060b00 0x7fda58090680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:25.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5e023700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda580abff0 0x7fda58151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:25.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5e023700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda580b5120 0x7fda58151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:25.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5e023700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda580adef0 con 0x7fda580abff0 2021-01-03T13:06:25.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5e023700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda58080590 con 0x7fda580b5120 2021-01-03T13:06:25.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5e023700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda58080830 con 0x7fda58060b00 2021-01-03T13:06:25.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5cdc1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda580b5120 0x7fda58151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:25.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5cdc1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda580b5120 0x7fda58151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38572/0 (socket says 172.21.15.133:38572) 2021-01-03T13:06:25.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5cdc1700 1 -- 172.21.15.133:0/111037251 learned_addr learned my addr 172.21.15.133:0/111037251 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:25.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda4ffff700 1 --2- 172.21.15.133:0/111037251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda580abff0 0x7fda58151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:25.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda57fff700 1 --2- 172.21.15.133:0/111037251 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fda58060b00 0x7fda58090680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:25.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5cdc1700 1 -- 172.21.15.133:0/111037251 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fda58060b00 msgr2=0x7fda58090680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5cdc1700 1 --2- 172.21.15.133:0/111037251 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fda58060b00 0x7fda58090680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5cdc1700 1 -- 172.21.15.133:0/111037251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda580abff0 msgr2=0x7fda58151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5cdc1700 1 --2- 172.21.15.133:0/111037251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda580abff0 0x7fda58151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5cdc1700 1 -- 172.21.15.133:0/111037251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda580ae120 con 0x7fda580b5120 2021-01-03T13:06:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5cdc1700 1 --2- 172.21.15.133:0/111037251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda580b5120 0x7fda58151fd0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7fda500032b0 tx=0x7fda50016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda557fa700 1 -- 172.21.15.133:0/111037251 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda50010660 con 0x7fda580b5120 2021-01-03T13:06:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda557fa700 1 -- 172.21.15.133:0/111037251 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda500107c0 con 0x7fda580b5120 2021-01-03T13:06:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5e023700 1 -- 172.21.15.133:0/111037251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda58091440 con 0x7fda580b5120 2021-01-03T13:06:25.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda557fa700 1 -- 172.21.15.133:0/111037251 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda50010b20 con 0x7fda580b5120 2021-01-03T13:06:25.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5e023700 1 -- 172.21.15.133:0/111037251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda580aeb50 con 0x7fda580b5120 2021-01-03T13:06:25.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.388+0000 7fda5e023700 1 -- 172.21.15.133:0/111037251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda580ae2b0 con 0x7fda580b5120 2021-01-03T13:06:25.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.392+0000 7fda557fa700 1 -- 172.21.15.133:0/111037251 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fda50026030 con 0x7fda580b5120 2021-01-03T13:06:25.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.392+0000 7fda557fa700 1 --2- 172.21.15.133:0/111037251 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fda3c055440 0x7fda3c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:25.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.392+0000 7fda57fff700 1 --2- 172.21.15.133:0/111037251 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fda3c055440 0x7fda3c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:25.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.392+0000 7fda557fa700 1 -- 172.21.15.133:0/111037251 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fda5006f130 con 0x7fda580b5120 2021-01-03T13:06:25.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.392+0000 7fda57fff700 1 --2- 172.21.15.133:0/111037251 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fda3c055440 0x7fda3c057900 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fda4800b000 tx=0x7fda48009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:25.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.396+0000 7fda557fa700 1 -- 172.21.15.133:0/111037251 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fda50045320 con 0x7fda580b5120 2021-01-03T13:06:25.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.588+0000 7fda5e023700 1 -- 172.21.15.133:0/111037251 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fda58057300 con 0x7fda580b5120 2021-01-03T13:06:25.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.596+0000 7fda557fa700 1 -- 172.21.15.133:0/111037251 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v27) v1 ==== 184+0+0 (secure 0 0 0) 0x7fda500150e0 con 0x7fda580b5120 2021-01-03T13:06:25.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.600+0000 7fda5e023700 1 -- 172.21.15.133:0/111037251 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fda3c055440 msgr2=0x7fda3c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.600+0000 7fda5e023700 1 --2- 172.21.15.133:0/111037251 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fda3c055440 0x7fda3c057900 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fda4800b000 tx=0x7fda48009040).stop 2021-01-03T13:06:25.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.600+0000 7fda5e023700 1 -- 172.21.15.133:0/111037251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda580b5120 msgr2=0x7fda58151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.600+0000 7fda5e023700 1 --2- 172.21.15.133:0/111037251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda580b5120 0x7fda58151fd0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7fda500032b0 tx=0x7fda50016000).stop 2021-01-03T13:06:25.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.600+0000 7fda5e023700 1 -- 172.21.15.133:0/111037251 shutdown_connections 2021-01-03T13:06:25.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.600+0000 7fda5e023700 1 --2- 172.21.15.133:0/111037251 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fda3c055440 0x7fda3c057900 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.600+0000 7fda5e023700 1 --2- 172.21.15.133:0/111037251 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda580b5120 0x7fda58151fd0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.600+0000 7fda5e023700 1 --2- 172.21.15.133:0/111037251 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fda58060b00 0x7fda58090680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.600+0000 7fda5e023700 1 --2- 172.21.15.133:0/111037251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fda580abff0 0x7fda58151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.600+0000 7fda5e023700 1 -- 172.21.15.133:0/111037251 >> 172.21.15.133:0/111037251 conn(0x7fda5805bdf0 msgr2=0x7fda580b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:25.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.600+0000 7fda5e023700 1 -- 172.21.15.133:0/111037251 shutdown_connections 2021-01-03T13:06:25.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.600+0000 7fda5e023700 1 -- 172.21.15.133:0/111037251 wait complete. 2021-01-03T13:06:25.608 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2021-01-03T13:06:25.620 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:06:25.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.736+0000 7fbe8b59e700 1 Processor -- start 2021-01-03T13:06:25.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.736+0000 7fbe8b59e700 1 -- start start 2021-01-03T13:06:25.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.736+0000 7fbe8b59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbe8c062450 0x7fbe8c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:25.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.736+0000 7fbe8b59e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe8c0adff0 con 0x7fbe8c0adc10 2021-01-03T13:06:25.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.736+0000 7fbe8b59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe8c05fb80 con 0x7fbe8c0b33b0 2021-01-03T13:06:25.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.736+0000 7fbe8b59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe8c0b1930 con 0x7fbe8c062450 2021-01-03T13:06:25.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.736+0000 7fbe8a59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbe8c062450 0x7fbe8c067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:25.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.736+0000 7fbe8a59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbe8c062450 0x7fbe8c067cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38580/0 (socket says 172.21.15.133:38580) 2021-01-03T13:06:25.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.736+0000 7fbe8a59c700 1 -- 172.21.15.133:0/7761008 learned_addr learned my addr 172.21.15.133:0/7761008 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:25.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.736+0000 7fbe90893700 1 --1- 172.21.15.133:0/7761008 >> v1:172.21.15.133:6789/0 conn(0x7fbe8c0b33b0 0x7fbe8c14f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59614/0 (socket says 172.21.15.133:59614) 2021-01-03T13:06:25.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.736+0000 7fbe8a59c700 1 -- 172.21.15.133:0/7761008 >> v1:172.21.15.133:6789/0 conn(0x7fbe8c0b33b0 legacy=0x7fbe8c14f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.736+0000 7fbe8a59c700 1 -- 172.21.15.133:0/7761008 >> v1:172.21.15.16:6789/0 conn(0x7fbe8c0adc10 legacy=0x7fbe8c0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:25.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.736+0000 7fbe8a59c700 1 -- 172.21.15.133:0/7761008 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c0b3860 con 0x7fbe8c062450 2021-01-03T13:06:25.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.740+0000 7fbe8a59c700 1 --2- 172.21.15.133:0/7761008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8c062450 0x7fbe8c067cb0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fbe8c026190 tx=0x7fbe80006e80).ready entity=mon.1 client_cookie=529361d649ac66ce server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:25.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.740+0000 7fbe89d9b700 1 -- 172.21.15.133:0/7761008 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe800097b0 con 0x7fbe8c062450 2021-01-03T13:06:25.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.740+0000 7fbe89d9b700 1 -- 172.21.15.133:0/7761008 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe80009910 con 0x7fbe8c062450 2021-01-03T13:06:25.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.740+0000 7fbe89d9b700 1 -- 172.21.15.133:0/7761008 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe80009a80 con 0x7fbe8c062450 2021-01-03T13:06:25.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.740+0000 7fbe8b59e700 1 -- 172.21.15.133:0/7761008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8c062450 msgr2=0x7fbe8c067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.740+0000 7fbe8b59e700 1 --2- 172.21.15.133:0/7761008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8c062450 0x7fbe8c067cb0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fbe8c026190 tx=0x7fbe80006e80).stop 2021-01-03T13:06:25.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.740+0000 7fbe8b59e700 1 -- 172.21.15.133:0/7761008 shutdown_connections 2021-01-03T13:06:25.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.740+0000 7fbe8b59e700 1 --2- 172.21.15.133:0/7761008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8c062450 0x7fbe8c067cb0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.740+0000 7fbe8b59e700 1 -- 172.21.15.133:0/7761008 >> 172.21.15.133:0/7761008 conn(0x7fbe8c060d10 msgr2=0x7fbe8c061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:25.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.740+0000 7fbe8b59e700 1 -- 172.21.15.133:0/7761008 shutdown_connections 2021-01-03T13:06:25.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.740+0000 7fbe8b59e700 1 -- 172.21.15.133:0/7761008 wait complete. 2021-01-03T13:06:25.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.740+0000 7fbe8b59e700 1 Processor -- start 2021-01-03T13:06:25.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.740+0000 7fbe8b59e700 1 -- start start 2021-01-03T13:06:25.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8b59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe8c062450 0x7fbe8c066fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:25.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8c0adc10 0x7fbe8c0b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:25.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8b59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbe8c0b33b0 0x7fbe8c153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:25.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8b59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c141ef0 con 0x7fbe8c062450 2021-01-03T13:06:25.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c142190 con 0x7fbe8c0adc10 2021-01-03T13:06:25.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8b59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8c142430 con 0x7fbe8c0b33b0 2021-01-03T13:06:25.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8c0adc10 0x7fbe8c0b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:25.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8a59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8c0adc10 0x7fbe8c0b4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38584/0 (socket says 172.21.15.133:38584) 2021-01-03T13:06:25.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8a59c700 1 -- 172.21.15.133:0/471149351 learned_addr learned my addr 172.21.15.133:0/471149351 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:25.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8ad9d700 1 --2- 172.21.15.133:0/471149351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe8c062450 0x7fbe8c066fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:25.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe90893700 1 --2- 172.21.15.133:0/471149351 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbe8c0b33b0 0x7fbe8c153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:25.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8a59c700 1 -- 172.21.15.133:0/471149351 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbe8c0b33b0 msgr2=0x7fbe8c153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8a59c700 1 --2- 172.21.15.133:0/471149351 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbe8c0b33b0 0x7fbe8c153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8a59c700 1 -- 172.21.15.133:0/471149351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe8c062450 msgr2=0x7fbe8c066fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8a59c700 1 --2- 172.21.15.133:0/471149351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe8c062450 0x7fbe8c066fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8a59c700 1 -- 172.21.15.133:0/471149351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8c1426d0 con 0x7fbe8c0adc10 2021-01-03T13:06:25.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8a59c700 1 --2- 172.21.15.133:0/471149351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8c0adc10 0x7fbe8c0b4aa0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fbe8c026190 tx=0x7fbe80016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:25.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe7b7fe700 1 -- 172.21.15.133:0/471149351 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe80021440 con 0x7fbe8c0adc10 2021-01-03T13:06:25.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe7b7fe700 1 -- 172.21.15.133:0/471149351 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe800215a0 con 0x7fbe8c0adc10 2021-01-03T13:06:25.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe7b7fe700 1 -- 172.21.15.133:0/471149351 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe80021900 con 0x7fbe8c0adc10 2021-01-03T13:06:25.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8b59e700 1 -- 172.21.15.133:0/471149351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8c0b4f90 con 0x7fbe8c0adc10 2021-01-03T13:06:25.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe8b59e700 1 -- 172.21.15.133:0/471149351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8c153760 con 0x7fbe8c0adc10 2021-01-03T13:06:25.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe7b7fe700 1 -- 172.21.15.133:0/471149351 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fbe80027020 con 0x7fbe8c0adc10 2021-01-03T13:06:25.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.744+0000 7fbe7b7fe700 1 --2- 172.21.15.133:0/471149351 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbe700553b0 0x7fbe70057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:25.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.748+0000 7fbe8b59e700 1 -- 172.21.15.133:0/471149351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8c142860 con 0x7fbe8c0adc10 2021-01-03T13:06:25.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.748+0000 7fbe7b7fe700 1 -- 172.21.15.133:0/471149351 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbe8006f0e0 con 0x7fbe8c0adc10 2021-01-03T13:06:25.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.748+0000 7fbe8ad9d700 1 --2- 172.21.15.133:0/471149351 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbe700553b0 0x7fbe70057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:25.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.748+0000 7fbe8ad9d700 1 --2- 172.21.15.133:0/471149351 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbe700553b0 0x7fbe70057870 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fbe7c00d000 tx=0x7fbe7c007b40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:25.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.752+0000 7fbe7b7fe700 1 -- 172.21.15.133:0/471149351 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbe80015020 con 0x7fbe8c0adc10 2021-01-03T13:06:25.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.940+0000 7fbe8b59e700 1 -- 172.21.15.133:0/471149351 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fbe8c057300 con 0x7fbe8c0adc10 2021-01-03T13:06:25.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.948+0000 7fbe7b7fe700 1 -- 172.21.15.133:0/471149351 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v28) v1 ==== 184+0+0 (secure 0 0 0) 0x7fbe800453e0 con 0x7fbe8c0adc10 2021-01-03T13:06:25.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.952+0000 7fbe8b59e700 1 -- 172.21.15.133:0/471149351 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbe700553b0 msgr2=0x7fbe70057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.952+0000 7fbe8b59e700 1 --2- 172.21.15.133:0/471149351 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbe700553b0 0x7fbe70057870 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fbe7c00d000 tx=0x7fbe7c007b40).stop 2021-01-03T13:06:25.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.952+0000 7fbe8b59e700 1 -- 172.21.15.133:0/471149351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8c0adc10 msgr2=0x7fbe8c0b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:25.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.952+0000 7fbe8b59e700 1 --2- 172.21.15.133:0/471149351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8c0adc10 0x7fbe8c0b4aa0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fbe8c026190 tx=0x7fbe80016000).stop 2021-01-03T13:06:25.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.952+0000 7fbe8b59e700 1 -- 172.21.15.133:0/471149351 shutdown_connections 2021-01-03T13:06:25.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.952+0000 7fbe8b59e700 1 --2- 172.21.15.133:0/471149351 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbe700553b0 0x7fbe70057870 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.952+0000 7fbe8b59e700 1 --2- 172.21.15.133:0/471149351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbe8c062450 0x7fbe8c066fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.952+0000 7fbe8b59e700 1 --2- 172.21.15.133:0/471149351 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbe8c0b33b0 0x7fbe8c153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.952+0000 7fbe8b59e700 1 --2- 172.21.15.133:0/471149351 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe8c0adc10 0x7fbe8c0b4aa0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:25.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.952+0000 7fbe8b59e700 1 -- 172.21.15.133:0/471149351 >> 172.21.15.133:0/471149351 conn(0x7fbe8c060d10 msgr2=0x7fbe8c130cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:25.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.952+0000 7fbe8b59e700 1 -- 172.21.15.133:0/471149351 shutdown_connections 2021-01-03T13:06:25.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:25.952+0000 7fbe8b59e700 1 -- 172.21.15.133:0/471149351 wait complete. 2021-01-03T13:06:25.962 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.1 2021-01-03T13:06:25.979 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:06:26.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6782d25700 1 Processor -- start 2021-01-03T13:06:26.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6782d25700 1 -- start start 2021-01-03T13:06:26.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6782d25700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f677c0b9f40 0x7f677c146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:26.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6782d25700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677c0605f0 con 0x7f677c146920 2021-01-03T13:06:26.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6782d25700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677c0600b0 con 0x7f677c0b9b60 2021-01-03T13:06:26.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6782d25700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677c0aed30 con 0x7f677c0b9f40 2021-01-03T13:06:26.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6781d23700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f677c0b9b60 0x7f677c0b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59624/0 (socket says 172.21.15.133:59624) 2021-01-03T13:06:26.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6781d23700 1 -- 172.21.15.133:0/840071529 learned_addr learned my addr 172.21.15.133:0/840071529 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:26.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6781522700 1 --2- 172.21.15.133:0/840071529 >> v2:172.21.15.16:3300/0 conn(0x7f677c0b9f40 0x7f677c146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:26.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6780d21700 1 -- 172.21.15.133:0/840071529 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536403584 0 0) 0x7f677c0600b0 con 0x7f677c0b9b60 2021-01-03T13:06:26.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6780d21700 1 -- 172.21.15.133:0/840071529 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f675c003230 con 0x7f677c0b9b60 2021-01-03T13:06:26.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6780d21700 1 -- 172.21.15.133:0/840071529 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1734165615 0 0) 0x7f675c003230 con 0x7f677c0b9b60 2021-01-03T13:06:26.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6780d21700 1 -- 172.21.15.133:0/840071529 >> v2:172.21.15.16:3300/0 conn(0x7f677c0b9f40 msgr2=0x7f677c146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:26.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6780d21700 1 --2- 172.21.15.133:0/840071529 >> v2:172.21.15.16:3300/0 conn(0x7f677c0b9f40 0x7f677c146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:26.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6780d21700 1 -- 172.21.15.133:0/840071529 >> v1:172.21.15.16:6789/0 conn(0x7f677c146920 legacy=0x7f677c14d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:26.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6780d21700 1 -- 172.21.15.133:0/840071529 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c060350 con 0x7f677c0b9b60 2021-01-03T13:06:26.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6780d21700 1 -- 172.21.15.133:0/840071529 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f676c0016d0 con 0x7f677c0b9b60 2021-01-03T13:06:26.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6780d21700 1 -- 172.21.15.133:0/840071529 >> v1:172.21.15.133:6789/0 conn(0x7f677c0b9b60 legacy=0x7f677c0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:26.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6780d21700 1 --2- 172.21.15.133:0/840071529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f675c003720 0x7f675c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:26.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6780d21700 1 --2- 172.21.15.133:0/840071529 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f675c0044d0 0x7f675c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:26.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6780d21700 1 --2- 172.21.15.133:0/840071529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f675c004e40 0x7f675c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:26.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6780d21700 1 -- 172.21.15.133:0/840071529 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c0aed30 con 0x7f675c003720 2021-01-03T13:06:26.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6780d21700 1 -- 172.21.15.133:0/840071529 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c004250 con 0x7f675c004e40 2021-01-03T13:06:26.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6780d21700 1 -- 172.21.15.133:0/840071529 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675c00bc10 con 0x7f675c0044d0 2021-01-03T13:06:26.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6782524700 1 --2- 172.21.15.133:0/840071529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f675c004e40 0x7f675c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:26.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6781522700 1 --2- 172.21.15.133:0/840071529 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f675c0044d0 0x7f675c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:26.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6782524700 1 -- 172.21.15.133:0/840071529 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f675c0044d0 msgr2=0x7f675c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:26.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6782524700 1 --2- 172.21.15.133:0/840071529 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f675c0044d0 0x7f675c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:26.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6782524700 1 -- 172.21.15.133:0/840071529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f675c003720 msgr2=0x7f675c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:26.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6782524700 1 --2- 172.21.15.133:0/840071529 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f675c003720 0x7f675c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-03T13:06:26.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.088+0000 7f6782524700 1 -- 172.21.15.133:0/840071529 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c003230 con 0x7f675c004e40 2021-01-03T13:06:26.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782524700 1 -- 172.21.15.133:0/840071529 reap_dead start 2021-01-03T13:06:26.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782524700 1 --2- 172.21.15.133:0/840071529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f675c004e40 0x7f675c00b720 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f677c068a40 tx=0x7f6774007ee0).ready entity=mon.1 client_cookie=bb788f87624ea128 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:26.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6780d21700 1 -- 172.21.15.133:0/840071529 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f677400cb20 con 0x7f675c004e40 2021-01-03T13:06:26.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6780d21700 1 -- 172.21.15.133:0/840071529 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677400cc80 con 0x7f675c004e40 2021-01-03T13:06:26.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6780d21700 1 -- 172.21.15.133:0/840071529 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6774013410 con 0x7f675c004e40 2021-01-03T13:06:26.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782d25700 1 -- 172.21.15.133:0/840071529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f675c004e40 msgr2=0x7f675c00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:26.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782d25700 1 --2- 172.21.15.133:0/840071529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f675c004e40 0x7f675c00b720 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f677c068a40 tx=0x7f6774007ee0).stop 2021-01-03T13:06:26.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782d25700 1 -- 172.21.15.133:0/840071529 shutdown_connections 2021-01-03T13:06:26.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782d25700 1 --2- 172.21.15.133:0/840071529 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f675c004e40 0x7f675c00b720 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:26.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782d25700 1 -- 172.21.15.133:0/840071529 >> 172.21.15.133:0/840071529 conn(0x7f677c0b69e0 msgr2=0x7f677c0b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:26.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782d25700 1 -- 172.21.15.133:0/840071529 shutdown_connections 2021-01-03T13:06:26.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782d25700 1 -- 172.21.15.133:0/840071529 wait complete. 2021-01-03T13:06:26.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782d25700 1 Processor -- start 2021-01-03T13:06:26.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782d25700 1 -- start start 2021-01-03T13:06:26.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782d25700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f675c004e40 0x7f677c1442d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:26.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782d25700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f677c09ed70 0x7f677c155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:26.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782d25700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f677c0b2e70 0x7f677c155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:26.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782d25700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c09f250 con 0x7f677c09ed70 2021-01-03T13:06:26.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782d25700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677c09c7a0 con 0x7f677c0b2e70 2021-01-03T13:06:26.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782d25700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677c09ca40 con 0x7f675c004e40 2021-01-03T13:06:26.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782524700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f677c0b2e70 0x7f677c155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:26.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782524700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f677c0b2e70 0x7f677c155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38608/0 (socket says 172.21.15.133:38608) 2021-01-03T13:06:26.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6782524700 1 -- 172.21.15.133:0/1152063346 learned_addr learned my addr 172.21.15.133:0/1152063346 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:26.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6781522700 1 --2- 172.21.15.133:0/1152063346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f677c09ed70 0x7f677c155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:26.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.092+0000 7f6781d23700 1 --2- 172.21.15.133:0/1152063346 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f675c004e40 0x7f677c1442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:26.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.096+0000 7f6782524700 1 -- 172.21.15.133:0/1152063346 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f675c004e40 msgr2=0x7f677c1442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.096+0000 7f6782524700 1 --2- 172.21.15.133:0/1152063346 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f675c004e40 0x7f677c1442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.096+0000 7f6782524700 1 -- 172.21.15.133:0/1152063346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f677c09ed70 msgr2=0x7f677c155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.096+0000 7f6782524700 1 --2- 172.21.15.133:0/1152063346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f677c09ed70 0x7f677c155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.096+0000 7f6782524700 1 -- 172.21.15.133:0/1152063346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c09cce0 con 0x7f677c0b2e70 2021-01-03T13:06:26.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.096+0000 7f6781522700 1 --2- 172.21.15.133:0/1152063346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f677c09ed70 0x7f677c155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.096+0000 7f6781d23700 1 --2- 172.21.15.133:0/1152063346 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f675c004e40 0x7f677c1442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.096+0000 7f6782524700 1 --2- 172.21.15.133:0/1152063346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f677c0b2e70 0x7f677c155620 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f677c068a40 tx=0x7f6774016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.096+0000 7f677affd700 1 -- 172.21.15.133:0/1152063346 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6774006860 con 0x7f677c0b2e70 2021-01-03T13:06:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.096+0000 7f677affd700 1 -- 172.21.15.133:0/1152063346 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67740069c0 con 0x7f677c0b2e70 2021-01-03T13:06:26.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.096+0000 7f677affd700 1 -- 172.21.15.133:0/1152063346 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6774006d20 con 0x7f677c0b2e70 2021-01-03T13:06:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.096+0000 7f6782d25700 1 -- 172.21.15.133:0/1152063346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677c0b3660 con 0x7f677c0b2e70 2021-01-03T13:06:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.096+0000 7f6782d25700 1 -- 172.21.15.133:0/1152063346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677c155cb0 con 0x7f677c0b2e70 2021-01-03T13:06:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.096+0000 7f6782d25700 1 -- 172.21.15.133:0/1152063346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677c057300 con 0x7f677c0b2e70 2021-01-03T13:06:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.096+0000 7f677affd700 1 -- 172.21.15.133:0/1152063346 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f677401b040 con 0x7f677c0b2e70 2021-01-03T13:06:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.096+0000 7f677affd700 1 --2- 172.21.15.133:0/1152063346 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6760055470 0x7f6760057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:26.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.100+0000 7f677affd700 1 -- 172.21.15.133:0/1152063346 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f677406ec30 con 0x7f677c0b2e70 2021-01-03T13:06:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.100+0000 7f6781d23700 1 --2- 172.21.15.133:0/1152063346 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6760055470 0x7f6760057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.100+0000 7f6781d23700 1 --2- 172.21.15.133:0/1152063346 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6760055470 0x7f6760057930 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f676c00b000 tx=0x7f676c000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:26.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.104+0000 7f677affd700 1 -- 172.21.15.133:0/1152063346 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6774048e60 con 0x7f677c0b2e70 2021-01-03T13:06:26.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.288+0000 7f6782d25700 1 -- 172.21.15.133:0/1152063346 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f677c067a00 con 0x7f677c0b2e70 2021-01-03T13:06:26.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.288+0000 7f677affd700 1 -- 172.21.15.133:0/1152063346 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f6774044f30 con 0x7f677c0b2e70 2021-01-03T13:06:26.296 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:26.296 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":56,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/34326903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":34326903},{"type":"v1","addr":"172.21.15.16:6833","nonce":34326903}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7426,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6836/1683013797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1683013797},{"type":"v1","addr":"172.21.15.133:6836","nonce":1683013797}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:06:23.150709+0000","modified":"2021-01-03T13:06:24.614525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7429},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7429":{"gid":7429,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1725513894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1725513894},{"type":"v1","addr":"172.21.15.133:6837","nonce":1725513894}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-01-03T13:06:26.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.292+0000 7f6782d25700 1 -- 172.21.15.133:0/1152063346 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6760055470 msgr2=0x7f6760057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:26.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.292+0000 7f6782d25700 1 --2- 172.21.15.133:0/1152063346 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6760055470 0x7f6760057930 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f676c00b000 tx=0x7f676c000b80).stop 2021-01-03T13:06:26.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.292+0000 7f6782d25700 1 -- 172.21.15.133:0/1152063346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f677c0b2e70 msgr2=0x7f677c155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:26.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.292+0000 7f6782d25700 1 --2- 172.21.15.133:0/1152063346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f677c0b2e70 0x7f677c155620 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f677c068a40 tx=0x7f6774016000).stop 2021-01-03T13:06:26.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.292+0000 7f6782d25700 1 -- 172.21.15.133:0/1152063346 shutdown_connections 2021-01-03T13:06:26.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.292+0000 7f6782d25700 1 --2- 172.21.15.133:0/1152063346 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6760055470 0x7f6760057930 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.292+0000 7f6782d25700 1 --2- 172.21.15.133:0/1152063346 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f677c0b2e70 0x7f677c155620 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.292+0000 7f6782d25700 1 --2- 172.21.15.133:0/1152063346 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f675c004e40 0x7f677c1442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.292+0000 7f6782d25700 1 --2- 172.21.15.133:0/1152063346 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f677c09ed70 0x7f677c155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.292+0000 7f6782d25700 1 -- 172.21.15.133:0/1152063346 >> 172.21.15.133:0/1152063346 conn(0x7f677c0b69e0 msgr2=0x7f677c13ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:26.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.292+0000 7f6782d25700 1 -- 172.21.15.133:0/1152063346 shutdown_connections 2021-01-03T13:06:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.292+0000 7f6782d25700 1 -- 172.21.15.133:0/1152063346 wait complete. 2021-01-03T13:06:26.301 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 56 2021-01-03T13:06:26.613 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:06:23.150709+0000', 'modified': '2021-01-03T13:06:24.614525+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7429}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7429': {'gid': 7429, 'name': 'c', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/1725513894', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 1725513894}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 1725513894}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:06:26.614 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:06:26.614 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T13:06:26.742 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":7429,"want_state":"up:active","state":"up:active","rank_uptime":3.5779859589999998,"mdsmap_epoch":56,"osdmap_epoch":124,"osdmap_epoch_barrier":124,"uptime":8.9971710530000006} 2021-01-03T13:06:26.743 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 7429, "mdsmap_epoch": 56, "osdmap_epoch": 124, "osdmap_epoch_barrier": 124, "rank_uptime": 3.577985959, "state": "up:active", "uptime": 8.997171053, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:06:26.744 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:06:26.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff3fff700 1 Processor -- start 2021-01-03T13:06:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff3fff700 1 -- start start 2021-01-03T13:06:26.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ff40b5330 0x7f9ff40abd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:26.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff3fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff40b5710 con 0x7f9ff4099ff0 2021-01-03T13:06:26.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff3fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff40ac270 con 0x7f9ff40b5ae0 2021-01-03T13:06:26.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff3fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff40b10f0 con 0x7f9ff40b5330 2021-01-03T13:06:26.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff27fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9ff40b5ae0 0x7f9ff4142c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59646/0 (socket says 172.21.15.133:59646) 2021-01-03T13:06:26.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff27fc700 1 -- 172.21.15.133:0/3957386068 learned_addr learned my addr 172.21.15.133:0/3957386068 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:26.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ff40b5330 0x7f9ff40abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:26.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff1ffb700 1 -- 172.21.15.133:0/3957386068 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781347459 0 0) 0x7f9ff40ac270 con 0x7f9ff40b5ae0 2021-01-03T13:06:26.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff1ffb700 1 -- 172.21.15.133:0/3957386068 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fd8003230 con 0x7f9ff40b5ae0 2021-01-03T13:06:26.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff1ffb700 1 -- 172.21.15.133:0/3957386068 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3704919812 0 0) 0x7f9fd8003230 con 0x7f9ff40b5ae0 2021-01-03T13:06:26.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff1ffb700 1 -- 172.21.15.133:0/3957386068 >> v2:172.21.15.133:3300/0 conn(0x7f9ff40b5330 msgr2=0x7f9ff40abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:26.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff1ffb700 1 --2- 172.21.15.133:0/3957386068 >> v2:172.21.15.133:3300/0 conn(0x7f9ff40b5330 0x7f9ff40abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:26.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff1ffb700 1 -- 172.21.15.133:0/3957386068 >> v1:172.21.15.16:6789/0 conn(0x7f9ff4099ff0 legacy=0x7f9ff413fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:26.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff1ffb700 1 -- 172.21.15.133:0/3957386068 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff40ab280 con 0x7f9ff40b5ae0 2021-01-03T13:06:26.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff1ffb700 1 -- 172.21.15.133:0/3957386068 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f9fdc0016d0 con 0x7f9ff40b5ae0 2021-01-03T13:06:26.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff1ffb700 1 -- 172.21.15.133:0/3957386068 >> v1:172.21.15.133:6789/0 conn(0x7f9ff40b5ae0 legacy=0x7f9ff4142c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:26.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff1ffb700 1 --2- 172.21.15.133:0/3957386068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fd8003720 0x7f9fd8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:26.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff1ffb700 1 --2- 172.21.15.133:0/3957386068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fd80044d0 0x7f9fd8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:26.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff1ffb700 1 --2- 172.21.15.133:0/3957386068 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9fd8004e40 0x7f9fd800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:26.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff1ffb700 1 -- 172.21.15.133:0/3957386068 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff40b10f0 con 0x7f9fd80044d0 2021-01-03T13:06:26.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff1ffb700 1 -- 172.21.15.133:0/3957386068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd8004200 con 0x7f9fd8003720 2021-01-03T13:06:26.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff1ffb700 1 -- 172.21.15.133:0/3957386068 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd800bc10 con 0x7f9fd8004e40 2021-01-03T13:06:26.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff2ffd700 1 --2- 172.21.15.133:0/3957386068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fd8003720 0x7f9fd8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:26.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff37fe700 1 --2- 172.21.15.133:0/3957386068 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9fd8004e40 0x7f9fd800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:26.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff2ffd700 1 -- 172.21.15.133:0/3957386068 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9fd8004e40 msgr2=0x7f9fd800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:26.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff27fc700 1 --2- 172.21.15.133:0/3957386068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fd80044d0 0x7f9fd8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:26.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff2ffd700 1 --2- 172.21.15.133:0/3957386068 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9fd8004e40 0x7f9fd800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:26.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff2ffd700 1 -- 172.21.15.133:0/3957386068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fd80044d0 msgr2=0x7f9fd8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:26.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff2ffd700 1 --2- 172.21.15.133:0/3957386068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fd80044d0 0x7f9fd8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:26.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff2ffd700 1 -- 172.21.15.133:0/3957386068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff40ab280 con 0x7f9fd8003720 2021-01-03T13:06:26.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff27fc700 1 --2- 172.21.15.133:0/3957386068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fd80044d0 0x7f9fd8004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:06:26.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff37fe700 1 --2- 172.21.15.133:0/3957386068 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9fd8004e40 0x7f9fd800b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:06:26.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff37fe700 1 -- 172.21.15.133:0/3957386068 reap_dead start 2021-01-03T13:06:26.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.852+0000 7f9ff2ffd700 1 --2- 172.21.15.133:0/3957386068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fd8003720 0x7f9fd8003b40 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f9fec00c000 tx=0x7f9fec008040).ready entity=mon.1 client_cookie=a13709b4c3e2de3b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:26.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.856+0000 7f9ff1ffb700 1 -- 172.21.15.133:0/3957386068 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fec00e9d0 con 0x7f9fd8003720 2021-01-03T13:06:26.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.856+0000 7f9ff1ffb700 1 -- 172.21.15.133:0/3957386068 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fec00eb30 con 0x7f9fd8003720 2021-01-03T13:06:26.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.856+0000 7f9ff1ffb700 1 -- 172.21.15.133:0/3957386068 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fec00ee90 con 0x7f9fd8003720 2021-01-03T13:06:26.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.856+0000 7f9ff3fff700 1 -- 172.21.15.133:0/3957386068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fd8003720 msgr2=0x7f9fd8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:26.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.856+0000 7f9ff3fff700 1 --2- 172.21.15.133:0/3957386068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fd8003720 0x7f9fd8003b40 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f9fec00c000 tx=0x7f9fec008040).stop 2021-01-03T13:06:26.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.856+0000 7f9ff3fff700 1 -- 172.21.15.133:0/3957386068 shutdown_connections 2021-01-03T13:06:26.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.856+0000 7f9ff3fff700 1 --2- 172.21.15.133:0/3957386068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fd8003720 0x7f9fd8003b40 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:26.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.856+0000 7f9ff3fff700 1 -- 172.21.15.133:0/3957386068 >> 172.21.15.133:0/3957386068 conn(0x7f9ff405bdf0 msgr2=0x7f9ff405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:26.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.856+0000 7f9ff3fff700 1 -- 172.21.15.133:0/3957386068 shutdown_connections 2021-01-03T13:06:26.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.856+0000 7f9ff3fff700 1 -- 172.21.15.133:0/3957386068 wait complete. 2021-01-03T13:06:26.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.856+0000 7f9ff3fff700 1 Processor -- start 2021-01-03T13:06:26.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.856+0000 7f9ff3fff700 1 -- start start 2021-01-03T13:06:26.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff3fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fd8003720 0x7f9ff4149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:26.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ff41463a0 0x7f9ff40ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:26.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff3fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ff40ace10 0x7f9ff4154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:26.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff3fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff40ac4f0 con 0x7f9fd8003720 2021-01-03T13:06:26.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff3fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff40af2b0 con 0x7f9ff41463a0 2021-01-03T13:06:26.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff3fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff4145920 con 0x7f9ff40ace10 2021-01-03T13:06:26.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ff41463a0 0x7f9ff40ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:26.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff27fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ff41463a0 0x7f9ff40ac920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38626/0 (socket says 172.21.15.133:38626) 2021-01-03T13:06:26.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff27fc700 1 -- 172.21.15.133:0/3494376458 learned_addr learned my addr 172.21.15.133:0/3494376458 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:26.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff2ffd700 1 --2- 172.21.15.133:0/3494376458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fd8003720 0x7f9ff4149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:26.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff37fe700 1 --2- 172.21.15.133:0/3494376458 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ff40ace10 0x7f9ff4154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:26.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff27fc700 1 -- 172.21.15.133:0/3494376458 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ff40ace10 msgr2=0x7f9ff4154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:26.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff27fc700 1 --2- 172.21.15.133:0/3494376458 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ff40ace10 0x7f9ff4154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:26.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff27fc700 1 -- 172.21.15.133:0/3494376458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fd8003720 msgr2=0x7f9ff4149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:26.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff27fc700 1 --2- 172.21.15.133:0/3494376458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fd8003720 0x7f9ff4149e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:26.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff27fc700 1 -- 172.21.15.133:0/3494376458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff4145bc0 con 0x7f9ff41463a0 2021-01-03T13:06:26.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff27fc700 1 --2- 172.21.15.133:0/3494376458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ff41463a0 0x7f9ff40ac920 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f9ff4146130 tx=0x7f9fdc009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:26.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9febfff700 1 -- 172.21.15.133:0/3494376458 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fdc007170 con 0x7f9ff41463a0 2021-01-03T13:06:26.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9febfff700 1 -- 172.21.15.133:0/3494376458 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc0072d0 con 0x7f9ff41463a0 2021-01-03T13:06:26.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9febfff700 1 -- 172.21.15.133:0/3494376458 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fdc00baf0 con 0x7f9ff41463a0 2021-01-03T13:06:26.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff3fff700 1 -- 172.21.15.133:0/3494376458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff4145e60 con 0x7f9ff41463a0 2021-01-03T13:06:26.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff3fff700 1 -- 172.21.15.133:0/3494376458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff4143a30 con 0x7f9ff41463a0 2021-01-03T13:06:26.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9ff3fff700 1 -- 172.21.15.133:0/3494376458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff40ac630 con 0x7f9ff41463a0 2021-01-03T13:06:26.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.860+0000 7f9febfff700 1 -- 172.21.15.133:0/3494376458 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9fdc00bc50 con 0x7f9ff41463a0 2021-01-03T13:06:26.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.864+0000 7f9febfff700 1 --2- 172.21.15.133:0/3494376458 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9fcc0553b0 0x7f9fcc057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:26.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.864+0000 7f9febfff700 1 -- 172.21.15.133:0/3494376458 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9fdc06e360 con 0x7f9ff41463a0 2021-01-03T13:06:26.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.864+0000 7f9ff2ffd700 1 --2- 172.21.15.133:0/3494376458 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9fcc0553b0 0x7f9fcc057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:26.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.864+0000 7f9ff2ffd700 1 --2- 172.21.15.133:0/3494376458 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9fcc0553b0 0x7f9fcc057870 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f9fec008000 tx=0x7f9fec01a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:26.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:26.868+0000 7f9febfff700 1 -- 172.21.15.133:0/3494376458 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9fdc044660 con 0x7f9ff41463a0 2021-01-03T13:06:27.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.012+0000 7f9ff3fff700 1 -- 172.21.15.133:0/3494376458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ff4057300 con 0x7f9ff41463a0 2021-01-03T13:06:27.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.016+0000 7f9febfff700 1 -- 172.21.15.133:0/3494376458 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f9fdc047c80 con 0x7f9ff41463a0 2021-01-03T13:06:27.022 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:27.022 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":124,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:06:24.154062+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:06:20.666416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-01-03T13:06:21.971060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:06:27.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.020+0000 7f9ff3fff700 1 -- 172.21.15.133:0/3494376458 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9fcc0553b0 msgr2=0x7f9fcc057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.020+0000 7f9ff3fff700 1 --2- 172.21.15.133:0/3494376458 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9fcc0553b0 0x7f9fcc057870 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f9fec008000 tx=0x7f9fec01a000).stop 2021-01-03T13:06:27.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.020+0000 7f9ff3fff700 1 -- 172.21.15.133:0/3494376458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ff41463a0 msgr2=0x7f9ff40ac920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.020+0000 7f9ff3fff700 1 --2- 172.21.15.133:0/3494376458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ff41463a0 0x7f9ff40ac920 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f9ff4146130 tx=0x7f9fdc009040).stop 2021-01-03T13:06:27.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.020+0000 7f9ff3fff700 1 -- 172.21.15.133:0/3494376458 shutdown_connections 2021-01-03T13:06:27.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.020+0000 7f9ff3fff700 1 --2- 172.21.15.133:0/3494376458 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9fcc0553b0 0x7f9fcc057870 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.020+0000 7f9ff3fff700 1 --2- 172.21.15.133:0/3494376458 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9fd8003720 0x7f9ff4149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.020+0000 7f9ff3fff700 1 --2- 172.21.15.133:0/3494376458 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ff40ace10 0x7f9ff4154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.020+0000 7f9ff3fff700 1 --2- 172.21.15.133:0/3494376458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ff41463a0 0x7f9ff40ac920 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.020+0000 7f9ff3fff700 1 -- 172.21.15.133:0/3494376458 >> 172.21.15.133:0/3494376458 conn(0x7f9ff405bdf0 msgr2=0x7f9ff40af920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:27.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.020+0000 7f9ff3fff700 1 -- 172.21.15.133:0/3494376458 shutdown_connections 2021-01-03T13:06:27.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.020+0000 7f9ff3fff700 1 -- 172.21.15.133:0/3494376458 wait complete. 2021-01-03T13:06:27.042 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:06:20.666416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:06:21.971060+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:06:27.043 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:06:27.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f0358fef700 1 Processor -- start 2021-01-03T13:06:27.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f0358fef700 1 -- start start 2021-01-03T13:06:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f0358fef700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03540b6bb0 0x7f035413a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f0358fef700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03540600c0 con 0x7f03540b29b0 2021-01-03T13:06:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f0358fef700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0354060360 con 0x7f035405f5e0 2021-01-03T13:06:27.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f0358fef700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03540b1f00 con 0x7f03540b6bb0 2021-01-03T13:06:27.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f035259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03540b6bb0 0x7f035413a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:27.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f0352d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f035405f5e0 0x7f035414b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59668/0 (socket says 172.21.15.133:59668) 2021-01-03T13:06:27.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f0352d9d700 1 -- 172.21.15.133:0/519065457 learned_addr learned my addr 172.21.15.133:0/519065457 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:27.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f035259c700 1 -- 172.21.15.133:0/519065457 >> v1:172.21.15.133:6789/0 conn(0x7f035405f5e0 legacy=0x7f035414b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f035159a700 1 -- 172.21.15.133:0/519065457 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722568002 0 0) 0x7f0354060360 con 0x7f035405f5e0 2021-01-03T13:06:27.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f035259c700 1 -- 172.21.15.133:0/519065457 >> v1:172.21.15.16:6789/0 conn(0x7f03540b29b0 legacy=0x7f03540b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f035259c700 1 -- 172.21.15.133:0/519065457 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0354060a60 con 0x7f03540b6bb0 2021-01-03T13:06:27.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f035259c700 1 --2- 172.21.15.133:0/519065457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03540b6bb0 0x7f035413a7a0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f03440010d0 tx=0x7f033c0091a0).ready entity=mon.1 client_cookie=c78d817e982e873f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:27.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f035159a700 1 -- 172.21.15.133:0/519065457 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033c00b910 con 0x7f03540b6bb0 2021-01-03T13:06:27.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f035159a700 1 -- 172.21.15.133:0/519065457 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c00ba70 con 0x7f03540b6bb0 2021-01-03T13:06:27.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f035159a700 1 -- 172.21.15.133:0/519065457 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f033c00bbe0 con 0x7f03540b6bb0 2021-01-03T13:06:27.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f0358fef700 1 -- 172.21.15.133:0/519065457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03540b6bb0 msgr2=0x7f035413a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.148+0000 7f0358fef700 1 --2- 172.21.15.133:0/519065457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03540b6bb0 0x7f035413a7a0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f03440010d0 tx=0x7f033c0091a0).stop 2021-01-03T13:06:27.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.152+0000 7f0358fef700 1 -- 172.21.15.133:0/519065457 shutdown_connections 2021-01-03T13:06:27.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.152+0000 7f0358fef700 1 --2- 172.21.15.133:0/519065457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03540b6bb0 0x7f035413a7a0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.152+0000 7f0358fef700 1 -- 172.21.15.133:0/519065457 >> 172.21.15.133:0/519065457 conn(0x7f03540622f0 msgr2=0x7f03540b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:27.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.152+0000 7f0358fef700 1 -- 172.21.15.133:0/519065457 shutdown_connections 2021-01-03T13:06:27.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.152+0000 7f0358fef700 1 -- 172.21.15.133:0/519065457 wait complete. 2021-01-03T13:06:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.152+0000 7f0358fef700 1 Processor -- start 2021-01-03T13:06:27.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.152+0000 7f0358fef700 1 -- start start 2021-01-03T13:06:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0358fef700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f035405f5e0 0x7f035413c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0358fef700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03540b6bb0 0x7f035413cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:27.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0358fef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035413bfe0 0x7f0354139cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0358fef700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0354150900 con 0x7f03540b6bb0 2021-01-03T13:06:27.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0358fef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0354150b60 con 0x7f035413bfe0 2021-01-03T13:06:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0358fef700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035413b480 con 0x7f035405f5e0 2021-01-03T13:06:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0352d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035413bfe0 0x7f0354139cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:27.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0352d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035413bfe0 0x7f0354139cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38642/0 (socket says 172.21.15.133:38642) 2021-01-03T13:06:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0352d9d700 1 -- 172.21.15.133:0/2788126672 learned_addr learned my addr 172.21.15.133:0/2788126672 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:27.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0351d9b700 1 --2- 172.21.15.133:0/2788126672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03540b6bb0 0x7f035413cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f035259c700 1 --2- 172.21.15.133:0/2788126672 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f035405f5e0 0x7f035413c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0352d9d700 1 -- 172.21.15.133:0/2788126672 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f035405f5e0 msgr2=0x7f035413c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0352d9d700 1 --2- 172.21.15.133:0/2788126672 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f035405f5e0 0x7f035413c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0352d9d700 1 -- 172.21.15.133:0/2788126672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03540b6bb0 msgr2=0x7f035413cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0352d9d700 1 --2- 172.21.15.133:0/2788126672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03540b6bb0 0x7f035413cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0352d9d700 1 -- 172.21.15.133:0/2788126672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035413b750 con 0x7f035413bfe0 2021-01-03T13:06:27.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0351d9b700 1 --2- 172.21.15.133:0/2788126672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03540b6bb0 0x7f035413cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:27.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0352d9d700 1 --2- 172.21.15.133:0/2788126672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035413bfe0 0x7f0354139cd0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f034c000e90 tx=0x7f034c007a10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:27.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f034b7fe700 1 -- 172.21.15.133:0/2788126672 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f034c007320 con 0x7f035413bfe0 2021-01-03T13:06:27.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0358fef700 1 -- 172.21.15.133:0/2788126672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0354067470 con 0x7f035413bfe0 2021-01-03T13:06:27.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f034b7fe700 1 -- 172.21.15.133:0/2788126672 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c007480 con 0x7f035413bfe0 2021-01-03T13:06:27.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f034b7fe700 1 -- 172.21.15.133:0/2788126672 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f034c005220 con 0x7f035413bfe0 2021-01-03T13:06:27.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.156+0000 7f0358fef700 1 -- 172.21.15.133:0/2788126672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035413a1c0 con 0x7f035413bfe0 2021-01-03T13:06:27.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.160+0000 7f0358fef700 1 -- 172.21.15.133:0/2788126672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035413b2e0 con 0x7f035413bfe0 2021-01-03T13:06:27.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.160+0000 7f034b7fe700 1 -- 172.21.15.133:0/2788126672 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f034c0055e0 con 0x7f035413bfe0 2021-01-03T13:06:27.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.160+0000 7f034b7fe700 1 --2- 172.21.15.133:0/2788126672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f032c055330 0x7f032c0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:27.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.160+0000 7f034b7fe700 1 -- 172.21.15.133:0/2788126672 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f034c06da30 con 0x7f035413bfe0 2021-01-03T13:06:27.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.160+0000 7f035259c700 1 --2- 172.21.15.133:0/2788126672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f032c055330 0x7f032c0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:27.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.160+0000 7f035259c700 1 --2- 172.21.15.133:0/2788126672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f032c055330 0x7f032c0577f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f033c019000 tx=0x7f033c016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:27.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.164+0000 7f034b7fe700 1 -- 172.21.15.133:0/2788126672 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f035413b2e0 con 0x7f035413bfe0 2021-01-03T13:06:27.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.304+0000 7f0358fef700 1 -- 172.21.15.133:0/2788126672 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f035413b2e0 con 0x7f035413bfe0 2021-01-03T13:06:27.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.304+0000 7f034b7fe700 1 -- 172.21.15.133:0/2788126672 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v124) v1 ==== 110+0+10 (secure 0 0 0) 0x7f035413b2e0 con 0x7f035413bfe0 2021-01-03T13:06:27.312 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:06:27.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.308+0000 7f0358fef700 1 -- 172.21.15.133:0/2788126672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f032c055330 msgr2=0x7f032c0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.308+0000 7f0358fef700 1 --2- 172.21.15.133:0/2788126672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f032c055330 0x7f032c0577f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f033c019000 tx=0x7f033c016000).stop 2021-01-03T13:06:27.314 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.308+0000 7f0358fef700 1 -- 172.21.15.133:0/2788126672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035413bfe0 msgr2=0x7f0354139cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.308+0000 7f0358fef700 1 --2- 172.21.15.133:0/2788126672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035413bfe0 0x7f0354139cd0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7f034c000e90 tx=0x7f034c007a10).stop 2021-01-03T13:06:27.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.308+0000 7f0358fef700 1 -- 172.21.15.133:0/2788126672 shutdown_connections 2021-01-03T13:06:27.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.308+0000 7f0358fef700 1 --2- 172.21.15.133:0/2788126672 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f032c055330 0x7f032c0577f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.308+0000 7f0358fef700 1 --2- 172.21.15.133:0/2788126672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f035413bfe0 0x7f0354139cd0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.308+0000 7f0358fef700 1 --2- 172.21.15.133:0/2788126672 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f035405f5e0 0x7f035413c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.308+0000 7f0358fef700 1 --2- 172.21.15.133:0/2788126672 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03540b6bb0 0x7f035413cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.308+0000 7f0358fef700 1 -- 172.21.15.133:0/2788126672 >> 172.21.15.133:0/2788126672 conn(0x7f03540622f0 msgr2=0x7f03540b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:27.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.308+0000 7f0358fef700 1 -- 172.21.15.133:0/2788126672 shutdown_connections 2021-01-03T13:06:27.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.308+0000 7f0358fef700 1 -- 172.21.15.133:0/2788126672 wait complete. 2021-01-03T13:06:27.327 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:06:27.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7fad018ea700 1 Processor -- start 2021-01-03T13:06:27.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7fad018ea700 1 -- start start 2021-01-03T13:06:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7fad018ea700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc05ffe0 0x7facfc0aae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7fad018ea700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7facfc0afde0 0x7facfc0b0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7fad018ea700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facfc0603c0 con 0x7facfc0b1ee0 2021-01-03T13:06:27.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7fad018ea700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facfc067930 con 0x7facfc0afde0 2021-01-03T13:06:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7fad018ea700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facfc0ab310 con 0x7facfc05ffe0 2021-01-03T13:06:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7facfbfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7facfc0afde0 0x7facfc0b0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7facfbfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7facfc0afde0 0x7facfc0b0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38650/0 (socket says 172.21.15.133:38650) 2021-01-03T13:06:27.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7facfbfff700 1 -- 172.21.15.133:0/732898067 learned_addr learned my addr 172.21.15.133:0/732898067 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7fad008e8700 1 --2- 172.21.15.133:0/732898067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc05ffe0 0x7facfc0aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7facfbfff700 1 -- 172.21.15.133:0/732898067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc05ffe0 msgr2=0x7facfc0aae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7facfbfff700 1 --2- 172.21.15.133:0/732898067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc05ffe0 0x7facfc0aae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7facfbfff700 1 -- 172.21.15.133:0/732898067 >> v1:172.21.15.16:6789/0 conn(0x7facfc0b1ee0 legacy=0x7facfc142790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7facfbfff700 1 -- 172.21.15.133:0/732898067 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc066f50 con 0x7facfc0afde0 2021-01-03T13:06:27.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7facfbfff700 1 --2- 172.21.15.133:0/732898067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0afde0 0x7facfc0b0260 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7face4002f30 tx=0x7face4006e80).ready entity=mon.1 client_cookie=c0e176ab20e924d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:27.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7facfb7fe700 1 -- 172.21.15.133:0/732898067 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7face40097f0 con 0x7facfc0afde0 2021-01-03T13:06:27.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.440+0000 7facfb7fe700 1 -- 172.21.15.133:0/732898067 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face4009950 con 0x7facfc0afde0 2021-01-03T13:06:27.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7facfb7fe700 1 -- 172.21.15.133:0/732898067 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7face4009cb0 con 0x7facfc0afde0 2021-01-03T13:06:27.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad018ea700 1 -- 172.21.15.133:0/732898067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0afde0 msgr2=0x7facfc0b0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad018ea700 1 --2- 172.21.15.133:0/732898067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0afde0 0x7facfc0b0260 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7face4002f30 tx=0x7face4006e80).stop 2021-01-03T13:06:27.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad018ea700 1 -- 172.21.15.133:0/732898067 shutdown_connections 2021-01-03T13:06:27.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad018ea700 1 --2- 172.21.15.133:0/732898067 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc05ffe0 0x7facfc0aae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad018ea700 1 --2- 172.21.15.133:0/732898067 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0afde0 0x7facfc0b0260 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad018ea700 1 -- 172.21.15.133:0/732898067 >> 172.21.15.133:0/732898067 conn(0x7facfc05bdf0 msgr2=0x7facfc05c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:27.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad018ea700 1 -- 172.21.15.133:0/732898067 shutdown_connections 2021-01-03T13:06:27.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad018ea700 1 -- 172.21.15.133:0/732898067 wait complete. 2021-01-03T13:06:27.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad018ea700 1 Processor -- start 2021-01-03T13:06:27.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad018ea700 1 -- start start 2021-01-03T13:06:27.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad018ea700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc05ffe0 0x7facfc0accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:27.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad018ea700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0afde0 0x7facfc1366e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:27.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad018ea700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facfc0b1ee0 0x7facfc136bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:27.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad018ea700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc0af960 con 0x7facfc0b1ee0 2021-01-03T13:06:27.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad018ea700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc1370c0 con 0x7facfc0afde0 2021-01-03T13:06:27.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad018ea700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facfc0ad910 con 0x7facfc05ffe0 2021-01-03T13:06:27.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7facfbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0afde0 0x7facfc1366e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:27.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7facfbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0afde0 0x7facfc1366e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38654/0 (socket says 172.21.15.133:38654) 2021-01-03T13:06:27.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7facfbfff700 1 -- 172.21.15.133:0/1540974611 learned_addr learned my addr 172.21.15.133:0/1540974611 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:27.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad008e8700 1 --2- 172.21.15.133:0/1540974611 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc05ffe0 0x7facfc0accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:27.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad010e9700 1 --2- 172.21.15.133:0/1540974611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facfc0b1ee0 0x7facfc136bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:27.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7facfbfff700 1 -- 172.21.15.133:0/1540974611 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc05ffe0 msgr2=0x7facfc0accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7facfbfff700 1 --2- 172.21.15.133:0/1540974611 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc05ffe0 0x7facfc0accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7facfbfff700 1 -- 172.21.15.133:0/1540974611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facfc0b1ee0 msgr2=0x7facfc136bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7facfbfff700 1 --2- 172.21.15.133:0/1540974611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facfc0b1ee0 0x7facfc136bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7facfbfff700 1 -- 172.21.15.133:0/1540974611 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc0adb40 con 0x7facfc0afde0 2021-01-03T13:06:27.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7fad010e9700 1 --2- 172.21.15.133:0/1540974611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facfc0b1ee0 0x7facfc136bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:27.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.444+0000 7facfbfff700 1 --2- 172.21.15.133:0/1540974611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0afde0 0x7facfc1366e0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7face4002f30 tx=0x7face4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:27.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.448+0000 7facf9ffb700 1 -- 172.21.15.133:0/1540974611 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7face4011c80 con 0x7facfc0afde0 2021-01-03T13:06:27.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.448+0000 7facf9ffb700 1 -- 172.21.15.133:0/1540974611 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face4011de0 con 0x7facfc0afde0 2021-01-03T13:06:27.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.448+0000 7facf9ffb700 1 -- 172.21.15.133:0/1540974611 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7face401e650 con 0x7facfc0afde0 2021-01-03T13:06:27.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.448+0000 7fad018ea700 1 -- 172.21.15.133:0/1540974611 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facfc13fd90 con 0x7facfc0afde0 2021-01-03T13:06:27.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.448+0000 7fad018ea700 1 -- 172.21.15.133:0/1540974611 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facfc0aef90 con 0x7facfc0afde0 2021-01-03T13:06:27.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.448+0000 7fad018ea700 1 -- 172.21.15.133:0/1540974611 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facfc0adcd0 con 0x7facfc0afde0 2021-01-03T13:06:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.448+0000 7facf9ffb700 1 -- 172.21.15.133:0/1540974611 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7face4025030 con 0x7facfc0afde0 2021-01-03T13:06:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.448+0000 7facf9ffb700 1 --2- 172.21.15.133:0/1540974611 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7face0055440 0x7face0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.448+0000 7facf9ffb700 1 -- 172.21.15.133:0/1540974611 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7face406f2d0 con 0x7facfc0afde0 2021-01-03T13:06:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.448+0000 7fad008e8700 1 --2- 172.21.15.133:0/1540974611 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7face0055440 0x7face0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:27.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.448+0000 7fad008e8700 1 --2- 172.21.15.133:0/1540974611 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7face0055440 0x7face0057900 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7facec00c000 tx=0x7facec008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:27.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.456+0000 7facf9ffb700 1 -- 172.21.15.133:0/1540974611 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7face40455d0 con 0x7facfc0afde0 2021-01-03T13:06:27.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.592+0000 7fad018ea700 1 -- 172.21.15.133:0/1540974611 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7facfc057300 con 0x7facfc0afde0 2021-01-03T13:06:27.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.596+0000 7facf9ffb700 1 -- 172.21.15.133:0/1540974611 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v124) v1 ==== 92+0+10 (secure 0 0 0) 0x7face4023020 con 0x7facfc0afde0 2021-01-03T13:06:27.601 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:06:27.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.596+0000 7fad018ea700 1 -- 172.21.15.133:0/1540974611 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7face0055440 msgr2=0x7face0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.596+0000 7fad018ea700 1 --2- 172.21.15.133:0/1540974611 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7face0055440 0x7face0057900 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7facec00c000 tx=0x7facec008040).stop 2021-01-03T13:06:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.596+0000 7fad018ea700 1 -- 172.21.15.133:0/1540974611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0afde0 msgr2=0x7facfc1366e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.596+0000 7fad018ea700 1 --2- 172.21.15.133:0/1540974611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0afde0 0x7facfc1366e0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7face4002f30 tx=0x7face4015000).stop 2021-01-03T13:06:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.596+0000 7fad018ea700 1 -- 172.21.15.133:0/1540974611 shutdown_connections 2021-01-03T13:06:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.596+0000 7fad018ea700 1 --2- 172.21.15.133:0/1540974611 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7face0055440 0x7face0057900 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.596+0000 7fad018ea700 1 --2- 172.21.15.133:0/1540974611 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7facfc0b1ee0 0x7facfc136bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.596+0000 7fad018ea700 1 --2- 172.21.15.133:0/1540974611 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7facfc05ffe0 0x7facfc0accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.596+0000 7fad018ea700 1 --2- 172.21.15.133:0/1540974611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7facfc0afde0 0x7facfc1366e0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.596+0000 7fad018ea700 1 -- 172.21.15.133:0/1540974611 >> 172.21.15.133:0/1540974611 conn(0x7facfc05bdf0 msgr2=0x7facfc142fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.596+0000 7fad018ea700 1 -- 172.21.15.133:0/1540974611 shutdown_connections 2021-01-03T13:06:27.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.596+0000 7fad018ea700 1 -- 172.21.15.133:0/1540974611 wait complete. 2021-01-03T13:06:27.614 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:06:27.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.724+0000 7f8508d9d700 1 Processor -- start 2021-01-03T13:06:27.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.724+0000 7f8508d9d700 1 -- start start 2021-01-03T13:06:27.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f8508d9d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8504060510 0x7f850405c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f8508d9d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f850405fd10 0x7f85040b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f8508d9d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850405bf00 con 0x7f85040b4c20 2021-01-03T13:06:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f8508d9d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850405c1a0 con 0x7f8504060510 2021-01-03T13:06:27.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f8508d9d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850405c440 con 0x7f850405fd10 2021-01-03T13:06:27.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f85037fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f85040b4c20 0x7f85040b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59692/0 (socket says 172.21.15.133:59692) 2021-01-03T13:06:27.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f85037fe700 1 -- 172.21.15.133:0/1800066200 learned_addr learned my addr 172.21.15.133:0/1800066200 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:27.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f8502ffd700 1 --2- 172.21.15.133:0/1800066200 >> v2:172.21.15.16:3300/0 conn(0x7f8504060510 0x7f850405c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:27.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f8503fff700 1 --2- 172.21.15.133:0/1800066200 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f850405fd10 0x7f85040b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:27.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f85027fc700 1 -- 172.21.15.133:0/1800066200 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983146072 0 0) 0x7f850405bf00 con 0x7f85040b4c20 2021-01-03T13:06:27.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f85027fc700 1 -- 172.21.15.133:0/1800066200 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84f0003230 con 0x7f85040b4c20 2021-01-03T13:06:27.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f8502ffd700 1 -- 172.21.15.133:0/1800066200 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f850405fd10 msgr2=0x7f85040b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:27.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f8502ffd700 1 --2- 172.21.15.133:0/1800066200 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f850405fd10 0x7f85040b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f8502ffd700 1 -- 172.21.15.133:0/1800066200 >> v1:172.21.15.133:6789/0 conn(0x7f85040b4c20 legacy=0x7f85040b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f8502ffd700 1 -- 172.21.15.133:0/1800066200 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85040b6ad0 con 0x7f8504060510 2021-01-03T13:06:27.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f8502ffd700 1 --2- 172.21.15.133:0/1800066200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8504060510 0x7f850405c8e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f84f4002f30 tx=0x7f84f4006dc0).ready entity=mon.0 client_cookie=5cbdba0e650e996b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:27.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f85027fc700 1 -- 172.21.15.133:0/1800066200 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f40096a0 con 0x7f8504060510 2021-01-03T13:06:27.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f85027fc700 1 -- 172.21.15.133:0/1800066200 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f4009800 con 0x7f8504060510 2021-01-03T13:06:27.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f85027fc700 1 -- 172.21.15.133:0/1800066200 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f4009b60 con 0x7f8504060510 2021-01-03T13:06:27.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f8508d9d700 1 -- 172.21.15.133:0/1800066200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8504060510 msgr2=0x7f850405c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.728+0000 7f8508d9d700 1 --2- 172.21.15.133:0/1800066200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8504060510 0x7f850405c8e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f84f4002f30 tx=0x7f84f4006dc0).stop 2021-01-03T13:06:27.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.732+0000 7f8508d9d700 1 -- 172.21.15.133:0/1800066200 shutdown_connections 2021-01-03T13:06:27.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.732+0000 7f8508d9d700 1 --2- 172.21.15.133:0/1800066200 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f850405fd10 0x7f85040b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.732+0000 7f8508d9d700 1 --2- 172.21.15.133:0/1800066200 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8504060510 0x7f850405c8e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.732+0000 7f8508d9d700 1 -- 172.21.15.133:0/1800066200 >> 172.21.15.133:0/1800066200 conn(0x7f85040b9f00 msgr2=0x7f85040b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:27.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.732+0000 7f8508d9d700 1 -- 172.21.15.133:0/1800066200 shutdown_connections 2021-01-03T13:06:27.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.732+0000 7f8508d9d700 1 -- 172.21.15.133:0/1800066200 wait complete. 2021-01-03T13:06:27.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.732+0000 7f8508d9d700 1 Processor -- start 2021-01-03T13:06:27.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.732+0000 7f8508d9d700 1 -- start start 2021-01-03T13:06:27.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.732+0000 7f8508d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f850405fd10 0x7f850409e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:27.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.732+0000 7f8508d9d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8504060510 0x7f8504144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:27.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.732+0000 7f8508d9d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85040b4c20 0x7f8504144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:27.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.732+0000 7f8508d9d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85041462f0 con 0x7f85040b4c20 2021-01-03T13:06:27.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.732+0000 7f8508d9d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8504146550 con 0x7f850405fd10 2021-01-03T13:06:27.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.732+0000 7f8508d9d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85041467f0 con 0x7f8504060510 2021-01-03T13:06:27.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.732+0000 7f85037fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f850405fd10 0x7f850409e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:27.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.732+0000 7f85037fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f850405fd10 0x7f850409e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38666/0 (socket says 172.21.15.133:38666) 2021-01-03T13:06:27.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.736+0000 7f85037fe700 1 -- 172.21.15.133:0/1624728489 learned_addr learned my addr 172.21.15.133:0/1624728489 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:27.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.736+0000 7f8502ffd700 1 --2- 172.21.15.133:0/1624728489 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8504060510 0x7f8504144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:27.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.736+0000 7f8503fff700 1 --2- 172.21.15.133:0/1624728489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85040b4c20 0x7f8504144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:27.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.736+0000 7f85037fe700 1 -- 172.21.15.133:0/1624728489 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8504060510 msgr2=0x7f8504144350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.736+0000 7f85037fe700 1 --2- 172.21.15.133:0/1624728489 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8504060510 0x7f8504144350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.736+0000 7f85037fe700 1 -- 172.21.15.133:0/1624728489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85040b4c20 msgr2=0x7f8504144840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.736+0000 7f85037fe700 1 --2- 172.21.15.133:0/1624728489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85040b4c20 0x7f8504144840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.736+0000 7f85037fe700 1 -- 172.21.15.133:0/1624728489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8504146a90 con 0x7f850405fd10 2021-01-03T13:06:27.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.736+0000 7f85037fe700 1 --2- 172.21.15.133:0/1624728489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f850405fd10 0x7f850409e450 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f84f80010d0 tx=0x7f84f8007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:27.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.736+0000 7f8500ff9700 1 -- 172.21.15.133:0/1624728489 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f80072e0 con 0x7f850405fd10 2021-01-03T13:06:27.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.736+0000 7f8500ff9700 1 -- 172.21.15.133:0/1624728489 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f8007440 con 0x7f850405fd10 2021-01-03T13:06:27.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.736+0000 7f8508d9d700 1 -- 172.21.15.133:0/1624728489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850409eef0 con 0x7f850405fd10 2021-01-03T13:06:27.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.736+0000 7f8500ff9700 1 -- 172.21.15.133:0/1624728489 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f80057d0 con 0x7f850405fd10 2021-01-03T13:06:27.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.736+0000 7f8508d9d700 1 -- 172.21.15.133:0/1624728489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8504148dc0 con 0x7f850405fd10 2021-01-03T13:06:27.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.736+0000 7f8508d9d700 1 -- 172.21.15.133:0/1624728489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8504146e50 con 0x7f850405fd10 2021-01-03T13:06:27.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.736+0000 7f8500ff9700 1 -- 172.21.15.133:0/1624728489 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f84f8010070 con 0x7f850405fd10 2021-01-03T13:06:27.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.740+0000 7f8500ff9700 1 --2- 172.21.15.133:0/1624728489 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f84e4055440 0x7f84e4057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:27.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.740+0000 7f8500ff9700 1 -- 172.21.15.133:0/1624728489 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f84f806d5d0 con 0x7f850405fd10 2021-01-03T13:06:27.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.740+0000 7f8502ffd700 1 --2- 172.21.15.133:0/1624728489 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f84e4055440 0x7f84e4057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:27.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.740+0000 7f8502ffd700 1 --2- 172.21.15.133:0/1624728489 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f84e4055440 0x7f84e4057900 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f84f401b000 tx=0x7f84f4015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:27.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.744+0000 7f8500ff9700 1 -- 172.21.15.133:0/1624728489 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8504146e50 con 0x7f850405fd10 2021-01-03T13:06:27.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.876+0000 7f8508d9d700 1 -- 172.21.15.133:0/1624728489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8504146e50 con 0x7f850405fd10 2021-01-03T13:06:27.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.876+0000 7f8500ff9700 1 -- 172.21.15.133:0/1624728489 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v124) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8504146e50 con 0x7f850405fd10 2021-01-03T13:06:27.885 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:06:27.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.880+0000 7f8508d9d700 1 -- 172.21.15.133:0/1624728489 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f84e4055440 msgr2=0x7f84e4057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.880+0000 7f8508d9d700 1 --2- 172.21.15.133:0/1624728489 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f84e4055440 0x7f84e4057900 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f84f401b000 tx=0x7f84f4015000).stop 2021-01-03T13:06:27.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.880+0000 7f8508d9d700 1 -- 172.21.15.133:0/1624728489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f850405fd10 msgr2=0x7f850409e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:27.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.880+0000 7f8508d9d700 1 --2- 172.21.15.133:0/1624728489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f850405fd10 0x7f850409e450 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f84f80010d0 tx=0x7f84f8007aa0).stop 2021-01-03T13:06:27.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.880+0000 7f8508d9d700 1 -- 172.21.15.133:0/1624728489 shutdown_connections 2021-01-03T13:06:27.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.880+0000 7f8508d9d700 1 --2- 172.21.15.133:0/1624728489 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f84e4055440 0x7f84e4057900 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.880+0000 7f8508d9d700 1 --2- 172.21.15.133:0/1624728489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f85040b4c20 0x7f8504144840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.880+0000 7f8508d9d700 1 --2- 172.21.15.133:0/1624728489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f850405fd10 0x7f850409e450 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.880+0000 7f8508d9d700 1 --2- 172.21.15.133:0/1624728489 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8504060510 0x7f8504144350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:27.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.880+0000 7f8508d9d700 1 -- 172.21.15.133:0/1624728489 >> 172.21.15.133:0/1624728489 conn(0x7f85040b9f00 msgr2=0x7f85040b80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:27.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.880+0000 7f8508d9d700 1 -- 172.21.15.133:0/1624728489 shutdown_connections 2021-01-03T13:06:27.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:27.880+0000 7f8508d9d700 1 -- 172.21.15.133:0/1624728489 wait complete. 2021-01-03T13:06:27.898 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:06:28.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.012+0000 7f157359e700 1 Processor -- start 2021-01-03T13:06:28.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.012+0000 7f157359e700 1 -- start start 2021-01-03T13:06:28.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.012+0000 7f157359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15740b7910 0x7f15740b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:28.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.012+0000 7f157359e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f15740b3670 0x7f15740b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:28.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.012+0000 7f157359e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15740ac200 con 0x7f157413e040 2021-01-03T13:06:28.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.012+0000 7f157359e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15740ad720 con 0x7f15740b3670 2021-01-03T13:06:28.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.012+0000 7f157359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15740acc10 con 0x7f15740b7910 2021-01-03T13:06:28.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.012+0000 7f1571d9b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f15740b3670 0x7f15740b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:28.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.012+0000 7f157259c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15740b7910 0x7f15740b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:28.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.012+0000 7f1572d9d700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f157413e040 0x7f15740b2ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:38438/0 (socket says 172.21.15.133:38438) 2021-01-03T13:06:28.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.012+0000 7f1572d9d700 1 -- 172.21.15.133:0/1264780242 learned_addr learned my addr 172.21.15.133:0/1264780242 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:28.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f157159a700 1 -- 172.21.15.133:0/1264780242 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170322398 0 0) 0x7f15740ac200 con 0x7f157413e040 2021-01-03T13:06:28.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f1571d9b700 1 -- 172.21.15.133:0/1264780242 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15740b7910 msgr2=0x7f15740b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:28.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f1571d9b700 1 --2- 172.21.15.133:0/1264780242 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15740b7910 0x7f15740b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:28.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f1571d9b700 1 -- 172.21.15.133:0/1264780242 >> v1:172.21.15.16:6789/0 conn(0x7f157413e040 legacy=0x7f15740b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:28.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f1571d9b700 1 -- 172.21.15.133:0/1264780242 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15740ac430 con 0x7f15740b3670 2021-01-03T13:06:28.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f1571d9b700 1 --2- 172.21.15.133:0/1264780242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15740b3670 0x7f15740b1f30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f155c002f30 tx=0x7f155c006d60).ready entity=mon.0 client_cookie=b8319ea02286c606 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:28.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f157159a700 1 -- 172.21.15.133:0/1264780242 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f155c009600 con 0x7f15740b3670 2021-01-03T13:06:28.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f157159a700 1 -- 172.21.15.133:0/1264780242 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c009760 con 0x7f15740b3670 2021-01-03T13:06:28.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f157159a700 1 -- 172.21.15.133:0/1264780242 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f155c0098d0 con 0x7f15740b3670 2021-01-03T13:06:28.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f157359e700 1 -- 172.21.15.133:0/1264780242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15740b3670 msgr2=0x7f15740b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:28.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f157359e700 1 --2- 172.21.15.133:0/1264780242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15740b3670 0x7f15740b1f30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f155c002f30 tx=0x7f155c006d60).stop 2021-01-03T13:06:28.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f157359e700 1 -- 172.21.15.133:0/1264780242 shutdown_connections 2021-01-03T13:06:28.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f157359e700 1 --2- 172.21.15.133:0/1264780242 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15740b7910 0x7f15740b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:28.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f157359e700 1 --2- 172.21.15.133:0/1264780242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15740b3670 0x7f15740b1f30 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:28.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f157359e700 1 -- 172.21.15.133:0/1264780242 >> 172.21.15.133:0/1264780242 conn(0x7f157405c8c0 msgr2=0x7f15740b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:28.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f157359e700 1 -- 172.21.15.133:0/1264780242 shutdown_connections 2021-01-03T13:06:28.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f157359e700 1 -- 172.21.15.133:0/1264780242 wait complete. 2021-01-03T13:06:28.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f157359e700 1 Processor -- start 2021-01-03T13:06:28.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.016+0000 7f157359e700 1 -- start start 2021-01-03T13:06:28.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f157359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15740b3670 0x7f1574150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:28.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f157359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15740b7910 0x7f15740ae940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:28.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f157359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f157413e040 0x7f1574142540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:28.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f157359e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157413f930 con 0x7f15740b3670 2021-01-03T13:06:28.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f157359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157413fbd0 con 0x7f15740b7910 2021-01-03T13:06:28.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f157359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157413fe70 con 0x7f157413e040 2021-01-03T13:06:28.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f1571d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15740b7910 0x7f15740ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:28.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f1571d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15740b7910 0x7f15740ae940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38684/0 (socket says 172.21.15.133:38684) 2021-01-03T13:06:28.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f1571d9b700 1 -- 172.21.15.133:0/1468551510 learned_addr learned my addr 172.21.15.133:0/1468551510 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:28.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f157259c700 1 --2- 172.21.15.133:0/1468551510 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15740b3670 0x7f1574150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:28.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f1572d9d700 1 --2- 172.21.15.133:0/1468551510 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f157413e040 0x7f1574142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:28.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f1571d9b700 1 -- 172.21.15.133:0/1468551510 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f157413e040 msgr2=0x7f1574142540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:28.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f1571d9b700 1 --2- 172.21.15.133:0/1468551510 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f157413e040 0x7f1574142540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:28.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f1571d9b700 1 -- 172.21.15.133:0/1468551510 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15740b3670 msgr2=0x7f1574150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:28.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f1571d9b700 1 --2- 172.21.15.133:0/1468551510 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15740b3670 0x7f1574150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:28.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f1571d9b700 1 -- 172.21.15.133:0/1468551510 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1574140110 con 0x7f15740b7910 2021-01-03T13:06:28.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f1571d9b700 1 --2- 172.21.15.133:0/1468551510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15740b7910 0x7f15740ae940 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f155c002f30 tx=0x7f155c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:28.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f156b7fe700 1 -- 172.21.15.133:0/1468551510 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f155c0119e0 con 0x7f15740b7910 2021-01-03T13:06:28.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f156b7fe700 1 -- 172.21.15.133:0/1468551510 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c011b40 con 0x7f15740b7910 2021-01-03T13:06:28.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f157359e700 1 -- 172.21.15.133:0/1468551510 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1574150610 con 0x7f15740b7910 2021-01-03T13:06:28.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f156b7fe700 1 -- 172.21.15.133:0/1468551510 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f155c011ea0 con 0x7f15740b7910 2021-01-03T13:06:28.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f157359e700 1 -- 172.21.15.133:0/1468551510 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15740af050 con 0x7f15740b7910 2021-01-03T13:06:28.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.020+0000 7f157359e700 1 -- 172.21.15.133:0/1468551510 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15741402a0 con 0x7f15740b7910 2021-01-03T13:06:28.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.024+0000 7f156b7fe700 1 -- 172.21.15.133:0/1468551510 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f155c026030 con 0x7f15740b7910 2021-01-03T13:06:28.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.024+0000 7f156b7fe700 1 --2- 172.21.15.133:0/1468551510 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1558055330 0x7f15580577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:28.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.024+0000 7f156b7fe700 1 -- 172.21.15.133:0/1468551510 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f155c06e710 con 0x7f15740b7910 2021-01-03T13:06:28.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.024+0000 7f157259c700 1 --2- 172.21.15.133:0/1468551510 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1558055330 0x7f15580577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:28.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.024+0000 7f157259c700 1 --2- 172.21.15.133:0/1468551510 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1558055330 0x7f15580577f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f1564008000 tx=0x7f1564008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:28.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.028+0000 7f156b7fe700 1 -- 172.21.15.133:0/1468551510 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f155c044900 con 0x7f15740b7910 2021-01-03T13:06:28.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.164+0000 7f157359e700 1 -- 172.21.15.133:0/1468551510 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1574057300 con 0x7f15740b7910 2021-01-03T13:06:28.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.164+0000 7f156b7fe700 1 -- 172.21.15.133:0/1468551510 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v124) v1 ==== 100+0+10 (secure 0 0 0) 0x7f155c0240a0 con 0x7f15740b7910 2021-01-03T13:06:28.170 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:06:28.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.164+0000 7f157359e700 1 -- 172.21.15.133:0/1468551510 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1558055330 msgr2=0x7f15580577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:28.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.164+0000 7f157359e700 1 --2- 172.21.15.133:0/1468551510 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1558055330 0x7f15580577f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f1564008000 tx=0x7f1564008040).stop 2021-01-03T13:06:28.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.164+0000 7f157359e700 1 -- 172.21.15.133:0/1468551510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15740b7910 msgr2=0x7f15740ae940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:28.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.164+0000 7f157359e700 1 --2- 172.21.15.133:0/1468551510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15740b7910 0x7f15740ae940 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f155c002f30 tx=0x7f155c016000).stop 2021-01-03T13:06:28.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.164+0000 7f157359e700 1 -- 172.21.15.133:0/1468551510 shutdown_connections 2021-01-03T13:06:28.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.164+0000 7f157359e700 1 --2- 172.21.15.133:0/1468551510 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1558055330 0x7f15580577f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:28.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.164+0000 7f157359e700 1 --2- 172.21.15.133:0/1468551510 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15740b3670 0x7f1574150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:28.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.164+0000 7f157359e700 1 --2- 172.21.15.133:0/1468551510 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f157413e040 0x7f1574142540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:28.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.164+0000 7f157359e700 1 --2- 172.21.15.133:0/1468551510 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15740b7910 0x7f15740ae940 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:28.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.164+0000 7f157359e700 1 -- 172.21.15.133:0/1468551510 >> 172.21.15.133:0/1468551510 conn(0x7f157405c8c0 msgr2=0x7f15740b29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:28.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.164+0000 7f157359e700 1 -- 172.21.15.133:0/1468551510 shutdown_connections 2021-01-03T13:06:28.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.164+0000 7f157359e700 1 -- 172.21.15.133:0/1468551510 wait complete. 2021-01-03T13:06:28.183 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:06:28.184 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:06:28.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.292+0000 7f3698827700 1 Processor -- start 2021-01-03T13:06:28.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.292+0000 7f3698827700 1 -- start start 2021-01-03T13:06:28.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.292+0000 7f3698827700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f36940b5ae0 0x7f36940ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.292+0000 7f3698827700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3694144050 con 0x7f36940ace10 2021-01-03T13:06:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.292+0000 7f3698827700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3694144f00 con 0x7f3694140a80 2021-01-03T13:06:28.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.292+0000 7f3698827700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36941415e0 con 0x7f36940b5ae0 2021-01-03T13:06:28.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.292+0000 7f3693fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3694140a80 0x7f3694140ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59724/0 (socket says 172.21.15.133:59724) 2021-01-03T13:06:28.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.292+0000 7f3693fff700 1 -- 172.21.15.133:0/480876368 learned_addr learned my addr 172.21.15.133:0/480876368 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:28.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.292+0000 7f3692ffd700 1 --2- 172.21.15.133:0/480876368 >> v2:172.21.15.16:3300/0 conn(0x7f36940b5ae0 0x7f36940ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:28.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.292+0000 7f36927fc700 1 -- 172.21.15.133:0/480876368 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828039670 0 0) 0x7f3694144f00 con 0x7f3694140a80 2021-01-03T13:06:28.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.292+0000 7f36927fc700 1 -- 172.21.15.133:0/480876368 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3678003230 con 0x7f3694140a80 2021-01-03T13:06:28.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.292+0000 7f3692ffd700 1 -- 172.21.15.133:0/480876368 >> v1:172.21.15.133:6789/0 conn(0x7f3694140a80 legacy=0x7f3694140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:28.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.292+0000 7f3692ffd700 1 -- 172.21.15.133:0/480876368 >> v1:172.21.15.16:6789/0 conn(0x7f36940ace10 legacy=0x7f36940b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:28.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.292+0000 7f3692ffd700 1 -- 172.21.15.133:0/480876368 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36940ad6e0 con 0x7f36940b5ae0 2021-01-03T13:06:28.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.296+0000 7f3692ffd700 1 --2- 172.21.15.133:0/480876368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36940b5ae0 0x7f36940ad1f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f3684002f30 tx=0x7f3684006dc0).ready entity=mon.0 client_cookie=c23d4c5703cbede1 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:28.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.296+0000 7f36927fc700 1 -- 172.21.15.133:0/480876368 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3684009800 con 0x7f36940b5ae0 2021-01-03T13:06:28.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.296+0000 7f36927fc700 1 -- 172.21.15.133:0/480876368 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3684009960 con 0x7f36940b5ae0 2021-01-03T13:06:28.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.296+0000 7f36927fc700 1 -- 172.21.15.133:0/480876368 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3684009cc0 con 0x7f36940b5ae0 2021-01-03T13:06:28.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.296+0000 7f3698827700 1 -- 172.21.15.133:0/480876368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36940b5ae0 msgr2=0x7f36940ad1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:28.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.296+0000 7f3698827700 1 --2- 172.21.15.133:0/480876368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36940b5ae0 0x7f36940ad1f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f3684002f30 tx=0x7f3684006dc0).stop 2021-01-03T13:06:28.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.296+0000 7f3698827700 1 -- 172.21.15.133:0/480876368 shutdown_connections 2021-01-03T13:06:28.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.296+0000 7f3698827700 1 --2- 172.21.15.133:0/480876368 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36940b5ae0 0x7f36940ad1f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:28.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.296+0000 7f3698827700 1 -- 172.21.15.133:0/480876368 >> 172.21.15.133:0/480876368 conn(0x7f369405bdf0 msgr2=0x7f369405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:28.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.296+0000 7f3698827700 1 -- 172.21.15.133:0/480876368 shutdown_connections 2021-01-03T13:06:28.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.296+0000 7f3698827700 1 -- 172.21.15.133:0/480876368 wait complete. 2021-01-03T13:06:28.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.296+0000 7f3698827700 1 Processor -- start 2021-01-03T13:06:28.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.296+0000 7f3698827700 1 -- start start 2021-01-03T13:06:28.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f3698827700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36940ace10 0x7f369413ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:28.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f3698827700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36940b5ae0 0x7f369413d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:28.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f3698827700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3694140a80 0x7f369413d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:28.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f3698827700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36940936f0 con 0x7f36940b5ae0 2021-01-03T13:06:28.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f3698827700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36940abb50 con 0x7f36940ace10 2021-01-03T13:06:28.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f3698827700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36940ab610 con 0x7f3694140a80 2021-01-03T13:06:28.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f36937fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36940ace10 0x7f369413ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:28.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f36937fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36940ace10 0x7f369413ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38696/0 (socket says 172.21.15.133:38696) 2021-01-03T13:06:28.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f36937fe700 1 -- 172.21.15.133:0/2530099665 learned_addr learned my addr 172.21.15.133:0/2530099665 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:28.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f3692ffd700 1 --2- 172.21.15.133:0/2530099665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36940b5ae0 0x7f369413d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:28.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f36937fe700 1 -- 172.21.15.133:0/2530099665 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3694140a80 msgr2=0x7f369413d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:28.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f3693fff700 1 --2- 172.21.15.133:0/2530099665 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3694140a80 0x7f369413d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:28.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f36937fe700 1 --2- 172.21.15.133:0/2530099665 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3694140a80 0x7f369413d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:28.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f36937fe700 1 -- 172.21.15.133:0/2530099665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36940b5ae0 msgr2=0x7f369413d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:28.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f36937fe700 1 --2- 172.21.15.133:0/2530099665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36940b5ae0 0x7f369413d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:28.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f36937fe700 1 -- 172.21.15.133:0/2530099665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36940ab8b0 con 0x7f36940ace10 2021-01-03T13:06:28.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f3692ffd700 1 --2- 172.21.15.133:0/2530099665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36940b5ae0 0x7f369413d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:06:28.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f3693fff700 1 --2- 172.21.15.133:0/2530099665 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3694140a80 0x7f369413d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:06:28.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f36937fe700 1 --2- 172.21.15.133:0/2530099665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36940ace10 0x7f369413ee80 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f3694093830 tx=0x7f367c007be0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:28.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f3690ff9700 1 -- 172.21.15.133:0/2530099665 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f367c0072a0 con 0x7f36940ace10 2021-01-03T13:06:28.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f3690ff9700 1 -- 172.21.15.133:0/2530099665 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c0064e0 con 0x7f36940ace10 2021-01-03T13:06:28.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f3698827700 1 -- 172.21.15.133:0/2530099665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369413dc10 con 0x7f36940ace10 2021-01-03T13:06:28.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f3690ff9700 1 -- 172.21.15.133:0/2530099665 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f367c006840 con 0x7f36940ace10 2021-01-03T13:06:28.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f3698827700 1 -- 172.21.15.133:0/2530099665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369408fd40 con 0x7f36940ace10 2021-01-03T13:06:28.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f3698827700 1 -- 172.21.15.133:0/2530099665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3694057300 con 0x7f36940ace10 2021-01-03T13:06:28.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.300+0000 7f3690ff9700 1 -- 172.21.15.133:0/2530099665 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f367c019020 con 0x7f36940ace10 2021-01-03T13:06:28.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.304+0000 7f3690ff9700 1 --2- 172.21.15.133:0/2530099665 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f366c055470 0x7f366c057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:28.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.304+0000 7f3692ffd700 1 --2- 172.21.15.133:0/2530099665 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f366c055470 0x7f366c057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:28.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.304+0000 7f3690ff9700 1 -- 172.21.15.133:0/2530099665 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f367c06d750 con 0x7f36940ace10 2021-01-03T13:06:28.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.304+0000 7f3692ffd700 1 --2- 172.21.15.133:0/2530099665 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f366c055470 0x7f366c057930 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f3684007000 tx=0x7f3684015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:28.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.304+0000 7f3690ff9700 1 -- 172.21.15.133:0/2530099665 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f367c0439d0 con 0x7f36940ace10 2021-01-03T13:06:28.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.484+0000 7f3698827700 1 -- 172.21.15.133:0/2530099665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3694062500 con 0x7f36940ace10 2021-01-03T13:06:28.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.488+0000 7f3690ff9700 1 -- 172.21.15.133:0/2530099665 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f367c0069a0 con 0x7f36940ace10 2021-01-03T13:06:28.493 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:28.493 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":56,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/34326903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":34326903},{"type":"v1","addr":"172.21.15.16:6833","nonce":34326903}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7426,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6836/1683013797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1683013797},{"type":"v1","addr":"172.21.15.133:6836","nonce":1683013797}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:06:23.150709+0000","modified":"2021-01-03T13:06:24.614525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7429},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7429":{"gid":7429,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1725513894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1725513894},{"type":"v1","addr":"172.21.15.133:6837","nonce":1725513894}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-01-03T13:06:28.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.488+0000 7f3698827700 1 -- 172.21.15.133:0/2530099665 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f366c055470 msgr2=0x7f366c057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:28.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.488+0000 7f3698827700 1 --2- 172.21.15.133:0/2530099665 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f366c055470 0x7f366c057930 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f3684007000 tx=0x7f3684015000).stop 2021-01-03T13:06:28.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.488+0000 7f3698827700 1 -- 172.21.15.133:0/2530099665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36940ace10 msgr2=0x7f369413ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:28.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.488+0000 7f3698827700 1 --2- 172.21.15.133:0/2530099665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36940ace10 0x7f369413ee80 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f3694093830 tx=0x7f367c007be0).stop 2021-01-03T13:06:28.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.488+0000 7f3698827700 1 -- 172.21.15.133:0/2530099665 shutdown_connections 2021-01-03T13:06:28.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.488+0000 7f3698827700 1 --2- 172.21.15.133:0/2530099665 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f366c055470 0x7f366c057930 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:28.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.488+0000 7f3698827700 1 --2- 172.21.15.133:0/2530099665 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3694140a80 0x7f369413d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:28.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.488+0000 7f3698827700 1 --2- 172.21.15.133:0/2530099665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f36940ace10 0x7f369413ee80 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:28.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.488+0000 7f3698827700 1 --2- 172.21.15.133:0/2530099665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f36940b5ae0 0x7f369413d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:28.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.488+0000 7f3698827700 1 -- 172.21.15.133:0/2530099665 >> 172.21.15.133:0/2530099665 conn(0x7f369405bdf0 msgr2=0x7f3694142f80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:28.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.488+0000 7f3698827700 1 -- 172.21.15.133:0/2530099665 shutdown_connections 2021-01-03T13:06:28.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:28.488+0000 7f3698827700 1 -- 172.21.15.133:0/2530099665 wait complete. 2021-01-03T13:06:28.497 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 56 2021-01-03T13:06:28.811 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:06:23.150709+0000', 'modified': '2021-01-03T13:06:24.614525+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7429}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7429': {'gid': 7429, 'name': 'c', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/1725513894', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 1725513894}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 1725513894}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:06:28.812 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:06:28.812 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T13:06:28.940 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":7429,"want_state":"up:active","state":"up:active","rank_uptime":5.7748407899999998,"mdsmap_epoch":56,"osdmap_epoch":124,"osdmap_epoch_barrier":124,"uptime":11.194024049999999} 2021-01-03T13:06:28.941 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 7429, "mdsmap_epoch": 56, "osdmap_epoch": 124, "osdmap_epoch_barrier": 124, "rank_uptime": 5.77484079, "state": "up:active", "uptime": 11.19402405, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:06:28.942 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:06:28.942 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-01-03T13:06:28.942 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi007.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-01-03T13:06:28.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:28.943 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:28.953 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:06:29.009 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:06:29.009 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:06:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:06:29.065 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:06:29.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:29.066 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:06:29.115 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:06:29.116 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:29.159 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:06:29.177 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:06:29.178 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:06:29.232 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:06:29.234 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:06:29.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:29.235 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:06:29.240 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2021-01-03T13:06:29.235+0000 7fe7de0080c0 -1 init, newargv = 0x55a46ed60ad0 newargc=9 2021-01-03T13:06:29.240 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12634]: starting ceph client 2021-01-03T13:06:29.251 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12634]: starting fuse 2021-01-03T13:06:30.350 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:06:30.367 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:06:30.367 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:06:30.424 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:06:30.427 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:06:30.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:30.428 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:06:30.480 INFO:teuthology.orchestra.run.smithi007.stdout:50 2021-01-03T13:06:30.481 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:06:30.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:30.482 DEBUG:teuthology.orchestra.run.smithi007:> sudo python3 -c ' 2021-01-03T13:06:30.483 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2021-01-03T13:06:30.483 DEBUG:teuthology.orchestra.run.smithi007:> import re 2021-01-03T13:06:30.484 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:06:30.485 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2021-01-03T13:06:30.485 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:06:30.486 DEBUG:teuthology.orchestra.run.smithi007:> def find_socket(client_name): 2021-01-03T13:06:30.487 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-01-03T13:06:30.488 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2021-01-03T13:06:30.489 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:06:30.489 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2021-01-03T13:06:30.492 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2021-01-03T13:06:30.493 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2021-01-03T13:06:30.494 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2021-01-03T13:06:30.494 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:06:30.495 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2021-01-03T13:06:30.496 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:06:30.496 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:06:30.496 DEBUG:teuthology.orchestra.run.smithi007:> return f 2021-01-03T13:06:30.497 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:06:30.497 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:06:30.498 DEBUG:teuthology.orchestra.run.smithi007:> print(find_socket("client.0")) 2021-01-03T13:06:30.499 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:06:30.572 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.12634.asok 2021-01-03T13:06:30.578 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12634.asok 2021-01-03T13:06:30.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:30.580 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12634.asok status 2021-01-03T13:06:30.683 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2021-01-03T13:06:30.684 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2021-01-03T13:06:30.684 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:06:30.684 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:06:30.684 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2021-01-03T13:06:30.684 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2021-01-03T13:06:30.685 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-01-03T13:06:30.685 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "12634", 2021-01-03T13:06:30.685 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2021-01-03T13:06:30.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:06:30.685 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2021-01-03T13:06:30.686 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2021-01-03T13:06:30.686 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 7509, 2021-01-03T13:06:30.686 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2021-01-03T13:06:30.686 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2021-01-03T13:06:30.686 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2021-01-03T13:06:30.687 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 7509 2021-01-03T13:06:30.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:06:30.687 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:06:30.687 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:06:30.687 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:06:30.688 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 4264037038 2021-01-03T13:06:30.688 INFO:teuthology.orchestra.run.smithi007.stdout: } 2021-01-03T13:06:30.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:06:30.688 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:06:30.688 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:06:30.689 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:06:30.689 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 4264037038 2021-01-03T13:06:30.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:06:30.689 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.7509 172.21.15.7:0/4264037038", 2021-01-03T13:06:30.689 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "172.21.15.7:0/4264037038", 2021-01-03T13:06:30.690 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2021-01-03T13:06:30.690 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 56, 2021-01-03T13:06:30.690 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 124, 2021-01-03T13:06:30.690 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:06:30.690 INFO:teuthology.orchestra.run.smithi007.stdout: "blacklisted": false, 2021-01-03T13:06:30.691 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2021-01-03T13:06:30.691 INFO:teuthology.orchestra.run.smithi007.stdout:} 2021-01-03T13:06:30.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:30.695 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:30.695 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:30.702 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:06:30.703 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:06:30.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:30.703 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:30.763 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:06:30.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.876+0000 7fcd2db90700 1 Processor -- start 2021-01-03T13:06:30.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.876+0000 7fcd2db90700 1 -- start start 2021-01-03T13:06:30.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.876+0000 7fcd2db90700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd280ace10 0x7fcd280b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:30.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.876+0000 7fcd2db90700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcd28140a80 0x7fcd28140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:30.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.876+0000 7fcd2db90700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd28144050 con 0x7fcd280ad1f0 2021-01-03T13:06:30.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.876+0000 7fcd2db90700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd28144f00 con 0x7fcd280ace10 2021-01-03T13:06:30.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.876+0000 7fcd2db90700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd28144280 con 0x7fcd28140a80 2021-01-03T13:06:30.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.876+0000 7fcd2cb8e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd280ace10 0x7fcd280b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:30.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.876+0000 7fcd2cb8e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd280ace10 0x7fcd280b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38706/0 (socket says 172.21.15.133:38706) 2021-01-03T13:06:30.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2cb8e700 1 -- 172.21.15.133:0/3227777585 learned_addr learned my addr 172.21.15.133:0/3227777585 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:30.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2d38f700 1 --2- 172.21.15.133:0/3227777585 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcd28140a80 0x7fcd28140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:30.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2cb8e700 1 -- 172.21.15.133:0/3227777585 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcd28140a80 msgr2=0x7fcd28140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2cb8e700 1 --2- 172.21.15.133:0/3227777585 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcd28140a80 0x7fcd28140ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2cb8e700 1 -- 172.21.15.133:0/3227777585 >> v1:172.21.15.16:6789/0 conn(0x7fcd280ad1f0 legacy=0x7fcd280b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2cb8e700 1 -- 172.21.15.133:0/3227777585 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd28144520 con 0x7fcd280ace10 2021-01-03T13:06:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2cb8e700 1 --2- 172.21.15.133:0/3227777585 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd280ace10 0x7fcd280b5ae0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7fcd280b1640 tx=0x7fcd18006e80).ready entity=mon.1 client_cookie=d3eb1efa92d48dc6 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:30.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd277fe700 1 -- 172.21.15.133:0/3227777585 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd180097b0 con 0x7fcd280ace10 2021-01-03T13:06:30.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd277fe700 1 -- 172.21.15.133:0/3227777585 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd18009910 con 0x7fcd280ace10 2021-01-03T13:06:30.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd277fe700 1 -- 172.21.15.133:0/3227777585 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd18009c70 con 0x7fcd280ace10 2021-01-03T13:06:30.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2db90700 1 -- 172.21.15.133:0/3227777585 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd280ace10 msgr2=0x7fcd280b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:30.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2db90700 1 --2- 172.21.15.133:0/3227777585 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd280ace10 0x7fcd280b5ae0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7fcd280b1640 tx=0x7fcd18006e80).stop 2021-01-03T13:06:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2db90700 1 -- 172.21.15.133:0/3227777585 shutdown_connections 2021-01-03T13:06:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2db90700 1 --2- 172.21.15.133:0/3227777585 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcd28140a80 0x7fcd28140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2db90700 1 --2- 172.21.15.133:0/3227777585 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd280ace10 0x7fcd280b5ae0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:30.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2db90700 1 -- 172.21.15.133:0/3227777585 >> 172.21.15.133:0/3227777585 conn(0x7fcd2805bdf0 msgr2=0x7fcd2805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:30.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2db90700 1 -- 172.21.15.133:0/3227777585 shutdown_connections 2021-01-03T13:06:30.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2db90700 1 -- 172.21.15.133:0/3227777585 wait complete. 2021-01-03T13:06:30.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2db90700 1 Processor -- start 2021-01-03T13:06:30.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2db90700 1 -- start start 2021-01-03T13:06:30.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2db90700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd280ace10 0x7fcd280ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:30.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2db90700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd280ad1f0 0x7fcd280aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:30.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2db90700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcd28140a80 0x7fcd28156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:30.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2db90700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd28156810 con 0x7fcd280ad1f0 2021-01-03T13:06:30.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.880+0000 7fcd2db90700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd280af470 con 0x7fcd280ace10 2021-01-03T13:06:30.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd2db90700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2814db60 con 0x7fcd28140a80 2021-01-03T13:06:30.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd2cb8e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd280ace10 0x7fcd280ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:30.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd2cb8e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd280ace10 0x7fcd280ae810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38710/0 (socket says 172.21.15.133:38710) 2021-01-03T13:06:30.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd2cb8e700 1 -- 172.21.15.133:0/92317475 learned_addr learned my addr 172.21.15.133:0/92317475 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:30.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd2d38f700 1 --2- 172.21.15.133:0/92317475 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcd28140a80 0x7fcd28156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:30.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd27fff700 1 --2- 172.21.15.133:0/92317475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd280ad1f0 0x7fcd280aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:30.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd2cb8e700 1 -- 172.21.15.133:0/92317475 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcd28140a80 msgr2=0x7fcd28156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:30.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd2cb8e700 1 --2- 172.21.15.133:0/92317475 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcd28140a80 0x7fcd28156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:30.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd2cb8e700 1 -- 172.21.15.133:0/92317475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd280ad1f0 msgr2=0x7fcd280aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:30.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd2cb8e700 1 --2- 172.21.15.133:0/92317475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd280ad1f0 0x7fcd280aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:30.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd2cb8e700 1 -- 172.21.15.133:0/92317475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2814de00 con 0x7fcd280ace10 2021-01-03T13:06:30.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd2cb8e700 1 --2- 172.21.15.133:0/92317475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd280ace10 0x7fcd280ae810 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7fcd280b1640 tx=0x7fcd18015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:30.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd25ffb700 1 -- 172.21.15.133:0/92317475 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd18006750 con 0x7fcd280ace10 2021-01-03T13:06:30.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd25ffb700 1 -- 172.21.15.133:0/92317475 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd18011b80 con 0x7fcd280ace10 2021-01-03T13:06:30.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd2db90700 1 -- 172.21.15.133:0/92317475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2814e0a0 con 0x7fcd280ace10 2021-01-03T13:06:30.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd25ffb700 1 -- 172.21.15.133:0/92317475 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd1801e460 con 0x7fcd280ace10 2021-01-03T13:06:30.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd2db90700 1 -- 172.21.15.133:0/92317475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd280abc40 con 0x7fcd280ace10 2021-01-03T13:06:30.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd25ffb700 1 -- 172.21.15.133:0/92317475 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fcd18025030 con 0x7fcd280ace10 2021-01-03T13:06:30.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd2db90700 1 -- 172.21.15.133:0/92317475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2814e260 con 0x7fcd280ace10 2021-01-03T13:06:30.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd25ffb700 1 --2- 172.21.15.133:0/92317475 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcd080553b0 0x7fcd08057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:30.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd25ffb700 1 -- 172.21.15.133:0/92317475 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcd1806f160 con 0x7fcd280ace10 2021-01-03T13:06:30.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.884+0000 7fcd27fff700 1 --2- 172.21.15.133:0/92317475 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcd080553b0 0x7fcd08057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:30.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.888+0000 7fcd27fff700 1 --2- 172.21.15.133:0/92317475 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcd080553b0 0x7fcd08057870 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fcd1c00d000 tx=0x7fcd1c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:30.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:30.896+0000 7fcd25ffb700 1 -- 172.21.15.133:0/92317475 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcd18045460 con 0x7fcd280ace10 2021-01-03T13:06:31.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.036+0000 7fcd2db90700 1 -- 172.21.15.133:0/92317475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd28057300 con 0x7fcd280ace10 2021-01-03T13:06:31.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.036+0000 7fcd25ffb700 1 -- 172.21.15.133:0/92317475 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16100 (secure 0 0 0) 0x7fcd18048a80 con 0x7fcd280ace10 2021-01-03T13:06:31.043 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:31.044 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":124,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:06:24.154062+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:06:20.666416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2021-01-03T13:06:21.971060+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:06:31.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.040+0000 7fcd2db90700 1 -- 172.21.15.133:0/92317475 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcd080553b0 msgr2=0x7fcd08057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.040+0000 7fcd2db90700 1 --2- 172.21.15.133:0/92317475 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcd080553b0 0x7fcd08057870 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fcd1c00d000 tx=0x7fcd1c009040).stop 2021-01-03T13:06:31.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.040+0000 7fcd2db90700 1 -- 172.21.15.133:0/92317475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd280ace10 msgr2=0x7fcd280ae810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.040+0000 7fcd2db90700 1 --2- 172.21.15.133:0/92317475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd280ace10 0x7fcd280ae810 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7fcd280b1640 tx=0x7fcd18015000).stop 2021-01-03T13:06:31.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.040+0000 7fcd2db90700 1 -- 172.21.15.133:0/92317475 shutdown_connections 2021-01-03T13:06:31.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.040+0000 7fcd2db90700 1 --2- 172.21.15.133:0/92317475 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcd080553b0 0x7fcd08057870 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.040+0000 7fcd2db90700 1 --2- 172.21.15.133:0/92317475 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcd28140a80 0x7fcd28156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.040+0000 7fcd2db90700 1 --2- 172.21.15.133:0/92317475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd280ace10 0x7fcd280ae810 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.040+0000 7fcd2db90700 1 --2- 172.21.15.133:0/92317475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcd280ad1f0 0x7fcd280aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.040+0000 7fcd2db90700 1 -- 172.21.15.133:0/92317475 >> 172.21.15.133:0/92317475 conn(0x7fcd2805bdf0 msgr2=0x7fcd28142960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:31.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.040+0000 7fcd2db90700 1 -- 172.21.15.133:0/92317475 shutdown_connections 2021-01-03T13:06:31.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.040+0000 7fcd2db90700 1 -- 172.21.15.133:0/92317475 wait complete. 2021-01-03T13:06:31.058 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:06:20.666416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:06:21.971060+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:06:31.060 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:06:31.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.168+0000 7f111189c700 1 Processor -- start 2021-01-03T13:06:31.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.168+0000 7f111189c700 1 -- start start 2021-01-03T13:06:31.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111189c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f110c0b4c20 0x7f110c05c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111189c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f110c060510 0x7f110c0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111189c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f110c05fd10 0x7f110c0b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111189c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c05bf00 con 0x7f110c060510 2021-01-03T13:06:31.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111189c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c05c1a0 con 0x7f110c0b4c20 2021-01-03T13:06:31.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111189c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c05c440 con 0x7f110c05fd10 2021-01-03T13:06:31.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111089a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f110c0b4c20 0x7f110c05c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111089a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f110c0b4c20 0x7f110c05c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38720/0 (socket says 172.21.15.133:38720) 2021-01-03T13:06:31.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111109b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f110c05fd10 0x7f110c0b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f110bfff700 1 --2- 172.21.15.133:0/1140452762 >> v2:172.21.15.16:3300/0 conn(0x7f110c060510 0x7f110c0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111089a700 1 -- 172.21.15.133:0/1140452762 learned_addr learned my addr 172.21.15.133:0/1140452762 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:31.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111089a700 1 -- 172.21.15.133:0/1140452762 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f110c05fd10 msgr2=0x7f110c0b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:31.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111089a700 1 --2- 172.21.15.133:0/1140452762 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f110c05fd10 0x7f110c0b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111089a700 1 -- 172.21.15.133:0/1140452762 >> v2:172.21.15.16:3300/0 conn(0x7f110c060510 msgr2=0x7f110c0b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:31.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111089a700 1 --2- 172.21.15.133:0/1140452762 >> v2:172.21.15.16:3300/0 conn(0x7f110c060510 0x7f110c0b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111089a700 1 -- 172.21.15.133:0/1140452762 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c0b54f0 con 0x7f110c0b4c20 2021-01-03T13:06:31.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111089a700 1 --2- 172.21.15.133:0/1140452762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c0b4c20 0x7f110c05c8e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f1100002f30 tx=0x7f1100006e80).ready entity=mon.1 client_cookie=68ecea3110547909 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:31.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f110b7fe700 1 -- 172.21.15.133:0/1140452762 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1100009640 con 0x7f110c0b4c20 2021-01-03T13:06:31.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f110b7fe700 1 -- 172.21.15.133:0/1140452762 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11000097a0 con 0x7f110c0b4c20 2021-01-03T13:06:31.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111189c700 1 -- 172.21.15.133:0/1140452762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c0b4c20 msgr2=0x7f110c05c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f110b7fe700 1 -- 172.21.15.133:0/1140452762 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1100009b00 con 0x7f110c0b4c20 2021-01-03T13:06:31.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111189c700 1 --2- 172.21.15.133:0/1140452762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c0b4c20 0x7f110c05c8e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f1100002f30 tx=0x7f1100006e80).stop 2021-01-03T13:06:31.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111189c700 1 -- 172.21.15.133:0/1140452762 shutdown_connections 2021-01-03T13:06:31.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111189c700 1 --2- 172.21.15.133:0/1140452762 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f110c05fd10 0x7f110c0b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111189c700 1 --2- 172.21.15.133:0/1140452762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c0b4c20 0x7f110c05c8e0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111189c700 1 --2- 172.21.15.133:0/1140452762 >> v2:172.21.15.16:3300/0 conn(0x7f110c060510 0x7f110c0b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111189c700 1 -- 172.21.15.133:0/1140452762 >> 172.21.15.133:0/1140452762 conn(0x7f110c0b9f00 msgr2=0x7f110c0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:31.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111189c700 1 -- 172.21.15.133:0/1140452762 shutdown_connections 2021-01-03T13:06:31.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.172+0000 7f111189c700 1 -- 172.21.15.133:0/1140452762 wait complete. 2021-01-03T13:06:31.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111189c700 1 Processor -- start 2021-01-03T13:06:31.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111189c700 1 -- start start 2021-01-03T13:06:31.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111189c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c05fd10 0x7f110c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111189c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f110c060510 0x7f110c0b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111189c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f110c0b4c20 0x7f110c142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111189c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0b3730 con 0x7f110c060510 2021-01-03T13:06:31.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111189c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c09e390 con 0x7f110c05fd10 2021-01-03T13:06:31.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111189c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c09e630 con 0x7f110c0b4c20 2021-01-03T13:06:31.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111089a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c05fd10 0x7f110c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111089a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c05fd10 0x7f110c0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38722/0 (socket says 172.21.15.133:38722) 2021-01-03T13:06:31.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111089a700 1 -- 172.21.15.133:0/2460143561 learned_addr learned my addr 172.21.15.133:0/2460143561 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:31.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111109b700 1 --2- 172.21.15.133:0/2460143561 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f110c0b4c20 0x7f110c142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f110bfff700 1 --2- 172.21.15.133:0/2460143561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f110c060510 0x7f110c0b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111089a700 1 -- 172.21.15.133:0/2460143561 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f110c0b4c20 msgr2=0x7f110c142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111089a700 1 --2- 172.21.15.133:0/2460143561 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f110c0b4c20 0x7f110c142670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111089a700 1 -- 172.21.15.133:0/2460143561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f110c060510 msgr2=0x7f110c0b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111089a700 1 --2- 172.21.15.133:0/2460143561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f110c060510 0x7f110c0b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111089a700 1 -- 172.21.15.133:0/2460143561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c0b2980 con 0x7f110c05fd10 2021-01-03T13:06:31.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111089a700 1 --2- 172.21.15.133:0/2460143561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c05fd10 0x7f110c0b3940 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f110c06b660 tx=0x7f1100015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:31.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f1109ffb700 1 -- 172.21.15.133:0/2460143561 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1100009e40 con 0x7f110c05fd10 2021-01-03T13:06:31.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f1109ffb700 1 -- 172.21.15.133:0/2460143561 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1100011bb0 con 0x7f110c05fd10 2021-01-03T13:06:31.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111189c700 1 -- 172.21.15.133:0/2460143561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110c154e60 con 0x7f110c05fd10 2021-01-03T13:06:31.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f1109ffb700 1 -- 172.21.15.133:0/2460143561 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f110001d450 con 0x7f110c05fd10 2021-01-03T13:06:31.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.176+0000 7f111189c700 1 -- 172.21.15.133:0/2460143561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c0b34a0 con 0x7f110c05fd10 2021-01-03T13:06:31.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.180+0000 7f1109ffb700 1 -- 172.21.15.133:0/2460143561 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f110000f070 con 0x7f110c05fd10 2021-01-03T13:06:31.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.180+0000 7f111189c700 1 -- 172.21.15.133:0/2460143561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110c155020 con 0x7f110c05fd10 2021-01-03T13:06:31.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.180+0000 7f1109ffb700 1 --2- 172.21.15.133:0/2460143561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f10f40553b0 0x7f10f4057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.180+0000 7f1109ffb700 1 -- 172.21.15.133:0/2460143561 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f110006f980 con 0x7f110c05fd10 2021-01-03T13:06:31.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.180+0000 7f110bfff700 1 --2- 172.21.15.133:0/2460143561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f10f40553b0 0x7f10f4057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.180+0000 7f110bfff700 1 --2- 172.21.15.133:0/2460143561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f10f40553b0 0x7f10f4057870 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f10f800b000 tx=0x7f10f8006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:31.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.188+0000 7f1109ffb700 1 -- 172.21.15.133:0/2460143561 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1100045c20 con 0x7f110c05fd10 2021-01-03T13:06:31.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.324+0000 7f111189c700 1 -- 172.21.15.133:0/2460143561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f110c057300 con 0x7f110c05fd10 2021-01-03T13:06:31.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.324+0000 7f1109ffb700 1 -- 172.21.15.133:0/2460143561 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v124) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1100049200 con 0x7f110c05fd10 2021-01-03T13:06:31.331 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:06:31.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.328+0000 7f111189c700 1 -- 172.21.15.133:0/2460143561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f10f40553b0 msgr2=0x7f10f4057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.328+0000 7f111189c700 1 --2- 172.21.15.133:0/2460143561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f10f40553b0 0x7f10f4057870 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f10f800b000 tx=0x7f10f8006dc0).stop 2021-01-03T13:06:31.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.328+0000 7f111189c700 1 -- 172.21.15.133:0/2460143561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c05fd10 msgr2=0x7f110c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.328+0000 7f111189c700 1 --2- 172.21.15.133:0/2460143561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c05fd10 0x7f110c0b3940 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f110c06b660 tx=0x7f1100015000).stop 2021-01-03T13:06:31.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.328+0000 7f111189c700 1 -- 172.21.15.133:0/2460143561 shutdown_connections 2021-01-03T13:06:31.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.328+0000 7f111189c700 1 --2- 172.21.15.133:0/2460143561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f10f40553b0 0x7f10f4057870 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.328+0000 7f111189c700 1 --2- 172.21.15.133:0/2460143561 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f110c0b4c20 0x7f110c142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.328+0000 7f111189c700 1 --2- 172.21.15.133:0/2460143561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f110c05fd10 0x7f110c0b3940 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.328+0000 7f111189c700 1 --2- 172.21.15.133:0/2460143561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f110c060510 0x7f110c0b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.328+0000 7f111189c700 1 -- 172.21.15.133:0/2460143561 >> 172.21.15.133:0/2460143561 conn(0x7f110c0b9f00 msgr2=0x7f110c13ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:31.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.328+0000 7f111189c700 1 -- 172.21.15.133:0/2460143561 shutdown_connections 2021-01-03T13:06:31.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.328+0000 7f111189c700 1 -- 172.21.15.133:0/2460143561 wait complete. 2021-01-03T13:06:31.350 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:06:31.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde5834a700 1 Processor -- start 2021-01-03T13:06:31.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde5834a700 1 -- start start 2021-01-03T13:06:31.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde5834a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fde500b5a70 0x7fde50140270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde5834a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fde50143520 0x7fde50140760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde5834a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde50146480 con 0x7fde500ac1a0 2021-01-03T13:06:31.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde5834a700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde50146720 con 0x7fde50143520 2021-01-03T13:06:31.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde5834a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde501469c0 con 0x7fde500b5a70 2021-01-03T13:06:31.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde558e5700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fde500ac1a0 0x7fde50142e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59764/0 (socket says 172.21.15.133:59764) 2021-01-03T13:06:31.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde558e5700 1 -- 172.21.15.133:0/1708924608 learned_addr learned my addr 172.21.15.133:0/1708924608 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:31.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde568e7700 1 --2- 172.21.15.133:0/1708924608 >> v2:172.21.15.16:3300/0 conn(0x7fde50143520 0x7fde50140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde560e6700 1 --2- 172.21.15.133:0/1708924608 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fde500b5a70 0x7fde50140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde550e4700 1 -- 172.21.15.133:0/1708924608 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750358606 0 0) 0x7fde50146480 con 0x7fde500ac1a0 2021-01-03T13:06:31.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde550e4700 1 -- 172.21.15.133:0/1708924608 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde38003230 con 0x7fde500ac1a0 2021-01-03T13:06:31.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde568e7700 1 -- 172.21.15.133:0/1708924608 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fde500b5a70 msgr2=0x7fde50140270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:31.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde568e7700 1 --2- 172.21.15.133:0/1708924608 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fde500b5a70 0x7fde50140270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde568e7700 1 -- 172.21.15.133:0/1708924608 >> v1:172.21.15.133:6789/0 conn(0x7fde500ac1a0 legacy=0x7fde50142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde568e7700 1 -- 172.21.15.133:0/1708924608 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50146c60 con 0x7fde50143520 2021-01-03T13:06:31.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde568e7700 1 --2- 172.21.15.133:0/1708924608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde50143520 0x7fde50140760 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fde480032b0 tx=0x7fde480091a0).ready entity=mon.0 client_cookie=9b1a2a88b956d13e server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:31.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde550e4700 1 -- 172.21.15.133:0/1708924608 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde4800b940 con 0x7fde50143520 2021-01-03T13:06:31.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde550e4700 1 -- 172.21.15.133:0/1708924608 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4800baa0 con 0x7fde50143520 2021-01-03T13:06:31.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde550e4700 1 -- 172.21.15.133:0/1708924608 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde4800bc10 con 0x7fde50143520 2021-01-03T13:06:31.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde5834a700 1 -- 172.21.15.133:0/1708924608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde50143520 msgr2=0x7fde50140760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.460+0000 7fde5834a700 1 --2- 172.21.15.133:0/1708924608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde50143520 0x7fde50140760 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fde480032b0 tx=0x7fde480091a0).stop 2021-01-03T13:06:31.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde5834a700 1 -- 172.21.15.133:0/1708924608 shutdown_connections 2021-01-03T13:06:31.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde5834a700 1 --2- 172.21.15.133:0/1708924608 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde50143520 0x7fde50140760 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde5834a700 1 --2- 172.21.15.133:0/1708924608 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fde500b5a70 0x7fde50140270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde5834a700 1 -- 172.21.15.133:0/1708924608 >> 172.21.15.133:0/1708924608 conn(0x7fde5005c8c0 msgr2=0x7fde500b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:31.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde5834a700 1 -- 172.21.15.133:0/1708924608 shutdown_connections 2021-01-03T13:06:31.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde5834a700 1 -- 172.21.15.133:0/1708924608 wait complete. 2021-01-03T13:06:31.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde5834a700 1 Processor -- start 2021-01-03T13:06:31.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde5834a700 1 -- start start 2021-01-03T13:06:31.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde5834a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde500b5a70 0x7fde5013db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde5834a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde50143520 0x7fde50155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde5834a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fde50141bc0 0x7fde50155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde5834a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde50142cc0 con 0x7fde500b5a70 2021-01-03T13:06:31.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde5834a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde50142f20 con 0x7fde50143520 2021-01-03T13:06:31.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde5834a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde501412b0 con 0x7fde50141bc0 2021-01-03T13:06:31.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde558e5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde50143520 0x7fde50155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde558e5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde50143520 0x7fde50155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38738/0 (socket says 172.21.15.133:38738) 2021-01-03T13:06:31.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde558e5700 1 -- 172.21.15.133:0/329060636 learned_addr learned my addr 172.21.15.133:0/329060636 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:31.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde568e7700 1 --2- 172.21.15.133:0/329060636 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fde50141bc0 0x7fde50155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.464+0000 7fde560e6700 1 --2- 172.21.15.133:0/329060636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde500b5a70 0x7fde5013db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.468+0000 7fde558e5700 1 -- 172.21.15.133:0/329060636 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fde50141bc0 msgr2=0x7fde50155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.468+0000 7fde558e5700 1 --2- 172.21.15.133:0/329060636 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fde50141bc0 0x7fde50155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.468+0000 7fde558e5700 1 -- 172.21.15.133:0/329060636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde500b5a70 msgr2=0x7fde5013db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.468+0000 7fde558e5700 1 --2- 172.21.15.133:0/329060636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde500b5a70 0x7fde5013db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.468+0000 7fde558e5700 1 -- 172.21.15.133:0/329060636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50141550 con 0x7fde50143520 2021-01-03T13:06:31.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.468+0000 7fde558e5700 1 --2- 172.21.15.133:0/329060636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde50143520 0x7fde50155260 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fde400010d0 tx=0x7fde40007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:31.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.468+0000 7fde3f7fe700 1 -- 172.21.15.133:0/329060636 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde400072e0 con 0x7fde50143520 2021-01-03T13:06:31.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.468+0000 7fde3f7fe700 1 -- 172.21.15.133:0/329060636 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde40007440 con 0x7fde50143520 2021-01-03T13:06:31.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.468+0000 7fde5834a700 1 -- 172.21.15.133:0/329060636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde501417f0 con 0x7fde50143520 2021-01-03T13:06:31.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.468+0000 7fde3f7fe700 1 -- 172.21.15.133:0/329060636 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde400057d0 con 0x7fde50143520 2021-01-03T13:06:31.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.468+0000 7fde5834a700 1 -- 172.21.15.133:0/329060636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde50142090 con 0x7fde50143520 2021-01-03T13:06:31.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.468+0000 7fde5834a700 1 -- 172.21.15.133:0/329060636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde50057300 con 0x7fde50143520 2021-01-03T13:06:31.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.468+0000 7fde3f7fe700 1 -- 172.21.15.133:0/329060636 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fde4001a060 con 0x7fde50143520 2021-01-03T13:06:31.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.472+0000 7fde3f7fe700 1 --2- 172.21.15.133:0/329060636 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fde30055500 0x7fde300579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.472+0000 7fde3f7fe700 1 -- 172.21.15.133:0/329060636 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fde4006d310 con 0x7fde50143520 2021-01-03T13:06:31.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.472+0000 7fde560e6700 1 --2- 172.21.15.133:0/329060636 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fde30055500 0x7fde300579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.472+0000 7fde560e6700 1 --2- 172.21.15.133:0/329060636 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fde30055500 0x7fde300579c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fde4c00b000 tx=0x7fde4c006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:31.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.476+0000 7fde3f7fe700 1 -- 172.21.15.133:0/329060636 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fde40043610 con 0x7fde50143520 2021-01-03T13:06:31.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.612+0000 7fde5834a700 1 -- 172.21.15.133:0/329060636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fde5005ce00 con 0x7fde50143520 2021-01-03T13:06:31.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.612+0000 7fde3f7fe700 1 -- 172.21.15.133:0/329060636 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v124) v1 ==== 92+0+10 (secure 0 0 0) 0x7fde40018020 con 0x7fde50143520 2021-01-03T13:06:31.620 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:06:31.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.616+0000 7fde5834a700 1 -- 172.21.15.133:0/329060636 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fde30055500 msgr2=0x7fde300579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.616+0000 7fde5834a700 1 --2- 172.21.15.133:0/329060636 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fde30055500 0x7fde300579c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fde4c00b000 tx=0x7fde4c006dc0).stop 2021-01-03T13:06:31.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.616+0000 7fde5834a700 1 -- 172.21.15.133:0/329060636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde50143520 msgr2=0x7fde50155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.616+0000 7fde5834a700 1 --2- 172.21.15.133:0/329060636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde50143520 0x7fde50155260 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fde400010d0 tx=0x7fde40007aa0).stop 2021-01-03T13:06:31.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.616+0000 7fde5834a700 1 -- 172.21.15.133:0/329060636 shutdown_connections 2021-01-03T13:06:31.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.616+0000 7fde5834a700 1 --2- 172.21.15.133:0/329060636 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fde30055500 0x7fde300579c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.616+0000 7fde5834a700 1 --2- 172.21.15.133:0/329060636 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fde500b5a70 0x7fde5013db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.616+0000 7fde5834a700 1 --2- 172.21.15.133:0/329060636 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fde50141bc0 0x7fde50155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.616+0000 7fde5834a700 1 --2- 172.21.15.133:0/329060636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fde50143520 0x7fde50155260 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.616+0000 7fde5834a700 1 -- 172.21.15.133:0/329060636 >> 172.21.15.133:0/329060636 conn(0x7fde5005c8c0 msgr2=0x7fde500b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:31.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.616+0000 7fde5834a700 1 -- 172.21.15.133:0/329060636 shutdown_connections 2021-01-03T13:06:31.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.616+0000 7fde5834a700 1 -- 172.21.15.133:0/329060636 wait complete. 2021-01-03T13:06:31.634 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:06:31.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cfcd20700 1 Processor -- start 2021-01-03T13:06:31.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cfcd20700 1 -- start start 2021-01-03T13:06:31.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cfcd20700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1cf80b4c20 0x7f1cf805c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cfcd20700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1cf805fd10 0x7f1cf80b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cfcd20700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf805bf00 con 0x7f1cf8060510 2021-01-03T13:06:31.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cfcd20700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf805c1a0 con 0x7f1cf805fd10 2021-01-03T13:06:31.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cfcd20700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf805c440 con 0x7f1cf80b4c20 2021-01-03T13:06:31.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cf77fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1cf80b4c20 0x7f1cf805c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cf7fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1cf805fd10 0x7f1cf80b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cf77fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1cf80b4c20 0x7f1cf805c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:47046/0 (socket says 172.21.15.133:47046) 2021-01-03T13:06:31.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cf7fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1cf805fd10 0x7f1cf80b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:37284/0 (socket says 172.21.15.133:37284) 2021-01-03T13:06:31.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cf77fe700 1 -- 172.21.15.133:0/920307937 learned_addr learned my addr 172.21.15.133:0/920307937 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:31.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cf6ffd700 1 --1- 172.21.15.133:0/920307937 >> v1:172.21.15.16:6789/0 conn(0x7f1cf8060510 0x7f1cf80b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:38508/0 (socket says 172.21.15.133:38508) 2021-01-03T13:06:31.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cf77fe700 1 -- 172.21.15.133:0/920307937 >> v2:172.21.15.16:3300/0 conn(0x7f1cf805fd10 msgr2=0x7f1cf80b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:31.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cf77fe700 1 --2- 172.21.15.133:0/920307937 >> v2:172.21.15.16:3300/0 conn(0x7f1cf805fd10 0x7f1cf80b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cf77fe700 1 -- 172.21.15.133:0/920307937 >> v1:172.21.15.16:6789/0 conn(0x7f1cf8060510 legacy=0x7f1cf80b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cf77fe700 1 -- 172.21.15.133:0/920307937 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf80b6ad0 con 0x7f1cf80b4c20 2021-01-03T13:06:31.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.744+0000 7f1cf77fe700 1 --2- 172.21.15.133:0/920307937 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1cf80b4c20 0x7f1cf805c8e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1ce8002f30 tx=0x7f1ce8006e80).ready entity=mon.2 client_cookie=fd797566ec337ae9 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:31.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.748+0000 7f1cf67fc700 1 -- 172.21.15.133:0/920307937 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce80097f0 con 0x7f1cf80b4c20 2021-01-03T13:06:31.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.748+0000 7f1cf67fc700 1 -- 172.21.15.133:0/920307937 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce8009950 con 0x7f1cf80b4c20 2021-01-03T13:06:31.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.748+0000 7f1cf67fc700 1 -- 172.21.15.133:0/920307937 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce8009cb0 con 0x7f1cf80b4c20 2021-01-03T13:06:31.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.748+0000 7f1cfcd20700 1 -- 172.21.15.133:0/920307937 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1cf80b4c20 msgr2=0x7f1cf805c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.748+0000 7f1cfcd20700 1 --2- 172.21.15.133:0/920307937 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1cf80b4c20 0x7f1cf805c8e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1ce8002f30 tx=0x7f1ce8006e80).stop 2021-01-03T13:06:31.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.748+0000 7f1cfcd20700 1 -- 172.21.15.133:0/920307937 shutdown_connections 2021-01-03T13:06:31.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.748+0000 7f1cfcd20700 1 --2- 172.21.15.133:0/920307937 >> v2:172.21.15.16:3300/0 conn(0x7f1cf805fd10 0x7f1cf80b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.748+0000 7f1cfcd20700 1 --2- 172.21.15.133:0/920307937 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1cf80b4c20 0x7f1cf805c8e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.748+0000 7f1cfcd20700 1 -- 172.21.15.133:0/920307937 >> 172.21.15.133:0/920307937 conn(0x7f1cf80b9f00 msgr2=0x7f1cf80b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:31.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.748+0000 7f1cfcd20700 1 -- 172.21.15.133:0/920307937 shutdown_connections 2021-01-03T13:06:31.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.748+0000 7f1cfcd20700 1 -- 172.21.15.133:0/920307937 wait complete. 2021-01-03T13:06:31.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.748+0000 7f1cfcd20700 1 Processor -- start 2021-01-03T13:06:31.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.748+0000 7f1cfcd20700 1 -- start start 2021-01-03T13:06:31.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cfcd20700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cf805fd10 0x7f1cf8140c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cfcd20700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cf8060510 0x7f1cf8142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cfcd20700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1cf80b4c20 0x7f1cf81433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cfcd20700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf81438d0 con 0x7f1cf805fd10 2021-01-03T13:06:31.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cfcd20700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf809de60 con 0x7f1cf8060510 2021-01-03T13:06:31.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cfcd20700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf809e100 con 0x7f1cf80b4c20 2021-01-03T13:06:31.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cf6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cf8060510 0x7f1cf8142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cf6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cf8060510 0x7f1cf8142ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38752/0 (socket says 172.21.15.133:38752) 2021-01-03T13:06:31.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cf6ffd700 1 -- 172.21.15.133:0/929134902 learned_addr learned my addr 172.21.15.133:0/929134902 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:31.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cf77fe700 1 --2- 172.21.15.133:0/929134902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cf805fd10 0x7f1cf8140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cf7fff700 1 --2- 172.21.15.133:0/929134902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1cf80b4c20 0x7f1cf81433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cf6ffd700 1 -- 172.21.15.133:0/929134902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1cf80b4c20 msgr2=0x7f1cf81433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cf6ffd700 1 --2- 172.21.15.133:0/929134902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1cf80b4c20 0x7f1cf81433e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cf6ffd700 1 -- 172.21.15.133:0/929134902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cf805fd10 msgr2=0x7f1cf8140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cf6ffd700 1 --2- 172.21.15.133:0/929134902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cf805fd10 0x7f1cf8140c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cf6ffd700 1 -- 172.21.15.133:0/929134902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf8142a50 con 0x7f1cf8060510 2021-01-03T13:06:31.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cf7fff700 1 --2- 172.21.15.133:0/929134902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1cf80b4c20 0x7f1cf81433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:06:31.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cf77fe700 1 --2- 172.21.15.133:0/929134902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cf805fd10 0x7f1cf8140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:31.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cf6ffd700 1 --2- 172.21.15.133:0/929134902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cf8060510 0x7f1cf8142ef0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f1cf805f8c0 tx=0x7f1cec007bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:31.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cf4ff9700 1 -- 172.21.15.133:0/929134902 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cec007320 con 0x7f1cf8060510 2021-01-03T13:06:31.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cf4ff9700 1 -- 172.21.15.133:0/929134902 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec005520 con 0x7f1cf8060510 2021-01-03T13:06:31.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cfcd20700 1 -- 172.21.15.133:0/929134902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf8141130 con 0x7f1cf8060510 2021-01-03T13:06:31.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cf4ff9700 1 -- 172.21.15.133:0/929134902 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cec005880 con 0x7f1cf8060510 2021-01-03T13:06:31.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cfcd20700 1 -- 172.21.15.133:0/929134902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf8148d90 con 0x7f1cf8060510 2021-01-03T13:06:31.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.752+0000 7f1cfcd20700 1 -- 172.21.15.133:0/929134902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf8057300 con 0x7f1cf8060510 2021-01-03T13:06:31.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.756+0000 7f1cf4ff9700 1 -- 172.21.15.133:0/929134902 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1cec010030 con 0x7f1cf8060510 2021-01-03T13:06:31.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.756+0000 7f1cf4ff9700 1 --2- 172.21.15.133:0/929134902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1cd8055440 0x7f1cd8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:31.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.756+0000 7f1cf77fe700 1 --2- 172.21.15.133:0/929134902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1cd8055440 0x7f1cd8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:31.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.756+0000 7f1cf4ff9700 1 -- 172.21.15.133:0/929134902 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1cec06dd00 con 0x7f1cf8060510 2021-01-03T13:06:31.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.756+0000 7f1cf77fe700 1 --2- 172.21.15.133:0/929134902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1cd8055440 0x7f1cd8057900 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f1ce801a000 tx=0x7f1ce8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:31.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.760+0000 7f1cf4ff9700 1 -- 172.21.15.133:0/929134902 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1cec043e10 con 0x7f1cf8060510 2021-01-03T13:06:31.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.904+0000 7f1cfcd20700 1 -- 172.21.15.133:0/929134902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1cf8067a00 con 0x7f1cf8060510 2021-01-03T13:06:31.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.904+0000 7f1cf4ff9700 1 -- 172.21.15.133:0/929134902 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v124) v1 ==== 104+0+10 (secure 0 0 0) 0x7f1cec047430 con 0x7f1cf8060510 2021-01-03T13:06:31.910 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:06:31.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.904+0000 7f1cfcd20700 1 -- 172.21.15.133:0/929134902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1cd8055440 msgr2=0x7f1cd8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.904+0000 7f1cfcd20700 1 --2- 172.21.15.133:0/929134902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1cd8055440 0x7f1cd8057900 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f1ce801a000 tx=0x7f1ce8015000).stop 2021-01-03T13:06:31.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.904+0000 7f1cfcd20700 1 -- 172.21.15.133:0/929134902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cf8060510 msgr2=0x7f1cf8142ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:31.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.904+0000 7f1cfcd20700 1 --2- 172.21.15.133:0/929134902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cf8060510 0x7f1cf8142ef0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f1cf805f8c0 tx=0x7f1cec007bf0).stop 2021-01-03T13:06:31.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.904+0000 7f1cfcd20700 1 -- 172.21.15.133:0/929134902 shutdown_connections 2021-01-03T13:06:31.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.904+0000 7f1cfcd20700 1 --2- 172.21.15.133:0/929134902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1cd8055440 0x7f1cd8057900 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.904+0000 7f1cfcd20700 1 --2- 172.21.15.133:0/929134902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1cf805fd10 0x7f1cf8140c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.904+0000 7f1cfcd20700 1 --2- 172.21.15.133:0/929134902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1cf80b4c20 0x7f1cf81433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.904+0000 7f1cfcd20700 1 --2- 172.21.15.133:0/929134902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1cf8060510 0x7f1cf8142ef0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:31.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.904+0000 7f1cfcd20700 1 -- 172.21.15.133:0/929134902 >> 172.21.15.133:0/929134902 conn(0x7f1cf80b9f00 msgr2=0x7f1cf809c690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:31.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.904+0000 7f1cfcd20700 1 -- 172.21.15.133:0/929134902 shutdown_connections 2021-01-03T13:06:31.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:31.904+0000 7f1cfcd20700 1 -- 172.21.15.133:0/929134902 wait complete. 2021-01-03T13:06:31.924 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:06:32.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcee19700 1 Processor -- start 2021-01-03T13:06:32.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcee19700 1 -- start start 2021-01-03T13:06:32.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcee19700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dc80b2440 0x7f6dc813ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:32.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcee19700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc80b2820 con 0x7f6dc80af780 2021-01-03T13:06:32.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcee19700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc80b1af0 con 0x7f6dc80a9750 2021-01-03T13:06:32.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcee19700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc80aecd0 con 0x7f6dc80b2440 2021-01-03T13:06:32.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dce618700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6dc80a9750 0x7f6dc814a300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59794/0 (socket says 172.21.15.133:59794) 2021-01-03T13:06:32.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dce618700 1 -- 172.21.15.133:0/4115426113 learned_addr learned my addr 172.21.15.133:0/4115426113 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:32.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcde17700 1 --2- 172.21.15.133:0/4115426113 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dc80b2440 0x7f6dc813ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:32.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcce15700 1 -- 172.21.15.133:0/4115426113 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929463438 0 0) 0x7f6dc80b1af0 con 0x7f6dc80a9750 2021-01-03T13:06:32.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcce15700 1 -- 172.21.15.133:0/4115426113 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6db4003230 con 0x7f6dc80a9750 2021-01-03T13:06:32.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcce15700 1 -- 172.21.15.133:0/4115426113 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3285616725 0 0) 0x7f6db4003230 con 0x7f6dc80a9750 2021-01-03T13:06:32.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcce15700 1 -- 172.21.15.133:0/4115426113 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dc80b2440 msgr2=0x7f6dc813ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:32.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcce15700 1 --2- 172.21.15.133:0/4115426113 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dc80b2440 0x7f6dc813ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcce15700 1 -- 172.21.15.133:0/4115426113 >> v1:172.21.15.16:6789/0 conn(0x7f6dc80af780 legacy=0x7f6dc80672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:32.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcce15700 1 -- 172.21.15.133:0/4115426113 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc80b1d90 con 0x7f6dc80a9750 2021-01-03T13:06:32.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcce15700 1 -- 172.21.15.133:0/4115426113 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f6dc0001aa0 con 0x7f6dc80a9750 2021-01-03T13:06:32.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcce15700 1 -- 172.21.15.133:0/4115426113 >> v1:172.21.15.133:6789/0 conn(0x7f6dc80a9750 legacy=0x7f6dc814a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:32.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcce15700 1 --2- 172.21.15.133:0/4115426113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6db4003720 0x7f6db4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:32.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcce15700 1 --2- 172.21.15.133:0/4115426113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6db40044d0 0x7f6db4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:32.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcce15700 1 --2- 172.21.15.133:0/4115426113 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dc80b2440 0x7f6db4004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:32.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcce15700 1 -- 172.21.15.133:0/4115426113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc80aecd0 con 0x7f6db40044d0 2021-01-03T13:06:32.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcce15700 1 -- 172.21.15.133:0/4115426113 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db4005330 con 0x7f6db4003720 2021-01-03T13:06:32.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcce15700 1 -- 172.21.15.133:0/4115426113 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db400b720 con 0x7f6dc80b2440 2021-01-03T13:06:32.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcde17700 1 --2- 172.21.15.133:0/4115426113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6db4003720 0x7f6db4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:32.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcde17700 1 -- 172.21.15.133:0/4115426113 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dc80b2440 msgr2=0x7f6db4004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:32.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dce618700 1 --2- 172.21.15.133:0/4115426113 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dc80b2440 0x7f6db4004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:32.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcd616700 1 --2- 172.21.15.133:0/4115426113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6db40044d0 0x7f6db4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:32.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcde17700 1 --2- 172.21.15.133:0/4115426113 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dc80b2440 0x7f6db4004e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcde17700 1 -- 172.21.15.133:0/4115426113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6db40044d0 msgr2=0x7f6db4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:32.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcde17700 1 --2- 172.21.15.133:0/4115426113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6db40044d0 0x7f6db4004950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcde17700 1 -- 172.21.15.133:0/4115426113 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db4003230 con 0x7f6db4003720 2021-01-03T13:06:32.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcde17700 1 --2- 172.21.15.133:0/4115426113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6db4003720 0x7f6db4003b40 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f6db800c000 tx=0x7f6db8008040).ready entity=mon.1 client_cookie=47c122ac129359eb server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:32.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.040+0000 7f6dcce15700 1 -- 172.21.15.133:0/4115426113 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6db800e9d0 con 0x7f6db4003720 2021-01-03T13:06:32.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcce15700 1 -- 172.21.15.133:0/4115426113 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db800eb30 con 0x7f6db4003720 2021-01-03T13:06:32.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcce15700 1 -- 172.21.15.133:0/4115426113 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6db800ee90 con 0x7f6db4003720 2021-01-03T13:06:32.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcee19700 1 -- 172.21.15.133:0/4115426113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6db4003720 msgr2=0x7f6db4003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:32.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcee19700 1 --2- 172.21.15.133:0/4115426113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6db4003720 0x7f6db4003b40 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f6db800c000 tx=0x7f6db8008040).stop 2021-01-03T13:06:32.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dce618700 1 -- 172.21.15.133:0/4115426113 reap_dead start 2021-01-03T13:06:32.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcee19700 1 -- 172.21.15.133:0/4115426113 shutdown_connections 2021-01-03T13:06:32.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcee19700 1 -- 172.21.15.133:0/4115426113 >> 172.21.15.133:0/4115426113 conn(0x7f6dc806b050 msgr2=0x7f6dc8060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:32.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcee19700 1 -- 172.21.15.133:0/4115426113 shutdown_connections 2021-01-03T13:06:32.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcee19700 1 -- 172.21.15.133:0/4115426113 wait complete. 2021-01-03T13:06:32.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcee19700 1 Processor -- start 2021-01-03T13:06:32.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcee19700 1 -- start start 2021-01-03T13:06:32.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcee19700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc813a3f0 0x7f6dc805c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:32.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcee19700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dc8135710 0x7f6dc81462d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:32.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcee19700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6dc81467c0 0x7f6dc8146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:32.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcee19700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc813ba10 con 0x7f6dc81467c0 2021-01-03T13:06:32.064 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcee19700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc8147130 con 0x7f6dc813a3f0 2021-01-03T13:06:32.064 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcee19700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc813a7d0 con 0x7f6dc8135710 2021-01-03T13:06:32.064 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcde17700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc813a3f0 0x7f6dc805c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:32.064 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcde17700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc813a3f0 0x7f6dc805c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38770/0 (socket says 172.21.15.133:38770) 2021-01-03T13:06:32.064 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.044+0000 7f6dcde17700 1 -- 172.21.15.133:0/2000117492 learned_addr learned my addr 172.21.15.133:0/2000117492 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:32.065 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dce618700 1 --2- 172.21.15.133:0/2000117492 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6dc81467c0 0x7f6dc8146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:32.065 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dcd616700 1 --2- 172.21.15.133:0/2000117492 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dc8135710 0x7f6dc81462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:32.065 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dcde17700 1 -- 172.21.15.133:0/2000117492 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dc8135710 msgr2=0x7f6dc81462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:32.065 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dcde17700 1 --2- 172.21.15.133:0/2000117492 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dc8135710 0x7f6dc81462d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.065 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dcde17700 1 -- 172.21.15.133:0/2000117492 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6dc81467c0 msgr2=0x7f6dc8146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:32.066 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dcde17700 1 --2- 172.21.15.133:0/2000117492 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6dc81467c0 0x7f6dc8146c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.066 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dcde17700 1 -- 172.21.15.133:0/2000117492 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc813b7b0 con 0x7f6dc813a3f0 2021-01-03T13:06:32.066 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dcde17700 1 --2- 172.21.15.133:0/2000117492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc813a3f0 0x7f6dc805c890 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f6dc805c500 tx=0x7f6db801a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:32.066 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dc6ffd700 1 -- 172.21.15.133:0/2000117492 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6db801c430 con 0x7f6dc813a3f0 2021-01-03T13:06:32.066 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dc6ffd700 1 -- 172.21.15.133:0/2000117492 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db801c590 con 0x7f6dc813a3f0 2021-01-03T13:06:32.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dcee19700 1 -- 172.21.15.133:0/2000117492 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc813afe0 con 0x7f6dc813a3f0 2021-01-03T13:06:32.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dc6ffd700 1 -- 172.21.15.133:0/2000117492 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6db801c8f0 con 0x7f6dc813a3f0 2021-01-03T13:06:32.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dcee19700 1 -- 172.21.15.133:0/2000117492 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc813bce0 con 0x7f6dc813a3f0 2021-01-03T13:06:32.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dcee19700 1 -- 172.21.15.133:0/2000117492 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc8057300 con 0x7f6dc813a3f0 2021-01-03T13:06:32.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dc6ffd700 1 -- 172.21.15.133:0/2000117492 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6db802b070 con 0x7f6dc813a3f0 2021-01-03T13:06:32.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dc6ffd700 1 --2- 172.21.15.133:0/2000117492 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6da80553b0 0x7f6da8057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:32.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dcd616700 1 --2- 172.21.15.133:0/2000117492 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6da80553b0 0x7f6da8057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:32.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dc6ffd700 1 -- 172.21.15.133:0/2000117492 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6db806f580 con 0x7f6dc813a3f0 2021-01-03T13:06:32.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.048+0000 7f6dcd616700 1 --2- 172.21.15.133:0/2000117492 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6da80553b0 0x7f6da8057870 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f6dbc009000 tx=0x7f6dbc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:32.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.052+0000 7f6dc6ffd700 1 -- 172.21.15.133:0/2000117492 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6db8045880 con 0x7f6dc813a3f0 2021-01-03T13:06:32.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.196+0000 7f6dcee19700 1 -- 172.21.15.133:0/2000117492 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6dc80b16d0 con 0x7f6dc813a3f0 2021-01-03T13:06:32.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.196+0000 7f6dc6ffd700 1 -- 172.21.15.133:0/2000117492 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v124) v1 ==== 100+0+10 (secure 0 0 0) 0x7f6db8016070 con 0x7f6dc813a3f0 2021-01-03T13:06:32.202 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:06:32.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.196+0000 7f6dcee19700 1 -- 172.21.15.133:0/2000117492 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6da80553b0 msgr2=0x7f6da8057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:32.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.196+0000 7f6dcee19700 1 --2- 172.21.15.133:0/2000117492 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6da80553b0 0x7f6da8057870 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f6dbc009000 tx=0x7f6dbc009040).stop 2021-01-03T13:06:32.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.196+0000 7f6dcee19700 1 -- 172.21.15.133:0/2000117492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc813a3f0 msgr2=0x7f6dc805c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:32.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.196+0000 7f6dcee19700 1 --2- 172.21.15.133:0/2000117492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc813a3f0 0x7f6dc805c890 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f6dc805c500 tx=0x7f6db801a000).stop 2021-01-03T13:06:32.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.200+0000 7f6dcee19700 1 -- 172.21.15.133:0/2000117492 shutdown_connections 2021-01-03T13:06:32.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.200+0000 7f6dcee19700 1 --2- 172.21.15.133:0/2000117492 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6da80553b0 0x7f6da8057870 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.200+0000 7f6dcee19700 1 --2- 172.21.15.133:0/2000117492 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6dc81467c0 0x7f6dc8146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.200+0000 7f6dcee19700 1 --2- 172.21.15.133:0/2000117492 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dc813a3f0 0x7f6dc805c890 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.200+0000 7f6dcee19700 1 --2- 172.21.15.133:0/2000117492 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dc8135710 0x7f6dc81462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.200+0000 7f6dcee19700 1 -- 172.21.15.133:0/2000117492 >> 172.21.15.133:0/2000117492 conn(0x7f6dc806b050 msgr2=0x7f6dc8060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:32.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.200+0000 7f6dcee19700 1 -- 172.21.15.133:0/2000117492 shutdown_connections 2021-01-03T13:06:32.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.200+0000 7f6dcee19700 1 -- 172.21.15.133:0/2000117492 wait complete. 2021-01-03T13:06:32.216 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:06:32.217 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:06:32.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddd03c700 1 Processor -- start 2021-01-03T13:06:32.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddd03c700 1 -- start start 2021-01-03T13:06:32.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddd03c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbdd80606f0 0x7fbdd8060ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:32.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddd03c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbdd80b0ac0 0x7fbdd8143050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:32.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddd03c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbdd80abc50 0x7fbdd80aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:32.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddd03c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd80b1210 con 0x7fbdd80b0ac0 2021-01-03T13:06:32.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddd03c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd80afd30 con 0x7fbdd80606f0 2021-01-03T13:06:32.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddd03c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd8143540 con 0x7fbdd80abc50 2021-01-03T13:06:32.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbdd7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbdd80606f0 0x7fbdd8060ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:32.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbdd7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbdd80606f0 0x7fbdd8060ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38780/0 (socket says 172.21.15.133:38780) 2021-01-03T13:06:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbdd7fff700 1 -- 172.21.15.133:0/490789809 learned_addr learned my addr 172.21.15.133:0/490789809 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbdd77fe700 1 --2- 172.21.15.133:0/490789809 >> v2:172.21.15.16:3300/0 conn(0x7fbdd80b0ac0 0x7fbdd8143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddc83b700 1 --2- 172.21.15.133:0/490789809 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbdd80abc50 0x7fbdd80aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbdd7fff700 1 -- 172.21.15.133:0/490789809 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbdd80abc50 msgr2=0x7fbdd80aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:32.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbdd7fff700 1 --2- 172.21.15.133:0/490789809 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbdd80abc50 0x7fbdd80aa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbdd7fff700 1 -- 172.21.15.133:0/490789809 >> v2:172.21.15.16:3300/0 conn(0x7fbdd80b0ac0 msgr2=0x7fbdd8143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:32.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbdd7fff700 1 --2- 172.21.15.133:0/490789809 >> v2:172.21.15.16:3300/0 conn(0x7fbdd80b0ac0 0x7fbdd8143050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbdd7fff700 1 -- 172.21.15.133:0/490789809 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd80afa90 con 0x7fbdd80606f0 2021-01-03T13:06:32.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbdd7fff700 1 --2- 172.21.15.133:0/490789809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdd80606f0 0x7fbdd8060ad0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7fbdc8002f30 tx=0x7fbdc8006e80).ready entity=mon.1 client_cookie=7ee3b1033167bfea server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:32.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbdd6ffd700 1 -- 172.21.15.133:0/490789809 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdc80097f0 con 0x7fbdd80606f0 2021-01-03T13:06:32.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbdd6ffd700 1 -- 172.21.15.133:0/490789809 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc8009950 con 0x7fbdd80606f0 2021-01-03T13:06:32.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbdd6ffd700 1 -- 172.21.15.133:0/490789809 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdc8009cb0 con 0x7fbdd80606f0 2021-01-03T13:06:32.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddd03c700 1 -- 172.21.15.133:0/490789809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdd80606f0 msgr2=0x7fbdd8060ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:32.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddd03c700 1 --2- 172.21.15.133:0/490789809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdd80606f0 0x7fbdd8060ad0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7fbdc8002f30 tx=0x7fbdc8006e80).stop 2021-01-03T13:06:32.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddd03c700 1 -- 172.21.15.133:0/490789809 shutdown_connections 2021-01-03T13:06:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddd03c700 1 --2- 172.21.15.133:0/490789809 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbdd80abc50 0x7fbdd80aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddd03c700 1 --2- 172.21.15.133:0/490789809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdd80606f0 0x7fbdd8060ad0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddd03c700 1 --2- 172.21.15.133:0/490789809 >> v2:172.21.15.16:3300/0 conn(0x7fbdd80b0ac0 0x7fbdd8143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddd03c700 1 -- 172.21.15.133:0/490789809 >> 172.21.15.133:0/490789809 conn(0x7fbdd805bdf0 msgr2=0x7fbdd805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:32.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddd03c700 1 -- 172.21.15.133:0/490789809 shutdown_connections 2021-01-03T13:06:32.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.324+0000 7fbddd03c700 1 -- 172.21.15.133:0/490789809 wait complete. 2021-01-03T13:06:32.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbddd03c700 1 Processor -- start 2021-01-03T13:06:32.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbddd03c700 1 -- start start 2021-01-03T13:06:32.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbddd03c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdd80606f0 0x7fbdd8140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbddd03c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdd80abc50 0x7fbdd80b5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbddd03c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbdd80b0ac0 0x7fbdd808fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbddd03c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd813fd60 con 0x7fbdd80abc50 2021-01-03T13:06:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbddd03c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd813f5a0 con 0x7fbdd80606f0 2021-01-03T13:06:32.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbddd03c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd813ff90 con 0x7fbdd80b0ac0 2021-01-03T13:06:32.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbdd7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdd80606f0 0x7fbdd8140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:32.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbdd7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdd80606f0 0x7fbdd8140990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38784/0 (socket says 172.21.15.133:38784) 2021-01-03T13:06:32.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbdd7fff700 1 -- 172.21.15.133:0/8329020 learned_addr learned my addr 172.21.15.133:0/8329020 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:32.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbddc83b700 1 --2- 172.21.15.133:0/8329020 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbdd80b0ac0 0x7fbdd808fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:32.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbdd77fe700 1 --2- 172.21.15.133:0/8329020 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdd80abc50 0x7fbdd80b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:32.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbdd7fff700 1 -- 172.21.15.133:0/8329020 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbdd80b0ac0 msgr2=0x7fbdd808fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:32.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbdd7fff700 1 --2- 172.21.15.133:0/8329020 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbdd80b0ac0 0x7fbdd808fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbdd7fff700 1 -- 172.21.15.133:0/8329020 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdd80abc50 msgr2=0x7fbdd80b5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:32.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbdd7fff700 1 --2- 172.21.15.133:0/8329020 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdd80abc50 0x7fbdd80b5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbdd7fff700 1 -- 172.21.15.133:0/8329020 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd813f840 con 0x7fbdd80606f0 2021-01-03T13:06:32.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbdd7fff700 1 --2- 172.21.15.133:0/8329020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdd80606f0 0x7fbdd8140990 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7fbdd8151bc0 tx=0x7fbdc8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:32.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbdd57fa700 1 -- 172.21.15.133:0/8329020 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdc8011b90 con 0x7fbdd80606f0 2021-01-03T13:06:32.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbdd57fa700 1 -- 172.21.15.133:0/8329020 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc8011cf0 con 0x7fbdd80606f0 2021-01-03T13:06:32.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbddd03c700 1 -- 172.21.15.133:0/8329020 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd80926f0 con 0x7fbdd80606f0 2021-01-03T13:06:32.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbdd57fa700 1 -- 172.21.15.133:0/8329020 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdc801e650 con 0x7fbdd80606f0 2021-01-03T13:06:32.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.328+0000 7fbddd03c700 1 -- 172.21.15.133:0/8329020 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd813f1a0 con 0x7fbdd80606f0 2021-01-03T13:06:32.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.332+0000 7fbddd03c700 1 -- 172.21.15.133:0/8329020 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd808fd40 con 0x7fbdd80606f0 2021-01-03T13:06:32.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.332+0000 7fbdd57fa700 1 -- 172.21.15.133:0/8329020 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fbdc8025030 con 0x7fbdd80606f0 2021-01-03T13:06:32.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.332+0000 7fbdd57fa700 1 --2- 172.21.15.133:0/8329020 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbdb8055330 0x7fbdb80577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:32.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.332+0000 7fbdd57fa700 1 -- 172.21.15.133:0/8329020 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbdc806f570 con 0x7fbdd80606f0 2021-01-03T13:06:32.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.332+0000 7fbdd77fe700 1 --2- 172.21.15.133:0/8329020 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbdb8055330 0x7fbdb80577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:32.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.332+0000 7fbdd77fe700 1 --2- 172.21.15.133:0/8329020 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbdb8055330 0x7fbdb80577f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fbdcc00c000 tx=0x7fbdcc008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:32.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.336+0000 7fbdd57fa700 1 -- 172.21.15.133:0/8329020 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbdc8045870 con 0x7fbdd80606f0 2021-01-03T13:06:32.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.516+0000 7fbddd03c700 1 -- 172.21.15.133:0/8329020 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdd8057300 con 0x7fbdd80606f0 2021-01-03T13:06:32.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.516+0000 7fbdd57fa700 1 -- 172.21.15.133:0/8329020 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fbdc8023090 con 0x7fbdd80606f0 2021-01-03T13:06:32.524 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:32.525 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":56,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7338,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6833/34326903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":34326903},{"type":"v1","addr":"172.21.15.16:6833","nonce":34326903}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":52},{"gid":7426,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6836/1683013797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1683013797},{"type":"v1","addr":"172.21.15.133:6836","nonce":1683013797}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":53}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:06:23.150709+0000","modified":"2021-01-03T13:06:24.614525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7429},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7429":{"gid":7429,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/1725513894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":1725513894},{"type":"v1","addr":"172.21.15.133:6837","nonce":1725513894}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2021-01-03T13:06:32.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.520+0000 7fbddd03c700 1 -- 172.21.15.133:0/8329020 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbdb8055330 msgr2=0x7fbdb80577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:32.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.520+0000 7fbddd03c700 1 --2- 172.21.15.133:0/8329020 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbdb8055330 0x7fbdb80577f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fbdcc00c000 tx=0x7fbdcc008040).stop 2021-01-03T13:06:32.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.520+0000 7fbddd03c700 1 -- 172.21.15.133:0/8329020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdd80606f0 msgr2=0x7fbdd8140990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:32.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.520+0000 7fbddd03c700 1 --2- 172.21.15.133:0/8329020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdd80606f0 0x7fbdd8140990 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7fbdd8151bc0 tx=0x7fbdc8015000).stop 2021-01-03T13:06:32.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.520+0000 7fbddd03c700 1 -- 172.21.15.133:0/8329020 shutdown_connections 2021-01-03T13:06:32.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.520+0000 7fbddd03c700 1 --2- 172.21.15.133:0/8329020 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbdb8055330 0x7fbdb80577f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.520+0000 7fbddd03c700 1 --2- 172.21.15.133:0/8329020 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbdd80b0ac0 0x7fbdd808fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.520+0000 7fbddd03c700 1 --2- 172.21.15.133:0/8329020 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbdd80606f0 0x7fbdd8140990 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.520+0000 7fbddd03c700 1 --2- 172.21.15.133:0/8329020 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbdd80abc50 0x7fbdd80b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:32.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.520+0000 7fbddd03c700 1 -- 172.21.15.133:0/8329020 >> 172.21.15.133:0/8329020 conn(0x7fbdd805bdf0 msgr2=0x7fbdd80ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:32.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.520+0000 7fbddd03c700 1 -- 172.21.15.133:0/8329020 shutdown_connections 2021-01-03T13:06:32.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:32.520+0000 7fbddd03c700 1 -- 172.21.15.133:0/8329020 wait complete. 2021-01-03T13:06:32.529 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 56 2021-01-03T13:06:32.840 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:06:23.150709+0000', 'modified': '2021-01-03T13:06:24.614525+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7429}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7429': {'gid': 7429, 'name': 'c', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/1725513894', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 1725513894}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 1725513894}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:06:32.841 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:06:32.841 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T13:06:32.971 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":7429,"want_state":"up:active","state":"up:active","rank_uptime":9.8060093070000001,"mdsmap_epoch":56,"osdmap_epoch":124,"osdmap_epoch_barrier":124,"uptime":15.225204055000001} 2021-01-03T13:06:32.972 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 7429, "mdsmap_epoch": 56, "osdmap_epoch": 124, "osdmap_epoch_barrier": 124, "rank_uptime": 9.806009307, "state": "up:active", "uptime": 15.225204055, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:06:32.973 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:06:32.973 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-01-03T13:06:32.973 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi036.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-01-03T13:06:32.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:32.976 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:32.985 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:06:33.040 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:06:33.041 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:06:33.097 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:06:33.098 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:06:33.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:33.099 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:06:33.148 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:06:33.149 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:33.192 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:06:33.207 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:06:33.208 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:06:33.265 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:06:33.266 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:06:33.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:33.267 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:06:33.268 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:2021-01-03T13:06:33.263+0000 7fd7614de0c0 -1 init, newargv = 0x55e58e8adb20 newargc=9ceph-fuse[12151]: starting ceph client 2021-01-03T13:06:33.268 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr: 2021-01-03T13:06:33.280 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[12151]: starting fuse 2021-01-03T13:06:34.378 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:06:34.394 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:06:34.395 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:06:34.452 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:06:34.453 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:06:34.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:34.454 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:06:34.500 INFO:teuthology.orchestra.run.smithi036.stdout:50 2021-01-03T13:06:34.500 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:06:34.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:34.501 DEBUG:teuthology.orchestra.run.smithi036:> sudo python3 -c ' 2021-01-03T13:06:34.502 DEBUG:teuthology.orchestra.run.smithi036:> import glob 2021-01-03T13:06:34.502 DEBUG:teuthology.orchestra.run.smithi036:> import re 2021-01-03T13:06:34.503 DEBUG:teuthology.orchestra.run.smithi036:> import os 2021-01-03T13:06:34.503 DEBUG:teuthology.orchestra.run.smithi036:> import subprocess 2021-01-03T13:06:34.505 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:06:34.505 DEBUG:teuthology.orchestra.run.smithi036:> def find_socket(client_name): 2021-01-03T13:06:34.506 DEBUG:teuthology.orchestra.run.smithi036:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-01-03T13:06:34.506 DEBUG:teuthology.orchestra.run.smithi036:> files = glob.glob(asok_path) 2021-01-03T13:06:34.506 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:06:34.507 DEBUG:teuthology.orchestra.run.smithi036:> # Given a non-glob path, it better be there 2021-01-03T13:06:34.507 DEBUG:teuthology.orchestra.run.smithi036:> if "*" not in asok_path: 2021-01-03T13:06:34.508 DEBUG:teuthology.orchestra.run.smithi036:> assert(len(files) == 1) 2021-01-03T13:06:34.508 DEBUG:teuthology.orchestra.run.smithi036:> return files[0] 2021-01-03T13:06:34.508 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:06:34.509 DEBUG:teuthology.orchestra.run.smithi036:> for f in files: 2021-01-03T13:06:34.510 DEBUG:teuthology.orchestra.run.smithi036:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:06:34.510 DEBUG:teuthology.orchestra.run.smithi036:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:06:34.510 DEBUG:teuthology.orchestra.run.smithi036:> return f 2021-01-03T13:06:34.511 DEBUG:teuthology.orchestra.run.smithi036:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:06:34.511 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:06:34.511 DEBUG:teuthology.orchestra.run.smithi036:> print(find_socket("client.1")) 2021-01-03T13:06:34.512 DEBUG:teuthology.orchestra.run.smithi036:> ' 2021-01-03T13:06:34.591 INFO:teuthology.orchestra.run.smithi036.stdout:/var/run/ceph/ceph-client.1.12151.asok 2021-01-03T13:06:34.596 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.12151.asok 2021-01-03T13:06:34.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:34.597 DEBUG:teuthology.orchestra.run.smithi036:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.12151.asok status 2021-01-03T13:06:34.698 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2021-01-03T13:06:34.698 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": { 2021-01-03T13:06:34.699 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:06:34.699 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:06:34.699 INFO:teuthology.orchestra.run.smithi036.stdout: "entity_id": "1", 2021-01-03T13:06:34.700 INFO:teuthology.orchestra.run.smithi036.stdout: "hostname": "smithi036", 2021-01-03T13:06:34.700 INFO:teuthology.orchestra.run.smithi036.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-01-03T13:06:34.700 INFO:teuthology.orchestra.run.smithi036.stdout: "pid": "12151", 2021-01-03T13:06:34.700 INFO:teuthology.orchestra.run.smithi036.stdout: "root": "/" 2021-01-03T13:06:34.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:06:34.701 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_count": 0, 2021-01-03T13:06:34.701 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_pinned_count": 0, 2021-01-03T13:06:34.701 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 7618, 2021-01-03T13:06:34.701 INFO:teuthology.orchestra.run.smithi036.stdout: "inst": { 2021-01-03T13:06:34.701 INFO:teuthology.orchestra.run.smithi036.stdout: "name": { 2021-01-03T13:06:34.702 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "client", 2021-01-03T13:06:34.702 INFO:teuthology.orchestra.run.smithi036.stdout: "num": 7618 2021-01-03T13:06:34.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:06:34.702 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:06:34.703 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:06:34.703 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:06:34.703 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 4089699868 2021-01-03T13:06:34.703 INFO:teuthology.orchestra.run.smithi036.stdout: } 2021-01-03T13:06:34.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:06:34.704 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:06:34.704 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:06:34.704 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:06:34.704 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 4089699868 2021-01-03T13:06:34.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:06:34.705 INFO:teuthology.orchestra.run.smithi036.stdout: "inst_str": "client.7618 172.21.15.36:0/4089699868", 2021-01-03T13:06:34.705 INFO:teuthology.orchestra.run.smithi036.stdout: "addr_str": "172.21.15.36:0/4089699868", 2021-01-03T13:06:34.705 INFO:teuthology.orchestra.run.smithi036.stdout: "inode_count": 1, 2021-01-03T13:06:34.706 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_epoch": 56, 2021-01-03T13:06:34.706 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch": 124, 2021-01-03T13:06:34.707 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:06:34.707 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklisted": false, 2021-01-03T13:06:34.707 INFO:teuthology.orchestra.run.smithi036.stdout: "fs_name": "cephfs" 2021-01-03T13:06:34.707 INFO:teuthology.orchestra.run.smithi036.stdout:} 2021-01-03T13:06:34.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:34.709 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:34.710 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:34.718 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:06:34.720 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:06:34.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:34.722 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:34.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:34.781 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:34.782 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:34.791 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:06:34.791 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:06:34.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:34.792 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:34.793 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:34.841 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:06:34.842 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:06:34.842 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T13:06:34.843 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:06:34.843 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:34.914 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12634]: fuse finished with error 0 and tester_r 0 2021-01-03T13:06:34.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:34.916 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:34.917 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:34.965 INFO:teuthology.orchestra.run.smithi007.stdout:ext2/ext3 2021-01-03T13:06:34.966 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:06:34.966 INFO:teuthology.orchestra.run:waiting for 900 2021-01-03T13:06:35.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:06:35.039 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:35.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:35.047 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:35.047 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:35.056 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:06:35.057 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:06:35.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:35.059 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:35.060 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:35.106 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:06:35.107 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:06:35.108 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi036.front.sepia.ceph.com... 2021-01-03T13:06:35.108 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:06:35.108 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:35.182 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[12151]: fuse finished with error 0 and tester_r 0 2021-01-03T13:06:35.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:35.185 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:35.185 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:35.234 INFO:teuthology.orchestra.run.smithi036.stdout:ext2/ext3 2021-01-03T13:06:35.235 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:06:35.236 INFO:teuthology.orchestra.run:waiting for 900 2021-01-03T13:06:35.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:06:35.266 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:35.313 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-01-03T13:06:35.314 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:06:35.314 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-01-03T13:06:35.315 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:06:35.315 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-01-03T13:06:35.315 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:06:35.330 INFO:tasks.ceph.mds.a:Stopped 2021-01-03T13:06:35.331 INFO:tasks.ceph.mds.c:Stopped 2021-01-03T13:06:35.331 DEBUG:teuthology.parallel:result is None 2021-01-03T13:06:35.332 DEBUG:teuthology.parallel:result is None 2021-01-03T13:06:35.333 INFO:tasks.ceph.mds.b:Stopped 2021-01-03T13:06:35.334 DEBUG:teuthology.parallel:result is None 2021-01-03T13:06:35.335 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail a 2021-01-03T13:06:35.336 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail c 2021-01-03T13:06:35.336 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail b 2021-01-03T13:06:35.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2f01794700 1 Processor -- start 2021-01-03T13:06:35.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2f01794700 1 -- start start 2021-01-03T13:06:35.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb68044e700 1 Processor -- start 2021-01-03T13:06:35.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb68044e700 1 -- start start 2021-01-03T13:06:35.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb68044e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb67805c840 0x7fb6780af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:35.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb68044e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb67813f960 0x7fb678138c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:35.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb68044e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67805cc20 con 0x7fb6780afa70 2021-01-03T13:06:35.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb68044e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6780b18e0 con 0x7fb67813f960 2021-01-03T13:06:35.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb68044e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6780afeb0 con 0x7fb67805c840 2021-01-03T13:06:35.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb67e9eb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb67813f960 0x7fb678138c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:35.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb67e9eb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb67813f960 0x7fb678138c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38802/0 (socket says 172.21.15.133:38802) 2021-01-03T13:06:35.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb67e9eb700 1 -- 172.21.15.133:0/1453790848 learned_addr learned my addr 172.21.15.133:0/1453790848 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:35.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb67e1ea700 1 --2- 172.21.15.133:0/1453790848 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb67805c840 0x7fb6780af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:35.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb67e9eb700 1 -- 172.21.15.133:0/1453790848 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb67805c840 msgr2=0x7fb6780af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:35.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb67e9eb700 1 --2- 172.21.15.133:0/1453790848 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb67805c840 0x7fb6780af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:35.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb67e9eb700 1 -- 172.21.15.133:0/1453790848 >> v1:172.21.15.16:6789/0 conn(0x7fb6780afa70 legacy=0x7fb67813f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:35.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb67e9eb700 1 -- 172.21.15.133:0/1453790848 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6780ad2d0 con 0x7fb67813f960 2021-01-03T13:06:35.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb67e9eb700 1 --2- 172.21.15.133:0/1453790848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb67813f960 0x7fb678138c40 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7fb6700032b0 tx=0x7fb670009270).ready entity=mon.1 client_cookie=9b58d7c4de1a98d6 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb67d1e8700 1 -- 172.21.15.133:0/1453790848 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb67000bc00 con 0x7fb67813f960 2021-01-03T13:06:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb67d1e8700 1 -- 172.21.15.133:0/1453790848 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67000bd60 con 0x7fb67813f960 2021-01-03T13:06:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb67d1e8700 1 -- 172.21.15.133:0/1453790848 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb670011400 con 0x7fb67813f960 2021-01-03T13:06:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb68044e700 1 -- 172.21.15.133:0/1453790848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb67813f960 msgr2=0x7fb678138c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:35.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7fb68044e700 1 --2- 172.21.15.133:0/1453790848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb67813f960 0x7fb678138c40 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7fb6700032b0 tx=0x7fb670009270).stop 2021-01-03T13:06:35.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb68044e700 1 -- 172.21.15.133:0/1453790848 shutdown_connections 2021-01-03T13:06:35.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb68044e700 1 --2- 172.21.15.133:0/1453790848 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb67805c840 0x7fb6780af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:35.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb68044e700 1 --2- 172.21.15.133:0/1453790848 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb67813f960 0x7fb678138c40 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:35.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb68044e700 1 -- 172.21.15.133:0/1453790848 >> 172.21.15.133:0/1453790848 conn(0x7fb67806aeb0 msgr2=0x7fb67805bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:35.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb68044e700 1 -- 172.21.15.133:0/1453790848 shutdown_connections 2021-01-03T13:06:35.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb68044e700 1 -- 172.21.15.133:0/1453790848 wait complete. 2021-01-03T13:06:35.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb68044e700 1 Processor -- start 2021-01-03T13:06:35.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb68044e700 1 -- start start 2021-01-03T13:06:35.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2f01794700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2efc0b23a0 0x7f2efc066fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:35.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2f01794700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2efc0af780 0x7f2efc0b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:35.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2f01794700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc0b2780 con 0x7f2efc1406b0 2021-01-03T13:06:35.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2f01794700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2efc0aef00 con 0x7f2efc0b23a0 2021-01-03T13:06:35.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2f01794700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0b1710 con 0x7f2efc0af780 2021-01-03T13:06:35.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2efbfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2efc0b23a0 0x7f2efc066fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:35.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2efbfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2efc0b23a0 0x7f2efc066fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38792/0 (socket says 172.21.15.133:38792) 2021-01-03T13:06:35.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2efbfff700 1 -- 172.21.15.133:0/2069541628 learned_addr learned my addr 172.21.15.133:0/2069541628 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:35.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2f00f93700 1 --2- 172.21.15.133:0/2069541628 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2efc0af780 0x7f2efc0b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:35.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2efbfff700 1 -- 172.21.15.133:0/2069541628 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2efc0af780 msgr2=0x7f2efc0b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:35.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2efbfff700 1 --2- 172.21.15.133:0/2069541628 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2efc0af780 0x7f2efc0b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:35.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2efbfff700 1 -- 172.21.15.133:0/2069541628 >> v1:172.21.15.16:6789/0 conn(0x7f2efc1406b0 legacy=0x7f2efc0674a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:35.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2efbfff700 1 -- 172.21.15.133:0/2069541628 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc0a9480 con 0x7f2efc0b23a0 2021-01-03T13:06:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2efbfff700 1 --2- 172.21.15.133:0/2069541628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2efc0b23a0 0x7f2efc066fb0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f2efc0610d0 tx=0x7f2eec006e80).ready entity=mon.1 client_cookie=458301dba1d329d9 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2efaffd700 1 -- 172.21.15.133:0/2069541628 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2eec0097b0 con 0x7f2efc0b23a0 2021-01-03T13:06:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2efaffd700 1 -- 172.21.15.133:0/2069541628 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec009910 con 0x7f2efc0b23a0 2021-01-03T13:06:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2efaffd700 1 -- 172.21.15.133:0/2069541628 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2eec009a80 con 0x7f2efc0b23a0 2021-01-03T13:06:35.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2f01794700 1 -- 172.21.15.133:0/2069541628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2efc0b23a0 msgr2=0x7f2efc066fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2f01794700 1 --2- 172.21.15.133:0/2069541628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2efc0b23a0 0x7f2efc066fb0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f2efc0610d0 tx=0x7f2eec006e80).stop 2021-01-03T13:06:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2f01794700 1 -- 172.21.15.133:0/2069541628 shutdown_connections 2021-01-03T13:06:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2f01794700 1 --2- 172.21.15.133:0/2069541628 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2efc0af780 0x7f2efc0b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2f01794700 1 --2- 172.21.15.133:0/2069541628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2efc0b23a0 0x7f2efc066fb0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2f01794700 1 -- 172.21.15.133:0/2069541628 >> 172.21.15.133:0/2069541628 conn(0x7f2efc06b050 msgr2=0x7f2efc060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:35.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2f01794700 1 -- 172.21.15.133:0/2069541628 shutdown_connections 2021-01-03T13:06:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.480+0000 7f2f01794700 1 -- 172.21.15.133:0/2069541628 wait complete. 2021-01-03T13:06:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2f01794700 1 Processor -- start 2021-01-03T13:06:35.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2f01794700 1 -- start start 2021-01-03T13:06:35.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f77d2284700 1 Processor -- start 2021-01-03T13:06:35.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f77d2284700 1 -- start start 2021-01-03T13:06:35.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f77d2284700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77cc142c50 0x7f77cc060cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:35.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f77d2284700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77cc09a170 con 0x7f77cc0b5b30 2021-01-03T13:06:35.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f77d2284700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77cc09a410 con 0x7f77cc0aa960 2021-01-03T13:06:35.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f77d2284700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc143c80 con 0x7f77cc142c50 2021-01-03T13:06:35.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f77d1282700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f77cc0aa960 0x7f77cc0b5420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59846/0 (socket says 172.21.15.133:59846) 2021-01-03T13:06:35.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f77d1282700 1 -- 172.21.15.133:0/4062599044 learned_addr learned my addr 172.21.15.133:0/4062599044 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:35.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f77bbfff700 1 -- 172.21.15.133:0/4062599044 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158411425 0 0) 0x7f77cc09a410 con 0x7f77cc0aa960 2021-01-03T13:06:35.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f77bbfff700 1 -- 172.21.15.133:0/4062599044 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77b4003230 con 0x7f77cc0aa960 2021-01-03T13:06:35.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f77d1a83700 1 --2- 172.21.15.133:0/4062599044 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77cc142c50 0x7f77cc060cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:35.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f77d1a83700 1 -- 172.21.15.133:0/4062599044 >> v1:172.21.15.133:6789/0 conn(0x7f77cc0aa960 legacy=0x7f77cc0b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:35.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f77d1a83700 1 -- 172.21.15.133:0/4062599044 >> v1:172.21.15.16:6789/0 conn(0x7f77cc0b5b30 legacy=0x7f77cc13fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:35.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f77d1a83700 1 -- 172.21.15.133:0/4062599044 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc0b4f80 con 0x7f77cc142c50 2021-01-03T13:06:35.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f77d1a83700 1 --2- 172.21.15.133:0/4062599044 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77cc142c50 0x7f77cc060cb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f77c80017f0 tx=0x7f77c40091a0).ready entity=mon.2 client_cookie=380630d6dcc8dfea server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:35.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f77bbfff700 1 -- 172.21.15.133:0/4062599044 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77c8001650 con 0x7f77cc142c50 2021-01-03T13:06:35.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f77bbfff700 1 -- 172.21.15.133:0/4062599044 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c400b8b0 con 0x7f77cc142c50 2021-01-03T13:06:35.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f77bbfff700 1 -- 172.21.15.133:0/4062599044 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77c400ba20 con 0x7f77cc142c50 2021-01-03T13:06:35.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f77d2284700 1 -- 172.21.15.133:0/4062599044 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77cc142c50 msgr2=0x7f77cc060cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:35.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f77d2284700 1 --2- 172.21.15.133:0/4062599044 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77cc142c50 0x7f77cc060cb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f77c80017f0 tx=0x7f77c40091a0).stop 2021-01-03T13:06:35.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d2284700 1 -- 172.21.15.133:0/4062599044 shutdown_connections 2021-01-03T13:06:35.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d2284700 1 --2- 172.21.15.133:0/4062599044 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77cc142c50 0x7f77cc060cb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:35.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d2284700 1 -- 172.21.15.133:0/4062599044 >> 172.21.15.133:0/4062599044 conn(0x7f77cc05bdf0 msgr2=0x7f77cc05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:35.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d2284700 1 -- 172.21.15.133:0/4062599044 shutdown_connections 2021-01-03T13:06:35.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d2284700 1 -- 172.21.15.133:0/4062599044 wait complete. 2021-01-03T13:06:35.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d2284700 1 Processor -- start 2021-01-03T13:06:35.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d2284700 1 -- start start 2021-01-03T13:06:35.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d2284700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77cc0aa960 0x7f77cc146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:35.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d2284700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77cc0b5b30 0x7f77cc13d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:35.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d2284700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77cc1495d0 0x7f77cc1450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:35.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d2284700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc1468b0 con 0x7f77cc0b5b30 2021-01-03T13:06:35.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d2284700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc149db0 con 0x7f77cc1495d0 2021-01-03T13:06:35.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d2284700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc14a050 con 0x7f77cc0aa960 2021-01-03T13:06:35.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d1a83700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77cc1495d0 0x7f77cc1450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:35.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d1a83700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77cc1495d0 0x7f77cc1450f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38828/0 (socket says 172.21.15.133:38828) 2021-01-03T13:06:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d1a83700 1 -- 172.21.15.133:0/599567625 learned_addr learned my addr 172.21.15.133:0/599567625 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d1282700 1 --2- 172.21.15.133:0/599567625 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77cc0aa960 0x7f77cc146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7f77d0a81700 1 --2- 172.21.15.133:0/599567625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77cc0b5b30 0x7f77cc13d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.496+0000 7f77d1a83700 1 -- 172.21.15.133:0/599567625 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77cc0aa960 msgr2=0x7f77cc146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.496+0000 7f77d1a83700 1 --2- 172.21.15.133:0/599567625 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77cc0aa960 0x7f77cc146ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.496+0000 7f77d1a83700 1 -- 172.21.15.133:0/599567625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77cc0b5b30 msgr2=0x7f77cc13d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.496+0000 7f77d1a83700 1 --2- 172.21.15.133:0/599567625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77cc0b5b30 0x7f77cc13d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.496+0000 7f77d1a83700 1 -- 172.21.15.133:0/599567625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc14a2f0 con 0x7f77cc1495d0 2021-01-03T13:06:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.496+0000 7f77d1a83700 1 --2- 172.21.15.133:0/599567625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77cc1495d0 0x7f77cc1450f0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f77c80017f0 tx=0x7f77cc09a5a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.496+0000 7f77ba7fc700 1 -- 172.21.15.133:0/599567625 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77c4011c30 con 0x7f77cc1495d0 2021-01-03T13:06:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.496+0000 7f77ba7fc700 1 -- 172.21.15.133:0/599567625 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c4011d90 con 0x7f77cc1495d0 2021-01-03T13:06:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.496+0000 7f77ba7fc700 1 -- 172.21.15.133:0/599567625 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77c401d450 con 0x7f77cc1495d0 2021-01-03T13:06:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.496+0000 7f77d2284700 1 -- 172.21.15.133:0/599567625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77cc149340 con 0x7f77cc1495d0 2021-01-03T13:06:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.496+0000 7f77d2284700 1 -- 172.21.15.133:0/599567625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77cc151ea0 con 0x7f77cc1495d0 2021-01-03T13:06:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.496+0000 7f77ba7fc700 1 -- 172.21.15.133:0/599567625 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f77c4024030 con 0x7f77cc1495d0 2021-01-03T13:06:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.500+0000 7f77d2284700 1 -- 172.21.15.133:0/599567625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77cc152460 con 0x7f77cc1495d0 2021-01-03T13:06:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.500+0000 7f77ba7fc700 1 --2- 172.21.15.133:0/599567625 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77ac055440 0x7f77ac057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.500+0000 7f77ba7fc700 1 -- 172.21.15.133:0/599567625 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f77c406efa0 con 0x7f77cc1495d0 2021-01-03T13:06:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.500+0000 7f77d1282700 1 --2- 172.21.15.133:0/599567625 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77ac055440 0x7f77ac057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.500+0000 7f77d1282700 1 --2- 172.21.15.133:0/599567625 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77ac055440 0x7f77ac057900 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f77c800d000 tx=0x7f77c8001780).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.504+0000 7f77ba7fc700 1 -- 172.21.15.133:0/599567625 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f77c40452a0 con 0x7f77cc1495d0 2021-01-03T13:06:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb68044e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb67805c840 0x7fb678142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb68044e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6780afa70 0x7fb678064c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:35.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb68044e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb67813f960 0x7fb67814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb68044e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67813b150 con 0x7fb67805c840 2021-01-03T13:06:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb68044e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb678139210 con 0x7fb67813f960 2021-01-03T13:06:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb68044e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67813ac10 con 0x7fb6780afa70 2021-01-03T13:06:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb67e9eb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb67813f960 0x7fb67814dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb67e9eb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb67813f960 0x7fb67814dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38808/0 (socket says 172.21.15.133:38808) 2021-01-03T13:06:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb67e9eb700 1 -- 172.21.15.133:0/3580824613 learned_addr learned my addr 172.21.15.133:0/3580824613 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb67e1ea700 1 --2- 172.21.15.133:0/3580824613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb67805c840 0x7fb678142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb67d9e9700 1 --2- 172.21.15.133:0/3580824613 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6780afa70 0x7fb678064c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb67e9eb700 1 -- 172.21.15.133:0/3580824613 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6780afa70 msgr2=0x7fb678064c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb67e9eb700 1 --2- 172.21.15.133:0/3580824613 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6780afa70 0x7fb678064c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb67e9eb700 1 -- 172.21.15.133:0/3580824613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb67805c840 msgr2=0x7fb678142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb67e9eb700 1 --2- 172.21.15.133:0/3580824613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb67805c840 0x7fb678142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb67e9eb700 1 -- 172.21.15.133:0/3580824613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67813aeb0 con 0x7fb67813f960 2021-01-03T13:06:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb67d9e9700 1 --2- 172.21.15.133:0/3580824613 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6780afa70 0x7fb678064c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb67e1ea700 1 --2- 172.21.15.133:0/3580824613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb67805c840 0x7fb678142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb67e9eb700 1 --2- 172.21.15.133:0/3580824613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb67813f960 0x7fb67814dd50 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7fb678143570 tx=0x7fb670016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb6677fe700 1 -- 172.21.15.133:0/3580824613 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb67001f3f0 con 0x7fb67813f960 2021-01-03T13:06:35.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb6677fe700 1 -- 172.21.15.133:0/3580824613 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67001f550 con 0x7fb67813f960 2021-01-03T13:06:35.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb68044e700 1 -- 172.21.15.133:0/3580824613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb678064780 con 0x7fb67813f960 2021-01-03T13:06:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb68044e700 1 -- 172.21.15.133:0/3580824613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67814e240 con 0x7fb67813f960 2021-01-03T13:06:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7fb6677fe700 1 -- 172.21.15.133:0/3580824613 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb67001f8b0 con 0x7fb67813f960 2021-01-03T13:06:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7fb68044e700 1 -- 172.21.15.133:0/3580824613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6540033e0 con 0x7fb67813f960 2021-01-03T13:06:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7fb6677fe700 1 -- 172.21.15.133:0/3580824613 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb670026030 con 0x7fb67813f960 2021-01-03T13:06:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7fb6677fe700 1 --2- 172.21.15.133:0/3580824613 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6580553b0 0x7fb658057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7fb6677fe700 1 -- 172.21.15.133:0/3580824613 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb67006ec00 con 0x7fb67813f960 2021-01-03T13:06:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7fb67e1ea700 1 --2- 172.21.15.133:0/3580824613 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6580553b0 0x7fb658057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7fb67e1ea700 1 --2- 172.21.15.133:0/3580824613 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6580553b0 0x7fb658057870 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fb67400c000 tx=0x7fb674008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.492+0000 7fb6677fe700 1 -- 172.21.15.133:0/3580824613 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb670044f40 con 0x7fb67813f960 2021-01-03T13:06:35.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2f01794700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2efc0af780 0x7f2efc0b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:35.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2f01794700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2efc0b23a0 0x7f2efc065200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:35.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2f01794700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2efc1406b0 0x7f2efc142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:35.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2f01794700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc14b940 con 0x7f2efc1406b0 2021-01-03T13:06:35.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2f01794700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0656f0 con 0x7f2efc0b23a0 2021-01-03T13:06:35.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2f01794700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc143690 con 0x7f2efc0af780 2021-01-03T13:06:35.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2efb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2efc0b23a0 0x7f2efc065200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:35.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2efb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2efc0b23a0 0x7f2efc065200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38810/0 (socket says 172.21.15.133:38810) 2021-01-03T13:06:35.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2efb7fe700 1 -- 172.21.15.133:0/1704047008 learned_addr learned my addr 172.21.15.133:0/1704047008 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:35.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2f00f93700 1 --2- 172.21.15.133:0/1704047008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2efc1406b0 0x7f2efc142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:35.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2efb7fe700 1 -- 172.21.15.133:0/1704047008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2efc0af780 msgr2=0x7f2efc0b4030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-03T13:06:35.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2efb7fe700 1 --2- 172.21.15.133:0/1704047008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2efc0af780 0x7f2efc0b4030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T13:06:35.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2efb7fe700 1 -- 172.21.15.133:0/1704047008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2efc1406b0 msgr2=0x7f2efc142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:35.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2efb7fe700 1 --2- 172.21.15.133:0/1704047008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2efc1406b0 0x7f2efc142170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:35.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2efb7fe700 1 -- 172.21.15.133:0/1704047008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc143930 con 0x7f2efc0b23a0 2021-01-03T13:06:35.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.484+0000 7f2efb7fe700 1 --2- 172.21.15.133:0/1704047008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2efc0b23a0 0x7f2efc065200 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f2ef0002ef0 tx=0x7f2ef0006d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:35.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f2ef97fa700 1 -- 172.21.15.133:0/1704047008 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ef000d4a0 con 0x7f2efc0b23a0 2021-01-03T13:06:35.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f2ef97fa700 1 -- 172.21.15.133:0/1704047008 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef0000e90 con 0x7f2efc0b23a0 2021-01-03T13:06:35.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f2f01794700 1 -- 172.21.15.133:0/1704047008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc143bd0 con 0x7f2efc0b23a0 2021-01-03T13:06:35.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f2f01794700 1 -- 172.21.15.133:0/1704047008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc142660 con 0x7f2efc0b23a0 2021-01-03T13:06:35.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f2ef97fa700 1 -- 172.21.15.133:0/1704047008 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ef000d7f0 con 0x7f2efc0b23a0 2021-01-03T13:06:35.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f2f01794700 1 -- 172.21.15.133:0/1704047008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc143d60 con 0x7f2efc0b23a0 2021-01-03T13:06:35.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f2ef97fa700 1 -- 172.21.15.133:0/1704047008 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2ef000f030 con 0x7f2efc0b23a0 2021-01-03T13:06:35.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f2ef97fa700 1 --2- 172.21.15.133:0/1704047008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2edc055330 0x7f2edc0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:35.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f2ef97fa700 1 -- 172.21.15.133:0/1704047008 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2ef006dc60 con 0x7f2efc0b23a0 2021-01-03T13:06:35.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f2efbfff700 1 --2- 172.21.15.133:0/1704047008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2edc055330 0x7f2edc0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:35.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.488+0000 7f2efbfff700 1 --2- 172.21.15.133:0/1704047008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2edc055330 0x7f2edc0577f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f2efc0610d0 tx=0x7f2eec016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:35.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.496+0000 7f2ef97fa700 1 -- 172.21.15.133:0/1704047008 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2ef0043e50 con 0x7f2efc0b23a0 2021-01-03T13:06:35.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.680+0000 7fb68044e700 1 -- 172.21.15.133:0/3580824613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7fb654002270 con 0x7fb67813f960 2021-01-03T13:06:35.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.692+0000 7f2f01794700 1 -- 172.21.15.133:0/1704047008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f2efc057300 con 0x7f2efc0b23a0 2021-01-03T13:06:35.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:35.696+0000 7f77d2284700 1 -- 172.21.15.133:0/599567625 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f77cc057300 con 0x7f77cc1495d0 2021-01-03T13:06:36.247 INFO:tasks.ceph.mon.b.smithi016.stderr:2021-01-03T13:06:36.241+0000 7fba5c9c4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-01-03T13:06:36.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.256+0000 7fb6677fe700 1 -- 172.21.15.133:0/3580824613 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7426 v57) v1 ==== 95+0+0 (secure 0 0 0) 0x7fb670015090 con 0x7fb67813f960 2021-01-03T13:06:36.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.256+0000 7f2ef97fa700 1 -- 172.21.15.133:0/1704047008 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7338 v57) v1 ==== 95+0+0 (secure 0 0 0) 0x7f2ef0047470 con 0x7f2efc0b23a0 2021-01-03T13:06:36.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.256+0000 7f77ba7fc700 1 -- 172.21.15.133:0/599567625 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7429 v57) v1 ==== 95+0+0 (secure 0 0 0) 0x7f77c4022020 con 0x7f77cc1495d0 2021-01-03T13:06:36.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f77d2284700 1 -- 172.21.15.133:0/599567625 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77ac055440 msgr2=0x7f77ac057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:36.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f77d2284700 1 --2- 172.21.15.133:0/599567625 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77ac055440 0x7f77ac057900 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f77c800d000 tx=0x7f77c8001780).stop 2021-01-03T13:06:36.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f77d2284700 1 -- 172.21.15.133:0/599567625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77cc1495d0 msgr2=0x7f77cc1450f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:36.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f77d2284700 1 --2- 172.21.15.133:0/599567625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77cc1495d0 0x7f77cc1450f0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f77c80017f0 tx=0x7f77cc09a5a0).stop 2021-01-03T13:06:36.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f77d2284700 1 -- 172.21.15.133:0/599567625 shutdown_connections 2021-01-03T13:06:36.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f77d2284700 1 --2- 172.21.15.133:0/599567625 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77ac055440 0x7f77ac057900 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:36.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f77d2284700 1 --2- 172.21.15.133:0/599567625 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77cc1495d0 0x7f77cc1450f0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:36.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f77d2284700 1 --2- 172.21.15.133:0/599567625 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77cc0aa960 0x7f77cc146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:36.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f77d2284700 1 --2- 172.21.15.133:0/599567625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77cc0b5b30 0x7f77cc13d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:36.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f77d2284700 1 -- 172.21.15.133:0/599567625 >> 172.21.15.133:0/599567625 conn(0x7f77cc05bdf0 msgr2=0x7f77cc13fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:36.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f77d2284700 1 -- 172.21.15.133:0/599567625 shutdown_connections 2021-01-03T13:06:36.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f77d2284700 1 -- 172.21.15.133:0/599567625 wait complete. 2021-01-03T13:06:36.269 INFO:teuthology.orchestra.run.smithi133.stderr:failed mds gid 7429 2021-01-03T13:06:36.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7fb68044e700 1 -- 172.21.15.133:0/3580824613 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6580553b0 msgr2=0x7fb658057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:36.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7fb68044e700 1 --2- 172.21.15.133:0/3580824613 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6580553b0 0x7fb658057870 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fb67400c000 tx=0x7fb674008040).stop 2021-01-03T13:06:36.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7fb68044e700 1 -- 172.21.15.133:0/3580824613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb67813f960 msgr2=0x7fb67814dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:36.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7fb68044e700 1 --2- 172.21.15.133:0/3580824613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb67813f960 0x7fb67814dd50 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7fb678143570 tx=0x7fb670016000).stop 2021-01-03T13:06:36.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7fb68044e700 1 -- 172.21.15.133:0/3580824613 shutdown_connections 2021-01-03T13:06:36.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7fb68044e700 1 --2- 172.21.15.133:0/3580824613 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6580553b0 0x7fb658057870 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:36.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7fb68044e700 1 --2- 172.21.15.133:0/3580824613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb67805c840 0x7fb678142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:36.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7fb68044e700 1 --2- 172.21.15.133:0/3580824613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb67813f960 0x7fb67814dd50 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:36.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7fb68044e700 1 --2- 172.21.15.133:0/3580824613 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6780afa70 0x7fb678064c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:36.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7fb68044e700 1 -- 172.21.15.133:0/3580824613 >> 172.21.15.133:0/3580824613 conn(0x7fb67806aeb0 msgr2=0x7fb67813f100 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:36.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7fb68044e700 1 -- 172.21.15.133:0/3580824613 shutdown_connections 2021-01-03T13:06:36.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7fb68044e700 1 -- 172.21.15.133:0/3580824613 wait complete. 2021-01-03T13:06:36.272 INFO:teuthology.orchestra.run.smithi133.stderr:failed mds gid 7426 2021-01-03T13:06:36.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f2f01794700 1 -- 172.21.15.133:0/1704047008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2edc055330 msgr2=0x7f2edc0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:36.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f2f01794700 1 --2- 172.21.15.133:0/1704047008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2edc055330 0x7f2edc0577f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f2efc0610d0 tx=0x7f2eec016000).stop 2021-01-03T13:06:36.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f2f01794700 1 -- 172.21.15.133:0/1704047008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2efc0b23a0 msgr2=0x7f2efc065200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:36.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f2f01794700 1 --2- 172.21.15.133:0/1704047008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2efc0b23a0 0x7f2efc065200 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f2ef0002ef0 tx=0x7f2ef0006d40).stop 2021-01-03T13:06:36.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f2f01794700 1 -- 172.21.15.133:0/1704047008 shutdown_connections 2021-01-03T13:06:36.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f2f01794700 1 --2- 172.21.15.133:0/1704047008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2edc055330 0x7f2edc0577f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:36.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f2f01794700 1 --2- 172.21.15.133:0/1704047008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2efc1406b0 0x7f2efc142170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:36.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f2f01794700 1 --2- 172.21.15.133:0/1704047008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2efc0af780 0x7f2efc0b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T13:06:36.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f2f01794700 1 --2- 172.21.15.133:0/1704047008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2efc0b23a0 0x7f2efc065200 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:36.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f2f01794700 1 -- 172.21.15.133:0/1704047008 >> 172.21.15.133:0/1704047008 conn(0x7f2efc06b050 msgr2=0x7f2efc0b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:36.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f2f01794700 1 -- 172.21.15.133:0/1704047008 shutdown_connections 2021-01-03T13:06:36.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.260+0000 7f2f01794700 1 -- 172.21.15.133:0/1704047008 wait complete. 2021-01-03T13:06:36.275 INFO:teuthology.orchestra.run.smithi133.stderr:failed mds gid 7338 2021-01-03T13:06:36.280 DEBUG:teuthology.parallel:result is '' 2021-01-03T13:06:36.280 DEBUG:teuthology.parallel:result is '' 2021-01-03T13:06:36.283 DEBUG:teuthology.parallel:result is '' 2021-01-03T13:06:36.283 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-01-03T13:06:36.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.436+0000 7f6e71efe700 1 Processor -- start 2021-01-03T13:06:36.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.436+0000 7f6e71efe700 1 -- start start 2021-01-03T13:06:36.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.436+0000 7f6e71efe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e6c0b9b60 0x7f6e6c0b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:36.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.436+0000 7f6e71efe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e6c0b4980 0x7f6e6c0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:36.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.436+0000 7f6e71efe700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e6c0605f0 con 0x7f6e6c146430 2021-01-03T13:06:36.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.436+0000 7f6e71efe700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e6c0aed30 con 0x7f6e6c0b4980 2021-01-03T13:06:36.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.436+0000 7f6e71efe700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c146fd0 con 0x7f6e6c0b9b60 2021-01-03T13:06:36.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.436+0000 7f6e6bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e6c0b4980 0x7f6e6c0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:36.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.436+0000 7f6e716fd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6e6c146430 0x7f6e6c1468c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59868/0 (socket says 172.21.15.133:59868) 2021-01-03T13:06:36.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.436+0000 7f6e716fd700 1 -- 172.21.15.133:0/2167832279 learned_addr learned my addr 172.21.15.133:0/2167832279 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:36.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.436+0000 7f6e70efc700 1 --2- 172.21.15.133:0/2167832279 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e6c0b9b60 0x7f6e6c0b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:36.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.436+0000 7f6e6bfff700 1 -- 172.21.15.133:0/2167832279 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e6c0b9b60 msgr2=0x7f6e6c0b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:36.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.436+0000 7f6e6bfff700 1 --2- 172.21.15.133:0/2167832279 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e6c0b9b60 0x7f6e6c0b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:36.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.436+0000 7f6e6bfff700 1 -- 172.21.15.133:0/2167832279 >> v1:172.21.15.133:6789/0 conn(0x7f6e6c146430 legacy=0x7f6e6c1468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:36.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.436+0000 7f6e6b7fe700 1 -- 172.21.15.133:0/2167832279 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166875890 0 0) 0x7f6e6c0605f0 con 0x7f6e6c146430 2021-01-03T13:06:36.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.436+0000 7f6e6bfff700 1 -- 172.21.15.133:0/2167832279 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c0600b0 con 0x7f6e6c0b4980 2021-01-03T13:06:36.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.440+0000 7f6e6bfff700 1 --2- 172.21.15.133:0/2167832279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c0b4980 0x7f6e6c0b4de0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f6e60002f30 tx=0x7f6e60006dc0).ready entity=mon.1 client_cookie=38955812c73debd5 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:36.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.440+0000 7f6e6b7fe700 1 -- 172.21.15.133:0/2167832279 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e60009760 con 0x7f6e6c0b4980 2021-01-03T13:06:36.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.440+0000 7f6e6b7fe700 1 -- 172.21.15.133:0/2167832279 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e600098c0 con 0x7f6e6c0b4980 2021-01-03T13:06:36.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.440+0000 7f6e6b7fe700 1 -- 172.21.15.133:0/2167832279 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e60009c20 con 0x7f6e6c0b4980 2021-01-03T13:06:36.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.440+0000 7f6e71efe700 1 -- 172.21.15.133:0/2167832279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c0b4980 msgr2=0x7f6e6c0b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:36.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.440+0000 7f6e71efe700 1 --2- 172.21.15.133:0/2167832279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c0b4980 0x7f6e6c0b4de0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f6e60002f30 tx=0x7f6e60006dc0).stop 2021-01-03T13:06:36.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.440+0000 7f6e71efe700 1 -- 172.21.15.133:0/2167832279 shutdown_connections 2021-01-03T13:06:36.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.440+0000 7f6e71efe700 1 --2- 172.21.15.133:0/2167832279 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e6c0b9b60 0x7f6e6c0b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:36.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.440+0000 7f6e71efe700 1 --2- 172.21.15.133:0/2167832279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c0b4980 0x7f6e6c0b4de0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:36.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.440+0000 7f6e71efe700 1 -- 172.21.15.133:0/2167832279 >> 172.21.15.133:0/2167832279 conn(0x7f6e6c0b69e0 msgr2=0x7f6e6c0b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:36.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.440+0000 7f6e71efe700 1 -- 172.21.15.133:0/2167832279 shutdown_connections 2021-01-03T13:06:36.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.440+0000 7f6e71efe700 1 -- 172.21.15.133:0/2167832279 wait complete. 2021-01-03T13:06:36.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.440+0000 7f6e71efe700 1 Processor -- start 2021-01-03T13:06:36.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.440+0000 7f6e71efe700 1 -- start start 2021-01-03T13:06:36.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e71efe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c0b4980 0x7f6e6c090c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:36.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e71efe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e6c0b9b60 0x7f6e6c09b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:36.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e71efe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e6c146430 0x7f6e6c09bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:36.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e71efe700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c143aa0 con 0x7f6e6c0b9b60 2021-01-03T13:06:36.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e71efe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c154f60 con 0x7f6e6c0b4980 2021-01-03T13:06:36.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e71efe700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c0b19c0 con 0x7f6e6c146430 2021-01-03T13:06:36.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e70efc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c0b4980 0x7f6e6c090c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:36.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e70efc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c0b4980 0x7f6e6c090c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38840/0 (socket says 172.21.15.133:38840) 2021-01-03T13:06:36.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e70efc700 1 -- 172.21.15.133:0/702076021 learned_addr learned my addr 172.21.15.133:0/702076021 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:36.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e716fd700 1 --2- 172.21.15.133:0/702076021 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e6c146430 0x7f6e6c09bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:36.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e6bfff700 1 --2- 172.21.15.133:0/702076021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e6c0b9b60 0x7f6e6c09b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:36.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e70efc700 1 -- 172.21.15.133:0/702076021 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e6c146430 msgr2=0x7f6e6c09bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:36.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e70efc700 1 --2- 172.21.15.133:0/702076021 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e6c146430 0x7f6e6c09bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:36.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e70efc700 1 -- 172.21.15.133:0/702076021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e6c0b9b60 msgr2=0x7f6e6c09b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:36.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e70efc700 1 --2- 172.21.15.133:0/702076021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e6c0b9b60 0x7f6e6c09b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:36.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e70efc700 1 -- 172.21.15.133:0/702076021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c0b1c60 con 0x7f6e6c0b4980 2021-01-03T13:06:36.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e6bfff700 1 --2- 172.21.15.133:0/702076021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e6c0b9b60 0x7f6e6c09b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:36.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e716fd700 1 --2- 172.21.15.133:0/702076021 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e6c146430 0x7f6e6c09bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:36.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e70efc700 1 --2- 172.21.15.133:0/702076021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c0b4980 0x7f6e6c090c20 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f6e5c006dd0 tx=0x7f6e5c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:36.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e69ffb700 1 -- 172.21.15.133:0/702076021 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e5c00cbb0 con 0x7f6e6c0b4980 2021-01-03T13:06:36.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e69ffb700 1 -- 172.21.15.133:0/702076021 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5c00cd10 con 0x7f6e6c0b4980 2021-01-03T13:06:36.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e71efe700 1 -- 172.21.15.133:0/702076021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6c0b08c0 con 0x7f6e6c0b4980 2021-01-03T13:06:36.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e69ffb700 1 -- 172.21.15.133:0/702076021 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e5c0125e0 con 0x7f6e6c0b4980 2021-01-03T13:06:36.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.444+0000 7f6e71efe700 1 -- 172.21.15.133:0/702076021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6c09c200 con 0x7f6e6c0b4980 2021-01-03T13:06:36.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.448+0000 7f6e69ffb700 1 -- 172.21.15.133:0/702076021 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6e5c022070 con 0x7f6e6c0b4980 2021-01-03T13:06:36.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.448+0000 7f6e71efe700 1 -- 172.21.15.133:0/702076021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6c155120 con 0x7f6e6c0b4980 2021-01-03T13:06:36.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.448+0000 7f6e69ffb700 1 --2- 172.21.15.133:0/702076021 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6e4c0554e0 0x7f6e4c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:36.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.448+0000 7f6e69ffb700 1 -- 172.21.15.133:0/702076021 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6e5c06e9a0 con 0x7f6e6c0b4980 2021-01-03T13:06:36.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.448+0000 7f6e6bfff700 1 --2- 172.21.15.133:0/702076021 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6e4c0554e0 0x7f6e4c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:36.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.448+0000 7f6e6bfff700 1 --2- 172.21.15.133:0/702076021 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6e4c0554e0 0x7f6e4c0579a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f6e60018000 tx=0x7f6e60015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:36.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.456+0000 7f6e69ffb700 1 -- 172.21.15.133:0/702076021 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6e5c044ac0 con 0x7f6e6c0b4980 2021-01-03T13:06:36.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:36.640+0000 7f6e71efe700 1 -- 172.21.15.133:0/702076021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6e6c057300 con 0x7f6e6c0b4980 2021-01-03T13:06:37.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.268+0000 7f6e69ffb700 1 -- 172.21.15.133:0/702076021 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6e5c016070 con 0x7f6e6c0b4980 2021-01-03T13:06:37.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.272+0000 7f6e71efe700 1 -- 172.21.15.133:0/702076021 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6e4c0554e0 msgr2=0x7f6e4c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:37.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.272+0000 7f6e71efe700 1 --2- 172.21.15.133:0/702076021 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6e4c0554e0 0x7f6e4c0579a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f6e60018000 tx=0x7f6e60015000).stop 2021-01-03T13:06:37.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.272+0000 7f6e71efe700 1 -- 172.21.15.133:0/702076021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c0b4980 msgr2=0x7f6e6c090c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:37.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.272+0000 7f6e71efe700 1 --2- 172.21.15.133:0/702076021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c0b4980 0x7f6e6c090c20 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f6e5c006dd0 tx=0x7f6e5c0091a0).stop 2021-01-03T13:06:37.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.272+0000 7f6e71efe700 1 -- 172.21.15.133:0/702076021 shutdown_connections 2021-01-03T13:06:37.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.272+0000 7f6e71efe700 1 --2- 172.21.15.133:0/702076021 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6e4c0554e0 0x7f6e4c0579a0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:37.280 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.272+0000 7f6e71efe700 1 --2- 172.21.15.133:0/702076021 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6e6c146430 0x7f6e6c09bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:37.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.272+0000 7f6e71efe700 1 --2- 172.21.15.133:0/702076021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6c0b4980 0x7f6e6c090c20 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:37.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.272+0000 7f6e71efe700 1 --2- 172.21.15.133:0/702076021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e6c0b9b60 0x7f6e6c09b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:37.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.272+0000 7f6e71efe700 1 -- 172.21.15.133:0/702076021 >> 172.21.15.133:0/702076021 conn(0x7f6e6c0b69e0 msgr2=0x7f6e6c0b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:37.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.272+0000 7f6e71efe700 1 -- 172.21.15.133:0/702076021 shutdown_connections 2021-01-03T13:06:37.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.272+0000 7f6e71efe700 1 -- 172.21.15.133:0/702076021 wait complete. 2021-01-03T13:06:37.295 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-01-03T13:06:37.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.408+0000 7fb6c8dc9700 1 Processor -- start 2021-01-03T13:06:37.415 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.408+0000 7fb6c8dc9700 1 -- start start 2021-01-03T13:06:37.416 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c8dc9700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb6c40b4c20 0x7fb6c405c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:37.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c8dc9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6c4060510 0x7fb6c40b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:37.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c8dc9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c40b6cf0 con 0x7fb6c405fd10 2021-01-03T13:06:37.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c8dc9700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c405bf00 con 0x7fb6c40b4c20 2021-01-03T13:06:37.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c8dc9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c405c1a0 con 0x7fb6c4060510 2021-01-03T13:06:37.417 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb6c405fd10 0x7fb6c40b65e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59882/0 (socket says 172.21.15.133:59882) 2021-01-03T13:06:37.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c3fff700 1 -- 172.21.15.133:0/2682924695 learned_addr learned my addr 172.21.15.133:0/2682924695 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:37.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c2ffd700 1 --2- 172.21.15.133:0/2682924695 >> v2:172.21.15.133:3300/0 conn(0x7fb6c4060510 0x7fb6c40b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:37.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c37fe700 1 --2- 172.21.15.133:0/2682924695 >> v2:172.21.15.16:3300/0 conn(0x7fb6c40b4c20 0x7fb6c405c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:37.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c27fc700 1 -- 172.21.15.133:0/2682924695 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786663035 0 0) 0x7fb6c40b6cf0 con 0x7fb6c405fd10 2021-01-03T13:06:37.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c27fc700 1 -- 172.21.15.133:0/2682924695 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6a4003230 con 0x7fb6c405fd10 2021-01-03T13:06:37.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c2ffd700 1 -- 172.21.15.133:0/2682924695 >> v2:172.21.15.16:3300/0 conn(0x7fb6c40b4c20 msgr2=0x7fb6c405c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:37.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c2ffd700 1 --2- 172.21.15.133:0/2682924695 >> v2:172.21.15.16:3300/0 conn(0x7fb6c40b4c20 0x7fb6c405c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:37.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c2ffd700 1 -- 172.21.15.133:0/2682924695 >> v1:172.21.15.133:6789/0 conn(0x7fb6c405fd10 legacy=0x7fb6c40b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:37.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c2ffd700 1 -- 172.21.15.133:0/2682924695 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c405c440 con 0x7fb6c4060510 2021-01-03T13:06:37.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c2ffd700 1 --2- 172.21.15.133:0/2682924695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6c4060510 0x7fb6c40b5000 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7fb6ac002f30 tx=0x7fb6ac006dc0).ready entity=mon.1 client_cookie=11b7efa3becc853c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:37.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c27fc700 1 -- 172.21.15.133:0/2682924695 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6ac0097b0 con 0x7fb6c4060510 2021-01-03T13:06:37.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c27fc700 1 -- 172.21.15.133:0/2682924695 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ac009910 con 0x7fb6c4060510 2021-01-03T13:06:37.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c27fc700 1 -- 172.21.15.133:0/2682924695 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6ac009c70 con 0x7fb6c4060510 2021-01-03T13:06:37.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c8dc9700 1 -- 172.21.15.133:0/2682924695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6c4060510 msgr2=0x7fb6c40b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:37.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c8dc9700 1 --2- 172.21.15.133:0/2682924695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6c4060510 0x7fb6c40b5000 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7fb6ac002f30 tx=0x7fb6ac006dc0).stop 2021-01-03T13:06:37.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c8dc9700 1 -- 172.21.15.133:0/2682924695 shutdown_connections 2021-01-03T13:06:37.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c8dc9700 1 --2- 172.21.15.133:0/2682924695 >> v2:172.21.15.16:3300/0 conn(0x7fb6c40b4c20 0x7fb6c405c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:37.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c8dc9700 1 --2- 172.21.15.133:0/2682924695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6c4060510 0x7fb6c40b5000 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:37.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c8dc9700 1 -- 172.21.15.133:0/2682924695 >> 172.21.15.133:0/2682924695 conn(0x7fb6c40b9f00 msgr2=0x7fb6c40b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:37.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c8dc9700 1 -- 172.21.15.133:0/2682924695 shutdown_connections 2021-01-03T13:06:37.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.412+0000 7fb6c8dc9700 1 -- 172.21.15.133:0/2682924695 wait complete. 2021-01-03T13:06:37.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c8dc9700 1 Processor -- start 2021-01-03T13:06:37.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c8dc9700 1 -- start start 2021-01-03T13:06:37.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c8dc9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6c405fd10 0x7fb6c4144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:37.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c8dc9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6c4060510 0x7fb6c409da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:37.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c8dc9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6c40b4c20 0x7fb6c409df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:37.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c8dc9700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c4152ab0 con 0x7fb6c405fd10 2021-01-03T13:06:37.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c8dc9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c409d780 con 0x7fb6c40b4c20 2021-01-03T13:06:37.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c8dc9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c4152810 con 0x7fb6c4060510 2021-01-03T13:06:37.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6c40b4c20 0x7fb6c409df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:37.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6c40b4c20 0x7fb6c409df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38854/0 (socket says 172.21.15.133:38854) 2021-01-03T13:06:37.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c3fff700 1 -- 172.21.15.133:0/170243075 learned_addr learned my addr 172.21.15.133:0/170243075 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:37.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c37fe700 1 --2- 172.21.15.133:0/170243075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6c405fd10 0x7fb6c4144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:37.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c3fff700 1 -- 172.21.15.133:0/170243075 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6c4060510 msgr2=0x7fb6c409da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:37.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c3fff700 1 --2- 172.21.15.133:0/170243075 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6c4060510 0x7fb6c409da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T13:06:37.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c3fff700 1 -- 172.21.15.133:0/170243075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6c405fd10 msgr2=0x7fb6c4144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:37.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c3fff700 1 --2- 172.21.15.133:0/170243075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6c405fd10 0x7fb6c4144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:37.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c3fff700 1 -- 172.21.15.133:0/170243075 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c4145e20 con 0x7fb6c40b4c20 2021-01-03T13:06:37.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c3fff700 1 --2- 172.21.15.133:0/170243075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6c40b4c20 0x7fb6c409df70 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7fb6bc001450 tx=0x7fb6bc007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:37.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c0ff9700 1 -- 172.21.15.133:0/170243075 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6bc005b70 con 0x7fb6c40b4c20 2021-01-03T13:06:37.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c0ff9700 1 -- 172.21.15.133:0/170243075 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc005cd0 con 0x7fb6c40b4c20 2021-01-03T13:06:37.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c0ff9700 1 -- 172.21.15.133:0/170243075 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6bc007300 con 0x7fb6c40b4c20 2021-01-03T13:06:37.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c8dc9700 1 -- 172.21.15.133:0/170243075 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c41460c0 con 0x7fb6c40b4c20 2021-01-03T13:06:37.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.416+0000 7fb6c8dc9700 1 -- 172.21.15.133:0/170243075 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c4148cf0 con 0x7fb6c40b4c20 2021-01-03T13:06:37.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.420+0000 7fb6c0ff9700 1 -- 172.21.15.133:0/170243075 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb6bc010030 con 0x7fb6c40b4c20 2021-01-03T13:06:37.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.420+0000 7fb6c8dc9700 1 -- 172.21.15.133:0/170243075 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c4146250 con 0x7fb6c40b4c20 2021-01-03T13:06:37.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.420+0000 7fb6c0ff9700 1 --2- 172.21.15.133:0/170243075 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6a80553b0 0x7fb6a8057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:37.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.420+0000 7fb6c0ff9700 1 -- 172.21.15.133:0/170243075 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb6bc06e170 con 0x7fb6c40b4c20 2021-01-03T13:06:37.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.420+0000 7fb6c37fe700 1 --2- 172.21.15.133:0/170243075 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6a80553b0 0x7fb6a8057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:37.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.420+0000 7fb6c37fe700 1 --2- 172.21.15.133:0/170243075 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6a80553b0 0x7fb6a8057870 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fb6b400c000 tx=0x7fb6b4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:37.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.428+0000 7fb6c0ff9700 1 -- 172.21.15.133:0/170243075 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb6bc044310 con 0x7fb6c40b4c20 2021-01-03T13:06:37.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:37.564+0000 7fb6c8dc9700 1 -- 172.21.15.133:0/170243075 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb6c4057300 con 0x7fb6c40b4c20 2021-01-03T13:06:38.150 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:06:38.153 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:06:38.155 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:06:38.157 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:06:38.279 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.272+0000 7fb6c0ff9700 1 -- 172.21.15.133:0/170243075 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v128) v1 ==== 185+0+0 (secure 0 0 0) 0x7fb6bc047930 con 0x7fb6c40b4c20 2021-01-03T13:06:38.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.276+0000 7fb6c8dc9700 1 -- 172.21.15.133:0/170243075 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6a80553b0 msgr2=0x7fb6a8057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:38.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.276+0000 7fb6c8dc9700 1 --2- 172.21.15.133:0/170243075 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6a80553b0 0x7fb6a8057870 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fb6b400c000 tx=0x7fb6b4008040).stop 2021-01-03T13:06:38.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.276+0000 7fb6c8dc9700 1 -- 172.21.15.133:0/170243075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6c40b4c20 msgr2=0x7fb6c409df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:38.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.276+0000 7fb6c8dc9700 1 --2- 172.21.15.133:0/170243075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6c40b4c20 0x7fb6c409df70 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7fb6bc001450 tx=0x7fb6bc007dd0).stop 2021-01-03T13:06:38.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.276+0000 7fb6c8dc9700 1 -- 172.21.15.133:0/170243075 shutdown_connections 2021-01-03T13:06:38.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.276+0000 7fb6c8dc9700 1 --2- 172.21.15.133:0/170243075 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6a80553b0 0x7fb6a8057870 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:38.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.276+0000 7fb6c8dc9700 1 --2- 172.21.15.133:0/170243075 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6c405fd10 0x7fb6c4144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:38.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.276+0000 7fb6c8dc9700 1 --2- 172.21.15.133:0/170243075 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6c40b4c20 0x7fb6c409df70 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:38.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.276+0000 7fb6c8dc9700 1 --2- 172.21.15.133:0/170243075 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6c4060510 0x7fb6c409da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T13:06:38.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.276+0000 7fb6c8dc9700 1 -- 172.21.15.133:0/170243075 >> 172.21.15.133:0/170243075 conn(0x7fb6c40b9f00 msgr2=0x7fb6c413eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:38.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.276+0000 7fb6c8dc9700 1 -- 172.21.15.133:0/170243075 shutdown_connections 2021-01-03T13:06:38.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.276+0000 7fb6c8dc9700 1 -- 172.21.15.133:0/170243075 wait complete. 2021-01-03T13:06:38.288 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2021-01-03T13:06:38.298 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-01-03T13:06:38.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.412+0000 7f6e0355c700 1 Processor -- start 2021-01-03T13:06:38.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.412+0000 7f6e0355c700 1 -- start start 2021-01-03T13:06:38.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.412+0000 7f6e0355c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6dfc0b2460 0x7f6dfc0a9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:38.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.412+0000 7f6e0355c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dfc0b0a60 0x7f6dfc0ad490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:38.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.412+0000 7f6e0355c700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dfc0b16a0 con 0x7f6dfc0ad980 2021-01-03T13:06:38.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.412+0000 7f6e0355c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dfc06ad30 con 0x7f6dfc0b2460 2021-01-03T13:06:38.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.412+0000 7f6e0355c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc0b2840 con 0x7f6dfc0b0a60 2021-01-03T13:06:38.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.412+0000 7f6e01d59700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dfc0b0a60 0x7f6dfc0ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:38.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.412+0000 7f6e0255a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6dfc0b2460 0x7f6dfc0a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:38.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.412+0000 7f6e02d5b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6dfc0ad980 0x7f6dfc06a620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:38624/0 (socket says 172.21.15.133:38624) 2021-01-03T13:06:38.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.412+0000 7f6e02d5b700 1 -- 172.21.15.133:0/1372440547 learned_addr learned my addr 172.21.15.133:0/1372440547 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:38.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.412+0000 7f6e01d59700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dfc0b0a60 0x7f6dfc0ad490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:47164/0 (socket says 172.21.15.133:47164) 2021-01-03T13:06:38.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0255a700 1 -- 172.21.15.133:0/1372440547 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dfc0b0a60 msgr2=0x7f6dfc0ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:38.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0255a700 1 --2- 172.21.15.133:0/1372440547 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dfc0b0a60 0x7f6dfc0ad490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:38.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e01558700 1 -- 172.21.15.133:0/1372440547 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4278257046 0 0) 0x7f6dfc0b16a0 con 0x7f6dfc0ad980 2021-01-03T13:06:38.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0255a700 1 -- 172.21.15.133:0/1372440547 >> v1:172.21.15.16:6789/0 conn(0x7f6dfc0ad980 legacy=0x7f6dfc06a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:38.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0255a700 1 -- 172.21.15.133:0/1372440547 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc0aeae0 con 0x7f6dfc0b2460 2021-01-03T13:06:38.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e01d59700 1 --2- 172.21.15.133:0/1372440547 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dfc0b0a60 0x7f6dfc0ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:06:38.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0255a700 1 --2- 172.21.15.133:0/1372440547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6dfc0b2460 0x7f6dfc0a9750 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f6df0002f30 tx=0x7f6df0006dc0).ready entity=mon.0 client_cookie=f5b73a9cc9f91690 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:38.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e01558700 1 -- 172.21.15.133:0/1372440547 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6df0009760 con 0x7f6dfc0b2460 2021-01-03T13:06:38.426 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e01558700 1 -- 172.21.15.133:0/1372440547 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df00098c0 con 0x7f6dfc0b2460 2021-01-03T13:06:38.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e01558700 1 -- 172.21.15.133:0/1372440547 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6df0009c20 con 0x7f6dfc0b2460 2021-01-03T13:06:38.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0355c700 1 -- 172.21.15.133:0/1372440547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6dfc0b2460 msgr2=0x7f6dfc0a9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:38.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0355c700 1 --2- 172.21.15.133:0/1372440547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6dfc0b2460 0x7f6dfc0a9750 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f6df0002f30 tx=0x7f6df0006dc0).stop 2021-01-03T13:06:38.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0355c700 1 -- 172.21.15.133:0/1372440547 shutdown_connections 2021-01-03T13:06:38.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0355c700 1 --2- 172.21.15.133:0/1372440547 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6dfc0b2460 0x7f6dfc0a9750 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:38.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0355c700 1 --2- 172.21.15.133:0/1372440547 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dfc0b0a60 0x7f6dfc0ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:38.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0355c700 1 -- 172.21.15.133:0/1372440547 >> 172.21.15.133:0/1372440547 conn(0x7f6dfc06b050 msgr2=0x7f6dfc060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:38.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0355c700 1 -- 172.21.15.133:0/1372440547 shutdown_connections 2021-01-03T13:06:38.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0355c700 1 -- 172.21.15.133:0/1372440547 wait complete. 2021-01-03T13:06:38.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0355c700 1 Processor -- start 2021-01-03T13:06:38.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0355c700 1 -- start start 2021-01-03T13:06:38.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0355c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dfc0ad980 0x7f6dfc152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:38.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0355c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6dfc0b0a60 0x7f6dfc09f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:38.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0355c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dfc0b2460 0x7f6dfc09ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:38.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0355c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc0a21c0 con 0x7f6dfc0b0a60 2021-01-03T13:06:38.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0355c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc151b50 con 0x7f6dfc0b2460 2021-01-03T13:06:38.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.416+0000 7f6e0355c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc09f150 con 0x7f6dfc0ad980 2021-01-03T13:06:38.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6e02d5b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dfc0b2460 0x7f6dfc09ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:38.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6e02d5b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dfc0b2460 0x7f6dfc09ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38870/0 (socket says 172.21.15.133:38870) 2021-01-03T13:06:38.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6e02d5b700 1 -- 172.21.15.133:0/3098060152 learned_addr learned my addr 172.21.15.133:0/3098060152 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:38.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6e0255a700 1 --2- 172.21.15.133:0/3098060152 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dfc0ad980 0x7f6dfc152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:38.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6e01d59700 1 --2- 172.21.15.133:0/3098060152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6dfc0b0a60 0x7f6dfc09f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:38.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6e02d5b700 1 -- 172.21.15.133:0/3098060152 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dfc0ad980 msgr2=0x7f6dfc152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:38.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6e02d5b700 1 --2- 172.21.15.133:0/3098060152 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dfc0ad980 0x7f6dfc152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:38.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6e02d5b700 1 -- 172.21.15.133:0/3098060152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6dfc0b0a60 msgr2=0x7f6dfc09f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:38.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6e02d5b700 1 --2- 172.21.15.133:0/3098060152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6dfc0b0a60 0x7f6dfc09f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:38.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6e02d5b700 1 -- 172.21.15.133:0/3098060152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc151d40 con 0x7f6dfc0b2460 2021-01-03T13:06:38.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6e02d5b700 1 --2- 172.21.15.133:0/3098060152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dfc0b2460 0x7f6dfc09ec60 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f6df40012e0 tx=0x7f6df4007d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:38.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6def7fe700 1 -- 172.21.15.133:0/3098060152 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6df400ce40 con 0x7f6dfc0b2460 2021-01-03T13:06:38.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6def7fe700 1 -- 172.21.15.133:0/3098060152 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df4005bc0 con 0x7f6dfc0b2460 2021-01-03T13:06:38.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6e0355c700 1 -- 172.21.15.133:0/3098060152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dfc151fe0 con 0x7f6dfc0b2460 2021-01-03T13:06:38.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6def7fe700 1 -- 172.21.15.133:0/3098060152 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6df4007110 con 0x7f6dfc0b2460 2021-01-03T13:06:38.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6e0355c700 1 -- 172.21.15.133:0/3098060152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dfc0a3440 con 0x7f6dfc0b2460 2021-01-03T13:06:38.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6e0355c700 1 -- 172.21.15.133:0/3098060152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dfc152480 con 0x7f6dfc0b2460 2021-01-03T13:06:38.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6def7fe700 1 -- 172.21.15.133:0/3098060152 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6df4010030 con 0x7f6dfc0b2460 2021-01-03T13:06:38.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6def7fe700 1 --2- 172.21.15.133:0/3098060152 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6ddc0554e0 0x7f6ddc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:38.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.420+0000 7f6def7fe700 1 -- 172.21.15.133:0/3098060152 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f6df406ddc0 con 0x7f6dfc0b2460 2021-01-03T13:06:38.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.424+0000 7f6e0255a700 1 --2- 172.21.15.133:0/3098060152 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6ddc0554e0 0x7f6ddc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:38.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.424+0000 7f6e0255a700 1 --2- 172.21.15.133:0/3098060152 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6ddc0554e0 0x7f6ddc0579a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f6df001a000 tx=0x7f6df0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:38.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.428+0000 7f6def7fe700 1 -- 172.21.15.133:0/3098060152 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6dfc152480 con 0x7f6dfc0b2460 2021-01-03T13:06:38.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:38.568+0000 7f6e0355c700 1 -- 172.21.15.133:0/3098060152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f6dfc152480 con 0x7f6dfc0b2460 2021-01-03T13:06:39.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:39.284+0000 7f6def7fe700 1 -- 172.21.15.133:0/3098060152 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v129) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6dfc152480 con 0x7f6dfc0b2460 2021-01-03T13:06:39.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:39.288+0000 7f6e0355c700 1 -- 172.21.15.133:0/3098060152 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6ddc0554e0 msgr2=0x7f6ddc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:39.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:39.288+0000 7f6e0355c700 1 --2- 172.21.15.133:0/3098060152 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6ddc0554e0 0x7f6ddc0579a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f6df001a000 tx=0x7f6df0015000).stop 2021-01-03T13:06:39.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:39.288+0000 7f6e0355c700 1 -- 172.21.15.133:0/3098060152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dfc0b2460 msgr2=0x7f6dfc09ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:39.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:39.288+0000 7f6e0355c700 1 --2- 172.21.15.133:0/3098060152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dfc0b2460 0x7f6dfc09ec60 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f6df40012e0 tx=0x7f6df4007d80).stop 2021-01-03T13:06:39.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:39.288+0000 7f6e0355c700 1 -- 172.21.15.133:0/3098060152 shutdown_connections 2021-01-03T13:06:39.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:39.288+0000 7f6e0355c700 1 --2- 172.21.15.133:0/3098060152 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f6ddc0554e0 0x7f6ddc0579a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:39.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:39.288+0000 7f6e0355c700 1 --2- 172.21.15.133:0/3098060152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6dfc0b2460 0x7f6dfc09ec60 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:39.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:39.288+0000 7f6e0355c700 1 --2- 172.21.15.133:0/3098060152 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6dfc0ad980 0x7f6dfc152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:39.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:39.288+0000 7f6e0355c700 1 --2- 172.21.15.133:0/3098060152 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6dfc0b0a60 0x7f6dfc09f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:39.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:39.288+0000 7f6e0355c700 1 -- 172.21.15.133:0/3098060152 >> 172.21.15.133:0/3098060152 conn(0x7f6dfc06b050 msgr2=0x7f6dfc0ab960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:39.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:39.288+0000 7f6e0355c700 1 -- 172.21.15.133:0/3098060152 shutdown_connections 2021-01-03T13:06:39.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:39.288+0000 7f6e0355c700 1 -- 172.21.15.133:0/3098060152 wait complete. 2021-01-03T13:06:39.299 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2021-01-03T13:06:39.310 DEBUG:teuthology.orchestra.run.smithi007:> sudo rados -p cephfs_metadata put key /etc/fstab 2021-01-03T13:06:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.347+0000 7f22dd558c00 1 Processor -- start 2021-01-03T13:06:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.347+0000 7f22dd558c00 1 -- start start 2021-01-03T13:06:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.347+0000 7f22dd558c00 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560dba477b80 0x560dba5088e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.347+0000 7f22dd558c00 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x560dba50c180 0x560dba508dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560dba50fc90 0x560dba5190d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dba424a10 con 0x560dba50fc90 2021-01-03T13:06:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dba4046f0 con 0x560dba477b80 2021-01-03T13:06:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x560dba3f56f0 con 0x560dba50c180 2021-01-03T13:06:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22cec4b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x560dba50c180 0x560dba508dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22cf44c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560dba477b80 0x560dba5088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22cfc4d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560dba50fc90 0x560dba5190d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22cec4b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x560dba50c180 0x560dba508dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.7:51952/0 (socket says 172.21.15.7:51952) 2021-01-03T13:06:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22cec4b700 1 -- 172.21.15.7:0/2577381688 learned_addr learned my addr 172.21.15.7:0/2577381688 (peer_addr_for_me v2:172.21.15.7:0/0) 2021-01-03T13:06:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22cec4b700 1 -- 172.21.15.7:0/2577381688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560dba477b80 msgr2=0x560dba5088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22cec4b700 1 --2- 172.21.15.7:0/2577381688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560dba477b80 0x560dba5088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22cec4b700 1 -- 172.21.15.7:0/2577381688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560dba50fc90 msgr2=0x560dba5190d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22cec4b700 1 --2- 172.21.15.7:0/2577381688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560dba50fc90 0x560dba5190d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22cec4b700 1 -- 172.21.15.7:0/2577381688 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560dba3ee2d0 con 0x560dba50c180 2021-01-03T13:06:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22cf44c700 1 --2- 172.21.15.7:0/2577381688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560dba477b80 0x560dba5088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:06:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22cfc4d700 1 --2- 172.21.15.7:0/2577381688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560dba50fc90 0x560dba5190d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:06:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22cec4b700 1 --2- 172.21.15.7:0/2577381688 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x560dba50c180 0x560dba508dd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f22c00010d0 tx=0x7f22c0001750).ready entity=mon.2 client_cookie=ed3d58b7f82592ac server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22cd448700 1 -- 172.21.15.7:0/2577381688 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22c000be70 con 0x560dba50c180 2021-01-03T13:06:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22cd448700 1 -- 172.21.15.7:0/2577381688 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c000e430 con 0x560dba50c180 2021-01-03T13:06:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22cd448700 1 -- 172.21.15.7:0/2577381688 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22c000e790 con 0x560dba50c180 2021-01-03T13:06:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 -- 172.21.15.7:0/2577381688 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x560dba50c180 msgr2=0x560dba508dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 --2- 172.21.15.7:0/2577381688 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x560dba50c180 0x560dba508dd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f22c00010d0 tx=0x7f22c0001750).stop 2021-01-03T13:06:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 -- 172.21.15.7:0/2577381688 shutdown_connections 2021-01-03T13:06:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 --2- 172.21.15.7:0/2577381688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560dba50fc90 0x560dba5190d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 --2- 172.21.15.7:0/2577381688 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560dba477b80 0x560dba5088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 --2- 172.21.15.7:0/2577381688 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x560dba50c180 0x560dba508dd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 -- 172.21.15.7:0/2577381688 >> 172.21.15.7:0/2577381688 conn(0x560dba4fdbe0 msgr2=0x560dba50e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 -- 172.21.15.7:0/2577381688 shutdown_connections 2021-01-03T13:06:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 -- 172.21.15.7:0/2577381688 wait complete. 2021-01-03T13:06:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 Processor -- start 2021-01-03T13:06:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 -- start start 2021-01-03T13:06:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560dba477b80 0x560dba519ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x560dba50c180 0x560dba51a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560dba50fc90 0x560dba513d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:39.366 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dba501480 con 0x560dba50fc90 2021-01-03T13:06:39.366 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dba514240 con 0x560dba477b80 2021-01-03T13:06:39.366 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.351+0000 7f22dd558c00 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x560dba514400 con 0x560dba50c180 2021-01-03T13:06:39.366 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22cf44c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560dba477b80 0x560dba519ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:39.366 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22cfc4d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560dba50fc90 0x560dba513d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22cec4b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x560dba50c180 0x560dba51a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22cfc4d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560dba50fc90 0x560dba513d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.7:49652/0 (socket says 172.21.15.7:49652) 2021-01-03T13:06:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22cfc4d700 1 -- 172.21.15.7:0/2582014283 learned_addr learned my addr 172.21.15.7:0/2582014283 (peer_addr_for_me v2:172.21.15.7:0/0) 2021-01-03T13:06:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22cf44c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560dba477b80 0x560dba519ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.7:36754/0 (socket says 172.21.15.7:36754) 2021-01-03T13:06:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22cf44c700 1 -- 172.21.15.7:0/2582014283 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x560dba50c180 msgr2=0x560dba51a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22cf44c700 1 --2- 172.21.15.7:0/2582014283 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x560dba50c180 0x560dba51a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22cf44c700 1 -- 172.21.15.7:0/2582014283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560dba50fc90 msgr2=0x560dba513d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22cf44c700 1 --2- 172.21.15.7:0/2582014283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560dba50fc90 0x560dba513d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22cf44c700 1 -- 172.21.15.7:0/2582014283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560dba5145c0 con 0x560dba477b80 2021-01-03T13:06:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22cfc4d700 1 --2- 172.21.15.7:0/2582014283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560dba50fc90 0x560dba513d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:06:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22cf44c700 1 --2- 172.21.15.7:0/2582014283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560dba477b80 0x560dba519ba0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f22b801a000 tx=0x7f22b8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22ccc47700 1 -- 172.21.15.7:0/2582014283 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22b8010cb0 con 0x560dba477b80 2021-01-03T13:06:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22ccc47700 1 -- 172.21.15.7:0/2582014283 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b8010e10 con 0x560dba477b80 2021-01-03T13:06:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22dd558c00 1 -- 172.21.15.7:0/2582014283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560dba5147b0 con 0x560dba477b80 2021-01-03T13:06:39.369 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22ccc47700 1 -- 172.21.15.7:0/2582014283 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22b8020670 con 0x560dba477b80 2021-01-03T13:06:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.355+0000 7f22dd558c00 1 -- 172.21.15.7:0/2582014283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560dba514b60 con 0x560dba477b80 2021-01-03T13:06:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.359+0000 7f22ccc47700 1 -- 172.21.15.7:0/2582014283 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f22b801d040 con 0x560dba477b80 2021-01-03T13:06:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.359+0000 7f22ccc47700 1 --2- 172.21.15.7:0/2582014283 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22b0054050 0x7f22b0056510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.359+0000 7f22ccc47700 1 -- 172.21.15.7:0/2582014283 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6075+0+0 (secure 0 0 0) 0x7f22b806e890 con 0x560dba477b80 2021-01-03T13:06:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.359+0000 7f22dd558c00 1 --2- 172.21.15.7:0/2582014283 >> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] conn(0x560dba5215e0 0x560dba5239d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.359+0000 7f22dd558c00 1 -- 172.21.15.7:0/2582014283 --> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] -- osd_op(unknown.0.0:1 23.0 23:0620e6f9:::key:head [writefull 0~617 in=617b] snapc 0=[] ondisk+write+known_if_redirected e129) v8 -- 0x560dba523f60 con 0x560dba5215e0 2021-01-03T13:06:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.359+0000 7f22cec4b700 1 --2- 172.21.15.7:0/2582014283 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22b0054050 0x7f22b0056510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.359+0000 7f22cfc4d700 1 --2- 172.21.15.7:0/2582014283 >> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] conn(0x560dba5215e0 0x560dba5239d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:39.372 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.359+0000 7f22cec4b700 1 --2- 172.21.15.7:0/2582014283 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22b0054050 0x7f22b0056510 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f22c001a000 tx=0x7f22c0014000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:39.373 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:39.359+0000 7f22cfc4d700 1 --2- 172.21.15.7:0/2582014283 >> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] conn(0x560dba5215e0 0x560dba5239d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:40.312 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:40.311+0000 7f22ccc47700 1 -- 172.21.15.7:0/2582014283 <== osd.0 v2:172.21.15.133:6810/12124 1 ==== osd_map(130..130 src has 1..130) v4 ==== 320+0+0 (crc 0 0 0) 0x7f22c800b040 con 0x560dba5215e0 2021-01-03T13:06:40.317 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:40.315+0000 7f22cfc4d700 1 -- 172.21.15.7:0/2582014283 <== osd.0 v2:172.21.15.133:6810/12124 2 ==== osd_op_reply(1 key [writefull 0~617] v130'1 uv1 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7f22c80124f0 con 0x560dba5215e0 2021-01-03T13:06:40.317 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:40.315+0000 7f22dd558c00 1 -- 172.21.15.7:0/2582014283 >> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] conn(0x560dba5215e0 msgr2=0x560dba5239d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:40.317 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:40.315+0000 7f22dd558c00 1 --2- 172.21.15.7:0/2582014283 >> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] conn(0x560dba5215e0 0x560dba5239d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:40.318 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:40.315+0000 7f22dd558c00 1 -- 172.21.15.7:0/2582014283 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22b0054050 msgr2=0x7f22b0056510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:40.318 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:40.315+0000 7f22dd558c00 1 --2- 172.21.15.7:0/2582014283 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22b0054050 0x7f22b0056510 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f22c001a000 tx=0x7f22c0014000).stop 2021-01-03T13:06:40.318 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:40.315+0000 7f22dd558c00 1 -- 172.21.15.7:0/2582014283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560dba477b80 msgr2=0x560dba519ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:40.318 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:40.315+0000 7f22dd558c00 1 --2- 172.21.15.7:0/2582014283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x560dba477b80 0x560dba519ba0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f22b801a000 tx=0x7f22b8015000).stop 2021-01-03T13:06:40.319 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:40.315+0000 7f22cfc4d700 1 -- 172.21.15.7:0/2582014283 reap_dead start 2021-01-03T13:06:40.319 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:40.315+0000 7f22dd558c00 1 -- 172.21.15.7:0/2582014283 shutdown_connections 2021-01-03T13:06:40.319 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:40.315+0000 7f22dd558c00 1 -- 172.21.15.7:0/2582014283 >> 172.21.15.7:0/2582014283 conn(0x560dba4fdbe0 msgr2=0x560dba50e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:40.319 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:40.315+0000 7f22dd558c00 1 -- 172.21.15.7:0/2582014283 shutdown_connections 2021-01-03T13:06:40.319 INFO:teuthology.orchestra.run.smithi007.stderr:2021-01-03T13:06:40.315+0000 7f22dd558c00 1 -- 172.21.15.7:0/2582014283 wait complete. 2021-01-03T13:06:40.322 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early df --format=json-pretty 2021-01-03T13:06:40.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.424+0000 7f5f4d4ef700 1 Processor -- start 2021-01-03T13:06:40.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.424+0000 7f5f4d4ef700 1 -- start start 2021-01-03T13:06:40.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f4d4ef700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4813fb40 0x7f5f4813fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:40.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f4d4ef700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5f4813c890 0x7f5f4813ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:40.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f4d4ef700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4805cc20 con 0x7f5f4805c840 2021-01-03T13:06:40.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f4d4ef700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f480aa1f0 con 0x7f5f4813c890 2021-01-03T13:06:40.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f4d4ef700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f480b1dc0 con 0x7f5f4813fb40 2021-01-03T13:06:40.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f477fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5f4813c890 0x7f5f4813ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:40.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f46ffd700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5f4805c840 0x7f5f480b16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:38634/0 (socket says 172.21.15.133:38634) 2021-01-03T13:06:40.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f46ffd700 1 -- 172.21.15.133:0/947012683 learned_addr learned my addr 172.21.15.133:0/947012683 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:40.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f467fc700 1 --2- 172.21.15.133:0/947012683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4813fb40 0x7f5f4813fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:40.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f45ffb700 1 -- 172.21.15.133:0/947012683 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020909977 0 0) 0x7f5f4805cc20 con 0x7f5f4805c840 2021-01-03T13:06:40.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f45ffb700 1 -- 172.21.15.133:0/947012683 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f28003230 con 0x7f5f4805c840 2021-01-03T13:06:40.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f477fe700 1 -- 172.21.15.133:0/947012683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4813fb40 msgr2=0x7f5f4813fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:40.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f477fe700 1 --2- 172.21.15.133:0/947012683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4813fb40 0x7f5f4813fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:40.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f477fe700 1 -- 172.21.15.133:0/947012683 >> v1:172.21.15.16:6789/0 conn(0x7f5f4805c840 legacy=0x7f5f480b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:40.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f477fe700 1 -- 172.21.15.133:0/947012683 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48143df0 con 0x7f5f4813c890 2021-01-03T13:06:40.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f477fe700 1 --2- 172.21.15.133:0/947012683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4813c890 0x7f5f4813ccd0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f5f40002f30 tx=0x7f5f40006dc0).ready entity=mon.1 client_cookie=27e17e90eaf3751f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:40.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f45ffb700 1 -- 172.21.15.133:0/947012683 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f400096a0 con 0x7f5f4813c890 2021-01-03T13:06:40.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f45ffb700 1 -- 172.21.15.133:0/947012683 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f40009800 con 0x7f5f4813c890 2021-01-03T13:06:40.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f4d4ef700 1 -- 172.21.15.133:0/947012683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4813c890 msgr2=0x7f5f4813ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:40.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f45ffb700 1 -- 172.21.15.133:0/947012683 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f40009b60 con 0x7f5f4813c890 2021-01-03T13:06:40.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f4d4ef700 1 --2- 172.21.15.133:0/947012683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4813c890 0x7f5f4813ccd0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f5f40002f30 tx=0x7f5f40006dc0).stop 2021-01-03T13:06:40.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f4d4ef700 1 -- 172.21.15.133:0/947012683 shutdown_connections 2021-01-03T13:06:40.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f4d4ef700 1 --2- 172.21.15.133:0/947012683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4813c890 0x7f5f4813ccd0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:40.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f4d4ef700 1 --2- 172.21.15.133:0/947012683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4813fb40 0x7f5f4813fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:40.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f4d4ef700 1 -- 172.21.15.133:0/947012683 >> 172.21.15.133:0/947012683 conn(0x7f5f4806aeb0 msgr2=0x7f5f4805bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:40.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f4d4ef700 1 -- 172.21.15.133:0/947012683 shutdown_connections 2021-01-03T13:06:40.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.428+0000 7f5f4d4ef700 1 -- 172.21.15.133:0/947012683 wait complete. 2021-01-03T13:06:40.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f4d4ef700 1 Processor -- start 2021-01-03T13:06:40.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f4d4ef700 1 -- start start 2021-01-03T13:06:40.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f4d4ef700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4805c840 0x7f5f480b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:40.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f4d4ef700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4813c890 0x7f5f48153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:40.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f4d4ef700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4813fb40 0x7f5f48153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f4d4ef700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f48146340 con 0x7f5f4805c840 2021-01-03T13:06:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f4d4ef700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f48152d30 con 0x7f5f4813fb40 2021-01-03T13:06:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f4d4ef700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f48145d80 con 0x7f5f4813c890 2021-01-03T13:06:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f477fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4813fb40 0x7f5f48153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:40.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f477fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4813fb40 0x7f5f48153680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38884/0 (socket says 172.21.15.133:38884) 2021-01-03T13:06:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f477fe700 1 -- 172.21.15.133:0/2564486103 learned_addr learned my addr 172.21.15.133:0/2564486103 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f46ffd700 1 --2- 172.21.15.133:0/2564486103 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4805c840 0x7f5f480b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f467fc700 1 --2- 172.21.15.133:0/2564486103 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4813c890 0x7f5f48153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f477fe700 1 -- 172.21.15.133:0/2564486103 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4813c890 msgr2=0x7f5f48153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:40.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f477fe700 1 --2- 172.21.15.133:0/2564486103 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4813c890 0x7f5f48153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:40.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f477fe700 1 -- 172.21.15.133:0/2564486103 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4805c840 msgr2=0x7f5f480b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:40.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f477fe700 1 --2- 172.21.15.133:0/2564486103 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4805c840 0x7f5f480b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:40.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f477fe700 1 -- 172.21.15.133:0/2564486103 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48146570 con 0x7f5f4813fb40 2021-01-03T13:06:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f477fe700 1 --2- 172.21.15.133:0/2564486103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4813fb40 0x7f5f48153680 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f5f40002f30 tx=0x7f5f40015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f3ffff700 1 -- 172.21.15.133:0/2564486103 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f40011c20 con 0x7f5f4813fb40 2021-01-03T13:06:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f3ffff700 1 -- 172.21.15.133:0/2564486103 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f40011d80 con 0x7f5f4813fb40 2021-01-03T13:06:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f4d4ef700 1 -- 172.21.15.133:0/2564486103 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f48153b70 con 0x7f5f4813fb40 2021-01-03T13:06:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f3ffff700 1 -- 172.21.15.133:0/2564486103 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f4001d640 con 0x7f5f4813fb40 2021-01-03T13:06:40.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.432+0000 7f5f4d4ef700 1 -- 172.21.15.133:0/2564486103 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f48065ff0 con 0x7f5f4813fb40 2021-01-03T13:06:40.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.436+0000 7f5f4d4ef700 1 -- 172.21.15.133:0/2564486103 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f48145ef0 con 0x7f5f4813fb40 2021-01-03T13:06:40.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.436+0000 7f5f3ffff700 1 -- 172.21.15.133:0/2564486103 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5f4000f070 con 0x7f5f4813fb40 2021-01-03T13:06:40.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.436+0000 7f5f3ffff700 1 --2- 172.21.15.133:0/2564486103 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f2c055440 0x7f5f2c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:40.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.436+0000 7f5f3ffff700 1 -- 172.21.15.133:0/2564486103 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6075+0+0 (secure 0 0 0) 0x7f5f4006ee30 con 0x7f5f4813fb40 2021-01-03T13:06:40.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.436+0000 7f5f46ffd700 1 --2- 172.21.15.133:0/2564486103 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f2c055440 0x7f5f2c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:40.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.436+0000 7f5f46ffd700 1 --2- 172.21.15.133:0/2564486103 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f2c055440 0x7f5f2c057900 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f5f3800d000 tx=0x7f5f38009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:40.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.440+0000 7f5f3ffff700 1 -- 172.21.15.133:0/2564486103 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5f48145ef0 con 0x7f5f4813fb40 2021-01-03T13:06:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.632+0000 7f5f4d4ef700 1 -- 172.21.15.133:0/2564486103 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f5f48145ef0 con 0x7f5f4813fb40 2021-01-03T13:06:40.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.632+0000 7f5f3ffff700 1 -- 172.21.15.133:0/2564486103 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1588 (secure 0 0 0) 0x7f5f48145ef0 con 0x7f5f4813fb40 2021-01-03T13:06:40.638 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:40.638 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:06:40.638 INFO:teuthology.orchestra.run.smithi133.stdout: "stats": { 2021-01-03T13:06:40.638 INFO:teuthology.orchestra.run.smithi133.stdout: "total_bytes": 773094113280, 2021-01-03T13:06:40.639 INFO:teuthology.orchestra.run.smithi133.stdout: "total_avail_bytes": 764491333632, 2021-01-03T13:06:40.639 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_bytes": 12845056, 2021-01-03T13:06:40.639 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_raw_bytes": 8602779648, 2021-01-03T13:06:40.639 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_raw_ratio": 0.011127726174890995, 2021-01-03T13:06:40.640 INFO:teuthology.orchestra.run.smithi133.stdout: "num_osds": 8, 2021-01-03T13:06:40.640 INFO:teuthology.orchestra.run.smithi133.stdout: "num_per_pool_osds": 8, 2021-01-03T13:06:40.640 INFO:teuthology.orchestra.run.smithi133.stdout: "num_per_pool_omap_osds": 8 2021-01-03T13:06:40.640 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:40.640 INFO:teuthology.orchestra.run.smithi133.stdout: "stats_by_class": { 2021-01-03T13:06:40.641 INFO:teuthology.orchestra.run.smithi133.stdout: "ssd": { 2021-01-03T13:06:40.641 INFO:teuthology.orchestra.run.smithi133.stdout: "total_bytes": 773094113280, 2021-01-03T13:06:40.641 INFO:teuthology.orchestra.run.smithi133.stdout: "total_avail_bytes": 764491333632, 2021-01-03T13:06:40.641 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_bytes": 12845056, 2021-01-03T13:06:40.641 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_raw_bytes": 8602779648, 2021-01-03T13:06:40.642 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_raw_ratio": 0.011127726174890995 2021-01-03T13:06:40.642 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:40.642 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:40.642 INFO:teuthology.orchestra.run.smithi133.stdout: "pools": [ 2021-01-03T13:06:40.643 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:40.643 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "device_health_metrics", 2021-01-03T13:06:40.643 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 1, 2021-01-03T13:06:40.644 INFO:teuthology.orchestra.run.smithi133.stdout: "stats": { 2021-01-03T13:06:40.644 INFO:teuthology.orchestra.run.smithi133.stdout: "stored": 0, 2021-01-03T13:06:40.644 INFO:teuthology.orchestra.run.smithi133.stdout: "objects": 2, 2021-01-03T13:06:40.644 INFO:teuthology.orchestra.run.smithi133.stdout: "kb_used": 0, 2021-01-03T13:06:40.644 INFO:teuthology.orchestra.run.smithi133.stdout: "bytes_used": 0, 2021-01-03T13:06:40.645 INFO:teuthology.orchestra.run.smithi133.stdout: "percent_used": 0, 2021-01-03T13:06:40.645 INFO:teuthology.orchestra.run.smithi133.stdout: "max_avail": 362918215680 2021-01-03T13:06:40.645 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:40.645 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:40.646 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:40.646 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rbd", 2021-01-03T13:06:40.647 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 2, 2021-01-03T13:06:40.647 INFO:teuthology.orchestra.run.smithi133.stdout: "stats": { 2021-01-03T13:06:40.647 INFO:teuthology.orchestra.run.smithi133.stdout: "stored": 0, 2021-01-03T13:06:40.647 INFO:teuthology.orchestra.run.smithi133.stdout: "objects": 0, 2021-01-03T13:06:40.648 INFO:teuthology.orchestra.run.smithi133.stdout: "kb_used": 0, 2021-01-03T13:06:40.648 INFO:teuthology.orchestra.run.smithi133.stdout: "bytes_used": 0, 2021-01-03T13:06:40.648 INFO:teuthology.orchestra.run.smithi133.stdout: "percent_used": 0, 2021-01-03T13:06:40.648 INFO:teuthology.orchestra.run.smithi133.stdout: "max_avail": 362918215680 2021-01-03T13:06:40.649 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:40.649 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:40.649 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:40.649 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephfs_data", 2021-01-03T13:06:40.649 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 22, 2021-01-03T13:06:40.650 INFO:teuthology.orchestra.run.smithi133.stdout: "stats": { 2021-01-03T13:06:40.650 INFO:teuthology.orchestra.run.smithi133.stdout: "stored": 0, 2021-01-03T13:06:40.650 INFO:teuthology.orchestra.run.smithi133.stdout: "objects": 0, 2021-01-03T13:06:40.650 INFO:teuthology.orchestra.run.smithi133.stdout: "kb_used": 0, 2021-01-03T13:06:40.650 INFO:teuthology.orchestra.run.smithi133.stdout: "bytes_used": 0, 2021-01-03T13:06:40.651 INFO:teuthology.orchestra.run.smithi133.stdout: "percent_used": 0, 2021-01-03T13:06:40.651 INFO:teuthology.orchestra.run.smithi133.stdout: "max_avail": 362918215680 2021-01-03T13:06:40.651 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:40.651 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:40.651 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:40.652 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:06:40.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.632+0000 7f5f4d4ef700 1 -- 172.21.15.133:0/2564486103 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f2c055440 msgr2=0x7f5f2c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:40.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.632+0000 7f5f4d4ef700 1 --2- 172.21.15.133:0/2564486103 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f2c055440 0x7f5f2c057900 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f5f3800d000 tx=0x7f5f38009040).stop 2021-01-03T13:06:40.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.632+0000 7f5f4d4ef700 1 -- 172.21.15.133:0/2564486103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4813fb40 msgr2=0x7f5f48153680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:40.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.632+0000 7f5f4d4ef700 1 --2- 172.21.15.133:0/2564486103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4813fb40 0x7f5f48153680 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f5f40002f30 tx=0x7f5f40015000).stop 2021-01-03T13:06:40.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.632+0000 7f5f4d4ef700 1 -- 172.21.15.133:0/2564486103 shutdown_connections 2021-01-03T13:06:40.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.632+0000 7f5f4d4ef700 1 --2- 172.21.15.133:0/2564486103 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f2c055440 0x7f5f2c057900 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:40.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.632+0000 7f5f4d4ef700 1 --2- 172.21.15.133:0/2564486103 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f4805c840 0x7f5f480b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:40.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.632+0000 7f5f4d4ef700 1 --2- 172.21.15.133:0/2564486103 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f4813fb40 0x7f5f48153680 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:40.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.632+0000 7f5f4d4ef700 1 --2- 172.21.15.133:0/2564486103 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f4813c890 0x7f5f48153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:40.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.632+0000 7f5f4d4ef700 1 -- 172.21.15.133:0/2564486103 >> 172.21.15.133:0/2564486103 conn(0x7f5f4806aeb0 msgr2=0x7f5f480aea40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:40.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.632+0000 7f5f4d4ef700 1 -- 172.21.15.133:0/2564486103 shutdown_connections 2021-01-03T13:06:40.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:40.632+0000 7f5f4d4ef700 1 -- 172.21.15.133:0/2564486103 wait complete. 2021-01-03T13:06:40.657 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30)... 2021-01-03T13:06:45.659 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early df --format=json-pretty 2021-01-03T13:06:45.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8ffff700 1 Processor -- start 2021-01-03T13:06:45.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8ffff700 1 -- start start 2021-01-03T13:06:45.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab900b0840 0x7fab90143860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:45.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8ffff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab9005cad0 con 0x7fab9005c630 2021-01-03T13:06:45.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8ffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab90067b80 con 0x7fab900677a0 2021-01-03T13:06:45.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab900ad090 con 0x7fab900b0840 2021-01-03T13:06:45.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8effd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fab900677a0 0x7fab900b0e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59920/0 (socket says 172.21.15.133:59920) 2021-01-03T13:06:45.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8effd700 1 -- 172.21.15.133:0/3403255093 learned_addr learned my addr 172.21.15.133:0/3403255093 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:45.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8f7fe700 1 --2- 172.21.15.133:0/3403255093 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab900b0840 0x7fab90143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:45.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8e7fc700 1 -- 172.21.15.133:0/3403255093 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3056977919 0 0) 0x7fab90067b80 con 0x7fab900677a0 2021-01-03T13:06:45.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8e7fc700 1 -- 172.21.15.133:0/3403255093 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab70003230 con 0x7fab900677a0 2021-01-03T13:06:45.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8e7fc700 1 -- 172.21.15.133:0/3403255093 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509643845 0 0) 0x7fab9005cad0 con 0x7fab9005c630 2021-01-03T13:06:45.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8e7fc700 1 -- 172.21.15.133:0/3403255093 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab90067b80 con 0x7fab9005c630 2021-01-03T13:06:45.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8f7fe700 1 -- 172.21.15.133:0/3403255093 >> v1:172.21.15.133:6789/0 conn(0x7fab900677a0 legacy=0x7fab900b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:45.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8e7fc700 1 -- 172.21.15.133:0/3403255093 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4148940923 0 0) 0x7fab70003230 con 0x7fab900677a0 2021-01-03T13:06:45.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8f7fe700 1 -- 172.21.15.133:0/3403255093 >> v1:172.21.15.16:6789/0 conn(0x7fab9005c630 legacy=0x7fab900a8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:45.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8f7fe700 1 -- 172.21.15.133:0/3403255093 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab90142e80 con 0x7fab900b0840 2021-01-03T13:06:45.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8f7fe700 1 --2- 172.21.15.133:0/3403255093 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab900b0840 0x7fab90143860 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fab800010d0 tx=0x7fab880091a0).ready entity=mon.2 client_cookie=31fc48348be0733f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:45.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8e7fc700 1 -- 172.21.15.133:0/3403255093 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab800016d0 con 0x7fab900b0840 2021-01-03T13:06:45.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8e7fc700 1 -- 172.21.15.133:0/3403255093 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8800b880 con 0x7fab900b0840 2021-01-03T13:06:45.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8e7fc700 1 -- 172.21.15.133:0/3403255093 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab8800b9f0 con 0x7fab900b0840 2021-01-03T13:06:45.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8ffff700 1 -- 172.21.15.133:0/3403255093 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab900b0840 msgr2=0x7fab90143860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:45.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.772+0000 7fab8ffff700 1 --2- 172.21.15.133:0/3403255093 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab900b0840 0x7fab90143860 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fab800010d0 tx=0x7fab880091a0).stop 2021-01-03T13:06:45.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab8ffff700 1 -- 172.21.15.133:0/3403255093 shutdown_connections 2021-01-03T13:06:45.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab8ffff700 1 --2- 172.21.15.133:0/3403255093 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab900b0840 0x7fab90143860 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:45.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab8ffff700 1 -- 172.21.15.133:0/3403255093 >> 172.21.15.133:0/3403255093 conn(0x7fab9006b050 msgr2=0x7fab90060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:45.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab8ffff700 1 -- 172.21.15.133:0/3403255093 shutdown_connections 2021-01-03T13:06:45.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab8ffff700 1 -- 172.21.15.133:0/3403255093 wait complete. 2021-01-03T13:06:45.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab8ffff700 1 Processor -- start 2021-01-03T13:06:45.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab8ffff700 1 -- start start 2021-01-03T13:06:45.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab8ffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab9005c630 0x7fab900abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:45.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab8ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab900677a0 0x7fab9013dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:45.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab8ffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab900b0840 0x7fab9013e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:45.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab8ffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab901427e0 con 0x7fab900b0840 2021-01-03T13:06:45.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab8ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab900445c0 con 0x7fab900677a0 2021-01-03T13:06:45.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab8ffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab901414c0 con 0x7fab9005c630 2021-01-03T13:06:45.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab867fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab900677a0 0x7fab9013dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:45.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab867fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab900677a0 0x7fab9013dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38896/0 (socket says 172.21.15.133:38896) 2021-01-03T13:06:45.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab867fc700 1 -- 172.21.15.133:0/4227252016 learned_addr learned my addr 172.21.15.133:0/4227252016 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:45.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab8effd700 1 --2- 172.21.15.133:0/4227252016 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab9005c630 0x7fab900abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:45.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab8f7fe700 1 --2- 172.21.15.133:0/4227252016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab900b0840 0x7fab9013e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:45.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab867fc700 1 -- 172.21.15.133:0/4227252016 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab9005c630 msgr2=0x7fab900abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:45.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab867fc700 1 --2- 172.21.15.133:0/4227252016 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab9005c630 0x7fab900abd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:45.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab867fc700 1 -- 172.21.15.133:0/4227252016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab900b0840 msgr2=0x7fab9013e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:45.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab867fc700 1 --2- 172.21.15.133:0/4227252016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab900b0840 0x7fab9013e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:45.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab867fc700 1 -- 172.21.15.133:0/4227252016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab90141dd0 con 0x7fab900677a0 2021-01-03T13:06:45.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.776+0000 7fab867fc700 1 --2- 172.21.15.133:0/4227252016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab900677a0 0x7fab9013dc50 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7fab780010d0 tx=0x7fab78007a80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:45.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.780+0000 7fab8cff9700 1 -- 172.21.15.133:0/4227252016 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab78010510 con 0x7fab900677a0 2021-01-03T13:06:45.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.780+0000 7fab8cff9700 1 -- 172.21.15.133:0/4227252016 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab78010670 con 0x7fab900677a0 2021-01-03T13:06:45.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.780+0000 7fab8ffff700 1 -- 172.21.15.133:0/4227252016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab90140ec0 con 0x7fab900677a0 2021-01-03T13:06:45.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.780+0000 7fab8cff9700 1 -- 172.21.15.133:0/4227252016 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab780107e0 con 0x7fab900677a0 2021-01-03T13:06:45.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.780+0000 7fab8ffff700 1 -- 172.21.15.133:0/4227252016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab90141720 con 0x7fab900677a0 2021-01-03T13:06:45.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.780+0000 7fab8ffff700 1 -- 172.21.15.133:0/4227252016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab90057300 con 0x7fab900677a0 2021-01-03T13:06:45.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.780+0000 7fab8cff9700 1 -- 172.21.15.133:0/4227252016 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fab78010070 con 0x7fab900677a0 2021-01-03T13:06:45.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.780+0000 7fab8cff9700 1 --2- 172.21.15.133:0/4227252016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fab74055440 0x7fab74057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:45.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.780+0000 7fab8cff9700 1 -- 172.21.15.133:0/4227252016 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6075+0+0 (secure 0 0 0) 0x7fab7806d810 con 0x7fab900677a0 2021-01-03T13:06:45.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.780+0000 7fab8effd700 1 --2- 172.21.15.133:0/4227252016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fab74055440 0x7fab74057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:45.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.780+0000 7fab8effd700 1 --2- 172.21.15.133:0/4227252016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fab74055440 0x7fab74057900 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fab8000b000 tx=0x7fab80000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:45.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.788+0000 7fab8cff9700 1 -- 172.21.15.133:0/4227252016 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fab78043b10 con 0x7fab900677a0 2021-01-03T13:06:45.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.980+0000 7fab8ffff700 1 -- 172.21.15.133:0/4227252016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fab900afc30 con 0x7fab900677a0 2021-01-03T13:06:45.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.980+0000 7fab8cff9700 1 -- 172.21.15.133:0/4227252016 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1932 (secure 0 0 0) 0x7fab78047130 con 0x7fab900677a0 2021-01-03T13:06:45.986 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:45.986 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:06:45.986 INFO:teuthology.orchestra.run.smithi133.stdout: "stats": { 2021-01-03T13:06:45.987 INFO:teuthology.orchestra.run.smithi133.stdout: "total_bytes": 773094113280, 2021-01-03T13:06:45.987 INFO:teuthology.orchestra.run.smithi133.stdout: "total_avail_bytes": 764491038720, 2021-01-03T13:06:45.987 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_bytes": 13139968, 2021-01-03T13:06:45.987 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_raw_bytes": 8603074560, 2021-01-03T13:06:45.988 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_raw_ratio": 0.011128108017146587, 2021-01-03T13:06:45.988 INFO:teuthology.orchestra.run.smithi133.stdout: "num_osds": 8, 2021-01-03T13:06:45.988 INFO:teuthology.orchestra.run.smithi133.stdout: "num_per_pool_osds": 8, 2021-01-03T13:06:45.988 INFO:teuthology.orchestra.run.smithi133.stdout: "num_per_pool_omap_osds": 8 2021-01-03T13:06:45.988 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:45.989 INFO:teuthology.orchestra.run.smithi133.stdout: "stats_by_class": { 2021-01-03T13:06:45.989 INFO:teuthology.orchestra.run.smithi133.stdout: "ssd": { 2021-01-03T13:06:45.989 INFO:teuthology.orchestra.run.smithi133.stdout: "total_bytes": 773094113280, 2021-01-03T13:06:45.989 INFO:teuthology.orchestra.run.smithi133.stdout: "total_avail_bytes": 764491038720, 2021-01-03T13:06:45.989 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_bytes": 13139968, 2021-01-03T13:06:45.990 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_raw_bytes": 8603074560, 2021-01-03T13:06:45.990 INFO:teuthology.orchestra.run.smithi133.stdout: "total_used_raw_ratio": 0.011128108017146587 2021-01-03T13:06:45.990 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:45.990 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:45.991 INFO:teuthology.orchestra.run.smithi133.stdout: "pools": [ 2021-01-03T13:06:45.991 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:45.991 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "device_health_metrics", 2021-01-03T13:06:45.991 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 1, 2021-01-03T13:06:45.991 INFO:teuthology.orchestra.run.smithi133.stdout: "stats": { 2021-01-03T13:06:45.992 INFO:teuthology.orchestra.run.smithi133.stdout: "stored": 0, 2021-01-03T13:06:45.992 INFO:teuthology.orchestra.run.smithi133.stdout: "objects": 2, 2021-01-03T13:06:45.992 INFO:teuthology.orchestra.run.smithi133.stdout: "kb_used": 0, 2021-01-03T13:06:45.992 INFO:teuthology.orchestra.run.smithi133.stdout: "bytes_used": 0, 2021-01-03T13:06:45.992 INFO:teuthology.orchestra.run.smithi133.stdout: "percent_used": 0, 2021-01-03T13:06:45.993 INFO:teuthology.orchestra.run.smithi133.stdout: "max_avail": 362918117376 2021-01-03T13:06:45.993 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:45.993 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:45.993 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:45.993 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "rbd", 2021-01-03T13:06:45.994 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 2, 2021-01-03T13:06:45.994 INFO:teuthology.orchestra.run.smithi133.stdout: "stats": { 2021-01-03T13:06:45.994 INFO:teuthology.orchestra.run.smithi133.stdout: "stored": 0, 2021-01-03T13:06:45.994 INFO:teuthology.orchestra.run.smithi133.stdout: "objects": 0, 2021-01-03T13:06:45.994 INFO:teuthology.orchestra.run.smithi133.stdout: "kb_used": 0, 2021-01-03T13:06:45.995 INFO:teuthology.orchestra.run.smithi133.stdout: "bytes_used": 0, 2021-01-03T13:06:45.995 INFO:teuthology.orchestra.run.smithi133.stdout: "percent_used": 0, 2021-01-03T13:06:45.995 INFO:teuthology.orchestra.run.smithi133.stdout: "max_avail": 362918117376 2021-01-03T13:06:45.995 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:45.995 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:45.996 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:45.996 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephfs_data", 2021-01-03T13:06:45.996 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 22, 2021-01-03T13:06:45.996 INFO:teuthology.orchestra.run.smithi133.stdout: "stats": { 2021-01-03T13:06:45.997 INFO:teuthology.orchestra.run.smithi133.stdout: "stored": 0, 2021-01-03T13:06:45.997 INFO:teuthology.orchestra.run.smithi133.stdout: "objects": 0, 2021-01-03T13:06:45.997 INFO:teuthology.orchestra.run.smithi133.stdout: "kb_used": 0, 2021-01-03T13:06:45.997 INFO:teuthology.orchestra.run.smithi133.stdout: "bytes_used": 0, 2021-01-03T13:06:45.997 INFO:teuthology.orchestra.run.smithi133.stdout: "percent_used": 0, 2021-01-03T13:06:45.998 INFO:teuthology.orchestra.run.smithi133.stdout: "max_avail": 362918117376 2021-01-03T13:06:45.998 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:45.998 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:45.998 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:45.999 INFO:teuthology.orchestra.run.smithi133.stdout: "name": "cephfs_metadata", 2021-01-03T13:06:45.999 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 23, 2021-01-03T13:06:45.999 INFO:teuthology.orchestra.run.smithi133.stdout: "stats": { 2021-01-03T13:06:45.999 INFO:teuthology.orchestra.run.smithi133.stdout: "stored": 617, 2021-01-03T13:06:45.999 INFO:teuthology.orchestra.run.smithi133.stdout: "objects": 1, 2021-01-03T13:06:46.000 INFO:teuthology.orchestra.run.smithi133.stdout: "kb_used": 8, 2021-01-03T13:06:46.000 INFO:teuthology.orchestra.run.smithi133.stdout: "bytes_used": 8192, 2021-01-03T13:06:46.000 INFO:teuthology.orchestra.run.smithi133.stdout: "percent_used": 1.1286292789236541e-08, 2021-01-03T13:06:46.000 INFO:teuthology.orchestra.run.smithi133.stdout: "max_avail": 362918117376 2021-01-03T13:06:46.000 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:46.001 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:46.001 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:46.001 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:06:46.002 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.980+0000 7fab8ffff700 1 -- 172.21.15.133:0/4227252016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fab74055440 msgr2=0x7fab74057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:46.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.980+0000 7fab8ffff700 1 --2- 172.21.15.133:0/4227252016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fab74055440 0x7fab74057900 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fab8000b000 tx=0x7fab80000b80).stop 2021-01-03T13:06:46.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.980+0000 7fab8ffff700 1 -- 172.21.15.133:0/4227252016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab900677a0 msgr2=0x7fab9013dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:46.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.980+0000 7fab8ffff700 1 --2- 172.21.15.133:0/4227252016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab900677a0 0x7fab9013dc50 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7fab780010d0 tx=0x7fab78007a80).stop 2021-01-03T13:06:46.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.980+0000 7fab8ffff700 1 -- 172.21.15.133:0/4227252016 shutdown_connections 2021-01-03T13:06:46.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.980+0000 7fab8ffff700 1 --2- 172.21.15.133:0/4227252016 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fab74055440 0x7fab74057900 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.980+0000 7fab8ffff700 1 --2- 172.21.15.133:0/4227252016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fab900b0840 0x7fab9013e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.980+0000 7fab8ffff700 1 --2- 172.21.15.133:0/4227252016 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fab9005c630 0x7fab900abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.980+0000 7fab8ffff700 1 --2- 172.21.15.133:0/4227252016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab900677a0 0x7fab9013dc50 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.980+0000 7fab8ffff700 1 -- 172.21.15.133:0/4227252016 >> 172.21.15.133:0/4227252016 conn(0x7fab9006b050 msgr2=0x7fab900b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:46.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.980+0000 7fab8ffff700 1 -- 172.21.15.133:0/4227252016 shutdown_connections 2021-01-03T13:06:46.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:45.980+0000 7fab8ffff700 1 -- 172.21.15.133:0/4227252016 wait complete. 2021-01-03T13:06:46.006 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s 2021-01-03T13:06:46.006 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data 2021-01-03T13:06:46.121 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff126618700 1 Processor -- start 2021-01-03T13:06:46.122 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff126618700 1 -- start start 2021-01-03T13:06:46.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff126618700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff1200b2e80 0x7ff1200ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.123 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff126618700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff120144120 0x7ff120144570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff126618700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1200b7880 con 0x7ff1200ace10 2021-01-03T13:06:46.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff126618700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1200ad6e0 con 0x7ff1200b2e80 2021-01-03T13:06:46.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff126618700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1200adad0 con 0x7ff120144120 2021-01-03T13:06:46.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff125e17700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff120144120 0x7ff120144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff125616700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff1200ace10 0x7ff1200b7170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59934/0 (socket says 172.21.15.133:59934) 2021-01-03T13:06:46.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff125616700 1 -- 172.21.15.133:0/2386416563 learned_addr learned my addr 172.21.15.133:0/2386416563 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:46.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff124e15700 1 --2- 172.21.15.133:0/2386416563 >> v2:172.21.15.16:3300/0 conn(0x7ff1200b2e80 0x7ff1200ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff125e17700 1 -- 172.21.15.133:0/2386416563 >> v2:172.21.15.16:3300/0 conn(0x7ff1200b2e80 msgr2=0x7ff1200ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:46.125 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff125e17700 1 --2- 172.21.15.133:0/2386416563 >> v2:172.21.15.16:3300/0 conn(0x7ff1200b2e80 0x7ff1200ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff125e17700 1 -- 172.21.15.133:0/2386416563 >> v1:172.21.15.133:6789/0 conn(0x7ff1200ace10 legacy=0x7ff1200b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:46.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff125e17700 1 -- 172.21.15.133:0/2386416563 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1200add70 con 0x7ff120144120 2021-01-03T13:06:46.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff125e17700 1 --2- 172.21.15.133:0/2386416563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff120144120 0x7ff120144570 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7ff1180032b0 tx=0x7ff1180091a0).ready entity=mon.1 client_cookie=3d70c2657612e429 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:46.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff117fff700 1 -- 172.21.15.133:0/2386416563 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff11800b9a0 con 0x7ff120144120 2021-01-03T13:06:46.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff117fff700 1 -- 172.21.15.133:0/2386416563 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11800bb00 con 0x7ff120144120 2021-01-03T13:06:46.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff126618700 1 -- 172.21.15.133:0/2386416563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff120144120 msgr2=0x7ff120144570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:46.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff126618700 1 --2- 172.21.15.133:0/2386416563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff120144120 0x7ff120144570 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7ff1180032b0 tx=0x7ff1180091a0).stop 2021-01-03T13:06:46.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.116+0000 7ff117fff700 1 -- 172.21.15.133:0/2386416563 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff11800bc70 con 0x7ff120144120 2021-01-03T13:06:46.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.120+0000 7ff126618700 1 -- 172.21.15.133:0/2386416563 shutdown_connections 2021-01-03T13:06:46.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.120+0000 7ff126618700 1 --2- 172.21.15.133:0/2386416563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff120144120 0x7ff120144570 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.120+0000 7ff126618700 1 --2- 172.21.15.133:0/2386416563 >> v2:172.21.15.16:3300/0 conn(0x7ff1200b2e80 0x7ff1200ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.120+0000 7ff126618700 1 -- 172.21.15.133:0/2386416563 >> 172.21.15.133:0/2386416563 conn(0x7ff12005bdf0 msgr2=0x7ff12005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:46.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.120+0000 7ff126618700 1 -- 172.21.15.133:0/2386416563 shutdown_connections 2021-01-03T13:06:46.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.120+0000 7ff126618700 1 -- 172.21.15.133:0/2386416563 wait complete. 2021-01-03T13:06:46.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.120+0000 7ff126618700 1 Processor -- start 2021-01-03T13:06:46.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.120+0000 7ff126618700 1 -- start start 2021-01-03T13:06:46.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff126618700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff1200ace10 0x7ff120141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff126618700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1200b2e80 0x7ff120146910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff126618700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff120144120 0x7ff12014fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff126618700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff120147000 con 0x7ff120144120 2021-01-03T13:06:46.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff126618700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1200afb50 con 0x7ff1200b2e80 2021-01-03T13:06:46.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff126618700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1200afdf0 con 0x7ff1200ace10 2021-01-03T13:06:46.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff124e15700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1200b2e80 0x7ff120146910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff124e15700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1200b2e80 0x7ff120146910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38910/0 (socket says 172.21.15.133:38910) 2021-01-03T13:06:46.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff124e15700 1 -- 172.21.15.133:0/3528528194 learned_addr learned my addr 172.21.15.133:0/3528528194 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:46.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff125616700 1 --2- 172.21.15.133:0/3528528194 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff1200ace10 0x7ff120141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff125e17700 1 --2- 172.21.15.133:0/3528528194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff120144120 0x7ff12014fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff124e15700 1 -- 172.21.15.133:0/3528528194 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff1200ace10 msgr2=0x7ff120141590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:46.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff124e15700 1 --2- 172.21.15.133:0/3528528194 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff1200ace10 0x7ff120141590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff124e15700 1 -- 172.21.15.133:0/3528528194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff120144120 msgr2=0x7ff12014fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:46.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff124e15700 1 --2- 172.21.15.133:0/3528528194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff120144120 0x7ff12014fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff124e15700 1 -- 172.21.15.133:0/3528528194 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1200b0090 con 0x7ff1200b2e80 2021-01-03T13:06:46.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff125e17700 1 --2- 172.21.15.133:0/3528528194 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff120144120 0x7ff12014fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:06:46.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff125616700 1 --2- 172.21.15.133:0/3528528194 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff1200ace10 0x7ff120141590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:06:46.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff124e15700 1 --2- 172.21.15.133:0/3528528194 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1200b2e80 0x7ff120146910 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7ff11c00c000 tx=0x7ff11c006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:46.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff1167fc700 1 -- 172.21.15.133:0/3528528194 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff11c00ca80 con 0x7ff1200b2e80 2021-01-03T13:06:46.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff1167fc700 1 -- 172.21.15.133:0/3528528194 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c00cbe0 con 0x7ff1200b2e80 2021-01-03T13:06:46.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff126618700 1 -- 172.21.15.133:0/3528528194 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1200b0330 con 0x7ff1200b2e80 2021-01-03T13:06:46.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff1167fc700 1 -- 172.21.15.133:0/3528528194 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff11c0123f0 con 0x7ff1200b2e80 2021-01-03T13:06:46.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff126618700 1 -- 172.21.15.133:0/3528528194 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12009c330 con 0x7ff1200b2e80 2021-01-03T13:06:46.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff126618700 1 -- 172.21.15.133:0/3528528194 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1200b04c0 con 0x7ff1200b2e80 2021-01-03T13:06:46.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff1167fc700 1 -- 172.21.15.133:0/3528528194 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff11c012550 con 0x7ff1200b2e80 2021-01-03T13:06:46.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.124+0000 7ff1167fc700 1 --2- 172.21.15.133:0/3528528194 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff108055350 0x7ff108057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.128+0000 7ff1167fc700 1 -- 172.21.15.133:0/3528528194 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6075+0+0 (secure 0 0 0) 0x7ff11c06e490 con 0x7ff1200b2e80 2021-01-03T13:06:46.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.128+0000 7ff125616700 1 --2- 172.21.15.133:0/3528528194 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff108055350 0x7ff108057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.128+0000 7ff125616700 1 --2- 172.21.15.133:0/3528528194 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff108055350 0x7ff108057810 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7ff110008000 tx=0x7ff110009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:46.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.132+0000 7ff1167fc700 1 -- 172.21.15.133:0/3528528194 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff11c044730 con 0x7ff1200b2e80 2021-01-03T13:06:46.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.316+0000 7ff126618700 1 -- 172.21.15.133:0/3528528194 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff120057300 con 0x7ff1200b2e80 2021-01-03T13:06:46.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.316+0000 7ff1167fc700 1 -- 172.21.15.133:0/3528528194 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=-22 pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. v58) v1 ==== 209+0+0 (secure 0 0 0) 0x7ff11c047d50 con 0x7ff1200b2e80 2021-01-03T13:06:46.326 INFO:teuthology.orchestra.run.smithi133.stderr:Error EINVAL: pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. 2021-01-03T13:06:46.328 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-01-03T13:06:46.329 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-01-03T13:06:46.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.440+0000 7fb3a2092700 1 Processor -- start 2021-01-03T13:06:46.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.440+0000 7fb3a2092700 1 -- start start 2021-01-03T13:06:46.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a2092700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb39c0b4c20 0x7fb39c05c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a2092700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb39c060510 0x7fb39c0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a2092700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb39c0b6cf0 con 0x7fb39c05fd10 2021-01-03T13:06:46.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a2092700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39c05bf00 con 0x7fb39c0b4c20 2021-01-03T13:06:46.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a2092700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c05c1a0 con 0x7fb39c060510 2021-01-03T13:06:46.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a088f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb39c060510 0x7fb39c0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a1891700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb39c05fd10 0x7fb39c0b65e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:38680/0 (socket says 172.21.15.133:38680) 2021-01-03T13:06:46.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a1891700 1 -- 172.21.15.133:0/3948233410 learned_addr learned my addr 172.21.15.133:0/3948233410 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:46.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a1090700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb39c0b4c20 0x7fb39c05c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a1090700 1 -- 172.21.15.133:0/3948233410 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb39c060510 msgr2=0x7fb39c0b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:46.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a1090700 1 --2- 172.21.15.133:0/3948233410 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb39c060510 0x7fb39c0b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a1090700 1 -- 172.21.15.133:0/3948233410 >> v1:172.21.15.16:6789/0 conn(0x7fb39c05fd10 legacy=0x7fb39c0b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:46.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a1090700 1 -- 172.21.15.133:0/3948233410 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c05c440 con 0x7fb39c0b4c20 2021-01-03T13:06:46.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a1090700 1 --2- 172.21.15.133:0/3948233410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb39c0b4c20 0x7fb39c05c8e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fb398002f30 tx=0x7fb398006dc0).ready entity=mon.0 client_cookie=bbda006a5b3d6c2a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:46.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb393fff700 1 -- 172.21.15.133:0/3948233410 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb398009760 con 0x7fb39c0b4c20 2021-01-03T13:06:46.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb393fff700 1 -- 172.21.15.133:0/3948233410 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3980098c0 con 0x7fb39c0b4c20 2021-01-03T13:06:46.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb393fff700 1 -- 172.21.15.133:0/3948233410 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb398009c20 con 0x7fb39c0b4c20 2021-01-03T13:06:46.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a2092700 1 -- 172.21.15.133:0/3948233410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb39c0b4c20 msgr2=0x7fb39c05c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:46.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a2092700 1 --2- 172.21.15.133:0/3948233410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb39c0b4c20 0x7fb39c05c8e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fb398002f30 tx=0x7fb398006dc0).stop 2021-01-03T13:06:46.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a2092700 1 -- 172.21.15.133:0/3948233410 shutdown_connections 2021-01-03T13:06:46.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a2092700 1 --2- 172.21.15.133:0/3948233410 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb39c0b4c20 0x7fb39c05c8e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a2092700 1 --2- 172.21.15.133:0/3948233410 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb39c060510 0x7fb39c0b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a2092700 1 -- 172.21.15.133:0/3948233410 >> 172.21.15.133:0/3948233410 conn(0x7fb39c0b9f00 msgr2=0x7fb39c0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:46.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a2092700 1 -- 172.21.15.133:0/3948233410 shutdown_connections 2021-01-03T13:06:46.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a2092700 1 -- 172.21.15.133:0/3948233410 wait complete. 2021-01-03T13:06:46.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a2092700 1 Processor -- start 2021-01-03T13:06:46.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.444+0000 7fb3a2092700 1 -- start start 2021-01-03T13:06:46.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a2092700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb39c05fd10 0x7fb39c142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a2092700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb39c060510 0x7fb39c146870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a2092700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb39c0b4c20 0x7fb39c1559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a2092700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c09ee90 con 0x7fb39c05fd10 2021-01-03T13:06:46.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a2092700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c09f130 con 0x7fb39c0b4c20 2021-01-03T13:06:46.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a2092700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c155270 con 0x7fb39c060510 2021-01-03T13:06:46.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a1891700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb39c0b4c20 0x7fb39c1559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a1891700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb39c0b4c20 0x7fb39c1559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38926/0 (socket says 172.21.15.133:38926) 2021-01-03T13:06:46.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a1891700 1 -- 172.21.15.133:0/613686865 learned_addr learned my addr 172.21.15.133:0/613686865 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:46.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a088f700 1 --2- 172.21.15.133:0/613686865 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb39c060510 0x7fb39c146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a1090700 1 --2- 172.21.15.133:0/613686865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb39c05fd10 0x7fb39c142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a1891700 1 -- 172.21.15.133:0/613686865 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb39c060510 msgr2=0x7fb39c146870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:46.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a1891700 1 --2- 172.21.15.133:0/613686865 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb39c060510 0x7fb39c146870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a1891700 1 -- 172.21.15.133:0/613686865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb39c05fd10 msgr2=0x7fb39c142c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:46.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a1891700 1 --2- 172.21.15.133:0/613686865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb39c05fd10 0x7fb39c142c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a1891700 1 -- 172.21.15.133:0/613686865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39c155510 con 0x7fb39c0b4c20 2021-01-03T13:06:46.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a1891700 1 --2- 172.21.15.133:0/613686865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb39c0b4c20 0x7fb39c1559b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fb39c05c7c0 tx=0x7fb394007f10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:46.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3927fc700 1 -- 172.21.15.133:0/613686865 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb394005b70 con 0x7fb39c0b4c20 2021-01-03T13:06:46.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a2092700 1 -- 172.21.15.133:0/613686865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39c09eb10 con 0x7fb39c0b4c20 2021-01-03T13:06:46.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a2092700 1 -- 172.21.15.133:0/613686865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39c0b09c0 con 0x7fb39c0b4c20 2021-01-03T13:06:46.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3927fc700 1 -- 172.21.15.133:0/613686865 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb394005cd0 con 0x7fb39c0b4c20 2021-01-03T13:06:46.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3927fc700 1 -- 172.21.15.133:0/613686865 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb394007300 con 0x7fb39c0b4c20 2021-01-03T13:06:46.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.448+0000 7fb3a2092700 1 -- 172.21.15.133:0/613686865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39c1556a0 con 0x7fb39c0b4c20 2021-01-03T13:06:46.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.452+0000 7fb3927fc700 1 -- 172.21.15.133:0/613686865 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb394010030 con 0x7fb39c0b4c20 2021-01-03T13:06:46.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.452+0000 7fb3927fc700 1 --2- 172.21.15.133:0/613686865 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb3840553b0 0x7fb384057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.452+0000 7fb3927fc700 1 -- 172.21.15.133:0/613686865 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6075+0+0 (secure 0 0 0) 0x7fb39406de00 con 0x7fb39c0b4c20 2021-01-03T13:06:46.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.452+0000 7fb3a1090700 1 --2- 172.21.15.133:0/613686865 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb3840553b0 0x7fb384057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.452+0000 7fb3a1090700 1 --2- 172.21.15.133:0/613686865 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb3840553b0 0x7fb384057870 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fb39801a000 tx=0x7fb398015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:46.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.456+0000 7fb3927fc700 1 -- 172.21.15.133:0/613686865 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb394044110 con 0x7fb39c0b4c20 2021-01-03T13:06:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.636+0000 7fb3a2092700 1 -- 172.21.15.133:0/613686865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fb39c0b09c0 con 0x7fb39c0b4c20 2021-01-03T13:06:46.643 INFO:tasks.ceph.mon.b.smithi016.stderr:2021-01-03T13:06:46.636+0000 7fba5a1bf700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-01-03T13:06:46.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.648+0000 7fb3927fc700 1 -- 172.21.15.133:0/613686865 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 23 and data pool 22 v59) v1 ==== 189+0+0 (secure 0 0 0) 0x7fb39c0b09c0 con 0x7fb39c0b4c20 2021-01-03T13:06:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.652+0000 7fb3a2092700 1 -- 172.21.15.133:0/613686865 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb3840553b0 msgr2=0x7fb384057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.652+0000 7fb3a2092700 1 --2- 172.21.15.133:0/613686865 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb3840553b0 0x7fb384057870 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fb39801a000 tx=0x7fb398015000).stop 2021-01-03T13:06:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.652+0000 7fb3a2092700 1 -- 172.21.15.133:0/613686865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb39c0b4c20 msgr2=0x7fb39c1559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.652+0000 7fb3a2092700 1 --2- 172.21.15.133:0/613686865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb39c0b4c20 0x7fb39c1559b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fb39c05c7c0 tx=0x7fb394007f10).stop 2021-01-03T13:06:46.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.652+0000 7fb3a2092700 1 -- 172.21.15.133:0/613686865 shutdown_connections 2021-01-03T13:06:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.652+0000 7fb3a2092700 1 --2- 172.21.15.133:0/613686865 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb3840553b0 0x7fb384057870 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.652+0000 7fb3a2092700 1 --2- 172.21.15.133:0/613686865 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb39c05fd10 0x7fb39c142c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.652+0000 7fb3a2092700 1 --2- 172.21.15.133:0/613686865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb39c0b4c20 0x7fb39c1559b0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.652+0000 7fb3a2092700 1 --2- 172.21.15.133:0/613686865 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb39c060510 0x7fb39c146870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.652+0000 7fb3a2092700 1 -- 172.21.15.133:0/613686865 >> 172.21.15.133:0/613686865 conn(0x7fb39c0b9f00 msgr2=0x7fb39c06b130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:46.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.652+0000 7fb3a2092700 1 -- 172.21.15.133:0/613686865 shutdown_connections 2021-01-03T13:06:46.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.652+0000 7fb3a2092700 1 -- 172.21.15.133:0/613686865 wait complete. 2021-01-03T13:06:46.659 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 23 and data pool 22 2021-01-03T13:06:46.669 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-01-03T13:06:46.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76b4914700 1 Processor -- start 2021-01-03T13:06:46.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76b4914700 1 -- start start 2021-01-03T13:06:46.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76b4914700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f76b00b2f00 0x7f76b005f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76b4914700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76b00b20c0 0x7f76b005fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76b4914700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76b00b3830 0x7f76b0140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76b4914700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b0142d30 con 0x7f76b00b2f00 2021-01-03T13:06:46.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76b4914700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b0142fd0 con 0x7f76b00b3830 2021-01-03T13:06:46.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76b4914700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b0143270 con 0x7f76b00b20c0 2021-01-03T13:06:46.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76affff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76b00b3830 0x7f76b0140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76affff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76b00b3830 0x7f76b0140060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38934/0 (socket says 172.21.15.133:38934) 2021-01-03T13:06:46.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76affff700 1 -- 172.21.15.133:0/4216575378 learned_addr learned my addr 172.21.15.133:0/4216575378 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:46.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76af7fe700 1 --2- 172.21.15.133:0/4216575378 >> v2:172.21.15.16:3300/0 conn(0x7f76b00b2f00 0x7f76b005f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76aeffd700 1 --2- 172.21.15.133:0/4216575378 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76b00b20c0 0x7f76b005fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76affff700 1 -- 172.21.15.133:0/4216575378 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76b00b20c0 msgr2=0x7f76b005fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:46.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76affff700 1 --2- 172.21.15.133:0/4216575378 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76b00b20c0 0x7f76b005fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76affff700 1 -- 172.21.15.133:0/4216575378 >> v2:172.21.15.16:3300/0 conn(0x7f76b00b2f00 msgr2=0x7f76b005f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:46.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76affff700 1 --2- 172.21.15.133:0/4216575378 >> v2:172.21.15.16:3300/0 conn(0x7f76b00b2f00 0x7f76b005f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76affff700 1 -- 172.21.15.133:0/4216575378 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b0143510 con 0x7f76b00b3830 2021-01-03T13:06:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76affff700 1 --2- 172.21.15.133:0/4216575378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00b3830 0x7f76b0140060 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f76a80032b0 tx=0x7f76a8009270).ready entity=mon.1 client_cookie=84a4e6dc39cfa332 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76ae7fc700 1 -- 172.21.15.133:0/4216575378 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76a800bc00 con 0x7f76b00b3830 2021-01-03T13:06:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76ae7fc700 1 -- 172.21.15.133:0/4216575378 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a800bd60 con 0x7f76b00b3830 2021-01-03T13:06:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76ae7fc700 1 -- 172.21.15.133:0/4216575378 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76a8011400 con 0x7f76b00b3830 2021-01-03T13:06:46.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76b4914700 1 -- 172.21.15.133:0/4216575378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00b3830 msgr2=0x7f76b0140060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:46.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76b4914700 1 --2- 172.21.15.133:0/4216575378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00b3830 0x7f76b0140060 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f76a80032b0 tx=0x7f76a8009270).stop 2021-01-03T13:06:46.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76b4914700 1 -- 172.21.15.133:0/4216575378 shutdown_connections 2021-01-03T13:06:46.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76b4914700 1 --2- 172.21.15.133:0/4216575378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00b3830 0x7f76b0140060 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76b4914700 1 --2- 172.21.15.133:0/4216575378 >> v2:172.21.15.16:3300/0 conn(0x7f76b00b2f00 0x7f76b005f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76b4914700 1 --2- 172.21.15.133:0/4216575378 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76b00b20c0 0x7f76b005fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.776+0000 7f76b4914700 1 -- 172.21.15.133:0/4216575378 >> 172.21.15.133:0/4216575378 conn(0x7f76b00b7200 msgr2=0x7f76b00b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:46.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76b4914700 1 -- 172.21.15.133:0/4216575378 shutdown_connections 2021-01-03T13:06:46.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76b4914700 1 -- 172.21.15.133:0/4216575378 wait complete. 2021-01-03T13:06:46.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76b4914700 1 Processor -- start 2021-01-03T13:06:46.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76b4914700 1 -- start start 2021-01-03T13:06:46.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76b4914700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00b20c0 0x7f76b0148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76b4914700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76b00b2f00 0x7f76b0145310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76b4914700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76b00b3830 0x7f76b0145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76b4914700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b0149720 con 0x7f76b00b2f00 2021-01-03T13:06:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76b4914700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b0148740 con 0x7f76b00b20c0 2021-01-03T13:06:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76b4914700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b0149950 con 0x7f76b00b3830 2021-01-03T13:06:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76af7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00b20c0 0x7f76b0148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76af7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00b20c0 0x7f76b0148cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38936/0 (socket says 172.21.15.133:38936) 2021-01-03T13:06:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76af7fe700 1 -- 172.21.15.133:0/18235246 learned_addr learned my addr 172.21.15.133:0/18235246 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76affff700 1 --2- 172.21.15.133:0/18235246 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76b00b3830 0x7f76b0145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76aeffd700 1 --2- 172.21.15.133:0/18235246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76b00b2f00 0x7f76b0145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76af7fe700 1 -- 172.21.15.133:0/18235246 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76b00b3830 msgr2=0x7f76b0145800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76af7fe700 1 --2- 172.21.15.133:0/18235246 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76b00b3830 0x7f76b0145800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.780+0000 7f76af7fe700 1 -- 172.21.15.133:0/18235246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76b00b2f00 msgr2=0x7f76b0145310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.784+0000 7f76af7fe700 1 --2- 172.21.15.133:0/18235246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76b00b2f00 0x7f76b0145310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.784+0000 7f76af7fe700 1 -- 172.21.15.133:0/18235246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b0149bf0 con 0x7f76b00b20c0 2021-01-03T13:06:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.784+0000 7f76aeffd700 1 --2- 172.21.15.133:0/18235246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76b00b2f00 0x7f76b0145310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:06:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.784+0000 7f76af7fe700 1 --2- 172.21.15.133:0/18235246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00b20c0 0x7f76b0148cb0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f76a4003070 tx=0x7f76a4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.784+0000 7f76acff9700 1 -- 172.21.15.133:0/18235246 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76a4009980 con 0x7f76b00b20c0 2021-01-03T13:06:46.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.784+0000 7f76b4914700 1 -- 172.21.15.133:0/18235246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b014a090 con 0x7f76b00b20c0 2021-01-03T13:06:46.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.784+0000 7f76acff9700 1 -- 172.21.15.133:0/18235246 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a4009ae0 con 0x7f76b00b20c0 2021-01-03T13:06:46.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.784+0000 7f76acff9700 1 -- 172.21.15.133:0/18235246 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76a4009e40 con 0x7f76b00b20c0 2021-01-03T13:06:46.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.784+0000 7f76b4914700 1 -- 172.21.15.133:0/18235246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b01493c0 con 0x7f76b00b20c0 2021-01-03T13:06:46.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.784+0000 7f76b4914700 1 -- 172.21.15.133:0/18235246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b0057300 con 0x7f76b00b20c0 2021-01-03T13:06:46.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.784+0000 7f76acff9700 1 -- 172.21.15.133:0/18235246 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f76a4013480 con 0x7f76b00b20c0 2021-01-03T13:06:46.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.784+0000 7f76acff9700 1 --2- 172.21.15.133:0/18235246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7690055440 0x7f7690057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:46.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.784+0000 7f76acff9700 1 -- 172.21.15.133:0/18235246 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f76a406f080 con 0x7f76b00b20c0 2021-01-03T13:06:46.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.784+0000 7f76aeffd700 1 --2- 172.21.15.133:0/18235246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7690055440 0x7f7690057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:46.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.788+0000 7f76aeffd700 1 --2- 172.21.15.133:0/18235246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7690055440 0x7f7690057900 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f76a0008000 tx=0x7f76a0008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:46.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.792+0000 7f76acff9700 1 -- 172.21.15.133:0/18235246 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f76a40452d0 con 0x7f76b00b20c0 2021-01-03T13:06:46.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:46.972+0000 7f76b4914700 1 -- 172.21.15.133:0/18235246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f76b00b2b00 con 0x7f76b00b20c0 2021-01-03T13:06:47.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.652+0000 7f76acff9700 1 -- 172.21.15.133:0/18235246 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) v1 ==== 104+0+0 (secure 0 0 0) 0x7f76a40488f0 con 0x7f76b00b20c0 2021-01-03T13:06:47.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.656+0000 7f76b4914700 1 -- 172.21.15.133:0/18235246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7690055440 msgr2=0x7f7690057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.656+0000 7f76b4914700 1 --2- 172.21.15.133:0/18235246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7690055440 0x7f7690057900 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f76a0008000 tx=0x7f76a0008040).stop 2021-01-03T13:06:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.656+0000 7f76b4914700 1 -- 172.21.15.133:0/18235246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00b20c0 msgr2=0x7f76b0148cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:47.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.656+0000 7f76b4914700 1 --2- 172.21.15.133:0/18235246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00b20c0 0x7f76b0148cb0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f76a4003070 tx=0x7f76a4008040).stop 2021-01-03T13:06:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.656+0000 7f76b4914700 1 -- 172.21.15.133:0/18235246 shutdown_connections 2021-01-03T13:06:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.656+0000 7f76b4914700 1 --2- 172.21.15.133:0/18235246 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7690055440 0x7f7690057900 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.656+0000 7f76b4914700 1 --2- 172.21.15.133:0/18235246 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f76b00b3830 0x7f76b0145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:47.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.656+0000 7f76b4914700 1 --2- 172.21.15.133:0/18235246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b00b20c0 0x7f76b0148cb0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.656+0000 7f76b4914700 1 --2- 172.21.15.133:0/18235246 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76b00b2f00 0x7f76b0145310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:47.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.656+0000 7f76b4914700 1 -- 172.21.15.133:0/18235246 >> 172.21.15.133:0/18235246 conn(0x7f76b00b7200 msgr2=0x7f76b0140bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.656+0000 7f76b4914700 1 -- 172.21.15.133:0/18235246 shutdown_connections 2021-01-03T13:06:47.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.656+0000 7f76b4914700 1 -- 172.21.15.133:0/18235246 wait complete. 2021-01-03T13:06:47.722 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-01-03T13:06:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.844+0000 7f508759e700 1 Processor -- start 2021-01-03T13:06:47.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.844+0000 7f508759e700 1 -- start start 2021-01-03T13:06:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.844+0000 7f508759e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f50880b5260 0x7f50881470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.844+0000 7f508759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f50881442a0 0x7f50881446f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:47.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.844+0000 7f508759e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50880b0c10 con 0x7f50880b5c00 2021-01-03T13:06:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.844+0000 7f508759e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50880b5640 con 0x7f50880b5260 2021-01-03T13:06:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.844+0000 7f508759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508809a4f0 con 0x7f50881442a0 2021-01-03T13:06:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.844+0000 7f5086d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f50881442a0 0x7f50881446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:47.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.844+0000 7f5086d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f50881442a0 0x7f50881446f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38948/0 (socket says 172.21.15.133:38948) 2021-01-03T13:06:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f5086d9d700 1 -- 172.21.15.133:0/549444098 learned_addr learned my addr 172.21.15.133:0/549444098 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f508659c700 1 --2- 172.21.15.133:0/549444098 >> v2:172.21.15.16:3300/0 conn(0x7f50880b5260 0x7f50881470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f5086d9d700 1 -- 172.21.15.133:0/549444098 >> v2:172.21.15.16:3300/0 conn(0x7f50880b5260 msgr2=0x7f50881470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:47.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f5086d9d700 1 --2- 172.21.15.133:0/549444098 >> v2:172.21.15.16:3300/0 conn(0x7f50880b5260 0x7f50881470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:47.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f5086d9d700 1 -- 172.21.15.133:0/549444098 >> v1:172.21.15.16:6789/0 conn(0x7f50880b5c00 legacy=0x7f50881475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:47.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f5086d9d700 1 -- 172.21.15.133:0/549444098 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50880b0e40 con 0x7f50881442a0 2021-01-03T13:06:47.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f5086d9d700 1 --2- 172.21.15.133:0/549444098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50881442a0 0x7f50881446f0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f50800032b0 tx=0x7f5080009270).ready entity=mon.1 client_cookie=164bee5cccecd668 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:47.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f508559a700 1 -- 172.21.15.133:0/549444098 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f508000bc00 con 0x7f50881442a0 2021-01-03T13:06:47.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f508559a700 1 -- 172.21.15.133:0/549444098 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508000bd60 con 0x7f50881442a0 2021-01-03T13:06:47.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f508559a700 1 -- 172.21.15.133:0/549444098 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5080011400 con 0x7f50881442a0 2021-01-03T13:06:47.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f508759e700 1 -- 172.21.15.133:0/549444098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50881442a0 msgr2=0x7f50881446f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:47.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f508759e700 1 --2- 172.21.15.133:0/549444098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50881442a0 0x7f50881446f0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f50800032b0 tx=0x7f5080009270).stop 2021-01-03T13:06:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f508759e700 1 -- 172.21.15.133:0/549444098 shutdown_connections 2021-01-03T13:06:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f508759e700 1 --2- 172.21.15.133:0/549444098 >> v2:172.21.15.16:3300/0 conn(0x7f50880b5260 0x7f50881470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f508759e700 1 --2- 172.21.15.133:0/549444098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50881442a0 0x7f50881446f0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:47.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f508759e700 1 -- 172.21.15.133:0/549444098 >> 172.21.15.133:0/549444098 conn(0x7f508805bdf0 msgr2=0x7f508805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f508759e700 1 -- 172.21.15.133:0/549444098 shutdown_connections 2021-01-03T13:06:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f508759e700 1 -- 172.21.15.133:0/549444098 wait complete. 2021-01-03T13:06:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f508759e700 1 Processor -- start 2021-01-03T13:06:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.848+0000 7f508759e700 1 -- start start 2021-01-03T13:06:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f508759e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50880b5260 0x7f50880b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f508759e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f50880b5c00 0x7f5088063540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f508759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50881442a0 0x7f50881410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f508759e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5088155ec0 con 0x7f50880b5260 2021-01-03T13:06:47.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f508759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50880aed70 con 0x7f50881442a0 2021-01-03T13:06:47.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f508759e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50880ae2a0 con 0x7f50880b5c00 2021-01-03T13:06:47.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f5086d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50881442a0 0x7f50881410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:47.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f5086d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50881442a0 0x7f50881410e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38954/0 (socket says 172.21.15.133:38954) 2021-01-03T13:06:47.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f5086d9d700 1 -- 172.21.15.133:0/303646014 learned_addr learned my addr 172.21.15.133:0/303646014 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:47.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f5085d9b700 1 --2- 172.21.15.133:0/303646014 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f50880b5c00 0x7f5088063540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f508659c700 1 --2- 172.21.15.133:0/303646014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50880b5260 0x7f50880b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f5086d9d700 1 -- 172.21.15.133:0/303646014 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f50880b5c00 msgr2=0x7f5088063540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f5086d9d700 1 --2- 172.21.15.133:0/303646014 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f50880b5c00 0x7f5088063540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f5086d9d700 1 -- 172.21.15.133:0/303646014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50880b5260 msgr2=0x7f50880b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f5086d9d700 1 --2- 172.21.15.133:0/303646014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50880b5260 0x7f50880b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f5086d9d700 1 -- 172.21.15.133:0/303646014 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50880add60 con 0x7f50881442a0 2021-01-03T13:06:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f5085d9b700 1 --2- 172.21.15.133:0/303646014 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f50880b5c00 0x7f5088063540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f5086d9d700 1 --2- 172.21.15.133:0/303646014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50881442a0 0x7f50881410e0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f50880ae430 tx=0x7f5080016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f507f7fe700 1 -- 172.21.15.133:0/303646014 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f508001f3f0 con 0x7f50881442a0 2021-01-03T13:06:47.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f507f7fe700 1 -- 172.21.15.133:0/303646014 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508001f550 con 0x7f50881442a0 2021-01-03T13:06:47.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f508759e700 1 -- 172.21.15.133:0/303646014 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50880ae000 con 0x7f50881442a0 2021-01-03T13:06:47.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f507f7fe700 1 -- 172.21.15.133:0/303646014 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f508001f8b0 con 0x7f50881442a0 2021-01-03T13:06:47.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f508759e700 1 -- 172.21.15.133:0/303646014 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50880b38f0 con 0x7f50881442a0 2021-01-03T13:06:47.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f508759e700 1 -- 172.21.15.133:0/303646014 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5088057300 con 0x7f50881442a0 2021-01-03T13:06:47.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f507f7fe700 1 -- 172.21.15.133:0/303646014 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5080026030 con 0x7f50881442a0 2021-01-03T13:06:47.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f507f7fe700 1 --2- 172.21.15.133:0/303646014 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5064055440 0x7f5064057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:47.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.852+0000 7f507f7fe700 1 -- 172.21.15.133:0/303646014 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f508006ec20 con 0x7f50881442a0 2021-01-03T13:06:47.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.856+0000 7f508659c700 1 --2- 172.21.15.133:0/303646014 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5064055440 0x7f5064057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.856+0000 7f508659c700 1 --2- 172.21.15.133:0/303646014 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5064055440 0x7f5064057900 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f507800c000 tx=0x7f5078008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:47.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:47.864+0000 7f507f7fe700 1 -- 172.21.15.133:0/303646014 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5080044ed0 con 0x7f50881442a0 2021-01-03T13:06:48.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.000+0000 7f508759e700 1 -- 172.21.15.133:0/303646014 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f50880aef00 con 0x7f50881442a0 2021-01-03T13:06:48.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.656+0000 7f507f7fe700 1 -- 172.21.15.133:0/303646014 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v133) v1 ==== 185+0+0 (secure 0 0 0) 0x7f50800240e0 con 0x7f50881442a0 2021-01-03T13:06:48.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.664+0000 7f508759e700 1 -- 172.21.15.133:0/303646014 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5064055440 msgr2=0x7f5064057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:48.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.664+0000 7f508759e700 1 --2- 172.21.15.133:0/303646014 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5064055440 0x7f5064057900 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f507800c000 tx=0x7f5078008040).stop 2021-01-03T13:06:48.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.664+0000 7f508759e700 1 -- 172.21.15.133:0/303646014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50881442a0 msgr2=0x7f50881410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:48.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.664+0000 7f508759e700 1 --2- 172.21.15.133:0/303646014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50881442a0 0x7f50881410e0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f50880ae430 tx=0x7f5080016000).stop 2021-01-03T13:06:48.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.664+0000 7f508759e700 1 -- 172.21.15.133:0/303646014 shutdown_connections 2021-01-03T13:06:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.664+0000 7f508759e700 1 --2- 172.21.15.133:0/303646014 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5064055440 0x7f5064057900 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.664+0000 7f508759e700 1 --2- 172.21.15.133:0/303646014 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f50880b5260 0x7f50880b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.664+0000 7f508759e700 1 --2- 172.21.15.133:0/303646014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50881442a0 0x7f50881410e0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.664+0000 7f508759e700 1 --2- 172.21.15.133:0/303646014 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f50880b5c00 0x7f5088063540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.664+0000 7f508759e700 1 -- 172.21.15.133:0/303646014 >> 172.21.15.133:0/303646014 conn(0x7f508805bdf0 msgr2=0x7f5088142420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.664+0000 7f508759e700 1 -- 172.21.15.133:0/303646014 shutdown_connections 2021-01-03T13:06:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.664+0000 7f508759e700 1 -- 172.21.15.133:0/303646014 wait complete. 2021-01-03T13:06:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2021-01-03T13:06:48.684 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-01-03T13:06:48.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.800+0000 7fa0f9b50700 1 Processor -- start 2021-01-03T13:06:48.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.800+0000 7fa0f9b50700 1 -- start start 2021-01-03T13:06:48.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.800+0000 7fa0f9b50700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0f4140410 0x7fa0f4146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:48.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.800+0000 7fa0f9b50700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa0f41407f0 0x7fa0f4142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:48.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.800+0000 7fa0f9b50700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0f405c500 con 0x7fa0f40b0470 2021-01-03T13:06:48.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.800+0000 7fa0f9b50700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f40b02d0 con 0x7fa0f41407f0 2021-01-03T13:06:48.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.800+0000 7fa0f9b50700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f4146390 con 0x7fa0f4140410 2021-01-03T13:06:48.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.800+0000 7fa0f2ffd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa0f41407f0 0x7fa0f4142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:48.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.800+0000 7fa0f37fe700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0f4140410 0x7fa0f4146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:48.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.800+0000 7fa0f3fff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa0f40b0470 0x7fa0f405bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:38718/0 (socket says 172.21.15.133:38718) 2021-01-03T13:06:48.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.800+0000 7fa0f3fff700 1 -- 172.21.15.133:0/1111256539 learned_addr learned my addr 172.21.15.133:0/1111256539 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:48.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.800+0000 7fa0f37fe700 1 -- 172.21.15.133:0/1111256539 >> v2:172.21.15.16:3300/0 conn(0x7fa0f41407f0 msgr2=0x7fa0f4142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:48.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.800+0000 7fa0f37fe700 1 --2- 172.21.15.133:0/1111256539 >> v2:172.21.15.16:3300/0 conn(0x7fa0f41407f0 0x7fa0f4142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:48.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.800+0000 7fa0f37fe700 1 -- 172.21.15.133:0/1111256539 >> v1:172.21.15.16:6789/0 conn(0x7fa0f40b0470 legacy=0x7fa0f405bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:48.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.800+0000 7fa0f27fc700 1 -- 172.21.15.133:0/1111256539 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166052041 0 0) 0x7fa0f405c500 con 0x7fa0f40b0470 2021-01-03T13:06:48.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.800+0000 7fa0f37fe700 1 -- 172.21.15.133:0/1111256539 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f405cf20 con 0x7fa0f4140410 2021-01-03T13:06:48.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.800+0000 7fa0f2ffd700 1 --2- 172.21.15.133:0/1111256539 >> v2:172.21.15.16:3300/0 conn(0x7fa0f41407f0 0x7fa0f4142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:06:48.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.804+0000 7fa0f37fe700 1 --2- 172.21.15.133:0/1111256539 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0f4140410 0x7fa0f4146cc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fa0dc002f30 tx=0x7fa0dc006dc0).ready entity=mon.2 client_cookie=58cf83ed5c800cd9 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:48.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.804+0000 7fa0f27fc700 1 -- 172.21.15.133:0/1111256539 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0dc009760 con 0x7fa0f4140410 2021-01-03T13:06:48.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.804+0000 7fa0f27fc700 1 -- 172.21.15.133:0/1111256539 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0dc0098c0 con 0x7fa0f4140410 2021-01-03T13:06:48.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.804+0000 7fa0f27fc700 1 -- 172.21.15.133:0/1111256539 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0dc009c20 con 0x7fa0f4140410 2021-01-03T13:06:48.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.804+0000 7fa0f9b50700 1 -- 172.21.15.133:0/1111256539 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0f4140410 msgr2=0x7fa0f4146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:48.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.804+0000 7fa0f9b50700 1 --2- 172.21.15.133:0/1111256539 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0f4140410 0x7fa0f4146cc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fa0dc002f30 tx=0x7fa0dc006dc0).stop 2021-01-03T13:06:48.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.804+0000 7fa0f9b50700 1 -- 172.21.15.133:0/1111256539 shutdown_connections 2021-01-03T13:06:48.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.804+0000 7fa0f9b50700 1 --2- 172.21.15.133:0/1111256539 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0f4140410 0x7fa0f4146cc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:48.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.804+0000 7fa0f9b50700 1 --2- 172.21.15.133:0/1111256539 >> v2:172.21.15.16:3300/0 conn(0x7fa0f41407f0 0x7fa0f4142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:48.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.804+0000 7fa0f9b50700 1 -- 172.21.15.133:0/1111256539 >> 172.21.15.133:0/1111256539 conn(0x7fa0f40b95d0 msgr2=0x7fa0f40b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:48.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.804+0000 7fa0f9b50700 1 -- 172.21.15.133:0/1111256539 shutdown_connections 2021-01-03T13:06:48.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.804+0000 7fa0f9b50700 1 -- 172.21.15.133:0/1111256539 wait complete. 2021-01-03T13:06:48.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.804+0000 7fa0f9b50700 1 Processor -- start 2021-01-03T13:06:48.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.804+0000 7fa0f9b50700 1 -- start start 2021-01-03T13:06:48.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f9b50700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f40b0470 0x7fa0f40b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:48.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f9b50700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0f4140410 0x7fa0f40b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:48.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f9b50700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0f41407f0 0x7fa0f41550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:48.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f9b50700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f41528e0 con 0x7fa0f41407f0 2021-01-03T13:06:48.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f9b50700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f41411b0 con 0x7fa0f40b0470 2021-01-03T13:06:48.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f9b50700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f4141450 con 0x7fa0f4140410 2021-01-03T13:06:48.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f40b0470 0x7fa0f40b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:48.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f40b0470 0x7fa0f40b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38964/0 (socket says 172.21.15.133:38964) 2021-01-03T13:06:48.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f37fe700 1 -- 172.21.15.133:0/2453790112 learned_addr learned my addr 172.21.15.133:0/2453790112 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:48.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f3fff700 1 --2- 172.21.15.133:0/2453790112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0f41407f0 0x7fa0f41550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:48.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f2ffd700 1 --2- 172.21.15.133:0/2453790112 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0f4140410 0x7fa0f40b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:48.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f37fe700 1 -- 172.21.15.133:0/2453790112 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0f4140410 msgr2=0x7fa0f40b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:48.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f37fe700 1 --2- 172.21.15.133:0/2453790112 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0f4140410 0x7fa0f40b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:48.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f37fe700 1 -- 172.21.15.133:0/2453790112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0f41407f0 msgr2=0x7fa0f41550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:48.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f37fe700 1 --2- 172.21.15.133:0/2453790112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0f41407f0 0x7fa0f41550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:48.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f37fe700 1 -- 172.21.15.133:0/2453790112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f4152520 con 0x7fa0f40b0470 2021-01-03T13:06:48.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f37fe700 1 --2- 172.21.15.133:0/2453790112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f40b0470 0x7fa0f40b1880 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7fa0dc002f30 tx=0x7fa0dc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:48.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f0ff9700 1 -- 172.21.15.133:0/2453790112 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0dc011b40 con 0x7fa0f40b0470 2021-01-03T13:06:48.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f0ff9700 1 -- 172.21.15.133:0/2453790112 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0dc011ca0 con 0x7fa0f40b0470 2021-01-03T13:06:48.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f0ff9700 1 -- 172.21.15.133:0/2453790112 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa0dc01d450 con 0x7fa0f40b0470 2021-01-03T13:06:48.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f9b50700 1 -- 172.21.15.133:0/2453790112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f40b2260 con 0x7fa0f40b0470 2021-01-03T13:06:48.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.808+0000 7fa0f9b50700 1 -- 172.21.15.133:0/2453790112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f4143870 con 0x7fa0f40b0470 2021-01-03T13:06:48.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.812+0000 7fa0f9b50700 1 -- 172.21.15.133:0/2453790112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f4152a50 con 0x7fa0f40b0470 2021-01-03T13:06:48.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.812+0000 7fa0f0ff9700 1 -- 172.21.15.133:0/2453790112 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa0dc024030 con 0x7fa0f40b0470 2021-01-03T13:06:48.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.812+0000 7fa0f0ff9700 1 --2- 172.21.15.133:0/2453790112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa0d8055440 0x7fa0d8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:48.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.812+0000 7fa0f0ff9700 1 -- 172.21.15.133:0/2453790112 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fa0dc06ed70 con 0x7fa0f40b0470 2021-01-03T13:06:48.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.812+0000 7fa0f2ffd700 1 --2- 172.21.15.133:0/2453790112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa0d8055440 0x7fa0d8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:48.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.812+0000 7fa0f2ffd700 1 --2- 172.21.15.133:0/2453790112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa0d8055440 0x7fa0d8057900 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7fa0e400b000 tx=0x7fa0e4006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:48.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.816+0000 7fa0f0ff9700 1 -- 172.21.15.133:0/2453790112 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa0dc0451d0 con 0x7fa0f40b0470 2021-01-03T13:06:48.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:48.956+0000 7fa0f9b50700 1 -- 172.21.15.133:0/2453790112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fa0f4057300 con 0x7fa0f40b0470 2021-01-03T13:06:49.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.668+0000 7fa0f0ff9700 1 -- 172.21.15.133:0/2453790112 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v134) v1 ==== 133+0+0 (secure 0 0 0) 0x7fa0dc0487f0 con 0x7fa0f40b0470 2021-01-03T13:06:49.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.676+0000 7fa0f9b50700 1 -- 172.21.15.133:0/2453790112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa0d8055440 msgr2=0x7fa0d8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:49.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.676+0000 7fa0f9b50700 1 --2- 172.21.15.133:0/2453790112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa0d8055440 0x7fa0d8057900 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7fa0e400b000 tx=0x7fa0e4006dc0).stop 2021-01-03T13:06:49.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.676+0000 7fa0f9b50700 1 -- 172.21.15.133:0/2453790112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f40b0470 msgr2=0x7fa0f40b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:49.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.676+0000 7fa0f9b50700 1 --2- 172.21.15.133:0/2453790112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f40b0470 0x7fa0f40b1880 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7fa0dc002f30 tx=0x7fa0dc015000).stop 2021-01-03T13:06:49.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.676+0000 7fa0f9b50700 1 -- 172.21.15.133:0/2453790112 shutdown_connections 2021-01-03T13:06:49.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.676+0000 7fa0f9b50700 1 --2- 172.21.15.133:0/2453790112 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa0d8055440 0x7fa0d8057900 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:49.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.676+0000 7fa0f9b50700 1 --2- 172.21.15.133:0/2453790112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0f41407f0 0x7fa0f41550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:49.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.676+0000 7fa0f9b50700 1 --2- 172.21.15.133:0/2453790112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0f40b0470 0x7fa0f40b1880 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:49.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.676+0000 7fa0f9b50700 1 --2- 172.21.15.133:0/2453790112 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0f4140410 0x7fa0f40b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:49.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.676+0000 7fa0f9b50700 1 -- 172.21.15.133:0/2453790112 >> 172.21.15.133:0/2453790112 conn(0x7fa0f40b95d0 msgr2=0x7fa0f4069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:49.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.676+0000 7fa0f9b50700 1 -- 172.21.15.133:0/2453790112 shutdown_connections 2021-01-03T13:06:49.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.676+0000 7fa0f9b50700 1 -- 172.21.15.133:0/2453790112 wait complete. 2021-01-03T13:06:49.685 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2021-01-03T13:06:49.696 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data 2021-01-03T13:06:49.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f009a39f700 1 Processor -- start 2021-01-03T13:06:49.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f009a39f700 1 -- start start 2021-01-03T13:06:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f009a39f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f009405c670 0x7f00940ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f009a39f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f00940b1a50 0x7f00940a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:49.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f009a39f700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0094140ae0 con 0x7f00940677a0 2021-01-03T13:06:49.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f009a39f700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00940ace10 con 0x7f00940b1a50 2021-01-03T13:06:49.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f009a39f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0094067b80 con 0x7f009405c670 2021-01-03T13:06:49.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f0099b9e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f00940b1a50 0x7f00940a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:49.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f009939d700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f00940677a0 0x7f0094146320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:38732/0 (socket says 172.21.15.133:38732) 2021-01-03T13:06:49.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f009939d700 1 -- 172.21.15.133:0/885118612 learned_addr learned my addr 172.21.15.133:0/885118612 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:49.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f0098b9c700 1 --2- 172.21.15.133:0/885118612 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f009405c670 0x7f00940ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:49.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f0083fff700 1 -- 172.21.15.133:0/885118612 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447285164 0 0) 0x7f0094140ae0 con 0x7f00940677a0 2021-01-03T13:06:49.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f0083fff700 1 -- 172.21.15.133:0/885118612 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f007c003230 con 0x7f00940677a0 2021-01-03T13:06:49.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f0099b9e700 1 -- 172.21.15.133:0/885118612 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f009405c670 msgr2=0x7f00940ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:49.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f0099b9e700 1 --2- 172.21.15.133:0/885118612 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f009405c670 0x7f00940ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f0099b9e700 1 -- 172.21.15.133:0/885118612 >> v1:172.21.15.16:6789/0 conn(0x7f00940677a0 legacy=0x7f0094146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f0099b9e700 1 -- 172.21.15.133:0/885118612 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00940b1560 con 0x7f00940b1a50 2021-01-03T13:06:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f0098b9c700 1 --2- 172.21.15.133:0/885118612 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f009405c670 0x7f00940ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:06:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.808+0000 7f0099b9e700 1 --2- 172.21.15.133:0/885118612 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00940b1a50 0x7f00940a8a80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f008c002f80 tx=0x7f008c006db0).ready entity=mon.0 client_cookie=52ef91ec10ed4de3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.812+0000 7f0083fff700 1 -- 172.21.15.133:0/885118612 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f008c000ea0 con 0x7f00940b1a50 2021-01-03T13:06:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.812+0000 7f0083fff700 1 -- 172.21.15.133:0/885118612 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c0096a0 con 0x7f00940b1a50 2021-01-03T13:06:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.812+0000 7f0083fff700 1 -- 172.21.15.133:0/885118612 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f008c009a00 con 0x7f00940b1a50 2021-01-03T13:06:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.812+0000 7f009a39f700 1 -- 172.21.15.133:0/885118612 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00940b1a50 msgr2=0x7f00940a8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.812+0000 7f009a39f700 1 --2- 172.21.15.133:0/885118612 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00940b1a50 0x7f00940a8a80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f008c002f80 tx=0x7f008c006db0).stop 2021-01-03T13:06:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.812+0000 7f009a39f700 1 -- 172.21.15.133:0/885118612 shutdown_connections 2021-01-03T13:06:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.812+0000 7f009a39f700 1 --2- 172.21.15.133:0/885118612 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f00940b1a50 0x7f00940a8a80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.812+0000 7f009a39f700 1 --2- 172.21.15.133:0/885118612 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f009405c670 0x7f00940ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.812+0000 7f009a39f700 1 -- 172.21.15.133:0/885118612 >> 172.21.15.133:0/885118612 conn(0x7f009406b050 msgr2=0x7f0094060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.812+0000 7f009a39f700 1 -- 172.21.15.133:0/885118612 shutdown_connections 2021-01-03T13:06:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.812+0000 7f009a39f700 1 -- 172.21.15.133:0/885118612 wait complete. 2021-01-03T13:06:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.812+0000 7f009a39f700 1 Processor -- start 2021-01-03T13:06:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.812+0000 7f009a39f700 1 -- start start 2021-01-03T13:06:49.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f009a39f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f009405c670 0x7f00940aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:49.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f009a39f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00940677a0 0x7f0094152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:49.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f009a39f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f00940b1a50 0x7f0094152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:49.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f009a39f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0094151aa0 con 0x7f009405c670 2021-01-03T13:06:49.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f009a39f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0094142f00 con 0x7f00940677a0 2021-01-03T13:06:49.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f009a39f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00941431a0 con 0x7f00940b1a50 2021-01-03T13:06:49.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f0098b9c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00940677a0 0x7f0094152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:49.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f0098b9c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00940677a0 0x7f0094152160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38980/0 (socket says 172.21.15.133:38980) 2021-01-03T13:06:49.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f0098b9c700 1 -- 172.21.15.133:0/955689038 learned_addr learned my addr 172.21.15.133:0/955689038 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f009939d700 1 --2- 172.21.15.133:0/955689038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f009405c670 0x7f00940aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f0099b9e700 1 --2- 172.21.15.133:0/955689038 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f00940b1a50 0x7f0094152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f0098b9c700 1 -- 172.21.15.133:0/955689038 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f00940b1a50 msgr2=0x7f0094152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f0098b9c700 1 --2- 172.21.15.133:0/955689038 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f00940b1a50 0x7f0094152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f0098b9c700 1 -- 172.21.15.133:0/955689038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f009405c670 msgr2=0x7f00940aaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f0098b9c700 1 --2- 172.21.15.133:0/955689038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f009405c670 0x7f00940aaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f0098b9c700 1 -- 172.21.15.133:0/955689038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0094143440 con 0x7f00940677a0 2021-01-03T13:06:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f0098b9c700 1 --2- 172.21.15.133:0/955689038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00940677a0 0x7f0094152160 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f008400c000 tx=0x7f0084006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f00827fc700 1 -- 172.21.15.133:0/955689038 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f008400cb40 con 0x7f00940677a0 2021-01-03T13:06:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f00827fc700 1 -- 172.21.15.133:0/955689038 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008400cca0 con 0x7f00940677a0 2021-01-03T13:06:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f009a39f700 1 -- 172.21.15.133:0/955689038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00940aaf90 con 0x7f00940677a0 2021-01-03T13:06:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f00827fc700 1 -- 172.21.15.133:0/955689038 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00840123f0 con 0x7f00940677a0 2021-01-03T13:06:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.816+0000 7f009a39f700 1 -- 172.21.15.133:0/955689038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00940ac180 con 0x7f00940677a0 2021-01-03T13:06:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.820+0000 7f009a39f700 1 -- 172.21.15.133:0/955689038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0094149f80 con 0x7f00940677a0 2021-01-03T13:06:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.820+0000 7f00827fc700 1 -- 172.21.15.133:0/955689038 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0084012550 con 0x7f00940677a0 2021-01-03T13:06:49.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.820+0000 7f00827fc700 1 --2- 172.21.15.133:0/955689038 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0074055470 0x7f0074057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:49.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.820+0000 7f00827fc700 1 -- 172.21.15.133:0/955689038 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6075+0+0 (secure 0 0 0) 0x7f008406e560 con 0x7f00940677a0 2021-01-03T13:06:49.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.820+0000 7f009939d700 1 --2- 172.21.15.133:0/955689038 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0074055470 0x7f0074057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:49.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.820+0000 7f009939d700 1 --2- 172.21.15.133:0/955689038 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0074055470 0x7f0074057930 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f009000d000 tx=0x7f0090009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:49.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:49.828+0000 7f00827fc700 1 -- 172.21.15.133:0/955689038 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0094149f80 con 0x7f00940677a0 2021-01-03T13:06:50.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.016+0000 7f009a39f700 1 -- 172.21.15.133:0/955689038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0094149f80 con 0x7f00940677a0 2021-01-03T13:06:50.024 INFO:tasks.ceph.mon.b.smithi016.stderr:2021-01-03T13:06:50.020+0000 7fba5a1bf700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-01-03T13:06:50.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.032+0000 7f00827fc700 1 -- 172.21.15.133:0/955689038 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 22 v61) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0094149f80 con 0x7f00940677a0 2021-01-03T13:06:50.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.036+0000 7f009a39f700 1 -- 172.21.15.133:0/955689038 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0074055470 msgr2=0x7f0074057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:50.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.036+0000 7f009a39f700 1 --2- 172.21.15.133:0/955689038 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0074055470 0x7f0074057930 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f009000d000 tx=0x7f0090009040).stop 2021-01-03T13:06:50.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.036+0000 7f009a39f700 1 -- 172.21.15.133:0/955689038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00940677a0 msgr2=0x7f0094152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:50.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.036+0000 7f009a39f700 1 --2- 172.21.15.133:0/955689038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00940677a0 0x7f0094152160 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f008400c000 tx=0x7f0084006dc0).stop 2021-01-03T13:06:50.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.036+0000 7f009a39f700 1 -- 172.21.15.133:0/955689038 shutdown_connections 2021-01-03T13:06:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.036+0000 7f009a39f700 1 --2- 172.21.15.133:0/955689038 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0074055470 0x7f0074057930 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.036+0000 7f009a39f700 1 --2- 172.21.15.133:0/955689038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f009405c670 0x7f00940aaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.036+0000 7f009a39f700 1 --2- 172.21.15.133:0/955689038 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f00940b1a50 0x7f0094152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.036+0000 7f009a39f700 1 --2- 172.21.15.133:0/955689038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f00940677a0 0x7f0094152160 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.036+0000 7f009a39f700 1 -- 172.21.15.133:0/955689038 >> 172.21.15.133:0/955689038 conn(0x7f009406b050 msgr2=0x7f00940af480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.036+0000 7f009a39f700 1 -- 172.21.15.133:0/955689038 shutdown_connections 2021-01-03T13:06:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.036+0000 7f009a39f700 1 -- 172.21.15.133:0/955689038 wait complete. 2021-01-03T13:06:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 24 and data pool 22 2021-01-03T13:06:50.054 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:06:50.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:06:50.073 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:06:50.088 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:06:50.106 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:06:50.123 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:06:50.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:50.125 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:50.125 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:50.132 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-03T13:06:50.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:06:50.133 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-01-03T13:06:50.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:06:50.135 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:50.183 INFO:teuthology.orchestra.run.smithi007.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-03T13:06:50.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:06:50.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:50.185 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:50.185 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:50.192 INFO:teuthology.orchestra.run.smithi036.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:06:50.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:06:50.194 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-01-03T13:06:50.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:06:50.195 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:50.240 INFO:teuthology.orchestra.run.smithi036.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:06:50.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:06:50.241 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-01-03T13:06:50.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.356+0000 7feaf98b2700 1 Processor -- start 2021-01-03T13:06:50.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.356+0000 7feaf98b2700 1 -- start start 2021-01-03T13:06:50.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.356+0000 7feaf98b2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feaf40af780 0x7feaf40b1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:50.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.356+0000 7feaf98b2700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf40b2780 con 0x7feaf41406b0 2021-01-03T13:06:50.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.356+0000 7feaf98b2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf40b1710 con 0x7feaf40b23a0 2021-01-03T13:06:50.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.356+0000 7feaf98b2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf40aef00 con 0x7feaf40af780 2021-01-03T13:06:50.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.356+0000 7feaf88b0700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feaf40b23a0 0x7feaf4066fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60018/0 (socket says 172.21.15.133:60018) 2021-01-03T13:06:50.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.356+0000 7feaf88b0700 1 -- 172.21.15.133:0/4155742126 learned_addr learned my addr 172.21.15.133:0/4155742126 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:50.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.356+0000 7feaf90b1700 1 --2- 172.21.15.133:0/4155742126 >> v2:172.21.15.133:3300/0 conn(0x7feaf40af780 0x7feaf40b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:50.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.360+0000 7feaf90b1700 1 -- 172.21.15.133:0/4155742126 >> v1:172.21.15.133:6789/0 conn(0x7feaf40b23a0 legacy=0x7feaf4066fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:50.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.360+0000 7feaf90b1700 1 -- 172.21.15.133:0/4155742126 >> v1:172.21.15.16:6789/0 conn(0x7feaf41406b0 legacy=0x7feaf40676c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:50.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.360+0000 7feaf37fe700 1 -- 172.21.15.133:0/4155742126 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828358968 0 0) 0x7feaf40b1710 con 0x7feaf40b23a0 2021-01-03T13:06:50.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.360+0000 7feaf90b1700 1 -- 172.21.15.133:0/4155742126 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf40a9480 con 0x7feaf40af780 2021-01-03T13:06:50.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.360+0000 7feaf90b1700 1 --2- 172.21.15.133:0/4155742126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaf40af780 0x7feaf40b1220 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7feaec0032b0 tx=0x7feaec0091a0).ready entity=mon.1 client_cookie=ee5378a99ae36418 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.360+0000 7feaf37fe700 1 -- 172.21.15.133:0/4155742126 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feaec00ba50 con 0x7feaf40af780 2021-01-03T13:06:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.360+0000 7feaf37fe700 1 -- 172.21.15.133:0/4155742126 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaec00bbb0 con 0x7feaf40af780 2021-01-03T13:06:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.360+0000 7feaf37fe700 1 -- 172.21.15.133:0/4155742126 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feaec00bd20 con 0x7feaf40af780 2021-01-03T13:06:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.360+0000 7feaf98b2700 1 -- 172.21.15.133:0/4155742126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaf40af780 msgr2=0x7feaf40b1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:50.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.360+0000 7feaf98b2700 1 --2- 172.21.15.133:0/4155742126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaf40af780 0x7feaf40b1220 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7feaec0032b0 tx=0x7feaec0091a0).stop 2021-01-03T13:06:50.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.360+0000 7feaf98b2700 1 -- 172.21.15.133:0/4155742126 shutdown_connections 2021-01-03T13:06:50.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.360+0000 7feaf98b2700 1 --2- 172.21.15.133:0/4155742126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaf40af780 0x7feaf40b1220 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:50.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.360+0000 7feaf98b2700 1 -- 172.21.15.133:0/4155742126 >> 172.21.15.133:0/4155742126 conn(0x7feaf406b050 msgr2=0x7feaf4060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:50.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.360+0000 7feaf98b2700 1 -- 172.21.15.133:0/4155742126 shutdown_connections 2021-01-03T13:06:50.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.360+0000 7feaf98b2700 1 -- 172.21.15.133:0/4155742126 wait complete. 2021-01-03T13:06:50.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.360+0000 7feaf98b2700 1 Processor -- start 2021-01-03T13:06:50.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.360+0000 7feaf98b2700 1 -- start start 2021-01-03T13:06:50.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf98b2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaf40af780 0x7feaf4145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf98b2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feaf40b23a0 0x7feaf4140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf98b2700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaf41406b0 0x7feaf41412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf98b2700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf413da60 con 0x7feaf41406b0 2021-01-03T13:06:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf98b2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf413f1d0 con 0x7feaf40af780 2021-01-03T13:06:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf98b2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf413f470 con 0x7feaf40b23a0 2021-01-03T13:06:50.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf88b0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaf40af780 0x7feaf4145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:50.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf88b0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaf40af780 0x7feaf4145790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38992/0 (socket says 172.21.15.133:38992) 2021-01-03T13:06:50.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf88b0700 1 -- 172.21.15.133:0/3884553986 learned_addr learned my addr 172.21.15.133:0/3884553986 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:50.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf3fff700 1 --2- 172.21.15.133:0/3884553986 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feaf40b23a0 0x7feaf4140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:50.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf90b1700 1 --2- 172.21.15.133:0/3884553986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaf41406b0 0x7feaf41412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:50.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf88b0700 1 -- 172.21.15.133:0/3884553986 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feaf40b23a0 msgr2=0x7feaf4140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:50.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf88b0700 1 --2- 172.21.15.133:0/3884553986 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feaf40b23a0 0x7feaf4140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:50.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf88b0700 1 -- 172.21.15.133:0/3884553986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaf41406b0 msgr2=0x7feaf41412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:50.375 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf88b0700 1 --2- 172.21.15.133:0/3884553986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaf41406b0 0x7feaf41412a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf88b0700 1 -- 172.21.15.133:0/3884553986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf4143760 con 0x7feaf40af780 2021-01-03T13:06:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf88b0700 1 --2- 172.21.15.133:0/3884553986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaf40af780 0x7feaf4145790 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7feae8000e90 tx=0x7feae8007a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf1ffb700 1 -- 172.21.15.133:0/3884553986 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae8007320 con 0x7feaf40af780 2021-01-03T13:06:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf1ffb700 1 -- 172.21.15.133:0/3884553986 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae8007480 con 0x7feaf40af780 2021-01-03T13:06:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf98b2700 1 -- 172.21.15.133:0/3884553986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf4143c00 con 0x7feaf40af780 2021-01-03T13:06:50.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf1ffb700 1 -- 172.21.15.133:0/3884553986 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feae80057d0 con 0x7feaf40af780 2021-01-03T13:06:50.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf98b2700 1 -- 172.21.15.133:0/3884553986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf4142100 con 0x7feaf40af780 2021-01-03T13:06:50.377 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.364+0000 7feaf98b2700 1 -- 172.21.15.133:0/3884553986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf413e9e0 con 0x7feaf40af780 2021-01-03T13:06:50.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.368+0000 7feaf1ffb700 1 -- 172.21.15.133:0/3884553986 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7feae8010030 con 0x7feaf40af780 2021-01-03T13:06:50.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.368+0000 7feaf1ffb700 1 --2- 172.21.15.133:0/3884553986 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feadc0553b0 0x7feadc057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:50.379 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.368+0000 7feaf1ffb700 1 -- 172.21.15.133:0/3884553986 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7feae806de60 con 0x7feaf40af780 2021-01-03T13:06:50.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.368+0000 7feaf3fff700 1 --2- 172.21.15.133:0/3884553986 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feadc0553b0 0x7feadc057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:50.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.368+0000 7feaf3fff700 1 --2- 172.21.15.133:0/3884553986 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feadc0553b0 0x7feadc057870 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7feae000b000 tx=0x7feae0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:50.380 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.372+0000 7feaf1ffb700 1 -- 172.21.15.133:0/3884553986 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7feaf413e9e0 con 0x7feaf40af780 2021-01-03T13:06:50.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.512+0000 7feaf98b2700 1 -- 172.21.15.133:0/3884553986 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7feaf413e9e0 con 0x7feaf40af780 2021-01-03T13:06:50.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.524+0000 7feaf1ffb700 1 -- 172.21.15.133:0/3884553986 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7feaf413e9e0 con 0x7feaf40af780 2021-01-03T13:06:50.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.524+0000 7feaf98b2700 1 -- 172.21.15.133:0/3884553986 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feadc0553b0 msgr2=0x7feadc057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:50.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.524+0000 7feaf98b2700 1 --2- 172.21.15.133:0/3884553986 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feadc0553b0 0x7feadc057870 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7feae000b000 tx=0x7feae0009040).stop 2021-01-03T13:06:50.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.524+0000 7feaf98b2700 1 -- 172.21.15.133:0/3884553986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaf40af780 msgr2=0x7feaf4145790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:50.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.524+0000 7feaf98b2700 1 --2- 172.21.15.133:0/3884553986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaf40af780 0x7feaf4145790 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7feae8000e90 tx=0x7feae8007a90).stop 2021-01-03T13:06:50.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.524+0000 7feaf98b2700 1 -- 172.21.15.133:0/3884553986 shutdown_connections 2021-01-03T13:06:50.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.524+0000 7feaf98b2700 1 --2- 172.21.15.133:0/3884553986 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feadc0553b0 0x7feadc057870 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:50.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.524+0000 7feaf98b2700 1 --2- 172.21.15.133:0/3884553986 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaf41406b0 0x7feaf41412a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:50.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.524+0000 7feaf98b2700 1 --2- 172.21.15.133:0/3884553986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feaf40af780 0x7feaf4145790 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:50.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.524+0000 7feaf98b2700 1 --2- 172.21.15.133:0/3884553986 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feaf40b23a0 0x7feaf4140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:50.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.524+0000 7feaf98b2700 1 -- 172.21.15.133:0/3884553986 >> 172.21.15.133:0/3884553986 conn(0x7feaf406b050 msgr2=0x7feaf40b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:50.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.524+0000 7feaf98b2700 1 -- 172.21.15.133:0/3884553986 shutdown_connections 2021-01-03T13:06:50.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.524+0000 7feaf98b2700 1 -- 172.21.15.133:0/3884553986 wait complete. 2021-01-03T13:06:50.546 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2021-01-03T13:06:50.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d392dd700 1 Processor -- start 2021-01-03T13:06:50.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d392dd700 1 -- start start 2021-01-03T13:06:50.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d392dd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d3405c130 0x7f8d341437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d392dd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8d340b02d0 0x7f8d34146a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d392dd700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3405c510 con 0x7f8d3405cc10 2021-01-03T13:06:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d392dd700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d340b0780 con 0x7f8d340b02d0 2021-01-03T13:06:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d392dd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d340b5c10 con 0x7f8d3405c130 2021-01-03T13:06:50.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d32ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d3405c130 0x7f8d341437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:50.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d32ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d3405c130 0x7f8d341437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39000/0 (socket says 172.21.15.133:39000) 2021-01-03T13:06:50.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d32ffd700 1 -- 172.21.15.133:0/221676949 learned_addr learned my addr 172.21.15.133:0/221676949 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:50.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d337fe700 1 --2- 172.21.15.133:0/221676949 >> v2:172.21.15.16:3300/0 conn(0x7f8d340b02d0 0x7f8d34146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:50.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d32ffd700 1 -- 172.21.15.133:0/221676949 >> v2:172.21.15.16:3300/0 conn(0x7f8d340b02d0 msgr2=0x7f8d34146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:50.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d32ffd700 1 --2- 172.21.15.133:0/221676949 >> v2:172.21.15.16:3300/0 conn(0x7f8d340b02d0 0x7f8d34146a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:50.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d32ffd700 1 -- 172.21.15.133:0/221676949 >> v1:172.21.15.16:6789/0 conn(0x7f8d3405cc10 legacy=0x7f8d34146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:50.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d32ffd700 1 -- 172.21.15.133:0/221676949 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d340af8f0 con 0x7f8d3405c130 2021-01-03T13:06:50.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d32ffd700 1 --2- 172.21.15.133:0/221676949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3405c130 0x7f8d341437e0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f8d240032b0 tx=0x7f8d24009270).ready entity=mon.1 client_cookie=402785d0c4e7a82c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:50.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d31ffb700 1 -- 172.21.15.133:0/221676949 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d2400bc00 con 0x7f8d3405c130 2021-01-03T13:06:50.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d31ffb700 1 -- 172.21.15.133:0/221676949 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2400bd60 con 0x7f8d3405c130 2021-01-03T13:06:50.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d31ffb700 1 -- 172.21.15.133:0/221676949 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d24011400 con 0x7f8d3405c130 2021-01-03T13:06:50.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d392dd700 1 -- 172.21.15.133:0/221676949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3405c130 msgr2=0x7f8d341437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:50.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.652+0000 7f8d392dd700 1 --2- 172.21.15.133:0/221676949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3405c130 0x7f8d341437e0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f8d240032b0 tx=0x7f8d24009270).stop 2021-01-03T13:06:50.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d392dd700 1 -- 172.21.15.133:0/221676949 shutdown_connections 2021-01-03T13:06:50.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d392dd700 1 --2- 172.21.15.133:0/221676949 >> v2:172.21.15.16:3300/0 conn(0x7f8d340b02d0 0x7f8d34146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:50.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d392dd700 1 --2- 172.21.15.133:0/221676949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3405c130 0x7f8d341437e0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:50.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d392dd700 1 -- 172.21.15.133:0/221676949 >> 172.21.15.133:0/221676949 conn(0x7f8d340b95d0 msgr2=0x7f8d340b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:50.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d392dd700 1 -- 172.21.15.133:0/221676949 shutdown_connections 2021-01-03T13:06:50.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d392dd700 1 -- 172.21.15.133:0/221676949 wait complete. 2021-01-03T13:06:50.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d392dd700 1 Processor -- start 2021-01-03T13:06:50.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d392dd700 1 -- start start 2021-01-03T13:06:50.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d392dd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d3405c130 0x7f8d340b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:50.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d392dd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3405cc10 0x7f8d3409d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:50.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d392dd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d340b02d0 0x7f8d3409dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d392dd700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3409d550 con 0x7f8d340b02d0 2021-01-03T13:06:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d392dd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d34142ae0 con 0x7f8d3405cc10 2021-01-03T13:06:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d392dd700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3409ce10 con 0x7f8d3405c130 2021-01-03T13:06:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d327fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3405cc10 0x7f8d3409d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d327fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3405cc10 0x7f8d3409d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39008/0 (socket says 172.21.15.133:39008) 2021-01-03T13:06:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d327fc700 1 -- 172.21.15.133:0/2542451185 learned_addr learned my addr 172.21.15.133:0/2542451185 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.656+0000 7f8d32ffd700 1 --2- 172.21.15.133:0/2542451185 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d3405c130 0x7f8d340b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.660+0000 7f8d337fe700 1 --2- 172.21.15.133:0/2542451185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d340b02d0 0x7f8d3409dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.660+0000 7f8d327fc700 1 -- 172.21.15.133:0/2542451185 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d3405c130 msgr2=0x7f8d340b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.660+0000 7f8d327fc700 1 --2- 172.21.15.133:0/2542451185 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d3405c130 0x7f8d340b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.660+0000 7f8d327fc700 1 -- 172.21.15.133:0/2542451185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d340b02d0 msgr2=0x7f8d3409dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.660+0000 7f8d327fc700 1 --2- 172.21.15.133:0/2542451185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d340b02d0 0x7f8d3409dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.660+0000 7f8d327fc700 1 -- 172.21.15.133:0/2542451185 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3409d0b0 con 0x7f8d3405cc10 2021-01-03T13:06:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.660+0000 7f8d327fc700 1 --2- 172.21.15.133:0/2542451185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3405cc10 0x7f8d3409d880 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f8d34142a00 tx=0x7f8d28007bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:50.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.660+0000 7f8d23fff700 1 -- 172.21.15.133:0/2542451185 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d28013410 con 0x7f8d3405cc10 2021-01-03T13:06:50.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.660+0000 7f8d23fff700 1 -- 172.21.15.133:0/2542451185 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d28013570 con 0x7f8d3405cc10 2021-01-03T13:06:50.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.660+0000 7f8d23fff700 1 -- 172.21.15.133:0/2542451185 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d280138d0 con 0x7f8d3405cc10 2021-01-03T13:06:50.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.660+0000 7f8d392dd700 1 -- 172.21.15.133:0/2542451185 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d340b54c0 con 0x7f8d3405cc10 2021-01-03T13:06:50.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.660+0000 7f8d392dd700 1 -- 172.21.15.133:0/2542451185 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3409c130 con 0x7f8d3405cc10 2021-01-03T13:06:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.660+0000 7f8d392dd700 1 -- 172.21.15.133:0/2542451185 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d3409d240 con 0x7f8d3405cc10 2021-01-03T13:06:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.660+0000 7f8d23fff700 1 -- 172.21.15.133:0/2542451185 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8d28010030 con 0x7f8d3405cc10 2021-01-03T13:06:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.660+0000 7f8d23fff700 1 --2- 172.21.15.133:0/2542451185 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d10055330 0x7f8d100577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.660+0000 7f8d23fff700 1 -- 172.21.15.133:0/2542451185 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8d2806dd10 con 0x7f8d3405cc10 2021-01-03T13:06:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.660+0000 7f8d32ffd700 1 --2- 172.21.15.133:0/2542451185 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d10055330 0x7f8d100577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.664+0000 7f8d32ffd700 1 --2- 172.21.15.133:0/2542451185 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d10055330 0x7f8d100577f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f8d2401a000 tx=0x7f8d24016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.668+0000 7f8d23fff700 1 -- 172.21.15.133:0/2542451185 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8d28043fc0 con 0x7f8d3405cc10 2021-01-03T13:06:50.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:50.860+0000 7f8d392dd700 1 -- 172.21.15.133:0/2542451185 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7f8d34057300 con 0x7f8d3405cc10 2021-01-03T13:06:51.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.680+0000 7f8d23fff700 1 -- 172.21.15.133:0/2542451185 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v403) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8d280475e0 con 0x7f8d3405cc10 2021-01-03T13:06:51.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.680+0000 7f8d392dd700 1 -- 172.21.15.133:0/2542451185 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d10055330 msgr2=0x7f8d100577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:51.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.680+0000 7f8d392dd700 1 --2- 172.21.15.133:0/2542451185 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d10055330 0x7f8d100577f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f8d2401a000 tx=0x7f8d24016000).stop 2021-01-03T13:06:51.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.680+0000 7f8d392dd700 1 -- 172.21.15.133:0/2542451185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3405cc10 msgr2=0x7f8d3409d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:51.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.680+0000 7f8d392dd700 1 --2- 172.21.15.133:0/2542451185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3405cc10 0x7f8d3409d880 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f8d34142a00 tx=0x7f8d28007bf0).stop 2021-01-03T13:06:51.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.680+0000 7f8d392dd700 1 -- 172.21.15.133:0/2542451185 shutdown_connections 2021-01-03T13:06:51.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.680+0000 7f8d392dd700 1 --2- 172.21.15.133:0/2542451185 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8d10055330 0x7f8d100577f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:51.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.680+0000 7f8d392dd700 1 --2- 172.21.15.133:0/2542451185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8d340b02d0 0x7f8d3409dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:51.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.680+0000 7f8d392dd700 1 --2- 172.21.15.133:0/2542451185 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8d3405c130 0x7f8d340b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:51.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.680+0000 7f8d392dd700 1 --2- 172.21.15.133:0/2542451185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3405cc10 0x7f8d3409d880 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:51.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.680+0000 7f8d392dd700 1 -- 172.21.15.133:0/2542451185 >> 172.21.15.133:0/2542451185 conn(0x7f8d340b95d0 msgr2=0x7f8d34144890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:51.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.680+0000 7f8d392dd700 1 -- 172.21.15.133:0/2542451185 shutdown_connections 2021-01-03T13:06:51.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.684+0000 7f8d392dd700 1 -- 172.21.15.133:0/2542451185 wait complete. 2021-01-03T13:06:51.706 INFO:tasks.cephfs_test_runner:test_fs_new (tasks.cephfs.test_misc.TestMisc) ... ok 2021-01-03T13:06:51.706 INFO:tasks.cephfs_test_runner:Starting test: test_getattr_caps (tasks.cephfs.test_misc.TestMisc) 2021-01-03T13:06:51.707 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-01-03T13:06:51.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.816+0000 7f22d9d50700 1 Processor -- start 2021-01-03T13:06:51.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.816+0000 7f22d9d50700 1 -- start start 2021-01-03T13:06:51.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d9d50700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22d40b5750 0x7f22d40b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:51.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d9d50700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d414a570 con 0x7f22d40b9b60 2021-01-03T13:06:51.827 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d9d50700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d40604b0 con 0x7f22d405ff30 2021-01-03T13:06:51.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d9d50700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d414a7a0 con 0x7f22d40b5750 2021-01-03T13:06:51.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d954f700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f22d405ff30 0x7f22d4147020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60050/0 (socket says 172.21.15.133:60050) 2021-01-03T13:06:51.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d954f700 1 -- 172.21.15.133:0/4199045208 learned_addr learned my addr 172.21.15.133:0/4199045208 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:51.828 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d3fff700 1 --2- 172.21.15.133:0/4199045208 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22d40b5750 0x7f22d40b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:51.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 -- 172.21.15.133:0/4199045208 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868760140 0 0) 0x7f22d40604b0 con 0x7f22d405ff30 2021-01-03T13:06:51.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 -- 172.21.15.133:0/4199045208 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22c0003230 con 0x7f22d405ff30 2021-01-03T13:06:51.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 -- 172.21.15.133:0/4199045208 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122075988 0 0) 0x7f22d414a570 con 0x7f22d40b9b60 2021-01-03T13:06:51.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 -- 172.21.15.133:0/4199045208 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22d40604b0 con 0x7f22d40b9b60 2021-01-03T13:06:51.829 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 -- 172.21.15.133:0/4199045208 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1645050540 0 0) 0x7f22c0003230 con 0x7f22d405ff30 2021-01-03T13:06:51.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 -- 172.21.15.133:0/4199045208 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22d40b5750 msgr2=0x7f22d40b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:51.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 --2- 172.21.15.133:0/4199045208 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22d40b5750 0x7f22d40b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:51.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 -- 172.21.15.133:0/4199045208 >> v1:172.21.15.16:6789/0 conn(0x7f22d40b9b60 legacy=0x7f22d414aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:51.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 -- 172.21.15.133:0/4199045208 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d414aa40 con 0x7f22d405ff30 2021-01-03T13:06:51.830 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 -- 172.21.15.133:0/4199045208 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f22cc001a50 con 0x7f22d405ff30 2021-01-03T13:06:51.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 -- 172.21.15.133:0/4199045208 >> v1:172.21.15.133:6789/0 conn(0x7f22d405ff30 legacy=0x7f22d4147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:51.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 --2- 172.21.15.133:0/4199045208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22c00038b0 0x7f22c0003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:51.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 --2- 172.21.15.133:0/4199045208 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22c00044d0 0x7f22c0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:51.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 --2- 172.21.15.133:0/4199045208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22c0004e40 0x7f22c000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:51.831 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 -- 172.21.15.133:0/4199045208 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d414a7a0 con 0x7f22c00038b0 2021-01-03T13:06:51.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 -- 172.21.15.133:0/4199045208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c00052c0 con 0x7f22c0004e40 2021-01-03T13:06:51.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 -- 172.21.15.133:0/4199045208 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c000bc10 con 0x7f22c00044d0 2021-01-03T13:06:51.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d3fff700 1 --2- 172.21.15.133:0/4199045208 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22d40b5750 0x7f22d40b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:06:51.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d954f700 1 --2- 172.21.15.133:0/4199045208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22c0004e40 0x7f22c000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:51.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d8d4e700 1 --2- 172.21.15.133:0/4199045208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22c00038b0 0x7f22c0003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:51.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d3fff700 1 --2- 172.21.15.133:0/4199045208 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22c00044d0 0x7f22c0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:51.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d954f700 1 -- 172.21.15.133:0/4199045208 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22c00044d0 msgr2=0x7f22c0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:51.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d954f700 1 --2- 172.21.15.133:0/4199045208 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22c00044d0 0x7f22c0004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:51.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d954f700 1 -- 172.21.15.133:0/4199045208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22c00038b0 msgr2=0x7f22c0003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:51.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d954f700 1 --2- 172.21.15.133:0/4199045208 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22c00038b0 0x7f22c0003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:51.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d954f700 1 -- 172.21.15.133:0/4199045208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c0003230 con 0x7f22c0004e40 2021-01-03T13:06:51.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d954f700 1 --2- 172.21.15.133:0/4199045208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22c0004e40 0x7f22c000b720 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f22c0004440 tx=0x7f22d4060750).ready entity=mon.1 client_cookie=31d3720d1a7c552a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:51.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 -- 172.21.15.133:0/4199045208 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22cc005b70 con 0x7f22c0004e40 2021-01-03T13:06:51.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 -- 172.21.15.133:0/4199045208 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22cc005cd0 con 0x7f22c0004e40 2021-01-03T13:06:51.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d37fe700 1 -- 172.21.15.133:0/4199045208 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22cc0072c0 con 0x7f22c0004e40 2021-01-03T13:06:51.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d9d50700 1 -- 172.21.15.133:0/4199045208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22c0004e40 msgr2=0x7f22c000b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:51.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d9d50700 1 --2- 172.21.15.133:0/4199045208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22c0004e40 0x7f22c000b720 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f22c0004440 tx=0x7f22d4060750).stop 2021-01-03T13:06:51.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.820+0000 7f22d954f700 1 -- 172.21.15.133:0/4199045208 reap_dead start 2021-01-03T13:06:51.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d9d50700 1 -- 172.21.15.133:0/4199045208 shutdown_connections 2021-01-03T13:06:51.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d9d50700 1 -- 172.21.15.133:0/4199045208 >> 172.21.15.133:0/4199045208 conn(0x7f22d40b69e0 msgr2=0x7f22d40b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:51.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d9d50700 1 -- 172.21.15.133:0/4199045208 shutdown_connections 2021-01-03T13:06:51.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d9d50700 1 -- 172.21.15.133:0/4199045208 wait complete. 2021-01-03T13:06:51.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d9d50700 1 Processor -- start 2021-01-03T13:06:51.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d9d50700 1 -- start start 2021-01-03T13:06:51.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d9d50700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d41494c0 0x7f22d40649e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:51.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d9d50700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22d409dbb0 0x7f22d4064ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:51.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d9d50700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22d4159870 0x7f22d4159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:51.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d9d50700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d40b5000 con 0x7f22d41494c0 2021-01-03T13:06:51.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d9d50700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d409e270 con 0x7f22d4159870 2021-01-03T13:06:51.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d9d50700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d41498a0 con 0x7f22d409dbb0 2021-01-03T13:06:51.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d954f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22d4159870 0x7f22d4159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:51.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d954f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22d4159870 0x7f22d4159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39030/0 (socket says 172.21.15.133:39030) 2021-01-03T13:06:51.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d954f700 1 -- 172.21.15.133:0/2223793093 learned_addr learned my addr 172.21.15.133:0/2223793093 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:51.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d3fff700 1 --2- 172.21.15.133:0/2223793093 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22d409dbb0 0x7f22d4064ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:51.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d8d4e700 1 --2- 172.21.15.133:0/2223793093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d41494c0 0x7f22d40649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:51.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d954f700 1 -- 172.21.15.133:0/2223793093 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22d409dbb0 msgr2=0x7f22d4064ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:51.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d954f700 1 --2- 172.21.15.133:0/2223793093 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22d409dbb0 0x7f22d4064ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:51.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d954f700 1 -- 172.21.15.133:0/2223793093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d41494c0 msgr2=0x7f22d40649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:51.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d954f700 1 --2- 172.21.15.133:0/2223793093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d41494c0 0x7f22d40649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:51.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d954f700 1 -- 172.21.15.133:0/2223793093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d409afe0 con 0x7f22d4159870 2021-01-03T13:06:51.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d954f700 1 --2- 172.21.15.133:0/2223793093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22d4159870 0x7f22d4159cf0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f22d409da00 tx=0x7f22cc013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:51.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d1ffb700 1 -- 172.21.15.133:0/2223793093 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22cc01a070 con 0x7f22d4159870 2021-01-03T13:06:51.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.824+0000 7f22d1ffb700 1 -- 172.21.15.133:0/2223793093 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22cc013640 con 0x7f22d4159870 2021-01-03T13:06:51.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.828+0000 7f22d9d50700 1 -- 172.21.15.133:0/2223793093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d409d140 con 0x7f22d4159870 2021-01-03T13:06:51.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.828+0000 7f22d1ffb700 1 -- 172.21.15.133:0/2223793093 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22cc0139e0 con 0x7f22d4159870 2021-01-03T13:06:51.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.828+0000 7f22d9d50700 1 -- 172.21.15.133:0/2223793093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d409ad10 con 0x7f22d4159870 2021-01-03T13:06:51.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.828+0000 7f22d1ffb700 1 -- 172.21.15.133:0/2223793093 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f22cc026070 con 0x7f22d4159870 2021-01-03T13:06:51.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.828+0000 7f22d9d50700 1 -- 172.21.15.133:0/2223793093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d4057300 con 0x7f22d4159870 2021-01-03T13:06:51.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.828+0000 7f22d1ffb700 1 --2- 172.21.15.133:0/2223793093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22b4055500 0x7f22b40579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:51.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.828+0000 7f22d1ffb700 1 -- 172.21.15.133:0/2223793093 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f22cc06e670 con 0x7f22d4159870 2021-01-03T13:06:51.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.828+0000 7f22d8d4e700 1 --2- 172.21.15.133:0/2223793093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22b4055500 0x7f22b40579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:51.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.828+0000 7f22d8d4e700 1 --2- 172.21.15.133:0/2223793093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22b4055500 0x7f22b40579c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f22c4009000 tx=0x7f22c4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:51.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:51.836+0000 7f22d1ffb700 1 -- 172.21.15.133:0/2223793093 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f22cc044920 con 0x7f22d4159870 2021-01-03T13:06:52.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.024+0000 7f22d9d50700 1 -- 172.21.15.133:0/2223793093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f22d40ae9f0 con 0x7f22d4159870 2021-01-03T13:06:52.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.680+0000 7f22d1ffb700 1 -- 172.21.15.133:0/2223793093 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v404) v1 ==== 131+0+0 (secure 0 0 0) 0x7f22cc017070 con 0x7f22d4159870 2021-01-03T13:06:52.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.684+0000 7f22d9d50700 1 -- 172.21.15.133:0/2223793093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22b4055500 msgr2=0x7f22b40579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:52.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.684+0000 7f22d9d50700 1 --2- 172.21.15.133:0/2223793093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22b4055500 0x7f22b40579c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f22c4009000 tx=0x7f22c4009040).stop 2021-01-03T13:06:52.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.684+0000 7f22d9d50700 1 -- 172.21.15.133:0/2223793093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22d4159870 msgr2=0x7f22d4159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:52.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.684+0000 7f22d9d50700 1 --2- 172.21.15.133:0/2223793093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22d4159870 0x7f22d4159cf0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f22d409da00 tx=0x7f22cc013000).stop 2021-01-03T13:06:52.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.684+0000 7f22d9d50700 1 -- 172.21.15.133:0/2223793093 shutdown_connections 2021-01-03T13:06:52.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.684+0000 7f22d9d50700 1 --2- 172.21.15.133:0/2223793093 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22b4055500 0x7f22b40579c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:52.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.684+0000 7f22d9d50700 1 --2- 172.21.15.133:0/2223793093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22d41494c0 0x7f22d40649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:52.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.684+0000 7f22d9d50700 1 --2- 172.21.15.133:0/2223793093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22d4159870 0x7f22d4159cf0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:52.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.684+0000 7f22d9d50700 1 --2- 172.21.15.133:0/2223793093 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22d409dbb0 0x7f22d4064ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:52.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.684+0000 7f22d9d50700 1 -- 172.21.15.133:0/2223793093 >> 172.21.15.133:0/2223793093 conn(0x7f22d40b69e0 msgr2=0x7f22d40b7880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:52.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.684+0000 7f22d9d50700 1 -- 172.21.15.133:0/2223793093 shutdown_connections 2021-01-03T13:06:52.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.684+0000 7f22d9d50700 1 -- 172.21.15.133:0/2223793093 wait complete. 2021-01-03T13:06:52.706 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-01-03T13:06:52.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3be1073700 1 Processor -- start 2021-01-03T13:06:52.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3be1073700 1 -- start start 2021-01-03T13:06:52.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3be1073700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3bdc05f920 0x7f3bdc0b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:52.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3be1073700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bdc05fd00 con 0x7f3bdc0b1590 2021-01-03T13:06:52.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3be1073700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bdc0accd0 con 0x7f3bdc066f30 2021-01-03T13:06:52.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3be1073700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0b2980 con 0x7f3bdc05f920 2021-01-03T13:06:52.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdb7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3bdc066f30 0x7f3bdc0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60068/0 (socket says 172.21.15.133:60068) 2021-01-03T13:06:52.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdb7fe700 1 -- 172.21.15.133:0/2549880386 learned_addr learned my addr 172.21.15.133:0/2549880386 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:52.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdbfff700 1 --2- 172.21.15.133:0/2549880386 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3bdc05f920 0x7f3bdc0b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:52.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdaffd700 1 -- 172.21.15.133:0/2549880386 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194858169 0 0) 0x7f3bdc0accd0 con 0x7f3bdc066f30 2021-01-03T13:06:52.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdaffd700 1 -- 172.21.15.133:0/2549880386 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bbc003230 con 0x7f3bdc066f30 2021-01-03T13:06:52.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdaffd700 1 -- 172.21.15.133:0/2549880386 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2842704207 0 0) 0x7f3bbc003230 con 0x7f3bdc066f30 2021-01-03T13:06:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdaffd700 1 -- 172.21.15.133:0/2549880386 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3bdc05f920 msgr2=0x7f3bdc0b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdaffd700 1 --2- 172.21.15.133:0/2549880386 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3bdc05f920 0x7f3bdc0b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdaffd700 1 -- 172.21.15.133:0/2549880386 >> v1:172.21.15.16:6789/0 conn(0x7f3bdc0b1590 legacy=0x7f3bdc13ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:52.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdaffd700 1 -- 172.21.15.133:0/2549880386 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc0acf70 con 0x7f3bdc066f30 2021-01-03T13:06:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdaffd700 1 -- 172.21.15.133:0/2549880386 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f3bc40016d0 con 0x7f3bdc066f30 2021-01-03T13:06:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdaffd700 1 -- 172.21.15.133:0/2549880386 >> v1:172.21.15.133:6789/0 conn(0x7f3bdc066f30 legacy=0x7f3bdc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdaffd700 1 --2- 172.21.15.133:0/2549880386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bbc003720 0x7f3bbc003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdaffd700 1 --2- 172.21.15.133:0/2549880386 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3bbc004080 0x7f3bbc004550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:52.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdaffd700 1 --2- 172.21.15.133:0/2549880386 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3bdc05f920 0x7f3bbc004bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:52.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdaffd700 1 -- 172.21.15.133:0/2549880386 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0b2980 con 0x7f3bbc004080 2021-01-03T13:06:52.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdaffd700 1 -- 172.21.15.133:0/2549880386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0050f0 con 0x7f3bbc003720 2021-01-03T13:06:52.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdaffd700 1 -- 172.21.15.133:0/2549880386 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0052b0 con 0x7f3bdc05f920 2021-01-03T13:06:52.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdbfff700 1 --2- 172.21.15.133:0/2549880386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bbc003720 0x7f3bbc003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:52.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdb7fe700 1 --2- 172.21.15.133:0/2549880386 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3bbc004080 0x7f3bbc004550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:52.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdbfff700 1 -- 172.21.15.133:0/2549880386 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3bdc05f920 msgr2=0x7f3bbc004bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:52.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdbfff700 1 --2- 172.21.15.133:0/2549880386 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3bdc05f920 0x7f3bbc004bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-03T13:06:52.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdbfff700 1 -- 172.21.15.133:0/2549880386 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3bbc004080 msgr2=0x7f3bbc004550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:52.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdbfff700 1 --2- 172.21.15.133:0/2549880386 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3bbc004080 0x7f3bbc004550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:52.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdbfff700 1 -- 172.21.15.133:0/2549880386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc003230 con 0x7f3bbc003720 2021-01-03T13:06:52.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.828+0000 7f3bdbfff700 1 --2- 172.21.15.133:0/2549880386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bbc003720 0x7f3bbc003b20 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f3bcc00c000 tx=0x7f3bcc008040).ready entity=mon.1 client_cookie=8b34e5afced58d90 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:52.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3bdaffd700 1 -- 172.21.15.133:0/2549880386 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bcc00e9d0 con 0x7f3bbc003720 2021-01-03T13:06:52.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3bdaffd700 1 -- 172.21.15.133:0/2549880386 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc00eb30 con 0x7f3bbc003720 2021-01-03T13:06:52.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3bdaffd700 1 -- 172.21.15.133:0/2549880386 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bcc00ee90 con 0x7f3bbc003720 2021-01-03T13:06:52.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3be1073700 1 -- 172.21.15.133:0/2549880386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bbc003720 msgr2=0x7f3bbc003b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:52.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3be1073700 1 --2- 172.21.15.133:0/2549880386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bbc003720 0x7f3bbc003b20 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7f3bcc00c000 tx=0x7f3bcc008040).stop 2021-01-03T13:06:52.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3be0872700 1 -- 172.21.15.133:0/2549880386 reap_dead start 2021-01-03T13:06:52.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3be1073700 1 -- 172.21.15.133:0/2549880386 shutdown_connections 2021-01-03T13:06:52.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3be1073700 1 -- 172.21.15.133:0/2549880386 >> 172.21.15.133:0/2549880386 conn(0x7f3bdc0b6110 msgr2=0x7f3bdc0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:52.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3be1073700 1 -- 172.21.15.133:0/2549880386 shutdown_connections 2021-01-03T13:06:52.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3be1073700 1 -- 172.21.15.133:0/2549880386 wait complete. 2021-01-03T13:06:52.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3be1073700 1 Processor -- start 2021-01-03T13:06:52.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3be1073700 1 -- start start 2021-01-03T13:06:52.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3be1073700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3bdc0668f0 0x7f3bdc141f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:52.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3be1073700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3bdc064e50 0x7f3bdc142480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:52.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3be1073700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bdc142970 0x7f3bdc155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:52.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3be1073700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc14b1a0 con 0x7f3bdc064e50 2021-01-03T13:06:52.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3be1073700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc066cd0 con 0x7f3bdc142970 2021-01-03T13:06:52.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.832+0000 7f3be1073700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc143170 con 0x7f3bdc0668f0 2021-01-03T13:06:52.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3be0872700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bdc142970 0x7f3bdc155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:52.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3be0872700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bdc142970 0x7f3bdc155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39050/0 (socket says 172.21.15.133:39050) 2021-01-03T13:06:52.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3be0872700 1 -- 172.21.15.133:0/2289802705 learned_addr learned my addr 172.21.15.133:0/2289802705 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:52.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3bdbfff700 1 --2- 172.21.15.133:0/2289802705 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3bdc0668f0 0x7f3bdc141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:52.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3bdb7fe700 1 --2- 172.21.15.133:0/2289802705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3bdc064e50 0x7f3bdc142480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:52.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3be0872700 1 -- 172.21.15.133:0/2289802705 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3bdc0668f0 msgr2=0x7f3bdc141f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:52.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3be0872700 1 --2- 172.21.15.133:0/2289802705 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3bdc0668f0 0x7f3bdc141f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:52.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3be0872700 1 -- 172.21.15.133:0/2289802705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3bdc064e50 msgr2=0x7f3bdc142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:52.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3be0872700 1 --2- 172.21.15.133:0/2289802705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3bdc064e50 0x7f3bdc142480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:52.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3be0872700 1 -- 172.21.15.133:0/2289802705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc143410 con 0x7f3bdc142970 2021-01-03T13:06:52.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3bdbfff700 1 --2- 172.21.15.133:0/2289802705 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3bdc0668f0 0x7f3bdc141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:52.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3be0872700 1 --2- 172.21.15.133:0/2289802705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bdc142970 0x7f3bdc155470 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f3bdc151f50 tx=0x7f3bd4007d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:52.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3bd97fa700 1 -- 172.21.15.133:0/2289802705 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bd4005850 con 0x7f3bdc142970 2021-01-03T13:06:52.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3bd97fa700 1 -- 172.21.15.133:0/2289802705 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd40059b0 con 0x7f3bdc142970 2021-01-03T13:06:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3be1073700 1 -- 172.21.15.133:0/2289802705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bdc1436b0 con 0x7f3bdc142970 2021-01-03T13:06:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3bd97fa700 1 -- 172.21.15.133:0/2289802705 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bd4005d10 con 0x7f3bdc142970 2021-01-03T13:06:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3be1073700 1 -- 172.21.15.133:0/2289802705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bdc1443a0 con 0x7f3bdc142970 2021-01-03T13:06:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3bd97fa700 1 -- 172.21.15.133:0/2289802705 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3bd401c030 con 0x7f3bdc142970 2021-01-03T13:06:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3be1073700 1 -- 172.21.15.133:0/2289802705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bdc057300 con 0x7f3bdc142970 2021-01-03T13:06:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3bd97fa700 1 --2- 172.21.15.133:0/2289802705 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3bc0055330 0x7f3bc00577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3bd97fa700 1 -- 172.21.15.133:0/2289802705 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3bd4003030 con 0x7f3bdc142970 2021-01-03T13:06:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.836+0000 7f3bdbfff700 1 --2- 172.21.15.133:0/2289802705 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3bc0055330 0x7f3bc00577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:52.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.840+0000 7f3bdbfff700 1 --2- 172.21.15.133:0/2289802705 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3bc0055330 0x7f3bc00577f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f3bcc007000 tx=0x7f3bcc01a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:52.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.844+0000 7f3bd97fa700 1 -- 172.21.15.133:0/2289802705 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3bd4044060 con 0x7f3bdc142970 2021-01-03T13:06:52.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.984+0000 7f3be1073700 1 -- 172.21.15.133:0/2289802705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7f3bdc0ae7c0 con 0x7f3bdc142970 2021-01-03T13:06:53.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.992+0000 7f3bd97fa700 1 -- 172.21.15.133:0/2289802705 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3bd4047680 con 0x7f3bdc142970 2021-01-03T13:06:53.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.996+0000 7f3be1073700 1 -- 172.21.15.133:0/2289802705 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3bc0055330 msgr2=0x7f3bc00577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:53.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.996+0000 7f3be1073700 1 --2- 172.21.15.133:0/2289802705 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3bc0055330 0x7f3bc00577f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f3bcc007000 tx=0x7f3bcc01a000).stop 2021-01-03T13:06:53.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.996+0000 7f3be1073700 1 -- 172.21.15.133:0/2289802705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bdc142970 msgr2=0x7f3bdc155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:53.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.996+0000 7f3be1073700 1 --2- 172.21.15.133:0/2289802705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bdc142970 0x7f3bdc155470 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f3bdc151f50 tx=0x7f3bd4007d10).stop 2021-01-03T13:06:53.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.996+0000 7f3be1073700 1 -- 172.21.15.133:0/2289802705 shutdown_connections 2021-01-03T13:06:53.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.996+0000 7f3be1073700 1 --2- 172.21.15.133:0/2289802705 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3bc0055330 0x7f3bc00577f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.996+0000 7f3be1073700 1 --2- 172.21.15.133:0/2289802705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bdc142970 0x7f3bdc155470 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.996+0000 7f3be1073700 1 --2- 172.21.15.133:0/2289802705 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3bdc0668f0 0x7f3bdc141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.996+0000 7f3be1073700 1 --2- 172.21.15.133:0/2289802705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3bdc064e50 0x7f3bdc142480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.996+0000 7f3be1073700 1 -- 172.21.15.133:0/2289802705 >> 172.21.15.133:0/2289802705 conn(0x7f3bdc0b6110 msgr2=0x7f3bdc0b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:53.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.996+0000 7f3be1073700 1 -- 172.21.15.133:0/2289802705 shutdown_connections 2021-01-03T13:06:53.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:52.996+0000 7f3be1073700 1 -- 172.21.15.133:0/2289802705 wait complete. 2021-01-03T13:06:53.015 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:06:53.016 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:06:53.034 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:06:53.051 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:06:53.069 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:06:53.088 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:06:53.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:53.090 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:53.091 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:06:53.098 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-03T13:06:53.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:06:53.100 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-01-03T13:06:53.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:06:53.100 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:06:53.101 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:06:53.118 INFO:teuthology.orchestra.run.smithi036.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:06:53.118 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:06:53.119 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-01-03T13:06:53.119 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-01-03T13:06:53.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.244+0000 7fa3fa1d8700 1 Processor -- start 2021-01-03T13:06:53.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.244+0000 7fa3fa1d8700 1 -- start start 2021-01-03T13:06:53.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3fa1d8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa3f40b72b0 0x7fa3f4144020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:53.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3fa1d8700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa3f40b2e00 0x7fa3f40ad160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:53.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3fa1d8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f409c0b0 con 0x7fa3f40b7eb0 2021-01-03T13:06:53.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3fa1d8700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f40ae480 con 0x7fa3f40b2e00 2021-01-03T13:06:53.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3fa1d8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f413e750 con 0x7fa3f40b72b0 2021-01-03T13:06:53.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3f91d6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa3f40b72b0 0x7fa3f4144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:53.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3f91d6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa3f40b72b0 0x7fa3f4144020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39058/0 (socket says 172.21.15.133:39058) 2021-01-03T13:06:53.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3f99d7700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa3f40b7eb0 0x7fa3f413e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60088/0 (socket says 172.21.15.133:60088) 2021-01-03T13:06:53.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3f91d6700 1 -- 172.21.15.133:0/3406196301 learned_addr learned my addr 172.21.15.133:0/3406196301 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:53.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3f89d5700 1 --2- 172.21.15.133:0/3406196301 >> v2:172.21.15.16:3300/0 conn(0x7fa3f40b2e00 0x7fa3f40ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:53.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3f91d6700 1 -- 172.21.15.133:0/3406196301 >> v2:172.21.15.16:3300/0 conn(0x7fa3f40b2e00 msgr2=0x7fa3f40ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:53.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3f91d6700 1 --2- 172.21.15.133:0/3406196301 >> v2:172.21.15.16:3300/0 conn(0x7fa3f40b2e00 0x7fa3f40ad160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3e7fff700 1 -- 172.21.15.133:0/3406196301 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819328565 0 0) 0x7fa3f409c0b0 con 0x7fa3f40b7eb0 2021-01-03T13:06:53.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3f91d6700 1 -- 172.21.15.133:0/3406196301 >> v1:172.21.15.133:6789/0 conn(0x7fa3f40b7eb0 legacy=0x7fa3f413e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:53.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3f91d6700 1 -- 172.21.15.133:0/3406196301 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f409c2e0 con 0x7fa3f40b72b0 2021-01-03T13:06:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3f91d6700 1 --2- 172.21.15.133:0/3406196301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3f40b72b0 0x7fa3f4144020 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7fa3f0002f30 tx=0x7fa3f0006e80).ready entity=mon.1 client_cookie=79f261bcc815bcf7 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3e7fff700 1 -- 172.21.15.133:0/3406196301 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3f00097f0 con 0x7fa3f40b72b0 2021-01-03T13:06:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3e7fff700 1 -- 172.21.15.133:0/3406196301 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f0009950 con 0x7fa3f40b72b0 2021-01-03T13:06:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3e7fff700 1 -- 172.21.15.133:0/3406196301 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3f0009cb0 con 0x7fa3f40b72b0 2021-01-03T13:06:53.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3fa1d8700 1 -- 172.21.15.133:0/3406196301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3f40b72b0 msgr2=0x7fa3f4144020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:53.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3fa1d8700 1 --2- 172.21.15.133:0/3406196301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3f40b72b0 0x7fa3f4144020 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7fa3f0002f30 tx=0x7fa3f0006e80).stop 2021-01-03T13:06:53.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3fa1d8700 1 -- 172.21.15.133:0/3406196301 shutdown_connections 2021-01-03T13:06:53.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3fa1d8700 1 --2- 172.21.15.133:0/3406196301 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3f40b72b0 0x7fa3f4144020 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3fa1d8700 1 --2- 172.21.15.133:0/3406196301 >> v2:172.21.15.16:3300/0 conn(0x7fa3f40b2e00 0x7fa3f40ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3fa1d8700 1 -- 172.21.15.133:0/3406196301 >> 172.21.15.133:0/3406196301 conn(0x7fa3f405bdf0 msgr2=0x7fa3f405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3fa1d8700 1 -- 172.21.15.133:0/3406196301 shutdown_connections 2021-01-03T13:06:53.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3fa1d8700 1 -- 172.21.15.133:0/3406196301 wait complete. 2021-01-03T13:06:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3fa1d8700 1 Processor -- start 2021-01-03T13:06:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.248+0000 7fa3fa1d8700 1 -- start start 2021-01-03T13:06:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3fa1d8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3f40b2e00 0x7fa3f41550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3fa1d8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3f40b72b0 0x7fa3f41442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:53.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3fa1d8700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3f41447e0 0x7fa3f4140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3fa1d8700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f4142bf0 con 0x7fa3f41447e0 2021-01-03T13:06:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3fa1d8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f4155980 con 0x7fa3f40b72b0 2021-01-03T13:06:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3fa1d8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f4155c20 con 0x7fa3f40b2e00 2021-01-03T13:06:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3f89d5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3f40b72b0 0x7fa3f41442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:53.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3f89d5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3f40b72b0 0x7fa3f41442f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39062/0 (socket says 172.21.15.133:39062) 2021-01-03T13:06:53.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3f89d5700 1 -- 172.21.15.133:0/354285068 learned_addr learned my addr 172.21.15.133:0/354285068 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:53.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3f91d6700 1 --2- 172.21.15.133:0/354285068 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3f40b2e00 0x7fa3f41550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:53.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3f99d7700 1 --2- 172.21.15.133:0/354285068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3f41447e0 0x7fa3f4140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:53.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3f89d5700 1 -- 172.21.15.133:0/354285068 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3f40b2e00 msgr2=0x7fa3f41550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:53.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3f89d5700 1 --2- 172.21.15.133:0/354285068 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3f40b2e00 0x7fa3f41550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3f89d5700 1 -- 172.21.15.133:0/354285068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3f41447e0 msgr2=0x7fa3f4140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:53.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3f89d5700 1 --2- 172.21.15.133:0/354285068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3f41447e0 0x7fa3f4140a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3f89d5700 1 -- 172.21.15.133:0/354285068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f41555b0 con 0x7fa3f40b72b0 2021-01-03T13:06:53.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3f99d7700 1 --2- 172.21.15.133:0/354285068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3f41447e0 0x7fa3f4140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:53.266 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3f89d5700 1 --2- 172.21.15.133:0/354285068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3f40b72b0 0x7fa3f41442f0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7fa3e8006a50 tx=0x7fa3e8006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3e67fc700 1 -- 172.21.15.133:0/354285068 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e800ca10 con 0x7fa3f40b72b0 2021-01-03T13:06:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3e67fc700 1 -- 172.21.15.133:0/354285068 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e800cb70 con 0x7fa3f40b72b0 2021-01-03T13:06:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3e67fc700 1 -- 172.21.15.133:0/354285068 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e80123f0 con 0x7fa3f40b72b0 2021-01-03T13:06:53.267 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3fa1d8700 1 -- 172.21.15.133:0/354285068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f4142510 con 0x7fa3f40b72b0 2021-01-03T13:06:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3fa1d8700 1 -- 172.21.15.133:0/354285068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f41433d0 con 0x7fa3f40b72b0 2021-01-03T13:06:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3fa1d8700 1 -- 172.21.15.133:0/354285068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f4141b70 con 0x7fa3f40b72b0 2021-01-03T13:06:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.252+0000 7fa3e67fc700 1 -- 172.21.15.133:0/354285068 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa3e8012550 con 0x7fa3f40b72b0 2021-01-03T13:06:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.256+0000 7fa3e67fc700 1 --2- 172.21.15.133:0/354285068 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa3dc055500 0x7fa3dc0579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:53.268 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.256+0000 7fa3e67fc700 1 -- 172.21.15.133:0/354285068 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa3e806e450 con 0x7fa3f40b72b0 2021-01-03T13:06:53.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.256+0000 7fa3f91d6700 1 --2- 172.21.15.133:0/354285068 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa3dc055500 0x7fa3dc0579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:53.269 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.256+0000 7fa3f91d6700 1 --2- 172.21.15.133:0/354285068 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa3dc055500 0x7fa3dc0579c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fa3f001c000 tx=0x7fa3f0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:53.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.260+0000 7fa3e67fc700 1 -- 172.21.15.133:0/354285068 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa3f4141b70 con 0x7fa3f40b72b0 2021-01-03T13:06:53.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.400+0000 7fa3fa1d8700 1 -- 172.21.15.133:0/354285068 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa3f4141b70 con 0x7fa3f40b72b0 2021-01-03T13:06:53.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.404+0000 7fa3e67fc700 1 -- 172.21.15.133:0/354285068 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v136) v1 ==== 81+0+33863 (secure 0 0 0) 0x7fa3f4141b70 con 0x7fa3f40b72b0 2021-01-03T13:06:53.410 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:53.410 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:06:53.410 INFO:teuthology.orchestra.run.smithi133.stdout: "epoch": 136, 2021-01-03T13:06:53.410 INFO:teuthology.orchestra.run.smithi133.stdout: "fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", 2021-01-03T13:06:53.411 INFO:teuthology.orchestra.run.smithi133.stdout: "created": "2021-01-03T12:57:43.298835+0000", 2021-01-03T13:06:53.411 INFO:teuthology.orchestra.run.smithi133.stdout: "modified": "2021-01-03T13:06:51.027406+0000", 2021-01-03T13:06:53.411 INFO:teuthology.orchestra.run.smithi133.stdout: "last_up_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:06:53.411 INFO:teuthology.orchestra.run.smithi133.stdout: "last_in_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:06:53.412 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-01-03T13:06:53.412 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_num": 5799936, 2021-01-03T13:06:53.412 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_set": [ 2021-01-03T13:06:53.412 INFO:teuthology.orchestra.run.smithi133.stdout: "pglog_hardlimit", 2021-01-03T13:06:53.412 INFO:teuthology.orchestra.run.smithi133.stdout: "purged_snapdirs", 2021-01-03T13:06:53.413 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_deletes", 2021-01-03T13:06:53.413 INFO:teuthology.orchestra.run.smithi133.stdout: "sortbitwise" 2021-01-03T13:06:53.413 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:06:53.413 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_version": 4, 2021-01-03T13:06:53.413 INFO:teuthology.orchestra.run.smithi133.stdout: "full_ratio": 0.94999998807907104, 2021-01-03T13:06:53.414 INFO:teuthology.orchestra.run.smithi133.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-01-03T13:06:53.414 INFO:teuthology.orchestra.run.smithi133.stdout: "nearfull_ratio": 0.85000002384185791, 2021-01-03T13:06:53.414 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_snapshot": "", 2021-01-03T13:06:53.414 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_max": 24, 2021-01-03T13:06:53.415 INFO:teuthology.orchestra.run.smithi133.stdout: "max_osd": 8, 2021-01-03T13:06:53.415 INFO:teuthology.orchestra.run.smithi133.stdout: "require_min_compat_client": "jewel", 2021-01-03T13:06:53.415 INFO:teuthology.orchestra.run.smithi133.stdout: "min_compat_client": "jewel", 2021-01-03T13:06:53.415 INFO:teuthology.orchestra.run.smithi133.stdout: "require_osd_release": "octopus", 2021-01-03T13:06:53.415 INFO:teuthology.orchestra.run.smithi133.stdout: "pools": [ 2021-01-03T13:06:53.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.416 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 1, 2021-01-03T13:06:53.416 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "device_health_metrics", 2021-01-03T13:06:53.416 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:47.102954+0000", 2021-01-03T13:06:53.416 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:06:53.417 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:06:53.417 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:06:53.417 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:06:53.417 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:06:53.418 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:06:53.418 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:06:53.418 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:06:53.418 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 1, 2021-01-03T13:06:53.418 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 1, 2021-01-03T13:06:53.419 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 1, 2021-01-03T13:06:53.419 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 1, 2021-01-03T13:06:53.419 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 1, 2021-01-03T13:06:53.420 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:06:53.420 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:06:53.420 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:06:53.420 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:06:53.420 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:06:53.421 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:06:53.421 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:06:53.421 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.421 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "16", 2021-01-03T13:06:53.421 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:06:53.422 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:06:53.422 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:06:53.422 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:06:53.422 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:06:53.423 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:06:53.423 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:06:53.423 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:06:53.423 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:06:53.423 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:06:53.424 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:06:53.424 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:06:53.424 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:06:53.424 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:06:53.424 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:06:53.425 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:06:53.425 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:06:53.425 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:06:53.425 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:06:53.426 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:06:53.426 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:06:53.426 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:06:53.426 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:06:53.427 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:06:53.427 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:06:53.427 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:06:53.427 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.427 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:06:53.428 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:06:53.428 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:06:53.428 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:06:53.428 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:06:53.428 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:06:53.429 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:06:53.429 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:06:53.429 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:06:53.430 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:06:53.430 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:06:53.430 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:06:53.430 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 1 2021-01-03T13:06:53.431 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.431 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:06:53.431 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr_devicehealth": {} 2021-01-03T13:06:53.431 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.432 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.432 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.432 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 2, 2021-01-03T13:06:53.433 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "rbd", 2021-01-03T13:06:53.433 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:55.472799+0000", 2021-01-03T13:06:53.433 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:06:53.433 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:06:53.434 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:06:53.434 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:06:53.435 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:06:53.435 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:06:53.435 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:06:53.436 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:06:53.436 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:06:53.436 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:06:53.436 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:06:53.437 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:06:53.437 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:06:53.437 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:06:53.437 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:06:53.438 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:06:53.438 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:06:53.438 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:06:53.438 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:06:53.439 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:06:53.439 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.439 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "19", 2021-01-03T13:06:53.439 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:06:53.440 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:06:53.440 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:06:53.440 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:06:53.440 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:06:53.441 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:06:53.441 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:06:53.441 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:06:53.441 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:06:53.441 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:06:53.442 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:06:53.442 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:06:53.442 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:06:53.442 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:06:53.443 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:06:53.443 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:06:53.443 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:06:53.443 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:06:53.443 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:06:53.444 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:06:53.444 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:06:53.444 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:06:53.444 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:06:53.445 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:06:53.445 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:06:53.445 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:06:53.445 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.445 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:06:53.446 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:06:53.446 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:06:53.446 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:06:53.446 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:06:53.447 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:06:53.447 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:06:53.447 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:06:53.447 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:06:53.447 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:06:53.448 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:06:53.448 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:06:53.448 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:06:53.448 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd": {} 2021-01-03T13:06:53.448 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.449 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.449 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.449 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 22, 2021-01-03T13:06:53.449 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_data", 2021-01-03T13:06:53.450 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:06:21.971060+0000", 2021-01-03T13:06:53.451 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:06:53.451 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:06:53.451 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:06:53.451 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:06:53.452 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:06:53.452 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:06:53.452 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:06:53.452 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:06:53.452 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:06:53.453 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:06:53.453 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:06:53.453 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:06:53.453 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:06:53.453 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:06:53.454 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:06:53.454 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:06:53.454 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:06:53.454 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:06:53.454 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:06:53.455 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:06:53.455 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.455 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "135", 2021-01-03T13:06:53.455 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:06:53.455 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:06:53.456 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:06:53.456 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:06:53.456 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:06:53.456 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:06:53.456 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:06:53.457 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:06:53.457 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:06:53.457 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:06:53.457 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:06:53.457 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:06:53.458 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:06:53.458 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:06:53.458 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:06:53.458 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:06:53.458 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:06:53.459 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:06:53.459 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:06:53.459 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:06:53.459 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:06:53.459 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:06:53.460 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:06:53.460 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:06:53.460 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:06:53.460 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:06:53.460 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.461 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:06:53.461 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:06:53.461 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:06:53.461 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:06:53.461 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:06:53.462 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:06:53.462 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:06:53.463 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:06:53.463 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:06:53.463 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:06:53.463 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:06:53.464 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:06:53.464 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:06:53.464 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:06:53.464 INFO:teuthology.orchestra.run.smithi133.stdout: "data": "cephfs" 2021-01-03T13:06:53.464 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.465 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.465 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.465 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.465 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 24, 2021-01-03T13:06:53.465 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_metadata", 2021-01-03T13:06:53.466 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:06:49.022836+0000", 2021-01-03T13:06:53.466 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:06:53.466 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:06:53.466 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:06:53.467 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:06:53.467 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:06:53.467 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:06:53.467 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:06:53.467 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:06:53.468 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:06:53.468 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:06:53.468 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:06:53.468 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:06:53.468 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:06:53.469 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:06:53.469 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:06:53.469 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:06:53.469 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:06:53.469 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:06:53.469 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:06:53.470 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:06:53.470 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.470 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "136", 2021-01-03T13:06:53.470 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:06:53.471 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:06:53.471 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:06:53.471 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:06:53.471 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:06:53.471 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:06:53.472 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:06:53.472 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:06:53.472 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:06:53.472 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:06:53.472 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:06:53.473 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:06:53.473 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:06:53.473 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:06:53.473 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:06:53.473 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:06:53.474 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:06:53.474 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:06:53.474 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:06:53.474 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:06:53.475 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:06:53.475 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:06:53.475 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:06:53.475 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:06:53.475 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:06:53.475 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:06:53.476 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.476 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:06:53.476 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:06:53.476 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:06:53.476 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:06:53.477 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:06:53.477 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:06:53.477 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:06:53.477 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:06:53.477 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:06:53.478 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:06:53.478 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:06:53.478 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:06:53.478 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_bias": 4, 2021-01-03T13:06:53.478 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 16, 2021-01-03T13:06:53.479 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_priority": 5 2021-01-03T13:06:53.479 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.479 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:06:53.479 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:06:53.479 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": "cephfs" 2021-01-03T13:06:53.480 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.480 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.480 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.480 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:06:53.480 INFO:teuthology.orchestra.run.smithi133.stdout: "osds": [ 2021-01-03T13:06:53.481 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.481 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:06:53.481 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a", 2021-01-03T13:06:53.482 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:06:53.482 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:06:53.482 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:06:53.483 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:06:53.483 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:06:53.483 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:06:53.483 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:06:53.483 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 134, 2021-01-03T13:06:53.484 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:06:53.484 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:06:53.484 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:06:53.484 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.484 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.485 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.485 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6810", 2021-01-03T13:06:53.485 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:06:53.485 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.485 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.486 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.486 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6811", 2021-01-03T13:06:53.486 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:06:53.486 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.487 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.487 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.487 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:06:53.487 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.487 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.488 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.488 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6812", 2021-01-03T13:06:53.488 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:06:53.488 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.488 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.489 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.489 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6813", 2021-01-03T13:06:53.489 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:06:53.489 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.489 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.490 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.490 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:06:53.490 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.490 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.490 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.491 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6816", 2021-01-03T13:06:53.491 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:06:53.491 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.491 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.491 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.492 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6817", 2021-01-03T13:06:53.492 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:06:53.492 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.492 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.492 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.493 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:06:53.493 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.493 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.493 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.494 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6814", 2021-01-03T13:06:53.494 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:06:53.494 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.494 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.494 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.495 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6815", 2021-01-03T13:06:53.495 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:06:53.495 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.495 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.495 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.496 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6811/12124", 2021-01-03T13:06:53.496 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6813/12124", 2021-01-03T13:06:53.496 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6817/12124", 2021-01-03T13:06:53.496 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6815/12124", 2021-01-03T13:06:53.496 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:06:53.497 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:06:53.497 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:06:53.497 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.497 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.497 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.499 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:06:53.499 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9170d1de-58d4-4dfd-b9de-80dc15ca9e60", 2021-01-03T13:06:53.499 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:06:53.499 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:06:53.500 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:06:53.500 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:06:53.500 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:06:53.500 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:06:53.500 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:06:53.501 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 134, 2021-01-03T13:06:53.501 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:06:53.501 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:06:53.501 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:06:53.502 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.502 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.502 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.502 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6818", 2021-01-03T13:06:53.502 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:06:53.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.503 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.503 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6819", 2021-01-03T13:06:53.504 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:06:53.504 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.504 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.504 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:06:53.505 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.505 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.505 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.505 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6820", 2021-01-03T13:06:53.505 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:06:53.506 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.506 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.506 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.506 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6821", 2021-01-03T13:06:53.507 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:06:53.507 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.508 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.508 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.508 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:06:53.508 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.508 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.509 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.509 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6824", 2021-01-03T13:06:53.510 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:06:53.510 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.510 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.510 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.511 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6825", 2021-01-03T13:06:53.511 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:06:53.511 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.512 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.512 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.512 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:06:53.512 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.512 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.513 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.513 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6822", 2021-01-03T13:06:53.513 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:06:53.513 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.514 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.514 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.514 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6823", 2021-01-03T13:06:53.515 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:06:53.515 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.515 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.516 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.516 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6819/12123", 2021-01-03T13:06:53.516 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6821/12123", 2021-01-03T13:06:53.516 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6825/12123", 2021-01-03T13:06:53.516 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6823/12123", 2021-01-03T13:06:53.517 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:06:53.517 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:06:53.517 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:06:53.517 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.517 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.518 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.518 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:06:53.518 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9fc5adf9-3537-4953-9c65-0c67ecb53776", 2021-01-03T13:06:53.518 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:06:53.519 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:06:53.519 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:06:53.519 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:06:53.519 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:06:53.520 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:06:53.520 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:06:53.520 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 129, 2021-01-03T13:06:53.520 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:06:53.520 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:06:53.521 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:06:53.521 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.521 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.521 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.521 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6802", 2021-01-03T13:06:53.521 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:06:53.522 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.522 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.522 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.522 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6803", 2021-01-03T13:06:53.523 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:06:53.523 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.523 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.523 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.523 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:06:53.524 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.524 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.524 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.524 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6804", 2021-01-03T13:06:53.524 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:06:53.525 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.525 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.525 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.525 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6805", 2021-01-03T13:06:53.525 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:06:53.526 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.526 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.526 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.526 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:06:53.526 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.527 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.527 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.527 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6808", 2021-01-03T13:06:53.527 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:06:53.527 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.528 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.528 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.528 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6809", 2021-01-03T13:06:53.528 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:06:53.528 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.529 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.529 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.529 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:06:53.529 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.529 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.530 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.530 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6806", 2021-01-03T13:06:53.530 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:06:53.530 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.530 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.531 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.531 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6807", 2021-01-03T13:06:53.531 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:06:53.531 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.531 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.532 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.532 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6803/12122", 2021-01-03T13:06:53.532 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6805/12122", 2021-01-03T13:06:53.532 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6809/12122", 2021-01-03T13:06:53.532 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6807/12122", 2021-01-03T13:06:53.533 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:06:53.533 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:06:53.533 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:06:53.533 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.533 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.534 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.534 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:06:53.534 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "0ad45ce5-6635-4089-bbf8-c966d0fe5338", 2021-01-03T13:06:53.534 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:06:53.534 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:06:53.535 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:06:53.535 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:06:53.535 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:06:53.535 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:06:53.535 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:06:53.536 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 134, 2021-01-03T13:06:53.536 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:06:53.536 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:06:53.536 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:06:53.536 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.537 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.537 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.537 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6826", 2021-01-03T13:06:53.537 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:06:53.537 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.538 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.538 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.538 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6827", 2021-01-03T13:06:53.538 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:06:53.538 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.539 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.539 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.539 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:06:53.539 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.539 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.540 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.540 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6828", 2021-01-03T13:06:53.540 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:06:53.540 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.540 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.541 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.541 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6829", 2021-01-03T13:06:53.541 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:06:53.541 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.541 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.542 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.542 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:06:53.542 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.542 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.542 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.543 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6832", 2021-01-03T13:06:53.543 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:06:53.543 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.543 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.543 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.544 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6833", 2021-01-03T13:06:53.544 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:06:53.544 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.544 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.544 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.545 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:06:53.545 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.545 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.545 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.545 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6830", 2021-01-03T13:06:53.546 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:06:53.546 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.546 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.546 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.546 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6831", 2021-01-03T13:06:53.547 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:06:53.547 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.547 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.547 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.547 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6827/12136", 2021-01-03T13:06:53.548 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6829/12136", 2021-01-03T13:06:53.548 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6833/12136", 2021-01-03T13:06:53.548 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6831/12136", 2021-01-03T13:06:53.548 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:06:53.548 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:06:53.549 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:06:53.549 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.549 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.549 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.549 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:06:53.550 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "86b8d6d5-271b-4a70-ae7b-a227afb38d7c", 2021-01-03T13:06:53.550 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:06:53.550 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:06:53.550 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:06:53.550 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:06:53.551 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:06:53.551 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:06:53.551 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:06:53.551 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 129, 2021-01-03T13:06:53.551 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:06:53.552 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:06:53.552 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:06:53.552 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.552 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.552 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.553 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6808", 2021-01-03T13:06:53.553 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:06:53.553 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.553 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.553 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.554 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6809", 2021-01-03T13:06:53.554 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:06:53.554 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.554 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.554 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.555 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:06:53.555 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.555 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.555 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.555 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6810", 2021-01-03T13:06:53.556 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:06:53.556 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.556 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.556 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.556 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6811", 2021-01-03T13:06:53.557 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:06:53.557 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.557 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.557 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.557 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:06:53.557 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.558 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.558 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.558 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6814", 2021-01-03T13:06:53.558 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:06:53.559 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.559 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.559 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.559 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6815", 2021-01-03T13:06:53.559 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:06:53.560 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.560 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.560 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.560 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:06:53.560 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.560 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.561 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.561 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6812", 2021-01-03T13:06:53.561 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:06:53.561 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.561 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.562 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.562 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6813", 2021-01-03T13:06:53.562 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:06:53.562 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.562 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.563 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.563 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6809/12672", 2021-01-03T13:06:53.563 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6811/12672", 2021-01-03T13:06:53.563 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6815/12672", 2021-01-03T13:06:53.563 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6813/12672", 2021-01-03T13:06:53.564 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:06:53.564 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:06:53.564 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:06:53.564 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.564 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.565 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.565 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:06:53.565 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "173feb9d-f596-4030-85d8-1f4b46a9ffe5", 2021-01-03T13:06:53.565 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:06:53.565 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:06:53.566 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:06:53.566 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:06:53.566 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:06:53.566 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:06:53.566 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:06:53.567 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 134, 2021-01-03T13:06:53.567 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:06:53.567 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:06:53.567 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:06:53.567 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.568 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.568 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.568 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6817", 2021-01-03T13:06:53.568 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:06:53.568 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.569 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.569 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.569 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6819", 2021-01-03T13:06:53.569 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:06:53.569 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.570 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.570 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.570 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:06:53.570 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.570 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.571 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.571 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6820", 2021-01-03T13:06:53.571 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:06:53.571 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.571 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.572 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.572 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6822", 2021-01-03T13:06:53.572 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:06:53.572 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.572 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.573 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.573 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:06:53.573 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.573 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.573 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.574 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6828", 2021-01-03T13:06:53.574 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:06:53.574 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.574 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.574 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.575 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6830", 2021-01-03T13:06:53.575 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:06:53.575 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.575 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.575 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.576 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:06:53.576 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.576 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.576 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.576 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6824", 2021-01-03T13:06:53.577 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:06:53.577 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.577 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.577 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.577 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6826", 2021-01-03T13:06:53.578 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:06:53.578 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.578 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.578 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.578 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6819/12673", 2021-01-03T13:06:53.579 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6822/12673", 2021-01-03T13:06:53.579 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6830/12673", 2021-01-03T13:06:53.579 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6826/12673", 2021-01-03T13:06:53.579 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:06:53.579 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:06:53.580 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:06:53.580 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.580 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.580 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.580 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:06:53.581 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "b487980e-ad4d-43c1-91fa-4845f7af3d4d", 2021-01-03T13:06:53.581 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:06:53.581 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:06:53.581 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:06:53.581 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:06:53.582 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:06:53.582 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:06:53.582 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:06:53.582 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 134, 2021-01-03T13:06:53.582 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:06:53.583 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:06:53.583 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:06:53.583 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.583 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.583 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.584 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6800", 2021-01-03T13:06:53.584 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:06:53.584 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.584 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.584 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.585 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6801", 2021-01-03T13:06:53.585 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:06:53.585 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.585 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.585 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.586 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:06:53.586 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.586 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.586 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.586 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6802", 2021-01-03T13:06:53.587 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:06:53.587 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.587 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.587 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.587 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6803", 2021-01-03T13:06:53.588 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:06:53.588 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.588 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.588 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.588 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:06:53.589 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.589 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.589 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.589 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6806", 2021-01-03T13:06:53.589 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:06:53.590 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.590 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.590 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.590 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6807", 2021-01-03T13:06:53.590 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:06:53.591 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.591 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.591 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.591 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:06:53.591 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.592 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.592 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.592 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6804", 2021-01-03T13:06:53.592 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:06:53.592 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.593 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.593 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.593 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6805", 2021-01-03T13:06:53.593 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:06:53.593 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.594 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.594 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.594 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6801/12662", 2021-01-03T13:06:53.594 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6803/12662", 2021-01-03T13:06:53.594 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6807/12662", 2021-01-03T13:06:53.595 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6805/12662", 2021-01-03T13:06:53.595 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:06:53.595 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:06:53.595 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:06:53.595 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.596 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.596 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.596 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:06:53.596 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "38ea839a-451f-4c09-a545-4514e049b178", 2021-01-03T13:06:53.596 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:06:53.597 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:06:53.597 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:06:53.597 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:06:53.597 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:06:53.597 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:06:53.598 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:06:53.598 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 134, 2021-01-03T13:06:53.598 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:06:53.598 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:06:53.598 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:06:53.599 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.599 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.599 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.599 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6816", 2021-01-03T13:06:53.599 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:06:53.600 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.600 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.600 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6818", 2021-01-03T13:06:53.600 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:06:53.601 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.601 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.601 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:06:53.601 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.602 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.602 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6821", 2021-01-03T13:06:53.602 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:06:53.602 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.603 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.603 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.603 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6823", 2021-01-03T13:06:53.603 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:06:53.603 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.604 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.604 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.604 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:06:53.604 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.605 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.605 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6829", 2021-01-03T13:06:53.605 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:06:53.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.606 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.606 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6831", 2021-01-03T13:06:53.606 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:06:53.606 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.606 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.607 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:06:53.607 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:06:53.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.607 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:06:53.608 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6825", 2021-01-03T13:06:53.608 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:06:53.608 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.608 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.608 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:06:53.609 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6827", 2021-01-03T13:06:53.609 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:06:53.609 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.609 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.610 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6818/12674", 2021-01-03T13:06:53.610 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6823/12674", 2021-01-03T13:06:53.610 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6831/12674", 2021-01-03T13:06:53.610 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6827/12674", 2021-01-03T13:06:53.610 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:06:53.611 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:06:53.611 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:06:53.611 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:53.611 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.611 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:06:53.612 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_xinfo": [ 2021-01-03T13:06:53.612 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.612 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:06:53.612 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:06:53.612 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:06:53.613 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:06:53.613 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:06:53.613 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:06:53.613 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.659942+0000", 2021-01-03T13:06:53.613 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:06:53.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.614 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:06:53.614 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:06:53.615 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:06:53.615 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:06:53.615 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:06:53.615 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:06:53.615 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.750326+0000", 2021-01-03T13:06:53.616 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:06:53.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.616 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:06:53.616 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:06:53.617 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:06:53.617 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:06:53.617 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:06:53.617 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:06:53.617 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.587742+0000", 2021-01-03T13:06:53.618 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:06:53.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.618 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:06:53.618 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:06:53.619 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:06:53.619 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:06:53.619 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:06:53.619 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:06:53.619 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.855073+0000", 2021-01-03T13:06:53.620 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:06:53.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.620 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:06:53.620 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:06:53.621 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:06:53.621 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:06:53.621 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:06:53.621 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:06:53.621 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.565030+0000", 2021-01-03T13:06:53.622 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:06:53.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.622 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:06:53.622 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:06:53.623 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:06:53.623 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:06:53.623 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:06:53.623 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:06:53.623 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.786206+0000", 2021-01-03T13:06:53.624 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:06:53.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.624 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:06:53.624 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:06:53.625 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:06:53.625 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:06:53.625 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:06:53.625 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:06:53.625 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.576185+0000", 2021-01-03T13:06:53.626 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:06:53.626 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:53.626 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:06:53.626 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:06:53.627 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:06:53.627 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:06:53.627 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:06:53.627 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:06:53.627 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.823786+0000", 2021-01-03T13:06:53.628 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:06:53.628 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.628 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:06:53.628 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap": [], 2021-01-03T13:06:53.628 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap_items": [], 2021-01-03T13:06:53.629 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_temp": [], 2021-01-03T13:06:53.629 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_temp": [], 2021-01-03T13:06:53.629 INFO:teuthology.orchestra.run.smithi133.stdout: "blacklist": { 2021-01-03T13:06:53.629 INFO:teuthology.orchestra.run.smithi133.stdout: "172.21.15.133:6837/1725513894": "2021-01-04T13:06:35.707559+0000", 2021-01-03T13:06:53.629 INFO:teuthology.orchestra.run.smithi133.stdout: "172.21.15.133:6835/1725513894": "2021-01-04T13:06:35.707559+0000" 2021-01-03T13:06:53.630 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.630 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profiles": { 2021-01-03T13:06:53.630 INFO:teuthology.orchestra.run.smithi133.stdout: "default": { 2021-01-03T13:06:53.630 INFO:teuthology.orchestra.run.smithi133.stdout: "crush-failure-domain": "osd", 2021-01-03T13:06:53.630 INFO:teuthology.orchestra.run.smithi133.stdout: "k": "2", 2021-01-03T13:06:53.631 INFO:teuthology.orchestra.run.smithi133.stdout: "m": "1", 2021-01-03T13:06:53.631 INFO:teuthology.orchestra.run.smithi133.stdout: "plugin": "jerasure", 2021-01-03T13:06:53.631 INFO:teuthology.orchestra.run.smithi133.stdout: "ruleset-failure-domain": "osd", 2021-01-03T13:06:53.631 INFO:teuthology.orchestra.run.smithi133.stdout: "technique": "reed_sol_van" 2021-01-03T13:06:53.631 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:53.632 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:53.632 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps_queue": [], 2021-01-03T13:06:53.632 INFO:teuthology.orchestra.run.smithi133.stdout: "new_removed_snaps": [], 2021-01-03T13:06:53.632 INFO:teuthology.orchestra.run.smithi133.stdout: "new_purged_snaps": [], 2021-01-03T13:06:53.632 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_node_flags": {}, 2021-01-03T13:06:53.633 INFO:teuthology.orchestra.run.smithi133.stdout: "device_class_flags": {} 2021-01-03T13:06:53.633 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:06:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.404+0000 7fa3fa1d8700 1 -- 172.21.15.133:0/354285068 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa3dc055500 msgr2=0x7fa3dc0579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.404+0000 7fa3fa1d8700 1 --2- 172.21.15.133:0/354285068 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa3dc055500 0x7fa3dc0579c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fa3f001c000 tx=0x7fa3f0015000).stop 2021-01-03T13:06:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.404+0000 7fa3fa1d8700 1 -- 172.21.15.133:0/354285068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3f40b72b0 msgr2=0x7fa3f41442f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:53.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.404+0000 7fa3fa1d8700 1 --2- 172.21.15.133:0/354285068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3f40b72b0 0x7fa3f41442f0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7fa3e8006a50 tx=0x7fa3e8006dc0).stop 2021-01-03T13:06:53.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.404+0000 7fa3fa1d8700 1 -- 172.21.15.133:0/354285068 shutdown_connections 2021-01-03T13:06:53.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.404+0000 7fa3fa1d8700 1 --2- 172.21.15.133:0/354285068 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa3dc055500 0x7fa3dc0579c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.404+0000 7fa3fa1d8700 1 --2- 172.21.15.133:0/354285068 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa3f41447e0 0x7fa3f4140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.404+0000 7fa3fa1d8700 1 --2- 172.21.15.133:0/354285068 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa3f40b2e00 0x7fa3f41550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.404+0000 7fa3fa1d8700 1 --2- 172.21.15.133:0/354285068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3f40b72b0 0x7fa3f41442f0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.404+0000 7fa3fa1d8700 1 -- 172.21.15.133:0/354285068 >> 172.21.15.133:0/354285068 conn(0x7fa3f405bdf0 msgr2=0x7fa3f40b4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:53.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.404+0000 7fa3fa1d8700 1 -- 172.21.15.133:0/354285068 shutdown_connections 2021-01-03T13:06:53.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.404+0000 7fa3fa1d8700 1 -- 172.21.15.133:0/354285068 wait complete. 2021-01-03T13:06:53.638 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:06:53.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8e117c700 1 Processor -- start 2021-01-03T13:06:53.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8e117c700 1 -- start start 2021-01-03T13:06:53.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8e117c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd8dc05c130 0x7fd8dc0b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:53.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8e117c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd8dc061890 0x7fd8dc1472d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:53.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8e117c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd8dc1477c0 0x7fd8dc1445e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:53.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8e117c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8dc05c510 con 0x7fd8dc05c130 2021-01-03T13:06:53.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8e117c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8dc14a930 con 0x7fd8dc061890 2021-01-03T13:06:53.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8e117c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc14abd0 con 0x7fd8dc1477c0 2021-01-03T13:06:53.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8db7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd8dc061890 0x7fd8dc1472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:53.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8db7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd8dc061890 0x7fd8dc1472d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39068/0 (socket says 172.21.15.133:39068) 2021-01-03T13:06:53.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8db7fe700 1 -- 172.21.15.133:0/2590513143 learned_addr learned my addr 172.21.15.133:0/2590513143 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:53.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8dbfff700 1 --2- 172.21.15.133:0/2590513143 >> v2:172.21.15.16:3300/0 conn(0x7fd8dc05c130 0x7fd8dc0b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:53.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8db7fe700 1 -- 172.21.15.133:0/2590513143 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd8dc1477c0 msgr2=0x7fd8dc1445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:53.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8e097b700 1 --2- 172.21.15.133:0/2590513143 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd8dc1477c0 0x7fd8dc1445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:53.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8db7fe700 1 --2- 172.21.15.133:0/2590513143 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd8dc1477c0 0x7fd8dc1445e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8db7fe700 1 -- 172.21.15.133:0/2590513143 >> v2:172.21.15.16:3300/0 conn(0x7fd8dc05c130 msgr2=0x7fd8dc0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:53.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8db7fe700 1 --2- 172.21.15.133:0/2590513143 >> v2:172.21.15.16:3300/0 conn(0x7fd8dc05c130 0x7fd8dc0b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8db7fe700 1 -- 172.21.15.133:0/2590513143 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc14ae70 con 0x7fd8dc061890 2021-01-03T13:06:53.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8dbfff700 1 --2- 172.21.15.133:0/2590513143 >> v2:172.21.15.16:3300/0 conn(0x7fd8dc05c130 0x7fd8dc0b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:06:53.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.752+0000 7fd8e097b700 1 --2- 172.21.15.133:0/2590513143 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd8dc1477c0 0x7fd8dc1445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:06:53.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8db7fe700 1 --2- 172.21.15.133:0/2590513143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8dc061890 0x7fd8dc1472d0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fd8cc002f30 tx=0x7fd8cc006e80).ready entity=mon.1 client_cookie=45c01c0f77e55920 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:53.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8daffd700 1 -- 172.21.15.133:0/2590513143 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8cc0097f0 con 0x7fd8dc061890 2021-01-03T13:06:53.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8daffd700 1 -- 172.21.15.133:0/2590513143 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc009950 con 0x7fd8dc061890 2021-01-03T13:06:53.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8daffd700 1 -- 172.21.15.133:0/2590513143 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8cc009cb0 con 0x7fd8dc061890 2021-01-03T13:06:53.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8e117c700 1 -- 172.21.15.133:0/2590513143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8dc061890 msgr2=0x7fd8dc1472d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:53.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8e117c700 1 --2- 172.21.15.133:0/2590513143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8dc061890 0x7fd8dc1472d0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7fd8cc002f30 tx=0x7fd8cc006e80).stop 2021-01-03T13:06:53.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8e117c700 1 -- 172.21.15.133:0/2590513143 shutdown_connections 2021-01-03T13:06:53.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8e117c700 1 --2- 172.21.15.133:0/2590513143 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd8dc1477c0 0x7fd8dc1445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8e117c700 1 --2- 172.21.15.133:0/2590513143 >> v2:172.21.15.16:3300/0 conn(0x7fd8dc05c130 0x7fd8dc0b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8e117c700 1 --2- 172.21.15.133:0/2590513143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8dc061890 0x7fd8dc1472d0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8e117c700 1 -- 172.21.15.133:0/2590513143 >> 172.21.15.133:0/2590513143 conn(0x7fd8dc0b6110 msgr2=0x7fd8dc0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:53.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8e117c700 1 -- 172.21.15.133:0/2590513143 shutdown_connections 2021-01-03T13:06:53.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8e117c700 1 -- 172.21.15.133:0/2590513143 wait complete. 2021-01-03T13:06:53.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8e117c700 1 Processor -- start 2021-01-03T13:06:53.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8e117c700 1 -- start start 2021-01-03T13:06:53.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8e117c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8dc05c130 0x7fd8dc146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:53.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8e117c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8dc061890 0x7fd8dc149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:53.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8e117c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd8dc1477c0 0x7fd8dc156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:53.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8e117c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc149a40 con 0x7fd8dc061890 2021-01-03T13:06:53.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8e117c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc14e790 con 0x7fd8dc05c130 2021-01-03T13:06:53.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8dbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8dc05c130 0x7fd8dc146890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:53.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.756+0000 7fd8e117c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc156e10 con 0x7fd8dc1477c0 2021-01-03T13:06:53.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8dbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8dc05c130 0x7fd8dc146890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39074/0 (socket says 172.21.15.133:39074) 2021-01-03T13:06:53.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8dbfff700 1 -- 172.21.15.133:0/4294364545 learned_addr learned my addr 172.21.15.133:0/4294364545 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:53.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8db7fe700 1 --2- 172.21.15.133:0/4294364545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8dc061890 0x7fd8dc149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:53.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8e097b700 1 --2- 172.21.15.133:0/4294364545 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd8dc1477c0 0x7fd8dc156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:53.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8dbfff700 1 -- 172.21.15.133:0/4294364545 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd8dc1477c0 msgr2=0x7fd8dc156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:53.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8dbfff700 1 --2- 172.21.15.133:0/4294364545 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd8dc1477c0 0x7fd8dc156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8dbfff700 1 -- 172.21.15.133:0/4294364545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8dc061890 msgr2=0x7fd8dc149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:53.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8dbfff700 1 --2- 172.21.15.133:0/4294364545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8dc061890 0x7fd8dc149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8dbfff700 1 -- 172.21.15.133:0/4294364545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc149c60 con 0x7fd8dc05c130 2021-01-03T13:06:53.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8dbfff700 1 --2- 172.21.15.133:0/4294364545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8dc05c130 0x7fd8dc146890 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fd8dc149b80 tx=0x7fd8c8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:53.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8d97fa700 1 -- 172.21.15.133:0/4294364545 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8c8007710 con 0x7fd8dc05c130 2021-01-03T13:06:53.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8d97fa700 1 -- 172.21.15.133:0/4294364545 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c8007870 con 0x7fd8dc05c130 2021-01-03T13:06:53.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8e117c700 1 -- 172.21.15.133:0/4294364545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc1561e0 con 0x7fd8dc05c130 2021-01-03T13:06:53.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8d97fa700 1 -- 172.21.15.133:0/4294364545 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8c8007bd0 con 0x7fd8dc05c130 2021-01-03T13:06:53.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8e117c700 1 -- 172.21.15.133:0/4294364545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc155e80 con 0x7fd8dc05c130 2021-01-03T13:06:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8e117c700 1 -- 172.21.15.133:0/4294364545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc149df0 con 0x7fd8dc05c130 2021-01-03T13:06:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8d97fa700 1 -- 172.21.15.133:0/4294364545 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd8c8007d30 con 0x7fd8dc05c130 2021-01-03T13:06:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.760+0000 7fd8d97fa700 1 --2- 172.21.15.133:0/4294364545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd8b8055330 0x7fd8b80577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:53.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.764+0000 7fd8d97fa700 1 -- 172.21.15.133:0/4294364545 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd8c806e2b0 con 0x7fd8dc05c130 2021-01-03T13:06:53.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.764+0000 7fd8db7fe700 1 --2- 172.21.15.133:0/4294364545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd8b8055330 0x7fd8b80577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:53.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.764+0000 7fd8db7fe700 1 --2- 172.21.15.133:0/4294364545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd8b8055330 0x7fd8b80577f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fd8cc01a000 tx=0x7fd8cc015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:53.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.768+0000 7fd8d97fa700 1 -- 172.21.15.133:0/4294364545 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd8c8044450 con 0x7fd8dc05c130 2021-01-03T13:06:53.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.952+0000 7fd8e117c700 1 -- 172.21.15.133:0/4294364545 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8dc057300 con 0x7fd8dc05c130 2021-01-03T13:06:53.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.952+0000 7fd8d97fa700 1 -- 172.21.15.133:0/4294364545 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+1426 (secure 0 0 0) 0x7fd8c8047a70 con 0x7fd8dc05c130 2021-01-03T13:06:53.959 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:53.959 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":61,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:06:50.024762+0000","modified":"2021-01-03T13:06:50.024895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-01-03T13:06:53.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.952+0000 7fd8e117c700 1 -- 172.21.15.133:0/4294364545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd8b8055330 msgr2=0x7fd8b80577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:53.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.956+0000 7fd8e117c700 1 --2- 172.21.15.133:0/4294364545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd8b8055330 0x7fd8b80577f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fd8cc01a000 tx=0x7fd8cc015000).stop 2021-01-03T13:06:53.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.956+0000 7fd8e117c700 1 -- 172.21.15.133:0/4294364545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8dc05c130 msgr2=0x7fd8dc146890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:53.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.956+0000 7fd8e117c700 1 --2- 172.21.15.133:0/4294364545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8dc05c130 0x7fd8dc146890 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fd8dc149b80 tx=0x7fd8c8008040).stop 2021-01-03T13:06:53.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.956+0000 7fd8e117c700 1 -- 172.21.15.133:0/4294364545 shutdown_connections 2021-01-03T13:06:53.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.956+0000 7fd8e117c700 1 --2- 172.21.15.133:0/4294364545 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd8b8055330 0x7fd8b80577f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.956+0000 7fd8e117c700 1 --2- 172.21.15.133:0/4294364545 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd8dc1477c0 0x7fd8dc156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.956+0000 7fd8e117c700 1 --2- 172.21.15.133:0/4294364545 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8dc05c130 0x7fd8dc146890 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.956+0000 7fd8e117c700 1 --2- 172.21.15.133:0/4294364545 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd8dc061890 0x7fd8dc149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:53.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.956+0000 7fd8e117c700 1 -- 172.21.15.133:0/4294364545 >> 172.21.15.133:0/4294364545 conn(0x7fd8dc0b6110 msgr2=0x7fd8dc0b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:53.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.956+0000 7fd8e117c700 1 -- 172.21.15.133:0/4294364545 shutdown_connections 2021-01-03T13:06:53.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:53.956+0000 7fd8e117c700 1 -- 172.21.15.133:0/4294364545 wait complete. 2021-01-03T13:06:53.963 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 61 2021-01-03T13:06:53.973 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-01-03T13:06:54.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.080+0000 7fa059a6b700 1 Processor -- start 2021-01-03T13:06:54.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.080+0000 7fa059a6b700 1 -- start start 2021-01-03T13:06:54.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.080+0000 7fa059a6b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa0540b0c30 0x7fa0541428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:54.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.080+0000 7fa059a6b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa0540b2050 0x7fa0540a8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:54.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.080+0000 7fa059a6b700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0540afa40 con 0x7fa0540b1300 2021-01-03T13:06:54.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.080+0000 7fa059a6b700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0540b25d0 con 0x7fa0540b2050 2021-01-03T13:06:54.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.080+0000 7fa059a6b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0540b2870 con 0x7fa0540b0c30 2021-01-03T13:06:54.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.080+0000 7fa053fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa0540b0c30 0x7fa0541428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:54.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.080+0000 7fa053fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa0540b0c30 0x7fa0541428c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39084/0 (socket says 172.21.15.133:39084) 2021-01-03T13:06:54.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.080+0000 7fa053fff700 1 -- 172.21.15.133:0/1445307599 learned_addr learned my addr 172.21.15.133:0/1445307599 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:54.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.080+0000 7fa05926a700 1 --2- 172.21.15.133:0/1445307599 >> v2:172.21.15.16:3300/0 conn(0x7fa0540b2050 0x7fa0540a8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:54.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.080+0000 7fa053fff700 1 -- 172.21.15.133:0/1445307599 >> v2:172.21.15.16:3300/0 conn(0x7fa0540b2050 msgr2=0x7fa0540a8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:54.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.080+0000 7fa053fff700 1 --2- 172.21.15.133:0/1445307599 >> v2:172.21.15.16:3300/0 conn(0x7fa0540b2050 0x7fa0540a8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:54.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.080+0000 7fa053fff700 1 -- 172.21.15.133:0/1445307599 >> v1:172.21.15.16:6789/0 conn(0x7fa0540b1300 legacy=0x7fa0540ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:54.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.080+0000 7fa053fff700 1 -- 172.21.15.133:0/1445307599 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0540ad040 con 0x7fa0540b0c30 2021-01-03T13:06:54.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.080+0000 7fa053fff700 1 --2- 172.21.15.133:0/1445307599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0540b0c30 0x7fa0541428c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fa03c0032b0 tx=0x7fa03c009270).ready entity=mon.1 client_cookie=229138194dafa8fb server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:54.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa0537fe700 1 -- 172.21.15.133:0/1445307599 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa03c00bdf0 con 0x7fa0540b0c30 2021-01-03T13:06:54.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa0537fe700 1 -- 172.21.15.133:0/1445307599 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c010470 con 0x7fa0540b0c30 2021-01-03T13:06:54.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa0537fe700 1 -- 172.21.15.133:0/1445307599 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa03c0107d0 con 0x7fa0540b0c30 2021-01-03T13:06:54.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa059a6b700 1 -- 172.21.15.133:0/1445307599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0540b0c30 msgr2=0x7fa0541428c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:54.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa059a6b700 1 --2- 172.21.15.133:0/1445307599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0540b0c30 0x7fa0541428c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fa03c0032b0 tx=0x7fa03c009270).stop 2021-01-03T13:06:54.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa059a6b700 1 -- 172.21.15.133:0/1445307599 shutdown_connections 2021-01-03T13:06:54.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa059a6b700 1 --2- 172.21.15.133:0/1445307599 >> v2:172.21.15.16:3300/0 conn(0x7fa0540b2050 0x7fa0540a8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:54.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa059a6b700 1 --2- 172.21.15.133:0/1445307599 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0540b0c30 0x7fa0541428c0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:54.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa059a6b700 1 -- 172.21.15.133:0/1445307599 >> 172.21.15.133:0/1445307599 conn(0x7fa05406b050 msgr2=0x7fa054060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:54.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa059a6b700 1 -- 172.21.15.133:0/1445307599 shutdown_connections 2021-01-03T13:06:54.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa059a6b700 1 -- 172.21.15.133:0/1445307599 wait complete. 2021-01-03T13:06:54.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa059a6b700 1 Processor -- start 2021-01-03T13:06:54.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa059a6b700 1 -- start start 2021-01-03T13:06:54.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa059a6b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0540b0c30 0x7fa05409ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:54.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa059a6b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0540b1300 0x7fa054064eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:54.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa059a6b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0540b2050 0x7fa0540653a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:54.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa059a6b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0540632d0 con 0x7fa0540b0c30 2021-01-03T13:06:54.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa059a6b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa054066a80 con 0x7fa0540b2050 2021-01-03T13:06:54.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.084+0000 7fa059a6b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa054065890 con 0x7fa0540b1300 2021-01-03T13:06:54.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa05926a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0540b2050 0x7fa0540653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa05926a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0540b2050 0x7fa0540653a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39092/0 (socket says 172.21.15.133:39092) 2021-01-03T13:06:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa05926a700 1 -- 172.21.15.133:0/1458667639 learned_addr learned my addr 172.21.15.133:0/1458667639 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa053fff700 1 --2- 172.21.15.133:0/1458667639 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0540b1300 0x7fa054064eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa058a69700 1 --2- 172.21.15.133:0/1458667639 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0540b0c30 0x7fa05409ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:54.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa05926a700 1 -- 172.21.15.133:0/1458667639 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0540b1300 msgr2=0x7fa054064eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa05926a700 1 --2- 172.21.15.133:0/1458667639 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0540b1300 0x7fa054064eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa05926a700 1 -- 172.21.15.133:0/1458667639 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0540b0c30 msgr2=0x7fa05409ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa05926a700 1 --2- 172.21.15.133:0/1458667639 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0540b0c30 0x7fa05409ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa05926a700 1 -- 172.21.15.133:0/1458667639 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa054063cd0 con 0x7fa0540b2050 2021-01-03T13:06:54.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa05926a700 1 --2- 172.21.15.133:0/1458667639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0540b2050 0x7fa0540653a0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7fa04c00a000 tx=0x7fa04c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:54.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa051ffb700 1 -- 172.21.15.133:0/1458667639 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa04c00f7e0 con 0x7fa0540b2050 2021-01-03T13:06:54.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa051ffb700 1 -- 172.21.15.133:0/1458667639 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04c00f940 con 0x7fa0540b2050 2021-01-03T13:06:54.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa059a6b700 1 -- 172.21.15.133:0/1458667639 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa054064480 con 0x7fa0540b2050 2021-01-03T13:06:54.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa051ffb700 1 -- 172.21.15.133:0/1458667639 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa04c00fca0 con 0x7fa0540b2050 2021-01-03T13:06:54.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa059a6b700 1 -- 172.21.15.133:0/1458667639 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05414e930 con 0x7fa0540b2050 2021-01-03T13:06:54.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa059a6b700 1 -- 172.21.15.133:0/1458667639 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa054057300 con 0x7fa0540b2050 2021-01-03T13:06:54.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa051ffb700 1 -- 172.21.15.133:0/1458667639 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa04c01a030 con 0x7fa0540b2050 2021-01-03T13:06:54.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa051ffb700 1 --2- 172.21.15.133:0/1458667639 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa038055440 0x7fa038057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:54.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa051ffb700 1 -- 172.21.15.133:0/1458667639 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa04c06dbb0 con 0x7fa0540b2050 2021-01-03T13:06:54.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.088+0000 7fa058a69700 1 --2- 172.21.15.133:0/1458667639 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa038055440 0x7fa038057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:54.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.092+0000 7fa058a69700 1 --2- 172.21.15.133:0/1458667639 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa038055440 0x7fa038057900 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fa04400d000 tx=0x7fa044009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:54.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.096+0000 7fa051ffb700 1 -- 172.21.15.133:0/1458667639 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa04c074080 con 0x7fa0540b2050 2021-01-03T13:06:54.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.280+0000 7fa059a6b700 1 -- 172.21.15.133:0/1458667639 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa05405f080 con 0x7fa0540b2050 2021-01-03T13:06:55.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:54.996+0000 7fa051ffb700 1 -- 172.21.15.133:0/1458667639 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v62) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa04c047890 con 0x7fa0540b2050 2021-01-03T13:06:55.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.000+0000 7fa059a6b700 1 -- 172.21.15.133:0/1458667639 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa038055440 msgr2=0x7fa038057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:55.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.000+0000 7fa059a6b700 1 --2- 172.21.15.133:0/1458667639 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa038055440 0x7fa038057900 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fa04400d000 tx=0x7fa044009040).stop 2021-01-03T13:06:55.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.000+0000 7fa059a6b700 1 -- 172.21.15.133:0/1458667639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0540b2050 msgr2=0x7fa0540653a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:55.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.000+0000 7fa059a6b700 1 --2- 172.21.15.133:0/1458667639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0540b2050 0x7fa0540653a0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7fa04c00a000 tx=0x7fa04c008040).stop 2021-01-03T13:06:55.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.000+0000 7fa059a6b700 1 -- 172.21.15.133:0/1458667639 shutdown_connections 2021-01-03T13:06:55.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.000+0000 7fa059a6b700 1 --2- 172.21.15.133:0/1458667639 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa038055440 0x7fa038057900 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.000+0000 7fa059a6b700 1 --2- 172.21.15.133:0/1458667639 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa0540b0c30 0x7fa05409ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.000+0000 7fa059a6b700 1 --2- 172.21.15.133:0/1458667639 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa0540b2050 0x7fa0540653a0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.000+0000 7fa059a6b700 1 --2- 172.21.15.133:0/1458667639 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa0540b1300 0x7fa054064eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.000+0000 7fa059a6b700 1 -- 172.21.15.133:0/1458667639 >> 172.21.15.133:0/1458667639 conn(0x7fa05406b050 msgr2=0x7fa0540670e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:55.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.000+0000 7fa059a6b700 1 -- 172.21.15.133:0/1458667639 shutdown_connections 2021-01-03T13:06:55.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.000+0000 7fa059a6b700 1 -- 172.21.15.133:0/1458667639 wait complete. 2021-01-03T13:06:55.010 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-01-03T13:06:55.025 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:06:55.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f0287fff700 1 Processor -- start 2021-01-03T13:06:55.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f0287fff700 1 -- start start 2021-01-03T13:06:55.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f0287fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f02880b0c90 0x7f02880b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:55.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f0287fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02880b5c00 0x7f0288143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:55.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f0287fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0288060da0 con 0x7f02880b52c0 2021-01-03T13:06:55.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f0287fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0288067a90 con 0x7f02880b0c90 2021-01-03T13:06:55.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f0287fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02880b0ad0 con 0x7f02880b5c00 2021-01-03T13:06:55.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f0286ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f02880b52c0 0x7f0288098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60128/0 (socket says 172.21.15.133:60128) 2021-01-03T13:06:55.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f0286ffd700 1 -- 172.21.15.133:0/3151708679 learned_addr learned my addr 172.21.15.133:0/3151708679 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:55.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f02867fc700 1 --2- 172.21.15.133:0/3151708679 >> v2:172.21.15.133:3300/0 conn(0x7f02880b0c90 0x7f02880b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:55.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f02877fe700 1 --2- 172.21.15.133:0/3151708679 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02880b5c00 0x7f0288143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:55.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f0285ffb700 1 -- 172.21.15.133:0/3151708679 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987386395 0 0) 0x7f0288060da0 con 0x7f02880b52c0 2021-01-03T13:06:55.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f0285ffb700 1 -- 172.21.15.133:0/3151708679 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0268003230 con 0x7f02880b52c0 2021-01-03T13:06:55.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f02867fc700 1 -- 172.21.15.133:0/3151708679 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02880b5c00 msgr2=0x7f0288143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:55.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f02867fc700 1 --2- 172.21.15.133:0/3151708679 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02880b5c00 0x7f0288143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f02867fc700 1 -- 172.21.15.133:0/3151708679 >> v1:172.21.15.133:6789/0 conn(0x7f02880b52c0 legacy=0x7f0288098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:55.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f02867fc700 1 -- 172.21.15.133:0/3151708679 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02880b56a0 con 0x7f02880b0c90 2021-01-03T13:06:55.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f02877fe700 1 --2- 172.21.15.133:0/3151708679 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02880b5c00 0x7f0288143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:55.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f02867fc700 1 --2- 172.21.15.133:0/3151708679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02880b0c90 0x7f02880b05e0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f02780032b0 tx=0x7f02780091a0).ready entity=mon.1 client_cookie=54b4d581058aa85 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:55.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f0285ffb700 1 -- 172.21.15.133:0/3151708679 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f027800b9a0 con 0x7f02880b0c90 2021-01-03T13:06:55.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f0285ffb700 1 -- 172.21.15.133:0/3151708679 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027800bb00 con 0x7f02880b0c90 2021-01-03T13:06:55.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f0285ffb700 1 -- 172.21.15.133:0/3151708679 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f027800bc70 con 0x7f02880b0c90 2021-01-03T13:06:55.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f0287fff700 1 -- 172.21.15.133:0/3151708679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02880b0c90 msgr2=0x7f02880b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:55.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.140+0000 7f0287fff700 1 --2- 172.21.15.133:0/3151708679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02880b0c90 0x7f02880b05e0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f02780032b0 tx=0x7f02780091a0).stop 2021-01-03T13:06:55.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.144+0000 7f0287fff700 1 -- 172.21.15.133:0/3151708679 shutdown_connections 2021-01-03T13:06:55.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.144+0000 7f0287fff700 1 --2- 172.21.15.133:0/3151708679 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02880b5c00 0x7f0288143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.144+0000 7f0287fff700 1 --2- 172.21.15.133:0/3151708679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02880b0c90 0x7f02880b05e0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.144+0000 7f0287fff700 1 -- 172.21.15.133:0/3151708679 >> 172.21.15.133:0/3151708679 conn(0x7f028805bdf0 msgr2=0x7f028805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:55.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.144+0000 7f0287fff700 1 -- 172.21.15.133:0/3151708679 shutdown_connections 2021-01-03T13:06:55.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.144+0000 7f0287fff700 1 -- 172.21.15.133:0/3151708679 wait complete. 2021-01-03T13:06:55.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.144+0000 7f0287fff700 1 Processor -- start 2021-01-03T13:06:55.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.144+0000 7f0287fff700 1 -- start start 2021-01-03T13:06:55.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f0287fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02880b0c90 0x7f02880ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:55.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f0287fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02880b52c0 0x7f02880b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:55.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f0287fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02880b5c00 0x7f02880ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:55.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f0287fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0288066830 con 0x7f02880b5c00 2021-01-03T13:06:55.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f0287fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02880af120 con 0x7f02880b52c0 2021-01-03T13:06:55.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f0287fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0288066ca0 con 0x7f02880b0c90 2021-01-03T13:06:55.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f02867fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02880b52c0 0x7f02880b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:55.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f02867fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02880b52c0 0x7f02880b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39104/0 (socket says 172.21.15.133:39104) 2021-01-03T13:06:55.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f02867fc700 1 -- 172.21.15.133:0/3851326566 learned_addr learned my addr 172.21.15.133:0/3851326566 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:55.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f0286ffd700 1 --2- 172.21.15.133:0/3851326566 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02880b0c90 0x7f02880ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:55.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f02877fe700 1 --2- 172.21.15.133:0/3851326566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02880b5c00 0x7f02880ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:55.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f02867fc700 1 -- 172.21.15.133:0/3851326566 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02880b0c90 msgr2=0x7f02880ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:55.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f02867fc700 1 --2- 172.21.15.133:0/3851326566 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02880b0c90 0x7f02880ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f02867fc700 1 -- 172.21.15.133:0/3851326566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02880b5c00 msgr2=0x7f02880ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:55.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f02867fc700 1 --2- 172.21.15.133:0/3851326566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02880b5c00 0x7f02880ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f02867fc700 1 -- 172.21.15.133:0/3851326566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0288066f40 con 0x7f02880b52c0 2021-01-03T13:06:55.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f02877fe700 1 --2- 172.21.15.133:0/3851326566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02880b5c00 0x7f02880ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:06:55.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f02867fc700 1 --2- 172.21.15.133:0/3851326566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02880b52c0 0x7f02880b46f0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f02780032b0 tx=0x7f0278016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:55.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f027ffff700 1 -- 172.21.15.133:0/3851326566 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f027800bc70 con 0x7f02880b52c0 2021-01-03T13:06:55.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f027ffff700 1 -- 172.21.15.133:0/3851326566 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027801f5e0 con 0x7f02880b52c0 2021-01-03T13:06:55.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f0287fff700 1 -- 172.21.15.133:0/3851326566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02880669e0 con 0x7f02880b52c0 2021-01-03T13:06:55.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f027ffff700 1 -- 172.21.15.133:0/3851326566 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f027801f940 con 0x7f02880b52c0 2021-01-03T13:06:55.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f0287fff700 1 -- 172.21.15.133:0/3851326566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02880ad730 con 0x7f02880b52c0 2021-01-03T13:06:55.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.148+0000 7f0287fff700 1 -- 172.21.15.133:0/3851326566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02880670d0 con 0x7f02880b52c0 2021-01-03T13:06:55.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.152+0000 7f027ffff700 1 -- 172.21.15.133:0/3851326566 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0278026030 con 0x7f02880b52c0 2021-01-03T13:06:55.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.152+0000 7f027ffff700 1 --2- 172.21.15.133:0/3851326566 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f026c055440 0x7f026c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:55.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.152+0000 7f027ffff700 1 -- 172.21.15.133:0/3851326566 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f027806eda0 con 0x7f02880b52c0 2021-01-03T13:06:55.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.152+0000 7f0286ffd700 1 --2- 172.21.15.133:0/3851326566 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f026c055440 0x7f026c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:55.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.152+0000 7f0286ffd700 1 --2- 172.21.15.133:0/3851326566 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f026c055440 0x7f026c057900 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f028000b000 tx=0x7f0280009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:55.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.160+0000 7f027ffff700 1 -- 172.21.15.133:0/3851326566 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0278044f40 con 0x7f02880b52c0 2021-01-03T13:06:55.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.348+0000 7f0287fff700 1 -- 172.21.15.133:0/3851326566 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0288057300 con 0x7f02880b52c0 2021-01-03T13:06:55.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.348+0000 7f027ffff700 1 -- 172.21.15.133:0/3851326566 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+1426 (secure 0 0 0) 0x7f0278024090 con 0x7f02880b52c0 2021-01-03T13:06:55.354 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:55.354 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":62,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":62,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:06:50.024762+0000","modified":"2021-01-03T13:06:54.996970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2021-01-03T13:06:55.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.348+0000 7f0287fff700 1 -- 172.21.15.133:0/3851326566 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f026c055440 msgr2=0x7f026c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:55.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.348+0000 7f0287fff700 1 --2- 172.21.15.133:0/3851326566 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f026c055440 0x7f026c057900 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f028000b000 tx=0x7f0280009040).stop 2021-01-03T13:06:55.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.348+0000 7f0287fff700 1 -- 172.21.15.133:0/3851326566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02880b52c0 msgr2=0x7f02880b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:55.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.348+0000 7f0287fff700 1 --2- 172.21.15.133:0/3851326566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02880b52c0 0x7f02880b46f0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f02780032b0 tx=0x7f0278016000).stop 2021-01-03T13:06:55.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.348+0000 7f0287fff700 1 -- 172.21.15.133:0/3851326566 shutdown_connections 2021-01-03T13:06:55.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.348+0000 7f0287fff700 1 --2- 172.21.15.133:0/3851326566 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f026c055440 0x7f026c057900 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.348+0000 7f0287fff700 1 --2- 172.21.15.133:0/3851326566 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02880b5c00 0x7f02880ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.348+0000 7f0287fff700 1 --2- 172.21.15.133:0/3851326566 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02880b0c90 0x7f02880ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.348+0000 7f0287fff700 1 --2- 172.21.15.133:0/3851326566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02880b52c0 0x7f02880b46f0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.348+0000 7f0287fff700 1 -- 172.21.15.133:0/3851326566 >> 172.21.15.133:0/3851326566 conn(0x7f028805bdf0 msgr2=0x7f02880b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:55.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.348+0000 7f0287fff700 1 -- 172.21.15.133:0/3851326566 shutdown_connections 2021-01-03T13:06:55.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.348+0000 7f0287fff700 1 -- 172.21.15.133:0/3851326566 wait complete. 2021-01-03T13:06:55.358 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 62 2021-01-03T13:06:55.371 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-01-03T13:06:55.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f9063700 1 Processor -- start 2021-01-03T13:06:55.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f9063700 1 -- start start 2021-01-03T13:06:55.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f9063700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63f40b0c30 0x7f63f41428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:55.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f9063700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63f40b2050 0x7f63f40a8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:55.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f9063700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f40afa40 con 0x7f63f40b1300 2021-01-03T13:06:55.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f9063700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f40b25d0 con 0x7f63f40b2050 2021-01-03T13:06:55.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f9063700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f40b2870 con 0x7f63f40b0c30 2021-01-03T13:06:55.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f8862700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f63f40b2050 0x7f63f40a8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:55.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f3fff700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f63f40b1300 0x7f63f40ad4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:38870/0 (socket says 172.21.15.133:38870) 2021-01-03T13:06:55.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f3fff700 1 -- 172.21.15.133:0/1308871318 learned_addr learned my addr 172.21.15.133:0/1308871318 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:55.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63ebfff700 1 --2- 172.21.15.133:0/1308871318 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63f40b0c30 0x7f63f41428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:55.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f37fe700 1 -- 172.21.15.133:0/1308871318 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717340556 0 0) 0x7f63f40afa40 con 0x7f63f40b1300 2021-01-03T13:06:55.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f37fe700 1 -- 172.21.15.133:0/1308871318 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63d4003230 con 0x7f63f40b1300 2021-01-03T13:06:55.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f8862700 1 -- 172.21.15.133:0/1308871318 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63f40b0c30 msgr2=0x7f63f41428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:55.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f8862700 1 --2- 172.21.15.133:0/1308871318 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63f40b0c30 0x7f63f41428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f8862700 1 -- 172.21.15.133:0/1308871318 >> v1:172.21.15.16:6789/0 conn(0x7f63f40b1300 legacy=0x7f63f40ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:55.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f8862700 1 -- 172.21.15.133:0/1308871318 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f40ad040 con 0x7f63f40b2050 2021-01-03T13:06:55.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f8862700 1 --2- 172.21.15.133:0/1308871318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f40b2050 0x7f63f40a8850 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f63ec0032b0 tx=0x7f63ec0091a0).ready entity=mon.1 client_cookie=a1c1dcfdf6224ce3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:55.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f37fe700 1 -- 172.21.15.133:0/1308871318 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63ec00b940 con 0x7f63f40b2050 2021-01-03T13:06:55.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f37fe700 1 -- 172.21.15.133:0/1308871318 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ec00baa0 con 0x7f63f40b2050 2021-01-03T13:06:55.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f37fe700 1 -- 172.21.15.133:0/1308871318 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63ec00bc10 con 0x7f63f40b2050 2021-01-03T13:06:55.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f9063700 1 -- 172.21.15.133:0/1308871318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f40b2050 msgr2=0x7f63f40a8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:55.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.484+0000 7f63f9063700 1 --2- 172.21.15.133:0/1308871318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f40b2050 0x7f63f40a8850 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f63ec0032b0 tx=0x7f63ec0091a0).stop 2021-01-03T13:06:55.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f9063700 1 -- 172.21.15.133:0/1308871318 shutdown_connections 2021-01-03T13:06:55.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f9063700 1 --2- 172.21.15.133:0/1308871318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f40b2050 0x7f63f40a8850 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f9063700 1 --2- 172.21.15.133:0/1308871318 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63f40b0c30 0x7f63f41428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f9063700 1 -- 172.21.15.133:0/1308871318 >> 172.21.15.133:0/1308871318 conn(0x7f63f406b050 msgr2=0x7f63f4060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:55.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f9063700 1 -- 172.21.15.133:0/1308871318 shutdown_connections 2021-01-03T13:06:55.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f9063700 1 -- 172.21.15.133:0/1308871318 wait complete. 2021-01-03T13:06:55.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f9063700 1 Processor -- start 2021-01-03T13:06:55.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f9063700 1 -- start start 2021-01-03T13:06:55.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f9063700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f40b0c30 0x7f63f4065bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:55.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f9063700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63f40b1300 0x7f63f40ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:55.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f9063700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f40b2050 0x7f63f40637c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:55.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f9063700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f4065250 con 0x7f63f40b0c30 2021-01-03T13:06:55.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f9063700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f4063080 con 0x7f63f40b2050 2021-01-03T13:06:55.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f9063700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f4063320 con 0x7f63f40b1300 2021-01-03T13:06:55.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f8862700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f40b2050 0x7f63f40637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:55.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63ebfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63f40b1300 0x7f63f40ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:55.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f8862700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f40b2050 0x7f63f40637c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39120/0 (socket says 172.21.15.133:39120) 2021-01-03T13:06:55.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f8862700 1 -- 172.21.15.133:0/796186620 learned_addr learned my addr 172.21.15.133:0/796186620 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:55.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.488+0000 7f63f3fff700 1 --2- 172.21.15.133:0/796186620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f40b0c30 0x7f63f4065bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:55.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.492+0000 7f63f8862700 1 -- 172.21.15.133:0/796186620 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63f40b1300 msgr2=0x7f63f40ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:55.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.492+0000 7f63f8862700 1 --2- 172.21.15.133:0/796186620 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63f40b1300 0x7f63f40ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.492+0000 7f63f8862700 1 -- 172.21.15.133:0/796186620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f40b0c30 msgr2=0x7f63f4065bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:55.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.492+0000 7f63f8862700 1 --2- 172.21.15.133:0/796186620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f40b0c30 0x7f63f4065bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:55.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.492+0000 7f63f8862700 1 -- 172.21.15.133:0/796186620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f4064510 con 0x7f63f40b2050 2021-01-03T13:06:55.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.492+0000 7f63f8862700 1 --2- 172.21.15.133:0/796186620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f40b2050 0x7f63f40637c0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f63ec0032b0 tx=0x7f63ec016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:55.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.492+0000 7f63f1ffb700 1 -- 172.21.15.133:0/796186620 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63ec0205f0 con 0x7f63f40b2050 2021-01-03T13:06:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.492+0000 7f63f1ffb700 1 -- 172.21.15.133:0/796186620 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ec020750 con 0x7f63f40b2050 2021-01-03T13:06:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.492+0000 7f63f9063700 1 -- 172.21.15.133:0/796186620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f4064e20 con 0x7f63f40b2050 2021-01-03T13:06:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.492+0000 7f63f1ffb700 1 -- 172.21.15.133:0/796186620 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63ec020ab0 con 0x7f63f40b2050 2021-01-03T13:06:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.492+0000 7f63f9063700 1 -- 172.21.15.133:0/796186620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f4063e50 con 0x7f63f40b2050 2021-01-03T13:06:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.492+0000 7f63f1ffb700 1 -- 172.21.15.133:0/796186620 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f63ec027030 con 0x7f63f40b2050 2021-01-03T13:06:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.492+0000 7f63f9063700 1 -- 172.21.15.133:0/796186620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f40634e0 con 0x7f63f40b2050 2021-01-03T13:06:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.492+0000 7f63f1ffb700 1 --2- 172.21.15.133:0/796186620 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63d8055440 0x7f63d8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.492+0000 7f63f1ffb700 1 -- 172.21.15.133:0/796186620 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f63ec06f230 con 0x7f63f40b2050 2021-01-03T13:06:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.492+0000 7f63f3fff700 1 --2- 172.21.15.133:0/796186620 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63d8055440 0x7f63d8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.492+0000 7f63f3fff700 1 --2- 172.21.15.133:0/796186620 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63d8055440 0x7f63d8057900 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f63e400d000 tx=0x7f63e4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.500+0000 7f63f1ffb700 1 -- 172.21.15.133:0/796186620 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f63ec045500 con 0x7f63f40b2050 2021-01-03T13:06:55.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:55.684+0000 7f63f9063700 1 -- 172.21.15.133:0/796186620 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f63f40646a0 con 0x7f63f40b2050 2021-01-03T13:06:56.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.000+0000 7f63f1ffb700 1 -- 172.21.15.133:0/796186620 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7f63ec048a60 con 0x7f63f40b2050 2021-01-03T13:06:56.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.004+0000 7f63f9063700 1 -- 172.21.15.133:0/796186620 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63d8055440 msgr2=0x7f63d8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:56.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.004+0000 7f63f9063700 1 --2- 172.21.15.133:0/796186620 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63d8055440 0x7f63d8057900 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f63e400d000 tx=0x7f63e4009040).stop 2021-01-03T13:06:56.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.004+0000 7f63f9063700 1 -- 172.21.15.133:0/796186620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f40b2050 msgr2=0x7f63f40637c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:56.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.004+0000 7f63f9063700 1 --2- 172.21.15.133:0/796186620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f40b2050 0x7f63f40637c0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f63ec0032b0 tx=0x7f63ec016000).stop 2021-01-03T13:06:56.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.004+0000 7f63f9063700 1 -- 172.21.15.133:0/796186620 shutdown_connections 2021-01-03T13:06:56.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.004+0000 7f63f9063700 1 --2- 172.21.15.133:0/796186620 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f63d8055440 0x7f63d8057900 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:56.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.004+0000 7f63f9063700 1 --2- 172.21.15.133:0/796186620 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f40b0c30 0x7f63f4065bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:56.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.004+0000 7f63f9063700 1 --2- 172.21.15.133:0/796186620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f63f40b2050 0x7f63f40637c0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:56.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.004+0000 7f63f9063700 1 --2- 172.21.15.133:0/796186620 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f63f40b1300 0x7f63f40ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:56.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.004+0000 7f63f9063700 1 -- 172.21.15.133:0/796186620 >> 172.21.15.133:0/796186620 conn(0x7f63f406b050 msgr2=0x7f63f40b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.004+0000 7f63f9063700 1 -- 172.21.15.133:0/796186620 shutdown_connections 2021-01-03T13:06:56.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.004+0000 7f63f9063700 1 -- 172.21.15.133:0/796186620 wait complete. 2021-01-03T13:06:56.031 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-01-03T13:06:56.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff21d742700 1 Processor -- start 2021-01-03T13:06:56.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff21d742700 1 -- start start 2021-01-03T13:06:56.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff21d742700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff2180b2990 0x7ff218146300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:56.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff21d742700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff2180b34e0 0x7ff218140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:56.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff21d742700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2181467f0 con 0x7ff2180b7ab0 2021-01-03T13:06:56.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff21d742700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2180b30f0 con 0x7ff2180b34e0 2021-01-03T13:06:56.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff21d742700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff218061480 con 0x7ff2180b2990 2021-01-03T13:06:56.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff2177fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff2180b2990 0x7ff218146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:56.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff2177fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff2180b2990 0x7ff218146300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39124/0 (socket says 172.21.15.133:39124) 2021-01-03T13:06:56.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff2177fe700 1 -- 172.21.15.133:0/770629938 learned_addr learned my addr 172.21.15.133:0/770629938 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:56.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff21cf41700 1 --2- 172.21.15.133:0/770629938 >> v2:172.21.15.16:3300/0 conn(0x7ff2180b34e0 0x7ff218140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:56.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff2177fe700 1 -- 172.21.15.133:0/770629938 >> v2:172.21.15.16:3300/0 conn(0x7ff2180b34e0 msgr2=0x7ff218140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:56.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff2177fe700 1 --2- 172.21.15.133:0/770629938 >> v2:172.21.15.16:3300/0 conn(0x7ff2180b34e0 0x7ff218140060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:56.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff2177fe700 1 -- 172.21.15.133:0/770629938 >> v1:172.21.15.16:6789/0 conn(0x7ff2180b7ab0 legacy=0x7ff2180b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:56.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff2177fe700 1 -- 172.21.15.133:0/770629938 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff218061720 con 0x7ff2180b2990 2021-01-03T13:06:56.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff21cf41700 1 --2- 172.21.15.133:0/770629938 >> v2:172.21.15.16:3300/0 conn(0x7ff2180b34e0 0x7ff218140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:06:56.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff2177fe700 1 --2- 172.21.15.133:0/770629938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2180b2990 0x7ff218146300 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7ff2180b33c0 tx=0x7ff200009220).ready entity=mon.1 client_cookie=7cef19ddf75bdc91 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:56.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff216ffd700 1 -- 172.21.15.133:0/770629938 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff20000bbc0 con 0x7ff2180b2990 2021-01-03T13:06:56.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff216ffd700 1 -- 172.21.15.133:0/770629938 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20000bd20 con 0x7ff2180b2990 2021-01-03T13:06:56.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff216ffd700 1 -- 172.21.15.133:0/770629938 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff20000be90 con 0x7ff2180b2990 2021-01-03T13:06:56.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff21d742700 1 -- 172.21.15.133:0/770629938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2180b2990 msgr2=0x7ff218146300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:56.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff21d742700 1 --2- 172.21.15.133:0/770629938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2180b2990 0x7ff218146300 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7ff2180b33c0 tx=0x7ff200009220).stop 2021-01-03T13:06:56.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff21d742700 1 -- 172.21.15.133:0/770629938 shutdown_connections 2021-01-03T13:06:56.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff21d742700 1 --2- 172.21.15.133:0/770629938 >> v2:172.21.15.16:3300/0 conn(0x7ff2180b34e0 0x7ff218140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:56.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff21d742700 1 --2- 172.21.15.133:0/770629938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2180b2990 0x7ff218146300 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:56.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff21d742700 1 -- 172.21.15.133:0/770629938 >> 172.21.15.133:0/770629938 conn(0x7ff21805c8c0 msgr2=0x7ff2180b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:56.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff21d742700 1 -- 172.21.15.133:0/770629938 shutdown_connections 2021-01-03T13:06:56.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.144+0000 7ff21d742700 1 -- 172.21.15.133:0/770629938 wait complete. 2021-01-03T13:06:56.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21d742700 1 Processor -- start 2021-01-03T13:06:56.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21d742700 1 -- start start 2021-01-03T13:06:56.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21d742700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2180b2990 0x7ff2180672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:56.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21d742700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2180b34e0 0x7ff21813b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:56.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21d742700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2180b7ab0 0x7ff21813ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:56.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21d742700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff218149330 con 0x7ff2180b2990 2021-01-03T13:06:56.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21d742700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180b5f00 con 0x7ff2180b7ab0 2021-01-03T13:06:56.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21d742700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff218066b90 con 0x7ff2180b34e0 2021-01-03T13:06:56.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21cf41700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2180b7ab0 0x7ff21813ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:56.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21cf41700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2180b7ab0 0x7ff21813ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39134/0 (socket says 172.21.15.133:39134) 2021-01-03T13:06:56.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21cf41700 1 -- 172.21.15.133:0/149973336 learned_addr learned my addr 172.21.15.133:0/149973336 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:56.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff2177fe700 1 --2- 172.21.15.133:0/149973336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2180b34e0 0x7ff21813b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:56.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff217fff700 1 --2- 172.21.15.133:0/149973336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2180b2990 0x7ff2180672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:56.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21cf41700 1 -- 172.21.15.133:0/149973336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2180b34e0 msgr2=0x7ff21813b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:56.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21cf41700 1 --2- 172.21.15.133:0/149973336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2180b34e0 0x7ff21813b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:56.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21cf41700 1 -- 172.21.15.133:0/149973336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2180b2990 msgr2=0x7ff2180672e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:56.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21cf41700 1 --2- 172.21.15.133:0/149973336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2180b2990 0x7ff2180672e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:56.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21cf41700 1 -- 172.21.15.133:0/149973336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff218148d00 con 0x7ff2180b7ab0 2021-01-03T13:06:56.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21cf41700 1 --2- 172.21.15.133:0/149973336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2180b7ab0 0x7ff21813ba90 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7ff210007000 tx=0x7ff210008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:56.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff2157fa700 1 -- 172.21.15.133:0/149973336 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff210007560 con 0x7ff2180b7ab0 2021-01-03T13:06:56.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff2157fa700 1 -- 172.21.15.133:0/149973336 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2100076c0 con 0x7ff2180b7ab0 2021-01-03T13:06:56.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff2157fa700 1 -- 172.21.15.133:0/149973336 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff210007a60 con 0x7ff2180b7ab0 2021-01-03T13:06:56.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21d742700 1 -- 172.21.15.133:0/149973336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2180b5600 con 0x7ff2180b7ab0 2021-01-03T13:06:56.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.148+0000 7ff21d742700 1 -- 172.21.15.133:0/149973336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff218064b10 con 0x7ff2180b7ab0 2021-01-03T13:06:56.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.152+0000 7ff21d742700 1 -- 172.21.15.133:0/149973336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2180b6100 con 0x7ff2180b7ab0 2021-01-03T13:06:56.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.152+0000 7ff2157fa700 1 -- 172.21.15.133:0/149973336 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff210019030 con 0x7ff2180b7ab0 2021-01-03T13:06:56.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.152+0000 7ff2157fa700 1 --2- 172.21.15.133:0/149973336 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff1fc055330 0x7ff1fc0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:56.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.152+0000 7ff2157fa700 1 -- 172.21.15.133:0/149973336 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff21006dba0 con 0x7ff2180b7ab0 2021-01-03T13:06:56.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.152+0000 7ff217fff700 1 --2- 172.21.15.133:0/149973336 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff1fc055330 0x7ff1fc0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:56.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.152+0000 7ff217fff700 1 --2- 172.21.15.133:0/149973336 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff1fc055330 0x7ff1fc0577f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7ff20800a000 tx=0x7ff208008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:56.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.156+0000 7ff2157fa700 1 -- 172.21.15.133:0/149973336 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff210043e50 con 0x7ff2180b7ab0 2021-01-03T13:06:56.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:56.300+0000 7ff21d742700 1 -- 172.21.15.133:0/149973336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff218066d50 con 0x7ff2180b7ab0 2021-01-03T13:06:57.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.020+0000 7ff2157fa700 1 -- 172.21.15.133:0/149973336 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v137) v1 ==== 185+0+0 (secure 0 0 0) 0x7ff210047470 con 0x7ff2180b7ab0 2021-01-03T13:06:57.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.024+0000 7ff21d742700 1 -- 172.21.15.133:0/149973336 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff1fc055330 msgr2=0x7ff1fc0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:57.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.024+0000 7ff21d742700 1 --2- 172.21.15.133:0/149973336 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff1fc055330 0x7ff1fc0577f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7ff20800a000 tx=0x7ff208008040).stop 2021-01-03T13:06:57.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.024+0000 7ff21d742700 1 -- 172.21.15.133:0/149973336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2180b7ab0 msgr2=0x7ff21813ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:57.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.024+0000 7ff21d742700 1 --2- 172.21.15.133:0/149973336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2180b7ab0 0x7ff21813ba90 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7ff210007000 tx=0x7ff210008040).stop 2021-01-03T13:06:57.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.024+0000 7ff21d742700 1 -- 172.21.15.133:0/149973336 shutdown_connections 2021-01-03T13:06:57.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.024+0000 7ff21d742700 1 --2- 172.21.15.133:0/149973336 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff1fc055330 0x7ff1fc0577f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:57.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.024+0000 7ff21d742700 1 --2- 172.21.15.133:0/149973336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2180b2990 0x7ff2180672e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:57.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.024+0000 7ff21d742700 1 --2- 172.21.15.133:0/149973336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2180b7ab0 0x7ff21813ba90 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:57.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.024+0000 7ff21d742700 1 --2- 172.21.15.133:0/149973336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2180b34e0 0x7ff21813b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:57.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.024+0000 7ff21d742700 1 -- 172.21.15.133:0/149973336 >> 172.21.15.133:0/149973336 conn(0x7ff21805c8c0 msgr2=0x7ff218144130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:57.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.024+0000 7ff21d742700 1 -- 172.21.15.133:0/149973336 shutdown_connections 2021-01-03T13:06:57.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.024+0000 7ff21d742700 1 -- 172.21.15.133:0/149973336 wait complete. 2021-01-03T13:06:57.034 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2021-01-03T13:06:57.045 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-01-03T13:06:57.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0ccd461700 1 Processor -- start 2021-01-03T13:06:57.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0ccd461700 1 -- start start 2021-01-03T13:06:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0ccd461700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc80622f0 0x7f0cc8066fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:57.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0ccd461700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc805c510 con 0x7f0cc80b02b0 2021-01-03T13:06:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0ccd461700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc80b15a0 con 0x7f0cc805c130 2021-01-03T13:06:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0ccd461700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc81473d0 con 0x7f0cc80622f0 2021-01-03T13:06:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc7fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0cc805c130 0x7f0cc80b1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60170/0 (socket says 172.21.15.133:60170) 2021-01-03T13:06:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc7fff700 1 -- 172.21.15.133:0/698515878 learned_addr learned my addr 172.21.15.133:0/698515878 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:57.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cccc60700 1 --2- 172.21.15.133:0/698515878 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc80622f0 0x7f0cc8066fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:57.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc6ffd700 1 -- 172.21.15.133:0/698515878 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484611764 0 0) 0x7f0cc80b15a0 con 0x7f0cc805c130 2021-01-03T13:06:57.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc6ffd700 1 -- 172.21.15.133:0/698515878 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ca8003230 con 0x7f0cc805c130 2021-01-03T13:06:57.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc6ffd700 1 -- 172.21.15.133:0/698515878 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469355893 0 0) 0x7f0cc805c510 con 0x7f0cc80b02b0 2021-01-03T13:06:57.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc6ffd700 1 -- 172.21.15.133:0/698515878 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc80b15a0 con 0x7f0cc80b02b0 2021-01-03T13:06:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc6ffd700 1 -- 172.21.15.133:0/698515878 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3404685032 0 0) 0x7f0ca8003230 con 0x7f0cc805c130 2021-01-03T13:06:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc6ffd700 1 -- 172.21.15.133:0/698515878 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc80622f0 msgr2=0x7f0cc8066fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc6ffd700 1 --2- 172.21.15.133:0/698515878 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc80622f0 0x7f0cc8066fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:57.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc6ffd700 1 -- 172.21.15.133:0/698515878 >> v1:172.21.15.16:6789/0 conn(0x7f0cc80b02b0 legacy=0x7f0cc80668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc6ffd700 1 -- 172.21.15.133:0/698515878 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc8061920 con 0x7f0cc805c130 2021-01-03T13:06:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc6ffd700 1 -- 172.21.15.133:0/698515878 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f0cb0001730 con 0x7f0cc805c130 2021-01-03T13:06:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc6ffd700 1 -- 172.21.15.133:0/698515878 >> v1:172.21.15.133:6789/0 conn(0x7f0cc805c130 legacy=0x7f0cc80b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc6ffd700 1 --2- 172.21.15.133:0/698515878 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc80622f0 0x7f0ca80038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:57.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc6ffd700 1 --2- 172.21.15.133:0/698515878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca8003da0 0x7f0ca80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:57.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc6ffd700 1 --2- 172.21.15.133:0/698515878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ca80049c0 0x7f0ca8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:57.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc6ffd700 1 -- 172.21.15.133:0/698515878 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc81473d0 con 0x7f0ca80049c0 2021-01-03T13:06:57.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc6ffd700 1 -- 172.21.15.133:0/698515878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8005330 con 0x7f0ca8003da0 2021-01-03T13:06:57.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc6ffd700 1 -- 172.21.15.133:0/698515878 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca800b750 con 0x7f0cc80622f0 2021-01-03T13:06:57.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc77fe700 1 --2- 172.21.15.133:0/698515878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca8003da0 0x7f0ca80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:57.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc7fff700 1 --2- 172.21.15.133:0/698515878 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc80622f0 0x7f0ca80038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:57.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cccc60700 1 --2- 172.21.15.133:0/698515878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ca80049c0 0x7f0ca8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:57.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc77fe700 1 -- 172.21.15.133:0/698515878 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc80622f0 msgr2=0x7f0ca80038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:57.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc77fe700 1 --2- 172.21.15.133:0/698515878 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc80622f0 0x7f0ca80038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:57.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc77fe700 1 -- 172.21.15.133:0/698515878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ca80049c0 msgr2=0x7f0ca8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:57.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc77fe700 1 --2- 172.21.15.133:0/698515878 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ca80049c0 0x7f0ca8004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:57.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.160+0000 7f0cc77fe700 1 -- 172.21.15.133:0/698515878 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca8003230 con 0x7f0ca8003da0 2021-01-03T13:06:57.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0cc77fe700 1 --2- 172.21.15.133:0/698515878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca8003da0 0x7f0ca80044d0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f0cb80010d0 tx=0x7f0cb8007b60).ready entity=mon.1 client_cookie=1de1b344a1fa8140 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:57.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0cc6ffd700 1 -- 172.21.15.133:0/698515878 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cb800c870 con 0x7f0ca8003da0 2021-01-03T13:06:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0cc6ffd700 1 -- 172.21.15.133:0/698515878 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb800c9d0 con 0x7f0ca8003da0 2021-01-03T13:06:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0cc6ffd700 1 -- 172.21.15.133:0/698515878 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cb800cd30 con 0x7f0ca8003da0 2021-01-03T13:06:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0ccd461700 1 -- 172.21.15.133:0/698515878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca8003da0 msgr2=0x7f0ca80044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0ccd461700 1 --2- 172.21.15.133:0/698515878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ca8003da0 0x7f0ca80044d0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f0cb80010d0 tx=0x7f0cb8007b60).stop 2021-01-03T13:06:57.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0cccc60700 1 -- 172.21.15.133:0/698515878 reap_dead start 2021-01-03T13:06:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0ccd461700 1 -- 172.21.15.133:0/698515878 shutdown_connections 2021-01-03T13:06:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0ccd461700 1 -- 172.21.15.133:0/698515878 >> 172.21.15.133:0/698515878 conn(0x7f0cc80b6110 msgr2=0x7f0cc80b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0ccd461700 1 -- 172.21.15.133:0/698515878 shutdown_connections 2021-01-03T13:06:57.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0ccd461700 1 -- 172.21.15.133:0/698515878 wait complete. 2021-01-03T13:06:57.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0ccd461700 1 Processor -- start 2021-01-03T13:06:57.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0ccd461700 1 -- start start 2021-01-03T13:06:57.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0ccd461700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc8064660 0x7f0cc81552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:57.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0ccd461700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc80653d0 0x7f0cc80661a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:57.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0ccd461700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc80ac250 0x7f0cc80ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:57.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0ccd461700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc8064a40 con 0x7f0cc80ac250 2021-01-03T13:06:57.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0ccd461700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc8141c90 con 0x7f0cc8064660 2021-01-03T13:06:57.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0ccd461700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc8141f30 con 0x7f0cc80653d0 2021-01-03T13:06:57.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0cc7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc8064660 0x7f0cc81552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:57.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0cc7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc8064660 0x7f0cc81552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39150/0 (socket says 172.21.15.133:39150) 2021-01-03T13:06:57.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0cc7fff700 1 -- 172.21.15.133:0/3266117747 learned_addr learned my addr 172.21.15.133:0/3266117747 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:57.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0cc77fe700 1 --2- 172.21.15.133:0/3266117747 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc80653d0 0x7f0cc80661a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:57.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0cccc60700 1 --2- 172.21.15.133:0/3266117747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc80ac250 0x7f0cc80ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:57.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0cc7fff700 1 -- 172.21.15.133:0/3266117747 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc80653d0 msgr2=0x7f0cc80661a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:57.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0cc7fff700 1 --2- 172.21.15.133:0/3266117747 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc80653d0 0x7f0cc80661a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:57.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0cc7fff700 1 -- 172.21.15.133:0/3266117747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc80ac250 msgr2=0x7f0cc80ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:57.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.164+0000 7f0cc7fff700 1 --2- 172.21.15.133:0/3266117747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc80ac250 0x7f0cc80ac6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:57.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.168+0000 7f0cc7fff700 1 -- 172.21.15.133:0/3266117747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc8065d00 con 0x7f0cc8064660 2021-01-03T13:06:57.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.168+0000 7f0cc77fe700 1 --2- 172.21.15.133:0/3266117747 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc80653d0 0x7f0cc80661a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.168+0000 7f0cccc60700 1 --2- 172.21.15.133:0/3266117747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc80ac250 0x7f0cc80ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.168+0000 7f0cc7fff700 1 --2- 172.21.15.133:0/3266117747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc8064660 0x7f0cc81552a0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f0cb000b000 tx=0x7f0cc805c8d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.168+0000 7f0cc57fa700 1 -- 172.21.15.133:0/3266117747 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cb000c9e0 con 0x7f0cc8064660 2021-01-03T13:06:57.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.168+0000 7f0cc57fa700 1 -- 172.21.15.133:0/3266117747 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb000cb40 con 0x7f0cc8064660 2021-01-03T13:06:57.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.168+0000 7f0cc57fa700 1 -- 172.21.15.133:0/3266117747 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cb000cea0 con 0x7f0cc8064660 2021-01-03T13:06:57.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.168+0000 7f0ccd461700 1 -- 172.21.15.133:0/3266117747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc80659e0 con 0x7f0cc8064660 2021-01-03T13:06:57.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.168+0000 7f0ccd461700 1 -- 172.21.15.133:0/3266117747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc8066690 con 0x7f0cc8064660 2021-01-03T13:06:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.168+0000 7f0cc57fa700 1 -- 172.21.15.133:0/3266117747 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0cb0014430 con 0x7f0cc8064660 2021-01-03T13:06:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.168+0000 7f0ccd461700 1 -- 172.21.15.133:0/3266117747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc8065e90 con 0x7f0cc8064660 2021-01-03T13:06:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.168+0000 7f0cc57fa700 1 --2- 172.21.15.133:0/3266117747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0cac0553b0 0x7f0cac057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.168+0000 7f0cc57fa700 1 -- 172.21.15.133:0/3266117747 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f0cb006dbf0 con 0x7f0cc8064660 2021-01-03T13:06:57.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.168+0000 7f0cc77fe700 1 --2- 172.21.15.133:0/3266117747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0cac0553b0 0x7f0cac057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.168+0000 7f0cc77fe700 1 --2- 172.21.15.133:0/3266117747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0cac0553b0 0x7f0cac057870 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f0cb8019000 tx=0x7f0cb8017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:57.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.172+0000 7f0cc57fa700 1 -- 172.21.15.133:0/3266117747 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0cb0043ff0 con 0x7f0cc8064660 2021-01-03T13:06:57.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:57.320+0000 7f0ccd461700 1 -- 172.21.15.133:0/3266117747 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0cc8065b70 con 0x7f0cc8064660 2021-01-03T13:06:58.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.032+0000 7f0cc57fa700 1 -- 172.21.15.133:0/3266117747 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v138) v1 ==== 173+0+0 (secure 0 0 0) 0x7f0cb0047610 con 0x7f0cc8064660 2021-01-03T13:06:58.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.036+0000 7f0ccd461700 1 -- 172.21.15.133:0/3266117747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0cac0553b0 msgr2=0x7f0cac057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:58.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.036+0000 7f0ccd461700 1 --2- 172.21.15.133:0/3266117747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0cac0553b0 0x7f0cac057870 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f0cb8019000 tx=0x7f0cb8017000).stop 2021-01-03T13:06:58.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.036+0000 7f0ccd461700 1 -- 172.21.15.133:0/3266117747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc8064660 msgr2=0x7f0cc81552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:58.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.036+0000 7f0ccd461700 1 --2- 172.21.15.133:0/3266117747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc8064660 0x7f0cc81552a0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f0cb000b000 tx=0x7f0cc805c8d0).stop 2021-01-03T13:06:58.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.036+0000 7f0ccd461700 1 -- 172.21.15.133:0/3266117747 shutdown_connections 2021-01-03T13:06:58.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.036+0000 7f0ccd461700 1 --2- 172.21.15.133:0/3266117747 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0cac0553b0 0x7f0cac057870 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:58.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.036+0000 7f0ccd461700 1 --2- 172.21.15.133:0/3266117747 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0cc80ac250 0x7f0cc80ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:58.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.036+0000 7f0ccd461700 1 --2- 172.21.15.133:0/3266117747 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cc8064660 0x7f0cc81552a0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:58.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.036+0000 7f0ccd461700 1 --2- 172.21.15.133:0/3266117747 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0cc80653d0 0x7f0cc80661a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:58.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.036+0000 7f0ccd461700 1 -- 172.21.15.133:0/3266117747 >> 172.21.15.133:0/3266117747 conn(0x7f0cc80b6110 msgr2=0x7f0cc80b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:58.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.036+0000 7f0ccd461700 1 -- 172.21.15.133:0/3266117747 shutdown_connections 2021-01-03T13:06:58.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.036+0000 7f0ccd461700 1 -- 172.21.15.133:0/3266117747 wait complete. 2021-01-03T13:06:58.045 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2021-01-03T13:06:58.057 INFO:tasks.ceph.mds.a:Restarting daemon 2021-01-03T13:06:58.058 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-01-03T13:06:58.058 INFO:tasks.ceph.mds.c:Restarting daemon 2021-01-03T13:06:58.059 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-01-03T13:06:58.059 INFO:tasks.ceph.mds.b:Restarting daemon 2021-01-03T13:06:58.060 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-01-03T13:06:58.062 INFO:tasks.ceph.mds.a:Started 2021-01-03T13:06:58.062 DEBUG:teuthology.parallel:result is None 2021-01-03T13:06:58.063 INFO:tasks.ceph.mds.b:Started 2021-01-03T13:06:58.064 INFO:tasks.ceph.mds.c:Started 2021-01-03T13:06:58.064 DEBUG:teuthology.parallel:result is None 2021-01-03T13:06:58.064 DEBUG:teuthology.parallel:result is None 2021-01-03T13:06:58.065 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-01-03T13:06:58.130 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T13:06:58.136 INFO:tasks.ceph.mds.b.smithi016.stdout:starting mds.b at 2021-01-03T13:06:58.139 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T13:06:58.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8778bd3700 1 Processor -- start 2021-01-03T13:06:58.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8778bd3700 1 -- start start 2021-01-03T13:06:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8778bd3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f87740b2e00 0x7f8774144020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:58.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8778bd3700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877409c0b0 con 0x7f87740b72b0 2021-01-03T13:06:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8778bd3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87740ae480 con 0x7f87740b7eb0 2021-01-03T13:06:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8778bd3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877413e750 con 0x7f87740b2e00 2021-01-03T13:06:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8772ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f87740b2e00 0x7f8774144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8773fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f87740b7eb0 0x7f877413e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60216/0 (socket says 172.21.15.133:60216) 2021-01-03T13:06:58.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8773fff700 1 -- 172.21.15.133:0/840116697 learned_addr learned my addr 172.21.15.133:0/840116697 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:06:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f87727fc700 1 -- 172.21.15.133:0/840116697 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859490503 0 0) 0x7f87740ae480 con 0x7f87740b7eb0 2021-01-03T13:06:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f87727fc700 1 -- 172.21.15.133:0/840116697 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8754003230 con 0x7f87740b7eb0 2021-01-03T13:06:58.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8772ffd700 1 -- 172.21.15.133:0/840116697 >> v1:172.21.15.133:6789/0 conn(0x7f87740b7eb0 legacy=0x7f877413e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8772ffd700 1 -- 172.21.15.133:0/840116697 >> v1:172.21.15.16:6789/0 conn(0x7f87740b72b0 legacy=0x7f87740ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f87727fc700 1 -- 172.21.15.133:0/840116697 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2089825048 0 0) 0x7f877409c0b0 con 0x7f87740b72b0 2021-01-03T13:06:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8772ffd700 1 -- 172.21.15.133:0/840116697 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877409c2e0 con 0x7f87740b2e00 2021-01-03T13:06:58.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8772ffd700 1 --2- 172.21.15.133:0/840116697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87740b2e00 0x7f8774144020 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f875c002f30 tx=0x7f875c006dc0).ready entity=mon.1 client_cookie=85ea51529d5b0e41 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f87727fc700 1 -- 172.21.15.133:0/840116697 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f875c009800 con 0x7f87740b2e00 2021-01-03T13:06:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f87727fc700 1 -- 172.21.15.133:0/840116697 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c009960 con 0x7f87740b2e00 2021-01-03T13:06:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f87727fc700 1 -- 172.21.15.133:0/840116697 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f875c009cc0 con 0x7f87740b2e00 2021-01-03T13:06:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8778bd3700 1 -- 172.21.15.133:0/840116697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87740b2e00 msgr2=0x7f8774144020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8778bd3700 1 --2- 172.21.15.133:0/840116697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87740b2e00 0x7f8774144020 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f875c002f30 tx=0x7f875c006dc0).stop 2021-01-03T13:06:58.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8778bd3700 1 -- 172.21.15.133:0/840116697 shutdown_connections 2021-01-03T13:06:58.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8778bd3700 1 --2- 172.21.15.133:0/840116697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87740b2e00 0x7f8774144020 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:58.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8778bd3700 1 -- 172.21.15.133:0/840116697 >> 172.21.15.133:0/840116697 conn(0x7f877405bdf0 msgr2=0x7f877405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:58.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8778bd3700 1 -- 172.21.15.133:0/840116697 shutdown_connections 2021-01-03T13:06:58.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.188+0000 7f8778bd3700 1 -- 172.21.15.133:0/840116697 wait complete. 2021-01-03T13:06:58.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8778bd3700 1 Processor -- start 2021-01-03T13:06:58.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8778bd3700 1 -- start start 2021-01-03T13:06:58.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8778bd3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87740b2e00 0x7f8774144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:58.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8778bd3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87740b72b0 0x7f8774146e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:58.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8778bd3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87741434a0 0x7f8774143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:58.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8778bd3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87740b0190 con 0x7f87741434a0 2021-01-03T13:06:58.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8778bd3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87740b03c0 con 0x7f87740b72b0 2021-01-03T13:06:58.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8778bd3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87740b0660 con 0x7f87740b2e00 2021-01-03T13:06:58.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8772ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87740b72b0 0x7f8774146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:58.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8772ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87740b72b0 0x7f8774146e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39190/0 (socket says 172.21.15.133:39190) 2021-01-03T13:06:58.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8772ffd700 1 -- 172.21.15.133:0/2114155084 learned_addr learned my addr 172.21.15.133:0/2114155084 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8773fff700 1 --2- 172.21.15.133:0/2114155084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87741434a0 0x7f8774143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f87737fe700 1 --2- 172.21.15.133:0/2114155084 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87740b2e00 0x7f8774144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8772ffd700 1 -- 172.21.15.133:0/2114155084 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87740b2e00 msgr2=0x7f8774144760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:58.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8772ffd700 1 --2- 172.21.15.133:0/2114155084 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87740b2e00 0x7f8774144760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:58.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8772ffd700 1 -- 172.21.15.133:0/2114155084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87741434a0 msgr2=0x7f8774143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:58.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8772ffd700 1 --2- 172.21.15.133:0/2114155084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87741434a0 0x7f8774143950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:58.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8772ffd700 1 -- 172.21.15.133:0/2114155084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87740b0900 con 0x7f87740b72b0 2021-01-03T13:06:58.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f87737fe700 1 --2- 172.21.15.133:0/2114155084 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87740b2e00 0x7f8774144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:06:58.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8772ffd700 1 --2- 172.21.15.133:0/2114155084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87740b72b0 0x7f8774146e50 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f875c002f30 tx=0x7f875c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:58.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8770ff9700 1 -- 172.21.15.133:0/2114155084 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f875c011c80 con 0x7f87740b72b0 2021-01-03T13:06:58.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8770ff9700 1 -- 172.21.15.133:0/2114155084 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c011de0 con 0x7f87740b72b0 2021-01-03T13:06:58.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8778bd3700 1 -- 172.21.15.133:0/2114155084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87740b0ba0 con 0x7f87740b72b0 2021-01-03T13:06:58.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8770ff9700 1 -- 172.21.15.133:0/2114155084 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f875c01d630 con 0x7f87740b72b0 2021-01-03T13:06:58.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8778bd3700 1 -- 172.21.15.133:0/2114155084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8774142ea0 con 0x7f87740b72b0 2021-01-03T13:06:58.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.192+0000 7f8778bd3700 1 -- 172.21.15.133:0/2114155084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8774057300 con 0x7f87740b72b0 2021-01-03T13:06:58.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.196+0000 7f8770ff9700 1 -- 172.21.15.133:0/2114155084 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f875c024030 con 0x7f87740b72b0 2021-01-03T13:06:58.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.196+0000 7f8770ff9700 1 --2- 172.21.15.133:0/2114155084 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f87580553b0 0x7f8758057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:58.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.196+0000 7f8770ff9700 1 -- 172.21.15.133:0/2114155084 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f875c06ead0 con 0x7f87740b72b0 2021-01-03T13:06:58.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.196+0000 7f87737fe700 1 --2- 172.21.15.133:0/2114155084 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f87580553b0 0x7f8758057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:58.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.196+0000 7f87737fe700 1 --2- 172.21.15.133:0/2114155084 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f87580553b0 0x7f8758057870 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f876400b000 tx=0x7f8764009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:58.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.200+0000 7f8770ff9700 1 -- 172.21.15.133:0/2114155084 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f875c0450b0 con 0x7f87740b72b0 2021-01-03T13:06:58.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:58.352+0000 7f8778bd3700 1 -- 172.21.15.133:0/2114155084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f877405ce00 con 0x7f87740b72b0 2021-01-03T13:06:59.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.252+0000 7f8770ff9700 1 -- 172.21.15.133:0/2114155084 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v139) v1 ==== 97+0+0 (secure 0 0 0) 0x7f875c022020 con 0x7f87740b72b0 2021-01-03T13:06:59.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.256+0000 7f8778bd3700 1 -- 172.21.15.133:0/2114155084 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f87580553b0 msgr2=0x7f8758057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:59.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.256+0000 7f8778bd3700 1 --2- 172.21.15.133:0/2114155084 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f87580553b0 0x7f8758057870 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f876400b000 tx=0x7f8764009040).stop 2021-01-03T13:06:59.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.256+0000 7f8778bd3700 1 -- 172.21.15.133:0/2114155084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87740b72b0 msgr2=0x7f8774146e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:59.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.256+0000 7f8778bd3700 1 --2- 172.21.15.133:0/2114155084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87740b72b0 0x7f8774146e50 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7f875c002f30 tx=0x7f875c015000).stop 2021-01-03T13:06:59.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.256+0000 7f8778bd3700 1 -- 172.21.15.133:0/2114155084 shutdown_connections 2021-01-03T13:06:59.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.256+0000 7f8778bd3700 1 --2- 172.21.15.133:0/2114155084 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f87580553b0 0x7f8758057870 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.256+0000 7f8778bd3700 1 --2- 172.21.15.133:0/2114155084 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87741434a0 0x7f8774143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.256+0000 7f8778bd3700 1 --2- 172.21.15.133:0/2114155084 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87740b2e00 0x7f8774144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.256+0000 7f8778bd3700 1 --2- 172.21.15.133:0/2114155084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87740b72b0 0x7f8774146e50 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.256+0000 7f8778bd3700 1 -- 172.21.15.133:0/2114155084 >> 172.21.15.133:0/2114155084 conn(0x7f877405bdf0 msgr2=0x7f87740663a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:59.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.256+0000 7f8778bd3700 1 -- 172.21.15.133:0/2114155084 shutdown_connections 2021-01-03T13:06:59.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.256+0000 7f8778bd3700 1 -- 172.21.15.133:0/2114155084 wait complete. 2021-01-03T13:06:59.264 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blacklist entries 2021-01-03T13:06:59.277 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-01-03T13:06:59.277 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-01-03T13:06:59.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.384+0000 7feafbfff700 1 Processor -- start 2021-01-03T13:06:59.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.384+0000 7feafbfff700 1 -- start start 2021-01-03T13:06:59.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.384+0000 7feafbfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feafc05f920 0x7feafc0b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:59.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.384+0000 7feafbfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feafc066f30 0x7feafc0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:59.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.384+0000 7feafbfff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc05fd00 con 0x7feafc0b1590 2021-01-03T13:06:59.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.384+0000 7feafbfff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feafc0ae700 con 0x7feafc066f30 2021-01-03T13:06:59.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.384+0000 7feafbfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feafc0accd0 con 0x7feafc05f920 2021-01-03T13:06:59.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.384+0000 7feafaffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feafc05f920 0x7feafc0b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:59.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.384+0000 7feafaffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feafc05f920 0x7feafc0b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39200/0 (socket says 172.21.15.133:39200) 2021-01-03T13:06:59.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.384+0000 7feafaffd700 1 -- 172.21.15.133:0/1361676977 learned_addr learned my addr 172.21.15.133:0/1361676977 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:59.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.384+0000 7feafb7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feafc0b1590 0x7feafc0613e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60236/0 (socket says 172.21.15.133:60236) 2021-01-03T13:06:59.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.384+0000 7feafa7fc700 1 --2- 172.21.15.133:0/1361676977 >> v2:172.21.15.16:3300/0 conn(0x7feafc066f30 0x7feafc0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:59.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.384+0000 7feafaffd700 1 -- 172.21.15.133:0/1361676977 >> v2:172.21.15.16:3300/0 conn(0x7feafc066f30 msgr2=0x7feafc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:59.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.384+0000 7feafaffd700 1 --2- 172.21.15.133:0/1361676977 >> v2:172.21.15.16:3300/0 conn(0x7feafc066f30 0x7feafc0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.384+0000 7feafaffd700 1 -- 172.21.15.133:0/1361676977 >> v1:172.21.15.133:6789/0 conn(0x7feafc0b1590 legacy=0x7feafc0613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:59.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.384+0000 7feafaffd700 1 -- 172.21.15.133:0/1361676977 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc0acf70 con 0x7feafc05f920 2021-01-03T13:06:59.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafaffd700 1 --2- 172.21.15.133:0/1361676977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feafc05f920 0x7feafc0b0ab0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7feaf4002f30 tx=0x7feaf4006e80).ready entity=mon.1 client_cookie=88f5df4d68598cef server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:59.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feaf9ffb700 1 -- 172.21.15.133:0/1361676977 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feaf40097f0 con 0x7feafc05f920 2021-01-03T13:06:59.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feaf9ffb700 1 -- 172.21.15.133:0/1361676977 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf4009950 con 0x7feafc05f920 2021-01-03T13:06:59.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feaf9ffb700 1 -- 172.21.15.133:0/1361676977 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feaf4009ac0 con 0x7feafc05f920 2021-01-03T13:06:59.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafbfff700 1 -- 172.21.15.133:0/1361676977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feafc05f920 msgr2=0x7feafc0b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:59.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafbfff700 1 --2- 172.21.15.133:0/1361676977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feafc05f920 0x7feafc0b0ab0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7feaf4002f30 tx=0x7feaf4006e80).stop 2021-01-03T13:06:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafbfff700 1 -- 172.21.15.133:0/1361676977 shutdown_connections 2021-01-03T13:06:59.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafbfff700 1 --2- 172.21.15.133:0/1361676977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feafc05f920 0x7feafc0b0ab0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafbfff700 1 --2- 172.21.15.133:0/1361676977 >> v2:172.21.15.16:3300/0 conn(0x7feafc066f30 0x7feafc0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafbfff700 1 -- 172.21.15.133:0/1361676977 >> 172.21.15.133:0/1361676977 conn(0x7feafc0b6110 msgr2=0x7feafc0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:59.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafbfff700 1 -- 172.21.15.133:0/1361676977 shutdown_connections 2021-01-03T13:06:59.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafbfff700 1 -- 172.21.15.133:0/1361676977 wait complete. 2021-01-03T13:06:59.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafbfff700 1 Processor -- start 2021-01-03T13:06:59.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafbfff700 1 -- start start 2021-01-03T13:06:59.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafbfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feafc05f920 0x7feafc13e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:59.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafbfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feafc066f30 0x7feafc13f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:59.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feafc0b1590 0x7feafc13fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:59.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafbfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc150d90 con 0x7feafc05f920 2021-01-03T13:06:59.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafbfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc141be0 con 0x7feafc0b1590 2021-01-03T13:06:59.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafbfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc141e80 con 0x7feafc066f30 2021-01-03T13:06:59.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.388+0000 7feafb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feafc0b1590 0x7feafc13fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:59.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feafb7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feafc0b1590 0x7feafc13fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39210/0 (socket says 172.21.15.133:39210) 2021-01-03T13:06:59.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feafb7fe700 1 -- 172.21.15.133:0/2905909033 learned_addr learned my addr 172.21.15.133:0/2905909033 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:59.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feafaffd700 1 --2- 172.21.15.133:0/2905909033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feafc05f920 0x7feafc13e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:59.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feafa7fc700 1 --2- 172.21.15.133:0/2905909033 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feafc066f30 0x7feafc13f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:59.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feafb7fe700 1 -- 172.21.15.133:0/2905909033 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feafc066f30 msgr2=0x7feafc13f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:59.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feafb7fe700 1 --2- 172.21.15.133:0/2905909033 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feafc066f30 0x7feafc13f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feafb7fe700 1 -- 172.21.15.133:0/2905909033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feafc05f920 msgr2=0x7feafc13e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:59.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feafb7fe700 1 --2- 172.21.15.133:0/2905909033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feafc05f920 0x7feafc13e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feafb7fe700 1 -- 172.21.15.133:0/2905909033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc142120 con 0x7feafc0b1590 2021-01-03T13:06:59.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feafb7fe700 1 --2- 172.21.15.133:0/2905909033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feafc0b1590 0x7feafc13fab0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7feafc0b0580 tx=0x7feaec007f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:59.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feaf3fff700 1 -- 172.21.15.133:0/2905909033 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feaec002040 con 0x7feafc0b1590 2021-01-03T13:06:59.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feafbfff700 1 -- 172.21.15.133:0/2905909033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feafc1425c0 con 0x7feafc0b1590 2021-01-03T13:06:59.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feaf3fff700 1 -- 172.21.15.133:0/2905909033 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaec005ab0 con 0x7feafc0b1590 2021-01-03T13:06:59.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feaf3fff700 1 -- 172.21.15.133:0/2905909033 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feaec005e10 con 0x7feafc0b1590 2021-01-03T13:06:59.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feafbfff700 1 -- 172.21.15.133:0/2905909033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feafc14da10 con 0x7feafc0b1590 2021-01-03T13:06:59.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feaf3fff700 1 -- 172.21.15.133:0/2905909033 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7feaec010030 con 0x7feafc0b1590 2021-01-03T13:06:59.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feafbfff700 1 -- 172.21.15.133:0/2905909033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feafc144150 con 0x7feafc0b1590 2021-01-03T13:06:59.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feaf3fff700 1 --2- 172.21.15.133:0/2905909033 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feae0055500 0x7feae00579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:59.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feaf3fff700 1 -- 172.21.15.133:0/2905909033 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5253+0+0 (secure 0 0 0) 0x7feaec06dbb0 con 0x7feafc0b1590 2021-01-03T13:06:59.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.392+0000 7feafaffd700 1 --2- 172.21.15.133:0/2905909033 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feae0055500 0x7feae00579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:59.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.396+0000 7feafaffd700 1 --2- 172.21.15.133:0/2905909033 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feae0055500 0x7feae00579c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7feaf4019000 tx=0x7feaf4016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:59.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.400+0000 7feaf3fff700 1 -- 172.21.15.133:0/2905909033 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7feaec074080 con 0x7feafc0b1590 2021-01-03T13:06:59.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.588+0000 7feafbfff700 1 -- 172.21.15.133:0/2905909033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7feafc1422b0 con 0x7feafc0b1590 2021-01-03T13:06:59.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.592+0000 7feaf3fff700 1 -- 172.21.15.133:0/2905909033 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v28) v1 ==== 80+0+4255 (secure 0 0 0) 0x7feaec044140 con 0x7feafc0b1590 2021-01-03T13:06:59.597 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:59.597 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:06:59.597 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2021-01-03T13:06:59.598 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:59.598 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2021-01-03T13:06:59.598 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Fflox9BxAA6coLDFV/FaQ/G/cvtonWgg==", 2021-01-03T13:06:59.598 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:59.598 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:06:59.599 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:59.599 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:59.599 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:59.599 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:59.599 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:59.600 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:59.600 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2021-01-03T13:06:59.600 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfrnWWFRAA3PHH/FJOvDozCChrb1T8Dg==", 2021-01-03T13:06:59.600 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:59.600 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:06:59.601 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:59.601 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:59.601 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:59.601 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:59.601 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:59.602 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:59.602 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2021-01-03T13:06:59.602 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfpPPLDxAAVvg80vLejYKDH485/L1gSQ==", 2021-01-03T13:06:59.602 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:59.602 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:06:59.603 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:59.603 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:59.603 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:59.603 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:59.603 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:59.604 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:59.604 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2021-01-03T13:06:59.604 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAnv/FfQ+CcDRAAUkTDLby5scMkNzxa0lVdAQ==", 2021-01-03T13:06:59.604 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:59.604 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:59.605 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:59.605 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:59.605 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:59.605 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:59.605 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:59.606 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2021-01-03T13:06:59.606 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApv/Ff1iilLhAAbK9hZmL772nNKAEJ4i+pkw==", 2021-01-03T13:06:59.606 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:59.606 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:59.606 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:59.607 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:59.607 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:59.607 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:59.607 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:59.607 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2021-01-03T13:06:59.608 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAsv/Ffmoe2FhAA1EbxU5yHncN+pbC/EX6d9A==", 2021-01-03T13:06:59.608 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:59.608 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:59.608 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:59.608 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:59.609 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:59.609 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:59.609 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:59.609 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2021-01-03T13:06:59.609 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAuv/FfJh/VORAAG9aCOh5s/2Lw+yN9hBFWLw==", 2021-01-03T13:06:59.610 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:59.610 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:59.610 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:59.610 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:59.610 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:59.611 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:59.611 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:59.611 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2021-01-03T13:06:59.611 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyv/Ffus0NJhAALX1TIqQ9EIupaX8KtRu7rQ==", 2021-01-03T13:06:59.611 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:59.612 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:59.612 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:59.612 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:59.612 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:59.612 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:59.613 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:59.613 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2021-01-03T13:06:59.613 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1v/FfoL6kDBAAggoRy/o0qas/41yLYqDVgA==", 2021-01-03T13:06:59.613 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:59.613 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:59.614 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:59.614 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:59.614 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:59.614 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:59.614 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:59.615 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2021-01-03T13:06:59.615 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA3v/FfwOPCMBAAGOt8ShPQ/szNbCfaP/uZEQ==", 2021-01-03T13:06:59.615 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:59.615 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:59.615 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:59.616 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:59.616 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:59.616 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:59.616 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:59.616 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2021-01-03T13:06:59.617 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA6v/Ffoz5xFxAAn3xvUDSeNSWrBJTa1Nsb6w==", 2021-01-03T13:06:59.617 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:59.617 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:59.617 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:59.617 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:59.618 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:59.618 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:59.618 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:59.618 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2021-01-03T13:06:59.619 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfyGlbGxAALm0NezvPiTAnlwu8iPEuCw==", 2021-01-03T13:06:59.619 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:59.619 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:06:59.619 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:06:59.619 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:06:59.620 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:59.620 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:59.620 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:59.620 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2021-01-03T13:06:59.620 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Ffa2AFHhAAD4Pq5zMJ28SqqEosBA9vnQ==", 2021-01-03T13:06:59.621 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:59.621 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:06:59.621 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:06:59.621 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:06:59.621 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:59.622 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:59.622 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:59.622 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2021-01-03T13:06:59.622 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjv/FfjxN8JxAAkV2Ia66fh21QYMX5fr1gTw==", 2021-01-03T13:06:59.623 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:59.623 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:06:59.623 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:06:59.623 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:06:59.623 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:59.623 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:59.624 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:59.624 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:59.624 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2021-01-03T13:06:59.624 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAU/DBBAASi+hx05pZEsP+dV9iwbz4g==", 2021-01-03T13:06:59.624 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:59.625 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:06:59.625 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:06:59.625 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:59.625 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:59.625 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:06:59.626 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:06:59.626 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2021-01-03T13:06:59.626 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAOFAAhAAPQOSkofyJoEYvcAqKK2+Mg==", 2021-01-03T13:06:59.626 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:06:59.626 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:06:59.627 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:06:59.627 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:06:59.627 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:59.627 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:06:59.628 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:06:59.628 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:06:59.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.592+0000 7feafbfff700 1 -- 172.21.15.133:0/2905909033 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feae0055500 msgr2=0x7feae00579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.592+0000 7feafbfff700 1 --2- 172.21.15.133:0/2905909033 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feae0055500 0x7feae00579c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7feaf4019000 tx=0x7feaf4016000).stop 2021-01-03T13:06:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.592+0000 7feafbfff700 1 -- 172.21.15.133:0/2905909033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feafc0b1590 msgr2=0x7feafc13fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.592+0000 7feafbfff700 1 --2- 172.21.15.133:0/2905909033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feafc0b1590 0x7feafc13fab0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7feafc0b0580 tx=0x7feaec007f70).stop 2021-01-03T13:06:59.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.592+0000 7feafbfff700 1 -- 172.21.15.133:0/2905909033 shutdown_connections 2021-01-03T13:06:59.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.592+0000 7feafbfff700 1 --2- 172.21.15.133:0/2905909033 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feae0055500 0x7feae00579c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.592+0000 7feafbfff700 1 --2- 172.21.15.133:0/2905909033 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feafc05f920 0x7feafc13e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.592+0000 7feafbfff700 1 --2- 172.21.15.133:0/2905909033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feafc0b1590 0x7feafc13fab0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.592+0000 7feafbfff700 1 --2- 172.21.15.133:0/2905909033 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feafc066f30 0x7feafc13f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.592+0000 7feafbfff700 1 -- 172.21.15.133:0/2905909033 >> 172.21.15.133:0/2905909033 conn(0x7feafc0b6110 msgr2=0x7feafc0ad480 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:59.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.592+0000 7feafbfff700 1 -- 172.21.15.133:0/2905909033 shutdown_connections 2021-01-03T13:06:59.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.596+0000 7feafbfff700 1 -- 172.21.15.133:0/2905909033 wait complete. 2021-01-03T13:06:59.632 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:06:59.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225a85e700 1 Processor -- start 2021-01-03T13:06:59.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225a85e700 1 -- start start 2021-01-03T13:06:59.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225a85e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22540b02b0 0x7f22540668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:59.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225a85e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f22540622f0 0x7f2254066d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:59.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225a85e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225405c510 con 0x7f225405c130 2021-01-03T13:06:59.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225a85e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22541473d0 con 0x7f22540622f0 2021-01-03T13:06:59.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225a85e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22540b0ab0 con 0x7f22540b02b0 2021-01-03T13:06:59.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225a05d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f22540622f0 0x7f2254066d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:59.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225a05d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f22540622f0 0x7f2254066d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39216/0 (socket says 172.21.15.133:39216) 2021-01-03T13:06:59.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225a05d700 1 -- 172.21.15.133:0/1767877785 learned_addr learned my addr 172.21.15.133:0/1767877785 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:59.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225a05d700 1 -- 172.21.15.133:0/1767877785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22540b02b0 msgr2=0x7f22540668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:06:59.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225a05d700 1 --2- 172.21.15.133:0/1767877785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22540b02b0 0x7f22540668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-03T13:06:59.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225a05d700 1 -- 172.21.15.133:0/1767877785 >> v1:172.21.15.16:6789/0 conn(0x7f225405c130 legacy=0x7f22540b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:59.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225a05d700 1 -- 172.21.15.133:0/1767877785 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22540b15a0 con 0x7f22540622f0 2021-01-03T13:06:59.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225a05d700 1 --2- 172.21.15.133:0/1767877785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22540622f0 0x7f2254066d90 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f2250002f30 tx=0x7f2250006e80).ready entity=mon.1 client_cookie=90cd813184860ce2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225885a700 1 -- 172.21.15.133:0/1767877785 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22500097f0 con 0x7f22540622f0 2021-01-03T13:06:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225885a700 1 -- 172.21.15.133:0/1767877785 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2250009950 con 0x7f22540622f0 2021-01-03T13:06:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225a85e700 1 -- 172.21.15.133:0/1767877785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22540622f0 msgr2=0x7f2254066d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225885a700 1 -- 172.21.15.133:0/1767877785 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2250009cf0 con 0x7f22540622f0 2021-01-03T13:06:59.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.740+0000 7f225a85e700 1 --2- 172.21.15.133:0/1767877785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22540622f0 0x7f2254066d90 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f2250002f30 tx=0x7f2250006e80).stop 2021-01-03T13:06:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a85e700 1 -- 172.21.15.133:0/1767877785 shutdown_connections 2021-01-03T13:06:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a85e700 1 --2- 172.21.15.133:0/1767877785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22540622f0 0x7f2254066d90 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a85e700 1 --2- 172.21.15.133:0/1767877785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22540b02b0 0x7f22540668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-03T13:06:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a85e700 1 -- 172.21.15.133:0/1767877785 >> 172.21.15.133:0/1767877785 conn(0x7f22540b6110 msgr2=0x7f22540b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:59.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a85e700 1 -- 172.21.15.133:0/1767877785 shutdown_connections 2021-01-03T13:06:59.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a85e700 1 -- 172.21.15.133:0/1767877785 wait complete. 2021-01-03T13:06:59.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a85e700 1 Processor -- start 2021-01-03T13:06:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a85e700 1 -- start start 2021-01-03T13:06:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a85e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f225405c130 0x7f2254152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a85e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22540622f0 0x7f2254141c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a85e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22540b02b0 0x7f2254064e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:59.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a85e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22540a40d0 con 0x7f22540622f0 2021-01-03T13:06:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a85e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2254152c50 con 0x7f22540b02b0 2021-01-03T13:06:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a85e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2254064060 con 0x7f225405c130 2021-01-03T13:06:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a05d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22540b02b0 0x7f2254064e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a05d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22540b02b0 0x7f2254064e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39224/0 (socket says 172.21.15.133:39224) 2021-01-03T13:06:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a05d700 1 -- 172.21.15.133:0/3288356627 learned_addr learned my addr 172.21.15.133:0/3288356627 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:06:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225905b700 1 --2- 172.21.15.133:0/3288356627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22540622f0 0x7f2254141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225985c700 1 --2- 172.21.15.133:0/3288356627 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f225405c130 0x7f2254152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a05d700 1 -- 172.21.15.133:0/3288356627 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f225405c130 msgr2=0x7f2254152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a05d700 1 --2- 172.21.15.133:0/3288356627 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f225405c130 0x7f2254152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a05d700 1 -- 172.21.15.133:0/3288356627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22540622f0 msgr2=0x7f2254141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a05d700 1 --2- 172.21.15.133:0/3288356627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22540622f0 0x7f2254141c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a05d700 1 -- 172.21.15.133:0/3288356627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2254064300 con 0x7f22540b02b0 2021-01-03T13:06:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a05d700 1 --2- 172.21.15.133:0/3288356627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22540b02b0 0x7f2254064e10 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f2250002f30 tx=0x7f2250015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f2242ffd700 1 -- 172.21.15.133:0/3288356627 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2250011d70 con 0x7f22540b02b0 2021-01-03T13:06:59.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f2242ffd700 1 -- 172.21.15.133:0/3288356627 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225001e460 con 0x7f22540b02b0 2021-01-03T13:06:59.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a85e700 1 -- 172.21.15.133:0/3288356627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2254152020 con 0x7f22540b02b0 2021-01-03T13:06:59.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f2242ffd700 1 -- 172.21.15.133:0/3288356627 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f225001e7c0 con 0x7f22540b02b0 2021-01-03T13:06:59.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.744+0000 7f225a85e700 1 -- 172.21.15.133:0/3288356627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2254142130 con 0x7f22540b02b0 2021-01-03T13:06:59.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.748+0000 7f225a85e700 1 -- 172.21.15.133:0/3288356627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2254057300 con 0x7f22540b02b0 2021-01-03T13:06:59.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.748+0000 7f2242ffd700 1 -- 172.21.15.133:0/3288356627 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f225001a040 con 0x7f22540b02b0 2021-01-03T13:06:59.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.748+0000 7f2242ffd700 1 --2- 172.21.15.133:0/3288356627 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22340553b0 0x7f2234057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:06:59.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.748+0000 7f2242ffd700 1 -- 172.21.15.133:0/3288356627 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f225006ee10 con 0x7f22540b02b0 2021-01-03T13:06:59.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.748+0000 7f225985c700 1 --2- 172.21.15.133:0/3288356627 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22340553b0 0x7f2234057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:06:59.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.748+0000 7f225985c700 1 --2- 172.21.15.133:0/3288356627 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22340553b0 0x7f2234057870 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f224c00b000 tx=0x7f224c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:06:59.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.752+0000 7f2242ffd700 1 -- 172.21.15.133:0/3288356627 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2250045480 con 0x7f22540b02b0 2021-01-03T13:06:59.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.892+0000 7f225a85e700 1 -- 172.21.15.133:0/3288356627 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2254061020 con 0x7f22540b02b0 2021-01-03T13:06:59.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.892+0000 7f2242ffd700 1 -- 172.21.15.133:0/3288356627 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+13239 (secure 0 0 0) 0x7f2250023030 con 0x7f22540b02b0 2021-01-03T13:06:59.898 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:06:59.898 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":139,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:06:59.248304+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:06:59.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.892+0000 7f225a85e700 1 -- 172.21.15.133:0/3288356627 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22340553b0 msgr2=0x7f2234057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.892+0000 7f225a85e700 1 --2- 172.21.15.133:0/3288356627 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22340553b0 0x7f2234057870 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f224c00b000 tx=0x7f224c009040).stop 2021-01-03T13:06:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.892+0000 7f225a85e700 1 -- 172.21.15.133:0/3288356627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22540b02b0 msgr2=0x7f2254064e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:06:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.892+0000 7f225a85e700 1 --2- 172.21.15.133:0/3288356627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22540b02b0 0x7f2254064e10 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f2250002f30 tx=0x7f2250015000).stop 2021-01-03T13:06:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.892+0000 7f225a85e700 1 -- 172.21.15.133:0/3288356627 shutdown_connections 2021-01-03T13:06:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.892+0000 7f225a85e700 1 --2- 172.21.15.133:0/3288356627 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f22340553b0 0x7f2234057870 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.892+0000 7f225a85e700 1 --2- 172.21.15.133:0/3288356627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22540b02b0 0x7f2254064e10 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.892+0000 7f225a85e700 1 --2- 172.21.15.133:0/3288356627 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f225405c130 0x7f2254152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.892+0000 7f225a85e700 1 --2- 172.21.15.133:0/3288356627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22540622f0 0x7f2254141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:06:59.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.892+0000 7f225a85e700 1 -- 172.21.15.133:0/3288356627 >> 172.21.15.133:0/3288356627 conn(0x7f22540b6110 msgr2=0x7f2254066ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:06:59.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.892+0000 7f225a85e700 1 -- 172.21.15.133:0/3288356627 shutdown_connections 2021-01-03T13:06:59.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:06:59.892+0000 7f225a85e700 1 -- 172.21.15.133:0/3288356627 wait complete. 2021-01-03T13:06:59.912 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-01-03T13:06:59.913 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:07:00.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.028+0000 7fdf79eba700 1 Processor -- start 2021-01-03T13:07:00.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.028+0000 7fdf79eba700 1 -- start start 2021-01-03T13:07:00.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf79eba700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdf740b0b30 0x7fdf740a75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf79eba700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf740b1b90 con 0x7fdf7414a940 2021-01-03T13:07:00.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf79eba700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf740af500 con 0x7fdf740b2370 2021-01-03T13:07:00.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf79eba700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf740a7c60 con 0x7fdf740b0b30 2021-01-03T13:07:00.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf78eb8700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdf740b2370 0x7fdf740671e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60260/0 (socket says 172.21.15.133:60260) 2021-01-03T13:07:00.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf78eb8700 1 -- 172.21.15.133:0/1482206377 learned_addr learned my addr 172.21.15.133:0/1482206377 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:00.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf796b9700 1 --2- 172.21.15.133:0/1482206377 >> v2:172.21.15.16:3300/0 conn(0x7fdf740b0b30 0x7fdf740a75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 -- 172.21.15.133:0/1482206377 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986631701 0 0) 0x7fdf740af500 con 0x7fdf740b2370 2021-01-03T13:07:00.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 -- 172.21.15.133:0/1482206377 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf60003230 con 0x7fdf740b2370 2021-01-03T13:07:00.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 -- 172.21.15.133:0/1482206377 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4219011457 0 0) 0x7fdf60003230 con 0x7fdf740b2370 2021-01-03T13:07:00.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 -- 172.21.15.133:0/1482206377 >> v2:172.21.15.16:3300/0 conn(0x7fdf740b0b30 msgr2=0x7fdf740a75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:00.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 --2- 172.21.15.133:0/1482206377 >> v2:172.21.15.16:3300/0 conn(0x7fdf740b0b30 0x7fdf740a75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 -- 172.21.15.133:0/1482206377 >> v1:172.21.15.16:6789/0 conn(0x7fdf7414a940 legacy=0x7fdf7414fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 -- 172.21.15.133:0/1482206377 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf740b0590 con 0x7fdf740b2370 2021-01-03T13:07:00.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 -- 172.21.15.133:0/1482206377 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fdf640016d0 con 0x7fdf740b2370 2021-01-03T13:07:00.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 -- 172.21.15.133:0/1482206377 >> v1:172.21.15.133:6789/0 conn(0x7fdf740b2370 legacy=0x7fdf740671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 --2- 172.21.15.133:0/1482206377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf60003720 0x7fdf60003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 --2- 172.21.15.133:0/1482206377 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf600044d0 0x7fdf60004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 --2- 172.21.15.133:0/1482206377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf60004e40 0x7fdf6000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 -- 172.21.15.133:0/1482206377 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf60004250 con 0x7fdf60004e40 2021-01-03T13:07:00.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 -- 172.21.15.133:0/1482206377 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6000bc10 con 0x7fdf60003720 2021-01-03T13:07:00.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 -- 172.21.15.133:0/1482206377 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6000bd50 con 0x7fdf600044d0 2021-01-03T13:07:00.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf78eb8700 1 --2- 172.21.15.133:0/1482206377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf60003720 0x7fdf60003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf796b9700 1 --2- 172.21.15.133:0/1482206377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf60004e40 0x7fdf6000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf73fff700 1 --2- 172.21.15.133:0/1482206377 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf600044d0 0x7fdf60004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf78eb8700 1 -- 172.21.15.133:0/1482206377 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf600044d0 msgr2=0x7fdf60004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf78eb8700 1 --2- 172.21.15.133:0/1482206377 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf600044d0 0x7fdf60004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf78eb8700 1 -- 172.21.15.133:0/1482206377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf60004e40 msgr2=0x7fdf6000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:00.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf78eb8700 1 --2- 172.21.15.133:0/1482206377 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf60004e40 0x7fdf6000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf796b9700 1 -- 172.21.15.133:0/1482206377 reap_dead start 2021-01-03T13:07:00.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf78eb8700 1 -- 172.21.15.133:0/1482206377 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf60003230 con 0x7fdf60003720 2021-01-03T13:07:00.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf73fff700 1 --2- 172.21.15.133:0/1482206377 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf600044d0 0x7fdf60004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:00.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf78eb8700 1 --2- 172.21.15.133:0/1482206377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf60003720 0x7fdf60003b40 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7fdf640013e0 tx=0x7fdf740a88e0).ready entity=mon.1 client_cookie=255c1c94ef412bb1 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:00.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 -- 172.21.15.133:0/1482206377 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf640070d0 con 0x7fdf60003720 2021-01-03T13:07:00.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 -- 172.21.15.133:0/1482206377 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf64007230 con 0x7fdf60003720 2021-01-03T13:07:00.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf737fe700 1 -- 172.21.15.133:0/1482206377 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf640055e0 con 0x7fdf60003720 2021-01-03T13:07:00.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf79eba700 1 -- 172.21.15.133:0/1482206377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf60003720 msgr2=0x7fdf60003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.032+0000 7fdf79eba700 1 --2- 172.21.15.133:0/1482206377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf60003720 0x7fdf60003b40 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7fdf640013e0 tx=0x7fdf740a88e0).stop 2021-01-03T13:07:00.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.036+0000 7fdf79eba700 1 -- 172.21.15.133:0/1482206377 shutdown_connections 2021-01-03T13:07:00.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.036+0000 7fdf79eba700 1 --2- 172.21.15.133:0/1482206377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf60003720 0x7fdf60003b40 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.036+0000 7fdf79eba700 1 -- 172.21.15.133:0/1482206377 >> 172.21.15.133:0/1482206377 conn(0x7fdf7406b050 msgr2=0x7fdf74060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:00.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.036+0000 7fdf79eba700 1 -- 172.21.15.133:0/1482206377 shutdown_connections 2021-01-03T13:07:00.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.036+0000 7fdf79eba700 1 -- 172.21.15.133:0/1482206377 wait complete. 2021-01-03T13:07:00.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.036+0000 7fdf79eba700 1 Processor -- start 2021-01-03T13:07:00.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.036+0000 7fdf79eba700 1 -- start start 2021-01-03T13:07:00.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf79eba700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf60003720 0x7fdf740abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf79eba700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf740a9430 0x7fdf74156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf79eba700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf740a88e0 0x7fdf741564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf79eba700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7414e0b0 con 0x7fdf740a9430 2021-01-03T13:07:00.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf79eba700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf740aa370 con 0x7fdf740a88e0 2021-01-03T13:07:00.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf79eba700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf741569e0 con 0x7fdf60003720 2021-01-03T13:07:00.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf796b9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf740a88e0 0x7fdf741564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf796b9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf740a88e0 0x7fdf741564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39244/0 (socket says 172.21.15.133:39244) 2021-01-03T13:07:00.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf78eb8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf60003720 0x7fdf740abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf796b9700 1 -- 172.21.15.133:0/2640865234 learned_addr learned my addr 172.21.15.133:0/2640865234 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:00.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf73fff700 1 --2- 172.21.15.133:0/2640865234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf740a9430 0x7fdf74156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf796b9700 1 -- 172.21.15.133:0/2640865234 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf60003720 msgr2=0x7fdf740abff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf796b9700 1 --2- 172.21.15.133:0/2640865234 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf60003720 0x7fdf740abff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf796b9700 1 -- 172.21.15.133:0/2640865234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf740a9430 msgr2=0x7fdf74156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf796b9700 1 --2- 172.21.15.133:0/2640865234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf740a9430 0x7fdf74156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf796b9700 1 -- 172.21.15.133:0/2640865234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf740aa5e0 con 0x7fdf740a88e0 2021-01-03T13:07:00.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf73fff700 1 --2- 172.21.15.133:0/2640865234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf740a9430 0x7fdf74156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:00.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.040+0000 7fdf796b9700 1 --2- 172.21.15.133:0/2640865234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf740a88e0 0x7fdf741564f0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7fdf68006000 tx=0x7fdf68006db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:00.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.044+0000 7fdf71ffb700 1 -- 172.21.15.133:0/2640865234 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf68013680 con 0x7fdf740a88e0 2021-01-03T13:07:00.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.044+0000 7fdf71ffb700 1 -- 172.21.15.133:0/2640865234 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf680137e0 con 0x7fdf740a88e0 2021-01-03T13:07:00.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.044+0000 7fdf79eba700 1 -- 172.21.15.133:0/2640865234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf740aa880 con 0x7fdf740a88e0 2021-01-03T13:07:00.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.044+0000 7fdf71ffb700 1 -- 172.21.15.133:0/2640865234 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf68013b40 con 0x7fdf740a88e0 2021-01-03T13:07:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.044+0000 7fdf79eba700 1 -- 172.21.15.133:0/2640865234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf740ac4e0 con 0x7fdf740a88e0 2021-01-03T13:07:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.044+0000 7fdf71ffb700 1 -- 172.21.15.133:0/2640865234 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fdf68013ca0 con 0x7fdf740a88e0 2021-01-03T13:07:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.044+0000 7fdf71ffb700 1 --2- 172.21.15.133:0/2640865234 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf54055330 0x7fdf540577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.044+0000 7fdf78eb8700 1 --2- 172.21.15.133:0/2640865234 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf54055330 0x7fdf540577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.048+0000 7fdf78eb8700 1 --2- 172.21.15.133:0/2640865234 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf54055330 0x7fdf540577f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fdf64019000 tx=0x7fdf64013000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:00.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.048+0000 7fdf71ffb700 1 -- 172.21.15.133:0/2640865234 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fdf68048500 con 0x7fdf740a88e0 2021-01-03T13:07:00.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.048+0000 7fdf79eba700 1 -- 172.21.15.133:0/2640865234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7414e220 con 0x7fdf740a88e0 2021-01-03T13:07:00.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.052+0000 7fdf71ffb700 1 -- 172.21.15.133:0/2640865234 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdf680448a0 con 0x7fdf740a88e0 2021-01-03T13:07:00.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.192+0000 7fdf79eba700 1 -- 172.21.15.133:0/2640865234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdf74057300 con 0x7fdf740a88e0 2021-01-03T13:07:00.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.192+0000 7fdf71ffb700 1 -- 172.21.15.133:0/2640865234 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v139) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdf68047ec0 con 0x7fdf740a88e0 2021-01-03T13:07:00.199 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:07:00.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.196+0000 7fdf79eba700 1 -- 172.21.15.133:0/2640865234 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf54055330 msgr2=0x7fdf540577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.196+0000 7fdf79eba700 1 --2- 172.21.15.133:0/2640865234 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf54055330 0x7fdf540577f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fdf64019000 tx=0x7fdf64013000).stop 2021-01-03T13:07:00.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.196+0000 7fdf79eba700 1 -- 172.21.15.133:0/2640865234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf740a88e0 msgr2=0x7fdf741564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.196+0000 7fdf79eba700 1 --2- 172.21.15.133:0/2640865234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf740a88e0 0x7fdf741564f0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7fdf68006000 tx=0x7fdf68006db0).stop 2021-01-03T13:07:00.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.196+0000 7fdf79eba700 1 -- 172.21.15.133:0/2640865234 shutdown_connections 2021-01-03T13:07:00.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.196+0000 7fdf79eba700 1 --2- 172.21.15.133:0/2640865234 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf54055330 0x7fdf540577f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.196+0000 7fdf79eba700 1 --2- 172.21.15.133:0/2640865234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf740a88e0 0x7fdf741564f0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.196+0000 7fdf79eba700 1 --2- 172.21.15.133:0/2640865234 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf60003720 0x7fdf740abff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.196+0000 7fdf79eba700 1 --2- 172.21.15.133:0/2640865234 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf740a9430 0x7fdf74156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.196+0000 7fdf79eba700 1 -- 172.21.15.133:0/2640865234 >> 172.21.15.133:0/2640865234 conn(0x7fdf7406b050 msgr2=0x7fdf740b5800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:00.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.196+0000 7fdf79eba700 1 -- 172.21.15.133:0/2640865234 shutdown_connections 2021-01-03T13:07:00.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.196+0000 7fdf79eba700 1 -- 172.21.15.133:0/2640865234 wait complete. 2021-01-03T13:07:00.212 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:07:00.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.324+0000 7fd969072700 1 Processor -- start 2021-01-03T13:07:00.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.324+0000 7fd969072700 1 -- start start 2021-01-03T13:07:00.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd969072700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd9640b5330 0x7fd96413fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd969072700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96405f5e0 con 0x7fd964060d10 2021-01-03T13:07:00.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd969072700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9640b5710 con 0x7fd96409a090 2021-01-03T13:07:00.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd969072700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd964143730 con 0x7fd9640b5330 2021-01-03T13:07:00.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd9637fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd96409a090 0x7fd964140360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60282/0 (socket says 172.21.15.133:60282) 2021-01-03T13:07:00.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd9637fe700 1 -- 172.21.15.133:0/3074630224 learned_addr learned my addr 172.21.15.133:0/3074630224 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:00.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd963fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd9640b5330 0x7fd96413fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd962ffd700 1 -- 172.21.15.133:0/3074630224 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002967634 0 0) 0x7fd9640b5710 con 0x7fd96409a090 2021-01-03T13:07:00.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd962ffd700 1 -- 172.21.15.133:0/3074630224 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd944003230 con 0x7fd96409a090 2021-01-03T13:07:00.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd963fff700 1 -- 172.21.15.133:0/3074630224 >> v1:172.21.15.133:6789/0 conn(0x7fd96409a090 legacy=0x7fd964140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd962ffd700 1 -- 172.21.15.133:0/3074630224 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2464347567 0 0) 0x7fd944003230 con 0x7fd96409a090 2021-01-03T13:07:00.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd963fff700 1 -- 172.21.15.133:0/3074630224 >> v1:172.21.15.16:6789/0 conn(0x7fd964060d10 legacy=0x7fd96405fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd963fff700 1 -- 172.21.15.133:0/3074630224 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd964143910 con 0x7fd9640b5330 2021-01-03T13:07:00.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd963fff700 1 --2- 172.21.15.133:0/3074630224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9640b5330 0x7fd96413fe70 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7fd954001870 tx=0x7fd94c006dc0).ready entity=mon.1 client_cookie=f3ac18a1805d8f44 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd962ffd700 1 -- 172.21.15.133:0/3074630224 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9540016d0 con 0x7fd9640b5330 2021-01-03T13:07:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd962ffd700 1 -- 172.21.15.133:0/3074630224 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c009670 con 0x7fd9640b5330 2021-01-03T13:07:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd962ffd700 1 -- 172.21.15.133:0/3074630224 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd94c0097e0 con 0x7fd9640b5330 2021-01-03T13:07:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd969072700 1 -- 172.21.15.133:0/3074630224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9640b5330 msgr2=0x7fd96413fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd969072700 1 --2- 172.21.15.133:0/3074630224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9640b5330 0x7fd96413fe70 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7fd954001870 tx=0x7fd94c006dc0).stop 2021-01-03T13:07:00.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd969072700 1 -- 172.21.15.133:0/3074630224 shutdown_connections 2021-01-03T13:07:00.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd969072700 1 --2- 172.21.15.133:0/3074630224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9640b5330 0x7fd96413fe70 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd969072700 1 -- 172.21.15.133:0/3074630224 >> 172.21.15.133:0/3074630224 conn(0x7fd96405bdf0 msgr2=0x7fd96405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:00.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd969072700 1 -- 172.21.15.133:0/3074630224 shutdown_connections 2021-01-03T13:07:00.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd969072700 1 -- 172.21.15.133:0/3074630224 wait complete. 2021-01-03T13:07:00.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd969072700 1 Processor -- start 2021-01-03T13:07:00.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.328+0000 7fd969072700 1 -- start start 2021-01-03T13:07:00.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd969072700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd964060d10 0x7fd9640ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd969072700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd96409a090 0x7fd964146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd969072700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9640b5330 0x7fd964146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd969072700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964140a70 con 0x7fd96409a090 2021-01-03T13:07:00.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd969072700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd964141b40 con 0x7fd9640b5330 2021-01-03T13:07:00.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd969072700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd964147030 con 0x7fd964060d10 2021-01-03T13:07:00.343 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd968871700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9640b5330 0x7fd964146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd968871700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9640b5330 0x7fd964146b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39258/0 (socket says 172.21.15.133:39258) 2021-01-03T13:07:00.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd968871700 1 -- 172.21.15.133:0/4276208185 learned_addr learned my addr 172.21.15.133:0/4276208185 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:00.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd9637fe700 1 --2- 172.21.15.133:0/4276208185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd96409a090 0x7fd964146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd963fff700 1 --2- 172.21.15.133:0/4276208185 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd964060d10 0x7fd9640ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.344 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd968871700 1 -- 172.21.15.133:0/4276208185 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd964060d10 msgr2=0x7fd9640ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd968871700 1 --2- 172.21.15.133:0/4276208185 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd964060d10 0x7fd9640ac820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd968871700 1 -- 172.21.15.133:0/4276208185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd96409a090 msgr2=0x7fd964146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd968871700 1 --2- 172.21.15.133:0/4276208185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd96409a090 0x7fd964146650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd968871700 1 -- 172.21.15.133:0/4276208185 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd964155f10 con 0x7fd9640b5330 2021-01-03T13:07:00.345 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd968871700 1 --2- 172.21.15.133:0/4276208185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9640b5330 0x7fd964146b40 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7fd964067ac0 tx=0x7fd95c007f10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:00.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd9617fa700 1 -- 172.21.15.133:0/4276208185 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd95c00a5a0 con 0x7fd9640b5330 2021-01-03T13:07:00.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd9617fa700 1 -- 172.21.15.133:0/4276208185 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c00a700 con 0x7fd9640b5330 2021-01-03T13:07:00.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd9617fa700 1 -- 172.21.15.133:0/4276208185 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd95c00aa60 con 0x7fd9640b5330 2021-01-03T13:07:00.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd969072700 1 -- 172.21.15.133:0/4276208185 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9641561b0 con 0x7fd9640b5330 2021-01-03T13:07:00.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd969072700 1 -- 172.21.15.133:0/4276208185 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd964144940 con 0x7fd9640b5330 2021-01-03T13:07:00.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.332+0000 7fd969072700 1 -- 172.21.15.133:0/4276208185 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd964156340 con 0x7fd9640b5330 2021-01-03T13:07:00.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.336+0000 7fd9617fa700 1 -- 172.21.15.133:0/4276208185 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd95c019030 con 0x7fd9640b5330 2021-01-03T13:07:00.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.336+0000 7fd9617fa700 1 --2- 172.21.15.133:0/4276208185 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd948055440 0x7fd948057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.336+0000 7fd9617fa700 1 -- 172.21.15.133:0/4276208185 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd95c06d520 con 0x7fd9640b5330 2021-01-03T13:07:00.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.336+0000 7fd963fff700 1 --2- 172.21.15.133:0/4276208185 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd948055440 0x7fd948057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.348 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.336+0000 7fd963fff700 1 --2- 172.21.15.133:0/4276208185 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd948055440 0x7fd948057900 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fd94c019000 tx=0x7fd94c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:00.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.340+0000 7fd9617fa700 1 -- 172.21.15.133:0/4276208185 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd95c043b50 con 0x7fd9640b5330 2021-01-03T13:07:00.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.484+0000 7fd969072700 1 -- 172.21.15.133:0/4276208185 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd964057300 con 0x7fd9640b5330 2021-01-03T13:07:00.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.484+0000 7fd9617fa700 1 -- 172.21.15.133:0/4276208185 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v139) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd95c047170 con 0x7fd9640b5330 2021-01-03T13:07:00.489 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:00.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.484+0000 7fd969072700 1 -- 172.21.15.133:0/4276208185 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd948055440 msgr2=0x7fd948057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.484+0000 7fd969072700 1 --2- 172.21.15.133:0/4276208185 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd948055440 0x7fd948057900 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fd94c019000 tx=0x7fd94c015000).stop 2021-01-03T13:07:00.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.484+0000 7fd969072700 1 -- 172.21.15.133:0/4276208185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9640b5330 msgr2=0x7fd964146b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.484+0000 7fd969072700 1 --2- 172.21.15.133:0/4276208185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9640b5330 0x7fd964146b40 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7fd964067ac0 tx=0x7fd95c007f10).stop 2021-01-03T13:07:00.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.484+0000 7fd969072700 1 -- 172.21.15.133:0/4276208185 shutdown_connections 2021-01-03T13:07:00.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.484+0000 7fd969072700 1 --2- 172.21.15.133:0/4276208185 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd948055440 0x7fd948057900 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.484+0000 7fd969072700 1 --2- 172.21.15.133:0/4276208185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd9640b5330 0x7fd964146b40 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.484+0000 7fd969072700 1 --2- 172.21.15.133:0/4276208185 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd964060d10 0x7fd9640ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.484+0000 7fd969072700 1 --2- 172.21.15.133:0/4276208185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd96409a090 0x7fd964146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.484+0000 7fd969072700 1 -- 172.21.15.133:0/4276208185 >> 172.21.15.133:0/4276208185 conn(0x7fd96405bdf0 msgr2=0x7fd96413e680 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:00.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.484+0000 7fd969072700 1 -- 172.21.15.133:0/4276208185 shutdown_connections 2021-01-03T13:07:00.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.484+0000 7fd969072700 1 -- 172.21.15.133:0/4276208185 wait complete. 2021-01-03T13:07:00.502 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-01-03T13:07:00.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.604+0000 7f12a3fff700 1 Processor -- start 2021-01-03T13:07:00.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.604+0000 7f12a3fff700 1 -- start start 2021-01-03T13:07:00.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.604+0000 7f12a3fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f12a405f920 0x7f12a40b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.604+0000 7f12a3fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12a40b1590 0x7f12a413ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.604+0000 7f12a3fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a405fd00 con 0x7f12a4066f30 2021-01-03T13:07:00.613 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.604+0000 7f12a3fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a40b2980 con 0x7f12a405f920 2021-01-03T13:07:00.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.604+0000 7f12a3fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40ae700 con 0x7f12a40b1590 2021-01-03T13:07:00.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.604+0000 7f12a27fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f12a4066f30 0x7f12a40b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60294/0 (socket says 172.21.15.133:60294) 2021-01-03T13:07:00.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.604+0000 7f12a27fc700 1 -- 172.21.15.133:0/52401562 learned_addr learned my addr 172.21.15.133:0/52401562 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:00.614 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.604+0000 7f12a2ffd700 1 --2- 172.21.15.133:0/52401562 >> v2:172.21.15.16:3300/0 conn(0x7f12a405f920 0x7f12a40b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a37fe700 1 --2- 172.21.15.133:0/52401562 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12a40b1590 0x7f12a413ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 -- 172.21.15.133:0/52401562 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229801245 0 0) 0x7f12a405fd00 con 0x7f12a4066f30 2021-01-03T13:07:00.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 -- 172.21.15.133:0/52401562 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1284003230 con 0x7f12a4066f30 2021-01-03T13:07:00.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 -- 172.21.15.133:0/52401562 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2450111150 0 0) 0x7f1284003230 con 0x7f12a4066f30 2021-01-03T13:07:00.615 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 -- 172.21.15.133:0/52401562 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12a40b1590 msgr2=0x7f12a413ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:00.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 --2- 172.21.15.133:0/52401562 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12a40b1590 0x7f12a413ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 -- 172.21.15.133:0/52401562 >> v2:172.21.15.16:3300/0 conn(0x7f12a405f920 msgr2=0x7f12a40b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:00.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 --2- 172.21.15.133:0/52401562 >> v2:172.21.15.16:3300/0 conn(0x7f12a405f920 0x7f12a40b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 -- 172.21.15.133:0/52401562 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a40accd0 con 0x7f12a4066f30 2021-01-03T13:07:00.616 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 -- 172.21.15.133:0/52401562 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f12940016d0 con 0x7f12a4066f30 2021-01-03T13:07:00.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 -- 172.21.15.133:0/52401562 >> v1:172.21.15.133:6789/0 conn(0x7f12a4066f30 legacy=0x7f12a40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 --2- 172.21.15.133:0/52401562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1284003720 0x7f1284003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 --2- 172.21.15.133:0/52401562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1284004030 0x7f12840044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 --2- 172.21.15.133:0/52401562 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12a40b1590 0x7f1284004a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 -- 172.21.15.133:0/52401562 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40b2980 con 0x7f1284004030 2021-01-03T13:07:00.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 -- 172.21.15.133:0/52401562 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1284004fc0 con 0x7f1284003720 2021-01-03T13:07:00.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 -- 172.21.15.133:0/52401562 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1284005180 con 0x7f12a40b1590 2021-01-03T13:07:00.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a2ffd700 1 --2- 172.21.15.133:0/52401562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1284003720 0x7f1284003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a27fc700 1 --2- 172.21.15.133:0/52401562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1284004030 0x7f12840044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a37fe700 1 --2- 172.21.15.133:0/52401562 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12a40b1590 0x7f1284004a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a2ffd700 1 -- 172.21.15.133:0/52401562 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12a40b1590 msgr2=0x7f1284004a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:00.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a2ffd700 1 --2- 172.21.15.133:0/52401562 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12a40b1590 0x7f1284004a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a2ffd700 1 -- 172.21.15.133:0/52401562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1284004030 msgr2=0x7f12840044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:00.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a2ffd700 1 --2- 172.21.15.133:0/52401562 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1284004030 0x7f12840044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a2ffd700 1 -- 172.21.15.133:0/52401562 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1284003230 con 0x7f1284003720 2021-01-03T13:07:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a2ffd700 1 --2- 172.21.15.133:0/52401562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1284003720 0x7f1284003b40 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7f128c00c000 tx=0x7f128c008040).ready entity=mon.1 client_cookie=673399463c5ad256 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 -- 172.21.15.133:0/52401562 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f128c00e970 con 0x7f1284003720 2021-01-03T13:07:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 -- 172.21.15.133:0/52401562 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c00ead0 con 0x7f1284003720 2021-01-03T13:07:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a1ffb700 1 -- 172.21.15.133:0/52401562 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f128c00ee30 con 0x7f1284003720 2021-01-03T13:07:00.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a3fff700 1 -- 172.21.15.133:0/52401562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1284003720 msgr2=0x7f1284003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a3fff700 1 --2- 172.21.15.133:0/52401562 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1284003720 0x7f1284003b40 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7f128c00c000 tx=0x7f128c008040).stop 2021-01-03T13:07:00.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a37fe700 1 -- 172.21.15.133:0/52401562 reap_dead start 2021-01-03T13:07:00.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a3fff700 1 -- 172.21.15.133:0/52401562 shutdown_connections 2021-01-03T13:07:00.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a3fff700 1 -- 172.21.15.133:0/52401562 >> 172.21.15.133:0/52401562 conn(0x7f12a40b6110 msgr2=0x7f12a40b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:00.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a3fff700 1 -- 172.21.15.133:0/52401562 shutdown_connections 2021-01-03T13:07:00.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a3fff700 1 -- 172.21.15.133:0/52401562 wait complete. 2021-01-03T13:07:00.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a3fff700 1 Processor -- start 2021-01-03T13:07:00.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.608+0000 7f12a3fff700 1 -- start start 2021-01-03T13:07:00.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a3fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12a413f720 0x7f12a414dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a3fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12a413aeb0 0x7f12a414e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a4139720 0x7f12a413a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a3fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a41392e0 con 0x7f12a413f720 2021-01-03T13:07:00.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a3fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a413fb00 con 0x7f12a4139720 2021-01-03T13:07:00.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a3fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40b3410 con 0x7f12a413aeb0 2021-01-03T13:07:00.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a4139720 0x7f12a413a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a4139720 0x7f12a413a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39276/0 (socket says 172.21.15.133:39276) 2021-01-03T13:07:00.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a37fe700 1 -- 172.21.15.133:0/4058862782 learned_addr learned my addr 172.21.15.133:0/4058862782 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:00.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a27fc700 1 --2- 172.21.15.133:0/4058862782 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12a413aeb0 0x7f12a414e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a2ffd700 1 --2- 172.21.15.133:0/4058862782 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12a413f720 0x7f12a414dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a37fe700 1 -- 172.21.15.133:0/4058862782 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12a413aeb0 msgr2=0x7f12a414e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a37fe700 1 --2- 172.21.15.133:0/4058862782 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12a413aeb0 0x7f12a414e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a37fe700 1 -- 172.21.15.133:0/4058862782 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12a413f720 msgr2=0x7f12a414dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a37fe700 1 --2- 172.21.15.133:0/4058862782 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12a413f720 0x7f12a414dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a37fe700 1 -- 172.21.15.133:0/4058862782 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a40b36b0 con 0x7f12a4139720 2021-01-03T13:07:00.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a2ffd700 1 --2- 172.21.15.133:0/4058862782 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12a413f720 0x7f12a414dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:00.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a37fe700 1 --2- 172.21.15.133:0/4058862782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a4139720 0x7f12a413a270 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f129c00b000 tx=0x7f129c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:00.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f129bfff700 1 -- 172.21.15.133:0/4058862782 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f129c01a070 con 0x7f12a4139720 2021-01-03T13:07:00.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f129bfff700 1 -- 172.21.15.133:0/4058862782 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c00fb10 con 0x7f12a4139720 2021-01-03T13:07:00.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f129bfff700 1 -- 172.21.15.133:0/4058862782 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f129c00fe70 con 0x7f12a4139720 2021-01-03T13:07:00.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a3fff700 1 -- 172.21.15.133:0/4058862782 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a40b3950 con 0x7f12a4139720 2021-01-03T13:07:00.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a3fff700 1 -- 172.21.15.133:0/4058862782 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a4065320 con 0x7f12a4139720 2021-01-03T13:07:00.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.612+0000 7f12a3fff700 1 -- 172.21.15.133:0/4058862782 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a4057300 con 0x7f12a4139720 2021-01-03T13:07:00.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.616+0000 7f129bfff700 1 -- 172.21.15.133:0/4058862782 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f129c014440 con 0x7f12a4139720 2021-01-03T13:07:00.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.616+0000 7f129bfff700 1 --2- 172.21.15.133:0/4058862782 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1288055350 0x7f1288057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.616+0000 7f12a2ffd700 1 --2- 172.21.15.133:0/4058862782 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1288055350 0x7f1288057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.616+0000 7f129bfff700 1 -- 172.21.15.133:0/4058862782 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f129c06e3b0 con 0x7f12a4139720 2021-01-03T13:07:00.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.616+0000 7f12a2ffd700 1 --2- 172.21.15.133:0/4058862782 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1288055350 0x7f1288057810 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f128c00b000 tx=0x7f128c01a000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:00.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.620+0000 7f129bfff700 1 -- 172.21.15.133:0/4058862782 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f129c044980 con 0x7f12a4139720 2021-01-03T13:07:00.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.764+0000 7f12a3fff700 1 -- 172.21.15.133:0/4058862782 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f12a4061020 con 0x7f12a4139720 2021-01-03T13:07:00.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.764+0000 7f129bfff700 1 -- 172.21.15.133:0/4058862782 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v139) v1 ==== 84+0+143 (secure 0 0 0) 0x7f129c047fa0 con 0x7f12a4139720 2021-01-03T13:07:00.772 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:00.772 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2021-01-03T13:07:00.772 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:00.772 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2021-01-03T13:07:00.773 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2021-01-03T13:07:00.773 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:00.773 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:00.773 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2021-01-03T13:07:00.773 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2021-01-03T13:07:00.774 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:00.774 INFO:teuthology.orchestra.run.smithi133.stdout:] 2021-01-03T13:07:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.768+0000 7f12a3fff700 1 -- 172.21.15.133:0/4058862782 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1288055350 msgr2=0x7f1288057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.768+0000 7f12a3fff700 1 --2- 172.21.15.133:0/4058862782 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1288055350 0x7f1288057810 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f128c00b000 tx=0x7f128c01a000).stop 2021-01-03T13:07:00.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.768+0000 7f12a3fff700 1 -- 172.21.15.133:0/4058862782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a4139720 msgr2=0x7f12a413a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.768+0000 7f12a3fff700 1 --2- 172.21.15.133:0/4058862782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a4139720 0x7f12a413a270 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f129c00b000 tx=0x7f129c0091a0).stop 2021-01-03T13:07:00.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.768+0000 7f12a3fff700 1 -- 172.21.15.133:0/4058862782 shutdown_connections 2021-01-03T13:07:00.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.768+0000 7f12a3fff700 1 --2- 172.21.15.133:0/4058862782 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1288055350 0x7f1288057810 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.768+0000 7f12a3fff700 1 --2- 172.21.15.133:0/4058862782 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12a413f720 0x7f12a414dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.768+0000 7f12a3fff700 1 --2- 172.21.15.133:0/4058862782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12a4139720 0x7f12a413a270 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.768+0000 7f12a3fff700 1 --2- 172.21.15.133:0/4058862782 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f12a413aeb0 0x7f12a414e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.768+0000 7f12a3fff700 1 -- 172.21.15.133:0/4058862782 >> 172.21.15.133:0/4058862782 conn(0x7f12a40b6110 msgr2=0x7f12a40b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:00.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.768+0000 7f12a3fff700 1 -- 172.21.15.133:0/4058862782 shutdown_connections 2021-01-03T13:07:00.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.768+0000 7f12a3fff700 1 -- 172.21.15.133:0/4058862782 wait complete. 2021-01-03T13:07:00.790 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-01-03T13:07:00.791 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-01-03T13:07:00.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f2d404700 1 Processor -- start 2021-01-03T13:07:00.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f2d404700 1 -- start start 2021-01-03T13:07:00.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f2d404700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5f28060510 0x7f5f2805c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f2d404700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f2805fd10 0x7f5f280b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f2d404700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2805bf00 con 0x7f5f280b4c20 2021-01-03T13:07:00.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f2d404700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f2805c1a0 con 0x7f5f28060510 2021-01-03T13:07:00.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f2d404700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2805c440 con 0x7f5f2805fd10 2021-01-03T13:07:00.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f277fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5f28060510 0x7f5f2805c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f2cc03700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f2805fd10 0x7f5f280b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f277fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5f28060510 0x7f5f2805c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39284/0 (socket says 172.21.15.133:39284) 2021-01-03T13:07:00.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f277fe700 1 -- 172.21.15.133:0/3432579919 learned_addr learned my addr 172.21.15.133:0/3432579919 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:00.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f277fe700 1 -- 172.21.15.133:0/3432579919 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f2805fd10 msgr2=0x7f5f280b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:00.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f277fe700 1 --2- 172.21.15.133:0/3432579919 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f2805fd10 0x7f5f280b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f277fe700 1 -- 172.21.15.133:0/3432579919 >> v1:172.21.15.16:6789/0 conn(0x7f5f280b4c20 legacy=0x7f5f280b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f277fe700 1 -- 172.21.15.133:0/3432579919 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f280b6ad0 con 0x7f5f28060510 2021-01-03T13:07:00.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f277fe700 1 --2- 172.21.15.133:0/3432579919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f28060510 0x7f5f2805c8e0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f5f180010d0 tx=0x7f5f1c006e80).ready entity=mon.1 client_cookie=b84b464dcabf06c7 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:00.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f26ffd700 1 -- 172.21.15.133:0/3432579919 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f1c0096b0 con 0x7f5f28060510 2021-01-03T13:07:00.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f26ffd700 1 -- 172.21.15.133:0/3432579919 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c009810 con 0x7f5f28060510 2021-01-03T13:07:00.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f26ffd700 1 -- 172.21.15.133:0/3432579919 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f1c009980 con 0x7f5f28060510 2021-01-03T13:07:00.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f2d404700 1 -- 172.21.15.133:0/3432579919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f28060510 msgr2=0x7f5f2805c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.900+0000 7f5f2d404700 1 --2- 172.21.15.133:0/3432579919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f28060510 0x7f5f2805c8e0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f5f180010d0 tx=0x7f5f1c006e80).stop 2021-01-03T13:07:00.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.904+0000 7f5f2d404700 1 -- 172.21.15.133:0/3432579919 shutdown_connections 2021-01-03T13:07:00.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.904+0000 7f5f2d404700 1 --2- 172.21.15.133:0/3432579919 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f2805fd10 0x7f5f280b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.904+0000 7f5f2d404700 1 --2- 172.21.15.133:0/3432579919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f28060510 0x7f5f2805c8e0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.904+0000 7f5f2d404700 1 -- 172.21.15.133:0/3432579919 >> 172.21.15.133:0/3432579919 conn(0x7f5f280b9f00 msgr2=0x7f5f280b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:00.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.904+0000 7f5f2d404700 1 -- 172.21.15.133:0/3432579919 shutdown_connections 2021-01-03T13:07:00.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.904+0000 7f5f2d404700 1 -- 172.21.15.133:0/3432579919 wait complete. 2021-01-03T13:07:00.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.904+0000 7f5f2d404700 1 Processor -- start 2021-01-03T13:07:00.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.904+0000 7f5f2d404700 1 -- start start 2021-01-03T13:07:00.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2d404700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f2805fd10 0x7f5f280b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2d404700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f28060510 0x7f5f281436a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2d404700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f280b4c20 0x7f5f28141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2d404700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f280b1c50 con 0x7f5f2805fd10 2021-01-03T13:07:00.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2d404700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f280b82d0 con 0x7f5f280b4c20 2021-01-03T13:07:00.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2d404700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f28142d30 con 0x7f5f28060510 2021-01-03T13:07:00.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2cc03700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f280b4c20 0x7f5f28141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2cc03700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f280b4c20 0x7f5f28141ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39292/0 (socket says 172.21.15.133:39292) 2021-01-03T13:07:00.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2cc03700 1 -- 172.21.15.133:0/2935521683 learned_addr learned my addr 172.21.15.133:0/2935521683 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:00.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f27fff700 1 --2- 172.21.15.133:0/2935521683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f2805fd10 0x7f5f280b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f277fe700 1 --2- 172.21.15.133:0/2935521683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f28060510 0x7f5f281436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2cc03700 1 -- 172.21.15.133:0/2935521683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f28060510 msgr2=0x7f5f281436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2cc03700 1 --2- 172.21.15.133:0/2935521683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f28060510 0x7f5f281436a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2cc03700 1 -- 172.21.15.133:0/2935521683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f2805fd10 msgr2=0x7f5f280b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:00.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2cc03700 1 --2- 172.21.15.133:0/2935521683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f2805fd10 0x7f5f280b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:00.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2cc03700 1 -- 172.21.15.133:0/2935521683 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f28142f60 con 0x7f5f280b4c20 2021-01-03T13:07:00.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f27fff700 1 --2- 172.21.15.133:0/2935521683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f2805fd10 0x7f5f280b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:00.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2cc03700 1 --2- 172.21.15.133:0/2935521683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f280b4c20 0x7f5f28141ab0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f5f280b27d0 tx=0x7f5f200091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:00.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f257fa700 1 -- 172.21.15.133:0/2935521683 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f2000cbb0 con 0x7f5f280b4c20 2021-01-03T13:07:00.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f257fa700 1 -- 172.21.15.133:0/2935521683 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2000cd10 con 0x7f5f280b4c20 2021-01-03T13:07:00.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2d404700 1 -- 172.21.15.133:0/2935521683 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f28143200 con 0x7f5f280b4c20 2021-01-03T13:07:00.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f257fa700 1 -- 172.21.15.133:0/2935521683 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f200125e0 con 0x7f5f280b4c20 2021-01-03T13:07:00.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2d404700 1 -- 172.21.15.133:0/2935521683 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f28151f80 con 0x7f5f280b4c20 2021-01-03T13:07:00.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f2d404700 1 -- 172.21.15.133:0/2935521683 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f28057300 con 0x7f5f280b4c20 2021-01-03T13:07:00.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.908+0000 7f5f257fa700 1 -- 172.21.15.133:0/2935521683 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5f20022070 con 0x7f5f280b4c20 2021-01-03T13:07:00.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.912+0000 7f5f257fa700 1 --2- 172.21.15.133:0/2935521683 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f080553b0 0x7f5f08057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:00.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.912+0000 7f5f257fa700 1 -- 172.21.15.133:0/2935521683 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5f2006e400 con 0x7f5f280b4c20 2021-01-03T13:07:00.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.912+0000 7f5f27fff700 1 --2- 172.21.15.133:0/2935521683 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f080553b0 0x7f5f08057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:00.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.912+0000 7f5f27fff700 1 --2- 172.21.15.133:0/2935521683 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f080553b0 0x7f5f08057870 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f5f1800b000 tx=0x7f5f18009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:00.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:00.916+0000 7f5f257fa700 1 -- 172.21.15.133:0/2935521683 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5f20044990 con 0x7f5f280b4c20 2021-01-03T13:07:01.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:01.056+0000 7f5f2d404700 1 -- 172.21.15.133:0/2935521683 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f5f28067a00 con 0x7f5f280b4c20 2021-01-03T13:07:02.071 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.064+0000 7f5f257fa700 1 -- 172.21.15.133:0/2935521683 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v140) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5f20016070 con 0x7f5f280b4c20 2021-01-03T13:07:02.074 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.068+0000 7f5f2d404700 1 -- 172.21.15.133:0/2935521683 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f080553b0 msgr2=0x7f5f08057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:02.075 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.068+0000 7f5f2d404700 1 --2- 172.21.15.133:0/2935521683 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f080553b0 0x7f5f08057870 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f5f1800b000 tx=0x7f5f18009040).stop 2021-01-03T13:07:02.075 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.068+0000 7f5f2d404700 1 -- 172.21.15.133:0/2935521683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f280b4c20 msgr2=0x7f5f28141ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:02.075 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.068+0000 7f5f2d404700 1 --2- 172.21.15.133:0/2935521683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f280b4c20 0x7f5f28141ab0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f5f280b27d0 tx=0x7f5f200091a0).stop 2021-01-03T13:07:02.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.068+0000 7f5f2d404700 1 -- 172.21.15.133:0/2935521683 shutdown_connections 2021-01-03T13:07:02.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.068+0000 7f5f2d404700 1 --2- 172.21.15.133:0/2935521683 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5f080553b0 0x7f5f08057870 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:02.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.068+0000 7f5f2d404700 1 --2- 172.21.15.133:0/2935521683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5f2805fd10 0x7f5f280b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:02.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.068+0000 7f5f2d404700 1 --2- 172.21.15.133:0/2935521683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5f280b4c20 0x7f5f28141ab0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:02.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.068+0000 7f5f2d404700 1 --2- 172.21.15.133:0/2935521683 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5f28060510 0x7f5f281436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:02.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.068+0000 7f5f2d404700 1 -- 172.21.15.133:0/2935521683 >> 172.21.15.133:0/2935521683 conn(0x7f5f280b9f00 msgr2=0x7f5f2809e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:02.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.068+0000 7f5f2d404700 1 -- 172.21.15.133:0/2935521683 shutdown_connections 2021-01-03T13:07:02.078 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.068+0000 7f5f2d404700 1 -- 172.21.15.133:0/2935521683 wait complete. 2021-01-03T13:07:02.078 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2021-01-03T13:07:02.089 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-01-03T13:07:02.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.196+0000 7f5799653700 1 Processor -- start 2021-01-03T13:07:02.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.196+0000 7f5799653700 1 -- start start 2021-01-03T13:07:02.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5799653700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f579405f920 0x7f57940b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:02.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5799653700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5794066f30 0x7f57940b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:02.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5799653700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579405fd00 con 0x7f57940b1590 2021-01-03T13:07:02.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5799653700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57940ae700 con 0x7f579405f920 2021-01-03T13:07:02.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5799653700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57940accd0 con 0x7f5794066f30 2021-01-03T13:07:02.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f57937fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5794066f30 0x7f57940b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:02.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f57937fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5794066f30 0x7f57940b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39296/0 (socket says 172.21.15.133:39296) 2021-01-03T13:07:02.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f57937fe700 1 -- 172.21.15.133:0/1016088806 learned_addr learned my addr 172.21.15.133:0/1016088806 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:02.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5793fff700 1 --2- 172.21.15.133:0/1016088806 >> v2:172.21.15.16:3300/0 conn(0x7f579405f920 0x7f57940b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:02.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f57937fe700 1 -- 172.21.15.133:0/1016088806 >> v2:172.21.15.16:3300/0 conn(0x7f579405f920 msgr2=0x7f57940b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:02.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f57937fe700 1 --2- 172.21.15.133:0/1016088806 >> v2:172.21.15.16:3300/0 conn(0x7f579405f920 0x7f57940b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:02.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f57937fe700 1 -- 172.21.15.133:0/1016088806 >> v1:172.21.15.16:6789/0 conn(0x7f57940b1590 legacy=0x7f57940613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:02.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f57937fe700 1 -- 172.21.15.133:0/1016088806 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57940acf70 con 0x7f5794066f30 2021-01-03T13:07:02.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f57937fe700 1 --2- 172.21.15.133:0/1016088806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5794066f30 0x7f57940b2270 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f5788002f30 tx=0x7f5788006e80).ready entity=mon.1 client_cookie=ff644b16a56e51c1 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:02.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5792ffd700 1 -- 172.21.15.133:0/1016088806 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57880097f0 con 0x7f5794066f30 2021-01-03T13:07:02.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5792ffd700 1 -- 172.21.15.133:0/1016088806 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5788009950 con 0x7f5794066f30 2021-01-03T13:07:02.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5792ffd700 1 -- 172.21.15.133:0/1016088806 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5788009cb0 con 0x7f5794066f30 2021-01-03T13:07:02.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5799653700 1 -- 172.21.15.133:0/1016088806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5794066f30 msgr2=0x7f57940b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:02.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5799653700 1 --2- 172.21.15.133:0/1016088806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5794066f30 0x7f57940b2270 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f5788002f30 tx=0x7f5788006e80).stop 2021-01-03T13:07:02.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5799653700 1 -- 172.21.15.133:0/1016088806 shutdown_connections 2021-01-03T13:07:02.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5799653700 1 --2- 172.21.15.133:0/1016088806 >> v2:172.21.15.16:3300/0 conn(0x7f579405f920 0x7f57940b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:02.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5799653700 1 --2- 172.21.15.133:0/1016088806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5794066f30 0x7f57940b2270 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:02.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5799653700 1 -- 172.21.15.133:0/1016088806 >> 172.21.15.133:0/1016088806 conn(0x7f57940b6110 msgr2=0x7f57940b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:02.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5799653700 1 -- 172.21.15.133:0/1016088806 shutdown_connections 2021-01-03T13:07:02.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5799653700 1 -- 172.21.15.133:0/1016088806 wait complete. 2021-01-03T13:07:02.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5799653700 1 Processor -- start 2021-01-03T13:07:02.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.200+0000 7f5799653700 1 -- start start 2021-01-03T13:07:02.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5799653700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579405f920 0x7f579413a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:02.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5799653700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5794066f30 0x7f5794064210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:02.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5799653700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57940b1590 0x7f5794151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:02.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5799653700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5794065a00 con 0x7f5794066f30 2021-01-03T13:07:02.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5799653700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5794063870 con 0x7f579405f920 2021-01-03T13:07:02.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5799653700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5794065c30 con 0x7f57940b1590 2021-01-03T13:07:02.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5793fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579405f920 0x7f579413a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:02.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5793fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579405f920 0x7f579413a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39302/0 (socket says 172.21.15.133:39302) 2021-01-03T13:07:02.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5793fff700 1 -- 172.21.15.133:0/1891484890 learned_addr learned my addr 172.21.15.133:0/1891484890 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:02.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f57937fe700 1 --2- 172.21.15.133:0/1891484890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5794066f30 0x7f5794064210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:02.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5798e52700 1 --2- 172.21.15.133:0/1891484890 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57940b1590 0x7f5794151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:02.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5793fff700 1 -- 172.21.15.133:0/1891484890 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57940b1590 msgr2=0x7f5794151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:02.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5793fff700 1 --2- 172.21.15.133:0/1891484890 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57940b1590 0x7f5794151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:02.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5793fff700 1 -- 172.21.15.133:0/1891484890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5794066f30 msgr2=0x7f5794064210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:02.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5793fff700 1 --2- 172.21.15.133:0/1891484890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5794066f30 0x7f5794064210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:02.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5793fff700 1 -- 172.21.15.133:0/1891484890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5794063ad0 con 0x7f579405f920 2021-01-03T13:07:02.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f57937fe700 1 --2- 172.21.15.133:0/1891484890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5794066f30 0x7f5794064210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:02.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5793fff700 1 --2- 172.21.15.133:0/1891484890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579405f920 0x7f579413a570 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f5784003070 tx=0x7f5784008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:02.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f57917fa700 1 -- 172.21.15.133:0/1891484890 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5784009980 con 0x7f579405f920 2021-01-03T13:07:02.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5799653700 1 -- 172.21.15.133:0/1891484890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5794063d70 con 0x7f579405f920 2021-01-03T13:07:02.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5799653700 1 -- 172.21.15.133:0/1891484890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5794147300 con 0x7f579405f920 2021-01-03T13:07:02.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f57917fa700 1 -- 172.21.15.133:0/1891484890 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5784009ae0 con 0x7f579405f920 2021-01-03T13:07:02.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f57917fa700 1 -- 172.21.15.133:0/1891484890 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5784009e40 con 0x7f579405f920 2021-01-03T13:07:02.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f5799653700 1 -- 172.21.15.133:0/1891484890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57700033e0 con 0x7f579405f920 2021-01-03T13:07:02.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.204+0000 7f57917fa700 1 -- 172.21.15.133:0/1891484890 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5784013480 con 0x7f579405f920 2021-01-03T13:07:02.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.208+0000 7f57917fa700 1 --2- 172.21.15.133:0/1891484890 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5774055440 0x7f5774057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:02.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.208+0000 7f57917fa700 1 -- 172.21.15.133:0/1891484890 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f578406e170 con 0x7f579405f920 2021-01-03T13:07:02.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.208+0000 7f57937fe700 1 --2- 172.21.15.133:0/1891484890 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5774055440 0x7f5774057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:02.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.208+0000 7f57937fe700 1 --2- 172.21.15.133:0/1891484890 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5774055440 0x7f5774057900 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f578801a000 tx=0x7f5788015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:02.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.212+0000 7f57917fa700 1 -- 172.21.15.133:0/1891484890 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5784044540 con 0x7f579405f920 2021-01-03T13:07:02.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:02.356+0000 7f5799653700 1 -- 172.21.15.133:0/1891484890 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f57700022a0 con 0x7f579405f920 2021-01-03T13:07:03.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.072+0000 7f57917fa700 1 -- 172.21.15.133:0/1891484890 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v141) v1 ==== 125+0+0 (secure 0 0 0) 0x7f5784047b60 con 0x7f579405f920 2021-01-03T13:07:03.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.080+0000 7f5799653700 1 -- 172.21.15.133:0/1891484890 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5774055440 msgr2=0x7f5774057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.080+0000 7f5799653700 1 --2- 172.21.15.133:0/1891484890 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5774055440 0x7f5774057900 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f578801a000 tx=0x7f5788015000).stop 2021-01-03T13:07:03.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.080+0000 7f5799653700 1 -- 172.21.15.133:0/1891484890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579405f920 msgr2=0x7f579413a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.080+0000 7f5799653700 1 --2- 172.21.15.133:0/1891484890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579405f920 0x7f579413a570 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f5784003070 tx=0x7f5784008040).stop 2021-01-03T13:07:03.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.084+0000 7f5799653700 1 -- 172.21.15.133:0/1891484890 shutdown_connections 2021-01-03T13:07:03.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.084+0000 7f5799653700 1 --2- 172.21.15.133:0/1891484890 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5774055440 0x7f5774057900 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.084+0000 7f5799653700 1 --2- 172.21.15.133:0/1891484890 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f57940b1590 0x7f5794151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.084+0000 7f5799653700 1 --2- 172.21.15.133:0/1891484890 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f579405f920 0x7f579413a570 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.084+0000 7f5799653700 1 --2- 172.21.15.133:0/1891484890 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5794066f30 0x7f5794064210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.084+0000 7f5799653700 1 -- 172.21.15.133:0/1891484890 >> 172.21.15.133:0/1891484890 conn(0x7f57940b6110 msgr2=0x7f57940b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:03.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.084+0000 7f5799653700 1 -- 172.21.15.133:0/1891484890 shutdown_connections 2021-01-03T13:07:03.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.084+0000 7f5799653700 1 -- 172.21.15.133:0/1891484890 wait complete. 2021-01-03T13:07:03.092 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2021-01-03T13:07:03.105 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-01-03T13:07:03.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.224+0000 7fb091974700 1 Processor -- start 2021-01-03T13:07:03.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.224+0000 7fb091974700 1 -- start start 2021-01-03T13:07:03.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.224+0000 7fb091974700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb08c0b2350 0x7fb08c144a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:03.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.224+0000 7fb091974700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c062650 con 0x7fb08c062270 2021-01-03T13:07:03.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.224+0000 7fb091974700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c060be0 con 0x7fb08c0b1ab0 2021-01-03T13:07:03.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.224+0000 7fb091974700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08c1471c0 con 0x7fb08c0b2350 2021-01-03T13:07:03.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.224+0000 7fb08a7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb08c0b1ab0 0x7fb08c14aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60344/0 (socket says 172.21.15.133:60344) 2021-01-03T13:07:03.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.224+0000 7fb08a7fc700 1 -- 172.21.15.133:0/4031823123 learned_addr learned my addr 172.21.15.133:0/4031823123 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:03.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.224+0000 7fb08b7fe700 1 --2- 172.21.15.133:0/4031823123 >> v2:172.21.15.133:3300/0 conn(0x7fb08c0b2350 0x7fb08c144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:03.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.224+0000 7fb089ffb700 1 -- 172.21.15.133:0/4031823123 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609538068 0 0) 0x7fb08c060be0 con 0x7fb08c0b1ab0 2021-01-03T13:07:03.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.224+0000 7fb089ffb700 1 -- 172.21.15.133:0/4031823123 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb070003230 con 0x7fb08c0b1ab0 2021-01-03T13:07:03.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb08b7fe700 1 -- 172.21.15.133:0/4031823123 >> v1:172.21.15.133:6789/0 conn(0x7fb08c0b1ab0 legacy=0x7fb08c14aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb08b7fe700 1 -- 172.21.15.133:0/4031823123 >> v1:172.21.15.16:6789/0 conn(0x7fb08c062270 legacy=0x7fb08c144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb08b7fe700 1 -- 172.21.15.133:0/4031823123 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0606a0 con 0x7fb08c0b2350 2021-01-03T13:07:03.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb08b7fe700 1 --2- 172.21.15.133:0/4031823123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c0b2350 0x7fb08c144a80 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7fb0840032b0 tx=0x7fb0840091a0).ready entity=mon.1 client_cookie=df662897da50f994 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:03.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb089ffb700 1 -- 172.21.15.133:0/4031823123 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb08400b9a0 con 0x7fb08c0b2350 2021-01-03T13:07:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb089ffb700 1 -- 172.21.15.133:0/4031823123 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08400bb00 con 0x7fb08c0b2350 2021-01-03T13:07:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb089ffb700 1 -- 172.21.15.133:0/4031823123 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb08400bc70 con 0x7fb08c0b2350 2021-01-03T13:07:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb091974700 1 -- 172.21.15.133:0/4031823123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c0b2350 msgr2=0x7fb08c144a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb091974700 1 --2- 172.21.15.133:0/4031823123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c0b2350 0x7fb08c144a80 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7fb0840032b0 tx=0x7fb0840091a0).stop 2021-01-03T13:07:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb091974700 1 -- 172.21.15.133:0/4031823123 shutdown_connections 2021-01-03T13:07:03.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb091974700 1 --2- 172.21.15.133:0/4031823123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c0b2350 0x7fb08c144a80 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb091974700 1 -- 172.21.15.133:0/4031823123 >> 172.21.15.133:0/4031823123 conn(0x7fb08c0b6db0 msgr2=0x7fb08c061820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:03.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb091974700 1 -- 172.21.15.133:0/4031823123 shutdown_connections 2021-01-03T13:07:03.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb091974700 1 -- 172.21.15.133:0/4031823123 wait complete. 2021-01-03T13:07:03.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb091974700 1 Processor -- start 2021-01-03T13:07:03.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb091974700 1 -- start start 2021-01-03T13:07:03.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb091974700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb08c062270 0x7fb08c0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:03.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb091974700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb08c0b1ab0 0x7fb08c14dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:03.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb091974700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c0b2350 0x7fb08c14e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:03.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb091974700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c15a400 con 0x7fb08c062270 2021-01-03T13:07:03.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb091974700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c065ad0 con 0x7fb08c0b2350 2021-01-03T13:07:03.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb091974700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c14e5f0 con 0x7fb08c0b1ab0 2021-01-03T13:07:03.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.228+0000 7fb08b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c0b2350 0x7fb08c14e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:03.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb08b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c0b2350 0x7fb08c14e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39318/0 (socket says 172.21.15.133:39318) 2021-01-03T13:07:03.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb08b7fe700 1 -- 172.21.15.133:0/1762088117 learned_addr learned my addr 172.21.15.133:0/1762088117 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:03.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb08a7fc700 1 --2- 172.21.15.133:0/1762088117 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb08c0b1ab0 0x7fb08c14dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:03.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb08affd700 1 --2- 172.21.15.133:0/1762088117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb08c062270 0x7fb08c0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:03.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb08b7fe700 1 -- 172.21.15.133:0/1762088117 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb08c0b1ab0 msgr2=0x7fb08c14dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb08b7fe700 1 --2- 172.21.15.133:0/1762088117 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb08c0b1ab0 0x7fb08c14dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb08b7fe700 1 -- 172.21.15.133:0/1762088117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb08c062270 msgr2=0x7fb08c0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb08b7fe700 1 --2- 172.21.15.133:0/1762088117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb08c062270 0x7fb08c0aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb08b7fe700 1 -- 172.21.15.133:0/1762088117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0652f0 con 0x7fb08c0b2350 2021-01-03T13:07:03.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb08affd700 1 --2- 172.21.15.133:0/1762088117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb08c062270 0x7fb08c0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:03.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb08b7fe700 1 --2- 172.21.15.133:0/1762088117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c0b2350 0x7fb08c14e100 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7fb08c064980 tx=0x7fb084016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:03.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb07bfff700 1 -- 172.21.15.133:0/1762088117 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0840107a0 con 0x7fb08c0b2350 2021-01-03T13:07:03.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb07bfff700 1 -- 172.21.15.133:0/1762088117 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb084010900 con 0x7fb08c0b2350 2021-01-03T13:07:03.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb091974700 1 -- 172.21.15.133:0/1762088117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c065590 con 0x7fb08c0b2350 2021-01-03T13:07:03.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb07bfff700 1 -- 172.21.15.133:0/1762088117 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb084010c60 con 0x7fb08c0b2350 2021-01-03T13:07:03.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb091974700 1 -- 172.21.15.133:0/1762088117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c14a900 con 0x7fb08c0b2350 2021-01-03T13:07:03.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb091974700 1 -- 172.21.15.133:0/1762088117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c057300 con 0x7fb08c0b2350 2021-01-03T13:07:03.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb07bfff700 1 -- 172.21.15.133:0/1762088117 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb08401e070 con 0x7fb08c0b2350 2021-01-03T13:07:03.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb07bfff700 1 --2- 172.21.15.133:0/1762088117 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb068055440 0x7fb068057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:03.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb08affd700 1 --2- 172.21.15.133:0/1762088117 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb068055440 0x7fb068057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:03.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.232+0000 7fb07bfff700 1 -- 172.21.15.133:0/1762088117 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fb08406eef0 con 0x7fb08c0b2350 2021-01-03T13:07:03.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.236+0000 7fb08affd700 1 --2- 172.21.15.133:0/1762088117 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb068055440 0x7fb068057900 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fb07c00b000 tx=0x7fb07c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:03.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.240+0000 7fb07bfff700 1 -- 172.21.15.133:0/1762088117 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb084045150 con 0x7fb08c0b2350 2021-01-03T13:07:03.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.428+0000 7fb091974700 1 -- 172.21.15.133:0/1762088117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fb08c05cf00 con 0x7fb08c0b2350 2021-01-03T13:07:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.444+0000 7fb07bfff700 1 -- 172.21.15.133:0/1762088117 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 25 and data pool 26 v66) v1 ==== 189+0+0 (secure 0 0 0) 0x7fb0840150d0 con 0x7fb08c0b2350 2021-01-03T13:07:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.452+0000 7fb091974700 1 -- 172.21.15.133:0/1762088117 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb068055440 msgr2=0x7fb068057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.452+0000 7fb091974700 1 --2- 172.21.15.133:0/1762088117 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb068055440 0x7fb068057900 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fb07c00b000 tx=0x7fb07c009040).stop 2021-01-03T13:07:03.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.452+0000 7fb091974700 1 -- 172.21.15.133:0/1762088117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c0b2350 msgr2=0x7fb08c14e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.452+0000 7fb091974700 1 --2- 172.21.15.133:0/1762088117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c0b2350 0x7fb08c14e100 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7fb08c064980 tx=0x7fb084016000).stop 2021-01-03T13:07:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.460+0000 7fb091974700 1 -- 172.21.15.133:0/1762088117 shutdown_connections 2021-01-03T13:07:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.460+0000 7fb091974700 1 --2- 172.21.15.133:0/1762088117 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb068055440 0x7fb068057900 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.460+0000 7fb091974700 1 --2- 172.21.15.133:0/1762088117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb08c062270 0x7fb08c0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.460+0000 7fb091974700 1 --2- 172.21.15.133:0/1762088117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb08c0b2350 0x7fb08c14e100 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.460+0000 7fb091974700 1 --2- 172.21.15.133:0/1762088117 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb08c0b1ab0 0x7fb08c14dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.460+0000 7fb091974700 1 -- 172.21.15.133:0/1762088117 >> 172.21.15.133:0/1762088117 conn(0x7fb08c0b6db0 msgr2=0x7fb08c1441a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:03.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.460+0000 7fb091974700 1 -- 172.21.15.133:0/1762088117 shutdown_connections 2021-01-03T13:07:03.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.460+0000 7fb091974700 1 -- 172.21.15.133:0/1762088117 wait complete. 2021-01-03T13:07:03.467 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 25 and data pool 26 2021-01-03T13:07:03.478 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:07:03.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.572+0000 7fa361335700 1 Processor -- start 2021-01-03T13:07:03.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.572+0000 7fa361335700 1 -- start start 2021-01-03T13:07:03.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.572+0000 7fa361335700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa35c0b7ab0 0x7fa35c064cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:03.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.572+0000 7fa361335700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa35c13e040 0x7fa35c13e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:03.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.572+0000 7fa361335700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa35c0b2140 con 0x7fa35c0b3800 2021-01-03T13:07:03.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.572+0000 7fa361335700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa35c144760 con 0x7fa35c0b7ab0 2021-01-03T13:07:03.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.572+0000 7fa361335700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa35c0651e0 con 0x7fa35c13e040 2021-01-03T13:07:03.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.572+0000 7fa35b7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa35c0b3800 0x7fa35c144050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60368/0 (socket says 172.21.15.133:60368) 2021-01-03T13:07:03.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.572+0000 7fa360b34700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa35c13e040 0x7fa35c13e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:03.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.572+0000 7fa35b7fe700 1 -- 172.21.15.133:0/2902932471 learned_addr learned my addr 172.21.15.133:0/2902932471 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:03.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.572+0000 7fa35bfff700 1 --2- 172.21.15.133:0/2902932471 >> v2:172.21.15.16:3300/0 conn(0x7fa35c0b7ab0 0x7fa35c064cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:03.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.572+0000 7fa360b34700 1 -- 172.21.15.133:0/2902932471 >> v2:172.21.15.16:3300/0 conn(0x7fa35c0b7ab0 msgr2=0x7fa35c064cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:03.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.572+0000 7fa360b34700 1 --2- 172.21.15.133:0/2902932471 >> v2:172.21.15.16:3300/0 conn(0x7fa35c0b7ab0 0x7fa35c064cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.572+0000 7fa360b34700 1 -- 172.21.15.133:0/2902932471 >> v1:172.21.15.133:6789/0 conn(0x7fa35c0b3800 legacy=0x7fa35c144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.572+0000 7fa35affd700 1 -- 172.21.15.133:0/2902932471 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 864486874 0 0) 0x7fa35c0b2140 con 0x7fa35c0b3800 2021-01-03T13:07:03.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.572+0000 7fa360b34700 1 -- 172.21.15.133:0/2902932471 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c0b2e30 con 0x7fa35c13e040 2021-01-03T13:07:03.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.572+0000 7fa360b34700 1 --2- 172.21.15.133:0/2902932471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa35c13e040 0x7fa35c13e490 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fa3540032b0 tx=0x7fa3540091a0).ready entity=mon.1 client_cookie=59d41c0c01aba235 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:03.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.576+0000 7fa35affd700 1 -- 172.21.15.133:0/2902932471 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa35400ba50 con 0x7fa35c13e040 2021-01-03T13:07:03.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.576+0000 7fa35affd700 1 -- 172.21.15.133:0/2902932471 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35400bbb0 con 0x7fa35c13e040 2021-01-03T13:07:03.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.576+0000 7fa35affd700 1 -- 172.21.15.133:0/2902932471 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa35400bd20 con 0x7fa35c13e040 2021-01-03T13:07:03.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.576+0000 7fa361335700 1 -- 172.21.15.133:0/2902932471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa35c13e040 msgr2=0x7fa35c13e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.576+0000 7fa361335700 1 --2- 172.21.15.133:0/2902932471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa35c13e040 0x7fa35c13e490 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fa3540032b0 tx=0x7fa3540091a0).stop 2021-01-03T13:07:03.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.576+0000 7fa361335700 1 -- 172.21.15.133:0/2902932471 shutdown_connections 2021-01-03T13:07:03.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.576+0000 7fa361335700 1 --2- 172.21.15.133:0/2902932471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa35c13e040 0x7fa35c13e490 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.576+0000 7fa361335700 1 --2- 172.21.15.133:0/2902932471 >> v2:172.21.15.16:3300/0 conn(0x7fa35c0b7ab0 0x7fa35c064cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.576+0000 7fa361335700 1 -- 172.21.15.133:0/2902932471 >> 172.21.15.133:0/2902932471 conn(0x7fa35c05c8c0 msgr2=0x7fa35c0b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:03.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.576+0000 7fa361335700 1 -- 172.21.15.133:0/2902932471 shutdown_connections 2021-01-03T13:07:03.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.576+0000 7fa361335700 1 -- 172.21.15.133:0/2902932471 wait complete. 2021-01-03T13:07:03.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.576+0000 7fa361335700 1 Processor -- start 2021-01-03T13:07:03.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.576+0000 7fa361335700 1 -- start start 2021-01-03T13:07:03.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa361335700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa35c0b3800 0x7fa35c1475a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:03.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa361335700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa35c0b7ab0 0x7fa35c0b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:03.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa361335700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa35c13e040 0x7fa35c0b62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:03.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa361335700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c143c40 con 0x7fa35c13e040 2021-01-03T13:07:03.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa361335700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c142c90 con 0x7fa35c0b3800 2021-01-03T13:07:03.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa361335700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35c142f30 con 0x7fa35c0b7ab0 2021-01-03T13:07:03.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa35bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa35c0b3800 0x7fa35c1475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:03.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa35bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa35c0b3800 0x7fa35c1475a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39340/0 (socket says 172.21.15.133:39340) 2021-01-03T13:07:03.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa35bfff700 1 -- 172.21.15.133:0/3326813613 learned_addr learned my addr 172.21.15.133:0/3326813613 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:03.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa360b34700 1 --2- 172.21.15.133:0/3326813613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa35c13e040 0x7fa35c0b62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa35b7fe700 1 --2- 172.21.15.133:0/3326813613 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa35c0b7ab0 0x7fa35c0b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa35bfff700 1 -- 172.21.15.133:0/3326813613 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa35c0b7ab0 msgr2=0x7fa35c0b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa35bfff700 1 --2- 172.21.15.133:0/3326813613 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa35c0b7ab0 0x7fa35c0b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa35bfff700 1 -- 172.21.15.133:0/3326813613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa35c13e040 msgr2=0x7fa35c0b62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa35bfff700 1 --2- 172.21.15.133:0/3326813613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa35c13e040 0x7fa35c0b62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa35bfff700 1 -- 172.21.15.133:0/3326813613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c09cba0 con 0x7fa35c0b3800 2021-01-03T13:07:03.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa35b7fe700 1 --2- 172.21.15.133:0/3326813613 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa35c0b7ab0 0x7fa35c0b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:03.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa360b34700 1 --2- 172.21.15.133:0/3326813613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa35c13e040 0x7fa35c0b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:03.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa35bfff700 1 --2- 172.21.15.133:0/3326813613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa35c0b3800 0x7fa35c1475a0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fa350003070 tx=0x7fa350008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:03.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa3597fa700 1 -- 172.21.15.133:0/3326813613 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa350009980 con 0x7fa35c0b3800 2021-01-03T13:07:03.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa3597fa700 1 -- 172.21.15.133:0/3326813613 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa350009ae0 con 0x7fa35c0b3800 2021-01-03T13:07:03.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa361335700 1 -- 172.21.15.133:0/3326813613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35c148040 con 0x7fa35c0b3800 2021-01-03T13:07:03.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa3597fa700 1 -- 172.21.15.133:0/3326813613 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa350009e40 con 0x7fa35c0b3800 2021-01-03T13:07:03.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa361335700 1 -- 172.21.15.133:0/3326813613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa35c0b59c0 con 0x7fa35c0b3800 2021-01-03T13:07:03.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.580+0000 7fa361335700 1 -- 172.21.15.133:0/3326813613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa35c143e40 con 0x7fa35c0b3800 2021-01-03T13:07:03.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.584+0000 7fa3597fa700 1 -- 172.21.15.133:0/3326813613 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa350013480 con 0x7fa35c0b3800 2021-01-03T13:07:03.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.584+0000 7fa3597fa700 1 --2- 172.21.15.133:0/3326813613 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa33c055330 0x7fa33c0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:03.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.584+0000 7fa3597fa700 1 -- 172.21.15.133:0/3326813613 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa35006e490 con 0x7fa35c0b3800 2021-01-03T13:07:03.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.584+0000 7fa35b7fe700 1 --2- 172.21.15.133:0/3326813613 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa33c055330 0x7fa33c0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:03.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.584+0000 7fa35b7fe700 1 --2- 172.21.15.133:0/3326813613 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa33c055330 0x7fa33c0577f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fa34c008000 tx=0x7fa34c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:03.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.588+0000 7fa3597fa700 1 -- 172.21.15.133:0/3326813613 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa350044730 con 0x7fa35c0b3800 2021-01-03T13:07:03.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.724+0000 7fa361335700 1 -- 172.21.15.133:0/3326813613 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa35c057300 con 0x7fa35c0b3800 2021-01-03T13:07:03.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.724+0000 7fa3597fa700 1 -- 172.21.15.133:0/3326813613 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+16113 (secure 0 0 0) 0x7fa350047d50 con 0x7fa35c0b3800 2021-01-03T13:07:03.731 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:03.731 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":142,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:03.437448+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:07:01.122595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-01-03T13:07:02.419257+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:07:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.728+0000 7fa361335700 1 -- 172.21.15.133:0/3326813613 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa33c055330 msgr2=0x7fa33c0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.728+0000 7fa361335700 1 --2- 172.21.15.133:0/3326813613 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa33c055330 0x7fa33c0577f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fa34c008000 tx=0x7fa34c009040).stop 2021-01-03T13:07:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.728+0000 7fa361335700 1 -- 172.21.15.133:0/3326813613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa35c0b3800 msgr2=0x7fa35c1475a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.728+0000 7fa361335700 1 --2- 172.21.15.133:0/3326813613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa35c0b3800 0x7fa35c1475a0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fa350003070 tx=0x7fa350008040).stop 2021-01-03T13:07:03.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.728+0000 7fa361335700 1 -- 172.21.15.133:0/3326813613 shutdown_connections 2021-01-03T13:07:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.728+0000 7fa361335700 1 --2- 172.21.15.133:0/3326813613 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa33c055330 0x7fa33c0577f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.728+0000 7fa361335700 1 --2- 172.21.15.133:0/3326813613 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa35c13e040 0x7fa35c0b62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.728+0000 7fa361335700 1 --2- 172.21.15.133:0/3326813613 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa35c0b3800 0x7fa35c1475a0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.728+0000 7fa361335700 1 --2- 172.21.15.133:0/3326813613 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa35c0b7ab0 0x7fa35c0b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.728+0000 7fa361335700 1 -- 172.21.15.133:0/3326813613 >> 172.21.15.133:0/3326813613 conn(0x7fa35c05c8c0 msgr2=0x7fa35c0b71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.728+0000 7fa361335700 1 -- 172.21.15.133:0/3326813613 shutdown_connections 2021-01-03T13:07:03.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.728+0000 7fa361335700 1 -- 172.21.15.133:0/3326813613 wait complete. 2021-01-03T13:07:03.744 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:07:03.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.852+0000 7fc673fff700 1 Processor -- start 2021-01-03T13:07:03.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.852+0000 7fc673fff700 1 -- start start 2021-01-03T13:07:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.852+0000 7fc673fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc67405c130 0x7fc6740b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.852+0000 7fc673fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc6741479e0 0x7fc6741445e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.852+0000 7fc673fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67405c510 con 0x7fc674061890 2021-01-03T13:07:03.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.852+0000 7fc673fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc67414a930 con 0x7fc6741479e0 2021-01-03T13:07:03.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.852+0000 7fc673fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67414abd0 con 0x7fc67405c130 2021-01-03T13:07:03.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.852+0000 7fc6737fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc6741479e0 0x7fc6741445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:03.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.852+0000 7fc6737fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc6741479e0 0x7fc6741445e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39352/0 (socket says 172.21.15.133:39352) 2021-01-03T13:07:03.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.852+0000 7fc6737fe700 1 -- 172.21.15.133:0/2587242052 learned_addr learned my addr 172.21.15.133:0/2587242052 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:03.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.852+0000 7fc672ffd700 1 --2- 172.21.15.133:0/2587242052 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc67405c130 0x7fc6740b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:03.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc6737fe700 1 -- 172.21.15.133:0/2587242052 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc67405c130 msgr2=0x7fc6740b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:03.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc6737fe700 1 --2- 172.21.15.133:0/2587242052 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc67405c130 0x7fc6740b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc6737fe700 1 -- 172.21.15.133:0/2587242052 >> v1:172.21.15.16:6789/0 conn(0x7fc674061890 legacy=0x7fc6741472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc6737fe700 1 -- 172.21.15.133:0/2587242052 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67414ae70 con 0x7fc6741479e0 2021-01-03T13:07:03.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc6737fe700 1 --2- 172.21.15.133:0/2587242052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6741479e0 0x7fc6741445e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7fc66c002f30 tx=0x7fc66c006e80).ready entity=mon.1 client_cookie=e5df8911d5c5517c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc671ffb700 1 -- 172.21.15.133:0/2587242052 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc66c0097f0 con 0x7fc6741479e0 2021-01-03T13:07:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc671ffb700 1 -- 172.21.15.133:0/2587242052 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66c009950 con 0x7fc6741479e0 2021-01-03T13:07:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc671ffb700 1 -- 172.21.15.133:0/2587242052 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc66c009cb0 con 0x7fc6741479e0 2021-01-03T13:07:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc673fff700 1 -- 172.21.15.133:0/2587242052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6741479e0 msgr2=0x7fc6741445e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc673fff700 1 --2- 172.21.15.133:0/2587242052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6741479e0 0x7fc6741445e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7fc66c002f30 tx=0x7fc66c006e80).stop 2021-01-03T13:07:03.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc673fff700 1 -- 172.21.15.133:0/2587242052 shutdown_connections 2021-01-03T13:07:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc673fff700 1 --2- 172.21.15.133:0/2587242052 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc67405c130 0x7fc6740b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc673fff700 1 --2- 172.21.15.133:0/2587242052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6741479e0 0x7fc6741445e0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc673fff700 1 -- 172.21.15.133:0/2587242052 >> 172.21.15.133:0/2587242052 conn(0x7fc6740b6110 msgr2=0x7fc6740b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:03.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc673fff700 1 -- 172.21.15.133:0/2587242052 shutdown_connections 2021-01-03T13:07:03.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc673fff700 1 -- 172.21.15.133:0/2587242052 wait complete. 2021-01-03T13:07:03.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc673fff700 1 Processor -- start 2021-01-03T13:07:03.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc673fff700 1 -- start start 2021-01-03T13:07:03.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc673fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc67405c130 0x7fc674140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:03.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc673fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc674061890 0x7fc67413ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:03.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc673fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6741479e0 0x7fc67413f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:03.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc673fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc674147330 con 0x7fc674061890 2021-01-03T13:07:03.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc673fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc674145560 con 0x7fc67405c130 2021-01-03T13:07:03.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc673fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc674145800 con 0x7fc6741479e0 2021-01-03T13:07:03.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc672ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc67405c130 0x7fc674140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:03.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc672ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc67405c130 0x7fc674140c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39354/0 (socket says 172.21.15.133:39354) 2021-01-03T13:07:03.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc672ffd700 1 -- 172.21.15.133:0/3837098587 learned_addr learned my addr 172.21.15.133:0/3837098587 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:03.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc6727fc700 1 --2- 172.21.15.133:0/3837098587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc674061890 0x7fc67413ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:03.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.856+0000 7fc6737fe700 1 --2- 172.21.15.133:0/3837098587 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6741479e0 0x7fc67413f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:03.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.860+0000 7fc672ffd700 1 -- 172.21.15.133:0/3837098587 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6741479e0 msgr2=0x7fc67413f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.860+0000 7fc672ffd700 1 --2- 172.21.15.133:0/3837098587 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6741479e0 0x7fc67413f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.860+0000 7fc672ffd700 1 -- 172.21.15.133:0/3837098587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc674061890 msgr2=0x7fc67413ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:03.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.860+0000 7fc672ffd700 1 --2- 172.21.15.133:0/3837098587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc674061890 0x7fc67413ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:03.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.860+0000 7fc672ffd700 1 -- 172.21.15.133:0/3837098587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc674146630 con 0x7fc67405c130 2021-01-03T13:07:03.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.860+0000 7fc672ffd700 1 --2- 172.21.15.133:0/3837098587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc67405c130 0x7fc674140c80 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7fc65c00c000 tx=0x7fc65c006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:03.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.860+0000 7fc66bfff700 1 -- 172.21.15.133:0/3837098587 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc65c00ca10 con 0x7fc67405c130 2021-01-03T13:07:03.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.860+0000 7fc66bfff700 1 -- 172.21.15.133:0/3837098587 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65c00cb70 con 0x7fc67405c130 2021-01-03T13:07:03.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.860+0000 7fc66bfff700 1 -- 172.21.15.133:0/3837098587 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc65c0123f0 con 0x7fc67405c130 2021-01-03T13:07:03.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.860+0000 7fc673fff700 1 -- 172.21.15.133:0/3837098587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6741468d0 con 0x7fc67405c130 2021-01-03T13:07:03.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.860+0000 7fc673fff700 1 -- 172.21.15.133:0/3837098587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc674141310 con 0x7fc67405c130 2021-01-03T13:07:03.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.860+0000 7fc673fff700 1 -- 172.21.15.133:0/3837098587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc674146a90 con 0x7fc67405c130 2021-01-03T13:07:03.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.860+0000 7fc66bfff700 1 -- 172.21.15.133:0/3837098587 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc65c012550 con 0x7fc67405c130 2021-01-03T13:07:03.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.860+0000 7fc66bfff700 1 --2- 172.21.15.133:0/3837098587 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc64c055440 0x7fc64c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:03.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.860+0000 7fc6727fc700 1 --2- 172.21.15.133:0/3837098587 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc64c055440 0x7fc64c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:03.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.860+0000 7fc66bfff700 1 -- 172.21.15.133:0/3837098587 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc65c06e350 con 0x7fc67405c130 2021-01-03T13:07:03.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.864+0000 7fc6727fc700 1 --2- 172.21.15.133:0/3837098587 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc64c055440 0x7fc64c057900 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fc66400d000 tx=0x7fc664000f00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:03.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:03.868+0000 7fc66bfff700 1 -- 172.21.15.133:0/3837098587 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc65c0444e0 con 0x7fc67405c130 2021-01-03T13:07:04.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.012+0000 7fc673fff700 1 -- 172.21.15.133:0/3837098587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc674146c90 con 0x7fc67405c130 2021-01-03T13:07:04.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.012+0000 7fc66bfff700 1 -- 172.21.15.133:0/3837098587 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+16113 (secure 0 0 0) 0x7fc65c047b00 con 0x7fc67405c130 2021-01-03T13:07:04.019 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:04.019 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":142,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:03.437448+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:07:01.122595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-01-03T13:07:02.419257+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:07:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.016+0000 7fc673fff700 1 -- 172.21.15.133:0/3837098587 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc64c055440 msgr2=0x7fc64c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.016+0000 7fc673fff700 1 --2- 172.21.15.133:0/3837098587 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc64c055440 0x7fc64c057900 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fc66400d000 tx=0x7fc664000f00).stop 2021-01-03T13:07:04.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.016+0000 7fc673fff700 1 -- 172.21.15.133:0/3837098587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc67405c130 msgr2=0x7fc674140c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.016+0000 7fc673fff700 1 --2- 172.21.15.133:0/3837098587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc67405c130 0x7fc674140c80 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7fc65c00c000 tx=0x7fc65c006dc0).stop 2021-01-03T13:07:04.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.016+0000 7fc673fff700 1 -- 172.21.15.133:0/3837098587 shutdown_connections 2021-01-03T13:07:04.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.016+0000 7fc673fff700 1 --2- 172.21.15.133:0/3837098587 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc64c055440 0x7fc64c057900 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.016+0000 7fc673fff700 1 --2- 172.21.15.133:0/3837098587 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc6741479e0 0x7fc67413f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.016+0000 7fc673fff700 1 --2- 172.21.15.133:0/3837098587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc67405c130 0x7fc674140c80 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.016+0000 7fc673fff700 1 --2- 172.21.15.133:0/3837098587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc674061890 0x7fc67413ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.016+0000 7fc673fff700 1 -- 172.21.15.133:0/3837098587 >> 172.21.15.133:0/3837098587 conn(0x7fc6740b6110 msgr2=0x7fc6740b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:04.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.016+0000 7fc673fff700 1 -- 172.21.15.133:0/3837098587 shutdown_connections 2021-01-03T13:07:04.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.016+0000 7fc673fff700 1 -- 172.21.15.133:0/3837098587 wait complete. 2021-01-03T13:07:04.040 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-01-03T13:07:04.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.152+0000 7f744d321700 1 Processor -- start 2021-01-03T13:07:04.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.152+0000 7f744d321700 1 -- start start 2021-01-03T13:07:04.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.152+0000 7f744d321700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f74480b2440 0x7f744813ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.152+0000 7f744d321700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f74480af780 0x7f74481404d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f744d321700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74480b2820 con 0x7f74480a9750 2021-01-03T13:07:04.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f744d321700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74480aecd0 con 0x7f74480b2440 2021-01-03T13:07:04.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f744d321700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74481409c0 con 0x7f74480af780 2021-01-03T13:07:04.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f74477fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f74480af780 0x7f74481404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f7447fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f74480b2440 0x7f744813ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f744cb20700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f74480a9750 0x7f74480672b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60396/0 (socket says 172.21.15.133:60396) 2021-01-03T13:07:04.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f744cb20700 1 -- 172.21.15.133:0/4262316267 learned_addr learned my addr 172.21.15.133:0/4262316267 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:04.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f74477fe700 1 -- 172.21.15.133:0/4262316267 >> v2:172.21.15.16:3300/0 conn(0x7f74480b2440 msgr2=0x7f744813ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:04.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f74477fe700 1 --2- 172.21.15.133:0/4262316267 >> v2:172.21.15.16:3300/0 conn(0x7f74480b2440 0x7f744813ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f74477fe700 1 -- 172.21.15.133:0/4262316267 >> v1:172.21.15.133:6789/0 conn(0x7f74480a9750 legacy=0x7f74480672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f7446ffd700 1 -- 172.21.15.133:0/4262316267 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154725249 0 0) 0x7f74480b2820 con 0x7f74480a9750 2021-01-03T13:07:04.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f74477fe700 1 -- 172.21.15.133:0/4262316267 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74480b1af0 con 0x7f74480af780 2021-01-03T13:07:04.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f74477fe700 1 --2- 172.21.15.133:0/4262316267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74480af780 0x7f74481404d0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f7430002f30 tx=0x7f7430006dc0).ready entity=mon.1 client_cookie=7c77987f2d9d1b46 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:04.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f7446ffd700 1 -- 172.21.15.133:0/4262316267 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74300097b0 con 0x7f74480af780 2021-01-03T13:07:04.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f7446ffd700 1 -- 172.21.15.133:0/4262316267 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7430009910 con 0x7f74480af780 2021-01-03T13:07:04.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f7446ffd700 1 -- 172.21.15.133:0/4262316267 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7430009c70 con 0x7f74480af780 2021-01-03T13:07:04.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f744d321700 1 -- 172.21.15.133:0/4262316267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74480af780 msgr2=0x7f74481404d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f744d321700 1 --2- 172.21.15.133:0/4262316267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74480af780 0x7f74481404d0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f7430002f30 tx=0x7f7430006dc0).stop 2021-01-03T13:07:04.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f744d321700 1 -- 172.21.15.133:0/4262316267 shutdown_connections 2021-01-03T13:07:04.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f744d321700 1 --2- 172.21.15.133:0/4262316267 >> v2:172.21.15.16:3300/0 conn(0x7f74480b2440 0x7f744813ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f744d321700 1 --2- 172.21.15.133:0/4262316267 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74480af780 0x7f74481404d0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f744d321700 1 -- 172.21.15.133:0/4262316267 >> 172.21.15.133:0/4262316267 conn(0x7f744806b050 msgr2=0x7f7448060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:04.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f744d321700 1 -- 172.21.15.133:0/4262316267 shutdown_connections 2021-01-03T13:07:04.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.156+0000 7f744d321700 1 -- 172.21.15.133:0/4262316267 wait complete. 2021-01-03T13:07:04.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f744d321700 1 Processor -- start 2021-01-03T13:07:04.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f744d321700 1 -- start start 2021-01-03T13:07:04.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f744d321700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74480a9750 0x7f7448152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f744d321700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74480af780 0x7f74480acee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f744d321700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f74480b2440 0x7f7448140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f744d321700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7448152350 con 0x7f74480af780 2021-01-03T13:07:04.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f744d321700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74481525f0 con 0x7f74480a9750 2021-01-03T13:07:04.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f744d321700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7448152890 con 0x7f74480b2440 2021-01-03T13:07:04.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f7447fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74480a9750 0x7f7448152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f7447fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74480a9750 0x7f7448152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39368/0 (socket says 172.21.15.133:39368) 2021-01-03T13:07:04.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f7447fff700 1 -- 172.21.15.133:0/2476763776 learned_addr learned my addr 172.21.15.133:0/2476763776 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:04.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f74477fe700 1 --2- 172.21.15.133:0/2476763776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74480af780 0x7f74480acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f744cb20700 1 --2- 172.21.15.133:0/2476763776 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f74480b2440 0x7f7448140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f7447fff700 1 -- 172.21.15.133:0/2476763776 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f74480b2440 msgr2=0x7f7448140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f7447fff700 1 --2- 172.21.15.133:0/2476763776 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f74480b2440 0x7f7448140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f7447fff700 1 -- 172.21.15.133:0/2476763776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74480af780 msgr2=0x7f74480acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f7447fff700 1 --2- 172.21.15.133:0/2476763776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74480af780 0x7f74480acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f7447fff700 1 -- 172.21.15.133:0/2476763776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74480b3e80 con 0x7f74480a9750 2021-01-03T13:07:04.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f7447fff700 1 --2- 172.21.15.133:0/2476763776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74480a9750 0x7f7448152d30 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f743800c000 tx=0x7f74380091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:04.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f74457fa700 1 -- 172.21.15.133:0/2476763776 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f743800cb50 con 0x7f74480a9750 2021-01-03T13:07:04.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f74457fa700 1 -- 172.21.15.133:0/2476763776 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743800ccb0 con 0x7f74480a9750 2021-01-03T13:07:04.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f744d321700 1 -- 172.21.15.133:0/2476763776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74480ad3d0 con 0x7f74480a9750 2021-01-03T13:07:04.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f74457fa700 1 -- 172.21.15.133:0/2476763776 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74380125e0 con 0x7f74480a9750 2021-01-03T13:07:04.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f744d321700 1 -- 172.21.15.133:0/2476763776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74481414c0 con 0x7f74480a9750 2021-01-03T13:07:04.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.160+0000 7f744d321700 1 -- 172.21.15.133:0/2476763776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7448152a50 con 0x7f74480a9750 2021-01-03T13:07:04.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.164+0000 7f74457fa700 1 -- 172.21.15.133:0/2476763776 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7438022070 con 0x7f74480a9750 2021-01-03T13:07:04.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.164+0000 7f74457fa700 1 --2- 172.21.15.133:0/2476763776 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f742c0553b0 0x7f742c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.164+0000 7f74457fa700 1 -- 172.21.15.133:0/2476763776 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f743806e720 con 0x7f74480a9750 2021-01-03T13:07:04.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.164+0000 7f74477fe700 1 --2- 172.21.15.133:0/2476763776 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f742c0553b0 0x7f742c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.164+0000 7f74477fe700 1 --2- 172.21.15.133:0/2476763776 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f742c0553b0 0x7f742c057870 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f7430018000 tx=0x7f7430015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:04.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.168+0000 7f74457fa700 1 -- 172.21.15.133:0/2476763776 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7438044910 con 0x7f74480a9750 2021-01-03T13:07:04.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.348+0000 7f744d321700 1 -- 172.21.15.133:0/2476763776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7448057300 con 0x7f74480a9750 2021-01-03T13:07:04.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.444+0000 7f74457fa700 1 -- 172.21.15.133:0/2476763776 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7438047f30 con 0x7f74480a9750 2021-01-03T13:07:04.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.448+0000 7f744d321700 1 -- 172.21.15.133:0/2476763776 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f742c0553b0 msgr2=0x7f742c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.448+0000 7f744d321700 1 --2- 172.21.15.133:0/2476763776 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f742c0553b0 0x7f742c057870 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f7430018000 tx=0x7f7430015000).stop 2021-01-03T13:07:04.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.448+0000 7f744d321700 1 -- 172.21.15.133:0/2476763776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74480a9750 msgr2=0x7f7448152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.448+0000 7f744d321700 1 --2- 172.21.15.133:0/2476763776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74480a9750 0x7f7448152d30 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f743800c000 tx=0x7f74380091a0).stop 2021-01-03T13:07:04.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.452+0000 7f744d321700 1 -- 172.21.15.133:0/2476763776 shutdown_connections 2021-01-03T13:07:04.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.452+0000 7f744d321700 1 --2- 172.21.15.133:0/2476763776 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f742c0553b0 0x7f742c057870 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.452+0000 7f744d321700 1 --2- 172.21.15.133:0/2476763776 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f74480b2440 0x7f7448140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.452+0000 7f744d321700 1 --2- 172.21.15.133:0/2476763776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74480a9750 0x7f7448152d30 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.452+0000 7f744d321700 1 --2- 172.21.15.133:0/2476763776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f74480af780 0x7f74480acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.452+0000 7f744d321700 1 -- 172.21.15.133:0/2476763776 >> 172.21.15.133:0/2476763776 conn(0x7f744806b050 msgr2=0x7f744813f230 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:04.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.452+0000 7f744d321700 1 -- 172.21.15.133:0/2476763776 shutdown_connections 2021-01-03T13:07:04.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.452+0000 7f744d321700 1 -- 172.21.15.133:0/2476763776 wait complete. 2021-01-03T13:07:04.471 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:07:04.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca6b97700 1 Processor -- start 2021-01-03T13:07:04.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca6b97700 1 -- start start 2021-01-03T13:07:04.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca6b97700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdca00b5c10 0x7fdca00aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca6b97700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdca00b0670 0x7fdca014a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca6b97700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca0098550 con 0x7fdca014acc0 2021-01-03T13:07:04.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca6b97700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca00b5ff0 con 0x7fdca00b5c10 2021-01-03T13:07:04.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca6b97700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00b0b10 con 0x7fdca00b0670 2021-01-03T13:07:04.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca5134700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdca014acc0 0x7fdca0144470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60412/0 (socket says 172.21.15.133:60412) 2021-01-03T13:07:04.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca4933700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdca00b5c10 0x7fdca00aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca5134700 1 -- 172.21.15.133:0/2466457427 learned_addr learned my addr 172.21.15.133:0/2466457427 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:04.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdc9ffff700 1 --2- 172.21.15.133:0/2466457427 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdca00b0670 0x7fdca014a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca4933700 1 -- 172.21.15.133:0/2466457427 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdca00b0670 msgr2=0x7fdca014a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:04.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca4933700 1 --2- 172.21.15.133:0/2466457427 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdca00b0670 0x7fdca014a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca4933700 1 -- 172.21.15.133:0/2466457427 >> v1:172.21.15.133:6789/0 conn(0x7fdca014acc0 legacy=0x7fdca0144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdc9f7fe700 1 -- 172.21.15.133:0/2466457427 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993259599 0 0) 0x7fdca0098550 con 0x7fdca014acc0 2021-01-03T13:07:04.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca4933700 1 -- 172.21.15.133:0/2466457427 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0098780 con 0x7fdca00b5c10 2021-01-03T13:07:04.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca4933700 1 --2- 172.21.15.133:0/2466457427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca00b5c10 0x7fdca00aae70 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fdc90002f30 tx=0x7fdc90006dc0).ready entity=mon.1 client_cookie=f66cc1bbe2970340 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:04.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdc9f7fe700 1 -- 172.21.15.133:0/2466457427 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc90009760 con 0x7fdca00b5c10 2021-01-03T13:07:04.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdc9f7fe700 1 -- 172.21.15.133:0/2466457427 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc900098c0 con 0x7fdca00b5c10 2021-01-03T13:07:04.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdc9f7fe700 1 -- 172.21.15.133:0/2466457427 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc90009c20 con 0x7fdca00b5c10 2021-01-03T13:07:04.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca6b97700 1 -- 172.21.15.133:0/2466457427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca00b5c10 msgr2=0x7fdca00aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca6b97700 1 --2- 172.21.15.133:0/2466457427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca00b5c10 0x7fdca00aae70 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fdc90002f30 tx=0x7fdc90006dc0).stop 2021-01-03T13:07:04.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca6b97700 1 -- 172.21.15.133:0/2466457427 shutdown_connections 2021-01-03T13:07:04.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca6b97700 1 --2- 172.21.15.133:0/2466457427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca00b5c10 0x7fdca00aae70 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca6b97700 1 --2- 172.21.15.133:0/2466457427 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdca00b0670 0x7fdca014a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca6b97700 1 -- 172.21.15.133:0/2466457427 >> 172.21.15.133:0/2466457427 conn(0x7fdca005c8c0 msgr2=0x7fdca00b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:04.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca6b97700 1 -- 172.21.15.133:0/2466457427 shutdown_connections 2021-01-03T13:07:04.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.580+0000 7fdca6b97700 1 -- 172.21.15.133:0/2466457427 wait complete. 2021-01-03T13:07:04.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca6b97700 1 Processor -- start 2021-01-03T13:07:04.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca6b97700 1 -- start start 2021-01-03T13:07:04.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca6b97700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdca00b0670 0x7fdca0062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca6b97700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca00b5c10 0x7fdca0159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca6b97700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca014acc0 0x7fdca01560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca6b97700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca0063870 con 0x7fdca00b5c10 2021-01-03T13:07:04.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca6b97700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca0159790 con 0x7fdca014acc0 2021-01-03T13:07:04.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca6b97700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca0159a30 con 0x7fdca00b0670 2021-01-03T13:07:04.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca5134700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca014acc0 0x7fdca01560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca5134700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca014acc0 0x7fdca01560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39386/0 (socket says 172.21.15.133:39386) 2021-01-03T13:07:04.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca5134700 1 -- 172.21.15.133:0/638784060 learned_addr learned my addr 172.21.15.133:0/638784060 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:04.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca4933700 1 --2- 172.21.15.133:0/638784060 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdca00b0670 0x7fdca0062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdc9ffff700 1 --2- 172.21.15.133:0/638784060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca00b5c10 0x7fdca0159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca5134700 1 -- 172.21.15.133:0/638784060 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdca00b0670 msgr2=0x7fdca0062e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca5134700 1 --2- 172.21.15.133:0/638784060 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdca00b0670 0x7fdca0062e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca5134700 1 -- 172.21.15.133:0/638784060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca00b5c10 msgr2=0x7fdca0159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca5134700 1 --2- 172.21.15.133:0/638784060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca00b5c10 0x7fdca0159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.606 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca5134700 1 -- 172.21.15.133:0/638784060 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca015a3c0 con 0x7fdca014acc0 2021-01-03T13:07:04.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdc9ffff700 1 --2- 172.21.15.133:0/638784060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca00b5c10 0x7fdca0159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:04.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca5134700 1 --2- 172.21.15.133:0/638784060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca014acc0 0x7fdca01560a0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fdc98000f00 tx=0x7fdc98007f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:04.607 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdc9dffb700 1 -- 172.21.15.133:0/638784060 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc98005b70 con 0x7fdca014acc0 2021-01-03T13:07:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdc9dffb700 1 -- 172.21.15.133:0/638784060 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc98005cd0 con 0x7fdca014acc0 2021-01-03T13:07:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdc9dffb700 1 -- 172.21.15.133:0/638784060 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc98007300 con 0x7fdca014acc0 2021-01-03T13:07:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca6b97700 1 -- 172.21.15.133:0/638784060 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca00671b0 con 0x7fdca014acc0 2021-01-03T13:07:04.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.584+0000 7fdca6b97700 1 -- 172.21.15.133:0/638784060 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca0067530 con 0x7fdca014acc0 2021-01-03T13:07:04.609 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.588+0000 7fdca6b97700 1 -- 172.21.15.133:0/638784060 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca0057300 con 0x7fdca014acc0 2021-01-03T13:07:04.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.588+0000 7fdc9dffb700 1 -- 172.21.15.133:0/638784060 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fdc98010030 con 0x7fdca014acc0 2021-01-03T13:07:04.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.588+0000 7fdc9dffb700 1 --2- 172.21.15.133:0/638784060 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdc84055330 0x7fdc840577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.610 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.588+0000 7fdc9dffb700 1 -- 172.21.15.133:0/638784060 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdc9806de00 con 0x7fdca014acc0 2021-01-03T13:07:04.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.588+0000 7fdca4933700 1 --2- 172.21.15.133:0/638784060 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdc84055330 0x7fdc840577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.611 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.588+0000 7fdca4933700 1 --2- 172.21.15.133:0/638784060 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdc84055330 0x7fdc840577f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fdc9001a000 tx=0x7fdc90015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:04.612 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.592+0000 7fdc9dffb700 1 -- 172.21.15.133:0/638784060 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdc98044100 con 0x7fdca014acc0 2021-01-03T13:07:04.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.776+0000 7fdca6b97700 1 -- 172.21.15.133:0/638784060 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdca009b420 con 0x7fdca014acc0 2021-01-03T13:07:04.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.776+0000 7fdc9dffb700 1 -- 172.21.15.133:0/638784060 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2498 (secure 0 0 0) 0x7fdc98047720 con 0x7fdca014acc0 2021-01-03T13:07:04.783 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:04.783 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":67,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6719,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/2510927889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2510927889},{"type":"v1","addr":"172.21.15.16:6833","nonce":2510927889}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":65},{"gid":6722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1243273461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1243273461},{"type":"v1","addr":"172.21.15.133:6837","nonce":1243273461}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:03.438043+0000","modified":"2021-01-03T13:07:04.442588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7792},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7792":{"gid":7792,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/679359254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":679359254},{"type":"v1","addr":"172.21.15.133:6835","nonce":679359254}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-01-03T13:07:04.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.780+0000 7fdca6b97700 1 -- 172.21.15.133:0/638784060 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdc84055330 msgr2=0x7fdc840577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.780+0000 7fdca6b97700 1 --2- 172.21.15.133:0/638784060 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdc84055330 0x7fdc840577f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fdc9001a000 tx=0x7fdc90015000).stop 2021-01-03T13:07:04.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.780+0000 7fdca6b97700 1 -- 172.21.15.133:0/638784060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca014acc0 msgr2=0x7fdca01560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.780+0000 7fdca6b97700 1 --2- 172.21.15.133:0/638784060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca014acc0 0x7fdca01560a0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fdc98000f00 tx=0x7fdc98007f70).stop 2021-01-03T13:07:04.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.780+0000 7fdca6b97700 1 -- 172.21.15.133:0/638784060 shutdown_connections 2021-01-03T13:07:04.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.780+0000 7fdca6b97700 1 --2- 172.21.15.133:0/638784060 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdc84055330 0x7fdc840577f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.780+0000 7fdca6b97700 1 --2- 172.21.15.133:0/638784060 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca014acc0 0x7fdca01560a0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.780+0000 7fdca6b97700 1 --2- 172.21.15.133:0/638784060 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdca00b0670 0x7fdca0062e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.780+0000 7fdca6b97700 1 --2- 172.21.15.133:0/638784060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca00b5c10 0x7fdca0159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.780+0000 7fdca6b97700 1 -- 172.21.15.133:0/638784060 >> 172.21.15.133:0/638784060 conn(0x7fdca005c8c0 msgr2=0x7fdca00b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:04.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.780+0000 7fdca6b97700 1 -- 172.21.15.133:0/638784060 shutdown_connections 2021-01-03T13:07:04.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.780+0000 7fdca6b97700 1 -- 172.21.15.133:0/638784060 wait complete. 2021-01-03T13:07:04.787 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 67 2021-01-03T13:07:04.796 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:07:04.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d6950700 1 Processor -- start 2021-01-03T13:07:04.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d6950700 1 -- start start 2021-01-03T13:07:04.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d6950700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f98d00b9f40 0x7f98d0146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d6950700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f98d0146920 0x7f98d014d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d6950700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d00605f0 con 0x7f98d00b9b60 2021-01-03T13:07:04.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d6950700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d00aed30 con 0x7f98d0146920 2021-01-03T13:07:04.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d6950700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d00600b0 con 0x7f98d00b9f40 2021-01-03T13:07:04.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d514d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f98d00b9f40 0x7f98d0146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d514d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f98d00b9f40 0x7f98d0146430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39390/0 (socket says 172.21.15.133:39390) 2021-01-03T13:07:04.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d514d700 1 -- 172.21.15.133:0/502670218 learned_addr learned my addr 172.21.15.133:0/502670218 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d614f700 1 --2- 172.21.15.133:0/502670218 >> v2:172.21.15.16:3300/0 conn(0x7f98d0146920 0x7f98d014d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d514d700 1 -- 172.21.15.133:0/502670218 >> v2:172.21.15.16:3300/0 conn(0x7f98d0146920 msgr2=0x7f98d014d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d514d700 1 --2- 172.21.15.133:0/502670218 >> v2:172.21.15.16:3300/0 conn(0x7f98d0146920 0x7f98d014d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d514d700 1 -- 172.21.15.133:0/502670218 >> v1:172.21.15.133:6789/0 conn(0x7f98d00b9b60 legacy=0x7f98d00b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d514d700 1 -- 172.21.15.133:0/502670218 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d0060350 con 0x7f98d00b9f40 2021-01-03T13:07:04.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d514d700 1 --2- 172.21.15.133:0/502670218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d00b9f40 0x7f98d0146430 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f98b8002f30 tx=0x7f98b8006e80).ready entity=mon.1 client_cookie=3a21956f7d2dffa8 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:04.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d494c700 1 -- 172.21.15.133:0/502670218 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98b80097f0 con 0x7f98d00b9f40 2021-01-03T13:07:04.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d494c700 1 -- 172.21.15.133:0/502670218 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b8009950 con 0x7f98d00b9f40 2021-01-03T13:07:04.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d494c700 1 -- 172.21.15.133:0/502670218 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98b8009ac0 con 0x7f98d00b9f40 2021-01-03T13:07:04.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d6950700 1 -- 172.21.15.133:0/502670218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d00b9f40 msgr2=0x7f98d0146430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.900+0000 7f98d6950700 1 --2- 172.21.15.133:0/502670218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d00b9f40 0x7f98d0146430 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f98b8002f30 tx=0x7f98b8006e80).stop 2021-01-03T13:07:04.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d6950700 1 -- 172.21.15.133:0/502670218 shutdown_connections 2021-01-03T13:07:04.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d6950700 1 --2- 172.21.15.133:0/502670218 >> v2:172.21.15.16:3300/0 conn(0x7f98d0146920 0x7f98d014d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d6950700 1 --2- 172.21.15.133:0/502670218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d00b9f40 0x7f98d0146430 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d6950700 1 -- 172.21.15.133:0/502670218 >> 172.21.15.133:0/502670218 conn(0x7f98d00b69e0 msgr2=0x7f98d00b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:04.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d6950700 1 -- 172.21.15.133:0/502670218 shutdown_connections 2021-01-03T13:07:04.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d6950700 1 -- 172.21.15.133:0/502670218 wait complete. 2021-01-03T13:07:04.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d6950700 1 Processor -- start 2021-01-03T13:07:04.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d6950700 1 -- start start 2021-01-03T13:07:04.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d6950700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98d00b9b60 0x7f98d013a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d6950700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d00b9f40 0x7f98d0155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d6950700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98d0146920 0x7f98d0155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d6950700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d009f070 con 0x7f98d0146920 2021-01-03T13:07:04.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d6950700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d0155150 con 0x7f98d00b9f40 2021-01-03T13:07:04.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d6950700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d009c810 con 0x7f98d00b9b60 2021-01-03T13:07:04.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d514d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d00b9f40 0x7f98d0155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d514d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d00b9f40 0x7f98d0155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39396/0 (socket says 172.21.15.133:39396) 2021-01-03T13:07:04.925 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d514d700 1 -- 172.21.15.133:0/3785845362 learned_addr learned my addr 172.21.15.133:0/3785845362 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:04.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d594e700 1 --2- 172.21.15.133:0/3785845362 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98d00b9b60 0x7f98d013a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d614f700 1 --2- 172.21.15.133:0/3785845362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98d0146920 0x7f98d0155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d514d700 1 -- 172.21.15.133:0/3785845362 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98d00b9b60 msgr2=0x7f98d013a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d514d700 1 --2- 172.21.15.133:0/3785845362 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98d00b9b60 0x7f98d013a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d514d700 1 -- 172.21.15.133:0/3785845362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98d0146920 msgr2=0x7f98d0155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:04.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d514d700 1 --2- 172.21.15.133:0/3785845362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98d0146920 0x7f98d0155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:04.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d514d700 1 -- 172.21.15.133:0/3785845362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d009cab0 con 0x7f98d00b9f40 2021-01-03T13:07:04.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d514d700 1 --2- 172.21.15.133:0/3785845362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d00b9f40 0x7f98d0155580 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f98b8002f30 tx=0x7f98b8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:04.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98ceffd700 1 -- 172.21.15.133:0/3785845362 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98b8011d30 con 0x7f98d00b9f40 2021-01-03T13:07:04.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98ceffd700 1 -- 172.21.15.133:0/3785845362 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b8011e90 con 0x7f98d00b9f40 2021-01-03T13:07:04.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d6950700 1 -- 172.21.15.133:0/3785845362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d009cd50 con 0x7f98d00b9f40 2021-01-03T13:07:04.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98ceffd700 1 -- 172.21.15.133:0/3785845362 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98b80205f0 con 0x7f98d00b9f40 2021-01-03T13:07:04.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.904+0000 7f98d6950700 1 -- 172.21.15.133:0/3785845362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d0155f60 con 0x7f98d00b9f40 2021-01-03T13:07:04.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.908+0000 7f98d6950700 1 -- 172.21.15.133:0/3785845362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d009c1b0 con 0x7f98d00b9f40 2021-01-03T13:07:04.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.908+0000 7f98ceffd700 1 -- 172.21.15.133:0/3785845362 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f98b801e070 con 0x7f98d00b9f40 2021-01-03T13:07:04.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.908+0000 7f98ceffd700 1 --2- 172.21.15.133:0/3785845362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98b40553b0 0x7f98b4057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:04.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.908+0000 7f98ceffd700 1 -- 172.21.15.133:0/3785845362 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f98b806eb10 con 0x7f98d00b9f40 2021-01-03T13:07:04.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.908+0000 7f98d594e700 1 --2- 172.21.15.133:0/3785845362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98b40553b0 0x7f98b4057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:04.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.908+0000 7f98d594e700 1 --2- 172.21.15.133:0/3785845362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98b40553b0 0x7f98b4057870 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f98c800d000 tx=0x7f98c8007b60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:04.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:04.916+0000 7f98ceffd700 1 -- 172.21.15.133:0/3785845362 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f98b8044d40 con 0x7f98d00b9f40 2021-01-03T13:07:05.064 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.056+0000 7f98d6950700 1 -- 172.21.15.133:0/3785845362 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98d0057300 con 0x7f98d00b9f40 2021-01-03T13:07:05.065 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.060+0000 7f98ceffd700 1 -- 172.21.15.133:0/3785845362 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f98b8031f00 con 0x7f98d00b9f40 2021-01-03T13:07:05.066 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:05.066 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":143,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:04.443265+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:07:01.122595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-01-03T13:07:02.419257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:07:05.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.060+0000 7f98d6950700 1 -- 172.21.15.133:0/3785845362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98b40553b0 msgr2=0x7f98b4057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:05.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.060+0000 7f98d6950700 1 --2- 172.21.15.133:0/3785845362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98b40553b0 0x7f98b4057870 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f98c800d000 tx=0x7f98c8007b60).stop 2021-01-03T13:07:05.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.060+0000 7f98d6950700 1 -- 172.21.15.133:0/3785845362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d00b9f40 msgr2=0x7f98d0155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:05.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.060+0000 7f98d6950700 1 --2- 172.21.15.133:0/3785845362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d00b9f40 0x7f98d0155580 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f98b8002f30 tx=0x7f98b8016000).stop 2021-01-03T13:07:05.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.060+0000 7f98d6950700 1 -- 172.21.15.133:0/3785845362 shutdown_connections 2021-01-03T13:07:05.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.060+0000 7f98d6950700 1 --2- 172.21.15.133:0/3785845362 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f98b40553b0 0x7f98b4057870 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.060+0000 7f98d6950700 1 --2- 172.21.15.133:0/3785845362 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f98d0146920 0x7f98d0155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.060+0000 7f98d6950700 1 --2- 172.21.15.133:0/3785845362 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f98d00b9b60 0x7f98d013a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.060+0000 7f98d6950700 1 --2- 172.21.15.133:0/3785845362 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98d00b9f40 0x7f98d0155580 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.060+0000 7f98d6950700 1 -- 172.21.15.133:0/3785845362 >> 172.21.15.133:0/3785845362 conn(0x7f98d00b69e0 msgr2=0x7f98d01451c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:05.069 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.060+0000 7f98d6950700 1 -- 172.21.15.133:0/3785845362 shutdown_connections 2021-01-03T13:07:05.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.060+0000 7f98d6950700 1 -- 172.21.15.133:0/3785845362 wait complete. 2021-01-03T13:07:05.080 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:07:05.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3bfff700 1 Processor -- start 2021-01-03T13:07:05.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3bfff700 1 -- start start 2021-01-03T13:07:05.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3bfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feb3c062450 0x7feb3c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb3c0b33b0 0x7feb3c14f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3bfff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3c0adff0 con 0x7feb3c0adc10 2021-01-03T13:07:05.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3bfff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3c0b1930 con 0x7feb3c062450 2021-01-03T13:07:05.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3bfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3c05fb80 con 0x7feb3c0b33b0 2021-01-03T13:07:05.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb41558700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb3c0b33b0 0x7feb3c14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb41558700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb3c0b33b0 0x7feb3c14f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39408/0 (socket says 172.21.15.133:39408) 2021-01-03T13:07:05.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb41558700 1 -- 172.21.15.133:0/3121915127 learned_addr learned my addr 172.21.15.133:0/3121915127 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:05.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3affd700 1 --2- 172.21.15.133:0/3121915127 >> v2:172.21.15.16:3300/0 conn(0x7feb3c062450 0x7feb3c067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3affd700 1 -- 172.21.15.133:0/3121915127 >> v2:172.21.15.133:3300/0 conn(0x7feb3c0b33b0 msgr2=0x7feb3c14f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:05.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3affd700 1 --2- 172.21.15.133:0/3121915127 >> v2:172.21.15.133:3300/0 conn(0x7feb3c0b33b0 0x7feb3c14f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3affd700 1 -- 172.21.15.133:0/3121915127 >> v1:172.21.15.16:6789/0 conn(0x7feb3c0adc10 legacy=0x7feb3c0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:05.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3affd700 1 -- 172.21.15.133:0/3121915127 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c0b3860 con 0x7feb3c062450 2021-01-03T13:07:05.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb41558700 1 --2- 172.21.15.133:0/3121915127 >> v2:172.21.15.133:3300/0 conn(0x7feb3c0b33b0 0x7feb3c14f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:05.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3affd700 1 --2- 172.21.15.133:0/3121915127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb3c062450 0x7feb3c067cb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7feb2c002f30 tx=0x7feb2c006dc0).ready entity=mon.0 client_cookie=9059e5c53a92998e server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:05.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3a7fc700 1 -- 172.21.15.133:0/3121915127 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb2c0097b0 con 0x7feb3c062450 2021-01-03T13:07:05.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3a7fc700 1 -- 172.21.15.133:0/3121915127 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2c009910 con 0x7feb3c062450 2021-01-03T13:07:05.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3a7fc700 1 -- 172.21.15.133:0/3121915127 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb2c009c70 con 0x7feb3c062450 2021-01-03T13:07:05.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3bfff700 1 -- 172.21.15.133:0/3121915127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb3c062450 msgr2=0x7feb3c067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:05.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.196+0000 7feb3bfff700 1 --2- 172.21.15.133:0/3121915127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb3c062450 0x7feb3c067cb0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7feb2c002f30 tx=0x7feb2c006dc0).stop 2021-01-03T13:07:05.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.200+0000 7feb3bfff700 1 -- 172.21.15.133:0/3121915127 shutdown_connections 2021-01-03T13:07:05.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.200+0000 7feb3bfff700 1 --2- 172.21.15.133:0/3121915127 >> v2:172.21.15.133:3300/0 conn(0x7feb3c0b33b0 0x7feb3c14f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.200+0000 7feb3bfff700 1 --2- 172.21.15.133:0/3121915127 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb3c062450 0x7feb3c067cb0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.200+0000 7feb3bfff700 1 -- 172.21.15.133:0/3121915127 >> 172.21.15.133:0/3121915127 conn(0x7feb3c060d10 msgr2=0x7feb3c061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.200+0000 7feb3bfff700 1 -- 172.21.15.133:0/3121915127 shutdown_connections 2021-01-03T13:07:05.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.200+0000 7feb3bfff700 1 -- 172.21.15.133:0/3121915127 wait complete. 2021-01-03T13:07:05.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.200+0000 7feb3bfff700 1 Processor -- start 2021-01-03T13:07:05.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.200+0000 7feb3bfff700 1 -- start start 2021-01-03T13:07:05.214 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.200+0000 7feb3bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb3c062450 0x7feb3c12acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.200+0000 7feb3bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb3c0adc10 0x7feb3c0b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.200+0000 7feb3bfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb3c0b33b0 0x7feb3c1257e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.200+0000 7feb3bfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c141c10 con 0x7feb3c062450 2021-01-03T13:07:05.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.200+0000 7feb3bfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c141eb0 con 0x7feb3c0adc10 2021-01-03T13:07:05.215 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.200+0000 7feb3bfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3c142150 con 0x7feb3c0b33b0 2021-01-03T13:07:05.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb3affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb3c0adc10 0x7feb3c0b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb3b7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb3c062450 0x7feb3c12acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb3affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb3c0adc10 0x7feb3c0b4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39412/0 (socket says 172.21.15.133:39412) 2021-01-03T13:07:05.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb3affd700 1 -- 172.21.15.133:0/719663032 learned_addr learned my addr 172.21.15.133:0/719663032 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:05.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb41558700 1 --2- 172.21.15.133:0/719663032 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb3c0b33b0 0x7feb3c1257e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb3affd700 1 -- 172.21.15.133:0/719663032 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb3c0b33b0 msgr2=0x7feb3c1257e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:05.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb3affd700 1 --2- 172.21.15.133:0/719663032 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb3c0b33b0 0x7feb3c1257e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb3affd700 1 -- 172.21.15.133:0/719663032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb3c062450 msgr2=0x7feb3c12acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:05.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb3affd700 1 --2- 172.21.15.133:0/719663032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb3c062450 0x7feb3c12acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb3affd700 1 -- 172.21.15.133:0/719663032 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c1423f0 con 0x7feb3c0adc10 2021-01-03T13:07:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb41558700 1 --2- 172.21.15.133:0/719663032 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb3c0b33b0 0x7feb3c1257e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb3affd700 1 --2- 172.21.15.133:0/719663032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb3c0adc10 0x7feb3c0b4440 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7feb2c002f30 tx=0x7feb2c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb33fff700 1 -- 172.21.15.133:0/719663032 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb2c011ad0 con 0x7feb3c0adc10 2021-01-03T13:07:05.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb33fff700 1 -- 172.21.15.133:0/719663032 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2c011c30 con 0x7feb3c0adc10 2021-01-03T13:07:05.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb3bfff700 1 -- 172.21.15.133:0/719663032 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb3c0b4930 con 0x7feb3c0adc10 2021-01-03T13:07:05.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb33fff700 1 -- 172.21.15.133:0/719663032 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb2c01d440 con 0x7feb3c0adc10 2021-01-03T13:07:05.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb3bfff700 1 -- 172.21.15.133:0/719663032 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3c073c90 con 0x7feb3c0adc10 2021-01-03T13:07:05.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb3bfff700 1 -- 172.21.15.133:0/719663032 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3c057300 con 0x7feb3c0adc10 2021-01-03T13:07:05.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.204+0000 7feb33fff700 1 -- 172.21.15.133:0/719663032 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7feb2c024030 con 0x7feb3c0adc10 2021-01-03T13:07:05.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.208+0000 7feb33fff700 1 --2- 172.21.15.133:0/719663032 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb20055470 0x7feb20057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.208+0000 7feb33fff700 1 -- 172.21.15.133:0/719663032 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feb2c06e9c0 con 0x7feb3c0adc10 2021-01-03T13:07:05.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.208+0000 7feb3b7fe700 1 --2- 172.21.15.133:0/719663032 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb20055470 0x7feb20057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.208+0000 7feb3b7fe700 1 --2- 172.21.15.133:0/719663032 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb20055470 0x7feb20057930 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7feb3400d000 tx=0x7feb34007ee0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:05.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.212+0000 7feb33fff700 1 -- 172.21.15.133:0/719663032 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7feb2c044cc0 con 0x7feb3c0adc10 2021-01-03T13:07:05.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.400+0000 7feb3bfff700 1 -- 172.21.15.133:0/719663032 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7feb3c068660 con 0x7feb3c0adc10 2021-01-03T13:07:05.414 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.408+0000 7feb33fff700 1 -- 172.21.15.133:0/719663032 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v29) v1 ==== 184+0+0 (secure 0 0 0) 0x7feb2c022070 con 0x7feb3c0adc10 2021-01-03T13:07:05.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.412+0000 7feb3bfff700 1 -- 172.21.15.133:0/719663032 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb20055470 msgr2=0x7feb20057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:05.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.412+0000 7feb3bfff700 1 --2- 172.21.15.133:0/719663032 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb20055470 0x7feb20057930 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7feb3400d000 tx=0x7feb34007ee0).stop 2021-01-03T13:07:05.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.412+0000 7feb3bfff700 1 -- 172.21.15.133:0/719663032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb3c0adc10 msgr2=0x7feb3c0b4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:05.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.412+0000 7feb3bfff700 1 --2- 172.21.15.133:0/719663032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb3c0adc10 0x7feb3c0b4440 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7feb2c002f30 tx=0x7feb2c015000).stop 2021-01-03T13:07:05.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.412+0000 7feb3bfff700 1 -- 172.21.15.133:0/719663032 shutdown_connections 2021-01-03T13:07:05.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.412+0000 7feb3bfff700 1 --2- 172.21.15.133:0/719663032 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb20055470 0x7feb20057930 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.419 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.412+0000 7feb3bfff700 1 --2- 172.21.15.133:0/719663032 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb3c062450 0x7feb3c12acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.412+0000 7feb3bfff700 1 --2- 172.21.15.133:0/719663032 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7feb3c0b33b0 0x7feb3c1257e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.412+0000 7feb3bfff700 1 --2- 172.21.15.133:0/719663032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb3c0adc10 0x7feb3c0b4440 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.412+0000 7feb3bfff700 1 -- 172.21.15.133:0/719663032 >> 172.21.15.133:0/719663032 conn(0x7feb3c060d10 msgr2=0x7feb3c0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:05.420 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.412+0000 7feb3bfff700 1 -- 172.21.15.133:0/719663032 shutdown_connections 2021-01-03T13:07:05.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.412+0000 7feb3bfff700 1 -- 172.21.15.133:0/719663032 wait complete. 2021-01-03T13:07:05.421 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2021-01-03T13:07:05.430 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:07:05.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405b7bb700 1 Processor -- start 2021-01-03T13:07:05.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405b7bb700 1 -- start start 2021-01-03T13:07:05.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405b7bb700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f40540b5120 0x7f40540ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405b7bb700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4054060b00 0x7f40540abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405b7bb700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405409a380 con 0x7f40540af9f0 2021-01-03T13:07:05.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405b7bb700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4054062340 con 0x7f40540b5120 2021-01-03T13:07:05.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405b7bb700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40540ac2c0 con 0x7f4054060b00 2021-01-03T13:07:05.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405a559700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f40540af9f0 0x7f40540afe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60454/0 (socket says 172.21.15.133:60454) 2021-01-03T13:07:05.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405a559700 1 -- 172.21.15.133:0/909324686 learned_addr learned my addr 172.21.15.133:0/909324686 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:05.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4059d58700 1 --2- 172.21.15.133:0/909324686 >> v2:172.21.15.16:3300/0 conn(0x7f40540b5120 0x7f40540ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4059557700 1 --2- 172.21.15.133:0/909324686 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4054060b00 0x7f40540abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 -- 172.21.15.133:0/909324686 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91109318 0 0) 0x7f405409a380 con 0x7f40540af9f0 2021-01-03T13:07:05.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 -- 172.21.15.133:0/909324686 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4040003230 con 0x7f40540af9f0 2021-01-03T13:07:05.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 -- 172.21.15.133:0/909324686 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3583939386 0 0) 0x7f4040003230 con 0x7f40540af9f0 2021-01-03T13:07:05.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 -- 172.21.15.133:0/909324686 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4054060b00 msgr2=0x7f40540abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:05.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 --2- 172.21.15.133:0/909324686 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4054060b00 0x7f40540abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 -- 172.21.15.133:0/909324686 >> v2:172.21.15.16:3300/0 conn(0x7f40540b5120 msgr2=0x7f40540ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:05.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 --2- 172.21.15.133:0/909324686 >> v2:172.21.15.16:3300/0 conn(0x7f40540b5120 0x7f40540ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 -- 172.21.15.133:0/909324686 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4054060090 con 0x7f40540af9f0 2021-01-03T13:07:05.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 -- 172.21.15.133:0/909324686 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f404c0016d0 con 0x7f40540af9f0 2021-01-03T13:07:05.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 -- 172.21.15.133:0/909324686 >> v1:172.21.15.133:6789/0 conn(0x7f40540af9f0 legacy=0x7f40540afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:05.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 --2- 172.21.15.133:0/909324686 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4040003750 0x7f4040003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 --2- 172.21.15.133:0/909324686 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4054060b00 0x7f40400044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 --2- 172.21.15.133:0/909324686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40400049c0 0x7f4040004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 -- 172.21.15.133:0/909324686 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4054062340 con 0x7f4040003750 2021-01-03T13:07:05.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 -- 172.21.15.133:0/909324686 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40540ac2c0 con 0x7f40400049c0 2021-01-03T13:07:05.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 -- 172.21.15.133:0/909324686 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4040004160 con 0x7f4054060b00 2021-01-03T13:07:05.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405a559700 1 --2- 172.21.15.133:0/909324686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40400049c0 0x7f4040004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4059557700 1 --2- 172.21.15.133:0/909324686 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4054060b00 0x7f40400044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4059d58700 1 --2- 172.21.15.133:0/909324686 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4040003750 0x7f4040003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405a559700 1 -- 172.21.15.133:0/909324686 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4054060b00 msgr2=0x7f40400044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:05.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405a559700 1 --2- 172.21.15.133:0/909324686 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4054060b00 0x7f40400044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405a559700 1 -- 172.21.15.133:0/909324686 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4040003750 msgr2=0x7f4040003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:05.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405a559700 1 --2- 172.21.15.133:0/909324686 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4040003750 0x7f4040003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405a559700 1 -- 172.21.15.133:0/909324686 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4040003230 con 0x7f40400049c0 2021-01-03T13:07:05.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405a559700 1 --2- 172.21.15.133:0/909324686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40400049c0 0x7f4040004e40 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f404c001b30 tx=0x7f40540605d0).ready entity=mon.1 client_cookie=a33e8c6cb1f2d180 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:05.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 -- 172.21.15.133:0/909324686 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f404c008a60 con 0x7f40400049c0 2021-01-03T13:07:05.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 -- 172.21.15.133:0/909324686 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c008170 con 0x7f40400049c0 2021-01-03T13:07:05.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f4058d56700 1 -- 172.21.15.133:0/909324686 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f404c0057f0 con 0x7f40400049c0 2021-01-03T13:07:05.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405b7bb700 1 -- 172.21.15.133:0/909324686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40400049c0 msgr2=0x7f4040004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:05.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405b7bb700 1 --2- 172.21.15.133:0/909324686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40400049c0 0x7f4040004e40 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f404c001b30 tx=0x7f40540605d0).stop 2021-01-03T13:07:05.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.548+0000 7f405a559700 1 -- 172.21.15.133:0/909324686 reap_dead start 2021-01-03T13:07:05.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405b7bb700 1 -- 172.21.15.133:0/909324686 shutdown_connections 2021-01-03T13:07:05.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405b7bb700 1 -- 172.21.15.133:0/909324686 >> 172.21.15.133:0/909324686 conn(0x7f405405bdf0 msgr2=0x7f405405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:05.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405b7bb700 1 -- 172.21.15.133:0/909324686 shutdown_connections 2021-01-03T13:07:05.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405b7bb700 1 -- 172.21.15.133:0/909324686 wait complete. 2021-01-03T13:07:05.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405b7bb700 1 Processor -- start 2021-01-03T13:07:05.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405b7bb700 1 -- start start 2021-01-03T13:07:05.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405b7bb700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4054132a10 0x7f4054066b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405b7bb700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4054063540 0x7f4054141190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405b7bb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4054067050 0x7f4054141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405b7bb700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4054132df0 con 0x7f4054132a10 2021-01-03T13:07:05.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405b7bb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4054063bd0 con 0x7f4054067050 2021-01-03T13:07:05.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405b7bb700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4054065550 con 0x7f4054063540 2021-01-03T13:07:05.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405a559700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4054067050 0x7f4054141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405a559700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4054067050 0x7f4054141680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39434/0 (socket says 172.21.15.133:39434) 2021-01-03T13:07:05.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405a559700 1 -- 172.21.15.133:0/3841578098 learned_addr learned my addr 172.21.15.133:0/3841578098 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:05.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f4059557700 1 --2- 172.21.15.133:0/3841578098 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4054063540 0x7f4054141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f4059d58700 1 --2- 172.21.15.133:0/3841578098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4054132a10 0x7f4054066b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405a559700 1 -- 172.21.15.133:0/3841578098 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4054063540 msgr2=0x7f4054141190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:05.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405a559700 1 --2- 172.21.15.133:0/3841578098 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4054063540 0x7f4054141190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405a559700 1 -- 172.21.15.133:0/3841578098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4054132a10 msgr2=0x7f4054066b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:05.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405a559700 1 --2- 172.21.15.133:0/3841578098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4054132a10 0x7f4054066b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.552+0000 7f405a559700 1 -- 172.21.15.133:0/3841578098 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405408fdb0 con 0x7f4054067050 2021-01-03T13:07:05.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.556+0000 7f405a559700 1 --2- 172.21.15.133:0/3841578098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4054067050 0x7f4054141680 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f4054060950 tx=0x7f404c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:05.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.556+0000 7f404a7fc700 1 -- 172.21.15.133:0/3841578098 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f404c0059e0 con 0x7f4054067050 2021-01-03T13:07:05.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.556+0000 7f404a7fc700 1 -- 172.21.15.133:0/3841578098 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c005b40 con 0x7f4054067050 2021-01-03T13:07:05.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.556+0000 7f404a7fc700 1 -- 172.21.15.133:0/3841578098 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f404c005ea0 con 0x7f4054067050 2021-01-03T13:07:05.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.556+0000 7f405b7bb700 1 -- 172.21.15.133:0/3841578098 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405412fe50 con 0x7f4054067050 2021-01-03T13:07:05.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.556+0000 7f405b7bb700 1 -- 172.21.15.133:0/3841578098 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4054064680 con 0x7f4054067050 2021-01-03T13:07:05.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.556+0000 7f405b7bb700 1 -- 172.21.15.133:0/3841578098 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4054065710 con 0x7f4054067050 2021-01-03T13:07:05.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.556+0000 7f404a7fc700 1 -- 172.21.15.133:0/3841578098 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f404c01e070 con 0x7f4054067050 2021-01-03T13:07:05.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.556+0000 7f404a7fc700 1 --2- 172.21.15.133:0/3841578098 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f403c055320 0x7f403c0577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.556+0000 7f404a7fc700 1 -- 172.21.15.133:0/3841578098 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f404c06df00 con 0x7f4054067050 2021-01-03T13:07:05.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.556+0000 7f4059d58700 1 --2- 172.21.15.133:0/3841578098 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f403c055320 0x7f403c0577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.556+0000 7f4059d58700 1 --2- 172.21.15.133:0/3841578098 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f403c055320 0x7f403c0577e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f405000b000 tx=0x7f4050008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:05.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.564+0000 7f404a7fc700 1 -- 172.21.15.133:0/3841578098 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f404c0442b0 con 0x7f4054067050 2021-01-03T13:07:05.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.752+0000 7f405b7bb700 1 -- 172.21.15.133:0/3841578098 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4054063d60 con 0x7f4054067050 2021-01-03T13:07:05.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.760+0000 7f404a7fc700 1 -- 172.21.15.133:0/3841578098 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v30) v1 ==== 184+0+0 (secure 0 0 0) 0x7f404c0478d0 con 0x7f4054067050 2021-01-03T13:07:05.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.764+0000 7f405b7bb700 1 -- 172.21.15.133:0/3841578098 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f403c055320 msgr2=0x7f403c0577e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:05.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.764+0000 7f405b7bb700 1 --2- 172.21.15.133:0/3841578098 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f403c055320 0x7f403c0577e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f405000b000 tx=0x7f4050008040).stop 2021-01-03T13:07:05.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.764+0000 7f405b7bb700 1 -- 172.21.15.133:0/3841578098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4054067050 msgr2=0x7f4054141680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:05.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.764+0000 7f405b7bb700 1 --2- 172.21.15.133:0/3841578098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4054067050 0x7f4054141680 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f4054060950 tx=0x7f404c016000).stop 2021-01-03T13:07:05.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.764+0000 7f405b7bb700 1 -- 172.21.15.133:0/3841578098 shutdown_connections 2021-01-03T13:07:05.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.764+0000 7f405b7bb700 1 --2- 172.21.15.133:0/3841578098 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f403c055320 0x7f403c0577e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.764+0000 7f405b7bb700 1 --2- 172.21.15.133:0/3841578098 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4054132a10 0x7f4054066b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.764+0000 7f405b7bb700 1 --2- 172.21.15.133:0/3841578098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4054067050 0x7f4054141680 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.764+0000 7f405b7bb700 1 --2- 172.21.15.133:0/3841578098 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4054063540 0x7f4054141190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.764+0000 7f405b7bb700 1 -- 172.21.15.133:0/3841578098 >> 172.21.15.133:0/3841578098 conn(0x7f405405bdf0 msgr2=0x7f40540af060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:05.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.764+0000 7f405b7bb700 1 -- 172.21.15.133:0/3841578098 shutdown_connections 2021-01-03T13:07:05.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.764+0000 7f405b7bb700 1 -- 172.21.15.133:0/3841578098 wait complete. 2021-01-03T13:07:05.772 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.1 2021-01-03T13:07:05.781 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:07:05.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febba3cd700 1 Processor -- start 2021-01-03T13:07:05.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febba3cd700 1 -- start start 2021-01-03T13:07:05.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febba3cd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7febb40b52c0 0x7febb40b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febba3cd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7febb40b0c90 0x7febb4098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febba3cd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febb40b5c00 0x7febb414a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febba3cd700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb4067a90 con 0x7febb40b52c0 2021-01-03T13:07:05.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febba3cd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb4060da0 con 0x7febb40b0c90 2021-01-03T13:07:05.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febba3cd700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb40b0ad0 con 0x7febb40b5c00 2021-01-03T13:07:05.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febb8bca700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7febb40b0c90 0x7febb4098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febb8bca700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7febb40b0c90 0x7febb4098ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39438/0 (socket says 172.21.15.133:39438) 2021-01-03T13:07:05.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febb8bca700 1 -- 172.21.15.133:0/1705428972 learned_addr learned my addr 172.21.15.133:0/1705428972 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:05.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febb93cb700 1 --2- 172.21.15.133:0/1705428972 >> v2:172.21.15.16:3300/0 conn(0x7febb40b52c0 0x7febb40b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febb9bcc700 1 --2- 172.21.15.133:0/1705428972 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febb40b5c00 0x7febb414a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febb8bca700 1 -- 172.21.15.133:0/1705428972 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febb40b5c00 msgr2=0x7febb414a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:05.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febb8bca700 1 --2- 172.21.15.133:0/1705428972 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febb40b5c00 0x7febb414a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febb8bca700 1 -- 172.21.15.133:0/1705428972 >> v2:172.21.15.16:3300/0 conn(0x7febb40b52c0 msgr2=0x7febb40b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:05.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febb8bca700 1 --2- 172.21.15.133:0/1705428972 >> v2:172.21.15.16:3300/0 conn(0x7febb40b52c0 0x7febb40b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febb8bca700 1 -- 172.21.15.133:0/1705428972 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb40b56a0 con 0x7febb40b0c90 2021-01-03T13:07:05.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febb8bca700 1 --2- 172.21.15.133:0/1705428972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febb40b0c90 0x7febb4098ec0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7feba4002f30 tx=0x7feba4006e80).ready entity=mon.1 client_cookie=edd76129f6fe9bf server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:05.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febabfff700 1 -- 172.21.15.133:0/1705428972 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feba40097f0 con 0x7febb40b0c90 2021-01-03T13:07:05.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febabfff700 1 -- 172.21.15.133:0/1705428972 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba4009950 con 0x7febb40b0c90 2021-01-03T13:07:05.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febabfff700 1 -- 172.21.15.133:0/1705428972 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feba4009cb0 con 0x7febb40b0c90 2021-01-03T13:07:05.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febba3cd700 1 -- 172.21.15.133:0/1705428972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febb40b0c90 msgr2=0x7febb4098ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:05.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febba3cd700 1 --2- 172.21.15.133:0/1705428972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febb40b0c90 0x7febb4098ec0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7feba4002f30 tx=0x7feba4006e80).stop 2021-01-03T13:07:05.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febba3cd700 1 -- 172.21.15.133:0/1705428972 shutdown_connections 2021-01-03T13:07:05.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febba3cd700 1 --2- 172.21.15.133:0/1705428972 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febb40b5c00 0x7febb414a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febba3cd700 1 --2- 172.21.15.133:0/1705428972 >> v2:172.21.15.16:3300/0 conn(0x7febb40b52c0 0x7febb40b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febba3cd700 1 --2- 172.21.15.133:0/1705428972 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febb40b0c90 0x7febb4098ec0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febba3cd700 1 -- 172.21.15.133:0/1705428972 >> 172.21.15.133:0/1705428972 conn(0x7febb405bdf0 msgr2=0x7febb405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:05.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febba3cd700 1 -- 172.21.15.133:0/1705428972 shutdown_connections 2021-01-03T13:07:05.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.888+0000 7febba3cd700 1 -- 172.21.15.133:0/1705428972 wait complete. 2021-01-03T13:07:05.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febba3cd700 1 Processor -- start 2021-01-03T13:07:05.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febba3cd700 1 -- start start 2021-01-03T13:07:05.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febba3cd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febb40b0c90 0x7febb4157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febba3cd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febb40b52c0 0x7febb4157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febba3cd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40b5c00 0x7febb40ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febba3cd700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb4159bd0 con 0x7febb40b5c00 2021-01-03T13:07:05.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febba3cd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb40ad920 con 0x7febb40b0c90 2021-01-03T13:07:05.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febba3cd700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb40ad6c0 con 0x7febb40b52c0 2021-01-03T13:07:05.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febb93cb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febb40b0c90 0x7febb4157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febb93cb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febb40b0c90 0x7febb4157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39446/0 (socket says 172.21.15.133:39446) 2021-01-03T13:07:05.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febb93cb700 1 -- 172.21.15.133:0/1244610762 learned_addr learned my addr 172.21.15.133:0/1244610762 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:05.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febb9bcc700 1 --2- 172.21.15.133:0/1244610762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40b5c00 0x7febb40ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febb8bca700 1 --2- 172.21.15.133:0/1244610762 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febb40b52c0 0x7febb4157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febb93cb700 1 -- 172.21.15.133:0/1244610762 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febb40b52c0 msgr2=0x7febb4157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:05.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febb93cb700 1 --2- 172.21.15.133:0/1244610762 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febb40b52c0 0x7febb4157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febb93cb700 1 -- 172.21.15.133:0/1244610762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40b5c00 msgr2=0x7febb40ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:05.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febb93cb700 1 --2- 172.21.15.133:0/1244610762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40b5c00 0x7febb40ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:05.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febb93cb700 1 -- 172.21.15.133:0/1244610762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb4159db0 con 0x7febb40b0c90 2021-01-03T13:07:05.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febb8bca700 1 --2- 172.21.15.133:0/1244610762 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febb40b52c0 0x7febb4157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:05.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febb93cb700 1 --2- 172.21.15.133:0/1244610762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febb40b0c90 0x7febb4157c00 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7febb000c000 tx=0x7febb00091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:05.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febaa7fc700 1 -- 172.21.15.133:0/1244610762 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febb000cb00 con 0x7febb40b0c90 2021-01-03T13:07:05.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febba3cd700 1 -- 172.21.15.133:0/1244610762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb415a050 con 0x7febb40b0c90 2021-01-03T13:07:05.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febba3cd700 1 -- 172.21.15.133:0/1244610762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb40ad1d0 con 0x7febb40b0c90 2021-01-03T13:07:05.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febaa7fc700 1 -- 172.21.15.133:0/1244610762 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb000cc60 con 0x7febb40b0c90 2021-01-03T13:07:05.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.892+0000 7febaa7fc700 1 -- 172.21.15.133:0/1244610762 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febb001b410 con 0x7febb40b0c90 2021-01-03T13:07:05.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.896+0000 7febba3cd700 1 -- 172.21.15.133:0/1244610762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb900033e0 con 0x7febb40b0c90 2021-01-03T13:07:05.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.896+0000 7febaa7fc700 1 -- 172.21.15.133:0/1244610762 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7febb00123f0 con 0x7febb40b0c90 2021-01-03T13:07:05.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.896+0000 7febaa7fc700 1 --2- 172.21.15.133:0/1244610762 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb9c055330 0x7feb9c0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:05.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.896+0000 7febaa7fc700 1 -- 172.21.15.133:0/1244610762 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7febb006e590 con 0x7febb40b0c90 2021-01-03T13:07:05.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.896+0000 7febb8bca700 1 --2- 172.21.15.133:0/1244610762 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb9c055330 0x7feb9c0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:05.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.896+0000 7febb8bca700 1 --2- 172.21.15.133:0/1244610762 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb9c055330 0x7feb9c0577f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7feba401a000 tx=0x7feba4015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:05.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:05.900+0000 7febaa7fc700 1 -- 172.21.15.133:0/1244610762 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7febb0044830 con 0x7febb40b0c90 2021-01-03T13:07:06.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.084+0000 7febba3cd700 1 -- 172.21.15.133:0/1244610762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb90003820 con 0x7febb40b0c90 2021-01-03T13:07:06.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.084+0000 7febaa7fc700 1 -- 172.21.15.133:0/1244610762 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2498 (secure 0 0 0) 0x7febb0016020 con 0x7febb40b0c90 2021-01-03T13:07:06.091 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:06.091 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":67,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6719,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/2510927889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2510927889},{"type":"v1","addr":"172.21.15.16:6833","nonce":2510927889}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":65},{"gid":6722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1243273461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1243273461},{"type":"v1","addr":"172.21.15.133:6837","nonce":1243273461}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:03.438043+0000","modified":"2021-01-03T13:07:04.442588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7792},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7792":{"gid":7792,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/679359254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":679359254},{"type":"v1","addr":"172.21.15.133:6835","nonce":679359254}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-01-03T13:07:06.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.088+0000 7febba3cd700 1 -- 172.21.15.133:0/1244610762 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb9c055330 msgr2=0x7feb9c0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:06.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.088+0000 7febba3cd700 1 --2- 172.21.15.133:0/1244610762 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb9c055330 0x7feb9c0577f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7feba401a000 tx=0x7feba4015000).stop 2021-01-03T13:07:06.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.088+0000 7febba3cd700 1 -- 172.21.15.133:0/1244610762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febb40b0c90 msgr2=0x7febb4157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:06.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.088+0000 7febba3cd700 1 --2- 172.21.15.133:0/1244610762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febb40b0c90 0x7febb4157c00 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7febb000c000 tx=0x7febb00091a0).stop 2021-01-03T13:07:06.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.088+0000 7febba3cd700 1 -- 172.21.15.133:0/1244610762 shutdown_connections 2021-01-03T13:07:06.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.088+0000 7febba3cd700 1 --2- 172.21.15.133:0/1244610762 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7feb9c055330 0x7feb9c0577f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.088+0000 7febba3cd700 1 --2- 172.21.15.133:0/1244610762 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febb40b5c00 0x7febb40ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.088+0000 7febba3cd700 1 --2- 172.21.15.133:0/1244610762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febb40b0c90 0x7febb4157c00 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.088+0000 7febba3cd700 1 --2- 172.21.15.133:0/1244610762 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febb40b52c0 0x7febb4157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.088+0000 7febba3cd700 1 -- 172.21.15.133:0/1244610762 >> 172.21.15.133:0/1244610762 conn(0x7febb405bdf0 msgr2=0x7febb41434e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:06.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.088+0000 7febba3cd700 1 -- 172.21.15.133:0/1244610762 shutdown_connections 2021-01-03T13:07:06.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.088+0000 7febba3cd700 1 -- 172.21.15.133:0/1244610762 wait complete. 2021-01-03T13:07:06.096 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 67 2021-01-03T13:07:06.414 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:07:03.438043+0000', 'modified': '2021-01-03T13:07:04.442588+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7792}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7792': {'gid': 7792, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6835/679359254', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 679359254}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 679359254}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:07:06.414 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:07:06.415 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-01-03T13:07:06.546 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":7792,"want_state":"up:active","state":"up:active","rank_uptime":3.0924636529999998,"mdsmap_epoch":67,"osdmap_epoch":143,"osdmap_epoch_barrier":142,"uptime":8.4047737169999994} 2021-01-03T13:07:06.547 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 7792, "mdsmap_epoch": 67, "osdmap_epoch": 143, "osdmap_epoch_barrier": 142, "rank_uptime": 3.092463653, "state": "up:active", "uptime": 8.404773717, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:07:06.547 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:07:06.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f30649dc700 1 Processor -- start 2021-01-03T13:07:06.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f30649dc700 1 -- start start 2021-01-03T13:07:06.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f30649dc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f30600b9b60 0x7f30600b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:06.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f30649dc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f30600b4980 0x7f30600b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:06.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f30649dc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3060146430 0x7f30601468c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:06.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f30649dc700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30600aed30 con 0x7f3060146430 2021-01-03T13:07:06.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f30649dc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30600605f0 con 0x7f30600b4980 2021-01-03T13:07:06.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f30649dc700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30600600b0 con 0x7f30600b9b60 2021-01-03T13:07:06.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f305659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f30600b4980 0x7f30600b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:06.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f305659c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f30600b4980 0x7f30600b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39452/0 (socket says 172.21.15.133:39452) 2021-01-03T13:07:06.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f305659c700 1 -- 172.21.15.133:0/2195820013 learned_addr learned my addr 172.21.15.133:0/2195820013 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:06.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f305ed9d700 1 --2- 172.21.15.133:0/2195820013 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f30600b9b60 0x7f30600b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:06.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f305f59e700 1 --2- 172.21.15.133:0/2195820013 >> v2:172.21.15.16:3300/0 conn(0x7f3060146430 0x7f30601468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:06.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f305659c700 1 -- 172.21.15.133:0/2195820013 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f30600b9b60 msgr2=0x7f30600b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:06.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f305659c700 1 --2- 172.21.15.133:0/2195820013 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f30600b9b60 0x7f30600b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f305659c700 1 -- 172.21.15.133:0/2195820013 >> v2:172.21.15.16:3300/0 conn(0x7f3060146430 msgr2=0x7f30601468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:06.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f305659c700 1 --2- 172.21.15.133:0/2195820013 >> v2:172.21.15.16:3300/0 conn(0x7f3060146430 0x7f30601468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f305659c700 1 -- 172.21.15.133:0/2195820013 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3060060350 con 0x7f30600b4980 2021-01-03T13:07:06.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f305f59e700 1 --2- 172.21.15.133:0/2195820013 >> v2:172.21.15.16:3300/0 conn(0x7f3060146430 0x7f30601468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:06.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f305659c700 1 --2- 172.21.15.133:0/2195820013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600b4980 0x7f30600b4de0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f3048002f30 tx=0x7f3048006e80).ready entity=mon.1 client_cookie=508a2c65fcaa60c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:06.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f305e59c700 1 -- 172.21.15.133:0/2195820013 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30480097f0 con 0x7f30600b4980 2021-01-03T13:07:06.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f305e59c700 1 -- 172.21.15.133:0/2195820013 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3048009950 con 0x7f30600b4980 2021-01-03T13:07:06.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f305e59c700 1 -- 172.21.15.133:0/2195820013 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3048009cb0 con 0x7f30600b4980 2021-01-03T13:07:06.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f30649dc700 1 -- 172.21.15.133:0/2195820013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600b4980 msgr2=0x7f30600b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:06.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.656+0000 7f30649dc700 1 --2- 172.21.15.133:0/2195820013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600b4980 0x7f30600b4de0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f3048002f30 tx=0x7f3048006e80).stop 2021-01-03T13:07:06.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f30649dc700 1 -- 172.21.15.133:0/2195820013 shutdown_connections 2021-01-03T13:07:06.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f30649dc700 1 --2- 172.21.15.133:0/2195820013 >> v2:172.21.15.16:3300/0 conn(0x7f3060146430 0x7f30601468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f30649dc700 1 --2- 172.21.15.133:0/2195820013 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f30600b9b60 0x7f30600b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f30649dc700 1 --2- 172.21.15.133:0/2195820013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600b4980 0x7f30600b4de0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f30649dc700 1 -- 172.21.15.133:0/2195820013 >> 172.21.15.133:0/2195820013 conn(0x7f30600b69e0 msgr2=0x7f30600b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:06.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f30649dc700 1 -- 172.21.15.133:0/2195820013 shutdown_connections 2021-01-03T13:07:06.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f30649dc700 1 -- 172.21.15.133:0/2195820013 wait complete. 2021-01-03T13:07:06.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f30649dc700 1 Processor -- start 2021-01-03T13:07:06.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f30649dc700 1 -- start start 2021-01-03T13:07:06.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f30649dc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600b4980 0x7f3060141010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:06.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f30649dc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30600b9b60 0x7f306009f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:06.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f30649dc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3060146430 0x7f3060143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:06.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f30649dc700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306009eac0 con 0x7f30600b9b60 2021-01-03T13:07:06.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f30649dc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30601525e0 con 0x7f30600b4980 2021-01-03T13:07:06.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f30649dc700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3060152880 con 0x7f3060146430 2021-01-03T13:07:06.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f305ed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600b4980 0x7f3060141010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:06.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f305ed9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600b4980 0x7f3060141010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39458/0 (socket says 172.21.15.133:39458) 2021-01-03T13:07:06.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f305ed9d700 1 -- 172.21.15.133:0/4067240419 learned_addr learned my addr 172.21.15.133:0/4067240419 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:06.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f305659c700 1 --2- 172.21.15.133:0/4067240419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30600b9b60 0x7f306009f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:06.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f305f59e700 1 --2- 172.21.15.133:0/4067240419 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3060146430 0x7f3060143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:06.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f305ed9d700 1 -- 172.21.15.133:0/4067240419 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3060146430 msgr2=0x7f3060143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:06.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f305ed9d700 1 --2- 172.21.15.133:0/4067240419 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3060146430 0x7f3060143320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f305ed9d700 1 -- 172.21.15.133:0/4067240419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30600b9b60 msgr2=0x7f306009f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:06.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f305ed9d700 1 --2- 172.21.15.133:0/4067240419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30600b9b60 0x7f306009f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f305ed9d700 1 -- 172.21.15.133:0/4067240419 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306009e380 con 0x7f30600b4980 2021-01-03T13:07:06.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f305659c700 1 --2- 172.21.15.133:0/4067240419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30600b9b60 0x7f306009f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:06.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.660+0000 7f305ed9d700 1 --2- 172.21.15.133:0/4067240419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600b4980 0x7f3060141010 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f305000c000 tx=0x7f3050006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:06.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.664+0000 7f305cd99700 1 -- 172.21.15.133:0/4067240419 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f305000ca80 con 0x7f30600b4980 2021-01-03T13:07:06.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.664+0000 7f305cd99700 1 -- 172.21.15.133:0/4067240419 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305000cbe0 con 0x7f30600b4980 2021-01-03T13:07:06.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.664+0000 7f305cd99700 1 -- 172.21.15.133:0/4067240419 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30500123f0 con 0x7f30600b4980 2021-01-03T13:07:06.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.664+0000 7f30649dc700 1 -- 172.21.15.133:0/4067240419 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306009e620 con 0x7f30600b4980 2021-01-03T13:07:06.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.664+0000 7f30649dc700 1 -- 172.21.15.133:0/4067240419 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3060141870 con 0x7f30600b4980 2021-01-03T13:07:06.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.664+0000 7f30649dc700 1 -- 172.21.15.133:0/4067240419 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3060057300 con 0x7f30600b4980 2021-01-03T13:07:06.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.664+0000 7f305cd99700 1 -- 172.21.15.133:0/4067240419 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3050012550 con 0x7f30600b4980 2021-01-03T13:07:06.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.664+0000 7f305cd99700 1 --2- 172.21.15.133:0/4067240419 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30440553b0 0x7f3044057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:06.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.664+0000 7f305cd99700 1 -- 172.21.15.133:0/4067240419 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f305006e3a0 con 0x7f30600b4980 2021-01-03T13:07:06.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.664+0000 7f305659c700 1 --2- 172.21.15.133:0/4067240419 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30440553b0 0x7f3044057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:06.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.664+0000 7f305659c700 1 --2- 172.21.15.133:0/4067240419 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30440553b0 0x7f3044057870 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f304801a000 tx=0x7f3048015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:06.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.672+0000 7f305cd99700 1 -- 172.21.15.133:0/4067240419 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3050044640 con 0x7f30600b4980 2021-01-03T13:07:06.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.812+0000 7f30649dc700 1 -- 172.21.15.133:0/4067240419 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3060067a00 con 0x7f30600b4980 2021-01-03T13:07:06.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.812+0000 7f305cd99700 1 -- 172.21.15.133:0/4067240419 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f3050047c60 con 0x7f30600b4980 2021-01-03T13:07:06.819 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:06.819 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":143,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:04.443265+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:07:01.122595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-01-03T13:07:02.419257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:07:06.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.816+0000 7f30649dc700 1 -- 172.21.15.133:0/4067240419 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30440553b0 msgr2=0x7f3044057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:06.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.816+0000 7f30649dc700 1 --2- 172.21.15.133:0/4067240419 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30440553b0 0x7f3044057870 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f304801a000 tx=0x7f3048015000).stop 2021-01-03T13:07:06.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.816+0000 7f30649dc700 1 -- 172.21.15.133:0/4067240419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600b4980 msgr2=0x7f3060141010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:06.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.816+0000 7f30649dc700 1 --2- 172.21.15.133:0/4067240419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600b4980 0x7f3060141010 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f305000c000 tx=0x7f3050006dc0).stop 2021-01-03T13:07:06.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.816+0000 7f30649dc700 1 -- 172.21.15.133:0/4067240419 shutdown_connections 2021-01-03T13:07:06.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.816+0000 7f30649dc700 1 --2- 172.21.15.133:0/4067240419 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f30440553b0 0x7f3044057870 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.816+0000 7f30649dc700 1 --2- 172.21.15.133:0/4067240419 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3060146430 0x7f3060143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.816+0000 7f30649dc700 1 --2- 172.21.15.133:0/4067240419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600b4980 0x7f3060141010 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.816+0000 7f30649dc700 1 --2- 172.21.15.133:0/4067240419 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f30600b9b60 0x7f306009f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.816+0000 7f30649dc700 1 -- 172.21.15.133:0/4067240419 >> 172.21.15.133:0/4067240419 conn(0x7f30600b69e0 msgr2=0x7f3060062010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:06.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.816+0000 7f30649dc700 1 -- 172.21.15.133:0/4067240419 shutdown_connections 2021-01-03T13:07:06.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.816+0000 7f30649dc700 1 -- 172.21.15.133:0/4067240419 wait complete. 2021-01-03T13:07:06.833 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:07:01.122595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:07:02.419257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:07:06.834 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:07:06.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.948+0000 7f9c1da01700 1 Processor -- start 2021-01-03T13:07:06.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.948+0000 7f9c1da01700 1 -- start start 2021-01-03T13:07:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.948+0000 7f9c1da01700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9c18060510 0x7f9c1805c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.948+0000 7f9c1da01700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c1805fd10 0x7f9c180b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:06.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.948+0000 7f9c1da01700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1805bf00 con 0x7f9c180b4c20 2021-01-03T13:07:06.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.948+0000 7f9c1da01700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1805c1a0 con 0x7f9c18060510 2021-01-03T13:07:06.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.948+0000 7f9c1da01700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1805c440 con 0x7f9c1805fd10 2021-01-03T13:07:06.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.948+0000 7f9c1d200700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c1805fd10 0x7f9c180b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:06.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c1d200700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c1805fd10 0x7f9c180b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:47772/0 (socket says 172.21.15.133:47772) 2021-01-03T13:07:06.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c1d200700 1 -- 172.21.15.133:0/2370426413 learned_addr learned my addr 172.21.15.133:0/2370426413 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:06.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c17fff700 1 --2- 172.21.15.133:0/2370426413 >> v2:172.21.15.16:3300/0 conn(0x7f9c18060510 0x7f9c1805c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:06.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c1d200700 1 -- 172.21.15.133:0/2370426413 >> v2:172.21.15.16:3300/0 conn(0x7f9c18060510 msgr2=0x7f9c1805c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:06.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c1d200700 1 --2- 172.21.15.133:0/2370426413 >> v2:172.21.15.16:3300/0 conn(0x7f9c18060510 0x7f9c1805c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c1d200700 1 -- 172.21.15.133:0/2370426413 >> v1:172.21.15.16:6789/0 conn(0x7f9c180b4c20 legacy=0x7f9c180b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:06.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c1d200700 1 -- 172.21.15.133:0/2370426413 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c180b6ad0 con 0x7f9c1805fd10 2021-01-03T13:07:06.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c1d200700 1 --2- 172.21.15.133:0/2370426413 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c1805fd10 0x7f9c180b65e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f9c100032b0 tx=0x7f9c10009270).ready entity=mon.2 client_cookie=b747295664bbffb1 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:06.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c177fe700 1 -- 172.21.15.133:0/2370426413 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c10009e60 con 0x7f9c1805fd10 2021-01-03T13:07:06.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c177fe700 1 -- 172.21.15.133:0/2370426413 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1000bc00 con 0x7f9c1805fd10 2021-01-03T13:07:06.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c177fe700 1 -- 172.21.15.133:0/2370426413 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c1000bd70 con 0x7f9c1805fd10 2021-01-03T13:07:06.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c1da01700 1 -- 172.21.15.133:0/2370426413 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c1805fd10 msgr2=0x7f9c180b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:06.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c1da01700 1 --2- 172.21.15.133:0/2370426413 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c1805fd10 0x7f9c180b65e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f9c100032b0 tx=0x7f9c10009270).stop 2021-01-03T13:07:06.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c1da01700 1 -- 172.21.15.133:0/2370426413 shutdown_connections 2021-01-03T13:07:06.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c1da01700 1 --2- 172.21.15.133:0/2370426413 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c1805fd10 0x7f9c180b65e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c1da01700 1 --2- 172.21.15.133:0/2370426413 >> v2:172.21.15.16:3300/0 conn(0x7f9c18060510 0x7f9c1805c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c1da01700 1 -- 172.21.15.133:0/2370426413 >> 172.21.15.133:0/2370426413 conn(0x7f9c180b9f00 msgr2=0x7f9c180b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:06.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c1da01700 1 -- 172.21.15.133:0/2370426413 shutdown_connections 2021-01-03T13:07:06.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c1da01700 1 -- 172.21.15.133:0/2370426413 wait complete. 2021-01-03T13:07:06.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.952+0000 7f9c1da01700 1 Processor -- start 2021-01-03T13:07:06.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1da01700 1 -- start start 2021-01-03T13:07:06.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1da01700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c1805fd10 0x7f9c180af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:06.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1da01700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c18060510 0x7f9c180b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:06.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1da01700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c180b4c20 0x7f9c180b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:06.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1da01700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18140bb0 con 0x7f9c18060510 2021-01-03T13:07:06.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1da01700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18140e50 con 0x7f9c180b4c20 2021-01-03T13:07:06.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1da01700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c181410f0 con 0x7f9c1805fd10 2021-01-03T13:07:06.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1d200700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c180b4c20 0x7f9c180b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:06.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1d200700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c180b4c20 0x7f9c180b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39474/0 (socket says 172.21.15.133:39474) 2021-01-03T13:07:06.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1d200700 1 -- 172.21.15.133:0/2722291867 learned_addr learned my addr 172.21.15.133:0/2722291867 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:06.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1c9ff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c1805fd10 0x7f9c180af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:06.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c17fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c18060510 0x7f9c180b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:06.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1d200700 1 -- 172.21.15.133:0/2722291867 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c1805fd10 msgr2=0x7f9c180af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:06.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1d200700 1 --2- 172.21.15.133:0/2722291867 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c1805fd10 0x7f9c180af6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1d200700 1 -- 172.21.15.133:0/2722291867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c18060510 msgr2=0x7f9c180b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:06.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1d200700 1 --2- 172.21.15.133:0/2722291867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c18060510 0x7f9c180b25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:06.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1d200700 1 -- 172.21.15.133:0/2722291867 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c18141390 con 0x7f9c180b4c20 2021-01-03T13:07:06.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1d200700 1 --2- 172.21.15.133:0/2722291867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c180b4c20 0x7f9c180b30d0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f9c100032b0 tx=0x7f9c10016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:06.976 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c15ffb700 1 -- 172.21.15.133:0/2722291867 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c100105b0 con 0x7f9c180b4c20 2021-01-03T13:07:06.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c15ffb700 1 -- 172.21.15.133:0/2722291867 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c10010710 con 0x7f9c180b4c20 2021-01-03T13:07:06.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c15ffb700 1 -- 172.21.15.133:0/2722291867 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c10010a70 con 0x7f9c180b4c20 2021-01-03T13:07:06.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1da01700 1 -- 172.21.15.133:0/2722291867 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c181436d0 con 0x7f9c180b4c20 2021-01-03T13:07:06.977 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.956+0000 7f9c1da01700 1 -- 172.21.15.133:0/2722291867 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c180b2aa0 con 0x7f9c180b4c20 2021-01-03T13:07:06.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.960+0000 7f9c1da01700 1 -- 172.21.15.133:0/2722291867 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c18141520 con 0x7f9c180b4c20 2021-01-03T13:07:06.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.960+0000 7f9c15ffb700 1 -- 172.21.15.133:0/2722291867 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9c1000f070 con 0x7f9c180b4c20 2021-01-03T13:07:06.978 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.960+0000 7f9c15ffb700 1 --2- 172.21.15.133:0/2722291867 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9bfc055470 0x7f9bfc057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:06.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.960+0000 7f9c1c9ff700 1 --2- 172.21.15.133:0/2722291867 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9bfc055470 0x7f9bfc057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:06.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.960+0000 7f9c15ffb700 1 -- 172.21.15.133:0/2722291867 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9c1006f6d0 con 0x7f9c180b4c20 2021-01-03T13:07:06.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.960+0000 7f9c1c9ff700 1 --2- 172.21.15.133:0/2722291867 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9bfc055470 0x7f9bfc057930 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f9c0800d000 tx=0x7f9c08007b60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:06.980 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:06.968+0000 7f9c15ffb700 1 -- 172.21.15.133:0/2722291867 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9c100492f0 con 0x7f9c180b4c20 2021-01-03T13:07:07.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.108+0000 7f9c1da01700 1 -- 172.21.15.133:0/2722291867 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9c18057300 con 0x7f9c180b4c20 2021-01-03T13:07:07.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.108+0000 7f9c15ffb700 1 -- 172.21.15.133:0/2722291867 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v143) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9c100150b0 con 0x7f9c180b4c20 2021-01-03T13:07:07.114 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:07:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.108+0000 7f9c1da01700 1 -- 172.21.15.133:0/2722291867 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9bfc055470 msgr2=0x7f9bfc057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.108+0000 7f9c1da01700 1 --2- 172.21.15.133:0/2722291867 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9bfc055470 0x7f9bfc057930 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f9c0800d000 tx=0x7f9c08007b60).stop 2021-01-03T13:07:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.108+0000 7f9c1da01700 1 -- 172.21.15.133:0/2722291867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c180b4c20 msgr2=0x7f9c180b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.108+0000 7f9c1da01700 1 --2- 172.21.15.133:0/2722291867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c180b4c20 0x7f9c180b30d0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7f9c100032b0 tx=0x7f9c10016000).stop 2021-01-03T13:07:07.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.108+0000 7f9c1da01700 1 -- 172.21.15.133:0/2722291867 shutdown_connections 2021-01-03T13:07:07.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.108+0000 7f9c1da01700 1 --2- 172.21.15.133:0/2722291867 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9bfc055470 0x7f9bfc057930 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.108+0000 7f9c1da01700 1 --2- 172.21.15.133:0/2722291867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c180b4c20 0x7f9c180b30d0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.108+0000 7f9c1da01700 1 --2- 172.21.15.133:0/2722291867 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9c1805fd10 0x7f9c180af6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.108+0000 7f9c1da01700 1 --2- 172.21.15.133:0/2722291867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9c18060510 0x7f9c180b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.108+0000 7f9c1da01700 1 -- 172.21.15.133:0/2722291867 >> 172.21.15.133:0/2722291867 conn(0x7f9c180b9f00 msgr2=0x7f9c180b7030 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:07.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.108+0000 7f9c1da01700 1 -- 172.21.15.133:0/2722291867 shutdown_connections 2021-01-03T13:07:07.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.108+0000 7f9c1da01700 1 -- 172.21.15.133:0/2722291867 wait complete. 2021-01-03T13:07:07.128 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:07:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55de037700 1 Processor -- start 2021-01-03T13:07:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55de037700 1 -- start start 2021-01-03T13:07:07.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55de037700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55d8060510 0x7f55d805c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:07.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55de037700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f55d805fd10 0x7f55d80b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:07.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55de037700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d805bf00 con 0x7f55d80b4c20 2021-01-03T13:07:07.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55de037700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d805c1a0 con 0x7f55d805fd10 2021-01-03T13:07:07.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55de037700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d805c440 con 0x7f55d8060510 2021-01-03T13:07:07.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55dd836700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f55d805fd10 0x7f55d80b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:07.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55dd836700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f55d805fd10 0x7f55d80b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39484/0 (socket says 172.21.15.133:39484) 2021-01-03T13:07:07.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55dd836700 1 -- 172.21.15.133:0/2102758955 learned_addr learned my addr 172.21.15.133:0/2102758955 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:07.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55dc834700 1 --2- 172.21.15.133:0/2102758955 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55d8060510 0x7f55d805c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:07.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55dd836700 1 -- 172.21.15.133:0/2102758955 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55d8060510 msgr2=0x7f55d805c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:07.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55dd836700 1 --2- 172.21.15.133:0/2102758955 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55d8060510 0x7f55d805c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55dd836700 1 -- 172.21.15.133:0/2102758955 >> v1:172.21.15.16:6789/0 conn(0x7f55d80b4c20 legacy=0x7f55d80b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:07.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55dd836700 1 -- 172.21.15.133:0/2102758955 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d80b6ad0 con 0x7f55d805fd10 2021-01-03T13:07:07.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55dc834700 1 --2- 172.21.15.133:0/2102758955 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55d8060510 0x7f55d805c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:07.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55dd836700 1 --2- 172.21.15.133:0/2102758955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d805fd10 0x7f55d80b65e0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f55d805c7c0 tx=0x7f55d0009270).ready entity=mon.1 client_cookie=fefca754feaf877 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:07.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55cffff700 1 -- 172.21.15.133:0/2102758955 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55d000bbc0 con 0x7f55d805fd10 2021-01-03T13:07:07.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55cffff700 1 -- 172.21.15.133:0/2102758955 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d000bd20 con 0x7f55d805fd10 2021-01-03T13:07:07.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55cffff700 1 -- 172.21.15.133:0/2102758955 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55d0011400 con 0x7f55d805fd10 2021-01-03T13:07:07.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55de037700 1 -- 172.21.15.133:0/2102758955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d805fd10 msgr2=0x7f55d80b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55de037700 1 --2- 172.21.15.133:0/2102758955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d805fd10 0x7f55d80b65e0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7f55d805c7c0 tx=0x7f55d0009270).stop 2021-01-03T13:07:07.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55de037700 1 -- 172.21.15.133:0/2102758955 shutdown_connections 2021-01-03T13:07:07.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55de037700 1 --2- 172.21.15.133:0/2102758955 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d805fd10 0x7f55d80b65e0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55de037700 1 --2- 172.21.15.133:0/2102758955 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55d8060510 0x7f55d805c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55de037700 1 -- 172.21.15.133:0/2102758955 >> 172.21.15.133:0/2102758955 conn(0x7f55d80b9f00 msgr2=0x7f55d80b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:07.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.240+0000 7f55de037700 1 -- 172.21.15.133:0/2102758955 shutdown_connections 2021-01-03T13:07:07.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.244+0000 7f55de037700 1 -- 172.21.15.133:0/2102758955 wait complete. 2021-01-03T13:07:07.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.244+0000 7f55de037700 1 Processor -- start 2021-01-03T13:07:07.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.244+0000 7f55de037700 1 -- start start 2021-01-03T13:07:07.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.244+0000 7f55de037700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55d805fd10 0x7f55d80af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:07.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.244+0000 7f55de037700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d8060510 0x7f55d8141470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:07.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.244+0000 7f55de037700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55d80b4c20 0x7f55d81519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:07.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.244+0000 7f55de037700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d8141960 con 0x7f55d80b4c20 2021-01-03T13:07:07.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.244+0000 7f55de037700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d8155090 con 0x7f55d8060510 2021-01-03T13:07:07.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.244+0000 7f55de037700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d8155330 con 0x7f55d805fd10 2021-01-03T13:07:07.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.244+0000 7f55dc834700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d8060510 0x7f55d8141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:07.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.244+0000 7f55dc834700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d8060510 0x7f55d8141470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39490/0 (socket says 172.21.15.133:39490) 2021-01-03T13:07:07.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.244+0000 7f55dc834700 1 -- 172.21.15.133:0/2389702338 learned_addr learned my addr 172.21.15.133:0/2389702338 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:07.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.244+0000 7f55dd035700 1 --2- 172.21.15.133:0/2389702338 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55d805fd10 0x7f55d80af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:07.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.244+0000 7f55dd836700 1 --2- 172.21.15.133:0/2389702338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55d80b4c20 0x7f55d81519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:07.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.248+0000 7f55dc834700 1 -- 172.21.15.133:0/2389702338 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55d805fd10 msgr2=0x7f55d80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.248+0000 7f55dc834700 1 --2- 172.21.15.133:0/2389702338 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55d805fd10 0x7f55d80af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.248+0000 7f55dc834700 1 -- 172.21.15.133:0/2389702338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55d80b4c20 msgr2=0x7f55d81519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.248+0000 7f55dc834700 1 --2- 172.21.15.133:0/2389702338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55d80b4c20 0x7f55d81519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.248+0000 7f55dc834700 1 -- 172.21.15.133:0/2389702338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d81555d0 con 0x7f55d8060510 2021-01-03T13:07:07.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.248+0000 7f55dc834700 1 --2- 172.21.15.133:0/2389702338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d8060510 0x7f55d8141470 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f55d8142740 tx=0x7f55d4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:07.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.248+0000 7f55ce7fc700 1 -- 172.21.15.133:0/2389702338 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55d4010580 con 0x7f55d8060510 2021-01-03T13:07:07.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.248+0000 7f55de037700 1 -- 172.21.15.133:0/2389702338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d8155870 con 0x7f55d8060510 2021-01-03T13:07:07.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.248+0000 7f55ce7fc700 1 -- 172.21.15.133:0/2389702338 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d40106e0 con 0x7f55d8060510 2021-01-03T13:07:07.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.248+0000 7f55ce7fc700 1 -- 172.21.15.133:0/2389702338 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55d4010a40 con 0x7f55d8060510 2021-01-03T13:07:07.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.248+0000 7f55de037700 1 -- 172.21.15.133:0/2389702338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d80b3ae0 con 0x7f55d8060510 2021-01-03T13:07:07.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.248+0000 7f55de037700 1 -- 172.21.15.133:0/2389702338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d8155a00 con 0x7f55d8060510 2021-01-03T13:07:07.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.248+0000 7f55ce7fc700 1 -- 172.21.15.133:0/2389702338 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f55d4010ba0 con 0x7f55d8060510 2021-01-03T13:07:07.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.248+0000 7f55ce7fc700 1 --2- 172.21.15.133:0/2389702338 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55c0055330 0x7f55c00577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:07.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.248+0000 7f55ce7fc700 1 -- 172.21.15.133:0/2389702338 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f55d406e0f0 con 0x7f55d8060510 2021-01-03T13:07:07.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.248+0000 7f55dd035700 1 --2- 172.21.15.133:0/2389702338 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55c0055330 0x7f55c00577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:07.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.252+0000 7f55dd035700 1 --2- 172.21.15.133:0/2389702338 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55c0055330 0x7f55c00577f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f55c800c000 tx=0x7f55c8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:07.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.256+0000 7f55ce7fc700 1 -- 172.21.15.133:0/2389702338 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f55d40442f0 con 0x7f55d8060510 2021-01-03T13:07:07.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.392+0000 7f55de037700 1 -- 172.21.15.133:0/2389702338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f55d8057300 con 0x7f55d8060510 2021-01-03T13:07:07.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.392+0000 7f55ce7fc700 1 -- 172.21.15.133:0/2389702338 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v143) v1 ==== 92+0+10 (secure 0 0 0) 0x7f55d4047910 con 0x7f55d8060510 2021-01-03T13:07:07.397 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:07.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.392+0000 7f55de037700 1 -- 172.21.15.133:0/2389702338 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55c0055330 msgr2=0x7f55c00577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.392+0000 7f55de037700 1 --2- 172.21.15.133:0/2389702338 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55c0055330 0x7f55c00577f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f55c800c000 tx=0x7f55c8008040).stop 2021-01-03T13:07:07.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.392+0000 7f55de037700 1 -- 172.21.15.133:0/2389702338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d8060510 msgr2=0x7f55d8141470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.392+0000 7f55de037700 1 --2- 172.21.15.133:0/2389702338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d8060510 0x7f55d8141470 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f55d8142740 tx=0x7f55d4008040).stop 2021-01-03T13:07:07.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.392+0000 7f55de037700 1 -- 172.21.15.133:0/2389702338 shutdown_connections 2021-01-03T13:07:07.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.392+0000 7f55de037700 1 --2- 172.21.15.133:0/2389702338 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f55c0055330 0x7f55c00577f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.392+0000 7f55de037700 1 --2- 172.21.15.133:0/2389702338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55d80b4c20 0x7f55d81519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.392+0000 7f55de037700 1 --2- 172.21.15.133:0/2389702338 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55d805fd10 0x7f55d80af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.392+0000 7f55de037700 1 --2- 172.21.15.133:0/2389702338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d8060510 0x7f55d8141470 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.392+0000 7f55de037700 1 -- 172.21.15.133:0/2389702338 >> 172.21.15.133:0/2389702338 conn(0x7f55d80b9f00 msgr2=0x7f55d80ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:07.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.392+0000 7f55de037700 1 -- 172.21.15.133:0/2389702338 shutdown_connections 2021-01-03T13:07:07.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.396+0000 7f55de037700 1 -- 172.21.15.133:0/2389702338 wait complete. 2021-01-03T13:07:07.418 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:07:07.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd9bd6700 1 Processor -- start 2021-01-03T13:07:07.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd9bd6700 1 -- start start 2021-01-03T13:07:07.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd9bd6700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfd4140060 0x7fbfd41436a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:07.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd9bd6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbfd4140440 0x7fbfd40b7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:07.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd9bd6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd4067c40 con 0x7fbfd409c3e0 2021-01-03T13:07:07.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd9bd6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd40628b0 con 0x7fbfd4140440 2021-01-03T13:07:07.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd9bd6700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4063160 con 0x7fbfd4140060 2021-01-03T13:07:07.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd93d5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbfd4140440 0x7fbfd40b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:07.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd93d5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbfd4140440 0x7fbfd40b7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39496/0 (socket says 172.21.15.133:39496) 2021-01-03T13:07:07.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd93d5700 1 -- 172.21.15.133:0/4189598189 learned_addr learned my addr 172.21.15.133:0/4189598189 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:07.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd3fff700 1 --1- 172.21.15.133:0/4189598189 >> v1:172.21.15.133:6789/0 conn(0x7fbfd409c3e0 0x7fbfd4062a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60530/0 (socket says 172.21.15.133:60530) 2021-01-03T13:07:07.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd8bd4700 1 --2- 172.21.15.133:0/4189598189 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfd4140060 0x7fbfd41436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:07.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd93d5700 1 -- 172.21.15.133:0/4189598189 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfd4140060 msgr2=0x7fbfd41436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:07.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd93d5700 1 --2- 172.21.15.133:0/4189598189 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfd4140060 0x7fbfd41436a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd93d5700 1 -- 172.21.15.133:0/4189598189 >> v1:172.21.15.133:6789/0 conn(0x7fbfd409c3e0 legacy=0x7fbfd4062a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd93d5700 1 -- 172.21.15.133:0/4189598189 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd4061ed0 con 0x7fbfd4140440 2021-01-03T13:07:07.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd93d5700 1 --2- 172.21.15.133:0/4189598189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd4140440 0x7fbfd40b7110 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7fbfcc0032b0 tx=0x7fbfcc009270).ready entity=mon.1 client_cookie=da03d46bfad21b56 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:07.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.536+0000 7fbfd37fe700 1 -- 172.21.15.133:0/4189598189 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfcc00bc00 con 0x7fbfd4140440 2021-01-03T13:07:07.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd37fe700 1 -- 172.21.15.133:0/4189598189 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc00bd60 con 0x7fbfd4140440 2021-01-03T13:07:07.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd37fe700 1 -- 172.21.15.133:0/4189598189 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfcc011400 con 0x7fbfd4140440 2021-01-03T13:07:07.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 -- 172.21.15.133:0/4189598189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd4140440 msgr2=0x7fbfd40b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 --2- 172.21.15.133:0/4189598189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd4140440 0x7fbfd40b7110 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7fbfcc0032b0 tx=0x7fbfcc009270).stop 2021-01-03T13:07:07.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 -- 172.21.15.133:0/4189598189 shutdown_connections 2021-01-03T13:07:07.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 --2- 172.21.15.133:0/4189598189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd4140440 0x7fbfd40b7110 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 --2- 172.21.15.133:0/4189598189 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfd4140060 0x7fbfd41436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 -- 172.21.15.133:0/4189598189 >> 172.21.15.133:0/4189598189 conn(0x7fbfd405bdf0 msgr2=0x7fbfd405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:07.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 -- 172.21.15.133:0/4189598189 shutdown_connections 2021-01-03T13:07:07.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 -- 172.21.15.133:0/4189598189 wait complete. 2021-01-03T13:07:07.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 Processor -- start 2021-01-03T13:07:07.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 -- start start 2021-01-03T13:07:07.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd409c3e0 0x7fbfd40b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:07.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfd4140060 0x7fbfd4066da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:07.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfd4140440 0x7fbfd40b75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:07.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd41497b0 con 0x7fbfd4140060 2021-01-03T13:07:07.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4149550 con 0x7fbfd409c3e0 2021-01-03T13:07:07.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4149f90 con 0x7fbfd4140440 2021-01-03T13:07:07.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd8bd4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd409c3e0 0x7fbfd40b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:07.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd8bd4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd409c3e0 0x7fbfd40b5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39500/0 (socket says 172.21.15.133:39500) 2021-01-03T13:07:07.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd8bd4700 1 -- 172.21.15.133:0/333749397 learned_addr learned my addr 172.21.15.133:0/333749397 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:07.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd93d5700 1 --2- 172.21.15.133:0/333749397 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfd4140440 0x7fbfd40b75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:07.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd3fff700 1 --2- 172.21.15.133:0/333749397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfd4140060 0x7fbfd4066da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:07.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd8bd4700 1 -- 172.21.15.133:0/333749397 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfd4140440 msgr2=0x7fbfd40b75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd8bd4700 1 --2- 172.21.15.133:0/333749397 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfd4140440 0x7fbfd40b75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd8bd4700 1 -- 172.21.15.133:0/333749397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfd4140060 msgr2=0x7fbfd4066da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd8bd4700 1 --2- 172.21.15.133:0/333749397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfd4140060 0x7fbfd4066da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd8bd4700 1 -- 172.21.15.133:0/333749397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd4144140 con 0x7fbfd409c3e0 2021-01-03T13:07:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd3fff700 1 --2- 172.21.15.133:0/333749397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfd4140060 0x7fbfd4066da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd8bd4700 1 --2- 172.21.15.133:0/333749397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd409c3e0 0x7fbfd40b5ea0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7fbfc4003070 tx=0x7fbfc4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd1ffb700 1 -- 172.21.15.133:0/333749397 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfc4009980 con 0x7fbfd409c3e0 2021-01-03T13:07:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd1ffb700 1 -- 172.21.15.133:0/333749397 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc4009ae0 con 0x7fbfd409c3e0 2021-01-03T13:07:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 -- 172.21.15.133:0/333749397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd4155d70 con 0x7fbfd409c3e0 2021-01-03T13:07:07.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd1ffb700 1 -- 172.21.15.133:0/333749397 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfc4009e40 con 0x7fbfd409c3e0 2021-01-03T13:07:07.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.540+0000 7fbfd9bd6700 1 -- 172.21.15.133:0/333749397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd4149c50 con 0x7fbfd409c3e0 2021-01-03T13:07:07.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.544+0000 7fbfd9bd6700 1 -- 172.21.15.133:0/333749397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd4057300 con 0x7fbfd409c3e0 2021-01-03T13:07:07.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.544+0000 7fbfd1ffb700 1 -- 172.21.15.133:0/333749397 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fbfc4013480 con 0x7fbfd409c3e0 2021-01-03T13:07:07.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.544+0000 7fbfd1ffb700 1 --2- 172.21.15.133:0/333749397 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfb0055440 0x7fbfb0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:07.558 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.544+0000 7fbfd3fff700 1 --2- 172.21.15.133:0/333749397 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfb0055440 0x7fbfb0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:07.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.544+0000 7fbfd1ffb700 1 -- 172.21.15.133:0/333749397 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbfc406e5d0 con 0x7fbfd409c3e0 2021-01-03T13:07:07.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.544+0000 7fbfd3fff700 1 --2- 172.21.15.133:0/333749397 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfb0055440 0x7fbfb0057900 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fbfc0008000 tx=0x7fbfc0009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:07.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.552+0000 7fbfd1ffb700 1 -- 172.21.15.133:0/333749397 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbfc4044760 con 0x7fbfd409c3e0 2021-01-03T13:07:07.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.692+0000 7fbfd9bd6700 1 -- 172.21.15.133:0/333749397 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbfd40b2ee0 con 0x7fbfd409c3e0 2021-01-03T13:07:07.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.692+0000 7fbfd1ffb700 1 -- 172.21.15.133:0/333749397 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v143) v1 ==== 104+0+10 (secure 0 0 0) 0x7fbfc4047d80 con 0x7fbfd409c3e0 2021-01-03T13:07:07.700 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:07.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.696+0000 7fbfd9bd6700 1 -- 172.21.15.133:0/333749397 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfb0055440 msgr2=0x7fbfb0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.696+0000 7fbfd9bd6700 1 --2- 172.21.15.133:0/333749397 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfb0055440 0x7fbfb0057900 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fbfc0008000 tx=0x7fbfc0009040).stop 2021-01-03T13:07:07.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.696+0000 7fbfd9bd6700 1 -- 172.21.15.133:0/333749397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd409c3e0 msgr2=0x7fbfd40b5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.696+0000 7fbfd9bd6700 1 --2- 172.21.15.133:0/333749397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd409c3e0 0x7fbfd40b5ea0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7fbfc4003070 tx=0x7fbfc4008040).stop 2021-01-03T13:07:07.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.696+0000 7fbfd9bd6700 1 -- 172.21.15.133:0/333749397 shutdown_connections 2021-01-03T13:07:07.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.696+0000 7fbfd9bd6700 1 --2- 172.21.15.133:0/333749397 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfb0055440 0x7fbfb0057900 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.696+0000 7fbfd9bd6700 1 --2- 172.21.15.133:0/333749397 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbfd4140440 0x7fbfd40b75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.696+0000 7fbfd9bd6700 1 --2- 172.21.15.133:0/333749397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbfd409c3e0 0x7fbfd40b5ea0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.696+0000 7fbfd9bd6700 1 --2- 172.21.15.133:0/333749397 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbfd4140060 0x7fbfd4066da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.696+0000 7fbfd9bd6700 1 -- 172.21.15.133:0/333749397 >> 172.21.15.133:0/333749397 conn(0x7fbfd405bdf0 msgr2=0x7fbfd4142470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:07.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.696+0000 7fbfd9bd6700 1 -- 172.21.15.133:0/333749397 shutdown_connections 2021-01-03T13:07:07.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.696+0000 7fbfd9bd6700 1 -- 172.21.15.133:0/333749397 wait complete. 2021-01-03T13:07:07.713 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:07:07.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.828+0000 7fb1668a2700 1 Processor -- start 2021-01-03T13:07:07.834 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.828+0000 7fb1668a2700 1 -- start start 2021-01-03T13:07:07.835 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.828+0000 7fb1668a2700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb160060510 0x7fb16005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:07.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.828+0000 7fb1668a2700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1600b6cf0 con 0x7fb1600b4c20 2021-01-03T13:07:07.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.828+0000 7fb1668a2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16005bf00 con 0x7fb16005fd10 2021-01-03T13:07:07.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.828+0000 7fb1668a2700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb16005c1a0 con 0x7fb160060510 2021-01-03T13:07:07.836 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.828+0000 7fb1660a1700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb16005fd10 0x7fb1600b65e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60544/0 (socket says 172.21.15.133:60544) 2021-01-03T13:07:07.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.828+0000 7fb1660a1700 1 -- 172.21.15.133:0/2728044660 learned_addr learned my addr 172.21.15.133:0/2728044660 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:07.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.828+0000 7fb16509f700 1 --2- 172.21.15.133:0/2728044660 >> v2:172.21.15.16:3300/0 conn(0x7fb160060510 0x7fb16005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:07.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb16489e700 1 -- 172.21.15.133:0/2728044660 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552429740 0 0) 0x7fb16005bf00 con 0x7fb16005fd10 2021-01-03T13:07:07.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb16489e700 1 -- 172.21.15.133:0/2728044660 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb148003230 con 0x7fb16005fd10 2021-01-03T13:07:07.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb16489e700 1 -- 172.21.15.133:0/2728044660 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546081626 0 0) 0x7fb1600b6cf0 con 0x7fb1600b4c20 2021-01-03T13:07:07.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb16489e700 1 -- 172.21.15.133:0/2728044660 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb16005bf00 con 0x7fb1600b4c20 2021-01-03T13:07:07.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb16509f700 1 -- 172.21.15.133:0/2728044660 >> v1:172.21.15.133:6789/0 conn(0x7fb16005fd10 legacy=0x7fb1600b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb16489e700 1 -- 172.21.15.133:0/2728044660 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 631732436 0 0) 0x7fb148003230 con 0x7fb16005fd10 2021-01-03T13:07:07.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb16509f700 1 -- 172.21.15.133:0/2728044660 >> v1:172.21.15.16:6789/0 conn(0x7fb1600b4c20 legacy=0x7fb1600b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb16509f700 1 -- 172.21.15.133:0/2728044660 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16005c440 con 0x7fb160060510 2021-01-03T13:07:07.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb16509f700 1 --2- 172.21.15.133:0/2728044660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb160060510 0x7fb16005c8e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fb158001450 tx=0x7fb154006dc0).ready entity=mon.0 client_cookie=db1aba43830dd33f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:07.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb16489e700 1 -- 172.21.15.133:0/2728044660 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb158001a50 con 0x7fb160060510 2021-01-03T13:07:07.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb16489e700 1 -- 172.21.15.133:0/2728044660 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15400d610 con 0x7fb160060510 2021-01-03T13:07:07.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb16489e700 1 -- 172.21.15.133:0/2728044660 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb15400d780 con 0x7fb160060510 2021-01-03T13:07:07.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb1668a2700 1 -- 172.21.15.133:0/2728044660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb160060510 msgr2=0x7fb16005c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb1668a2700 1 --2- 172.21.15.133:0/2728044660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb160060510 0x7fb16005c8e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fb158001450 tx=0x7fb154006dc0).stop 2021-01-03T13:07:07.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb1668a2700 1 -- 172.21.15.133:0/2728044660 shutdown_connections 2021-01-03T13:07:07.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb1668a2700 1 --2- 172.21.15.133:0/2728044660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb160060510 0x7fb16005c8e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb1668a2700 1 -- 172.21.15.133:0/2728044660 >> 172.21.15.133:0/2728044660 conn(0x7fb1600b9f00 msgr2=0x7fb1600b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:07.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb1668a2700 1 -- 172.21.15.133:0/2728044660 shutdown_connections 2021-01-03T13:07:07.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.832+0000 7fb1668a2700 1 -- 172.21.15.133:0/2728044660 wait complete. 2021-01-03T13:07:07.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1668a2700 1 Processor -- start 2021-01-03T13:07:07.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1668a2700 1 -- start start 2021-01-03T13:07:07.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1668a2700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb16005fd10 0x7fb16009e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:07.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1668a2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb160060510 0x7fb160144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:07.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1668a2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1600b4c20 0x7fb160144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:07.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1668a2700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb160144000 con 0x7fb16005fd10 2021-01-03T13:07:07.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1668a2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb160146120 con 0x7fb1600b4c20 2021-01-03T13:07:07.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1668a2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb160144e10 con 0x7fb160060510 2021-01-03T13:07:07.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1660a1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1600b4c20 0x7fb160144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:07.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1660a1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1600b4c20 0x7fb160144920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39518/0 (socket says 172.21.15.133:39518) 2021-01-03T13:07:07.846 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1660a1700 1 -- 172.21.15.133:0/3802182575 learned_addr learned my addr 172.21.15.133:0/3802182575 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:07.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb16509f700 1 --2- 172.21.15.133:0/3802182575 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb160060510 0x7fb160144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:07.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1658a0700 1 --2- 172.21.15.133:0/3802182575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb16005fd10 0x7fb16009e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:07.847 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1660a1700 1 -- 172.21.15.133:0/3802182575 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb160060510 msgr2=0x7fb160144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1660a1700 1 --2- 172.21.15.133:0/3802182575 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb160060510 0x7fb160144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1660a1700 1 -- 172.21.15.133:0/3802182575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb16005fd10 msgr2=0x7fb16009e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1660a1700 1 --2- 172.21.15.133:0/3802182575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb16005fd10 0x7fb16009e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1660a1700 1 -- 172.21.15.133:0/3802182575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb160146380 con 0x7fb1600b4c20 2021-01-03T13:07:07.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1660a1700 1 --2- 172.21.15.133:0/3802182575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1600b4c20 0x7fb160144920 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7fb1601455d0 tx=0x7fb158001600).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:07.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb152ffd700 1 -- 172.21.15.133:0/3802182575 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb158004a80 con 0x7fb1600b4c20 2021-01-03T13:07:07.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1668a2700 1 -- 172.21.15.133:0/3802182575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb160146620 con 0x7fb1600b4c20 2021-01-03T13:07:07.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb152ffd700 1 -- 172.21.15.133:0/3802182575 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb158004be0 con 0x7fb1600b4c20 2021-01-03T13:07:07.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb152ffd700 1 -- 172.21.15.133:0/3802182575 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb158007170 con 0x7fb1600b4c20 2021-01-03T13:07:07.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.836+0000 7fb1668a2700 1 -- 172.21.15.133:0/3802182575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb160143780 con 0x7fb1600b4c20 2021-01-03T13:07:07.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.840+0000 7fb1668a2700 1 -- 172.21.15.133:0/3802182575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb160057300 con 0x7fb1600b4c20 2021-01-03T13:07:07.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.840+0000 7fb152ffd700 1 -- 172.21.15.133:0/3802182575 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb158010070 con 0x7fb1600b4c20 2021-01-03T13:07:07.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.840+0000 7fb152ffd700 1 --2- 172.21.15.133:0/3802182575 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb140055440 0x7fb140057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:07.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.840+0000 7fb152ffd700 1 -- 172.21.15.133:0/3802182575 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb15806dd00 con 0x7fb1600b4c20 2021-01-03T13:07:07.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.840+0000 7fb1658a0700 1 --2- 172.21.15.133:0/3802182575 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb140055440 0x7fb140057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:07.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.844+0000 7fb1658a0700 1 --2- 172.21.15.133:0/3802182575 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb140055440 0x7fb140057900 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fb15c00d000 tx=0x7fb15c0079d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:07.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.848+0000 7fb152ffd700 1 -- 172.21.15.133:0/3802182575 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb158043e70 con 0x7fb1600b4c20 2021-01-03T13:07:07.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.988+0000 7fb1668a2700 1 -- 172.21.15.133:0/3802182575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb160145cf0 con 0x7fb1600b4c20 2021-01-03T13:07:07.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.988+0000 7fb152ffd700 1 -- 172.21.15.133:0/3802182575 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v143) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb158047490 con 0x7fb1600b4c20 2021-01-03T13:07:07.995 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:07.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.988+0000 7fb1668a2700 1 -- 172.21.15.133:0/3802182575 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb140055440 msgr2=0x7fb140057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.988+0000 7fb1668a2700 1 --2- 172.21.15.133:0/3802182575 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb140055440 0x7fb140057900 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fb15c00d000 tx=0x7fb15c0079d0).stop 2021-01-03T13:07:07.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.988+0000 7fb1668a2700 1 -- 172.21.15.133:0/3802182575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1600b4c20 msgr2=0x7fb160144920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:07.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.988+0000 7fb1668a2700 1 --2- 172.21.15.133:0/3802182575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1600b4c20 0x7fb160144920 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7fb1601455d0 tx=0x7fb158001600).stop 2021-01-03T13:07:07.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.992+0000 7fb1668a2700 1 -- 172.21.15.133:0/3802182575 shutdown_connections 2021-01-03T13:07:07.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.992+0000 7fb1668a2700 1 --2- 172.21.15.133:0/3802182575 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb140055440 0x7fb140057900 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.992+0000 7fb1668a2700 1 --2- 172.21.15.133:0/3802182575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb16005fd10 0x7fb16009e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.992+0000 7fb1668a2700 1 --2- 172.21.15.133:0/3802182575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1600b4c20 0x7fb160144920 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.992+0000 7fb1668a2700 1 --2- 172.21.15.133:0/3802182575 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb160060510 0x7fb160144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:07.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.992+0000 7fb1668a2700 1 -- 172.21.15.133:0/3802182575 >> 172.21.15.133:0/3802182575 conn(0x7fb1600b9f00 msgr2=0x7fb16013ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:07.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.992+0000 7fb1668a2700 1 -- 172.21.15.133:0/3802182575 shutdown_connections 2021-01-03T13:07:07.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:07.992+0000 7fb1668a2700 1 -- 172.21.15.133:0/3802182575 wait complete. 2021-01-03T13:07:08.013 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:07:08.014 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:07:08.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.116+0000 7f95e33f8700 1 Processor -- start 2021-01-03T13:07:08.124 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e33f8700 1 -- start start 2021-01-03T13:07:08.126 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e33f8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f95d40426e0 0x7f95d403f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:08.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e33f8700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d403de00 con 0x7f95d4041390 2021-01-03T13:07:08.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e33f8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d403f2a0 con 0x7f95d403da20 2021-01-03T13:07:08.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e33f8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d403e120 con 0x7f95d40426e0 2021-01-03T13:07:08.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e1bf5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f95d40426e0 0x7f95d403f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:08.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e23f6700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f95d403da20 0x7f95d40d84b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60554/0 (socket says 172.21.15.133:60554) 2021-01-03T13:07:08.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e1bf5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f95d40426e0 0x7f95d403f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39524/0 (socket says 172.21.15.133:39524) 2021-01-03T13:07:08.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e23f6700 1 -- 172.21.15.133:0/2892412727 learned_addr learned my addr 172.21.15.133:0/2892412727 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:08.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e13f4700 1 -- 172.21.15.133:0/2892412727 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401438328 0 0) 0x7f95d403de00 con 0x7f95d4041390 2021-01-03T13:07:08.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e13f4700 1 -- 172.21.15.133:0/2892412727 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95c4003230 con 0x7f95d4041390 2021-01-03T13:07:08.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e1bf5700 1 -- 172.21.15.133:0/2892412727 >> v1:172.21.15.133:6789/0 conn(0x7f95d403da20 legacy=0x7f95d40d84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:08.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e13f4700 1 -- 172.21.15.133:0/2892412727 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541827547 0 0) 0x7f95d403f2a0 con 0x7f95d403da20 2021-01-03T13:07:08.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e1bf5700 1 -- 172.21.15.133:0/2892412727 >> v1:172.21.15.16:6789/0 conn(0x7f95d4041390 legacy=0x7f95d403c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:08.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e1bf5700 1 -- 172.21.15.133:0/2892412727 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d4040f80 con 0x7f95d40426e0 2021-01-03T13:07:08.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e1bf5700 1 --2- 172.21.15.133:0/2892412727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95d40426e0 0x7f95d403f9a0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f95d0002f30 tx=0x7f95d0006dc0).ready entity=mon.1 client_cookie=a366ee79e7cbd06b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:08.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e13f4700 1 -- 172.21.15.133:0/2892412727 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95d0009800 con 0x7f95d40426e0 2021-01-03T13:07:08.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e13f4700 1 -- 172.21.15.133:0/2892412727 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d0009960 con 0x7f95d40426e0 2021-01-03T13:07:08.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e13f4700 1 -- 172.21.15.133:0/2892412727 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95d0009cc0 con 0x7f95d40426e0 2021-01-03T13:07:08.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e33f8700 1 -- 172.21.15.133:0/2892412727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95d40426e0 msgr2=0x7f95d403f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:08.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e33f8700 1 --2- 172.21.15.133:0/2892412727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95d40426e0 0x7f95d403f9a0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f95d0002f30 tx=0x7f95d0006dc0).stop 2021-01-03T13:07:08.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e33f8700 1 -- 172.21.15.133:0/2892412727 shutdown_connections 2021-01-03T13:07:08.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e33f8700 1 --2- 172.21.15.133:0/2892412727 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95d40426e0 0x7f95d403f9a0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:08.135 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e33f8700 1 -- 172.21.15.133:0/2892412727 >> 172.21.15.133:0/2892412727 conn(0x7f95d40462a0 msgr2=0x7f95d40466b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:08.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e33f8700 1 -- 172.21.15.133:0/2892412727 shutdown_connections 2021-01-03T13:07:08.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.120+0000 7f95e33f8700 1 -- 172.21.15.133:0/2892412727 wait complete. 2021-01-03T13:07:08.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e33f8700 1 Processor -- start 2021-01-03T13:07:08.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e33f8700 1 -- start start 2021-01-03T13:07:08.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e33f8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95d403da20 0x7f95d4044bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:08.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e33f8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95d4041390 0x7f95d40d7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:08.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e33f8700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95d40426e0 0x7f95d40d7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:08.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e33f8700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d40d0960 con 0x7f95d40426e0 2021-01-03T13:07:08.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e33f8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d40cff80 con 0x7f95d4041390 2021-01-03T13:07:08.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e33f8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d40d0220 con 0x7f95d403da20 2021-01-03T13:07:08.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e1bf5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95d4041390 0x7f95d40d7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:08.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e1bf5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95d4041390 0x7f95d40d7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39528/0 (socket says 172.21.15.133:39528) 2021-01-03T13:07:08.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e1bf5700 1 -- 172.21.15.133:0/2564505948 learned_addr learned my addr 172.21.15.133:0/2564505948 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:08.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e23f6700 1 --2- 172.21.15.133:0/2564505948 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95d403da20 0x7f95d4044bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:08.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e2bf7700 1 --2- 172.21.15.133:0/2564505948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95d40426e0 0x7f95d40d7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:08.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e1bf5700 1 -- 172.21.15.133:0/2564505948 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95d403da20 msgr2=0x7f95d4044bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:08.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e1bf5700 1 --2- 172.21.15.133:0/2564505948 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95d403da20 0x7f95d4044bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:08.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e1bf5700 1 -- 172.21.15.133:0/2564505948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95d40426e0 msgr2=0x7f95d40d7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e1bf5700 1 --2- 172.21.15.133:0/2564505948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95d40426e0 0x7f95d40d7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e1bf5700 1 -- 172.21.15.133:0/2564505948 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d40d04c0 con 0x7f95d4041390 2021-01-03T13:07:08.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e1bf5700 1 --2- 172.21.15.133:0/2564505948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95d4041390 0x7f95d40d7820 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f95d0002f30 tx=0x7f95d0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:08.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95cf7fe700 1 -- 172.21.15.133:0/2564505948 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95d0011b80 con 0x7f95d4041390 2021-01-03T13:07:08.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95cf7fe700 1 -- 172.21.15.133:0/2564505948 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d0011ce0 con 0x7f95d4041390 2021-01-03T13:07:08.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e33f8700 1 -- 172.21.15.133:0/2564505948 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d403bb60 con 0x7f95d4041390 2021-01-03T13:07:08.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95cf7fe700 1 -- 172.21.15.133:0/2564505948 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95d001d630 con 0x7f95d4041390 2021-01-03T13:07:08.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.124+0000 7f95e33f8700 1 -- 172.21.15.133:0/2564505948 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d40d8200 con 0x7f95d4041390 2021-01-03T13:07:08.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.128+0000 7f95e33f8700 1 -- 172.21.15.133:0/2564505948 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d40d64f0 con 0x7f95d4041390 2021-01-03T13:07:08.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.128+0000 7f95cf7fe700 1 -- 172.21.15.133:0/2564505948 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f95d0024030 con 0x7f95d4041390 2021-01-03T13:07:08.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.128+0000 7f95cf7fe700 1 --2- 172.21.15.133:0/2564505948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95bc055440 0x7f95bc057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:08.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.128+0000 7f95cf7fe700 1 -- 172.21.15.133:0/2564505948 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f95d006ee50 con 0x7f95d4041390 2021-01-03T13:07:08.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.128+0000 7f95e23f6700 1 --2- 172.21.15.133:0/2564505948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95bc055440 0x7f95bc057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:08.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.128+0000 7f95e23f6700 1 --2- 172.21.15.133:0/2564505948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95bc055440 0x7f95bc057900 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f95d800d000 tx=0x7f95d80079d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:08.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.136+0000 7f95cf7fe700 1 -- 172.21.15.133:0/2564505948 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f95d0044fe0 con 0x7f95d4041390 2021-01-03T13:07:08.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.316+0000 7f95e33f8700 1 -- 172.21.15.133:0/2564505948 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95d40d0650 con 0x7f95d4041390 2021-01-03T13:07:08.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.316+0000 7f95cf7fe700 1 -- 172.21.15.133:0/2564505948 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2498 (secure 0 0 0) 0x7f95d0022020 con 0x7f95d4041390 2021-01-03T13:07:08.324 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:08.324 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":67,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6719,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/2510927889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2510927889},{"type":"v1","addr":"172.21.15.16:6833","nonce":2510927889}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":65},{"gid":6722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1243273461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1243273461},{"type":"v1","addr":"172.21.15.133:6837","nonce":1243273461}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:03.438043+0000","modified":"2021-01-03T13:07:04.442588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7792},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7792":{"gid":7792,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/679359254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":679359254},{"type":"v1","addr":"172.21.15.133:6835","nonce":679359254}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-01-03T13:07:08.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.320+0000 7f95e33f8700 1 -- 172.21.15.133:0/2564505948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95bc055440 msgr2=0x7f95bc057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:08.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.320+0000 7f95e33f8700 1 --2- 172.21.15.133:0/2564505948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95bc055440 0x7f95bc057900 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f95d800d000 tx=0x7f95d80079d0).stop 2021-01-03T13:07:08.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.320+0000 7f95e33f8700 1 -- 172.21.15.133:0/2564505948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95d4041390 msgr2=0x7f95d40d7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:08.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.320+0000 7f95e33f8700 1 --2- 172.21.15.133:0/2564505948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95d4041390 0x7f95d40d7820 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f95d0002f30 tx=0x7f95d0015000).stop 2021-01-03T13:07:08.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.320+0000 7f95e33f8700 1 -- 172.21.15.133:0/2564505948 shutdown_connections 2021-01-03T13:07:08.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.320+0000 7f95e33f8700 1 --2- 172.21.15.133:0/2564505948 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95bc055440 0x7f95bc057900 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:08.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.320+0000 7f95e33f8700 1 --2- 172.21.15.133:0/2564505948 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95d40426e0 0x7f95d40d7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:08.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.320+0000 7f95e33f8700 1 --2- 172.21.15.133:0/2564505948 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95d403da20 0x7f95d4044bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:08.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.320+0000 7f95e33f8700 1 --2- 172.21.15.133:0/2564505948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95d4041390 0x7f95d40d7820 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:08.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.320+0000 7f95e33f8700 1 -- 172.21.15.133:0/2564505948 >> 172.21.15.133:0/2564505948 conn(0x7f95d40462a0 msgr2=0x7f95d4045420 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:08.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.320+0000 7f95e33f8700 1 -- 172.21.15.133:0/2564505948 shutdown_connections 2021-01-03T13:07:08.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:08.320+0000 7f95e33f8700 1 -- 172.21.15.133:0/2564505948 wait complete. 2021-01-03T13:07:08.331 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 67 2021-01-03T13:07:08.395 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:07:08.398 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:07:08.400 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:07:08.402 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:07:08.640 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:07:03.438043+0000', 'modified': '2021-01-03T13:07:04.442588+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7792}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7792': {'gid': 7792, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6835/679359254', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 679359254}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 679359254}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:07:08.641 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:07:08.641 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-01-03T13:07:08.769 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":7792,"want_state":"up:active","state":"up:active","rank_uptime":5.315551288,"mdsmap_epoch":67,"osdmap_epoch":143,"osdmap_epoch_barrier":142,"uptime":10.627860583} 2021-01-03T13:07:08.770 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 7792, "mdsmap_epoch": 67, "osdmap_epoch": 143, "osdmap_epoch_barrier": 142, "rank_uptime": 5.315551288, "state": "up:active", "uptime": 10.627860583, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:07:08.771 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:07:08.771 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-01-03T13:07:08.772 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi007.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-01-03T13:07:08.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:08.774 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:08.783 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:07:08.841 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:07:08.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:07:08.896 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:07:08.897 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:07:08.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:08.898 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:07:08.943 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:07:08.944 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:08.987 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:07:09.003 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:07:09.004 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:07:09.060 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:07:09.061 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:07:09.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:09.062 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:07:09.065 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2021-01-03T13:07:09.058+0000 7fd56fdb50c0 -1 init, newargv = 0x55f1b0f6b6c0 newargc=9ceph-fuse[ 2021-01-03T13:07:09.065 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:12752]: starting ceph client 2021-01-03T13:07:09.076 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12752]: starting fuse 2021-01-03T13:07:10.171 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:07:10.188 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:07:10.188 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:07:10.244 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:07:10.245 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:07:10.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:10.246 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:07:10.291 INFO:teuthology.orchestra.run.smithi007.stdout:50 2021-01-03T13:07:10.292 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:07:10.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:10.293 DEBUG:teuthology.orchestra.run.smithi007:> sudo python3 -c ' 2021-01-03T13:07:10.293 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2021-01-03T13:07:10.294 DEBUG:teuthology.orchestra.run.smithi007:> import re 2021-01-03T13:07:10.294 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:07:10.295 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2021-01-03T13:07:10.295 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:07:10.295 DEBUG:teuthology.orchestra.run.smithi007:> def find_socket(client_name): 2021-01-03T13:07:10.296 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-01-03T13:07:10.296 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2021-01-03T13:07:10.297 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:07:10.297 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2021-01-03T13:07:10.297 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2021-01-03T13:07:10.298 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2021-01-03T13:07:10.298 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2021-01-03T13:07:10.298 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:07:10.299 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2021-01-03T13:07:10.299 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:07:10.300 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:07:10.300 DEBUG:teuthology.orchestra.run.smithi007:> return f 2021-01-03T13:07:10.300 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:07:10.301 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:07:10.301 DEBUG:teuthology.orchestra.run.smithi007:> print(find_socket("client.0")) 2021-01-03T13:07:10.301 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:07:10.384 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.12752.asok 2021-01-03T13:07:10.389 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12752.asok 2021-01-03T13:07:10.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:10.391 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12752.asok status 2021-01-03T13:07:10.491 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2021-01-03T13:07:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2021-01-03T13:07:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:07:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:07:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2021-01-03T13:07:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2021-01-03T13:07:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-01-03T13:07:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "12752", 2021-01-03T13:07:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2021-01-03T13:07:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:07:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2021-01-03T13:07:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2021-01-03T13:07:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 7860, 2021-01-03T13:07:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2021-01-03T13:07:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2021-01-03T13:07:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2021-01-03T13:07:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 7860 2021-01-03T13:07:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:07:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:07:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:07:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:07:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1914839633 2021-01-03T13:07:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: } 2021-01-03T13:07:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:07:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:07:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:07:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:07:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1914839633 2021-01-03T13:07:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:07:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.7860 172.21.15.7:0/1914839633", 2021-01-03T13:07:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "172.21.15.7:0/1914839633", 2021-01-03T13:07:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2021-01-03T13:07:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 67, 2021-01-03T13:07:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 143, 2021-01-03T13:07:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:07:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "blacklisted": false, 2021-01-03T13:07:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2021-01-03T13:07:10.499 INFO:teuthology.orchestra.run.smithi007.stdout:} 2021-01-03T13:07:10.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:10.501 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:10.501 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:10.508 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:07:10.509 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:07:10.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:10.510 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:10.570 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:07:10.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f1689f47700 1 Processor -- start 2021-01-03T13:07:10.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f1689f47700 1 -- start start 2021-01-03T13:07:10.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f1689f47700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f16840b0c90 0x7f16840b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:10.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f1689f47700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1684060da0 con 0x7f16840b52c0 2021-01-03T13:07:10.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f1689f47700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16840b0ad0 con 0x7f16840b5c00 2021-01-03T13:07:10.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f1689f47700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1684067a90 con 0x7f16840b0c90 2021-01-03T13:07:10.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f1683fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f16840b0c90 0x7f16840b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:10.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f1688f45700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f16840b52c0 0x7f1684098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:39296/0 (socket says 172.21.15.133:39296) 2021-01-03T13:07:10.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f1683fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f16840b0c90 0x7f16840b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39538/0 (socket says 172.21.15.133:39538) 2021-01-03T13:07:10.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f1689746700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f16840b5c00 0x7f1684143eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60572/0 (socket says 172.21.15.133:60572) 2021-01-03T13:07:10.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f1683fff700 1 -- 172.21.15.133:0/1169785354 learned_addr learned my addr 172.21.15.133:0/1169785354 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:10.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f16837fe700 1 -- 172.21.15.133:0/1169785354 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222529935 0 0) 0x7f1684060da0 con 0x7f16840b52c0 2021-01-03T13:07:10.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f1683fff700 1 -- 172.21.15.133:0/1169785354 >> v1:172.21.15.133:6789/0 conn(0x7f16840b5c00 legacy=0x7f1684143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:10.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f1683fff700 1 -- 172.21.15.133:0/1169785354 >> v1:172.21.15.16:6789/0 conn(0x7f16840b52c0 legacy=0x7f1684098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:10.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f1683fff700 1 -- 172.21.15.133:0/1169785354 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16840b56a0 con 0x7f16840b0c90 2021-01-03T13:07:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f1683fff700 1 --2- 172.21.15.133:0/1169785354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16840b0c90 0x7f16840b05e0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f167c0015e0 tx=0x7f1678006e80).ready entity=mon.1 client_cookie=136b67fc1342586a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f16837fe700 1 -- 172.21.15.133:0/1169785354 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1678009730 con 0x7f16840b0c90 2021-01-03T13:07:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f16837fe700 1 -- 172.21.15.133:0/1169785354 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1678009890 con 0x7f16840b0c90 2021-01-03T13:07:10.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f16837fe700 1 -- 172.21.15.133:0/1169785354 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1678009a00 con 0x7f16840b0c90 2021-01-03T13:07:10.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f1689f47700 1 -- 172.21.15.133:0/1169785354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16840b0c90 msgr2=0x7f16840b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:10.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.684+0000 7f1689f47700 1 --2- 172.21.15.133:0/1169785354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16840b0c90 0x7f16840b05e0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f167c0015e0 tx=0x7f1678006e80).stop 2021-01-03T13:07:10.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1689f47700 1 -- 172.21.15.133:0/1169785354 shutdown_connections 2021-01-03T13:07:10.697 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1689f47700 1 --2- 172.21.15.133:0/1169785354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16840b0c90 0x7f16840b05e0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:10.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1689f47700 1 -- 172.21.15.133:0/1169785354 >> 172.21.15.133:0/1169785354 conn(0x7f168405bdf0 msgr2=0x7f168405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:10.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1689f47700 1 -- 172.21.15.133:0/1169785354 shutdown_connections 2021-01-03T13:07:10.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1689f47700 1 -- 172.21.15.133:0/1169785354 wait complete. 2021-01-03T13:07:10.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1689f47700 1 Processor -- start 2021-01-03T13:07:10.698 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1689f47700 1 -- start start 2021-01-03T13:07:10.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1689f47700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16840b0c90 0x7f16840ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:10.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1689f47700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f16840b52c0 0x7f16840aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:10.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1689f47700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16840b5c00 0x7f16840aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:10.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1689f47700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16840ae8c0 con 0x7f16840b5c00 2021-01-03T13:07:10.699 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1689f47700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168414a680 con 0x7f16840b0c90 2021-01-03T13:07:10.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1689f47700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168414a920 con 0x7f16840b52c0 2021-01-03T13:07:10.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1688f45700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16840b0c90 0x7f16840ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:10.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1688f45700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16840b0c90 0x7f16840ac6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39542/0 (socket says 172.21.15.133:39542) 2021-01-03T13:07:10.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1688f45700 1 -- 172.21.15.133:0/1615225066 learned_addr learned my addr 172.21.15.133:0/1615225066 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:10.700 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1689746700 1 --2- 172.21.15.133:0/1615225066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16840b5c00 0x7f16840aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:10.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1683fff700 1 --2- 172.21.15.133:0/1615225066 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f16840b52c0 0x7f16840aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:10.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1688f45700 1 -- 172.21.15.133:0/1615225066 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f16840b52c0 msgr2=0x7f16840aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:10.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1688f45700 1 --2- 172.21.15.133:0/1615225066 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f16840b52c0 0x7f16840aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:10.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1688f45700 1 -- 172.21.15.133:0/1615225066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16840b5c00 msgr2=0x7f16840aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:10.701 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1688f45700 1 --2- 172.21.15.133:0/1615225066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16840b5c00 0x7f16840aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:10.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1688f45700 1 -- 172.21.15.133:0/1615225066 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168414abc0 con 0x7f16840b0c90 2021-01-03T13:07:10.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1688f45700 1 --2- 172.21.15.133:0/1615225066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16840b0c90 0x7f16840ac6d0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f1674000e90 tx=0x7f1674007a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:10.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1681ffb700 1 -- 172.21.15.133:0/1615225066 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16740073b0 con 0x7f16840b0c90 2021-01-03T13:07:10.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.688+0000 7f1689f47700 1 -- 172.21.15.133:0/1615225066 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168414ae60 con 0x7f16840b0c90 2021-01-03T13:07:10.702 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.692+0000 7f1681ffb700 1 -- 172.21.15.133:0/1615225066 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1674005520 con 0x7f16840b0c90 2021-01-03T13:07:10.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.692+0000 7f1689f47700 1 -- 172.21.15.133:0/1615225066 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1684149360 con 0x7f16840b0c90 2021-01-03T13:07:10.703 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.692+0000 7f1681ffb700 1 -- 172.21.15.133:0/1615225066 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1674005880 con 0x7f16840b0c90 2021-01-03T13:07:10.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.692+0000 7f1689f47700 1 -- 172.21.15.133:0/1615225066 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1684057300 con 0x7f16840b0c90 2021-01-03T13:07:10.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.692+0000 7f1681ffb700 1 -- 172.21.15.133:0/1615225066 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1674010070 con 0x7f16840b0c90 2021-01-03T13:07:10.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.692+0000 7f1681ffb700 1 --2- 172.21.15.133:0/1615225066 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1664055330 0x7f16640577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:10.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.692+0000 7f1681ffb700 1 -- 172.21.15.133:0/1615225066 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f167406dd60 con 0x7f16840b0c90 2021-01-03T13:07:10.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.692+0000 7f1683fff700 1 --2- 172.21.15.133:0/1615225066 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1664055330 0x7f16640577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:10.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.692+0000 7f1683fff700 1 --2- 172.21.15.133:0/1615225066 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1664055330 0x7f16640577f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f167801b000 tx=0x7f1678016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:10.705 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.696+0000 7f1681ffb700 1 -- 172.21.15.133:0/1615225066 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1674044060 con 0x7f16840b0c90 2021-01-03T13:07:10.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.844+0000 7f1689f47700 1 -- 172.21.15.133:0/1615225066 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f168405ce00 con 0x7f16840b0c90 2021-01-03T13:07:10.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.844+0000 7f1681ffb700 1 -- 172.21.15.133:0/1615225066 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f1674047680 con 0x7f16840b0c90 2021-01-03T13:07:10.850 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:10.850 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":143,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:04.443265+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:07:01.122595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-01-03T13:07:02.419257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:07:10.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.844+0000 7f1689f47700 1 -- 172.21.15.133:0/1615225066 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1664055330 msgr2=0x7f16640577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:10.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.844+0000 7f1689f47700 1 --2- 172.21.15.133:0/1615225066 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1664055330 0x7f16640577f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f167801b000 tx=0x7f1678016000).stop 2021-01-03T13:07:10.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.844+0000 7f1689f47700 1 -- 172.21.15.133:0/1615225066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16840b0c90 msgr2=0x7f16840ac6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:10.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.844+0000 7f1689f47700 1 --2- 172.21.15.133:0/1615225066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16840b0c90 0x7f16840ac6d0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f1674000e90 tx=0x7f1674007a90).stop 2021-01-03T13:07:10.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.844+0000 7f1689f47700 1 -- 172.21.15.133:0/1615225066 shutdown_connections 2021-01-03T13:07:10.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.844+0000 7f1689f47700 1 --2- 172.21.15.133:0/1615225066 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1664055330 0x7f16640577f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:10.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.844+0000 7f1689f47700 1 --2- 172.21.15.133:0/1615225066 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f16840b5c00 0x7f16840aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:10.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.844+0000 7f1689f47700 1 --2- 172.21.15.133:0/1615225066 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16840b0c90 0x7f16840ac6d0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:10.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.844+0000 7f1689f47700 1 --2- 172.21.15.133:0/1615225066 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f16840b52c0 0x7f16840aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:10.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.844+0000 7f1689f47700 1 -- 172.21.15.133:0/1615225066 >> 172.21.15.133:0/1615225066 conn(0x7f168405bdf0 msgr2=0x7f16840b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:10.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.848+0000 7f1689f47700 1 -- 172.21.15.133:0/1615225066 shutdown_connections 2021-01-03T13:07:10.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.848+0000 7f1689f47700 1 -- 172.21.15.133:0/1615225066 wait complete. 2021-01-03T13:07:10.864 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:07:01.122595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:07:02.419257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:07:10.865 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:07:10.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.972+0000 7fc9f16ab700 1 Processor -- start 2021-01-03T13:07:10.979 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.972+0000 7fc9f16ab700 1 -- start start 2021-01-03T13:07:10.981 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9f16ab700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc9ec140410 0x7fc9ec146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:10.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9f16ab700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc9ec0b0470 0x7fc9ec05bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:10.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9f16ab700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ec05cf20 con 0x7fc9ec1407f0 2021-01-03T13:07:10.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9f16ab700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ec0b02d0 con 0x7fc9ec140410 2021-01-03T13:07:10.982 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9f16ab700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ec146390 con 0x7fc9ec0b0470 2021-01-03T13:07:10.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9eb7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc9ec0b0470 0x7fc9ec05bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:10.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9eb7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc9ec0b0470 0x7fc9ec05bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39554/0 (socket says 172.21.15.133:39554) 2021-01-03T13:07:10.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9eb7fe700 1 -- 172.21.15.133:0/2242902329 learned_addr learned my addr 172.21.15.133:0/2242902329 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:10.983 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9eaffd700 1 --2- 172.21.15.133:0/2242902329 >> v2:172.21.15.16:3300/0 conn(0x7fc9ec140410 0x7fc9ec146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:10.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9eb7fe700 1 -- 172.21.15.133:0/2242902329 >> v2:172.21.15.16:3300/0 conn(0x7fc9ec140410 msgr2=0x7fc9ec146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:10.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9eb7fe700 1 --2- 172.21.15.133:0/2242902329 >> v2:172.21.15.16:3300/0 conn(0x7fc9ec140410 0x7fc9ec146cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:10.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9eb7fe700 1 -- 172.21.15.133:0/2242902329 >> v1:172.21.15.16:6789/0 conn(0x7fc9ec1407f0 legacy=0x7fc9ec142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:10.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9eb7fe700 1 -- 172.21.15.133:0/2242902329 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec146580 con 0x7fc9ec0b0470 2021-01-03T13:07:10.984 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9eaffd700 1 --2- 172.21.15.133:0/2242902329 >> v2:172.21.15.16:3300/0 conn(0x7fc9ec140410 0x7fc9ec146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:10.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9eb7fe700 1 --2- 172.21.15.133:0/2242902329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9ec0b0470 0x7fc9ec05bdf0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fc9ec0ba120 tx=0x7fc9e4009270).ready entity=mon.1 client_cookie=48ebc03eb786def6 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:10.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9e9ffb700 1 -- 172.21.15.133:0/2242902329 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9e400bbc0 con 0x7fc9ec0b0470 2021-01-03T13:07:10.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9e9ffb700 1 -- 172.21.15.133:0/2242902329 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e400bd20 con 0x7fc9ec0b0470 2021-01-03T13:07:10.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9e9ffb700 1 -- 172.21.15.133:0/2242902329 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9e4011400 con 0x7fc9ec0b0470 2021-01-03T13:07:10.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9f16ab700 1 -- 172.21.15.133:0/2242902329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9ec0b0470 msgr2=0x7fc9ec05bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:10.986 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9f16ab700 1 --2- 172.21.15.133:0/2242902329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9ec0b0470 0x7fc9ec05bdf0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fc9ec0ba120 tx=0x7fc9e4009270).stop 2021-01-03T13:07:10.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9f16ab700 1 -- 172.21.15.133:0/2242902329 shutdown_connections 2021-01-03T13:07:10.988 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9f16ab700 1 --2- 172.21.15.133:0/2242902329 >> v2:172.21.15.16:3300/0 conn(0x7fc9ec140410 0x7fc9ec146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:10.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9f16ab700 1 --2- 172.21.15.133:0/2242902329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9ec0b0470 0x7fc9ec05bdf0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:10.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9f16ab700 1 -- 172.21.15.133:0/2242902329 >> 172.21.15.133:0/2242902329 conn(0x7fc9ec0b95d0 msgr2=0x7fc9ec0b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:10.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9f16ab700 1 -- 172.21.15.133:0/2242902329 shutdown_connections 2021-01-03T13:07:10.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.976+0000 7fc9f16ab700 1 -- 172.21.15.133:0/2242902329 wait complete. 2021-01-03T13:07:10.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9f16ab700 1 Processor -- start 2021-01-03T13:07:10.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9f16ab700 1 -- start start 2021-01-03T13:07:10.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9f16ab700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9ec0b0470 0x7fc9ec149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:10.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9f16ab700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ec140410 0x7fc9ec09dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:10.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9f16ab700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc9ec1407f0 0x7fc9ec13f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:10.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9f16ab700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec09f4f0 con 0x7fc9ec140410 2021-01-03T13:07:10.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9f16ab700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec09d890 con 0x7fc9ec0b0470 2021-01-03T13:07:10.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9f16ab700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec0b19f0 con 0x7fc9ec1407f0 2021-01-03T13:07:10.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9eaffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9ec0b0470 0x7fc9ec149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:10.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9eaffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9ec0b0470 0x7fc9ec149fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39556/0 (socket says 172.21.15.133:39556) 2021-01-03T13:07:10.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9eaffd700 1 -- 172.21.15.133:0/3102737575 learned_addr learned my addr 172.21.15.133:0/3102737575 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:10.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9ea7fc700 1 --2- 172.21.15.133:0/3102737575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ec140410 0x7fc9ec09dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:10.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9eb7fe700 1 --2- 172.21.15.133:0/3102737575 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc9ec1407f0 0x7fc9ec13f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:10.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9eaffd700 1 -- 172.21.15.133:0/3102737575 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc9ec1407f0 msgr2=0x7fc9ec13f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:10.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9eaffd700 1 --2- 172.21.15.133:0/3102737575 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc9ec1407f0 0x7fc9ec13f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:10.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9eaffd700 1 -- 172.21.15.133:0/3102737575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ec140410 msgr2=0x7fc9ec09dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:10.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9eaffd700 1 --2- 172.21.15.133:0/3102737575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ec140410 0x7fc9ec09dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:10.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.980+0000 7fc9eaffd700 1 -- 172.21.15.133:0/3102737575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec09e7b0 con 0x7fc9ec0b0470 2021-01-03T13:07:10.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.984+0000 7fc9eaffd700 1 --2- 172.21.15.133:0/3102737575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9ec0b0470 0x7fc9ec149fc0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7fc9dc007000 tx=0x7fc9dc008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:10.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.984+0000 7fc9e3fff700 1 -- 172.21.15.133:0/3102737575 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9dc010580 con 0x7fc9ec0b0470 2021-01-03T13:07:10.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.984+0000 7fc9e3fff700 1 -- 172.21.15.133:0/3102737575 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc0106e0 con 0x7fc9ec0b0470 2021-01-03T13:07:10.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.984+0000 7fc9e3fff700 1 -- 172.21.15.133:0/3102737575 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9dc010a40 con 0x7fc9ec0b0470 2021-01-03T13:07:10.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.984+0000 7fc9f16ab700 1 -- 172.21.15.133:0/3102737575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ec140c60 con 0x7fc9ec0b0470 2021-01-03T13:07:10.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.984+0000 7fc9f16ab700 1 -- 172.21.15.133:0/3102737575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ec141c00 con 0x7fc9ec0b0470 2021-01-03T13:07:10.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.984+0000 7fc9f16ab700 1 -- 172.21.15.133:0/3102737575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ec09e560 con 0x7fc9ec0b0470 2021-01-03T13:07:10.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.984+0000 7fc9e3fff700 1 -- 172.21.15.133:0/3102737575 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc9dc010ba0 con 0x7fc9ec0b0470 2021-01-03T13:07:10.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.984+0000 7fc9e3fff700 1 --2- 172.21.15.133:0/3102737575 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9d0055330 0x7fc9d00577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:10.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.988+0000 7fc9e3fff700 1 -- 172.21.15.133:0/3102737575 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc9dc06e010 con 0x7fc9ec0b0470 2021-01-03T13:07:10.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.988+0000 7fc9ea7fc700 1 --2- 172.21.15.133:0/3102737575 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9d0055330 0x7fc9d00577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:10.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.988+0000 7fc9ea7fc700 1 --2- 172.21.15.133:0/3102737575 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9d0055330 0x7fc9d00577f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fc9d400c000 tx=0x7fc9d4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:10.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:10.988+0000 7fc9e3fff700 1 -- 172.21.15.133:0/3102737575 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc9ec09e560 con 0x7fc9ec0b0470 2021-01-03T13:07:11.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.132+0000 7fc9f16ab700 1 -- 172.21.15.133:0/3102737575 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc9ec09e560 con 0x7fc9ec0b0470 2021-01-03T13:07:11.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.132+0000 7fc9e3fff700 1 -- 172.21.15.133:0/3102737575 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v143) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc9ec09e560 con 0x7fc9ec0b0470 2021-01-03T13:07:11.137 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:07:11.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.132+0000 7fc9f16ab700 1 -- 172.21.15.133:0/3102737575 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9d0055330 msgr2=0x7fc9d00577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.132+0000 7fc9f16ab700 1 --2- 172.21.15.133:0/3102737575 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9d0055330 0x7fc9d00577f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fc9d400c000 tx=0x7fc9d4008040).stop 2021-01-03T13:07:11.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.132+0000 7fc9f16ab700 1 -- 172.21.15.133:0/3102737575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9ec0b0470 msgr2=0x7fc9ec149fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.132+0000 7fc9f16ab700 1 --2- 172.21.15.133:0/3102737575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9ec0b0470 0x7fc9ec149fc0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7fc9dc007000 tx=0x7fc9dc008040).stop 2021-01-03T13:07:11.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.132+0000 7fc9f16ab700 1 -- 172.21.15.133:0/3102737575 shutdown_connections 2021-01-03T13:07:11.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.132+0000 7fc9f16ab700 1 --2- 172.21.15.133:0/3102737575 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc9d0055330 0x7fc9d00577f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.132+0000 7fc9f16ab700 1 --2- 172.21.15.133:0/3102737575 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc9ec1407f0 0x7fc9ec13f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.132+0000 7fc9f16ab700 1 --2- 172.21.15.133:0/3102737575 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9ec0b0470 0x7fc9ec149fc0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.132+0000 7fc9f16ab700 1 --2- 172.21.15.133:0/3102737575 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9ec140410 0x7fc9ec09dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.132+0000 7fc9f16ab700 1 -- 172.21.15.133:0/3102737575 >> 172.21.15.133:0/3102737575 conn(0x7fc9ec0b95d0 msgr2=0x7fc9ec1441c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:11.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.132+0000 7fc9f16ab700 1 -- 172.21.15.133:0/3102737575 shutdown_connections 2021-01-03T13:07:11.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.132+0000 7fc9f16ab700 1 -- 172.21.15.133:0/3102737575 wait complete. 2021-01-03T13:07:11.156 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:07:11.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.264+0000 7fea22c5d700 1 Processor -- start 2021-01-03T13:07:11.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.264+0000 7fea22c5d700 1 -- start start 2021-01-03T13:07:11.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea22c5d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fea1c0b4c20 0x7fea1c05c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea22c5d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fea1c060510 0x7fea1c0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea22c5d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c0b6cf0 con 0x7fea1c05fd10 2021-01-03T13:07:11.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea22c5d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c05bf00 con 0x7fea1c060510 2021-01-03T13:07:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea22c5d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c05c1a0 con 0x7fea1c0b4c20 2021-01-03T13:07:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea21c5b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fea1c0b4c20 0x7fea1c05c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea21c5b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fea1c0b4c20 0x7fea1c05c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39564/0 (socket says 172.21.15.133:39564) 2021-01-03T13:07:11.274 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea21c5b700 1 -- 172.21.15.133:0/1635228834 learned_addr learned my addr 172.21.15.133:0/1635228834 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:11.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea2145a700 1 --2- 172.21.15.133:0/1635228834 >> v2:172.21.15.16:3300/0 conn(0x7fea1c060510 0x7fea1c0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea21c5b700 1 -- 172.21.15.133:0/1635228834 >> v2:172.21.15.16:3300/0 conn(0x7fea1c060510 msgr2=0x7fea1c0b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:11.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea21c5b700 1 --2- 172.21.15.133:0/1635228834 >> v2:172.21.15.16:3300/0 conn(0x7fea1c060510 0x7fea1c0b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea21c5b700 1 -- 172.21.15.133:0/1635228834 >> v1:172.21.15.16:6789/0 conn(0x7fea1c05fd10 legacy=0x7fea1c0b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.275 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea21c5b700 1 -- 172.21.15.133:0/1635228834 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c05c440 con 0x7fea1c0b4c20 2021-01-03T13:07:11.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea2145a700 1 --2- 172.21.15.133:0/1635228834 >> v2:172.21.15.16:3300/0 conn(0x7fea1c060510 0x7fea1c0b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:11.276 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea21c5b700 1 --2- 172.21.15.133:0/1635228834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0b4c20 0x7fea1c05c8e0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7fea18002f30 tx=0x7fea18006e80).ready entity=mon.1 client_cookie=ea7d512be8c6bd62 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea20c59700 1 -- 172.21.15.133:0/1635228834 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea180097f0 con 0x7fea1c0b4c20 2021-01-03T13:07:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea20c59700 1 -- 172.21.15.133:0/1635228834 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea18009950 con 0x7fea1c0b4c20 2021-01-03T13:07:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea20c59700 1 -- 172.21.15.133:0/1635228834 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea18009cb0 con 0x7fea1c0b4c20 2021-01-03T13:07:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea22c5d700 1 -- 172.21.15.133:0/1635228834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0b4c20 msgr2=0x7fea1c05c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.268+0000 7fea22c5d700 1 --2- 172.21.15.133:0/1635228834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0b4c20 0x7fea1c05c8e0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7fea18002f30 tx=0x7fea18006e80).stop 2021-01-03T13:07:11.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea22c5d700 1 -- 172.21.15.133:0/1635228834 shutdown_connections 2021-01-03T13:07:11.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea22c5d700 1 --2- 172.21.15.133:0/1635228834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c0b4c20 0x7fea1c05c8e0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea22c5d700 1 --2- 172.21.15.133:0/1635228834 >> v2:172.21.15.16:3300/0 conn(0x7fea1c060510 0x7fea1c0b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea22c5d700 1 -- 172.21.15.133:0/1635228834 >> 172.21.15.133:0/1635228834 conn(0x7fea1c0b9f00 msgr2=0x7fea1c0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea22c5d700 1 -- 172.21.15.133:0/1635228834 shutdown_connections 2021-01-03T13:07:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea22c5d700 1 -- 172.21.15.133:0/1635228834 wait complete. 2021-01-03T13:07:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea22c5d700 1 Processor -- start 2021-01-03T13:07:11.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea22c5d700 1 -- start start 2021-01-03T13:07:11.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea22c5d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea1c05fd10 0x7fea1c09e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea22c5d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c060510 0x7fea1c155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea22c5d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea1c0b4c20 0x7fea1c13a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea22c5d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c155e10 con 0x7fea1c0b4c20 2021-01-03T13:07:11.285 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea22c5d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c1431f0 con 0x7fea1c060510 2021-01-03T13:07:11.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea22c5d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c143490 con 0x7fea1c05fd10 2021-01-03T13:07:11.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea2145a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c060510 0x7fea1c155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea21c5b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea1c05fd10 0x7fea1c09e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea2145a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c060510 0x7fea1c155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39572/0 (socket says 172.21.15.133:39572) 2021-01-03T13:07:11.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea21c5b700 1 --2- 172.21.15.133:0/3624826242 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea1c05fd10 0x7fea1c09e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:47872/0 (socket says 172.21.15.133:47872) 2021-01-03T13:07:11.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea2145a700 1 -- 172.21.15.133:0/3624826242 learned_addr learned my addr 172.21.15.133:0/3624826242 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:11.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.272+0000 7fea2245c700 1 --2- 172.21.15.133:0/3624826242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea1c0b4c20 0x7fea1c13a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.276+0000 7fea2145a700 1 -- 172.21.15.133:0/3624826242 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea1c05fd10 msgr2=0x7fea1c09e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.276+0000 7fea2145a700 1 --2- 172.21.15.133:0/3624826242 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea1c05fd10 0x7fea1c09e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.276+0000 7fea2145a700 1 -- 172.21.15.133:0/3624826242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea1c0b4c20 msgr2=0x7fea1c13a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.276+0000 7fea2145a700 1 --2- 172.21.15.133:0/3624826242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea1c0b4c20 0x7fea1c13a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.276+0000 7fea2145a700 1 -- 172.21.15.133:0/3624826242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c143730 con 0x7fea1c060510 2021-01-03T13:07:11.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.276+0000 7fea2245c700 1 --2- 172.21.15.133:0/3624826242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea1c0b4c20 0x7fea1c13a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:11.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.276+0000 7fea2145a700 1 --2- 172.21.15.133:0/3624826242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c060510 0x7fea1c155920 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7fea0c00a000 tx=0x7fea0c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:11.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.276+0000 7fea12ffd700 1 -- 172.21.15.133:0/3624826242 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea0c009790 con 0x7fea1c060510 2021-01-03T13:07:11.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.276+0000 7fea12ffd700 1 -- 172.21.15.133:0/3624826242 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c0098f0 con 0x7fea1c060510 2021-01-03T13:07:11.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.276+0000 7fea22c5d700 1 -- 172.21.15.133:0/3624826242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c1439d0 con 0x7fea1c060510 2021-01-03T13:07:11.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.276+0000 7fea12ffd700 1 -- 172.21.15.133:0/3624826242 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea0c009c50 con 0x7fea1c060510 2021-01-03T13:07:11.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.276+0000 7fea22c5d700 1 -- 172.21.15.133:0/3624826242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1c0b3f20 con 0x7fea1c060510 2021-01-03T13:07:11.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.276+0000 7fea12ffd700 1 -- 172.21.15.133:0/3624826242 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fea0c013480 con 0x7fea1c060510 2021-01-03T13:07:11.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.276+0000 7fea22c5d700 1 -- 172.21.15.133:0/3624826242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1c057300 con 0x7fea1c060510 2021-01-03T13:07:11.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.276+0000 7fea12ffd700 1 --2- 172.21.15.133:0/3624826242 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea040553f0 0x7fea040578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.276+0000 7fea21c5b700 1 --2- 172.21.15.133:0/3624826242 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea040553f0 0x7fea040578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.276+0000 7fea12ffd700 1 -- 172.21.15.133:0/3624826242 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fea0c06e590 con 0x7fea1c060510 2021-01-03T13:07:11.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.280+0000 7fea21c5b700 1 --2- 172.21.15.133:0/3624826242 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea040553f0 0x7fea040578b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fea1801c000 tx=0x7fea18015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:11.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.284+0000 7fea12ffd700 1 -- 172.21.15.133:0/3624826242 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fea0c044830 con 0x7fea1c060510 2021-01-03T13:07:11.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.424+0000 7fea22c5d700 1 -- 172.21.15.133:0/3624826242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fea1c067a00 con 0x7fea1c060510 2021-01-03T13:07:11.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.428+0000 7fea12ffd700 1 -- 172.21.15.133:0/3624826242 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v143) v1 ==== 92+0+10 (secure 0 0 0) 0x7fea0c009db0 con 0x7fea1c060510 2021-01-03T13:07:11.433 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:11.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.428+0000 7fea22c5d700 1 -- 172.21.15.133:0/3624826242 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea040553f0 msgr2=0x7fea040578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.428+0000 7fea22c5d700 1 --2- 172.21.15.133:0/3624826242 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea040553f0 0x7fea040578b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fea1801c000 tx=0x7fea18015000).stop 2021-01-03T13:07:11.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.428+0000 7fea22c5d700 1 -- 172.21.15.133:0/3624826242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c060510 msgr2=0x7fea1c155920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.428+0000 7fea22c5d700 1 --2- 172.21.15.133:0/3624826242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c060510 0x7fea1c155920 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7fea0c00a000 tx=0x7fea0c008040).stop 2021-01-03T13:07:11.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.428+0000 7fea22c5d700 1 -- 172.21.15.133:0/3624826242 shutdown_connections 2021-01-03T13:07:11.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.428+0000 7fea22c5d700 1 --2- 172.21.15.133:0/3624826242 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fea040553f0 0x7fea040578b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.428+0000 7fea22c5d700 1 --2- 172.21.15.133:0/3624826242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea1c0b4c20 0x7fea1c13a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.428+0000 7fea22c5d700 1 --2- 172.21.15.133:0/3624826242 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fea1c05fd10 0x7fea1c09e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.428+0000 7fea22c5d700 1 --2- 172.21.15.133:0/3624826242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea1c060510 0x7fea1c155920 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.428+0000 7fea22c5d700 1 -- 172.21.15.133:0/3624826242 >> 172.21.15.133:0/3624826242 conn(0x7fea1c0b9f00 msgr2=0x7fea1c09c690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:11.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.428+0000 7fea22c5d700 1 -- 172.21.15.133:0/3624826242 shutdown_connections 2021-01-03T13:07:11.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.428+0000 7fea22c5d700 1 -- 172.21.15.133:0/3624826242 wait complete. 2021-01-03T13:07:11.452 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:07:11.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.564+0000 7f2dbb59e700 1 Processor -- start 2021-01-03T13:07:11.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.564+0000 7f2dbb59e700 1 -- start start 2021-01-03T13:07:11.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.564+0000 7f2dbb59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2dbc05c130 0x7f2dbc0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.564+0000 7f2dbb59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dbc0622f0 0x7f2dbc0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.564+0000 7f2dbb59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dbc05c510 con 0x7f2dbc0b02b0 2021-01-03T13:07:11.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.564+0000 7f2dbb59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dbc1473d0 con 0x7f2dbc05c130 2021-01-03T13:07:11.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.564+0000 7f2dbb59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc0b0ab0 con 0x7f2dbc0622f0 2021-01-03T13:07:11.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2dba59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2dbc05c130 0x7f2dbc0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2db9d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2dbc0b02b0 0x7f2dbc0668a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60610/0 (socket says 172.21.15.133:60610) 2021-01-03T13:07:11.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2db9d9b700 1 -- 172.21.15.133:0/1365131340 learned_addr learned my addr 172.21.15.133:0/1365131340 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:11.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2dbad9d700 1 --2- 172.21.15.133:0/1365131340 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dbc0622f0 0x7f2dbc0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2db959a700 1 -- 172.21.15.133:0/1365131340 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234698907 0 0) 0x7f2dbc05c510 con 0x7f2dbc0b02b0 2021-01-03T13:07:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2db959a700 1 -- 172.21.15.133:0/1365131340 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d9c003230 con 0x7f2dbc0b02b0 2021-01-03T13:07:11.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2dba59c700 1 -- 172.21.15.133:0/1365131340 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dbc0622f0 msgr2=0x7f2dbc0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2dba59c700 1 --2- 172.21.15.133:0/1365131340 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dbc0622f0 0x7f2dbc0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2dba59c700 1 -- 172.21.15.133:0/1365131340 >> v1:172.21.15.133:6789/0 conn(0x7f2dbc0b02b0 legacy=0x7f2dbc0668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2dba59c700 1 -- 172.21.15.133:0/1365131340 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dbc0b15a0 con 0x7f2dbc05c130 2021-01-03T13:07:11.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2dba59c700 1 --2- 172.21.15.133:0/1365131340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dbc05c130 0x7f2dbc0b1a00 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f2dac002f30 tx=0x7f2dac006dc0).ready entity=mon.1 client_cookie=9ca1c65d8f47dd62 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:11.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2db959a700 1 -- 172.21.15.133:0/1365131340 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dac0096a0 con 0x7f2dbc05c130 2021-01-03T13:07:11.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2db959a700 1 -- 172.21.15.133:0/1365131340 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac009800 con 0x7f2dbc05c130 2021-01-03T13:07:11.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2db959a700 1 -- 172.21.15.133:0/1365131340 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dac009ba0 con 0x7f2dbc05c130 2021-01-03T13:07:11.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2dbb59e700 1 -- 172.21.15.133:0/1365131340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dbc05c130 msgr2=0x7f2dbc0b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2dbb59e700 1 --2- 172.21.15.133:0/1365131340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dbc05c130 0x7f2dbc0b1a00 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f2dac002f30 tx=0x7f2dac006dc0).stop 2021-01-03T13:07:11.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2dbb59e700 1 -- 172.21.15.133:0/1365131340 shutdown_connections 2021-01-03T13:07:11.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2dbb59e700 1 --2- 172.21.15.133:0/1365131340 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dbc05c130 0x7f2dbc0b1a00 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2dbb59e700 1 --2- 172.21.15.133:0/1365131340 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dbc0622f0 0x7f2dbc0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2dbb59e700 1 -- 172.21.15.133:0/1365131340 >> 172.21.15.133:0/1365131340 conn(0x7f2dbc0b6110 msgr2=0x7f2dbc0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:11.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2dbb59e700 1 -- 172.21.15.133:0/1365131340 shutdown_connections 2021-01-03T13:07:11.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2dbb59e700 1 -- 172.21.15.133:0/1365131340 wait complete. 2021-01-03T13:07:11.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2dbb59e700 1 Processor -- start 2021-01-03T13:07:11.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.568+0000 7f2dbb59e700 1 -- start start 2021-01-03T13:07:11.581 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dbb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dbc05c130 0x7f2dbc145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dbb59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dbc0622f0 0x7f2dbc13e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dbb59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dbc0b02b0 0x7f2dbc13e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dbb59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc156120 con 0x7f2dbc0b02b0 2021-01-03T13:07:11.582 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dbb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc0651d0 con 0x7f2dbc05c130 2021-01-03T13:07:11.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dbb59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc065470 con 0x7f2dbc0622f0 2021-01-03T13:07:11.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dba59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dbc05c130 0x7f2dbc145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dba59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dbc05c130 0x7f2dbc145760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39584/0 (socket says 172.21.15.133:39584) 2021-01-03T13:07:11.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dba59c700 1 -- 172.21.15.133:0/3195513240 learned_addr learned my addr 172.21.15.133:0/3195513240 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:11.583 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dbad9d700 1 --2- 172.21.15.133:0/3195513240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dbc0b02b0 0x7f2dbc13e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2db9d9b700 1 --2- 172.21.15.133:0/3195513240 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dbc0622f0 0x7f2dbc13e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dba59c700 1 -- 172.21.15.133:0/3195513240 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dbc0622f0 msgr2=0x7f2dbc13e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dba59c700 1 --2- 172.21.15.133:0/3195513240 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dbc0622f0 0x7f2dbc13e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dba59c700 1 -- 172.21.15.133:0/3195513240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dbc0b02b0 msgr2=0x7f2dbc13e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dba59c700 1 --2- 172.21.15.133:0/3195513240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dbc0b02b0 0x7f2dbc13e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dba59c700 1 -- 172.21.15.133:0/3195513240 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dbc065710 con 0x7f2dbc05c130 2021-01-03T13:07:11.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dba59c700 1 --2- 172.21.15.133:0/3195513240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dbc05c130 0x7f2dbc145760 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f2dac002f30 tx=0x7f2dac015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:11.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2db37fe700 1 -- 172.21.15.133:0/3195513240 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dac011b60 con 0x7f2dbc05c130 2021-01-03T13:07:11.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2db37fe700 1 -- 172.21.15.133:0/3195513240 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac011cc0 con 0x7f2dbc05c130 2021-01-03T13:07:11.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dbb59e700 1 -- 172.21.15.133:0/3195513240 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dbc145d90 con 0x7f2dbc05c130 2021-01-03T13:07:11.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dbb59e700 1 -- 172.21.15.133:0/3195513240 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dbc155c80 con 0x7f2dbc05c130 2021-01-03T13:07:11.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2db37fe700 1 -- 172.21.15.133:0/3195513240 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dac01d640 con 0x7f2dbc05c130 2021-01-03T13:07:11.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.572+0000 7f2dbb59e700 1 -- 172.21.15.133:0/3195513240 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dbc064ce0 con 0x7f2dbc05c130 2021-01-03T13:07:11.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.576+0000 7f2db37fe700 1 -- 172.21.15.133:0/3195513240 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2dac024030 con 0x7f2dbc05c130 2021-01-03T13:07:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.576+0000 7f2db37fe700 1 --2- 172.21.15.133:0/3195513240 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2da00553b0 0x7f2da0057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.576+0000 7f2db37fe700 1 -- 172.21.15.133:0/3195513240 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2dac06f000 con 0x7f2dbc05c130 2021-01-03T13:07:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.576+0000 7f2db9d9b700 1 --2- 172.21.15.133:0/3195513240 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2da00553b0 0x7f2da0057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.576+0000 7f2db9d9b700 1 --2- 172.21.15.133:0/3195513240 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2da00553b0 0x7f2da0057870 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f2da400d000 tx=0x7f2da4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:11.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.584+0000 7f2db37fe700 1 -- 172.21.15.133:0/3195513240 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2dbc064ce0 con 0x7f2dbc05c130 2021-01-03T13:07:11.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.724+0000 7f2dbb59e700 1 -- 172.21.15.133:0/3195513240 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2dbc064ce0 con 0x7f2dbc05c130 2021-01-03T13:07:11.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.728+0000 7f2db37fe700 1 -- 172.21.15.133:0/3195513240 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v143) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2dbc064ce0 con 0x7f2dbc05c130 2021-01-03T13:07:11.733 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:11.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.728+0000 7f2dbb59e700 1 -- 172.21.15.133:0/3195513240 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2da00553b0 msgr2=0x7f2da0057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.728+0000 7f2dbb59e700 1 --2- 172.21.15.133:0/3195513240 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2da00553b0 0x7f2da0057870 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f2da400d000 tx=0x7f2da4009040).stop 2021-01-03T13:07:11.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.728+0000 7f2dbb59e700 1 -- 172.21.15.133:0/3195513240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dbc05c130 msgr2=0x7f2dbc145760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.728+0000 7f2dbb59e700 1 --2- 172.21.15.133:0/3195513240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dbc05c130 0x7f2dbc145760 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f2dac002f30 tx=0x7f2dac015000).stop 2021-01-03T13:07:11.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.728+0000 7f2dbb59e700 1 -- 172.21.15.133:0/3195513240 shutdown_connections 2021-01-03T13:07:11.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.728+0000 7f2dbb59e700 1 --2- 172.21.15.133:0/3195513240 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2da00553b0 0x7f2da0057870 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.728+0000 7f2dbb59e700 1 --2- 172.21.15.133:0/3195513240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2dbc0b02b0 0x7f2dbc13e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.728+0000 7f2dbb59e700 1 --2- 172.21.15.133:0/3195513240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dbc05c130 0x7f2dbc145760 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.728+0000 7f2dbb59e700 1 --2- 172.21.15.133:0/3195513240 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2dbc0622f0 0x7f2dbc13e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.728+0000 7f2dbb59e700 1 -- 172.21.15.133:0/3195513240 >> 172.21.15.133:0/3195513240 conn(0x7f2dbc0b6110 msgr2=0x7f2dbc0b5880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:11.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.728+0000 7f2dbb59e700 1 -- 172.21.15.133:0/3195513240 shutdown_connections 2021-01-03T13:07:11.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.728+0000 7f2dbb59e700 1 -- 172.21.15.133:0/3195513240 wait complete. 2021-01-03T13:07:11.746 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:07:11.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe585600700 1 Processor -- start 2021-01-03T13:07:11.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe585600700 1 -- start start 2021-01-03T13:07:11.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe585600700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe5801449b0 0x7fe5801477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe585600700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5800b0c10 con 0x7fe5800b5260 2021-01-03T13:07:11.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe585600700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5800b5640 con 0x7fe5800b5c00 2021-01-03T13:07:11.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe585600700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe580144e00 con 0x7fe5801449b0 2021-01-03T13:07:11.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57f7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe5800b5c00 0x7fe5801442a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60626/0 (socket says 172.21.15.133:60626) 2021-01-03T13:07:11.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57f7fe700 1 -- 172.21.15.133:0/76703304 learned_addr learned my addr 172.21.15.133:0/76703304 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:11.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe584dff700 1 --2- 172.21.15.133:0/76703304 >> v2:172.21.15.16:3300/0 conn(0x7fe5801449b0 0x7fe5801477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57effd700 1 -- 172.21.15.133:0/76703304 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682659105 0 0) 0x7fe5800b5640 con 0x7fe5800b5c00 2021-01-03T13:07:11.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57effd700 1 -- 172.21.15.133:0/76703304 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe56c003230 con 0x7fe5800b5c00 2021-01-03T13:07:11.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57effd700 1 -- 172.21.15.133:0/76703304 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1071452072 0 0) 0x7fe56c003230 con 0x7fe5800b5c00 2021-01-03T13:07:11.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57effd700 1 -- 172.21.15.133:0/76703304 >> v2:172.21.15.16:3300/0 conn(0x7fe5801449b0 msgr2=0x7fe5801477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:11.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57effd700 1 --2- 172.21.15.133:0/76703304 >> v2:172.21.15.16:3300/0 conn(0x7fe5801449b0 0x7fe5801477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57effd700 1 -- 172.21.15.133:0/76703304 >> v1:172.21.15.16:6789/0 conn(0x7fe5800b5260 legacy=0x7fe5801470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57effd700 1 -- 172.21.15.133:0/76703304 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58009a4f0 con 0x7fe5800b5c00 2021-01-03T13:07:11.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe584dff700 1 --2- 172.21.15.133:0/76703304 >> v2:172.21.15.16:3300/0 conn(0x7fe5801449b0 0x7fe5801477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:11.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57effd700 1 -- 172.21.15.133:0/76703304 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fe574001710 con 0x7fe5800b5c00 2021-01-03T13:07:11.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57effd700 1 -- 172.21.15.133:0/76703304 >> v1:172.21.15.133:6789/0 conn(0x7fe5800b5c00 legacy=0x7fe5801442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57effd700 1 --2- 172.21.15.133:0/76703304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe56c003720 0x7fe56c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57effd700 1 --2- 172.21.15.133:0/76703304 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe56c0044d0 0x7fe56c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57effd700 1 --2- 172.21.15.133:0/76703304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe56c004e40 0x7fe56c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57effd700 1 -- 172.21.15.133:0/76703304 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c004250 con 0x7fe56c004e40 2021-01-03T13:07:11.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57effd700 1 -- 172.21.15.133:0/76703304 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c00bc10 con 0x7fe56c003720 2021-01-03T13:07:11.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57effd700 1 -- 172.21.15.133:0/76703304 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c00bd50 con 0x7fe56c0044d0 2021-01-03T13:07:11.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57ffff700 1 --2- 172.21.15.133:0/76703304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe56c003720 0x7fe56c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe584dff700 1 --2- 172.21.15.133:0/76703304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe56c004e40 0x7fe56c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57f7fe700 1 --2- 172.21.15.133:0/76703304 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe56c0044d0 0x7fe56c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57ffff700 1 -- 172.21.15.133:0/76703304 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe56c0044d0 msgr2=0x7fe56c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:11.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57ffff700 1 --2- 172.21.15.133:0/76703304 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe56c0044d0 0x7fe56c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57ffff700 1 -- 172.21.15.133:0/76703304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe56c004e40 msgr2=0x7fe56c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:11.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57ffff700 1 --2- 172.21.15.133:0/76703304 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe56c004e40 0x7fe56c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe584dff700 1 -- 172.21.15.133:0/76703304 reap_dead start 2021-01-03T13:07:11.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57ffff700 1 -- 172.21.15.133:0/76703304 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c003230 con 0x7fe56c003720 2021-01-03T13:07:11.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57f7fe700 1 --2- 172.21.15.133:0/76703304 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe56c0044d0 0x7fe56c004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:11.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.856+0000 7fe57ffff700 1 --2- 172.21.15.133:0/76703304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe56c003720 0x7fe56c003b40 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7fe580062160 tx=0x7fe570007b60).ready entity=mon.1 client_cookie=dedef4b203ad468d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:11.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe57effd700 1 -- 172.21.15.133:0/76703304 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe57000c660 con 0x7fe56c003720 2021-01-03T13:07:11.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe57effd700 1 -- 172.21.15.133:0/76703304 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57000c7c0 con 0x7fe56c003720 2021-01-03T13:07:11.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe57effd700 1 -- 172.21.15.133:0/76703304 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe57000cb20 con 0x7fe56c003720 2021-01-03T13:07:11.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe585600700 1 -- 172.21.15.133:0/76703304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe56c003720 msgr2=0x7fe56c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe585600700 1 --2- 172.21.15.133:0/76703304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe56c003720 0x7fe56c003b40 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7fe580062160 tx=0x7fe570007b60).stop 2021-01-03T13:07:11.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe585600700 1 -- 172.21.15.133:0/76703304 shutdown_connections 2021-01-03T13:07:11.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe585600700 1 --2- 172.21.15.133:0/76703304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe56c003720 0x7fe56c003b40 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe585600700 1 -- 172.21.15.133:0/76703304 >> 172.21.15.133:0/76703304 conn(0x7fe58005bdf0 msgr2=0x7fe58005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:11.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe585600700 1 -- 172.21.15.133:0/76703304 shutdown_connections 2021-01-03T13:07:11.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe585600700 1 -- 172.21.15.133:0/76703304 wait complete. 2021-01-03T13:07:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe585600700 1 Processor -- start 2021-01-03T13:07:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe585600700 1 -- start start 2021-01-03T13:07:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe585600700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe56c003720 0x7fe5800aa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe585600700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5800669e0 0x7fe580145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe585600700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580145b80 0x7fe58014d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe585600700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe580067570 con 0x7fe56c003720 2021-01-03T13:07:11.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe585600700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5801484b0 con 0x7fe580145b80 2021-01-03T13:07:11.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe585600700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe580146010 con 0x7fe5800669e0 2021-01-03T13:07:11.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe584dff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580145b80 0x7fe58014d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe584dff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580145b80 0x7fe58014d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39608/0 (socket says 172.21.15.133:39608) 2021-01-03T13:07:11.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe584dff700 1 -- 172.21.15.133:0/378580673 learned_addr learned my addr 172.21.15.133:0/378580673 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:11.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe57ffff700 1 --2- 172.21.15.133:0/378580673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe56c003720 0x7fe5800aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.860+0000 7fe57f7fe700 1 --2- 172.21.15.133:0/378580673 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5800669e0 0x7fe580145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.864+0000 7fe584dff700 1 -- 172.21.15.133:0/378580673 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5800669e0 msgr2=0x7fe580145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.864+0000 7fe584dff700 1 --2- 172.21.15.133:0/378580673 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5800669e0 0x7fe580145690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.864+0000 7fe584dff700 1 -- 172.21.15.133:0/378580673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe56c003720 msgr2=0x7fe5800aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:11.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.864+0000 7fe584dff700 1 --2- 172.21.15.133:0/378580673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe56c003720 0x7fe5800aa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:11.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.864+0000 7fe584dff700 1 -- 172.21.15.133:0/378580673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe580146300 con 0x7fe580145b80 2021-01-03T13:07:11.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.864+0000 7fe584dff700 1 --2- 172.21.15.133:0/378580673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580145b80 0x7fe58014d900 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7fe57800b000 tx=0x7fe578008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:11.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.864+0000 7fe57d7fa700 1 -- 172.21.15.133:0/378580673 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe57800ec30 con 0x7fe580145b80 2021-01-03T13:07:11.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.864+0000 7fe57d7fa700 1 -- 172.21.15.133:0/378580673 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57800ed90 con 0x7fe580145b80 2021-01-03T13:07:11.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.864+0000 7fe585600700 1 -- 172.21.15.133:0/378580673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5800672d0 con 0x7fe580145b80 2021-01-03T13:07:11.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.864+0000 7fe57d7fa700 1 -- 172.21.15.133:0/378580673 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe578014620 con 0x7fe580145b80 2021-01-03T13:07:11.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.864+0000 7fe585600700 1 -- 172.21.15.133:0/378580673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5801592e0 con 0x7fe580145b80 2021-01-03T13:07:11.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.864+0000 7fe585600700 1 -- 172.21.15.133:0/378580673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe580057300 con 0x7fe580145b80 2021-01-03T13:07:11.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.864+0000 7fe57d7fa700 1 -- 172.21.15.133:0/378580673 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe578014780 con 0x7fe580145b80 2021-01-03T13:07:11.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.864+0000 7fe57d7fa700 1 --2- 172.21.15.133:0/378580673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5600553b0 0x7fe560057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:11.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.864+0000 7fe57d7fa700 1 -- 172.21.15.133:0/378580673 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe57806ea50 con 0x7fe580145b80 2021-01-03T13:07:11.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.864+0000 7fe57ffff700 1 --2- 172.21.15.133:0/378580673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5600553b0 0x7fe560057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:11.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.864+0000 7fe57ffff700 1 --2- 172.21.15.133:0/378580673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5600553b0 0x7fe560057870 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fe57001b000 tx=0x7fe570017000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:11.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:11.872+0000 7fe57d7fa700 1 -- 172.21.15.133:0/378580673 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe578044d50 con 0x7fe580145b80 2021-01-03T13:07:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.012+0000 7fe585600700 1 -- 172.21.15.133:0/378580673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe580146490 con 0x7fe580145b80 2021-01-03T13:07:12.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.012+0000 7fe57d7fa700 1 -- 172.21.15.133:0/378580673 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v143) v1 ==== 100+0+10 (secure 0 0 0) 0x7fe578048370 con 0x7fe580145b80 2021-01-03T13:07:12.019 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:12.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.016+0000 7fe585600700 1 -- 172.21.15.133:0/378580673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5600553b0 msgr2=0x7fe560057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:12.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.016+0000 7fe585600700 1 --2- 172.21.15.133:0/378580673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5600553b0 0x7fe560057870 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fe57001b000 tx=0x7fe570017000).stop 2021-01-03T13:07:12.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.016+0000 7fe585600700 1 -- 172.21.15.133:0/378580673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580145b80 msgr2=0x7fe58014d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:12.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.016+0000 7fe585600700 1 --2- 172.21.15.133:0/378580673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580145b80 0x7fe58014d900 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7fe57800b000 tx=0x7fe578008040).stop 2021-01-03T13:07:12.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.016+0000 7fe585600700 1 -- 172.21.15.133:0/378580673 shutdown_connections 2021-01-03T13:07:12.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.016+0000 7fe585600700 1 --2- 172.21.15.133:0/378580673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe5600553b0 0x7fe560057870 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:12.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.016+0000 7fe585600700 1 --2- 172.21.15.133:0/378580673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe56c003720 0x7fe5800aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:12.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.016+0000 7fe585600700 1 --2- 172.21.15.133:0/378580673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe580145b80 0x7fe58014d900 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:12.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.016+0000 7fe585600700 1 --2- 172.21.15.133:0/378580673 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe5800669e0 0x7fe580145690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:12.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.016+0000 7fe585600700 1 -- 172.21.15.133:0/378580673 >> 172.21.15.133:0/378580673 conn(0x7fe58005bdf0 msgr2=0x7fe5800602b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:12.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.016+0000 7fe585600700 1 -- 172.21.15.133:0/378580673 shutdown_connections 2021-01-03T13:07:12.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.016+0000 7fe585600700 1 -- 172.21.15.133:0/378580673 wait complete. 2021-01-03T13:07:12.032 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:07:12.033 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:07:12.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.136+0000 7fd1c359e700 1 Processor -- start 2021-01-03T13:07:12.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.136+0000 7fd1c359e700 1 -- start start 2021-01-03T13:07:12.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c359e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd1c4066f30 0x7fd1c40b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:12.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1c40b1590 0x7fd1c413ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:12.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c359e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c405fd00 con 0x7fd1c405f920 2021-01-03T13:07:12.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c359e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c40b2980 con 0x7fd1c4066f30 2021-01-03T13:07:12.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40ae700 con 0x7fd1c40b1590 2021-01-03T13:07:12.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c259c700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd1c405f920 0x7fd1c40b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:39372/0 (socket says 172.21.15.133:39372) 2021-01-03T13:07:12.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c259c700 1 -- 172.21.15.133:0/3742150153 learned_addr learned my addr 172.21.15.133:0/3742150153 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:12.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c2d9d700 1 --2- 172.21.15.133:0/3742150153 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1c40b1590 0x7fd1c413ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:12.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c1d9b700 1 --2- 172.21.15.133:0/3742150153 >> v2:172.21.15.16:3300/0 conn(0x7fd1c4066f30 0x7fd1c40b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:12.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c159a700 1 -- 172.21.15.133:0/3742150153 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367226941 0 0) 0x7fd1c405fd00 con 0x7fd1c405f920 2021-01-03T13:07:12.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c159a700 1 -- 172.21.15.133:0/3742150153 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a8003230 con 0x7fd1c405f920 2021-01-03T13:07:12.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c2d9d700 1 -- 172.21.15.133:0/3742150153 >> v2:172.21.15.16:3300/0 conn(0x7fd1c4066f30 msgr2=0x7fd1c40b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:12.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c2d9d700 1 --2- 172.21.15.133:0/3742150153 >> v2:172.21.15.16:3300/0 conn(0x7fd1c4066f30 0x7fd1c40b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:12.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c2d9d700 1 -- 172.21.15.133:0/3742150153 >> v1:172.21.15.16:6789/0 conn(0x7fd1c405f920 legacy=0x7fd1c40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:12.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c2d9d700 1 -- 172.21.15.133:0/3742150153 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c40accd0 con 0x7fd1c40b1590 2021-01-03T13:07:12.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c2d9d700 1 --2- 172.21.15.133:0/3742150153 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1c40b1590 0x7fd1c413ff80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fd1bc0032b0 tx=0x7fd1bc0091a0).ready entity=mon.2 client_cookie=684b9da9d78b02b8 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:12.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c159a700 1 -- 172.21.15.133:0/3742150153 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1bc00b940 con 0x7fd1c40b1590 2021-01-03T13:07:12.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c159a700 1 -- 172.21.15.133:0/3742150153 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc00baa0 con 0x7fd1c40b1590 2021-01-03T13:07:12.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c159a700 1 -- 172.21.15.133:0/3742150153 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1bc00bc10 con 0x7fd1c40b1590 2021-01-03T13:07:12.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c359e700 1 -- 172.21.15.133:0/3742150153 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1c40b1590 msgr2=0x7fd1c413ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:12.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.140+0000 7fd1c359e700 1 --2- 172.21.15.133:0/3742150153 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1c40b1590 0x7fd1c413ff80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fd1bc0032b0 tx=0x7fd1bc0091a0).stop 2021-01-03T13:07:12.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.144+0000 7fd1c359e700 1 -- 172.21.15.133:0/3742150153 shutdown_connections 2021-01-03T13:07:12.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.144+0000 7fd1c359e700 1 --2- 172.21.15.133:0/3742150153 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1c40b1590 0x7fd1c413ff80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:12.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.144+0000 7fd1c359e700 1 --2- 172.21.15.133:0/3742150153 >> v2:172.21.15.16:3300/0 conn(0x7fd1c4066f30 0x7fd1c40b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:12.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.144+0000 7fd1c359e700 1 -- 172.21.15.133:0/3742150153 >> 172.21.15.133:0/3742150153 conn(0x7fd1c40b6110 msgr2=0x7fd1c40b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:12.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.144+0000 7fd1c359e700 1 -- 172.21.15.133:0/3742150153 shutdown_connections 2021-01-03T13:07:12.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.144+0000 7fd1c359e700 1 -- 172.21.15.133:0/3742150153 wait complete. 2021-01-03T13:07:12.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.144+0000 7fd1c359e700 1 Processor -- start 2021-01-03T13:07:12.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.144+0000 7fd1c359e700 1 -- start start 2021-01-03T13:07:12.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1c405f920 0x7fd1c41468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:12.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c4066f30 0x7fd1c409e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:12.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1c40b1590 0x7fd1c409ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:12.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c359e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c4064d00 con 0x7fd1c40b1590 2021-01-03T13:07:12.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c4064fa0 con 0x7fd1c4066f30 2021-01-03T13:07:12.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c409f320 con 0x7fd1c405f920 2021-01-03T13:07:12.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c4066f30 0x7fd1c409e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:12.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c1d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c4066f30 0x7fd1c409e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39620/0 (socket says 172.21.15.133:39620) 2021-01-03T13:07:12.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c1d9b700 1 -- 172.21.15.133:0/3181031837 learned_addr learned my addr 172.21.15.133:0/3181031837 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:12.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c2d9d700 1 --2- 172.21.15.133:0/3181031837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1c40b1590 0x7fd1c409ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:12.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c259c700 1 --2- 172.21.15.133:0/3181031837 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1c405f920 0x7fd1c41468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:12.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c1d9b700 1 -- 172.21.15.133:0/3181031837 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1c405f920 msgr2=0x7fd1c41468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:12.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c1d9b700 1 --2- 172.21.15.133:0/3181031837 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1c405f920 0x7fd1c41468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:12.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c1d9b700 1 -- 172.21.15.133:0/3181031837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1c40b1590 msgr2=0x7fd1c409ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:12.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c1d9b700 1 --2- 172.21.15.133:0/3181031837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1c40b1590 0x7fd1c409ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:12.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c1d9b700 1 -- 172.21.15.133:0/3181031837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c4152e90 con 0x7fd1c4066f30 2021-01-03T13:07:12.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c2d9d700 1 --2- 172.21.15.133:0/3181031837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1c40b1590 0x7fd1c409ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:12.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c1d9b700 1 --2- 172.21.15.133:0/3181031837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c4066f30 0x7fd1c409e940 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7fd1b800c000 tx=0x7fd1b8006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:12.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1b37fe700 1 -- 172.21.15.133:0/3181031837 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1b800ca10 con 0x7fd1c4066f30 2021-01-03T13:07:12.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1b37fe700 1 -- 172.21.15.133:0/3181031837 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b800cb70 con 0x7fd1c4066f30 2021-01-03T13:07:12.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c359e700 1 -- 172.21.15.133:0/3181031837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c4147000 con 0x7fd1c4066f30 2021-01-03T13:07:12.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1b37fe700 1 -- 172.21.15.133:0/3181031837 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1b8013450 con 0x7fd1c4066f30 2021-01-03T13:07:12.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.148+0000 7fd1c359e700 1 -- 172.21.15.133:0/3181031837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c40659d0 con 0x7fd1c4066f30 2021-01-03T13:07:12.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.152+0000 7fd1c359e700 1 -- 172.21.15.133:0/3181031837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c4057300 con 0x7fd1c4066f30 2021-01-03T13:07:12.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.152+0000 7fd1b37fe700 1 -- 172.21.15.133:0/3181031837 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd1b801a030 con 0x7fd1c4066f30 2021-01-03T13:07:12.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.152+0000 7fd1b37fe700 1 --2- 172.21.15.133:0/3181031837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd1a0055470 0x7fd1a0057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:12.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.152+0000 7fd1b37fe700 1 -- 172.21.15.133:0/3181031837 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd1b806e530 con 0x7fd1c4066f30 2021-01-03T13:07:12.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.152+0000 7fd1c259c700 1 --2- 172.21.15.133:0/3181031837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd1a0055470 0x7fd1a0057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:12.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.152+0000 7fd1c259c700 1 --2- 172.21.15.133:0/3181031837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd1a0055470 0x7fd1a0057930 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fd1b400d000 tx=0x7fd1b4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:12.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.160+0000 7fd1b37fe700 1 -- 172.21.15.133:0/3181031837 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd1b80448e0 con 0x7fd1c4066f30 2021-01-03T13:07:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.340+0000 7fd1c359e700 1 -- 172.21.15.133:0/3181031837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1c4061020 con 0x7fd1c4066f30 2021-01-03T13:07:12.347 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.340+0000 7fd1b37fe700 1 -- 172.21.15.133:0/3181031837 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2498 (secure 0 0 0) 0x7fd1b8022070 con 0x7fd1c4066f30 2021-01-03T13:07:12.347 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:12.347 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":67,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6719,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/2510927889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2510927889},{"type":"v1","addr":"172.21.15.16:6833","nonce":2510927889}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":65},{"gid":6722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1243273461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1243273461},{"type":"v1","addr":"172.21.15.133:6837","nonce":1243273461}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:03.438043+0000","modified":"2021-01-03T13:07:04.442588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7792},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7792":{"gid":7792,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/679359254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":679359254},{"type":"v1","addr":"172.21.15.133:6835","nonce":679359254}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-01-03T13:07:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.344+0000 7fd1c359e700 1 -- 172.21.15.133:0/3181031837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd1a0055470 msgr2=0x7fd1a0057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.344+0000 7fd1c359e700 1 --2- 172.21.15.133:0/3181031837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd1a0055470 0x7fd1a0057930 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fd1b400d000 tx=0x7fd1b4009040).stop 2021-01-03T13:07:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.344+0000 7fd1c359e700 1 -- 172.21.15.133:0/3181031837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c4066f30 msgr2=0x7fd1c409e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.344+0000 7fd1c359e700 1 --2- 172.21.15.133:0/3181031837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c4066f30 0x7fd1c409e940 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7fd1b800c000 tx=0x7fd1b8006dc0).stop 2021-01-03T13:07:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.344+0000 7fd1c359e700 1 -- 172.21.15.133:0/3181031837 shutdown_connections 2021-01-03T13:07:12.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.344+0000 7fd1c359e700 1 --2- 172.21.15.133:0/3181031837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd1a0055470 0x7fd1a0057930 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:12.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.344+0000 7fd1c359e700 1 --2- 172.21.15.133:0/3181031837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1c40b1590 0x7fd1c409ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:12.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.344+0000 7fd1c359e700 1 --2- 172.21.15.133:0/3181031837 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd1c405f920 0x7fd1c41468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:12.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.344+0000 7fd1c359e700 1 --2- 172.21.15.133:0/3181031837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1c4066f30 0x7fd1c409e940 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.344+0000 7fd1c359e700 1 -- 172.21.15.133:0/3181031837 >> 172.21.15.133:0/3181031837 conn(0x7fd1c40b6110 msgr2=0x7fd1c4065d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.344+0000 7fd1c359e700 1 -- 172.21.15.133:0/3181031837 shutdown_connections 2021-01-03T13:07:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:12.344+0000 7fd1c359e700 1 -- 172.21.15.133:0/3181031837 wait complete. 2021-01-03T13:07:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 67 2021-01-03T13:07:12.670 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:07:03.438043+0000', 'modified': '2021-01-03T13:07:04.442588+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7792}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7792': {'gid': 7792, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6835/679359254', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 679359254}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 679359254}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:07:12.670 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:07:12.671 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-01-03T13:07:12.799 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":7792,"want_state":"up:active","state":"up:active","rank_uptime":9.3455977430000008,"mdsmap_epoch":67,"osdmap_epoch":143,"osdmap_epoch_barrier":142,"uptime":14.657909704} 2021-01-03T13:07:12.800 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 7792, "mdsmap_epoch": 67, "osdmap_epoch": 143, "osdmap_epoch_barrier": 142, "rank_uptime": 9.345597743, "state": "up:active", "uptime": 14.657909704, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:07:12.800 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:07:12.801 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-01-03T13:07:12.802 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi036.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-01-03T13:07:12.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:12.803 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:12.811 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:07:12.869 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:07:12.869 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:07:12.924 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:07:12.925 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:07:12.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:12.926 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:07:12.976 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:07:12.976 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:13.020 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:07:13.037 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:07:13.037 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:07:13.091 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:07:13.092 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:07:13.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:13.093 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:07:13.102 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:2021-01-03T13:07:13.102+0000 7f87834ef0c0 -1 init, newargv = 0x55c52d91b090 newargc=9ceph-fuse[12245]: starting ceph client 2021-01-03T13:07:13.103 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr: 2021-01-03T13:07:13.114 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[12245]: starting fuse 2021-01-03T13:07:14.210 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:07:14.226 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:07:14.227 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:07:14.288 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:07:14.289 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:07:14.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:14.291 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:07:14.335 INFO:teuthology.orchestra.run.smithi036.stdout:50 2021-01-03T13:07:14.336 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:07:14.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:14.337 DEBUG:teuthology.orchestra.run.smithi036:> sudo python3 -c ' 2021-01-03T13:07:14.337 DEBUG:teuthology.orchestra.run.smithi036:> import glob 2021-01-03T13:07:14.338 DEBUG:teuthology.orchestra.run.smithi036:> import re 2021-01-03T13:07:14.338 DEBUG:teuthology.orchestra.run.smithi036:> import os 2021-01-03T13:07:14.338 DEBUG:teuthology.orchestra.run.smithi036:> import subprocess 2021-01-03T13:07:14.339 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:07:14.339 DEBUG:teuthology.orchestra.run.smithi036:> def find_socket(client_name): 2021-01-03T13:07:14.340 DEBUG:teuthology.orchestra.run.smithi036:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-01-03T13:07:14.340 DEBUG:teuthology.orchestra.run.smithi036:> files = glob.glob(asok_path) 2021-01-03T13:07:14.340 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:07:14.341 DEBUG:teuthology.orchestra.run.smithi036:> # Given a non-glob path, it better be there 2021-01-03T13:07:14.341 DEBUG:teuthology.orchestra.run.smithi036:> if "*" not in asok_path: 2021-01-03T13:07:14.341 DEBUG:teuthology.orchestra.run.smithi036:> assert(len(files) == 1) 2021-01-03T13:07:14.342 DEBUG:teuthology.orchestra.run.smithi036:> return files[0] 2021-01-03T13:07:14.342 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:07:14.343 DEBUG:teuthology.orchestra.run.smithi036:> for f in files: 2021-01-03T13:07:14.343 DEBUG:teuthology.orchestra.run.smithi036:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:07:14.343 DEBUG:teuthology.orchestra.run.smithi036:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:07:14.344 DEBUG:teuthology.orchestra.run.smithi036:> return f 2021-01-03T13:07:14.344 DEBUG:teuthology.orchestra.run.smithi036:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:07:14.344 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:07:14.345 DEBUG:teuthology.orchestra.run.smithi036:> print(find_socket("client.1")) 2021-01-03T13:07:14.345 DEBUG:teuthology.orchestra.run.smithi036:> ' 2021-01-03T13:07:14.426 INFO:teuthology.orchestra.run.smithi036.stdout:/var/run/ceph/ceph-client.1.12245.asok 2021-01-03T13:07:14.431 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.12245.asok 2021-01-03T13:07:14.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:14.432 DEBUG:teuthology.orchestra.run.smithi036:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.12245.asok status 2021-01-03T13:07:14.533 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2021-01-03T13:07:14.534 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": { 2021-01-03T13:07:14.534 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:07:14.534 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:07:14.534 INFO:teuthology.orchestra.run.smithi036.stdout: "entity_id": "1", 2021-01-03T13:07:14.535 INFO:teuthology.orchestra.run.smithi036.stdout: "hostname": "smithi036", 2021-01-03T13:07:14.535 INFO:teuthology.orchestra.run.smithi036.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-01-03T13:07:14.535 INFO:teuthology.orchestra.run.smithi036.stdout: "pid": "12245", 2021-01-03T13:07:14.535 INFO:teuthology.orchestra.run.smithi036.stdout: "root": "/" 2021-01-03T13:07:14.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:07:14.536 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_count": 0, 2021-01-03T13:07:14.536 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_pinned_count": 0, 2021-01-03T13:07:14.536 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 7902, 2021-01-03T13:07:14.536 INFO:teuthology.orchestra.run.smithi036.stdout: "inst": { 2021-01-03T13:07:14.536 INFO:teuthology.orchestra.run.smithi036.stdout: "name": { 2021-01-03T13:07:14.537 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "client", 2021-01-03T13:07:14.537 INFO:teuthology.orchestra.run.smithi036.stdout: "num": 7902 2021-01-03T13:07:14.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:07:14.537 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:07:14.537 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:07:14.538 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:07:14.538 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 3691356330 2021-01-03T13:07:14.538 INFO:teuthology.orchestra.run.smithi036.stdout: } 2021-01-03T13:07:14.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:07:14.538 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:07:14.539 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:07:14.539 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:07:14.539 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 3691356330 2021-01-03T13:07:14.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:07:14.539 INFO:teuthology.orchestra.run.smithi036.stdout: "inst_str": "client.7902 172.21.15.36:0/3691356330", 2021-01-03T13:07:14.540 INFO:teuthology.orchestra.run.smithi036.stdout: "addr_str": "172.21.15.36:0/3691356330", 2021-01-03T13:07:14.540 INFO:teuthology.orchestra.run.smithi036.stdout: "inode_count": 1, 2021-01-03T13:07:14.540 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_epoch": 67, 2021-01-03T13:07:14.540 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch": 143, 2021-01-03T13:07:14.540 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:07:14.541 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklisted": false, 2021-01-03T13:07:14.541 INFO:teuthology.orchestra.run.smithi036.stdout: "fs_name": "cephfs" 2021-01-03T13:07:14.541 INFO:teuthology.orchestra.run.smithi036.stdout:} 2021-01-03T13:07:14.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:14.545 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:14.545 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:14.553 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:07:14.554 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:07:14.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:14.555 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:14.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:14.616 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:14.616 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:14.665 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:07:14.666 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:07:14.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:14.667 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:14.667 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:14.717 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:07:14.718 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:07:14.718 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi036.front.sepia.ceph.com... 2021-01-03T13:07:14.719 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:07:14.719 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:14.798 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[12245]: fuse finished with error 0 and tester_r 0 2021-01-03T13:07:14.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:14.801 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:14.801 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:14.848 INFO:teuthology.orchestra.run.smithi036.stdout:ext2/ext3 2021-01-03T13:07:14.849 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:07:14.850 INFO:teuthology.orchestra.run:waiting for 900 2021-01-03T13:07:14.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:07:14.894 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:14.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-01-03T13:07:14.905 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-01-03T13:07:14.907 DEBUG:teuthology.orchestra.run.smithi036:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-01-03T13:07:14.944 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-01-03T13:07:14.948 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2021-01-03T13:07:14.948 INFO:teuthology.orchestra.run.smithi016.stdout: chdir = "" 2021-01-03T13:07:14.948 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-01-03T13:07:14.948 INFO:teuthology.orchestra.run.smithi016.stdout: auth supported = cephx 2021-01-03T13:07:14.949 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.949 INFO:teuthology.orchestra.run.smithi016.stdout: filestore xattr use omap = true 2021-01-03T13:07:14.949 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.949 INFO:teuthology.orchestra.run.smithi016.stdout: mon clock drift allowed = 1.000 2021-01-03T13:07:14.950 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.950 INFO:teuthology.orchestra.run.smithi016.stdout: osd crush chooseleaf type = 0 2021-01-03T13:07:14.950 INFO:teuthology.orchestra.run.smithi016.stdout: auth debug = true 2021-01-03T13:07:14.950 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.950 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on old message = true 2021-01-03T13:07:14.951 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on bug = true 2021-01-03T13:07:14.951 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.951 INFO:teuthology.orchestra.run.smithi016.stdout: mon max pg per osd = 10000 # >= luminous 2021-01-03T13:07:14.951 INFO:teuthology.orchestra.run.smithi016.stdout: mon pg warn max object skew = 0 2021-01-03T13:07:14.951 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.952 INFO:teuthology.orchestra.run.smithi016.stdout: # disable pg_autoscaler by default for new pools 2021-01-03T13:07:14.952 INFO:teuthology.orchestra.run.smithi016.stdout: osd_pool_default_pg_autoscale_mode = off 2021-01-03T13:07:14.952 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.952 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default size = 2 2021-01-03T13:07:14.952 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.953 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow primary affinity = true 2021-01-03T13:07:14.953 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow pg remap = true 2021-01-03T13:07:14.953 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on legacy crush tunables = false 2021-01-03T13:07:14.953 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on crush straw calc version zero = false 2021-01-03T13:07:14.954 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on no sortbitwise = false 2021-01-03T13:07:14.954 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on osd down out interval zero = false 2021-01-03T13:07:14.954 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on too few osds = false 2021-01-03T13:07:14.954 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-01-03T13:07:14.954 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_no_redundancy = false 2021-01-03T13:07:14.955 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.955 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-01-03T13:07:14.955 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.955 INFO:teuthology.orchestra.run.smithi016.stdout: osd default data pool replay window = 5 2021-01-03T13:07:14.955 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.956 INFO:teuthology.orchestra.run.smithi016.stdout: mon allow pool delete = true 2021-01-03T13:07:14.956 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.956 INFO:teuthology.orchestra.run.smithi016.stdout: mon cluster log file level = debug 2021-01-03T13:07:14.956 INFO:teuthology.orchestra.run.smithi016.stdout: debug asserts on shutdown = true 2021-01-03T13:07:14.957 INFO:teuthology.orchestra.run.smithi016.stdout: mon health detail to clog = false 2021-01-03T13:07:14.957 INFO:teuthology.orchestra.run.smithi016.stdout: mon host = "172.21.15.133,172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790]" 2021-01-03T13:07:14.957 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = 80bc9ef3-5820-4b9f-9c57-8f734e4c440e 2021-01-03T13:07:14.957 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.957 INFO:teuthology.orchestra.run.smithi016.stdout:[osd] 2021-01-03T13:07:14.958 INFO:teuthology.orchestra.run.smithi016.stdout: osd journal size = 100 2021-01-03T13:07:14.958 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.958 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub load threshold = 5.0 2021-01-03T13:07:14.958 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub max interval = 600 2021-01-03T13:07:14.958 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.959 INFO:teuthology.orchestra.run.smithi016.stdout: osd recover clone overlap = true 2021-01-03T13:07:14.959 INFO:teuthology.orchestra.run.smithi016.stdout: osd recovery max chunk = 1048576 2021-01-03T13:07:14.959 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.959 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug shutdown = true 2021-01-03T13:07:14.959 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug op order = true 2021-01-03T13:07:14.960 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug verify stray on activate = true 2021-01-03T13:07:14.960 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.960 INFO:teuthology.orchestra.run.smithi016.stdout: osd open classes on start = true 2021-01-03T13:07:14.960 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug pg log writeout = true 2021-01-03T13:07:14.960 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.961 INFO:teuthology.orchestra.run.smithi016.stdout: osd deep scrub update digest min age = 30 2021-01-03T13:07:14.961 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.961 INFO:teuthology.orchestra.run.smithi016.stdout: osd map max advance = 10 2021-01-03T13:07:14.961 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.961 INFO:teuthology.orchestra.run.smithi016.stdout: journal zero on create = true 2021-01-03T13:07:14.962 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.962 INFO:teuthology.orchestra.run.smithi016.stdout: filestore ondisk finisher threads = 3 2021-01-03T13:07:14.962 INFO:teuthology.orchestra.run.smithi016.stdout: filestore apply finisher threads = 3 2021-01-03T13:07:14.962 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.962 INFO:teuthology.orchestra.run.smithi016.stdout: bdev debug aio = true 2021-01-03T13:07:14.963 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug misdirected ops = true 2021-01-03T13:07:14.963 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore block size = 96636764160 2021-01-03T13:07:14.963 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore compression mode = aggressive 2021-01-03T13:07:14.963 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore fsck on mount = True 2021-01-03T13:07:14.964 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluefs = 20 2021-01-03T13:07:14.964 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluestore = 20 2021-01-03T13:07:14.964 INFO:teuthology.orchestra.run.smithi016.stdout: debug filestore = 20 2021-01-03T13:07:14.964 INFO:teuthology.orchestra.run.smithi016.stdout: debug journal = 20 2021-01-03T13:07:14.964 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 20 2021-01-03T13:07:14.965 INFO:teuthology.orchestra.run.smithi016.stdout: debug osd = 25 2021-01-03T13:07:14.965 INFO:teuthology.orchestra.run.smithi016.stdout: debug rocksdb = 10 2021-01-03T13:07:14.965 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd backfillfull_ratio = 0.85 2021-01-03T13:07:14.965 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd full ratio = 0.9 2021-01-03T13:07:14.965 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd nearfull ratio = 0.8 2021-01-03T13:07:14.966 INFO:teuthology.orchestra.run.smithi016.stdout: osd failsafe full ratio = 0.95 2021-01-03T13:07:14.966 INFO:teuthology.orchestra.run.smithi016.stdout: osd objectstore = bluestore 2021-01-03T13:07:14.966 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2021-01-03T13:07:14.966 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.966 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr] 2021-01-03T13:07:14.967 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2021-01-03T13:07:14.967 INFO:teuthology.orchestra.run.smithi016.stdout: debug mgr = 20 2021-01-03T13:07:14.967 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2021-01-03T13:07:14.967 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2021-01-03T13:07:14.967 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2021-01-03T13:07:14.968 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2021-01-03T13:07:14.968 INFO:teuthology.orchestra.run.smithi016.stdout: mgr/telemetry/nag = false 2021-01-03T13:07:14.968 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.968 INFO:teuthology.orchestra.run.smithi016.stdout:[mon] 2021-01-03T13:07:14.968 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2021-01-03T13:07:14.969 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2021-01-03T13:07:14.969 INFO:teuthology.orchestra.run.smithi016.stdout: debug paxos = 20 2021-01-03T13:07:14.969 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2021-01-03T13:07:14.969 INFO:teuthology.orchestra.run.smithi016.stdout: mon data avail warn = 5 2021-01-03T13:07:14.969 INFO:teuthology.orchestra.run.smithi016.stdout: mon mgr mkfs grace = 240 2021-01-03T13:07:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2021-01-03T13:07:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd reporter subtree level = osd 2021-01-03T13:07:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd prime pg temp = true 2021-01-03T13:07:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2021-01-03T13:07:14.970 INFO:teuthology.orchestra.run.smithi016.stdout: mon op complaint time = 120 2021-01-03T13:07:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:14.971 INFO:teuthology.orchestra.run.smithi016.stdout:[client] 2021-01-03T13:07:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: rgw cache enabled = true 2021-01-03T13:07:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable ops log = true 2021-01-03T13:07:14.971 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable usage log = true 2021-01-03T13:07:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-01-03T13:07:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-01-03T13:07:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: client mount timeout = 600 2021-01-03T13:07:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2021-01-03T13:07:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2021-01-03T13:07:14.972 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 15m 2021-01-03T13:07:14.973 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 15m 2021-01-03T13:07:14.973 INFO:teuthology.orchestra.run.smithi016.stdout: client debug getattr caps = true 2021-01-03T13:07:14.973 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.a] 2021-01-03T13:07:14.973 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.b] 2021-01-03T13:07:14.973 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.c] 2021-01-03T13:07:14.974 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2021-01-03T13:07:14.974 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2021-01-03T13:07:14.974 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2021-01-03T13:07:14.974 INFO:teuthology.orchestra.run.smithi016.stdout:[mds] 2021-01-03T13:07:14.975 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds = 20 2021-01-03T13:07:14.975 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2021-01-03T13:07:14.975 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal frag = True 2021-01-03T13:07:14.975 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal fragment size max = 10000 2021-01-03T13:07:14.975 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal merge size = 5 2021-01-03T13:07:14.975 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal split bits = 3 2021-01-03T13:07:14.976 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal split size = 100 2021-01-03T13:07:14.976 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug frag = True 2021-01-03T13:07:14.976 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug scatterstat = True 2021-01-03T13:07:14.976 INFO:teuthology.orchestra.run.smithi016.stdout: mds op complaint time = 180 2021-01-03T13:07:14.976 INFO:teuthology.orchestra.run.smithi016.stdout: mds verify scatter = True 2021-01-03T13:07:14.977 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2021-01-03T13:07:14.977 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 15m 2021-01-03T13:07:14.977 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 15m 2021-01-03T13:07:14.977 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2021-01-03T13:07:14.978 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2021-01-03T13:07:14.978 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-01-03T13:07:14.978 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2021-01-03T13:07:14.978 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.978 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2021-01-03T13:07:14.979 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.979 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2021-01-03T13:07:14.979 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.979 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2021-01-03T13:07:14.979 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2021-01-03T13:07:14.980 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.980 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2021-01-03T13:07:14.980 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2021-01-03T13:07:14.980 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.980 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2021-01-03T13:07:14.981 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2021-01-03T13:07:14.981 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.981 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2021-01-03T13:07:14.981 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2021-01-03T13:07:14.981 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.982 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2021-01-03T13:07:14.982 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.982 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2021-01-03T13:07:14.982 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2021-01-03T13:07:14.982 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2021-01-03T13:07:14.983 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2021-01-03T13:07:14.983 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2021-01-03T13:07:14.983 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2021-01-03T13:07:14.983 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2021-01-03T13:07:14.983 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-01-03T13:07:14.984 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2021-01-03T13:07:14.984 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.984 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-01-03T13:07:14.984 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.984 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2021-01-03T13:07:14.985 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.985 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2021-01-03T13:07:14.985 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.985 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2021-01-03T13:07:14.985 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2021-01-03T13:07:14.985 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2021-01-03T13:07:14.986 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "172.21.15.133,172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790]" 2021-01-03T13:07:14.986 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = 80bc9ef3-5820-4b9f-9c57-8f734e4c440e 2021-01-03T13:07:14.986 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.986 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2021-01-03T13:07:14.986 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2021-01-03T13:07:14.987 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.987 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2021-01-03T13:07:14.987 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2021-01-03T13:07:14.987 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.987 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2021-01-03T13:07:14.988 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2021-01-03T13:07:14.988 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.988 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2021-01-03T13:07:14.988 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2021-01-03T13:07:14.988 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2021-01-03T13:07:14.989 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.989 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2021-01-03T13:07:14.989 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2021-01-03T13:07:14.989 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.989 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2021-01-03T13:07:14.990 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.990 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2021-01-03T13:07:14.990 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.990 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2021-01-03T13:07:14.990 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.991 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2021-01-03T13:07:14.991 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2021-01-03T13:07:14.991 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.991 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2021-01-03T13:07:14.991 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2021-01-03T13:07:14.992 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2021-01-03T13:07:14.992 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore compression mode = aggressive 2021-01-03T13:07:14.992 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2021-01-03T13:07:14.992 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 20 2021-01-03T13:07:14.992 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 20 2021-01-03T13:07:14.993 INFO:teuthology.orchestra.run.smithi007.stdout: debug filestore = 20 2021-01-03T13:07:14.993 INFO:teuthology.orchestra.run.smithi007.stdout: debug journal = 20 2021-01-03T13:07:14.993 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 20 2021-01-03T13:07:14.993 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 25 2021-01-03T13:07:14.993 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 10 2021-01-03T13:07:14.994 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2021-01-03T13:07:14.994 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2021-01-03T13:07:14.994 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2021-01-03T13:07:14.994 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2021-01-03T13:07:14.994 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2021-01-03T13:07:14.995 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2021-01-03T13:07:14.995 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.995 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2021-01-03T13:07:14.995 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2021-01-03T13:07:14.995 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2021-01-03T13:07:14.996 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2021-01-03T13:07:14.996 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2021-01-03T13:07:14.996 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2021-01-03T13:07:14.996 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2021-01-03T13:07:14.996 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2021-01-03T13:07:14.997 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.997 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2021-01-03T13:07:14.997 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2021-01-03T13:07:14.997 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2021-01-03T13:07:14.997 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2021-01-03T13:07:14.997 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2021-01-03T13:07:14.998 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2021-01-03T13:07:14.998 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2021-01-03T13:07:14.998 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2021-01-03T13:07:14.998 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2021-01-03T13:07:14.998 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2021-01-03T13:07:14.999 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2021-01-03T13:07:14.999 INFO:teuthology.orchestra.run.smithi007.stdout: mon op complaint time = 120 2021-01-03T13:07:14.999 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:14.999 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2021-01-03T13:07:14.999 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2021-01-03T13:07:15.000 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = true 2021-01-03T13:07:15.000 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2021-01-03T13:07:15.000 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-01-03T13:07:15.000 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-01-03T13:07:15.000 INFO:teuthology.orchestra.run.smithi007.stdout: client mount timeout = 600 2021-01-03T13:07:15.001 INFO:teuthology.orchestra.run.smithi007.stdout: debug client = 20 2021-01-03T13:07:15.001 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2021-01-03T13:07:15.001 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 15m 2021-01-03T13:07:15.001 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 15m 2021-01-03T13:07:15.001 INFO:teuthology.orchestra.run.smithi007.stdout: client debug getattr caps = true 2021-01-03T13:07:15.002 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2021-01-03T13:07:15.002 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2021-01-03T13:07:15.002 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2021-01-03T13:07:15.002 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2021-01-03T13:07:15.002 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c] 2021-01-03T13:07:15.003 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b] 2021-01-03T13:07:15.003 INFO:teuthology.orchestra.run.smithi007.stdout:[mds] 2021-01-03T13:07:15.003 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds = 20 2021-01-03T13:07:15.003 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2021-01-03T13:07:15.003 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal frag = True 2021-01-03T13:07:15.004 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal fragment size max = 10000 2021-01-03T13:07:15.004 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal merge size = 5 2021-01-03T13:07:15.004 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal split bits = 3 2021-01-03T13:07:15.004 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal split size = 100 2021-01-03T13:07:15.004 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug frag = True 2021-01-03T13:07:15.005 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug scatterstat = True 2021-01-03T13:07:15.005 INFO:teuthology.orchestra.run.smithi007.stdout: mds op complaint time = 180 2021-01-03T13:07:15.005 INFO:teuthology.orchestra.run.smithi007.stdout: mds verify scatter = True 2021-01-03T13:07:15.005 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2021-01-03T13:07:15.005 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 15m 2021-01-03T13:07:15.006 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 15m 2021-01-03T13:07:15.008 INFO:teuthology.orchestra.run.smithi036.stdout:[global] 2021-01-03T13:07:15.008 INFO:teuthology.orchestra.run.smithi036.stdout: chdir = "" 2021-01-03T13:07:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-01-03T13:07:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: auth supported = cephx 2021-01-03T13:07:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: filestore xattr use omap = true 2021-01-03T13:07:15.009 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: mon clock drift allowed = 1.000 2021-01-03T13:07:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: osd crush chooseleaf type = 0 2021-01-03T13:07:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: auth debug = true 2021-01-03T13:07:15.010 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: ms die on old message = true 2021-01-03T13:07:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: ms die on bug = true 2021-01-03T13:07:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: mon max pg per osd = 10000 # >= luminous 2021-01-03T13:07:15.011 INFO:teuthology.orchestra.run.smithi036.stdout: mon pg warn max object skew = 0 2021-01-03T13:07:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: # disable pg_autoscaler by default for new pools 2021-01-03T13:07:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: osd_pool_default_pg_autoscale_mode = off 2021-01-03T13:07:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.012 INFO:teuthology.orchestra.run.smithi036.stdout: osd pool default size = 2 2021-01-03T13:07:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd allow primary affinity = true 2021-01-03T13:07:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd allow pg remap = true 2021-01-03T13:07:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on legacy crush tunables = false 2021-01-03T13:07:15.013 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on crush straw calc version zero = false 2021-01-03T13:07:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on no sortbitwise = false 2021-01-03T13:07:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on osd down out interval zero = false 2021-01-03T13:07:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on too few osds = false 2021-01-03T13:07:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-01-03T13:07:15.014 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_pool_no_redundancy = false 2021-01-03T13:07:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-01-03T13:07:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: osd default data pool replay window = 5 2021-01-03T13:07:15.015 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: mon allow pool delete = true 2021-01-03T13:07:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: mon cluster log file level = debug 2021-01-03T13:07:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: debug asserts on shutdown = true 2021-01-03T13:07:15.016 INFO:teuthology.orchestra.run.smithi036.stdout: mon health detail to clog = false 2021-01-03T13:07:15.017 INFO:teuthology.orchestra.run.smithi036.stdout: mon host = "172.21.15.133,172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790]" 2021-01-03T13:07:15.017 INFO:teuthology.orchestra.run.smithi036.stdout: fsid = 80bc9ef3-5820-4b9f-9c57-8f734e4c440e 2021-01-03T13:07:15.017 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.017 INFO:teuthology.orchestra.run.smithi036.stdout:[osd] 2021-01-03T13:07:15.017 INFO:teuthology.orchestra.run.smithi036.stdout: osd journal size = 100 2021-01-03T13:07:15.018 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.018 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub load threshold = 5.0 2021-01-03T13:07:15.018 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub max interval = 600 2021-01-03T13:07:15.018 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.018 INFO:teuthology.orchestra.run.smithi036.stdout: osd recover clone overlap = true 2021-01-03T13:07:15.019 INFO:teuthology.orchestra.run.smithi036.stdout: osd recovery max chunk = 1048576 2021-01-03T13:07:15.019 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.019 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug shutdown = true 2021-01-03T13:07:15.019 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug op order = true 2021-01-03T13:07:15.019 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug verify stray on activate = true 2021-01-03T13:07:15.020 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.020 INFO:teuthology.orchestra.run.smithi036.stdout: osd open classes on start = true 2021-01-03T13:07:15.020 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug pg log writeout = true 2021-01-03T13:07:15.020 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.020 INFO:teuthology.orchestra.run.smithi036.stdout: osd deep scrub update digest min age = 30 2021-01-03T13:07:15.021 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.021 INFO:teuthology.orchestra.run.smithi036.stdout: osd map max advance = 10 2021-01-03T13:07:15.021 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.021 INFO:teuthology.orchestra.run.smithi036.stdout: journal zero on create = true 2021-01-03T13:07:15.021 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.022 INFO:teuthology.orchestra.run.smithi036.stdout: filestore ondisk finisher threads = 3 2021-01-03T13:07:15.022 INFO:teuthology.orchestra.run.smithi036.stdout: filestore apply finisher threads = 3 2021-01-03T13:07:15.022 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.022 INFO:teuthology.orchestra.run.smithi036.stdout: bdev debug aio = true 2021-01-03T13:07:15.022 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug misdirected ops = true 2021-01-03T13:07:15.023 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore block size = 96636764160 2021-01-03T13:07:15.023 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore compression mode = aggressive 2021-01-03T13:07:15.023 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore fsck on mount = True 2021-01-03T13:07:15.023 INFO:teuthology.orchestra.run.smithi036.stdout: debug bluefs = 20 2021-01-03T13:07:15.023 INFO:teuthology.orchestra.run.smithi036.stdout: debug bluestore = 20 2021-01-03T13:07:15.024 INFO:teuthology.orchestra.run.smithi036.stdout: debug filestore = 20 2021-01-03T13:07:15.024 INFO:teuthology.orchestra.run.smithi036.stdout: debug journal = 20 2021-01-03T13:07:15.024 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 20 2021-01-03T13:07:15.024 INFO:teuthology.orchestra.run.smithi036.stdout: debug osd = 25 2021-01-03T13:07:15.024 INFO:teuthology.orchestra.run.smithi036.stdout: debug rocksdb = 10 2021-01-03T13:07:15.025 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd backfillfull_ratio = 0.85 2021-01-03T13:07:15.025 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd full ratio = 0.9 2021-01-03T13:07:15.025 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd nearfull ratio = 0.8 2021-01-03T13:07:15.025 INFO:teuthology.orchestra.run.smithi036.stdout: osd failsafe full ratio = 0.95 2021-01-03T13:07:15.025 INFO:teuthology.orchestra.run.smithi036.stdout: osd objectstore = bluestore 2021-01-03T13:07:15.026 INFO:teuthology.orchestra.run.smithi036.stdout: osd op complaint time = 180 2021-01-03T13:07:15.026 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.026 INFO:teuthology.orchestra.run.smithi036.stdout:[mgr] 2021-01-03T13:07:15.026 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2021-01-03T13:07:15.026 INFO:teuthology.orchestra.run.smithi036.stdout: debug mgr = 20 2021-01-03T13:07:15.027 INFO:teuthology.orchestra.run.smithi036.stdout: debug mon = 20 2021-01-03T13:07:15.027 INFO:teuthology.orchestra.run.smithi036.stdout: debug auth = 20 2021-01-03T13:07:15.027 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min pgs per osd = 4 2021-01-03T13:07:15.027 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min bytes per osd = 10 2021-01-03T13:07:15.027 INFO:teuthology.orchestra.run.smithi036.stdout: mgr/telemetry/nag = false 2021-01-03T13:07:15.028 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.028 INFO:teuthology.orchestra.run.smithi036.stdout:[mon] 2021-01-03T13:07:15.028 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2021-01-03T13:07:15.028 INFO:teuthology.orchestra.run.smithi036.stdout: debug mon = 20 2021-01-03T13:07:15.028 INFO:teuthology.orchestra.run.smithi036.stdout: debug paxos = 20 2021-01-03T13:07:15.029 INFO:teuthology.orchestra.run.smithi036.stdout: debug auth = 20 2021-01-03T13:07:15.029 INFO:teuthology.orchestra.run.smithi036.stdout: mon data avail warn = 5 2021-01-03T13:07:15.029 INFO:teuthology.orchestra.run.smithi036.stdout: mon mgr mkfs grace = 240 2021-01-03T13:07:15.029 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min pgs per osd = 4 2021-01-03T13:07:15.029 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd reporter subtree level = osd 2021-01-03T13:07:15.030 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd prime pg temp = true 2021-01-03T13:07:15.030 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min bytes per osd = 10 2021-01-03T13:07:15.030 INFO:teuthology.orchestra.run.smithi036.stdout: mon op complaint time = 120 2021-01-03T13:07:15.030 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:15.031 INFO:teuthology.orchestra.run.smithi036.stdout:[client] 2021-01-03T13:07:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: rgw cache enabled = true 2021-01-03T13:07:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: rgw enable ops log = true 2021-01-03T13:07:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: rgw enable usage log = true 2021-01-03T13:07:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-01-03T13:07:15.031 INFO:teuthology.orchestra.run.smithi036.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-01-03T13:07:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: client mount timeout = 600 2021-01-03T13:07:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: debug client = 20 2021-01-03T13:07:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2021-01-03T13:07:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: rados mon op timeout = 15m 2021-01-03T13:07:15.032 INFO:teuthology.orchestra.run.smithi036.stdout: rados osd op timeout = 15m 2021-01-03T13:07:15.033 INFO:teuthology.orchestra.run.smithi036.stdout: client debug getattr caps = true 2021-01-03T13:07:15.033 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.a] 2021-01-03T13:07:15.033 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.b] 2021-01-03T13:07:15.033 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.c] 2021-01-03T13:07:15.033 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.a] 2021-01-03T13:07:15.034 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.c] 2021-01-03T13:07:15.034 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.b] 2021-01-03T13:07:15.034 INFO:teuthology.orchestra.run.smithi036.stdout:[mds] 2021-01-03T13:07:15.034 INFO:teuthology.orchestra.run.smithi036.stdout: debug mds = 20 2021-01-03T13:07:15.034 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2021-01-03T13:07:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal frag = True 2021-01-03T13:07:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal fragment size max = 10000 2021-01-03T13:07:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal merge size = 5 2021-01-03T13:07:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal split bits = 3 2021-01-03T13:07:15.035 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal split size = 100 2021-01-03T13:07:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: mds debug frag = True 2021-01-03T13:07:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: mds debug scatterstat = True 2021-01-03T13:07:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: mds op complaint time = 180 2021-01-03T13:07:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: mds verify scatter = True 2021-01-03T13:07:15.036 INFO:teuthology.orchestra.run.smithi036.stdout: osd op complaint time = 180 2021-01-03T13:07:15.037 INFO:teuthology.orchestra.run.smithi036.stdout: rados mon op timeout = 15m 2021-01-03T13:07:15.037 INFO:teuthology.orchestra.run.smithi036.stdout: rados osd op timeout = 15m 2021-01-03T13:07:15.037 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2021-01-03T13:07:15.037 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2021-01-03T13:07:15.038 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-01-03T13:07:15.038 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2021-01-03T13:07:15.038 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.038 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2021-01-03T13:07:15.038 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.039 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2021-01-03T13:07:15.039 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.039 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2021-01-03T13:07:15.039 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2021-01-03T13:07:15.039 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.040 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2021-01-03T13:07:15.040 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2021-01-03T13:07:15.040 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.040 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2021-01-03T13:07:15.040 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2021-01-03T13:07:15.041 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.041 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2021-01-03T13:07:15.041 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2021-01-03T13:07:15.041 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.041 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2021-01-03T13:07:15.042 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.042 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2021-01-03T13:07:15.042 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2021-01-03T13:07:15.042 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2021-01-03T13:07:15.042 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2021-01-03T13:07:15.043 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2021-01-03T13:07:15.043 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2021-01-03T13:07:15.043 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2021-01-03T13:07:15.043 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-01-03T13:07:15.043 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2021-01-03T13:07:15.044 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.044 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-01-03T13:07:15.044 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.044 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2021-01-03T13:07:15.044 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.045 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2021-01-03T13:07:15.045 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.045 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2021-01-03T13:07:15.045 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2021-01-03T13:07:15.045 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2021-01-03T13:07:15.046 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = "172.21.15.133,172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790]" 2021-01-03T13:07:15.046 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = 80bc9ef3-5820-4b9f-9c57-8f734e4c440e 2021-01-03T13:07:15.046 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.046 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2021-01-03T13:07:15.046 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2021-01-03T13:07:15.047 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.047 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2021-01-03T13:07:15.047 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2021-01-03T13:07:15.047 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.047 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2021-01-03T13:07:15.048 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2021-01-03T13:07:15.048 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.048 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2021-01-03T13:07:15.048 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2021-01-03T13:07:15.048 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2021-01-03T13:07:15.049 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.049 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2021-01-03T13:07:15.049 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2021-01-03T13:07:15.049 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.049 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2021-01-03T13:07:15.050 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.050 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2021-01-03T13:07:15.050 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.050 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2021-01-03T13:07:15.050 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.051 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2021-01-03T13:07:15.051 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2021-01-03T13:07:15.051 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.051 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2021-01-03T13:07:15.051 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2021-01-03T13:07:15.052 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2021-01-03T13:07:15.052 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore compression mode = aggressive 2021-01-03T13:07:15.052 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2021-01-03T13:07:15.052 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 20 2021-01-03T13:07:15.052 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 20 2021-01-03T13:07:15.053 INFO:teuthology.orchestra.run.smithi133.stdout: debug filestore = 20 2021-01-03T13:07:15.053 INFO:teuthology.orchestra.run.smithi133.stdout: debug journal = 20 2021-01-03T13:07:15.053 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 20 2021-01-03T13:07:15.053 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 25 2021-01-03T13:07:15.053 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 10 2021-01-03T13:07:15.054 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2021-01-03T13:07:15.054 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2021-01-03T13:07:15.054 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2021-01-03T13:07:15.054 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 0.95 2021-01-03T13:07:15.054 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = bluestore 2021-01-03T13:07:15.055 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2021-01-03T13:07:15.055 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.055 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2021-01-03T13:07:15.055 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2021-01-03T13:07:15.055 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2021-01-03T13:07:15.056 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2021-01-03T13:07:15.056 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2021-01-03T13:07:15.056 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2021-01-03T13:07:15.056 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2021-01-03T13:07:15.056 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2021-01-03T13:07:15.057 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.057 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2021-01-03T13:07:15.057 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2021-01-03T13:07:15.057 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2021-01-03T13:07:15.057 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2021-01-03T13:07:15.058 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2021-01-03T13:07:15.058 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2021-01-03T13:07:15.058 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2021-01-03T13:07:15.058 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2021-01-03T13:07:15.058 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2021-01-03T13:07:15.059 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2021-01-03T13:07:15.059 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2021-01-03T13:07:15.059 INFO:teuthology.orchestra.run.smithi133.stdout: mon op complaint time = 120 2021-01-03T13:07:15.059 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.059 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2021-01-03T13:07:15.060 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2021-01-03T13:07:15.060 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = true 2021-01-03T13:07:15.060 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2021-01-03T13:07:15.060 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-01-03T13:07:15.060 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-01-03T13:07:15.061 INFO:teuthology.orchestra.run.smithi133.stdout: client mount timeout = 600 2021-01-03T13:07:15.061 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2021-01-03T13:07:15.061 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2021-01-03T13:07:15.061 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 15m 2021-01-03T13:07:15.061 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 15m 2021-01-03T13:07:15.062 INFO:teuthology.orchestra.run.smithi133.stdout: client debug getattr caps = true 2021-01-03T13:07:15.062 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2021-01-03T13:07:15.062 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.b] 2021-01-03T13:07:15.062 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.c] 2021-01-03T13:07:15.062 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2021-01-03T13:07:15.063 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2021-01-03T13:07:15.063 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2021-01-03T13:07:15.063 INFO:teuthology.orchestra.run.smithi133.stdout:[mds] 2021-01-03T13:07:15.063 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds = 20 2021-01-03T13:07:15.063 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2021-01-03T13:07:15.064 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal frag = True 2021-01-03T13:07:15.064 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal fragment size max = 10000 2021-01-03T13:07:15.064 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal merge size = 5 2021-01-03T13:07:15.064 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal split bits = 3 2021-01-03T13:07:15.064 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal split size = 100 2021-01-03T13:07:15.065 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug frag = True 2021-01-03T13:07:15.065 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug scatterstat = True 2021-01-03T13:07:15.065 INFO:teuthology.orchestra.run.smithi133.stdout: mds op complaint time = 180 2021-01-03T13:07:15.065 INFO:teuthology.orchestra.run.smithi133.stdout: mds verify scatter = True 2021-01-03T13:07:15.065 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2021-01-03T13:07:15.066 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 15m 2021-01-03T13:07:15.066 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 15m 2021-01-03T13:07:15.067 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:07:15.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5e91a700 1 Processor -- start 2021-01-03T13:07:15.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5e91a700 1 -- start start 2021-01-03T13:07:15.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5e91a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e580afb00 0x7f7e580af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5e91a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e580b15b0 con 0x7f7e580b5430 2021-01-03T13:07:15.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5e91a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e580b5810 con 0x7f7e580b0010 2021-01-03T13:07:15.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5e91a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e580b17e0 con 0x7f7e580afb00 2021-01-03T13:07:15.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5d117700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7e580b0010 0x7f7e580aece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60658/0 (socket says 172.21.15.133:60658) 2021-01-03T13:07:15.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5d117700 1 -- 172.21.15.133:0/784215310 learned_addr learned my addr 172.21.15.133:0/784215310 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:15.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5e119700 1 --2- 172.21.15.133:0/784215310 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e580afb00 0x7f7e580af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5c916700 1 -- 172.21.15.133:0/784215310 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509546903 0 0) 0x7f7e580b5810 con 0x7f7e580b0010 2021-01-03T13:07:15.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5c916700 1 -- 172.21.15.133:0/784215310 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e40003230 con 0x7f7e580b0010 2021-01-03T13:07:15.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5c916700 1 -- 172.21.15.133:0/784215310 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 685149916 0 0) 0x7f7e40003230 con 0x7f7e580b0010 2021-01-03T13:07:15.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5c916700 1 -- 172.21.15.133:0/784215310 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e580afb00 msgr2=0x7f7e580af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:15.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5c916700 1 --2- 172.21.15.133:0/784215310 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e580afb00 0x7f7e580af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5c916700 1 -- 172.21.15.133:0/784215310 >> v1:172.21.15.16:6789/0 conn(0x7f7e580b5430 legacy=0x7f7e5814ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5c916700 1 -- 172.21.15.133:0/784215310 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5814a8c0 con 0x7f7e580b0010 2021-01-03T13:07:15.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5c916700 1 -- 172.21.15.133:0/784215310 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f7e540016d0 con 0x7f7e580b0010 2021-01-03T13:07:15.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5c916700 1 -- 172.21.15.133:0/784215310 >> v1:172.21.15.133:6789/0 conn(0x7f7e580b0010 legacy=0x7f7e580aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5c916700 1 --2- 172.21.15.133:0/784215310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e40003720 0x7f7e40003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5c916700 1 --2- 172.21.15.133:0/784215310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e40004060 0x7f7e40004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5c916700 1 --2- 172.21.15.133:0/784215310 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e580afb00 0x7f7e40004b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5c916700 1 -- 172.21.15.133:0/784215310 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e580b17e0 con 0x7f7e40003720 2021-01-03T13:07:15.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5c916700 1 -- 172.21.15.133:0/784215310 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400050d0 con 0x7f7e40004060 2021-01-03T13:07:15.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.180+0000 7f7e5c916700 1 -- 172.21.15.133:0/784215310 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e40005290 con 0x7f7e580afb00 2021-01-03T13:07:15.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5d117700 1 --2- 172.21.15.133:0/784215310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e40004060 0x7f7e40004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5e119700 1 --2- 172.21.15.133:0/784215310 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e580afb00 0x7f7e40004b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5d918700 1 --2- 172.21.15.133:0/784215310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e40003720 0x7f7e40003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5d117700 1 -- 172.21.15.133:0/784215310 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e580afb00 msgr2=0x7f7e40004b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:15.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5d117700 1 --2- 172.21.15.133:0/784215310 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e580afb00 0x7f7e40004b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5d117700 1 -- 172.21.15.133:0/784215310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e40003720 msgr2=0x7f7e40003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:15.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5d117700 1 --2- 172.21.15.133:0/784215310 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e40003720 0x7f7e40003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5d117700 1 -- 172.21.15.133:0/784215310 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e40003230 con 0x7f7e40004060 2021-01-03T13:07:15.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5d117700 1 --2- 172.21.15.133:0/784215310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e40004060 0x7f7e40004530 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f7e540013e0 tx=0x7f7e580b1a80).ready entity=mon.1 client_cookie=cd6bf6b9a07a665 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:15.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5c916700 1 -- 172.21.15.133:0/784215310 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e540070d0 con 0x7f7e40004060 2021-01-03T13:07:15.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5c916700 1 -- 172.21.15.133:0/784215310 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e54007230 con 0x7f7e40004060 2021-01-03T13:07:15.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5c916700 1 -- 172.21.15.133:0/784215310 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e540055e0 con 0x7f7e40004060 2021-01-03T13:07:15.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5e91a700 1 -- 172.21.15.133:0/784215310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e40004060 msgr2=0x7f7e40004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5e91a700 1 --2- 172.21.15.133:0/784215310 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e40004060 0x7f7e40004530 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f7e540013e0 tx=0x7f7e580b1a80).stop 2021-01-03T13:07:15.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5e119700 1 -- 172.21.15.133:0/784215310 reap_dead start 2021-01-03T13:07:15.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5e91a700 1 -- 172.21.15.133:0/784215310 shutdown_connections 2021-01-03T13:07:15.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5e91a700 1 -- 172.21.15.133:0/784215310 >> 172.21.15.133:0/784215310 conn(0x7f7e58061c00 msgr2=0x7f7e58061fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:15.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5e91a700 1 -- 172.21.15.133:0/784215310 shutdown_connections 2021-01-03T13:07:15.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.184+0000 7f7e5e91a700 1 -- 172.21.15.133:0/784215310 wait complete. 2021-01-03T13:07:15.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e91a700 1 Processor -- start 2021-01-03T13:07:15.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e91a700 1 -- start start 2021-01-03T13:07:15.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e91a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e580b4220 0x7f7e581596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e91a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e58145960 0x7f7e58159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e91a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e58146550 0x7f7e58146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e91a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e58145100 con 0x7f7e58145960 2021-01-03T13:07:15.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e91a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e580b4600 con 0x7f7e58146550 2021-01-03T13:07:15.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e91a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e581460d0 con 0x7f7e580b4220 2021-01-03T13:07:15.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e119700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e58146550 0x7f7e58146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5d918700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e580b4220 0x7f7e581596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e119700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e58146550 0x7f7e58146a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39642/0 (socket says 172.21.15.133:39642) 2021-01-03T13:07:15.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5d117700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e58145960 0x7f7e58159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e119700 1 -- 172.21.15.133:0/868342224 learned_addr learned my addr 172.21.15.133:0/868342224 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:15.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5d918700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e580b4220 0x7f7e581596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3301/0 says I am v2:172.21.15.133:47940/0 (socket says 172.21.15.133:47940) 2021-01-03T13:07:15.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e119700 1 -- 172.21.15.133:0/868342224 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e580b4220 msgr2=0x7f7e581596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e119700 1 --2- 172.21.15.133:0/868342224 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e580b4220 0x7f7e581596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e119700 1 -- 172.21.15.133:0/868342224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e58145960 msgr2=0x7f7e58159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e119700 1 --2- 172.21.15.133:0/868342224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e58145960 0x7f7e58159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e119700 1 -- 172.21.15.133:0/868342224 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e58144920 con 0x7f7e58146550 2021-01-03T13:07:15.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e119700 1 --2- 172.21.15.133:0/868342224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e58146550 0x7f7e58146a00 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f7e581595b0 tx=0x7f7e500091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:15.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e46ffd700 1 -- 172.21.15.133:0/868342224 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e50019070 con 0x7f7e58146550 2021-01-03T13:07:15.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e46ffd700 1 -- 172.21.15.133:0/868342224 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5000fab0 con 0x7f7e58146550 2021-01-03T13:07:15.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e46ffd700 1 -- 172.21.15.133:0/868342224 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e5000fe10 con 0x7f7e58146550 2021-01-03T13:07:15.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e91a700 1 -- 172.21.15.133:0/868342224 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e58144bc0 con 0x7f7e58146550 2021-01-03T13:07:15.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.188+0000 7f7e5e91a700 1 -- 172.21.15.133:0/868342224 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e580b4920 con 0x7f7e58146550 2021-01-03T13:07:15.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.192+0000 7f7e5e91a700 1 -- 172.21.15.133:0/868342224 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5815a250 con 0x7f7e58146550 2021-01-03T13:07:15.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.192+0000 7f7e46ffd700 1 -- 172.21.15.133:0/868342224 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7e50014440 con 0x7f7e58146550 2021-01-03T13:07:15.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.192+0000 7f7e46ffd700 1 --2- 172.21.15.133:0/868342224 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e380553f0 0x7f7e380578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.192+0000 7f7e5d918700 1 --2- 172.21.15.133:0/868342224 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e380553f0 0x7f7e380578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.192+0000 7f7e46ffd700 1 -- 172.21.15.133:0/868342224 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7e5006e890 con 0x7f7e58146550 2021-01-03T13:07:15.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.192+0000 7f7e5d918700 1 --2- 172.21.15.133:0/868342224 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e380553f0 0x7f7e380578b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f7e48003000 tx=0x7f7e48007b40).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:15.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.200+0000 7f7e46ffd700 1 -- 172.21.15.133:0/868342224 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7e50044b30 con 0x7f7e58146550 2021-01-03T13:07:15.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.344+0000 7f7e5e91a700 1 -- 172.21.15.133:0/868342224 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e581593c0 con 0x7f7e58146550 2021-01-03T13:07:15.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.344+0000 7f7e46ffd700 1 -- 172.21.15.133:0/868342224 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f7e50048150 con 0x7f7e58146550 2021-01-03T13:07:15.351 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:15.352 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":143,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:04.443265+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:07:01.122595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2021-01-03T13:07:02.419257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:07:15.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.348+0000 7f7e5e91a700 1 -- 172.21.15.133:0/868342224 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e380553f0 msgr2=0x7f7e380578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.348+0000 7f7e5e91a700 1 --2- 172.21.15.133:0/868342224 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e380553f0 0x7f7e380578b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f7e48003000 tx=0x7f7e48007b40).stop 2021-01-03T13:07:15.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.348+0000 7f7e5e91a700 1 -- 172.21.15.133:0/868342224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e58146550 msgr2=0x7f7e58146a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.348+0000 7f7e5e91a700 1 --2- 172.21.15.133:0/868342224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e58146550 0x7f7e58146a00 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f7e581595b0 tx=0x7f7e500091a0).stop 2021-01-03T13:07:15.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.348+0000 7f7e5e91a700 1 -- 172.21.15.133:0/868342224 shutdown_connections 2021-01-03T13:07:15.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.348+0000 7f7e5e91a700 1 --2- 172.21.15.133:0/868342224 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7e380553f0 0x7f7e380578b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.348+0000 7f7e5e91a700 1 --2- 172.21.15.133:0/868342224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e58146550 0x7f7e58146a00 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.348+0000 7f7e5e91a700 1 --2- 172.21.15.133:0/868342224 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7e580b4220 0x7f7e581596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.348+0000 7f7e5e91a700 1 --2- 172.21.15.133:0/868342224 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e58145960 0x7f7e58159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.348+0000 7f7e5e91a700 1 -- 172.21.15.133:0/868342224 >> 172.21.15.133:0/868342224 conn(0x7f7e58061c00 msgr2=0x7f7e5814c400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:15.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.348+0000 7f7e5e91a700 1 -- 172.21.15.133:0/868342224 shutdown_connections 2021-01-03T13:07:15.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.348+0000 7f7e5e91a700 1 -- 172.21.15.133:0/868342224 wait complete. 2021-01-03T13:07:15.372 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:07:01.122595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:07:02.419257+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:07:15.373 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:07:15.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.480+0000 7f4ea1f38700 1 Processor -- start 2021-01-03T13:07:15.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.480+0000 7f4ea1f38700 1 -- start start 2021-01-03T13:07:15.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4ea1f38700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4e9c0af3d0 0x7f4e9c0acc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4ea1f38700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9c0ac820 con 0x7f4e9c0ad4a0 2021-01-03T13:07:15.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4ea1f38700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9c060360 con 0x7f4e9c0aeff0 2021-01-03T13:07:15.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4ea1f38700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c0b59c0 con 0x7f4e9c0af3d0 2021-01-03T13:07:15.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9b7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4e9c0aeff0 0x7f4e9c0b52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60678/0 (socket says 172.21.15.133:60678) 2021-01-03T13:07:15.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9b7fe700 1 -- 172.21.15.133:0/1105507850 learned_addr learned my addr 172.21.15.133:0/1105507850 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:15.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9bfff700 1 --2- 172.21.15.133:0/1105507850 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4e9c0af3d0 0x7f4e9c0acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 -- 172.21.15.133:0/1105507850 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011189290 0 0) 0x7f4e9c060360 con 0x7f4e9c0aeff0 2021-01-03T13:07:15.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 -- 172.21.15.133:0/1105507850 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e7c003230 con 0x7f4e9c0aeff0 2021-01-03T13:07:15.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 -- 172.21.15.133:0/1105507850 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3343537091 0 0) 0x7f4e9c0ac820 con 0x7f4e9c0ad4a0 2021-01-03T13:07:15.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 -- 172.21.15.133:0/1105507850 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e9c060360 con 0x7f4e9c0ad4a0 2021-01-03T13:07:15.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 -- 172.21.15.133:0/1105507850 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1033886420 0 0) 0x7f4e7c003230 con 0x7f4e9c0aeff0 2021-01-03T13:07:15.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 -- 172.21.15.133:0/1105507850 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4e9c0af3d0 msgr2=0x7f4e9c0acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:15.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 --2- 172.21.15.133:0/1105507850 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4e9c0af3d0 0x7f4e9c0acc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 -- 172.21.15.133:0/1105507850 >> v1:172.21.15.16:6789/0 conn(0x7f4e9c0ad4a0 legacy=0x7f4e9c05fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 -- 172.21.15.133:0/1105507850 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c0b0870 con 0x7f4e9c0aeff0 2021-01-03T13:07:15.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 -- 172.21.15.133:0/1105507850 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f4e8c0016d0 con 0x7f4e9c0aeff0 2021-01-03T13:07:15.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 -- 172.21.15.133:0/1105507850 >> v1:172.21.15.133:6789/0 conn(0x7f4e9c0aeff0 legacy=0x7f4e9c0b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 --2- 172.21.15.133:0/1105507850 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e7c0038b0 0x7f4e7c003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 --2- 172.21.15.133:0/1105507850 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4e7c0044d0 0x7f4e7c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 --2- 172.21.15.133:0/1105507850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e7c004e40 0x7f4e7c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 -- 172.21.15.133:0/1105507850 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c0b59c0 con 0x7f4e7c0038b0 2021-01-03T13:07:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 -- 172.21.15.133:0/1105507850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c0052c0 con 0x7f4e7c004e40 2021-01-03T13:07:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 -- 172.21.15.133:0/1105507850 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c00bc10 con 0x7f4e7c0044d0 2021-01-03T13:07:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9bfff700 1 --2- 172.21.15.133:0/1105507850 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4e9c0af3d0 0x7f4e9c0acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:15.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9b7fe700 1 --2- 172.21.15.133:0/1105507850 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e7c0038b0 0x7f4e7c003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9bfff700 1 --2- 172.21.15.133:0/1105507850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e7c004e40 0x7f4e7c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e93fff700 1 --2- 172.21.15.133:0/1105507850 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4e7c0044d0 0x7f4e7c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9bfff700 1 -- 172.21.15.133:0/1105507850 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4e7c0044d0 msgr2=0x7f4e7c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:15.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9bfff700 1 --2- 172.21.15.133:0/1105507850 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4e7c0044d0 0x7f4e7c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9bfff700 1 -- 172.21.15.133:0/1105507850 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e7c0038b0 msgr2=0x7f4e7c003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:15.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9bfff700 1 --2- 172.21.15.133:0/1105507850 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e7c0038b0 0x7f4e7c003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9bfff700 1 -- 172.21.15.133:0/1105507850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c003230 con 0x7f4e7c004e40 2021-01-03T13:07:15.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9b7fe700 1 --2- 172.21.15.133:0/1105507850 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e7c0038b0 0x7f4e7c003cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:15.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9bfff700 1 --2- 172.21.15.133:0/1105507850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e7c004e40 0x7f4e7c00b720 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f4e7c004440 tx=0x7f4e940091a0).ready entity=mon.1 client_cookie=a97fe15e6f4d3bdf server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:15.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 -- 172.21.15.133:0/1105507850 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e9400e970 con 0x7f4e7c004e40 2021-01-03T13:07:15.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 -- 172.21.15.133:0/1105507850 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9400ead0 con 0x7f4e7c004e40 2021-01-03T13:07:15.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9affd700 1 -- 172.21.15.133:0/1105507850 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e9400ee30 con 0x7f4e7c004e40 2021-01-03T13:07:15.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4ea1f38700 1 -- 172.21.15.133:0/1105507850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e7c004e40 msgr2=0x7f4e7c00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4ea1f38700 1 --2- 172.21.15.133:0/1105507850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e7c004e40 0x7f4e7c00b720 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f4e7c004440 tx=0x7f4e940091a0).stop 2021-01-03T13:07:15.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.484+0000 7f4e9bfff700 1 -- 172.21.15.133:0/1105507850 reap_dead start 2021-01-03T13:07:15.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4ea1f38700 1 -- 172.21.15.133:0/1105507850 shutdown_connections 2021-01-03T13:07:15.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4ea1f38700 1 -- 172.21.15.133:0/1105507850 >> 172.21.15.133:0/1105507850 conn(0x7f4e9c061e90 msgr2=0x7f4e9c062270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:15.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4ea1f38700 1 -- 172.21.15.133:0/1105507850 shutdown_connections 2021-01-03T13:07:15.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4ea1f38700 1 -- 172.21.15.133:0/1105507850 wait complete. 2021-01-03T13:07:15.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4ea1f38700 1 Processor -- start 2021-01-03T13:07:15.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4ea1f38700 1 -- start start 2021-01-03T13:07:15.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4ea1f38700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e9c148ad0 0x7f4e9c0aad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4ea1f38700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e9c142f60 0x7f4e9c153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4ea1f38700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4e9c138600 0x7f4e9c138a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4ea1f38700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c152760 con 0x7f4e9c148ad0 2021-01-03T13:07:15.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4ea1f38700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c13b780 con 0x7f4e9c142f60 2021-01-03T13:07:15.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4ea1f38700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c148eb0 con 0x7f4e9c138600 2021-01-03T13:07:15.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4e93fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e9c142f60 0x7f4e9c153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4e93fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e9c142f60 0x7f4e9c153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39660/0 (socket says 172.21.15.133:39660) 2021-01-03T13:07:15.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4e93fff700 1 -- 172.21.15.133:0/3457263903 learned_addr learned my addr 172.21.15.133:0/3457263903 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:15.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4e9b7fe700 1 --2- 172.21.15.133:0/3457263903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e9c148ad0 0x7f4e9c0aad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4e9bfff700 1 --2- 172.21.15.133:0/3457263903 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4e9c138600 0x7f4e9c138a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4e93fff700 1 -- 172.21.15.133:0/3457263903 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4e9c138600 msgr2=0x7f4e9c138a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.488+0000 7f4e93fff700 1 --2- 172.21.15.133:0/3457263903 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4e9c138600 0x7f4e9c138a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.492+0000 7f4e93fff700 1 -- 172.21.15.133:0/3457263903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e9c148ad0 msgr2=0x7f4e9c0aad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.492+0000 7f4e93fff700 1 --2- 172.21.15.133:0/3457263903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e9c148ad0 0x7f4e9c0aad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.492+0000 7f4e93fff700 1 -- 172.21.15.133:0/3457263903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c1438d0 con 0x7f4e9c142f60 2021-01-03T13:07:15.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.492+0000 7f4e93fff700 1 --2- 172.21.15.133:0/3457263903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e9c142f60 0x7f4e9c153090 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f4e8400d000 tx=0x7f4e84007b40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:15.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.492+0000 7f4e997fa700 1 -- 172.21.15.133:0/3457263903 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e8400fa30 con 0x7f4e9c142f60 2021-01-03T13:07:15.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.492+0000 7f4e997fa700 1 -- 172.21.15.133:0/3457263903 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8400fb90 con 0x7f4e9c142f60 2021-01-03T13:07:15.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.492+0000 7f4ea1f38700 1 -- 172.21.15.133:0/3457263903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9c143b70 con 0x7f4e9c142f60 2021-01-03T13:07:15.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.492+0000 7f4e997fa700 1 -- 172.21.15.133:0/3457263903 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e84014450 con 0x7f4e9c142f60 2021-01-03T13:07:15.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.492+0000 7f4ea1f38700 1 -- 172.21.15.133:0/3457263903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c152bf0 con 0x7f4e9c142f60 2021-01-03T13:07:15.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.492+0000 7f4e997fa700 1 -- 172.21.15.133:0/3457263903 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4e8401b030 con 0x7f4e9c142f60 2021-01-03T13:07:15.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.492+0000 7f4ea1f38700 1 -- 172.21.15.133:0/3457263903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9c143d70 con 0x7f4e9c142f60 2021-01-03T13:07:15.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.492+0000 7f4e997fa700 1 --2- 172.21.15.133:0/3457263903 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4e800553f0 0x7f4e800578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.492+0000 7f4e997fa700 1 -- 172.21.15.133:0/3457263903 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4e8406e100 con 0x7f4e9c142f60 2021-01-03T13:07:15.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.492+0000 7f4e9b7fe700 1 --2- 172.21.15.133:0/3457263903 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4e800553f0 0x7f4e800578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.496+0000 7f4e9b7fe700 1 --2- 172.21.15.133:0/3457263903 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4e800553f0 0x7f4e800578b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f4e8c005000 tx=0x7f4e9c13fcf0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:15.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.500+0000 7f4e997fa700 1 -- 172.21.15.133:0/3457263903 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4e840442f0 con 0x7f4e9c142f60 2021-01-03T13:07:15.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.640+0000 7f4ea1f38700 1 -- 172.21.15.133:0/3457263903 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4e9c152db0 con 0x7f4e9c142f60 2021-01-03T13:07:15.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.644+0000 7f4e997fa700 1 -- 172.21.15.133:0/3457263903 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v143) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4e84047910 con 0x7f4e9c142f60 2021-01-03T13:07:15.649 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:07:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.644+0000 7f4ea1f38700 1 -- 172.21.15.133:0/3457263903 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4e800553f0 msgr2=0x7f4e800578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.644+0000 7f4ea1f38700 1 --2- 172.21.15.133:0/3457263903 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4e800553f0 0x7f4e800578b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f4e8c005000 tx=0x7f4e9c13fcf0).stop 2021-01-03T13:07:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.644+0000 7f4ea1f38700 1 -- 172.21.15.133:0/3457263903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e9c142f60 msgr2=0x7f4e9c153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.644+0000 7f4ea1f38700 1 --2- 172.21.15.133:0/3457263903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e9c142f60 0x7f4e9c153090 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f4e8400d000 tx=0x7f4e84007b40).stop 2021-01-03T13:07:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.644+0000 7f4ea1f38700 1 -- 172.21.15.133:0/3457263903 shutdown_connections 2021-01-03T13:07:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.644+0000 7f4ea1f38700 1 --2- 172.21.15.133:0/3457263903 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4e800553f0 0x7f4e800578b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.644+0000 7f4ea1f38700 1 --2- 172.21.15.133:0/3457263903 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4e9c148ad0 0x7f4e9c0aad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.644+0000 7f4ea1f38700 1 --2- 172.21.15.133:0/3457263903 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4e9c138600 0x7f4e9c138a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.644+0000 7f4ea1f38700 1 --2- 172.21.15.133:0/3457263903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4e9c142f60 0x7f4e9c153090 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.644+0000 7f4ea1f38700 1 -- 172.21.15.133:0/3457263903 >> 172.21.15.133:0/3457263903 conn(0x7f4e9c061e90 msgr2=0x7f4e9c13efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:15.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.644+0000 7f4ea1f38700 1 -- 172.21.15.133:0/3457263903 shutdown_connections 2021-01-03T13:07:15.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.644+0000 7f4ea1f38700 1 -- 172.21.15.133:0/3457263903 wait complete. 2021-01-03T13:07:15.669 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:07:15.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.776+0000 7f13b3142700 1 Processor -- start 2021-01-03T13:07:15.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.776+0000 7f13b3142700 1 -- start start 2021-01-03T13:07:15.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.776+0000 7f13b3142700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f13ac099c60 0x7f13ac066d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.776+0000 7f13b3142700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ac146450 con 0x7f13ac142f00 2021-01-03T13:07:15.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.776+0000 7f13b3142700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ac1466f0 con 0x7f13ac066920 2021-01-03T13:07:15.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.776+0000 7f13b3142700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ac060160 con 0x7f13ac099c60 2021-01-03T13:07:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.776+0000 7f13b193f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f13ac099c60 0x7f13ac066d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.776+0000 7f13b2140700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f13ac066920 0x7f13ac05fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60698/0 (socket says 172.21.15.133:60698) 2021-01-03T13:07:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.776+0000 7f13b2140700 1 -- 172.21.15.133:0/766431948 learned_addr learned my addr 172.21.15.133:0/766431948 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:15.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b113e700 1 -- 172.21.15.133:0/766431948 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859269110 0 0) 0x7f13ac1466f0 con 0x7f13ac066920 2021-01-03T13:07:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b113e700 1 -- 172.21.15.133:0/766431948 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f138c003230 con 0x7f13ac066920 2021-01-03T13:07:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b193f700 1 -- 172.21.15.133:0/766431948 >> v1:172.21.15.133:6789/0 conn(0x7f13ac066920 legacy=0x7f13ac05fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b193f700 1 -- 172.21.15.133:0/766431948 >> v1:172.21.15.16:6789/0 conn(0x7f13ac142f00 legacy=0x7f13ac143300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b113e700 1 -- 172.21.15.133:0/766431948 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647987873 0 0) 0x7f13ac146450 con 0x7f13ac142f00 2021-01-03T13:07:15.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b193f700 1 -- 172.21.15.133:0/766431948 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac146990 con 0x7f13ac099c60 2021-01-03T13:07:15.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b193f700 1 --2- 172.21.15.133:0/766431948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13ac099c60 0x7f13ac066d00 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f1394002f30 tx=0x7f1394006dc0).ready entity=mon.1 client_cookie=40e1a6ee39a753f2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:15.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b113e700 1 -- 172.21.15.133:0/766431948 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1394009800 con 0x7f13ac099c60 2021-01-03T13:07:15.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b113e700 1 -- 172.21.15.133:0/766431948 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1394009960 con 0x7f13ac099c60 2021-01-03T13:07:15.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b113e700 1 -- 172.21.15.133:0/766431948 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1394009cc0 con 0x7f13ac099c60 2021-01-03T13:07:15.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b3142700 1 -- 172.21.15.133:0/766431948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13ac099c60 msgr2=0x7f13ac066d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b3142700 1 --2- 172.21.15.133:0/766431948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13ac099c60 0x7f13ac066d00 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f1394002f30 tx=0x7f1394006dc0).stop 2021-01-03T13:07:15.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b3142700 1 -- 172.21.15.133:0/766431948 shutdown_connections 2021-01-03T13:07:15.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b3142700 1 --2- 172.21.15.133:0/766431948 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13ac099c60 0x7f13ac066d00 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b3142700 1 -- 172.21.15.133:0/766431948 >> 172.21.15.133:0/766431948 conn(0x7f13ac0b5a30 msgr2=0x7f13ac0b5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:15.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b3142700 1 -- 172.21.15.133:0/766431948 shutdown_connections 2021-01-03T13:07:15.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b3142700 1 -- 172.21.15.133:0/766431948 wait complete. 2021-01-03T13:07:15.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b3142700 1 Processor -- start 2021-01-03T13:07:15.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.780+0000 7f13b3142700 1 -- start start 2021-01-03T13:07:15.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b3142700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13ac066920 0x7f13ac09b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b3142700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13ac099c60 0x7f13ac152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b3142700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f13ac142f00 0x7f13ac152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b3142700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac13a390 con 0x7f13ac066920 2021-01-03T13:07:15.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b3142700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac146150 con 0x7f13ac099c60 2021-01-03T13:07:15.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b3142700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac140da0 con 0x7f13ac142f00 2021-01-03T13:07:15.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b193f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13ac099c60 0x7f13ac152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b193f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13ac099c60 0x7f13ac152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39672/0 (socket says 172.21.15.133:39672) 2021-01-03T13:07:15.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b193f700 1 -- 172.21.15.133:0/3072259776 learned_addr learned my addr 172.21.15.133:0/3072259776 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:15.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b2140700 1 --2- 172.21.15.133:0/3072259776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13ac066920 0x7f13ac09b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b193f700 1 -- 172.21.15.133:0/3072259776 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f13ac142f00 msgr2=0x7f13ac152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b2941700 1 --2- 172.21.15.133:0/3072259776 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f13ac142f00 0x7f13ac152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b193f700 1 --2- 172.21.15.133:0/3072259776 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f13ac142f00 0x7f13ac152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b193f700 1 -- 172.21.15.133:0/3072259776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13ac066920 msgr2=0x7f13ac09b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b193f700 1 --2- 172.21.15.133:0/3072259776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13ac066920 0x7f13ac09b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b193f700 1 -- 172.21.15.133:0/3072259776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac1424f0 con 0x7f13ac099c60 2021-01-03T13:07:15.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b2140700 1 --2- 172.21.15.133:0/3072259776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13ac066920 0x7f13ac09b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:15.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b2941700 1 --2- 172.21.15.133:0/3072259776 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f13ac142f00 0x7f13ac152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:15.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b193f700 1 --2- 172.21.15.133:0/3072259776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13ac099c60 0x7f13ac152120 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f1394002f30 tx=0x7f1394015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:15.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13ab7fe700 1 -- 172.21.15.133:0/3072259776 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1394011c80 con 0x7f13ac099c60 2021-01-03T13:07:15.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13ab7fe700 1 -- 172.21.15.133:0/3072259776 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1394011de0 con 0x7f13ac099c60 2021-01-03T13:07:15.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b3142700 1 -- 172.21.15.133:0/3072259776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ac152b00 con 0x7f13ac099c60 2021-01-03T13:07:15.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13ab7fe700 1 -- 172.21.15.133:0/3072259776 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f139401d630 con 0x7f13ac099c60 2021-01-03T13:07:15.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b3142700 1 -- 172.21.15.133:0/3072259776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ac146380 con 0x7f13ac099c60 2021-01-03T13:07:15.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13ab7fe700 1 -- 172.21.15.133:0/3072259776 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1394024030 con 0x7f13ac099c60 2021-01-03T13:07:15.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.784+0000 7f13b3142700 1 -- 172.21.15.133:0/3072259776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ac057300 con 0x7f13ac099c60 2021-01-03T13:07:15.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.788+0000 7f13ab7fe700 1 --2- 172.21.15.133:0/3072259776 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1390055440 0x7f1390057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:15.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.788+0000 7f13ab7fe700 1 -- 172.21.15.133:0/3072259776 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f139406ed40 con 0x7f13ac099c60 2021-01-03T13:07:15.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.788+0000 7f13b2140700 1 --2- 172.21.15.133:0/3072259776 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1390055440 0x7f1390057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:15.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.788+0000 7f13b2140700 1 --2- 172.21.15.133:0/3072259776 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1390055440 0x7f1390057900 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f13a4008000 tx=0x7f13a4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:15.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.788+0000 7f13ab7fe700 1 -- 172.21.15.133:0/3072259776 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f13940450c0 con 0x7f13ac099c60 2021-01-03T13:07:15.935 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.928+0000 7f13b3142700 1 -- 172.21.15.133:0/3072259776 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f13ac068740 con 0x7f13ac099c60 2021-01-03T13:07:15.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.932+0000 7f13ab7fe700 1 -- 172.21.15.133:0/3072259776 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v143) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1394022070 con 0x7f13ac099c60 2021-01-03T13:07:15.936 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:15.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.932+0000 7f13b3142700 1 -- 172.21.15.133:0/3072259776 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1390055440 msgr2=0x7f1390057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.932+0000 7f13b3142700 1 --2- 172.21.15.133:0/3072259776 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1390055440 0x7f1390057900 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f13a4008000 tx=0x7f13a4009040).stop 2021-01-03T13:07:15.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.932+0000 7f13b3142700 1 -- 172.21.15.133:0/3072259776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13ac099c60 msgr2=0x7f13ac152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:15.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.932+0000 7f13b3142700 1 --2- 172.21.15.133:0/3072259776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13ac099c60 0x7f13ac152120 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f1394002f30 tx=0x7f1394015000).stop 2021-01-03T13:07:15.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.932+0000 7f13b3142700 1 -- 172.21.15.133:0/3072259776 shutdown_connections 2021-01-03T13:07:15.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.932+0000 7f13b3142700 1 --2- 172.21.15.133:0/3072259776 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1390055440 0x7f1390057900 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.932+0000 7f13b3142700 1 --2- 172.21.15.133:0/3072259776 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f13ac066920 0x7f13ac09b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.932+0000 7f13b3142700 1 --2- 172.21.15.133:0/3072259776 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f13ac142f00 0x7f13ac152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.932+0000 7f13b3142700 1 --2- 172.21.15.133:0/3072259776 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13ac099c60 0x7f13ac152120 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:15.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.932+0000 7f13b3142700 1 -- 172.21.15.133:0/3072259776 >> 172.21.15.133:0/3072259776 conn(0x7f13ac0b5a30 msgr2=0x7f13ac0b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:15.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.932+0000 7f13b3142700 1 -- 172.21.15.133:0/3072259776 shutdown_connections 2021-01-03T13:07:15.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:15.932+0000 7f13b3142700 1 -- 172.21.15.133:0/3072259776 wait complete. 2021-01-03T13:07:15.949 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:07:16.064 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749c68e700 1 Processor -- start 2021-01-03T13:07:16.065 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749c68e700 1 -- start start 2021-01-03T13:07:16.066 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749c68e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f749405fdf0 0x7f74940b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:16.066 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749c68e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f74940b5f30 0x7f74941473d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:16.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749c68e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74940b52b0 con 0x7f74940a8cc0 2021-01-03T13:07:16.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749c68e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74940b5550 con 0x7f74940b5f30 2021-01-03T13:07:16.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749c68e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74940b57f0 con 0x7f749405fdf0 2021-01-03T13:07:16.067 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749a42a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f749405fdf0 0x7f74940b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:16.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749a42a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f749405fdf0 0x7f74940b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39680/0 (socket says 172.21.15.133:39680) 2021-01-03T13:07:16.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749ac2b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f74940a8cc0 0x7f74940ada10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60714/0 (socket says 172.21.15.133:60714) 2021-01-03T13:07:16.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749a42a700 1 -- 172.21.15.133:0/1648360013 learned_addr learned my addr 172.21.15.133:0/1648360013 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:16.068 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f7499c29700 1 --2- 172.21.15.133:0/1648360013 >> v2:172.21.15.16:3300/0 conn(0x7f74940b5f30 0x7f74941473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:16.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749a42a700 1 -- 172.21.15.133:0/1648360013 >> v2:172.21.15.16:3300/0 conn(0x7f74940b5f30 msgr2=0x7f74941473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:16.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749a42a700 1 --2- 172.21.15.133:0/1648360013 >> v2:172.21.15.16:3300/0 conn(0x7f74940b5f30 0x7f74941473d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749a42a700 1 -- 172.21.15.133:0/1648360013 >> v1:172.21.15.133:6789/0 conn(0x7f74940a8cc0 legacy=0x7f74940ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f7499428700 1 -- 172.21.15.133:0/1648360013 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348834799 0 0) 0x7f74940b52b0 con 0x7f74940a8cc0 2021-01-03T13:07:16.070 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749a42a700 1 -- 172.21.15.133:0/1648360013 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74940b5a90 con 0x7f749405fdf0 2021-01-03T13:07:16.071 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749a42a700 1 --2- 172.21.15.133:0/1648360013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f749405fdf0 0x7f74940b2640 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f7488002f30 tx=0x7f7488006e80).ready entity=mon.1 client_cookie=a2ccffb876200904 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:16.071 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f7499428700 1 -- 172.21.15.133:0/1648360013 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74880097f0 con 0x7f749405fdf0 2021-01-03T13:07:16.071 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f7499428700 1 -- 172.21.15.133:0/1648360013 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7488009950 con 0x7f749405fdf0 2021-01-03T13:07:16.071 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f7499428700 1 -- 172.21.15.133:0/1648360013 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7488009cb0 con 0x7f749405fdf0 2021-01-03T13:07:16.072 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749c68e700 1 -- 172.21.15.133:0/1648360013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f749405fdf0 msgr2=0x7f74940b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.072 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.060+0000 7f749c68e700 1 --2- 172.21.15.133:0/1648360013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f749405fdf0 0x7f74940b2640 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f7488002f30 tx=0x7f7488006e80).stop 2021-01-03T13:07:16.072 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f749c68e700 1 -- 172.21.15.133:0/1648360013 shutdown_connections 2021-01-03T13:07:16.072 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f749c68e700 1 --2- 172.21.15.133:0/1648360013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f749405fdf0 0x7f74940b2640 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.072 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f749c68e700 1 --2- 172.21.15.133:0/1648360013 >> v2:172.21.15.16:3300/0 conn(0x7f74940b5f30 0x7f74941473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.073 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f749c68e700 1 -- 172.21.15.133:0/1648360013 >> 172.21.15.133:0/1648360013 conn(0x7f7494061e90 msgr2=0x7f7494062270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:16.073 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f749c68e700 1 -- 172.21.15.133:0/1648360013 shutdown_connections 2021-01-03T13:07:16.073 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f749c68e700 1 -- 172.21.15.133:0/1648360013 wait complete. 2021-01-03T13:07:16.075 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f749c68e700 1 Processor -- start 2021-01-03T13:07:16.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f749c68e700 1 -- start start 2021-01-03T13:07:16.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f749c68e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f749405fdf0 0x7f7494142220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:16.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f749c68e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940a8cc0 0x7f74941562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:16.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f749c68e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f74940b5f30 0x7f74941567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:16.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f749c68e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7494142e00 con 0x7f749405fdf0 2021-01-03T13:07:16.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f749c68e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749414db00 con 0x7f74940a8cc0 2021-01-03T13:07:16.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f749c68e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74940abb90 con 0x7f74940b5f30 2021-01-03T13:07:16.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f7499c29700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940a8cc0 0x7f74941562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:16.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f7499c29700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940a8cc0 0x7f74941562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39688/0 (socket says 172.21.15.133:39688) 2021-01-03T13:07:16.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f7499c29700 1 -- 172.21.15.133:0/4066056222 learned_addr learned my addr 172.21.15.133:0/4066056222 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:16.078 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f749ac2b700 1 --2- 172.21.15.133:0/4066056222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f74940b5f30 0x7f74941567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:16.078 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.064+0000 7f749a42a700 1 --2- 172.21.15.133:0/4066056222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f749405fdf0 0x7f7494142220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:16.078 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.068+0000 7f7499c29700 1 -- 172.21.15.133:0/4066056222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f74940b5f30 msgr2=0x7f74941567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.078 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.068+0000 7f7499c29700 1 --2- 172.21.15.133:0/4066056222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f74940b5f30 0x7f74941567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.079 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.068+0000 7f7499c29700 1 -- 172.21.15.133:0/4066056222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f749405fdf0 msgr2=0x7f7494142220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.079 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.068+0000 7f7499c29700 1 --2- 172.21.15.133:0/4066056222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f749405fdf0 0x7f7494142220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.079 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.068+0000 7f7499c29700 1 -- 172.21.15.133:0/4066056222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7494156cb0 con 0x7f74940a8cc0 2021-01-03T13:07:16.079 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.068+0000 7f749a42a700 1 --2- 172.21.15.133:0/4066056222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f749405fdf0 0x7f7494142220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:16.079 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.068+0000 7f7499c29700 1 --2- 172.21.15.133:0/4066056222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940a8cc0 0x7f74941562d0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f749000c000 tx=0x7f7490006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:16.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.068+0000 7f74877fe700 1 -- 172.21.15.133:0/4066056222 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f749000ca10 con 0x7f74940a8cc0 2021-01-03T13:07:16.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.068+0000 7f749c68e700 1 -- 172.21.15.133:0/4066056222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749414c900 con 0x7f74940a8cc0 2021-01-03T13:07:16.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.068+0000 7f74877fe700 1 -- 172.21.15.133:0/4066056222 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749000cb70 con 0x7f74940a8cc0 2021-01-03T13:07:16.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.068+0000 7f74877fe700 1 -- 172.21.15.133:0/4066056222 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74900123f0 con 0x7f74940a8cc0 2021-01-03T13:07:16.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.068+0000 7f749c68e700 1 -- 172.21.15.133:0/4066056222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7494145800 con 0x7f74940a8cc0 2021-01-03T13:07:16.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.068+0000 7f749c68e700 1 -- 172.21.15.133:0/4066056222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74940ac160 con 0x7f74940a8cc0 2021-01-03T13:07:16.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.068+0000 7f74877fe700 1 -- 172.21.15.133:0/4066056222 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7490012550 con 0x7f74940a8cc0 2021-01-03T13:07:16.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.068+0000 7f74877fe700 1 --2- 172.21.15.133:0/4066056222 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f74740554e0 0x7f74740579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:16.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.068+0000 7f74877fe700 1 -- 172.21.15.133:0/4066056222 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f749006e4d0 con 0x7f74940a8cc0 2021-01-03T13:07:16.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.068+0000 7f749a42a700 1 --2- 172.21.15.133:0/4066056222 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f74740554e0 0x7f74740579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:16.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.072+0000 7f749a42a700 1 --2- 172.21.15.133:0/4066056222 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f74740554e0 0x7f74740579a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f748801a000 tx=0x7f7488015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:16.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.076+0000 7f74877fe700 1 -- 172.21.15.133:0/4066056222 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f74900445e0 con 0x7f74940a8cc0 2021-01-03T13:07:16.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.212+0000 7f749c68e700 1 -- 172.21.15.133:0/4066056222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7494057300 con 0x7f74940a8cc0 2021-01-03T13:07:16.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.212+0000 7f74877fe700 1 -- 172.21.15.133:0/4066056222 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v143) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7490047c00 con 0x7f74940a8cc0 2021-01-03T13:07:16.219 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:16.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.216+0000 7f749c68e700 1 -- 172.21.15.133:0/4066056222 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f74740554e0 msgr2=0x7f74740579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.216+0000 7f749c68e700 1 --2- 172.21.15.133:0/4066056222 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f74740554e0 0x7f74740579a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f748801a000 tx=0x7f7488015000).stop 2021-01-03T13:07:16.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.216+0000 7f749c68e700 1 -- 172.21.15.133:0/4066056222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940a8cc0 msgr2=0x7f74941562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.216+0000 7f749c68e700 1 --2- 172.21.15.133:0/4066056222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940a8cc0 0x7f74941562d0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f749000c000 tx=0x7f7490006dc0).stop 2021-01-03T13:07:16.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.216+0000 7f749c68e700 1 -- 172.21.15.133:0/4066056222 shutdown_connections 2021-01-03T13:07:16.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.216+0000 7f749c68e700 1 --2- 172.21.15.133:0/4066056222 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f74740554e0 0x7f74740579a0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.216+0000 7f749c68e700 1 --2- 172.21.15.133:0/4066056222 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f749405fdf0 0x7f7494142220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.216+0000 7f749c68e700 1 --2- 172.21.15.133:0/4066056222 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f74940b5f30 0x7f74941567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.216+0000 7f749c68e700 1 --2- 172.21.15.133:0/4066056222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74940a8cc0 0x7f74941562d0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.216+0000 7f749c68e700 1 -- 172.21.15.133:0/4066056222 >> 172.21.15.133:0/4066056222 conn(0x7f7494061e90 msgr2=0x7f7494143bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:16.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.216+0000 7f749c68e700 1 -- 172.21.15.133:0/4066056222 shutdown_connections 2021-01-03T13:07:16.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.216+0000 7f749c68e700 1 -- 172.21.15.133:0/4066056222 wait complete. 2021-01-03T13:07:16.232 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:07:16.349 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.340+0000 7f95f4f1c700 1 Processor -- start 2021-01-03T13:07:16.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.340+0000 7f95f4f1c700 1 -- start start 2021-01-03T13:07:16.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95f4f1c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f95f0060c40 0x7f95f01400d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:16.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95f4f1c700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f0140cd0 con 0x7f95f00ac590 2021-01-03T13:07:16.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95f4f1c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f0061020 con 0x7f95f00b1ef0 2021-01-03T13:07:16.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95f4f1c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f00b2390 con 0x7f95f0060c40 2021-01-03T13:07:16.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95eed9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f95f00b1ef0 0x7f95f013f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60730/0 (socket says 172.21.15.133:60730) 2021-01-03T13:07:16.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95eed9d700 1 -- 172.21.15.133:0/263302843 learned_addr learned my addr 172.21.15.133:0/263302843 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:16.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95ee59c700 1 --2- 172.21.15.133:0/263302843 >> v2:172.21.15.16:3300/0 conn(0x7f95f0060c40 0x7f95f01400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:16.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95ed59a700 1 -- 172.21.15.133:0/263302843 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828098159 0 0) 0x7f95f0061020 con 0x7f95f00b1ef0 2021-01-03T13:07:16.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95ed59a700 1 -- 172.21.15.133:0/263302843 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95d4003230 con 0x7f95f00b1ef0 2021-01-03T13:07:16.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95ee59c700 1 -- 172.21.15.133:0/263302843 >> v1:172.21.15.133:6789/0 conn(0x7f95f00b1ef0 legacy=0x7f95f013f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95ee59c700 1 -- 172.21.15.133:0/263302843 >> v1:172.21.15.16:6789/0 conn(0x7f95f00ac590 legacy=0x7f95f01405c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95ed59a700 1 -- 172.21.15.133:0/263302843 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944132777 0 0) 0x7f95e40010d0 con 0x7f95f00ac590 2021-01-03T13:07:16.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95ee59c700 1 -- 172.21.15.133:0/263302843 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f00aab50 con 0x7f95f0060c40 2021-01-03T13:07:16.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95ee59c700 1 --2- 172.21.15.133:0/263302843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f0060c40 0x7f95f01400d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f95e0002f30 tx=0x7f95e0006dc0).ready entity=mon.0 client_cookie=de599afea03abf47 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:16.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95ed59a700 1 -- 172.21.15.133:0/263302843 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e0009800 con 0x7f95f0060c40 2021-01-03T13:07:16.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95ed59a700 1 -- 172.21.15.133:0/263302843 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e0009960 con 0x7f95f0060c40 2021-01-03T13:07:16.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95ed59a700 1 -- 172.21.15.133:0/263302843 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e0009cc0 con 0x7f95f0060c40 2021-01-03T13:07:16.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95f4f1c700 1 -- 172.21.15.133:0/263302843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f0060c40 msgr2=0x7f95f01400d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.344+0000 7f95f4f1c700 1 --2- 172.21.15.133:0/263302843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f0060c40 0x7f95f01400d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f95e0002f30 tx=0x7f95e0006dc0).stop 2021-01-03T13:07:16.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.348+0000 7f95f4f1c700 1 -- 172.21.15.133:0/263302843 shutdown_connections 2021-01-03T13:07:16.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.348+0000 7f95f4f1c700 1 --2- 172.21.15.133:0/263302843 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f0060c40 0x7f95f01400d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.348+0000 7f95f4f1c700 1 -- 172.21.15.133:0/263302843 >> 172.21.15.133:0/263302843 conn(0x7f95f005bee0 msgr2=0x7f95f005c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:16.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.348+0000 7f95f4f1c700 1 -- 172.21.15.133:0/263302843 shutdown_connections 2021-01-03T13:07:16.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.348+0000 7f95f4f1c700 1 -- 172.21.15.133:0/263302843 wait complete. 2021-01-03T13:07:16.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.348+0000 7f95f4f1c700 1 Processor -- start 2021-01-03T13:07:16.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.348+0000 7f95f4f1c700 1 -- start start 2021-01-03T13:07:16.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95f4f1c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95f0060c40 0x7f95f0143c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:16.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95f4f1c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95f00ac590 0x7f95f00ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:16.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95f4f1c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f00b1ef0 0x7f95f01557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:16.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95f4f1c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f0096a50 con 0x7f95f00b1ef0 2021-01-03T13:07:16.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95f4f1c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00ad890 con 0x7f95f0060c40 2021-01-03T13:07:16.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95f4f1c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00adb30 con 0x7f95f00ac590 2021-01-03T13:07:16.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95ee59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95f0060c40 0x7f95f0143c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:16.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95ee59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95f0060c40 0x7f95f0143c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39700/0 (socket says 172.21.15.133:39700) 2021-01-03T13:07:16.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95ee59c700 1 -- 172.21.15.133:0/1641274360 learned_addr learned my addr 172.21.15.133:0/1641274360 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:16.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95eed9d700 1 --2- 172.21.15.133:0/1641274360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f00b1ef0 0x7f95f01557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:16.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95edd9b700 1 --2- 172.21.15.133:0/1641274360 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95f00ac590 0x7f95f00ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:16.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95ee59c700 1 -- 172.21.15.133:0/1641274360 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95f00ac590 msgr2=0x7f95f00ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95ee59c700 1 --2- 172.21.15.133:0/1641274360 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95f00ac590 0x7f95f00ad1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95ee59c700 1 -- 172.21.15.133:0/1641274360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f00b1ef0 msgr2=0x7f95f01557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95ee59c700 1 --2- 172.21.15.133:0/1641274360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f00b1ef0 0x7f95f01557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95ee59c700 1 -- 172.21.15.133:0/1641274360 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f0155350 con 0x7f95f0060c40 2021-01-03T13:07:16.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95ee59c700 1 --2- 172.21.15.133:0/1641274360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95f0060c40 0x7f95f0143c70 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7f95e0002f30 tx=0x7f95e0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:16.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95df7fe700 1 -- 172.21.15.133:0/1641274360 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e0011bb0 con 0x7f95f0060c40 2021-01-03T13:07:16.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95df7fe700 1 -- 172.21.15.133:0/1641274360 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e0011d10 con 0x7f95f0060c40 2021-01-03T13:07:16.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95f4f1c700 1 -- 172.21.15.133:0/1641274360 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f00ae630 con 0x7f95f0060c40 2021-01-03T13:07:16.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95df7fe700 1 -- 172.21.15.133:0/1641274360 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e001d640 con 0x7f95f0060c40 2021-01-03T13:07:16.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.352+0000 7f95f4f1c700 1 -- 172.21.15.133:0/1641274360 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f0155ce0 con 0x7f95f0060c40 2021-01-03T13:07:16.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.356+0000 7f95f4f1c700 1 -- 172.21.15.133:0/1641274360 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f00adcf0 con 0x7f95f0060c40 2021-01-03T13:07:16.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.356+0000 7f95df7fe700 1 -- 172.21.15.133:0/1641274360 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f95e0024030 con 0x7f95f0060c40 2021-01-03T13:07:16.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.356+0000 7f95df7fe700 1 --2- 172.21.15.133:0/1641274360 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95cc055350 0x7f95cc057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:16.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.356+0000 7f95df7fe700 1 -- 172.21.15.133:0/1641274360 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f95e006efe0 con 0x7f95f0060c40 2021-01-03T13:07:16.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.356+0000 7f95edd9b700 1 --2- 172.21.15.133:0/1641274360 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95cc055350 0x7f95cc057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:16.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.356+0000 7f95edd9b700 1 --2- 172.21.15.133:0/1641274360 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95cc055350 0x7f95cc057810 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f95e400d000 tx=0x7f95e40016f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:16.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.360+0000 7f95df7fe700 1 -- 172.21.15.133:0/1641274360 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f95e00452e0 con 0x7f95f0060c40 2021-01-03T13:07:16.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.496+0000 7f95f4f1c700 1 -- 172.21.15.133:0/1641274360 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f95f0057300 con 0x7f95f0060c40 2021-01-03T13:07:16.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.500+0000 7f95df7fe700 1 -- 172.21.15.133:0/1641274360 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v143) v1 ==== 100+0+10 (secure 0 0 0) 0x7f95e0022070 con 0x7f95f0060c40 2021-01-03T13:07:16.505 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:16.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.500+0000 7f95f4f1c700 1 -- 172.21.15.133:0/1641274360 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95cc055350 msgr2=0x7f95cc057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.500+0000 7f95f4f1c700 1 --2- 172.21.15.133:0/1641274360 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95cc055350 0x7f95cc057810 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f95e400d000 tx=0x7f95e40016f0).stop 2021-01-03T13:07:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.500+0000 7f95f4f1c700 1 -- 172.21.15.133:0/1641274360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95f0060c40 msgr2=0x7f95f0143c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.500+0000 7f95f4f1c700 1 --2- 172.21.15.133:0/1641274360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95f0060c40 0x7f95f0143c70 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7f95e0002f30 tx=0x7f95e0015000).stop 2021-01-03T13:07:16.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.500+0000 7f95f4f1c700 1 -- 172.21.15.133:0/1641274360 shutdown_connections 2021-01-03T13:07:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.500+0000 7f95f4f1c700 1 --2- 172.21.15.133:0/1641274360 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95cc055350 0x7f95cc057810 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.500+0000 7f95f4f1c700 1 --2- 172.21.15.133:0/1641274360 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95f00b1ef0 0x7f95f01557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.500+0000 7f95f4f1c700 1 --2- 172.21.15.133:0/1641274360 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95f0060c40 0x7f95f0143c70 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.500+0000 7f95f4f1c700 1 --2- 172.21.15.133:0/1641274360 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95f00ac590 0x7f95f00ad1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.500+0000 7f95f4f1c700 1 -- 172.21.15.133:0/1641274360 >> 172.21.15.133:0/1641274360 conn(0x7f95f005bee0 msgr2=0x7f95f0094290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:16.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.500+0000 7f95f4f1c700 1 -- 172.21.15.133:0/1641274360 shutdown_connections 2021-01-03T13:07:16.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.500+0000 7f95f4f1c700 1 -- 172.21.15.133:0/1641274360 wait complete. 2021-01-03T13:07:16.517 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:07:16.518 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:07:16.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.624+0000 7f5c1de4b700 1 Processor -- start 2021-01-03T13:07:16.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.624+0000 7f5c1de4b700 1 -- start start 2021-01-03T13:07:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1de4b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5c180b70b0 0x7f5c1813fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1de4b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c1813ca00 0x7f5c1813ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:16.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1de4b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c180b6b60 con 0x7f5c180b6780 2021-01-03T13:07:16.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1de4b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c180af250 con 0x7f5c1813ca00 2021-01-03T13:07:16.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1de4b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c180afdc0 con 0x7f5c180b70b0 2021-01-03T13:07:16.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1d64a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5c1813ca00 0x7f5c1813ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:16.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1ce49700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5c180b6780 0x7f5c180af6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60740/0 (socket says 172.21.15.133:60740) 2021-01-03T13:07:16.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1ce49700 1 -- 172.21.15.133:0/1368565498 learned_addr learned my addr 172.21.15.133:0/1368565498 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c17fff700 1 --2- 172.21.15.133:0/1368565498 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5c180b70b0 0x7f5c1813fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c177fe700 1 -- 172.21.15.133:0/1368565498 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956114619 0 0) 0x7f5c180b6b60 con 0x7f5c180b6780 2021-01-03T13:07:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c177fe700 1 -- 172.21.15.133:0/1368565498 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bfc003230 con 0x7f5c180b6780 2021-01-03T13:07:16.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1d64a700 1 -- 172.21.15.133:0/1368565498 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5c180b70b0 msgr2=0x7f5c1813fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1d64a700 1 --2- 172.21.15.133:0/1368565498 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5c180b70b0 0x7f5c1813fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c177fe700 1 -- 172.21.15.133:0/1368565498 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3377485181 0 0) 0x7f5bfc003230 con 0x7f5c180b6780 2021-01-03T13:07:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1d64a700 1 -- 172.21.15.133:0/1368565498 >> v1:172.21.15.133:6789/0 conn(0x7f5c180b6780 legacy=0x7f5c180af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1d64a700 1 -- 172.21.15.133:0/1368565498 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c180ada70 con 0x7f5c1813ca00 2021-01-03T13:07:16.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1d64a700 1 --2- 172.21.15.133:0/1368565498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c1813ca00 0x7f5c1813ce90 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f5c0c001870 tx=0x7f5c100091a0).ready entity=mon.1 client_cookie=c3916c87f2965068 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c177fe700 1 -- 172.21.15.133:0/1368565498 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c0c0016d0 con 0x7f5c1813ca00 2021-01-03T13:07:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c177fe700 1 -- 172.21.15.133:0/1368565498 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1000b800 con 0x7f5c1813ca00 2021-01-03T13:07:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c177fe700 1 -- 172.21.15.133:0/1368565498 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c1000b970 con 0x7f5c1813ca00 2021-01-03T13:07:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1de4b700 1 -- 172.21.15.133:0/1368565498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c1813ca00 msgr2=0x7f5c1813ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1de4b700 1 --2- 172.21.15.133:0/1368565498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c1813ca00 0x7f5c1813ce90 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f5c0c001870 tx=0x7f5c100091a0).stop 2021-01-03T13:07:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1de4b700 1 -- 172.21.15.133:0/1368565498 shutdown_connections 2021-01-03T13:07:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1de4b700 1 --2- 172.21.15.133:0/1368565498 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c1813ca00 0x7f5c1813ce90 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1de4b700 1 --2- 172.21.15.133:0/1368565498 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5c180b70b0 0x7f5c1813fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1de4b700 1 -- 172.21.15.133:0/1368565498 >> 172.21.15.133:0/1368565498 conn(0x7f5c18060d90 msgr2=0x7f5c18061170 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:16.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1de4b700 1 -- 172.21.15.133:0/1368565498 shutdown_connections 2021-01-03T13:07:16.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.628+0000 7f5c1de4b700 1 -- 172.21.15.133:0/1368565498 wait complete. 2021-01-03T13:07:16.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1de4b700 1 Processor -- start 2021-01-03T13:07:16.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1de4b700 1 -- start start 2021-01-03T13:07:16.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1de4b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c180b6780 0x7f5c18145660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:16.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1de4b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c180b70b0 0x7f5c1813bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:16.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1de4b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5c1813ca00 0x7f5c1813c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:16.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1de4b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c181509b0 con 0x7f5c180b70b0 2021-01-03T13:07:16.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1de4b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c18150710 con 0x7f5c180b6780 2021-01-03T13:07:16.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1de4b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c180641b0 con 0x7f5c1813ca00 2021-01-03T13:07:16.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1ce49700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c180b6780 0x7f5c18145660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:16.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1ce49700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c180b6780 0x7f5c18145660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39714/0 (socket says 172.21.15.133:39714) 2021-01-03T13:07:16.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1ce49700 1 -- 172.21.15.133:0/3184335125 learned_addr learned my addr 172.21.15.133:0/3184335125 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c17fff700 1 --2- 172.21.15.133:0/3184335125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c180b70b0 0x7f5c1813bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1d64a700 1 --2- 172.21.15.133:0/3184335125 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5c1813ca00 0x7f5c1813c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1ce49700 1 -- 172.21.15.133:0/3184335125 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5c1813ca00 msgr2=0x7f5c1813c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1ce49700 1 --2- 172.21.15.133:0/3184335125 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5c1813ca00 0x7f5c1813c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1ce49700 1 -- 172.21.15.133:0/3184335125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c180b70b0 msgr2=0x7f5c1813bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1ce49700 1 --2- 172.21.15.133:0/3184335125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c180b70b0 0x7f5c1813bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1ce49700 1 -- 172.21.15.133:0/3184335125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c18064450 con 0x7f5c180b6780 2021-01-03T13:07:16.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c17fff700 1 --2- 172.21.15.133:0/3184335125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c180b70b0 0x7f5c1813bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:16.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1d64a700 1 --2- 172.21.15.133:0/3184335125 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5c1813ca00 0x7f5c1813c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:16.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1ce49700 1 --2- 172.21.15.133:0/3184335125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c180b6780 0x7f5c18145660 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f5c0c001930 tx=0x7f5c0c001af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:16.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c15ffb700 1 -- 172.21.15.133:0/3184335125 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c0c007170 con 0x7f5c180b6780 2021-01-03T13:07:16.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c15ffb700 1 -- 172.21.15.133:0/3184335125 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c0072d0 con 0x7f5c180b6780 2021-01-03T13:07:16.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1de4b700 1 -- 172.21.15.133:0/3184335125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c18150430 con 0x7f5c180b6780 2021-01-03T13:07:16.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c15ffb700 1 -- 172.21.15.133:0/3184335125 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c0c00a9a0 con 0x7f5c180b6780 2021-01-03T13:07:16.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1de4b700 1 -- 172.21.15.133:0/3184335125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c18145b50 con 0x7f5c180b6780 2021-01-03T13:07:16.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.632+0000 7f5c1de4b700 1 -- 172.21.15.133:0/3184335125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c180645e0 con 0x7f5c180b6780 2021-01-03T13:07:16.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.636+0000 7f5c15ffb700 1 -- 172.21.15.133:0/3184335125 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5c0c010070 con 0x7f5c180b6780 2021-01-03T13:07:16.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.636+0000 7f5c15ffb700 1 --2- 172.21.15.133:0/3184335125 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5c00055440 0x7f5c00057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:16.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.636+0000 7f5c15ffb700 1 -- 172.21.15.133:0/3184335125 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5c0c06deb0 con 0x7f5c180b6780 2021-01-03T13:07:16.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.636+0000 7f5c17fff700 1 --2- 172.21.15.133:0/3184335125 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5c00055440 0x7f5c00057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:16.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.636+0000 7f5c17fff700 1 --2- 172.21.15.133:0/3184335125 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5c00055440 0x7f5c00057900 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f5c04006000 tx=0x7f5c04008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:16.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.640+0000 7f5c15ffb700 1 -- 172.21.15.133:0/3184335125 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5c0c0440a0 con 0x7f5c180b6780 2021-01-03T13:07:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.828+0000 7f5c1de4b700 1 -- 172.21.15.133:0/3184335125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c18057300 con 0x7f5c180b6780 2021-01-03T13:07:16.833 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.828+0000 7f5c15ffb700 1 -- 172.21.15.133:0/3184335125 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2498 (secure 0 0 0) 0x7f5c0c0476c0 con 0x7f5c180b6780 2021-01-03T13:07:16.834 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:16.834 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":67,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6719,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/2510927889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2510927889},{"type":"v1","addr":"172.21.15.16:6833","nonce":2510927889}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":65},{"gid":6722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1243273461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1243273461},{"type":"v1","addr":"172.21.15.133:6837","nonce":1243273461}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:03.438043+0000","modified":"2021-01-03T13:07:04.442588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7792},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7792":{"gid":7792,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/679359254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":679359254},{"type":"v1","addr":"172.21.15.133:6835","nonce":679359254}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-01-03T13:07:16.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.832+0000 7f5c1de4b700 1 -- 172.21.15.133:0/3184335125 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5c00055440 msgr2=0x7f5c00057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.832+0000 7f5c1de4b700 1 --2- 172.21.15.133:0/3184335125 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5c00055440 0x7f5c00057900 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f5c04006000 tx=0x7f5c04008040).stop 2021-01-03T13:07:16.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.832+0000 7f5c1de4b700 1 -- 172.21.15.133:0/3184335125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c180b6780 msgr2=0x7f5c18145660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.832+0000 7f5c1de4b700 1 --2- 172.21.15.133:0/3184335125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c180b6780 0x7f5c18145660 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f5c0c001930 tx=0x7f5c0c001af0).stop 2021-01-03T13:07:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.832+0000 7f5c1de4b700 1 -- 172.21.15.133:0/3184335125 shutdown_connections 2021-01-03T13:07:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.832+0000 7f5c1de4b700 1 --2- 172.21.15.133:0/3184335125 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f5c00055440 0x7f5c00057900 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.832+0000 7f5c1de4b700 1 --2- 172.21.15.133:0/3184335125 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f5c1813ca00 0x7f5c1813c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.832+0000 7f5c1de4b700 1 --2- 172.21.15.133:0/3184335125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5c180b6780 0x7f5c18145660 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.832+0000 7f5c1de4b700 1 --2- 172.21.15.133:0/3184335125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c180b70b0 0x7f5c1813bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.832+0000 7f5c1de4b700 1 -- 172.21.15.133:0/3184335125 >> 172.21.15.133:0/3184335125 conn(0x7f5c18060d90 msgr2=0x7f5c1813fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.832+0000 7f5c1de4b700 1 -- 172.21.15.133:0/3184335125 shutdown_connections 2021-01-03T13:07:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:16.832+0000 7f5c1de4b700 1 -- 172.21.15.133:0/3184335125 wait complete. 2021-01-03T13:07:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 67 2021-01-03T13:07:17.157 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:07:03.438043+0000', 'modified': '2021-01-03T13:07:04.442588+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7792}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7792': {'gid': 7792, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6835/679359254', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 679359254}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 679359254}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:07:17.157 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:07:17.158 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-01-03T13:07:17.290 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":7792,"want_state":"up:active","state":"up:active","rank_uptime":13.836014077,"mdsmap_epoch":67,"osdmap_epoch":143,"osdmap_epoch_barrier":142,"uptime":19.148327672000001} 2021-01-03T13:07:17.291 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 7792, "mdsmap_epoch": 67, "osdmap_epoch": 143, "osdmap_epoch_barrier": 142, "rank_uptime": 13.836014077, "state": "up:active", "uptime": 19.148327672, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:07:17.292 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:07:17.293 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-01-03T13:07:17.293 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi036.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-01-03T13:07:17.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:17.295 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:17.304 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:07:17.361 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:07:17.361 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:07:17.416 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:07:17.417 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:07:17.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:17.419 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:07:17.464 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:07:17.464 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:17.511 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:07:17.527 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:07:17.528 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:07:17.586 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[12328]: starting ceph client2021-01-03T13:07:17.586+0000 7fc91772a0c0 -1 init, newargv = 0x556bcc10b760 newargc=9 2021-01-03T13:07:17.587 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr: 2021-01-03T13:07:17.596 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:07:17.596 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:07:17.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:17.597 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:07:17.598 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[12328]: starting fuse 2021-01-03T13:07:17.606 INFO:teuthology.orchestra.run.smithi036.stdout:50 2021-01-03T13:07:17.607 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:07:17.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:17.608 DEBUG:teuthology.orchestra.run.smithi036:> sudo python3 -c ' 2021-01-03T13:07:17.609 DEBUG:teuthology.orchestra.run.smithi036:> import glob 2021-01-03T13:07:17.610 DEBUG:teuthology.orchestra.run.smithi036:> import re 2021-01-03T13:07:17.610 DEBUG:teuthology.orchestra.run.smithi036:> import os 2021-01-03T13:07:17.611 DEBUG:teuthology.orchestra.run.smithi036:> import subprocess 2021-01-03T13:07:17.612 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:07:17.612 DEBUG:teuthology.orchestra.run.smithi036:> def find_socket(client_name): 2021-01-03T13:07:17.613 DEBUG:teuthology.orchestra.run.smithi036:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-01-03T13:07:17.614 DEBUG:teuthology.orchestra.run.smithi036:> files = glob.glob(asok_path) 2021-01-03T13:07:17.615 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:07:17.615 DEBUG:teuthology.orchestra.run.smithi036:> # Given a non-glob path, it better be there 2021-01-03T13:07:17.615 DEBUG:teuthology.orchestra.run.smithi036:> if "*" not in asok_path: 2021-01-03T13:07:17.616 DEBUG:teuthology.orchestra.run.smithi036:> assert(len(files) == 1) 2021-01-03T13:07:17.617 DEBUG:teuthology.orchestra.run.smithi036:> return files[0] 2021-01-03T13:07:17.617 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:07:17.617 DEBUG:teuthology.orchestra.run.smithi036:> for f in files: 2021-01-03T13:07:17.618 DEBUG:teuthology.orchestra.run.smithi036:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:07:17.618 DEBUG:teuthology.orchestra.run.smithi036:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:07:17.619 DEBUG:teuthology.orchestra.run.smithi036:> return f 2021-01-03T13:07:17.619 DEBUG:teuthology.orchestra.run.smithi036:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:07:17.619 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:07:17.620 DEBUG:teuthology.orchestra.run.smithi036:> print(find_socket("client.1")) 2021-01-03T13:07:17.620 DEBUG:teuthology.orchestra.run.smithi036:> ' 2021-01-03T13:07:17.701 INFO:teuthology.orchestra.run.smithi036.stdout:/var/run/ceph/ceph-client.1.12328.asok 2021-01-03T13:07:17.706 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.12328.asok 2021-01-03T13:07:17.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:17.707 DEBUG:teuthology.orchestra.run.smithi036:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.12328.asok status 2021-01-03T13:07:17.809 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2021-01-03T13:07:17.809 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": { 2021-01-03T13:07:17.809 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:07:17.810 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:07:17.810 INFO:teuthology.orchestra.run.smithi036.stdout: "entity_id": "1", 2021-01-03T13:07:17.810 INFO:teuthology.orchestra.run.smithi036.stdout: "hostname": "smithi036", 2021-01-03T13:07:17.810 INFO:teuthology.orchestra.run.smithi036.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-01-03T13:07:17.810 INFO:teuthology.orchestra.run.smithi036.stdout: "pid": "12328", 2021-01-03T13:07:17.811 INFO:teuthology.orchestra.run.smithi036.stdout: "root": "/" 2021-01-03T13:07:17.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:07:17.811 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_count": 0, 2021-01-03T13:07:17.811 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_pinned_count": 0, 2021-01-03T13:07:17.811 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 7941, 2021-01-03T13:07:17.812 INFO:teuthology.orchestra.run.smithi036.stdout: "inst": { 2021-01-03T13:07:17.812 INFO:teuthology.orchestra.run.smithi036.stdout: "name": { 2021-01-03T13:07:17.812 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "client", 2021-01-03T13:07:17.812 INFO:teuthology.orchestra.run.smithi036.stdout: "num": 7941 2021-01-03T13:07:17.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:07:17.813 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:07:17.813 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:07:17.813 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:07:17.813 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 1401651446 2021-01-03T13:07:17.813 INFO:teuthology.orchestra.run.smithi036.stdout: } 2021-01-03T13:07:17.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:07:17.814 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:07:17.814 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:07:17.814 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:07:17.814 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 1401651446 2021-01-03T13:07:17.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:07:17.815 INFO:teuthology.orchestra.run.smithi036.stdout: "inst_str": "client.7941 172.21.15.36:0/1401651446", 2021-01-03T13:07:17.815 INFO:teuthology.orchestra.run.smithi036.stdout: "addr_str": "172.21.15.36:0/1401651446", 2021-01-03T13:07:17.815 INFO:teuthology.orchestra.run.smithi036.stdout: "inode_count": 1, 2021-01-03T13:07:17.815 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_epoch": 67, 2021-01-03T13:07:17.816 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch": 143, 2021-01-03T13:07:17.816 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:07:17.816 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklisted": false, 2021-01-03T13:07:17.816 INFO:teuthology.orchestra.run.smithi036.stdout: "fs_name": "cephfs" 2021-01-03T13:07:17.816 INFO:teuthology.orchestra.run.smithi036.stdout:} 2021-01-03T13:07:17.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:17.819 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:17.819 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:17.827 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:07:17.828 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:07:17.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:17.830 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:17.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:17.889 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:17.889 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:17.902 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:07:17.903 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:07:17.904 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2021-01-03T13:07:17.904 DEBUG:teuthology.orchestra.run.smithi007:> import time 2021-01-03T13:07:17.905 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:07:17.906 DEBUG:teuthology.orchestra.run.smithi007:> with open("/home/ubuntu/cephtest/mnt.0/testfile", '"'"'w'"'"') as f: 2021-01-03T13:07:17.907 DEBUG:teuthology.orchestra.run.smithi007:> f.write('"'"'content'"'"') 2021-01-03T13:07:17.907 DEBUG:teuthology.orchestra.run.smithi007:> f.flush() 2021-01-03T13:07:17.907 DEBUG:teuthology.orchestra.run.smithi007:> f.write('"'"'content2'"'"') 2021-01-03T13:07:17.908 DEBUG:teuthology.orchestra.run.smithi007:> while True: 2021-01-03T13:07:17.908 DEBUG:teuthology.orchestra.run.smithi007:> time.sleep(1) 2021-01-03T13:07:17.908 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:07:17.947 DEBUG:teuthology.orchestra.run.smithi007:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-01-03T13:07:17.969 INFO:teuthology.orchestra.run.smithi007.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/testfile': No such file or directory 2021-01-03T13:07:17.971 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-01-03T13:07:18.973 DEBUG:teuthology.orchestra.run.smithi007:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2021-01-03T13:07:18.988 INFO:teuthology.orchestra.run.smithi007.stdout:/home/ubuntu/cephtest/mnt.0/testfile 2021-01-03T13:07:18.989 DEBUG:tasks.cephfs.mount:File testfile became visible from 0 after 1s 2021-01-03T13:07:18.990 DEBUG:teuthology.orchestra.run.smithi036:> sudo ls /home/ubuntu/cephtest/mnt.1/testfile 2021-01-03T13:07:19.028 INFO:teuthology.orchestra.run.smithi036.stdout:/home/ubuntu/cephtest/mnt.1/testfile 2021-01-03T13:07:19.030 DEBUG:tasks.cephfs.mount:File testfile became visible from 1 after 0s 2021-01-03T13:07:19.030 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-01-03T13:07:19.030 DEBUG:teuthology.orchestra.run.smithi036:> cd /home/ubuntu/cephtest/mnt.1 && sudo cat testfile 2021-01-03T13:07:19.119 INFO:teuthology.orchestra.run.smithi036.stdout:content 2021-01-03T13:07:19.135 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:07:19.135 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:07:19.195 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:07:19.214 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:07:19.232 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:07:19.250 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:07:19.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:19.251 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:19.251 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:19.260 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:07:19.261 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:07:19.261 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T13:07:19.262 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:07:19.262 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:19.338 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12752]: fuse finished with error 0 and tester_r 0 2021-01-03T13:07:19.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:19.340 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:19.341 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:19.388 INFO:teuthology.orchestra.run.smithi007.stdout:ext2/ext3 2021-01-03T13:07:19.389 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:07:19.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:07:19.473 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:19.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:19.489 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:19.490 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:19.498 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:07:19.499 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:07:19.499 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi036.front.sepia.ceph.com... 2021-01-03T13:07:19.500 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:07:19.500 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:19.578 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[12328]: fuse finished with error 0 and tester_r 0 2021-01-03T13:07:19.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:19.581 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:19.581 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:19.628 INFO:teuthology.orchestra.run.smithi036.stdout:ext2/ext3 2021-01-03T13:07:19.629 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:07:19.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:07:19.747 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:19.797 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-01-03T13:07:19.800 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-01-03T13:07:19.803 DEBUG:teuthology.orchestra.run.smithi036:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-01-03T13:07:19.840 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-01-03T13:07:19.844 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2021-01-03T13:07:19.844 INFO:teuthology.orchestra.run.smithi016.stdout: chdir = "" 2021-01-03T13:07:19.845 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-01-03T13:07:19.845 INFO:teuthology.orchestra.run.smithi016.stdout: auth supported = cephx 2021-01-03T13:07:19.845 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.845 INFO:teuthology.orchestra.run.smithi016.stdout: filestore xattr use omap = true 2021-01-03T13:07:19.846 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.846 INFO:teuthology.orchestra.run.smithi016.stdout: mon clock drift allowed = 1.000 2021-01-03T13:07:19.846 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.846 INFO:teuthology.orchestra.run.smithi016.stdout: osd crush chooseleaf type = 0 2021-01-03T13:07:19.847 INFO:teuthology.orchestra.run.smithi016.stdout: auth debug = true 2021-01-03T13:07:19.847 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.847 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on old message = true 2021-01-03T13:07:19.847 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on bug = true 2021-01-03T13:07:19.847 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.848 INFO:teuthology.orchestra.run.smithi016.stdout: mon max pg per osd = 10000 # >= luminous 2021-01-03T13:07:19.848 INFO:teuthology.orchestra.run.smithi016.stdout: mon pg warn max object skew = 0 2021-01-03T13:07:19.848 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.850 INFO:teuthology.orchestra.run.smithi016.stdout: # disable pg_autoscaler by default for new pools 2021-01-03T13:07:19.850 INFO:teuthology.orchestra.run.smithi016.stdout: osd_pool_default_pg_autoscale_mode = off 2021-01-03T13:07:19.851 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.851 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default size = 2 2021-01-03T13:07:19.851 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.851 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow primary affinity = true 2021-01-03T13:07:19.852 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow pg remap = true 2021-01-03T13:07:19.852 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on legacy crush tunables = false 2021-01-03T13:07:19.852 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on crush straw calc version zero = false 2021-01-03T13:07:19.852 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on no sortbitwise = false 2021-01-03T13:07:19.852 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on osd down out interval zero = false 2021-01-03T13:07:19.853 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on too few osds = false 2021-01-03T13:07:19.853 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-01-03T13:07:19.853 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_no_redundancy = false 2021-01-03T13:07:19.853 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.853 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-01-03T13:07:19.854 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.854 INFO:teuthology.orchestra.run.smithi016.stdout: osd default data pool replay window = 5 2021-01-03T13:07:19.854 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.854 INFO:teuthology.orchestra.run.smithi016.stdout: mon allow pool delete = true 2021-01-03T13:07:19.854 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.855 INFO:teuthology.orchestra.run.smithi016.stdout: mon cluster log file level = debug 2021-01-03T13:07:19.855 INFO:teuthology.orchestra.run.smithi016.stdout: debug asserts on shutdown = true 2021-01-03T13:07:19.855 INFO:teuthology.orchestra.run.smithi016.stdout: mon health detail to clog = false 2021-01-03T13:07:19.855 INFO:teuthology.orchestra.run.smithi016.stdout: mon host = "172.21.15.133,172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790]" 2021-01-03T13:07:19.855 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = 80bc9ef3-5820-4b9f-9c57-8f734e4c440e 2021-01-03T13:07:19.856 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.856 INFO:teuthology.orchestra.run.smithi016.stdout:[osd] 2021-01-03T13:07:19.856 INFO:teuthology.orchestra.run.smithi016.stdout: osd journal size = 100 2021-01-03T13:07:19.856 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.857 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub load threshold = 5.0 2021-01-03T13:07:19.857 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub max interval = 600 2021-01-03T13:07:19.857 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.858 INFO:teuthology.orchestra.run.smithi016.stdout: osd recover clone overlap = true 2021-01-03T13:07:19.858 INFO:teuthology.orchestra.run.smithi016.stdout: osd recovery max chunk = 1048576 2021-01-03T13:07:19.858 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.858 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug shutdown = true 2021-01-03T13:07:19.859 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug op order = true 2021-01-03T13:07:19.859 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug verify stray on activate = true 2021-01-03T13:07:19.859 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.859 INFO:teuthology.orchestra.run.smithi016.stdout: osd open classes on start = true 2021-01-03T13:07:19.859 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug pg log writeout = true 2021-01-03T13:07:19.860 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.860 INFO:teuthology.orchestra.run.smithi016.stdout: osd deep scrub update digest min age = 30 2021-01-03T13:07:19.860 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.861 INFO:teuthology.orchestra.run.smithi016.stdout: osd map max advance = 10 2021-01-03T13:07:19.861 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.861 INFO:teuthology.orchestra.run.smithi016.stdout: journal zero on create = true 2021-01-03T13:07:19.861 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.862 INFO:teuthology.orchestra.run.smithi016.stdout: filestore ondisk finisher threads = 3 2021-01-03T13:07:19.862 INFO:teuthology.orchestra.run.smithi016.stdout: filestore apply finisher threads = 3 2021-01-03T13:07:19.862 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.862 INFO:teuthology.orchestra.run.smithi016.stdout: bdev debug aio = true 2021-01-03T13:07:19.862 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug misdirected ops = true 2021-01-03T13:07:19.863 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore block size = 96636764160 2021-01-03T13:07:19.863 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore compression mode = aggressive 2021-01-03T13:07:19.863 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore fsck on mount = True 2021-01-03T13:07:19.863 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluefs = 20 2021-01-03T13:07:19.863 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluestore = 20 2021-01-03T13:07:19.864 INFO:teuthology.orchestra.run.smithi016.stdout: debug filestore = 20 2021-01-03T13:07:19.864 INFO:teuthology.orchestra.run.smithi016.stdout: debug journal = 20 2021-01-03T13:07:19.864 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 20 2021-01-03T13:07:19.864 INFO:teuthology.orchestra.run.smithi016.stdout: debug osd = 25 2021-01-03T13:07:19.864 INFO:teuthology.orchestra.run.smithi016.stdout: debug rocksdb = 10 2021-01-03T13:07:19.865 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd backfillfull_ratio = 0.85 2021-01-03T13:07:19.865 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd full ratio = 0.9 2021-01-03T13:07:19.865 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd nearfull ratio = 0.8 2021-01-03T13:07:19.865 INFO:teuthology.orchestra.run.smithi016.stdout: osd failsafe full ratio = 0.95 2021-01-03T13:07:19.865 INFO:teuthology.orchestra.run.smithi016.stdout: osd objectstore = bluestore 2021-01-03T13:07:19.866 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2021-01-03T13:07:19.866 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.866 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr] 2021-01-03T13:07:19.866 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2021-01-03T13:07:19.866 INFO:teuthology.orchestra.run.smithi016.stdout: debug mgr = 20 2021-01-03T13:07:19.867 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2021-01-03T13:07:19.867 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2021-01-03T13:07:19.867 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2021-01-03T13:07:19.867 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2021-01-03T13:07:19.867 INFO:teuthology.orchestra.run.smithi016.stdout: mgr/telemetry/nag = false 2021-01-03T13:07:19.868 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.868 INFO:teuthology.orchestra.run.smithi016.stdout:[mon] 2021-01-03T13:07:19.868 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2021-01-03T13:07:19.868 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2021-01-03T13:07:19.868 INFO:teuthology.orchestra.run.smithi016.stdout: debug paxos = 20 2021-01-03T13:07:19.869 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2021-01-03T13:07:19.869 INFO:teuthology.orchestra.run.smithi016.stdout: mon data avail warn = 5 2021-01-03T13:07:19.869 INFO:teuthology.orchestra.run.smithi016.stdout: mon mgr mkfs grace = 240 2021-01-03T13:07:19.869 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2021-01-03T13:07:19.869 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd reporter subtree level = osd 2021-01-03T13:07:19.870 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd prime pg temp = true 2021-01-03T13:07:19.870 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2021-01-03T13:07:19.870 INFO:teuthology.orchestra.run.smithi016.stdout: mon op complaint time = 120 2021-01-03T13:07:19.870 INFO:teuthology.orchestra.run.smithi016.stdout: 2021-01-03T13:07:19.871 INFO:teuthology.orchestra.run.smithi016.stdout:[client] 2021-01-03T13:07:19.871 INFO:teuthology.orchestra.run.smithi016.stdout: rgw cache enabled = true 2021-01-03T13:07:19.871 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable ops log = true 2021-01-03T13:07:19.871 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable usage log = true 2021-01-03T13:07:19.871 INFO:teuthology.orchestra.run.smithi016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-01-03T13:07:19.872 INFO:teuthology.orchestra.run.smithi016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-01-03T13:07:19.872 INFO:teuthology.orchestra.run.smithi016.stdout: client mount timeout = 600 2021-01-03T13:07:19.872 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2021-01-03T13:07:19.872 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2021-01-03T13:07:19.872 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 15m 2021-01-03T13:07:19.873 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 15m 2021-01-03T13:07:19.873 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.a] 2021-01-03T13:07:19.873 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.b] 2021-01-03T13:07:19.873 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.c] 2021-01-03T13:07:19.873 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2021-01-03T13:07:19.874 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2021-01-03T13:07:19.874 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2021-01-03T13:07:19.874 INFO:teuthology.orchestra.run.smithi016.stdout:[mds] 2021-01-03T13:07:19.874 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds = 20 2021-01-03T13:07:19.874 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2021-01-03T13:07:19.875 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal frag = True 2021-01-03T13:07:19.875 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal fragment size max = 10000 2021-01-03T13:07:19.875 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal merge size = 5 2021-01-03T13:07:19.875 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal split bits = 3 2021-01-03T13:07:19.875 INFO:teuthology.orchestra.run.smithi016.stdout: mds bal split size = 100 2021-01-03T13:07:19.876 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug frag = True 2021-01-03T13:07:19.876 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug scatterstat = True 2021-01-03T13:07:19.876 INFO:teuthology.orchestra.run.smithi016.stdout: mds op complaint time = 180 2021-01-03T13:07:19.876 INFO:teuthology.orchestra.run.smithi016.stdout: mds verify scatter = True 2021-01-03T13:07:19.876 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2021-01-03T13:07:19.877 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 15m 2021-01-03T13:07:19.877 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 15m 2021-01-03T13:07:19.877 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2021-01-03T13:07:19.877 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2021-01-03T13:07:19.877 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-01-03T13:07:19.878 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2021-01-03T13:07:19.878 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.878 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2021-01-03T13:07:19.878 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.878 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2021-01-03T13:07:19.879 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.879 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2021-01-03T13:07:19.879 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2021-01-03T13:07:19.879 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.879 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2021-01-03T13:07:19.880 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2021-01-03T13:07:19.880 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.880 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2021-01-03T13:07:19.880 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2021-01-03T13:07:19.880 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.881 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2021-01-03T13:07:19.881 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2021-01-03T13:07:19.881 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.881 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2021-01-03T13:07:19.881 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.882 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2021-01-03T13:07:19.882 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2021-01-03T13:07:19.882 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2021-01-03T13:07:19.882 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2021-01-03T13:07:19.882 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2021-01-03T13:07:19.883 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2021-01-03T13:07:19.883 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2021-01-03T13:07:19.883 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-01-03T13:07:19.883 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2021-01-03T13:07:19.883 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.884 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-01-03T13:07:19.884 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.884 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2021-01-03T13:07:19.884 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.884 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2021-01-03T13:07:19.885 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.885 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2021-01-03T13:07:19.885 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2021-01-03T13:07:19.885 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2021-01-03T13:07:19.885 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "172.21.15.133,172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790]" 2021-01-03T13:07:19.886 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = 80bc9ef3-5820-4b9f-9c57-8f734e4c440e 2021-01-03T13:07:19.886 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.886 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2021-01-03T13:07:19.886 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2021-01-03T13:07:19.886 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.887 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2021-01-03T13:07:19.887 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2021-01-03T13:07:19.887 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.887 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2021-01-03T13:07:19.887 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2021-01-03T13:07:19.888 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.888 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2021-01-03T13:07:19.888 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2021-01-03T13:07:19.888 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2021-01-03T13:07:19.888 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.889 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2021-01-03T13:07:19.889 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2021-01-03T13:07:19.889 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.889 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2021-01-03T13:07:19.889 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.890 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2021-01-03T13:07:19.890 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.890 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2021-01-03T13:07:19.890 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.890 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2021-01-03T13:07:19.891 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2021-01-03T13:07:19.891 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.891 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2021-01-03T13:07:19.891 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2021-01-03T13:07:19.891 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2021-01-03T13:07:19.892 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore compression mode = aggressive 2021-01-03T13:07:19.892 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2021-01-03T13:07:19.892 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 20 2021-01-03T13:07:19.892 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 20 2021-01-03T13:07:19.892 INFO:teuthology.orchestra.run.smithi007.stdout: debug filestore = 20 2021-01-03T13:07:19.892 INFO:teuthology.orchestra.run.smithi007.stdout: debug journal = 20 2021-01-03T13:07:19.893 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 20 2021-01-03T13:07:19.893 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 25 2021-01-03T13:07:19.893 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 10 2021-01-03T13:07:19.893 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2021-01-03T13:07:19.893 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2021-01-03T13:07:19.894 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2021-01-03T13:07:19.894 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2021-01-03T13:07:19.894 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2021-01-03T13:07:19.894 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2021-01-03T13:07:19.895 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.895 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2021-01-03T13:07:19.895 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2021-01-03T13:07:19.895 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2021-01-03T13:07:19.895 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2021-01-03T13:07:19.895 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2021-01-03T13:07:19.896 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2021-01-03T13:07:19.896 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2021-01-03T13:07:19.896 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2021-01-03T13:07:19.896 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.896 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2021-01-03T13:07:19.897 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2021-01-03T13:07:19.897 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2021-01-03T13:07:19.897 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2021-01-03T13:07:19.897 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2021-01-03T13:07:19.897 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2021-01-03T13:07:19.898 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2021-01-03T13:07:19.898 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2021-01-03T13:07:19.898 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2021-01-03T13:07:19.898 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2021-01-03T13:07:19.898 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2021-01-03T13:07:19.899 INFO:teuthology.orchestra.run.smithi007.stdout: mon op complaint time = 120 2021-01-03T13:07:19.899 INFO:teuthology.orchestra.run.smithi007.stdout: 2021-01-03T13:07:19.899 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2021-01-03T13:07:19.899 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2021-01-03T13:07:19.899 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = true 2021-01-03T13:07:19.900 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2021-01-03T13:07:19.900 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-01-03T13:07:19.900 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-01-03T13:07:19.900 INFO:teuthology.orchestra.run.smithi007.stdout: client mount timeout = 600 2021-01-03T13:07:19.900 INFO:teuthology.orchestra.run.smithi007.stdout: debug client = 20 2021-01-03T13:07:19.900 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2021-01-03T13:07:19.901 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 15m 2021-01-03T13:07:19.901 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 15m 2021-01-03T13:07:19.901 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2021-01-03T13:07:19.901 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2021-01-03T13:07:19.901 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2021-01-03T13:07:19.902 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2021-01-03T13:07:19.902 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c] 2021-01-03T13:07:19.902 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b] 2021-01-03T13:07:19.902 INFO:teuthology.orchestra.run.smithi007.stdout:[mds] 2021-01-03T13:07:19.902 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds = 20 2021-01-03T13:07:19.903 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2021-01-03T13:07:19.903 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal frag = True 2021-01-03T13:07:19.903 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal fragment size max = 10000 2021-01-03T13:07:19.903 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal merge size = 5 2021-01-03T13:07:19.903 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal split bits = 3 2021-01-03T13:07:19.904 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal split size = 100 2021-01-03T13:07:19.904 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug frag = True 2021-01-03T13:07:19.904 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug scatterstat = True 2021-01-03T13:07:19.904 INFO:teuthology.orchestra.run.smithi007.stdout: mds op complaint time = 180 2021-01-03T13:07:19.904 INFO:teuthology.orchestra.run.smithi007.stdout: mds verify scatter = True 2021-01-03T13:07:19.905 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2021-01-03T13:07:19.905 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 15m 2021-01-03T13:07:19.905 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 15m 2021-01-03T13:07:19.907 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2021-01-03T13:07:19.908 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2021-01-03T13:07:19.908 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-01-03T13:07:19.908 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2021-01-03T13:07:19.908 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.908 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2021-01-03T13:07:19.909 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.909 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2021-01-03T13:07:19.909 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.909 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2021-01-03T13:07:19.909 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2021-01-03T13:07:19.910 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.910 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2021-01-03T13:07:19.910 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2021-01-03T13:07:19.910 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.911 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2021-01-03T13:07:19.911 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2021-01-03T13:07:19.911 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.911 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2021-01-03T13:07:19.911 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2021-01-03T13:07:19.912 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.912 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2021-01-03T13:07:19.912 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.912 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2021-01-03T13:07:19.912 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2021-01-03T13:07:19.912 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2021-01-03T13:07:19.913 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2021-01-03T13:07:19.913 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2021-01-03T13:07:19.913 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2021-01-03T13:07:19.913 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2021-01-03T13:07:19.913 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-01-03T13:07:19.914 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2021-01-03T13:07:19.914 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.914 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-01-03T13:07:19.914 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.915 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2021-01-03T13:07:19.915 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.915 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2021-01-03T13:07:19.915 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.915 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2021-01-03T13:07:19.915 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2021-01-03T13:07:19.916 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2021-01-03T13:07:19.916 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = "172.21.15.133,172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790]" 2021-01-03T13:07:19.916 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = 80bc9ef3-5820-4b9f-9c57-8f734e4c440e 2021-01-03T13:07:19.916 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.916 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2021-01-03T13:07:19.917 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2021-01-03T13:07:19.917 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.917 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2021-01-03T13:07:19.917 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2021-01-03T13:07:19.917 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.918 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2021-01-03T13:07:19.918 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2021-01-03T13:07:19.918 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.918 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2021-01-03T13:07:19.918 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2021-01-03T13:07:19.919 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2021-01-03T13:07:19.919 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.919 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2021-01-03T13:07:19.919 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2021-01-03T13:07:19.919 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.920 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2021-01-03T13:07:19.920 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.920 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2021-01-03T13:07:19.920 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.920 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2021-01-03T13:07:19.921 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.921 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2021-01-03T13:07:19.921 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2021-01-03T13:07:19.921 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.921 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2021-01-03T13:07:19.922 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2021-01-03T13:07:19.922 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2021-01-03T13:07:19.922 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore compression mode = aggressive 2021-01-03T13:07:19.922 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2021-01-03T13:07:19.922 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 20 2021-01-03T13:07:19.923 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 20 2021-01-03T13:07:19.923 INFO:teuthology.orchestra.run.smithi133.stdout: debug filestore = 20 2021-01-03T13:07:19.923 INFO:teuthology.orchestra.run.smithi133.stdout: debug journal = 20 2021-01-03T13:07:19.923 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 20 2021-01-03T13:07:19.923 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 25 2021-01-03T13:07:19.924 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 10 2021-01-03T13:07:19.924 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2021-01-03T13:07:19.924 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2021-01-03T13:07:19.924 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2021-01-03T13:07:19.924 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 0.95 2021-01-03T13:07:19.924 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = bluestore 2021-01-03T13:07:19.925 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2021-01-03T13:07:19.925 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.925 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2021-01-03T13:07:19.925 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2021-01-03T13:07:19.925 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2021-01-03T13:07:19.926 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2021-01-03T13:07:19.926 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2021-01-03T13:07:19.926 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2021-01-03T13:07:19.926 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2021-01-03T13:07:19.926 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2021-01-03T13:07:19.927 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.927 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2021-01-03T13:07:19.927 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2021-01-03T13:07:19.927 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2021-01-03T13:07:19.927 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2021-01-03T13:07:19.928 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2021-01-03T13:07:19.928 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2021-01-03T13:07:19.928 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2021-01-03T13:07:19.928 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2021-01-03T13:07:19.928 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2021-01-03T13:07:19.929 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2021-01-03T13:07:19.929 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2021-01-03T13:07:19.929 INFO:teuthology.orchestra.run.smithi133.stdout: mon op complaint time = 120 2021-01-03T13:07:19.929 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:19.929 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2021-01-03T13:07:19.930 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2021-01-03T13:07:19.930 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = true 2021-01-03T13:07:19.930 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2021-01-03T13:07:19.930 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-01-03T13:07:19.930 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-01-03T13:07:19.931 INFO:teuthology.orchestra.run.smithi133.stdout: client mount timeout = 600 2021-01-03T13:07:19.931 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2021-01-03T13:07:19.931 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2021-01-03T13:07:19.931 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 15m 2021-01-03T13:07:19.931 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 15m 2021-01-03T13:07:19.932 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2021-01-03T13:07:19.932 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.b] 2021-01-03T13:07:19.932 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.c] 2021-01-03T13:07:19.932 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2021-01-03T13:07:19.932 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2021-01-03T13:07:19.933 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2021-01-03T13:07:19.933 INFO:teuthology.orchestra.run.smithi133.stdout:[mds] 2021-01-03T13:07:19.933 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds = 20 2021-01-03T13:07:19.933 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2021-01-03T13:07:19.933 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal frag = True 2021-01-03T13:07:19.934 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal fragment size max = 10000 2021-01-03T13:07:19.934 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal merge size = 5 2021-01-03T13:07:19.934 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal split bits = 3 2021-01-03T13:07:19.934 INFO:teuthology.orchestra.run.smithi133.stdout: mds bal split size = 100 2021-01-03T13:07:19.934 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug frag = True 2021-01-03T13:07:19.934 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug scatterstat = True 2021-01-03T13:07:19.935 INFO:teuthology.orchestra.run.smithi133.stdout: mds op complaint time = 180 2021-01-03T13:07:19.935 INFO:teuthology.orchestra.run.smithi133.stdout: mds verify scatter = True 2021-01-03T13:07:19.935 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2021-01-03T13:07:19.935 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 15m 2021-01-03T13:07:19.935 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 15m 2021-01-03T13:07:19.936 INFO:teuthology.orchestra.run.smithi036.stdout:[global] 2021-01-03T13:07:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: chdir = "" 2021-01-03T13:07:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-01-03T13:07:19.936 INFO:teuthology.orchestra.run.smithi036.stdout: auth supported = cephx 2021-01-03T13:07:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: filestore xattr use omap = true 2021-01-03T13:07:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: mon clock drift allowed = 1.000 2021-01-03T13:07:19.937 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: osd crush chooseleaf type = 0 2021-01-03T13:07:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: auth debug = true 2021-01-03T13:07:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: ms die on old message = true 2021-01-03T13:07:19.938 INFO:teuthology.orchestra.run.smithi036.stdout: ms die on bug = true 2021-01-03T13:07:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: mon max pg per osd = 10000 # >= luminous 2021-01-03T13:07:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: mon pg warn max object skew = 0 2021-01-03T13:07:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.939 INFO:teuthology.orchestra.run.smithi036.stdout: # disable pg_autoscaler by default for new pools 2021-01-03T13:07:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: osd_pool_default_pg_autoscale_mode = off 2021-01-03T13:07:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: osd pool default size = 2 2021-01-03T13:07:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.940 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd allow primary affinity = true 2021-01-03T13:07:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd allow pg remap = true 2021-01-03T13:07:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on legacy crush tunables = false 2021-01-03T13:07:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on crush straw calc version zero = false 2021-01-03T13:07:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on no sortbitwise = false 2021-01-03T13:07:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on osd down out interval zero = false 2021-01-03T13:07:19.941 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on too few osds = false 2021-01-03T13:07:19.942 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-01-03T13:07:19.942 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_pool_no_redundancy = false 2021-01-03T13:07:19.942 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.942 INFO:teuthology.orchestra.run.smithi036.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-01-03T13:07:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: osd default data pool replay window = 5 2021-01-03T13:07:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: mon allow pool delete = true 2021-01-03T13:07:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.943 INFO:teuthology.orchestra.run.smithi036.stdout: mon cluster log file level = debug 2021-01-03T13:07:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: debug asserts on shutdown = true 2021-01-03T13:07:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: mon health detail to clog = false 2021-01-03T13:07:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: mon host = "172.21.15.133,172.21.15.16,[v2:172.21.15.16:3301,v1:172.21.15.16:6790]" 2021-01-03T13:07:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: fsid = 80bc9ef3-5820-4b9f-9c57-8f734e4c440e 2021-01-03T13:07:19.944 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.945 INFO:teuthology.orchestra.run.smithi036.stdout:[osd] 2021-01-03T13:07:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: osd journal size = 100 2021-01-03T13:07:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub load threshold = 5.0 2021-01-03T13:07:19.945 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub max interval = 600 2021-01-03T13:07:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: osd recover clone overlap = true 2021-01-03T13:07:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: osd recovery max chunk = 1048576 2021-01-03T13:07:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.946 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug shutdown = true 2021-01-03T13:07:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug op order = true 2021-01-03T13:07:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug verify stray on activate = true 2021-01-03T13:07:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: osd open classes on start = true 2021-01-03T13:07:19.947 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug pg log writeout = true 2021-01-03T13:07:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: osd deep scrub update digest min age = 30 2021-01-03T13:07:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: osd map max advance = 10 2021-01-03T13:07:19.948 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: journal zero on create = true 2021-01-03T13:07:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: filestore ondisk finisher threads = 3 2021-01-03T13:07:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: filestore apply finisher threads = 3 2021-01-03T13:07:19.949 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: bdev debug aio = true 2021-01-03T13:07:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug misdirected ops = true 2021-01-03T13:07:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore block size = 96636764160 2021-01-03T13:07:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore compression mode = aggressive 2021-01-03T13:07:19.950 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore fsck on mount = True 2021-01-03T13:07:19.951 INFO:teuthology.orchestra.run.smithi036.stdout: debug bluefs = 20 2021-01-03T13:07:19.951 INFO:teuthology.orchestra.run.smithi036.stdout: debug bluestore = 20 2021-01-03T13:07:19.951 INFO:teuthology.orchestra.run.smithi036.stdout: debug filestore = 20 2021-01-03T13:07:19.951 INFO:teuthology.orchestra.run.smithi036.stdout: debug journal = 20 2021-01-03T13:07:19.951 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 20 2021-01-03T13:07:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: debug osd = 25 2021-01-03T13:07:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: debug rocksdb = 10 2021-01-03T13:07:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd backfillfull_ratio = 0.85 2021-01-03T13:07:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd full ratio = 0.9 2021-01-03T13:07:19.952 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd nearfull ratio = 0.8 2021-01-03T13:07:19.953 INFO:teuthology.orchestra.run.smithi036.stdout: osd failsafe full ratio = 0.95 2021-01-03T13:07:19.953 INFO:teuthology.orchestra.run.smithi036.stdout: osd objectstore = bluestore 2021-01-03T13:07:19.953 INFO:teuthology.orchestra.run.smithi036.stdout: osd op complaint time = 180 2021-01-03T13:07:19.953 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.953 INFO:teuthology.orchestra.run.smithi036.stdout:[mgr] 2021-01-03T13:07:19.954 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2021-01-03T13:07:19.954 INFO:teuthology.orchestra.run.smithi036.stdout: debug mgr = 20 2021-01-03T13:07:19.954 INFO:teuthology.orchestra.run.smithi036.stdout: debug mon = 20 2021-01-03T13:07:19.954 INFO:teuthology.orchestra.run.smithi036.stdout: debug auth = 20 2021-01-03T13:07:19.954 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min pgs per osd = 4 2021-01-03T13:07:19.955 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min bytes per osd = 10 2021-01-03T13:07:19.955 INFO:teuthology.orchestra.run.smithi036.stdout: mgr/telemetry/nag = false 2021-01-03T13:07:19.955 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.955 INFO:teuthology.orchestra.run.smithi036.stdout:[mon] 2021-01-03T13:07:19.955 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2021-01-03T13:07:19.956 INFO:teuthology.orchestra.run.smithi036.stdout: debug mon = 20 2021-01-03T13:07:19.956 INFO:teuthology.orchestra.run.smithi036.stdout: debug paxos = 20 2021-01-03T13:07:19.956 INFO:teuthology.orchestra.run.smithi036.stdout: debug auth = 20 2021-01-03T13:07:19.956 INFO:teuthology.orchestra.run.smithi036.stdout: mon data avail warn = 5 2021-01-03T13:07:19.956 INFO:teuthology.orchestra.run.smithi036.stdout: mon mgr mkfs grace = 240 2021-01-03T13:07:19.956 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min pgs per osd = 4 2021-01-03T13:07:19.957 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd reporter subtree level = osd 2021-01-03T13:07:19.957 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd prime pg temp = true 2021-01-03T13:07:19.957 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min bytes per osd = 10 2021-01-03T13:07:19.957 INFO:teuthology.orchestra.run.smithi036.stdout: mon op complaint time = 120 2021-01-03T13:07:19.957 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-01-03T13:07:19.958 INFO:teuthology.orchestra.run.smithi036.stdout:[client] 2021-01-03T13:07:19.958 INFO:teuthology.orchestra.run.smithi036.stdout: rgw cache enabled = true 2021-01-03T13:07:19.958 INFO:teuthology.orchestra.run.smithi036.stdout: rgw enable ops log = true 2021-01-03T13:07:19.958 INFO:teuthology.orchestra.run.smithi036.stdout: rgw enable usage log = true 2021-01-03T13:07:19.958 INFO:teuthology.orchestra.run.smithi036.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-01-03T13:07:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-01-03T13:07:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: client mount timeout = 600 2021-01-03T13:07:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: debug client = 20 2021-01-03T13:07:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2021-01-03T13:07:19.959 INFO:teuthology.orchestra.run.smithi036.stdout: rados mon op timeout = 15m 2021-01-03T13:07:19.960 INFO:teuthology.orchestra.run.smithi036.stdout: rados osd op timeout = 15m 2021-01-03T13:07:19.960 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.a] 2021-01-03T13:07:19.960 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.b] 2021-01-03T13:07:19.960 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.c] 2021-01-03T13:07:19.960 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.a] 2021-01-03T13:07:19.961 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.c] 2021-01-03T13:07:19.961 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.b] 2021-01-03T13:07:19.961 INFO:teuthology.orchestra.run.smithi036.stdout:[mds] 2021-01-03T13:07:19.961 INFO:teuthology.orchestra.run.smithi036.stdout: debug mds = 20 2021-01-03T13:07:19.961 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2021-01-03T13:07:19.962 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal frag = True 2021-01-03T13:07:19.962 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal fragment size max = 10000 2021-01-03T13:07:19.962 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal merge size = 5 2021-01-03T13:07:19.962 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal split bits = 3 2021-01-03T13:07:19.962 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal split size = 100 2021-01-03T13:07:19.963 INFO:teuthology.orchestra.run.smithi036.stdout: mds debug frag = True 2021-01-03T13:07:19.963 INFO:teuthology.orchestra.run.smithi036.stdout: mds debug scatterstat = True 2021-01-03T13:07:19.963 INFO:teuthology.orchestra.run.smithi036.stdout: mds op complaint time = 180 2021-01-03T13:07:19.963 INFO:teuthology.orchestra.run.smithi036.stdout: mds verify scatter = True 2021-01-03T13:07:19.963 INFO:teuthology.orchestra.run.smithi036.stdout: osd op complaint time = 180 2021-01-03T13:07:19.963 INFO:teuthology.orchestra.run.smithi036.stdout: rados mon op timeout = 15m 2021-01-03T13:07:19.964 INFO:teuthology.orchestra.run.smithi036.stdout: rados osd op timeout = 15m 2021-01-03T13:07:19.964 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-01-03T13:07:20.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.083+0000 7f05bb215700 1 Processor -- start 2021-01-03T13:07:20.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.083+0000 7f05bb215700 1 -- start start 2021-01-03T13:07:20.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.083+0000 7f05bb215700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f05b405f920 0x7f05b40b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:20.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.083+0000 7f05bb215700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05b4066f30 0x7f05b40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:20.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.083+0000 7f05bb215700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b405fd00 con 0x7f05b40b1590 2021-01-03T13:07:20.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.083+0000 7f05bb215700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b40ae700 con 0x7f05b405f920 2021-01-03T13:07:20.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.083+0000 7f05bb215700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40accd0 con 0x7f05b4066f30 2021-01-03T13:07:20.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.083+0000 7f05ba213700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f05b405f920 0x7f05b40b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:20.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.083+0000 7f05ba213700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f05b405f920 0x7f05b40b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39722/0 (socket says 172.21.15.133:39722) 2021-01-03T13:07:20.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.083+0000 7f05ba213700 1 -- 172.21.15.133:0/3235424792 learned_addr learned my addr 172.21.15.133:0/3235424792 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:20.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.083+0000 7f05b9a12700 1 --2- 172.21.15.133:0/3235424792 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05b4066f30 0x7f05b40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:20.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.083+0000 7f05ba213700 1 -- 172.21.15.133:0/3235424792 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05b4066f30 msgr2=0x7f05b40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:20.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.083+0000 7f05ba213700 1 --2- 172.21.15.133:0/3235424792 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05b4066f30 0x7f05b40b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:20.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.083+0000 7f05ba213700 1 -- 172.21.15.133:0/3235424792 >> v1:172.21.15.16:6789/0 conn(0x7f05b40b1590 legacy=0x7f05b40613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:20.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.083+0000 7f05ba213700 1 -- 172.21.15.133:0/3235424792 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b40acf70 con 0x7f05b405f920 2021-01-03T13:07:20.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.083+0000 7f05b9a12700 1 --2- 172.21.15.133:0/3235424792 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05b4066f30 0x7f05b40b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:20.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.083+0000 7f05ba213700 1 --2- 172.21.15.133:0/3235424792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05b405f920 0x7f05b40b0ab0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7f05ac002f30 tx=0x7f05ac006e80).ready entity=mon.1 client_cookie=2801d344ffa40d48 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:20.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.087+0000 7f05b9211700 1 -- 172.21.15.133:0/3235424792 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05ac0097f0 con 0x7f05b405f920 2021-01-03T13:07:20.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.087+0000 7f05b9211700 1 -- 172.21.15.133:0/3235424792 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac009950 con 0x7f05b405f920 2021-01-03T13:07:20.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.087+0000 7f05b9211700 1 -- 172.21.15.133:0/3235424792 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05ac009cb0 con 0x7f05b405f920 2021-01-03T13:07:20.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.087+0000 7f05bb215700 1 -- 172.21.15.133:0/3235424792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05b405f920 msgr2=0x7f05b40b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:20.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.087+0000 7f05bb215700 1 --2- 172.21.15.133:0/3235424792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05b405f920 0x7f05b40b0ab0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7f05ac002f30 tx=0x7f05ac006e80).stop 2021-01-03T13:07:20.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.087+0000 7f05bb215700 1 -- 172.21.15.133:0/3235424792 shutdown_connections 2021-01-03T13:07:20.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.087+0000 7f05bb215700 1 --2- 172.21.15.133:0/3235424792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05b405f920 0x7f05b40b0ab0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:20.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.087+0000 7f05bb215700 1 --2- 172.21.15.133:0/3235424792 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05b4066f30 0x7f05b40b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:20.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.087+0000 7f05bb215700 1 -- 172.21.15.133:0/3235424792 >> 172.21.15.133:0/3235424792 conn(0x7f05b40b6110 msgr2=0x7f05b40b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:20.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.087+0000 7f05bb215700 1 -- 172.21.15.133:0/3235424792 shutdown_connections 2021-01-03T13:07:20.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.087+0000 7f05bb215700 1 -- 172.21.15.133:0/3235424792 wait complete. 2021-01-03T13:07:20.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.087+0000 7f05bb215700 1 Processor -- start 2021-01-03T13:07:20.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.087+0000 7f05bb215700 1 -- start start 2021-01-03T13:07:20.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05bb215700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05b405f920 0x7f05b4065dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:20.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05bb215700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05b4066f30 0x7f05b40a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:20.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05bb215700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b40b1590 0x7f05b40a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:20.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05bb215700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b4150c50 con 0x7f05b40b1590 2021-01-03T13:07:20.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05bb215700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b405c260 con 0x7f05b4066f30 2021-01-03T13:07:20.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05bb215700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b405cb80 con 0x7f05b405f920 2021-01-03T13:07:20.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05b9a12700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05b4066f30 0x7f05b40a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:20.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05b9a12700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05b4066f30 0x7f05b40a0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39728/0 (socket says 172.21.15.133:39728) 2021-01-03T13:07:20.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05b9a12700 1 -- 172.21.15.133:0/2626689785 learned_addr learned my addr 172.21.15.133:0/2626689785 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:20.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05ba213700 1 --2- 172.21.15.133:0/2626689785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05b405f920 0x7f05b4065dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:20.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05baa14700 1 --2- 172.21.15.133:0/2626689785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b40b1590 0x7f05b40a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:20.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05b9a12700 1 -- 172.21.15.133:0/2626689785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05b405f920 msgr2=0x7f05b4065dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:20.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05b9a12700 1 --2- 172.21.15.133:0/2626689785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05b405f920 0x7f05b4065dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:20.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05b9a12700 1 -- 172.21.15.133:0/2626689785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b40b1590 msgr2=0x7f05b40a1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:20.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05b9a12700 1 --2- 172.21.15.133:0/2626689785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b40b1590 0x7f05b40a1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:20.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05b9a12700 1 -- 172.21.15.133:0/2626689785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b4153d80 con 0x7f05b4066f30 2021-01-03T13:07:20.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05b9a12700 1 --2- 172.21.15.133:0/2626689785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05b4066f30 0x7f05b40a0f30 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f05b4150d90 tx=0x7f05a4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:20.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05b37fe700 1 -- 172.21.15.133:0/2626689785 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05a400cad0 con 0x7f05b4066f30 2021-01-03T13:07:20.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05b37fe700 1 -- 172.21.15.133:0/2626689785 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a400cc30 con 0x7f05b4066f30 2021-01-03T13:07:20.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05bb215700 1 -- 172.21.15.133:0/2626689785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b4154020 con 0x7f05b4066f30 2021-01-03T13:07:20.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05b37fe700 1 -- 172.21.15.133:0/2626689785 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05a4013430 con 0x7f05b4066f30 2021-01-03T13:07:20.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05bb215700 1 -- 172.21.15.133:0/2626689785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b414fe40 con 0x7f05b4066f30 2021-01-03T13:07:20.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05bb215700 1 -- 172.21.15.133:0/2626689785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b4153bb0 con 0x7f05b4066f30 2021-01-03T13:07:20.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.091+0000 7f05b37fe700 1 -- 172.21.15.133:0/2626689785 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f05a4013590 con 0x7f05b4066f30 2021-01-03T13:07:20.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.095+0000 7f05b37fe700 1 --2- 172.21.15.133:0/2626689785 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0598055470 0x7f0598057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:20.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.095+0000 7f05b37fe700 1 -- 172.21.15.133:0/2626689785 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f05a406e4b0 con 0x7f05b4066f30 2021-01-03T13:07:20.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.095+0000 7f05ba213700 1 --2- 172.21.15.133:0/2626689785 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0598055470 0x7f0598057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:20.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.095+0000 7f05ba213700 1 --2- 172.21.15.133:0/2626689785 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0598055470 0x7f0598057930 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f05ac01a000 tx=0x7f05ac015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:20.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.103+0000 7f05b37fe700 1 -- 172.21.15.133:0/2626689785 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f05a4044750 con 0x7f05b4066f30 2021-01-03T13:07:20.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.243+0000 7f05bb215700 1 -- 172.21.15.133:0/2626689785 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f05b4057300 con 0x7f05b4066f30 2021-01-03T13:07:20.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.255+0000 7f05b37fe700 1 -- 172.21.15.133:0/2626689785 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f05a4009570 con 0x7f05b4066f30 2021-01-03T13:07:20.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.255+0000 7f05bb215700 1 -- 172.21.15.133:0/2626689785 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0598055470 msgr2=0x7f0598057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:20.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.255+0000 7f05bb215700 1 --2- 172.21.15.133:0/2626689785 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0598055470 0x7f0598057930 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f05ac01a000 tx=0x7f05ac015000).stop 2021-01-03T13:07:20.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.255+0000 7f05bb215700 1 -- 172.21.15.133:0/2626689785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05b4066f30 msgr2=0x7f05b40a0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:20.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.255+0000 7f05bb215700 1 --2- 172.21.15.133:0/2626689785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05b4066f30 0x7f05b40a0f30 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f05b4150d90 tx=0x7f05a4008040).stop 2021-01-03T13:07:20.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.255+0000 7f05bb215700 1 -- 172.21.15.133:0/2626689785 shutdown_connections 2021-01-03T13:07:20.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.255+0000 7f05bb215700 1 --2- 172.21.15.133:0/2626689785 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0598055470 0x7f0598057930 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:20.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.255+0000 7f05bb215700 1 --2- 172.21.15.133:0/2626689785 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f05b40b1590 0x7f05b40a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:20.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.255+0000 7f05bb215700 1 --2- 172.21.15.133:0/2626689785 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05b405f920 0x7f05b4065dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:20.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.255+0000 7f05bb215700 1 --2- 172.21.15.133:0/2626689785 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05b4066f30 0x7f05b40a0f30 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:20.264 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.255+0000 7f05bb215700 1 -- 172.21.15.133:0/2626689785 >> 172.21.15.133:0/2626689785 conn(0x7f05b40b6110 msgr2=0x7f05b40b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:20.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.255+0000 7f05bb215700 1 -- 172.21.15.133:0/2626689785 shutdown_connections 2021-01-03T13:07:20.265 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.255+0000 7f05bb215700 1 -- 172.21.15.133:0/2626689785 wait complete. 2021-01-03T13:07:20.276 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2021-01-03T13:07:20.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.379+0000 7f4890e68700 1 Processor -- start 2021-01-03T13:07:20.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.379+0000 7f4890e68700 1 -- start start 2021-01-03T13:07:20.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.379+0000 7f4890e68700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f488c0b9b60 0x7f488c0b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:20.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.379+0000 7f4890e68700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f488c0b4980 0x7f488c146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.379+0000 7f4890e68700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f488c0b4e10 0x7f488c146920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.379+0000 7f4890e68700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488c0aed30 con 0x7f488c0b9b60 2021-01-03T13:07:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.379+0000 7f4890e68700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488c0605f0 con 0x7f488c0b4980 2021-01-03T13:07:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.379+0000 7f4890e68700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c0600b0 con 0x7f488c0b4e10 2021-01-03T13:07:20.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f488affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f488c0b4980 0x7f488c146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f488affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f488c0b4980 0x7f488c146430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39738/0 (socket says 172.21.15.133:39738) 2021-01-03T13:07:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f488affd700 1 -- 172.21.15.133:0/764241939 learned_addr learned my addr 172.21.15.133:0/764241939 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f488b7fe700 1 --2- 172.21.15.133:0/764241939 >> v2:172.21.15.16:3300/0 conn(0x7f488c0b9b60 0x7f488c0b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:20.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f488bfff700 1 --2- 172.21.15.133:0/764241939 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f488c0b4e10 0x7f488c146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f488affd700 1 -- 172.21.15.133:0/764241939 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f488c0b4e10 msgr2=0x7f488c146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f488affd700 1 --2- 172.21.15.133:0/764241939 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f488c0b4e10 0x7f488c146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f488affd700 1 -- 172.21.15.133:0/764241939 >> v2:172.21.15.16:3300/0 conn(0x7f488c0b9b60 msgr2=0x7f488c0b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f488affd700 1 --2- 172.21.15.133:0/764241939 >> v2:172.21.15.16:3300/0 conn(0x7f488c0b9b60 0x7f488c0b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:20.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f488affd700 1 -- 172.21.15.133:0/764241939 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c060350 con 0x7f488c0b4980 2021-01-03T13:07:20.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f488affd700 1 --2- 172.21.15.133:0/764241939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f488c0b4980 0x7f488c146430 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f4874002f30 tx=0x7f4874006e80).ready entity=mon.1 client_cookie=4f108c56d29a6dd9 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:20.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f488a7fc700 1 -- 172.21.15.133:0/764241939 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4874009640 con 0x7f488c0b4980 2021-01-03T13:07:20.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f488a7fc700 1 -- 172.21.15.133:0/764241939 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48740097a0 con 0x7f488c0b4980 2021-01-03T13:07:20.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f488a7fc700 1 -- 172.21.15.133:0/764241939 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4874009b00 con 0x7f488c0b4980 2021-01-03T13:07:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f4890e68700 1 -- 172.21.15.133:0/764241939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f488c0b4980 msgr2=0x7f488c146430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:20.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f4890e68700 1 --2- 172.21.15.133:0/764241939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f488c0b4980 0x7f488c146430 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f4874002f30 tx=0x7f4874006e80).stop 2021-01-03T13:07:20.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f4890e68700 1 -- 172.21.15.133:0/764241939 shutdown_connections 2021-01-03T13:07:20.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f4890e68700 1 --2- 172.21.15.133:0/764241939 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f488c0b4e10 0x7f488c146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:20.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f4890e68700 1 --2- 172.21.15.133:0/764241939 >> v2:172.21.15.16:3300/0 conn(0x7f488c0b9b60 0x7f488c0b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:20.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f4890e68700 1 --2- 172.21.15.133:0/764241939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f488c0b4980 0x7f488c146430 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:20.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f4890e68700 1 -- 172.21.15.133:0/764241939 >> 172.21.15.133:0/764241939 conn(0x7f488c0b69e0 msgr2=0x7f488c0b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:20.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f4890e68700 1 -- 172.21.15.133:0/764241939 shutdown_connections 2021-01-03T13:07:20.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f4890e68700 1 -- 172.21.15.133:0/764241939 wait complete. 2021-01-03T13:07:20.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f4890e68700 1 Processor -- start 2021-01-03T13:07:20.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.383+0000 7f4890e68700 1 -- start start 2021-01-03T13:07:20.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f4890e68700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f488c0b4980 0x7f488c140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:20.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f4890e68700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f488c0b4e10 0x7f488c1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:20.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f4890e68700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f488c0b9b60 0x7f488c1556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:20.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f4890e68700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c152c50 con 0x7f488c0b4980 2021-01-03T13:07:20.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f4890e68700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c1529b0 con 0x7f488c0b4e10 2021-01-03T13:07:20.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f4890e68700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c149630 con 0x7f488c0b9b60 2021-01-03T13:07:20.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f488affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f488c0b4e10 0x7f488c1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:20.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f488affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f488c0b4e10 0x7f488c1551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39742/0 (socket says 172.21.15.133:39742) 2021-01-03T13:07:20.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f488affd700 1 -- 172.21.15.133:0/2141038423 learned_addr learned my addr 172.21.15.133:0/2141038423 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:20.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f488b7fe700 1 --2- 172.21.15.133:0/2141038423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f488c0b4980 0x7f488c140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:20.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f488bfff700 1 --2- 172.21.15.133:0/2141038423 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f488c0b9b60 0x7f488c1556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:20.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f488affd700 1 -- 172.21.15.133:0/2141038423 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f488c0b9b60 msgr2=0x7f488c1556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:20.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f488affd700 1 --2- 172.21.15.133:0/2141038423 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f488c0b9b60 0x7f488c1556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:20.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f488affd700 1 -- 172.21.15.133:0/2141038423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f488c0b4980 msgr2=0x7f488c140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:20.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f488affd700 1 --2- 172.21.15.133:0/2141038423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f488c0b4980 0x7f488c140bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:20.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f488affd700 1 -- 172.21.15.133:0/2141038423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c1498d0 con 0x7f488c0b4e10 2021-01-03T13:07:20.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f488bfff700 1 --2- 172.21.15.133:0/2141038423 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f488c0b9b60 0x7f488c1556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:20.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f488affd700 1 --2- 172.21.15.133:0/2141038423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f488c0b4e10 0x7f488c1551e0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f488c149550 tx=0x7f4874015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:20.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f4888ff9700 1 -- 172.21.15.133:0/2141038423 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4874011c60 con 0x7f488c0b4e10 2021-01-03T13:07:20.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f4888ff9700 1 -- 172.21.15.133:0/2141038423 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4874011dc0 con 0x7f488c0b4e10 2021-01-03T13:07:20.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f4888ff9700 1 -- 172.21.15.133:0/2141038423 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f487401d640 con 0x7f488c0b4e10 2021-01-03T13:07:20.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f4890e68700 1 -- 172.21.15.133:0/2141038423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488c1526d0 con 0x7f488c0b4e10 2021-01-03T13:07:20.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.387+0000 7f4890e68700 1 -- 172.21.15.133:0/2141038423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488c143970 con 0x7f488c0b4e10 2021-01-03T13:07:20.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.391+0000 7f4890e68700 1 -- 172.21.15.133:0/2141038423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488c09c2c0 con 0x7f488c0b4e10 2021-01-03T13:07:20.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.391+0000 7f4888ff9700 1 -- 172.21.15.133:0/2141038423 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f487400f070 con 0x7f488c0b4e10 2021-01-03T13:07:20.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.391+0000 7f4888ff9700 1 --2- 172.21.15.133:0/2141038423 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f48700553b0 0x7f4870057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:20.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.391+0000 7f4888ff9700 1 -- 172.21.15.133:0/2141038423 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f487406fa30 con 0x7f488c0b4e10 2021-01-03T13:07:20.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.391+0000 7f488b7fe700 1 --2- 172.21.15.133:0/2141038423 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f48700553b0 0x7f4870057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:20.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.391+0000 7f488b7fe700 1 --2- 172.21.15.133:0/2141038423 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f48700553b0 0x7f4870057870 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f487c00b000 tx=0x7f487c006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:20.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.399+0000 7f4888ff9700 1 -- 172.21.15.133:0/2141038423 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4874045c90 con 0x7f488c0b4e10 2021-01-03T13:07:20.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:20.587+0000 7f4890e68700 1 -- 172.21.15.133:0/2141038423 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f488c057300 con 0x7f488c0b4e10 2021-01-03T13:07:21.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.319+0000 7f4888ff9700 1 -- 172.21.15.133:0/2141038423 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v430) v1 ==== 128+0+0 (secure 0 0 0) 0x7f48740492b0 con 0x7f488c0b4e10 2021-01-03T13:07:21.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.323+0000 7f4890e68700 1 -- 172.21.15.133:0/2141038423 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f48700553b0 msgr2=0x7f4870057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:21.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.323+0000 7f4890e68700 1 --2- 172.21.15.133:0/2141038423 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f48700553b0 0x7f4870057870 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f487c00b000 tx=0x7f487c006dc0).stop 2021-01-03T13:07:21.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.323+0000 7f4890e68700 1 -- 172.21.15.133:0/2141038423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f488c0b4e10 msgr2=0x7f488c1551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:21.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.323+0000 7f4890e68700 1 --2- 172.21.15.133:0/2141038423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f488c0b4e10 0x7f488c1551e0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f488c149550 tx=0x7f4874015000).stop 2021-01-03T13:07:21.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.323+0000 7f4890e68700 1 -- 172.21.15.133:0/2141038423 shutdown_connections 2021-01-03T13:07:21.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.323+0000 7f4890e68700 1 --2- 172.21.15.133:0/2141038423 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f48700553b0 0x7f4870057870 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:21.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.323+0000 7f4890e68700 1 --2- 172.21.15.133:0/2141038423 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f488c0b4980 0x7f488c140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:21.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.323+0000 7f4890e68700 1 --2- 172.21.15.133:0/2141038423 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f488c0b9b60 0x7f488c1556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:21.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.323+0000 7f4890e68700 1 --2- 172.21.15.133:0/2141038423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f488c0b4e10 0x7f488c1551e0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:21.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.323+0000 7f4890e68700 1 -- 172.21.15.133:0/2141038423 >> 172.21.15.133:0/2141038423 conn(0x7f488c0b69e0 msgr2=0x7f488c05bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:21.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.323+0000 7f4890e68700 1 -- 172.21.15.133:0/2141038423 shutdown_connections 2021-01-03T13:07:21.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.323+0000 7f4890e68700 1 -- 172.21.15.133:0/2141038423 wait complete. 2021-01-03T13:07:21.345 INFO:tasks.cephfs_test_runner:test_getattr_caps (tasks.cephfs.test_misc.TestMisc) ... ok 2021-01-03T13:07:21.346 INFO:tasks.cephfs_test_runner:Starting test: test_root_rctime (tasks.cephfs.test_misc.TestMisc) 2021-01-03T13:07:21.347 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-01-03T13:07:21.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.451+0000 7f565f419700 1 Processor -- start 2021-01-03T13:07:21.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565f419700 1 -- start start 2021-01-03T13:07:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565f419700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f56580b9f40 0x7f5658146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:21.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565f419700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5658146920 0x7f565814d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565f419700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56580605f0 con 0x7f56580b9b60 2021-01-03T13:07:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565f419700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56580aed30 con 0x7f5658146920 2021-01-03T13:07:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565f419700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56580600b0 con 0x7f56580b9f40 2021-01-03T13:07:21.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565dc16700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f56580b9f40 0x7f5658146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:21.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565dc16700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f56580b9f40 0x7f5658146430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39750/0 (socket says 172.21.15.133:39750) 2021-01-03T13:07:21.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565dc16700 1 -- 172.21.15.133:0/1419628766 learned_addr learned my addr 172.21.15.133:0/1419628766 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:21.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565ec18700 1 --2- 172.21.15.133:0/1419628766 >> v2:172.21.15.16:3300/0 conn(0x7f5658146920 0x7f565814d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:21.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565dc16700 1 -- 172.21.15.133:0/1419628766 >> v2:172.21.15.16:3300/0 conn(0x7f5658146920 msgr2=0x7f565814d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:21.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565dc16700 1 --2- 172.21.15.133:0/1419628766 >> v2:172.21.15.16:3300/0 conn(0x7f5658146920 0x7f565814d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:21.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565dc16700 1 -- 172.21.15.133:0/1419628766 >> v1:172.21.15.16:6789/0 conn(0x7f56580b9b60 legacy=0x7f56580b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:21.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565dc16700 1 -- 172.21.15.133:0/1419628766 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5658060350 con 0x7f56580b9f40 2021-01-03T13:07:21.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565dc16700 1 --2- 172.21.15.133:0/1419628766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56580b9f40 0x7f5658146430 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f5654002f30 tx=0x7f5654006e80).ready entity=mon.1 client_cookie=e512caca5537b97f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:21.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565d415700 1 -- 172.21.15.133:0/1419628766 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56540097f0 con 0x7f56580b9f40 2021-01-03T13:07:21.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565d415700 1 -- 172.21.15.133:0/1419628766 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5654009950 con 0x7f56580b9f40 2021-01-03T13:07:21.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565d415700 1 -- 172.21.15.133:0/1419628766 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5654009cb0 con 0x7f56580b9f40 2021-01-03T13:07:21.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565f419700 1 -- 172.21.15.133:0/1419628766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56580b9f40 msgr2=0x7f5658146430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:21.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565f419700 1 --2- 172.21.15.133:0/1419628766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56580b9f40 0x7f5658146430 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f5654002f30 tx=0x7f5654006e80).stop 2021-01-03T13:07:21.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565f419700 1 -- 172.21.15.133:0/1419628766 shutdown_connections 2021-01-03T13:07:21.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565f419700 1 --2- 172.21.15.133:0/1419628766 >> v2:172.21.15.16:3300/0 conn(0x7f5658146920 0x7f565814d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:21.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565f419700 1 --2- 172.21.15.133:0/1419628766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56580b9f40 0x7f5658146430 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:21.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565f419700 1 -- 172.21.15.133:0/1419628766 >> 172.21.15.133:0/1419628766 conn(0x7f56580b69e0 msgr2=0x7f56580b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:21.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565f419700 1 -- 172.21.15.133:0/1419628766 shutdown_connections 2021-01-03T13:07:21.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.455+0000 7f565f419700 1 -- 172.21.15.133:0/1419628766 wait complete. 2021-01-03T13:07:21.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565f419700 1 Processor -- start 2021-01-03T13:07:21.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565f419700 1 -- start start 2021-01-03T13:07:21.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565f419700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f56580b9b60 0x7f5658155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:21.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565f419700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56580b9f40 0x7f56580b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:21.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565f419700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5658146920 0x7f565813f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:21.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565f419700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56580b2c70 con 0x7f56580b9f40 2021-01-03T13:07:21.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565f419700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56580b0fa0 con 0x7f5658146920 2021-01-03T13:07:21.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565f419700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56580b2ee0 con 0x7f56580b9b60 2021-01-03T13:07:21.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565ec18700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5658146920 0x7f565813f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:21.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565ec18700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5658146920 0x7f565813f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39758/0 (socket says 172.21.15.133:39758) 2021-01-03T13:07:21.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565ec18700 1 -- 172.21.15.133:0/3751938164 learned_addr learned my addr 172.21.15.133:0/3751938164 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:21.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565dc16700 1 --2- 172.21.15.133:0/3751938164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56580b9f40 0x7f56580b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:21.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565e417700 1 --2- 172.21.15.133:0/3751938164 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f56580b9b60 0x7f5658155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:21.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565ec18700 1 -- 172.21.15.133:0/3751938164 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f56580b9b60 msgr2=0x7f5658155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:21.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565ec18700 1 --2- 172.21.15.133:0/3751938164 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f56580b9b60 0x7f5658155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:21.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565ec18700 1 -- 172.21.15.133:0/3751938164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56580b9f40 msgr2=0x7f56580b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:21.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565ec18700 1 --2- 172.21.15.133:0/3751938164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56580b9f40 0x7f56580b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:21.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565ec18700 1 -- 172.21.15.133:0/3751938164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56580b3180 con 0x7f5658146920 2021-01-03T13:07:21.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565ec18700 1 --2- 172.21.15.133:0/3751938164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5658146920 0x7f565813f5e0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f565000a000 tx=0x7f5650008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:21.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f564b7fe700 1 -- 172.21.15.133:0/3751938164 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f565000b9a0 con 0x7f5658146920 2021-01-03T13:07:21.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f564b7fe700 1 -- 172.21.15.133:0/3751938164 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565000bb00 con 0x7f5658146920 2021-01-03T13:07:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565f419700 1 -- 172.21.15.133:0/3751938164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5658155cd0 con 0x7f5658146920 2021-01-03T13:07:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f564b7fe700 1 -- 172.21.15.133:0/3751938164 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f565000be60 con 0x7f5658146920 2021-01-03T13:07:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.459+0000 7f565f419700 1 -- 172.21.15.133:0/3751938164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565809d620 con 0x7f5658146920 2021-01-03T13:07:21.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.463+0000 7f565f419700 1 -- 172.21.15.133:0/3751938164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5658057300 con 0x7f5658146920 2021-01-03T13:07:21.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.463+0000 7f564b7fe700 1 -- 172.21.15.133:0/3751938164 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f565001c460 con 0x7f5658146920 2021-01-03T13:07:21.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.463+0000 7f564b7fe700 1 --2- 172.21.15.133:0/3751938164 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f56380553b0 0x7f5638057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:21.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.463+0000 7f564b7fe700 1 -- 172.21.15.133:0/3751938164 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f565006e590 con 0x7f5658146920 2021-01-03T13:07:21.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.463+0000 7f565e417700 1 --2- 172.21.15.133:0/3751938164 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f56380553b0 0x7f5638057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:21.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.463+0000 7f565e417700 1 --2- 172.21.15.133:0/3751938164 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f56380553b0 0x7f5638057870 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f564c00d000 tx=0x7f564c007b60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:21.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.467+0000 7f564b7fe700 1 -- 172.21.15.133:0/3751938164 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5650044720 con 0x7f5658146920 2021-01-03T13:07:21.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:21.659+0000 7f565f419700 1 -- 172.21.15.133:0/3751938164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7f5658067a00 con 0x7f5658146920 2021-01-03T13:07:22.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.323+0000 7f564b7fe700 1 -- 172.21.15.133:0/3751938164 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v431) v1 ==== 130+0+0 (secure 0 0 0) 0x7f5650047d40 con 0x7f5658146920 2021-01-03T13:07:22.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.327+0000 7f565f419700 1 -- 172.21.15.133:0/3751938164 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f56380553b0 msgr2=0x7f5638057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:22.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.327+0000 7f565f419700 1 --2- 172.21.15.133:0/3751938164 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f56380553b0 0x7f5638057870 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f564c00d000 tx=0x7f564c007b60).stop 2021-01-03T13:07:22.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.327+0000 7f565f419700 1 -- 172.21.15.133:0/3751938164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5658146920 msgr2=0x7f565813f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:22.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.327+0000 7f565f419700 1 --2- 172.21.15.133:0/3751938164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5658146920 0x7f565813f5e0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f565000a000 tx=0x7f5650008040).stop 2021-01-03T13:07:22.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.327+0000 7f565f419700 1 -- 172.21.15.133:0/3751938164 shutdown_connections 2021-01-03T13:07:22.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.327+0000 7f565f419700 1 --2- 172.21.15.133:0/3751938164 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f56380553b0 0x7f5638057870 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:22.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.327+0000 7f565f419700 1 --2- 172.21.15.133:0/3751938164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5658146920 0x7f565813f5e0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:22.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.327+0000 7f565f419700 1 --2- 172.21.15.133:0/3751938164 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f56580b9b60 0x7f5658155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:22.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.327+0000 7f565f419700 1 --2- 172.21.15.133:0/3751938164 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f56580b9f40 0x7f56580b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:22.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.327+0000 7f565f419700 1 -- 172.21.15.133:0/3751938164 >> 172.21.15.133:0/3751938164 conn(0x7f56580b69e0 msgr2=0x7f56581461b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:22.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.327+0000 7f565f419700 1 -- 172.21.15.133:0/3751938164 shutdown_connections 2021-01-03T13:07:22.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.327+0000 7f565f419700 1 -- 172.21.15.133:0/3751938164 wait complete. 2021-01-03T13:07:22.351 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-01-03T13:07:22.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.471+0000 7fdf47fff700 1 Processor -- start 2021-01-03T13:07:22.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.471+0000 7fdf47fff700 1 -- start start 2021-01-03T13:07:22.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf47fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf48146300 0x7fdf48140060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:22.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf47fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf48061480 con 0x7fdf480b2990 2021-01-03T13:07:22.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf47fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf48061720 con 0x7fdf480b7ab0 2021-01-03T13:07:22.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf47fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf480b30f0 con 0x7fdf48146300 2021-01-03T13:07:22.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf46ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdf480b7ab0 0x7fdf480b1d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60794/0 (socket says 172.21.15.133:60794) 2021-01-03T13:07:22.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf46ffd700 1 -- 172.21.15.133:0/3344823934 learned_addr learned my addr 172.21.15.133:0/3344823934 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:22.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf477fe700 1 --2- 172.21.15.133:0/3344823934 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf48146300 0x7fdf48140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:22.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf45ffb700 1 -- 172.21.15.133:0/3344823934 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337018493 0 0) 0x7fdf48061720 con 0x7fdf480b7ab0 2021-01-03T13:07:22.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf45ffb700 1 -- 172.21.15.133:0/3344823934 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf2c003230 con 0x7fdf480b7ab0 2021-01-03T13:07:22.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf45ffb700 1 -- 172.21.15.133:0/3344823934 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785379742 0 0) 0x7fdf48061480 con 0x7fdf480b2990 2021-01-03T13:07:22.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf477fe700 1 -- 172.21.15.133:0/3344823934 >> v1:172.21.15.133:6789/0 conn(0x7fdf480b7ab0 legacy=0x7fdf480b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:22.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf477fe700 1 -- 172.21.15.133:0/3344823934 >> v1:172.21.15.16:6789/0 conn(0x7fdf480b2990 legacy=0x7fdf480b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:22.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf477fe700 1 -- 172.21.15.133:0/3344823934 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf480619c0 con 0x7fdf48146300 2021-01-03T13:07:22.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf477fe700 1 --2- 172.21.15.133:0/3344823934 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf48146300 0x7fdf48140060 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fdf400032b0 tx=0x7fdf400091a0).ready entity=mon.2 client_cookie=3d76bd6d8743518 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:22.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf45ffb700 1 -- 172.21.15.133:0/3344823934 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf4000b9f0 con 0x7fdf48146300 2021-01-03T13:07:22.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf45ffb700 1 -- 172.21.15.133:0/3344823934 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4000bb50 con 0x7fdf48146300 2021-01-03T13:07:22.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf45ffb700 1 -- 172.21.15.133:0/3344823934 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf4000bcc0 con 0x7fdf48146300 2021-01-03T13:07:22.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf47fff700 1 -- 172.21.15.133:0/3344823934 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf48146300 msgr2=0x7fdf48140060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:22.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf47fff700 1 --2- 172.21.15.133:0/3344823934 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf48146300 0x7fdf48140060 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fdf400032b0 tx=0x7fdf400091a0).stop 2021-01-03T13:07:22.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf47fff700 1 -- 172.21.15.133:0/3344823934 shutdown_connections 2021-01-03T13:07:22.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf47fff700 1 --2- 172.21.15.133:0/3344823934 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf48146300 0x7fdf48140060 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:22.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf47fff700 1 -- 172.21.15.133:0/3344823934 >> 172.21.15.133:0/3344823934 conn(0x7fdf4805c8c0 msgr2=0x7fdf480b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:22.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf47fff700 1 -- 172.21.15.133:0/3344823934 shutdown_connections 2021-01-03T13:07:22.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.475+0000 7fdf47fff700 1 -- 172.21.15.133:0/3344823934 wait complete. 2021-01-03T13:07:22.490 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf47fff700 1 Processor -- start 2021-01-03T13:07:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf47fff700 1 -- start start 2021-01-03T13:07:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf47fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf480b2990 0x7fdf4809cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf47fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf480b7ab0 0x7fdf48064970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf47fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf48146300 0x7fdf48064e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf47fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf48065350 con 0x7fdf480b7ab0 2021-01-03T13:07:22.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf47fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf480b6a00 con 0x7fdf48146300 2021-01-03T13:07:22.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf47fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf480b6020 con 0x7fdf480b2990 2021-01-03T13:07:22.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf477fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf48146300 0x7fdf48064e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:22.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf477fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf48146300 0x7fdf48064e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39772/0 (socket says 172.21.15.133:39772) 2021-01-03T13:07:22.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf477fe700 1 -- 172.21.15.133:0/2772156532 learned_addr learned my addr 172.21.15.133:0/2772156532 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:22.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf467fc700 1 --2- 172.21.15.133:0/2772156532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf480b7ab0 0x7fdf48064970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:22.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf46ffd700 1 --2- 172.21.15.133:0/2772156532 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf480b2990 0x7fdf4809cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:22.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf477fe700 1 -- 172.21.15.133:0/2772156532 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf480b2990 msgr2=0x7fdf4809cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:22.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf477fe700 1 --2- 172.21.15.133:0/2772156532 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf480b2990 0x7fdf4809cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:22.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf477fe700 1 -- 172.21.15.133:0/2772156532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf480b7ab0 msgr2=0x7fdf48064970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:22.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf477fe700 1 --2- 172.21.15.133:0/2772156532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf480b7ab0 0x7fdf48064970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:22.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.479+0000 7fdf477fe700 1 -- 172.21.15.133:0/2772156532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf480b5bc0 con 0x7fdf48146300 2021-01-03T13:07:22.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.483+0000 7fdf477fe700 1 --2- 172.21.15.133:0/2772156532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf48146300 0x7fdf48064e60 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7fdf48065490 tx=0x7fdf40016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:22.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.483+0000 7fdf37fff700 1 -- 172.21.15.133:0/2772156532 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf400203f0 con 0x7fdf48146300 2021-01-03T13:07:22.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.483+0000 7fdf47fff700 1 -- 172.21.15.133:0/2772156532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf480b6c60 con 0x7fdf48146300 2021-01-03T13:07:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.483+0000 7fdf37fff700 1 -- 172.21.15.133:0/2772156532 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf40020550 con 0x7fdf48146300 2021-01-03T13:07:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.483+0000 7fdf37fff700 1 -- 172.21.15.133:0/2772156532 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf400208b0 con 0x7fdf48146300 2021-01-03T13:07:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.483+0000 7fdf47fff700 1 -- 172.21.15.133:0/2772156532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf48067420 con 0x7fdf48146300 2021-01-03T13:07:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.483+0000 7fdf47fff700 1 -- 172.21.15.133:0/2772156532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf48057300 con 0x7fdf48146300 2021-01-03T13:07:22.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.483+0000 7fdf37fff700 1 -- 172.21.15.133:0/2772156532 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fdf4001e070 con 0x7fdf48146300 2021-01-03T13:07:22.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.483+0000 7fdf37fff700 1 --2- 172.21.15.133:0/2772156532 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf24055350 0x7fdf24057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:22.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.483+0000 7fdf37fff700 1 -- 172.21.15.133:0/2772156532 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdf4006ed10 con 0x7fdf48146300 2021-01-03T13:07:22.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.483+0000 7fdf46ffd700 1 --2- 172.21.15.133:0/2772156532 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf24055350 0x7fdf24057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:22.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.487+0000 7fdf46ffd700 1 --2- 172.21.15.133:0/2772156532 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf24055350 0x7fdf24057810 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fdf3800d000 tx=0x7fdf38009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:22.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.491+0000 7fdf37fff700 1 -- 172.21.15.133:0/2772156532 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdf40044fb0 con 0x7fdf48146300 2021-01-03T13:07:22.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.631+0000 7fdf47fff700 1 -- 172.21.15.133:0/2772156532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7fdf4805ce00 con 0x7fdf48146300 2021-01-03T13:07:22.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.643+0000 7fdf37fff700 1 -- 172.21.15.133:0/2772156532 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdf4001b070 con 0x7fdf48146300 2021-01-03T13:07:22.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.643+0000 7fdf47fff700 1 -- 172.21.15.133:0/2772156532 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf24055350 msgr2=0x7fdf24057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:22.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.643+0000 7fdf47fff700 1 --2- 172.21.15.133:0/2772156532 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf24055350 0x7fdf24057810 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fdf3800d000 tx=0x7fdf38009040).stop 2021-01-03T13:07:22.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.643+0000 7fdf47fff700 1 -- 172.21.15.133:0/2772156532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf48146300 msgr2=0x7fdf48064e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:22.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.643+0000 7fdf47fff700 1 --2- 172.21.15.133:0/2772156532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf48146300 0x7fdf48064e60 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7fdf48065490 tx=0x7fdf40016000).stop 2021-01-03T13:07:22.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.643+0000 7fdf47fff700 1 -- 172.21.15.133:0/2772156532 shutdown_connections 2021-01-03T13:07:22.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.643+0000 7fdf47fff700 1 --2- 172.21.15.133:0/2772156532 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdf24055350 0x7fdf24057810 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:22.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.643+0000 7fdf47fff700 1 --2- 172.21.15.133:0/2772156532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf48146300 0x7fdf48064e60 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:22.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.643+0000 7fdf47fff700 1 --2- 172.21.15.133:0/2772156532 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdf480b2990 0x7fdf4809cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:22.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.643+0000 7fdf47fff700 1 --2- 172.21.15.133:0/2772156532 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf480b7ab0 0x7fdf48064970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:22.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.643+0000 7fdf47fff700 1 -- 172.21.15.133:0/2772156532 >> 172.21.15.133:0/2772156532 conn(0x7fdf4805c8c0 msgr2=0x7fdf481452a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:22.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.643+0000 7fdf47fff700 1 -- 172.21.15.133:0/2772156532 shutdown_connections 2021-01-03T13:07:22.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.643+0000 7fdf47fff700 1 -- 172.21.15.133:0/2772156532 wait complete. 2021-01-03T13:07:22.664 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:07:22.665 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:07:22.683 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:07:22.701 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:07:22.719 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:07:22.737 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:07:22.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:22.738 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:22.739 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:22.744 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-03T13:07:22.745 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:07:22.746 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-01-03T13:07:22.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:22.747 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:22.747 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:22.768 INFO:teuthology.orchestra.run.smithi036.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:07:22.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:07:22.770 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-01-03T13:07:22.770 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-01-03T13:07:22.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff748255700 1 Processor -- start 2021-01-03T13:07:22.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff748255700 1 -- start start 2021-01-03T13:07:22.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff748255700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7400b5c10 0x7ff7400aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:22.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff748255700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff74014aee0 0x7ff740144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:22.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff748255700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff740098550 con 0x7ff7400b0670 2021-01-03T13:07:22.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff748255700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7400b5ff0 con 0x7ff74014aee0 2021-01-03T13:07:22.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff748255700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400b0b10 con 0x7ff7400b5c10 2021-01-03T13:07:22.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff7457f0700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff7400b0670 0x7ff74014a7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60808/0 (socket says 172.21.15.133:60808) 2021-01-03T13:07:22.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff7457f0700 1 -- 172.21.15.133:0/2183680134 learned_addr learned my addr 172.21.15.133:0/2183680134 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:22.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff7467f2700 1 --2- 172.21.15.133:0/2183680134 >> v2:172.21.15.16:3300/0 conn(0x7ff74014aee0 0x7ff740144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:22.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff745ff1700 1 --2- 172.21.15.133:0/2183680134 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7400b5c10 0x7ff7400aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:22.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff744fef700 1 -- 172.21.15.133:0/2183680134 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640707236 0 0) 0x7ff740098550 con 0x7ff7400b0670 2021-01-03T13:07:22.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff744fef700 1 -- 172.21.15.133:0/2183680134 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff720003230 con 0x7ff7400b0670 2021-01-03T13:07:22.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff744fef700 1 -- 172.21.15.133:0/2183680134 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2141560505 0 0) 0x7ff720003230 con 0x7ff7400b0670 2021-01-03T13:07:22.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff744fef700 1 -- 172.21.15.133:0/2183680134 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7400b5c10 msgr2=0x7ff7400aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:22.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff744fef700 1 --2- 172.21.15.133:0/2183680134 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7400b5c10 0x7ff7400aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:22.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff744fef700 1 -- 172.21.15.133:0/2183680134 >> v2:172.21.15.16:3300/0 conn(0x7ff74014aee0 msgr2=0x7ff740144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:22.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff744fef700 1 --2- 172.21.15.133:0/2183680134 >> v2:172.21.15.16:3300/0 conn(0x7ff74014aee0 0x7ff740144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:22.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff744fef700 1 -- 172.21.15.133:0/2183680134 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff740098780 con 0x7ff7400b0670 2021-01-03T13:07:22.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff7467f2700 1 --2- 172.21.15.133:0/2183680134 >> v2:172.21.15.16:3300/0 conn(0x7ff74014aee0 0x7ff740144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:22.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff744fef700 1 -- 172.21.15.133:0/2183680134 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7ff728001a50 con 0x7ff7400b0670 2021-01-03T13:07:22.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff744fef700 1 -- 172.21.15.133:0/2183680134 >> v1:172.21.15.133:6789/0 conn(0x7ff7400b0670 legacy=0x7ff74014a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:22.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff744fef700 1 --2- 172.21.15.133:0/2183680134 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7400b5c10 0x7ff720003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:22.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff744fef700 1 --2- 172.21.15.133:0/2183680134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff720003c30 0x7ff7200044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:22.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff744fef700 1 --2- 172.21.15.133:0/2183680134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7200049c0 0x7ff720004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:22.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff744fef700 1 -- 172.21.15.133:0/2183680134 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400b5ff0 con 0x7ff720003c30 2021-01-03T13:07:22.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff744fef700 1 -- 172.21.15.133:0/2183680134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400b0b10 con 0x7ff7200049c0 2021-01-03T13:07:22.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff744fef700 1 -- 172.21.15.133:0/2183680134 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7200041f0 con 0x7ff7400b5c10 2021-01-03T13:07:22.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff7467f2700 1 --2- 172.21.15.133:0/2183680134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7200049c0 0x7ff720004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:22.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.891+0000 7ff745ff1700 1 --2- 172.21.15.133:0/2183680134 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7400b5c10 0x7ff720003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:22.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff7457f0700 1 --2- 172.21.15.133:0/2183680134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff720003c30 0x7ff7200044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:22.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff7467f2700 1 -- 172.21.15.133:0/2183680134 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7400b5c10 msgr2=0x7ff720003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:22.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff7467f2700 1 --2- 172.21.15.133:0/2183680134 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff7400b5c10 0x7ff720003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:22.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff7467f2700 1 -- 172.21.15.133:0/2183680134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff720003c30 msgr2=0x7ff7200044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:22.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff7467f2700 1 --2- 172.21.15.133:0/2183680134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff720003c30 0x7ff7200044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:22.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff7467f2700 1 -- 172.21.15.133:0/2183680134 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff720003230 con 0x7ff7200049c0 2021-01-03T13:07:22.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff7457f0700 1 --2- 172.21.15.133:0/2183680134 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff720003c30 0x7ff7200044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:22.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff7467f2700 1 --2- 172.21.15.133:0/2183680134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7200049c0 0x7ff720004e40 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7ff73800c000 tx=0x7ff738008040).ready entity=mon.1 client_cookie=57c5e6a0243a2c87 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:22.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff744fef700 1 -- 172.21.15.133:0/2183680134 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff73800ec30 con 0x7ff7200049c0 2021-01-03T13:07:22.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff744fef700 1 -- 172.21.15.133:0/2183680134 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73800ed90 con 0x7ff7200049c0 2021-01-03T13:07:22.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff744fef700 1 -- 172.21.15.133:0/2183680134 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7380125e0 con 0x7ff7200049c0 2021-01-03T13:07:22.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff748255700 1 -- 172.21.15.133:0/2183680134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7200049c0 msgr2=0x7ff720004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:22.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff748255700 1 --2- 172.21.15.133:0/2183680134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7200049c0 0x7ff720004e40 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7ff73800c000 tx=0x7ff738008040).stop 2021-01-03T13:07:22.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff7467f2700 1 -- 172.21.15.133:0/2183680134 reap_dead start 2021-01-03T13:07:22.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff748255700 1 -- 172.21.15.133:0/2183680134 shutdown_connections 2021-01-03T13:07:22.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff748255700 1 -- 172.21.15.133:0/2183680134 >> 172.21.15.133:0/2183680134 conn(0x7ff74005c8c0 msgr2=0x7ff7400b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:22.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff748255700 1 -- 172.21.15.133:0/2183680134 shutdown_connections 2021-01-03T13:07:22.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.895+0000 7ff748255700 1 -- 172.21.15.133:0/2183680134 wait complete. 2021-01-03T13:07:22.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff748255700 1 Processor -- start 2021-01-03T13:07:22.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff748255700 1 -- start start 2021-01-03T13:07:22.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff748255700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff74009a0b0 0x7ff740156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:22.914 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff748255700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7400ac610 0x7ff7400af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:22.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff748255700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7400af500 0x7ff7401596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:22.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff748255700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74009a490 con 0x7ff7400ac610 2021-01-03T13:07:22.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff748255700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74009a9e0 con 0x7ff7400af500 2021-01-03T13:07:22.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff748255700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7400ae630 con 0x7ff74009a0b0 2021-01-03T13:07:22.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff7467f2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7400af500 0x7ff7401596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff7467f2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7400af500 0x7ff7401596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39790/0 (socket says 172.21.15.133:39790) 2021-01-03T13:07:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff7467f2700 1 -- 172.21.15.133:0/3529365374 learned_addr learned my addr 172.21.15.133:0/3529365374 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff745ff1700 1 --2- 172.21.15.133:0/3529365374 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff74009a0b0 0x7ff740156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff7457f0700 1 --2- 172.21.15.133:0/3529365374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7400ac610 0x7ff7400af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:22.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff7467f2700 1 -- 172.21.15.133:0/3529365374 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff74009a0b0 msgr2=0x7ff740156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff7467f2700 1 --2- 172.21.15.133:0/3529365374 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff74009a0b0 0x7ff740156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff7467f2700 1 -- 172.21.15.133:0/3529365374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7400ac610 msgr2=0x7ff7400af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff7467f2700 1 --2- 172.21.15.133:0/3529365374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7400ac610 0x7ff7400af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff7467f2700 1 -- 172.21.15.133:0/3529365374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7400ae8d0 con 0x7ff7400af500 2021-01-03T13:07:22.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff7467f2700 1 --2- 172.21.15.133:0/3529365374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7400af500 0x7ff7401596e0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7ff728001450 tx=0x7ff73801a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff73effd700 1 -- 172.21.15.133:0/3529365374 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7380127f0 con 0x7ff7400af500 2021-01-03T13:07:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff73effd700 1 -- 172.21.15.133:0/3529365374 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73801be90 con 0x7ff7400af500 2021-01-03T13:07:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff748255700 1 -- 172.21.15.133:0/3529365374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7400aeb70 con 0x7ff7400af500 2021-01-03T13:07:22.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff73effd700 1 -- 172.21.15.133:0/3529365374 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff738012b40 con 0x7ff7400af500 2021-01-03T13:07:22.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff748255700 1 -- 172.21.15.133:0/3529365374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff740062bb0 con 0x7ff7400af500 2021-01-03T13:07:22.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.899+0000 7ff748255700 1 -- 172.21.15.133:0/3529365374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7400aed30 con 0x7ff7400af500 2021-01-03T13:07:22.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.903+0000 7ff73effd700 1 -- 172.21.15.133:0/3529365374 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff738012ca0 con 0x7ff7400af500 2021-01-03T13:07:22.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.903+0000 7ff73effd700 1 --2- 172.21.15.133:0/3529365374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff724055440 0x7ff724057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:22.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.903+0000 7ff73effd700 1 -- 172.21.15.133:0/3529365374 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff73806eec0 con 0x7ff7400af500 2021-01-03T13:07:22.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.903+0000 7ff745ff1700 1 --2- 172.21.15.133:0/3529365374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff724055440 0x7ff724057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:22.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.903+0000 7ff745ff1700 1 --2- 172.21.15.133:0/3529365374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff724055440 0x7ff724057900 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7ff730008000 tx=0x7ff730008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:22.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:22.907+0000 7ff73effd700 1 -- 172.21.15.133:0/3529365374 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff7380451c0 con 0x7ff7400af500 2021-01-03T13:07:23.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.047+0000 7ff748255700 1 -- 172.21.15.133:0/3529365374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff740057300 con 0x7ff7400af500 2021-01-03T13:07:23.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.051+0000 7ff73effd700 1 -- 172.21.15.133:0/3529365374 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v143) v1 ==== 81+0+33707 (secure 0 0 0) 0x7ff738016070 con 0x7ff7400af500 2021-01-03T13:07:23.057 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:23.057 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:07:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: "epoch": 143, 2021-01-03T13:07:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: "fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", 2021-01-03T13:07:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: "created": "2021-01-03T12:57:43.298835+0000", 2021-01-03T13:07:23.058 INFO:teuthology.orchestra.run.smithi133.stdout: "modified": "2021-01-03T13:07:04.443265+0000", 2021-01-03T13:07:23.059 INFO:teuthology.orchestra.run.smithi133.stdout: "last_up_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:07:23.059 INFO:teuthology.orchestra.run.smithi133.stdout: "last_in_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:07:23.059 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-01-03T13:07:23.059 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_num": 5799936, 2021-01-03T13:07:23.059 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_set": [ 2021-01-03T13:07:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: "pglog_hardlimit", 2021-01-03T13:07:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: "purged_snapdirs", 2021-01-03T13:07:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_deletes", 2021-01-03T13:07:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: "sortbitwise" 2021-01-03T13:07:23.060 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:07:23.061 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_version": 4, 2021-01-03T13:07:23.061 INFO:teuthology.orchestra.run.smithi133.stdout: "full_ratio": 0.94999998807907104, 2021-01-03T13:07:23.061 INFO:teuthology.orchestra.run.smithi133.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-01-03T13:07:23.061 INFO:teuthology.orchestra.run.smithi133.stdout: "nearfull_ratio": 0.85000002384185791, 2021-01-03T13:07:23.061 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_snapshot": "", 2021-01-03T13:07:23.062 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_max": 26, 2021-01-03T13:07:23.062 INFO:teuthology.orchestra.run.smithi133.stdout: "max_osd": 8, 2021-01-03T13:07:23.062 INFO:teuthology.orchestra.run.smithi133.stdout: "require_min_compat_client": "jewel", 2021-01-03T13:07:23.062 INFO:teuthology.orchestra.run.smithi133.stdout: "min_compat_client": "jewel", 2021-01-03T13:07:23.062 INFO:teuthology.orchestra.run.smithi133.stdout: "require_osd_release": "octopus", 2021-01-03T13:07:23.063 INFO:teuthology.orchestra.run.smithi133.stdout: "pools": [ 2021-01-03T13:07:23.063 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.063 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 1, 2021-01-03T13:07:23.063 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "device_health_metrics", 2021-01-03T13:07:23.064 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:47.102954+0000", 2021-01-03T13:07:23.064 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:07:23.064 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:07:23.064 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:07:23.064 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:07:23.065 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:07:23.065 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:07:23.065 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:07:23.065 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:07:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 1, 2021-01-03T13:07:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 1, 2021-01-03T13:07:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 1, 2021-01-03T13:07:23.066 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 1, 2021-01-03T13:07:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 1, 2021-01-03T13:07:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:07:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:07:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:07:23.067 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:07:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:07:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:07:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:07:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.068 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "16", 2021-01-03T13:07:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:07:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:07:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:07:23.069 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:07:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:07:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:07:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:07:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:07:23.070 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:07:23.071 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:07:23.071 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:07:23.071 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:07:23.071 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:07:23.071 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:07:23.072 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:07:23.072 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:07:23.072 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:07:23.072 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:07:23.072 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:07:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:07:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:07:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:07:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:07:23.073 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:07:23.074 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:07:23.074 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:07:23.074 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.074 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:07:23.074 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:07:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:07:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:07:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:07:23.075 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:07:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:07:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:07:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:07:23.076 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:07:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:07:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:07:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 1 2021-01-03T13:07:23.077 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:07:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr_devicehealth": {} 2021-01-03T13:07:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.078 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 2, 2021-01-03T13:07:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "rbd", 2021-01-03T13:07:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:55.472799+0000", 2021-01-03T13:07:23.079 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:07:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:07:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:07:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:07:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:07:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:07:23.080 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:07:23.081 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:07:23.081 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:07:23.081 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:07:23.081 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:07:23.081 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:07:23.082 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:07:23.082 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:07:23.082 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:07:23.082 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:07:23.082 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:07:23.083 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:07:23.083 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:07:23.083 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:07:23.083 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.083 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "19", 2021-01-03T13:07:23.084 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:07:23.084 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:07:23.084 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:07:23.084 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:07:23.084 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:07:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:07:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:07:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:07:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:07:23.085 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:07:23.086 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:07:23.086 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:07:23.086 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:07:23.086 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:07:23.086 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:07:23.087 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:07:23.087 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:07:23.087 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:07:23.087 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:07:23.087 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:07:23.088 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:07:23.088 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:07:23.088 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:07:23.088 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:07:23.088 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:07:23.088 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:07:23.089 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.089 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:07:23.089 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:07:23.089 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:07:23.090 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:07:23.090 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:07:23.090 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:07:23.090 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:07:23.090 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:07:23.091 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:07:23.091 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:07:23.091 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:07:23.091 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:07:23.091 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:07:23.092 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd": {} 2021-01-03T13:07:23.092 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.092 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.092 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.092 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 25, 2021-01-03T13:07:23.093 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_metadata", 2021-01-03T13:07:23.093 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:07:01.122595+0000", 2021-01-03T13:07:23.093 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:07:23.093 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:07:23.093 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:07:23.094 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:07:23.094 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:07:23.094 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:07:23.094 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:07:23.094 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:07:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:07:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:07:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:07:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:07:23.095 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:07:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:07:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:07:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:07:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:07:23.096 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:07:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:07:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:07:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "142", 2021-01-03T13:07:23.097 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:07:23.098 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:07:23.098 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:07:23.098 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:07:23.098 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:07:23.098 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:07:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:07:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:07:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:07:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:07:23.099 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:07:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:07:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:07:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:07:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:07:23.100 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:07:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:07:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:07:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:07:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:07:23.101 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:07:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:07:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:07:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:07:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:07:23.102 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:07:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:07:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:07:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:07:23.103 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:07:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:07:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:07:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:07:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:07:23.104 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:07:23.105 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:07:23.105 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:07:23.105 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:07:23.105 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_bias": 4, 2021-01-03T13:07:23.105 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 16, 2021-01-03T13:07:23.106 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_priority": 5 2021-01-03T13:07:23.106 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.106 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:07:23.106 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:07:23.106 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": "cephfs" 2021-01-03T13:07:23.107 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.107 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.107 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.107 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.108 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 26, 2021-01-03T13:07:23.108 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_data", 2021-01-03T13:07:23.108 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:07:02.419257+0000", 2021-01-03T13:07:23.108 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:07:23.108 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:07:23.108 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:07:23.109 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:07:23.109 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:07:23.109 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:07:23.109 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:07:23.109 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:07:23.110 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:07:23.110 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:07:23.110 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:07:23.110 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:07:23.110 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:07:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:07:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:07:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:07:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:07:23.111 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:07:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:07:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:07:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "143", 2021-01-03T13:07:23.112 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:07:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:07:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:07:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:07:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:07:23.113 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:07:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:07:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:07:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:07:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:07:23.114 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:07:23.115 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:07:23.115 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:07:23.115 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:07:23.115 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:07:23.115 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:07:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:07:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:07:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:07:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:07:23.116 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:07:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:07:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:07:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:07:23.117 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:07:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:07:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:07:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:07:23.118 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:07:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:07:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:07:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:07:23.119 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:07:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:07:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:07:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:07:23.120 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:07:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:07:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:07:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:07:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: "data": "cephfs" 2021-01-03T13:07:23.121 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.122 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.122 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.122 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:07:23.122 INFO:teuthology.orchestra.run.smithi133.stdout: "osds": [ 2021-01-03T13:07:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:07:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a", 2021-01-03T13:07:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:07:23.123 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:07:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:07:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:07:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:07:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:07:23.124 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:07:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 140, 2021-01-03T13:07:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:07:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:07:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:07:23.125 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.126 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.126 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.126 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6810", 2021-01-03T13:07:23.126 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:07:23.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6811", 2021-01-03T13:07:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:07:23.127 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.128 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.128 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.128 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:07:23.128 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6812", 2021-01-03T13:07:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:07:23.129 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6813", 2021-01-03T13:07:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:07:23.130 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:07:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.131 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6816", 2021-01-03T13:07:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:07:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.132 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6817", 2021-01-03T13:07:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:07:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.133 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:07:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.134 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6814", 2021-01-03T13:07:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:07:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.135 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6815", 2021-01-03T13:07:23.136 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:07:23.136 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.136 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.136 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6811/12124", 2021-01-03T13:07:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6813/12124", 2021-01-03T13:07:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6817/12124", 2021-01-03T13:07:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6815/12124", 2021-01-03T13:07:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:07:23.137 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:07:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:07:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.138 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:07:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9170d1de-58d4-4dfd-b9de-80dc15ca9e60", 2021-01-03T13:07:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:07:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:07:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:07:23.139 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:07:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:07:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:07:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:07:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 141, 2021-01-03T13:07:23.140 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:07:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:07:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:07:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.141 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6818", 2021-01-03T13:07:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:07:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.142 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6819", 2021-01-03T13:07:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:07:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:07:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.144 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6820", 2021-01-03T13:07:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:07:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.145 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6821", 2021-01-03T13:07:23.146 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:07:23.146 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.146 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.146 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:07:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6824", 2021-01-03T13:07:23.147 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:07:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6825", 2021-01-03T13:07:23.148 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:07:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:07:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6822", 2021-01-03T13:07:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:07:23.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.151 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.151 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6823", 2021-01-03T13:07:23.151 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:07:23.151 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6819/12123", 2021-01-03T13:07:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6821/12123", 2021-01-03T13:07:23.152 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6825/12123", 2021-01-03T13:07:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6823/12123", 2021-01-03T13:07:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:07:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:07:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:07:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.153 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.154 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.154 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:07:23.154 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9fc5adf9-3537-4953-9c65-0c67ecb53776", 2021-01-03T13:07:23.154 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:07:23.154 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:07:23.155 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:07:23.155 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:07:23.155 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:07:23.155 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:07:23.155 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:07:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 141, 2021-01-03T13:07:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:07:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:07:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:07:23.156 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.157 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.157 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.157 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6802", 2021-01-03T13:07:23.157 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:07:23.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6803", 2021-01-03T13:07:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:07:23.158 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:07:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.159 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6804", 2021-01-03T13:07:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:07:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.160 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6805", 2021-01-03T13:07:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:07:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.161 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:07:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.162 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6808", 2021-01-03T13:07:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:07:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.163 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.164 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6809", 2021-01-03T13:07:23.164 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:07:23.164 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.164 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.164 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.165 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:07:23.165 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.165 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.165 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.165 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6806", 2021-01-03T13:07:23.166 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:07:23.166 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.166 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.166 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6807", 2021-01-03T13:07:23.167 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:07:23.167 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.167 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.167 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.167 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6803/12122", 2021-01-03T13:07:23.168 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6805/12122", 2021-01-03T13:07:23.168 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6809/12122", 2021-01-03T13:07:23.168 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6807/12122", 2021-01-03T13:07:23.168 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:07:23.168 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:07:23.169 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:07:23.169 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.169 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.169 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:07:23.170 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "0ad45ce5-6635-4089-bbf8-c966d0fe5338", 2021-01-03T13:07:23.170 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:07:23.170 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:07:23.170 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:07:23.170 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:07:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:07:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:07:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:07:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 140, 2021-01-03T13:07:23.171 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:07:23.172 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:07:23.172 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:07:23.172 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.172 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6826", 2021-01-03T13:07:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:07:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.173 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6827", 2021-01-03T13:07:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:07:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:07:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.175 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6828", 2021-01-03T13:07:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:07:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.176 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6829", 2021-01-03T13:07:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:07:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:07:23.177 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.178 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.178 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6832", 2021-01-03T13:07:23.178 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:07:23.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.179 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.179 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6833", 2021-01-03T13:07:23.179 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:07:23.179 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.180 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.180 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:07:23.180 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.180 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6830", 2021-01-03T13:07:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:07:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.181 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6831", 2021-01-03T13:07:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:07:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.182 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.183 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.183 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6827/12136", 2021-01-03T13:07:23.183 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6829/12136", 2021-01-03T13:07:23.183 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6833/12136", 2021-01-03T13:07:23.183 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6831/12136", 2021-01-03T13:07:23.184 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:07:23.184 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:07:23.184 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:07:23.184 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.184 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:07:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "86b8d6d5-271b-4a70-ae7b-a227afb38d7c", 2021-01-03T13:07:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:07:23.185 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:07:23.186 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:07:23.186 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:07:23.186 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:07:23.186 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:07:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:07:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 141, 2021-01-03T13:07:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:07:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:07:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:07:23.187 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.188 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.188 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6808", 2021-01-03T13:07:23.188 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:07:23.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.189 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.189 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6809", 2021-01-03T13:07:23.189 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:07:23.189 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.190 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.190 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.190 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:07:23.190 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.190 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.191 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.191 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6810", 2021-01-03T13:07:23.191 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:07:23.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.192 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.192 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6811", 2021-01-03T13:07:23.192 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:07:23.192 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.192 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.193 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.193 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:07:23.193 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.193 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.193 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.194 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6814", 2021-01-03T13:07:23.194 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:07:23.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.194 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.195 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6815", 2021-01-03T13:07:23.195 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:07:23.195 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.195 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.196 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:07:23.196 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.196 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.196 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.197 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6812", 2021-01-03T13:07:23.197 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:07:23.197 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.197 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.197 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.198 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6813", 2021-01-03T13:07:23.198 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:07:23.198 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.198 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.199 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6809/12672", 2021-01-03T13:07:23.199 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6811/12672", 2021-01-03T13:07:23.199 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6815/12672", 2021-01-03T13:07:23.199 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6813/12672", 2021-01-03T13:07:23.199 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:07:23.199 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:07:23.200 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:07:23.200 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.200 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.200 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.201 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:07:23.201 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "173feb9d-f596-4030-85d8-1f4b46a9ffe5", 2021-01-03T13:07:23.201 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:07:23.201 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:07:23.201 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:07:23.202 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:07:23.202 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:07:23.202 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:07:23.202 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:07:23.203 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 134, 2021-01-03T13:07:23.203 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:07:23.203 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:07:23.203 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:07:23.203 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.204 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.204 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6817", 2021-01-03T13:07:23.204 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:07:23.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.205 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.205 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6819", 2021-01-03T13:07:23.205 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:07:23.205 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.205 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.206 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.206 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:07:23.206 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.206 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.206 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.207 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6820", 2021-01-03T13:07:23.207 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:07:23.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.208 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.208 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6822", 2021-01-03T13:07:23.208 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:07:23.208 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.208 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.209 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:07:23.209 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.209 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.209 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.209 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6828", 2021-01-03T13:07:23.210 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:07:23.210 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.210 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.211 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6830", 2021-01-03T13:07:23.211 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:07:23.211 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.211 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.212 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:07:23.212 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.212 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.212 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6824", 2021-01-03T13:07:23.213 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:07:23.213 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.213 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.213 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.213 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6826", 2021-01-03T13:07:23.214 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:07:23.214 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.214 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.214 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6819/12673", 2021-01-03T13:07:23.215 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6822/12673", 2021-01-03T13:07:23.215 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6830/12673", 2021-01-03T13:07:23.215 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6826/12673", 2021-01-03T13:07:23.215 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:07:23.216 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:07:23.216 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:07:23.216 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.216 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.216 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.217 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:07:23.217 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "b487980e-ad4d-43c1-91fa-4845f7af3d4d", 2021-01-03T13:07:23.217 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:07:23.217 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:07:23.217 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:07:23.218 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:07:23.218 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:07:23.218 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:07:23.218 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:07:23.218 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 141, 2021-01-03T13:07:23.219 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:07:23.219 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:07:23.219 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:07:23.219 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.219 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.220 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.220 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6800", 2021-01-03T13:07:23.220 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:07:23.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.221 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.221 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6801", 2021-01-03T13:07:23.221 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:07:23.221 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.221 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.222 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.222 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:07:23.222 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.222 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.222 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.223 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6802", 2021-01-03T13:07:23.223 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:07:23.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.223 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.224 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6803", 2021-01-03T13:07:23.224 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:07:23.224 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.224 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.225 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:07:23.225 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.225 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.225 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.225 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6806", 2021-01-03T13:07:23.226 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:07:23.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.226 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.227 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6807", 2021-01-03T13:07:23.227 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:07:23.227 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.227 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.228 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:07:23.228 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.228 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.228 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.228 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6804", 2021-01-03T13:07:23.229 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:07:23.229 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.229 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.229 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.229 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6805", 2021-01-03T13:07:23.230 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:07:23.230 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.230 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.230 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6801/12662", 2021-01-03T13:07:23.231 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6803/12662", 2021-01-03T13:07:23.231 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6807/12662", 2021-01-03T13:07:23.231 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6805/12662", 2021-01-03T13:07:23.231 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:07:23.231 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:07:23.232 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:07:23.232 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.232 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.232 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.232 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:07:23.233 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "38ea839a-451f-4c09-a545-4514e049b178", 2021-01-03T13:07:23.233 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:07:23.233 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:07:23.233 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:07:23.233 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:07:23.234 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:07:23.234 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:07:23.234 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:07:23.234 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 141, 2021-01-03T13:07:23.234 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:07:23.235 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:07:23.235 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:07:23.235 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.235 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.235 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.236 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6816", 2021-01-03T13:07:23.236 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:07:23.236 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.236 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.237 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6818", 2021-01-03T13:07:23.237 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:07:23.237 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.237 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.238 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:07:23.238 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.238 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.238 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.238 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6821", 2021-01-03T13:07:23.239 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:07:23.239 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.239 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.239 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6823", 2021-01-03T13:07:23.240 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:07:23.240 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.240 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.240 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:07:23.241 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.241 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.241 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.241 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6829", 2021-01-03T13:07:23.241 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:07:23.242 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.242 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.242 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6831", 2021-01-03T13:07:23.242 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:07:23.243 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.243 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.243 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:07:23.243 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:23.244 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.244 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:23.244 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6825", 2021-01-03T13:07:23.244 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:07:23.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.245 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.245 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:23.245 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6827", 2021-01-03T13:07:23.245 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:07:23.245 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.246 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.246 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6818/12674", 2021-01-03T13:07:23.246 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6823/12674", 2021-01-03T13:07:23.247 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6831/12674", 2021-01-03T13:07:23.247 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6827/12674", 2021-01-03T13:07:23.247 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:07:23.247 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:07:23.247 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:07:23.248 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:23.248 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.248 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:07:23.248 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_xinfo": [ 2021-01-03T13:07:23.248 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.249 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:07:23.249 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:07:23.249 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:07:23.249 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:07:23.249 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:07:23.250 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:07:23.250 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.659942+0000", 2021-01-03T13:07:23.250 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:07:23.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.251 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:07:23.251 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:07:23.251 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:07:23.251 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:07:23.251 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:07:23.252 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:07:23.252 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.750326+0000", 2021-01-03T13:07:23.252 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:07:23.252 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.253 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:07:23.253 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:07:23.253 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:07:23.253 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:07:23.253 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:07:23.254 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:07:23.254 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.587742+0000", 2021-01-03T13:07:23.254 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:07:23.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.254 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.255 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:07:23.255 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:07:23.255 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:07:23.255 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:07:23.255 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:07:23.256 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:07:23.256 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.855073+0000", 2021-01-03T13:07:23.256 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:07:23.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.257 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:07:23.257 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:07:23.257 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:07:23.257 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:07:23.257 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:07:23.258 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:07:23.258 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.565030+0000", 2021-01-03T13:07:23.258 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:07:23.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.259 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:07:23.259 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:07:23.259 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:07:23.259 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:07:23.259 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:07:23.260 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:07:23.260 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.786206+0000", 2021-01-03T13:07:23.260 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:07:23.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.260 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:07:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:07:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:07:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:07:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:07:23.261 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:07:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.576185+0000", 2021-01-03T13:07:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:07:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:23.263 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:07:23.263 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:07:23.263 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:07:23.263 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:07:23.263 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:07:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:07:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.823786+0000", 2021-01-03T13:07:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:07:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.264 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:07:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap": [], 2021-01-03T13:07:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap_items": [], 2021-01-03T13:07:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_temp": [], 2021-01-03T13:07:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_temp": [], 2021-01-03T13:07:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: "blacklist": {}, 2021-01-03T13:07:23.265 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profiles": { 2021-01-03T13:07:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: "default": { 2021-01-03T13:07:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: "crush-failure-domain": "osd", 2021-01-03T13:07:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: "k": "2", 2021-01-03T13:07:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: "m": "1", 2021-01-03T13:07:23.266 INFO:teuthology.orchestra.run.smithi133.stdout: "plugin": "jerasure", 2021-01-03T13:07:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: "ruleset-failure-domain": "osd", 2021-01-03T13:07:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: "technique": "reed_sol_van" 2021-01-03T13:07:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:23.267 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps_queue": [], 2021-01-03T13:07:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: "new_removed_snaps": [], 2021-01-03T13:07:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: "new_purged_snaps": [], 2021-01-03T13:07:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_node_flags": {}, 2021-01-03T13:07:23.268 INFO:teuthology.orchestra.run.smithi133.stdout: "device_class_flags": {} 2021-01-03T13:07:23.268 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:07:23.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.051+0000 7ff748255700 1 -- 172.21.15.133:0/3529365374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff724055440 msgr2=0x7ff724057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:23.270 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.051+0000 7ff748255700 1 --2- 172.21.15.133:0/3529365374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff724055440 0x7ff724057900 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7ff730008000 tx=0x7ff730008040).stop 2021-01-03T13:07:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.051+0000 7ff748255700 1 -- 172.21.15.133:0/3529365374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7400af500 msgr2=0x7ff7401596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.051+0000 7ff748255700 1 --2- 172.21.15.133:0/3529365374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7400af500 0x7ff7401596e0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7ff728001450 tx=0x7ff73801a000).stop 2021-01-03T13:07:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.051+0000 7ff748255700 1 -- 172.21.15.133:0/3529365374 shutdown_connections 2021-01-03T13:07:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.051+0000 7ff748255700 1 --2- 172.21.15.133:0/3529365374 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff724055440 0x7ff724057900 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.051+0000 7ff748255700 1 --2- 172.21.15.133:0/3529365374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7400af500 0x7ff7401596e0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.051+0000 7ff748255700 1 --2- 172.21.15.133:0/3529365374 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff74009a0b0 0x7ff740156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.051+0000 7ff748255700 1 --2- 172.21.15.133:0/3529365374 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff7400ac610 0x7ff7400af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.051+0000 7ff748255700 1 -- 172.21.15.133:0/3529365374 >> 172.21.15.133:0/3529365374 conn(0x7ff74005c8c0 msgr2=0x7ff740145050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:23.272 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.051+0000 7ff748255700 1 -- 172.21.15.133:0/3529365374 shutdown_connections 2021-01-03T13:07:23.273 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.051+0000 7ff748255700 1 -- 172.21.15.133:0/3529365374 wait complete. 2021-01-03T13:07:23.273 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:07:23.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff00359e700 1 Processor -- start 2021-01-03T13:07:23.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff00359e700 1 -- start start 2021-01-03T13:07:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff00359e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff0040b3060 0x7ff004141660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff00359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff0040b3870 0x7ff0040b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:23.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff00359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff00405f5e0 0x7ff00413def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff00359e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0040b24f0 con 0x7ff0040b3060 2021-01-03T13:07:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff00359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0040b3440 con 0x7ff0040b3870 2021-01-03T13:07:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff00359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff004140c80 con 0x7ff00405f5e0 2021-01-03T13:07:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff001d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff0040b3870 0x7ff0040b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:23.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff001d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff0040b3870 0x7ff0040b1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39798/0 (socket says 172.21.15.133:39798) 2021-01-03T13:07:23.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff001d9b700 1 -- 172.21.15.133:0/3285533997 learned_addr learned my addr 172.21.15.133:0/3285533997 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:23.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff00259c700 1 --2- 172.21.15.133:0/3285533997 >> v2:172.21.15.16:3300/0 conn(0x7ff0040b3060 0x7ff004141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:23.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff002d9d700 1 --2- 172.21.15.133:0/3285533997 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff00405f5e0 0x7ff00413def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:23.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff001d9b700 1 -- 172.21.15.133:0/3285533997 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff00405f5e0 msgr2=0x7ff00413def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:23.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff001d9b700 1 --2- 172.21.15.133:0/3285533997 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff00405f5e0 0x7ff00413def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff001d9b700 1 -- 172.21.15.133:0/3285533997 >> v2:172.21.15.16:3300/0 conn(0x7ff0040b3060 msgr2=0x7ff004141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:23.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff001d9b700 1 --2- 172.21.15.133:0/3285533997 >> v2:172.21.15.16:3300/0 conn(0x7ff0040b3060 0x7ff004141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff001d9b700 1 -- 172.21.15.133:0/3285533997 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff004140f20 con 0x7ff0040b3870 2021-01-03T13:07:23.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff00259c700 1 --2- 172.21.15.133:0/3285533997 >> v2:172.21.15.16:3300/0 conn(0x7ff0040b3060 0x7ff004141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:23.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff001d9b700 1 --2- 172.21.15.133:0/3285533997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0040b3870 0x7ff0040b1cc0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7feff8002f30 tx=0x7feff8006e80).ready entity=mon.1 client_cookie=22ee31ff7c70d97c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:23.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff00159a700 1 -- 172.21.15.133:0/3285533997 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feff80098c0 con 0x7ff0040b3870 2021-01-03T13:07:23.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff00159a700 1 -- 172.21.15.133:0/3285533997 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff8009a20 con 0x7ff0040b3870 2021-01-03T13:07:23.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff00159a700 1 -- 172.21.15.133:0/3285533997 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feff8009d80 con 0x7ff0040b3870 2021-01-03T13:07:23.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff00359e700 1 -- 172.21.15.133:0/3285533997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0040b3870 msgr2=0x7ff0040b1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:23.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.387+0000 7ff00359e700 1 --2- 172.21.15.133:0/3285533997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0040b3870 0x7ff0040b1cc0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7feff8002f30 tx=0x7feff8006e80).stop 2021-01-03T13:07:23.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.391+0000 7ff00359e700 1 -- 172.21.15.133:0/3285533997 shutdown_connections 2021-01-03T13:07:23.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.391+0000 7ff00359e700 1 --2- 172.21.15.133:0/3285533997 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff00405f5e0 0x7ff00413def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.391+0000 7ff00359e700 1 --2- 172.21.15.133:0/3285533997 >> v2:172.21.15.16:3300/0 conn(0x7ff0040b3060 0x7ff004141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.391+0000 7ff00359e700 1 --2- 172.21.15.133:0/3285533997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0040b3870 0x7ff0040b1cc0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.391+0000 7ff00359e700 1 -- 172.21.15.133:0/3285533997 >> 172.21.15.133:0/3285533997 conn(0x7ff0040b7200 msgr2=0x7ff0040b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:23.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.391+0000 7ff00359e700 1 -- 172.21.15.133:0/3285533997 shutdown_connections 2021-01-03T13:07:23.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.391+0000 7ff00359e700 1 -- 172.21.15.133:0/3285533997 wait complete. 2021-01-03T13:07:23.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.391+0000 7ff00359e700 1 Processor -- start 2021-01-03T13:07:23.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.391+0000 7ff00359e700 1 -- start start 2021-01-03T13:07:23.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff00405f5e0 0x7ff00413ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0040b3060 0x7ff0041473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff0040b3870 0x7ff004153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00359e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff004152f20 con 0x7ff0040b3060 2021-01-03T13:07:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0040af9a0 con 0x7ff00405f5e0 2021-01-03T13:07:23.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff004153180 con 0x7ff0040b3870 2021-01-03T13:07:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff00405f5e0 0x7ff00413ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff00405f5e0 0x7ff00413ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39802/0 (socket says 172.21.15.133:39802) 2021-01-03T13:07:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00259c700 1 -- 172.21.15.133:0/1878424754 learned_addr learned my addr 172.21.15.133:0/1878424754 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff001d9b700 1 --2- 172.21.15.133:0/1878424754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0040b3060 0x7ff0041473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:23.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff002d9d700 1 --2- 172.21.15.133:0/1878424754 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff0040b3870 0x7ff004153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:23.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00259c700 1 -- 172.21.15.133:0/1878424754 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff0040b3870 msgr2=0x7ff004153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:23.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00259c700 1 --2- 172.21.15.133:0/1878424754 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff0040b3870 0x7ff004153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00259c700 1 -- 172.21.15.133:0/1878424754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0040b3060 msgr2=0x7ff0041473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:23.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00259c700 1 --2- 172.21.15.133:0/1878424754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0040b3060 0x7ff0041473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00259c700 1 -- 172.21.15.133:0/1878424754 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0040b5fe0 con 0x7ff00405f5e0 2021-01-03T13:07:23.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff002d9d700 1 --2- 172.21.15.133:0/1878424754 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff0040b3870 0x7ff004153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:23.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff001d9b700 1 --2- 172.21.15.133:0/1878424754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0040b3060 0x7ff0041473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:23.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00259c700 1 --2- 172.21.15.133:0/1878424754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff00405f5e0 0x7ff00413ae40 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7feff4006dd0 tx=0x7feff4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:23.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7feff37fe700 1 -- 172.21.15.133:0/1878424754 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feff400cad0 con 0x7ff00405f5e0 2021-01-03T13:07:23.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7feff37fe700 1 -- 172.21.15.133:0/1878424754 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff400cc30 con 0x7ff00405f5e0 2021-01-03T13:07:23.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7feff37fe700 1 -- 172.21.15.133:0/1878424754 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feff4013430 con 0x7ff00405f5e0 2021-01-03T13:07:23.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00359e700 1 -- 172.21.15.133:0/1878424754 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0040afc40 con 0x7ff00405f5e0 2021-01-03T13:07:23.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00359e700 1 -- 172.21.15.133:0/1878424754 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0040b6e90 con 0x7ff00405f5e0 2021-01-03T13:07:23.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.395+0000 7ff00359e700 1 -- 172.21.15.133:0/1878424754 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff004057300 con 0x7ff00405f5e0 2021-01-03T13:07:23.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.399+0000 7feff37fe700 1 -- 172.21.15.133:0/1878424754 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7feff4013590 con 0x7ff00405f5e0 2021-01-03T13:07:23.410 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.399+0000 7feff37fe700 1 --2- 172.21.15.133:0/1878424754 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fefe00553b0 0x7fefe0057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:23.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.399+0000 7feff37fe700 1 -- 172.21.15.133:0/1878424754 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feff406e670 con 0x7ff00405f5e0 2021-01-03T13:07:23.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.399+0000 7ff001d9b700 1 --2- 172.21.15.133:0/1878424754 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fefe00553b0 0x7fefe0057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:23.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.399+0000 7ff001d9b700 1 --2- 172.21.15.133:0/1878424754 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fefe00553b0 0x7fefe0057870 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7feff8017000 tx=0x7feff8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:23.411 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.403+0000 7feff37fe700 1 -- 172.21.15.133:0/1878424754 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7feff4044800 con 0x7ff00405f5e0 2021-01-03T13:07:23.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.595+0000 7ff00359e700 1 -- 172.21.15.133:0/1878424754 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0040b3650 con 0x7ff00405f5e0 2021-01-03T13:07:23.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.595+0000 7feff37fe700 1 -- 172.21.15.133:0/1878424754 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2498 (secure 0 0 0) 0x7feff4047e20 con 0x7ff00405f5e0 2021-01-03T13:07:23.601 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:23.601 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":67,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6719,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/2510927889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2510927889},{"type":"v1","addr":"172.21.15.16:6833","nonce":2510927889}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":65},{"gid":6722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1243273461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1243273461},{"type":"v1","addr":"172.21.15.133:6837","nonce":1243273461}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:03.438043+0000","modified":"2021-01-03T13:07:04.442588+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7792},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7792":{"gid":7792,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/679359254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":679359254},{"type":"v1","addr":"172.21.15.133:6835","nonce":679359254}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-01-03T13:07:23.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.595+0000 7ff00359e700 1 -- 172.21.15.133:0/1878424754 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fefe00553b0 msgr2=0x7fefe0057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:23.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.595+0000 7ff00359e700 1 --2- 172.21.15.133:0/1878424754 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fefe00553b0 0x7fefe0057870 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7feff8017000 tx=0x7feff8015000).stop 2021-01-03T13:07:23.603 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.595+0000 7ff00359e700 1 -- 172.21.15.133:0/1878424754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff00405f5e0 msgr2=0x7ff00413ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:23.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.595+0000 7ff00359e700 1 --2- 172.21.15.133:0/1878424754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff00405f5e0 0x7ff00413ae40 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7feff4006dd0 tx=0x7feff4008040).stop 2021-01-03T13:07:23.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.595+0000 7ff00359e700 1 -- 172.21.15.133:0/1878424754 shutdown_connections 2021-01-03T13:07:23.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.595+0000 7ff00359e700 1 --2- 172.21.15.133:0/1878424754 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fefe00553b0 0x7fefe0057870 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.595+0000 7ff00359e700 1 --2- 172.21.15.133:0/1878424754 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff0040b3870 0x7ff004153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.604 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.595+0000 7ff00359e700 1 --2- 172.21.15.133:0/1878424754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff00405f5e0 0x7ff00413ae40 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.595+0000 7ff00359e700 1 --2- 172.21.15.133:0/1878424754 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0040b3060 0x7ff0041473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.595+0000 7ff00359e700 1 -- 172.21.15.133:0/1878424754 >> 172.21.15.133:0/1878424754 conn(0x7ff0040b7200 msgr2=0x7ff0040b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:23.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.595+0000 7ff00359e700 1 -- 172.21.15.133:0/1878424754 shutdown_connections 2021-01-03T13:07:23.605 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.595+0000 7ff00359e700 1 -- 172.21.15.133:0/1878424754 wait complete. 2021-01-03T13:07:23.606 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 67 2021-01-03T13:07:23.615 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-01-03T13:07:23.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f645df61700 1 Processor -- start 2021-01-03T13:07:23.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f645df61700 1 -- start start 2021-01-03T13:07:23.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f645df61700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f645805c130 0x7f64581437e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f645df61700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f64580b02d0 0x7f6458146a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f645df61700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645805c510 con 0x7f645805cc10 2021-01-03T13:07:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f645df61700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64580b0780 con 0x7f64580b02d0 2021-01-03T13:07:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f645df61700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64580b5c10 con 0x7f645805c130 2021-01-03T13:07:23.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f64577fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f645805c130 0x7f64581437e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:23.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f64577fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f645805c130 0x7f64581437e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39810/0 (socket says 172.21.15.133:39810) 2021-01-03T13:07:23.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f64577fe700 1 -- 172.21.15.133:0/2726592040 learned_addr learned my addr 172.21.15.133:0/2726592040 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:23.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f6457fff700 1 --2- 172.21.15.133:0/2726592040 >> v2:172.21.15.16:3300/0 conn(0x7f64580b02d0 0x7f6458146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:23.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f64577fe700 1 -- 172.21.15.133:0/2726592040 >> v2:172.21.15.16:3300/0 conn(0x7f64580b02d0 msgr2=0x7f6458146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:23.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f64577fe700 1 --2- 172.21.15.133:0/2726592040 >> v2:172.21.15.16:3300/0 conn(0x7f64580b02d0 0x7f6458146a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f64577fe700 1 -- 172.21.15.133:0/2726592040 >> v1:172.21.15.133:6789/0 conn(0x7f645805cc10 legacy=0x7f6458146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:23.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f64577fe700 1 -- 172.21.15.133:0/2726592040 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64580af8f0 con 0x7f645805c130 2021-01-03T13:07:23.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f64577fe700 1 --2- 172.21.15.133:0/2726592040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f645805c130 0x7f64581437e0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f6440002f30 tx=0x7f6440006e80).ready entity=mon.1 client_cookie=fb1325245f8e3dba server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:23.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f64567fc700 1 -- 172.21.15.133:0/2726592040 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64400097f0 con 0x7f645805c130 2021-01-03T13:07:23.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f64567fc700 1 -- 172.21.15.133:0/2726592040 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6440009950 con 0x7f645805c130 2021-01-03T13:07:23.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f64567fc700 1 -- 172.21.15.133:0/2726592040 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6440009cf0 con 0x7f645805c130 2021-01-03T13:07:23.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f645df61700 1 -- 172.21.15.133:0/2726592040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f645805c130 msgr2=0x7f64581437e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:23.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.723+0000 7f645df61700 1 --2- 172.21.15.133:0/2726592040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f645805c130 0x7f64581437e0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f6440002f30 tx=0x7f6440006e80).stop 2021-01-03T13:07:23.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f645df61700 1 -- 172.21.15.133:0/2726592040 shutdown_connections 2021-01-03T13:07:23.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f645df61700 1 --2- 172.21.15.133:0/2726592040 >> v2:172.21.15.16:3300/0 conn(0x7f64580b02d0 0x7f6458146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f645df61700 1 --2- 172.21.15.133:0/2726592040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f645805c130 0x7f64581437e0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f645df61700 1 -- 172.21.15.133:0/2726592040 >> 172.21.15.133:0/2726592040 conn(0x7f64580b95d0 msgr2=0x7f64580b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:23.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f645df61700 1 -- 172.21.15.133:0/2726592040 shutdown_connections 2021-01-03T13:07:23.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f645df61700 1 -- 172.21.15.133:0/2726592040 wait complete. 2021-01-03T13:07:23.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f645df61700 1 Processor -- start 2021-01-03T13:07:23.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f645df61700 1 -- start start 2021-01-03T13:07:23.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f645df61700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f645805c130 0x7f6458141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:23.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f645df61700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f645805cc10 0x7f64581557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:23.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f645df61700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64580b02d0 0x7f6458155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:23.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f645df61700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64581416f0 con 0x7f645805c130 2021-01-03T13:07:23.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f645df61700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645809cdb0 con 0x7f64580b02d0 2021-01-03T13:07:23.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f645df61700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6458141920 con 0x7f645805cc10 2021-01-03T13:07:23.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f6457fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64580b02d0 0x7f6458155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:23.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f6457fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64580b02d0 0x7f6458155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39820/0 (socket says 172.21.15.133:39820) 2021-01-03T13:07:23.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f6457fff700 1 -- 172.21.15.133:0/3841693143 learned_addr learned my addr 172.21.15.133:0/3841693143 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:23.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f6456ffd700 1 --2- 172.21.15.133:0/3841693143 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f645805cc10 0x7f64581557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:23.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.727+0000 7f64577fe700 1 --2- 172.21.15.133:0/3841693143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f645805c130 0x7f6458141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:23.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.731+0000 7f6457fff700 1 -- 172.21.15.133:0/3841693143 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f645805cc10 msgr2=0x7f64581557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:23.741 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.731+0000 7f6457fff700 1 --2- 172.21.15.133:0/3841693143 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f645805cc10 0x7f64581557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.731+0000 7f6457fff700 1 -- 172.21.15.133:0/3841693143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f645805c130 msgr2=0x7f6458141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:23.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.731+0000 7f6457fff700 1 --2- 172.21.15.133:0/3841693143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f645805c130 0x7f6458141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:23.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.731+0000 7f6457fff700 1 -- 172.21.15.133:0/3841693143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645809d050 con 0x7f64580b02d0 2021-01-03T13:07:23.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.731+0000 7f6457fff700 1 --2- 172.21.15.133:0/3841693143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64580b02d0 0x7f6458155ca0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f645000a000 tx=0x7f6450008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:23.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.731+0000 7f6454ff9700 1 -- 172.21.15.133:0/3841693143 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f645000b9a0 con 0x7f64580b02d0 2021-01-03T13:07:23.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.731+0000 7f6454ff9700 1 -- 172.21.15.133:0/3841693143 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645000bb00 con 0x7f64580b02d0 2021-01-03T13:07:23.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.731+0000 7f6454ff9700 1 -- 172.21.15.133:0/3841693143 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f645000be60 con 0x7f64580b02d0 2021-01-03T13:07:23.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.731+0000 7f645df61700 1 -- 172.21.15.133:0/3841693143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645809ca30 con 0x7f64580b02d0 2021-01-03T13:07:23.743 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.731+0000 7f645df61700 1 -- 172.21.15.133:0/3841693143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645809c220 con 0x7f64580b02d0 2021-01-03T13:07:23.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.731+0000 7f6454ff9700 1 -- 172.21.15.133:0/3841693143 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f645001c460 con 0x7f64580b02d0 2021-01-03T13:07:23.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.731+0000 7f645df61700 1 -- 172.21.15.133:0/3841693143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6458057300 con 0x7f64580b02d0 2021-01-03T13:07:23.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.731+0000 7f6454ff9700 1 --2- 172.21.15.133:0/3841693143 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f643c0554e0 0x7f643c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:23.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.731+0000 7f6454ff9700 1 -- 172.21.15.133:0/3841693143 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f645006e6b0 con 0x7f64580b02d0 2021-01-03T13:07:23.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.731+0000 7f64577fe700 1 --2- 172.21.15.133:0/3841693143 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f643c0554e0 0x7f643c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:23.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.735+0000 7f64577fe700 1 --2- 172.21.15.133:0/3841693143 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f643c0554e0 0x7f643c0579a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f644001c000 tx=0x7f6440015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:23.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.739+0000 7f6454ff9700 1 -- 172.21.15.133:0/3841693143 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6450044840 con 0x7f64580b02d0 2021-01-03T13:07:23.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:23.923+0000 7f645df61700 1 -- 172.21.15.133:0/3841693143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f645805d270 con 0x7f64580b02d0 2021-01-03T13:07:24.645 INFO:tasks.ceph.mon.b.smithi016.stderr:2021-01-03T13:07:24.644+0000 7fba5c9c4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-01-03T13:07:24.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.647+0000 7f6454ff9700 1 -- 172.21.15.133:0/3841693143 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v68) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6450047e60 con 0x7f64580b02d0 2021-01-03T13:07:24.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.651+0000 7f645df61700 1 -- 172.21.15.133:0/3841693143 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f643c0554e0 msgr2=0x7f643c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:24.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.651+0000 7f645df61700 1 --2- 172.21.15.133:0/3841693143 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f643c0554e0 0x7f643c0579a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f644001c000 tx=0x7f6440015000).stop 2021-01-03T13:07:24.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.651+0000 7f645df61700 1 -- 172.21.15.133:0/3841693143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64580b02d0 msgr2=0x7f6458155ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:24.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.651+0000 7f645df61700 1 --2- 172.21.15.133:0/3841693143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64580b02d0 0x7f6458155ca0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f645000a000 tx=0x7f6450008040).stop 2021-01-03T13:07:24.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.651+0000 7f645df61700 1 -- 172.21.15.133:0/3841693143 shutdown_connections 2021-01-03T13:07:24.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.651+0000 7f645df61700 1 --2- 172.21.15.133:0/3841693143 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f643c0554e0 0x7f643c0579a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:24.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.651+0000 7f645df61700 1 --2- 172.21.15.133:0/3841693143 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f645805c130 0x7f6458141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:24.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.651+0000 7f645df61700 1 --2- 172.21.15.133:0/3841693143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64580b02d0 0x7f6458155ca0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:24.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.651+0000 7f645df61700 1 --2- 172.21.15.133:0/3841693143 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f645805cc10 0x7f64581557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:24.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.651+0000 7f645df61700 1 -- 172.21.15.133:0/3841693143 >> 172.21.15.133:0/3841693143 conn(0x7f64580b95d0 msgr2=0x7f64580b6070 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:24.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.651+0000 7f645df61700 1 -- 172.21.15.133:0/3841693143 shutdown_connections 2021-01-03T13:07:24.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.651+0000 7f645df61700 1 -- 172.21.15.133:0/3841693143 wait complete. 2021-01-03T13:07:24.665 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-01-03T13:07:24.679 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:07:24.685 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T13:07:24.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6482508700 1 Processor -- start 2021-01-03T13:07:24.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6482508700 1 -- start start 2021-01-03T13:07:24.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6482508700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b0c90 0x7f647c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:24.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6482508700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f647c0b5c00 0x7f647c143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:24.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6482508700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c060da0 con 0x7f647c0b52c0 2021-01-03T13:07:24.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6482508700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647c067a90 con 0x7f647c0b5c00 2021-01-03T13:07:24.790 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6482508700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c0b0ad0 con 0x7f647c0b0c90 2021-01-03T13:07:24.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6481506700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f647c0b52c0 0x7f647c098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60868/0 (socket says 172.21.15.133:60868) 2021-01-03T13:07:24.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6481506700 1 -- 172.21.15.133:0/3400023227 learned_addr learned my addr 172.21.15.133:0/3400023227 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:24.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6481d07700 1 --2- 172.21.15.133:0/3400023227 >> v2:172.21.15.16:3300/0 conn(0x7f647c0b5c00 0x7f647c143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:24.791 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6480d05700 1 --2- 172.21.15.133:0/3400023227 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b0c90 0x7f647c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:24.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6473fff700 1 -- 172.21.15.133:0/3400023227 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676321647 0 0) 0x7f647c060da0 con 0x7f647c0b52c0 2021-01-03T13:07:24.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6473fff700 1 -- 172.21.15.133:0/3400023227 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6460003230 con 0x7f647c0b52c0 2021-01-03T13:07:24.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6473fff700 1 -- 172.21.15.133:0/3400023227 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1069974848 0 0) 0x7f6460003230 con 0x7f647c0b52c0 2021-01-03T13:07:24.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6473fff700 1 -- 172.21.15.133:0/3400023227 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b0c90 msgr2=0x7f647c0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:24.792 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6473fff700 1 --2- 172.21.15.133:0/3400023227 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b0c90 0x7f647c0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6473fff700 1 -- 172.21.15.133:0/3400023227 >> v2:172.21.15.16:3300/0 conn(0x7f647c0b5c00 msgr2=0x7f647c143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6473fff700 1 --2- 172.21.15.133:0/3400023227 >> v2:172.21.15.16:3300/0 conn(0x7f647c0b5c00 0x7f647c143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6473fff700 1 -- 172.21.15.133:0/3400023227 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c0b56a0 con 0x7f647c0b52c0 2021-01-03T13:07:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6473fff700 1 -- 172.21.15.133:0/3400023227 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f6474001a50 con 0x7f647c0b52c0 2021-01-03T13:07:24.793 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6481d07700 1 --2- 172.21.15.133:0/3400023227 >> v2:172.21.15.16:3300/0 conn(0x7f647c0b5c00 0x7f647c143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:24.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6480d05700 1 --2- 172.21.15.133:0/3400023227 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b0c90 0x7f647c0b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:24.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6473fff700 1 -- 172.21.15.133:0/3400023227 >> v1:172.21.15.133:6789/0 conn(0x7f647c0b52c0 legacy=0x7f647c098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:24.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6473fff700 1 --2- 172.21.15.133:0/3400023227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6460003720 0x7f6460003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:24.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6473fff700 1 --2- 172.21.15.133:0/3400023227 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b0c90 0x7f64600044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6473fff700 1 --2- 172.21.15.133:0/3400023227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64600049c0 0x7f6460004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6473fff700 1 -- 172.21.15.133:0/3400023227 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c067a90 con 0x7f64600049c0 2021-01-03T13:07:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6473fff700 1 -- 172.21.15.133:0/3400023227 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c0b0ad0 con 0x7f6460003720 2021-01-03T13:07:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6473fff700 1 -- 172.21.15.133:0/3400023227 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64600041a0 con 0x7f647c0b0c90 2021-01-03T13:07:24.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.779+0000 7f6481506700 1 --2- 172.21.15.133:0/3400023227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6460003720 0x7f6460003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6481d07700 1 --2- 172.21.15.133:0/3400023227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64600049c0 0x7f6460004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6480d05700 1 --2- 172.21.15.133:0/3400023227 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b0c90 0x7f64600044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6481506700 1 -- 172.21.15.133:0/3400023227 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b0c90 msgr2=0x7f64600044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6481506700 1 --2- 172.21.15.133:0/3400023227 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c0b0c90 0x7f64600044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:24.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6481506700 1 -- 172.21.15.133:0/3400023227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64600049c0 msgr2=0x7f6460004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:24.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6481506700 1 --2- 172.21.15.133:0/3400023227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64600049c0 0x7f6460004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:24.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6481506700 1 -- 172.21.15.133:0/3400023227 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6460003230 con 0x7f6460003720 2021-01-03T13:07:24.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6481d07700 1 --2- 172.21.15.133:0/3400023227 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f64600049c0 0x7f6460004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:24.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6481506700 1 --2- 172.21.15.133:0/3400023227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6460003720 0x7f6460003b40 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f6474001760 tx=0x7f647c0b0070).ready entity=mon.1 client_cookie=b24a9859b5889a71 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:24.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6473fff700 1 -- 172.21.15.133:0/3400023227 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6474005b70 con 0x7f6460003720 2021-01-03T13:07:24.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6473fff700 1 -- 172.21.15.133:0/3400023227 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6474005cd0 con 0x7f6460003720 2021-01-03T13:07:24.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6473fff700 1 -- 172.21.15.133:0/3400023227 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6474007300 con 0x7f6460003720 2021-01-03T13:07:24.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6482508700 1 -- 172.21.15.133:0/3400023227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6460003720 msgr2=0x7f6460003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:24.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6482508700 1 --2- 172.21.15.133:0/3400023227 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6460003720 0x7f6460003b40 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f6474001760 tx=0x7f647c0b0070).stop 2021-01-03T13:07:24.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6481d07700 1 -- 172.21.15.133:0/3400023227 reap_dead start 2021-01-03T13:07:24.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6482508700 1 -- 172.21.15.133:0/3400023227 shutdown_connections 2021-01-03T13:07:24.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6482508700 1 -- 172.21.15.133:0/3400023227 >> 172.21.15.133:0/3400023227 conn(0x7f647c05bdf0 msgr2=0x7f647c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:24.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6482508700 1 -- 172.21.15.133:0/3400023227 shutdown_connections 2021-01-03T13:07:24.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.783+0000 7f6482508700 1 -- 172.21.15.133:0/3400023227 wait complete. 2021-01-03T13:07:24.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6482508700 1 Processor -- start 2021-01-03T13:07:24.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6482508700 1 -- start start 2021-01-03T13:07:24.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6482508700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c14b010 0x7f647c155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:24.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6482508700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c14b3f0 0x7f647c148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:24.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6482508700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c148e80 0x7f647c14c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:24.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6482508700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c0657e0 con 0x7f647c14b010 2021-01-03T13:07:24.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6482508700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c14b850 con 0x7f647c148e80 2021-01-03T13:07:24.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6482508700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c1594c0 con 0x7f647c14b3f0 2021-01-03T13:07:24.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6481d07700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c148e80 0x7f647c14c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:24.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6481d07700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c148e80 0x7f647c14c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39852/0 (socket says 172.21.15.133:39852) 2021-01-03T13:07:24.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6481d07700 1 -- 172.21.15.133:0/843514131 learned_addr learned my addr 172.21.15.133:0/843514131 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:24.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6480d05700 1 --2- 172.21.15.133:0/843514131 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c14b3f0 0x7f647c148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:24.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6481506700 1 --2- 172.21.15.133:0/843514131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c14b010 0x7f647c155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:24.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6481d07700 1 -- 172.21.15.133:0/843514131 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c14b3f0 msgr2=0x7f647c148990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:24.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6481d07700 1 --2- 172.21.15.133:0/843514131 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c14b3f0 0x7f647c148990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:24.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6481d07700 1 -- 172.21.15.133:0/843514131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c14b010 msgr2=0x7f647c155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:24.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6481d07700 1 --2- 172.21.15.133:0/843514131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c14b010 0x7f647c155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:24.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6481d07700 1 -- 172.21.15.133:0/843514131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c15a370 con 0x7f647c148e80 2021-01-03T13:07:24.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6481d07700 1 --2- 172.21.15.133:0/843514131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c148e80 0x7f647c14c9e0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f6478008000 tx=0x7f6478008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:24.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f64727fc700 1 -- 172.21.15.133:0/843514131 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6478019070 con 0x7f647c148e80 2021-01-03T13:07:24.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f64727fc700 1 -- 172.21.15.133:0/843514131 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647800e9b0 con 0x7f647c148e80 2021-01-03T13:07:24.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6482508700 1 -- 172.21.15.133:0/843514131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647c1596f0 con 0x7f647c148e80 2021-01-03T13:07:24.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f64727fc700 1 -- 172.21.15.133:0/843514131 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f647800ed10 con 0x7f647c148e80 2021-01-03T13:07:24.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.787+0000 7f6482508700 1 -- 172.21.15.133:0/843514131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647c159c30 con 0x7f647c148e80 2021-01-03T13:07:24.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.791+0000 7f6482508700 1 -- 172.21.15.133:0/843514131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647c15a070 con 0x7f647c148e80 2021-01-03T13:07:24.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.791+0000 7f64727fc700 1 -- 172.21.15.133:0/843514131 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f6478014470 con 0x7f647c148e80 2021-01-03T13:07:24.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.791+0000 7f64727fc700 1 --2- 172.21.15.133:0/843514131 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64640553b0 0x7f6464057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:24.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.791+0000 7f64727fc700 1 -- 172.21.15.133:0/843514131 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f647806e460 con 0x7f647c148e80 2021-01-03T13:07:24.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.791+0000 7f6481506700 1 --2- 172.21.15.133:0/843514131 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64640553b0 0x7f6464057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:24.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.791+0000 7f6481506700 1 --2- 172.21.15.133:0/843514131 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64640553b0 0x7f6464057870 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f647401b000 tx=0x7f6474014000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:24.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.799+0000 7f64727fc700 1 -- 172.21.15.133:0/843514131 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f64780446b0 con 0x7f647c148e80 2021-01-03T13:07:24.993 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.987+0000 7f6482508700 1 -- 172.21.15.133:0/843514131 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f647c057300 con 0x7f647c148e80 2021-01-03T13:07:24.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.987+0000 7f64727fc700 1 -- 172.21.15.133:0/843514131 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f6478047cd0 con 0x7f647c148e80 2021-01-03T13:07:24.994 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:24.994 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":68,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6719,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/2510927889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2510927889},{"type":"v1","addr":"172.21.15.16:6833","nonce":2510927889}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":65},{"gid":6722,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6837/1243273461","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":1243273461},{"type":"v1","addr":"172.21.15.133:6837","nonce":1243273461}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:03.438043+0000","modified":"2021-01-03T13:07:24.645055+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":144,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2021-01-03T13:07:24.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.987+0000 7f6482508700 1 -- 172.21.15.133:0/843514131 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64640553b0 msgr2=0x7f6464057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:24.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.987+0000 7f6482508700 1 --2- 172.21.15.133:0/843514131 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64640553b0 0x7f6464057870 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f647401b000 tx=0x7f6474014000).stop 2021-01-03T13:07:24.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.987+0000 7f6482508700 1 -- 172.21.15.133:0/843514131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c148e80 msgr2=0x7f647c14c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:24.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.987+0000 7f6482508700 1 --2- 172.21.15.133:0/843514131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c148e80 0x7f647c14c9e0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f6478008000 tx=0x7f6478008040).stop 2021-01-03T13:07:24.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.991+0000 7f6482508700 1 -- 172.21.15.133:0/843514131 shutdown_connections 2021-01-03T13:07:24.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.991+0000 7f6482508700 1 --2- 172.21.15.133:0/843514131 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f64640553b0 0x7f6464057870 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:24.997 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.991+0000 7f6482508700 1 --2- 172.21.15.133:0/843514131 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f647c14b010 0x7f647c155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:24.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.991+0000 7f6482508700 1 --2- 172.21.15.133:0/843514131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f647c148e80 0x7f647c14c9e0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:24.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.991+0000 7f6482508700 1 --2- 172.21.15.133:0/843514131 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f647c14b3f0 0x7f647c148990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:24.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.991+0000 7f6482508700 1 -- 172.21.15.133:0/843514131 >> 172.21.15.133:0/843514131 conn(0x7f647c05bdf0 msgr2=0x7f647c0b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:24.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.991+0000 7f6482508700 1 -- 172.21.15.133:0/843514131 shutdown_connections 2021-01-03T13:07:24.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:24.991+0000 7f6482508700 1 -- 172.21.15.133:0/843514131 wait complete. 2021-01-03T13:07:24.999 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 68 2021-01-03T13:07:25.008 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-01-03T13:07:25.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.163+0000 7fe111218700 1 Processor -- start 2021-01-03T13:07:25.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.163+0000 7fe111218700 1 -- start start 2021-01-03T13:07:25.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.163+0000 7fe111218700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe10c0b52c0 0x7fe10c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:25.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.163+0000 7fe111218700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe10c0b5c00 0x7fe10c143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:25.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.163+0000 7fe111218700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10c060da0 con 0x7fe10c0b0c90 2021-01-03T13:07:25.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.163+0000 7fe111218700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe10c067a90 con 0x7fe10c0b5c00 2021-01-03T13:07:25.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.163+0000 7fe111218700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c0b0ad0 con 0x7fe10c0b52c0 2021-01-03T13:07:25.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10b7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe10c0b0c90 0x7fe10c098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60888/0 (socket says 172.21.15.133:60888) 2021-01-03T13:07:25.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10b7fe700 1 -- 172.21.15.133:0/165273255 learned_addr learned my addr 172.21.15.133:0/165273255 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:25.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10bfff700 1 --2- 172.21.15.133:0/165273255 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe10c0b52c0 0x7fe10c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:25.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe110a17700 1 --2- 172.21.15.133:0/165273255 >> v2:172.21.15.16:3300/0 conn(0x7fe10c0b5c00 0x7fe10c143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:25.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 -- 172.21.15.133:0/165273255 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279527266 0 0) 0x7fe10c060da0 con 0x7fe10c0b0c90 2021-01-03T13:07:25.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 -- 172.21.15.133:0/165273255 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0ec003230 con 0x7fe10c0b0c90 2021-01-03T13:07:25.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 -- 172.21.15.133:0/165273255 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1316169178 0 0) 0x7fe0ec003230 con 0x7fe10c0b0c90 2021-01-03T13:07:25.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 -- 172.21.15.133:0/165273255 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe10c0b52c0 msgr2=0x7fe10c0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:25.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 --2- 172.21.15.133:0/165273255 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe10c0b52c0 0x7fe10c0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:25.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 -- 172.21.15.133:0/165273255 >> v2:172.21.15.16:3300/0 conn(0x7fe10c0b5c00 msgr2=0x7fe10c143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:25.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 --2- 172.21.15.133:0/165273255 >> v2:172.21.15.16:3300/0 conn(0x7fe10c0b5c00 0x7fe10c143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:25.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 -- 172.21.15.133:0/165273255 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c0b56a0 con 0x7fe10c0b0c90 2021-01-03T13:07:25.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 -- 172.21.15.133:0/165273255 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fe0f40016d0 con 0x7fe10c0b0c90 2021-01-03T13:07:25.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 -- 172.21.15.133:0/165273255 >> v1:172.21.15.133:6789/0 conn(0x7fe10c0b0c90 legacy=0x7fe10c098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:25.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 --2- 172.21.15.133:0/165273255 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe10c0b52c0 0x7fe0ec003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:25.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 --2- 172.21.15.133:0/165273255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0ec003c30 0x7fe0ec0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:25.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 --2- 172.21.15.133:0/165273255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0ec0049c0 0x7fe0ec004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:25.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 -- 172.21.15.133:0/165273255 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c067a90 con 0x7fe0ec0049c0 2021-01-03T13:07:25.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 -- 172.21.15.133:0/165273255 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c0b0ad0 con 0x7fe0ec003c30 2021-01-03T13:07:25.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 -- 172.21.15.133:0/165273255 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0041f0 con 0x7fe10c0b52c0 2021-01-03T13:07:25.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe110a17700 1 --2- 172.21.15.133:0/165273255 >> v2:172.21.15.16:3300/0 conn(0x7fe10c0b5c00 0x7fe10c143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:25.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10b7fe700 1 --2- 172.21.15.133:0/165273255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0ec003c30 0x7fe0ec0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:25.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10b7fe700 1 -- 172.21.15.133:0/165273255 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe10c0b52c0 msgr2=0x7fe0ec003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:25.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10b7fe700 1 --2- 172.21.15.133:0/165273255 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe10c0b52c0 0x7fe0ec003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-03T13:07:25.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10b7fe700 1 -- 172.21.15.133:0/165273255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0ec0049c0 msgr2=0x7fe0ec004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:25.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10b7fe700 1 --2- 172.21.15.133:0/165273255 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0ec0049c0 0x7fe0ec004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-03T13:07:25.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10b7fe700 1 -- 172.21.15.133:0/165273255 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec003230 con 0x7fe0ec003c30 2021-01-03T13:07:25.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10b7fe700 1 --2- 172.21.15.133:0/165273255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0ec003c30 0x7fe0ec0044d0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fe0f40013e0 tx=0x7fe10c0b0070).ready entity=mon.1 client_cookie=c0fb54b6e50336b1 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:25.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 -- 172.21.15.133:0/165273255 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0f40070d0 con 0x7fe0ec003c30 2021-01-03T13:07:25.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 -- 172.21.15.133:0/165273255 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f4007230 con 0x7fe0ec003c30 2021-01-03T13:07:25.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe10affd700 1 -- 172.21.15.133:0/165273255 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0f40055e0 con 0x7fe0ec003c30 2021-01-03T13:07:25.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe111218700 1 -- 172.21.15.133:0/165273255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0ec003c30 msgr2=0x7fe0ec0044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:25.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe111218700 1 --2- 172.21.15.133:0/165273255 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0ec003c30 0x7fe0ec0044d0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fe0f40013e0 tx=0x7fe10c0b0070).stop 2021-01-03T13:07:25.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe110a17700 1 -- 172.21.15.133:0/165273255 reap_dead start 2021-01-03T13:07:25.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe111218700 1 -- 172.21.15.133:0/165273255 shutdown_connections 2021-01-03T13:07:25.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe111218700 1 -- 172.21.15.133:0/165273255 >> 172.21.15.133:0/165273255 conn(0x7fe10c05bdf0 msgr2=0x7fe10c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:25.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe111218700 1 -- 172.21.15.133:0/165273255 shutdown_connections 2021-01-03T13:07:25.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.167+0000 7fe111218700 1 -- 172.21.15.133:0/165273255 wait complete. 2021-01-03T13:07:25.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe111218700 1 Processor -- start 2021-01-03T13:07:25.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe111218700 1 -- start start 2021-01-03T13:07:25.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe111218700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe10c159730 0x7fe10c0ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:25.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe111218700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe10c0aaff0 0x7fe10c0ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:25.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe111218700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe10c0aa8d0 0x7fe10c142150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:25.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe111218700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c0ac430 con 0x7fe10c0aaff0 2021-01-03T13:07:25.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe111218700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c0acd80 con 0x7fe10c159730 2021-01-03T13:07:25.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe111218700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c159f00 con 0x7fe10c0aa8d0 2021-01-03T13:07:25.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe10bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe10c159730 0x7fe10c0ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:25.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe10bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe10c159730 0x7fe10c0ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39868/0 (socket says 172.21.15.133:39868) 2021-01-03T13:07:25.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe10bfff700 1 -- 172.21.15.133:0/679614751 learned_addr learned my addr 172.21.15.133:0/679614751 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:25.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe10b7fe700 1 --2- 172.21.15.133:0/679614751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe10c0aaff0 0x7fe10c0ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:25.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe110a17700 1 --2- 172.21.15.133:0/679614751 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe10c0aa8d0 0x7fe10c142150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:25.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe10bfff700 1 -- 172.21.15.133:0/679614751 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe10c0aa8d0 msgr2=0x7fe10c142150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:25.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe10bfff700 1 --2- 172.21.15.133:0/679614751 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe10c0aa8d0 0x7fe10c142150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:25.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe10bfff700 1 -- 172.21.15.133:0/679614751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe10c0aaff0 msgr2=0x7fe10c0ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:25.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe10bfff700 1 --2- 172.21.15.133:0/679614751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe10c0aaff0 0x7fe10c0ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:25.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe10bfff700 1 -- 172.21.15.133:0/679614751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c15a1a0 con 0x7fe10c159730 2021-01-03T13:07:25.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe10bfff700 1 --2- 172.21.15.133:0/679614751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe10c159730 0x7fe10c0ac890 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7fe0fc00c000 tx=0x7fe0fc006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:25.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe1097fa700 1 -- 172.21.15.133:0/679614751 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0fc016070 con 0x7fe10c159730 2021-01-03T13:07:25.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe111218700 1 -- 172.21.15.133:0/679614751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10c0ae6c0 con 0x7fe10c159730 2021-01-03T13:07:25.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe1097fa700 1 -- 172.21.15.133:0/679614751 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc010780 con 0x7fe10c159730 2021-01-03T13:07:25.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe1097fa700 1 -- 172.21.15.133:0/679614751 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0fc010ae0 con 0x7fe10c159730 2021-01-03T13:07:25.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.171+0000 7fe111218700 1 -- 172.21.15.133:0/679614751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10c159b10 con 0x7fe10c159730 2021-01-03T13:07:25.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.175+0000 7fe111218700 1 -- 172.21.15.133:0/679614751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10c159d60 con 0x7fe10c159730 2021-01-03T13:07:25.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.175+0000 7fe1097fa700 1 -- 172.21.15.133:0/679614751 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe0fc010c40 con 0x7fe10c159730 2021-01-03T13:07:25.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.175+0000 7fe1097fa700 1 --2- 172.21.15.133:0/679614751 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe0f00553b0 0x7fe0f0057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:25.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.175+0000 7fe1097fa700 1 -- 172.21.15.133:0/679614751 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe0fc06e8d0 con 0x7fe10c159730 2021-01-03T13:07:25.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.175+0000 7fe10b7fe700 1 --2- 172.21.15.133:0/679614751 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe0f00553b0 0x7fe0f0057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:25.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.175+0000 7fe10b7fe700 1 --2- 172.21.15.133:0/679614751 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe0f00553b0 0x7fe0f0057870 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fe0f4018000 tx=0x7fe0f4013000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:25.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.183+0000 7fe1097fa700 1 -- 172.21.15.133:0/679614751 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe0fc044b80 con 0x7fe10c159730 2021-01-03T13:07:25.371 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:25.363+0000 7fe111218700 1 -- 172.21.15.133:0/679614751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe10c159d60 con 0x7fe10c159730 2021-01-03T13:07:26.346 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.339+0000 7fe1097fa700 1 -- 172.21.15.133:0/679614751 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v69) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe10c159d60 con 0x7fe10c159730 2021-01-03T13:07:26.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.343+0000 7fe111218700 1 -- 172.21.15.133:0/679614751 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe0f00553b0 msgr2=0x7fe0f0057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:26.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.343+0000 7fe111218700 1 --2- 172.21.15.133:0/679614751 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe0f00553b0 0x7fe0f0057870 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fe0f4018000 tx=0x7fe0f4013000).stop 2021-01-03T13:07:26.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.343+0000 7fe111218700 1 -- 172.21.15.133:0/679614751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe10c159730 msgr2=0x7fe10c0ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:26.350 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.343+0000 7fe111218700 1 --2- 172.21.15.133:0/679614751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe10c159730 0x7fe10c0ac890 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7fe0fc00c000 tx=0x7fe0fc006dc0).stop 2021-01-03T13:07:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.343+0000 7fe111218700 1 -- 172.21.15.133:0/679614751 shutdown_connections 2021-01-03T13:07:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.343+0000 7fe111218700 1 --2- 172.21.15.133:0/679614751 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe0f00553b0 0x7fe0f0057870 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.343+0000 7fe111218700 1 --2- 172.21.15.133:0/679614751 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe10c0aa8d0 0x7fe10c142150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.343+0000 7fe111218700 1 --2- 172.21.15.133:0/679614751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe10c159730 0x7fe10c0ac890 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.343+0000 7fe111218700 1 --2- 172.21.15.133:0/679614751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe10c0aaff0 0x7fe10c0ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:26.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.343+0000 7fe111218700 1 -- 172.21.15.133:0/679614751 >> 172.21.15.133:0/679614751 conn(0x7fe10c05bdf0 msgr2=0x7fe10c0b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:26.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.343+0000 7fe111218700 1 -- 172.21.15.133:0/679614751 shutdown_connections 2021-01-03T13:07:26.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.343+0000 7fe111218700 1 -- 172.21.15.133:0/679614751 wait complete. 2021-01-03T13:07:26.367 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-01-03T13:07:26.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f2020d23700 1 Processor -- start 2021-01-03T13:07:26.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f2020d23700 1 -- start start 2021-01-03T13:07:26.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f2020d23700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f201c0a9190 0x7f201c0ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:26.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f2020d23700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201c140ae0 con 0x7f201c0677a0 2021-01-03T13:07:26.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f2020d23700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201c067b80 con 0x7f201c05c670 2021-01-03T13:07:26.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f2020d23700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201c0ace10 con 0x7f201c0a9190 2021-01-03T13:07:26.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f201affd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f201c05c670 0x7f201c0a8a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60910/0 (socket says 172.21.15.133:60910) 2021-01-03T13:07:26.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f201affd700 1 -- 172.21.15.133:0/4258178465 learned_addr learned my addr 172.21.15.133:0/4258178465 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:26.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f201bfff700 1 --2- 172.21.15.133:0/4258178465 >> v2:172.21.15.16:3300/0 conn(0x7f201c0a9190 0x7f201c0ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:26.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f201a7fc700 1 -- 172.21.15.133:0/4258178465 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239883110 0 0) 0x7f201c067b80 con 0x7f201c05c670 2021-01-03T13:07:26.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f201a7fc700 1 -- 172.21.15.133:0/4258178465 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ffc003230 con 0x7f201c05c670 2021-01-03T13:07:26.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f201bfff700 1 -- 172.21.15.133:0/4258178465 >> v1:172.21.15.133:6789/0 conn(0x7f201c05c670 legacy=0x7f201c0a8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:26.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f201bfff700 1 -- 172.21.15.133:0/4258178465 >> v1:172.21.15.16:6789/0 conn(0x7f201c0677a0 legacy=0x7f201c146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:26.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f201bfff700 1 -- 172.21.15.133:0/4258178465 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c0b1560 con 0x7f201c0a9190 2021-01-03T13:07:26.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f201bfff700 1 --2- 172.21.15.133:0/4258178465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f201c0a9190 0x7f201c0ae3b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f2014003300 tx=0x7f20140091a0).ready entity=mon.0 client_cookie=eb5bcb370189a674 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:26.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f201a7fc700 1 -- 172.21.15.133:0/4258178465 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f201400b9a0 con 0x7f201c0a9190 2021-01-03T13:07:26.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f201a7fc700 1 -- 172.21.15.133:0/4258178465 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201400bb00 con 0x7f201c0a9190 2021-01-03T13:07:26.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f201a7fc700 1 -- 172.21.15.133:0/4258178465 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f201400bc70 con 0x7f201c0a9190 2021-01-03T13:07:26.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f2020d23700 1 -- 172.21.15.133:0/4258178465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f201c0a9190 msgr2=0x7f201c0ae3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:26.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f2020d23700 1 --2- 172.21.15.133:0/4258178465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f201c0a9190 0x7f201c0ae3b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f2014003300 tx=0x7f20140091a0).stop 2021-01-03T13:07:26.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f2020d23700 1 -- 172.21.15.133:0/4258178465 shutdown_connections 2021-01-03T13:07:26.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f2020d23700 1 --2- 172.21.15.133:0/4258178465 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f201c0a9190 0x7f201c0ae3b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:26.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f2020d23700 1 -- 172.21.15.133:0/4258178465 >> 172.21.15.133:0/4258178465 conn(0x7f201c06b050 msgr2=0x7f201c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:26.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.487+0000 7f2020d23700 1 -- 172.21.15.133:0/4258178465 shutdown_connections 2021-01-03T13:07:26.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.491+0000 7f2020d23700 1 -- 172.21.15.133:0/4258178465 wait complete. 2021-01-03T13:07:26.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.491+0000 7f2020d23700 1 Processor -- start 2021-01-03T13:07:26.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.491+0000 7f2020d23700 1 -- start start 2021-01-03T13:07:26.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f2020d23700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f201c05c670 0x7f201c149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:26.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f2020d23700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f201c0677a0 0x7f201c0a9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:26.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f2020d23700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f201c0a9190 0x7f201c13fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:26.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f2020d23700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c146ce0 con 0x7f201c0677a0 2021-01-03T13:07:26.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f2020d23700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c0a97e0 con 0x7f201c0a9190 2021-01-03T13:07:26.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f2020d23700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c146a40 con 0x7f201c05c670 2021-01-03T13:07:26.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f201bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f201c0a9190 0x7f201c13fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:26.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f201bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f201c0a9190 0x7f201c13fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39886/0 (socket says 172.21.15.133:39886) 2021-01-03T13:07:26.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f201bfff700 1 -- 172.21.15.133:0/1023642422 learned_addr learned my addr 172.21.15.133:0/1023642422 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:26.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f201affd700 1 --2- 172.21.15.133:0/1023642422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f201c0677a0 0x7f201c0a9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:26.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f201b7fe700 1 --2- 172.21.15.133:0/1023642422 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f201c05c670 0x7f201c149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:26.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f201bfff700 1 -- 172.21.15.133:0/1023642422 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f201c05c670 msgr2=0x7f201c149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:26.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f201bfff700 1 --2- 172.21.15.133:0/1023642422 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f201c05c670 0x7f201c149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:26.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f201bfff700 1 -- 172.21.15.133:0/1023642422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f201c0677a0 msgr2=0x7f201c0a9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:26.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f201bfff700 1 --2- 172.21.15.133:0/1023642422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f201c0677a0 0x7f201c0a9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:26.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f201bfff700 1 -- 172.21.15.133:0/1023642422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c146160 con 0x7f201c0a9190 2021-01-03T13:07:26.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f201bfff700 1 --2- 172.21.15.133:0/1023642422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f201c0a9190 0x7f201c13fad0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f2014003300 tx=0x7f2014016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:26.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f2018ff9700 1 -- 172.21.15.133:0/1023642422 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2014005c80 con 0x7f201c0a9190 2021-01-03T13:07:26.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f2018ff9700 1 -- 172.21.15.133:0/1023642422 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2014005de0 con 0x7f201c0a9190 2021-01-03T13:07:26.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f2020d23700 1 -- 172.21.15.133:0/1023642422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f201c145d80 con 0x7f201c0a9190 2021-01-03T13:07:26.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f2018ff9700 1 -- 172.21.15.133:0/1023642422 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2014006220 con 0x7f201c0a9190 2021-01-03T13:07:26.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f2020d23700 1 -- 172.21.15.133:0/1023642422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201c1554b0 con 0x7f201c0a9190 2021-01-03T13:07:26.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.495+0000 7f2020d23700 1 -- 172.21.15.133:0/1023642422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201c146470 con 0x7f201c0a9190 2021-01-03T13:07:26.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.499+0000 7f2018ff9700 1 -- 172.21.15.133:0/1023642422 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f201401e070 con 0x7f201c0a9190 2021-01-03T13:07:26.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.499+0000 7f2018ff9700 1 --2- 172.21.15.133:0/1023642422 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2000055440 0x7f2000057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:26.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.499+0000 7f2018ff9700 1 -- 172.21.15.133:0/1023642422 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f201406ef40 con 0x7f201c0a9190 2021-01-03T13:07:26.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.499+0000 7f201b7fe700 1 --2- 172.21.15.133:0/1023642422 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2000055440 0x7f2000057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:26.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.499+0000 7f201b7fe700 1 --2- 172.21.15.133:0/1023642422 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2000055440 0x7f2000057900 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f200c00d000 tx=0x7f200c000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:26.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.503+0000 7f2018ff9700 1 -- 172.21.15.133:0/1023642422 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f201c146470 con 0x7f201c0a9190 2021-01-03T13:07:26.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:26.643+0000 7f2020d23700 1 -- 172.21.15.133:0/1023642422 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f201c146470 con 0x7f201c0a9190 2021-01-03T13:07:27.358 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.351+0000 7f2018ff9700 1 -- 172.21.15.133:0/1023642422 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v145) v1 ==== 185+0+0 (secure 0 0 0) 0x7f201c146470 con 0x7f201c0a9190 2021-01-03T13:07:27.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.355+0000 7f2020d23700 1 -- 172.21.15.133:0/1023642422 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2000055440 msgr2=0x7f2000057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:27.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.355+0000 7f2020d23700 1 --2- 172.21.15.133:0/1023642422 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2000055440 0x7f2000057900 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f200c00d000 tx=0x7f200c000b80).stop 2021-01-03T13:07:27.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.355+0000 7f2020d23700 1 -- 172.21.15.133:0/1023642422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f201c0a9190 msgr2=0x7f201c13fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:27.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.355+0000 7f2020d23700 1 --2- 172.21.15.133:0/1023642422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f201c0a9190 0x7f201c13fad0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f2014003300 tx=0x7f2014016000).stop 2021-01-03T13:07:27.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.355+0000 7f2020d23700 1 -- 172.21.15.133:0/1023642422 shutdown_connections 2021-01-03T13:07:27.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.355+0000 7f2020d23700 1 --2- 172.21.15.133:0/1023642422 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2000055440 0x7f2000057900 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:27.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.355+0000 7f2020d23700 1 --2- 172.21.15.133:0/1023642422 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f201c0a9190 0x7f201c13fad0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:27.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.355+0000 7f2020d23700 1 --2- 172.21.15.133:0/1023642422 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f201c05c670 0x7f201c149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:27.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.355+0000 7f2020d23700 1 --2- 172.21.15.133:0/1023642422 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f201c0677a0 0x7f201c0a9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:27.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.355+0000 7f2020d23700 1 -- 172.21.15.133:0/1023642422 >> 172.21.15.133:0/1023642422 conn(0x7f201c06b050 msgr2=0x7f201c0a8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:27.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.355+0000 7f2020d23700 1 -- 172.21.15.133:0/1023642422 shutdown_connections 2021-01-03T13:07:27.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.355+0000 7f2020d23700 1 -- 172.21.15.133:0/1023642422 wait complete. 2021-01-03T13:07:27.367 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2021-01-03T13:07:27.378 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-01-03T13:07:27.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.491+0000 7fe83010b700 1 Processor -- start 2021-01-03T13:07:27.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.491+0000 7fe83010b700 1 -- start start 2021-01-03T13:07:27.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe83010b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe828140410 0x7fe828146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:27.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe83010b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe8280b0470 0x7fe82805bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:27.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe83010b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82805cf20 con 0x7fe8281407f0 2021-01-03T13:07:27.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe83010b700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8280b02d0 con 0x7fe828140410 2021-01-03T13:07:27.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe83010b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe828146390 con 0x7fe8280b0470 2021-01-03T13:07:27.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe82e6a8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe8280b0470 0x7fe82805bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:27.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe82e6a8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe8280b0470 0x7fe82805bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39890/0 (socket says 172.21.15.133:39890) 2021-01-03T13:07:27.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe82d6a6700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe8281407f0 0x7fe828142dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60922/0 (socket says 172.21.15.133:60922) 2021-01-03T13:07:27.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe82e6a8700 1 -- 172.21.15.133:0/565270082 learned_addr learned my addr 172.21.15.133:0/565270082 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:27.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe82dea7700 1 --2- 172.21.15.133:0/565270082 >> v2:172.21.15.16:3300/0 conn(0x7fe828140410 0x7fe828146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:27.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe82e6a8700 1 -- 172.21.15.133:0/565270082 >> v2:172.21.15.16:3300/0 conn(0x7fe828140410 msgr2=0x7fe828146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:27.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe82e6a8700 1 --2- 172.21.15.133:0/565270082 >> v2:172.21.15.16:3300/0 conn(0x7fe828140410 0x7fe828146cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:27.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe82e6a8700 1 -- 172.21.15.133:0/565270082 >> v1:172.21.15.133:6789/0 conn(0x7fe8281407f0 legacy=0x7fe828142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:27.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe82e6a8700 1 -- 172.21.15.133:0/565270082 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe828146580 con 0x7fe8280b0470 2021-01-03T13:07:27.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe82cea5700 1 -- 172.21.15.133:0/565270082 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324726710 0 0) 0x7fe82805cf20 con 0x7fe8281407f0 2021-01-03T13:07:27.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe82e6a8700 1 --2- 172.21.15.133:0/565270082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8280b0470 0x7fe82805bdf0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7fe8200032b0 tx=0x7fe820009270).ready entity=mon.1 client_cookie=e704fa6453954c02 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe82cea5700 1 -- 172.21.15.133:0/565270082 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe82000bc00 con 0x7fe8280b0470 2021-01-03T13:07:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe82cea5700 1 -- 172.21.15.133:0/565270082 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82000bd60 con 0x7fe8280b0470 2021-01-03T13:07:27.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe82cea5700 1 -- 172.21.15.133:0/565270082 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe820011400 con 0x7fe8280b0470 2021-01-03T13:07:27.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe83010b700 1 -- 172.21.15.133:0/565270082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8280b0470 msgr2=0x7fe82805bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:27.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe83010b700 1 --2- 172.21.15.133:0/565270082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8280b0470 0x7fe82805bdf0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7fe8200032b0 tx=0x7fe820009270).stop 2021-01-03T13:07:27.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe83010b700 1 -- 172.21.15.133:0/565270082 shutdown_connections 2021-01-03T13:07:27.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe83010b700 1 --2- 172.21.15.133:0/565270082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8280b0470 0x7fe82805bdf0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:27.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe83010b700 1 --2- 172.21.15.133:0/565270082 >> v2:172.21.15.16:3300/0 conn(0x7fe828140410 0x7fe828146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:27.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe83010b700 1 -- 172.21.15.133:0/565270082 >> 172.21.15.133:0/565270082 conn(0x7fe8280b95d0 msgr2=0x7fe8280b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:27.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe83010b700 1 -- 172.21.15.133:0/565270082 shutdown_connections 2021-01-03T13:07:27.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.495+0000 7fe83010b700 1 -- 172.21.15.133:0/565270082 wait complete. 2021-01-03T13:07:27.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe83010b700 1 Processor -- start 2021-01-03T13:07:27.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe83010b700 1 -- start start 2021-01-03T13:07:27.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe83010b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8280b0470 0x7fe828141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:27.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe83010b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe828140410 0x7fe8281421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:27.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe83010b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe8281407f0 0x7fe8281426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:27.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe83010b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe828151ca0 con 0x7fe8280b0470 2021-01-03T13:07:27.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe83010b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8280b3e10 con 0x7fe828140410 2021-01-03T13:07:27.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe83010b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe828142bd0 con 0x7fe8281407f0 2021-01-03T13:07:27.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe82d6a6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe828140410 0x7fe8281421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:27.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe82d6a6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe828140410 0x7fe8281421f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39896/0 (socket says 172.21.15.133:39896) 2021-01-03T13:07:27.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe82d6a6700 1 -- 172.21.15.133:0/365087012 learned_addr learned my addr 172.21.15.133:0/365087012 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:27.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe82dea7700 1 --2- 172.21.15.133:0/365087012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8280b0470 0x7fe828141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:27.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe82e6a8700 1 --2- 172.21.15.133:0/365087012 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe8281407f0 0x7fe8281426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:27.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe82d6a6700 1 -- 172.21.15.133:0/365087012 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe8281407f0 msgr2=0x7fe8281426e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:27.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe82d6a6700 1 --2- 172.21.15.133:0/365087012 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe8281407f0 0x7fe8281426e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:27.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe82d6a6700 1 -- 172.21.15.133:0/365087012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8280b0470 msgr2=0x7fe828141120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:27.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe82d6a6700 1 --2- 172.21.15.133:0/365087012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8280b0470 0x7fe828141120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:27.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe82d6a6700 1 -- 172.21.15.133:0/365087012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe828151e90 con 0x7fe828140410 2021-01-03T13:07:27.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe82dea7700 1 --2- 172.21.15.133:0/365087012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8280b0470 0x7fe828141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe82e6a8700 1 --2- 172.21.15.133:0/365087012 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe8281407f0 0x7fe8281426e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe82d6a6700 1 --2- 172.21.15.133:0/365087012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe828140410 0x7fe8281421f0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fe824000e90 tx=0x7fe824007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe81affd700 1 -- 172.21.15.133:0/365087012 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8240072e0 con 0x7fe828140410 2021-01-03T13:07:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe81affd700 1 -- 172.21.15.133:0/365087012 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe824005520 con 0x7fe828140410 2021-01-03T13:07:27.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe81affd700 1 -- 172.21.15.133:0/365087012 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe824005880 con 0x7fe828140410 2021-01-03T13:07:27.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe83010b700 1 -- 172.21.15.133:0/365087012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe828152130 con 0x7fe828140410 2021-01-03T13:07:27.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.499+0000 7fe83010b700 1 -- 172.21.15.133:0/365087012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe828141610 con 0x7fe828140410 2021-01-03T13:07:27.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.503+0000 7fe81affd700 1 -- 172.21.15.133:0/365087012 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe824010070 con 0x7fe828140410 2021-01-03T13:07:27.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.503+0000 7fe83010b700 1 -- 172.21.15.133:0/365087012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe828057300 con 0x7fe828140410 2021-01-03T13:07:27.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.503+0000 7fe81affd700 1 --2- 172.21.15.133:0/365087012 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe808055440 0x7fe808057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:27.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.503+0000 7fe81affd700 1 -- 172.21.15.133:0/365087012 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fe82406d530 con 0x7fe828140410 2021-01-03T13:07:27.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.503+0000 7fe82dea7700 1 --2- 172.21.15.133:0/365087012 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe808055440 0x7fe808057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:27.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.503+0000 7fe82dea7700 1 --2- 172.21.15.133:0/365087012 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe808055440 0x7fe808057900 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fe81c008000 tx=0x7fe81c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:27.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.511+0000 7fe81affd700 1 -- 172.21.15.133:0/365087012 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe824043990 con 0x7fe828140410 2021-01-03T13:07:27.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:27.651+0000 7fe83010b700 1 -- 172.21.15.133:0/365087012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe82805bdf0 con 0x7fe828140410 2021-01-03T13:07:28.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.359+0000 7fe81affd700 1 -- 172.21.15.133:0/365087012 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v146) v1 ==== 173+0+0 (secure 0 0 0) 0x7fe824046fb0 con 0x7fe828140410 2021-01-03T13:07:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.363+0000 7fe83010b700 1 -- 172.21.15.133:0/365087012 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe808055440 msgr2=0x7fe808057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.363+0000 7fe83010b700 1 --2- 172.21.15.133:0/365087012 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe808055440 0x7fe808057900 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7fe81c008000 tx=0x7fe81c008040).stop 2021-01-03T13:07:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.363+0000 7fe83010b700 1 -- 172.21.15.133:0/365087012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe828140410 msgr2=0x7fe8281421f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.363+0000 7fe83010b700 1 --2- 172.21.15.133:0/365087012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe828140410 0x7fe8281421f0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fe824000e90 tx=0x7fe824007c50).stop 2021-01-03T13:07:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.367+0000 7fe83010b700 1 -- 172.21.15.133:0/365087012 shutdown_connections 2021-01-03T13:07:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.367+0000 7fe83010b700 1 --2- 172.21.15.133:0/365087012 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fe808055440 0x7fe808057900 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.367+0000 7fe83010b700 1 --2- 172.21.15.133:0/365087012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8280b0470 0x7fe828141120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.367+0000 7fe83010b700 1 --2- 172.21.15.133:0/365087012 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe8281407f0 0x7fe8281426e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.367+0000 7fe83010b700 1 --2- 172.21.15.133:0/365087012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe828140410 0x7fe8281421f0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.367+0000 7fe83010b700 1 -- 172.21.15.133:0/365087012 >> 172.21.15.133:0/365087012 conn(0x7fe8280b95d0 msgr2=0x7fe8280b8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.367+0000 7fe83010b700 1 -- 172.21.15.133:0/365087012 shutdown_connections 2021-01-03T13:07:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.367+0000 7fe83010b700 1 -- 172.21.15.133:0/365087012 wait complete. 2021-01-03T13:07:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2021-01-03T13:07:28.388 INFO:tasks.ceph.mds.a:Restarting daemon 2021-01-03T13:07:28.389 INFO:tasks.ceph.mds.a:Stopping old one... 2021-01-03T13:07:28.389 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-01-03T13:07:28.389 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:07:28.390 INFO:tasks.ceph.mds.c:Restarting daemon 2021-01-03T13:07:28.390 INFO:tasks.ceph.mds.c:Stopping old one... 2021-01-03T13:07:28.390 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-01-03T13:07:28.391 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:07:28.391 INFO:tasks.ceph.mds.b:Restarting daemon 2021-01-03T13:07:28.391 INFO:tasks.ceph.mds.b:Stopping old one... 2021-01-03T13:07:28.392 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-01-03T13:07:28.392 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:07:28.399 INFO:tasks.ceph.mds.a:Stopped 2021-01-03T13:07:28.400 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-01-03T13:07:28.403 INFO:tasks.ceph.mds.c:Stopped 2021-01-03T13:07:28.403 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-01-03T13:07:28.405 INFO:tasks.ceph.mds.b:Stopped 2021-01-03T13:07:28.405 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-01-03T13:07:28.445 INFO:tasks.ceph.mds.a:Started 2021-01-03T13:07:28.446 DEBUG:teuthology.parallel:result is None 2021-01-03T13:07:28.447 INFO:tasks.ceph.mds.c:Started 2021-01-03T13:07:28.447 DEBUG:teuthology.parallel:result is None 2021-01-03T13:07:28.449 INFO:tasks.ceph.mds.b:Started 2021-01-03T13:07:28.450 DEBUG:teuthology.parallel:result is None 2021-01-03T13:07:28.450 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-01-03T13:07:28.516 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T13:07:28.517 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T13:07:28.521 INFO:tasks.ceph.mds.b.smithi016.stdout:starting mds.b at 2021-01-03T13:07:28.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.555+0000 7f1de8417700 1 Processor -- start 2021-01-03T13:07:28.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.555+0000 7f1de8417700 1 -- start start 2021-01-03T13:07:28.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.555+0000 7f1de8417700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1de005c840 0x7f1de0143940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:28.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.555+0000 7f1de8417700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de005cc20 con 0x7f1de0146dc0 2021-01-03T13:07:28.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.555+0000 7f1de8417700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de0142f60 con 0x7f1de0067710 2021-01-03T13:07:28.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.555+0000 7f1de8417700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de00ad5a0 con 0x7f1de005c840 2021-01-03T13:07:28.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de61b3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1de005c840 0x7f1de0143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:28.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de61b3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1de005c840 0x7f1de0143940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39930/0 (socket says 172.21.15.133:39930) 2021-01-03T13:07:28.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de61b3700 1 -- 172.21.15.133:0/3613352026 learned_addr learned my addr 172.21.15.133:0/3613352026 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:28.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de61b3700 1 -- 172.21.15.133:0/3613352026 >> v1:172.21.15.133:6789/0 conn(0x7f1de0067710 legacy=0x7f1de013c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:28.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de61b3700 1 -- 172.21.15.133:0/3613352026 >> v1:172.21.15.16:6789/0 conn(0x7f1de0146dc0 legacy=0x7f1de00b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:28.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de51b1700 1 -- 172.21.15.133:0/3613352026 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641653100 0 0) 0x7f1de0142f60 con 0x7f1de0067710 2021-01-03T13:07:28.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de61b3700 1 -- 172.21.15.133:0/3613352026 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de0143200 con 0x7f1de005c840 2021-01-03T13:07:28.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de61b3700 1 --2- 172.21.15.133:0/3613352026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de005c840 0x7f1de0143940 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f1de006ad30 tx=0x7f1dd0006e80).ready entity=mon.1 client_cookie=51b1020e31391c70 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:28.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de51b1700 1 -- 172.21.15.133:0/3613352026 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dd0009800 con 0x7f1de005c840 2021-01-03T13:07:28.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de51b1700 1 -- 172.21.15.133:0/3613352026 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd0009960 con 0x7f1de005c840 2021-01-03T13:07:28.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de51b1700 1 -- 172.21.15.133:0/3613352026 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dd0009cc0 con 0x7f1de005c840 2021-01-03T13:07:28.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de8417700 1 -- 172.21.15.133:0/3613352026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de005c840 msgr2=0x7f1de0143940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:28.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de8417700 1 --2- 172.21.15.133:0/3613352026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de005c840 0x7f1de0143940 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f1de006ad30 tx=0x7f1dd0006e80).stop 2021-01-03T13:07:28.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de8417700 1 -- 172.21.15.133:0/3613352026 shutdown_connections 2021-01-03T13:07:28.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de8417700 1 --2- 172.21.15.133:0/3613352026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de005c840 0x7f1de0143940 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:28.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de8417700 1 -- 172.21.15.133:0/3613352026 >> 172.21.15.133:0/3613352026 conn(0x7f1de006aeb0 msgr2=0x7f1de005bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:28.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de8417700 1 -- 172.21.15.133:0/3613352026 shutdown_connections 2021-01-03T13:07:28.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de8417700 1 -- 172.21.15.133:0/3613352026 wait complete. 2021-01-03T13:07:28.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de8417700 1 Processor -- start 2021-01-03T13:07:28.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.559+0000 7f1de8417700 1 -- start start 2021-01-03T13:07:28.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de8417700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1de005c840 0x7f1de013e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:28.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de8417700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1de0067710 0x7f1de0141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:28.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de8417700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de0146dc0 0x7f1de01423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:28.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de8417700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de00b10b0 con 0x7f1de005c840 2021-01-03T13:07:28.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de8417700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de0145c20 con 0x7f1de0146dc0 2021-01-03T13:07:28.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de8417700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de01401d0 con 0x7f1de0067710 2021-01-03T13:07:28.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de69b4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de0146dc0 0x7f1de01423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:28.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de61b3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1de005c840 0x7f1de013e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:28.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de69b4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de0146dc0 0x7f1de01423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39940/0 (socket says 172.21.15.133:39940) 2021-01-03T13:07:28.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de69b4700 1 -- 172.21.15.133:0/2924899101 learned_addr learned my addr 172.21.15.133:0/2924899101 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:28.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de59b2700 1 --2- 172.21.15.133:0/2924899101 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1de0067710 0x7f1de0141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:28.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de69b4700 1 -- 172.21.15.133:0/2924899101 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1de0067710 msgr2=0x7f1de0141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:28.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de69b4700 1 --2- 172.21.15.133:0/2924899101 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1de0067710 0x7f1de0141ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:28.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de69b4700 1 -- 172.21.15.133:0/2924899101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1de005c840 msgr2=0x7f1de013e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:28.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de69b4700 1 --2- 172.21.15.133:0/2924899101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1de005c840 0x7f1de013e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:28.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de69b4700 1 -- 172.21.15.133:0/2924899101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de0156410 con 0x7f1de0146dc0 2021-01-03T13:07:28.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de69b4700 1 --2- 172.21.15.133:0/2924899101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de0146dc0 0x7f1de01423b0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f1dd8001210 tx=0x7f1dd8007d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:28.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1ddf7fe700 1 -- 172.21.15.133:0/2924899101 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dd800a7b0 con 0x7f1de0146dc0 2021-01-03T13:07:28.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1ddf7fe700 1 -- 172.21.15.133:0/2924899101 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd800a910 con 0x7f1de0146dc0 2021-01-03T13:07:28.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de8417700 1 -- 172.21.15.133:0/2924899101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de0155590 con 0x7f1de0146dc0 2021-01-03T13:07:28.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1ddf7fe700 1 -- 172.21.15.133:0/2924899101 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1dd800ac70 con 0x7f1de0146dc0 2021-01-03T13:07:28.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.563+0000 7f1de8417700 1 -- 172.21.15.133:0/2924899101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de0145ed0 con 0x7f1de0146dc0 2021-01-03T13:07:28.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.567+0000 7f1de8417700 1 -- 172.21.15.133:0/2924899101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de0155720 con 0x7f1de0146dc0 2021-01-03T13:07:28.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.567+0000 7f1ddf7fe700 1 -- 172.21.15.133:0/2924899101 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1dd8019030 con 0x7f1de0146dc0 2021-01-03T13:07:28.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.567+0000 7f1ddf7fe700 1 --2- 172.21.15.133:0/2924899101 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1dc00554e0 0x7f1dc00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:28.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.567+0000 7f1ddf7fe700 1 -- 172.21.15.133:0/2924899101 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f1dd806d3a0 con 0x7f1de0146dc0 2021-01-03T13:07:28.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.567+0000 7f1de61b3700 1 --2- 172.21.15.133:0/2924899101 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1dc00554e0 0x7f1dc00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:28.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.567+0000 7f1de61b3700 1 --2- 172.21.15.133:0/2924899101 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1dc00554e0 0x7f1dc00579a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f1dd001c000 tx=0x7f1dd0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:28.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.575+0000 7f1ddf7fe700 1 -- 172.21.15.133:0/2924899101 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1dd8041df0 con 0x7f1de0146dc0 2021-01-03T13:07:28.737 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:28.731+0000 7f1de8417700 1 -- 172.21.15.133:0/2924899101 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f1de0142a40 con 0x7f1de0146dc0 2021-01-03T13:07:29.378 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.371+0000 7f1ddf7fe700 1 -- 172.21.15.133:0/2924899101 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v147) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1dd8043a30 con 0x7f1de0146dc0 2021-01-03T13:07:29.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.375+0000 7f1de8417700 1 -- 172.21.15.133:0/2924899101 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1dc00554e0 msgr2=0x7f1dc00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:29.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.375+0000 7f1de8417700 1 --2- 172.21.15.133:0/2924899101 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1dc00554e0 0x7f1dc00579a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f1dd001c000 tx=0x7f1dd0015000).stop 2021-01-03T13:07:29.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.375+0000 7f1de8417700 1 -- 172.21.15.133:0/2924899101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de0146dc0 msgr2=0x7f1de01423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:29.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.375+0000 7f1de8417700 1 --2- 172.21.15.133:0/2924899101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de0146dc0 0x7f1de01423b0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f1dd8001210 tx=0x7f1dd8007d90).stop 2021-01-03T13:07:29.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.375+0000 7f1de8417700 1 -- 172.21.15.133:0/2924899101 shutdown_connections 2021-01-03T13:07:29.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.375+0000 7f1de8417700 1 --2- 172.21.15.133:0/2924899101 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f1dc00554e0 0x7f1dc00579a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:29.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.375+0000 7f1de8417700 1 --2- 172.21.15.133:0/2924899101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1de005c840 0x7f1de013e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:29.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.375+0000 7f1de8417700 1 --2- 172.21.15.133:0/2924899101 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1de0146dc0 0x7f1de01423b0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:29.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.375+0000 7f1de8417700 1 --2- 172.21.15.133:0/2924899101 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1de0067710 0x7f1de0141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:29.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.375+0000 7f1de8417700 1 -- 172.21.15.133:0/2924899101 >> 172.21.15.133:0/2924899101 conn(0x7f1de006aeb0 msgr2=0x7f1de0148af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:29.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.375+0000 7f1de8417700 1 -- 172.21.15.133:0/2924899101 shutdown_connections 2021-01-03T13:07:29.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.375+0000 7f1de8417700 1 -- 172.21.15.133:0/2924899101 wait complete. 2021-01-03T13:07:29.385 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blacklist entries 2021-01-03T13:07:29.397 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-01-03T13:07:29.398 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-01-03T13:07:29.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f260947b700 1 Processor -- start 2021-01-03T13:07:29.501 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f260947b700 1 -- start start 2021-01-03T13:07:29.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f260947b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2604142e90 0x7f2604143320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:29.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f260947b700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26040b7130 con 0x7f2604143810 2021-01-03T13:07:29.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f260947b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26040ae600 con 0x7f26040b6d50 2021-01-03T13:07:29.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f260947b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26040ae8a0 con 0x7f2604142e90 2021-01-03T13:07:29.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f26027fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2604142e90 0x7f2604143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:29.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f26027fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2604142e90 0x7f2604143320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39946/0 (socket says 172.21.15.133:39946) 2021-01-03T13:07:29.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f2602ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f26040b6d50 0x7f2604146bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60976/0 (socket says 172.21.15.133:60976) 2021-01-03T13:07:29.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f26027fc700 1 -- 172.21.15.133:0/891451859 learned_addr learned my addr 172.21.15.133:0/891451859 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:29.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f26027fc700 1 -- 172.21.15.133:0/891451859 >> v1:172.21.15.133:6789/0 conn(0x7f26040b6d50 legacy=0x7f2604146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:29.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f26027fc700 1 -- 172.21.15.133:0/891451859 >> v1:172.21.15.16:6789/0 conn(0x7f2604143810 legacy=0x7f260413fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:29.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f26027fc700 1 -- 172.21.15.133:0/891451859 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26040aeb40 con 0x7f2604142e90 2021-01-03T13:07:29.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f26027fc700 1 --2- 172.21.15.133:0/891451859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2604142e90 0x7f2604143320 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f25f40032b0 tx=0x7f25f4009270).ready entity=mon.1 client_cookie=324a1b05754056f9 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:29.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f2601ffb700 1 -- 172.21.15.133:0/891451859 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25f400bc00 con 0x7f2604142e90 2021-01-03T13:07:29.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f2601ffb700 1 -- 172.21.15.133:0/891451859 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f400bd60 con 0x7f2604142e90 2021-01-03T13:07:29.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f2601ffb700 1 -- 172.21.15.133:0/891451859 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25f4011400 con 0x7f2604142e90 2021-01-03T13:07:29.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f260947b700 1 -- 172.21.15.133:0/891451859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2604142e90 msgr2=0x7f2604143320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:29.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f260947b700 1 --2- 172.21.15.133:0/891451859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2604142e90 0x7f2604143320 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f25f40032b0 tx=0x7f25f4009270).stop 2021-01-03T13:07:29.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f260947b700 1 -- 172.21.15.133:0/891451859 shutdown_connections 2021-01-03T13:07:29.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f260947b700 1 --2- 172.21.15.133:0/891451859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2604142e90 0x7f2604143320 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:29.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f260947b700 1 -- 172.21.15.133:0/891451859 >> 172.21.15.133:0/891451859 conn(0x7f26040622f0 msgr2=0x7f26040b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:29.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f260947b700 1 -- 172.21.15.133:0/891451859 shutdown_connections 2021-01-03T13:07:29.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.495+0000 7f260947b700 1 -- 172.21.15.133:0/891451859 wait complete. 2021-01-03T13:07:29.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f260947b700 1 Processor -- start 2021-01-03T13:07:29.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f260947b700 1 -- start start 2021-01-03T13:07:29.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f260947b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26040b6d50 0x7f2604063e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:29.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f260947b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2604142e90 0x7f260413cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:29.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f260947b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2604143810 0x7f260413d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:29.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f260947b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26040b5710 con 0x7f2604142e90 2021-01-03T13:07:29.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f260947b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26040b59b0 con 0x7f26040b6d50 2021-01-03T13:07:29.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f260947b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2604152eb0 con 0x7f2604143810 2021-01-03T13:07:29.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f2602ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26040b6d50 0x7f2604063e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:29.512 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f2602ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26040b6d50 0x7f2604063e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39950/0 (socket says 172.21.15.133:39950) 2021-01-03T13:07:29.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f2602ffd700 1 -- 172.21.15.133:0/827749751 learned_addr learned my addr 172.21.15.133:0/827749751 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:29.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f26027fc700 1 --2- 172.21.15.133:0/827749751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2604142e90 0x7f260413cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:29.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f26037fe700 1 --2- 172.21.15.133:0/827749751 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2604143810 0x7f260413d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:29.513 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f2602ffd700 1 -- 172.21.15.133:0/827749751 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2604143810 msgr2=0x7f260413d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:29.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f2602ffd700 1 --2- 172.21.15.133:0/827749751 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2604143810 0x7f260413d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:29.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f2602ffd700 1 -- 172.21.15.133:0/827749751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2604142e90 msgr2=0x7f260413cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:29.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f2602ffd700 1 --2- 172.21.15.133:0/827749751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2604142e90 0x7f260413cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:29.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f2602ffd700 1 -- 172.21.15.133:0/827749751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2604152bb0 con 0x7f26040b6d50 2021-01-03T13:07:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f26037fe700 1 --2- 172.21.15.133:0/827749751 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2604143810 0x7f260413d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f26027fc700 1 --2- 172.21.15.133:0/827749751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2604142e90 0x7f260413cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f2602ffd700 1 --2- 172.21.15.133:0/827749751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26040b6d50 0x7f2604063e20 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f26040b0ae0 tx=0x7f25fc007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f25fbfff700 1 -- 172.21.15.133:0/827749751 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25fc0072e0 con 0x7f26040b6d50 2021-01-03T13:07:29.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f25fbfff700 1 -- 172.21.15.133:0/827749751 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25fc005520 con 0x7f26040b6d50 2021-01-03T13:07:29.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f260947b700 1 -- 172.21.15.133:0/827749751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260413d570 con 0x7f26040b6d50 2021-01-03T13:07:29.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f25fbfff700 1 -- 172.21.15.133:0/827749751 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25fc005880 con 0x7f26040b6d50 2021-01-03T13:07:29.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.499+0000 7f260947b700 1 -- 172.21.15.133:0/827749751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26040b4ff0 con 0x7f26040b6d50 2021-01-03T13:07:29.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.503+0000 7f25fbfff700 1 -- 172.21.15.133:0/827749751 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f25fc010070 con 0x7f26040b6d50 2021-01-03T13:07:29.516 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.503+0000 7f260947b700 1 -- 172.21.15.133:0/827749751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26040b5b70 con 0x7f26040b6d50 2021-01-03T13:07:29.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.503+0000 7f25fbfff700 1 --2- 172.21.15.133:0/827749751 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f25dc055440 0x7f25dc057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:29.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.503+0000 7f25fbfff700 1 -- 172.21.15.133:0/827749751 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f25fc06d4a0 con 0x7f26040b6d50 2021-01-03T13:07:29.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.503+0000 7f26027fc700 1 --2- 172.21.15.133:0/827749751 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f25dc055440 0x7f25dc057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:29.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.503+0000 7f26027fc700 1 --2- 172.21.15.133:0/827749751 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f25dc055440 0x7f25dc057900 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f25f4018000 tx=0x7f25f4016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:29.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.511+0000 7f25fbfff700 1 -- 172.21.15.133:0/827749751 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f25fc043a30 con 0x7f26040b6d50 2021-01-03T13:07:29.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.695+0000 7f260947b700 1 -- 172.21.15.133:0/827749751 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2604153070 con 0x7f26040b6d50 2021-01-03T13:07:29.704 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.699+0000 7f25fbfff700 1 -- 172.21.15.133:0/827749751 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v30) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f25fc047050 con 0x7f26040b6d50 2021-01-03T13:07:29.705 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:29.705 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:07:29.705 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2021-01-03T13:07:29.705 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:29.706 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2021-01-03T13:07:29.706 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Fflox9BxAA6coLDFV/FaQ/G/cvtonWgg==", 2021-01-03T13:07:29.706 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:29.706 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:07:29.707 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:29.707 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:29.707 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:29.707 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:29.707 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:29.708 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:29.708 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2021-01-03T13:07:29.708 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfrnWWFRAA3PHH/FJOvDozCChrb1T8Dg==", 2021-01-03T13:07:29.708 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:29.708 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:07:29.709 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:29.709 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:29.709 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:29.709 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:29.709 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:29.710 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:29.710 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2021-01-03T13:07:29.710 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfpPPLDxAAVvg80vLejYKDH485/L1gSQ==", 2021-01-03T13:07:29.710 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:29.711 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:07:29.711 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:29.711 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:29.711 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:29.711 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:29.712 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:29.712 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:29.712 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2021-01-03T13:07:29.712 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAnv/FfQ+CcDRAAUkTDLby5scMkNzxa0lVdAQ==", 2021-01-03T13:07:29.712 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:29.713 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:29.713 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:29.713 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:29.713 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:29.713 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:29.714 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:29.714 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2021-01-03T13:07:29.714 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApv/Ff1iilLhAAbK9hZmL772nNKAEJ4i+pkw==", 2021-01-03T13:07:29.714 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:29.714 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:29.715 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:29.715 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:29.715 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:29.715 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:29.715 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:29.716 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2021-01-03T13:07:29.716 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAsv/Ffmoe2FhAA1EbxU5yHncN+pbC/EX6d9A==", 2021-01-03T13:07:29.716 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:29.716 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:29.716 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:29.717 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:29.717 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:29.717 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:29.717 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:29.717 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2021-01-03T13:07:29.718 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAuv/FfJh/VORAAG9aCOh5s/2Lw+yN9hBFWLw==", 2021-01-03T13:07:29.718 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:29.718 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:29.718 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:29.718 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:29.719 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:29.719 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:29.719 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:29.719 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2021-01-03T13:07:29.719 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyv/Ffus0NJhAALX1TIqQ9EIupaX8KtRu7rQ==", 2021-01-03T13:07:29.720 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:29.720 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:29.720 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:29.720 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:29.720 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:29.721 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:29.721 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:29.721 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2021-01-03T13:07:29.721 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1v/FfoL6kDBAAggoRy/o0qas/41yLYqDVgA==", 2021-01-03T13:07:29.721 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:29.722 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:29.722 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:29.722 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:29.722 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:29.722 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:29.723 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:29.723 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2021-01-03T13:07:29.723 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA3v/FfwOPCMBAAGOt8ShPQ/szNbCfaP/uZEQ==", 2021-01-03T13:07:29.723 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:29.723 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:29.724 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:29.724 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:29.724 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:29.724 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:29.724 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:29.725 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2021-01-03T13:07:29.725 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA6v/Ffoz5xFxAAn3xvUDSeNSWrBJTa1Nsb6w==", 2021-01-03T13:07:29.725 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:29.725 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:29.725 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:29.726 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:29.726 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:29.727 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:29.727 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:29.727 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2021-01-03T13:07:29.727 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfyGlbGxAALm0NezvPiTAnlwu8iPEuCw==", 2021-01-03T13:07:29.727 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:29.728 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:07:29.728 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:07:29.728 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:07:29.728 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:29.728 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:29.729 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:29.729 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2021-01-03T13:07:29.729 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Ffa2AFHhAAD4Pq5zMJ28SqqEosBA9vnQ==", 2021-01-03T13:07:29.729 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:29.729 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:07:29.730 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:07:29.730 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:07:29.730 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:29.730 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:29.730 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:29.731 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2021-01-03T13:07:29.731 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjv/FfjxN8JxAAkV2Ia66fh21QYMX5fr1gTw==", 2021-01-03T13:07:29.731 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:29.731 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:07:29.731 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:29.732 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:29.732 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:29.732 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:29.732 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:29.732 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:29.733 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2021-01-03T13:07:29.733 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAU/DBBAASi+hx05pZEsP+dV9iwbz4g==", 2021-01-03T13:07:29.733 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:29.733 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:07:29.733 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:07:29.734 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:29.734 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:29.734 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:29.734 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:29.735 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2021-01-03T13:07:29.735 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAOFAAhAAPQOSkofyJoEYvcAqKK2+Mg==", 2021-01-03T13:07:29.735 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:29.735 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:07:29.735 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:07:29.736 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:29.736 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:29.736 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:29.736 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:29.736 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:07:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.699+0000 7f260947b700 1 -- 172.21.15.133:0/827749751 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f25dc055440 msgr2=0x7f25dc057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.699+0000 7f260947b700 1 --2- 172.21.15.133:0/827749751 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f25dc055440 0x7f25dc057900 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f25f4018000 tx=0x7f25f4016000).stop 2021-01-03T13:07:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.699+0000 7f260947b700 1 -- 172.21.15.133:0/827749751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26040b6d50 msgr2=0x7f2604063e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:29.738 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.699+0000 7f260947b700 1 --2- 172.21.15.133:0/827749751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26040b6d50 0x7f2604063e20 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f26040b0ae0 tx=0x7f25fc007bd0).stop 2021-01-03T13:07:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.699+0000 7f260947b700 1 -- 172.21.15.133:0/827749751 shutdown_connections 2021-01-03T13:07:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.699+0000 7f260947b700 1 --2- 172.21.15.133:0/827749751 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f25dc055440 0x7f25dc057900 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.699+0000 7f260947b700 1 --2- 172.21.15.133:0/827749751 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2604143810 0x7f260413d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:29.739 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.699+0000 7f260947b700 1 --2- 172.21.15.133:0/827749751 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26040b6d50 0x7f2604063e20 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:29.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.699+0000 7f260947b700 1 --2- 172.21.15.133:0/827749751 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2604142e90 0x7f260413cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:29.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.699+0000 7f260947b700 1 -- 172.21.15.133:0/827749751 >> 172.21.15.133:0/827749751 conn(0x7f26040622f0 msgr2=0x7f26040b62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:29.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.699+0000 7f260947b700 1 -- 172.21.15.133:0/827749751 shutdown_connections 2021-01-03T13:07:29.740 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.699+0000 7f260947b700 1 -- 172.21.15.133:0/827749751 wait complete. 2021-01-03T13:07:29.741 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:07:29.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f92657c6700 1 Processor -- start 2021-01-03T13:07:29.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f92657c6700 1 -- start start 2021-01-03T13:07:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f92657c6700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f92600b9b60 0x7f92600b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f92657c6700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92600b4e10 0x7f9260146b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:29.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f92657c6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9260147030 con 0x7f92600b4980 2021-01-03T13:07:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f92657c6700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92600aed30 con 0x7f92600b9b60 2021-01-03T13:07:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f92657c6700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92600605f0 con 0x7f92600b4e10 2021-01-03T13:07:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f925ffff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f92600b9b60 0x7f92600b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:29.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f925f7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f92600b4980 0x7f9260146430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:60992/0 (socket says 172.21.15.133:60992) 2021-01-03T13:07:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f925f7fe700 1 -- 172.21.15.133:0/3217663204 learned_addr learned my addr 172.21.15.133:0/3217663204 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f9264fc5700 1 --2- 172.21.15.133:0/3217663204 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92600b4e10 0x7f9260146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f925effd700 1 -- 172.21.15.133:0/3217663204 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954917638 0 0) 0x7f9260147030 con 0x7f92600b4980 2021-01-03T13:07:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f925effd700 1 -- 172.21.15.133:0/3217663204 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9240003230 con 0x7f92600b4980 2021-01-03T13:07:29.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f925ffff700 1 -- 172.21.15.133:0/3217663204 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92600b4e10 msgr2=0x7f9260146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f925ffff700 1 --2- 172.21.15.133:0/3217663204 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92600b4e10 0x7f9260146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f925ffff700 1 -- 172.21.15.133:0/3217663204 >> v1:172.21.15.133:6789/0 conn(0x7f92600b4980 legacy=0x7f9260146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f925ffff700 1 -- 172.21.15.133:0/3217663204 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92600600b0 con 0x7f92600b9b60 2021-01-03T13:07:29.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f925ffff700 1 --2- 172.21.15.133:0/3217663204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92600b9b60 0x7f92600b9f40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f92580032b0 tx=0x7f92580091a0).ready entity=mon.0 client_cookie=c5b4648d759cd4b0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:29.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f925effd700 1 -- 172.21.15.133:0/3217663204 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f925800b940 con 0x7f92600b9b60 2021-01-03T13:07:29.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f925effd700 1 -- 172.21.15.133:0/3217663204 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925800baa0 con 0x7f92600b9b60 2021-01-03T13:07:29.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f925effd700 1 -- 172.21.15.133:0/3217663204 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f925800bc10 con 0x7f92600b9b60 2021-01-03T13:07:29.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f92657c6700 1 -- 172.21.15.133:0/3217663204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92600b9b60 msgr2=0x7f92600b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:29.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f92657c6700 1 --2- 172.21.15.133:0/3217663204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92600b9b60 0x7f92600b9f40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f92580032b0 tx=0x7f92580091a0).stop 2021-01-03T13:07:29.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f92657c6700 1 -- 172.21.15.133:0/3217663204 shutdown_connections 2021-01-03T13:07:29.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f92657c6700 1 --2- 172.21.15.133:0/3217663204 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92600b9b60 0x7f92600b9f40 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:29.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f92657c6700 1 --2- 172.21.15.133:0/3217663204 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92600b4e10 0x7f9260146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:29.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f92657c6700 1 -- 172.21.15.133:0/3217663204 >> 172.21.15.133:0/3217663204 conn(0x7f92600b69e0 msgr2=0x7f92600b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:29.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f92657c6700 1 -- 172.21.15.133:0/3217663204 shutdown_connections 2021-01-03T13:07:29.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.851+0000 7f92657c6700 1 -- 172.21.15.133:0/3217663204 wait complete. 2021-01-03T13:07:29.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f92657c6700 1 Processor -- start 2021-01-03T13:07:29.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f92657c6700 1 -- start start 2021-01-03T13:07:29.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f92657c6700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92600b4980 0x7f92600b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:29.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f92657c6700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92600b4e10 0x7f92600b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:29.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f92657c6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92600b9b60 0x7f926013f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:29.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f92657c6700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92600b5550 con 0x7f92600b4e10 2021-01-03T13:07:29.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f92657c6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92600b2890 con 0x7f92600b9b60 2021-01-03T13:07:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f92657c6700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92600b1eb0 con 0x7f92600b4980 2021-01-03T13:07:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f9264fc5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92600b9b60 0x7f926013f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f9264fc5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92600b9b60 0x7f926013f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39968/0 (socket says 172.21.15.133:39968) 2021-01-03T13:07:29.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f9264fc5700 1 -- 172.21.15.133:0/896509367 learned_addr learned my addr 172.21.15.133:0/896509367 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f925ffff700 1 --2- 172.21.15.133:0/896509367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92600b4980 0x7f92600b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f925f7fe700 1 --2- 172.21.15.133:0/896509367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92600b4e10 0x7f92600b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f9264fc5700 1 -- 172.21.15.133:0/896509367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92600b4980 msgr2=0x7f92600b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:29.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f9264fc5700 1 --2- 172.21.15.133:0/896509367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92600b4980 0x7f92600b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f9264fc5700 1 -- 172.21.15.133:0/896509367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92600b4e10 msgr2=0x7f92600b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f9264fc5700 1 --2- 172.21.15.133:0/896509367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92600b4e10 0x7f92600b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:29.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f9264fc5700 1 -- 172.21.15.133:0/896509367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92600b2150 con 0x7f92600b9b60 2021-01-03T13:07:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f9264fc5700 1 --2- 172.21.15.133:0/896509367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92600b9b60 0x7f926013f6e0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f92600b1c80 tx=0x7f9250006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f925d7fa700 1 -- 172.21.15.133:0/896509367 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f925000ca10 con 0x7f92600b9b60 2021-01-03T13:07:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f925d7fa700 1 -- 172.21.15.133:0/896509367 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925000cb70 con 0x7f92600b9b60 2021-01-03T13:07:29.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f92657c6700 1 -- 172.21.15.133:0/896509367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92600b23f0 con 0x7f92600b9b60 2021-01-03T13:07:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f925d7fa700 1 -- 172.21.15.133:0/896509367 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92500123f0 con 0x7f92600b9b60 2021-01-03T13:07:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.855+0000 7f92657c6700 1 -- 172.21.15.133:0/896509367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926009dae0 con 0x7f92600b9b60 2021-01-03T13:07:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.859+0000 7f92657c6700 1 -- 172.21.15.133:0/896509367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92600b2580 con 0x7f92600b9b60 2021-01-03T13:07:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.859+0000 7f925d7fa700 1 -- 172.21.15.133:0/896509367 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f92500125e0 con 0x7f92600b9b60 2021-01-03T13:07:29.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.859+0000 7f925d7fa700 1 --2- 172.21.15.133:0/896509367 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9244055330 0x7f92440577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.859+0000 7f925d7fa700 1 -- 172.21.15.133:0/896509367 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f925006e1f0 con 0x7f92600b9b60 2021-01-03T13:07:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.859+0000 7f925ffff700 1 --2- 172.21.15.133:0/896509367 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9244055330 0x7f92440577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:29.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.859+0000 7f925ffff700 1 --2- 172.21.15.133:0/896509367 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9244055330 0x7f92440577f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f925801c000 tx=0x7f9258016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:29.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:29.867+0000 7f925d7fa700 1 -- 172.21.15.133:0/896509367 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9250044690 con 0x7f92600b9b60 2021-01-03T13:07:30.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.007+0000 7f92657c6700 1 -- 172.21.15.133:0/896509367 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9260057300 con 0x7f92600b9b60 2021-01-03T13:07:30.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.007+0000 7f925d7fa700 1 -- 172.21.15.133:0/896509367 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+13239 (secure 0 0 0) 0x7f9250047cb0 con 0x7f92600b9b60 2021-01-03T13:07:30.015 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:30.015 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":147,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:29.362241+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:07:30.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.011+0000 7f92657c6700 1 -- 172.21.15.133:0/896509367 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9244055330 msgr2=0x7f92440577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.011+0000 7f92657c6700 1 --2- 172.21.15.133:0/896509367 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9244055330 0x7f92440577f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f925801c000 tx=0x7f9258016000).stop 2021-01-03T13:07:30.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.011+0000 7f92657c6700 1 -- 172.21.15.133:0/896509367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92600b9b60 msgr2=0x7f926013f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.011+0000 7f92657c6700 1 --2- 172.21.15.133:0/896509367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92600b9b60 0x7f926013f6e0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f92600b1c80 tx=0x7f9250006dc0).stop 2021-01-03T13:07:30.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.011+0000 7f92657c6700 1 -- 172.21.15.133:0/896509367 shutdown_connections 2021-01-03T13:07:30.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.011+0000 7f92657c6700 1 --2- 172.21.15.133:0/896509367 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9244055330 0x7f92440577f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.011+0000 7f92657c6700 1 --2- 172.21.15.133:0/896509367 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92600b9b60 0x7f926013f6e0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.011+0000 7f92657c6700 1 --2- 172.21.15.133:0/896509367 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92600b4980 0x7f92600b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.011+0000 7f92657c6700 1 --2- 172.21.15.133:0/896509367 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92600b4e10 0x7f92600b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.011+0000 7f92657c6700 1 -- 172.21.15.133:0/896509367 >> 172.21.15.133:0/896509367 conn(0x7f92600b69e0 msgr2=0x7f926005bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:30.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.011+0000 7f92657c6700 1 -- 172.21.15.133:0/896509367 shutdown_connections 2021-01-03T13:07:30.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.011+0000 7f92657c6700 1 -- 172.21.15.133:0/896509367 wait complete. 2021-01-03T13:07:30.029 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-01-03T13:07:30.030 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:07:30.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.135+0000 7f80cdda1700 1 Processor -- start 2021-01-03T13:07:30.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.135+0000 7f80cdda1700 1 -- start start 2021-01-03T13:07:30.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cdda1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80c8060510 0x7f80c805c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cdda1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f80c805fd10 0x7f80c80b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cdda1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c805bf00 con 0x7f80c80b4c20 2021-01-03T13:07:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cdda1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c805c1a0 con 0x7f80c805fd10 2021-01-03T13:07:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cdda1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c805c440 con 0x7f80c8060510 2021-01-03T13:07:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cd5a0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f80c805fd10 0x7f80c80b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80ccd9f700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f80c80b4c20 0x7f80c80b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:32774/0 (socket says 172.21.15.133:32774) 2021-01-03T13:07:30.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80ccd9f700 1 -- 172.21.15.133:0/4029389397 learned_addr learned my addr 172.21.15.133:0/4029389397 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:30.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80c7fff700 1 --2- 172.21.15.133:0/4029389397 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80c8060510 0x7f80c805c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cd5a0700 1 -- 172.21.15.133:0/4029389397 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80c8060510 msgr2=0x7f80c805c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:30.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80c77fe700 1 -- 172.21.15.133:0/4029389397 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785954205 0 0) 0x7f80c805bf00 con 0x7f80c80b4c20 2021-01-03T13:07:30.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cd5a0700 1 --2- 172.21.15.133:0/4029389397 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80c8060510 0x7f80c805c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cd5a0700 1 -- 172.21.15.133:0/4029389397 >> v1:172.21.15.133:6789/0 conn(0x7f80c80b4c20 legacy=0x7f80c80b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cd5a0700 1 -- 172.21.15.133:0/4029389397 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c80b6ad0 con 0x7f80c805fd10 2021-01-03T13:07:30.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cd5a0700 1 --2- 172.21.15.133:0/4029389397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80c805fd10 0x7f80c80b65e0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f80c00032b0 tx=0x7f80c00091a0).ready entity=mon.1 client_cookie=183f73ab7a888c99 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:30.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80c77fe700 1 -- 172.21.15.133:0/4029389397 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80c000ba50 con 0x7f80c805fd10 2021-01-03T13:07:30.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80c77fe700 1 -- 172.21.15.133:0/4029389397 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c000bbb0 con 0x7f80c805fd10 2021-01-03T13:07:30.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80c77fe700 1 -- 172.21.15.133:0/4029389397 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80c000bd20 con 0x7f80c805fd10 2021-01-03T13:07:30.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cdda1700 1 -- 172.21.15.133:0/4029389397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80c805fd10 msgr2=0x7f80c80b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cdda1700 1 --2- 172.21.15.133:0/4029389397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80c805fd10 0x7f80c80b65e0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f80c00032b0 tx=0x7f80c00091a0).stop 2021-01-03T13:07:30.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cdda1700 1 -- 172.21.15.133:0/4029389397 shutdown_connections 2021-01-03T13:07:30.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cdda1700 1 --2- 172.21.15.133:0/4029389397 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80c805fd10 0x7f80c80b65e0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cdda1700 1 --2- 172.21.15.133:0/4029389397 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80c8060510 0x7f80c805c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cdda1700 1 -- 172.21.15.133:0/4029389397 >> 172.21.15.133:0/4029389397 conn(0x7f80c80b9f00 msgr2=0x7f80c80b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:30.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cdda1700 1 -- 172.21.15.133:0/4029389397 shutdown_connections 2021-01-03T13:07:30.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.139+0000 7f80cdda1700 1 -- 172.21.15.133:0/4029389397 wait complete. 2021-01-03T13:07:30.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80cdda1700 1 Processor -- start 2021-01-03T13:07:30.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80cdda1700 1 -- start start 2021-01-03T13:07:30.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80cdda1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80c805fd10 0x7f80c8141780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80cdda1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80c8060510 0x7f80c80b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80cdda1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80c80b4c20 0x7f80c80b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80cdda1700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c81415b0 con 0x7f80c80b4c20 2021-01-03T13:07:30.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80cdda1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c8152330 con 0x7f80c805fd10 2021-01-03T13:07:30.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80cdda1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c809f0d0 con 0x7f80c8060510 2021-01-03T13:07:30.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80ccd9f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80c805fd10 0x7f80c8141780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80ccd9f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80c805fd10 0x7f80c8141780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39978/0 (socket says 172.21.15.133:39978) 2021-01-03T13:07:30.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80ccd9f700 1 -- 172.21.15.133:0/649870827 learned_addr learned my addr 172.21.15.133:0/649870827 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:30.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80c7fff700 1 --2- 172.21.15.133:0/649870827 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80c8060510 0x7f80c80b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80cd5a0700 1 --2- 172.21.15.133:0/649870827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80c80b4c20 0x7f80c80b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80ccd9f700 1 -- 172.21.15.133:0/649870827 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80c8060510 msgr2=0x7f80c80b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80ccd9f700 1 --2- 172.21.15.133:0/649870827 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80c8060510 0x7f80c80b1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80ccd9f700 1 -- 172.21.15.133:0/649870827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80c80b4c20 msgr2=0x7f80c80b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80ccd9f700 1 --2- 172.21.15.133:0/649870827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80c80b4c20 0x7f80c80b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80ccd9f700 1 -- 172.21.15.133:0/649870827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c81525a0 con 0x7f80c805fd10 2021-01-03T13:07:30.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80ccd9f700 1 --2- 172.21.15.133:0/649870827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80c805fd10 0x7f80c8141780 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f80c80b1370 tx=0x7f80b8007cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:30.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80c5ffb700 1 -- 172.21.15.133:0/649870827 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80b80072e0 con 0x7f80c805fd10 2021-01-03T13:07:30.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80c5ffb700 1 -- 172.21.15.133:0/649870827 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b8007440 con 0x7f80c805fd10 2021-01-03T13:07:30.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80cdda1700 1 -- 172.21.15.133:0/649870827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c8152840 con 0x7f80c805fd10 2021-01-03T13:07:30.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80c5ffb700 1 -- 172.21.15.133:0/649870827 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80b80057d0 con 0x7f80c805fd10 2021-01-03T13:07:30.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.143+0000 7f80cdda1700 1 -- 172.21.15.133:0/649870827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c8141110 con 0x7f80c805fd10 2021-01-03T13:07:30.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.147+0000 7f80cdda1700 1 -- 172.21.15.133:0/649870827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c81412d0 con 0x7f80c805fd10 2021-01-03T13:07:30.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.147+0000 7f80c5ffb700 1 -- 172.21.15.133:0/649870827 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f80b801a060 con 0x7f80c805fd10 2021-01-03T13:07:30.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.147+0000 7f80c5ffb700 1 --2- 172.21.15.133:0/649870827 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80a8055440 0x7f80a8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.147+0000 7f80c5ffb700 1 -- 172.21.15.133:0/649870827 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f80b806d370 con 0x7f80c805fd10 2021-01-03T13:07:30.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.147+0000 7f80c7fff700 1 --2- 172.21.15.133:0/649870827 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80a8055440 0x7f80a8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.147+0000 7f80c7fff700 1 --2- 172.21.15.133:0/649870827 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80a8055440 0x7f80a8057900 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f80bc00c000 tx=0x7f80bc008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:30.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.155+0000 7f80c5ffb700 1 -- 172.21.15.133:0/649870827 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f80b80439a0 con 0x7f80c805fd10 2021-01-03T13:07:30.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.295+0000 7f80cdda1700 1 -- 172.21.15.133:0/649870827 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f80c8057300 con 0x7f80c805fd10 2021-01-03T13:07:30.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.295+0000 7f80c5ffb700 1 -- 172.21.15.133:0/649870827 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v147) v1 ==== 110+0+10 (secure 0 0 0) 0x7f80b8018070 con 0x7f80c805fd10 2021-01-03T13:07:30.303 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:07:30.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.295+0000 7f80cdda1700 1 -- 172.21.15.133:0/649870827 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80a8055440 msgr2=0x7f80a8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.295+0000 7f80cdda1700 1 --2- 172.21.15.133:0/649870827 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80a8055440 0x7f80a8057900 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f80bc00c000 tx=0x7f80bc008040).stop 2021-01-03T13:07:30.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.299+0000 7f80cdda1700 1 -- 172.21.15.133:0/649870827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80c805fd10 msgr2=0x7f80c8141780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.299+0000 7f80cdda1700 1 --2- 172.21.15.133:0/649870827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80c805fd10 0x7f80c8141780 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f80c80b1370 tx=0x7f80b8007cb0).stop 2021-01-03T13:07:30.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.299+0000 7f80cdda1700 1 -- 172.21.15.133:0/649870827 shutdown_connections 2021-01-03T13:07:30.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.299+0000 7f80cdda1700 1 --2- 172.21.15.133:0/649870827 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80a8055440 0x7f80a8057900 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.299+0000 7f80cdda1700 1 --2- 172.21.15.133:0/649870827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f80c80b4c20 0x7f80c80b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.299+0000 7f80cdda1700 1 --2- 172.21.15.133:0/649870827 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80c805fd10 0x7f80c8141780 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.299+0000 7f80cdda1700 1 --2- 172.21.15.133:0/649870827 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f80c8060510 0x7f80c80b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.299+0000 7f80cdda1700 1 -- 172.21.15.133:0/649870827 >> 172.21.15.133:0/649870827 conn(0x7f80c80b9f00 msgr2=0x7f80c813eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:30.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.299+0000 7f80cdda1700 1 -- 172.21.15.133:0/649870827 shutdown_connections 2021-01-03T13:07:30.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.299+0000 7f80cdda1700 1 -- 172.21.15.133:0/649870827 wait complete. 2021-01-03T13:07:30.316 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:07:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.423+0000 7f436a797700 1 Processor -- start 2021-01-03T13:07:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.423+0000 7f436a797700 1 -- start start 2021-01-03T13:07:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f436a797700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f43640b2460 0x7f43640a9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f436a797700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f43640b0a60 0x7f43640ad490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f436a797700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43640b16a0 con 0x7f43640ad980 2021-01-03T13:07:30.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f436a797700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43640b2840 con 0x7f43640b0a60 2021-01-03T13:07:30.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f436a797700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43640aeae0 con 0x7f43640b2460 2021-01-03T13:07:30.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f4369795700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f43640b2460 0x7f43640a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f4369795700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f43640b2460 0x7f43640a9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39986/0 (socket says 172.21.15.133:39986) 2021-01-03T13:07:30.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f4369795700 1 -- 172.21.15.133:0/4055909898 learned_addr learned my addr 172.21.15.133:0/4055909898 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:30.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f4368f94700 1 --2- 172.21.15.133:0/4055909898 >> v2:172.21.15.16:3300/0 conn(0x7f43640b0a60 0x7f43640ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f4369795700 1 -- 172.21.15.133:0/4055909898 >> v2:172.21.15.16:3300/0 conn(0x7f43640b0a60 msgr2=0x7f43640ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:30.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f4369795700 1 --2- 172.21.15.133:0/4055909898 >> v2:172.21.15.16:3300/0 conn(0x7f43640b0a60 0x7f43640ad490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f4369795700 1 -- 172.21.15.133:0/4055909898 >> v1:172.21.15.16:6789/0 conn(0x7f43640ad980 legacy=0x7f43640a8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f4369795700 1 -- 172.21.15.133:0/4055909898 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43640b1160 con 0x7f43640b2460 2021-01-03T13:07:30.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f4369795700 1 --2- 172.21.15.133:0/4055909898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43640b2460 0x7f43640a9750 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f4360002f30 tx=0x7f4360006e80).ready entity=mon.1 client_cookie=def9283ff3a1d7b4 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:30.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f4353fff700 1 -- 172.21.15.133:0/4055909898 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4360014070 con 0x7f43640b2460 2021-01-03T13:07:30.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f4353fff700 1 -- 172.21.15.133:0/4055909898 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4360009940 con 0x7f43640b2460 2021-01-03T13:07:30.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f4353fff700 1 -- 172.21.15.133:0/4055909898 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4360009ca0 con 0x7f43640b2460 2021-01-03T13:07:30.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f436a797700 1 -- 172.21.15.133:0/4055909898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43640b2460 msgr2=0x7f43640a9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f436a797700 1 --2- 172.21.15.133:0/4055909898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43640b2460 0x7f43640a9750 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f4360002f30 tx=0x7f4360006e80).stop 2021-01-03T13:07:30.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f436a797700 1 -- 172.21.15.133:0/4055909898 shutdown_connections 2021-01-03T13:07:30.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f436a797700 1 --2- 172.21.15.133:0/4055909898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43640b2460 0x7f43640a9750 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f436a797700 1 --2- 172.21.15.133:0/4055909898 >> v2:172.21.15.16:3300/0 conn(0x7f43640b0a60 0x7f43640ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f436a797700 1 -- 172.21.15.133:0/4055909898 >> 172.21.15.133:0/4055909898 conn(0x7f436406b050 msgr2=0x7f4364060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:30.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f436a797700 1 -- 172.21.15.133:0/4055909898 shutdown_connections 2021-01-03T13:07:30.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.427+0000 7f436a797700 1 -- 172.21.15.133:0/4055909898 wait complete. 2021-01-03T13:07:30.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f436a797700 1 Processor -- start 2021-01-03T13:07:30.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f436a797700 1 -- start start 2021-01-03T13:07:30.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f436a797700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43640ad980 0x7f4364066180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f436a797700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43640b0a60 0x7f436409ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f436a797700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f43640b2460 0x7f436409f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f436a797700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436409f5c0 con 0x7f43640ad980 2021-01-03T13:07:30.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f436a797700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436409e7b0 con 0x7f43640b0a60 2021-01-03T13:07:30.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f436a797700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43640a0cc0 con 0x7f43640b2460 2021-01-03T13:07:30.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f4368f94700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43640b0a60 0x7f436409ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f4369795700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43640ad980 0x7f4364066180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f4368f94700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43640b0a60 0x7f436409ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39994/0 (socket says 172.21.15.133:39994) 2021-01-03T13:07:30.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f4368f94700 1 -- 172.21.15.133:0/2684124930 learned_addr learned my addr 172.21.15.133:0/2684124930 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:30.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f4369f96700 1 --2- 172.21.15.133:0/2684124930 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f43640b2460 0x7f436409f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f4368f94700 1 -- 172.21.15.133:0/2684124930 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f43640b2460 msgr2=0x7f436409f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f4368f94700 1 --2- 172.21.15.133:0/2684124930 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f43640b2460 0x7f436409f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f4368f94700 1 -- 172.21.15.133:0/2684124930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43640ad980 msgr2=0x7f4364066180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f4368f94700 1 --2- 172.21.15.133:0/2684124930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43640ad980 0x7f4364066180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f4368f94700 1 -- 172.21.15.133:0/2684124930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43640a0f60 con 0x7f43640b0a60 2021-01-03T13:07:30.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f4369795700 1 --2- 172.21.15.133:0/2684124930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43640ad980 0x7f4364066180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:30.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f4368f94700 1 --2- 172.21.15.133:0/2684124930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43640b0a60 0x7f436409ebe0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f43640a4480 tx=0x7f4354006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:30.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f43527fc700 1 -- 172.21.15.133:0/2684124930 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f435400ca10 con 0x7f43640b0a60 2021-01-03T13:07:30.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f43527fc700 1 -- 172.21.15.133:0/2684124930 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435400cb70 con 0x7f43640b0a60 2021-01-03T13:07:30.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f43527fc700 1 -- 172.21.15.133:0/2684124930 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43540123f0 con 0x7f43640b0a60 2021-01-03T13:07:30.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.431+0000 7f436a797700 1 -- 172.21.15.133:0/2684124930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43640a1200 con 0x7f43640b0a60 2021-01-03T13:07:30.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.435+0000 7f436a797700 1 -- 172.21.15.133:0/2684124930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4364153100 con 0x7f43640b0a60 2021-01-03T13:07:30.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.435+0000 7f436a797700 1 -- 172.21.15.133:0/2684124930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436409e8f0 con 0x7f43640b0a60 2021-01-03T13:07:30.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.435+0000 7f43527fc700 1 -- 172.21.15.133:0/2684124930 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4354012550 con 0x7f43640b0a60 2021-01-03T13:07:30.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.435+0000 7f43527fc700 1 --2- 172.21.15.133:0/2684124930 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f43440553b0 0x7f4344057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.435+0000 7f43527fc700 1 -- 172.21.15.133:0/2684124930 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f435406e050 con 0x7f43640b0a60 2021-01-03T13:07:30.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.435+0000 7f4369795700 1 --2- 172.21.15.133:0/2684124930 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f43440553b0 0x7f4344057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.435+0000 7f4369795700 1 --2- 172.21.15.133:0/2684124930 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f43440553b0 0x7f4344057870 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f436001c000 tx=0x7f4360016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:30.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.439+0000 7f43527fc700 1 -- 172.21.15.133:0/2684124930 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4354044620 con 0x7f43640b0a60 2021-01-03T13:07:30.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.575+0000 7f436a797700 1 -- 172.21.15.133:0/2684124930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4364057300 con 0x7f43640b0a60 2021-01-03T13:07:30.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.579+0000 7f43527fc700 1 -- 172.21.15.133:0/2684124930 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v147) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4354047c40 con 0x7f43640b0a60 2021-01-03T13:07:30.585 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:30.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.579+0000 7f436a797700 1 -- 172.21.15.133:0/2684124930 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f43440553b0 msgr2=0x7f4344057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.579+0000 7f436a797700 1 --2- 172.21.15.133:0/2684124930 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f43440553b0 0x7f4344057870 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f436001c000 tx=0x7f4360016000).stop 2021-01-03T13:07:30.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.579+0000 7f436a797700 1 -- 172.21.15.133:0/2684124930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43640b0a60 msgr2=0x7f436409ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.579+0000 7f436a797700 1 --2- 172.21.15.133:0/2684124930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43640b0a60 0x7f436409ebe0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f43640a4480 tx=0x7f4354006dc0).stop 2021-01-03T13:07:30.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.579+0000 7f436a797700 1 -- 172.21.15.133:0/2684124930 shutdown_connections 2021-01-03T13:07:30.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.579+0000 7f436a797700 1 --2- 172.21.15.133:0/2684124930 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f43440553b0 0x7f4344057870 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.579+0000 7f436a797700 1 --2- 172.21.15.133:0/2684124930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f43640ad980 0x7f4364066180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.579+0000 7f436a797700 1 --2- 172.21.15.133:0/2684124930 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f43640b2460 0x7f436409f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.579+0000 7f436a797700 1 --2- 172.21.15.133:0/2684124930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43640b0a60 0x7f436409ebe0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.579+0000 7f436a797700 1 -- 172.21.15.133:0/2684124930 >> 172.21.15.133:0/2684124930 conn(0x7f436406b050 msgr2=0x7f43640b5510 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:30.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.579+0000 7f436a797700 1 -- 172.21.15.133:0/2684124930 shutdown_connections 2021-01-03T13:07:30.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.579+0000 7f436a797700 1 -- 172.21.15.133:0/2684124930 wait complete. 2021-01-03T13:07:30.604 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-01-03T13:07:30.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f4833fff700 1 Processor -- start 2021-01-03T13:07:30.710 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f4833fff700 1 -- start start 2021-01-03T13:07:30.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f4833fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4834063270 0x7f48340ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f4833fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f48340b0250 0x7f48340ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f4833fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f48340accf0 0x7f48340b5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f4833fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48340afd30 con 0x7f48340b0250 2021-01-03T13:07:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f4833fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4834063650 con 0x7f48340accf0 2021-01-03T13:07:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f4833fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48340b30e0 con 0x7f4834063270 2021-01-03T13:07:30.713 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f48337fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f48340accf0 0x7f48340b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f48337fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f48340accf0 0x7f48340b5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40004/0 (socket says 172.21.15.133:40004) 2021-01-03T13:07:30.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f48337fe700 1 -- 172.21.15.133:0/477447200 learned_addr learned my addr 172.21.15.133:0/477447200 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:30.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f48327fc700 1 --2- 172.21.15.133:0/477447200 >> v2:172.21.15.16:3300/0 conn(0x7f48340b0250 0x7f48340ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f4832ffd700 1 --2- 172.21.15.133:0/477447200 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4834063270 0x7f48340ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f48337fe700 1 -- 172.21.15.133:0/477447200 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4834063270 msgr2=0x7f48340ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:30.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f48337fe700 1 --2- 172.21.15.133:0/477447200 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4834063270 0x7f48340ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f48337fe700 1 -- 172.21.15.133:0/477447200 >> v2:172.21.15.16:3300/0 conn(0x7f48340b0250 msgr2=0x7f48340ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:30.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f48337fe700 1 --2- 172.21.15.133:0/477447200 >> v2:172.21.15.16:3300/0 conn(0x7f48340b0250 0x7f48340ae8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f48337fe700 1 -- 172.21.15.133:0/477447200 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48340af5f0 con 0x7f48340accf0 2021-01-03T13:07:30.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.703+0000 7f48337fe700 1 --2- 172.21.15.133:0/477447200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340accf0 0x7f48340b5820 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f4824002f30 tx=0x7f4824006e80).ready entity=mon.1 client_cookie=5cd40f24d90db583 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4831ffb700 1 -- 172.21.15.133:0/477447200 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48240097f0 con 0x7f48340accf0 2021-01-03T13:07:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4831ffb700 1 -- 172.21.15.133:0/477447200 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4824009950 con 0x7f48340accf0 2021-01-03T13:07:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4831ffb700 1 -- 172.21.15.133:0/477447200 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4824009ac0 con 0x7f48340accf0 2021-01-03T13:07:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4833fff700 1 -- 172.21.15.133:0/477447200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340accf0 msgr2=0x7f48340b5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4833fff700 1 --2- 172.21.15.133:0/477447200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340accf0 0x7f48340b5820 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f4824002f30 tx=0x7f4824006e80).stop 2021-01-03T13:07:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4833fff700 1 -- 172.21.15.133:0/477447200 shutdown_connections 2021-01-03T13:07:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4833fff700 1 --2- 172.21.15.133:0/477447200 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340accf0 0x7f48340b5820 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4833fff700 1 --2- 172.21.15.133:0/477447200 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4834063270 0x7f48340ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4833fff700 1 --2- 172.21.15.133:0/477447200 >> v2:172.21.15.16:3300/0 conn(0x7f48340b0250 0x7f48340ae8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4833fff700 1 -- 172.21.15.133:0/477447200 >> 172.21.15.133:0/477447200 conn(0x7f48340617b0 msgr2=0x7f483406aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4833fff700 1 -- 172.21.15.133:0/477447200 shutdown_connections 2021-01-03T13:07:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4833fff700 1 -- 172.21.15.133:0/477447200 wait complete. 2021-01-03T13:07:30.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4833fff700 1 Processor -- start 2021-01-03T13:07:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4833fff700 1 -- start start 2021-01-03T13:07:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4833fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4834063270 0x7f48340a96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4833fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48340accf0 0x7f483413d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4833fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340b0250 0x7f483413d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4833fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483413ebf0 con 0x7f48340accf0 2021-01-03T13:07:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4833fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48340b3a90 con 0x7f48340b0250 2021-01-03T13:07:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f4833fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48340a86b0 con 0x7f4834063270 2021-01-03T13:07:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f48337fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340b0250 0x7f483413d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f48337fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340b0250 0x7f483413d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40010/0 (socket says 172.21.15.133:40010) 2021-01-03T13:07:30.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.707+0000 7f48337fe700 1 -- 172.21.15.133:0/3359195455 learned_addr learned my addr 172.21.15.133:0/3359195455 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f4832ffd700 1 --2- 172.21.15.133:0/3359195455 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4834063270 0x7f48340a96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f48327fc700 1 --2- 172.21.15.133:0/3359195455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48340accf0 0x7f483413d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f48337fe700 1 -- 172.21.15.133:0/3359195455 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4834063270 msgr2=0x7f48340a96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f48337fe700 1 --2- 172.21.15.133:0/3359195455 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4834063270 0x7f48340a96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f48337fe700 1 -- 172.21.15.133:0/3359195455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48340accf0 msgr2=0x7f483413d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f48337fe700 1 --2- 172.21.15.133:0/3359195455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48340accf0 0x7f483413d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f48337fe700 1 -- 172.21.15.133:0/3359195455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48340b3ce0 con 0x7f48340b0250 2021-01-03T13:07:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f48337fe700 1 --2- 172.21.15.133:0/3359195455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340b0250 0x7f483413d510 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f4824002f30 tx=0x7f4824016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f4823fff700 1 -- 172.21.15.133:0/3359195455 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4824011e90 con 0x7f48340b0250 2021-01-03T13:07:30.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f4823fff700 1 -- 172.21.15.133:0/3359195455 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4824021440 con 0x7f48340b0250 2021-01-03T13:07:30.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f4833fff700 1 -- 172.21.15.133:0/3359195455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48340abed0 con 0x7f48340b0250 2021-01-03T13:07:30.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f4823fff700 1 -- 172.21.15.133:0/3359195455 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48240217a0 con 0x7f48340b0250 2021-01-03T13:07:30.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f4833fff700 1 -- 172.21.15.133:0/3359195455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48340b5450 con 0x7f48340b0250 2021-01-03T13:07:30.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f4833fff700 1 -- 172.21.15.133:0/3359195455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48340b38f0 con 0x7f48340b0250 2021-01-03T13:07:30.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f4823fff700 1 -- 172.21.15.133:0/3359195455 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4824027020 con 0x7f48340b0250 2021-01-03T13:07:30.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f4823fff700 1 --2- 172.21.15.133:0/3359195455 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f48100553b0 0x7f4810057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:30.729 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f4823fff700 1 -- 172.21.15.133:0/3359195455 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f482406ecb0 con 0x7f48340b0250 2021-01-03T13:07:30.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.711+0000 7f4832ffd700 1 --2- 172.21.15.133:0/3359195455 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f48100553b0 0x7f4810057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:30.730 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.715+0000 7f4832ffd700 1 --2- 172.21.15.133:0/3359195455 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f48100553b0 0x7f4810057870 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f482800c000 tx=0x7f4828008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:30.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.719+0000 7f4823fff700 1 -- 172.21.15.133:0/3359195455 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f48340b38f0 con 0x7f48340b0250 2021-01-03T13:07:30.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.859+0000 7f4833fff700 1 -- 172.21.15.133:0/3359195455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f48340b38f0 con 0x7f48340b0250 2021-01-03T13:07:30.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.863+0000 7f4823fff700 1 -- 172.21.15.133:0/3359195455 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v147) v1 ==== 84+0+143 (secure 0 0 0) 0x7f48340b38f0 con 0x7f48340b0250 2021-01-03T13:07:30.869 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:30.869 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2021-01-03T13:07:30.869 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:30.870 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2021-01-03T13:07:30.870 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2021-01-03T13:07:30.870 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:30.870 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:30.870 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2021-01-03T13:07:30.871 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2021-01-03T13:07:30.871 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:30.871 INFO:teuthology.orchestra.run.smithi133.stdout:] 2021-01-03T13:07:30.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.863+0000 7f4833fff700 1 -- 172.21.15.133:0/3359195455 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f48100553b0 msgr2=0x7f4810057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.863+0000 7f4833fff700 1 --2- 172.21.15.133:0/3359195455 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f48100553b0 0x7f4810057870 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f482800c000 tx=0x7f4828008040).stop 2021-01-03T13:07:30.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.863+0000 7f4833fff700 1 -- 172.21.15.133:0/3359195455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340b0250 msgr2=0x7f483413d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:30.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.863+0000 7f4833fff700 1 --2- 172.21.15.133:0/3359195455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340b0250 0x7f483413d510 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f4824002f30 tx=0x7f4824016000).stop 2021-01-03T13:07:30.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.863+0000 7f4833fff700 1 -- 172.21.15.133:0/3359195455 shutdown_connections 2021-01-03T13:07:30.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.863+0000 7f4833fff700 1 --2- 172.21.15.133:0/3359195455 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f48100553b0 0x7f4810057870 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.863+0000 7f4833fff700 1 --2- 172.21.15.133:0/3359195455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f48340b0250 0x7f483413d510 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.863+0000 7f4833fff700 1 --2- 172.21.15.133:0/3359195455 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4834063270 0x7f48340a96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.863+0000 7f4833fff700 1 --2- 172.21.15.133:0/3359195455 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f48340accf0 0x7f483413d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:30.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.863+0000 7f4833fff700 1 -- 172.21.15.133:0/3359195455 >> 172.21.15.133:0/3359195455 conn(0x7f48340617b0 msgr2=0x7f48340b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:30.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.863+0000 7f4833fff700 1 -- 172.21.15.133:0/3359195455 shutdown_connections 2021-01-03T13:07:30.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.863+0000 7f4833fff700 1 -- 172.21.15.133:0/3359195455 wait complete. 2021-01-03T13:07:30.882 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-01-03T13:07:30.882 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-01-03T13:07:30.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.991+0000 7f95ee67d700 1 Processor -- start 2021-01-03T13:07:30.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.991+0000 7f95ee67d700 1 -- start start 2021-01-03T13:07:31.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.991+0000 7f95ee67d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95e80b5ae0 0x7f95e8141630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:31.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.991+0000 7f95ee67d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f95e8144930 0x7f95e80af310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:31.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.991+0000 7f95ee67d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e80b5710 con 0x7f95e80b5330 2021-01-03T13:07:31.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.991+0000 7f95ee67d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e80b16b0 con 0x7f95e8144930 2021-01-03T13:07:31.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.991+0000 7f95ee67d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e8140a60 con 0x7f95e80b5ae0 2021-01-03T13:07:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.991+0000 7f95ede7c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f95e8144930 0x7f95e80af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.991+0000 7f95ed67b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f95e80b5330 0x7f95e80aec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:32814/0 (socket says 172.21.15.133:32814) 2021-01-03T13:07:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.991+0000 7f95ed67b700 1 -- 172.21.15.133:0/234578754 learned_addr learned my addr 172.21.15.133:0/234578754 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:31.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95ece7a700 1 --2- 172.21.15.133:0/234578754 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95e80b5ae0 0x7f95e8141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:31.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95ede7c700 1 -- 172.21.15.133:0/234578754 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95e80b5ae0 msgr2=0x7f95e8141630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:31.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95ede7c700 1 --2- 172.21.15.133:0/234578754 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95e80b5ae0 0x7f95e8141630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:31.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95ede7c700 1 -- 172.21.15.133:0/234578754 >> v1:172.21.15.133:6789/0 conn(0x7f95e80b5330 legacy=0x7f95e80aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:31.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95e7fff700 1 -- 172.21.15.133:0/234578754 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465799530 0 0) 0x7f95e80b5710 con 0x7f95e80b5330 2021-01-03T13:07:31.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95ede7c700 1 -- 172.21.15.133:0/234578754 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e8140c50 con 0x7f95e8144930 2021-01-03T13:07:31.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95ede7c700 1 --2- 172.21.15.133:0/234578754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95e8144930 0x7f95e80af310 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f95e0002f30 tx=0x7f95e0006dc0).ready entity=mon.1 client_cookie=d91a47e134649ade server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:31.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95e7fff700 1 -- 172.21.15.133:0/234578754 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e0009760 con 0x7f95e8144930 2021-01-03T13:07:31.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95e7fff700 1 -- 172.21.15.133:0/234578754 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e00098c0 con 0x7f95e8144930 2021-01-03T13:07:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95e7fff700 1 -- 172.21.15.133:0/234578754 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e0009c20 con 0x7f95e8144930 2021-01-03T13:07:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95ee67d700 1 -- 172.21.15.133:0/234578754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95e8144930 msgr2=0x7f95e80af310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95ee67d700 1 --2- 172.21.15.133:0/234578754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95e8144930 0x7f95e80af310 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f95e0002f30 tx=0x7f95e0006dc0).stop 2021-01-03T13:07:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95ee67d700 1 -- 172.21.15.133:0/234578754 shutdown_connections 2021-01-03T13:07:31.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95ee67d700 1 --2- 172.21.15.133:0/234578754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95e8144930 0x7f95e80af310 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:31.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95ee67d700 1 --2- 172.21.15.133:0/234578754 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95e80b5ae0 0x7f95e8141630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:31.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95ee67d700 1 -- 172.21.15.133:0/234578754 >> 172.21.15.133:0/234578754 conn(0x7f95e805bdf0 msgr2=0x7f95e805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:31.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95ee67d700 1 -- 172.21.15.133:0/234578754 shutdown_connections 2021-01-03T13:07:31.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95ee67d700 1 -- 172.21.15.133:0/234578754 wait complete. 2021-01-03T13:07:31.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95ee67d700 1 Processor -- start 2021-01-03T13:07:31.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.995+0000 7f95ee67d700 1 -- start start 2021-01-03T13:07:31.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ee67d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95e80b5330 0x7f95e8065c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:31.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ee67d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95e80b5ae0 0x7f95e80aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:31.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ee67d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95e8144930 0x7f95e80acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:31.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ee67d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e80b1160 con 0x7f95e80b5330 2021-01-03T13:07:31.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ee67d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e8066460 con 0x7f95e8144930 2021-01-03T13:07:31.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ee67d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e80661c0 con 0x7f95e80b5ae0 2021-01-03T13:07:31.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ede7c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95e8144930 0x7f95e80acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:31.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ede7c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95e8144930 0x7f95e80acb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40024/0 (socket says 172.21.15.133:40024) 2021-01-03T13:07:31.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ede7c700 1 -- 172.21.15.133:0/2136312830 learned_addr learned my addr 172.21.15.133:0/2136312830 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:31.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ed67b700 1 --2- 172.21.15.133:0/2136312830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95e80b5330 0x7f95e8065c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:31.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ece7a700 1 --2- 172.21.15.133:0/2136312830 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95e80b5ae0 0x7f95e80aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:31.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ede7c700 1 -- 172.21.15.133:0/2136312830 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95e80b5ae0 msgr2=0x7f95e80aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:31.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ede7c700 1 --2- 172.21.15.133:0/2136312830 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95e80b5ae0 0x7f95e80aa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:31.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ede7c700 1 -- 172.21.15.133:0/2136312830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95e80b5330 msgr2=0x7f95e8065c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:31.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ede7c700 1 --2- 172.21.15.133:0/2136312830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95e80b5330 0x7f95e8065c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:31.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ede7c700 1 -- 172.21.15.133:0/2136312830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e8063fc0 con 0x7f95e8144930 2021-01-03T13:07:31.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ede7c700 1 --2- 172.21.15.133:0/2136312830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95e8144930 0x7f95e80acb70 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f95e814c340 tx=0x7f95e0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:31.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95e67fc700 1 -- 172.21.15.133:0/2136312830 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e0011a90 con 0x7f95e8144930 2021-01-03T13:07:31.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95e67fc700 1 -- 172.21.15.133:0/2136312830 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e0011bf0 con 0x7f95e8144930 2021-01-03T13:07:31.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ee67d700 1 -- 172.21.15.133:0/2136312830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e8064260 con 0x7f95e8144930 2021-01-03T13:07:31.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95e67fc700 1 -- 172.21.15.133:0/2136312830 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e001d440 con 0x7f95e8144930 2021-01-03T13:07:31.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ee67d700 1 -- 172.21.15.133:0/2136312830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e8064700 con 0x7f95e8144930 2021-01-03T13:07:31.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:30.999+0000 7f95ee67d700 1 -- 172.21.15.133:0/2136312830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e80643f0 con 0x7f95e8144930 2021-01-03T13:07:31.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.003+0000 7f95e67fc700 1 -- 172.21.15.133:0/2136312830 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f95e0024030 con 0x7f95e8144930 2021-01-03T13:07:31.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.003+0000 7f95e67fc700 1 --2- 172.21.15.133:0/2136312830 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95cc0553b0 0x7f95cc057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:31.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.003+0000 7f95e67fc700 1 -- 172.21.15.133:0/2136312830 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f95e006eb60 con 0x7f95e8144930 2021-01-03T13:07:31.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.003+0000 7f95ed67b700 1 --2- 172.21.15.133:0/2136312830 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95cc0553b0 0x7f95cc057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:31.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.003+0000 7f95ed67b700 1 --2- 172.21.15.133:0/2136312830 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95cc0553b0 0x7f95cc057870 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f95d000d000 tx=0x7f95d00079d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:31.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.011+0000 7f95e67fc700 1 -- 172.21.15.133:0/2136312830 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f95e0045080 con 0x7f95e8144930 2021-01-03T13:07:31.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.143+0000 7f95ee67d700 1 -- 172.21.15.133:0/2136312830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f95e8057300 con 0x7f95e8144930 2021-01-03T13:07:31.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.387+0000 7f95e67fc700 1 -- 172.21.15.133:0/2136312830 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v148) v1 ==== 133+0+0 (secure 0 0 0) 0x7f95e0022020 con 0x7f95e8144930 2021-01-03T13:07:31.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.391+0000 7f95ee67d700 1 -- 172.21.15.133:0/2136312830 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95cc0553b0 msgr2=0x7f95cc057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:31.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.391+0000 7f95ee67d700 1 --2- 172.21.15.133:0/2136312830 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95cc0553b0 0x7f95cc057870 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f95d000d000 tx=0x7f95d00079d0).stop 2021-01-03T13:07:31.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.391+0000 7f95ee67d700 1 -- 172.21.15.133:0/2136312830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95e8144930 msgr2=0x7f95e80acb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:31.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.391+0000 7f95ee67d700 1 --2- 172.21.15.133:0/2136312830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95e8144930 0x7f95e80acb70 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f95e814c340 tx=0x7f95e0015000).stop 2021-01-03T13:07:31.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.391+0000 7f95ee67d700 1 -- 172.21.15.133:0/2136312830 shutdown_connections 2021-01-03T13:07:31.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.391+0000 7f95ee67d700 1 --2- 172.21.15.133:0/2136312830 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f95cc0553b0 0x7f95cc057870 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:31.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.391+0000 7f95ee67d700 1 --2- 172.21.15.133:0/2136312830 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f95e80b5330 0x7f95e8065c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:31.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.391+0000 7f95ee67d700 1 --2- 172.21.15.133:0/2136312830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95e8144930 0x7f95e80acb70 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:31.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.391+0000 7f95ee67d700 1 --2- 172.21.15.133:0/2136312830 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f95e80b5ae0 0x7f95e80aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:31.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.391+0000 7f95ee67d700 1 -- 172.21.15.133:0/2136312830 >> 172.21.15.133:0/2136312830 conn(0x7f95e805bdf0 msgr2=0x7f95e80ab6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:31.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.391+0000 7f95ee67d700 1 -- 172.21.15.133:0/2136312830 shutdown_connections 2021-01-03T13:07:31.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.391+0000 7f95ee67d700 1 -- 172.21.15.133:0/2136312830 wait complete. 2021-01-03T13:07:31.401 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2021-01-03T13:07:31.413 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-01-03T13:07:31.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.523+0000 7f2fc0a7f700 1 Processor -- start 2021-01-03T13:07:31.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.523+0000 7f2fc0a7f700 1 -- start start 2021-01-03T13:07:31.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fc0a7f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2fbc140410 0x7f2fbc146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:31.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fc0a7f700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc05c500 con 0x7f2fbc0b0470 2021-01-03T13:07:31.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fc0a7f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc05cf20 con 0x7f2fbc1407f0 2021-01-03T13:07:31.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fc0a7f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc0b02d0 con 0x7f2fbc140410 2021-01-03T13:07:31.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fb9d9b700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2fbc1407f0 0x7f2fbc142dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:32832/0 (socket says 172.21.15.133:32832) 2021-01-03T13:07:31.534 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fb9d9b700 1 -- 172.21.15.133:0/571433826 learned_addr learned my addr 172.21.15.133:0/571433826 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:31.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fba59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2fbc140410 0x7f2fbc146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:31.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fb959a700 1 -- 172.21.15.133:0/571433826 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228515773 0 0) 0x7f2fbc05cf20 con 0x7f2fbc1407f0 2021-01-03T13:07:31.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fb959a700 1 -- 172.21.15.133:0/571433826 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fa0003230 con 0x7f2fbc1407f0 2021-01-03T13:07:31.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fba59c700 1 -- 172.21.15.133:0/571433826 >> v1:172.21.15.133:6789/0 conn(0x7f2fbc1407f0 legacy=0x7f2fbc142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:31.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fba59c700 1 -- 172.21.15.133:0/571433826 >> v1:172.21.15.16:6789/0 conn(0x7f2fbc0b0470 legacy=0x7f2fbc05bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:31.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fba59c700 1 -- 172.21.15.133:0/571433826 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc146580 con 0x7f2fbc140410 2021-01-03T13:07:31.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fba59c700 1 --2- 172.21.15.133:0/571433826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc140410 0x7f2fbc146cc0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f2fb0002f30 tx=0x7f2fb0006dc0).ready entity=mon.1 client_cookie=8f24b7adaa9d3f06 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:31.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fb959a700 1 -- 172.21.15.133:0/571433826 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fb0009800 con 0x7f2fbc140410 2021-01-03T13:07:31.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fb959a700 1 -- 172.21.15.133:0/571433826 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb0009960 con 0x7f2fbc140410 2021-01-03T13:07:31.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fb959a700 1 -- 172.21.15.133:0/571433826 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fb0009cc0 con 0x7f2fbc140410 2021-01-03T13:07:31.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fc0a7f700 1 -- 172.21.15.133:0/571433826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc140410 msgr2=0x7f2fbc146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:31.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fc0a7f700 1 --2- 172.21.15.133:0/571433826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc140410 0x7f2fbc146cc0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f2fb0002f30 tx=0x7f2fb0006dc0).stop 2021-01-03T13:07:31.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fc0a7f700 1 -- 172.21.15.133:0/571433826 shutdown_connections 2021-01-03T13:07:31.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fc0a7f700 1 --2- 172.21.15.133:0/571433826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc140410 0x7f2fbc146cc0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:31.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fc0a7f700 1 -- 172.21.15.133:0/571433826 >> 172.21.15.133:0/571433826 conn(0x7f2fbc0b95d0 msgr2=0x7f2fbc0b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:31.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fc0a7f700 1 -- 172.21.15.133:0/571433826 shutdown_connections 2021-01-03T13:07:31.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.527+0000 7f2fc0a7f700 1 -- 172.21.15.133:0/571433826 wait complete. 2021-01-03T13:07:31.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fc0a7f700 1 Processor -- start 2021-01-03T13:07:31.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fc0a7f700 1 -- start start 2021-01-03T13:07:31.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fc0a7f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc0b0470 0x7f2fbc155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:31.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fc0a7f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2fbc140410 0x7f2fbc142db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:31.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fc0a7f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fbc1407f0 0x7f2fbc14a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:31.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fc0a7f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc09f520 con 0x7f2fbc1407f0 2021-01-03T13:07:31.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fc0a7f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc141dc0 con 0x7f2fbc0b0470 2021-01-03T13:07:31.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fc0a7f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc09e900 con 0x7f2fbc140410 2021-01-03T13:07:31.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fba59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc0b0470 0x7f2fbc155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:31.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fba59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc0b0470 0x7f2fbc155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40034/0 (socket says 172.21.15.133:40034) 2021-01-03T13:07:31.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fba59c700 1 -- 172.21.15.133:0/3867451334 learned_addr learned my addr 172.21.15.133:0/3867451334 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:31.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fb9d9b700 1 --2- 172.21.15.133:0/3867451334 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2fbc140410 0x7f2fbc142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:31.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fbad9d700 1 --2- 172.21.15.133:0/3867451334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fbc1407f0 0x7f2fbc14a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:31.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fba59c700 1 -- 172.21.15.133:0/3867451334 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2fbc140410 msgr2=0x7f2fbc142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:31.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fba59c700 1 --2- 172.21.15.133:0/3867451334 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2fbc140410 0x7f2fbc142db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:31.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fba59c700 1 -- 172.21.15.133:0/3867451334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fbc1407f0 msgr2=0x7f2fbc14a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:31.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fba59c700 1 --2- 172.21.15.133:0/3867451334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fbc1407f0 0x7f2fbc14a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:31.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fba59c700 1 -- 172.21.15.133:0/3867451334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc140c60 con 0x7f2fbc0b0470 2021-01-03T13:07:31.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fba59c700 1 --2- 172.21.15.133:0/3867451334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc0b0470 0x7f2fbc155480 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f2fb0002f30 tx=0x7f2fb0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:31.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fab7fe700 1 -- 172.21.15.133:0/3867451334 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fb0011b00 con 0x7f2fbc0b0470 2021-01-03T13:07:31.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fab7fe700 1 -- 172.21.15.133:0/3867451334 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb0011c60 con 0x7f2fbc0b0470 2021-01-03T13:07:31.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fc0a7f700 1 -- 172.21.15.133:0/3867451334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc140eb0 con 0x7f2fbc0b0470 2021-01-03T13:07:31.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fab7fe700 1 -- 172.21.15.133:0/3867451334 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fb001d440 con 0x7f2fbc0b0470 2021-01-03T13:07:31.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.531+0000 7f2fc0a7f700 1 -- 172.21.15.133:0/3867451334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc0b1590 con 0x7f2fbc0b0470 2021-01-03T13:07:31.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.535+0000 7f2fc0a7f700 1 -- 172.21.15.133:0/3867451334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc057300 con 0x7f2fbc0b0470 2021-01-03T13:07:31.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.535+0000 7f2fab7fe700 1 -- 172.21.15.133:0/3867451334 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2fb0017070 con 0x7f2fbc0b0470 2021-01-03T13:07:31.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.535+0000 7f2fab7fe700 1 --2- 172.21.15.133:0/3867451334 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f98055440 0x7f2f98057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:31.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.535+0000 7f2fab7fe700 1 -- 172.21.15.133:0/3867451334 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f2fb006e980 con 0x7f2fbc0b0470 2021-01-03T13:07:31.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.535+0000 7f2fb9d9b700 1 --2- 172.21.15.133:0/3867451334 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f98055440 0x7f2f98057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:31.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.535+0000 7f2fb9d9b700 1 --2- 172.21.15.133:0/3867451334 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f98055440 0x7f2f98057900 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f2fac00b000 tx=0x7f2fac009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:31.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.543+0000 7f2fab7fe700 1 -- 172.21.15.133:0/3867451334 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2fb0044e50 con 0x7f2fbc0b0470 2021-01-03T13:07:31.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:31.679+0000 7f2fc0a7f700 1 -- 172.21.15.133:0/3867451334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f2fbc0b52a0 con 0x7f2fbc0b0470 2021-01-03T13:07:32.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.391+0000 7f2fab7fe700 1 -- 172.21.15.133:0/3867451334 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v149) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2fb0022020 con 0x7f2fbc0b0470 2021-01-03T13:07:32.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.399+0000 7f2fc0a7f700 1 -- 172.21.15.133:0/3867451334 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f98055440 msgr2=0x7f2f98057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:32.404 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.399+0000 7f2fc0a7f700 1 --2- 172.21.15.133:0/3867451334 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f98055440 0x7f2f98057900 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f2fac00b000 tx=0x7f2fac009040).stop 2021-01-03T13:07:32.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.399+0000 7f2fc0a7f700 1 -- 172.21.15.133:0/3867451334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc0b0470 msgr2=0x7f2fbc155480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:32.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.399+0000 7f2fc0a7f700 1 --2- 172.21.15.133:0/3867451334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc0b0470 0x7f2fbc155480 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f2fb0002f30 tx=0x7f2fb0015000).stop 2021-01-03T13:07:32.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.399+0000 7f2fc0a7f700 1 -- 172.21.15.133:0/3867451334 shutdown_connections 2021-01-03T13:07:32.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.399+0000 7f2fc0a7f700 1 --2- 172.21.15.133:0/3867451334 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f98055440 0x7f2f98057900 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.399+0000 7f2fc0a7f700 1 --2- 172.21.15.133:0/3867451334 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2fbc1407f0 0x7f2fbc14a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.399+0000 7f2fc0a7f700 1 --2- 172.21.15.133:0/3867451334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fbc0b0470 0x7f2fbc155480 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.399+0000 7f2fc0a7f700 1 --2- 172.21.15.133:0/3867451334 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2fbc140410 0x7f2fbc142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.399+0000 7f2fc0a7f700 1 -- 172.21.15.133:0/3867451334 >> 172.21.15.133:0/3867451334 conn(0x7f2fbc0b95d0 msgr2=0x7f2fbc05c690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:32.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.399+0000 7f2fc0a7f700 1 -- 172.21.15.133:0/3867451334 shutdown_connections 2021-01-03T13:07:32.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.399+0000 7f2fc0a7f700 1 -- 172.21.15.133:0/3867451334 wait complete. 2021-01-03T13:07:32.409 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2021-01-03T13:07:32.421 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-01-03T13:07:32.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.523+0000 7f2188f3b700 1 Processor -- start 2021-01-03T13:07:32.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.523+0000 7f2188f3b700 1 -- start start 2021-01-03T13:07:32.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.523+0000 7f2188f3b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2184140410 0x7f2184146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:32.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.523+0000 7f2188f3b700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f218405c500 con 0x7f21841407f0 2021-01-03T13:07:32.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.523+0000 7f2188f3b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f218405cf20 con 0x7f21840b0470 2021-01-03T13:07:32.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.523+0000 7f2188f3b700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21840b02d0 con 0x7f2184140410 2021-01-03T13:07:32.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.523+0000 7f2182d9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f21840b0470 0x7f218405bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:32846/0 (socket says 172.21.15.133:32846) 2021-01-03T13:07:32.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.523+0000 7f2182d9d700 1 -- 172.21.15.133:0/391494240 learned_addr learned my addr 172.21.15.133:0/391494240 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:32.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.523+0000 7f218259c700 1 --2- 172.21.15.133:0/391494240 >> v2:172.21.15.16:3300/0 conn(0x7f2184140410 0x7f2184146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:32.535 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.523+0000 7f218159a700 1 -- 172.21.15.133:0/391494240 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421421667 0 0) 0x7f218405cf20 con 0x7f21840b0470 2021-01-03T13:07:32.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.523+0000 7f218159a700 1 -- 172.21.15.133:0/391494240 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2168003230 con 0x7f21840b0470 2021-01-03T13:07:32.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218159a700 1 -- 172.21.15.133:0/391494240 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 481858958 0 0) 0x7f2168003230 con 0x7f21840b0470 2021-01-03T13:07:32.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218159a700 1 -- 172.21.15.133:0/391494240 >> v2:172.21.15.16:3300/0 conn(0x7f2184140410 msgr2=0x7f2184146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:32.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218159a700 1 --2- 172.21.15.133:0/391494240 >> v2:172.21.15.16:3300/0 conn(0x7f2184140410 0x7f2184146cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.536 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218159a700 1 -- 172.21.15.133:0/391494240 >> v1:172.21.15.16:6789/0 conn(0x7f21841407f0 legacy=0x7f2184142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:32.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218159a700 1 -- 172.21.15.133:0/391494240 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2184146580 con 0x7f21840b0470 2021-01-03T13:07:32.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218159a700 1 -- 172.21.15.133:0/391494240 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f217c001a50 con 0x7f21840b0470 2021-01-03T13:07:32.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218159a700 1 -- 172.21.15.133:0/391494240 >> v1:172.21.15.133:6789/0 conn(0x7f21840b0470 legacy=0x7f218405bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:32.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218159a700 1 --2- 172.21.15.133:0/391494240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2168003720 0x7f2168003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:32.537 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218159a700 1 --2- 172.21.15.133:0/391494240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21680044d0 0x7f2168004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:32.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218159a700 1 --2- 172.21.15.133:0/391494240 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2168004e40 0x7f216800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:32.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218159a700 1 -- 172.21.15.133:0/391494240 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2168004250 con 0x7f2168003720 2021-01-03T13:07:32.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218159a700 1 -- 172.21.15.133:0/391494240 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216800bc10 con 0x7f21680044d0 2021-01-03T13:07:32.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218159a700 1 -- 172.21.15.133:0/391494240 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216800bd50 con 0x7f2168004e40 2021-01-03T13:07:32.538 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f2181d9b700 1 --2- 172.21.15.133:0/391494240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21680044d0 0x7f2168004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:32.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218259c700 1 --2- 172.21.15.133:0/391494240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2168003720 0x7f2168003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:32.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f2182d9d700 1 --2- 172.21.15.133:0/391494240 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2168004e40 0x7f216800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:32.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f2181d9b700 1 -- 172.21.15.133:0/391494240 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2168004e40 msgr2=0x7f216800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:32.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f2181d9b700 1 --2- 172.21.15.133:0/391494240 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2168004e40 0x7f216800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f2181d9b700 1 -- 172.21.15.133:0/391494240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2168003720 msgr2=0x7f2168003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f2181d9b700 1 --2- 172.21.15.133:0/391494240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2168003720 0x7f2168003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f2181d9b700 1 -- 172.21.15.133:0/391494240 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2168003230 con 0x7f21680044d0 2021-01-03T13:07:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218259c700 1 --2- 172.21.15.133:0/391494240 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2168003720 0x7f2168003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f2182d9d700 1 -- 172.21.15.133:0/391494240 reap_dead start 2021-01-03T13:07:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f2181d9b700 1 --2- 172.21.15.133:0/391494240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21680044d0 0x7f2168004950 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f21840ba120 tx=0x7f2174007b60).ready entity=mon.1 client_cookie=d916e7627909b924 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:32.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218159a700 1 -- 172.21.15.133:0/391494240 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f217400c660 con 0x7f21680044d0 2021-01-03T13:07:32.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218159a700 1 -- 172.21.15.133:0/391494240 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217400c7c0 con 0x7f21680044d0 2021-01-03T13:07:32.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f218159a700 1 -- 172.21.15.133:0/391494240 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f217400cb20 con 0x7f21680044d0 2021-01-03T13:07:32.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f2188f3b700 1 -- 172.21.15.133:0/391494240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21680044d0 msgr2=0x7f2168004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:32.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f2188f3b700 1 --2- 172.21.15.133:0/391494240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21680044d0 0x7f2168004950 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f21840ba120 tx=0x7f2174007b60).stop 2021-01-03T13:07:32.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f2188f3b700 1 -- 172.21.15.133:0/391494240 shutdown_connections 2021-01-03T13:07:32.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f2188f3b700 1 --2- 172.21.15.133:0/391494240 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21680044d0 0x7f2168004950 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f2188f3b700 1 -- 172.21.15.133:0/391494240 >> 172.21.15.133:0/391494240 conn(0x7f21840b95d0 msgr2=0x7f21840b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:32.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f2188f3b700 1 -- 172.21.15.133:0/391494240 shutdown_connections 2021-01-03T13:07:32.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f2188f3b700 1 -- 172.21.15.133:0/391494240 wait complete. 2021-01-03T13:07:32.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.527+0000 7f2188f3b700 1 Processor -- start 2021-01-03T13:07:32.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2188f3b700 1 -- start start 2021-01-03T13:07:32.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2188f3b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21680044d0 0x7f21840b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:32.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2188f3b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f21841485d0 0x7f21840b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:32.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2188f3b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21840b2150 0x7f218413f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:32.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2188f3b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21840b1110 con 0x7f21680044d0 2021-01-03T13:07:32.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2188f3b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2184143c40 con 0x7f21840b2150 2021-01-03T13:07:32.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2188f3b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2184155570 con 0x7f21841485d0 2021-01-03T13:07:32.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2182d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21840b2150 0x7f218413f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:32.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2182d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21840b2150 0x7f218413f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40058/0 (socket says 172.21.15.133:40058) 2021-01-03T13:07:32.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f218259c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21680044d0 0x7f21840b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:32.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2182d9d700 1 -- 172.21.15.133:0/3810119516 learned_addr learned my addr 172.21.15.133:0/3810119516 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:32.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2181d9b700 1 --2- 172.21.15.133:0/3810119516 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f21841485d0 0x7f21840b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:32.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2182d9d700 1 -- 172.21.15.133:0/3810119516 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f21841485d0 msgr2=0x7f21840b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2182d9d700 1 --2- 172.21.15.133:0/3810119516 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f21841485d0 0x7f21840b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2182d9d700 1 -- 172.21.15.133:0/3810119516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21680044d0 msgr2=0x7f21840b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2182d9d700 1 --2- 172.21.15.133:0/3810119516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21680044d0 0x7f21840b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2182d9d700 1 -- 172.21.15.133:0/3810119516 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21840b2730 con 0x7f21840b2150 2021-01-03T13:07:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2182d9d700 1 --2- 172.21.15.133:0/3810119516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21840b2150 0x7f218413f7f0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f21840b3e30 tx=0x7f2184060890).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:32.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f21737fe700 1 -- 172.21.15.133:0/3810119516 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f217c00c9a0 con 0x7f21840b2150 2021-01-03T13:07:32.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f21737fe700 1 -- 172.21.15.133:0/3810119516 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217c00eed0 con 0x7f21840b2150 2021-01-03T13:07:32.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2188f3b700 1 -- 172.21.15.133:0/3810119516 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21840b29d0 con 0x7f21840b2150 2021-01-03T13:07:32.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f21737fe700 1 -- 172.21.15.133:0/3810119516 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f217c00ccf0 con 0x7f21840b2150 2021-01-03T13:07:32.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.531+0000 7f2188f3b700 1 -- 172.21.15.133:0/3810119516 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21841551f0 con 0x7f21840b2150 2021-01-03T13:07:32.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.535+0000 7f2188f3b700 1 -- 172.21.15.133:0/3810119516 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2184057300 con 0x7f21840b2150 2021-01-03T13:07:32.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.535+0000 7f21737fe700 1 -- 172.21.15.133:0/3810119516 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f217c014430 con 0x7f21840b2150 2021-01-03T13:07:32.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.535+0000 7f21737fe700 1 --2- 172.21.15.133:0/3810119516 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f21600553b0 0x7f2160057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:32.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.535+0000 7f21737fe700 1 -- 172.21.15.133:0/3810119516 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f217c06daf0 con 0x7f21840b2150 2021-01-03T13:07:32.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.535+0000 7f218259c700 1 --2- 172.21.15.133:0/3810119516 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f21600553b0 0x7f2160057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:32.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.535+0000 7f218259c700 1 --2- 172.21.15.133:0/3810119516 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f21600553b0 0x7f2160057870 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f2178008000 tx=0x7f2178008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:32.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.539+0000 7f21737fe700 1 -- 172.21.15.133:0/3810119516 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f217c043e00 con 0x7f21840b2150 2021-01-03T13:07:32.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.727+0000 7f2188f3b700 1 -- 172.21.15.133:0/3810119516 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f218405d270 con 0x7f21840b2150 2021-01-03T13:07:32.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.743+0000 7f21737fe700 1 -- 172.21.15.133:0/3810119516 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 27 and data pool 28 v70) v1 ==== 189+0+0 (secure 0 0 0) 0x7f217c047420 con 0x7f21840b2150 2021-01-03T13:07:32.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.747+0000 7f2188f3b700 1 -- 172.21.15.133:0/3810119516 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f21600553b0 msgr2=0x7f2160057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:32.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.747+0000 7f2188f3b700 1 --2- 172.21.15.133:0/3810119516 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f21600553b0 0x7f2160057870 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f2178008000 tx=0x7f2178008040).stop 2021-01-03T13:07:32.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.747+0000 7f2188f3b700 1 -- 172.21.15.133:0/3810119516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21840b2150 msgr2=0x7f218413f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:32.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.747+0000 7f2188f3b700 1 --2- 172.21.15.133:0/3810119516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21840b2150 0x7f218413f7f0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f21840b3e30 tx=0x7f2184060890).stop 2021-01-03T13:07:32.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.747+0000 7f2188f3b700 1 -- 172.21.15.133:0/3810119516 shutdown_connections 2021-01-03T13:07:32.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.747+0000 7f2188f3b700 1 --2- 172.21.15.133:0/3810119516 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f21600553b0 0x7f2160057870 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.747+0000 7f2188f3b700 1 --2- 172.21.15.133:0/3810119516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21680044d0 0x7f21840b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.747+0000 7f2188f3b700 1 --2- 172.21.15.133:0/3810119516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21840b2150 0x7f218413f7f0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.747+0000 7f2188f3b700 1 --2- 172.21.15.133:0/3810119516 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f21841485d0 0x7f21840b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.747+0000 7f2188f3b700 1 -- 172.21.15.133:0/3810119516 >> 172.21.15.133:0/3810119516 conn(0x7f21840b95d0 msgr2=0x7f21841441c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:32.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.747+0000 7f2188f3b700 1 -- 172.21.15.133:0/3810119516 shutdown_connections 2021-01-03T13:07:32.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.747+0000 7f2188f3b700 1 -- 172.21.15.133:0/3810119516 wait complete. 2021-01-03T13:07:32.756 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 27 and data pool 28 2021-01-03T13:07:32.768 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:07:32.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.859+0000 7fcb5bfff700 1 Processor -- start 2021-01-03T13:07:32.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.859+0000 7fcb5bfff700 1 -- start start 2021-01-03T13:07:32.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.859+0000 7fcb5bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb5c0b1300 0x7fcb5c1428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:32.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.859+0000 7fcb5bfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb5c0b0c30 0x7fcb5c0ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:32.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.859+0000 7fcb5bfff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5c0afa40 con 0x7fcb5c0b2050 2021-01-03T13:07:32.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.859+0000 7fcb5bfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb5c0b25d0 con 0x7fcb5c0b1300 2021-01-03T13:07:32.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.859+0000 7fcb5bfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c0b2870 con 0x7fcb5c0b0c30 2021-01-03T13:07:32.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.859+0000 7fcb5affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb5c0b1300 0x7fcb5c1428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:32.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.859+0000 7fcb5affd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb5c0b1300 0x7fcb5c1428c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40080/0 (socket says 172.21.15.133:40080) 2021-01-03T13:07:32.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.859+0000 7fcb5affd700 1 -- 172.21.15.133:0/3684121997 learned_addr learned my addr 172.21.15.133:0/3684121997 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:32.869 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.859+0000 7fcb5a7fc700 1 --2- 172.21.15.133:0/3684121997 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb5c0b0c30 0x7fcb5c0ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:32.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb5affd700 1 -- 172.21.15.133:0/3684121997 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb5c0b0c30 msgr2=0x7fcb5c0ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:32.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb5affd700 1 --2- 172.21.15.133:0/3684121997 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb5c0b0c30 0x7fcb5c0ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb5affd700 1 -- 172.21.15.133:0/3684121997 >> v1:172.21.15.16:6789/0 conn(0x7fcb5c0b2050 legacy=0x7fcb5c0a8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:32.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb5affd700 1 -- 172.21.15.133:0/3684121997 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c0ad040 con 0x7fcb5c0b1300 2021-01-03T13:07:32.870 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb5affd700 1 --2- 172.21.15.133:0/3684121997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb5c0b1300 0x7fcb5c1428c0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fcb4c0032b0 tx=0x7fcb4c009270).ready entity=mon.1 client_cookie=d890088cce060e63 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:32.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb59ffb700 1 -- 172.21.15.133:0/3684121997 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb4c00bc00 con 0x7fcb5c0b1300 2021-01-03T13:07:32.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb59ffb700 1 -- 172.21.15.133:0/3684121997 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c00bd60 con 0x7fcb5c0b1300 2021-01-03T13:07:32.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb59ffb700 1 -- 172.21.15.133:0/3684121997 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb4c011400 con 0x7fcb5c0b1300 2021-01-03T13:07:32.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb5bfff700 1 -- 172.21.15.133:0/3684121997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb5c0b1300 msgr2=0x7fcb5c1428c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:32.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb5bfff700 1 --2- 172.21.15.133:0/3684121997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb5c0b1300 0x7fcb5c1428c0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fcb4c0032b0 tx=0x7fcb4c009270).stop 2021-01-03T13:07:32.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb5bfff700 1 -- 172.21.15.133:0/3684121997 shutdown_connections 2021-01-03T13:07:32.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb5bfff700 1 --2- 172.21.15.133:0/3684121997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb5c0b1300 0x7fcb5c1428c0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb5bfff700 1 --2- 172.21.15.133:0/3684121997 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb5c0b0c30 0x7fcb5c0ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb5bfff700 1 -- 172.21.15.133:0/3684121997 >> 172.21.15.133:0/3684121997 conn(0x7fcb5c06b050 msgr2=0x7fcb5c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb5bfff700 1 -- 172.21.15.133:0/3684121997 shutdown_connections 2021-01-03T13:07:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb5bfff700 1 -- 172.21.15.133:0/3684121997 wait complete. 2021-01-03T13:07:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb5bfff700 1 Processor -- start 2021-01-03T13:07:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.863+0000 7fcb5bfff700 1 -- start start 2021-01-03T13:07:32.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb5c0b0c30 0x7fcb5c142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:32.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5bfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb5c0b1300 0x7fcb5c066410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:32.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb5c0b2050 0x7fcb5c14f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:32.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5bfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c14ea80 con 0x7fcb5c0b2050 2021-01-03T13:07:32.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5bfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c09fe50 con 0x7fcb5c0b0c30 2021-01-03T13:07:32.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5bfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c14ecd0 con 0x7fcb5c0b1300 2021-01-03T13:07:32.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb5c0b0c30 0x7fcb5c142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:32.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb5c0b0c30 0x7fcb5c142cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40082/0 (socket says 172.21.15.133:40082) 2021-01-03T13:07:32.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5affd700 1 -- 172.21.15.133:0/2658342388 learned_addr learned my addr 172.21.15.133:0/2658342388 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:32.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5b7fe700 1 --2- 172.21.15.133:0/2658342388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb5c0b2050 0x7fcb5c14f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:32.878 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5a7fc700 1 --2- 172.21.15.133:0/2658342388 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb5c0b1300 0x7fcb5c066410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:32.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5affd700 1 -- 172.21.15.133:0/2658342388 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb5c0b1300 msgr2=0x7fcb5c066410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:32.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5affd700 1 --2- 172.21.15.133:0/2658342388 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb5c0b1300 0x7fcb5c066410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5affd700 1 -- 172.21.15.133:0/2658342388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb5c0b2050 msgr2=0x7fcb5c14f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:32.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5affd700 1 --2- 172.21.15.133:0/2658342388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb5c0b2050 0x7fcb5c14f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:32.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5affd700 1 -- 172.21.15.133:0/2658342388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c14ef70 con 0x7fcb5c0b0c30 2021-01-03T13:07:32.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5b7fe700 1 --2- 172.21.15.133:0/2658342388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb5c0b2050 0x7fcb5c14f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:32.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5affd700 1 --2- 172.21.15.133:0/2658342388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb5c0b0c30 0x7fcb5c142cf0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7fcb4c0032b0 tx=0x7fcb4c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:32.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb4bfff700 1 -- 172.21.15.133:0/2658342388 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb4c0107a0 con 0x7fcb5c0b0c30 2021-01-03T13:07:32.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb4bfff700 1 -- 172.21.15.133:0/2658342388 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c010900 con 0x7fcb5c0b0c30 2021-01-03T13:07:32.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb4bfff700 1 -- 172.21.15.133:0/2658342388 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb4c010c60 con 0x7fcb5c0b0c30 2021-01-03T13:07:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5bfff700 1 -- 172.21.15.133:0/2658342388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5c066090 con 0x7fcb5c0b0c30 2021-01-03T13:07:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5bfff700 1 -- 172.21.15.133:0/2658342388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5c14faa0 con 0x7fcb5c0b0c30 2021-01-03T13:07:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.867+0000 7fcb5bfff700 1 -- 172.21.15.133:0/2658342388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb5c0a0050 con 0x7fcb5c0b0c30 2021-01-03T13:07:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.871+0000 7fcb4bfff700 1 -- 172.21.15.133:0/2658342388 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fcb4c00f070 con 0x7fcb5c0b0c30 2021-01-03T13:07:32.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.871+0000 7fcb4bfff700 1 --2- 172.21.15.133:0/2658342388 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb380553b0 0x7fcb38057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:32.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.871+0000 7fcb4bfff700 1 -- 172.21.15.133:0/2658342388 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcb4c06ee60 con 0x7fcb5c0b0c30 2021-01-03T13:07:32.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.871+0000 7fcb5a7fc700 1 --2- 172.21.15.133:0/2658342388 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb380553b0 0x7fcb38057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:32.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.871+0000 7fcb5a7fc700 1 --2- 172.21.15.133:0/2658342388 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb380553b0 0x7fcb38057870 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fcb5000c000 tx=0x7fcb50008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:32.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:32.875+0000 7fcb4bfff700 1 -- 172.21.15.133:0/2658342388 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcb4c045160 con 0x7fcb5c0b0c30 2021-01-03T13:07:33.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.015+0000 7fcb5bfff700 1 -- 172.21.15.133:0/2658342388 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb5c14f100 con 0x7fcb5c0b0c30 2021-01-03T13:07:33.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.019+0000 7fcb4bfff700 1 -- 172.21.15.133:0/2658342388 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+16100 (secure 0 0 0) 0x7fcb4c015090 con 0x7fcb5c0b0c30 2021-01-03T13:07:33.026 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:33.026 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":152,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:32.736676+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:07:31.210499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-01-03T13:07:31.743590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:07:33.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.019+0000 7fcb5bfff700 1 -- 172.21.15.133:0/2658342388 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb380553b0 msgr2=0x7fcb38057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:33.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.019+0000 7fcb5bfff700 1 --2- 172.21.15.133:0/2658342388 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb380553b0 0x7fcb38057870 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fcb5000c000 tx=0x7fcb50008040).stop 2021-01-03T13:07:33.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.019+0000 7fcb5bfff700 1 -- 172.21.15.133:0/2658342388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb5c0b0c30 msgr2=0x7fcb5c142cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:33.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.019+0000 7fcb5bfff700 1 --2- 172.21.15.133:0/2658342388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb5c0b0c30 0x7fcb5c142cf0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7fcb4c0032b0 tx=0x7fcb4c016000).stop 2021-01-03T13:07:33.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.023+0000 7fcb5bfff700 1 -- 172.21.15.133:0/2658342388 shutdown_connections 2021-01-03T13:07:33.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.023+0000 7fcb5bfff700 1 --2- 172.21.15.133:0/2658342388 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb380553b0 0x7fcb38057870 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.023+0000 7fcb5bfff700 1 --2- 172.21.15.133:0/2658342388 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb5c0b2050 0x7fcb5c14f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.023+0000 7fcb5bfff700 1 --2- 172.21.15.133:0/2658342388 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb5c0b0c30 0x7fcb5c142cf0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.023+0000 7fcb5bfff700 1 --2- 172.21.15.133:0/2658342388 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb5c0b1300 0x7fcb5c066410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.023+0000 7fcb5bfff700 1 -- 172.21.15.133:0/2658342388 >> 172.21.15.133:0/2658342388 conn(0x7fcb5c06b050 msgr2=0x7fcb5c0b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:33.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.023+0000 7fcb5bfff700 1 -- 172.21.15.133:0/2658342388 shutdown_connections 2021-01-03T13:07:33.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.023+0000 7fcb5bfff700 1 -- 172.21.15.133:0/2658342388 wait complete. 2021-01-03T13:07:33.040 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:07:33.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.143+0000 7f77dca02700 1 Processor -- start 2021-01-03T13:07:33.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.143+0000 7f77dca02700 1 -- start start 2021-01-03T13:07:33.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77dca02700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77d805c840 0x7f77d80af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:33.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77dca02700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f77d80afa70 0x7f77d813f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:33.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77dca02700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f77d813f740 0x7f77d8138c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:33.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77dca02700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d80b18e0 con 0x7f77d813f740 2021-01-03T13:07:33.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77dca02700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d80afeb0 con 0x7f77d80afa70 2021-01-03T13:07:33.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77dca02700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d805cc20 con 0x7f77d805c840 2021-01-03T13:07:33.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77cdd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f77d80afa70 0x7f77d813f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:33.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77cdd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f77d80afa70 0x7f77d813f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40092/0 (socket says 172.21.15.133:40092) 2021-01-03T13:07:33.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77cdd9b700 1 -- 172.21.15.133:0/657804296 learned_addr learned my addr 172.21.15.133:0/657804296 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:33.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77d659c700 1 --2- 172.21.15.133:0/657804296 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77d805c840 0x7f77d80af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:33.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77d6d9d700 1 --2- 172.21.15.133:0/657804296 >> v2:172.21.15.16:3300/0 conn(0x7f77d813f740 0x7f77d8138c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:33.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77cdd9b700 1 -- 172.21.15.133:0/657804296 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77d805c840 msgr2=0x7f77d80af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:33.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77cdd9b700 1 --2- 172.21.15.133:0/657804296 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77d805c840 0x7f77d80af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77cdd9b700 1 -- 172.21.15.133:0/657804296 >> v2:172.21.15.16:3300/0 conn(0x7f77d813f740 msgr2=0x7f77d8138c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:33.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77cdd9b700 1 --2- 172.21.15.133:0/657804296 >> v2:172.21.15.16:3300/0 conn(0x7f77d813f740 0x7f77d8138c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77cdd9b700 1 -- 172.21.15.133:0/657804296 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d80ad2d0 con 0x7f77d80afa70 2021-01-03T13:07:33.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77cdd9b700 1 --2- 172.21.15.133:0/657804296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77d80afa70 0x7f77d813f250 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f77c0002f30 tx=0x7f77c0006f10).ready entity=mon.1 client_cookie=7c9b11af5ee4c72 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:33.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77d5d9b700 1 -- 172.21.15.133:0/657804296 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77c000cb70 con 0x7f77d80afa70 2021-01-03T13:07:33.162 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77d5d9b700 1 -- 172.21.15.133:0/657804296 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c000ccd0 con 0x7f77d80afa70 2021-01-03T13:07:33.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77d5d9b700 1 -- 172.21.15.133:0/657804296 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77c0010600 con 0x7f77d80afa70 2021-01-03T13:07:33.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77dca02700 1 -- 172.21.15.133:0/657804296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77d80afa70 msgr2=0x7f77d813f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:33.163 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77dca02700 1 --2- 172.21.15.133:0/657804296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77d80afa70 0x7f77d813f250 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f77c0002f30 tx=0x7f77c0006f10).stop 2021-01-03T13:07:33.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77dca02700 1 -- 172.21.15.133:0/657804296 shutdown_connections 2021-01-03T13:07:33.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77dca02700 1 --2- 172.21.15.133:0/657804296 >> v2:172.21.15.16:3300/0 conn(0x7f77d813f740 0x7f77d8138c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77dca02700 1 --2- 172.21.15.133:0/657804296 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77d805c840 0x7f77d80af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77dca02700 1 --2- 172.21.15.133:0/657804296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77d80afa70 0x7f77d813f250 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77dca02700 1 -- 172.21.15.133:0/657804296 >> 172.21.15.133:0/657804296 conn(0x7f77d806aeb0 msgr2=0x7f77d805bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:33.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77dca02700 1 -- 172.21.15.133:0/657804296 shutdown_connections 2021-01-03T13:07:33.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.147+0000 7f77dca02700 1 -- 172.21.15.133:0/657804296 wait complete. 2021-01-03T13:07:33.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77dca02700 1 Processor -- start 2021-01-03T13:07:33.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77dca02700 1 -- start start 2021-01-03T13:07:33.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77dca02700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77d805c840 0x7f77d80b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:33.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77dca02700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77d80afa70 0x7f77d8153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:33.168 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77dca02700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77d813f740 0x7f77d8153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:33.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77dca02700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d8063320 con 0x7f77d80afa70 2021-01-03T13:07:33.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77dca02700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d80b4ba0 con 0x7f77d813f740 2021-01-03T13:07:33.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77dca02700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d813bf40 con 0x7f77d805c840 2021-01-03T13:07:33.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77d6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77d813f740 0x7f77d8153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:33.169 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77d6d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77d813f740 0x7f77d8153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40100/0 (socket says 172.21.15.133:40100) 2021-01-03T13:07:33.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77d6d9d700 1 -- 172.21.15.133:0/3461320063 learned_addr learned my addr 172.21.15.133:0/3461320063 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:33.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77d659c700 1 --2- 172.21.15.133:0/3461320063 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77d805c840 0x7f77d80b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:33.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77cdd9b700 1 --2- 172.21.15.133:0/3461320063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77d80afa70 0x7f77d8153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:33.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77d6d9d700 1 -- 172.21.15.133:0/3461320063 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77d805c840 msgr2=0x7f77d80b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:33.170 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77d6d9d700 1 --2- 172.21.15.133:0/3461320063 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77d805c840 0x7f77d80b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77d6d9d700 1 -- 172.21.15.133:0/3461320063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77d80afa70 msgr2=0x7f77d8153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:33.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77d6d9d700 1 --2- 172.21.15.133:0/3461320063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77d80afa70 0x7f77d8153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77d6d9d700 1 -- 172.21.15.133:0/3461320063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d813c1e0 con 0x7f77d813f740 2021-01-03T13:07:33.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77d6d9d700 1 --2- 172.21.15.133:0/3461320063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77d813f740 0x7f77d8153a40 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f77d0006dd0 tx=0x7f77d00091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:33.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77cffff700 1 -- 172.21.15.133:0/3461320063 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77d000c950 con 0x7f77d813f740 2021-01-03T13:07:33.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77cffff700 1 -- 172.21.15.133:0/3461320063 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d000cab0 con 0x7f77d813f740 2021-01-03T13:07:33.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77dca02700 1 -- 172.21.15.133:0/3461320063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d80b3ca0 con 0x7f77d813f740 2021-01-03T13:07:33.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77cffff700 1 -- 172.21.15.133:0/3461320063 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77d000ce10 con 0x7f77d813f740 2021-01-03T13:07:33.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.151+0000 7f77dca02700 1 -- 172.21.15.133:0/3461320063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d813b890 con 0x7f77d813f740 2021-01-03T13:07:33.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.155+0000 7f77dca02700 1 -- 172.21.15.133:0/3461320063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d813c370 con 0x7f77d813f740 2021-01-03T13:07:33.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.155+0000 7f77cffff700 1 -- 172.21.15.133:0/3461320063 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f77d0022070 con 0x7f77d813f740 2021-01-03T13:07:33.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.155+0000 7f77cffff700 1 --2- 172.21.15.133:0/3461320063 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77bc055330 0x7f77bc0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:33.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.155+0000 7f77cffff700 1 -- 172.21.15.133:0/3461320063 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f77d006e650 con 0x7f77d813f740 2021-01-03T13:07:33.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.155+0000 7f77d659c700 1 --2- 172.21.15.133:0/3461320063 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77bc055330 0x7f77bc0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:33.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.155+0000 7f77d659c700 1 --2- 172.21.15.133:0/3461320063 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77bc055330 0x7f77bc0577f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f77c800b000 tx=0x7f77c8006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:33.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.163+0000 7f77cffff700 1 -- 172.21.15.133:0/3461320063 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f77d00448b0 con 0x7f77d813f740 2021-01-03T13:07:33.313 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.307+0000 7f77dca02700 1 -- 172.21.15.133:0/3461320063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77d8057300 con 0x7f77d813f740 2021-01-03T13:07:33.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.307+0000 7f77cffff700 1 -- 172.21.15.133:0/3461320063 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f77d0016070 con 0x7f77d813f740 2021-01-03T13:07:33.315 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:33.315 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":152,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:32.736676+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:07:31.210499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-01-03T13:07:31.743590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:07:33.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.311+0000 7f77dca02700 1 -- 172.21.15.133:0/3461320063 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77bc055330 msgr2=0x7f77bc0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:33.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.311+0000 7f77dca02700 1 --2- 172.21.15.133:0/3461320063 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77bc055330 0x7f77bc0577f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f77c800b000 tx=0x7f77c8006dc0).stop 2021-01-03T13:07:33.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.311+0000 7f77dca02700 1 -- 172.21.15.133:0/3461320063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77d813f740 msgr2=0x7f77d8153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:33.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.311+0000 7f77dca02700 1 --2- 172.21.15.133:0/3461320063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77d813f740 0x7f77d8153a40 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f77d0006dd0 tx=0x7f77d00091a0).stop 2021-01-03T13:07:33.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.311+0000 7f77dca02700 1 -- 172.21.15.133:0/3461320063 shutdown_connections 2021-01-03T13:07:33.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.311+0000 7f77dca02700 1 --2- 172.21.15.133:0/3461320063 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f77bc055330 0x7f77bc0577f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.311+0000 7f77dca02700 1 --2- 172.21.15.133:0/3461320063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77d813f740 0x7f77d8153a40 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.311+0000 7f77dca02700 1 --2- 172.21.15.133:0/3461320063 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f77d805c840 0x7f77d80b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.311+0000 7f77dca02700 1 --2- 172.21.15.133:0/3461320063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f77d80afa70 0x7f77d8153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.311+0000 7f77dca02700 1 -- 172.21.15.133:0/3461320063 >> 172.21.15.133:0/3461320063 conn(0x7f77d806aeb0 msgr2=0x7f77d81381b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:33.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.311+0000 7f77dca02700 1 -- 172.21.15.133:0/3461320063 shutdown_connections 2021-01-03T13:07:33.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.311+0000 7f77dca02700 1 -- 172.21.15.133:0/3461320063 wait complete. 2021-01-03T13:07:33.329 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-01-03T13:07:33.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.443+0000 7f082d460700 1 Processor -- start 2021-01-03T13:07:33.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.443+0000 7f082d460700 1 -- start start 2021-01-03T13:07:33.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.443+0000 7f082d460700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0828063270 0x7f08280ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:33.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.443+0000 7f082d460700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08280b0250 0x7f08280ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:33.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.443+0000 7f082d460700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0828063650 con 0x7f08280accf0 2021-01-03T13:07:33.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.443+0000 7f082d460700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08280afd30 con 0x7f0828063270 2021-01-03T13:07:33.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.443+0000 7f082d460700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08280b30e0 con 0x7f08280b0250 2021-01-03T13:07:33.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.443+0000 7f08277fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08280b0250 0x7f08280ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:33.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.443+0000 7f08277fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f08280b0250 0x7f08280ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40108/0 (socket says 172.21.15.133:40108) 2021-01-03T13:07:33.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.443+0000 7f08277fe700 1 -- 172.21.15.133:0/2722144541 learned_addr learned my addr 172.21.15.133:0/2722144541 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:33.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.443+0000 7f0827fff700 1 --2- 172.21.15.133:0/2722144541 >> v2:172.21.15.16:3300/0 conn(0x7f0828063270 0x7f08280ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:33.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.443+0000 7f08277fe700 1 -- 172.21.15.133:0/2722144541 >> v2:172.21.15.16:3300/0 conn(0x7f0828063270 msgr2=0x7f08280ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:33.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.443+0000 7f08277fe700 1 --2- 172.21.15.133:0/2722144541 >> v2:172.21.15.16:3300/0 conn(0x7f0828063270 0x7f08280ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.443+0000 7f08277fe700 1 -- 172.21.15.133:0/2722144541 >> v1:172.21.15.16:6789/0 conn(0x7f08280accf0 legacy=0x7f08280b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:33.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.443+0000 7f08277fe700 1 -- 172.21.15.133:0/2722144541 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08280af5f0 con 0x7f08280b0250 2021-01-03T13:07:33.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.443+0000 7f08277fe700 1 --2- 172.21.15.133:0/2722144541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08280b0250 0x7f08280ae8e0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f0818002f30 tx=0x7f0818006e80).ready entity=mon.1 client_cookie=c444fe578a1ba59b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:33.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f0826ffd700 1 -- 172.21.15.133:0/2722144541 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08180097f0 con 0x7f08280b0250 2021-01-03T13:07:33.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f0826ffd700 1 -- 172.21.15.133:0/2722144541 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0818009950 con 0x7f08280b0250 2021-01-03T13:07:33.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f0826ffd700 1 -- 172.21.15.133:0/2722144541 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0818009cb0 con 0x7f08280b0250 2021-01-03T13:07:33.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f082d460700 1 -- 172.21.15.133:0/2722144541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08280b0250 msgr2=0x7f08280ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:33.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f082d460700 1 --2- 172.21.15.133:0/2722144541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08280b0250 0x7f08280ae8e0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f0818002f30 tx=0x7f0818006e80).stop 2021-01-03T13:07:33.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f082d460700 1 -- 172.21.15.133:0/2722144541 shutdown_connections 2021-01-03T13:07:33.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f082d460700 1 --2- 172.21.15.133:0/2722144541 >> v2:172.21.15.16:3300/0 conn(0x7f0828063270 0x7f08280ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f082d460700 1 --2- 172.21.15.133:0/2722144541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08280b0250 0x7f08280ae8e0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f082d460700 1 -- 172.21.15.133:0/2722144541 >> 172.21.15.133:0/2722144541 conn(0x7f08280617b0 msgr2=0x7f082806aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:33.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f082d460700 1 -- 172.21.15.133:0/2722144541 shutdown_connections 2021-01-03T13:07:33.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f082d460700 1 -- 172.21.15.133:0/2722144541 wait complete. 2021-01-03T13:07:33.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f082d460700 1 Processor -- start 2021-01-03T13:07:33.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f082d460700 1 -- start start 2021-01-03T13:07:33.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f082d460700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0828063270 0x7f08280b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:33.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f082d460700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08280accf0 0x7f08280aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:33.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f082d460700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08280b0250 0x7f0828155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:33.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f082d460700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0828067670 con 0x7f08280b0250 2021-01-03T13:07:33.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f082d460700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0828067910 con 0x7f0828063270 2021-01-03T13:07:33.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f082d460700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08280a9bb0 con 0x7f08280accf0 2021-01-03T13:07:33.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f0827fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0828063270 0x7f08280b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:33.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f0827fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0828063270 0x7f08280b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40110/0 (socket says 172.21.15.133:40110) 2021-01-03T13:07:33.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f0827fff700 1 -- 172.21.15.133:0/1496666984 learned_addr learned my addr 172.21.15.133:0/1496666984 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:33.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.447+0000 7f08277fe700 1 --2- 172.21.15.133:0/1496666984 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08280accf0 0x7f08280aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:33.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f082cc5f700 1 --2- 172.21.15.133:0/1496666984 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08280b0250 0x7f0828155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:33.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f0827fff700 1 -- 172.21.15.133:0/1496666984 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08280accf0 msgr2=0x7f08280aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:33.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f0827fff700 1 --2- 172.21.15.133:0/1496666984 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08280accf0 0x7f08280aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f0827fff700 1 -- 172.21.15.133:0/1496666984 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08280b0250 msgr2=0x7f0828155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:33.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f0827fff700 1 --2- 172.21.15.133:0/1496666984 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08280b0250 0x7f0828155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:33.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f0827fff700 1 -- 172.21.15.133:0/1496666984 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08280b5f10 con 0x7f0828063270 2021-01-03T13:07:33.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f08277fe700 1 --2- 172.21.15.133:0/1496666984 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08280accf0 0x7f08280aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:33.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f0827fff700 1 --2- 172.21.15.133:0/1496666984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0828063270 0x7f08280b5900 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f0810003070 tx=0x7f0810008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:33.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f08257fa700 1 -- 172.21.15.133:0/1496666984 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0810009980 con 0x7f0828063270 2021-01-03T13:07:33.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f08257fa700 1 -- 172.21.15.133:0/1496666984 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0810009ae0 con 0x7f0828063270 2021-01-03T13:07:33.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f082d460700 1 -- 172.21.15.133:0/1496666984 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08280aa050 con 0x7f0828063270 2021-01-03T13:07:33.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f08257fa700 1 -- 172.21.15.133:0/1496666984 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0810009e40 con 0x7f0828063270 2021-01-03T13:07:33.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f082d460700 1 -- 172.21.15.133:0/1496666984 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08280aa310 con 0x7f0828063270 2021-01-03T13:07:33.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f082d460700 1 -- 172.21.15.133:0/1496666984 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08280a9d70 con 0x7f0828063270 2021-01-03T13:07:33.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f08257fa700 1 -- 172.21.15.133:0/1496666984 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0810013480 con 0x7f0828063270 2021-01-03T13:07:33.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f08257fa700 1 --2- 172.21.15.133:0/1496666984 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f080c0554e0 0x7f080c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:33.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f08277fe700 1 --2- 172.21.15.133:0/1496666984 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f080c0554e0 0x7f080c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:33.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f08257fa700 1 -- 172.21.15.133:0/1496666984 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f081006e490 con 0x7f0828063270 2021-01-03T13:07:33.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.451+0000 7f08277fe700 1 --2- 172.21.15.133:0/1496666984 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f080c0554e0 0x7f080c0579a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f081801a000 tx=0x7f0818015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:33.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.459+0000 7f08257fa700 1 -- 172.21.15.133:0/1496666984 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0810044730 con 0x7f0828063270 2021-01-03T13:07:33.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:33.639+0000 7f082d460700 1 -- 172.21.15.133:0/1496666984 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0828057300 con 0x7f0828063270 2021-01-03T13:07:34.418 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.411+0000 7f08257fa700 1 -- 172.21.15.133:0/1496666984 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v72) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0810047d50 con 0x7f0828063270 2021-01-03T13:07:34.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.415+0000 7f082d460700 1 -- 172.21.15.133:0/1496666984 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f080c0554e0 msgr2=0x7f080c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:34.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.415+0000 7f082d460700 1 --2- 172.21.15.133:0/1496666984 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f080c0554e0 0x7f080c0579a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f081801a000 tx=0x7f0818015000).stop 2021-01-03T13:07:34.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.415+0000 7f082d460700 1 -- 172.21.15.133:0/1496666984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0828063270 msgr2=0x7f08280b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:34.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.415+0000 7f082d460700 1 --2- 172.21.15.133:0/1496666984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0828063270 0x7f08280b5900 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7f0810003070 tx=0x7f0810008040).stop 2021-01-03T13:07:34.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.415+0000 7f082d460700 1 -- 172.21.15.133:0/1496666984 shutdown_connections 2021-01-03T13:07:34.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.415+0000 7f082d460700 1 --2- 172.21.15.133:0/1496666984 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f080c0554e0 0x7f080c0579a0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.415+0000 7f082d460700 1 --2- 172.21.15.133:0/1496666984 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f08280b0250 0x7f0828155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.415+0000 7f082d460700 1 --2- 172.21.15.133:0/1496666984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0828063270 0x7f08280b5900 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.415+0000 7f082d460700 1 --2- 172.21.15.133:0/1496666984 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f08280accf0 0x7f08280aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.423 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.415+0000 7f082d460700 1 -- 172.21.15.133:0/1496666984 >> 172.21.15.133:0/1496666984 conn(0x7f08280617b0 msgr2=0x7f082813bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:34.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.415+0000 7f082d460700 1 -- 172.21.15.133:0/1496666984 shutdown_connections 2021-01-03T13:07:34.424 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.415+0000 7f082d460700 1 -- 172.21.15.133:0/1496666984 wait complete. 2021-01-03T13:07:34.440 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:07:34.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b7fff700 1 Processor -- start 2021-01-03T13:07:34.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b7fff700 1 -- start start 2021-01-03T13:07:34.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b7fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2b8146b40 0x7ff2b814e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:34.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b7fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b80605f0 con 0x7ff2b80b9f40 2021-01-03T13:07:34.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b7fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b8146fd0 con 0x7ff2b80b9b60 2021-01-03T13:07:34.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b7fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b80aed30 con 0x7ff2b8146b40 2021-01-03T13:07:34.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b6ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff2b80b9b60 0x7ff2b80b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:32918/0 (socket says 172.21.15.133:32918) 2021-01-03T13:07:34.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b6ffd700 1 -- 172.21.15.133:0/2978714336 learned_addr learned my addr 172.21.15.133:0/2978714336 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:34.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b77fe700 1 --2- 172.21.15.133:0/2978714336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2b8146b40 0x7ff2b814e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:34.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b5ffb700 1 -- 172.21.15.133:0/2978714336 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040917581 0 0) 0x7ff2b8146fd0 con 0x7ff2b80b9b60 2021-01-03T13:07:34.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b5ffb700 1 -- 172.21.15.133:0/2978714336 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff29c003230 con 0x7ff2b80b9b60 2021-01-03T13:07:34.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b5ffb700 1 -- 172.21.15.133:0/2978714336 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1442365127 0 0) 0x7ff29c003230 con 0x7ff2b80b9b60 2021-01-03T13:07:34.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b5ffb700 1 -- 172.21.15.133:0/2978714336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2b8146b40 msgr2=0x7ff2b814e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:34.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b5ffb700 1 --2- 172.21.15.133:0/2978714336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2b8146b40 0x7ff2b814e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b5ffb700 1 -- 172.21.15.133:0/2978714336 >> v1:172.21.15.16:6789/0 conn(0x7ff2b80b9f40 legacy=0x7ff2b8146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:34.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b5ffb700 1 -- 172.21.15.133:0/2978714336 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b80600b0 con 0x7ff2b80b9b60 2021-01-03T13:07:34.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b5ffb700 1 -- 172.21.15.133:0/2978714336 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7ff2a80016d0 con 0x7ff2b80b9b60 2021-01-03T13:07:34.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b5ffb700 1 -- 172.21.15.133:0/2978714336 >> v1:172.21.15.133:6789/0 conn(0x7ff2b80b9b60 legacy=0x7ff2b80b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:34.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b5ffb700 1 --2- 172.21.15.133:0/2978714336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff29c003720 0x7ff29c003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:34.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b5ffb700 1 --2- 172.21.15.133:0/2978714336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2b8146b40 0x7ff29c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:34.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b5ffb700 1 --2- 172.21.15.133:0/2978714336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff29c0049c0 0x7ff29c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:34.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b5ffb700 1 -- 172.21.15.133:0/2978714336 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b80aed30 con 0x7ff29c003720 2021-01-03T13:07:34.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b5ffb700 1 -- 172.21.15.133:0/2978714336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c0040e0 con 0x7ff29c0049c0 2021-01-03T13:07:34.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b5ffb700 1 -- 172.21.15.133:0/2978714336 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c0042a0 con 0x7ff2b8146b40 2021-01-03T13:07:34.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b77fe700 1 --2- 172.21.15.133:0/2978714336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff29c0049c0 0x7ff29c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:34.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b6ffd700 1 --2- 172.21.15.133:0/2978714336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff29c003720 0x7ff29c003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:34.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b67fc700 1 --2- 172.21.15.133:0/2978714336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2b8146b40 0x7ff29c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:34.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b77fe700 1 -- 172.21.15.133:0/2978714336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2b8146b40 msgr2=0x7ff29c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:34.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.547+0000 7ff2b77fe700 1 --2- 172.21.15.133:0/2978714336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2b8146b40 0x7ff29c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b77fe700 1 -- 172.21.15.133:0/2978714336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff29c003720 msgr2=0x7ff29c003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:34.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b77fe700 1 --2- 172.21.15.133:0/2978714336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff29c003720 0x7ff29c003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b77fe700 1 -- 172.21.15.133:0/2978714336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c003230 con 0x7ff29c0049c0 2021-01-03T13:07:34.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b67fc700 1 --2- 172.21.15.133:0/2978714336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2b8146b40 0x7ff29c0044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:34.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b77fe700 1 --2- 172.21.15.133:0/2978714336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff29c0049c0 0x7ff29c004e40 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7ff2b000c000 tx=0x7ff2b00091a0).ready entity=mon.1 client_cookie=3dd7c8d04c238081 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:34.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b5ffb700 1 -- 172.21.15.133:0/2978714336 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2b000ed00 con 0x7ff29c0049c0 2021-01-03T13:07:34.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b5ffb700 1 -- 172.21.15.133:0/2978714336 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b000ee60 con 0x7ff29c0049c0 2021-01-03T13:07:34.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b5ffb700 1 -- 172.21.15.133:0/2978714336 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2b00125e0 con 0x7ff29c0049c0 2021-01-03T13:07:34.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b7fff700 1 -- 172.21.15.133:0/2978714336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff29c0049c0 msgr2=0x7ff29c004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:34.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b7fff700 1 --2- 172.21.15.133:0/2978714336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff29c0049c0 0x7ff29c004e40 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7ff2b000c000 tx=0x7ff2b00091a0).stop 2021-01-03T13:07:34.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b77fe700 1 -- 172.21.15.133:0/2978714336 reap_dead start 2021-01-03T13:07:34.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b7fff700 1 -- 172.21.15.133:0/2978714336 shutdown_connections 2021-01-03T13:07:34.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b7fff700 1 -- 172.21.15.133:0/2978714336 >> 172.21.15.133:0/2978714336 conn(0x7ff2b80b69e0 msgr2=0x7ff2b80b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:34.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b7fff700 1 -- 172.21.15.133:0/2978714336 shutdown_connections 2021-01-03T13:07:34.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b7fff700 1 -- 172.21.15.133:0/2978714336 wait complete. 2021-01-03T13:07:34.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b7fff700 1 Processor -- start 2021-01-03T13:07:34.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b7fff700 1 -- start start 2021-01-03T13:07:34.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2b8151f50 0x7ff2b8152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:34.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b7fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2b813f740 0x7ff2b813fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:34.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b7fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2b8141850 0x7ff2b8141d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:34.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b7fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b8152820 con 0x7ff2b813f740 2021-01-03T13:07:34.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b7fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b8143640 con 0x7ff2b8151f50 2021-01-03T13:07:34.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.551+0000 7ff2b7fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b81438e0 con 0x7ff2b8141850 2021-01-03T13:07:34.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2b6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2b8151f50 0x7ff2b8152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:34.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2b6ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2b8151f50 0x7ff2b8152330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40130/0 (socket says 172.21.15.133:40130) 2021-01-03T13:07:34.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2b6ffd700 1 -- 172.21.15.133:0/148249008 learned_addr learned my addr 172.21.15.133:0/148249008 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:34.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2b67fc700 1 --2- 172.21.15.133:0/148249008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2b813f740 0x7ff2b813fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:34.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2b77fe700 1 --2- 172.21.15.133:0/148249008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2b8141850 0x7ff2b8141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:34.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2b6ffd700 1 -- 172.21.15.133:0/148249008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2b8141850 msgr2=0x7ff2b8141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:34.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2b6ffd700 1 --2- 172.21.15.133:0/148249008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2b8141850 0x7ff2b8141d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2b6ffd700 1 -- 172.21.15.133:0/148249008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2b813f740 msgr2=0x7ff2b813fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:34.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2b6ffd700 1 --2- 172.21.15.133:0/148249008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2b813f740 0x7ff2b813fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2b6ffd700 1 -- 172.21.15.133:0/148249008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b8141110 con 0x7ff2b8151f50 2021-01-03T13:07:34.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2b6ffd700 1 --2- 172.21.15.133:0/148249008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2b8151f50 0x7ff2b8152330 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7ff2a800c000 tx=0x7ff2a800d040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:34.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2a7fff700 1 -- 172.21.15.133:0/148249008 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2a8010040 con 0x7ff2b8151f50 2021-01-03T13:07:34.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2a7fff700 1 -- 172.21.15.133:0/148249008 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a800e980 con 0x7ff2b8151f50 2021-01-03T13:07:34.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2b7fff700 1 -- 172.21.15.133:0/148249008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b81413b0 con 0x7ff2b8151f50 2021-01-03T13:07:34.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2a7fff700 1 -- 172.21.15.133:0/148249008 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2a800ece0 con 0x7ff2b8151f50 2021-01-03T13:07:34.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2b7fff700 1 -- 172.21.15.133:0/148249008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b809f1a0 con 0x7ff2b8151f50 2021-01-03T13:07:34.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2b7fff700 1 -- 172.21.15.133:0/148249008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b8141540 con 0x7ff2b8151f50 2021-01-03T13:07:34.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.555+0000 7ff2a7fff700 1 -- 172.21.15.133:0/148249008 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff2a801b020 con 0x7ff2b8151f50 2021-01-03T13:07:34.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.559+0000 7ff2a7fff700 1 --2- 172.21.15.133:0/148249008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff294055500 0x7ff2940579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:34.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.559+0000 7ff2a7fff700 1 -- 172.21.15.133:0/148249008 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff2a806d790 con 0x7ff2b8151f50 2021-01-03T13:07:34.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.559+0000 7ff2b67fc700 1 --2- 172.21.15.133:0/148249008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff294055500 0x7ff2940579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:34.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.559+0000 7ff2b67fc700 1 --2- 172.21.15.133:0/148249008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff294055500 0x7ff2940579c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7ff2ac00e000 tx=0x7ff2ac009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:34.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.563+0000 7ff2a7fff700 1 -- 172.21.15.133:0/148249008 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff2a8043a90 con 0x7ff2b8151f50 2021-01-03T13:07:34.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.747+0000 7ff2b7fff700 1 -- 172.21.15.133:0/148249008 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2b8057300 con 0x7ff2b8151f50 2021-01-03T13:07:34.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.747+0000 7ff2a7fff700 1 -- 172.21.15.133:0/148249008 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+2501 (secure 0 0 0) 0x7ff2a80470b0 con 0x7ff2b8151f50 2021-01-03T13:07:34.756 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:34.757 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":72,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/3955382552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3955382552},{"type":"v1","addr":"172.21.15.16:6833","nonce":3955382552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6836/2756803911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2756803911},{"type":"v1","addr":"172.21.15.133:6836","nonce":2756803911}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:32.737122+0000","modified":"2021-01-03T13:07:34.405167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8167":{"gid":8167,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/3125642229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3125642229},{"type":"v1","addr":"172.21.15.133:6837","nonce":3125642229}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-01-03T13:07:34.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.751+0000 7ff2b7fff700 1 -- 172.21.15.133:0/148249008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff294055500 msgr2=0x7ff2940579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:34.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.751+0000 7ff2b7fff700 1 --2- 172.21.15.133:0/148249008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff294055500 0x7ff2940579c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7ff2ac00e000 tx=0x7ff2ac009040).stop 2021-01-03T13:07:34.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.751+0000 7ff2b7fff700 1 -- 172.21.15.133:0/148249008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2b8151f50 msgr2=0x7ff2b8152330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.751+0000 7ff2b7fff700 1 --2- 172.21.15.133:0/148249008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2b8151f50 0x7ff2b8152330 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7ff2a800c000 tx=0x7ff2a800d040).stop 2021-01-03T13:07:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.751+0000 7ff2b7fff700 1 -- 172.21.15.133:0/148249008 shutdown_connections 2021-01-03T13:07:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.751+0000 7ff2b7fff700 1 --2- 172.21.15.133:0/148249008 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff294055500 0x7ff2940579c0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.751+0000 7ff2b7fff700 1 --2- 172.21.15.133:0/148249008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff2b8141850 0x7ff2b8141d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.751+0000 7ff2b7fff700 1 --2- 172.21.15.133:0/148249008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2b8151f50 0x7ff2b8152330 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.751+0000 7ff2b7fff700 1 --2- 172.21.15.133:0/148249008 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2b813f740 0x7ff2b813fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.751+0000 7ff2b7fff700 1 -- 172.21.15.133:0/148249008 >> 172.21.15.133:0/148249008 conn(0x7ff2b80b69e0 msgr2=0x7ff2b80af460 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:34.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.751+0000 7ff2b7fff700 1 -- 172.21.15.133:0/148249008 shutdown_connections 2021-01-03T13:07:34.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.751+0000 7ff2b7fff700 1 -- 172.21.15.133:0/148249008 wait complete. 2021-01-03T13:07:34.762 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 72 2021-01-03T13:07:34.775 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:07:34.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.879+0000 7f4bbe1e8700 1 Processor -- start 2021-01-03T13:07:34.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.879+0000 7f4bbe1e8700 1 -- start start 2021-01-03T13:07:34.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbe1e8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4bb80b5900 0x7f4bb813f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:34.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbe1e8700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb80afd20 con 0x7f4bb80b02b0 2021-01-03T13:07:34.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbe1e8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb80ab960 con 0x7f4bb80ab580 2021-01-03T13:07:34.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbe1e8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb80aff50 con 0x7f4bb80b5900 2021-01-03T13:07:34.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbd1e6700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4bb80ab580 0x7f4bb813f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:32938/0 (socket says 172.21.15.133:32938) 2021-01-03T13:07:34.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbd1e6700 1 -- 172.21.15.133:0/2582527882 learned_addr learned my addr 172.21.15.133:0/2582527882 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:34.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbc9e5700 1 --2- 172.21.15.133:0/2582527882 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4bb80b5900 0x7f4bb813f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:34.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 -- 172.21.15.133:0/2582527882 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678653661 0 0) 0x7f4bb80ab960 con 0x7f4bb80ab580 2021-01-03T13:07:34.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 -- 172.21.15.133:0/2582527882 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b9c003230 con 0x7f4bb80ab580 2021-01-03T13:07:34.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 -- 172.21.15.133:0/2582527882 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445361277 0 0) 0x7f4bb80afd20 con 0x7f4bb80b02b0 2021-01-03T13:07:34.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 -- 172.21.15.133:0/2582527882 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb80ab960 con 0x7f4bb80b02b0 2021-01-03T13:07:34.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 -- 172.21.15.133:0/2582527882 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2532430485 0 0) 0x7f4b9c003230 con 0x7f4bb80ab580 2021-01-03T13:07:34.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 -- 172.21.15.133:0/2582527882 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4bb80b5900 msgr2=0x7f4bb813f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:34.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 --2- 172.21.15.133:0/2582527882 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4bb80b5900 0x7f4bb813f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 -- 172.21.15.133:0/2582527882 >> v1:172.21.15.16:6789/0 conn(0x7f4bb80b02b0 legacy=0x7f4bb80b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:34.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 -- 172.21.15.133:0/2582527882 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb813fee0 con 0x7f4bb80ab580 2021-01-03T13:07:34.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 -- 172.21.15.133:0/2582527882 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f4ba80016d0 con 0x7f4bb80ab580 2021-01-03T13:07:34.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 -- 172.21.15.133:0/2582527882 >> v1:172.21.15.133:6789/0 conn(0x7f4bb80ab580 legacy=0x7f4bb813f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:34.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 --2- 172.21.15.133:0/2582527882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b9c0038b0 0x7f4b9c003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:34.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 --2- 172.21.15.133:0/2582527882 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4bb80b5900 0x7f4b9c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:34.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 --2- 172.21.15.133:0/2582527882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b9c0049c0 0x7f4b9c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:34.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 -- 172.21.15.133:0/2582527882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb80aff50 con 0x7f4b9c0038b0 2021-01-03T13:07:34.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 -- 172.21.15.133:0/2582527882 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c005330 con 0x7f4b9c0049c0 2021-01-03T13:07:34.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 -- 172.21.15.133:0/2582527882 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c00b750 con 0x7f4bb80b5900 2021-01-03T13:07:34.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbd9e7700 1 --2- 172.21.15.133:0/2582527882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b9c0049c0 0x7f4b9c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:34.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbd1e6700 1 --2- 172.21.15.133:0/2582527882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b9c0038b0 0x7f4b9c003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:34.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbc9e5700 1 --2- 172.21.15.133:0/2582527882 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4bb80b5900 0x7f4b9c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbd9e7700 1 -- 172.21.15.133:0/2582527882 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4bb80b5900 msgr2=0x7f4b9c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbd9e7700 1 --2- 172.21.15.133:0/2582527882 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4bb80b5900 0x7f4b9c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbd9e7700 1 -- 172.21.15.133:0/2582527882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b9c0038b0 msgr2=0x7f4b9c003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbd9e7700 1 --2- 172.21.15.133:0/2582527882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4b9c0038b0 0x7f4b9c003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbd9e7700 1 -- 172.21.15.133:0/2582527882 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c003230 con 0x7f4b9c0049c0 2021-01-03T13:07:34.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbc9e5700 1 --2- 172.21.15.133:0/2582527882 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4bb80b5900 0x7f4b9c0044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:34.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbd9e7700 1 --2- 172.21.15.133:0/2582527882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b9c0049c0 0x7f4b9c004e40 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f4b9c004440 tx=0x7f4bb0007ee0).ready entity=mon.1 client_cookie=a61a5a787fec87e7 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:34.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 -- 172.21.15.133:0/2582527882 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bb000cbc0 con 0x7f4b9c0049c0 2021-01-03T13:07:34.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 -- 172.21.15.133:0/2582527882 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb000cd20 con 0x7f4b9c0049c0 2021-01-03T13:07:34.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4baffff700 1 -- 172.21.15.133:0/2582527882 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bb00125f0 con 0x7f4b9c0049c0 2021-01-03T13:07:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbe1e8700 1 -- 172.21.15.133:0/2582527882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b9c0049c0 msgr2=0x7f4b9c004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbe1e8700 1 --2- 172.21.15.133:0/2582527882 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4b9c0049c0 0x7f4b9c004e40 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f4b9c004440 tx=0x7f4bb0007ee0).stop 2021-01-03T13:07:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbd9e7700 1 -- 172.21.15.133:0/2582527882 reap_dead start 2021-01-03T13:07:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbe1e8700 1 -- 172.21.15.133:0/2582527882 shutdown_connections 2021-01-03T13:07:34.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbe1e8700 1 -- 172.21.15.133:0/2582527882 >> 172.21.15.133:0/2582527882 conn(0x7f4bb805bdf0 msgr2=0x7f4bb805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:34.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.883+0000 7f4bbe1e8700 1 -- 172.21.15.133:0/2582527882 shutdown_connections 2021-01-03T13:07:34.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbe1e8700 1 -- 172.21.15.133:0/2582527882 wait complete. 2021-01-03T13:07:34.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbe1e8700 1 Processor -- start 2021-01-03T13:07:34.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbe1e8700 1 -- start start 2021-01-03T13:07:34.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbe1e8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb80663e0 0x7f4bb80ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:34.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbe1e8700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4bb80aee40 0x7f4bb80667c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:34.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbe1e8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4bb8063f10 0x7f4bb8135e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbe1e8700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb80ae320 con 0x7f4bb80aee40 2021-01-03T13:07:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbe1e8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb80ae550 con 0x7f4bb80663e0 2021-01-03T13:07:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbe1e8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb80ae7f0 con 0x7f4bb8063f10 2021-01-03T13:07:34.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbd1e6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb80663e0 0x7f4bb80ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbd1e6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb80663e0 0x7f4bb80ace80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40150/0 (socket says 172.21.15.133:40150) 2021-01-03T13:07:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbd1e6700 1 -- 172.21.15.133:0/3865929130 learned_addr learned my addr 172.21.15.133:0/3865929130 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbd9e7700 1 --2- 172.21.15.133:0/3865929130 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4bb8063f10 0x7f4bb8135e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbc9e5700 1 --2- 172.21.15.133:0/3865929130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4bb80aee40 0x7f4bb80667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:34.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbd1e6700 1 -- 172.21.15.133:0/3865929130 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4bb8063f10 msgr2=0x7f4bb8135e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbd1e6700 1 --2- 172.21.15.133:0/3865929130 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4bb8063f10 0x7f4bb8135e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbd1e6700 1 -- 172.21.15.133:0/3865929130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4bb80aee40 msgr2=0x7f4bb80667c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbd1e6700 1 --2- 172.21.15.133:0/3865929130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4bb80aee40 0x7f4bb80667c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbd1e6700 1 -- 172.21.15.133:0/3865929130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb80ad760 con 0x7f4bb80663e0 2021-01-03T13:07:34.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbd9e7700 1 --2- 172.21.15.133:0/3865929130 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4bb8063f10 0x7f4bb8135e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbc9e5700 1 --2- 172.21.15.133:0/3865929130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4bb80aee40 0x7f4bb80667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbd1e6700 1 --2- 172.21.15.133:0/3865929130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb80663e0 0x7f4bb80ace80 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f4ba800b000 tx=0x7f4ba8001060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bae7fc700 1 -- 172.21.15.133:0/3865929130 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ba800a960 con 0x7f4bb80663e0 2021-01-03T13:07:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bae7fc700 1 -- 172.21.15.133:0/3865929130 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba8010040 con 0x7f4bb80663e0 2021-01-03T13:07:34.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbe1e8700 1 -- 172.21.15.133:0/3865929130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb80643a0 con 0x7f4bb80663e0 2021-01-03T13:07:34.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bae7fc700 1 -- 172.21.15.133:0/3865929130 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ba800acb0 con 0x7f4bb80663e0 2021-01-03T13:07:34.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.887+0000 7f4bbe1e8700 1 -- 172.21.15.133:0/3865929130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb8064680 con 0x7f4bb80663e0 2021-01-03T13:07:34.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.891+0000 7f4bbe1e8700 1 -- 172.21.15.133:0/3865929130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb80ae9b0 con 0x7f4bb80663e0 2021-01-03T13:07:34.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.891+0000 7f4bae7fc700 1 -- 172.21.15.133:0/3865929130 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4ba801b020 con 0x7f4bb80663e0 2021-01-03T13:07:34.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.891+0000 7f4bae7fc700 1 --2- 172.21.15.133:0/3865929130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4ba00553b0 0x7f4ba0057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:34.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.891+0000 7f4bae7fc700 1 -- 172.21.15.133:0/3865929130 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4ba806d960 con 0x7f4bb80663e0 2021-01-03T13:07:34.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.891+0000 7f4bbc9e5700 1 --2- 172.21.15.133:0/3865929130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4ba00553b0 0x7f4ba0057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:34.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.895+0000 7f4bbc9e5700 1 --2- 172.21.15.133:0/3865929130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4ba00553b0 0x7f4ba0057870 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f4bb4008000 tx=0x7f4bb400b040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:34.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:34.899+0000 7f4bae7fc700 1 -- 172.21.15.133:0/3865929130 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4ba8043bc0 con 0x7f4bb80663e0 2021-01-03T13:07:35.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.035+0000 7f4bbe1e8700 1 -- 172.21.15.133:0/3865929130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bb8057300 con 0x7f4bb80663e0 2021-01-03T13:07:35.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.039+0000 7f4bae7fc700 1 -- 172.21.15.133:0/3865929130 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f4ba80471e0 con 0x7f4bb80663e0 2021-01-03T13:07:35.045 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:35.045 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":152,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:32.736676+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:07:31.210499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-01-03T13:07:31.743590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:07:35.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.039+0000 7f4bbe1e8700 1 -- 172.21.15.133:0/3865929130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4ba00553b0 msgr2=0x7f4ba0057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.039+0000 7f4bbe1e8700 1 --2- 172.21.15.133:0/3865929130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4ba00553b0 0x7f4ba0057870 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f4bb4008000 tx=0x7f4bb400b040).stop 2021-01-03T13:07:35.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.039+0000 7f4bbe1e8700 1 -- 172.21.15.133:0/3865929130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb80663e0 msgr2=0x7f4bb80ace80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.039+0000 7f4bbe1e8700 1 --2- 172.21.15.133:0/3865929130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb80663e0 0x7f4bb80ace80 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f4ba800b000 tx=0x7f4ba8001060).stop 2021-01-03T13:07:35.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.039+0000 7f4bbe1e8700 1 -- 172.21.15.133:0/3865929130 shutdown_connections 2021-01-03T13:07:35.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.039+0000 7f4bbe1e8700 1 --2- 172.21.15.133:0/3865929130 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4ba00553b0 0x7f4ba0057870 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.039+0000 7f4bbe1e8700 1 --2- 172.21.15.133:0/3865929130 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4bb8063f10 0x7f4bb8135e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.039+0000 7f4bbe1e8700 1 --2- 172.21.15.133:0/3865929130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bb80663e0 0x7f4bb80ace80 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.039+0000 7f4bbe1e8700 1 --2- 172.21.15.133:0/3865929130 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4bb80aee40 0x7f4bb80667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.039+0000 7f4bbe1e8700 1 -- 172.21.15.133:0/3865929130 >> 172.21.15.133:0/3865929130 conn(0x7f4bb805bdf0 msgr2=0x7f4bb805fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:35.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.039+0000 7f4bbe1e8700 1 -- 172.21.15.133:0/3865929130 shutdown_connections 2021-01-03T13:07:35.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.039+0000 7f4bbe1e8700 1 -- 172.21.15.133:0/3865929130 wait complete. 2021-01-03T13:07:35.065 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:07:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fdf1cc700 1 Processor -- start 2021-01-03T13:07:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fdf1cc700 1 -- start start 2021-01-03T13:07:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fdf1cc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4fd8062450 0x7f4fd8067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fdf1cc700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd80adff0 con 0x7f4fd80adc10 2021-01-03T13:07:35.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fdf1cc700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd805fb80 con 0x7f4fd80b33b0 2021-01-03T13:07:35.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fdf1cc700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd80b1930 con 0x7f4fd8062450 2021-01-03T13:07:35.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fe042e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4fd80b33b0 0x7f4fd814f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:32962/0 (socket says 172.21.15.133:32962) 2021-01-03T13:07:35.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fde1ca700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4fd8062450 0x7f4fd8067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fe042e700 1 -- 172.21.15.133:0/1566256543 learned_addr learned my addr 172.21.15.133:0/1566256543 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:35.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fdd9c9700 1 -- 172.21.15.133:0/1566256543 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269351011 0 0) 0x7f4fd805fb80 con 0x7f4fd80b33b0 2021-01-03T13:07:35.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fdd9c9700 1 -- 172.21.15.133:0/1566256543 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fc0003230 con 0x7f4fd80b33b0 2021-01-03T13:07:35.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fdd9c9700 1 -- 172.21.15.133:0/1566256543 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59465566 0 0) 0x7f4fd80adff0 con 0x7f4fd80adc10 2021-01-03T13:07:35.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fdd9c9700 1 -- 172.21.15.133:0/1566256543 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fd805fb80 con 0x7f4fd80adc10 2021-01-03T13:07:35.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fde1ca700 1 -- 172.21.15.133:0/1566256543 >> v1:172.21.15.133:6789/0 conn(0x7f4fd80b33b0 legacy=0x7f4fd814f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fde1ca700 1 -- 172.21.15.133:0/1566256543 >> v1:172.21.15.16:6789/0 conn(0x7f4fd80adc10 legacy=0x7f4fd80b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fde1ca700 1 -- 172.21.15.133:0/1566256543 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80b3860 con 0x7f4fd8062450 2021-01-03T13:07:35.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fde1ca700 1 --2- 172.21.15.133:0/1566256543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd8062450 0x7f4fd8067cb0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f4fcc002f30 tx=0x7f4fcc006dc0).ready entity=mon.1 client_cookie=18b140bcd75dc89d server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:35.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fdd9c9700 1 -- 172.21.15.133:0/1566256543 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fcc009740 con 0x7f4fd8062450 2021-01-03T13:07:35.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fdd9c9700 1 -- 172.21.15.133:0/1566256543 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fcc0098a0 con 0x7f4fd8062450 2021-01-03T13:07:35.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.183+0000 7f4fdd9c9700 1 -- 172.21.15.133:0/1566256543 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fcc009c00 con 0x7f4fd8062450 2021-01-03T13:07:35.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.187+0000 7f4fdf1cc700 1 -- 172.21.15.133:0/1566256543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd8062450 msgr2=0x7f4fd8067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.187+0000 7f4fdf1cc700 1 --2- 172.21.15.133:0/1566256543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd8062450 0x7f4fd8067cb0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f4fcc002f30 tx=0x7f4fcc006dc0).stop 2021-01-03T13:07:35.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.187+0000 7f4fdf1cc700 1 -- 172.21.15.133:0/1566256543 shutdown_connections 2021-01-03T13:07:35.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.187+0000 7f4fdf1cc700 1 --2- 172.21.15.133:0/1566256543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd8062450 0x7f4fd8067cb0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.187+0000 7f4fdf1cc700 1 -- 172.21.15.133:0/1566256543 >> 172.21.15.133:0/1566256543 conn(0x7f4fd8060d10 msgr2=0x7f4fd8061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:35.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.187+0000 7f4fdf1cc700 1 -- 172.21.15.133:0/1566256543 shutdown_connections 2021-01-03T13:07:35.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.187+0000 7f4fdf1cc700 1 -- 172.21.15.133:0/1566256543 wait complete. 2021-01-03T13:07:35.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.187+0000 7f4fdf1cc700 1 Processor -- start 2021-01-03T13:07:35.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fdf1cc700 1 -- start start 2021-01-03T13:07:35.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fdf1cc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fd8062450 0x7f4fd80aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fdf1cc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4fd80adc10 0x7f4fd8066160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fdf1cc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd80b33b0 0x7f4fd811eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fdf1cc700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd811eb90 con 0x7f4fd8062450 2021-01-03T13:07:35.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fdf1cc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8065960 con 0x7f4fd80b33b0 2021-01-03T13:07:35.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fdf1cc700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8065c00 con 0x7f4fd80adc10 2021-01-03T13:07:35.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fe042e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd80b33b0 0x7f4fd811eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fe042e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd80b33b0 0x7f4fd811eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40168/0 (socket says 172.21.15.133:40168) 2021-01-03T13:07:35.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fe042e700 1 -- 172.21.15.133:0/601213779 learned_addr learned my addr 172.21.15.133:0/601213779 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:35.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fde9cb700 1 --2- 172.21.15.133:0/601213779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fd8062450 0x7f4fd80aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fde1ca700 1 --2- 172.21.15.133:0/601213779 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4fd80adc10 0x7f4fd8066160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fe042e700 1 -- 172.21.15.133:0/601213779 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4fd80adc10 msgr2=0x7f4fd8066160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fe042e700 1 --2- 172.21.15.133:0/601213779 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4fd80adc10 0x7f4fd8066160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fe042e700 1 -- 172.21.15.133:0/601213779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fd8062450 msgr2=0x7f4fd80aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fe042e700 1 --2- 172.21.15.133:0/601213779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fd8062450 0x7f4fd80aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fe042e700 1 -- 172.21.15.133:0/601213779 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd8065ea0 con 0x7f4fd80b33b0 2021-01-03T13:07:35.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fde1ca700 1 --2- 172.21.15.133:0/601213779 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4fd80adc10 0x7f4fd8066160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:35.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fe042e700 1 --2- 172.21.15.133:0/601213779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd80b33b0 0x7f4fd811eff0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f4fd00010d0 tx=0x7f4fd0007a50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:35.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fd77fe700 1 -- 172.21.15.133:0/601213779 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fd00072e0 con 0x7f4fd80b33b0 2021-01-03T13:07:35.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fd77fe700 1 -- 172.21.15.133:0/601213779 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd0007440 con 0x7f4fd80b33b0 2021-01-03T13:07:35.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fdf1cc700 1 -- 172.21.15.133:0/601213779 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd8064c90 con 0x7f4fd80b33b0 2021-01-03T13:07:35.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fd77fe700 1 -- 172.21.15.133:0/601213779 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fd00057d0 con 0x7f4fd80b33b0 2021-01-03T13:07:35.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.191+0000 7f4fdf1cc700 1 -- 172.21.15.133:0/601213779 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd811f4e0 con 0x7f4fd80b33b0 2021-01-03T13:07:35.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.195+0000 7f4fdf1cc700 1 -- 172.21.15.133:0/601213779 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd811ed00 con 0x7f4fd80b33b0 2021-01-03T13:07:35.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.195+0000 7f4fd77fe700 1 -- 172.21.15.133:0/601213779 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4fd0010070 con 0x7f4fd80b33b0 2021-01-03T13:07:35.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.195+0000 7f4fd77fe700 1 --2- 172.21.15.133:0/601213779 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4fb8055470 0x7f4fb8057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.195+0000 7f4fd77fe700 1 -- 172.21.15.133:0/601213779 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4fd006d4a0 con 0x7f4fd80b33b0 2021-01-03T13:07:35.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.195+0000 7f4fde9cb700 1 --2- 172.21.15.133:0/601213779 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4fb8055470 0x7f4fb8057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.195+0000 7f4fde9cb700 1 --2- 172.21.15.133:0/601213779 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4fb8055470 0x7f4fb8057930 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f4fc800d000 tx=0x7f4fc8007d70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:35.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.203+0000 7f4fd77fe700 1 -- 172.21.15.133:0/601213779 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4fd0043700 con 0x7f4fd80b33b0 2021-01-03T13:07:35.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.387+0000 7f4fdf1cc700 1 -- 172.21.15.133:0/601213779 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4fd8057300 con 0x7f4fd80b33b0 2021-01-03T13:07:35.405 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.399+0000 7f4fd77fe700 1 -- 172.21.15.133:0/601213779 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v31) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4fd0018070 con 0x7f4fd80b33b0 2021-01-03T13:07:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.399+0000 7f4fdf1cc700 1 -- 172.21.15.133:0/601213779 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4fb8055470 msgr2=0x7f4fb8057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.399+0000 7f4fdf1cc700 1 --2- 172.21.15.133:0/601213779 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4fb8055470 0x7f4fb8057930 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f4fc800d000 tx=0x7f4fc8007d70).stop 2021-01-03T13:07:35.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.399+0000 7f4fdf1cc700 1 -- 172.21.15.133:0/601213779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd80b33b0 msgr2=0x7f4fd811eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.399+0000 7f4fdf1cc700 1 --2- 172.21.15.133:0/601213779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd80b33b0 0x7f4fd811eff0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f4fd00010d0 tx=0x7f4fd0007a50).stop 2021-01-03T13:07:35.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.399+0000 7f4fdf1cc700 1 -- 172.21.15.133:0/601213779 shutdown_connections 2021-01-03T13:07:35.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.399+0000 7f4fdf1cc700 1 --2- 172.21.15.133:0/601213779 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4fb8055470 0x7f4fb8057930 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.399+0000 7f4fdf1cc700 1 --2- 172.21.15.133:0/601213779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fd8062450 0x7f4fd80aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.399+0000 7f4fdf1cc700 1 --2- 172.21.15.133:0/601213779 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4fd80b33b0 0x7f4fd811eff0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.399+0000 7f4fdf1cc700 1 --2- 172.21.15.133:0/601213779 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4fd80adc10 0x7f4fd8066160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.399+0000 7f4fdf1cc700 1 -- 172.21.15.133:0/601213779 >> 172.21.15.133:0/601213779 conn(0x7f4fd8060d10 msgr2=0x7f4fd80b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:35.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.399+0000 7f4fdf1cc700 1 -- 172.21.15.133:0/601213779 shutdown_connections 2021-01-03T13:07:35.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.399+0000 7f4fdf1cc700 1 -- 172.21.15.133:0/601213779 wait complete. 2021-01-03T13:07:35.410 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2021-01-03T13:07:35.424 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:07:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f150e27b700 1 Processor -- start 2021-01-03T13:07:35.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f150e27b700 1 -- start start 2021-01-03T13:07:35.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f150e27b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1508060b00 0x7f15080af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f150e27b700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150809a380 con 0x7f15080b5120 2021-01-03T13:07:35.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f150e27b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1508060090 con 0x7f15080abff0 2021-01-03T13:07:35.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f150e27b700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1508062340 con 0x7f1508060b00 2021-01-03T13:07:35.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f150d019700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f15080abff0 0x7f15080afee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:32976/0 (socket says 172.21.15.133:32976) 2021-01-03T13:07:35.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f150d019700 1 -- 172.21.15.133:0/2530642670 learned_addr learned my addr 172.21.15.133:0/2530642670 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:35.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f1507fff700 1 --2- 172.21.15.133:0/2530642670 >> v2:172.21.15.16:3300/0 conn(0x7f1508060b00 0x7f15080af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f15077fe700 1 -- 172.21.15.133:0/2530642670 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341253367 0 0) 0x7f1508060090 con 0x7f15080abff0 2021-01-03T13:07:35.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f15077fe700 1 -- 172.21.15.133:0/2530642670 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14f4003230 con 0x7f15080abff0 2021-01-03T13:07:35.549 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f15077fe700 1 -- 172.21.15.133:0/2530642670 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3575309936 0 0) 0x7f14f4003230 con 0x7f15080abff0 2021-01-03T13:07:35.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f15077fe700 1 -- 172.21.15.133:0/2530642670 >> v2:172.21.15.16:3300/0 conn(0x7f1508060b00 msgr2=0x7f15080af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:35.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f15077fe700 1 --2- 172.21.15.133:0/2530642670 >> v2:172.21.15.16:3300/0 conn(0x7f1508060b00 0x7f15080af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f15077fe700 1 -- 172.21.15.133:0/2530642670 >> v1:172.21.15.16:6789/0 conn(0x7f15080b5120 legacy=0x7f15080ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.550 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f15077fe700 1 -- 172.21.15.133:0/2530642670 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1508060330 con 0x7f15080abff0 2021-01-03T13:07:35.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f15077fe700 1 -- 172.21.15.133:0/2530642670 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f1500001a50 con 0x7f15080abff0 2021-01-03T13:07:35.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f1507fff700 1 --2- 172.21.15.133:0/2530642670 >> v2:172.21.15.16:3300/0 conn(0x7f1508060b00 0x7f15080af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:35.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f15077fe700 1 -- 172.21.15.133:0/2530642670 >> v1:172.21.15.133:6789/0 conn(0x7f15080abff0 legacy=0x7f15080afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f15077fe700 1 --2- 172.21.15.133:0/2530642670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f4003720 0x7f14f4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.551 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f15077fe700 1 --2- 172.21.15.133:0/2530642670 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f14f40044d0 0x7f14f4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f15077fe700 1 --2- 172.21.15.133:0/2530642670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14f4004e40 0x7f14f400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f15077fe700 1 -- 172.21.15.133:0/2530642670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1508062340 con 0x7f14f4003720 2021-01-03T13:07:35.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f15077fe700 1 -- 172.21.15.133:0/2530642670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f4004250 con 0x7f14f4004e40 2021-01-03T13:07:35.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f15077fe700 1 -- 172.21.15.133:0/2530642670 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f404fc20 con 0x7f14f40044d0 2021-01-03T13:07:35.552 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f150d019700 1 --2- 172.21.15.133:0/2530642670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14f4004e40 0x7f14f400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f1507fff700 1 --2- 172.21.15.133:0/2530642670 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f14f40044d0 0x7f14f4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f150c818700 1 --2- 172.21.15.133:0/2530642670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f4003720 0x7f14f4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f150d019700 1 -- 172.21.15.133:0/2530642670 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f14f40044d0 msgr2=0x7f14f4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:35.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f150d019700 1 --2- 172.21.15.133:0/2530642670 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f14f40044d0 0x7f14f4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.553 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f150d019700 1 -- 172.21.15.133:0/2530642670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f4003720 msgr2=0x7f14f4003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:35.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.535+0000 7f150d019700 1 --2- 172.21.15.133:0/2530642670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f4003720 0x7f14f4003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.539+0000 7f150d019700 1 -- 172.21.15.133:0/2530642670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f4003230 con 0x7f14f4004e40 2021-01-03T13:07:35.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.539+0000 7f1507fff700 1 --2- 172.21.15.133:0/2530642670 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f14f40044d0 0x7f14f4004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:35.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.539+0000 7f150d019700 1 -- 172.21.15.133:0/2530642670 reap_dead start 2021-01-03T13:07:35.554 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.539+0000 7f150d019700 1 --2- 172.21.15.133:0/2530642670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14f4004e40 0x7f14f400b720 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f1500001760 tx=0x7f1508060220).ready entity=mon.1 client_cookie=52b925a3a7c8e736 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:35.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.539+0000 7f15077fe700 1 -- 172.21.15.133:0/2530642670 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1500005c40 con 0x7f14f4004e40 2021-01-03T13:07:35.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.539+0000 7f15077fe700 1 -- 172.21.15.133:0/2530642670 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1500005da0 con 0x7f14f4004e40 2021-01-03T13:07:35.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.539+0000 7f15077fe700 1 -- 172.21.15.133:0/2530642670 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15000072c0 con 0x7f14f4004e40 2021-01-03T13:07:35.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.539+0000 7f150e27b700 1 -- 172.21.15.133:0/2530642670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14f4004e40 msgr2=0x7f14f400b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.555 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.539+0000 7f150e27b700 1 --2- 172.21.15.133:0/2530642670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14f4004e40 0x7f14f400b720 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f1500001760 tx=0x7f1508060220).stop 2021-01-03T13:07:35.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.539+0000 7f150e27b700 1 -- 172.21.15.133:0/2530642670 shutdown_connections 2021-01-03T13:07:35.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.539+0000 7f150e27b700 1 --2- 172.21.15.133:0/2530642670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14f4004e40 0x7f14f400b720 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.539+0000 7f150e27b700 1 -- 172.21.15.133:0/2530642670 >> 172.21.15.133:0/2530642670 conn(0x7f150805bdf0 msgr2=0x7f150805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:35.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.539+0000 7f150e27b700 1 -- 172.21.15.133:0/2530642670 shutdown_connections 2021-01-03T13:07:35.556 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.539+0000 7f150e27b700 1 -- 172.21.15.133:0/2530642670 wait complete. 2021-01-03T13:07:35.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.539+0000 7f150e27b700 1 Processor -- start 2021-01-03T13:07:35.557 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.539+0000 7f150e27b700 1 -- start start 2021-01-03T13:07:35.559 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150e27b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f4004e40 0x7f1508093ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150e27b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f150808fd40 0x7f15080666e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150e27b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1508091ed0 0x7f15081420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150e27b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15080935d0 con 0x7f14f4004e40 2021-01-03T13:07:35.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150e27b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150813f6f0 con 0x7f1508091ed0 2021-01-03T13:07:35.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150e27b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150813f990 con 0x7f150808fd40 2021-01-03T13:07:35.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150d019700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1508091ed0 0x7f15081420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150d019700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1508091ed0 0x7f15081420f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40188/0 (socket says 172.21.15.133:40188) 2021-01-03T13:07:35.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150d019700 1 -- 172.21.15.133:0/2058546217 learned_addr learned my addr 172.21.15.133:0/2058546217 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:35.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150c818700 1 --2- 172.21.15.133:0/2058546217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f4004e40 0x7f1508093ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f1507fff700 1 --2- 172.21.15.133:0/2058546217 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f150808fd40 0x7f15080666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150d019700 1 -- 172.21.15.133:0/2058546217 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f150808fd40 msgr2=0x7f15080666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150d019700 1 --2- 172.21.15.133:0/2058546217 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f150808fd40 0x7f15080666e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150d019700 1 -- 172.21.15.133:0/2058546217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f4004e40 msgr2=0x7f1508093ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150d019700 1 --2- 172.21.15.133:0/2058546217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f4004e40 0x7f1508093ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150d019700 1 -- 172.21.15.133:0/2058546217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1508093800 con 0x7f1508091ed0 2021-01-03T13:07:35.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f1507fff700 1 --2- 172.21.15.133:0/2058546217 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f150808fd40 0x7f15080666e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:35.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150d019700 1 --2- 172.21.15.133:0/2058546217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1508091ed0 0x7f15081420f0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f1500001760 tx=0x7f1500013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:35.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f15057fa700 1 -- 172.21.15.133:0/2058546217 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1500007570 con 0x7f1508091ed0 2021-01-03T13:07:35.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150e27b700 1 -- 172.21.15.133:0/2058546217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1508066bd0 con 0x7f1508091ed0 2021-01-03T13:07:35.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f15057fa700 1 -- 172.21.15.133:0/2058546217 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15000076d0 con 0x7f1508091ed0 2021-01-03T13:07:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f15057fa700 1 -- 172.21.15.133:0/2058546217 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1500013640 con 0x7f1508091ed0 2021-01-03T13:07:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.543+0000 7f150e27b700 1 -- 172.21.15.133:0/2058546217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15081425e0 con 0x7f1508091ed0 2021-01-03T13:07:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.547+0000 7f150e27b700 1 -- 172.21.15.133:0/2058546217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1508093990 con 0x7f1508091ed0 2021-01-03T13:07:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.547+0000 7f15057fa700 1 -- 172.21.15.133:0/2058546217 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f1500027070 con 0x7f1508091ed0 2021-01-03T13:07:35.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.547+0000 7f15057fa700 1 --2- 172.21.15.133:0/2058546217 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f14ec055440 0x7f14ec057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.547+0000 7f15057fa700 1 -- 172.21.15.133:0/2058546217 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f150006e890 con 0x7f1508091ed0 2021-01-03T13:07:35.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.547+0000 7f150c818700 1 --2- 172.21.15.133:0/2058546217 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f14ec055440 0x7f14ec057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.547+0000 7f150c818700 1 --2- 172.21.15.133:0/2058546217 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f14ec055440 0x7f14ec057900 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f14f000d000 tx=0x7f14f000c040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:35.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.551+0000 7f15057fa700 1 -- 172.21.15.133:0/2058546217 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1500044b90 con 0x7f1508091ed0 2021-01-03T13:07:35.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.743+0000 7f150e27b700 1 -- 172.21.15.133:0/2058546217 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1508057300 con 0x7f1508091ed0 2021-01-03T13:07:35.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.751+0000 7f15057fa700 1 -- 172.21.15.133:0/2058546217 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v32) v1 ==== 184+0+0 (secure 0 0 0) 0x7f15000481b0 con 0x7f1508091ed0 2021-01-03T13:07:35.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.755+0000 7f150e27b700 1 -- 172.21.15.133:0/2058546217 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f14ec055440 msgr2=0x7f14ec057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.755+0000 7f150e27b700 1 --2- 172.21.15.133:0/2058546217 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f14ec055440 0x7f14ec057900 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f14f000d000 tx=0x7f14f000c040).stop 2021-01-03T13:07:35.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.755+0000 7f150e27b700 1 -- 172.21.15.133:0/2058546217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1508091ed0 msgr2=0x7f15081420f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.755+0000 7f150e27b700 1 --2- 172.21.15.133:0/2058546217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1508091ed0 0x7f15081420f0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f1500001760 tx=0x7f1500013000).stop 2021-01-03T13:07:35.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.755+0000 7f150e27b700 1 -- 172.21.15.133:0/2058546217 shutdown_connections 2021-01-03T13:07:35.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.755+0000 7f150e27b700 1 --2- 172.21.15.133:0/2058546217 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f14ec055440 0x7f14ec057900 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.755+0000 7f150e27b700 1 --2- 172.21.15.133:0/2058546217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f14f4004e40 0x7f1508093ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.755+0000 7f150e27b700 1 --2- 172.21.15.133:0/2058546217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1508091ed0 0x7f15081420f0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.755+0000 7f150e27b700 1 --2- 172.21.15.133:0/2058546217 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f150808fd40 0x7f15080666e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.755+0000 7f150e27b700 1 -- 172.21.15.133:0/2058546217 >> 172.21.15.133:0/2058546217 conn(0x7f150805bdf0 msgr2=0x7f15080642a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:35.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.755+0000 7f150e27b700 1 -- 172.21.15.133:0/2058546217 shutdown_connections 2021-01-03T13:07:35.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.755+0000 7f150e27b700 1 -- 172.21.15.133:0/2058546217 wait complete. 2021-01-03T13:07:35.765 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.1 2021-01-03T13:07:35.778 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:07:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.875+0000 7f2c86f6b700 1 Processor -- start 2021-01-03T13:07:35.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.875+0000 7f2c86f6b700 1 -- start start 2021-01-03T13:07:35.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c86f6b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c800b9f40 0x7f2c80146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c86f6b700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c800605f0 con 0x7f2c800b9b60 2021-01-03T13:07:35.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c86f6b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c800600b0 con 0x7f2c80146920 2021-01-03T13:07:35.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c86f6b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c800aed30 con 0x7f2c800b9f40 2021-01-03T13:07:35.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c8676a700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2c80146920 0x7f2c8014d500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:32996/0 (socket says 172.21.15.133:32996) 2021-01-03T13:07:35.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c8676a700 1 -- 172.21.15.133:0/1354170980 learned_addr learned my addr 172.21.15.133:0/1354170980 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:35.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c85768700 1 --2- 172.21.15.133:0/1354170980 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c800b9f40 0x7f2c80146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 -- 172.21.15.133:0/1354170980 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753496823 0 0) 0x7f2c800600b0 con 0x7f2c80146920 2021-01-03T13:07:35.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 -- 172.21.15.133:0/1354170980 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c68003230 con 0x7f2c80146920 2021-01-03T13:07:35.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 -- 172.21.15.133:0/1354170980 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2773284426 0 0) 0x7f2c68003230 con 0x7f2c80146920 2021-01-03T13:07:35.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 -- 172.21.15.133:0/1354170980 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c800b9f40 msgr2=0x7f2c80146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:35.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 --2- 172.21.15.133:0/1354170980 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c800b9f40 0x7f2c80146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 -- 172.21.15.133:0/1354170980 >> v1:172.21.15.16:6789/0 conn(0x7f2c800b9b60 legacy=0x7f2c800b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 -- 172.21.15.133:0/1354170980 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c80060350 con 0x7f2c80146920 2021-01-03T13:07:35.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 -- 172.21.15.133:0/1354170980 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f2c78001a50 con 0x7f2c80146920 2021-01-03T13:07:35.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 -- 172.21.15.133:0/1354170980 >> v1:172.21.15.133:6789/0 conn(0x7f2c80146920 legacy=0x7f2c8014d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 --2- 172.21.15.133:0/1354170980 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c800b9f40 0x7f2c68003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 --2- 172.21.15.133:0/1354170980 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c68003c10 0x7f2c680044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 --2- 172.21.15.133:0/1354170980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c680049c0 0x7f2c68004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 -- 172.21.15.133:0/1354170980 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c800aed30 con 0x7f2c68003c10 2021-01-03T13:07:35.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 -- 172.21.15.133:0/1354170980 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c68004130 con 0x7f2c680049c0 2021-01-03T13:07:35.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 -- 172.21.15.133:0/1354170980 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c680042f0 con 0x7f2c800b9f40 2021-01-03T13:07:35.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c8676a700 1 --2- 172.21.15.133:0/1354170980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c680049c0 0x7f2c68004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c85768700 1 --2- 172.21.15.133:0/1354170980 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c68003c10 0x7f2c680044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c85f69700 1 --2- 172.21.15.133:0/1354170980 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c800b9f40 0x7f2c68003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c8676a700 1 -- 172.21.15.133:0/1354170980 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c800b9f40 msgr2=0x7f2c68003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:35.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c8676a700 1 --2- 172.21.15.133:0/1354170980 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c800b9f40 0x7f2c68003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c8676a700 1 -- 172.21.15.133:0/1354170980 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c68003c10 msgr2=0x7f2c680044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:35.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c8676a700 1 --2- 172.21.15.133:0/1354170980 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c68003c10 0x7f2c680044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c8676a700 1 -- 172.21.15.133:0/1354170980 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c68003230 con 0x7f2c680049c0 2021-01-03T13:07:35.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c85768700 1 --2- 172.21.15.133:0/1354170980 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c68003c10 0x7f2c680044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:35.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c8676a700 1 --2- 172.21.15.133:0/1354170980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c680049c0 0x7f2c68004e40 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f2c78001760 tx=0x7f2c80142b90).ready entity=mon.1 client_cookie=14c1d5513030b501 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:35.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 -- 172.21.15.133:0/1354170980 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c78005b70 con 0x7f2c680049c0 2021-01-03T13:07:35.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 -- 172.21.15.133:0/1354170980 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c78005cd0 con 0x7f2c680049c0 2021-01-03T13:07:35.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c84f67700 1 -- 172.21.15.133:0/1354170980 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c780072c0 con 0x7f2c680049c0 2021-01-03T13:07:35.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c86f6b700 1 -- 172.21.15.133:0/1354170980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c680049c0 msgr2=0x7f2c68004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c86f6b700 1 --2- 172.21.15.133:0/1354170980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c680049c0 0x7f2c68004e40 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f2c78001760 tx=0x7f2c80142b90).stop 2021-01-03T13:07:35.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c8676a700 1 -- 172.21.15.133:0/1354170980 reap_dead start 2021-01-03T13:07:35.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c86f6b700 1 -- 172.21.15.133:0/1354170980 shutdown_connections 2021-01-03T13:07:35.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c86f6b700 1 -- 172.21.15.133:0/1354170980 >> 172.21.15.133:0/1354170980 conn(0x7f2c800b69e0 msgr2=0x7f2c800b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:35.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.879+0000 7f2c86f6b700 1 -- 172.21.15.133:0/1354170980 shutdown_connections 2021-01-03T13:07:35.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c86f6b700 1 -- 172.21.15.133:0/1354170980 wait complete. 2021-01-03T13:07:35.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c86f6b700 1 Processor -- start 2021-01-03T13:07:35.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c86f6b700 1 -- start start 2021-01-03T13:07:35.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c86f6b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c800b0c30 0x7f2c80142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c86f6b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c80143900 0x7f2c80142a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c86f6b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c800b3050 0x7f2c80141750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c86f6b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c80154d70 con 0x7f2c800b3050 2021-01-03T13:07:35.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c86f6b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c80154fa0 con 0x7f2c800b0c30 2021-01-03T13:07:35.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c86f6b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c80155240 con 0x7f2c80143900 2021-01-03T13:07:35.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c85f69700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c800b0c30 0x7f2c80142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c85f69700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c800b0c30 0x7f2c80142510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40204/0 (socket says 172.21.15.133:40204) 2021-01-03T13:07:35.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c85f69700 1 -- 172.21.15.133:0/2349370035 learned_addr learned my addr 172.21.15.133:0/2349370035 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:35.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c8676a700 1 --2- 172.21.15.133:0/2349370035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c800b3050 0x7f2c80141750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c85768700 1 --2- 172.21.15.133:0/2349370035 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c80143900 0x7f2c80142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c85f69700 1 -- 172.21.15.133:0/2349370035 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c80143900 msgr2=0x7f2c80142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c85f69700 1 --2- 172.21.15.133:0/2349370035 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c80143900 0x7f2c80142a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c85f69700 1 -- 172.21.15.133:0/2349370035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c800b3050 msgr2=0x7f2c80141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:35.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c85f69700 1 --2- 172.21.15.133:0/2349370035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c800b3050 0x7f2c80141750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:35.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c85f69700 1 -- 172.21.15.133:0/2349370035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c801554e0 con 0x7f2c800b0c30 2021-01-03T13:07:35.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c85f69700 1 --2- 172.21.15.133:0/2349370035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c800b0c30 0x7f2c80142510 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7f2c7c00b000 tx=0x7f2c7c009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:35.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c6effd700 1 -- 172.21.15.133:0/2349370035 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c7c001680 con 0x7f2c800b0c30 2021-01-03T13:07:35.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c6effd700 1 -- 172.21.15.133:0/2349370035 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7c010040 con 0x7f2c800b0c30 2021-01-03T13:07:35.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c86f6b700 1 -- 172.21.15.133:0/2349370035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c800b1010 con 0x7f2c800b0c30 2021-01-03T13:07:35.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c6effd700 1 -- 172.21.15.133:0/2349370035 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c7c0019d0 con 0x7f2c800b0c30 2021-01-03T13:07:35.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.883+0000 7f2c86f6b700 1 -- 172.21.15.133:0/2349370035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c80155b20 con 0x7f2c800b0c30 2021-01-03T13:07:35.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.887+0000 7f2c6effd700 1 -- 172.21.15.133:0/2349370035 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2c7c001b30 con 0x7f2c800b0c30 2021-01-03T13:07:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.887+0000 7f2c86f6b700 1 -- 172.21.15.133:0/2349370035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c80057300 con 0x7f2c800b0c30 2021-01-03T13:07:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.887+0000 7f2c6effd700 1 --2- 172.21.15.133:0/2349370035 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2c60055350 0x7f2c60057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.887+0000 7f2c6effd700 1 -- 172.21.15.133:0/2349370035 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2c7c06e170 con 0x7f2c800b0c30 2021-01-03T13:07:35.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.887+0000 7f2c85768700 1 --2- 172.21.15.133:0/2349370035 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2c60055350 0x7f2c60057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:35.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.887+0000 7f2c85768700 1 --2- 172.21.15.133:0/2349370035 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2c60055350 0x7f2c60057810 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f2c70008000 tx=0x7f2c70008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:35.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:35.895+0000 7f2c6effd700 1 -- 172.21.15.133:0/2349370035 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2c7c044470 con 0x7f2c800b0c30 2021-01-03T13:07:36.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.075+0000 7f2c86f6b700 1 -- 172.21.15.133:0/2349370035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c80067a00 con 0x7f2c800b0c30 2021-01-03T13:07:36.083 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.075+0000 7f2c6effd700 1 -- 172.21.15.133:0/2349370035 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+2501 (secure 0 0 0) 0x7f2c7c047a90 con 0x7f2c800b0c30 2021-01-03T13:07:36.083 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:36.084 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":72,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/3955382552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3955382552},{"type":"v1","addr":"172.21.15.16:6833","nonce":3955382552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6836/2756803911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2756803911},{"type":"v1","addr":"172.21.15.133:6836","nonce":2756803911}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:32.737122+0000","modified":"2021-01-03T13:07:34.405167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8167":{"gid":8167,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/3125642229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3125642229},{"type":"v1","addr":"172.21.15.133:6837","nonce":3125642229}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-01-03T13:07:36.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.079+0000 7f2c86f6b700 1 -- 172.21.15.133:0/2349370035 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2c60055350 msgr2=0x7f2c60057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:36.085 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.079+0000 7f2c86f6b700 1 --2- 172.21.15.133:0/2349370035 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2c60055350 0x7f2c60057810 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f2c70008000 tx=0x7f2c70008040).stop 2021-01-03T13:07:36.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.079+0000 7f2c86f6b700 1 -- 172.21.15.133:0/2349370035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c800b0c30 msgr2=0x7f2c80142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:36.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.079+0000 7f2c86f6b700 1 --2- 172.21.15.133:0/2349370035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c800b0c30 0x7f2c80142510 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7f2c7c00b000 tx=0x7f2c7c009040).stop 2021-01-03T13:07:36.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.079+0000 7f2c86f6b700 1 -- 172.21.15.133:0/2349370035 shutdown_connections 2021-01-03T13:07:36.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.079+0000 7f2c86f6b700 1 --2- 172.21.15.133:0/2349370035 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2c60055350 0x7f2c60057810 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.079+0000 7f2c86f6b700 1 --2- 172.21.15.133:0/2349370035 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2c800b3050 0x7f2c80141750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.079+0000 7f2c86f6b700 1 --2- 172.21.15.133:0/2349370035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2c800b0c30 0x7f2c80142510 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.079+0000 7f2c86f6b700 1 --2- 172.21.15.133:0/2349370035 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2c80143900 0x7f2c80142a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.079+0000 7f2c86f6b700 1 -- 172.21.15.133:0/2349370035 >> 172.21.15.133:0/2349370035 conn(0x7f2c800b69e0 msgr2=0x7f2c80062850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:36.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.079+0000 7f2c86f6b700 1 -- 172.21.15.133:0/2349370035 shutdown_connections 2021-01-03T13:07:36.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.079+0000 7f2c86f6b700 1 -- 172.21.15.133:0/2349370035 wait complete. 2021-01-03T13:07:36.088 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 72 2021-01-03T13:07:36.399 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:07:32.737122+0000', 'modified': '2021-01-03T13:07:34.405167+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8167}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8167': {'gid': 8167, 'name': 'c', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/3125642229', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 3125642229}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 3125642229}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:07:36.399 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:07:36.400 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T13:07:36.528 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":8167,"want_state":"up:active","state":"up:active","rank_uptime":3.7763052149999998,"mdsmap_epoch":72,"osdmap_epoch":152,"osdmap_epoch_barrier":152,"uptime":7.9999345420000001} 2021-01-03T13:07:36.529 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 8167, "mdsmap_epoch": 72, "osdmap_epoch": 152, "osdmap_epoch_barrier": 152, "rank_uptime": 3.776305215, "state": "up:active", "uptime": 7.999934542, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:07:36.529 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:07:36.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93cbfff700 1 Processor -- start 2021-01-03T13:07:36.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93cbfff700 1 -- start start 2021-01-03T13:07:36.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93cbfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f93cc0ab580 0x7f93cc13f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:36.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93cbfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93cc0b02b0 0x7f93cc0b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:36.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93cbfff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93cc0afd20 con 0x7f93cc0b5900 2021-01-03T13:07:36.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93cbfff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93cc0ab960 con 0x7f93cc0ab580 2021-01-03T13:07:36.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93cbfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93cc0aff50 con 0x7f93cc0b02b0 2021-01-03T13:07:36.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93ca7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f93cc0b5900 0x7f93cc13f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33014/0 (socket says 172.21.15.133:33014) 2021-01-03T13:07:36.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93ca7fc700 1 -- 172.21.15.133:0/1228689787 learned_addr learned my addr 172.21.15.133:0/1228689787 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:36.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93cb7fe700 1 --2- 172.21.15.133:0/1228689787 >> v2:172.21.15.133:3300/0 conn(0x7f93cc0b02b0 0x7f93cc0b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:36.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93caffd700 1 --2- 172.21.15.133:0/1228689787 >> v2:172.21.15.16:3300/0 conn(0x7f93cc0ab580 0x7f93cc13f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:36.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93c9ffb700 1 -- 172.21.15.133:0/1228689787 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481449055 0 0) 0x7f93cc0afd20 con 0x7f93cc0b5900 2021-01-03T13:07:36.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93c9ffb700 1 -- 172.21.15.133:0/1228689787 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93b0003230 con 0x7f93cc0b5900 2021-01-03T13:07:36.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93c9ffb700 1 -- 172.21.15.133:0/1228689787 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2132576803 0 0) 0x7f93b0003230 con 0x7f93cc0b5900 2021-01-03T13:07:36.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93c9ffb700 1 -- 172.21.15.133:0/1228689787 >> v2:172.21.15.133:3300/0 conn(0x7f93cc0b02b0 msgr2=0x7f93cc0b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:36.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93c9ffb700 1 --2- 172.21.15.133:0/1228689787 >> v2:172.21.15.133:3300/0 conn(0x7f93cc0b02b0 0x7f93cc0b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93c9ffb700 1 -- 172.21.15.133:0/1228689787 >> v2:172.21.15.16:3300/0 conn(0x7f93cc0ab580 msgr2=0x7f93cc13f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:36.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93c9ffb700 1 --2- 172.21.15.133:0/1228689787 >> v2:172.21.15.16:3300/0 conn(0x7f93cc0ab580 0x7f93cc13f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93c9ffb700 1 -- 172.21.15.133:0/1228689787 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc13fee0 con 0x7f93cc0b5900 2021-01-03T13:07:36.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.635+0000 7f93c9ffb700 1 -- 172.21.15.133:0/1228689787 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f93c00016d0 con 0x7f93cc0b5900 2021-01-03T13:07:36.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93c9ffb700 1 -- 172.21.15.133:0/1228689787 >> v1:172.21.15.133:6789/0 conn(0x7f93cc0b5900 legacy=0x7f93cc13f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:36.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93c9ffb700 1 --2- 172.21.15.133:0/1228689787 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93b0003720 0x7f93b0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:36.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93c9ffb700 1 --2- 172.21.15.133:0/1228689787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93b00044d0 0x7f93b0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:36.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93c9ffb700 1 --2- 172.21.15.133:0/1228689787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93b0004e40 0x7f93b000d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:36.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93c9ffb700 1 -- 172.21.15.133:0/1228689787 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0ab960 con 0x7f93b00044d0 2021-01-03T13:07:36.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93c9ffb700 1 -- 172.21.15.133:0/1228689787 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0aff50 con 0x7f93b0004e40 2021-01-03T13:07:36.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93c9ffb700 1 -- 172.21.15.133:0/1228689787 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b00042d0 con 0x7f93b0003720 2021-01-03T13:07:36.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93cb7fe700 1 --2- 172.21.15.133:0/1228689787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93b0004e40 0x7f93b000d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:36.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93ca7fc700 1 --2- 172.21.15.133:0/1228689787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93b00044d0 0x7f93b0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:36.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93caffd700 1 --2- 172.21.15.133:0/1228689787 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93b0003720 0x7f93b0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:36.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93cb7fe700 1 -- 172.21.15.133:0/1228689787 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93b0003720 msgr2=0x7f93b0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:36.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93cb7fe700 1 --2- 172.21.15.133:0/1228689787 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93b0003720 0x7f93b0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93cb7fe700 1 -- 172.21.15.133:0/1228689787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93b00044d0 msgr2=0x7f93b0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:36.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93cb7fe700 1 --2- 172.21.15.133:0/1228689787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93b00044d0 0x7f93b0004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93cb7fe700 1 -- 172.21.15.133:0/1228689787 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b0003230 con 0x7f93b0004e40 2021-01-03T13:07:36.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93ca7fc700 1 --2- 172.21.15.133:0/1228689787 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93b00044d0 0x7f93b0004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:36.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93cb7fe700 1 -- 172.21.15.133:0/1228689787 reap_dead start 2021-01-03T13:07:36.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93cb7fe700 1 --2- 172.21.15.133:0/1228689787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93b0004e40 0x7f93b000d930 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f93c400c000 tx=0x7f93c4008040).ready entity=mon.1 client_cookie=c81b347bc3bbbbf2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:36.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93c9ffb700 1 -- 172.21.15.133:0/1228689787 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93c400e970 con 0x7f93b0004e40 2021-01-03T13:07:36.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93c9ffb700 1 -- 172.21.15.133:0/1228689787 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c400ead0 con 0x7f93b0004e40 2021-01-03T13:07:36.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93c9ffb700 1 -- 172.21.15.133:0/1228689787 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93c400ee30 con 0x7f93b0004e40 2021-01-03T13:07:36.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93cbfff700 1 -- 172.21.15.133:0/1228689787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93b0004e40 msgr2=0x7f93b000d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:36.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93cbfff700 1 --2- 172.21.15.133:0/1228689787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93b0004e40 0x7f93b000d930 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f93c400c000 tx=0x7f93c4008040).stop 2021-01-03T13:07:36.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93cbfff700 1 -- 172.21.15.133:0/1228689787 shutdown_connections 2021-01-03T13:07:36.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93cbfff700 1 --2- 172.21.15.133:0/1228689787 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93b0004e40 0x7f93b000d930 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93cbfff700 1 -- 172.21.15.133:0/1228689787 >> 172.21.15.133:0/1228689787 conn(0x7f93cc05bdf0 msgr2=0x7f93cc05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:36.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93cbfff700 1 -- 172.21.15.133:0/1228689787 shutdown_connections 2021-01-03T13:07:36.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.639+0000 7f93cbfff700 1 -- 172.21.15.133:0/1228689787 wait complete. 2021-01-03T13:07:36.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93cbfff700 1 Processor -- start 2021-01-03T13:07:36.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93cbfff700 1 -- start start 2021-01-03T13:07:36.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93cbfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93b0004e40 0x7f93cc0adce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:36.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93cbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93cc0ac440 0x7f93cc13c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:36.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93cbfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93cc13c710 0x7f93cc0b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:36.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93cbfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0ad160 con 0x7f93b0004e40 2021-01-03T13:07:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93cbfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0aca60 con 0x7f93cc0ac440 2021-01-03T13:07:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93cbfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0ae5c0 con 0x7f93cc13c710 2021-01-03T13:07:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93ca7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93cc0ac440 0x7f93cc13c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93ca7fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93cc0ac440 0x7f93cc13c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40226/0 (socket says 172.21.15.133:40226) 2021-01-03T13:07:36.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93ca7fc700 1 -- 172.21.15.133:0/3925231884 learned_addr learned my addr 172.21.15.133:0/3925231884 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:36.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93caffd700 1 --2- 172.21.15.133:0/3925231884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93b0004e40 0x7f93cc0adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:36.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93cb7fe700 1 --2- 172.21.15.133:0/3925231884 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93cc13c710 0x7f93cc0b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:36.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93ca7fc700 1 -- 172.21.15.133:0/3925231884 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93cc13c710 msgr2=0x7f93cc0b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:36.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93ca7fc700 1 --2- 172.21.15.133:0/3925231884 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93cc13c710 0x7f93cc0b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93ca7fc700 1 -- 172.21.15.133:0/3925231884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93b0004e40 msgr2=0x7f93cc0adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:36.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93ca7fc700 1 --2- 172.21.15.133:0/3925231884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93b0004e40 0x7f93cc0adce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93ca7fc700 1 -- 172.21.15.133:0/3925231884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc0648f0 con 0x7f93cc0ac440 2021-01-03T13:07:36.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93ca7fc700 1 --2- 172.21.15.133:0/3925231884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93cc0ac440 0x7f93cc13c220 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f93c000d000 tx=0x7f93c00077c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:36.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93bbfff700 1 -- 172.21.15.133:0/3925231884 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93c000fe20 con 0x7f93cc0ac440 2021-01-03T13:07:36.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93bbfff700 1 -- 172.21.15.133:0/3925231884 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c0007e50 con 0x7f93cc0ac440 2021-01-03T13:07:36.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93cbfff700 1 -- 172.21.15.133:0/3925231884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93cc0b2570 con 0x7f93cc0ac440 2021-01-03T13:07:36.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93bbfff700 1 -- 172.21.15.133:0/3925231884 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93c0012540 con 0x7f93cc0ac440 2021-01-03T13:07:36.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93cbfff700 1 -- 172.21.15.133:0/3925231884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93cc0ad660 con 0x7f93cc0ac440 2021-01-03T13:07:36.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.643+0000 7f93cbfff700 1 -- 172.21.15.133:0/3925231884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93cc0acbd0 con 0x7f93cc0ac440 2021-01-03T13:07:36.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.647+0000 7f93bbfff700 1 -- 172.21.15.133:0/3925231884 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f93c001b030 con 0x7f93cc0ac440 2021-01-03T13:07:36.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.647+0000 7f93bbfff700 1 --2- 172.21.15.133:0/3925231884 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f93a8055440 0x7f93a8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:36.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.647+0000 7f93bbfff700 1 -- 172.21.15.133:0/3925231884 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f93c006dcb0 con 0x7f93cc0ac440 2021-01-03T13:07:36.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.647+0000 7f93caffd700 1 --2- 172.21.15.133:0/3925231884 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f93a8055440 0x7f93a8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:36.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.647+0000 7f93caffd700 1 --2- 172.21.15.133:0/3925231884 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f93a8055440 0x7f93a8057900 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f93bc00b000 tx=0x7f93bc0091a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:36.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.651+0000 7f93bbfff700 1 -- 172.21.15.133:0/3925231884 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f93cc0acbd0 con 0x7f93cc0ac440 2021-01-03T13:07:36.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.791+0000 7f93cbfff700 1 -- 172.21.15.133:0/3925231884 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93cc0ae420 con 0x7f93cc0ac440 2021-01-03T13:07:36.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.791+0000 7f93bbfff700 1 -- 172.21.15.133:0/3925231884 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f93cc0ae420 con 0x7f93cc0ac440 2021-01-03T13:07:36.800 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:36.800 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":152,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:32.736676+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:07:31.210499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-01-03T13:07:31.743590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:07:36.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.795+0000 7f93cbfff700 1 -- 172.21.15.133:0/3925231884 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f93a8055440 msgr2=0x7f93a8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:36.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.795+0000 7f93cbfff700 1 --2- 172.21.15.133:0/3925231884 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f93a8055440 0x7f93a8057900 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f93bc00b000 tx=0x7f93bc0091a0).stop 2021-01-03T13:07:36.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.795+0000 7f93cbfff700 1 -- 172.21.15.133:0/3925231884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93cc0ac440 msgr2=0x7f93cc13c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:36.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.795+0000 7f93cbfff700 1 --2- 172.21.15.133:0/3925231884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93cc0ac440 0x7f93cc13c220 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f93c000d000 tx=0x7f93c00077c0).stop 2021-01-03T13:07:36.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.795+0000 7f93cbfff700 1 -- 172.21.15.133:0/3925231884 shutdown_connections 2021-01-03T13:07:36.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.795+0000 7f93cbfff700 1 --2- 172.21.15.133:0/3925231884 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f93a8055440 0x7f93a8057900 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.795+0000 7f93cbfff700 1 --2- 172.21.15.133:0/3925231884 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93b0004e40 0x7f93cc0adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.795+0000 7f93cbfff700 1 --2- 172.21.15.133:0/3925231884 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f93cc13c710 0x7f93cc0b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.795+0000 7f93cbfff700 1 --2- 172.21.15.133:0/3925231884 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93cc0ac440 0x7f93cc13c220 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.795+0000 7f93cbfff700 1 -- 172.21.15.133:0/3925231884 >> 172.21.15.133:0/3925231884 conn(0x7f93cc05bdf0 msgr2=0x7f93cc141d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:36.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.795+0000 7f93cbfff700 1 -- 172.21.15.133:0/3925231884 shutdown_connections 2021-01-03T13:07:36.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.795+0000 7f93cbfff700 1 -- 172.21.15.133:0/3925231884 wait complete. 2021-01-03T13:07:36.820 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:07:31.210499+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:07:31.743590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:07:36.821 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:07:36.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.931+0000 7fdb01eee700 1 Processor -- start 2021-01-03T13:07:36.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb01eee700 1 -- start start 2021-01-03T13:07:36.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb01eee700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdafc0b4c20 0x7fdafc05c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:36.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb01eee700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdafc060510 0x7fdafc0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:36.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb01eee700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdafc05fd10 0x7fdafc0b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:36.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb01eee700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdafc05bf00 con 0x7fdafc060510 2021-01-03T13:07:36.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb01eee700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdafc05c1a0 con 0x7fdafc0b4c20 2021-01-03T13:07:36.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb01eee700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc05c440 con 0x7fdafc05fd10 2021-01-03T13:07:36.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb00eec700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdafc0b4c20 0x7fdafc05c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:36.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb00eec700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdafc0b4c20 0x7fdafc05c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40232/0 (socket says 172.21.15.133:40232) 2021-01-03T13:07:36.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb00eec700 1 -- 172.21.15.133:0/3422721501 learned_addr learned my addr 172.21.15.133:0/3422721501 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:36.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb016ed700 1 --2- 172.21.15.133:0/3422721501 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdafc05fd10 0x7fdafc0b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:36.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdafbfff700 1 --2- 172.21.15.133:0/3422721501 >> v2:172.21.15.16:3300/0 conn(0x7fdafc060510 0x7fdafc0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:36.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb00eec700 1 -- 172.21.15.133:0/3422721501 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdafc05fd10 msgr2=0x7fdafc0b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:36.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb00eec700 1 --2- 172.21.15.133:0/3422721501 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdafc05fd10 0x7fdafc0b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb00eec700 1 -- 172.21.15.133:0/3422721501 >> v2:172.21.15.16:3300/0 conn(0x7fdafc060510 msgr2=0x7fdafc0b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:36.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb00eec700 1 --2- 172.21.15.133:0/3422721501 >> v2:172.21.15.16:3300/0 conn(0x7fdafc060510 0x7fdafc0b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb00eec700 1 -- 172.21.15.133:0/3422721501 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc0b54f0 con 0x7fdafc0b4c20 2021-01-03T13:07:36.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb016ed700 1 --2- 172.21.15.133:0/3422721501 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdafc05fd10 0x7fdafc0b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:36.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb00eec700 1 --2- 172.21.15.133:0/3422721501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdafc0b4c20 0x7fdafc05c8e0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7fdaec002f30 tx=0x7fdaec006e80).ready entity=mon.1 client_cookie=d062c344467be58b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:36.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdafb7fe700 1 -- 172.21.15.133:0/3422721501 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaec0097f0 con 0x7fdafc0b4c20 2021-01-03T13:07:36.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdafb7fe700 1 -- 172.21.15.133:0/3422721501 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec009950 con 0x7fdafc0b4c20 2021-01-03T13:07:36.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdafb7fe700 1 -- 172.21.15.133:0/3422721501 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaec009cb0 con 0x7fdafc0b4c20 2021-01-03T13:07:36.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb01eee700 1 -- 172.21.15.133:0/3422721501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdafc0b4c20 msgr2=0x7fdafc05c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:36.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb01eee700 1 --2- 172.21.15.133:0/3422721501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdafc0b4c20 0x7fdafc05c8e0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7fdaec002f30 tx=0x7fdaec006e80).stop 2021-01-03T13:07:36.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb01eee700 1 -- 172.21.15.133:0/3422721501 shutdown_connections 2021-01-03T13:07:36.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb01eee700 1 --2- 172.21.15.133:0/3422721501 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdafc05fd10 0x7fdafc0b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb01eee700 1 --2- 172.21.15.133:0/3422721501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdafc0b4c20 0x7fdafc05c8e0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb01eee700 1 --2- 172.21.15.133:0/3422721501 >> v2:172.21.15.16:3300/0 conn(0x7fdafc060510 0x7fdafc0b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb01eee700 1 -- 172.21.15.133:0/3422721501 >> 172.21.15.133:0/3422721501 conn(0x7fdafc0b9f00 msgr2=0x7fdafc0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:36.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb01eee700 1 -- 172.21.15.133:0/3422721501 shutdown_connections 2021-01-03T13:07:36.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.935+0000 7fdb01eee700 1 -- 172.21.15.133:0/3422721501 wait complete. 2021-01-03T13:07:36.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.939+0000 7fdb01eee700 1 Processor -- start 2021-01-03T13:07:36.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.939+0000 7fdb01eee700 1 -- start start 2021-01-03T13:07:36.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.939+0000 7fdb01eee700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdafc05fd10 0x7fdafc09e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:36.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.939+0000 7fdb01eee700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdafc060510 0x7fdafc151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:36.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.939+0000 7fdb01eee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdafc0b4c20 0x7fdafc151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:36.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.939+0000 7fdb01eee700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0b3a70 con 0x7fdafc060510 2021-01-03T13:07:36.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.939+0000 7fdb01eee700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0b33a0 con 0x7fdafc0b4c20 2021-01-03T13:07:36.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.939+0000 7fdb01eee700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc155b20 con 0x7fdafc05fd10 2021-01-03T13:07:36.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.939+0000 7fdb016ed700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdafc0b4c20 0x7fdafc151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:36.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.939+0000 7fdb016ed700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdafc0b4c20 0x7fdafc151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40238/0 (socket says 172.21.15.133:40238) 2021-01-03T13:07:36.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.939+0000 7fdb016ed700 1 -- 172.21.15.133:0/4227317768 learned_addr learned my addr 172.21.15.133:0/4227317768 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:36.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.939+0000 7fdafbfff700 1 --2- 172.21.15.133:0/4227317768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdafc060510 0x7fdafc151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:36.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.939+0000 7fdb00eec700 1 --2- 172.21.15.133:0/4227317768 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdafc05fd10 0x7fdafc09e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:36.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdb016ed700 1 -- 172.21.15.133:0/4227317768 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdafc05fd10 msgr2=0x7fdafc09e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:36.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdb016ed700 1 --2- 172.21.15.133:0/4227317768 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdafc05fd10 0x7fdafc09e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdb016ed700 1 -- 172.21.15.133:0/4227317768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdafc060510 msgr2=0x7fdafc151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:36.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdb016ed700 1 --2- 172.21.15.133:0/4227317768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdafc060510 0x7fdafc151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:36.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdb016ed700 1 -- 172.21.15.133:0/4227317768 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc155dc0 con 0x7fdafc0b4c20 2021-01-03T13:07:36.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdafbfff700 1 --2- 172.21.15.133:0/4227317768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdafc060510 0x7fdafc151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:36.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdb016ed700 1 --2- 172.21.15.133:0/4227317768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdafc0b4c20 0x7fdafc151fd0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7fdafc142820 tx=0x7fdaf4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:36.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdaf9ffb700 1 -- 172.21.15.133:0/4227317768 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaf400c920 con 0x7fdafc0b4c20 2021-01-03T13:07:36.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdaf9ffb700 1 -- 172.21.15.133:0/4227317768 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf400ca80 con 0x7fdafc0b4c20 2021-01-03T13:07:36.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdaf9ffb700 1 -- 172.21.15.133:0/4227317768 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaf400cde0 con 0x7fdafc0b4c20 2021-01-03T13:07:36.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdb01eee700 1 -- 172.21.15.133:0/4227317768 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdafc0b35d0 con 0x7fdafc0b4c20 2021-01-03T13:07:36.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdb01eee700 1 -- 172.21.15.133:0/4227317768 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdafc1524c0 con 0x7fdafc0b4c20 2021-01-03T13:07:36.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdb01eee700 1 -- 172.21.15.133:0/4227317768 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdafc155f50 con 0x7fdafc0b4c20 2021-01-03T13:07:36.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdaf9ffb700 1 -- 172.21.15.133:0/4227317768 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fdaf401d460 con 0x7fdafc0b4c20 2021-01-03T13:07:36.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdaf9ffb700 1 --2- 172.21.15.133:0/4227317768 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdae0055440 0x7fdae0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:36.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdaf9ffb700 1 -- 172.21.15.133:0/4227317768 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdaf406e520 con 0x7fdafc0b4c20 2021-01-03T13:07:36.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdb00eec700 1 --2- 172.21.15.133:0/4227317768 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdae0055440 0x7fdae0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:36.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.943+0000 7fdb00eec700 1 --2- 172.21.15.133:0/4227317768 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdae0055440 0x7fdae0057900 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fdaec01a000 tx=0x7fdaec015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:36.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:36.951+0000 7fdaf9ffb700 1 -- 172.21.15.133:0/4227317768 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdafc155f50 con 0x7fdafc0b4c20 2021-01-03T13:07:37.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.091+0000 7fdb01eee700 1 -- 172.21.15.133:0/4227317768 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdafc155f50 con 0x7fdafc0b4c20 2021-01-03T13:07:37.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.095+0000 7fdaf9ffb700 1 -- 172.21.15.133:0/4227317768 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v152) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdafc155f50 con 0x7fdafc0b4c20 2021-01-03T13:07:37.100 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:07:37.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.095+0000 7fdb01eee700 1 -- 172.21.15.133:0/4227317768 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdae0055440 msgr2=0x7fdae0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.095+0000 7fdb01eee700 1 --2- 172.21.15.133:0/4227317768 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdae0055440 0x7fdae0057900 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fdaec01a000 tx=0x7fdaec015000).stop 2021-01-03T13:07:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.095+0000 7fdb01eee700 1 -- 172.21.15.133:0/4227317768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdafc0b4c20 msgr2=0x7fdafc151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.095+0000 7fdb01eee700 1 --2- 172.21.15.133:0/4227317768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdafc0b4c20 0x7fdafc151fd0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7fdafc142820 tx=0x7fdaf4008040).stop 2021-01-03T13:07:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.095+0000 7fdb01eee700 1 -- 172.21.15.133:0/4227317768 shutdown_connections 2021-01-03T13:07:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.095+0000 7fdb01eee700 1 --2- 172.21.15.133:0/4227317768 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdae0055440 0x7fdae0057900 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.095+0000 7fdb01eee700 1 --2- 172.21.15.133:0/4227317768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdafc0b4c20 0x7fdafc151fd0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.095+0000 7fdb01eee700 1 --2- 172.21.15.133:0/4227317768 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fdafc05fd10 0x7fdafc09e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.095+0000 7fdb01eee700 1 --2- 172.21.15.133:0/4227317768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdafc060510 0x7fdafc151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.095+0000 7fdb01eee700 1 -- 172.21.15.133:0/4227317768 >> 172.21.15.133:0/4227317768 conn(0x7fdafc0b9f00 msgr2=0x7fdafc0ae430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:37.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.095+0000 7fdb01eee700 1 -- 172.21.15.133:0/4227317768 shutdown_connections 2021-01-03T13:07:37.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.095+0000 7fdb01eee700 1 -- 172.21.15.133:0/4227317768 wait complete. 2021-01-03T13:07:37.114 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:07:37.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.219+0000 7f3b17fff700 1 Processor -- start 2021-01-03T13:07:37.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.219+0000 7f3b17fff700 1 -- start start 2021-01-03T13:07:37.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.219+0000 7f3b17fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3b180b3670 0x7f3b180b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:37.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.219+0000 7f3b17fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b180ac200 con 0x7f3b180b7910 2021-01-03T13:07:37.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.219+0000 7f3b17fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b180ac430 con 0x7f3b180b1f30 2021-01-03T13:07:37.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.219+0000 7f3b17fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b180ad720 con 0x7f3b180b3670 2021-01-03T13:07:37.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b177fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3b180b1f30 0x7f3b180b2ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33050/0 (socket says 172.21.15.133:33050) 2021-01-03T13:07:37.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b177fe700 1 -- 172.21.15.133:0/4172691675 learned_addr learned my addr 172.21.15.133:0/4172691675 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:37.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b167fc700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3b180b3670 0x7f3b180b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:37.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b167fc700 1 -- 172.21.15.133:0/4172691675 >> v1:172.21.15.133:6789/0 conn(0x7f3b180b1f30 legacy=0x7f3b180b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b167fc700 1 -- 172.21.15.133:0/4172691675 >> v1:172.21.15.16:6789/0 conn(0x7f3b180b7910 legacy=0x7f3b1813e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b167fc700 1 -- 172.21.15.133:0/4172691675 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b180ac6d0 con 0x7f3b180b3670 2021-01-03T13:07:37.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b167fc700 1 --2- 172.21.15.133:0/4172691675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b180b3670 0x7f3b180b7cf0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f3b08002f30 tx=0x7f3b08006d60).ready entity=mon.1 client_cookie=773c2cc5c25005c9 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:37.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b15ffb700 1 -- 172.21.15.133:0/4172691675 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b080097f0 con 0x7f3b180b3670 2021-01-03T13:07:37.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b15ffb700 1 -- 172.21.15.133:0/4172691675 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b08009950 con 0x7f3b180b3670 2021-01-03T13:07:37.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b15ffb700 1 -- 172.21.15.133:0/4172691675 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b08009ac0 con 0x7f3b180b3670 2021-01-03T13:07:37.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b17fff700 1 -- 172.21.15.133:0/4172691675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b180b3670 msgr2=0x7f3b180b7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b17fff700 1 --2- 172.21.15.133:0/4172691675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b180b3670 0x7f3b180b7cf0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f3b08002f30 tx=0x7f3b08006d60).stop 2021-01-03T13:07:37.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b17fff700 1 -- 172.21.15.133:0/4172691675 shutdown_connections 2021-01-03T13:07:37.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b17fff700 1 --2- 172.21.15.133:0/4172691675 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b180b3670 0x7f3b180b7cf0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b17fff700 1 -- 172.21.15.133:0/4172691675 >> 172.21.15.133:0/4172691675 conn(0x7f3b1805c8c0 msgr2=0x7f3b180b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:37.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b17fff700 1 -- 172.21.15.133:0/4172691675 shutdown_connections 2021-01-03T13:07:37.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b17fff700 1 -- 172.21.15.133:0/4172691675 wait complete. 2021-01-03T13:07:37.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b17fff700 1 Processor -- start 2021-01-03T13:07:37.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.223+0000 7f3b17fff700 1 -- start start 2021-01-03T13:07:37.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b17fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b180b1f30 0x7f3b181383f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:37.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b17fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3b180b3670 0x7f3b18153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:37.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b17fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b180b7910 0x7f3b18153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:37.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b17fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18138de0 con 0x7f3b180b1f30 2021-01-03T13:07:37.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b17fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18153110 con 0x7f3b180b7910 2021-01-03T13:07:37.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b17fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18064af0 con 0x7f3b180b3670 2021-01-03T13:07:37.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b177fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b180b7910 0x7f3b18153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:37.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b177fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b180b7910 0x7f3b18153a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40256/0 (socket says 172.21.15.133:40256) 2021-01-03T13:07:37.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b177fe700 1 -- 172.21.15.133:0/3047757587 learned_addr learned my addr 172.21.15.133:0/3047757587 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:37.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b16ffd700 1 --2- 172.21.15.133:0/3047757587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b180b1f30 0x7f3b181383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:37.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b167fc700 1 --2- 172.21.15.133:0/3047757587 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3b180b3670 0x7f3b18153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:37.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b177fe700 1 -- 172.21.15.133:0/3047757587 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3b180b3670 msgr2=0x7f3b18153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b177fe700 1 --2- 172.21.15.133:0/3047757587 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3b180b3670 0x7f3b18153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b177fe700 1 -- 172.21.15.133:0/3047757587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b180b1f30 msgr2=0x7f3b181383f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b177fe700 1 --2- 172.21.15.133:0/3047757587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b180b1f30 0x7f3b181383f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b177fe700 1 -- 172.21.15.133:0/3047757587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b18064d90 con 0x7f3b180b7910 2021-01-03T13:07:37.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b16ffd700 1 --2- 172.21.15.133:0/3047757587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b180b1f30 0x7f3b181383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:37.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b177fe700 1 --2- 172.21.15.133:0/3047757587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b180b7910 0x7f3b18153a60 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f3b10001360 tx=0x7f3b10007f50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:37.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b0ffff700 1 -- 172.21.15.133:0/3047757587 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b10005b70 con 0x7f3b180b7910 2021-01-03T13:07:37.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b0ffff700 1 -- 172.21.15.133:0/3047757587 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b10005cd0 con 0x7f3b180b7910 2021-01-03T13:07:37.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b0ffff700 1 -- 172.21.15.133:0/3047757587 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b10007300 con 0x7f3b180b7910 2021-01-03T13:07:37.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b17fff700 1 -- 172.21.15.133:0/3047757587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1813a890 con 0x7f3b180b7910 2021-01-03T13:07:37.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.227+0000 7f3b17fff700 1 -- 172.21.15.133:0/3047757587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b18153f50 con 0x7f3b180b7910 2021-01-03T13:07:37.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.231+0000 7f3b17fff700 1 -- 172.21.15.133:0/3047757587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1813aef0 con 0x7f3b180b7910 2021-01-03T13:07:37.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.231+0000 7f3b0ffff700 1 -- 172.21.15.133:0/3047757587 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3b10010030 con 0x7f3b180b7910 2021-01-03T13:07:37.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.231+0000 7f3b0ffff700 1 --2- 172.21.15.133:0/3047757587 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3afc055350 0x7f3afc057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:37.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.231+0000 7f3b0ffff700 1 -- 172.21.15.133:0/3047757587 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3b1006dfb0 con 0x7f3b180b7910 2021-01-03T13:07:37.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.231+0000 7f3b16ffd700 1 --2- 172.21.15.133:0/3047757587 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3afc055350 0x7f3afc057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:37.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.231+0000 7f3b16ffd700 1 --2- 172.21.15.133:0/3047757587 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3afc055350 0x7f3afc057810 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f3b0000b000 tx=0x7f3b00009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:37.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.235+0000 7f3b0ffff700 1 -- 172.21.15.133:0/3047757587 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3b100441a0 con 0x7f3b180b7910 2021-01-03T13:07:37.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.379+0000 7f3b17fff700 1 -- 172.21.15.133:0/3047757587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3b18057300 con 0x7f3b180b7910 2021-01-03T13:07:37.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.379+0000 7f3b0ffff700 1 -- 172.21.15.133:0/3047757587 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v152) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3b100477c0 con 0x7f3b180b7910 2021-01-03T13:07:37.386 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:37.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.383+0000 7f3b17fff700 1 -- 172.21.15.133:0/3047757587 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3afc055350 msgr2=0x7f3afc057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.383+0000 7f3b17fff700 1 --2- 172.21.15.133:0/3047757587 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3afc055350 0x7f3afc057810 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f3b0000b000 tx=0x7f3b00009040).stop 2021-01-03T13:07:37.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.383+0000 7f3b17fff700 1 -- 172.21.15.133:0/3047757587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b180b7910 msgr2=0x7f3b18153a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.383+0000 7f3b17fff700 1 --2- 172.21.15.133:0/3047757587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b180b7910 0x7f3b18153a60 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f3b10001360 tx=0x7f3b10007f50).stop 2021-01-03T13:07:37.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.383+0000 7f3b17fff700 1 -- 172.21.15.133:0/3047757587 shutdown_connections 2021-01-03T13:07:37.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.383+0000 7f3b17fff700 1 --2- 172.21.15.133:0/3047757587 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3afc055350 0x7f3afc057810 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.383+0000 7f3b17fff700 1 --2- 172.21.15.133:0/3047757587 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3b180b1f30 0x7f3b181383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.383+0000 7f3b17fff700 1 --2- 172.21.15.133:0/3047757587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b180b7910 0x7f3b18153a60 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.383+0000 7f3b17fff700 1 --2- 172.21.15.133:0/3047757587 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3b180b3670 0x7f3b18153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.383+0000 7f3b17fff700 1 -- 172.21.15.133:0/3047757587 >> 172.21.15.133:0/3047757587 conn(0x7f3b1805c8c0 msgr2=0x7f3b180b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:37.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.383+0000 7f3b17fff700 1 -- 172.21.15.133:0/3047757587 shutdown_connections 2021-01-03T13:07:37.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.383+0000 7f3b17fff700 1 -- 172.21.15.133:0/3047757587 wait complete. 2021-01-03T13:07:37.405 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:07:37.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.507+0000 7f8e3bfff700 1 Processor -- start 2021-01-03T13:07:37.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.507+0000 7f8e3bfff700 1 -- start start 2021-01-03T13:07:37.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.507+0000 7f8e3bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8e3c0b9b60 0x7f8e3c0b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:37.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.507+0000 7f8e3bfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8e3c0b4980 0x7f8e3c0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:37.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.507+0000 7f8e3bfff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3c0605f0 con 0x7f8e3c146430 2021-01-03T13:07:37.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.507+0000 7f8e3bfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3c0aed30 con 0x7f8e3c0b9b60 2021-01-03T13:07:37.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.507+0000 7f8e3bfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c146fd0 con 0x7f8e3c0b4980 2021-01-03T13:07:37.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.507+0000 7f8e3b7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8e3c146430 0x7f8e3c1468c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33064/0 (socket says 172.21.15.133:33064) 2021-01-03T13:07:37.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e3b7fe700 1 -- 172.21.15.133:0/607754942 learned_addr learned my addr 172.21.15.133:0/607754942 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:37.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.507+0000 7f8e3affd700 1 --2- 172.21.15.133:0/607754942 >> v2:172.21.15.133:3300/0 conn(0x7f8e3c0b9b60 0x7f8e3c0b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:37.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e3a7fc700 1 --2- 172.21.15.133:0/607754942 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8e3c0b4980 0x7f8e3c0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:37.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e39ffb700 1 -- 172.21.15.133:0/607754942 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213006900 0 0) 0x7f8e3c0605f0 con 0x7f8e3c146430 2021-01-03T13:07:37.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e39ffb700 1 -- 172.21.15.133:0/607754942 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e1c003230 con 0x7f8e3c146430 2021-01-03T13:07:37.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e3affd700 1 -- 172.21.15.133:0/607754942 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8e3c0b4980 msgr2=0x7f8e3c0b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e3affd700 1 --2- 172.21.15.133:0/607754942 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8e3c0b4980 0x7f8e3c0b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e3affd700 1 -- 172.21.15.133:0/607754942 >> v1:172.21.15.133:6789/0 conn(0x7f8e3c146430 legacy=0x7f8e3c1468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e3affd700 1 -- 172.21.15.133:0/607754942 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c0600b0 con 0x7f8e3c0b9b60 2021-01-03T13:07:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e3affd700 1 --2- 172.21.15.133:0/607754942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e3c0b9b60 0x7f8e3c0b9f40 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f8e24002f30 tx=0x7f8e24006dc0).ready entity=mon.1 client_cookie=9a72dd8aec949526 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e39ffb700 1 -- 172.21.15.133:0/607754942 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e240096a0 con 0x7f8e3c0b9b60 2021-01-03T13:07:37.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e39ffb700 1 -- 172.21.15.133:0/607754942 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e24009800 con 0x7f8e3c0b9b60 2021-01-03T13:07:37.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e39ffb700 1 -- 172.21.15.133:0/607754942 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e24009b60 con 0x7f8e3c0b9b60 2021-01-03T13:07:37.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e3bfff700 1 -- 172.21.15.133:0/607754942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e3c0b9b60 msgr2=0x7f8e3c0b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e3bfff700 1 --2- 172.21.15.133:0/607754942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e3c0b9b60 0x7f8e3c0b9f40 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f8e24002f30 tx=0x7f8e24006dc0).stop 2021-01-03T13:07:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e3bfff700 1 -- 172.21.15.133:0/607754942 shutdown_connections 2021-01-03T13:07:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e3bfff700 1 --2- 172.21.15.133:0/607754942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e3c0b9b60 0x7f8e3c0b9f40 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e3bfff700 1 --2- 172.21.15.133:0/607754942 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8e3c0b4980 0x7f8e3c0b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e3bfff700 1 -- 172.21.15.133:0/607754942 >> 172.21.15.133:0/607754942 conn(0x7f8e3c0b69e0 msgr2=0x7f8e3c0b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e3bfff700 1 -- 172.21.15.133:0/607754942 shutdown_connections 2021-01-03T13:07:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e3bfff700 1 -- 172.21.15.133:0/607754942 wait complete. 2021-01-03T13:07:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e3bfff700 1 Processor -- start 2021-01-03T13:07:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.511+0000 7f8e3bfff700 1 -- start start 2021-01-03T13:07:37.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3bfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8e3c0b4980 0x7f8e3c149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:37.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e3c0b9b60 0x7f8e3c1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:37.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e3c146430 0x7f8e3c155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:37.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3bfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c140ad0 con 0x7f8e3c0b9b60 2021-01-03T13:07:37.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3bfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c140d70 con 0x7f8e3c146430 2021-01-03T13:07:37.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3bfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3c141010 con 0x7f8e3c0b4980 2021-01-03T13:07:37.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e3c146430 0x7f8e3c155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:37.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e3c146430 0x7f8e3c155590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40270/0 (socket says 172.21.15.133:40270) 2021-01-03T13:07:37.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3b7fe700 1 -- 172.21.15.133:0/2024356693 learned_addr learned my addr 172.21.15.133:0/2024356693 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:37.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3a7fc700 1 --2- 172.21.15.133:0/2024356693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e3c0b9b60 0x7f8e3c1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:37.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3affd700 1 --2- 172.21.15.133:0/2024356693 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8e3c0b4980 0x7f8e3c149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:37.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3b7fe700 1 -- 172.21.15.133:0/2024356693 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8e3c0b4980 msgr2=0x7f8e3c149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3b7fe700 1 --2- 172.21.15.133:0/2024356693 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8e3c0b4980 0x7f8e3c149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3b7fe700 1 -- 172.21.15.133:0/2024356693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e3c0b9b60 msgr2=0x7f8e3c1550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3b7fe700 1 --2- 172.21.15.133:0/2024356693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e3c0b9b60 0x7f8e3c1550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3b7fe700 1 -- 172.21.15.133:0/2024356693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c149ea0 con 0x7f8e3c146430 2021-01-03T13:07:37.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3b7fe700 1 --2- 172.21.15.133:0/2024356693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e3c146430 0x7f8e3c155590 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f8e34001450 tx=0x7f8e34007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:37.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e33fff700 1 -- 172.21.15.133:0/2024356693 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e3400cea0 con 0x7f8e3c146430 2021-01-03T13:07:37.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e33fff700 1 -- 172.21.15.133:0/2024356693 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e34005b70 con 0x7f8e3c146430 2021-01-03T13:07:37.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3bfff700 1 -- 172.21.15.133:0/2024356693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3c155a80 con 0x7f8e3c146430 2021-01-03T13:07:37.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e33fff700 1 -- 172.21.15.133:0/2024356693 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e34007110 con 0x7f8e3c146430 2021-01-03T13:07:37.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3bfff700 1 -- 172.21.15.133:0/2024356693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3c0b1e50 con 0x7f8e3c146430 2021-01-03T13:07:37.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.515+0000 7f8e3bfff700 1 -- 172.21.15.133:0/2024356693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3c1411d0 con 0x7f8e3c146430 2021-01-03T13:07:37.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.519+0000 7f8e33fff700 1 -- 172.21.15.133:0/2024356693 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8e34010030 con 0x7f8e3c146430 2021-01-03T13:07:37.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.519+0000 7f8e33fff700 1 --2- 172.21.15.133:0/2024356693 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8e20055330 0x7f8e200577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:37.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.519+0000 7f8e33fff700 1 -- 172.21.15.133:0/2024356693 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8e3406dff0 con 0x7f8e3c146430 2021-01-03T13:07:37.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.519+0000 7f8e3affd700 1 --2- 172.21.15.133:0/2024356693 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8e20055330 0x7f8e200577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:37.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.519+0000 7f8e3affd700 1 --2- 172.21.15.133:0/2024356693 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8e20055330 0x7f8e200577f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f8e24019000 tx=0x7f8e24015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:37.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.527+0000 7f8e33fff700 1 -- 172.21.15.133:0/2024356693 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8e34044240 con 0x7f8e3c146430 2021-01-03T13:07:37.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.663+0000 7f8e3bfff700 1 -- 172.21.15.133:0/2024356693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e3c057300 con 0x7f8e3c146430 2021-01-03T13:07:37.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.663+0000 7f8e33fff700 1 -- 172.21.15.133:0/2024356693 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v152) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8e34047860 con 0x7f8e3c146430 2021-01-03T13:07:37.670 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:37.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.663+0000 7f8e3bfff700 1 -- 172.21.15.133:0/2024356693 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8e20055330 msgr2=0x7f8e200577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.663+0000 7f8e3bfff700 1 --2- 172.21.15.133:0/2024356693 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8e20055330 0x7f8e200577f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f8e24019000 tx=0x7f8e24015000).stop 2021-01-03T13:07:37.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.663+0000 7f8e3bfff700 1 -- 172.21.15.133:0/2024356693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e3c146430 msgr2=0x7f8e3c155590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.663+0000 7f8e3bfff700 1 --2- 172.21.15.133:0/2024356693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e3c146430 0x7f8e3c155590 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f8e34001450 tx=0x7f8e34007dd0).stop 2021-01-03T13:07:37.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.663+0000 7f8e3bfff700 1 -- 172.21.15.133:0/2024356693 shutdown_connections 2021-01-03T13:07:37.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.663+0000 7f8e3bfff700 1 --2- 172.21.15.133:0/2024356693 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8e20055330 0x7f8e200577f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.663+0000 7f8e3bfff700 1 --2- 172.21.15.133:0/2024356693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8e3c146430 0x7f8e3c155590 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.663+0000 7f8e3bfff700 1 --2- 172.21.15.133:0/2024356693 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f8e3c0b4980 0x7f8e3c149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.663+0000 7f8e3bfff700 1 --2- 172.21.15.133:0/2024356693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8e3c0b9b60 0x7f8e3c1550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.663+0000 7f8e3bfff700 1 -- 172.21.15.133:0/2024356693 >> 172.21.15.133:0/2024356693 conn(0x7f8e3c0b69e0 msgr2=0x7f8e3c0b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:37.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.663+0000 7f8e3bfff700 1 -- 172.21.15.133:0/2024356693 shutdown_connections 2021-01-03T13:07:37.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.667+0000 7f8e3bfff700 1 -- 172.21.15.133:0/2024356693 wait complete. 2021-01-03T13:07:37.683 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:07:37.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.795+0000 7fd0e8e11700 1 Processor -- start 2021-01-03T13:07:37.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e8e11700 1 -- start start 2021-01-03T13:07:37.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e8e11700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd0e40b5330 0x7fd0e4141630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:37.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e8e11700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd0e40b5ae0 0x7fd0e4144930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:37.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e8e11700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e40b5710 con 0x7fd0e40aec00 2021-01-03T13:07:37.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e8e11700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e40b16b0 con 0x7fd0e40b5ae0 2021-01-03T13:07:37.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e8e11700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e4140a60 con 0x7fd0e40b5330 2021-01-03T13:07:37.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd0e40b5ae0 0x7fd0e4144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:37.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd0e40b5ae0 0x7fd0e4144930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40276/0 (socket says 172.21.15.133:40276) 2021-01-03T13:07:37.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e2ffd700 1 -- 172.21.15.133:0/3375797138 learned_addr learned my addr 172.21.15.133:0/3375797138 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:37.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e37fe700 1 --2- 172.21.15.133:0/3375797138 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd0e40b5330 0x7fd0e4141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:37.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e2ffd700 1 -- 172.21.15.133:0/3375797138 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd0e40b5330 msgr2=0x7fd0e4141630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:37.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e2ffd700 1 --2- 172.21.15.133:0/3375797138 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd0e40b5330 0x7fd0e4141630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e2ffd700 1 -- 172.21.15.133:0/3375797138 >> v1:172.21.15.133:6789/0 conn(0x7fd0e40aec00 legacy=0x7fd0e40af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e2ffd700 1 -- 172.21.15.133:0/3375797138 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e4140c50 con 0x7fd0e40b5ae0 2021-01-03T13:07:37.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e37fe700 1 --2- 172.21.15.133:0/3375797138 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd0e40b5330 0x7fd0e4141630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:37.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e2ffd700 1 --2- 172.21.15.133:0/3375797138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e40b5ae0 0x7fd0e4144930 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7fd0cc002f30 tx=0x7fd0cc006e80).ready entity=mon.1 client_cookie=43b9eb8db748cb78 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:37.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e27fc700 1 -- 172.21.15.133:0/3375797138 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0cc0097f0 con 0x7fd0e40b5ae0 2021-01-03T13:07:37.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e27fc700 1 -- 172.21.15.133:0/3375797138 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0cc009950 con 0x7fd0e40b5ae0 2021-01-03T13:07:37.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e27fc700 1 -- 172.21.15.133:0/3375797138 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0cc009cb0 con 0x7fd0e40b5ae0 2021-01-03T13:07:37.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e8e11700 1 -- 172.21.15.133:0/3375797138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e40b5ae0 msgr2=0x7fd0e4144930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e8e11700 1 --2- 172.21.15.133:0/3375797138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e40b5ae0 0x7fd0e4144930 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7fd0cc002f30 tx=0x7fd0cc006e80).stop 2021-01-03T13:07:37.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e8e11700 1 -- 172.21.15.133:0/3375797138 shutdown_connections 2021-01-03T13:07:37.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e8e11700 1 --2- 172.21.15.133:0/3375797138 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd0e40b5330 0x7fd0e4141630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e8e11700 1 --2- 172.21.15.133:0/3375797138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e40b5ae0 0x7fd0e4144930 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e8e11700 1 -- 172.21.15.133:0/3375797138 >> 172.21.15.133:0/3375797138 conn(0x7fd0e405bdf0 msgr2=0x7fd0e405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:37.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.799+0000 7fd0e8e11700 1 -- 172.21.15.133:0/3375797138 shutdown_connections 2021-01-03T13:07:37.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.803+0000 7fd0e8e11700 1 -- 172.21.15.133:0/3375797138 wait complete. 2021-01-03T13:07:37.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.803+0000 7fd0e8e11700 1 Processor -- start 2021-01-03T13:07:37.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.803+0000 7fd0e8e11700 1 -- start start 2021-01-03T13:07:37.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e8e11700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0e40aec00 0x7fd0e414fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:37.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e8e11700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e40b5330 0x7fd0e4142640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:37.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e8e11700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd0e40b5ae0 0x7fd0e4065880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:37.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e8e11700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e413d9f0 con 0x7fd0e40aec00 2021-01-03T13:07:37.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e8e11700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e413dc90 con 0x7fd0e40b5330 2021-01-03T13:07:37.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e8e11700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e413df30 con 0x7fd0e40b5ae0 2021-01-03T13:07:37.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e40b5330 0x7fd0e4142640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:37.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e40b5330 0x7fd0e4142640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40282/0 (socket says 172.21.15.133:40282) 2021-01-03T13:07:37.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e2ffd700 1 -- 172.21.15.133:0/3842881654 learned_addr learned my addr 172.21.15.133:0/3842881654 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:37.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e37fe700 1 --2- 172.21.15.133:0/3842881654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0e40aec00 0x7fd0e414fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:37.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e3fff700 1 --2- 172.21.15.133:0/3842881654 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd0e40b5ae0 0x7fd0e4065880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:37.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e2ffd700 1 -- 172.21.15.133:0/3842881654 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd0e40b5ae0 msgr2=0x7fd0e4065880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e2ffd700 1 --2- 172.21.15.133:0/3842881654 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd0e40b5ae0 0x7fd0e4065880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e2ffd700 1 -- 172.21.15.133:0/3842881654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0e40aec00 msgr2=0x7fd0e414fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e2ffd700 1 --2- 172.21.15.133:0/3842881654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0e40aec00 0x7fd0e414fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e2ffd700 1 -- 172.21.15.133:0/3842881654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e40653e0 con 0x7fd0e40b5330 2021-01-03T13:07:37.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e2ffd700 1 --2- 172.21.15.133:0/3842881654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e40b5330 0x7fd0e4142640 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7fd0cc002f30 tx=0x7fd0cc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:37.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e0ff9700 1 -- 172.21.15.133:0/3842881654 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0cc011b60 con 0x7fd0e40b5330 2021-01-03T13:07:37.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e0ff9700 1 -- 172.21.15.133:0/3842881654 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0cc011cc0 con 0x7fd0e40b5330 2021-01-03T13:07:37.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e0ff9700 1 -- 172.21.15.133:0/3842881654 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0cc01e650 con 0x7fd0e40b5330 2021-01-03T13:07:37.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e8e11700 1 -- 172.21.15.133:0/3842881654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e41500c0 con 0x7fd0e40b5330 2021-01-03T13:07:37.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.807+0000 7fd0e8e11700 1 -- 172.21.15.133:0/3842881654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e4065d70 con 0x7fd0e40b5330 2021-01-03T13:07:37.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.811+0000 7fd0e8e11700 1 -- 172.21.15.133:0/3842881654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e4057300 con 0x7fd0e40b5330 2021-01-03T13:07:37.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.811+0000 7fd0e0ff9700 1 -- 172.21.15.133:0/3842881654 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd0cc025030 con 0x7fd0e40b5330 2021-01-03T13:07:37.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.811+0000 7fd0e0ff9700 1 --2- 172.21.15.133:0/3842881654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd0c80553b0 0x7fd0c8057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:37.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.811+0000 7fd0e0ff9700 1 -- 172.21.15.133:0/3842881654 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd0cc06f210 con 0x7fd0e40b5330 2021-01-03T13:07:37.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.811+0000 7fd0e37fe700 1 --2- 172.21.15.133:0/3842881654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd0c80553b0 0x7fd0c8057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:37.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.811+0000 7fd0e37fe700 1 --2- 172.21.15.133:0/3842881654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd0c80553b0 0x7fd0c8057870 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fd0d400c000 tx=0x7fd0d4008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:37.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.819+0000 7fd0e0ff9700 1 -- 172.21.15.133:0/3842881654 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd0cc045400 con 0x7fd0e40b5330 2021-01-03T13:07:37.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.951+0000 7fd0e8e11700 1 -- 172.21.15.133:0/3842881654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd0e406b110 con 0x7fd0e40b5330 2021-01-03T13:07:37.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.955+0000 7fd0e0ff9700 1 -- 172.21.15.133:0/3842881654 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v152) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd0cc048a20 con 0x7fd0e40b5330 2021-01-03T13:07:37.961 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:37.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.955+0000 7fd0e8e11700 1 -- 172.21.15.133:0/3842881654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd0c80553b0 msgr2=0x7fd0c8057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.955+0000 7fd0e8e11700 1 --2- 172.21.15.133:0/3842881654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd0c80553b0 0x7fd0c8057870 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fd0d400c000 tx=0x7fd0d4008040).stop 2021-01-03T13:07:37.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.955+0000 7fd0e8e11700 1 -- 172.21.15.133:0/3842881654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e40b5330 msgr2=0x7fd0e4142640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:37.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.955+0000 7fd0e8e11700 1 --2- 172.21.15.133:0/3842881654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e40b5330 0x7fd0e4142640 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7fd0cc002f30 tx=0x7fd0cc015000).stop 2021-01-03T13:07:37.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.955+0000 7fd0e8e11700 1 -- 172.21.15.133:0/3842881654 shutdown_connections 2021-01-03T13:07:37.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.955+0000 7fd0e8e11700 1 --2- 172.21.15.133:0/3842881654 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd0c80553b0 0x7fd0c8057870 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.955+0000 7fd0e8e11700 1 --2- 172.21.15.133:0/3842881654 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd0e40aec00 0x7fd0e414fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.955+0000 7fd0e8e11700 1 --2- 172.21.15.133:0/3842881654 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd0e40b5ae0 0x7fd0e4065880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.955+0000 7fd0e8e11700 1 --2- 172.21.15.133:0/3842881654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0e40b5330 0x7fd0e4142640 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:37.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.955+0000 7fd0e8e11700 1 -- 172.21.15.133:0/3842881654 >> 172.21.15.133:0/3842881654 conn(0x7fd0e405bdf0 msgr2=0x7fd0e4143520 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:37.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.955+0000 7fd0e8e11700 1 -- 172.21.15.133:0/3842881654 shutdown_connections 2021-01-03T13:07:37.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:37.955+0000 7fd0e8e11700 1 -- 172.21.15.133:0/3842881654 wait complete. 2021-01-03T13:07:37.974 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:07:37.974 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:07:38.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f803226b700 1 Processor -- start 2021-01-03T13:07:38.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f803226b700 1 -- start start 2021-01-03T13:07:38.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f803226b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f802c0b52c0 0x7f802c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f803226b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f802c0b0c90 0x7f802c098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f803226b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802c060da0 con 0x7f802c0b5c00 2021-01-03T13:07:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f803226b700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802c067a90 con 0x7f802c0b0c90 2021-01-03T13:07:38.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f803226b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0b0ad0 con 0x7f802c0b52c0 2021-01-03T13:07:38.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f8031a6a700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f802c0b5c00 0x7f802c14a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33090/0 (socket says 172.21.15.133:33090) 2021-01-03T13:07:38.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f8031a6a700 1 -- 172.21.15.133:0/1045737489 learned_addr learned my addr 172.21.15.133:0/1045737489 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:38.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f8030a68700 1 --2- 172.21.15.133:0/1045737489 >> v2:172.21.15.16:3300/0 conn(0x7f802c0b0c90 0x7f802c098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:38.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f8031269700 1 --2- 172.21.15.133:0/1045737489 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f802c0b52c0 0x7f802c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:38.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f802bfff700 1 -- 172.21.15.133:0/1045737489 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371680054 0 0) 0x7f802c060da0 con 0x7f802c0b5c00 2021-01-03T13:07:38.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f802bfff700 1 -- 172.21.15.133:0/1045737489 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f800c003230 con 0x7f802c0b5c00 2021-01-03T13:07:38.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f8030a68700 1 -- 172.21.15.133:0/1045737489 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f802c0b52c0 msgr2=0x7f802c0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:38.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f8030a68700 1 --2- 172.21.15.133:0/1045737489 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f802c0b52c0 0x7f802c0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:38.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f8030a68700 1 -- 172.21.15.133:0/1045737489 >> v1:172.21.15.133:6789/0 conn(0x7f802c0b5c00 legacy=0x7f802c14a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:38.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f8030a68700 1 -- 172.21.15.133:0/1045737489 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c0b56a0 con 0x7f802c0b0c90 2021-01-03T13:07:38.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f8030a68700 1 --2- 172.21.15.133:0/1045737489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f802c0b0c90 0x7f802c098ec0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f8014002f30 tx=0x7f8014006dc0).ready entity=mon.0 client_cookie=340915db30d05ca0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:38.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f802bfff700 1 -- 172.21.15.133:0/1045737489 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80140096a0 con 0x7f802c0b0c90 2021-01-03T13:07:38.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f802bfff700 1 -- 172.21.15.133:0/1045737489 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8014009800 con 0x7f802c0b0c90 2021-01-03T13:07:38.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f802bfff700 1 -- 172.21.15.133:0/1045737489 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8014009b60 con 0x7f802c0b0c90 2021-01-03T13:07:38.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f803226b700 1 -- 172.21.15.133:0/1045737489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f802c0b0c90 msgr2=0x7f802c098ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:38.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f803226b700 1 --2- 172.21.15.133:0/1045737489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f802c0b0c90 0x7f802c098ec0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f8014002f30 tx=0x7f8014006dc0).stop 2021-01-03T13:07:38.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f803226b700 1 -- 172.21.15.133:0/1045737489 shutdown_connections 2021-01-03T13:07:38.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f803226b700 1 --2- 172.21.15.133:0/1045737489 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f802c0b52c0 0x7f802c0b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:38.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f803226b700 1 --2- 172.21.15.133:0/1045737489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f802c0b0c90 0x7f802c098ec0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:38.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f803226b700 1 -- 172.21.15.133:0/1045737489 >> 172.21.15.133:0/1045737489 conn(0x7f802c05bdf0 msgr2=0x7f802c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:38.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.083+0000 7f803226b700 1 -- 172.21.15.133:0/1045737489 shutdown_connections 2021-01-03T13:07:38.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f803226b700 1 -- 172.21.15.133:0/1045737489 wait complete. 2021-01-03T13:07:38.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f803226b700 1 Processor -- start 2021-01-03T13:07:38.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f803226b700 1 -- start start 2021-01-03T13:07:38.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f803226b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f802c0b0c90 0x7f802c066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:38.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f803226b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f802c0b52c0 0x7f802c1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:38.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f803226b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f802c0b5c00 0x7f802c1566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:38.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f803226b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0af060 con 0x7f802c0b5c00 2021-01-03T13:07:38.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f803226b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0af300 con 0x7f802c0b52c0 2021-01-03T13:07:38.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f803226b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0af5a0 con 0x7f802c0b0c90 2021-01-03T13:07:38.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f8030a68700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f802c0b52c0 0x7f802c1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:38.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f8030a68700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f802c0b52c0 0x7f802c1561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40296/0 (socket says 172.21.15.133:40296) 2021-01-03T13:07:38.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f8030a68700 1 -- 172.21.15.133:0/2163233788 learned_addr learned my addr 172.21.15.133:0/2163233788 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:38.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f8031269700 1 --2- 172.21.15.133:0/2163233788 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f802c0b0c90 0x7f802c066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:38.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f8031a6a700 1 --2- 172.21.15.133:0/2163233788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f802c0b5c00 0x7f802c1566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:38.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f8031a6a700 1 -- 172.21.15.133:0/2163233788 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f802c0b0c90 msgr2=0x7f802c066190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:38.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f8031a6a700 1 --2- 172.21.15.133:0/2163233788 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f802c0b0c90 0x7f802c066190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:38.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f8031a6a700 1 -- 172.21.15.133:0/2163233788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f802c0b52c0 msgr2=0x7f802c1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:38.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f8031a6a700 1 --2- 172.21.15.133:0/2163233788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f802c0b52c0 0x7f802c1561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:38.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f8031a6a700 1 -- 172.21.15.133:0/2163233788 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c155d30 con 0x7f802c0b5c00 2021-01-03T13:07:38.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f8030a68700 1 --2- 172.21.15.133:0/2163233788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f802c0b52c0 0x7f802c1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:38.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f8031a6a700 1 --2- 172.21.15.133:0/2163233788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f802c0b5c00 0x7f802c1566c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f80240010d0 tx=0x7f8024007990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:38.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f802a7fc700 1 -- 172.21.15.133:0/2163233788 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8024001d50 con 0x7f802c0b5c00 2021-01-03T13:07:38.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f802a7fc700 1 -- 172.21.15.133:0/2163233788 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80240072e0 con 0x7f802c0b5c00 2021-01-03T13:07:38.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f803226b700 1 -- 172.21.15.133:0/2163233788 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802c0638f0 con 0x7f802c0b5c00 2021-01-03T13:07:38.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f802a7fc700 1 -- 172.21.15.133:0/2163233788 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80240057d0 con 0x7f802c0b5c00 2021-01-03T13:07:38.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.087+0000 7f803226b700 1 -- 172.21.15.133:0/2163233788 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802c067510 con 0x7f802c0b5c00 2021-01-03T13:07:38.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.091+0000 7f803226b700 1 -- 172.21.15.133:0/2163233788 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802c057300 con 0x7f802c0b5c00 2021-01-03T13:07:38.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.091+0000 7f802a7fc700 1 -- 172.21.15.133:0/2163233788 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8024010070 con 0x7f802c0b5c00 2021-01-03T13:07:38.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.091+0000 7f802a7fc700 1 --2- 172.21.15.133:0/2163233788 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80100553b0 0x7f8010057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:38.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.091+0000 7f802a7fc700 1 -- 172.21.15.133:0/2163233788 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f802406d950 con 0x7f802c0b5c00 2021-01-03T13:07:38.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.091+0000 7f8031269700 1 --2- 172.21.15.133:0/2163233788 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80100553b0 0x7f8010057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:38.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.091+0000 7f8031269700 1 --2- 172.21.15.133:0/2163233788 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80100553b0 0x7f8010057870 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f801c00b000 tx=0x7f801c0091a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:38.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.103+0000 7f802a7fc700 1 -- 172.21.15.133:0/2163233788 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8024043b40 con 0x7f802c0b5c00 2021-01-03T13:07:38.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.283+0000 7f803226b700 1 -- 172.21.15.133:0/2163233788 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f802c05ce00 con 0x7f802c0b5c00 2021-01-03T13:07:38.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.283+0000 7f802a7fc700 1 -- 172.21.15.133:0/2163233788 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+2501 (secure 0 0 0) 0x7f8024047160 con 0x7f802c0b5c00 2021-01-03T13:07:38.291 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:38.291 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":72,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/3955382552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3955382552},{"type":"v1","addr":"172.21.15.16:6833","nonce":3955382552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6836/2756803911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2756803911},{"type":"v1","addr":"172.21.15.133:6836","nonce":2756803911}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:32.737122+0000","modified":"2021-01-03T13:07:34.405167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8167":{"gid":8167,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/3125642229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3125642229},{"type":"v1","addr":"172.21.15.133:6837","nonce":3125642229}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-01-03T13:07:38.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.287+0000 7f803226b700 1 -- 172.21.15.133:0/2163233788 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80100553b0 msgr2=0x7f8010057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:38.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.287+0000 7f803226b700 1 --2- 172.21.15.133:0/2163233788 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80100553b0 0x7f8010057870 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f801c00b000 tx=0x7f801c0091a0).stop 2021-01-03T13:07:38.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.287+0000 7f803226b700 1 -- 172.21.15.133:0/2163233788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f802c0b5c00 msgr2=0x7f802c1566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:38.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.287+0000 7f803226b700 1 --2- 172.21.15.133:0/2163233788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f802c0b5c00 0x7f802c1566c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f80240010d0 tx=0x7f8024007990).stop 2021-01-03T13:07:38.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.287+0000 7f803226b700 1 -- 172.21.15.133:0/2163233788 shutdown_connections 2021-01-03T13:07:38.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.287+0000 7f803226b700 1 --2- 172.21.15.133:0/2163233788 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f80100553b0 0x7f8010057870 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:38.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.287+0000 7f803226b700 1 --2- 172.21.15.133:0/2163233788 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f802c0b5c00 0x7f802c1566c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:38.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.287+0000 7f803226b700 1 --2- 172.21.15.133:0/2163233788 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f802c0b0c90 0x7f802c066190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:38.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.287+0000 7f803226b700 1 --2- 172.21.15.133:0/2163233788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f802c0b52c0 0x7f802c1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.287+0000 7f803226b700 1 -- 172.21.15.133:0/2163233788 >> 172.21.15.133:0/2163233788 conn(0x7f802c05bdf0 msgr2=0x7f802c143500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.287+0000 7f803226b700 1 -- 172.21.15.133:0/2163233788 shutdown_connections 2021-01-03T13:07:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:38.287+0000 7f803226b700 1 -- 172.21.15.133:0/2163233788 wait complete. 2021-01-03T13:07:38.295 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 72 2021-01-03T13:07:38.442 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:07:38.444 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:07:38.447 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:07:38.449 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:07:38.605 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:07:32.737122+0000', 'modified': '2021-01-03T13:07:34.405167+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8167}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8167': {'gid': 8167, 'name': 'c', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/3125642229', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 3125642229}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 3125642229}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:07:38.606 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:07:38.607 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T13:07:38.735 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":8167,"want_state":"up:active","state":"up:active","rank_uptime":5.9829726230000002,"mdsmap_epoch":72,"osdmap_epoch":152,"osdmap_epoch_barrier":152,"uptime":10.206608856000001} 2021-01-03T13:07:38.736 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 8167, "mdsmap_epoch": 72, "osdmap_epoch": 152, "osdmap_epoch_barrier": 152, "rank_uptime": 5.982972623, "state": "up:active", "uptime": 10.206608856, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:07:38.736 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:07:38.737 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-01-03T13:07:38.737 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi007.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-01-03T13:07:38.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:38.738 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:38.746 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:07:38.804 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:07:38.805 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:07:38.860 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:07:38.861 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:07:38.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:38.862 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:07:38.907 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:07:38.908 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:38.951 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:07:38.968 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:07:38.968 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:07:39.024 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:07:39.026 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:07:39.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:39.028 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:07:39.030 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2021-01-03T13:07:39.026+0000 7fb7386170c0 -1 init, newargv = 0x5581a7ab2f50 newargc=9 2021-01-03T13:07:39.030 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12868]: starting ceph client 2021-01-03T13:07:39.040 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12868]: starting fuse 2021-01-03T13:07:40.138 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:07:40.154 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:07:40.155 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:07:40.211 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:07:40.212 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:07:40.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:40.213 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:07:40.259 INFO:teuthology.orchestra.run.smithi007.stdout:50 2021-01-03T13:07:40.260 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:07:40.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:40.261 DEBUG:teuthology.orchestra.run.smithi007:> sudo python3 -c ' 2021-01-03T13:07:40.261 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2021-01-03T13:07:40.262 DEBUG:teuthology.orchestra.run.smithi007:> import re 2021-01-03T13:07:40.262 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:07:40.262 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2021-01-03T13:07:40.263 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:07:40.263 DEBUG:teuthology.orchestra.run.smithi007:> def find_socket(client_name): 2021-01-03T13:07:40.264 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-01-03T13:07:40.264 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2021-01-03T13:07:40.264 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:07:40.265 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2021-01-03T13:07:40.265 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2021-01-03T13:07:40.265 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2021-01-03T13:07:40.266 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2021-01-03T13:07:40.266 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:07:40.267 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2021-01-03T13:07:40.267 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:07:40.268 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:07:40.268 DEBUG:teuthology.orchestra.run.smithi007:> return f 2021-01-03T13:07:40.269 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:07:40.269 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:07:40.270 DEBUG:teuthology.orchestra.run.smithi007:> print(find_socket("client.0")) 2021-01-03T13:07:40.271 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:07:40.350 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.12868.asok 2021-01-03T13:07:40.355 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12868.asok 2021-01-03T13:07:40.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:40.356 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12868.asok status 2021-01-03T13:07:40.457 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2021-01-03T13:07:40.458 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2021-01-03T13:07:40.458 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:07:40.458 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:07:40.458 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2021-01-03T13:07:40.459 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2021-01-03T13:07:40.459 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-01-03T13:07:40.459 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "12868", 2021-01-03T13:07:40.459 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2021-01-03T13:07:40.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:07:40.460 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2021-01-03T13:07:40.460 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2021-01-03T13:07:40.460 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 8344, 2021-01-03T13:07:40.460 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2021-01-03T13:07:40.461 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2021-01-03T13:07:40.461 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2021-01-03T13:07:40.461 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 8344 2021-01-03T13:07:40.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:07:40.461 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:07:40.462 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:07:40.462 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:07:40.462 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 585569693 2021-01-03T13:07:40.462 INFO:teuthology.orchestra.run.smithi007.stdout: } 2021-01-03T13:07:40.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:07:40.463 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:07:40.463 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:07:40.463 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:07:40.463 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 585569693 2021-01-03T13:07:40.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:07:40.464 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.8344 172.21.15.7:0/585569693", 2021-01-03T13:07:40.464 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "172.21.15.7:0/585569693", 2021-01-03T13:07:40.464 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2021-01-03T13:07:40.464 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 72, 2021-01-03T13:07:40.465 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 152, 2021-01-03T13:07:40.465 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:07:40.465 INFO:teuthology.orchestra.run.smithi007.stdout: "blacklisted": false, 2021-01-03T13:07:40.465 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2021-01-03T13:07:40.465 INFO:teuthology.orchestra.run.smithi007.stdout:} 2021-01-03T13:07:40.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:40.468 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:40.469 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:40.475 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:07:40.476 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:07:40.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:40.477 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:40.535 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:07:40.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.647+0000 7fef99719700 1 Processor -- start 2021-01-03T13:07:40.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.647+0000 7fef99719700 1 -- start start 2021-01-03T13:07:40.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.647+0000 7fef99719700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef940b5900 0x7fef9413f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:40.657 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.647+0000 7fef99719700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef940b02b0 0x7fef940b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:40.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.647+0000 7fef99719700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef940afd20 con 0x7fef940ab580 2021-01-03T13:07:40.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.647+0000 7fef99719700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef940ab960 con 0x7fef940b02b0 2021-01-03T13:07:40.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.647+0000 7fef99719700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef940aff50 con 0x7fef940b5900 2021-01-03T13:07:40.658 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef98f18700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef940b02b0 0x7fef940b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef98f18700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fef940b02b0 0x7fef940b0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40306/0 (socket says 172.21.15.133:40306) 2021-01-03T13:07:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef98f18700 1 -- 172.21.15.133:0/2245410901 learned_addr learned my addr 172.21.15.133:0/2245410901 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef937fe700 1 --2- 172.21.15.133:0/2245410901 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef940b5900 0x7fef9413f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:40.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef98f18700 1 -- 172.21.15.133:0/2245410901 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef940b5900 msgr2=0x7fef9413f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef98f18700 1 --2- 172.21.15.133:0/2245410901 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef940b5900 0x7fef9413f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef98f18700 1 -- 172.21.15.133:0/2245410901 >> v1:172.21.15.16:6789/0 conn(0x7fef940ab580 legacy=0x7fef9413f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef98f18700 1 -- 172.21.15.133:0/2245410901 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9413fee0 con 0x7fef940b02b0 2021-01-03T13:07:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef937fe700 1 --2- 172.21.15.133:0/2245410901 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef940b5900 0x7fef9413f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:40.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef98f18700 1 --2- 172.21.15.133:0/2245410901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef940b02b0 0x7fef940b0740 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7fef8c0032b0 tx=0x7fef8c009270).ready entity=mon.1 client_cookie=a7ea544572dea605 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef92ffd700 1 -- 172.21.15.133:0/2245410901 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef8c00bc00 con 0x7fef940b02b0 2021-01-03T13:07:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef92ffd700 1 -- 172.21.15.133:0/2245410901 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c00bd60 con 0x7fef940b02b0 2021-01-03T13:07:40.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef92ffd700 1 -- 172.21.15.133:0/2245410901 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef8c011400 con 0x7fef940b02b0 2021-01-03T13:07:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef99719700 1 -- 172.21.15.133:0/2245410901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef940b02b0 msgr2=0x7fef940b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:40.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef99719700 1 --2- 172.21.15.133:0/2245410901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef940b02b0 0x7fef940b0740 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7fef8c0032b0 tx=0x7fef8c009270).stop 2021-01-03T13:07:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef99719700 1 -- 172.21.15.133:0/2245410901 shutdown_connections 2021-01-03T13:07:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef99719700 1 --2- 172.21.15.133:0/2245410901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef940b02b0 0x7fef940b0740 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef99719700 1 --2- 172.21.15.133:0/2245410901 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef940b5900 0x7fef9413f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:40.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef99719700 1 -- 172.21.15.133:0/2245410901 >> 172.21.15.133:0/2245410901 conn(0x7fef9405bdf0 msgr2=0x7fef9405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef99719700 1 -- 172.21.15.133:0/2245410901 shutdown_connections 2021-01-03T13:07:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef99719700 1 -- 172.21.15.133:0/2245410901 wait complete. 2021-01-03T13:07:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef99719700 1 Processor -- start 2021-01-03T13:07:40.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.651+0000 7fef99719700 1 -- start start 2021-01-03T13:07:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef99719700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef940ab580 0x7fef94140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef99719700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef940b02b0 0x7fef940ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef99719700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef940b5900 0x7fef9413d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef99719700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef94044650 con 0x7fef940ab580 2021-01-03T13:07:40.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef99719700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef940670b0 con 0x7fef940b02b0 2021-01-03T13:07:40.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef99719700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef94153d90 con 0x7fef940b5900 2021-01-03T13:07:40.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef937fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef940b02b0 0x7fef940ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:40.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef93fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef940ab580 0x7fef94140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:40.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef937fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef940b02b0 0x7fef940ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40312/0 (socket says 172.21.15.133:40312) 2021-01-03T13:07:40.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef937fe700 1 -- 172.21.15.133:0/3767312600 learned_addr learned my addr 172.21.15.133:0/3767312600 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:40.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef98f18700 1 --2- 172.21.15.133:0/3767312600 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef940b5900 0x7fef9413d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:40.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef937fe700 1 -- 172.21.15.133:0/3767312600 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef940b5900 msgr2=0x7fef9413d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:40.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef937fe700 1 --2- 172.21.15.133:0/3767312600 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef940b5900 0x7fef9413d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:40.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef937fe700 1 -- 172.21.15.133:0/3767312600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef940ab580 msgr2=0x7fef94140d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:40.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef937fe700 1 --2- 172.21.15.133:0/3767312600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef940ab580 0x7fef94140d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:40.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef937fe700 1 -- 172.21.15.133:0/3767312600 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef94141880 con 0x7fef940b02b0 2021-01-03T13:07:40.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef93fff700 1 --2- 172.21.15.133:0/3767312600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef940ab580 0x7fef94140d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:40.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef937fe700 1 --2- 172.21.15.133:0/3767312600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef940b02b0 0x7fef940ac310 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7fef94044790 tx=0x7fef88008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:40.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef917fa700 1 -- 172.21.15.133:0/3767312600 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef880127e0 con 0x7fef940b02b0 2021-01-03T13:07:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef917fa700 1 -- 172.21.15.133:0/3767312600 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef88012940 con 0x7fef940b02b0 2021-01-03T13:07:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef99719700 1 -- 172.21.15.133:0/3767312600 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef940672e0 con 0x7fef940b02b0 2021-01-03T13:07:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef917fa700 1 -- 172.21.15.133:0/3767312600 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef88012ca0 con 0x7fef940b02b0 2021-01-03T13:07:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.655+0000 7fef99719700 1 -- 172.21.15.133:0/3767312600 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef941538b0 con 0x7fef940b02b0 2021-01-03T13:07:40.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.659+0000 7fef99719700 1 -- 172.21.15.133:0/3767312600 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef940af660 con 0x7fef940b02b0 2021-01-03T13:07:40.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.659+0000 7fef917fa700 1 -- 172.21.15.133:0/3767312600 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fef88013480 con 0x7fef940b02b0 2021-01-03T13:07:40.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.659+0000 7fef917fa700 1 --2- 172.21.15.133:0/3767312600 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef74055470 0x7fef74057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.659+0000 7fef917fa700 1 -- 172.21.15.133:0/3767312600 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fef8806e550 con 0x7fef940b02b0 2021-01-03T13:07:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.659+0000 7fef93fff700 1 --2- 172.21.15.133:0/3767312600 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef74055470 0x7fef74057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.659+0000 7fef93fff700 1 --2- 172.21.15.133:0/3767312600 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef74055470 0x7fef74057930 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fef8400d000 tx=0x7fef84009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:40.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.663+0000 7fef917fa700 1 -- 172.21.15.133:0/3767312600 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fef880447f0 con 0x7fef940b02b0 2021-01-03T13:07:40.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.803+0000 7fef99719700 1 -- 172.21.15.133:0/3767312600 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef94153ad0 con 0x7fef940b02b0 2021-01-03T13:07:40.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.807+0000 7fef917fa700 1 -- 172.21.15.133:0/3767312600 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+16100 (secure 0 0 0) 0x7fef94153ad0 con 0x7fef940b02b0 2021-01-03T13:07:40.813 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:40.814 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":152,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:32.736676+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:07:31.210499+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2021-01-03T13:07:31.743590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:07:40.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.807+0000 7fef99719700 1 -- 172.21.15.133:0/3767312600 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef74055470 msgr2=0x7fef74057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:40.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.807+0000 7fef99719700 1 --2- 172.21.15.133:0/3767312600 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef74055470 0x7fef74057930 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fef8400d000 tx=0x7fef84009040).stop 2021-01-03T13:07:40.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.807+0000 7fef99719700 1 -- 172.21.15.133:0/3767312600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef940b02b0 msgr2=0x7fef940ac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:40.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.807+0000 7fef99719700 1 --2- 172.21.15.133:0/3767312600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef940b02b0 0x7fef940ac310 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7fef94044790 tx=0x7fef88008040).stop 2021-01-03T13:07:40.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.807+0000 7fef99719700 1 -- 172.21.15.133:0/3767312600 shutdown_connections 2021-01-03T13:07:40.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.807+0000 7fef99719700 1 --2- 172.21.15.133:0/3767312600 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fef74055470 0x7fef74057930 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:40.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.807+0000 7fef99719700 1 --2- 172.21.15.133:0/3767312600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fef940ab580 0x7fef94140d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:40.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.807+0000 7fef99719700 1 --2- 172.21.15.133:0/3767312600 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fef940b5900 0x7fef9413d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:40.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.807+0000 7fef99719700 1 --2- 172.21.15.133:0/3767312600 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fef940b02b0 0x7fef940ac310 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:40.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.807+0000 7fef99719700 1 -- 172.21.15.133:0/3767312600 >> 172.21.15.133:0/3767312600 conn(0x7fef9405bdf0 msgr2=0x7fef9413c570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:40.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.807+0000 7fef99719700 1 -- 172.21.15.133:0/3767312600 shutdown_connections 2021-01-03T13:07:40.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.807+0000 7fef99719700 1 -- 172.21.15.133:0/3767312600 wait complete. 2021-01-03T13:07:40.827 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:07:31.210499+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:07:31.743590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:07:40.828 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:07:40.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.939+0000 7f20d3fff700 1 Processor -- start 2021-01-03T13:07:40.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.939+0000 7f20d3fff700 1 -- start start 2021-01-03T13:07:40.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f20d40b5260 0x7f20d41470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:40.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d3fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f20d40b5c00 0x7f20d41475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:40.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d3fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d40b0c10 con 0x7f20d41442a0 2021-01-03T13:07:40.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d3fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d4144e00 con 0x7f20d40b5c00 2021-01-03T13:07:40.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d3fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d40b5640 con 0x7f20d40b5260 2021-01-03T13:07:40.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f20d40b5260 0x7f20d41470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:40.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d2ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f20d40b5260 0x7f20d41470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40318/0 (socket says 172.21.15.133:40318) 2021-01-03T13:07:40.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d2ffd700 1 -- 172.21.15.133:0/1965444072 learned_addr learned my addr 172.21.15.133:0/1965444072 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:40.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20ca7fc700 1 --2- 172.21.15.133:0/1965444072 >> v2:172.21.15.16:3300/0 conn(0x7f20d40b5c00 0x7f20d41475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:40.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d2ffd700 1 -- 172.21.15.133:0/1965444072 >> v2:172.21.15.16:3300/0 conn(0x7f20d40b5c00 msgr2=0x7f20d41475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:40.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d2ffd700 1 --2- 172.21.15.133:0/1965444072 >> v2:172.21.15.16:3300/0 conn(0x7f20d40b5c00 0x7f20d41475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:40.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d2ffd700 1 -- 172.21.15.133:0/1965444072 >> v1:172.21.15.16:6789/0 conn(0x7f20d41442a0 legacy=0x7f20d41446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:40.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d2ffd700 1 -- 172.21.15.133:0/1965444072 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d409a4f0 con 0x7f20d40b5260 2021-01-03T13:07:40.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d2ffd700 1 --2- 172.21.15.133:0/1965444072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20d40b5260 0x7f20d41470b0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f20bc002f30 tx=0x7f20bc006e80).ready entity=mon.1 client_cookie=e32627302f189f02 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:40.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d27fc700 1 -- 172.21.15.133:0/1965444072 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20bc0097f0 con 0x7f20d40b5260 2021-01-03T13:07:40.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d27fc700 1 -- 172.21.15.133:0/1965444072 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc009950 con 0x7f20d40b5260 2021-01-03T13:07:40.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d27fc700 1 -- 172.21.15.133:0/1965444072 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20bc009cb0 con 0x7f20d40b5260 2021-01-03T13:07:40.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d3fff700 1 -- 172.21.15.133:0/1965444072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20d40b5260 msgr2=0x7f20d41470b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:40.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d3fff700 1 --2- 172.21.15.133:0/1965444072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20d40b5260 0x7f20d41470b0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f20bc002f30 tx=0x7f20bc006e80).stop 2021-01-03T13:07:40.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d3fff700 1 -- 172.21.15.133:0/1965444072 shutdown_connections 2021-01-03T13:07:40.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d3fff700 1 --2- 172.21.15.133:0/1965444072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20d40b5260 0x7f20d41470b0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:40.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d3fff700 1 --2- 172.21.15.133:0/1965444072 >> v2:172.21.15.16:3300/0 conn(0x7f20d40b5c00 0x7f20d41475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:40.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d3fff700 1 -- 172.21.15.133:0/1965444072 >> 172.21.15.133:0/1965444072 conn(0x7f20d405bdf0 msgr2=0x7f20d405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:40.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d3fff700 1 -- 172.21.15.133:0/1965444072 shutdown_connections 2021-01-03T13:07:40.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.943+0000 7f20d3fff700 1 -- 172.21.15.133:0/1965444072 wait complete. 2021-01-03T13:07:40.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d3fff700 1 Processor -- start 2021-01-03T13:07:40.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d3fff700 1 -- start start 2021-01-03T13:07:40.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d3fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20d40b5260 0x7f20d4155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:40.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d3fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f20d40b5c00 0x7f20d40af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:40.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20d41442a0 0x7f20d413de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:40.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d3fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d40acec0 con 0x7f20d40b5260 2021-01-03T13:07:40.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d3fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d4156590 con 0x7f20d41442a0 2021-01-03T13:07:40.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d3fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d4156830 con 0x7f20d40b5c00 2021-01-03T13:07:40.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20d41442a0 0x7f20d413de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:40.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d37fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20d41442a0 0x7f20d413de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40326/0 (socket says 172.21.15.133:40326) 2021-01-03T13:07:40.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d37fe700 1 -- 172.21.15.133:0/3005730238 learned_addr learned my addr 172.21.15.133:0/3005730238 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:40.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d2ffd700 1 --2- 172.21.15.133:0/3005730238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20d40b5260 0x7f20d4155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:40.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20ca7fc700 1 --2- 172.21.15.133:0/3005730238 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f20d40b5c00 0x7f20d40af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:40.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d37fe700 1 -- 172.21.15.133:0/3005730238 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f20d40b5c00 msgr2=0x7f20d40af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:40.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d37fe700 1 --2- 172.21.15.133:0/3005730238 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f20d40b5c00 0x7f20d40af920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:40.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d37fe700 1 -- 172.21.15.133:0/3005730238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20d40b5260 msgr2=0x7f20d4155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:40.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d37fe700 1 --2- 172.21.15.133:0/3005730238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20d40b5260 0x7f20d4155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:40.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d37fe700 1 -- 172.21.15.133:0/3005730238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d4156ad0 con 0x7f20d41442a0 2021-01-03T13:07:40.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d2ffd700 1 --2- 172.21.15.133:0/3005730238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20d40b5260 0x7f20d4155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:40.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d37fe700 1 --2- 172.21.15.133:0/3005730238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20d41442a0 0x7f20d413de50 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f20d4062160 tx=0x7f20cc007f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:40.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d0ff9700 1 -- 172.21.15.133:0/3005730238 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20cc003080 con 0x7f20d41442a0 2021-01-03T13:07:40.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d0ff9700 1 -- 172.21.15.133:0/3005730238 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc00a7b0 con 0x7f20d41442a0 2021-01-03T13:07:40.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d3fff700 1 -- 172.21.15.133:0/3005730238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d4156d70 con 0x7f20d41442a0 2021-01-03T13:07:40.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d0ff9700 1 -- 172.21.15.133:0/3005730238 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20cc00ab10 con 0x7f20d41442a0 2021-01-03T13:07:40.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.947+0000 7f20d3fff700 1 -- 172.21.15.133:0/3005730238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d40b0030 con 0x7f20d41442a0 2021-01-03T13:07:40.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.951+0000 7f20d3fff700 1 -- 172.21.15.133:0/3005730238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d4057300 con 0x7f20d41442a0 2021-01-03T13:07:40.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.951+0000 7f20d0ff9700 1 -- 172.21.15.133:0/3005730238 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f20cc019030 con 0x7f20d41442a0 2021-01-03T13:07:40.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.951+0000 7f20d0ff9700 1 --2- 172.21.15.133:0/3005730238 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f20b80553b0 0x7f20b8057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:40.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.951+0000 7f20d0ff9700 1 -- 172.21.15.133:0/3005730238 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f20cc06d630 con 0x7f20d41442a0 2021-01-03T13:07:40.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.951+0000 7f20d2ffd700 1 --2- 172.21.15.133:0/3005730238 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f20b80553b0 0x7f20b8057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:40.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.951+0000 7f20d2ffd700 1 --2- 172.21.15.133:0/3005730238 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f20b80553b0 0x7f20b8057870 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f20bc01a000 tx=0x7f20bc015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:40.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:40.955+0000 7f20d0ff9700 1 -- 172.21.15.133:0/3005730238 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f20cc043930 con 0x7f20d41442a0 2021-01-03T13:07:41.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.099+0000 7f20d3fff700 1 -- 172.21.15.133:0/3005730238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f20d405ce00 con 0x7f20d41442a0 2021-01-03T13:07:41.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.099+0000 7f20d0ff9700 1 -- 172.21.15.133:0/3005730238 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v152) v1 ==== 110+0+10 (secure 0 0 0) 0x7f20cc046f50 con 0x7f20d41442a0 2021-01-03T13:07:41.106 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:07:41.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.099+0000 7f20d3fff700 1 -- 172.21.15.133:0/3005730238 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f20b80553b0 msgr2=0x7f20b8057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.099+0000 7f20d3fff700 1 --2- 172.21.15.133:0/3005730238 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f20b80553b0 0x7f20b8057870 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f20bc01a000 tx=0x7f20bc015000).stop 2021-01-03T13:07:41.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.099+0000 7f20d3fff700 1 -- 172.21.15.133:0/3005730238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20d41442a0 msgr2=0x7f20d413de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.099+0000 7f20d3fff700 1 --2- 172.21.15.133:0/3005730238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20d41442a0 0x7f20d413de50 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f20d4062160 tx=0x7f20cc007f70).stop 2021-01-03T13:07:41.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.099+0000 7f20d3fff700 1 -- 172.21.15.133:0/3005730238 shutdown_connections 2021-01-03T13:07:41.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.099+0000 7f20d3fff700 1 --2- 172.21.15.133:0/3005730238 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f20b80553b0 0x7f20b8057870 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.099+0000 7f20d3fff700 1 --2- 172.21.15.133:0/3005730238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f20d40b5260 0x7f20d4155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.099+0000 7f20d3fff700 1 --2- 172.21.15.133:0/3005730238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20d41442a0 0x7f20d413de50 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.099+0000 7f20d3fff700 1 --2- 172.21.15.133:0/3005730238 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f20d40b5c00 0x7f20d40af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.099+0000 7f20d3fff700 1 -- 172.21.15.133:0/3005730238 >> 172.21.15.133:0/3005730238 conn(0x7f20d405bdf0 msgr2=0x7f20d4098d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:41.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.099+0000 7f20d3fff700 1 -- 172.21.15.133:0/3005730238 shutdown_connections 2021-01-03T13:07:41.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.099+0000 7f20d3fff700 1 -- 172.21.15.133:0/3005730238 wait complete. 2021-01-03T13:07:41.119 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:07:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.227+0000 7f2a712b9700 1 Processor -- start 2021-01-03T13:07:41.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.227+0000 7f2a712b9700 1 -- start start 2021-01-03T13:07:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.227+0000 7f2a712b9700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2a6c066f30 0x7f2a6c0b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.227+0000 7f2a712b9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2a6c0b1590 0x7f2a6c13ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:41.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.227+0000 7f2a712b9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a6c05fd00 con 0x7f2a6c05f920 2021-01-03T13:07:41.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.227+0000 7f2a712b9700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6c0b2980 con 0x7f2a6c066f30 2021-01-03T13:07:41.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.227+0000 7f2a712b9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6c0ae700 con 0x7f2a6c0b1590 2021-01-03T13:07:41.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a6bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2a6c05f920 0x7f2a6c0b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33130/0 (socket says 172.21.15.133:33130) 2021-01-03T13:07:41.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a6bfff700 1 -- 172.21.15.133:0/3063263542 learned_addr learned my addr 172.21.15.133:0/3063263542 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:41.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a70ab8700 1 --2- 172.21.15.133:0/3063263542 >> v2:172.21.15.133:3300/0 conn(0x7f2a6c0b1590 0x7f2a6c13ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:41.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a6b7fe700 1 --2- 172.21.15.133:0/3063263542 >> v2:172.21.15.16:3300/0 conn(0x7f2a6c066f30 0x7f2a6c0b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a70ab8700 1 -- 172.21.15.133:0/3063263542 >> v2:172.21.15.16:3300/0 conn(0x7f2a6c066f30 msgr2=0x7f2a6c0b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a70ab8700 1 --2- 172.21.15.133:0/3063263542 >> v2:172.21.15.16:3300/0 conn(0x7f2a6c066f30 0x7f2a6c0b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a70ab8700 1 -- 172.21.15.133:0/3063263542 >> v1:172.21.15.133:6789/0 conn(0x7f2a6c05f920 legacy=0x7f2a6c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a70ab8700 1 -- 172.21.15.133:0/3063263542 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c0accd0 con 0x7f2a6c0b1590 2021-01-03T13:07:41.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a6affd700 1 -- 172.21.15.133:0/3063263542 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985046783 0 0) 0x7f2a6c05fd00 con 0x7f2a6c05f920 2021-01-03T13:07:41.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a70ab8700 1 --2- 172.21.15.133:0/3063263542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a6c0b1590 0x7f2a6c13ff80 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f2a640032b0 tx=0x7f2a640091a0).ready entity=mon.1 client_cookie=4c26240b077960e3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:41.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a6affd700 1 -- 172.21.15.133:0/3063263542 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a6400b9a0 con 0x7f2a6c0b1590 2021-01-03T13:07:41.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a6affd700 1 -- 172.21.15.133:0/3063263542 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6400bb00 con 0x7f2a6c0b1590 2021-01-03T13:07:41.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a6affd700 1 -- 172.21.15.133:0/3063263542 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a6400bc70 con 0x7f2a6c0b1590 2021-01-03T13:07:41.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a712b9700 1 -- 172.21.15.133:0/3063263542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a6c0b1590 msgr2=0x7f2a6c13ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a712b9700 1 --2- 172.21.15.133:0/3063263542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a6c0b1590 0x7f2a6c13ff80 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f2a640032b0 tx=0x7f2a640091a0).stop 2021-01-03T13:07:41.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a712b9700 1 -- 172.21.15.133:0/3063263542 shutdown_connections 2021-01-03T13:07:41.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a712b9700 1 --2- 172.21.15.133:0/3063263542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a6c0b1590 0x7f2a6c13ff80 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a712b9700 1 --2- 172.21.15.133:0/3063263542 >> v2:172.21.15.16:3300/0 conn(0x7f2a6c066f30 0x7f2a6c0b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a712b9700 1 -- 172.21.15.133:0/3063263542 >> 172.21.15.133:0/3063263542 conn(0x7f2a6c0b6110 msgr2=0x7f2a6c0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:41.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a712b9700 1 -- 172.21.15.133:0/3063263542 shutdown_connections 2021-01-03T13:07:41.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a712b9700 1 -- 172.21.15.133:0/3063263542 wait complete. 2021-01-03T13:07:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a712b9700 1 Processor -- start 2021-01-03T13:07:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.231+0000 7f2a712b9700 1 -- start start 2021-01-03T13:07:41.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a712b9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a6c05f920 0x7f2a6c152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:41.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a712b9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a6c066f30 0x7f2a6c0638b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:41.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a712b9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a6c0b1590 0x7f2a6c141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:41.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a712b9700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c13b4c0 con 0x7f2a6c066f30 2021-01-03T13:07:41.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a712b9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c063fc0 con 0x7f2a6c0b1590 2021-01-03T13:07:41.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a712b9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c063da0 con 0x7f2a6c05f920 2021-01-03T13:07:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a70ab8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a6c0b1590 0x7f2a6c141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a70ab8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a6c0b1590 0x7f2a6c141d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40340/0 (socket says 172.21.15.133:40340) 2021-01-03T13:07:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a70ab8700 1 -- 172.21.15.133:0/2764088192 learned_addr learned my addr 172.21.15.133:0/2764088192 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a6b7fe700 1 --2- 172.21.15.133:0/2764088192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a6c066f30 0x7f2a6c0638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a6bfff700 1 --2- 172.21.15.133:0/2764088192 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a6c05f920 0x7f2a6c152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a70ab8700 1 -- 172.21.15.133:0/2764088192 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a6c05f920 msgr2=0x7f2a6c152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a70ab8700 1 --2- 172.21.15.133:0/2764088192 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a6c05f920 0x7f2a6c152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a70ab8700 1 -- 172.21.15.133:0/2764088192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a6c066f30 msgr2=0x7f2a6c0638b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a70ab8700 1 --2- 172.21.15.133:0/2764088192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a6c066f30 0x7f2a6c0638b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a70ab8700 1 -- 172.21.15.133:0/2764088192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c151e80 con 0x7f2a6c0b1590 2021-01-03T13:07:41.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a6b7fe700 1 --2- 172.21.15.133:0/2764088192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a6c066f30 0x7f2a6c0638b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:41.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a70ab8700 1 --2- 172.21.15.133:0/2764088192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a6c0b1590 0x7f2a6c141d70 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f2a6c0b3e20 tx=0x7f2a64016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a697fa700 1 -- 172.21.15.133:0/2764088192 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a640205f0 con 0x7f2a6c0b1590 2021-01-03T13:07:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a697fa700 1 -- 172.21.15.133:0/2764088192 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a64020750 con 0x7f2a6c0b1590 2021-01-03T13:07:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a712b9700 1 -- 172.21.15.133:0/2764088192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6c152120 con 0x7f2a6c0b1590 2021-01-03T13:07:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a697fa700 1 -- 172.21.15.133:0/2764088192 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a64020ab0 con 0x7f2a6c0b1590 2021-01-03T13:07:41.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.235+0000 7f2a712b9700 1 -- 172.21.15.133:0/2764088192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6c142260 con 0x7f2a6c0b1590 2021-01-03T13:07:41.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.239+0000 7f2a697fa700 1 -- 172.21.15.133:0/2764088192 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2a64027030 con 0x7f2a6c0b1590 2021-01-03T13:07:41.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.239+0000 7f2a712b9700 1 -- 172.21.15.133:0/2764088192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6c057300 con 0x7f2a6c0b1590 2021-01-03T13:07:41.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.239+0000 7f2a697fa700 1 --2- 172.21.15.133:0/2764088192 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a4c055440 0x7f2a4c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:41.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.239+0000 7f2a6bfff700 1 --2- 172.21.15.133:0/2764088192 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a4c055440 0x7f2a4c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:41.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.239+0000 7f2a697fa700 1 -- 172.21.15.133:0/2764088192 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2a6406f440 con 0x7f2a6c0b1590 2021-01-03T13:07:41.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.239+0000 7f2a6bfff700 1 --2- 172.21.15.133:0/2764088192 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a4c055440 0x7f2a4c057900 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f2a5c00b000 tx=0x7f2a5c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:41.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.243+0000 7f2a697fa700 1 -- 172.21.15.133:0/2764088192 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2a64045650 con 0x7f2a6c0b1590 2021-01-03T13:07:41.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.383+0000 7f2a712b9700 1 -- 172.21.15.133:0/2764088192 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2a6c061020 con 0x7f2a6c0b1590 2021-01-03T13:07:41.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.383+0000 7f2a697fa700 1 -- 172.21.15.133:0/2764088192 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v152) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2a64048bf0 con 0x7f2a6c0b1590 2021-01-03T13:07:41.390 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:41.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.383+0000 7f2a712b9700 1 -- 172.21.15.133:0/2764088192 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a4c055440 msgr2=0x7f2a4c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.383+0000 7f2a712b9700 1 --2- 172.21.15.133:0/2764088192 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a4c055440 0x7f2a4c057900 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f2a5c00b000 tx=0x7f2a5c009040).stop 2021-01-03T13:07:41.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.383+0000 7f2a712b9700 1 -- 172.21.15.133:0/2764088192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a6c0b1590 msgr2=0x7f2a6c141d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.383+0000 7f2a712b9700 1 --2- 172.21.15.133:0/2764088192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a6c0b1590 0x7f2a6c141d70 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f2a6c0b3e20 tx=0x7f2a64016000).stop 2021-01-03T13:07:41.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.383+0000 7f2a712b9700 1 -- 172.21.15.133:0/2764088192 shutdown_connections 2021-01-03T13:07:41.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.383+0000 7f2a712b9700 1 --2- 172.21.15.133:0/2764088192 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2a4c055440 0x7f2a4c057900 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.383+0000 7f2a712b9700 1 --2- 172.21.15.133:0/2764088192 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a6c0b1590 0x7f2a6c141d70 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.383+0000 7f2a712b9700 1 --2- 172.21.15.133:0/2764088192 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2a6c05f920 0x7f2a6c152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.383+0000 7f2a712b9700 1 --2- 172.21.15.133:0/2764088192 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a6c066f30 0x7f2a6c0638b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.383+0000 7f2a712b9700 1 -- 172.21.15.133:0/2764088192 >> 172.21.15.133:0/2764088192 conn(0x7f2a6c0b6110 msgr2=0x7f2a6c0b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:41.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.387+0000 7f2a712b9700 1 -- 172.21.15.133:0/2764088192 shutdown_connections 2021-01-03T13:07:41.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.387+0000 7f2a712b9700 1 -- 172.21.15.133:0/2764088192 wait complete. 2021-01-03T13:07:41.403 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:07:41.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c63e8700 1 Processor -- start 2021-01-03T13:07:41.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c63e8700 1 -- start start 2021-01-03T13:07:41.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c63e8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8c00b4c20 0x7ff8c005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:41.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c63e8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8c0060510 0x7ff8c00b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:41.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c63e8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c00b6cf0 con 0x7ff8c005fd10 2021-01-03T13:07:41.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c63e8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c005bf00 con 0x7ff8c00b4c20 2021-01-03T13:07:41.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c63e8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c005c1a0 con 0x7ff8c0060510 2021-01-03T13:07:41.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c53e6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8c00b4c20 0x7ff8c005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:41.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c5be7700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff8c005fd10 0x7ff8c00b65e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33146/0 (socket says 172.21.15.133:33146) 2021-01-03T13:07:41.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c5be7700 1 -- 172.21.15.133:0/3473005159 learned_addr learned my addr 172.21.15.133:0/3473005159 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:41.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c4be5700 1 --2- 172.21.15.133:0/3473005159 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8c0060510 0x7ff8c00b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:41.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c53e6700 1 -- 172.21.15.133:0/3473005159 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8c0060510 msgr2=0x7ff8c00b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:41.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c53e6700 1 --2- 172.21.15.133:0/3473005159 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8c0060510 0x7ff8c00b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c53e6700 1 -- 172.21.15.133:0/3473005159 >> v1:172.21.15.133:6789/0 conn(0x7ff8c005fd10 legacy=0x7ff8c00b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c53e6700 1 -- 172.21.15.133:0/3473005159 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c005c440 con 0x7ff8c00b4c20 2021-01-03T13:07:41.521 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c53e6700 1 --2- 172.21.15.133:0/3473005159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8c00b4c20 0x7ff8c005c8e0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7ff8b8002f30 tx=0x7ff8b8006dc0).ready entity=mon.1 client_cookie=a5bb9206e3f712c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:41.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8bffff700 1 -- 172.21.15.133:0/3473005159 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8b80097f0 con 0x7ff8c00b4c20 2021-01-03T13:07:41.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8bffff700 1 -- 172.21.15.133:0/3473005159 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b8009950 con 0x7ff8c00b4c20 2021-01-03T13:07:41.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8bffff700 1 -- 172.21.15.133:0/3473005159 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8b8009cb0 con 0x7ff8c00b4c20 2021-01-03T13:07:41.522 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c63e8700 1 -- 172.21.15.133:0/3473005159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8c00b4c20 msgr2=0x7ff8c005c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c63e8700 1 --2- 172.21.15.133:0/3473005159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8c00b4c20 0x7ff8c005c8e0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7ff8b8002f30 tx=0x7ff8b8006dc0).stop 2021-01-03T13:07:41.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c63e8700 1 -- 172.21.15.133:0/3473005159 shutdown_connections 2021-01-03T13:07:41.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c63e8700 1 --2- 172.21.15.133:0/3473005159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8c00b4c20 0x7ff8c005c8e0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c63e8700 1 --2- 172.21.15.133:0/3473005159 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8c0060510 0x7ff8c00b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c63e8700 1 -- 172.21.15.133:0/3473005159 >> 172.21.15.133:0/3473005159 conn(0x7ff8c00b9f00 msgr2=0x7ff8c00b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:41.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c63e8700 1 -- 172.21.15.133:0/3473005159 shutdown_connections 2021-01-03T13:07:41.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.511+0000 7ff8c63e8700 1 -- 172.21.15.133:0/3473005159 wait complete. 2021-01-03T13:07:41.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c63e8700 1 Processor -- start 2021-01-03T13:07:41.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c63e8700 1 -- start start 2021-01-03T13:07:41.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c63e8700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8c005fd10 0x7ff8c0143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:41.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c63e8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8c0060510 0x7ff8c01555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:41.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c63e8700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8c00b4c20 0x7ff8c0155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:41.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c63e8700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c0151c50 con 0x7ff8c005fd10 2021-01-03T13:07:41.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c63e8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c009ece0 con 0x7ff8c0060510 2021-01-03T13:07:41.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c63e8700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c009ef80 con 0x7ff8c00b4c20 2021-01-03T13:07:41.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c4be5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8c0060510 0x7ff8c01555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:41.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c4be5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8c0060510 0x7ff8c01555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40352/0 (socket says 172.21.15.133:40352) 2021-01-03T13:07:41.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c4be5700 1 -- 172.21.15.133:0/1754768523 learned_addr learned my addr 172.21.15.133:0/1754768523 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:41.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c53e6700 1 --2- 172.21.15.133:0/1754768523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8c005fd10 0x7ff8c0143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:41.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c5be7700 1 --2- 172.21.15.133:0/1754768523 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8c00b4c20 0x7ff8c0155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:41.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c4be5700 1 -- 172.21.15.133:0/1754768523 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8c00b4c20 msgr2=0x7ff8c0155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c4be5700 1 --2- 172.21.15.133:0/1754768523 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8c00b4c20 0x7ff8c0155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c4be5700 1 -- 172.21.15.133:0/1754768523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8c005fd10 msgr2=0x7ff8c0143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c4be5700 1 --2- 172.21.15.133:0/1754768523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8c005fd10 0x7ff8c0143a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c4be5700 1 -- 172.21.15.133:0/1754768523 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c009f220 con 0x7ff8c0060510 2021-01-03T13:07:41.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c4be5700 1 --2- 172.21.15.133:0/1754768523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8c0060510 0x7ff8c01555a0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7ff8b00033f0 tx=0x7ff8b0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:41.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8be7fc700 1 -- 172.21.15.133:0/1754768523 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8b000ba70 con 0x7ff8c0060510 2021-01-03T13:07:41.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8be7fc700 1 -- 172.21.15.133:0/1754768523 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b000bbd0 con 0x7ff8c0060510 2021-01-03T13:07:41.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8be7fc700 1 -- 172.21.15.133:0/1754768523 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8b0012420 con 0x7ff8c0060510 2021-01-03T13:07:41.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c63e8700 1 -- 172.21.15.133:0/1754768523 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c0155f80 con 0x7ff8c0060510 2021-01-03T13:07:41.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.515+0000 7ff8c63e8700 1 -- 172.21.15.133:0/1754768523 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c0140c40 con 0x7ff8c0060510 2021-01-03T13:07:41.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.519+0000 7ff8c63e8700 1 -- 172.21.15.133:0/1754768523 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c0057300 con 0x7ff8c0060510 2021-01-03T13:07:41.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.519+0000 7ff8be7fc700 1 -- 172.21.15.133:0/1754768523 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff8b0012580 con 0x7ff8c0060510 2021-01-03T13:07:41.532 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.519+0000 7ff8be7fc700 1 --2- 172.21.15.133:0/1754768523 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff8a40553b0 0x7ff8a4057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:41.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.519+0000 7ff8be7fc700 1 -- 172.21.15.133:0/1754768523 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff8b006e470 con 0x7ff8c0060510 2021-01-03T13:07:41.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.519+0000 7ff8c53e6700 1 --2- 172.21.15.133:0/1754768523 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff8a40553b0 0x7ff8a4057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:41.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.519+0000 7ff8c53e6700 1 --2- 172.21.15.133:0/1754768523 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff8a40553b0 0x7ff8a4057870 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7ff8b801b000 tx=0x7ff8b8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:41.533 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.527+0000 7ff8be7fc700 1 -- 172.21.15.133:0/1754768523 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff8b0044670 con 0x7ff8c0060510 2021-01-03T13:07:41.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.667+0000 7ff8c63e8700 1 -- 172.21.15.133:0/1754768523 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff8c00b5760 con 0x7ff8c0060510 2021-01-03T13:07:41.674 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.667+0000 7ff8be7fc700 1 -- 172.21.15.133:0/1754768523 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v152) v1 ==== 104+0+10 (secure 0 0 0) 0x7ff8b0047c90 con 0x7ff8c0060510 2021-01-03T13:07:41.674 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:41.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.667+0000 7ff8c63e8700 1 -- 172.21.15.133:0/1754768523 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff8a40553b0 msgr2=0x7ff8a4057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.667+0000 7ff8c63e8700 1 --2- 172.21.15.133:0/1754768523 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff8a40553b0 0x7ff8a4057870 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7ff8b801b000 tx=0x7ff8b8015000).stop 2021-01-03T13:07:41.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.667+0000 7ff8c63e8700 1 -- 172.21.15.133:0/1754768523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8c0060510 msgr2=0x7ff8c01555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.667+0000 7ff8c63e8700 1 --2- 172.21.15.133:0/1754768523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8c0060510 0x7ff8c01555a0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7ff8b00033f0 tx=0x7ff8b0008040).stop 2021-01-03T13:07:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.671+0000 7ff8c63e8700 1 -- 172.21.15.133:0/1754768523 shutdown_connections 2021-01-03T13:07:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.671+0000 7ff8c63e8700 1 --2- 172.21.15.133:0/1754768523 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff8a40553b0 0x7ff8a4057870 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.671+0000 7ff8c63e8700 1 --2- 172.21.15.133:0/1754768523 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff8c005fd10 0x7ff8c0143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.671+0000 7ff8c63e8700 1 --2- 172.21.15.133:0/1754768523 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8c00b4c20 0x7ff8c0155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.671+0000 7ff8c63e8700 1 --2- 172.21.15.133:0/1754768523 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8c0060510 0x7ff8c01555a0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.671+0000 7ff8c63e8700 1 -- 172.21.15.133:0/1754768523 >> 172.21.15.133:0/1754768523 conn(0x7ff8c00b9f00 msgr2=0x7ff8c009c690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.671+0000 7ff8c63e8700 1 -- 172.21.15.133:0/1754768523 shutdown_connections 2021-01-03T13:07:41.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.671+0000 7ff8c63e8700 1 -- 172.21.15.133:0/1754768523 wait complete. 2021-01-03T13:07:41.688 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:07:41.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.799+0000 7f3e8a323700 1 Processor -- start 2021-01-03T13:07:41.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.799+0000 7f3e8a323700 1 -- start start 2021-01-03T13:07:41.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.799+0000 7f3e8a323700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3e8405c840 0x7f3e840b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:41.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.799+0000 7f3e8a323700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e84140700 con 0x7f3e8413c890 2021-01-03T13:07:41.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.799+0000 7f3e8a323700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e8405cc20 con 0x7f3e8413fb40 2021-01-03T13:07:41.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.799+0000 7f3e8a323700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e840aa1f0 con 0x7f3e8405c840 2021-01-03T13:07:41.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.799+0000 7f3e837fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3e8413fb40 0x7f3e8413fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33160/0 (socket says 172.21.15.133:33160) 2021-01-03T13:07:41.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.799+0000 7f3e837fe700 1 -- 172.21.15.133:0/1393111925 learned_addr learned my addr 172.21.15.133:0/1393111925 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:41.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.799+0000 7f3e83fff700 1 --2- 172.21.15.133:0/1393111925 >> v2:172.21.15.133:3300/0 conn(0x7f3e8405c840 0x7f3e840b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:41.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.799+0000 7f3e82ffd700 1 -- 172.21.15.133:0/1393111925 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924865243 0 0) 0x7f3e8405cc20 con 0x7f3e8413fb40 2021-01-03T13:07:41.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.799+0000 7f3e82ffd700 1 -- 172.21.15.133:0/1393111925 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e64003230 con 0x7f3e8413fb40 2021-01-03T13:07:41.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.799+0000 7f3e83fff700 1 -- 172.21.15.133:0/1393111925 >> v1:172.21.15.133:6789/0 conn(0x7f3e8413fb40 legacy=0x7f3e8413fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.799+0000 7f3e83fff700 1 -- 172.21.15.133:0/1393111925 >> v1:172.21.15.16:6789/0 conn(0x7f3e8413c890 legacy=0x7f3e8413cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.799+0000 7f3e83fff700 1 -- 172.21.15.133:0/1393111925 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e84143df0 con 0x7f3e8405c840 2021-01-03T13:07:41.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.799+0000 7f3e83fff700 1 --2- 172.21.15.133:0/1393111925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e8405c840 0x7f3e840b16b0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f3e840af650 tx=0x7f3e7c006dc0).ready entity=mon.1 client_cookie=41aef78d0541ffbb server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:41.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.799+0000 7f3e82ffd700 1 -- 172.21.15.133:0/1393111925 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e7c0097c0 con 0x7f3e8405c840 2021-01-03T13:07:41.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e82ffd700 1 -- 172.21.15.133:0/1393111925 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c009920 con 0x7f3e8405c840 2021-01-03T13:07:41.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e82ffd700 1 -- 172.21.15.133:0/1393111925 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e7c009c80 con 0x7f3e8405c840 2021-01-03T13:07:41.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e8a323700 1 -- 172.21.15.133:0/1393111925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e8405c840 msgr2=0x7f3e840b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e8a323700 1 --2- 172.21.15.133:0/1393111925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e8405c840 0x7f3e840b16b0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7f3e840af650 tx=0x7f3e7c006dc0).stop 2021-01-03T13:07:41.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e8a323700 1 -- 172.21.15.133:0/1393111925 shutdown_connections 2021-01-03T13:07:41.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e8a323700 1 --2- 172.21.15.133:0/1393111925 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e8405c840 0x7f3e840b16b0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e8a323700 1 -- 172.21.15.133:0/1393111925 >> 172.21.15.133:0/1393111925 conn(0x7f3e8406aeb0 msgr2=0x7f3e8405bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:41.815 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e8a323700 1 -- 172.21.15.133:0/1393111925 shutdown_connections 2021-01-03T13:07:41.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e8a323700 1 -- 172.21.15.133:0/1393111925 wait complete. 2021-01-03T13:07:41.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e8a323700 1 Processor -- start 2021-01-03T13:07:41.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e8a323700 1 -- start start 2021-01-03T13:07:41.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e8a323700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e8405c840 0x7f3e840646a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:41.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e8a323700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e8413c890 0x7f3e84067470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:41.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e8a323700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3e8413fb40 0x7f3e84067960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:41.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e8a323700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e840b6440 con 0x7f3e8405c840 2021-01-03T13:07:41.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e8a323700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e840b4360 con 0x7f3e8413c890 2021-01-03T13:07:41.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e8a323700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e84067e50 con 0x7f3e8413fb40 2021-01-03T13:07:41.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e837fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e8413c890 0x7f3e84067470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:41.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e837fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e8413c890 0x7f3e84067470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40366/0 (socket says 172.21.15.133:40366) 2021-01-03T13:07:41.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e837fe700 1 -- 172.21.15.133:0/1308436309 learned_addr learned my addr 172.21.15.133:0/1308436309 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:41.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e83fff700 1 --2- 172.21.15.133:0/1308436309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e8405c840 0x7f3e840646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:41.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e888c0700 1 --2- 172.21.15.133:0/1308436309 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3e8413fb40 0x7f3e84067960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:41.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e837fe700 1 -- 172.21.15.133:0/1308436309 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3e8413fb40 msgr2=0x7f3e84067960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e837fe700 1 --2- 172.21.15.133:0/1308436309 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3e8413fb40 0x7f3e84067960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e837fe700 1 -- 172.21.15.133:0/1308436309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e8405c840 msgr2=0x7f3e840646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e837fe700 1 --2- 172.21.15.133:0/1308436309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e8405c840 0x7f3e840646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.803+0000 7f3e837fe700 1 -- 172.21.15.133:0/1308436309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e840b4800 con 0x7f3e8413c890 2021-01-03T13:07:41.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.807+0000 7f3e837fe700 1 --2- 172.21.15.133:0/1308436309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e8413c890 0x7f3e84067470 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f3e6c001450 tx=0x7f3e6c007df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:41.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.807+0000 7f3e817fa700 1 -- 172.21.15.133:0/1308436309 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e6c005960 con 0x7f3e8413c890 2021-01-03T13:07:41.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.807+0000 7f3e8a323700 1 -- 172.21.15.133:0/1308436309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e840b66e0 con 0x7f3e8413c890 2021-01-03T13:07:41.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.807+0000 7f3e817fa700 1 -- 172.21.15.133:0/1308436309 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c005ac0 con 0x7f3e8413c890 2021-01-03T13:07:41.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.807+0000 7f3e817fa700 1 -- 172.21.15.133:0/1308436309 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e6c005e20 con 0x7f3e8413c890 2021-01-03T13:07:41.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.807+0000 7f3e8a323700 1 -- 172.21.15.133:0/1308436309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e840b5270 con 0x7f3e8413c890 2021-01-03T13:07:41.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.807+0000 7f3e8a323700 1 -- 172.21.15.133:0/1308436309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e840b6280 con 0x7f3e8413c890 2021-01-03T13:07:41.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.807+0000 7f3e817fa700 1 -- 172.21.15.133:0/1308436309 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3e6c010030 con 0x7f3e8413c890 2021-01-03T13:07:41.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.807+0000 7f3e817fa700 1 --2- 172.21.15.133:0/1308436309 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e680553b0 0x7f3e68057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:41.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.807+0000 7f3e817fa700 1 -- 172.21.15.133:0/1308436309 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3e6c06def0 con 0x7f3e8413c890 2021-01-03T13:07:41.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.807+0000 7f3e83fff700 1 --2- 172.21.15.133:0/1308436309 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e680553b0 0x7f3e68057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:41.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.807+0000 7f3e83fff700 1 --2- 172.21.15.133:0/1308436309 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e680553b0 0x7f3e68057870 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f3e7c01b000 tx=0x7f3e7c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:41.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.815+0000 7f3e817fa700 1 -- 172.21.15.133:0/1308436309 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3e6c044150 con 0x7f3e8413c890 2021-01-03T13:07:41.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.955+0000 7f3e8a323700 1 -- 172.21.15.133:0/1308436309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e84057300 con 0x7f3e8413c890 2021-01-03T13:07:41.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.955+0000 7f3e817fa700 1 -- 172.21.15.133:0/1308436309 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v152) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3e6c047770 con 0x7f3e8413c890 2021-01-03T13:07:41.961 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:41.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.955+0000 7f3e8a323700 1 -- 172.21.15.133:0/1308436309 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e680553b0 msgr2=0x7f3e68057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.955+0000 7f3e8a323700 1 --2- 172.21.15.133:0/1308436309 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e680553b0 0x7f3e68057870 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f3e7c01b000 tx=0x7f3e7c015000).stop 2021-01-03T13:07:41.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.955+0000 7f3e8a323700 1 -- 172.21.15.133:0/1308436309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e8413c890 msgr2=0x7f3e84067470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:41.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.955+0000 7f3e8a323700 1 --2- 172.21.15.133:0/1308436309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e8413c890 0x7f3e84067470 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f3e6c001450 tx=0x7f3e6c007df0).stop 2021-01-03T13:07:41.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.955+0000 7f3e8a323700 1 -- 172.21.15.133:0/1308436309 shutdown_connections 2021-01-03T13:07:41.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.955+0000 7f3e8a323700 1 --2- 172.21.15.133:0/1308436309 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f3e680553b0 0x7f3e68057870 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.955+0000 7f3e8a323700 1 --2- 172.21.15.133:0/1308436309 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e8405c840 0x7f3e840646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.955+0000 7f3e8a323700 1 --2- 172.21.15.133:0/1308436309 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f3e8413fb40 0x7f3e84067960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.955+0000 7f3e8a323700 1 --2- 172.21.15.133:0/1308436309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e8413c890 0x7f3e84067470 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:41.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.955+0000 7f3e8a323700 1 -- 172.21.15.133:0/1308436309 >> 172.21.15.133:0/1308436309 conn(0x7f3e8406aeb0 msgr2=0x7f3e8413e620 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:41.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.955+0000 7f3e8a323700 1 -- 172.21.15.133:0/1308436309 shutdown_connections 2021-01-03T13:07:41.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:41.955+0000 7f3e8a323700 1 -- 172.21.15.133:0/1308436309 wait complete. 2021-01-03T13:07:41.974 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:07:41.975 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:07:42.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.079+0000 7fcb90e60700 1 Processor -- start 2021-01-03T13:07:42.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.079+0000 7fcb90e60700 1 -- start start 2021-01-03T13:07:42.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.079+0000 7fcb90e60700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb8c0b9b60 0x7fcb8c0b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:42.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.079+0000 7fcb90e60700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb8c0b4980 0x7fcb8c0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:42.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.079+0000 7fcb90e60700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8c0605f0 con 0x7fcb8c146430 2021-01-03T13:07:42.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.079+0000 7fcb90e60700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8c0aed30 con 0x7fcb8c0b9b60 2021-01-03T13:07:42.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.079+0000 7fcb90e60700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c146fd0 con 0x7fcb8c0b4980 2021-01-03T13:07:42.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.079+0000 7fcb8b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb8c0b9b60 0x7fcb8c0b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:42.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.079+0000 7fcb8bfff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcb8c146430 0x7fcb8c1468c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33174/0 (socket says 172.21.15.133:33174) 2021-01-03T13:07:42.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.079+0000 7fcb8b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcb8c0b9b60 0x7fcb8c0b9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40372/0 (socket says 172.21.15.133:40372) 2021-01-03T13:07:42.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.079+0000 7fcb8bfff700 1 -- 172.21.15.133:0/1833197888 learned_addr learned my addr 172.21.15.133:0/1833197888 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:42.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.079+0000 7fcb8affd700 1 --2- 172.21.15.133:0/1833197888 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb8c0b4980 0x7fcb8c0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:42.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb8b7fe700 1 -- 172.21.15.133:0/1833197888 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb8c0b4980 msgr2=0x7fcb8c0b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:42.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb8b7fe700 1 --2- 172.21.15.133:0/1833197888 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb8c0b4980 0x7fcb8c0b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:42.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb8b7fe700 1 -- 172.21.15.133:0/1833197888 >> v1:172.21.15.133:6789/0 conn(0x7fcb8c146430 legacy=0x7fcb8c1468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:42.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb8a7fc700 1 -- 172.21.15.133:0/1833197888 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237240924 0 0) 0x7fcb8c0605f0 con 0x7fcb8c146430 2021-01-03T13:07:42.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb8b7fe700 1 -- 172.21.15.133:0/1833197888 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c0600b0 con 0x7fcb8c0b9b60 2021-01-03T13:07:42.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb8b7fe700 1 --2- 172.21.15.133:0/1833197888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb8c0b9b60 0x7fcb8c0b9f40 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7fcb7c0032b0 tx=0x7fcb7c0091a0).ready entity=mon.1 client_cookie=18d092f3e77db1a3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:42.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb8a7fc700 1 -- 172.21.15.133:0/1833197888 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb7c00b9a0 con 0x7fcb8c0b9b60 2021-01-03T13:07:42.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb8a7fc700 1 -- 172.21.15.133:0/1833197888 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c00bb00 con 0x7fcb8c0b9b60 2021-01-03T13:07:42.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb90e60700 1 -- 172.21.15.133:0/1833197888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb8c0b9b60 msgr2=0x7fcb8c0b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:42.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb90e60700 1 --2- 172.21.15.133:0/1833197888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb8c0b9b60 0x7fcb8c0b9f40 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7fcb7c0032b0 tx=0x7fcb7c0091a0).stop 2021-01-03T13:07:42.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb90e60700 1 -- 172.21.15.133:0/1833197888 shutdown_connections 2021-01-03T13:07:42.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb90e60700 1 --2- 172.21.15.133:0/1833197888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb8c0b9b60 0x7fcb8c0b9f40 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:42.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb90e60700 1 --2- 172.21.15.133:0/1833197888 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb8c0b4980 0x7fcb8c0b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:42.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb90e60700 1 -- 172.21.15.133:0/1833197888 >> 172.21.15.133:0/1833197888 conn(0x7fcb8c0b69e0 msgr2=0x7fcb8c0b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:42.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb90e60700 1 -- 172.21.15.133:0/1833197888 shutdown_connections 2021-01-03T13:07:42.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb90e60700 1 -- 172.21.15.133:0/1833197888 wait complete. 2021-01-03T13:07:42.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb90e60700 1 Processor -- start 2021-01-03T13:07:42.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb90e60700 1 -- start start 2021-01-03T13:07:42.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb90e60700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb8c0b4980 0x7fcb8c09eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:42.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb90e60700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb8c0b9b60 0x7fcb8c142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:42.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb90e60700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c146430 0x7fcb8c142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:42.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb90e60700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c09f4d0 con 0x7fcb8c146430 2021-01-03T13:07:42.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb90e60700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0b20f0 con 0x7fcb8c0b4980 2021-01-03T13:07:42.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb90e60700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c140b90 con 0x7fcb8c0b9b60 2021-01-03T13:07:42.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb8b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb8c0b4980 0x7fcb8c09eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:42.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb8b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb8c0b4980 0x7fcb8c09eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40378/0 (socket says 172.21.15.133:40378) 2021-01-03T13:07:42.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb8b7fe700 1 -- 172.21.15.133:0/1069094451 learned_addr learned my addr 172.21.15.133:0/1069094451 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:42.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb8affd700 1 --2- 172.21.15.133:0/1069094451 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb8c0b9b60 0x7fcb8c142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:42.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.083+0000 7fcb8bfff700 1 --2- 172.21.15.133:0/1069094451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c146430 0x7fcb8c142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:42.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb8b7fe700 1 -- 172.21.15.133:0/1069094451 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb8c0b9b60 msgr2=0x7fcb8c142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:42.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb8b7fe700 1 --2- 172.21.15.133:0/1069094451 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb8c0b9b60 0x7fcb8c142920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:42.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb8b7fe700 1 -- 172.21.15.133:0/1069094451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c146430 msgr2=0x7fcb8c142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:42.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb8b7fe700 1 --2- 172.21.15.133:0/1069094451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c146430 0x7fcb8c142e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:42.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb8b7fe700 1 -- 172.21.15.133:0/1069094451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c140e30 con 0x7fcb8c0b4980 2021-01-03T13:07:42.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb8affd700 1 --2- 172.21.15.133:0/1069094451 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb8c0b9b60 0x7fcb8c142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:42.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb8b7fe700 1 --2- 172.21.15.133:0/1069094451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb8c0b4980 0x7fcb8c09eae0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7fcb7c0032b0 tx=0x7fcb7c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:42.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb88ff9700 1 -- 172.21.15.133:0/1069094451 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb7c011e80 con 0x7fcb8c0b4980 2021-01-03T13:07:42.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb88ff9700 1 -- 172.21.15.133:0/1069094451 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c01f3f0 con 0x7fcb8c0b4980 2021-01-03T13:07:42.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb90e60700 1 -- 172.21.15.133:0/1069094451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c1412d0 con 0x7fcb8c0b4980 2021-01-03T13:07:42.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb88ff9700 1 -- 172.21.15.133:0/1069094451 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb7c01f750 con 0x7fcb8c0b4980 2021-01-03T13:07:42.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb90e60700 1 -- 172.21.15.133:0/1069094451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8c0b1d90 con 0x7fcb8c0b4980 2021-01-03T13:07:42.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb88ff9700 1 -- 172.21.15.133:0/1069094451 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fcb7c026030 con 0x7fcb8c0b4980 2021-01-03T13:07:42.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb90e60700 1 -- 172.21.15.133:0/1069094451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8c0b2b00 con 0x7fcb8c0b4980 2021-01-03T13:07:42.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb88ff9700 1 --2- 172.21.15.133:0/1069094451 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb6c055440 0x7fcb6c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:42.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb88ff9700 1 -- 172.21.15.133:0/1069094451 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcb7c06eba0 con 0x7fcb8c0b4980 2021-01-03T13:07:42.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb8affd700 1 --2- 172.21.15.133:0/1069094451 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb6c055440 0x7fcb6c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:42.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.087+0000 7fcb8affd700 1 --2- 172.21.15.133:0/1069094451 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb6c055440 0x7fcb6c057900 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fcb8000b000 tx=0x7fcb80008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:42.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.091+0000 7fcb88ff9700 1 -- 172.21.15.133:0/1069094451 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcb8c0b2b00 con 0x7fcb8c0b4980 2021-01-03T13:07:42.282 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.275+0000 7fcb90e60700 1 -- 172.21.15.133:0/1069094451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb8c0b2b00 con 0x7fcb8c0b4980 2021-01-03T13:07:42.283 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.275+0000 7fcb88ff9700 1 -- 172.21.15.133:0/1069094451 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+2501 (secure 0 0 0) 0x7fcb8c0b2b00 con 0x7fcb8c0b4980 2021-01-03T13:07:42.283 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:42.283 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":72,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/3955382552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3955382552},{"type":"v1","addr":"172.21.15.16:6833","nonce":3955382552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6836/2756803911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2756803911},{"type":"v1","addr":"172.21.15.133:6836","nonce":2756803911}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:32.737122+0000","modified":"2021-01-03T13:07:34.405167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8167":{"gid":8167,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/3125642229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3125642229},{"type":"v1","addr":"172.21.15.133:6837","nonce":3125642229}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-01-03T13:07:42.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.279+0000 7fcb90e60700 1 -- 172.21.15.133:0/1069094451 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb6c055440 msgr2=0x7fcb6c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:42.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.279+0000 7fcb90e60700 1 --2- 172.21.15.133:0/1069094451 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb6c055440 0x7fcb6c057900 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fcb8000b000 tx=0x7fcb80008040).stop 2021-01-03T13:07:42.286 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.279+0000 7fcb90e60700 1 -- 172.21.15.133:0/1069094451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb8c0b4980 msgr2=0x7fcb8c09eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:42.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.279+0000 7fcb90e60700 1 --2- 172.21.15.133:0/1069094451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb8c0b4980 0x7fcb8c09eae0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7fcb7c0032b0 tx=0x7fcb7c016000).stop 2021-01-03T13:07:42.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.279+0000 7fcb90e60700 1 -- 172.21.15.133:0/1069094451 shutdown_connections 2021-01-03T13:07:42.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.279+0000 7fcb90e60700 1 --2- 172.21.15.133:0/1069094451 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb6c055440 0x7fcb6c057900 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:42.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.279+0000 7fcb90e60700 1 --2- 172.21.15.133:0/1069094451 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb8c146430 0x7fcb8c142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:42.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.279+0000 7fcb90e60700 1 --2- 172.21.15.133:0/1069094451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb8c0b4980 0x7fcb8c09eae0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:42.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.279+0000 7fcb90e60700 1 --2- 172.21.15.133:0/1069094451 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb8c0b9b60 0x7fcb8c142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:42.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.279+0000 7fcb90e60700 1 -- 172.21.15.133:0/1069094451 >> 172.21.15.133:0/1069094451 conn(0x7fcb8c0b69e0 msgr2=0x7fcb8c0b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:42.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.279+0000 7fcb90e60700 1 -- 172.21.15.133:0/1069094451 shutdown_connections 2021-01-03T13:07:42.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:42.279+0000 7fcb90e60700 1 -- 172.21.15.133:0/1069094451 wait complete. 2021-01-03T13:07:42.289 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 72 2021-01-03T13:07:42.604 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:07:32.737122+0000', 'modified': '2021-01-03T13:07:34.405167+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8167}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8167': {'gid': 8167, 'name': 'c', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/3125642229', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6835', 'nonce': 3125642229}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 3125642229}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:07:42.604 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:07:42.605 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2021-01-03T13:07:42.737 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":8167,"want_state":"up:active","state":"up:active","rank_uptime":9.9846130679999998,"mdsmap_epoch":72,"osdmap_epoch":152,"osdmap_epoch_barrier":152,"uptime":14.208233857} 2021-01-03T13:07:42.737 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 8167, "mdsmap_epoch": 72, "osdmap_epoch": 152, "osdmap_epoch_barrier": 152, "rank_uptime": 9.984613068, "state": "up:active", "uptime": 14.208233857, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:07:42.738 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:07:42.738 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-01-03T13:07:42.739 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi036.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-01-03T13:07:42.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:42.739 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:42.747 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:07:42.804 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:07:42.805 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:07:42.861 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:07:42.862 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:07:42.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:42.863 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:07:42.912 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:07:42.912 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:42.956 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:07:42.971 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:07:42.972 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:07:43.028 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:07:43.029 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:07:43.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:43.030 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:07:43.033 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:2021-01-03T13:07:43.030+0000 7f9741a0c0c0 -1 init, newargv = 0x55d57f1cfe10 newargc=9 2021-01-03T13:07:43.034 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[12423]: starting ceph client 2021-01-03T13:07:43.045 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[12423]: starting fuse 2021-01-03T13:07:44.140 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:07:44.156 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:07:44.157 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:07:44.212 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:07:44.213 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:07:44.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:44.214 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:07:44.260 INFO:teuthology.orchestra.run.smithi036.stdout:50 2021-01-03T13:07:44.260 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:07:44.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:44.261 DEBUG:teuthology.orchestra.run.smithi036:> sudo python3 -c ' 2021-01-03T13:07:44.261 DEBUG:teuthology.orchestra.run.smithi036:> import glob 2021-01-03T13:07:44.262 DEBUG:teuthology.orchestra.run.smithi036:> import re 2021-01-03T13:07:44.262 DEBUG:teuthology.orchestra.run.smithi036:> import os 2021-01-03T13:07:44.262 DEBUG:teuthology.orchestra.run.smithi036:> import subprocess 2021-01-03T13:07:44.263 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:07:44.263 DEBUG:teuthology.orchestra.run.smithi036:> def find_socket(client_name): 2021-01-03T13:07:44.264 DEBUG:teuthology.orchestra.run.smithi036:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-01-03T13:07:44.264 DEBUG:teuthology.orchestra.run.smithi036:> files = glob.glob(asok_path) 2021-01-03T13:07:44.264 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:07:44.265 DEBUG:teuthology.orchestra.run.smithi036:> # Given a non-glob path, it better be there 2021-01-03T13:07:44.265 DEBUG:teuthology.orchestra.run.smithi036:> if "*" not in asok_path: 2021-01-03T13:07:44.265 DEBUG:teuthology.orchestra.run.smithi036:> assert(len(files) == 1) 2021-01-03T13:07:44.266 DEBUG:teuthology.orchestra.run.smithi036:> return files[0] 2021-01-03T13:07:44.266 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:07:44.267 DEBUG:teuthology.orchestra.run.smithi036:> for f in files: 2021-01-03T13:07:44.267 DEBUG:teuthology.orchestra.run.smithi036:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:07:44.268 DEBUG:teuthology.orchestra.run.smithi036:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:07:44.268 DEBUG:teuthology.orchestra.run.smithi036:> return f 2021-01-03T13:07:44.269 DEBUG:teuthology.orchestra.run.smithi036:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:07:44.269 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:07:44.270 DEBUG:teuthology.orchestra.run.smithi036:> print(find_socket("client.1")) 2021-01-03T13:07:44.270 DEBUG:teuthology.orchestra.run.smithi036:> ' 2021-01-03T13:07:44.350 INFO:teuthology.orchestra.run.smithi036.stdout:/var/run/ceph/ceph-client.1.12423.asok 2021-01-03T13:07:44.355 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.12423.asok 2021-01-03T13:07:44.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:44.356 DEBUG:teuthology.orchestra.run.smithi036:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.12423.asok status 2021-01-03T13:07:44.457 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2021-01-03T13:07:44.458 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": { 2021-01-03T13:07:44.458 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:07:44.458 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:07:44.458 INFO:teuthology.orchestra.run.smithi036.stdout: "entity_id": "1", 2021-01-03T13:07:44.459 INFO:teuthology.orchestra.run.smithi036.stdout: "hostname": "smithi036", 2021-01-03T13:07:44.459 INFO:teuthology.orchestra.run.smithi036.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-01-03T13:07:44.459 INFO:teuthology.orchestra.run.smithi036.stdout: "pid": "12423", 2021-01-03T13:07:44.459 INFO:teuthology.orchestra.run.smithi036.stdout: "root": "/" 2021-01-03T13:07:44.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:07:44.460 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_count": 0, 2021-01-03T13:07:44.460 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_pinned_count": 0, 2021-01-03T13:07:44.460 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 8395, 2021-01-03T13:07:44.460 INFO:teuthology.orchestra.run.smithi036.stdout: "inst": { 2021-01-03T13:07:44.460 INFO:teuthology.orchestra.run.smithi036.stdout: "name": { 2021-01-03T13:07:44.461 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "client", 2021-01-03T13:07:44.461 INFO:teuthology.orchestra.run.smithi036.stdout: "num": 8395 2021-01-03T13:07:44.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:07:44.461 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:07:44.461 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:07:44.462 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:07:44.462 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 4216803521 2021-01-03T13:07:44.462 INFO:teuthology.orchestra.run.smithi036.stdout: } 2021-01-03T13:07:44.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:07:44.462 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:07:44.463 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:07:44.463 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:07:44.463 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 4216803521 2021-01-03T13:07:44.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:07:44.463 INFO:teuthology.orchestra.run.smithi036.stdout: "inst_str": "client.8395 172.21.15.36:0/4216803521", 2021-01-03T13:07:44.464 INFO:teuthology.orchestra.run.smithi036.stdout: "addr_str": "172.21.15.36:0/4216803521", 2021-01-03T13:07:44.464 INFO:teuthology.orchestra.run.smithi036.stdout: "inode_count": 1, 2021-01-03T13:07:44.464 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_epoch": 72, 2021-01-03T13:07:44.464 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch": 152, 2021-01-03T13:07:44.464 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:07:44.465 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklisted": false, 2021-01-03T13:07:44.465 INFO:teuthology.orchestra.run.smithi036.stdout: "fs_name": "cephfs" 2021-01-03T13:07:44.465 INFO:teuthology.orchestra.run.smithi036.stdout:} 2021-01-03T13:07:44.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:44.468 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:44.469 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:44.475 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:07:44.476 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:07:44.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:44.477 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:44.535 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-01-03T13:07:44.536 DEBUG:teuthology.orchestra.run.smithi007:> cd /home/ubuntu/cephtest/mnt.0 && sudo getfattr --only-values -n ceph.dir.rctime . 2021-01-03T13:07:44.581 INFO:teuthology.orchestra.run.smithi007.stdout:1609679264.532809636 2021-01-03T13:07:44.581 INFO:tasks.cephfs.test_misc:rctime = 1609679264.532809636 2021-01-03T13:07:44.582 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:07:44.582 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:07:44.639 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:07:44.657 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:07:44.675 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:07:44.693 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:07:44.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:44.694 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:44.694 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:44.702 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:07:44.703 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:07:44.703 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2021-01-03T13:07:44.704 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:07:44.704 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:44.778 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12868]: fuse finished with error 0 and tester_r 0 2021-01-03T13:07:44.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:44.781 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:44.781 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:44.828 INFO:teuthology.orchestra.run.smithi007.stdout:ext2/ext3 2021-01-03T13:07:44.829 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:07:44.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:07:44.830 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:44.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:44.880 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:44.881 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:44.888 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:07:44.889 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:07:44.890 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi036.front.sepia.ceph.com... 2021-01-03T13:07:44.890 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:07:44.891 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:44.962 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[12423]: fuse finished with error 0 and tester_r 0 2021-01-03T13:07:44.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:44.965 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:44.965 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:45.016 INFO:teuthology.orchestra.run.smithi036.stdout:ext2/ext3 2021-01-03T13:07:45.017 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:07:45.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:07:45.028 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:45.077 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2021-01-03T13:07:45.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa227fff700 1 Processor -- start 2021-01-03T13:07:45.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa227fff700 1 -- start start 2021-01-03T13:07:45.204 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa227fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa2280b9f40 0x7fa228146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:45.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa227fff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa228146920 0x7fa22814d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:45.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa227fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2280605f0 con 0x7fa2280b9b60 2021-01-03T13:07:45.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa227fff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2280aed30 con 0x7fa228146920 2021-01-03T13:07:45.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa227fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280600b0 con 0x7fa2280b9f40 2021-01-03T13:07:45.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa226ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa2280b9b60 0x7fa2280b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33188/0 (socket says 172.21.15.133:33188) 2021-01-03T13:07:45.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa226ffd700 1 -- 172.21.15.133:0/280702902 learned_addr learned my addr 172.21.15.133:0/280702902 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:45.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa2267fc700 1 --2- 172.21.15.133:0/280702902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa2280b9f40 0x7fa228146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:45.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa2277fe700 1 --2- 172.21.15.133:0/280702902 >> v2:172.21.15.16:3300/0 conn(0x7fa228146920 0x7fa22814d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:45.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa225ffb700 1 -- 172.21.15.133:0/280702902 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280020746 0 0) 0x7fa2280605f0 con 0x7fa2280b9b60 2021-01-03T13:07:45.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa225ffb700 1 -- 172.21.15.133:0/280702902 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa20c003230 con 0x7fa2280b9b60 2021-01-03T13:07:45.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa225ffb700 1 -- 172.21.15.133:0/280702902 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3545715632 0 0) 0x7fa20c003230 con 0x7fa2280b9b60 2021-01-03T13:07:45.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa225ffb700 1 -- 172.21.15.133:0/280702902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa2280b9f40 msgr2=0x7fa228146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:45.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa225ffb700 1 --2- 172.21.15.133:0/280702902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa2280b9f40 0x7fa228146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:45.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa225ffb700 1 -- 172.21.15.133:0/280702902 >> v2:172.21.15.16:3300/0 conn(0x7fa228146920 msgr2=0x7fa22814d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:45.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa225ffb700 1 --2- 172.21.15.133:0/280702902 >> v2:172.21.15.16:3300/0 conn(0x7fa228146920 0x7fa22814d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:45.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa225ffb700 1 -- 172.21.15.133:0/280702902 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa228060350 con 0x7fa2280b9b60 2021-01-03T13:07:45.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa225ffb700 1 -- 172.21.15.133:0/280702902 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fa2200016d0 con 0x7fa2280b9b60 2021-01-03T13:07:45.208 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa225ffb700 1 -- 172.21.15.133:0/280702902 >> v1:172.21.15.133:6789/0 conn(0x7fa2280b9b60 legacy=0x7fa2280b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:45.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa225ffb700 1 --2- 172.21.15.133:0/280702902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa20c003720 0x7fa20c003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:45.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa225ffb700 1 --2- 172.21.15.133:0/280702902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa2280b9f40 0x7fa20c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:45.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa225ffb700 1 --2- 172.21.15.133:0/280702902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20c0049c0 0x7fa20c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:45.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa225ffb700 1 -- 172.21.15.133:0/280702902 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280aed30 con 0x7fa20c0049c0 2021-01-03T13:07:45.209 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa225ffb700 1 -- 172.21.15.133:0/280702902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280600b0 con 0x7fa20c003720 2021-01-03T13:07:45.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa225ffb700 1 -- 172.21.15.133:0/280702902 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20c004130 con 0x7fa2280b9f40 2021-01-03T13:07:45.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa226ffd700 1 --2- 172.21.15.133:0/280702902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa20c003720 0x7fa20c003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:45.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa2267fc700 1 --2- 172.21.15.133:0/280702902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa2280b9f40 0x7fa20c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:45.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa2277fe700 1 --2- 172.21.15.133:0/280702902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20c0049c0 0x7fa20c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:45.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa226ffd700 1 -- 172.21.15.133:0/280702902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa2280b9f40 msgr2=0x7fa20c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:45.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa226ffd700 1 --2- 172.21.15.133:0/280702902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa2280b9f40 0x7fa20c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:45.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa226ffd700 1 -- 172.21.15.133:0/280702902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20c0049c0 msgr2=0x7fa20c004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:45.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa226ffd700 1 --2- 172.21.15.133:0/280702902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20c0049c0 0x7fa20c004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:45.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa226ffd700 1 -- 172.21.15.133:0/280702902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c003230 con 0x7fa20c003720 2021-01-03T13:07:45.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.195+0000 7fa2277fe700 1 --2- 172.21.15.133:0/280702902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa20c0049c0 0x7fa20c004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:45.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.199+0000 7fa226ffd700 1 --2- 172.21.15.133:0/280702902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa20c003720 0x7fa20c003b00 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7fa220001000 tx=0x7fa2281409c0).ready entity=mon.1 client_cookie=9aaa076f36f69eec server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:45.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.199+0000 7fa225ffb700 1 -- 172.21.15.133:0/280702902 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa220008170 con 0x7fa20c003720 2021-01-03T13:07:45.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.199+0000 7fa225ffb700 1 -- 172.21.15.133:0/280702902 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2200082d0 con 0x7fa20c003720 2021-01-03T13:07:45.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.199+0000 7fa225ffb700 1 -- 172.21.15.133:0/280702902 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa2200059e0 con 0x7fa20c003720 2021-01-03T13:07:45.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.199+0000 7fa227fff700 1 -- 172.21.15.133:0/280702902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa20c003720 msgr2=0x7fa20c003b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:45.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.199+0000 7fa227fff700 1 --2- 172.21.15.133:0/280702902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa20c003720 0x7fa20c003b00 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7fa220001000 tx=0x7fa2281409c0).stop 2021-01-03T13:07:45.213 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.199+0000 7fa2277fe700 1 -- 172.21.15.133:0/280702902 reap_dead start 2021-01-03T13:07:45.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.199+0000 7fa227fff700 1 -- 172.21.15.133:0/280702902 shutdown_connections 2021-01-03T13:07:45.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.199+0000 7fa227fff700 1 -- 172.21.15.133:0/280702902 >> 172.21.15.133:0/280702902 conn(0x7fa2280b69e0 msgr2=0x7fa2280b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:45.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.199+0000 7fa227fff700 1 -- 172.21.15.133:0/280702902 shutdown_connections 2021-01-03T13:07:45.216 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.199+0000 7fa227fff700 1 -- 172.21.15.133:0/280702902 wait complete. 2021-01-03T13:07:45.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa227fff700 1 Processor -- start 2021-01-03T13:07:45.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa227fff700 1 -- start start 2021-01-03T13:07:45.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa227fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa22809e370 0x7fa2280b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:45.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa227fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa22809f1c0 0x7fa228142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:45.217 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa227fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa228141c50 0x7fa2281420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:45.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa227fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280b1390 con 0x7fa22809e370 2021-01-03T13:07:45.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa227fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22809e750 con 0x7fa22809f1c0 2021-01-03T13:07:45.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa227fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa228062800 con 0x7fa228141c50 2021-01-03T13:07:45.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa2267fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa22809f1c0 0x7fa228142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:45.218 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa226ffd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa22809e370 0x7fa2280b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:45.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa2267fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa22809f1c0 0x7fa228142a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40400/0 (socket says 172.21.15.133:40400) 2021-01-03T13:07:45.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa2267fc700 1 -- 172.21.15.133:0/800390789 learned_addr learned my addr 172.21.15.133:0/800390789 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:45.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa2277fe700 1 --2- 172.21.15.133:0/800390789 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa228141c50 0x7fa2281420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:45.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa2267fc700 1 -- 172.21.15.133:0/800390789 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa228141c50 msgr2=0x7fa2281420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:45.219 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa2267fc700 1 --2- 172.21.15.133:0/800390789 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa228141c50 0x7fa2281420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:45.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa2267fc700 1 -- 172.21.15.133:0/800390789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa22809e370 msgr2=0x7fa2280b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:45.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa2267fc700 1 --2- 172.21.15.133:0/800390789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa22809e370 0x7fa2280b1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:45.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa2267fc700 1 -- 172.21.15.133:0/800390789 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2281527f0 con 0x7fa22809f1c0 2021-01-03T13:07:45.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa2267fc700 1 --2- 172.21.15.133:0/800390789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa22809f1c0 0x7fa228142a20 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7fa22814fa50 tx=0x7fa210008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:45.220 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa21ffff700 1 -- 172.21.15.133:0/800390789 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa21000edc0 con 0x7fa22809f1c0 2021-01-03T13:07:45.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa21ffff700 1 -- 172.21.15.133:0/800390789 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa210014430 con 0x7fa22809f1c0 2021-01-03T13:07:45.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa227fff700 1 -- 172.21.15.133:0/800390789 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa228152a90 con 0x7fa22809f1c0 2021-01-03T13:07:45.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa21ffff700 1 -- 172.21.15.133:0/800390789 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa210014790 con 0x7fa22809f1c0 2021-01-03T13:07:45.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.203+0000 7fa227fff700 1 -- 172.21.15.133:0/800390789 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22809edc0 con 0x7fa22809f1c0 2021-01-03T13:07:45.221 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.207+0000 7fa227fff700 1 -- 172.21.15.133:0/800390789 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa228057300 con 0x7fa22809f1c0 2021-01-03T13:07:45.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.207+0000 7fa21ffff700 1 -- 172.21.15.133:0/800390789 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa210024070 con 0x7fa22809f1c0 2021-01-03T13:07:45.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.207+0000 7fa21ffff700 1 --2- 172.21.15.133:0/800390789 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa2000553b0 0x7fa200057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:45.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.207+0000 7fa21ffff700 1 -- 172.21.15.133:0/800390789 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa21006e9d0 con 0x7fa22809f1c0 2021-01-03T13:07:45.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.207+0000 7fa226ffd700 1 --2- 172.21.15.133:0/800390789 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa2000553b0 0x7fa200057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:45.222 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.207+0000 7fa226ffd700 1 --2- 172.21.15.133:0/800390789 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa2000553b0 0x7fa200057870 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fa22001b000 tx=0x7fa220014000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:45.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.211+0000 7fa21ffff700 1 -- 172.21.15.133:0/800390789 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa210044cd0 con 0x7fa22809f1c0 2021-01-03T13:07:45.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.351+0000 7fa227fff700 1 -- 172.21.15.133:0/800390789 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa228142750 con 0x7fa22809f1c0 2021-01-03T13:07:45.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.359+0000 7fa21ffff700 1 -- 172.21.15.133:0/800390789 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa2100482f0 con 0x7fa22809f1c0 2021-01-03T13:07:45.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.359+0000 7fa227fff700 1 -- 172.21.15.133:0/800390789 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa2000553b0 msgr2=0x7fa200057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:45.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.359+0000 7fa227fff700 1 --2- 172.21.15.133:0/800390789 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa2000553b0 0x7fa200057870 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fa22001b000 tx=0x7fa220014000).stop 2021-01-03T13:07:45.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.359+0000 7fa227fff700 1 -- 172.21.15.133:0/800390789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa22809f1c0 msgr2=0x7fa228142a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:45.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.359+0000 7fa227fff700 1 --2- 172.21.15.133:0/800390789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa22809f1c0 0x7fa228142a20 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7fa22814fa50 tx=0x7fa210008040).stop 2021-01-03T13:07:45.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.363+0000 7fa227fff700 1 -- 172.21.15.133:0/800390789 shutdown_connections 2021-01-03T13:07:45.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.363+0000 7fa227fff700 1 --2- 172.21.15.133:0/800390789 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa2000553b0 0x7fa200057870 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:45.369 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.363+0000 7fa227fff700 1 --2- 172.21.15.133:0/800390789 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa22809e370 0x7fa2280b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:45.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.363+0000 7fa227fff700 1 --2- 172.21.15.133:0/800390789 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa228141c50 0x7fa2281420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:45.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.363+0000 7fa227fff700 1 --2- 172.21.15.133:0/800390789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa22809f1c0 0x7fa228142a20 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:45.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.363+0000 7fa227fff700 1 -- 172.21.15.133:0/800390789 >> 172.21.15.133:0/800390789 conn(0x7fa2280b69e0 msgr2=0x7fa228062060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:45.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.363+0000 7fa227fff700 1 -- 172.21.15.133:0/800390789 shutdown_connections 2021-01-03T13:07:45.370 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.363+0000 7fa227fff700 1 -- 172.21.15.133:0/800390789 wait complete. 2021-01-03T13:07:45.382 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2021-01-03T13:07:45.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.483+0000 7faf09a0a700 1 Processor -- start 2021-01-03T13:07:45.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf09a0a700 1 -- start start 2021-01-03T13:07:45.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf09a0a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf040b0c90 0x7faf040b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:45.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf09a0a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faf040b5c00 0x7faf04143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:45.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf09a0a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf04060da0 con 0x7faf040b52c0 2021-01-03T13:07:45.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf09a0a700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf04067a90 con 0x7faf040b5c00 2021-01-03T13:07:45.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf09a0a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf040b0ad0 con 0x7faf040b0c90 2021-01-03T13:07:45.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf03fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf040b0c90 0x7faf040b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:45.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf03fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf040b0c90 0x7faf040b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40406/0 (socket says 172.21.15.133:40406) 2021-01-03T13:07:45.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf03fff700 1 -- 172.21.15.133:0/775660640 learned_addr learned my addr 172.21.15.133:0/775660640 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:45.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf09209700 1 --2- 172.21.15.133:0/775660640 >> v2:172.21.15.16:3300/0 conn(0x7faf040b5c00 0x7faf04143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:45.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf03fff700 1 -- 172.21.15.133:0/775660640 >> v2:172.21.15.16:3300/0 conn(0x7faf040b5c00 msgr2=0x7faf04143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:45.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf03fff700 1 --2- 172.21.15.133:0/775660640 >> v2:172.21.15.16:3300/0 conn(0x7faf040b5c00 0x7faf04143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:45.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf03fff700 1 -- 172.21.15.133:0/775660640 >> v1:172.21.15.16:6789/0 conn(0x7faf040b52c0 legacy=0x7faf04098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:45.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf03fff700 1 -- 172.21.15.133:0/775660640 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040b56a0 con 0x7faf040b0c90 2021-01-03T13:07:45.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf03fff700 1 --2- 172.21.15.133:0/775660640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf040b0c90 0x7faf040b05e0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7faf04098e10 tx=0x7faef0006e80).ready entity=mon.1 client_cookie=91c5d24a5dce50c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:45.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf037fe700 1 -- 172.21.15.133:0/775660640 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef00097b0 con 0x7faf040b0c90 2021-01-03T13:07:45.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf037fe700 1 -- 172.21.15.133:0/775660640 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef0009910 con 0x7faf040b0c90 2021-01-03T13:07:45.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf037fe700 1 -- 172.21.15.133:0/775660640 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef0009a80 con 0x7faf040b0c90 2021-01-03T13:07:45.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf09a0a700 1 -- 172.21.15.133:0/775660640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf040b0c90 msgr2=0x7faf040b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:45.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf09a0a700 1 --2- 172.21.15.133:0/775660640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf040b0c90 0x7faf040b05e0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7faf04098e10 tx=0x7faef0006e80).stop 2021-01-03T13:07:45.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf09a0a700 1 -- 172.21.15.133:0/775660640 shutdown_connections 2021-01-03T13:07:45.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf09a0a700 1 --2- 172.21.15.133:0/775660640 >> v2:172.21.15.16:3300/0 conn(0x7faf040b5c00 0x7faf04143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:45.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf09a0a700 1 --2- 172.21.15.133:0/775660640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf040b0c90 0x7faf040b05e0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:45.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf09a0a700 1 -- 172.21.15.133:0/775660640 >> 172.21.15.133:0/775660640 conn(0x7faf0405bdf0 msgr2=0x7faf0405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:45.499 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf09a0a700 1 -- 172.21.15.133:0/775660640 shutdown_connections 2021-01-03T13:07:45.500 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.487+0000 7faf09a0a700 1 -- 172.21.15.133:0/775660640 wait complete. 2021-01-03T13:07:45.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09a0a700 1 Processor -- start 2021-01-03T13:07:45.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09a0a700 1 -- start start 2021-01-03T13:07:45.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09a0a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7faf040b0c90 0x7faf040b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:45.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09a0a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf040b52c0 0x7faf040aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:45.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09a0a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf040b5c00 0x7faf04156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:45.503 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09a0a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf040ae360 con 0x7faf040b52c0 2021-01-03T13:07:45.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09a0a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf040ad980 con 0x7faf040b5c00 2021-01-03T13:07:45.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09a0a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf040adc20 con 0x7faf040b0c90 2021-01-03T13:07:45.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09209700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf040b5c00 0x7faf04156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:45.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09209700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf040b5c00 0x7faf04156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40416/0 (socket says 172.21.15.133:40416) 2021-01-03T13:07:45.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09209700 1 -- 172.21.15.133:0/1003145116 learned_addr learned my addr 172.21.15.133:0/1003145116 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:45.504 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf03fff700 1 --2- 172.21.15.133:0/1003145116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf040b52c0 0x7faf040aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:45.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf08a08700 1 --2- 172.21.15.133:0/1003145116 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7faf040b0c90 0x7faf040b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:45.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09209700 1 -- 172.21.15.133:0/1003145116 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7faf040b0c90 msgr2=0x7faf040b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:45.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09209700 1 --2- 172.21.15.133:0/1003145116 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7faf040b0c90 0x7faf040b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:45.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09209700 1 -- 172.21.15.133:0/1003145116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf040b52c0 msgr2=0x7faf040aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:45.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09209700 1 --2- 172.21.15.133:0/1003145116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf040b52c0 0x7faf040aa0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:45.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09209700 1 -- 172.21.15.133:0/1003145116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040adec0 con 0x7faf040b5c00 2021-01-03T13:07:45.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09209700 1 --2- 172.21.15.133:0/1003145116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf040b5c00 0x7faf04156030 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7faefc00a000 tx=0x7faefc008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:45.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf01ffb700 1 -- 172.21.15.133:0/1003145116 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faefc00ba70 con 0x7faf040b5c00 2021-01-03T13:07:45.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf01ffb700 1 -- 172.21.15.133:0/1003145116 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc00bbd0 con 0x7faf040b5c00 2021-01-03T13:07:45.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09a0a700 1 -- 172.21.15.133:0/1003145116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf040aeee0 con 0x7faf040b5c00 2021-01-03T13:07:45.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf01ffb700 1 -- 172.21.15.133:0/1003145116 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faefc012420 con 0x7faf040b5c00 2021-01-03T13:07:45.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09a0a700 1 -- 172.21.15.133:0/1003145116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf040aa800 con 0x7faf040b5c00 2021-01-03T13:07:45.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf09a0a700 1 -- 172.21.15.133:0/1003145116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf04057300 con 0x7faf040b5c00 2021-01-03T13:07:45.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.491+0000 7faf01ffb700 1 -- 172.21.15.133:0/1003145116 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7faefc012580 con 0x7faf040b5c00 2021-01-03T13:07:45.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.495+0000 7faf01ffb700 1 --2- 172.21.15.133:0/1003145116 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faeec0553b0 0x7faeec057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:45.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.495+0000 7faf01ffb700 1 -- 172.21.15.133:0/1003145116 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faefc06e770 con 0x7faf040b5c00 2021-01-03T13:07:45.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.495+0000 7faf08a08700 1 --2- 172.21.15.133:0/1003145116 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faeec0553b0 0x7faeec057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:45.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.495+0000 7faf08a08700 1 --2- 172.21.15.133:0/1003145116 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faeec0553b0 0x7faeec057870 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7faef800a000 tx=0x7faef8008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:45.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.499+0000 7faf01ffb700 1 -- 172.21.15.133:0/1003145116 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7faefc044970 con 0x7faf040b5c00 2021-01-03T13:07:45.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:45.687+0000 7faf09a0a700 1 -- 172.21.15.133:0/1003145116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7faf040ae050 con 0x7faf040b5c00 2021-01-03T13:07:46.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.471+0000 7faf01ffb700 1 -- 172.21.15.133:0/1003145116 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v453) v1 ==== 127+0+0 (secure 0 0 0) 0x7faefc047f90 con 0x7faf040b5c00 2021-01-03T13:07:46.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.475+0000 7faf09a0a700 1 -- 172.21.15.133:0/1003145116 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faeec0553b0 msgr2=0x7faeec057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:46.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.475+0000 7faf09a0a700 1 --2- 172.21.15.133:0/1003145116 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faeec0553b0 0x7faeec057870 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7faef800a000 tx=0x7faef8008040).stop 2021-01-03T13:07:46.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.475+0000 7faf09a0a700 1 -- 172.21.15.133:0/1003145116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf040b5c00 msgr2=0x7faf04156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:46.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.475+0000 7faf09a0a700 1 --2- 172.21.15.133:0/1003145116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf040b5c00 0x7faf04156030 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7faefc00a000 tx=0x7faefc008040).stop 2021-01-03T13:07:46.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.475+0000 7faf09a0a700 1 -- 172.21.15.133:0/1003145116 shutdown_connections 2021-01-03T13:07:46.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.475+0000 7faf09a0a700 1 --2- 172.21.15.133:0/1003145116 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7faeec0553b0 0x7faeec057870 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:46.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.475+0000 7faf09a0a700 1 --2- 172.21.15.133:0/1003145116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf040b5c00 0x7faf04156030 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:46.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.475+0000 7faf09a0a700 1 --2- 172.21.15.133:0/1003145116 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7faf040b0c90 0x7faf040b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:46.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.475+0000 7faf09a0a700 1 --2- 172.21.15.133:0/1003145116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf040b52c0 0x7faf040aa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:46.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.475+0000 7faf09a0a700 1 -- 172.21.15.133:0/1003145116 >> 172.21.15.133:0/1003145116 conn(0x7faf0405bdf0 msgr2=0x7faf041444b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:46.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.475+0000 7faf09a0a700 1 -- 172.21.15.133:0/1003145116 shutdown_connections 2021-01-03T13:07:46.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.475+0000 7faf09a0a700 1 -- 172.21.15.133:0/1003145116 wait complete. 2021-01-03T13:07:46.501 INFO:tasks.cephfs_test_runner:test_root_rctime (tasks.cephfs.test_misc.TestMisc) ... ok 2021-01-03T13:07:46.501 INFO:tasks.cephfs_test_runner:Starting test: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-01-03T13:07:46.502 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs' 2021-01-03T13:07:46.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a861c2700 1 Processor -- start 2021-01-03T13:07:46.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a861c2700 1 -- start start 2021-01-03T13:07:46.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a861c2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4a800b0670 0x7f4a800aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a861c2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a8014aee0 0x7f4a80144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a861c2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a80098550 con 0x7f4a800b5c10 2021-01-03T13:07:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a861c2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a800b5ff0 con 0x7f4a800b0670 2021-01-03T13:07:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a861c2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a800b0b10 con 0x7f4a8014aee0 2021-01-03T13:07:46.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a7f7fe700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4a800b5c10 0x7f4a8014a7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33220/0 (socket says 172.21.15.133:33220) 2021-01-03T13:07:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a7f7fe700 1 -- 172.21.15.133:0/286803518 learned_addr learned my addr 172.21.15.133:0/286803518 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a7effd700 1 --2- 172.21.15.133:0/286803518 >> v2:172.21.15.133:3300/0 conn(0x7f4a800b0670 0x7f4a800aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a7e7fc700 1 -- 172.21.15.133:0/286803518 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580757416 0 0) 0x7f4a80098550 con 0x7f4a800b5c10 2021-01-03T13:07:46.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a7e7fc700 1 -- 172.21.15.133:0/286803518 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a64003230 con 0x7f4a800b5c10 2021-01-03T13:07:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a7ffff700 1 --2- 172.21.15.133:0/286803518 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a8014aee0 0x7f4a80144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a7effd700 1 -- 172.21.15.133:0/286803518 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a8014aee0 msgr2=0x7f4a80144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a7effd700 1 --2- 172.21.15.133:0/286803518 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a8014aee0 0x7f4a80144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a7effd700 1 -- 172.21.15.133:0/286803518 >> v1:172.21.15.133:6789/0 conn(0x7f4a800b5c10 legacy=0x7f4a8014a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a7effd700 1 -- 172.21.15.133:0/286803518 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a80098780 con 0x7f4a800b0670 2021-01-03T13:07:46.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a7effd700 1 --2- 172.21.15.133:0/286803518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a800b0670 0x7f4a800aae70 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f4a70002f30 tx=0x7f4a70006dc0).ready entity=mon.1 client_cookie=7f0e29b2f9707150 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:46.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a7e7fc700 1 -- 172.21.15.133:0/286803518 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a70009760 con 0x7f4a800b0670 2021-01-03T13:07:46.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a7e7fc700 1 -- 172.21.15.133:0/286803518 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a700098c0 con 0x7f4a800b0670 2021-01-03T13:07:46.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a7e7fc700 1 -- 172.21.15.133:0/286803518 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a70009c20 con 0x7f4a800b0670 2021-01-03T13:07:46.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a861c2700 1 -- 172.21.15.133:0/286803518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a800b0670 msgr2=0x7f4a800aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a861c2700 1 --2- 172.21.15.133:0/286803518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a800b0670 0x7f4a800aae70 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f4a70002f30 tx=0x7f4a70006dc0).stop 2021-01-03T13:07:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a861c2700 1 -- 172.21.15.133:0/286803518 shutdown_connections 2021-01-03T13:07:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a861c2700 1 --2- 172.21.15.133:0/286803518 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a8014aee0 0x7f4a80144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a861c2700 1 --2- 172.21.15.133:0/286803518 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a800b0670 0x7f4a800aae70 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:46.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a861c2700 1 -- 172.21.15.133:0/286803518 >> 172.21.15.133:0/286803518 conn(0x7f4a8005c8c0 msgr2=0x7f4a800b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a861c2700 1 -- 172.21.15.133:0/286803518 shutdown_connections 2021-01-03T13:07:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.615+0000 7f4a861c2700 1 -- 172.21.15.133:0/286803518 wait complete. 2021-01-03T13:07:46.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a861c2700 1 Processor -- start 2021-01-03T13:07:46.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a861c2700 1 -- start start 2021-01-03T13:07:46.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a861c2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a800b0670 0x7f4a8014e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:46.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a861c2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a800b5c10 0x7f4a80147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:46.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a861c2700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a8014aee0 0x7f4a8014cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:46.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a861c2700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a800ad360 con 0x7f4a8014aee0 2021-01-03T13:07:46.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a861c2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a80147640 con 0x7f4a800b0670 2021-01-03T13:07:46.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a861c2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a80147070 con 0x7f4a800b5c10 2021-01-03T13:07:46.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a7f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a800b0670 0x7f4a8014e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:46.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a7f7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a800b0670 0x7f4a8014e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40426/0 (socket says 172.21.15.133:40426) 2021-01-03T13:07:46.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a7f7fe700 1 -- 172.21.15.133:0/1770838880 learned_addr learned my addr 172.21.15.133:0/1770838880 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:46.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a7ffff700 1 --2- 172.21.15.133:0/1770838880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a8014aee0 0x7f4a8014cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:46.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a7effd700 1 --2- 172.21.15.133:0/1770838880 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a800b5c10 0x7f4a80147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:46.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a7f7fe700 1 -- 172.21.15.133:0/1770838880 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a800b5c10 msgr2=0x7f4a80147d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:46.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a7f7fe700 1 --2- 172.21.15.133:0/1770838880 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a800b5c10 0x7f4a80147d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:46.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a7f7fe700 1 -- 172.21.15.133:0/1770838880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a8014aee0 msgr2=0x7f4a8014cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:46.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a7f7fe700 1 --2- 172.21.15.133:0/1770838880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a8014aee0 0x7f4a8014cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:46.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a7f7fe700 1 -- 172.21.15.133:0/1770838880 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a80147870 con 0x7f4a800b0670 2021-01-03T13:07:46.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a7f7fe700 1 --2- 172.21.15.133:0/1770838880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a800b0670 0x7f4a8014e3f0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f4a78001450 tx=0x7f4a78007e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:46.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a7cff9700 1 -- 172.21.15.133:0/1770838880 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a78005b70 con 0x7f4a800b0670 2021-01-03T13:07:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a7cff9700 1 -- 172.21.15.133:0/1770838880 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a78005cd0 con 0x7f4a800b0670 2021-01-03T13:07:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a861c2700 1 -- 172.21.15.133:0/1770838880 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a80147310 con 0x7f4a800b0670 2021-01-03T13:07:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a7cff9700 1 -- 172.21.15.133:0/1770838880 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a78007300 con 0x7f4a800b0670 2021-01-03T13:07:46.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.619+0000 7f4a861c2700 1 -- 172.21.15.133:0/1770838880 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a800ac610 con 0x7f4a800b0670 2021-01-03T13:07:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.623+0000 7f4a861c2700 1 -- 172.21.15.133:0/1770838880 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a80057300 con 0x7f4a800b0670 2021-01-03T13:07:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.623+0000 7f4a7cff9700 1 -- 172.21.15.133:0/1770838880 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4a78010030 con 0x7f4a800b0670 2021-01-03T13:07:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.623+0000 7f4a7cff9700 1 --2- 172.21.15.133:0/1770838880 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a58055440 0x7f4a58057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.623+0000 7f4a7cff9700 1 -- 172.21.15.133:0/1770838880 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4a7806e020 con 0x7f4a800b0670 2021-01-03T13:07:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.623+0000 7f4a7effd700 1 --2- 172.21.15.133:0/1770838880 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a58055440 0x7f4a58057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:46.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.623+0000 7f4a7effd700 1 --2- 172.21.15.133:0/1770838880 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a58055440 0x7f4a58057900 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f4a70018000 tx=0x7f4a70015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:46.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.627+0000 7f4a7cff9700 1 -- 172.21.15.133:0/1770838880 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4a78044220 con 0x7f4a800b0670 2021-01-03T13:07:46.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:46.815+0000 7f4a861c2700 1 -- 172.21.15.133:0/1770838880 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]} v 0) v1 -- 0x7f4a80147a00 con 0x7f4a800b0670 2021-01-03T13:07:47.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.483+0000 7f4a7cff9700 1 -- 172.21.15.133:0/1770838880 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]}]=0 v454) v1 ==== 139+0+0 (secure 0 0 0) 0x7f4a78047840 con 0x7f4a800b0670 2021-01-03T13:07:47.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.487+0000 7f4a861c2700 1 -- 172.21.15.133:0/1770838880 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a58055440 msgr2=0x7f4a58057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:47.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.487+0000 7f4a861c2700 1 --2- 172.21.15.133:0/1770838880 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a58055440 0x7f4a58057900 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f4a70018000 tx=0x7f4a70015000).stop 2021-01-03T13:07:47.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.487+0000 7f4a861c2700 1 -- 172.21.15.133:0/1770838880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a800b0670 msgr2=0x7f4a8014e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:47.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.487+0000 7f4a861c2700 1 --2- 172.21.15.133:0/1770838880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a800b0670 0x7f4a8014e3f0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f4a78001450 tx=0x7f4a78007e20).stop 2021-01-03T13:07:47.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.487+0000 7f4a861c2700 1 -- 172.21.15.133:0/1770838880 shutdown_connections 2021-01-03T13:07:47.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.487+0000 7f4a861c2700 1 --2- 172.21.15.133:0/1770838880 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a58055440 0x7f4a58057900 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.487+0000 7f4a861c2700 1 --2- 172.21.15.133:0/1770838880 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a8014aee0 0x7f4a8014cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.487+0000 7f4a861c2700 1 --2- 172.21.15.133:0/1770838880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a800b0670 0x7f4a8014e3f0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.487+0000 7f4a861c2700 1 --2- 172.21.15.133:0/1770838880 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a800b5c10 0x7f4a80147d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.487+0000 7f4a861c2700 1 -- 172.21.15.133:0/1770838880 >> 172.21.15.133:0/1770838880 conn(0x7f4a8005c8c0 msgr2=0x7f4a800b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.487+0000 7f4a861c2700 1 -- 172.21.15.133:0/1770838880 shutdown_connections 2021-01-03T13:07:47.495 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.487+0000 7f4a861c2700 1 -- 172.21.15.133:0/1770838880 wait complete. 2021-01-03T13:07:47.509 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2021-01-03T13:07:47.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49c5e3700 1 Processor -- start 2021-01-03T13:07:47.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49c5e3700 1 -- start start 2021-01-03T13:07:47.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49c5e3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb494140410 0x7fb494146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:47.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49c5e3700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb4941407f0 0x7fb494142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:47.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49c5e3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb49405c500 con 0x7fb4940b0470 2021-01-03T13:07:47.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49c5e3700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4940b02d0 con 0x7fb4941407f0 2021-01-03T13:07:47.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49c5e3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb494146390 con 0x7fb494140410 2021-01-03T13:07:47.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49ab80700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb4940b0470 0x7fb49405bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33234/0 (socket says 172.21.15.133:33234) 2021-01-03T13:07:47.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49ab80700 1 -- 172.21.15.133:0/1768297980 learned_addr learned my addr 172.21.15.133:0/1768297980 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:47.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb499b7e700 1 --2- 172.21.15.133:0/1768297980 >> v2:172.21.15.16:3300/0 conn(0x7fb4941407f0 0x7fb494142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:47.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49a37f700 1 --2- 172.21.15.133:0/1768297980 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb494140410 0x7fb494146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:47.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49937d700 1 -- 172.21.15.133:0/1768297980 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217121624 0 0) 0x7fb49405c500 con 0x7fb4940b0470 2021-01-03T13:07:47.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49937d700 1 -- 172.21.15.133:0/1768297980 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb47c003230 con 0x7fb4940b0470 2021-01-03T13:07:47.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49a37f700 1 -- 172.21.15.133:0/1768297980 >> v2:172.21.15.16:3300/0 conn(0x7fb4941407f0 msgr2=0x7fb494142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:47.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49a37f700 1 --2- 172.21.15.133:0/1768297980 >> v2:172.21.15.16:3300/0 conn(0x7fb4941407f0 0x7fb494142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:47.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49a37f700 1 -- 172.21.15.133:0/1768297980 >> v1:172.21.15.133:6789/0 conn(0x7fb4940b0470 legacy=0x7fb49405bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:47.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49a37f700 1 -- 172.21.15.133:0/1768297980 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49405cf20 con 0x7fb494140410 2021-01-03T13:07:47.638 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49a37f700 1 --2- 172.21.15.133:0/1768297980 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb494140410 0x7fb494146cc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fb490002f30 tx=0x7fb490006dc0).ready entity=mon.2 client_cookie=104b9f2ae84f55cc server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:47.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49937d700 1 -- 172.21.15.133:0/1768297980 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4900096a0 con 0x7fb494140410 2021-01-03T13:07:47.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49937d700 1 -- 172.21.15.133:0/1768297980 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb490009800 con 0x7fb494140410 2021-01-03T13:07:47.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49c5e3700 1 -- 172.21.15.133:0/1768297980 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb494140410 msgr2=0x7fb494146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:47.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49c5e3700 1 --2- 172.21.15.133:0/1768297980 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb494140410 0x7fb494146cc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fb490002f30 tx=0x7fb490006dc0).stop 2021-01-03T13:07:47.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49c5e3700 1 -- 172.21.15.133:0/1768297980 shutdown_connections 2021-01-03T13:07:47.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49c5e3700 1 --2- 172.21.15.133:0/1768297980 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb494140410 0x7fb494146cc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:47.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49c5e3700 1 --2- 172.21.15.133:0/1768297980 >> v2:172.21.15.16:3300/0 conn(0x7fb4941407f0 0x7fb494142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:47.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.627+0000 7fb49c5e3700 1 -- 172.21.15.133:0/1768297980 >> 172.21.15.133:0/1768297980 conn(0x7fb4940b95d0 msgr2=0x7fb4940b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:47.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49c5e3700 1 -- 172.21.15.133:0/1768297980 shutdown_connections 2021-01-03T13:07:47.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49c5e3700 1 -- 172.21.15.133:0/1768297980 wait complete. 2021-01-03T13:07:47.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49c5e3700 1 Processor -- start 2021-01-03T13:07:47.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49c5e3700 1 -- start start 2021-01-03T13:07:47.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49c5e3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4940b0470 0x7fb494141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:47.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49c5e3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb494140410 0x7fb494147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:47.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49c5e3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4941407f0 0x7fb494140ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:47.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49c5e3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb494155d70 con 0x7fb494140410 2021-01-03T13:07:47.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49c5e3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb494143300 con 0x7fb4941407f0 2021-01-03T13:07:47.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49c5e3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4941435a0 con 0x7fb4940b0470 2021-01-03T13:07:47.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49ab80700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4941407f0 0x7fb494140ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:47.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49ab80700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4941407f0 0x7fb494140ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40442/0 (socket says 172.21.15.133:40442) 2021-01-03T13:07:47.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49ab80700 1 -- 172.21.15.133:0/2965877837 learned_addr learned my addr 172.21.15.133:0/2965877837 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:47.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb499b7e700 1 --2- 172.21.15.133:0/2965877837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb494140410 0x7fb494147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:47.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49a37f700 1 --2- 172.21.15.133:0/2965877837 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4940b0470 0x7fb494141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:47.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49ab80700 1 -- 172.21.15.133:0/2965877837 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4940b0470 msgr2=0x7fb494141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:47.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49ab80700 1 --2- 172.21.15.133:0/2965877837 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4940b0470 0x7fb494141990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:47.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49ab80700 1 -- 172.21.15.133:0/2965877837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb494140410 msgr2=0x7fb494147cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:47.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49ab80700 1 --2- 172.21.15.133:0/2965877837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb494140410 0x7fb494147cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:47.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49ab80700 1 -- 172.21.15.133:0/2965877837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4941414e0 con 0x7fb4941407f0 2021-01-03T13:07:47.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49ab80700 1 --2- 172.21.15.133:0/2965877837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4941407f0 0x7fb494140ff0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fb48c001450 tx=0x7fb48c007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:47.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb4837fe700 1 -- 172.21.15.133:0/2965877837 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb48c005b70 con 0x7fb4941407f0 2021-01-03T13:07:47.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb4837fe700 1 -- 172.21.15.133:0/2965877837 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c005cd0 con 0x7fb4941407f0 2021-01-03T13:07:47.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49c5e3700 1 -- 172.21.15.133:0/2965877837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4941423a0 con 0x7fb4941407f0 2021-01-03T13:07:47.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb4837fe700 1 -- 172.21.15.133:0/2965877837 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb48c007300 con 0x7fb4941407f0 2021-01-03T13:07:47.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.631+0000 7fb49c5e3700 1 -- 172.21.15.133:0/2965877837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4941555f0 con 0x7fb4941407f0 2021-01-03T13:07:47.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.635+0000 7fb49c5e3700 1 -- 172.21.15.133:0/2965877837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb494057300 con 0x7fb4941407f0 2021-01-03T13:07:47.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.635+0000 7fb4837fe700 1 -- 172.21.15.133:0/2965877837 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb48c010030 con 0x7fb4941407f0 2021-01-03T13:07:47.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.635+0000 7fb4837fe700 1 --2- 172.21.15.133:0/2965877837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb4740554e0 0x7fb4740579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:47.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.635+0000 7fb4837fe700 1 -- 172.21.15.133:0/2965877837 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb48c06dfb0 con 0x7fb4941407f0 2021-01-03T13:07:47.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.635+0000 7fb49a37f700 1 --2- 172.21.15.133:0/2965877837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb4740554e0 0x7fb4740579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:47.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.635+0000 7fb49a37f700 1 --2- 172.21.15.133:0/2965877837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb4740554e0 0x7fb4740579a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fb490019000 tx=0x7fb490015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:47.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.647+0000 7fb4837fe700 1 -- 172.21.15.133:0/2965877837 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb48c0442b0 con 0x7fb4941407f0 2021-01-03T13:07:47.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.779+0000 7fb49c5e3700 1 -- 172.21.15.133:0/2965877837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7fb49405d250 con 0x7fb4941407f0 2021-01-03T13:07:47.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.791+0000 7fb4837fe700 1 -- 172.21.15.133:0/2965877837 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb48c0478d0 con 0x7fb4941407f0 2021-01-03T13:07:47.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.791+0000 7fb49c5e3700 1 -- 172.21.15.133:0/2965877837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb4740554e0 msgr2=0x7fb4740579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:47.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.791+0000 7fb49c5e3700 1 --2- 172.21.15.133:0/2965877837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb4740554e0 0x7fb4740579a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fb490019000 tx=0x7fb490015000).stop 2021-01-03T13:07:47.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.791+0000 7fb49c5e3700 1 -- 172.21.15.133:0/2965877837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4941407f0 msgr2=0x7fb494140ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:47.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.791+0000 7fb49c5e3700 1 --2- 172.21.15.133:0/2965877837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4941407f0 0x7fb494140ff0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fb48c001450 tx=0x7fb48c007dd0).stop 2021-01-03T13:07:47.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.791+0000 7fb49c5e3700 1 -- 172.21.15.133:0/2965877837 shutdown_connections 2021-01-03T13:07:47.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.791+0000 7fb49c5e3700 1 --2- 172.21.15.133:0/2965877837 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb4740554e0 0x7fb4740579a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:47.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.791+0000 7fb49c5e3700 1 --2- 172.21.15.133:0/2965877837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4941407f0 0x7fb494140ff0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:47.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.791+0000 7fb49c5e3700 1 --2- 172.21.15.133:0/2965877837 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb4940b0470 0x7fb494141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:47.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.791+0000 7fb49c5e3700 1 --2- 172.21.15.133:0/2965877837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb494140410 0x7fb494147cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:47.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.791+0000 7fb49c5e3700 1 -- 172.21.15.133:0/2965877837 >> 172.21.15.133:0/2965877837 conn(0x7fb4940b95d0 msgr2=0x7fb494069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:47.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.791+0000 7fb49c5e3700 1 -- 172.21.15.133:0/2965877837 shutdown_connections 2021-01-03T13:07:47.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:47.791+0000 7fb49c5e3700 1 -- 172.21.15.133:0/2965877837 wait complete. 2021-01-03T13:07:47.812 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:07:47.813 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:07:47.831 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:07:47.849 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:07:47.867 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:07:47.885 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:07:47.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:47.885 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:47.886 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:07:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-03T13:07:47.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:07:47.894 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2021-01-03T13:07:47.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:07:47.895 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:07:47.896 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:07:47.916 INFO:teuthology.orchestra.run.smithi036.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2021-01-03T13:07:47.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:07:47.917 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2021-01-03T13:07:47.918 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-01-03T13:07:48.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f9246bfd700 1 Processor -- start 2021-01-03T13:07:48.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f9246bfd700 1 -- start start 2021-01-03T13:07:48.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f9246bfd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f92400b3d80 0x7f92400b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f9246bfd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92400b35a0 0x7f92400ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f9246bfd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f924009a740 0x7f9240144830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f9246bfd700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924009aec0 con 0x7f92400b3d80 2021-01-03T13:07:48.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f9246bfd700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924009b160 con 0x7f924009a740 2021-01-03T13:07:48.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f9246bfd700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92401440f0 con 0x7f92400b35a0 2021-01-03T13:07:48.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f924519a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f924009a740 0x7f9240144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f924519a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f924009a740 0x7f9240144830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40452/0 (socket says 172.21.15.133:40452) 2021-01-03T13:07:48.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f924519a700 1 -- 172.21.15.133:0/279144013 learned_addr learned my addr 172.21.15.133:0/279144013 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:48.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f9244999700 1 --2- 172.21.15.133:0/279144013 >> v2:172.21.15.16:3300/0 conn(0x7f92400b3d80 0x7f92400b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f923ffff700 1 --2- 172.21.15.133:0/279144013 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92400b35a0 0x7f92400ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f924519a700 1 -- 172.21.15.133:0/279144013 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92400b35a0 msgr2=0x7f92400ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:48.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f924519a700 1 --2- 172.21.15.133:0/279144013 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92400b35a0 0x7f92400ac5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f924519a700 1 -- 172.21.15.133:0/279144013 >> v2:172.21.15.16:3300/0 conn(0x7f92400b3d80 msgr2=0x7f92400b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:48.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f924519a700 1 --2- 172.21.15.133:0/279144013 >> v2:172.21.15.16:3300/0 conn(0x7f92400b3d80 0x7f92400b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f924519a700 1 -- 172.21.15.133:0/279144013 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9240144390 con 0x7f924009a740 2021-01-03T13:07:48.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f924519a700 1 --2- 172.21.15.133:0/279144013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f924009a740 0x7f9240144830 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f9238002f30 tx=0x7f9238006e80).ready entity=mon.1 client_cookie=b3b24301a9d3e872 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:48.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f923f7fe700 1 -- 172.21.15.133:0/279144013 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9238009640 con 0x7f924009a740 2021-01-03T13:07:48.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f923f7fe700 1 -- 172.21.15.133:0/279144013 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92380097a0 con 0x7f924009a740 2021-01-03T13:07:48.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f923f7fe700 1 -- 172.21.15.133:0/279144013 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9238009b00 con 0x7f924009a740 2021-01-03T13:07:48.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f9246bfd700 1 -- 172.21.15.133:0/279144013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f924009a740 msgr2=0x7f9240144830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:48.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.039+0000 7f9246bfd700 1 --2- 172.21.15.133:0/279144013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f924009a740 0x7f9240144830 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f9238002f30 tx=0x7f9238006e80).stop 2021-01-03T13:07:48.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9246bfd700 1 -- 172.21.15.133:0/279144013 shutdown_connections 2021-01-03T13:07:48.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9246bfd700 1 --2- 172.21.15.133:0/279144013 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f924009a740 0x7f9240144830 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9246bfd700 1 --2- 172.21.15.133:0/279144013 >> v2:172.21.15.16:3300/0 conn(0x7f92400b3d80 0x7f92400b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9246bfd700 1 --2- 172.21.15.133:0/279144013 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92400b35a0 0x7f92400ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9246bfd700 1 -- 172.21.15.133:0/279144013 >> 172.21.15.133:0/279144013 conn(0x7f924005bdf0 msgr2=0x7f924005c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:48.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9246bfd700 1 -- 172.21.15.133:0/279144013 shutdown_connections 2021-01-03T13:07:48.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9246bfd700 1 -- 172.21.15.133:0/279144013 wait complete. 2021-01-03T13:07:48.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9246bfd700 1 Processor -- start 2021-01-03T13:07:48.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9246bfd700 1 -- start start 2021-01-03T13:07:48.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9246bfd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f924009a740 0x7f9240147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9246bfd700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92400b35a0 0x7f9240064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9246bfd700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92400b3d80 0x7f9240065090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9246bfd700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9240065580 con 0x7f92400b35a0 2021-01-03T13:07:48.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9246bfd700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92400b6e80 con 0x7f924009a740 2021-01-03T13:07:48.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9246bfd700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92400b7cc0 con 0x7f92400b3d80 2021-01-03T13:07:48.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9244999700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f924009a740 0x7f9240147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9244999700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f924009a740 0x7f9240147600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40454/0 (socket says 172.21.15.133:40454) 2021-01-03T13:07:48.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9244999700 1 -- 172.21.15.133:0/2390985561 learned_addr learned my addr 172.21.15.133:0/2390985561 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:48.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f923ffff700 1 --2- 172.21.15.133:0/2390985561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92400b35a0 0x7f9240064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f924519a700 1 --2- 172.21.15.133:0/2390985561 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92400b3d80 0x7f9240065090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9244999700 1 -- 172.21.15.133:0/2390985561 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92400b3d80 msgr2=0x7f9240065090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:48.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9244999700 1 --2- 172.21.15.133:0/2390985561 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92400b3d80 0x7f9240065090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9244999700 1 -- 172.21.15.133:0/2390985561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92400b35a0 msgr2=0x7f9240064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:48.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.043+0000 7f9244999700 1 --2- 172.21.15.133:0/2390985561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92400b35a0 0x7f9240064ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.047+0000 7f9244999700 1 -- 172.21.15.133:0/2390985561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92400b7450 con 0x7f924009a740 2021-01-03T13:07:48.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.047+0000 7f9244999700 1 --2- 172.21.15.133:0/2390985561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f924009a740 0x7f9240147600 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f92400656c0 tx=0x7f9228006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:48.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.047+0000 7f923dffb700 1 -- 172.21.15.133:0/2390985561 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f922800ca10 con 0x7f924009a740 2021-01-03T13:07:48.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.047+0000 7f923dffb700 1 -- 172.21.15.133:0/2390985561 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922800cb70 con 0x7f924009a740 2021-01-03T13:07:48.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.047+0000 7f923dffb700 1 -- 172.21.15.133:0/2390985561 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92280123f0 con 0x7f924009a740 2021-01-03T13:07:48.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.047+0000 7f9246bfd700 1 -- 172.21.15.133:0/2390985561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92400b6be0 con 0x7f924009a740 2021-01-03T13:07:48.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.047+0000 7f9246bfd700 1 -- 172.21.15.133:0/2390985561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9240067650 con 0x7f924009a740 2021-01-03T13:07:48.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.047+0000 7f9246bfd700 1 -- 172.21.15.133:0/2390985561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9240057300 con 0x7f924009a740 2021-01-03T13:07:48.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.047+0000 7f923dffb700 1 -- 172.21.15.133:0/2390985561 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9228012550 con 0x7f924009a740 2021-01-03T13:07:48.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.047+0000 7f923dffb700 1 --2- 172.21.15.133:0/2390985561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9218055330 0x7f92180577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.047+0000 7f923dffb700 1 -- 172.21.15.133:0/2390985561 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f922806e230 con 0x7f924009a740 2021-01-03T13:07:48.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.047+0000 7f923ffff700 1 --2- 172.21.15.133:0/2390985561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9218055330 0x7f92180577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.051+0000 7f923ffff700 1 --2- 172.21.15.133:0/2390985561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9218055330 0x7f92180577f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f923000b000 tx=0x7f92300091a0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:48.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.055+0000 7f923dffb700 1 -- 172.21.15.133:0/2390985561 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f92280444d0 con 0x7f924009a740 2021-01-03T13:07:48.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.195+0000 7f9246bfd700 1 -- 172.21.15.133:0/2390985561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f924005ce00 con 0x7f924009a740 2021-01-03T13:07:48.205 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.203+0000 7f923dffb700 1 -- 172.21.15.133:0/2390985561 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v152) v1 ==== 81+0+33707 (secure 0 0 0) 0x7f9228047af0 con 0x7f924009a740 2021-01-03T13:07:48.206 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:48.206 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:07:48.207 INFO:teuthology.orchestra.run.smithi133.stdout: "epoch": 152, 2021-01-03T13:07:48.207 INFO:teuthology.orchestra.run.smithi133.stdout: "fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", 2021-01-03T13:07:48.207 INFO:teuthology.orchestra.run.smithi133.stdout: "created": "2021-01-03T12:57:43.298835+0000", 2021-01-03T13:07:48.207 INFO:teuthology.orchestra.run.smithi133.stdout: "modified": "2021-01-03T13:07:32.736676+0000", 2021-01-03T13:07:48.208 INFO:teuthology.orchestra.run.smithi133.stdout: "last_up_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:07:48.208 INFO:teuthology.orchestra.run.smithi133.stdout: "last_in_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:07:48.208 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-01-03T13:07:48.208 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_num": 5799936, 2021-01-03T13:07:48.208 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_set": [ 2021-01-03T13:07:48.209 INFO:teuthology.orchestra.run.smithi133.stdout: "pglog_hardlimit", 2021-01-03T13:07:48.209 INFO:teuthology.orchestra.run.smithi133.stdout: "purged_snapdirs", 2021-01-03T13:07:48.209 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_deletes", 2021-01-03T13:07:48.209 INFO:teuthology.orchestra.run.smithi133.stdout: "sortbitwise" 2021-01-03T13:07:48.209 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:07:48.210 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_version": 4, 2021-01-03T13:07:48.210 INFO:teuthology.orchestra.run.smithi133.stdout: "full_ratio": 0.94999998807907104, 2021-01-03T13:07:48.210 INFO:teuthology.orchestra.run.smithi133.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-01-03T13:07:48.210 INFO:teuthology.orchestra.run.smithi133.stdout: "nearfull_ratio": 0.85000002384185791, 2021-01-03T13:07:48.210 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_snapshot": "", 2021-01-03T13:07:48.211 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_max": 28, 2021-01-03T13:07:48.211 INFO:teuthology.orchestra.run.smithi133.stdout: "max_osd": 8, 2021-01-03T13:07:48.211 INFO:teuthology.orchestra.run.smithi133.stdout: "require_min_compat_client": "jewel", 2021-01-03T13:07:48.211 INFO:teuthology.orchestra.run.smithi133.stdout: "min_compat_client": "jewel", 2021-01-03T13:07:48.211 INFO:teuthology.orchestra.run.smithi133.stdout: "require_osd_release": "octopus", 2021-01-03T13:07:48.212 INFO:teuthology.orchestra.run.smithi133.stdout: "pools": [ 2021-01-03T13:07:48.212 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.212 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 1, 2021-01-03T13:07:48.212 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "device_health_metrics", 2021-01-03T13:07:48.212 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:47.102954+0000", 2021-01-03T13:07:48.213 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:07:48.213 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:07:48.213 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:07:48.213 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:07:48.214 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:07:48.214 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:07:48.214 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:07:48.214 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:07:48.214 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 1, 2021-01-03T13:07:48.215 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 1, 2021-01-03T13:07:48.215 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 1, 2021-01-03T13:07:48.215 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 1, 2021-01-03T13:07:48.215 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 1, 2021-01-03T13:07:48.215 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:07:48.216 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:07:48.216 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:07:48.216 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:07:48.216 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:07:48.217 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:07:48.217 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:07:48.217 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.217 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "16", 2021-01-03T13:07:48.217 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:07:48.218 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:07:48.218 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:07:48.218 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:07:48.218 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:07:48.218 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:07:48.219 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:07:48.219 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:07:48.219 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:07:48.219 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:07:48.219 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:07:48.220 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:07:48.220 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:07:48.220 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:07:48.220 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:07:48.220 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:07:48.221 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:07:48.221 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:07:48.221 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:07:48.221 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:07:48.221 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:07:48.222 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:07:48.222 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:07:48.222 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:07:48.222 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:07:48.222 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:07:48.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.223 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:07:48.223 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:07:48.223 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:07:48.223 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:07:48.224 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:07:48.224 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:07:48.224 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:07:48.224 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:07:48.224 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:07:48.224 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:07:48.225 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:07:48.225 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:07:48.225 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 1 2021-01-03T13:07:48.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.226 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:07:48.226 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr_devicehealth": {} 2021-01-03T13:07:48.226 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.226 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.227 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 2, 2021-01-03T13:07:48.227 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "rbd", 2021-01-03T13:07:48.227 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:55.472799+0000", 2021-01-03T13:07:48.227 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:07:48.227 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:07:48.228 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:07:48.228 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:07:48.228 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:07:48.228 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:07:48.228 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:07:48.229 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:07:48.229 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:07:48.229 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:07:48.229 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:07:48.229 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:07:48.230 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:07:48.230 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:07:48.230 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:07:48.230 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:07:48.230 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:07:48.231 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:07:48.231 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:07:48.231 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:07:48.231 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.231 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "19", 2021-01-03T13:07:48.232 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:07:48.232 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:07:48.232 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:07:48.232 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:07:48.232 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:07:48.233 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:07:48.233 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:07:48.233 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:07:48.233 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:07:48.233 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:07:48.234 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:07:48.234 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:07:48.234 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:07:48.234 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:07:48.234 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:07:48.235 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:07:48.235 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:07:48.235 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:07:48.235 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:07:48.235 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:07:48.236 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:07:48.236 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:07:48.236 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:07:48.236 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:07:48.236 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:07:48.237 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:07:48.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.237 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:07:48.237 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:07:48.237 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:07:48.238 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:07:48.238 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:07:48.238 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:07:48.238 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:07:48.238 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:07:48.239 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:07:48.239 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:07:48.239 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:07:48.239 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:07:48.240 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:07:48.240 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd": {} 2021-01-03T13:07:48.240 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.241 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 27, 2021-01-03T13:07:48.241 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_metadata", 2021-01-03T13:07:48.241 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:07:31.210499+0000", 2021-01-03T13:07:48.241 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:07:48.241 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:07:48.242 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:07:48.242 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:07:48.242 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:07:48.242 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:07:48.242 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:07:48.243 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:07:48.243 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:07:48.243 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:07:48.243 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:07:48.243 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:07:48.244 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:07:48.244 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:07:48.244 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:07:48.244 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:07:48.244 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:07:48.245 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:07:48.245 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:07:48.245 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:07:48.245 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.245 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "152", 2021-01-03T13:07:48.246 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:07:48.246 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:07:48.246 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:07:48.246 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:07:48.247 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:07:48.247 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:07:48.247 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:07:48.247 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:07:48.247 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:07:48.248 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:07:48.248 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:07:48.248 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:07:48.248 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:07:48.248 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:07:48.249 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:07:48.249 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:07:48.249 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:07:48.249 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:07:48.250 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:07:48.250 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:07:48.250 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:07:48.250 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:07:48.250 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:07:48.251 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:07:48.251 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:07:48.251 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:07:48.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.251 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:07:48.252 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:07:48.252 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:07:48.252 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:07:48.252 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:07:48.252 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:07:48.253 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:07:48.253 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:07:48.253 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:07:48.253 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:07:48.253 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:07:48.254 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:07:48.254 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_bias": 4, 2021-01-03T13:07:48.254 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 16, 2021-01-03T13:07:48.254 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_priority": 5 2021-01-03T13:07:48.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.255 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:07:48.255 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:07:48.255 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": "cephfs" 2021-01-03T13:07:48.255 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.255 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.256 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 28, 2021-01-03T13:07:48.256 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_data", 2021-01-03T13:07:48.256 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:07:31.743590+0000", 2021-01-03T13:07:48.257 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:07:48.257 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:07:48.257 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:07:48.257 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:07:48.257 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:07:48.258 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:07:48.258 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:07:48.258 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:07:48.258 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:07:48.258 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:07:48.259 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:07:48.259 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:07:48.259 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:07:48.259 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:07:48.259 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:07:48.260 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:07:48.260 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:07:48.260 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:07:48.260 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:07:48.260 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:07:48.261 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.261 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "152", 2021-01-03T13:07:48.261 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:07:48.261 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:07:48.261 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:07:48.262 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:07:48.262 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:07:48.262 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:07:48.262 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:07:48.262 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:07:48.263 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:07:48.263 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:07:48.263 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:07:48.263 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:07:48.263 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:07:48.264 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:07:48.264 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:07:48.264 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:07:48.264 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:07:48.264 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:07:48.265 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:07:48.265 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:07:48.265 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:07:48.265 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:07:48.265 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:07:48.265 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:07:48.266 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:07:48.266 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:07:48.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.266 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:07:48.266 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:07:48.267 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:07:48.267 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:07:48.267 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:07:48.267 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:07:48.267 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:07:48.268 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:07:48.268 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:07:48.268 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:07:48.268 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:07:48.268 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:07:48.269 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:07:48.269 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:07:48.269 INFO:teuthology.orchestra.run.smithi133.stdout: "data": "cephfs" 2021-01-03T13:07:48.269 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.269 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.270 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.270 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:07:48.271 INFO:teuthology.orchestra.run.smithi133.stdout: "osds": [ 2021-01-03T13:07:48.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.271 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:07:48.271 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a", 2021-01-03T13:07:48.272 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:07:48.272 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:07:48.272 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:07:48.272 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:07:48.272 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:07:48.273 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:07:48.273 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:07:48.273 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 149, 2021-01-03T13:07:48.273 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:07:48.273 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:07:48.274 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:07:48.274 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.274 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.275 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6810", 2021-01-03T13:07:48.275 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:07:48.275 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.275 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.275 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.276 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6811", 2021-01-03T13:07:48.276 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:07:48.276 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.276 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.276 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.276 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:07:48.277 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.277 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.277 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.277 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6812", 2021-01-03T13:07:48.277 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:07:48.278 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.278 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.279 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6813", 2021-01-03T13:07:48.279 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:07:48.279 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.280 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.280 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.280 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:07:48.280 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.281 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.282 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6816", 2021-01-03T13:07:48.282 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:07:48.282 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.282 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.282 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.283 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6817", 2021-01-03T13:07:48.283 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:07:48.283 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.283 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.284 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:07:48.285 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.285 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.285 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6814", 2021-01-03T13:07:48.286 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:07:48.286 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.287 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.287 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.287 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6815", 2021-01-03T13:07:48.288 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:07:48.288 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.288 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.289 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.289 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6811/12124", 2021-01-03T13:07:48.290 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6813/12124", 2021-01-03T13:07:48.290 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6817/12124", 2021-01-03T13:07:48.290 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6815/12124", 2021-01-03T13:07:48.290 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:07:48.291 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:07:48.291 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:07:48.292 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.292 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.292 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:07:48.293 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9170d1de-58d4-4dfd-b9de-80dc15ca9e60", 2021-01-03T13:07:48.293 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:07:48.293 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:07:48.293 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:07:48.294 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:07:48.294 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:07:48.294 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:07:48.294 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:07:48.295 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 149, 2021-01-03T13:07:48.295 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:07:48.295 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:07:48.295 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:07:48.295 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.296 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.296 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.296 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6818", 2021-01-03T13:07:48.296 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:07:48.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.297 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.297 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.297 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6819", 2021-01-03T13:07:48.297 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:07:48.297 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.298 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.298 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.298 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:07:48.298 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.299 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.299 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.299 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6820", 2021-01-03T13:07:48.299 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:07:48.299 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.300 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.300 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.300 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6821", 2021-01-03T13:07:48.300 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:07:48.300 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.301 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.301 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.301 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:07:48.301 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.301 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.302 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.302 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6824", 2021-01-03T13:07:48.302 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:07:48.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.303 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.303 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6825", 2021-01-03T13:07:48.303 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:07:48.304 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.304 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.304 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.304 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:07:48.304 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.305 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.305 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.305 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6822", 2021-01-03T13:07:48.305 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:07:48.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.306 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.306 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.306 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6823", 2021-01-03T13:07:48.306 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:07:48.307 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.307 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.307 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6819/12123", 2021-01-03T13:07:48.307 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6821/12123", 2021-01-03T13:07:48.308 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6825/12123", 2021-01-03T13:07:48.308 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6823/12123", 2021-01-03T13:07:48.308 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:07:48.308 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:07:48.308 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:07:48.309 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.309 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.309 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:07:48.309 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9fc5adf9-3537-4953-9c65-0c67ecb53776", 2021-01-03T13:07:48.309 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:07:48.310 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:07:48.310 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:07:48.310 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:07:48.310 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:07:48.311 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:07:48.311 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:07:48.311 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 148, 2021-01-03T13:07:48.311 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:07:48.311 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:07:48.312 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:07:48.312 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.312 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.312 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.312 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6802", 2021-01-03T13:07:48.313 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:07:48.313 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.313 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.313 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.313 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6803", 2021-01-03T13:07:48.314 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:07:48.314 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.314 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.314 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.314 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:07:48.315 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.315 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.315 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.315 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6804", 2021-01-03T13:07:48.315 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:07:48.316 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.316 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.316 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.316 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6805", 2021-01-03T13:07:48.316 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:07:48.317 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.317 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.317 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.317 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:07:48.317 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.318 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.318 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.318 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6808", 2021-01-03T13:07:48.318 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:07:48.319 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.319 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.319 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.319 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6809", 2021-01-03T13:07:48.319 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:07:48.320 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.320 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.320 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.320 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:07:48.320 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.321 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.321 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.321 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6806", 2021-01-03T13:07:48.321 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:07:48.321 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.322 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.322 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.322 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6807", 2021-01-03T13:07:48.322 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:07:48.322 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.323 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.323 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.323 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6803/12122", 2021-01-03T13:07:48.323 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6805/12122", 2021-01-03T13:07:48.324 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6809/12122", 2021-01-03T13:07:48.324 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6807/12122", 2021-01-03T13:07:48.324 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:07:48.324 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:07:48.324 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:07:48.325 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.325 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.325 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.325 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:07:48.325 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "0ad45ce5-6635-4089-bbf8-c966d0fe5338", 2021-01-03T13:07:48.325 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:07:48.326 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:07:48.326 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:07:48.326 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:07:48.326 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:07:48.327 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:07:48.327 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:07:48.327 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 140, 2021-01-03T13:07:48.327 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:07:48.327 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:07:48.328 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:07:48.328 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.328 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.329 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.329 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6826", 2021-01-03T13:07:48.329 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:07:48.330 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.330 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.330 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.331 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6827", 2021-01-03T13:07:48.331 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:07:48.331 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.332 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.332 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.332 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:07:48.333 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.333 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.333 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.334 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6828", 2021-01-03T13:07:48.334 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:07:48.334 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.335 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.335 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.335 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6829", 2021-01-03T13:07:48.336 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:07:48.336 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.336 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.337 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.337 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:07:48.337 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.338 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.338 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.339 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6832", 2021-01-03T13:07:48.339 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:07:48.339 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.340 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.340 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.340 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6833", 2021-01-03T13:07:48.341 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:07:48.341 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.341 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.342 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.342 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:07:48.342 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.343 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.343 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.343 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6830", 2021-01-03T13:07:48.344 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:07:48.344 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.344 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.345 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.345 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6831", 2021-01-03T13:07:48.345 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:07:48.346 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.346 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.346 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.347 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6827/12136", 2021-01-03T13:07:48.347 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6829/12136", 2021-01-03T13:07:48.347 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6833/12136", 2021-01-03T13:07:48.348 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6831/12136", 2021-01-03T13:07:48.348 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:07:48.348 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:07:48.349 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:07:48.349 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.349 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.350 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.350 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:07:48.350 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "86b8d6d5-271b-4a70-ae7b-a227afb38d7c", 2021-01-03T13:07:48.351 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:07:48.351 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:07:48.351 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:07:48.351 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:07:48.351 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:07:48.352 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:07:48.352 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:07:48.352 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 148, 2021-01-03T13:07:48.352 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:07:48.353 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:07:48.353 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:07:48.353 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.353 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.353 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.354 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6808", 2021-01-03T13:07:48.354 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:07:48.354 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.354 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.355 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.355 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6809", 2021-01-03T13:07:48.355 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:07:48.355 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.355 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.356 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.356 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:07:48.356 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.356 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.356 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.357 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6810", 2021-01-03T13:07:48.357 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:07:48.357 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.357 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.357 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.358 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6811", 2021-01-03T13:07:48.358 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:07:48.358 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.358 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.358 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.359 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:07:48.359 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.359 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.359 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.360 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6814", 2021-01-03T13:07:48.360 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:07:48.360 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.360 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.360 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.361 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6815", 2021-01-03T13:07:48.361 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:07:48.361 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.361 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.361 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.362 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:07:48.362 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.362 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.362 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.362 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6812", 2021-01-03T13:07:48.363 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:07:48.363 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.363 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.363 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.363 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6813", 2021-01-03T13:07:48.364 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:07:48.364 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.364 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.364 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.364 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6809/12672", 2021-01-03T13:07:48.365 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6811/12672", 2021-01-03T13:07:48.365 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6815/12672", 2021-01-03T13:07:48.365 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6813/12672", 2021-01-03T13:07:48.365 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:07:48.365 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:07:48.366 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:07:48.366 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.366 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.366 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.366 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:07:48.367 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "173feb9d-f596-4030-85d8-1f4b46a9ffe5", 2021-01-03T13:07:48.367 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:07:48.367 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:07:48.367 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:07:48.367 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:07:48.368 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:07:48.368 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:07:48.368 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:07:48.368 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 149, 2021-01-03T13:07:48.368 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:07:48.369 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:07:48.369 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:07:48.369 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.369 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.369 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.370 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6817", 2021-01-03T13:07:48.370 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:07:48.370 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.370 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.370 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.371 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6819", 2021-01-03T13:07:48.371 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:07:48.371 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.371 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.372 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.372 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:07:48.372 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.372 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.372 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.373 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6820", 2021-01-03T13:07:48.373 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:07:48.373 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.373 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.373 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.374 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6822", 2021-01-03T13:07:48.374 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:07:48.374 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.374 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.374 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.375 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:07:48.375 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.375 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.375 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.375 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6828", 2021-01-03T13:07:48.376 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:07:48.376 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.376 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.376 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.376 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6830", 2021-01-03T13:07:48.377 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:07:48.377 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.377 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.377 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.377 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:07:48.378 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.378 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.378 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.378 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6824", 2021-01-03T13:07:48.379 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:07:48.379 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.379 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.379 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.379 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6826", 2021-01-03T13:07:48.380 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:07:48.380 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.380 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.380 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.381 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6819/12673", 2021-01-03T13:07:48.381 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6822/12673", 2021-01-03T13:07:48.381 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6830/12673", 2021-01-03T13:07:48.381 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6826/12673", 2021-01-03T13:07:48.381 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:07:48.381 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:07:48.382 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:07:48.382 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.382 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.382 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.383 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:07:48.383 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "b487980e-ad4d-43c1-91fa-4845f7af3d4d", 2021-01-03T13:07:48.383 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:07:48.383 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:07:48.383 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:07:48.384 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:07:48.384 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:07:48.384 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:07:48.384 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:07:48.384 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 149, 2021-01-03T13:07:48.385 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:07:48.385 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:07:48.385 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:07:48.385 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.385 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.385 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.386 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6800", 2021-01-03T13:07:48.386 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:07:48.386 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.387 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.387 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6801", 2021-01-03T13:07:48.387 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:07:48.387 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.387 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.388 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.388 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:07:48.388 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.388 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.388 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.388 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6802", 2021-01-03T13:07:48.389 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:07:48.389 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.389 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.389 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.389 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6803", 2021-01-03T13:07:48.390 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:07:48.390 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.390 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.390 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.390 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:07:48.391 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.391 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.391 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.391 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6806", 2021-01-03T13:07:48.392 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:07:48.392 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.392 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.392 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.392 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6807", 2021-01-03T13:07:48.393 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:07:48.393 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.393 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.393 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.393 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:07:48.394 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.394 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.394 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.394 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6804", 2021-01-03T13:07:48.394 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:07:48.394 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.395 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.395 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.395 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6805", 2021-01-03T13:07:48.395 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:07:48.395 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.396 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.396 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.396 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6801/12662", 2021-01-03T13:07:48.396 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6803/12662", 2021-01-03T13:07:48.396 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6807/12662", 2021-01-03T13:07:48.397 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6805/12662", 2021-01-03T13:07:48.397 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:07:48.397 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:07:48.397 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:07:48.397 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.398 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.398 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.398 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:07:48.398 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "38ea839a-451f-4c09-a545-4514e049b178", 2021-01-03T13:07:48.398 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:07:48.399 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:07:48.399 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:07:48.399 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:07:48.399 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:07:48.399 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:07:48.400 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:07:48.400 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 149, 2021-01-03T13:07:48.400 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:07:48.400 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:07:48.400 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:07:48.401 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.401 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.401 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.401 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6816", 2021-01-03T13:07:48.401 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:07:48.402 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.402 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.402 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.402 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6818", 2021-01-03T13:07:48.402 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:07:48.403 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.403 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.403 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.403 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:07:48.403 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.404 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.404 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.404 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6821", 2021-01-03T13:07:48.404 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:07:48.404 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.405 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.405 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.405 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6823", 2021-01-03T13:07:48.405 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:07:48.405 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.406 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.406 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.406 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:07:48.406 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.407 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.407 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.407 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6829", 2021-01-03T13:07:48.407 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:07:48.407 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.408 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.408 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.408 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6831", 2021-01-03T13:07:48.408 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:07:48.408 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.409 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.409 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.409 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:07:48.409 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:07:48.409 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.410 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:07:48.410 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6825", 2021-01-03T13:07:48.410 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:07:48.410 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.410 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.411 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:07:48.411 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6827", 2021-01-03T13:07:48.411 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:07:48.411 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.411 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.412 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.412 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6818/12674", 2021-01-03T13:07:48.412 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6823/12674", 2021-01-03T13:07:48.412 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6831/12674", 2021-01-03T13:07:48.412 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6827/12674", 2021-01-03T13:07:48.413 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:07:48.413 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:07:48.413 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:07:48.413 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:48.413 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.414 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:07:48.414 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_xinfo": [ 2021-01-03T13:07:48.414 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.414 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:07:48.415 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:07:48.415 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:07:48.415 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:07:48.415 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:07:48.415 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:07:48.416 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.659942+0000", 2021-01-03T13:07:48.416 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:07:48.416 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.416 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.416 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:07:48.417 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:07:48.417 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:07:48.417 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:07:48.417 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:07:48.417 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:07:48.418 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.750326+0000", 2021-01-03T13:07:48.418 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:07:48.418 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.418 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.418 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:07:48.419 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:07:48.419 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:07:48.419 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:07:48.419 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:07:48.419 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:07:48.420 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.587742+0000", 2021-01-03T13:07:48.420 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:07:48.420 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.420 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.420 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:07:48.421 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:07:48.421 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:07:48.421 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:07:48.421 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:07:48.421 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:07:48.422 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.855073+0000", 2021-01-03T13:07:48.422 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:07:48.422 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.422 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.423 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:07:48.423 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:07:48.423 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:07:48.423 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:07:48.423 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:07:48.424 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:07:48.424 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.565030+0000", 2021-01-03T13:07:48.424 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:07:48.424 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.425 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.425 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:07:48.425 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:07:48.425 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:07:48.425 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:07:48.426 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:07:48.426 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:07:48.426 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.786206+0000", 2021-01-03T13:07:48.426 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:07:48.426 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.427 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.427 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:07:48.427 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:07:48.427 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:07:48.427 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:07:48.428 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:07:48.428 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:07:48.428 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.576185+0000", 2021-01-03T13:07:48.428 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:07:48.428 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.429 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:48.429 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:07:48.429 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:07:48.429 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:07:48.429 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:07:48.430 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:07:48.430 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:07:48.430 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.823786+0000", 2021-01-03T13:07:48.430 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:07:48.430 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.431 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:07:48.431 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap": [], 2021-01-03T13:07:48.431 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap_items": [], 2021-01-03T13:07:48.431 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_temp": [], 2021-01-03T13:07:48.431 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_temp": [], 2021-01-03T13:07:48.432 INFO:teuthology.orchestra.run.smithi133.stdout: "blacklist": {}, 2021-01-03T13:07:48.432 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profiles": { 2021-01-03T13:07:48.432 INFO:teuthology.orchestra.run.smithi133.stdout: "default": { 2021-01-03T13:07:48.432 INFO:teuthology.orchestra.run.smithi133.stdout: "crush-failure-domain": "osd", 2021-01-03T13:07:48.432 INFO:teuthology.orchestra.run.smithi133.stdout: "k": "2", 2021-01-03T13:07:48.433 INFO:teuthology.orchestra.run.smithi133.stdout: "m": "1", 2021-01-03T13:07:48.433 INFO:teuthology.orchestra.run.smithi133.stdout: "plugin": "jerasure", 2021-01-03T13:07:48.433 INFO:teuthology.orchestra.run.smithi133.stdout: "ruleset-failure-domain": "osd", 2021-01-03T13:07:48.433 INFO:teuthology.orchestra.run.smithi133.stdout: "technique": "reed_sol_van" 2021-01-03T13:07:48.433 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:48.434 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:48.434 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps_queue": [], 2021-01-03T13:07:48.434 INFO:teuthology.orchestra.run.smithi133.stdout: "new_removed_snaps": [], 2021-01-03T13:07:48.434 INFO:teuthology.orchestra.run.smithi133.stdout: "new_purged_snaps": [], 2021-01-03T13:07:48.434 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_node_flags": {}, 2021-01-03T13:07:48.435 INFO:teuthology.orchestra.run.smithi133.stdout: "device_class_flags": {} 2021-01-03T13:07:48.435 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:07:48.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.203+0000 7f9246bfd700 1 -- 172.21.15.133:0/2390985561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9218055330 msgr2=0x7f92180577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:48.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.203+0000 7f9246bfd700 1 --2- 172.21.15.133:0/2390985561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9218055330 0x7f92180577f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f923000b000 tx=0x7f92300091a0).stop 2021-01-03T13:07:48.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.203+0000 7f9246bfd700 1 -- 172.21.15.133:0/2390985561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f924009a740 msgr2=0x7f9240147600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:48.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.203+0000 7f9246bfd700 1 --2- 172.21.15.133:0/2390985561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f924009a740 0x7f9240147600 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f92400656c0 tx=0x7f9228006dc0).stop 2021-01-03T13:07:48.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.203+0000 7f9246bfd700 1 -- 172.21.15.133:0/2390985561 shutdown_connections 2021-01-03T13:07:48.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.203+0000 7f9246bfd700 1 --2- 172.21.15.133:0/2390985561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9218055330 0x7f92180577f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.203+0000 7f9246bfd700 1 --2- 172.21.15.133:0/2390985561 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f92400b3d80 0x7f9240065090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.203+0000 7f9246bfd700 1 --2- 172.21.15.133:0/2390985561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f924009a740 0x7f9240147600 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.203+0000 7f9246bfd700 1 --2- 172.21.15.133:0/2390985561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f92400b35a0 0x7f9240064ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.203+0000 7f9246bfd700 1 -- 172.21.15.133:0/2390985561 >> 172.21.15.133:0/2390985561 conn(0x7f924005bdf0 msgr2=0x7f92400ac5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:48.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.207+0000 7f9246bfd700 1 -- 172.21.15.133:0/2390985561 shutdown_connections 2021-01-03T13:07:48.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.207+0000 7f9246bfd700 1 -- 172.21.15.133:0/2390985561 wait complete. 2021-01-03T13:07:48.440 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:07:48.560 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f7570886700 1 Processor -- start 2021-01-03T13:07:48.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f7570886700 1 -- start start 2021-01-03T13:07:48.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f7570886700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f756c0b9f40 0x7f756c146430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f7570886700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f756c146920 0x7f756c14d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.562 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f7570886700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f756c0605f0 con 0x7f756c0b9b60 2021-01-03T13:07:48.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f7570886700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f756c0aed30 con 0x7f756c0b9f40 2021-01-03T13:07:48.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f7570886700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756c0600b0 con 0x7f756c146920 2021-01-03T13:07:48.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f756affd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f756c0b9f40 0x7f756c146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.563 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f756bfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f756c146920 0x7f756c14d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f756affd700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f756c0b9f40 0x7f756c146430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:39004/0 (socket says 172.21.15.133:39004) 2021-01-03T13:07:48.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f756affd700 1 -- 172.21.15.133:0/1910533853 learned_addr learned my addr 172.21.15.133:0/1910533853 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:48.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f756b7fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f756c0b9b60 0x7f756c0b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:40222/0 (socket says 172.21.15.133:40222) 2021-01-03T13:07:48.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f756affd700 1 -- 172.21.15.133:0/1910533853 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f756c146920 msgr2=0x7f756c14d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:48.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f756affd700 1 --2- 172.21.15.133:0/1910533853 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f756c146920 0x7f756c14d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f756affd700 1 -- 172.21.15.133:0/1910533853 >> v1:172.21.15.16:6789/0 conn(0x7f756c0b9b60 legacy=0x7f756c0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:48.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f756affd700 1 -- 172.21.15.133:0/1910533853 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c060350 con 0x7f756c0b9f40 2021-01-03T13:07:48.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f756affd700 1 --2- 172.21.15.133:0/1910533853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f756c0b9f40 0x7f756c146430 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f7560002f30 tx=0x7f7560006e80).ready entity=mon.0 client_cookie=3a1c4fb948fbb707 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:48.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f756a7fc700 1 -- 172.21.15.133:0/1910533853 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75600097f0 con 0x7f756c0b9f40 2021-01-03T13:07:48.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f756a7fc700 1 -- 172.21.15.133:0/1910533853 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7560009950 con 0x7f756c0b9f40 2021-01-03T13:07:48.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f756a7fc700 1 -- 172.21.15.133:0/1910533853 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7560009cb0 con 0x7f756c0b9f40 2021-01-03T13:07:48.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f7570886700 1 -- 172.21.15.133:0/1910533853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f756c0b9f40 msgr2=0x7f756c146430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:48.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.559+0000 7f7570886700 1 --2- 172.21.15.133:0/1910533853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f756c0b9f40 0x7f756c146430 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f7560002f30 tx=0x7f7560006e80).stop 2021-01-03T13:07:48.568 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7570886700 1 -- 172.21.15.133:0/1910533853 shutdown_connections 2021-01-03T13:07:48.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7570886700 1 --2- 172.21.15.133:0/1910533853 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f756c146920 0x7f756c14d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7570886700 1 --2- 172.21.15.133:0/1910533853 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f756c0b9f40 0x7f756c146430 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7570886700 1 -- 172.21.15.133:0/1910533853 >> 172.21.15.133:0/1910533853 conn(0x7f756c0b69e0 msgr2=0x7f756c0b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:48.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7570886700 1 -- 172.21.15.133:0/1910533853 shutdown_connections 2021-01-03T13:07:48.569 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7570886700 1 -- 172.21.15.133:0/1910533853 wait complete. 2021-01-03T13:07:48.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7570886700 1 Processor -- start 2021-01-03T13:07:48.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7570886700 1 -- start start 2021-01-03T13:07:48.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7570886700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f756c0b9b60 0x7f756c0b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7570886700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f756c0b9f40 0x7f756c0b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7570886700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c146920 0x7f756c0b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7570886700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c1436d0 con 0x7f756c0b9b60 2021-01-03T13:07:48.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7570886700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c140ce0 con 0x7f756c146920 2021-01-03T13:07:48.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7570886700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756c142cf0 con 0x7f756c0b9f40 2021-01-03T13:07:48.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f756b7fe700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f756c0b9b60 0x7f756c0b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f756bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c146920 0x7f756c0b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f756bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c146920 0x7f756c0b3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40472/0 (socket says 172.21.15.133:40472) 2021-01-03T13:07:48.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f756bfff700 1 -- 172.21.15.133:0/9728161 learned_addr learned my addr 172.21.15.133:0/9728161 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:48.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f756affd700 1 --2- 172.21.15.133:0/9728161 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f756c0b9f40 0x7f756c0b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f756bfff700 1 -- 172.21.15.133:0/9728161 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f756c0b9f40 msgr2=0x7f756c0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:48.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f756bfff700 1 --2- 172.21.15.133:0/9728161 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f756c0b9f40 0x7f756c0b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f756bfff700 1 -- 172.21.15.133:0/9728161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f756c0b9b60 msgr2=0x7f756c0b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:48.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f756bfff700 1 --2- 172.21.15.133:0/9728161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f756c0b9b60 0x7f756c0b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f756bfff700 1 -- 172.21.15.133:0/9728161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c143430 con 0x7f756c146920 2021-01-03T13:07:48.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f756affd700 1 --2- 172.21.15.133:0/9728161 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f756c0b9f40 0x7f756c0b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:48.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f756bfff700 1 --2- 172.21.15.133:0/9728161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c146920 0x7f756c0b3240 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f756c142e80 tx=0x7f755c006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:48.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7568ff9700 1 -- 172.21.15.133:0/9728161 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f755c00ca10 con 0x7f756c146920 2021-01-03T13:07:48.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7568ff9700 1 -- 172.21.15.133:0/9728161 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c00cb70 con 0x7f756c146920 2021-01-03T13:07:48.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7570886700 1 -- 172.21.15.133:0/9728161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756c140ed0 con 0x7f756c146920 2021-01-03T13:07:48.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7568ff9700 1 -- 172.21.15.133:0/9728161 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f755c00ced0 con 0x7f756c146920 2021-01-03T13:07:48.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.563+0000 7f7570886700 1 -- 172.21.15.133:0/9728161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756c0b3730 con 0x7f756c146920 2021-01-03T13:07:48.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.567+0000 7f7570886700 1 -- 172.21.15.133:0/9728161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f756c057300 con 0x7f756c146920 2021-01-03T13:07:48.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.567+0000 7f7568ff9700 1 -- 172.21.15.133:0/9728161 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f755c01c460 con 0x7f756c146920 2021-01-03T13:07:48.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.567+0000 7f7568ff9700 1 --2- 172.21.15.133:0/9728161 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f754c055380 0x7f754c057840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.567+0000 7f7568ff9700 1 -- 172.21.15.133:0/9728161 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f755c06e330 con 0x7f756c146920 2021-01-03T13:07:48.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.567+0000 7f756b7fe700 1 --2- 172.21.15.133:0/9728161 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f754c055380 0x7f754c057840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.567+0000 7f756b7fe700 1 --2- 172.21.15.133:0/9728161 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f754c055380 0x7f754c057840 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f756400d000 tx=0x7f7564007e90).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:48.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.571+0000 7f7568ff9700 1 -- 172.21.15.133:0/9728161 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f755c0445d0 con 0x7f756c146920 2021-01-03T13:07:48.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.755+0000 7f7570886700 1 -- 172.21.15.133:0/9728161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f756c145f80 con 0x7f756c146920 2021-01-03T13:07:48.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.755+0000 7f7568ff9700 1 -- 172.21.15.133:0/9728161 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+2501 (secure 0 0 0) 0x7f755c047bf0 con 0x7f756c146920 2021-01-03T13:07:48.759 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:48.759 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":72,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/3955382552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3955382552},{"type":"v1","addr":"172.21.15.16:6833","nonce":3955382552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6836/2756803911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2756803911},{"type":"v1","addr":"172.21.15.133:6836","nonce":2756803911}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:32.737122+0000","modified":"2021-01-03T13:07:34.405167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8167":{"gid":8167,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/3125642229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6835","nonce":3125642229},{"type":"v1","addr":"172.21.15.133:6837","nonce":3125642229}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-01-03T13:07:48.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.759+0000 7f7570886700 1 -- 172.21.15.133:0/9728161 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f754c055380 msgr2=0x7f754c057840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:48.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.759+0000 7f7570886700 1 --2- 172.21.15.133:0/9728161 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f754c055380 0x7f754c057840 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f756400d000 tx=0x7f7564007e90).stop 2021-01-03T13:07:48.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.759+0000 7f7570886700 1 -- 172.21.15.133:0/9728161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c146920 msgr2=0x7f756c0b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:48.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.759+0000 7f7570886700 1 --2- 172.21.15.133:0/9728161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c146920 0x7f756c0b3240 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f756c142e80 tx=0x7f755c006dc0).stop 2021-01-03T13:07:48.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.759+0000 7f7570886700 1 -- 172.21.15.133:0/9728161 shutdown_connections 2021-01-03T13:07:48.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.759+0000 7f7570886700 1 --2- 172.21.15.133:0/9728161 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f754c055380 0x7f754c057840 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.759+0000 7f7570886700 1 --2- 172.21.15.133:0/9728161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f756c0b9b60 0x7f756c0b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.759+0000 7f7570886700 1 --2- 172.21.15.133:0/9728161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f756c146920 0x7f756c0b3240 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.759+0000 7f7570886700 1 --2- 172.21.15.133:0/9728161 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f756c0b9f40 0x7f756c0b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.759+0000 7f7570886700 1 -- 172.21.15.133:0/9728161 >> 172.21.15.133:0/9728161 conn(0x7f756c0b69e0 msgr2=0x7f756c0b8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:48.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.759+0000 7f7570886700 1 -- 172.21.15.133:0/9728161 shutdown_connections 2021-01-03T13:07:48.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.759+0000 7f7570886700 1 -- 172.21.15.133:0/9728161 wait complete. 2021-01-03T13:07:48.765 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 72 2021-01-03T13:07:48.780 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-01-03T13:07:48.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a49374700 1 Processor -- start 2021-01-03T13:07:48.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a49374700 1 -- start start 2021-01-03T13:07:48.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a49374700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a440b52c0 0x7f4a440b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a49374700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a44060da0 con 0x7f4a440b0c90 2021-01-03T13:07:48.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a49374700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a440b0ad0 con 0x7f4a440b5c00 2021-01-03T13:07:48.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a49374700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44067a90 con 0x7f4a440b52c0 2021-01-03T13:07:48.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a48b73700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4a440b5c00 0x7f4a44143eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33276/0 (socket says 172.21.15.133:33276) 2021-01-03T13:07:48.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a48b73700 1 -- 172.21.15.133:0/784335664 learned_addr learned my addr 172.21.15.133:0/784335664 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:48.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a43fff700 1 --2- 172.21.15.133:0/784335664 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a440b52c0 0x7f4a440b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a42ffd700 1 -- 172.21.15.133:0/784335664 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383075121 0 0) 0x7f4a3c0010d0 con 0x7f4a440b5c00 2021-01-03T13:07:48.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a42ffd700 1 -- 172.21.15.133:0/784335664 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a24003230 con 0x7f4a440b5c00 2021-01-03T13:07:48.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a42ffd700 1 -- 172.21.15.133:0/784335664 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3334148053 0 0) 0x7f4a24003230 con 0x7f4a440b5c00 2021-01-03T13:07:48.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a42ffd700 1 -- 172.21.15.133:0/784335664 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a440b52c0 msgr2=0x7f4a440b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:48.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a42ffd700 1 --2- 172.21.15.133:0/784335664 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a440b52c0 0x7f4a440b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a42ffd700 1 -- 172.21.15.133:0/784335664 >> v1:172.21.15.16:6789/0 conn(0x7f4a440b0c90 legacy=0x7f4a44098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:48.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a42ffd700 1 -- 172.21.15.133:0/784335664 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a440b56a0 con 0x7f4a440b5c00 2021-01-03T13:07:48.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a42ffd700 1 -- 172.21.15.133:0/784335664 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f4a3c001860 con 0x7f4a440b5c00 2021-01-03T13:07:48.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a42ffd700 1 -- 172.21.15.133:0/784335664 >> v1:172.21.15.133:6789/0 conn(0x7f4a440b5c00 legacy=0x7f4a44143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:48.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a42ffd700 1 --2- 172.21.15.133:0/784335664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a24003720 0x7f4a24003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a42ffd700 1 --2- 172.21.15.133:0/784335664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a24004060 0x7f4a24004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a42ffd700 1 --2- 172.21.15.133:0/784335664 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a440b52c0 0x7f4a24004b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a42ffd700 1 -- 172.21.15.133:0/784335664 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44067a90 con 0x7f4a24004060 2021-01-03T13:07:48.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a42ffd700 1 -- 172.21.15.133:0/784335664 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a240050d0 con 0x7f4a24003720 2021-01-03T13:07:48.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.887+0000 7f4a42ffd700 1 -- 172.21.15.133:0/784335664 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a24005290 con 0x7f4a440b52c0 2021-01-03T13:07:48.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a48b73700 1 --2- 172.21.15.133:0/784335664 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a440b52c0 0x7f4a24004b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a43fff700 1 --2- 172.21.15.133:0/784335664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a24003720 0x7f4a24003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a437fe700 1 --2- 172.21.15.133:0/784335664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a24004060 0x7f4a24004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a48b73700 1 -- 172.21.15.133:0/784335664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a24003720 msgr2=0x7f4a24003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:48.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a48b73700 1 --2- 172.21.15.133:0/784335664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a24003720 0x7f4a24003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a48b73700 1 -- 172.21.15.133:0/784335664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a24004060 msgr2=0x7f4a24004530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:48.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a48b73700 1 --2- 172.21.15.133:0/784335664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a24004060 0x7f4a24004530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a48b73700 1 -- 172.21.15.133:0/784335664 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a24003230 con 0x7f4a440b52c0 2021-01-03T13:07:48.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a437fe700 1 --2- 172.21.15.133:0/784335664 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a24004060 0x7f4a24004530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:48.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a43fff700 1 --2- 172.21.15.133:0/784335664 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a24003720 0x7f4a24003b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:48.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a48b73700 1 --2- 172.21.15.133:0/784335664 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a440b52c0 0x7f4a24004b90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f4a3c001570 tx=0x7f4a440b0070).ready entity=mon.2 client_cookie=d7d35a7e8a6a51f0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:48.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a42ffd700 1 -- 172.21.15.133:0/784335664 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a3c00ce10 con 0x7f4a440b52c0 2021-01-03T13:07:48.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a42ffd700 1 -- 172.21.15.133:0/784335664 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3c0072e0 con 0x7f4a440b52c0 2021-01-03T13:07:48.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a49374700 1 -- 172.21.15.133:0/784335664 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a440b52c0 msgr2=0x7f4a24004b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:48.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a42ffd700 1 -- 172.21.15.133:0/784335664 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a3c0057d0 con 0x7f4a440b52c0 2021-01-03T13:07:48.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a49374700 1 --2- 172.21.15.133:0/784335664 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a440b52c0 0x7f4a24004b90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f4a3c001570 tx=0x7f4a440b0070).stop 2021-01-03T13:07:48.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a48b73700 1 -- 172.21.15.133:0/784335664 reap_dead start 2021-01-03T13:07:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a49374700 1 -- 172.21.15.133:0/784335664 shutdown_connections 2021-01-03T13:07:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a49374700 1 -- 172.21.15.133:0/784335664 >> 172.21.15.133:0/784335664 conn(0x7f4a4405bdf0 msgr2=0x7f4a4405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a49374700 1 -- 172.21.15.133:0/784335664 shutdown_connections 2021-01-03T13:07:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a49374700 1 -- 172.21.15.133:0/784335664 wait complete. 2021-01-03T13:07:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a49374700 1 Processor -- start 2021-01-03T13:07:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.891+0000 7f4a49374700 1 -- start start 2021-01-03T13:07:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a49374700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a441432b0 0x7f4a44146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a49374700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a44063540 0x7f4a440650e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a49374700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a44140260 0x7f4a441406e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a49374700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44143690 con 0x7f4a441432b0 2021-01-03T13:07:48.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a49374700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44143f90 con 0x7f4a44063540 2021-01-03T13:07:48.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a49374700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44145d80 con 0x7f4a44140260 2021-01-03T13:07:48.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a437fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a44063540 0x7f4a440650e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a437fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a44063540 0x7f4a440650e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40488/0 (socket says 172.21.15.133:40488) 2021-01-03T13:07:48.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a437fe700 1 -- 172.21.15.133:0/2755019949 learned_addr learned my addr 172.21.15.133:0/2755019949 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:48.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a43fff700 1 --2- 172.21.15.133:0/2755019949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a441432b0 0x7f4a44146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a48b73700 1 --2- 172.21.15.133:0/2755019949 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a44140260 0x7f4a441406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a437fe700 1 -- 172.21.15.133:0/2755019949 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a44140260 msgr2=0x7f4a441406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:48.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a437fe700 1 --2- 172.21.15.133:0/2755019949 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a44140260 0x7f4a441406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a437fe700 1 -- 172.21.15.133:0/2755019949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a441432b0 msgr2=0x7f4a44146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:48.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a437fe700 1 --2- 172.21.15.133:0/2755019949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a441432b0 0x7f4a44146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:48.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a437fe700 1 -- 172.21.15.133:0/2755019949 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a44146020 con 0x7f4a44063540 2021-01-03T13:07:48.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a437fe700 1 --2- 172.21.15.133:0/2755019949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a44063540 0x7f4a440650e0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f4a3400d000 tx=0x7f4a34009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:48.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a417fa700 1 -- 172.21.15.133:0/2755019949 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a34014450 con 0x7f4a44063540 2021-01-03T13:07:48.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a417fa700 1 -- 172.21.15.133:0/2755019949 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a340145b0 con 0x7f4a44063540 2021-01-03T13:07:48.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a49374700 1 -- 172.21.15.133:0/2755019949 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a441462c0 con 0x7f4a44063540 2021-01-03T13:07:48.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a417fa700 1 -- 172.21.15.133:0/2755019949 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a34014910 con 0x7f4a44063540 2021-01-03T13:07:48.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a49374700 1 -- 172.21.15.133:0/2755019949 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a44145aa0 con 0x7f4a44063540 2021-01-03T13:07:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a49374700 1 -- 172.21.15.133:0/2755019949 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a44140d70 con 0x7f4a44063540 2021-01-03T13:07:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a417fa700 1 -- 172.21.15.133:0/2755019949 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4a3401b030 con 0x7f4a44063540 2021-01-03T13:07:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.895+0000 7f4a417fa700 1 --2- 172.21.15.133:0/2755019949 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a280553f0 0x7f4a280578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.899+0000 7f4a417fa700 1 -- 172.21.15.133:0/2755019949 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4a3406e680 con 0x7f4a44063540 2021-01-03T13:07:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.899+0000 7f4a43fff700 1 --2- 172.21.15.133:0/2755019949 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a280553f0 0x7f4a280578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.899+0000 7f4a43fff700 1 --2- 172.21.15.133:0/2755019949 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a280553f0 0x7f4a280578b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f4a2c008000 tx=0x7f4a2c008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:48.903+0000 7f4a417fa700 1 -- 172.21.15.133:0/2755019949 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4a34044980 con 0x7f4a44063540 2021-01-03T13:07:49.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.083+0000 7f4a49374700 1 -- 172.21.15.133:0/2755019949 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4a44057300 con 0x7f4a44063540 2021-01-03T13:07:49.487 INFO:tasks.ceph.mon.b.smithi016.stderr:2021-01-03T13:07:49.483+0000 7fba5c9c4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-01-03T13:07:49.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.499+0000 7f4a417fa700 1 -- 172.21.15.133:0/2755019949 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4a34047fa0 con 0x7f4a44063540 2021-01-03T13:07:49.505 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.503+0000 7f4a49374700 1 -- 172.21.15.133:0/2755019949 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a280553f0 msgr2=0x7f4a280578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:49.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.503+0000 7f4a49374700 1 --2- 172.21.15.133:0/2755019949 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a280553f0 0x7f4a280578b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f4a2c008000 tx=0x7f4a2c008040).stop 2021-01-03T13:07:49.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.503+0000 7f4a49374700 1 -- 172.21.15.133:0/2755019949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a44063540 msgr2=0x7f4a440650e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:49.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.503+0000 7f4a49374700 1 --2- 172.21.15.133:0/2755019949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a44063540 0x7f4a440650e0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f4a3400d000 tx=0x7f4a34009040).stop 2021-01-03T13:07:49.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.503+0000 7f4a49374700 1 -- 172.21.15.133:0/2755019949 shutdown_connections 2021-01-03T13:07:49.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.503+0000 7f4a49374700 1 --2- 172.21.15.133:0/2755019949 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4a280553f0 0x7f4a280578b0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:49.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.503+0000 7f4a49374700 1 --2- 172.21.15.133:0/2755019949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4a441432b0 0x7f4a44146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:49.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.503+0000 7f4a49374700 1 --2- 172.21.15.133:0/2755019949 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4a44140260 0x7f4a441406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:49.507 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.503+0000 7f4a49374700 1 --2- 172.21.15.133:0/2755019949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4a44063540 0x7f4a440650e0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:49.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.503+0000 7f4a49374700 1 -- 172.21.15.133:0/2755019949 >> 172.21.15.133:0/2755019949 conn(0x7f4a4405bdf0 msgr2=0x7f4a4414bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:49.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.503+0000 7f4a49374700 1 -- 172.21.15.133:0/2755019949 shutdown_connections 2021-01-03T13:07:49.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.503+0000 7f4a49374700 1 -- 172.21.15.133:0/2755019949 wait complete. 2021-01-03T13:07:49.508 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-01-03T13:07:49.522 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:07:49.527 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T13:07:49.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd9fa1700 1 Processor -- start 2021-01-03T13:07:49.637 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd9fa1700 1 -- start start 2021-01-03T13:07:49.639 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd9fa1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fabd40b1300 0x7fabd41428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd9fa1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fabd40b2050 0x7fabd40a8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd9fa1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd40afa40 con 0x7fabd40b0c30 2021-01-03T13:07:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd9fa1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd40b25d0 con 0x7fabd40b2050 2021-01-03T13:07:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd9fa1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd40b2870 con 0x7fabd40b1300 2021-01-03T13:07:49.640 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd97a0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fabd40b2050 0x7fabd40a8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd97a0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fabd40b2050 0x7fabd40a8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40512/0 (socket says 172.21.15.133:40512) 2021-01-03T13:07:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd97a0700 1 -- 172.21.15.133:0/856742627 learned_addr learned my addr 172.21.15.133:0/856742627 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd3fff700 1 --1- 172.21.15.133:0/856742627 >> v1:172.21.15.133:6789/0 conn(0x7fabd40b0c30 0x7fabd40ad4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33310/0 (socket says 172.21.15.133:33310) 2021-01-03T13:07:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd8f9f700 1 --2- 172.21.15.133:0/856742627 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fabd40b1300 0x7fabd41428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:49.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd97a0700 1 -- 172.21.15.133:0/856742627 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fabd40b1300 msgr2=0x7fabd41428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd97a0700 1 --2- 172.21.15.133:0/856742627 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fabd40b1300 0x7fabd41428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd97a0700 1 -- 172.21.15.133:0/856742627 >> v1:172.21.15.133:6789/0 conn(0x7fabd40b0c30 legacy=0x7fabd40ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd97a0700 1 -- 172.21.15.133:0/856742627 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd40ad040 con 0x7fabd40b2050 2021-01-03T13:07:49.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd97a0700 1 --2- 172.21.15.133:0/856742627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabd40b2050 0x7fabd40a8850 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7fabcc0032b0 tx=0x7fabcc00a410).ready entity=mon.1 client_cookie=488755ec3817eb36 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:49.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.635+0000 7fabd37fe700 1 -- 172.21.15.133:0/856742627 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabcc00f470 con 0x7fabd40b2050 2021-01-03T13:07:49.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd37fe700 1 -- 172.21.15.133:0/856742627 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabcc00f5d0 con 0x7fabd40b2050 2021-01-03T13:07:49.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd37fe700 1 -- 172.21.15.133:0/856742627 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabcc00f930 con 0x7fabd40b2050 2021-01-03T13:07:49.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 -- 172.21.15.133:0/856742627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabd40b2050 msgr2=0x7fabd40a8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:49.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 --2- 172.21.15.133:0/856742627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabd40b2050 0x7fabd40a8850 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7fabcc0032b0 tx=0x7fabcc00a410).stop 2021-01-03T13:07:49.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 -- 172.21.15.133:0/856742627 shutdown_connections 2021-01-03T13:07:49.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 --2- 172.21.15.133:0/856742627 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabd40b2050 0x7fabd40a8850 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:49.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 --2- 172.21.15.133:0/856742627 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fabd40b1300 0x7fabd41428c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:49.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 -- 172.21.15.133:0/856742627 >> 172.21.15.133:0/856742627 conn(0x7fabd406b050 msgr2=0x7fabd4060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:49.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 -- 172.21.15.133:0/856742627 shutdown_connections 2021-01-03T13:07:49.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 -- 172.21.15.133:0/856742627 wait complete. 2021-01-03T13:07:49.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 Processor -- start 2021-01-03T13:07:49.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 -- start start 2021-01-03T13:07:49.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabd40b0c30 0x7fabd40a0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:49.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabd40b1300 0x7fabd40a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:49.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fabd40b2050 0x7fabd40a8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:49.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd4142360 con 0x7fabd40b1300 2021-01-03T13:07:49.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd40a4d30 con 0x7fabd40b0c30 2021-01-03T13:07:49.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd40a4350 con 0x7fabd40b2050 2021-01-03T13:07:49.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd8f9f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabd40b0c30 0x7fabd40a0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:49.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd8f9f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabd40b0c30 0x7fabd40a0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40514/0 (socket says 172.21.15.133:40514) 2021-01-03T13:07:49.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd8f9f700 1 -- 172.21.15.133:0/860916813 learned_addr learned my addr 172.21.15.133:0/860916813 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:49.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd3fff700 1 --2- 172.21.15.133:0/860916813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabd40b1300 0x7fabd40a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:49.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd8f9f700 1 -- 172.21.15.133:0/860916813 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fabd40b2050 msgr2=0x7fabd40a8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:49.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd97a0700 1 --2- 172.21.15.133:0/860916813 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fabd40b2050 0x7fabd40a8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:49.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd8f9f700 1 --2- 172.21.15.133:0/860916813 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fabd40b2050 0x7fabd40a8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:49.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd8f9f700 1 -- 172.21.15.133:0/860916813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabd40b1300 msgr2=0x7fabd40a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:49.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd8f9f700 1 --2- 172.21.15.133:0/860916813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabd40b1300 0x7fabd40a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:49.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd8f9f700 1 -- 172.21.15.133:0/860916813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd40a45f0 con 0x7fabd40b0c30 2021-01-03T13:07:49.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd3fff700 1 --2- 172.21.15.133:0/860916813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabd40b1300 0x7fabd40a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:49.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd97a0700 1 --2- 172.21.15.133:0/860916813 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fabd40b2050 0x7fabd40a8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:49.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd8f9f700 1 --2- 172.21.15.133:0/860916813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabd40b0c30 0x7fabd40a0fc0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7fabc400c000 tx=0x7fabc4006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:49.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd1ffb700 1 -- 172.21.15.133:0/860916813 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabc400ca80 con 0x7fabd40b0c30 2021-01-03T13:07:49.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd1ffb700 1 -- 172.21.15.133:0/860916813 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc400cbe0 con 0x7fabd40b0c30 2021-01-03T13:07:49.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 -- 172.21.15.133:0/860916813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd40a4890 con 0x7fabd40b0c30 2021-01-03T13:07:49.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd1ffb700 1 -- 172.21.15.133:0/860916813 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabc40123f0 con 0x7fabd40b0c30 2021-01-03T13:07:49.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.639+0000 7fabd9fa1700 1 -- 172.21.15.133:0/860916813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd40a2aa0 con 0x7fabd40b0c30 2021-01-03T13:07:49.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.643+0000 7fabd9fa1700 1 -- 172.21.15.133:0/860916813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd4057300 con 0x7fabd40b0c30 2021-01-03T13:07:49.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.643+0000 7fabd1ffb700 1 -- 172.21.15.133:0/860916813 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fabc4012550 con 0x7fabd40b0c30 2021-01-03T13:07:49.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.643+0000 7fabd1ffb700 1 --2- 172.21.15.133:0/860916813 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fabb4055440 0x7fabb4057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:49.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.643+0000 7fabd1ffb700 1 -- 172.21.15.133:0/860916813 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fabc406e5f0 con 0x7fabd40b0c30 2021-01-03T13:07:49.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.643+0000 7fabd3fff700 1 --2- 172.21.15.133:0/860916813 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fabb4055440 0x7fabb4057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:49.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.643+0000 7fabd3fff700 1 --2- 172.21.15.133:0/860916813 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fabb4055440 0x7fabb4057900 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fabc800b000 tx=0x7fabc80070e0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:49.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.651+0000 7fabd1ffb700 1 -- 172.21.15.133:0/860916813 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fabc40447a0 con 0x7fabd40b0c30 2021-01-03T13:07:49.837 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.835+0000 7fabd9fa1700 1 -- 172.21.15.133:0/860916813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabd405f080 con 0x7fabd40b0c30 2021-01-03T13:07:49.838 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.835+0000 7fabd1ffb700 1 -- 172.21.15.133:0/860916813 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+2138 (secure 0 0 0) 0x7fabc4047dc0 con 0x7fabd40b0c30 2021-01-03T13:07:49.838 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:49.838 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":73,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/3955382552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":3955382552},{"type":"v1","addr":"172.21.15.16:6833","nonce":3955382552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.133:6836/2756803911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":2756803911},{"type":"v1","addr":"172.21.15.133:6836","nonce":2756803911}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":73,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:32.737122+0000","modified":"2021-01-03T13:07:49.487602+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":153,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2021-01-03T13:07:49.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.835+0000 7fabd9fa1700 1 -- 172.21.15.133:0/860916813 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fabb4055440 msgr2=0x7fabb4057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:49.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.835+0000 7fabd9fa1700 1 --2- 172.21.15.133:0/860916813 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fabb4055440 0x7fabb4057900 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fabc800b000 tx=0x7fabc80070e0).stop 2021-01-03T13:07:49.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.835+0000 7fabd9fa1700 1 -- 172.21.15.133:0/860916813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabd40b0c30 msgr2=0x7fabd40a0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:49.840 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.835+0000 7fabd9fa1700 1 --2- 172.21.15.133:0/860916813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabd40b0c30 0x7fabd40a0fc0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7fabc400c000 tx=0x7fabc4006dc0).stop 2021-01-03T13:07:49.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.835+0000 7fabd9fa1700 1 -- 172.21.15.133:0/860916813 shutdown_connections 2021-01-03T13:07:49.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.835+0000 7fabd9fa1700 1 --2- 172.21.15.133:0/860916813 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fabb4055440 0x7fabb4057900 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:49.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.835+0000 7fabd9fa1700 1 --2- 172.21.15.133:0/860916813 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fabd40b2050 0x7fabd40a8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:49.841 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.835+0000 7fabd9fa1700 1 --2- 172.21.15.133:0/860916813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabd40b0c30 0x7fabd40a0fc0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.835+0000 7fabd9fa1700 1 --2- 172.21.15.133:0/860916813 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fabd40b1300 0x7fabd40a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.835+0000 7fabd9fa1700 1 -- 172.21.15.133:0/860916813 >> 172.21.15.133:0/860916813 conn(0x7fabd406b050 msgr2=0x7fabd4142f70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.839+0000 7fabd9fa1700 1 -- 172.21.15.133:0/860916813 shutdown_connections 2021-01-03T13:07:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:49.839+0000 7fabd9fa1700 1 -- 172.21.15.133:0/860916813 wait complete. 2021-01-03T13:07:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 73 2021-01-03T13:07:49.851 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-01-03T13:07:50.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.015+0000 7ff9b2316700 1 Processor -- start 2021-01-03T13:07:50.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.015+0000 7ff9b2316700 1 -- start start 2021-01-03T13:07:50.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.015+0000 7ff9b2316700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9ac0af200 0x7ff9ac05bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:50.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.015+0000 7ff9b2316700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff9ac144bb0 0x7ff9ac0ab300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:50.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.015+0000 7ff9b2316700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac0af5e0 con 0x7ff9ac0b0210 2021-01-03T13:07:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.015+0000 7ff9b2316700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ac05c620 con 0x7ff9ac0af200 2021-01-03T13:07:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.015+0000 7ff9b2316700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac05c8c0 con 0x7ff9ac144bb0 2021-01-03T13:07:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.015+0000 7ff9b1314700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9ac0af200 0x7ff9ac05bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.015+0000 7ff9b1314700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9ac0af200 0x7ff9ac05bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40522/0 (socket says 172.21.15.133:40522) 2021-01-03T13:07:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.015+0000 7ff9b1314700 1 -- 172.21.15.133:0/2240619321 learned_addr learned my addr 172.21.15.133:0/2240619321 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.015+0000 7ff9b1b15700 1 --2- 172.21.15.133:0/2240619321 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff9ac144bb0 0x7ff9ac0ab300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:50.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.015+0000 7ff9b1314700 1 -- 172.21.15.133:0/2240619321 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff9ac144bb0 msgr2=0x7ff9ac0ab300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:50.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.015+0000 7ff9b1314700 1 --2- 172.21.15.133:0/2240619321 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff9ac144bb0 0x7ff9ac0ab300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:50.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.015+0000 7ff9b1314700 1 -- 172.21.15.133:0/2240619321 >> v1:172.21.15.16:6789/0 conn(0x7ff9ac0b0210 legacy=0x7ff9ac141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:50.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.019+0000 7ff9b1314700 1 -- 172.21.15.133:0/2240619321 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac140a40 con 0x7ff9ac0af200 2021-01-03T13:07:50.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.015+0000 7ff9abfff700 1 -- 172.21.15.133:0/2240619321 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505069705 0 0) 0x7ff9ac0af5e0 con 0x7ff9ac0b0210 2021-01-03T13:07:50.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.019+0000 7ff9b1314700 1 --2- 172.21.15.133:0/2240619321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9ac0af200 0x7ff9ac05bdf0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7ff9a4002f30 tx=0x7ff9a4006e80).ready entity=mon.1 client_cookie=d3c77a084b1f09ae server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:50.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.019+0000 7ff9abfff700 1 -- 172.21.15.133:0/2240619321 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9a40097f0 con 0x7ff9ac0af200 2021-01-03T13:07:50.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.019+0000 7ff9abfff700 1 -- 172.21.15.133:0/2240619321 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a4009950 con 0x7ff9ac0af200 2021-01-03T13:07:50.023 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.019+0000 7ff9abfff700 1 -- 172.21.15.133:0/2240619321 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9a4009cb0 con 0x7ff9ac0af200 2021-01-03T13:07:50.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.019+0000 7ff9b2316700 1 -- 172.21.15.133:0/2240619321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9ac0af200 msgr2=0x7ff9ac05bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:50.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.019+0000 7ff9b2316700 1 --2- 172.21.15.133:0/2240619321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9ac0af200 0x7ff9ac05bdf0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7ff9a4002f30 tx=0x7ff9a4006e80).stop 2021-01-03T13:07:50.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.019+0000 7ff9b2316700 1 -- 172.21.15.133:0/2240619321 shutdown_connections 2021-01-03T13:07:50.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.019+0000 7ff9b2316700 1 --2- 172.21.15.133:0/2240619321 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff9ac144bb0 0x7ff9ac0ab300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:50.024 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.019+0000 7ff9b2316700 1 --2- 172.21.15.133:0/2240619321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9ac0af200 0x7ff9ac05bdf0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.019+0000 7ff9b2316700 1 -- 172.21.15.133:0/2240619321 >> 172.21.15.133:0/2240619321 conn(0x7ff9ac06b050 msgr2=0x7ff9ac060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.019+0000 7ff9b2316700 1 -- 172.21.15.133:0/2240619321 shutdown_connections 2021-01-03T13:07:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.019+0000 7ff9b2316700 1 -- 172.21.15.133:0/2240619321 wait complete. 2021-01-03T13:07:50.025 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b2316700 1 Processor -- start 2021-01-03T13:07:50.026 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b2316700 1 -- start start 2021-01-03T13:07:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b2316700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9ac0af200 0x7ff9ac0ab320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b2316700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9ac0b0210 0x7ff9ac0accb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b2316700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff9ac144bb0 0x7ff9ac1526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b2316700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0ae430 con 0x7ff9ac0b0210 2021-01-03T13:07:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b2316700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0ae6d0 con 0x7ff9ac0af200 2021-01-03T13:07:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b2316700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac151fb0 con 0x7ff9ac144bb0 2021-01-03T13:07:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b1314700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9ac0af200 0x7ff9ac0ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b1314700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9ac0af200 0x7ff9ac0ab320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40526/0 (socket says 172.21.15.133:40526) 2021-01-03T13:07:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b1314700 1 -- 172.21.15.133:0/2968138231 learned_addr learned my addr 172.21.15.133:0/2968138231 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b1b15700 1 --2- 172.21.15.133:0/2968138231 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff9ac144bb0 0x7ff9ac1526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b0b13700 1 --2- 172.21.15.133:0/2968138231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9ac0b0210 0x7ff9ac0accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b1314700 1 -- 172.21.15.133:0/2968138231 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff9ac144bb0 msgr2=0x7ff9ac1526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b1314700 1 --2- 172.21.15.133:0/2968138231 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff9ac144bb0 0x7ff9ac1526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b1314700 1 -- 172.21.15.133:0/2968138231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9ac0b0210 msgr2=0x7ff9ac0accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b1314700 1 --2- 172.21.15.133:0/2968138231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9ac0b0210 0x7ff9ac0accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b1314700 1 -- 172.21.15.133:0/2968138231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac152250 con 0x7ff9ac0af200 2021-01-03T13:07:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b1314700 1 --2- 172.21.15.133:0/2968138231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9ac0af200 0x7ff9ac0ab320 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7ff9a4002f30 tx=0x7ff9a4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9aa7fc700 1 -- 172.21.15.133:0/2968138231 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9a4011c30 con 0x7ff9ac0af200 2021-01-03T13:07:50.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9aa7fc700 1 -- 172.21.15.133:0/2968138231 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a4011d90 con 0x7ff9ac0af200 2021-01-03T13:07:50.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b2316700 1 -- 172.21.15.133:0/2968138231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ac066ac0 con 0x7ff9ac0af200 2021-01-03T13:07:50.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9aa7fc700 1 -- 172.21.15.133:0/2968138231 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9a401e650 con 0x7ff9ac0af200 2021-01-03T13:07:50.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.023+0000 7ff9b2316700 1 -- 172.21.15.133:0/2968138231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ac152d80 con 0x7ff9ac0af200 2021-01-03T13:07:50.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.027+0000 7ff9b2316700 1 -- 172.21.15.133:0/2968138231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ac1523e0 con 0x7ff9ac0af200 2021-01-03T13:07:50.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.027+0000 7ff9aa7fc700 1 -- 172.21.15.133:0/2968138231 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff9a4025030 con 0x7ff9ac0af200 2021-01-03T13:07:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.027+0000 7ff9aa7fc700 1 --2- 172.21.15.133:0/2968138231 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff98c055440 0x7ff98c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.027+0000 7ff9b0b13700 1 --2- 172.21.15.133:0/2968138231 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff98c055440 0x7ff98c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.027+0000 7ff9aa7fc700 1 -- 172.21.15.133:0/2968138231 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff9a406f350 con 0x7ff9ac0af200 2021-01-03T13:07:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.027+0000 7ff9b0b13700 1 --2- 172.21.15.133:0/2968138231 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff98c055440 0x7ff98c057900 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7ff9a000d000 tx=0x7ff9a0007d50).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:50.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.035+0000 7ff9aa7fc700 1 -- 172.21.15.133:0/2968138231 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff9a4045600 con 0x7ff9ac0af200 2021-01-03T13:07:50.237 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:50.235+0000 7ff9b2316700 1 -- 172.21.15.133:0/2968138231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff9ac057300 con 0x7ff9ac0af200 2021-01-03T13:07:51.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.095+0000 7ff9aa7fc700 1 -- 172.21.15.133:0/2968138231 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff9a4048c20 con 0x7ff9ac0af200 2021-01-03T13:07:51.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.099+0000 7ff9b2316700 1 -- 172.21.15.133:0/2968138231 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff98c055440 msgr2=0x7ff98c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:51.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.099+0000 7ff9b2316700 1 --2- 172.21.15.133:0/2968138231 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff98c055440 0x7ff98c057900 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7ff9a000d000 tx=0x7ff9a0007d50).stop 2021-01-03T13:07:51.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.099+0000 7ff9b2316700 1 -- 172.21.15.133:0/2968138231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9ac0af200 msgr2=0x7ff9ac0ab320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:51.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.099+0000 7ff9b2316700 1 --2- 172.21.15.133:0/2968138231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9ac0af200 0x7ff9ac0ab320 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7ff9a4002f30 tx=0x7ff9a4015000).stop 2021-01-03T13:07:51.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.099+0000 7ff9b2316700 1 -- 172.21.15.133:0/2968138231 shutdown_connections 2021-01-03T13:07:51.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.099+0000 7ff9b2316700 1 --2- 172.21.15.133:0/2968138231 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff98c055440 0x7ff98c057900 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:51.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.099+0000 7ff9b2316700 1 --2- 172.21.15.133:0/2968138231 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff9ac144bb0 0x7ff9ac1526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:51.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.099+0000 7ff9b2316700 1 --2- 172.21.15.133:0/2968138231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9ac0af200 0x7ff9ac0ab320 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:51.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.099+0000 7ff9b2316700 1 --2- 172.21.15.133:0/2968138231 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff9ac0b0210 0x7ff9ac0accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:51.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.099+0000 7ff9b2316700 1 -- 172.21.15.133:0/2968138231 >> 172.21.15.133:0/2968138231 conn(0x7ff9ac06b050 msgr2=0x7ff9ac0b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:51.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.099+0000 7ff9b2316700 1 -- 172.21.15.133:0/2968138231 shutdown_connections 2021-01-03T13:07:51.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.099+0000 7ff9b2316700 1 -- 172.21.15.133:0/2968138231 wait complete. 2021-01-03T13:07:51.118 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-01-03T13:07:51.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.239+0000 7ff1bb59e700 1 Processor -- start 2021-01-03T13:07:51.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.239+0000 7ff1bb59e700 1 -- start start 2021-01-03T13:07:51.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1bb59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1bc0a9750 0x7ff1bc0a8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:51.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1bb59e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1bc0b16a0 con 0x7ff1bc0b0a60 2021-01-03T13:07:51.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1bb59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1bc0a9ba0 con 0x7ff1bc0b2460 2021-01-03T13:07:51.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1bb59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1bc0b2840 con 0x7ff1bc0a9750 2021-01-03T13:07:51.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1bad9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1bc0a9750 0x7ff1bc0a8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:51.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1ba59c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff1bc0b2460 0x7ff1bc0ad490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33334/0 (socket says 172.21.15.133:33334) 2021-01-03T13:07:51.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1ba59c700 1 -- 172.21.15.133:0/708023765 learned_addr learned my addr 172.21.15.133:0/708023765 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:51.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1bad9d700 1 -- 172.21.15.133:0/708023765 >> v1:172.21.15.133:6789/0 conn(0x7ff1bc0b2460 legacy=0x7ff1bc0ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:51.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1b9d9b700 1 -- 172.21.15.133:0/708023765 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421415069 0 0) 0x7ff1bc0a9ba0 con 0x7ff1bc0b2460 2021-01-03T13:07:51.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1bad9d700 1 -- 172.21.15.133:0/708023765 >> v1:172.21.15.16:6789/0 conn(0x7ff1bc0b0a60 legacy=0x7ff1bc0a8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:51.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1bad9d700 1 -- 172.21.15.133:0/708023765 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc0aeae0 con 0x7ff1bc0a9750 2021-01-03T13:07:51.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1bad9d700 1 --2- 172.21.15.133:0/708023765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1bc0a9750 0x7ff1bc0a8f60 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7ff1b4003300 tx=0x7ff1b400a330).ready entity=mon.1 client_cookie=145d22b18bad3259 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:51.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1b9d9b700 1 -- 172.21.15.133:0/708023765 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1b4010410 con 0x7ff1bc0a9750 2021-01-03T13:07:51.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1b9d9b700 1 -- 172.21.15.133:0/708023765 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b4010570 con 0x7ff1bc0a9750 2021-01-03T13:07:51.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1b9d9b700 1 -- 172.21.15.133:0/708023765 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1b40108d0 con 0x7ff1bc0a9750 2021-01-03T13:07:51.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1bb59e700 1 -- 172.21.15.133:0/708023765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1bc0a9750 msgr2=0x7ff1bc0a8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:51.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1bb59e700 1 --2- 172.21.15.133:0/708023765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1bc0a9750 0x7ff1bc0a8f60 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7ff1b4003300 tx=0x7ff1b400a330).stop 2021-01-03T13:07:51.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1bb59e700 1 -- 172.21.15.133:0/708023765 shutdown_connections 2021-01-03T13:07:51.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1bb59e700 1 --2- 172.21.15.133:0/708023765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1bc0a9750 0x7ff1bc0a8f60 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:51.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1bb59e700 1 -- 172.21.15.133:0/708023765 >> 172.21.15.133:0/708023765 conn(0x7ff1bc06b050 msgr2=0x7ff1bc060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:51.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1bb59e700 1 -- 172.21.15.133:0/708023765 shutdown_connections 2021-01-03T13:07:51.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.243+0000 7ff1bb59e700 1 -- 172.21.15.133:0/708023765 wait complete. 2021-01-03T13:07:51.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.247+0000 7ff1bb59e700 1 Processor -- start 2021-01-03T13:07:51.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.247+0000 7ff1bb59e700 1 -- start start 2021-01-03T13:07:51.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.247+0000 7ff1bb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1bc0a9750 0x7ff1bc09fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:51.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.247+0000 7ff1bb59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff1bc0b0a60 0x7ff1bc0a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:51.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.247+0000 7ff1bb59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1bc0b2460 0x7ff1bc0a7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:51.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.247+0000 7ff1bb59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc09eef0 con 0x7ff1bc0b2460 2021-01-03T13:07:51.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.247+0000 7ff1bb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc09e7b0 con 0x7ff1bc0a9750 2021-01-03T13:07:51.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.247+0000 7ff1bb59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc09e9e0 con 0x7ff1bc0b0a60 2021-01-03T13:07:51.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.247+0000 7ff1ba59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1bc0a9750 0x7ff1bc09fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:51.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.247+0000 7ff1ba59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1bc0a9750 0x7ff1bc09fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40540/0 (socket says 172.21.15.133:40540) 2021-01-03T13:07:51.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.247+0000 7ff1ba59c700 1 -- 172.21.15.133:0/1065347272 learned_addr learned my addr 172.21.15.133:0/1065347272 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:51.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1bad9d700 1 --2- 172.21.15.133:0/1065347272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1bc0b2460 0x7ff1bc0a7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:51.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1b1d9b700 1 --2- 172.21.15.133:0/1065347272 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff1bc0b0a60 0x7ff1bc0a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:51.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1ba59c700 1 -- 172.21.15.133:0/1065347272 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff1bc0b0a60 msgr2=0x7ff1bc0a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:51.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1ba59c700 1 --2- 172.21.15.133:0/1065347272 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff1bc0b0a60 0x7ff1bc0a0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:51.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1ba59c700 1 -- 172.21.15.133:0/1065347272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1bc0b2460 msgr2=0x7ff1bc0a7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:51.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1ba59c700 1 --2- 172.21.15.133:0/1065347272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1bc0b2460 0x7ff1bc0a7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:51.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1ba59c700 1 -- 172.21.15.133:0/1065347272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc14e560 con 0x7ff1bc0a9750 2021-01-03T13:07:51.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1b1d9b700 1 --2- 172.21.15.133:0/1065347272 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff1bc0b0a60 0x7ff1bc0a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:51.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1ba59c700 1 --2- 172.21.15.133:0/1065347272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1bc0a9750 0x7ff1bc09fc50 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7ff1ac000e90 tx=0x7ff1ac007cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:51.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1b3fff700 1 -- 172.21.15.133:0/1065347272 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1ac0072e0 con 0x7ff1bc0a9750 2021-01-03T13:07:51.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1b3fff700 1 -- 172.21.15.133:0/1065347272 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac007440 con 0x7ff1bc0a9750 2021-01-03T13:07:51.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1bb59e700 1 -- 172.21.15.133:0/1065347272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1bc14e800 con 0x7ff1bc0a9750 2021-01-03T13:07:51.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1b3fff700 1 -- 172.21.15.133:0/1065347272 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1ac0057d0 con 0x7ff1bc0a9750 2021-01-03T13:07:51.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1bb59e700 1 -- 172.21.15.133:0/1065347272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1bc0674c0 con 0x7ff1bc0a9750 2021-01-03T13:07:51.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1bb59e700 1 -- 172.21.15.133:0/1065347272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1bc14e3c0 con 0x7ff1bc0a9750 2021-01-03T13:07:51.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1b3fff700 1 -- 172.21.15.133:0/1065347272 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff1ac010070 con 0x7ff1bc0a9750 2021-01-03T13:07:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1b3fff700 1 --2- 172.21.15.133:0/1065347272 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff1a00554e0 0x7ff1a00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1b3fff700 1 -- 172.21.15.133:0/1065347272 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff1ac06d560 con 0x7ff1bc0a9750 2021-01-03T13:07:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.251+0000 7ff1b1d9b700 1 --2- 172.21.15.133:0/1065347272 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff1a00554e0 0x7ff1a00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:51.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.255+0000 7ff1b1d9b700 1 --2- 172.21.15.133:0/1065347272 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff1a00554e0 0x7ff1a00579a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7ff1a400b000 tx=0x7ff1a4009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:51.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.259+0000 7ff1b3fff700 1 -- 172.21.15.133:0/1065347272 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff1bc14e3c0 con 0x7ff1bc0a9750 2021-01-03T13:07:51.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:51.407+0000 7ff1bb59e700 1 -- 172.21.15.133:0/1065347272 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff1bc14e3c0 con 0x7ff1bc0a9750 2021-01-03T13:07:52.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.103+0000 7ff1b3fff700 1 -- 172.21.15.133:0/1065347272 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v154) v1 ==== 185+0+0 (secure 0 0 0) 0x7ff1bc14e3c0 con 0x7ff1bc0a9750 2021-01-03T13:07:52.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.107+0000 7ff1bb59e700 1 -- 172.21.15.133:0/1065347272 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff1a00554e0 msgr2=0x7ff1a00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:52.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.107+0000 7ff1bb59e700 1 --2- 172.21.15.133:0/1065347272 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff1a00554e0 0x7ff1a00579a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7ff1a400b000 tx=0x7ff1a4009040).stop 2021-01-03T13:07:52.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.107+0000 7ff1bb59e700 1 -- 172.21.15.133:0/1065347272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1bc0a9750 msgr2=0x7ff1bc09fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:52.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.107+0000 7ff1bb59e700 1 --2- 172.21.15.133:0/1065347272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1bc0a9750 0x7ff1bc09fc50 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7ff1ac000e90 tx=0x7ff1ac007cb0).stop 2021-01-03T13:07:52.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.111+0000 7ff1bb59e700 1 -- 172.21.15.133:0/1065347272 shutdown_connections 2021-01-03T13:07:52.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.111+0000 7ff1bb59e700 1 --2- 172.21.15.133:0/1065347272 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff1a00554e0 0x7ff1a00579a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:52.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.111+0000 7ff1bb59e700 1 --2- 172.21.15.133:0/1065347272 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff1bc0b2460 0x7ff1bc0a7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:52.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.111+0000 7ff1bb59e700 1 --2- 172.21.15.133:0/1065347272 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1bc0a9750 0x7ff1bc09fc50 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:52.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.111+0000 7ff1bb59e700 1 --2- 172.21.15.133:0/1065347272 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff1bc0b0a60 0x7ff1bc0a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:52.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.111+0000 7ff1bb59e700 1 -- 172.21.15.133:0/1065347272 >> 172.21.15.133:0/1065347272 conn(0x7ff1bc06b050 msgr2=0x7ff1bc0b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:52.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.111+0000 7ff1bb59e700 1 -- 172.21.15.133:0/1065347272 shutdown_connections 2021-01-03T13:07:52.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.111+0000 7ff1bb59e700 1 -- 172.21.15.133:0/1065347272 wait complete. 2021-01-03T13:07:52.115 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2021-01-03T13:07:52.129 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-01-03T13:07:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.239+0000 7f3202a47700 1 Processor -- start 2021-01-03T13:07:52.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.239+0000 7f3202a47700 1 -- start start 2021-01-03T13:07:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f3202a47700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f31fc0b6d50 0x7f31fc0af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f3202a47700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31fc0b18e0 0x7f31fc0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:52.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f3202a47700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31fc0b0e60 con 0x7f31fc05f5e0 2021-01-03T13:07:52.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f3202a47700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31fc0b7130 con 0x7f31fc0b6d50 2021-01-03T13:07:52.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f3202a47700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31fc0b0260 con 0x7f31fc0b18e0 2021-01-03T13:07:52.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f31fb7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f31fc0b18e0 0x7f31fc0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:52.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f3200fe4700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f31fc05f5e0 0x7f31fc05fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33352/0 (socket says 172.21.15.133:33352) 2021-01-03T13:07:52.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f3200fe4700 1 -- 172.21.15.133:0/3474488454 learned_addr learned my addr 172.21.15.133:0/3474488454 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:52.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f31fbfff700 1 --2- 172.21.15.133:0/3474488454 >> v2:172.21.15.16:3300/0 conn(0x7f31fc0b6d50 0x7f31fc0af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:52.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f31fb7fe700 1 -- 172.21.15.133:0/3474488454 >> v2:172.21.15.16:3300/0 conn(0x7f31fc0b6d50 msgr2=0x7f31fc0af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:52.248 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f31fb7fe700 1 --2- 172.21.15.133:0/3474488454 >> v2:172.21.15.16:3300/0 conn(0x7f31fc0b6d50 0x7f31fc0af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:52.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f31fb7fe700 1 -- 172.21.15.133:0/3474488454 >> v1:172.21.15.133:6789/0 conn(0x7f31fc05f5e0 legacy=0x7f31fc05fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:52.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f31faffd700 1 -- 172.21.15.133:0/3474488454 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502938305 0 0) 0x7f31fc0b0e60 con 0x7f31fc05f5e0 2021-01-03T13:07:52.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f31fb7fe700 1 -- 172.21.15.133:0/3474488454 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc0b1090 con 0x7f31fc0b18e0 2021-01-03T13:07:52.249 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f31fb7fe700 1 --2- 172.21.15.133:0/3474488454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31fc0b18e0 0x7f31fc0afbe0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f31f00032b0 tx=0x7f31f00091a0).ready entity=mon.1 client_cookie=14ef2ffdf2b3308c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f31faffd700 1 -- 172.21.15.133:0/3474488454 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31f000b9a0 con 0x7f31fc0b18e0 2021-01-03T13:07:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f31faffd700 1 -- 172.21.15.133:0/3474488454 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f000bb00 con 0x7f31fc0b18e0 2021-01-03T13:07:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f31faffd700 1 -- 172.21.15.133:0/3474488454 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31f000bc70 con 0x7f31fc0b18e0 2021-01-03T13:07:52.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f3202a47700 1 -- 172.21.15.133:0/3474488454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31fc0b18e0 msgr2=0x7f31fc0afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:52.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f3202a47700 1 --2- 172.21.15.133:0/3474488454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31fc0b18e0 0x7f31fc0afbe0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f31f00032b0 tx=0x7f31f00091a0).stop 2021-01-03T13:07:52.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f3202a47700 1 -- 172.21.15.133:0/3474488454 shutdown_connections 2021-01-03T13:07:52.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f3202a47700 1 --2- 172.21.15.133:0/3474488454 >> v2:172.21.15.16:3300/0 conn(0x7f31fc0b6d50 0x7f31fc0af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:52.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f3202a47700 1 --2- 172.21.15.133:0/3474488454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31fc0b18e0 0x7f31fc0afbe0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:52.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f3202a47700 1 -- 172.21.15.133:0/3474488454 >> 172.21.15.133:0/3474488454 conn(0x7f31fc0622f0 msgr2=0x7f31fc0b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:52.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f3202a47700 1 -- 172.21.15.133:0/3474488454 shutdown_connections 2021-01-03T13:07:52.252 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.243+0000 7f3202a47700 1 -- 172.21.15.133:0/3474488454 wait complete. 2021-01-03T13:07:52.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.247+0000 7f3202a47700 1 Processor -- start 2021-01-03T13:07:52.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.247+0000 7f3202a47700 1 -- start start 2021-01-03T13:07:52.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.247+0000 7f3202a47700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31fc05f5e0 0x7f31fc1433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:52.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.247+0000 7f3202a47700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f31fc0b18e0 0x7f31fc13f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:52.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.247+0000 7f3202a47700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31fc0b6d50 0x7f31fc140360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:52.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.247+0000 7f3202a47700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc05c540 con 0x7f31fc0b6d50 2021-01-03T13:07:52.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.247+0000 7f3202a47700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc13fee0 con 0x7f31fc05f5e0 2021-01-03T13:07:52.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.247+0000 7f3202a47700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc136af0 con 0x7f31fc0b18e0 2021-01-03T13:07:52.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.251+0000 7f31fbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31fc05f5e0 0x7f31fc1433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:52.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.251+0000 7f31fbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31fc05f5e0 0x7f31fc1433b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40554/0 (socket says 172.21.15.133:40554) 2021-01-03T13:07:52.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.251+0000 7f31fbfff700 1 -- 172.21.15.133:0/3179944219 learned_addr learned my addr 172.21.15.133:0/3179944219 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:52.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.251+0000 7f31fb7fe700 1 --2- 172.21.15.133:0/3179944219 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f31fc0b18e0 0x7f31fc13f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:52.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.251+0000 7f3200fe4700 1 --2- 172.21.15.133:0/3179944219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31fc0b6d50 0x7f31fc140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:52.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.251+0000 7f31fbfff700 1 -- 172.21.15.133:0/3179944219 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f31fc0b18e0 msgr2=0x7f31fc13f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:52.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.251+0000 7f31fbfff700 1 --2- 172.21.15.133:0/3179944219 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f31fc0b18e0 0x7f31fc13f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:52.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.251+0000 7f31fbfff700 1 -- 172.21.15.133:0/3179944219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31fc0b6d50 msgr2=0x7f31fc140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:52.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.251+0000 7f31fbfff700 1 --2- 172.21.15.133:0/3179944219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31fc0b6d50 0x7f31fc140360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:52.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.251+0000 7f31fbfff700 1 -- 172.21.15.133:0/3179944219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc136d90 con 0x7f31fc05f5e0 2021-01-03T13:07:52.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.251+0000 7f31fbfff700 1 --2- 172.21.15.133:0/3179944219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31fc05f5e0 0x7f31fc1433b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f31ec00c000 tx=0x7f31ec006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:52.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.251+0000 7f31f97fa700 1 -- 172.21.15.133:0/3179944219 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31ec00ca10 con 0x7f31fc05f5e0 2021-01-03T13:07:52.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.251+0000 7f31f97fa700 1 -- 172.21.15.133:0/3179944219 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec00cb70 con 0x7f31fc05f5e0 2021-01-03T13:07:52.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.251+0000 7f3202a47700 1 -- 172.21.15.133:0/3179944219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31fc1372c0 con 0x7f31fc05f5e0 2021-01-03T13:07:52.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.251+0000 7f31f97fa700 1 -- 172.21.15.133:0/3179944219 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31ec00be50 con 0x7f31fc05f5e0 2021-01-03T13:07:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.251+0000 7f3202a47700 1 -- 172.21.15.133:0/3179944219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31fc05c0a0 con 0x7f31fc05f5e0 2021-01-03T13:07:52.259 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.255+0000 7f3202a47700 1 -- 172.21.15.133:0/3179944219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31fc05cd10 con 0x7f31fc05f5e0 2021-01-03T13:07:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.255+0000 7f31f97fa700 1 -- 172.21.15.133:0/3179944219 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f31ec01b410 con 0x7f31fc05f5e0 2021-01-03T13:07:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.255+0000 7f31f97fa700 1 --2- 172.21.15.133:0/3179944219 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f31dc0554e0 0x7f31dc0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.255+0000 7f31f97fa700 1 -- 172.21.15.133:0/3179944219 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f31ec06df80 con 0x7f31fc05f5e0 2021-01-03T13:07:52.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.255+0000 7f31fb7fe700 1 --2- 172.21.15.133:0/3179944219 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f31dc0554e0 0x7f31dc0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:52.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.255+0000 7f31fb7fe700 1 --2- 172.21.15.133:0/3179944219 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f31dc0554e0 0x7f31dc0579a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f31f001b000 tx=0x7f31f0016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:52.263 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.259+0000 7f31f97fa700 1 -- 172.21.15.133:0/3179944219 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f31fc05cd10 con 0x7f31fc05f5e0 2021-01-03T13:07:52.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:52.399+0000 7f3202a47700 1 -- 172.21.15.133:0/3179944219 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f31fc05cd10 con 0x7f31fc05f5e0 2021-01-03T13:07:53.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.107+0000 7f31f97fa700 1 -- 172.21.15.133:0/3179944219 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v155) v1 ==== 173+0+0 (secure 0 0 0) 0x7f31fc05cd10 con 0x7f31fc05f5e0 2021-01-03T13:07:53.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.111+0000 7f3202a47700 1 -- 172.21.15.133:0/3179944219 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f31dc0554e0 msgr2=0x7f31dc0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:53.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.111+0000 7f3202a47700 1 --2- 172.21.15.133:0/3179944219 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f31dc0554e0 0x7f31dc0579a0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f31f001b000 tx=0x7f31f0016000).stop 2021-01-03T13:07:53.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.111+0000 7f3202a47700 1 -- 172.21.15.133:0/3179944219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31fc05f5e0 msgr2=0x7f31fc1433b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:53.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.111+0000 7f3202a47700 1 --2- 172.21.15.133:0/3179944219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31fc05f5e0 0x7f31fc1433b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f31ec00c000 tx=0x7f31ec006dc0).stop 2021-01-03T13:07:53.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.111+0000 7f3202a47700 1 -- 172.21.15.133:0/3179944219 shutdown_connections 2021-01-03T13:07:53.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.111+0000 7f3202a47700 1 --2- 172.21.15.133:0/3179944219 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f31dc0554e0 0x7f31dc0579a0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:53.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.111+0000 7f3202a47700 1 --2- 172.21.15.133:0/3179944219 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f31fc0b6d50 0x7f31fc140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:53.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.111+0000 7f3202a47700 1 --2- 172.21.15.133:0/3179944219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31fc05f5e0 0x7f31fc1433b0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:53.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.111+0000 7f3202a47700 1 --2- 172.21.15.133:0/3179944219 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f31fc0b18e0 0x7f31fc13f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:53.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.115+0000 7f3202a47700 1 -- 172.21.15.133:0/3179944219 >> 172.21.15.133:0/3179944219 conn(0x7f31fc0622f0 msgr2=0x7f31fc060800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:53.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.115+0000 7f3202a47700 1 -- 172.21.15.133:0/3179944219 shutdown_connections 2021-01-03T13:07:53.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.115+0000 7f3202a47700 1 -- 172.21.15.133:0/3179944219 wait complete. 2021-01-03T13:07:53.119 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2021-01-03T13:07:53.131 INFO:tasks.ceph.mds.a:Restarting daemon 2021-01-03T13:07:53.131 INFO:tasks.ceph.mds.a:Stopping old one... 2021-01-03T13:07:53.132 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-01-03T13:07:53.132 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:07:53.132 INFO:tasks.ceph.mds.c:Restarting daemon 2021-01-03T13:07:53.132 INFO:tasks.ceph.mds.c:Stopping old one... 2021-01-03T13:07:53.133 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-01-03T13:07:53.133 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:07:53.133 INFO:tasks.ceph.mds.b:Restarting daemon 2021-01-03T13:07:53.134 INFO:tasks.ceph.mds.b:Stopping old one... 2021-01-03T13:07:53.134 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-01-03T13:07:53.134 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:07:53.143 INFO:tasks.ceph.mds.a:Stopped 2021-01-03T13:07:53.143 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2021-01-03T13:07:53.144 INFO:tasks.ceph.mds.c:Stopped 2021-01-03T13:07:53.144 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2021-01-03T13:07:53.146 INFO:tasks.ceph.mds.b:Stopped 2021-01-03T13:07:53.147 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2021-01-03T13:07:53.185 INFO:tasks.ceph.mds.a:Started 2021-01-03T13:07:53.186 DEBUG:teuthology.parallel:result is None 2021-01-03T13:07:53.187 INFO:tasks.ceph.mds.c:Started 2021-01-03T13:07:53.187 DEBUG:teuthology.parallel:result is None 2021-01-03T13:07:53.189 INFO:tasks.ceph.mds.b:Started 2021-01-03T13:07:53.189 DEBUG:teuthology.parallel:result is None 2021-01-03T13:07:53.190 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2021-01-03T13:07:53.262 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2021-01-03T13:07:53.267 INFO:tasks.ceph.mds.b.smithi016.stdout:starting mds.b at 2021-01-03T13:07:53.279 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T13:07:53.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875759e700 1 Processor -- start 2021-01-03T13:07:53.321 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875759e700 1 -- start start 2021-01-03T13:07:53.322 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875759e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f87580af060 0x7f87580b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:53.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875759e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f875805bf10 0x7f87580b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:53.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875759e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87580aa1d0 con 0x7f87580ac280 2021-01-03T13:07:53.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875759e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f875805c3b0 con 0x7f87580af060 2021-01-03T13:07:53.323 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875759e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87580aa400 con 0x7f875805bf10 2021-01-03T13:07:53.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f8755d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f875805bf10 0x7f87580b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:53.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f8755d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f875805bf10 0x7f87580b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40594/0 (socket says 172.21.15.133:40594) 2021-01-03T13:07:53.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f8755d9b700 1 -- 172.21.15.133:0/25034765 learned_addr learned my addr 172.21.15.133:0/25034765 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:53.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875659c700 1 --2- 172.21.15.133:0/25034765 >> v2:172.21.15.16:3300/0 conn(0x7f87580af060 0x7f87580b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f8755d9b700 1 -- 172.21.15.133:0/25034765 >> v2:172.21.15.16:3300/0 conn(0x7f87580af060 msgr2=0x7f87580b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f8755d9b700 1 --2- 172.21.15.133:0/25034765 >> v2:172.21.15.16:3300/0 conn(0x7f87580af060 0x7f87580b1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f8755d9b700 1 -- 172.21.15.133:0/25034765 >> v1:172.21.15.16:6789/0 conn(0x7f87580ac280 legacy=0x7f8758144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f8755d9b700 1 -- 172.21.15.133:0/25034765 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87580aa6a0 con 0x7f875805bf10 2021-01-03T13:07:53.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f8755d9b700 1 --2- 172.21.15.133:0/25034765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f875805bf10 0x7f87580b24c0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f87580673c0 tx=0x7f8750009270).ready entity=mon.1 client_cookie=5909c698bd751528 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:53.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875559a700 1 -- 172.21.15.133:0/25034765 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f875000bbc0 con 0x7f875805bf10 2021-01-03T13:07:53.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875559a700 1 -- 172.21.15.133:0/25034765 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875000bd20 con 0x7f875805bf10 2021-01-03T13:07:53.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875559a700 1 -- 172.21.15.133:0/25034765 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8750011400 con 0x7f875805bf10 2021-01-03T13:07:53.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875759e700 1 -- 172.21.15.133:0/25034765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f875805bf10 msgr2=0x7f87580b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:53.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875759e700 1 --2- 172.21.15.133:0/25034765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f875805bf10 0x7f87580b24c0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f87580673c0 tx=0x7f8750009270).stop 2021-01-03T13:07:53.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875759e700 1 -- 172.21.15.133:0/25034765 shutdown_connections 2021-01-03T13:07:53.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875759e700 1 --2- 172.21.15.133:0/25034765 >> v2:172.21.15.16:3300/0 conn(0x7f87580af060 0x7f87580b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:53.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875759e700 1 --2- 172.21.15.133:0/25034765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f875805bf10 0x7f87580b24c0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:53.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875759e700 1 -- 172.21.15.133:0/25034765 >> 172.21.15.133:0/25034765 conn(0x7f875806b050 msgr2=0x7f8758060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:53.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875759e700 1 -- 172.21.15.133:0/25034765 shutdown_connections 2021-01-03T13:07:53.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.319+0000 7f875759e700 1 -- 172.21.15.133:0/25034765 wait complete. 2021-01-03T13:07:53.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875759e700 1 Processor -- start 2021-01-03T13:07:53.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875759e700 1 -- start start 2021-01-03T13:07:53.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f875805bf10 0x7f87580aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:53.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875759e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87580ac280 0x7f8758066420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:53.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875759e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87580af060 0x7f8758066910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:53.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875759e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8758145810 con 0x7f87580ac280 2021-01-03T13:07:53.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8758150a60 con 0x7f875805bf10 2021-01-03T13:07:53.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875759e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8758150d00 con 0x7f87580af060 2021-01-03T13:07:53.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f875805bf10 0x7f87580aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:53.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875659c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f875805bf10 0x7f87580aafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40598/0 (socket says 172.21.15.133:40598) 2021-01-03T13:07:53.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875659c700 1 -- 172.21.15.133:0/1972026979 learned_addr learned my addr 172.21.15.133:0/1972026979 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:53.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f8756d9d700 1 --2- 172.21.15.133:0/1972026979 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87580af060 0x7f8758066910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:53.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f8755d9b700 1 --2- 172.21.15.133:0/1972026979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87580ac280 0x7f8758066420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:53.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875659c700 1 -- 172.21.15.133:0/1972026979 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87580af060 msgr2=0x7f8758066910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:53.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875659c700 1 --2- 172.21.15.133:0/1972026979 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87580af060 0x7f8758066910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:53.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875659c700 1 -- 172.21.15.133:0/1972026979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87580ac280 msgr2=0x7f8758066420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:53.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875659c700 1 --2- 172.21.15.133:0/1972026979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87580ac280 0x7f8758066420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:53.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875659c700 1 -- 172.21.15.133:0/1972026979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875814daa0 con 0x7f875805bf10 2021-01-03T13:07:53.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f8756d9d700 1 --2- 172.21.15.133:0/1972026979 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87580af060 0x7f8758066910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:53.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f8755d9b700 1 --2- 172.21.15.133:0/1972026979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87580ac280 0x7f8758066420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:07:53.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875659c700 1 --2- 172.21.15.133:0/1972026979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f875805bf10 0x7f87580aafa0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f8748003070 tx=0x7f8748008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:53.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f874f7fe700 1 -- 172.21.15.133:0/1972026979 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8748009980 con 0x7f875805bf10 2021-01-03T13:07:53.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f874f7fe700 1 -- 172.21.15.133:0/1972026979 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8748009ae0 con 0x7f875805bf10 2021-01-03T13:07:53.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875759e700 1 -- 172.21.15.133:0/1972026979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87580aba00 con 0x7f875805bf10 2021-01-03T13:07:53.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f874f7fe700 1 -- 172.21.15.133:0/1972026979 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8748009e40 con 0x7f875805bf10 2021-01-03T13:07:53.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.323+0000 7f875759e700 1 -- 172.21.15.133:0/1972026979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8758143d60 con 0x7f875805bf10 2021-01-03T13:07:53.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.327+0000 7f875759e700 1 -- 172.21.15.133:0/1972026979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87581508b0 con 0x7f875805bf10 2021-01-03T13:07:53.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.327+0000 7f874f7fe700 1 -- 172.21.15.133:0/1972026979 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8748013480 con 0x7f875805bf10 2021-01-03T13:07:53.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.327+0000 7f874f7fe700 1 --2- 172.21.15.133:0/1972026979 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f873c055440 0x7f873c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:53.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.327+0000 7f874f7fe700 1 -- 172.21.15.133:0/1972026979 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f874806e390 con 0x7f875805bf10 2021-01-03T13:07:53.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.327+0000 7f8755d9b700 1 --2- 172.21.15.133:0/1972026979 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f873c055440 0x7f873c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:53.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.327+0000 7f8755d9b700 1 --2- 172.21.15.133:0/1972026979 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f873c055440 0x7f873c057900 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f8750017000 tx=0x7f8750016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:53.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.335+0000 7f874f7fe700 1 -- 172.21.15.133:0/1972026979 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8748044910 con 0x7f875805bf10 2021-01-03T13:07:53.492 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:53.491+0000 7f875759e700 1 -- 172.21.15.133:0/1972026979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f8758057300 con 0x7f875805bf10 2021-01-03T13:07:54.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.303+0000 7f874f7fe700 1 -- 172.21.15.133:0/1972026979 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v157) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8748047f30 con 0x7f875805bf10 2021-01-03T13:07:54.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.303+0000 7f875759e700 1 -- 172.21.15.133:0/1972026979 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f873c055440 msgr2=0x7f873c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:54.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.303+0000 7f875759e700 1 --2- 172.21.15.133:0/1972026979 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f873c055440 0x7f873c057900 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f8750017000 tx=0x7f8750016000).stop 2021-01-03T13:07:54.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.303+0000 7f875759e700 1 -- 172.21.15.133:0/1972026979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f875805bf10 msgr2=0x7f87580aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:54.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.303+0000 7f875759e700 1 --2- 172.21.15.133:0/1972026979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f875805bf10 0x7f87580aafa0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f8748003070 tx=0x7f8748008040).stop 2021-01-03T13:07:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.303+0000 7f875759e700 1 -- 172.21.15.133:0/1972026979 shutdown_connections 2021-01-03T13:07:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.303+0000 7f875759e700 1 --2- 172.21.15.133:0/1972026979 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f873c055440 0x7f873c057900 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.303+0000 7f875759e700 1 --2- 172.21.15.133:0/1972026979 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f87580af060 0x7f8758066910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.303+0000 7f875759e700 1 --2- 172.21.15.133:0/1972026979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f875805bf10 0x7f87580aafa0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.303+0000 7f875759e700 1 --2- 172.21.15.133:0/1972026979 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87580ac280 0x7f8758066420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.303+0000 7f875759e700 1 -- 172.21.15.133:0/1972026979 >> 172.21.15.133:0/1972026979 conn(0x7f875806b050 msgr2=0x7f87580b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:54.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.303+0000 7f875759e700 1 -- 172.21.15.133:0/1972026979 shutdown_connections 2021-01-03T13:07:54.310 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.303+0000 7f875759e700 1 -- 172.21.15.133:0/1972026979 wait complete. 2021-01-03T13:07:54.311 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blacklist entries 2021-01-03T13:07:54.325 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2021-01-03T13:07:54.325 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2021-01-03T13:07:54.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.439+0000 7f27334f4700 1 Processor -- start 2021-01-03T13:07:54.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.439+0000 7f27334f4700 1 -- start start 2021-01-03T13:07:54.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.439+0000 7f27334f4700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f272c0af440 0x7f272c0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:54.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.439+0000 7f27334f4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f272c13f960 0x7f272c138c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:54.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.439+0000 7f27334f4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c05cc20 con 0x7f272c05c840 2021-01-03T13:07:54.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.439+0000 7f27334f4700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c0b18e0 con 0x7f272c0af440 2021-01-03T13:07:54.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.439+0000 7f27334f4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c13fdb0 con 0x7f272c13f960 2021-01-03T13:07:54.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.439+0000 7f2731290700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f272c05c840 0x7f272c13f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33410/0 (socket says 172.21.15.133:33410) 2021-01-03T13:07:54.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.439+0000 7f2731290700 1 -- 172.21.15.133:0/1283133922 learned_addr learned my addr 172.21.15.133:0/1283133922 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:54.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.439+0000 7f2731a91700 1 --2- 172.21.15.133:0/1283133922 >> v2:172.21.15.133:3300/0 conn(0x7f272c13f960 0x7f272c138c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:54.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.439+0000 7f2730a8f700 1 --2- 172.21.15.133:0/1283133922 >> v2:172.21.15.16:3300/0 conn(0x7f272c0af440 0x7f272c0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:54.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f272bfff700 1 -- 172.21.15.133:0/1283133922 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463837307 0 0) 0x7f272c05cc20 con 0x7f272c05c840 2021-01-03T13:07:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f272bfff700 1 -- 172.21.15.133:0/1283133922 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2718003230 con 0x7f272c05c840 2021-01-03T13:07:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f2730a8f700 1 -- 172.21.15.133:0/1283133922 >> v2:172.21.15.133:3300/0 conn(0x7f272c13f960 msgr2=0x7f272c138c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f2730a8f700 1 --2- 172.21.15.133:0/1283133922 >> v2:172.21.15.133:3300/0 conn(0x7f272c13f960 0x7f272c138c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f2730a8f700 1 -- 172.21.15.133:0/1283133922 >> v1:172.21.15.133:6789/0 conn(0x7f272c05c840 legacy=0x7f272c13f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:54.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f2730a8f700 1 -- 172.21.15.133:0/1283133922 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c0ad2d0 con 0x7f272c0af440 2021-01-03T13:07:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f2731a91700 1 --2- 172.21.15.133:0/1283133922 >> v2:172.21.15.133:3300/0 conn(0x7f272c13f960 0x7f272c138c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:07:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f2730a8f700 1 --2- 172.21.15.133:0/1283133922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f272c0af440 0x7f272c0afa70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f272c0af390 tx=0x7f2720006dc0).ready entity=mon.0 client_cookie=6120b0d24df03e93 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f272bfff700 1 -- 172.21.15.133:0/1283133922 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2720009690 con 0x7f272c0af440 2021-01-03T13:07:54.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f272bfff700 1 -- 172.21.15.133:0/1283133922 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27200097f0 con 0x7f272c0af440 2021-01-03T13:07:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f272bfff700 1 -- 172.21.15.133:0/1283133922 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2720009b50 con 0x7f272c0af440 2021-01-03T13:07:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f27334f4700 1 -- 172.21.15.133:0/1283133922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f272c0af440 msgr2=0x7f272c0afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f27334f4700 1 --2- 172.21.15.133:0/1283133922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f272c0af440 0x7f272c0afa70 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f272c0af390 tx=0x7f2720006dc0).stop 2021-01-03T13:07:54.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f27334f4700 1 -- 172.21.15.133:0/1283133922 shutdown_connections 2021-01-03T13:07:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f27334f4700 1 --2- 172.21.15.133:0/1283133922 >> v2:172.21.15.133:3300/0 conn(0x7f272c13f960 0x7f272c138c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f27334f4700 1 --2- 172.21.15.133:0/1283133922 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f272c0af440 0x7f272c0afa70 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f27334f4700 1 -- 172.21.15.133:0/1283133922 >> 172.21.15.133:0/1283133922 conn(0x7f272c06aeb0 msgr2=0x7f272c05bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:54.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f27334f4700 1 -- 172.21.15.133:0/1283133922 shutdown_connections 2021-01-03T13:07:54.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.443+0000 7f27334f4700 1 -- 172.21.15.133:0/1283133922 wait complete. 2021-01-03T13:07:54.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.447+0000 7f27334f4700 1 Processor -- start 2021-01-03T13:07:54.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.447+0000 7f27334f4700 1 -- start start 2021-01-03T13:07:54.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.447+0000 7f27334f4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f272c05c840 0x7f272c135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:54.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.447+0000 7f27334f4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f272c0af440 0x7f272c13c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:54.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.447+0000 7f27334f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f272c13f960 0x7f272c13c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:54.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.447+0000 7f27334f4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c143510 con 0x7f272c05c840 2021-01-03T13:07:54.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.447+0000 7f27334f4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c13bfc0 con 0x7f272c13f960 2021-01-03T13:07:54.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.447+0000 7f27334f4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c141160 con 0x7f272c0af440 2021-01-03T13:07:54.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.447+0000 7f2731a91700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f272c13f960 0x7f272c13c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:54.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.447+0000 7f2731a91700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f272c13f960 0x7f272c13c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40620/0 (socket says 172.21.15.133:40620) 2021-01-03T13:07:54.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.447+0000 7f2731a91700 1 -- 172.21.15.133:0/564679496 learned_addr learned my addr 172.21.15.133:0/564679496 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:54.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.447+0000 7f2730a8f700 1 --2- 172.21.15.133:0/564679496 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f272c0af440 0x7f272c13c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:54.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.447+0000 7f2731290700 1 --2- 172.21.15.133:0/564679496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f272c05c840 0x7f272c135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:54.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.447+0000 7f2731a91700 1 -- 172.21.15.133:0/564679496 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f272c0af440 msgr2=0x7f272c13c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:54.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.447+0000 7f2731a91700 1 --2- 172.21.15.133:0/564679496 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f272c0af440 0x7f272c13c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.447+0000 7f2731a91700 1 -- 172.21.15.133:0/564679496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f272c05c840 msgr2=0x7f272c135fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:54.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.447+0000 7f2731a91700 1 --2- 172.21.15.133:0/564679496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f272c05c840 0x7f272c135fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.451+0000 7f2731a91700 1 -- 172.21.15.133:0/564679496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c141400 con 0x7f272c13f960 2021-01-03T13:07:54.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.451+0000 7f2731a91700 1 --2- 172.21.15.133:0/564679496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f272c13f960 0x7f272c13c910 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f272400d000 tx=0x7f2724006e50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:54.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.451+0000 7f272a7fc700 1 -- 172.21.15.133:0/564679496 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f272400b980 con 0x7f272c13f960 2021-01-03T13:07:54.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.451+0000 7f272a7fc700 1 -- 172.21.15.133:0/564679496 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272400bae0 con 0x7f272c13f960 2021-01-03T13:07:54.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.451+0000 7f27334f4700 1 -- 172.21.15.133:0/564679496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c1416a0 con 0x7f272c13f960 2021-01-03T13:07:54.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.451+0000 7f272a7fc700 1 -- 172.21.15.133:0/564679496 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f272400be40 con 0x7f272c13f960 2021-01-03T13:07:54.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.451+0000 7f27334f4700 1 -- 172.21.15.133:0/564679496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c141960 con 0x7f272c13f960 2021-01-03T13:07:54.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.451+0000 7f27334f4700 1 -- 172.21.15.133:0/564679496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272c13c130 con 0x7f272c13f960 2021-01-03T13:07:54.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.451+0000 7f272a7fc700 1 -- 172.21.15.133:0/564679496 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2724021070 con 0x7f272c13f960 2021-01-03T13:07:54.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.451+0000 7f272a7fc700 1 --2- 172.21.15.133:0/564679496 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f270c0554e0 0x7f270c0579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:54.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.451+0000 7f272a7fc700 1 -- 172.21.15.133:0/564679496 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f272406de00 con 0x7f272c13f960 2021-01-03T13:07:54.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.451+0000 7f2731290700 1 --2- 172.21.15.133:0/564679496 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f270c0554e0 0x7f270c0579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:54.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.451+0000 7f2731290700 1 --2- 172.21.15.133:0/564679496 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f270c0554e0 0x7f270c0579a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f271c00d000 tx=0x7f271c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:54.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.459+0000 7f272a7fc700 1 -- 172.21.15.133:0/564679496 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2724044430 con 0x7f272c13f960 2021-01-03T13:07:54.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.647+0000 7f27334f4700 1 -- 172.21.15.133:0/564679496 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f272c057300 con 0x7f272c13f960 2021-01-03T13:07:54.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.647+0000 7f272a7fc700 1 -- 172.21.15.133:0/564679496 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v32) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f2724015020 con 0x7f272c13f960 2021-01-03T13:07:54.651 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:54.652 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:07:54.652 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2021-01-03T13:07:54.652 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:54.652 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2021-01-03T13:07:54.652 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Fflox9BxAA6coLDFV/FaQ/G/cvtonWgg==", 2021-01-03T13:07:54.653 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:54.653 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:07:54.653 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:54.653 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:54.653 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:54.654 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:54.654 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:54.654 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:54.654 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2021-01-03T13:07:54.654 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfrnWWFRAA3PHH/FJOvDozCChrb1T8Dg==", 2021-01-03T13:07:54.655 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:54.655 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:07:54.655 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:54.655 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:54.655 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:54.656 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:54.656 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:54.656 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:54.656 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2021-01-03T13:07:54.656 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfpPPLDxAAVvg80vLejYKDH485/L1gSQ==", 2021-01-03T13:07:54.657 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:54.657 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:07:54.657 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:54.657 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:54.657 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:54.658 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:54.658 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:54.658 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:54.658 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2021-01-03T13:07:54.659 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAnv/FfQ+CcDRAAUkTDLby5scMkNzxa0lVdAQ==", 2021-01-03T13:07:54.659 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:54.659 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:54.659 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:54.659 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:54.660 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:54.660 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:54.660 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:54.660 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2021-01-03T13:07:54.660 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQApv/Ff1iilLhAAbK9hZmL772nNKAEJ4i+pkw==", 2021-01-03T13:07:54.661 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:54.661 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:54.661 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:54.661 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:54.661 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:54.662 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:54.662 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:54.662 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2021-01-03T13:07:54.662 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAsv/Ffmoe2FhAA1EbxU5yHncN+pbC/EX6d9A==", 2021-01-03T13:07:54.662 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:54.663 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:54.663 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:54.663 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:54.663 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:54.663 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:54.664 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:54.664 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2021-01-03T13:07:54.664 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAuv/FfJh/VORAAG9aCOh5s/2Lw+yN9hBFWLw==", 2021-01-03T13:07:54.664 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:54.664 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:54.665 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:54.665 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:54.665 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:54.665 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:54.665 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:54.666 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2021-01-03T13:07:54.666 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAyv/Ffus0NJhAALX1TIqQ9EIupaX8KtRu7rQ==", 2021-01-03T13:07:54.666 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:54.666 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:54.666 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:54.667 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:54.667 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:54.667 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:54.667 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:54.667 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2021-01-03T13:07:54.668 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA1v/FfoL6kDBAAggoRy/o0qas/41yLYqDVgA==", 2021-01-03T13:07:54.668 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:54.668 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:54.668 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:54.669 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:54.669 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:54.669 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:54.669 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:54.669 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2021-01-03T13:07:54.670 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA3v/FfwOPCMBAAGOt8ShPQ/szNbCfaP/uZEQ==", 2021-01-03T13:07:54.670 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:54.670 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:54.670 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:54.670 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:54.671 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:54.671 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:54.671 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:54.671 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2021-01-03T13:07:54.671 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQA6v/Ffoz5xFxAAn3xvUDSeNSWrBJTa1Nsb6w==", 2021-01-03T13:07:54.672 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:54.672 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:54.672 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:54.672 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:54.672 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:54.673 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:54.673 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:54.673 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2021-01-03T13:07:54.673 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfyGlbGxAALm0NezvPiTAnlwu8iPEuCw==", 2021-01-03T13:07:54.673 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:54.674 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:07:54.674 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:07:54.674 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:07:54.674 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:54.674 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:54.675 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:54.675 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2021-01-03T13:07:54.675 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/Ffa2AFHhAAD4Pq5zMJ28SqqEosBA9vnQ==", 2021-01-03T13:07:54.675 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:54.675 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2021-01-03T13:07:54.676 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2021-01-03T13:07:54.676 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs_data" 2021-01-03T13:07:54.676 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:54.676 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:54.676 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:54.677 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2021-01-03T13:07:54.677 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAjv/FfjxN8JxAAkV2Ia66fh21QYMX5fr1gTw==", 2021-01-03T13:07:54.677 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:54.677 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:07:54.677 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2021-01-03T13:07:54.678 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2021-01-03T13:07:54.678 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:54.678 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:54.678 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:54.678 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:54.679 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2021-01-03T13:07:54.679 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAU/DBBAASi+hx05pZEsP+dV9iwbz4g==", 2021-01-03T13:07:54.679 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:54.679 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:07:54.680 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:07:54.680 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:54.680 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:54.680 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:54.680 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:54.681 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2021-01-03T13:07:54.681 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAkv/FfAOFAAhAAPQOSkofyJoEYvcAqKK2+Mg==", 2021-01-03T13:07:54.681 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2021-01-03T13:07:54.681 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2021-01-03T13:07:54.681 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2021-01-03T13:07:54.682 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2021-01-03T13:07:54.682 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:54.682 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:54.682 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:07:54.682 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:07:54.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.651+0000 7f27334f4700 1 -- 172.21.15.133:0/564679496 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f270c0554e0 msgr2=0x7f270c0579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:54.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.651+0000 7f27334f4700 1 --2- 172.21.15.133:0/564679496 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f270c0554e0 0x7f270c0579a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f271c00d000 tx=0x7f271c009040).stop 2021-01-03T13:07:54.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.651+0000 7f27334f4700 1 -- 172.21.15.133:0/564679496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f272c13f960 msgr2=0x7f272c13c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:54.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.651+0000 7f27334f4700 1 --2- 172.21.15.133:0/564679496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f272c13f960 0x7f272c13c910 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f272400d000 tx=0x7f2724006e50).stop 2021-01-03T13:07:54.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.651+0000 7f27334f4700 1 -- 172.21.15.133:0/564679496 shutdown_connections 2021-01-03T13:07:54.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.651+0000 7f27334f4700 1 --2- 172.21.15.133:0/564679496 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f270c0554e0 0x7f270c0579a0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.651+0000 7f27334f4700 1 --2- 172.21.15.133:0/564679496 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f272c05c840 0x7f272c135fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.651+0000 7f27334f4700 1 --2- 172.21.15.133:0/564679496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f272c13f960 0x7f272c13c910 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.651+0000 7f27334f4700 1 --2- 172.21.15.133:0/564679496 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f272c0af440 0x7f272c13c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.651+0000 7f27334f4700 1 -- 172.21.15.133:0/564679496 >> 172.21.15.133:0/564679496 conn(0x7f272c06aeb0 msgr2=0x7f272c0b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:54.686 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.651+0000 7f27334f4700 1 -- 172.21.15.133:0/564679496 shutdown_connections 2021-01-03T13:07:54.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.651+0000 7f27334f4700 1 -- 172.21.15.133:0/564679496 wait complete. 2021-01-03T13:07:54.687 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:07:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e69142700 1 Processor -- start 2021-01-03T13:07:54.798 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e69142700 1 -- start start 2021-01-03T13:07:54.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e69142700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9e640b52c0 0x7f9e640b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:54.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e69142700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e640b0c90 0x7f9e64098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:54.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e69142700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e64060da0 con 0x7f9e640b5c00 2021-01-03T13:07:54.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e69142700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e64067a90 con 0x7f9e640b52c0 2021-01-03T13:07:54.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e69142700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e640b0ad0 con 0x7f9e640b0c90 2021-01-03T13:07:54.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e637fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e640b0c90 0x7f9e64098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:54.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e68941700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9e640b5c00 0x7f9e6414a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33424/0 (socket says 172.21.15.133:33424) 2021-01-03T13:07:54.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e68941700 1 -- 172.21.15.133:0/1363857761 learned_addr learned my addr 172.21.15.133:0/1363857761 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e63fff700 1 --2- 172.21.15.133:0/1363857761 >> v2:172.21.15.16:3300/0 conn(0x7f9e640b52c0 0x7f9e640b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e637fe700 1 -- 172.21.15.133:0/1363857761 >> v2:172.21.15.16:3300/0 conn(0x7f9e640b52c0 msgr2=0x7f9e640b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e637fe700 1 --2- 172.21.15.133:0/1363857761 >> v2:172.21.15.16:3300/0 conn(0x7f9e640b52c0 0x7f9e640b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e637fe700 1 -- 172.21.15.133:0/1363857761 >> v1:172.21.15.133:6789/0 conn(0x7f9e640b5c00 legacy=0x7f9e6414a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:54.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e62ffd700 1 -- 172.21.15.133:0/1363857761 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545124964 0 0) 0x7f9e64060da0 con 0x7f9e640b5c00 2021-01-03T13:07:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e637fe700 1 -- 172.21.15.133:0/1363857761 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e640b56a0 con 0x7f9e640b0c90 2021-01-03T13:07:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e637fe700 1 --2- 172.21.15.133:0/1363857761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e640b0c90 0x7f9e64098ec0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f9e58002f30 tx=0x7f9e58006dc0).ready entity=mon.1 client_cookie=4ee1370c8c46a69f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e62ffd700 1 -- 172.21.15.133:0/1363857761 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e580097f0 con 0x7f9e640b0c90 2021-01-03T13:07:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e62ffd700 1 -- 172.21.15.133:0/1363857761 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e58009950 con 0x7f9e640b0c90 2021-01-03T13:07:54.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e62ffd700 1 -- 172.21.15.133:0/1363857761 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e58009cb0 con 0x7f9e640b0c90 2021-01-03T13:07:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e69142700 1 -- 172.21.15.133:0/1363857761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e640b0c90 msgr2=0x7f9e64098ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:54.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.795+0000 7f9e69142700 1 --2- 172.21.15.133:0/1363857761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e640b0c90 0x7f9e64098ec0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f9e58002f30 tx=0x7f9e58006dc0).stop 2021-01-03T13:07:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e69142700 1 -- 172.21.15.133:0/1363857761 shutdown_connections 2021-01-03T13:07:54.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e69142700 1 --2- 172.21.15.133:0/1363857761 >> v2:172.21.15.16:3300/0 conn(0x7f9e640b52c0 0x7f9e640b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e69142700 1 --2- 172.21.15.133:0/1363857761 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e640b0c90 0x7f9e64098ec0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e69142700 1 -- 172.21.15.133:0/1363857761 >> 172.21.15.133:0/1363857761 conn(0x7f9e6405bdf0 msgr2=0x7f9e6405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e69142700 1 -- 172.21.15.133:0/1363857761 shutdown_connections 2021-01-03T13:07:54.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e69142700 1 -- 172.21.15.133:0/1363857761 wait complete. 2021-01-03T13:07:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e69142700 1 Processor -- start 2021-01-03T13:07:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e69142700 1 -- start start 2021-01-03T13:07:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e69142700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9e640b0c90 0x7f9e640aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e69142700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e640b52c0 0x7f9e640ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:54.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e69142700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e640b5c00 0x7f9e641487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e69142700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e640ae990 con 0x7f9e640b52c0 2021-01-03T13:07:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e69142700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e640ad3f0 con 0x7f9e640b5c00 2021-01-03T13:07:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e69142700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e640ad640 con 0x7f9e640b0c90 2021-01-03T13:07:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e68941700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e640b5c00 0x7f9e641487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:54.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e68941700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e640b5c00 0x7f9e641487b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40634/0 (socket says 172.21.15.133:40634) 2021-01-03T13:07:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e68941700 1 -- 172.21.15.133:0/3043823959 learned_addr learned my addr 172.21.15.133:0/3043823959 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e637fe700 1 --2- 172.21.15.133:0/3043823959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e640b52c0 0x7f9e640ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.799+0000 7f9e63fff700 1 --2- 172.21.15.133:0/3043823959 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9e640b0c90 0x7f9e640aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.803+0000 7f9e68941700 1 -- 172.21.15.133:0/3043823959 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9e640b0c90 msgr2=0x7f9e640aeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:54.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.803+0000 7f9e68941700 1 --2- 172.21.15.133:0/3043823959 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9e640b0c90 0x7f9e640aeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.803+0000 7f9e68941700 1 -- 172.21.15.133:0/3043823959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e640b52c0 msgr2=0x7f9e640ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.803+0000 7f9e68941700 1 --2- 172.21.15.133:0/3043823959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e640b52c0 0x7f9e640ab5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.803+0000 7f9e68941700 1 -- 172.21.15.133:0/3043823959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e640ae230 con 0x7f9e640b5c00 2021-01-03T13:07:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.803+0000 7f9e68941700 1 --2- 172.21.15.133:0/3043823959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e640b5c00 0x7f9e641487b0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f9e640afd30 tx=0x7f9e5c007f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:54.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.803+0000 7f9e617fa700 1 -- 172.21.15.133:0/3043823959 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e5c005b70 con 0x7f9e640b5c00 2021-01-03T13:07:54.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.803+0000 7f9e617fa700 1 -- 172.21.15.133:0/3043823959 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5c005cd0 con 0x7f9e640b5c00 2021-01-03T13:07:54.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.803+0000 7f9e617fa700 1 -- 172.21.15.133:0/3043823959 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e5c007300 con 0x7f9e640b5c00 2021-01-03T13:07:54.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.803+0000 7f9e69142700 1 -- 172.21.15.133:0/3043823959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e640ae4d0 con 0x7f9e640b5c00 2021-01-03T13:07:54.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.803+0000 7f9e69142700 1 -- 172.21.15.133:0/3043823959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e640ad1d0 con 0x7f9e640b5c00 2021-01-03T13:07:54.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.803+0000 7f9e69142700 1 -- 172.21.15.133:0/3043823959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e640687f0 con 0x7f9e640b5c00 2021-01-03T13:07:54.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.803+0000 7f9e617fa700 1 -- 172.21.15.133:0/3043823959 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9e5c010030 con 0x7f9e640b5c00 2021-01-03T13:07:54.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.803+0000 7f9e617fa700 1 --2- 172.21.15.133:0/3043823959 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9e440554e0 0x7f9e440579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:54.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.807+0000 7f9e617fa700 1 -- 172.21.15.133:0/3043823959 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9e5c06df10 con 0x7f9e640b5c00 2021-01-03T13:07:54.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.807+0000 7f9e63fff700 1 --2- 172.21.15.133:0/3043823959 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9e440554e0 0x7f9e440579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:54.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.807+0000 7f9e63fff700 1 --2- 172.21.15.133:0/3043823959 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9e440554e0 0x7f9e440579a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f9e5400c000 tx=0x7f9e54008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:54.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.811+0000 7f9e617fa700 1 -- 172.21.15.133:0/3043823959 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9e5c0444e0 con 0x7f9e640b5c00 2021-01-03T13:07:54.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.951+0000 7f9e69142700 1 -- 172.21.15.133:0/3043823959 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e640687f0 con 0x7f9e640b5c00 2021-01-03T13:07:54.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.955+0000 7f9e617fa700 1 -- 172.21.15.133:0/3043823959 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+13239 (secure 0 0 0) 0x7f9e640687f0 con 0x7f9e640b5c00 2021-01-03T13:07:54.956 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:54.957 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":157,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:54.295372+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":148,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:07:54.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.955+0000 7f9e69142700 1 -- 172.21.15.133:0/3043823959 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9e440554e0 msgr2=0x7f9e440579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:54.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.955+0000 7f9e69142700 1 --2- 172.21.15.133:0/3043823959 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9e440554e0 0x7f9e440579a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f9e5400c000 tx=0x7f9e54008040).stop 2021-01-03T13:07:54.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.955+0000 7f9e69142700 1 -- 172.21.15.133:0/3043823959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e640b5c00 msgr2=0x7f9e641487b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:54.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.955+0000 7f9e69142700 1 --2- 172.21.15.133:0/3043823959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e640b5c00 0x7f9e641487b0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f9e640afd30 tx=0x7f9e5c007f70).stop 2021-01-03T13:07:54.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.955+0000 7f9e69142700 1 -- 172.21.15.133:0/3043823959 shutdown_connections 2021-01-03T13:07:54.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.955+0000 7f9e69142700 1 --2- 172.21.15.133:0/3043823959 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9e440554e0 0x7f9e440579a0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.955+0000 7f9e69142700 1 --2- 172.21.15.133:0/3043823959 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e640b5c00 0x7f9e641487b0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.955+0000 7f9e69142700 1 --2- 172.21.15.133:0/3043823959 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9e640b0c90 0x7f9e640aeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.955+0000 7f9e69142700 1 --2- 172.21.15.133:0/3043823959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e640b52c0 0x7f9e640ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:54.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.955+0000 7f9e69142700 1 -- 172.21.15.133:0/3043823959 >> 172.21.15.133:0/3043823959 conn(0x7f9e6405bdf0 msgr2=0x7f9e6405fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:54.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.955+0000 7f9e69142700 1 -- 172.21.15.133:0/3043823959 shutdown_connections 2021-01-03T13:07:54.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:54.955+0000 7f9e69142700 1 -- 172.21.15.133:0/3043823959 wait complete. 2021-01-03T13:07:54.970 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-01-03T13:07:54.971 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:07:55.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febfb1c3700 1 Processor -- start 2021-01-03T13:07:55.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febfb1c3700 1 -- start start 2021-01-03T13:07:55.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febfb1c3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febf40b0470 0x7febf405bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febfb1c3700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf405cf20 con 0x7febf4140410 2021-01-03T13:07:55.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febfb1c3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf4146580 con 0x7febf41407f0 2021-01-03T13:07:55.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febfb1c3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf40b02d0 con 0x7febf40b0470 2021-01-03T13:07:55.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febf3fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7febf41407f0 0x7febf4142dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33440/0 (socket says 172.21.15.133:33440) 2021-01-03T13:07:55.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febf3fff700 1 -- 172.21.15.133:0/3146187630 learned_addr learned my addr 172.21.15.133:0/3146187630 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:55.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febf9760700 1 --2- 172.21.15.133:0/3146187630 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febf40b0470 0x7febf405bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febf37fe700 1 -- 172.21.15.133:0/3146187630 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165914473 0 0) 0x7febf4146580 con 0x7febf41407f0 2021-01-03T13:07:55.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febf37fe700 1 -- 172.21.15.133:0/3146187630 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febd8003230 con 0x7febf41407f0 2021-01-03T13:07:55.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febf37fe700 1 -- 172.21.15.133:0/3146187630 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330772597 0 0) 0x7febf405cf20 con 0x7febf4140410 2021-01-03T13:07:55.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febf37fe700 1 -- 172.21.15.133:0/3146187630 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febf4146580 con 0x7febf4140410 2021-01-03T13:07:55.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febf37fe700 1 -- 172.21.15.133:0/3146187630 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3749065195 0 0) 0x7febd8003230 con 0x7febf41407f0 2021-01-03T13:07:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febf9760700 1 -- 172.21.15.133:0/3146187630 >> v1:172.21.15.133:6789/0 conn(0x7febf41407f0 legacy=0x7febf4142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febf9760700 1 -- 172.21.15.133:0/3146187630 >> v1:172.21.15.16:6789/0 conn(0x7febf4140410 legacy=0x7febf4146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febf9760700 1 -- 172.21.15.133:0/3146187630 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf4146820 con 0x7febf40b0470 2021-01-03T13:07:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febf9760700 1 --2- 172.21.15.133:0/3146187630 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febf40b0470 0x7febf405bdf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7febe00010d0 tx=0x7febec0091a0).ready entity=mon.2 client_cookie=ec4047c7af539aa3 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febf37fe700 1 -- 172.21.15.133:0/3146187630 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febe00016d0 con 0x7febf40b0470 2021-01-03T13:07:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febf37fe700 1 -- 172.21.15.133:0/3146187630 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec00b880 con 0x7febf40b0470 2021-01-03T13:07:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febf37fe700 1 -- 172.21.15.133:0/3146187630 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febec00b9f0 con 0x7febf40b0470 2021-01-03T13:07:55.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febfb1c3700 1 -- 172.21.15.133:0/3146187630 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febf40b0470 msgr2=0x7febf405bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.087+0000 7febfb1c3700 1 --2- 172.21.15.133:0/3146187630 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febf40b0470 0x7febf405bdf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7febe00010d0 tx=0x7febec0091a0).stop 2021-01-03T13:07:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febfb1c3700 1 -- 172.21.15.133:0/3146187630 shutdown_connections 2021-01-03T13:07:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febfb1c3700 1 --2- 172.21.15.133:0/3146187630 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febf40b0470 0x7febf405bdf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febfb1c3700 1 -- 172.21.15.133:0/3146187630 >> 172.21.15.133:0/3146187630 conn(0x7febf40b95d0 msgr2=0x7febf40b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:55.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febfb1c3700 1 -- 172.21.15.133:0/3146187630 shutdown_connections 2021-01-03T13:07:55.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febfb1c3700 1 -- 172.21.15.133:0/3146187630 wait complete. 2021-01-03T13:07:55.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febfb1c3700 1 Processor -- start 2021-01-03T13:07:55.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febfb1c3700 1 -- start start 2021-01-03T13:07:55.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febfb1c3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf40b0470 0x7febf4141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febfb1c3700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febf4140410 0x7febf41422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febfb1c3700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febf41407f0 0x7febf4151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febfb1c3700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf40b30e0 con 0x7febf4140410 2021-01-03T13:07:55.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febfb1c3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf41427a0 con 0x7febf40b0470 2021-01-03T13:07:55.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febfb1c3700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf40b3930 con 0x7febf41407f0 2021-01-03T13:07:55.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febf8f5f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf40b0470 0x7febf4141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febf8f5f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf40b0470 0x7febf4141dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40644/0 (socket says 172.21.15.133:40644) 2021-01-03T13:07:55.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febf8f5f700 1 -- 172.21.15.133:0/3202250774 learned_addr learned my addr 172.21.15.133:0/3202250774 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:55.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febf9760700 1 --2- 172.21.15.133:0/3202250774 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febf41407f0 0x7febf4151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.091+0000 7febf3fff700 1 --2- 172.21.15.133:0/3202250774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febf4140410 0x7febf41422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.095+0000 7febf8f5f700 1 -- 172.21.15.133:0/3202250774 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febf41407f0 msgr2=0x7febf4151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.095+0000 7febf8f5f700 1 --2- 172.21.15.133:0/3202250774 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febf41407f0 0x7febf4151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.095+0000 7febf8f5f700 1 -- 172.21.15.133:0/3202250774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febf4140410 msgr2=0x7febf41422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.095+0000 7febf8f5f700 1 --2- 172.21.15.133:0/3202250774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febf4140410 0x7febf41422b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.095+0000 7febf8f5f700 1 -- 172.21.15.133:0/3202250774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf409d500 con 0x7febf40b0470 2021-01-03T13:07:55.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.095+0000 7febf3fff700 1 --2- 172.21.15.133:0/3202250774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febf4140410 0x7febf41422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:55.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.095+0000 7febf8f5f700 1 --2- 172.21.15.133:0/3202250774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf40b0470 0x7febf4141dc0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7febf41428e0 tx=0x7febe8007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:55.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.095+0000 7febf1ffb700 1 -- 172.21.15.133:0/3202250774 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febe800f470 con 0x7febf40b0470 2021-01-03T13:07:55.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.095+0000 7febf1ffb700 1 -- 172.21.15.133:0/3202250774 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe800f5d0 con 0x7febf40b0470 2021-01-03T13:07:55.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.095+0000 7febfb1c3700 1 -- 172.21.15.133:0/3202250774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf4152af0 con 0x7febf40b0470 2021-01-03T13:07:55.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.095+0000 7febf1ffb700 1 -- 172.21.15.133:0/3202250774 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febe800f930 con 0x7febf40b0470 2021-01-03T13:07:55.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.095+0000 7febfb1c3700 1 -- 172.21.15.133:0/3202250774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf40b3260 con 0x7febf40b0470 2021-01-03T13:07:55.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.095+0000 7febfb1c3700 1 -- 172.21.15.133:0/3202250774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf409cff0 con 0x7febf40b0470 2021-01-03T13:07:55.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.095+0000 7febf1ffb700 1 -- 172.21.15.133:0/3202250774 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7febe8019030 con 0x7febf40b0470 2021-01-03T13:07:55.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.099+0000 7febf1ffb700 1 --2- 172.21.15.133:0/3202250774 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febdc055440 0x7febdc057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.099+0000 7febf3fff700 1 --2- 172.21.15.133:0/3202250774 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febdc055440 0x7febdc057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.099+0000 7febf1ffb700 1 -- 172.21.15.133:0/3202250774 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5253+0+0 (secure 0 0 0) 0x7febe806d040 con 0x7febf40b0470 2021-01-03T13:07:55.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.099+0000 7febf3fff700 1 --2- 172.21.15.133:0/3202250774 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febdc055440 0x7febdc057900 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7febe000b000 tx=0x7febe0000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:55.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.107+0000 7febf1ffb700 1 -- 172.21.15.133:0/3202250774 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7febe8043610 con 0x7febf40b0470 2021-01-03T13:07:55.250 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.247+0000 7febfb1c3700 1 -- 172.21.15.133:0/3202250774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7febf4057300 con 0x7febf40b0470 2021-01-03T13:07:55.251 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.247+0000 7febf1ffb700 1 -- 172.21.15.133:0/3202250774 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v157) v1 ==== 110+0+10 (secure 0 0 0) 0x7febe8046c30 con 0x7febf40b0470 2021-01-03T13:07:55.251 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:07:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.251+0000 7febfb1c3700 1 -- 172.21.15.133:0/3202250774 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febdc055440 msgr2=0x7febdc057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.251+0000 7febfb1c3700 1 --2- 172.21.15.133:0/3202250774 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febdc055440 0x7febdc057900 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7febe000b000 tx=0x7febe0000b80).stop 2021-01-03T13:07:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.251+0000 7febfb1c3700 1 -- 172.21.15.133:0/3202250774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf40b0470 msgr2=0x7febf4141dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.251+0000 7febfb1c3700 1 --2- 172.21.15.133:0/3202250774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf40b0470 0x7febf4141dc0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7febf41428e0 tx=0x7febe8007a60).stop 2021-01-03T13:07:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.251+0000 7febfb1c3700 1 -- 172.21.15.133:0/3202250774 shutdown_connections 2021-01-03T13:07:55.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.251+0000 7febfb1c3700 1 --2- 172.21.15.133:0/3202250774 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febdc055440 0x7febdc057900 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.251+0000 7febfb1c3700 1 --2- 172.21.15.133:0/3202250774 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febf41407f0 0x7febf4151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.251+0000 7febfb1c3700 1 --2- 172.21.15.133:0/3202250774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febf40b0470 0x7febf4141dc0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.251+0000 7febfb1c3700 1 --2- 172.21.15.133:0/3202250774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febf4140410 0x7febf41422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.255 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.251+0000 7febfb1c3700 1 -- 172.21.15.133:0/3202250774 >> 172.21.15.133:0/3202250774 conn(0x7febf40b95d0 msgr2=0x7febf40b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.251+0000 7febfb1c3700 1 -- 172.21.15.133:0/3202250774 shutdown_connections 2021-01-03T13:07:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.251+0000 7febfb1c3700 1 -- 172.21.15.133:0/3202250774 wait complete. 2021-01-03T13:07:55.266 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:07:55.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.379+0000 7f7b3cde0700 1 Processor -- start 2021-01-03T13:07:55.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.379+0000 7f7b3cde0700 1 -- start start 2021-01-03T13:07:55.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b3cde0700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7b380b5260 0x7f7b381470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b3cde0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7b381442a0 0x7f7b38144730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b3cde0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b380b0c10 con 0x7f7b380b5c00 2021-01-03T13:07:55.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b3cde0700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b380b5640 con 0x7f7b380b5260 2021-01-03T13:07:55.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b3cde0700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3809a4f0 con 0x7f7b381442a0 2021-01-03T13:07:55.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b36ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7b380b5c00 0x7f7b381475a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33456/0 (socket says 172.21.15.133:33456) 2021-01-03T13:07:55.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b36ffd700 1 -- 172.21.15.133:0/664848380 learned_addr learned my addr 172.21.15.133:0/664848380 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:55.387 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b37fff700 1 --2- 172.21.15.133:0/664848380 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7b381442a0 0x7f7b38144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b377fe700 1 --2- 172.21.15.133:0/664848380 >> v2:172.21.15.16:3300/0 conn(0x7f7b380b5260 0x7f7b381470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b367fc700 1 -- 172.21.15.133:0/664848380 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473271900 0 0) 0x7f7b380b0c10 con 0x7f7b380b5c00 2021-01-03T13:07:55.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b367fc700 1 -- 172.21.15.133:0/664848380 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b18003230 con 0x7f7b380b5c00 2021-01-03T13:07:55.388 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b37fff700 1 -- 172.21.15.133:0/664848380 >> v2:172.21.15.16:3300/0 conn(0x7f7b380b5260 msgr2=0x7f7b381470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:55.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b37fff700 1 --2- 172.21.15.133:0/664848380 >> v2:172.21.15.16:3300/0 conn(0x7f7b380b5260 0x7f7b381470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b37fff700 1 -- 172.21.15.133:0/664848380 >> v1:172.21.15.133:6789/0 conn(0x7f7b380b5c00 legacy=0x7f7b381475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b37fff700 1 -- 172.21.15.133:0/664848380 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b380b0e40 con 0x7f7b381442a0 2021-01-03T13:07:55.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b37fff700 1 --2- 172.21.15.133:0/664848380 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7b381442a0 0x7f7b38144730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f7b280032b0 tx=0x7f7b280091a0).ready entity=mon.2 client_cookie=6c6bcaf880078cca server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:55.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b367fc700 1 -- 172.21.15.133:0/664848380 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b2800b940 con 0x7f7b381442a0 2021-01-03T13:07:55.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b367fc700 1 -- 172.21.15.133:0/664848380 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2800baa0 con 0x7f7b381442a0 2021-01-03T13:07:55.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b367fc700 1 -- 172.21.15.133:0/664848380 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b2800bc10 con 0x7f7b381442a0 2021-01-03T13:07:55.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b3cde0700 1 -- 172.21.15.133:0/664848380 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7b381442a0 msgr2=0x7f7b38144730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b3cde0700 1 --2- 172.21.15.133:0/664848380 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7b381442a0 0x7f7b38144730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f7b280032b0 tx=0x7f7b280091a0).stop 2021-01-03T13:07:55.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b3cde0700 1 -- 172.21.15.133:0/664848380 shutdown_connections 2021-01-03T13:07:55.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b3cde0700 1 --2- 172.21.15.133:0/664848380 >> v2:172.21.15.16:3300/0 conn(0x7f7b380b5260 0x7f7b381470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b3cde0700 1 --2- 172.21.15.133:0/664848380 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7b381442a0 0x7f7b38144730 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.383+0000 7f7b3cde0700 1 -- 172.21.15.133:0/664848380 >> 172.21.15.133:0/664848380 conn(0x7f7b3805bdf0 msgr2=0x7f7b3805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:55.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b3cde0700 1 -- 172.21.15.133:0/664848380 shutdown_connections 2021-01-03T13:07:55.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b3cde0700 1 -- 172.21.15.133:0/664848380 wait complete. 2021-01-03T13:07:55.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b3cde0700 1 Processor -- start 2021-01-03T13:07:55.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b3cde0700 1 -- start start 2021-01-03T13:07:55.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b3cde0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7b380b5260 0x7f7b38156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b3cde0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b380b5c00 0x7f7b38146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b3cde0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b381442a0 0x7f7b38159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b3cde0700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b38155c40 con 0x7f7b380b5c00 2021-01-03T13:07:55.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b3cde0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b38155e30 con 0x7f7b381442a0 2021-01-03T13:07:55.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b3cde0700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b381560d0 con 0x7f7b380b5260 2021-01-03T13:07:55.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b37fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b381442a0 0x7f7b38159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b37fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b381442a0 0x7f7b38159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40662/0 (socket says 172.21.15.133:40662) 2021-01-03T13:07:55.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b37fff700 1 -- 172.21.15.133:0/3251188621 learned_addr learned my addr 172.21.15.133:0/3251188621 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:55.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b377fe700 1 --2- 172.21.15.133:0/3251188621 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7b380b5260 0x7f7b38156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b36ffd700 1 --2- 172.21.15.133:0/3251188621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b380b5c00 0x7f7b38146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b37fff700 1 -- 172.21.15.133:0/3251188621 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7b380b5260 msgr2=0x7f7b38156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b37fff700 1 --2- 172.21.15.133:0/3251188621 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7b380b5260 0x7f7b38156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b37fff700 1 -- 172.21.15.133:0/3251188621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b380b5c00 msgr2=0x7f7b38146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b37fff700 1 --2- 172.21.15.133:0/3251188621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b380b5c00 0x7f7b38146220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b37fff700 1 -- 172.21.15.133:0/3251188621 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b38156370 con 0x7f7b381442a0 2021-01-03T13:07:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b377fe700 1 --2- 172.21.15.133:0/3251188621 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7b380b5260 0x7f7b38156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b37fff700 1 --2- 172.21.15.133:0/3251188621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b381442a0 0x7f7b38159190 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f7b280032b0 tx=0x7f7b28016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b34ff9700 1 -- 172.21.15.133:0/3251188621 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b280205f0 con 0x7f7b381442a0 2021-01-03T13:07:55.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b3cde0700 1 -- 172.21.15.133:0/3251188621 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b38065880 con 0x7f7b381442a0 2021-01-03T13:07:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b34ff9700 1 -- 172.21.15.133:0/3251188621 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b28020750 con 0x7f7b381442a0 2021-01-03T13:07:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b3cde0700 1 -- 172.21.15.133:0/3251188621 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b38067300 con 0x7f7b381442a0 2021-01-03T13:07:55.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.387+0000 7f7b34ff9700 1 -- 172.21.15.133:0/3251188621 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b28020ab0 con 0x7f7b381442a0 2021-01-03T13:07:55.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.391+0000 7f7b3cde0700 1 -- 172.21.15.133:0/3251188621 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b38063880 con 0x7f7b381442a0 2021-01-03T13:07:55.401 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.391+0000 7f7b34ff9700 1 -- 172.21.15.133:0/3251188621 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7b28027030 con 0x7f7b381442a0 2021-01-03T13:07:55.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.391+0000 7f7b34ff9700 1 --2- 172.21.15.133:0/3251188621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7b1c055350 0x7f7b1c057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.391+0000 7f7b377fe700 1 --2- 172.21.15.133:0/3251188621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7b1c055350 0x7f7b1c057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.391+0000 7f7b34ff9700 1 -- 172.21.15.133:0/3251188621 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7b2806ef20 con 0x7f7b381442a0 2021-01-03T13:07:55.402 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.391+0000 7f7b377fe700 1 --2- 172.21.15.133:0/3251188621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7b1c055350 0x7f7b1c057810 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f7b3000b000 tx=0x7f7b30008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:55.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.399+0000 7f7b34ff9700 1 -- 172.21.15.133:0/3251188621 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7b38063880 con 0x7f7b381442a0 2021-01-03T13:07:55.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.539+0000 7f7b3cde0700 1 -- 172.21.15.133:0/3251188621 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7b38063880 con 0x7f7b381442a0 2021-01-03T13:07:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.543+0000 7f7b34ff9700 1 -- 172.21.15.133:0/3251188621 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v157) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7b38063880 con 0x7f7b381442a0 2021-01-03T13:07:55.544 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:07:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.543+0000 7f7b3cde0700 1 -- 172.21.15.133:0/3251188621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7b1c055350 msgr2=0x7f7b1c057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.543+0000 7f7b3cde0700 1 --2- 172.21.15.133:0/3251188621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7b1c055350 0x7f7b1c057810 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f7b3000b000 tx=0x7f7b30008040).stop 2021-01-03T13:07:55.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.543+0000 7f7b3cde0700 1 -- 172.21.15.133:0/3251188621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b381442a0 msgr2=0x7f7b38159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.546 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.543+0000 7f7b3cde0700 1 --2- 172.21.15.133:0/3251188621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b381442a0 0x7f7b38159190 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f7b280032b0 tx=0x7f7b28016000).stop 2021-01-03T13:07:55.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.543+0000 7f7b3cde0700 1 -- 172.21.15.133:0/3251188621 shutdown_connections 2021-01-03T13:07:55.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.543+0000 7f7b3cde0700 1 --2- 172.21.15.133:0/3251188621 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7b1c055350 0x7f7b1c057810 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.547 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.543+0000 7f7b3cde0700 1 --2- 172.21.15.133:0/3251188621 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b381442a0 0x7f7b38159190 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.543+0000 7f7b3cde0700 1 --2- 172.21.15.133:0/3251188621 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7b380b5260 0x7f7b38156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.543+0000 7f7b3cde0700 1 --2- 172.21.15.133:0/3251188621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b380b5c00 0x7f7b38146220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.543+0000 7f7b3cde0700 1 -- 172.21.15.133:0/3251188621 >> 172.21.15.133:0/3251188621 conn(0x7f7b3805bdf0 msgr2=0x7f7b3805c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:55.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.543+0000 7f7b3cde0700 1 -- 172.21.15.133:0/3251188621 shutdown_connections 2021-01-03T13:07:55.548 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.543+0000 7f7b3cde0700 1 -- 172.21.15.133:0/3251188621 wait complete. 2021-01-03T13:07:55.558 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2021-01-03T13:07:55.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.663+0000 7fc76e0e2700 1 Processor -- start 2021-01-03T13:07:55.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.663+0000 7fc76e0e2700 1 -- start start 2021-01-03T13:07:55.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76e0e2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc7680622f0 0x7fc768066fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76e0e2700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76805c510 con 0x7fc7680b02b0 2021-01-03T13:07:55.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76e0e2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7680b15a0 con 0x7fc76805c130 2021-01-03T13:07:55.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76e0e2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7681473d0 con 0x7fc7680622f0 2021-01-03T13:07:55.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76d8e1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc7680622f0 0x7fc768066fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76d0e0700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc76805c130 0x7fc7680b1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33466/0 (socket says 172.21.15.133:33466) 2021-01-03T13:07:55.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76d0e0700 1 -- 172.21.15.133:0/2805690794 learned_addr learned my addr 172.21.15.133:0/2805690794 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:55.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76d8e1700 1 --2- 172.21.15.133:0/2805690794 >> v2:172.21.15.133:3300/0 conn(0x7fc7680622f0 0x7fc768066fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40670/0 (socket says 172.21.15.133:40670) 2021-01-03T13:07:55.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76d8e1700 1 -- 172.21.15.133:0/2805690794 >> v1:172.21.15.133:6789/0 conn(0x7fc76805c130 legacy=0x7fc7680b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76d8e1700 1 -- 172.21.15.133:0/2805690794 >> v1:172.21.15.16:6789/0 conn(0x7fc7680b02b0 legacy=0x7fc7680668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76d8e1700 1 -- 172.21.15.133:0/2805690794 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc768061920 con 0x7fc7680622f0 2021-01-03T13:07:55.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76d8e1700 1 --2- 172.21.15.133:0/2805690794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7680622f0 0x7fc768066fb0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7fc764002f30 tx=0x7fc764006dc0).ready entity=mon.1 client_cookie=d89af3f367a38d8f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:55.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc75bfff700 1 -- 172.21.15.133:0/2805690794 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7640097f0 con 0x7fc7680622f0 2021-01-03T13:07:55.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc75bfff700 1 -- 172.21.15.133:0/2805690794 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc764009950 con 0x7fc7680622f0 2021-01-03T13:07:55.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc75bfff700 1 -- 172.21.15.133:0/2805690794 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc764009cf0 con 0x7fc7680622f0 2021-01-03T13:07:55.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76e0e2700 1 -- 172.21.15.133:0/2805690794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7680622f0 msgr2=0x7fc768066fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76e0e2700 1 --2- 172.21.15.133:0/2805690794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7680622f0 0x7fc768066fb0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7fc764002f30 tx=0x7fc764006dc0).stop 2021-01-03T13:07:55.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76e0e2700 1 -- 172.21.15.133:0/2805690794 shutdown_connections 2021-01-03T13:07:55.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76e0e2700 1 --2- 172.21.15.133:0/2805690794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7680622f0 0x7fc768066fb0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76e0e2700 1 -- 172.21.15.133:0/2805690794 >> 172.21.15.133:0/2805690794 conn(0x7fc7680b6110 msgr2=0x7fc7680b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:55.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76e0e2700 1 -- 172.21.15.133:0/2805690794 shutdown_connections 2021-01-03T13:07:55.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.667+0000 7fc76e0e2700 1 -- 172.21.15.133:0/2805690794 wait complete. 2021-01-03T13:07:55.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76e0e2700 1 Processor -- start 2021-01-03T13:07:55.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76e0e2700 1 -- start start 2021-01-03T13:07:55.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76e0e2700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc76805c130 0x7fc768145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76e0e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7680622f0 0x7fc768063bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76e0e2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc7680b02b0 0x7fc7681528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76e0e2700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc768144a10 con 0x7fc76805c130 2021-01-03T13:07:55.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76e0e2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc768141170 con 0x7fc7680622f0 2021-01-03T13:07:55.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76e0e2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc768144c40 con 0x7fc7680b02b0 2021-01-03T13:07:55.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76c8df700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7680622f0 0x7fc768063bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76c8df700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7680622f0 0x7fc768063bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40672/0 (socket says 172.21.15.133:40672) 2021-01-03T13:07:55.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76c8df700 1 -- 172.21.15.133:0/1865729409 learned_addr learned my addr 172.21.15.133:0/1865729409 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:55.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76d8e1700 1 --2- 172.21.15.133:0/1865729409 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc7680b02b0 0x7fc7681528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76d0e0700 1 --2- 172.21.15.133:0/1865729409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc76805c130 0x7fc768145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76c8df700 1 -- 172.21.15.133:0/1865729409 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc7680b02b0 msgr2=0x7fc7681528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76c8df700 1 --2- 172.21.15.133:0/1865729409 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc7680b02b0 0x7fc7681528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76c8df700 1 -- 172.21.15.133:0/1865729409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc76805c130 msgr2=0x7fc768145130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76c8df700 1 --2- 172.21.15.133:0/1865729409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc76805c130 0x7fc768145130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76c8df700 1 -- 172.21.15.133:0/1865729409 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc768152440 con 0x7fc7680622f0 2021-01-03T13:07:55.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76c8df700 1 --2- 172.21.15.133:0/1865729409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7680622f0 0x7fc768063bb0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7fc768065510 tx=0x7fc75c007ba0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:55.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc75a7fc700 1 -- 172.21.15.133:0/1865729409 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc75c007240 con 0x7fc7680622f0 2021-01-03T13:07:55.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc75a7fc700 1 -- 172.21.15.133:0/1865729409 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c0073a0 con 0x7fc7680622f0 2021-01-03T13:07:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76e0e2700 1 -- 172.21.15.133:0/1865729409 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc768066040 con 0x7fc7680622f0 2021-01-03T13:07:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc75a7fc700 1 -- 172.21.15.133:0/1865729409 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc75c0066d0 con 0x7fc7680622f0 2021-01-03T13:07:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.671+0000 7fc76e0e2700 1 -- 172.21.15.133:0/1865729409 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7680ace70 con 0x7fc7680622f0 2021-01-03T13:07:55.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.675+0000 7fc76e0e2700 1 -- 172.21.15.133:0/1865729409 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7681447b0 con 0x7fc7680622f0 2021-01-03T13:07:55.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.675+0000 7fc75a7fc700 1 -- 172.21.15.133:0/1865729409 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc75c010070 con 0x7fc7680622f0 2021-01-03T13:07:55.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.675+0000 7fc75a7fc700 1 --2- 172.21.15.133:0/1865729409 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc7480554e0 0x7fc7480579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.675+0000 7fc75a7fc700 1 -- 172.21.15.133:0/1865729409 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc75c06d450 con 0x7fc7680622f0 2021-01-03T13:07:55.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.675+0000 7fc76d0e0700 1 --2- 172.21.15.133:0/1865729409 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc7480554e0 0x7fc7480579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.675+0000 7fc76d0e0700 1 --2- 172.21.15.133:0/1865729409 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc7480554e0 0x7fc7480579a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fc76000d000 tx=0x7fc760009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:55.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.679+0000 7fc75a7fc700 1 -- 172.21.15.133:0/1865729409 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc75c043970 con 0x7fc7680622f0 2021-01-03T13:07:55.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.819+0000 7fc76e0e2700 1 -- 172.21.15.133:0/1865729409 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc768057300 con 0x7fc7680622f0 2021-01-03T13:07:55.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.819+0000 7fc75a7fc700 1 -- 172.21.15.133:0/1865729409 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v157) v1 ==== 84+0+143 (secure 0 0 0) 0x7fc75c046f90 con 0x7fc7680622f0 2021-01-03T13:07:55.821 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:55.821 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2021-01-03T13:07:55.821 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:55.822 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2021-01-03T13:07:55.822 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "device_health_metrics" 2021-01-03T13:07:55.822 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:07:55.822 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:07:55.822 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 2, 2021-01-03T13:07:55.823 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "rbd" 2021-01-03T13:07:55.823 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:07:55.823 INFO:teuthology.orchestra.run.smithi133.stdout:] 2021-01-03T13:07:55.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.819+0000 7fc76e0e2700 1 -- 172.21.15.133:0/1865729409 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc7480554e0 msgr2=0x7fc7480579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.824 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.819+0000 7fc76e0e2700 1 --2- 172.21.15.133:0/1865729409 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc7480554e0 0x7fc7480579a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fc76000d000 tx=0x7fc760009040).stop 2021-01-03T13:07:55.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.819+0000 7fc76e0e2700 1 -- 172.21.15.133:0/1865729409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7680622f0 msgr2=0x7fc768063bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.819+0000 7fc76e0e2700 1 --2- 172.21.15.133:0/1865729409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7680622f0 0x7fc768063bb0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7fc768065510 tx=0x7fc75c007ba0).stop 2021-01-03T13:07:55.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.819+0000 7fc76e0e2700 1 -- 172.21.15.133:0/1865729409 shutdown_connections 2021-01-03T13:07:55.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.819+0000 7fc76e0e2700 1 --2- 172.21.15.133:0/1865729409 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc7480554e0 0x7fc7480579a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.825 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.819+0000 7fc76e0e2700 1 --2- 172.21.15.133:0/1865729409 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc76805c130 0x7fc768145130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.819+0000 7fc76e0e2700 1 --2- 172.21.15.133:0/1865729409 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc7680b02b0 0x7fc7681528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.819+0000 7fc76e0e2700 1 --2- 172.21.15.133:0/1865729409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7680622f0 0x7fc768063bb0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.819+0000 7fc76e0e2700 1 -- 172.21.15.133:0/1865729409 >> 172.21.15.133:0/1865729409 conn(0x7fc7680b6110 msgr2=0x7fc7680ae660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:55.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.819+0000 7fc76e0e2700 1 -- 172.21.15.133:0/1865729409 shutdown_connections 2021-01-03T13:07:55.826 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.819+0000 7fc76e0e2700 1 -- 172.21.15.133:0/1865729409 wait complete. 2021-01-03T13:07:55.834 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2021-01-03T13:07:55.835 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2021-01-03T13:07:55.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf06088700 1 Processor -- start 2021-01-03T13:07:55.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf06088700 1 -- start start 2021-01-03T13:07:55.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf06088700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbf000b5c00 0x7fbf001477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf06088700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbf001442a0 0x7fbf00144730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf06088700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf000b0c10 con 0x7fbf000b5260 2021-01-03T13:07:55.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf06088700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf000b5640 con 0x7fbf000b5c00 2021-01-03T13:07:55.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf06088700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0009a4f0 con 0x7fbf001442a0 2021-01-03T13:07:55.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf05887700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbf001442a0 0x7fbf00144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf05086700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fbf000b5260 0x7fbf001470b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:40440/0 (socket says 172.21.15.133:40440) 2021-01-03T13:07:55.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf04885700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbf000b5c00 0x7fbf001477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf05086700 1 -- 172.21.15.133:0/3319399008 learned_addr learned my addr 172.21.15.133:0/3319399008 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:55.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf05887700 1 -- 172.21.15.133:0/3319399008 >> v2:172.21.15.16:3300/0 conn(0x7fbf000b5c00 msgr2=0x7fbf001477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:55.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf05887700 1 --2- 172.21.15.133:0/3319399008 >> v2:172.21.15.16:3300/0 conn(0x7fbf000b5c00 0x7fbf001477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf05887700 1 -- 172.21.15.133:0/3319399008 >> v1:172.21.15.16:6789/0 conn(0x7fbf000b5260 legacy=0x7fbf001470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf05887700 1 -- 172.21.15.133:0/3319399008 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf000b0e40 con 0x7fbf001442a0 2021-01-03T13:07:55.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf05887700 1 --2- 172.21.15.133:0/3319399008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbf001442a0 0x7fbf00144730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fbef8002f30 tx=0x7fbef8006dc0).ready entity=mon.2 client_cookie=63730cf11ee2beeb server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:55.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbef3fff700 1 -- 172.21.15.133:0/3319399008 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbef8009760 con 0x7fbf001442a0 2021-01-03T13:07:55.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbef3fff700 1 -- 172.21.15.133:0/3319399008 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef80098c0 con 0x7fbf001442a0 2021-01-03T13:07:55.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbef3fff700 1 -- 172.21.15.133:0/3319399008 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbef8009c20 con 0x7fbf001442a0 2021-01-03T13:07:55.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf06088700 1 -- 172.21.15.133:0/3319399008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbf001442a0 msgr2=0x7fbf00144730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.947+0000 7fbf06088700 1 --2- 172.21.15.133:0/3319399008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbf001442a0 0x7fbf00144730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fbef8002f30 tx=0x7fbef8006dc0).stop 2021-01-03T13:07:55.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.951+0000 7fbf06088700 1 -- 172.21.15.133:0/3319399008 shutdown_connections 2021-01-03T13:07:55.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.951+0000 7fbf06088700 1 --2- 172.21.15.133:0/3319399008 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbf001442a0 0x7fbf00144730 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.951+0000 7fbf06088700 1 --2- 172.21.15.133:0/3319399008 >> v2:172.21.15.16:3300/0 conn(0x7fbf000b5c00 0x7fbf001477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.951+0000 7fbf06088700 1 -- 172.21.15.133:0/3319399008 >> 172.21.15.133:0/3319399008 conn(0x7fbf0005bdf0 msgr2=0x7fbf0005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:55.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.951+0000 7fbf06088700 1 -- 172.21.15.133:0/3319399008 shutdown_connections 2021-01-03T13:07:55.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.951+0000 7fbf06088700 1 -- 172.21.15.133:0/3319399008 wait complete. 2021-01-03T13:07:55.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.951+0000 7fbf06088700 1 Processor -- start 2021-01-03T13:07:55.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.951+0000 7fbf06088700 1 -- start start 2021-01-03T13:07:55.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf06088700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf000b5260 0x7fbf000ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf06088700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbf000b5c00 0x7fbf00159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf06088700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf001442a0 0x7fbf0015a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf06088700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0015a500 con 0x7fbf000b5260 2021-01-03T13:07:55.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf06088700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000ab510 con 0x7fbf001442a0 2021-01-03T13:07:55.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf06088700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf000ab740 con 0x7fbf000b5c00 2021-01-03T13:07:55.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf05887700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf001442a0 0x7fbf0015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.960 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf05887700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf001442a0 0x7fbf0015a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40690/0 (socket says 172.21.15.133:40690) 2021-01-03T13:07:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf05887700 1 -- 172.21.15.133:0/3054802003 learned_addr learned my addr 172.21.15.133:0/3054802003 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf05086700 1 --2- 172.21.15.133:0/3054802003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf000b5260 0x7fbf000ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf04885700 1 --2- 172.21.15.133:0/3054802003 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbf000b5c00 0x7fbf00159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf05887700 1 -- 172.21.15.133:0/3054802003 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbf000b5c00 msgr2=0x7fbf00159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf05887700 1 --2- 172.21.15.133:0/3054802003 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbf000b5c00 0x7fbf00159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf05887700 1 -- 172.21.15.133:0/3054802003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf000b5260 msgr2=0x7fbf000ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:55.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf05887700 1 --2- 172.21.15.133:0/3054802003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf000b5260 0x7fbf000ae4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:55.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf05887700 1 -- 172.21.15.133:0/3054802003 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf000ab9e0 con 0x7fbf001442a0 2021-01-03T13:07:55.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf04885700 1 --2- 172.21.15.133:0/3054802003 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbf000b5c00 0x7fbf00159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:55.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf05086700 1 --2- 172.21.15.133:0/3054802003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf000b5260 0x7fbf000ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:55.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf05887700 1 --2- 172.21.15.133:0/3054802003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf001442a0 0x7fbf0015a010 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7fbf0015a640 tx=0x7fbef8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:55.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbef27fc700 1 -- 172.21.15.133:0/3054802003 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbef8011ac0 con 0x7fbf001442a0 2021-01-03T13:07:55.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbef27fc700 1 -- 172.21.15.133:0/3054802003 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef8011c20 con 0x7fbf001442a0 2021-01-03T13:07:55.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf06088700 1 -- 172.21.15.133:0/3054802003 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf000abc80 con 0x7fbf001442a0 2021-01-03T13:07:55.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbef27fc700 1 -- 172.21.15.133:0/3054802003 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbef801d440 con 0x7fbf001442a0 2021-01-03T13:07:55.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.955+0000 7fbf06088700 1 -- 172.21.15.133:0/3054802003 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf000af500 con 0x7fbf001442a0 2021-01-03T13:07:55.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.959+0000 7fbf06088700 1 -- 172.21.15.133:0/3054802003 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf00057300 con 0x7fbf001442a0 2021-01-03T13:07:55.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.959+0000 7fbef27fc700 1 -- 172.21.15.133:0/3054802003 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fbef8024030 con 0x7fbf001442a0 2021-01-03T13:07:55.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.959+0000 7fbef27fc700 1 --2- 172.21.15.133:0/3054802003 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbee80553b0 0x7fbee8057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:55.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.959+0000 7fbf05086700 1 --2- 172.21.15.133:0/3054802003 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbee80553b0 0x7fbee8057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:55.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.959+0000 7fbef27fc700 1 -- 172.21.15.133:0/3054802003 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fbef806eb70 con 0x7fbf001442a0 2021-01-03T13:07:55.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.959+0000 7fbf05086700 1 --2- 172.21.15.133:0/3054802003 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbee80553b0 0x7fbee8057870 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fbefc00b000 tx=0x7fbefc009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:55.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:55.967+0000 7fbef27fc700 1 -- 172.21.15.133:0/3054802003 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbef80451a0 con 0x7fbf001442a0 2021-01-03T13:07:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.107+0000 7fbf06088700 1 -- 172.21.15.133:0/3054802003 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fbf00060790 con 0x7fbf001442a0 2021-01-03T13:07:56.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.319+0000 7fbef27fc700 1 -- 172.21.15.133:0/3054802003 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v158) v1 ==== 133+0+0 (secure 0 0 0) 0x7fbef8022020 con 0x7fbf001442a0 2021-01-03T13:07:56.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.319+0000 7fbf06088700 1 -- 172.21.15.133:0/3054802003 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbee80553b0 msgr2=0x7fbee8057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:56.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.319+0000 7fbf06088700 1 --2- 172.21.15.133:0/3054802003 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbee80553b0 0x7fbee8057870 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fbefc00b000 tx=0x7fbefc009040).stop 2021-01-03T13:07:56.324 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.319+0000 7fbf06088700 1 -- 172.21.15.133:0/3054802003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf001442a0 msgr2=0x7fbf0015a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:56.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.319+0000 7fbf06088700 1 --2- 172.21.15.133:0/3054802003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf001442a0 0x7fbf0015a010 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7fbf0015a640 tx=0x7fbef8015000).stop 2021-01-03T13:07:56.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.319+0000 7fbf06088700 1 -- 172.21.15.133:0/3054802003 shutdown_connections 2021-01-03T13:07:56.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.319+0000 7fbf06088700 1 --2- 172.21.15.133:0/3054802003 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbee80553b0 0x7fbee8057870 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:56.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.319+0000 7fbf06088700 1 --2- 172.21.15.133:0/3054802003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbf000b5260 0x7fbf000ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:56.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.319+0000 7fbf06088700 1 --2- 172.21.15.133:0/3054802003 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf001442a0 0x7fbf0015a010 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:56.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.319+0000 7fbf06088700 1 --2- 172.21.15.133:0/3054802003 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fbf000b5c00 0x7fbf00159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:56.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.319+0000 7fbf06088700 1 -- 172.21.15.133:0/3054802003 >> 172.21.15.133:0/3054802003 conn(0x7fbf0005bdf0 msgr2=0x7fbf001474e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:56.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.323+0000 7fbf06088700 1 -- 172.21.15.133:0/3054802003 shutdown_connections 2021-01-03T13:07:56.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.323+0000 7fbf06088700 1 -- 172.21.15.133:0/3054802003 wait complete. 2021-01-03T13:07:56.327 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2021-01-03T13:07:56.339 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2021-01-03T13:07:56.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.459+0000 7fa61470c700 1 Processor -- start 2021-01-03T13:07:56.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.459+0000 7fa61470c700 1 -- start start 2021-01-03T13:07:56.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa61470c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa60c05c840 0x7fa60c0af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:56.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa61470c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa60c0afa70 0x7fa60c13f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:56.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa61470c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa60c13f740 0x7fa60c138c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:56.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa61470c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c0b18e0 con 0x7fa60c0afa70 2021-01-03T13:07:56.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa61470c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c05cc20 con 0x7fa60c05c840 2021-01-03T13:07:56.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa61470c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0ad2d0 con 0x7fa60c13f740 2021-01-03T13:07:56.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa6124a8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa60c05c840 0x7fa60c0af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:56.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa6124a8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa60c05c840 0x7fa60c0af440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40694/0 (socket says 172.21.15.133:40694) 2021-01-03T13:07:56.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa6124a8700 1 -- 172.21.15.133:0/1715984512 learned_addr learned my addr 172.21.15.133:0/1715984512 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:56.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa612ca9700 1 --2- 172.21.15.133:0/1715984512 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa60c13f740 0x7fa60c138c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:56.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa611ca7700 1 --2- 172.21.15.133:0/1715984512 >> v2:172.21.15.16:3300/0 conn(0x7fa60c0afa70 0x7fa60c13f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:56.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa6124a8700 1 -- 172.21.15.133:0/1715984512 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa60c13f740 msgr2=0x7fa60c138c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:56.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa6124a8700 1 --2- 172.21.15.133:0/1715984512 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa60c13f740 0x7fa60c138c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa6124a8700 1 -- 172.21.15.133:0/1715984512 >> v2:172.21.15.16:3300/0 conn(0x7fa60c0afa70 msgr2=0x7fa60c13f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa6124a8700 1 --2- 172.21.15.133:0/1715984512 >> v2:172.21.15.16:3300/0 conn(0x7fa60c0afa70 0x7fa60c13f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa6124a8700 1 -- 172.21.15.133:0/1715984512 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c0ad570 con 0x7fa60c05c840 2021-01-03T13:07:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa612ca9700 1 --2- 172.21.15.133:0/1715984512 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa60c13f740 0x7fa60c138c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:56.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa6124a8700 1 --2- 172.21.15.133:0/1715984512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa60c05c840 0x7fa60c0af440 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7fa60c0af390 tx=0x7fa5fc009270).ready entity=mon.1 client_cookie=ef45c7b35f605bf5 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa6114a6700 1 -- 172.21.15.133:0/1715984512 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5fc00bbc0 con 0x7fa60c05c840 2021-01-03T13:07:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa6114a6700 1 -- 172.21.15.133:0/1715984512 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc00bd20 con 0x7fa60c05c840 2021-01-03T13:07:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa6114a6700 1 -- 172.21.15.133:0/1715984512 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5fc00be90 con 0x7fa60c05c840 2021-01-03T13:07:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa61470c700 1 -- 172.21.15.133:0/1715984512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa60c05c840 msgr2=0x7fa60c0af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:56.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa61470c700 1 --2- 172.21.15.133:0/1715984512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa60c05c840 0x7fa60c0af440 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7fa60c0af390 tx=0x7fa5fc009270).stop 2021-01-03T13:07:56.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa61470c700 1 -- 172.21.15.133:0/1715984512 shutdown_connections 2021-01-03T13:07:56.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa61470c700 1 --2- 172.21.15.133:0/1715984512 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa60c13f740 0x7fa60c138c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:56.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa61470c700 1 --2- 172.21.15.133:0/1715984512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa60c05c840 0x7fa60c0af440 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:56.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa61470c700 1 --2- 172.21.15.133:0/1715984512 >> v2:172.21.15.16:3300/0 conn(0x7fa60c0afa70 0x7fa60c13f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:56.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa61470c700 1 -- 172.21.15.133:0/1715984512 >> 172.21.15.133:0/1715984512 conn(0x7fa60c06aeb0 msgr2=0x7fa60c05bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:56.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.463+0000 7fa61470c700 1 -- 172.21.15.133:0/1715984512 shutdown_connections 2021-01-03T13:07:56.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.467+0000 7fa61470c700 1 -- 172.21.15.133:0/1715984512 wait complete. 2021-01-03T13:07:56.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.467+0000 7fa61470c700 1 Processor -- start 2021-01-03T13:07:56.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.467+0000 7fa61470c700 1 -- start start 2021-01-03T13:07:56.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa61470c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa60c05c840 0x7fa60c0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:56.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa61470c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa60c0afa70 0x7fa60c12f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:56.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa61470c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa60c13f740 0x7fa60c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:56.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa61470c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c130210 con 0x7fa60c13f740 2021-01-03T13:07:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa61470c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c13b800 con 0x7fa60c05c840 2021-01-03T13:07:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa61470c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c13bf90 con 0x7fa60c0afa70 2021-01-03T13:07:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa6124a8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa60c05c840 0x7fa60c0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa6124a8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa60c05c840 0x7fa60c0b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40702/0 (socket says 172.21.15.133:40702) 2021-01-03T13:07:56.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa6124a8700 1 -- 172.21.15.133:0/1154948765 learned_addr learned my addr 172.21.15.133:0/1154948765 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa611ca7700 1 --2- 172.21.15.133:0/1154948765 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa60c0afa70 0x7fa60c12f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa612ca9700 1 --2- 172.21.15.133:0/1154948765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa60c13f740 0x7fa60c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa6124a8700 1 -- 172.21.15.133:0/1154948765 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa60c0afa70 msgr2=0x7fa60c12f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa6124a8700 1 --2- 172.21.15.133:0/1154948765 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa60c0afa70 0x7fa60c12f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:56.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa6124a8700 1 -- 172.21.15.133:0/1154948765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa60c13f740 msgr2=0x7fa60c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa6124a8700 1 --2- 172.21.15.133:0/1154948765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa60c13f740 0x7fa60c12fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa6124a8700 1 -- 172.21.15.133:0/1154948765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c13ba30 con 0x7fa60c05c840 2021-01-03T13:07:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa6124a8700 1 --2- 172.21.15.133:0/1154948765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa60c05c840 0x7fa60c0b49a0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fa60c0af390 tx=0x7fa5fc016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa60b7fe700 1 -- 172.21.15.133:0/1154948765 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5fc01f670 con 0x7fa60c05c840 2021-01-03T13:07:56.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa60b7fe700 1 -- 172.21.15.133:0/1154948765 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc01f7d0 con 0x7fa60c05c840 2021-01-03T13:07:56.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa61470c700 1 -- 172.21.15.133:0/1154948765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c13b460 con 0x7fa60c05c840 2021-01-03T13:07:56.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa60b7fe700 1 -- 172.21.15.133:0/1154948765 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5fc01fb30 con 0x7fa60c05c840 2021-01-03T13:07:56.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa61470c700 1 -- 172.21.15.133:0/1154948765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c13f400 con 0x7fa60c05c840 2021-01-03T13:07:56.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa61470c700 1 -- 172.21.15.133:0/1154948765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c143590 con 0x7fa60c05c840 2021-01-03T13:07:56.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.471+0000 7fa60b7fe700 1 -- 172.21.15.133:0/1154948765 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa5fc026030 con 0x7fa60c05c840 2021-01-03T13:07:56.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.475+0000 7fa60b7fe700 1 --2- 172.21.15.133:0/1154948765 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa5ec055440 0x7fa5ec057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:56.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.475+0000 7fa60b7fe700 1 -- 172.21.15.133:0/1154948765 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fa5fc06fba0 con 0x7fa60c05c840 2021-01-03T13:07:56.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.475+0000 7fa611ca7700 1 --2- 172.21.15.133:0/1154948765 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa5ec055440 0x7fa5ec057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:56.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.475+0000 7fa611ca7700 1 --2- 172.21.15.133:0/1154948765 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa5ec055440 0x7fa5ec057900 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fa60000c000 tx=0x7fa600008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:56.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.479+0000 7fa60b7fe700 1 -- 172.21.15.133:0/1154948765 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa5fc045f60 con 0x7fa60c05c840 2021-01-03T13:07:56.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:56.619+0000 7fa61470c700 1 -- 172.21.15.133:0/1154948765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fa60c13ae20 con 0x7fa60c05c840 2021-01-03T13:07:57.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.283+0000 7fa60b7fe700 1 -- 172.21.15.133:0/1154948765 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v159) v1 ==== 125+0+0 (secure 0 0 0) 0x7fa60c13ae20 con 0x7fa60c05c840 2021-01-03T13:07:57.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.295+0000 7fa61470c700 1 -- 172.21.15.133:0/1154948765 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa5ec055440 msgr2=0x7fa5ec057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:57.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.295+0000 7fa61470c700 1 --2- 172.21.15.133:0/1154948765 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa5ec055440 0x7fa5ec057900 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fa60000c000 tx=0x7fa600008040).stop 2021-01-03T13:07:57.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.295+0000 7fa61470c700 1 -- 172.21.15.133:0/1154948765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa60c05c840 msgr2=0x7fa60c0b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:57.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.295+0000 7fa61470c700 1 --2- 172.21.15.133:0/1154948765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa60c05c840 0x7fa60c0b49a0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fa60c0af390 tx=0x7fa5fc016000).stop 2021-01-03T13:07:57.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.295+0000 7fa61470c700 1 -- 172.21.15.133:0/1154948765 shutdown_connections 2021-01-03T13:07:57.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.295+0000 7fa61470c700 1 --2- 172.21.15.133:0/1154948765 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa5ec055440 0x7fa5ec057900 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.295+0000 7fa61470c700 1 --2- 172.21.15.133:0/1154948765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa60c13f740 0x7fa60c12fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.295+0000 7fa61470c700 1 --2- 172.21.15.133:0/1154948765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa60c05c840 0x7fa60c0b49a0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.295+0000 7fa61470c700 1 --2- 172.21.15.133:0/1154948765 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa60c0afa70 0x7fa60c12f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.295+0000 7fa61470c700 1 -- 172.21.15.133:0/1154948765 >> 172.21.15.133:0/1154948765 conn(0x7fa60c06aeb0 msgr2=0x7fa60c138020 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:57.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.295+0000 7fa61470c700 1 -- 172.21.15.133:0/1154948765 shutdown_connections 2021-01-03T13:07:57.299 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.295+0000 7fa61470c700 1 -- 172.21.15.133:0/1154948765 wait complete. 2021-01-03T13:07:57.300 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2021-01-03T13:07:57.310 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2021-01-03T13:07:57.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f5741c6d700 1 Processor -- start 2021-01-03T13:07:57.425 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f5741c6d700 1 -- start start 2021-01-03T13:07:57.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f5741c6d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f573c140410 0x7f573c146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:57.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f5741c6d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573c1407f0 0x7f573c142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:57.427 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f5741c6d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f573c0b0470 0x7f573c05bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:57.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f5741c6d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573c0b02d0 con 0x7f573c0b0470 2021-01-03T13:07:57.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f5741c6d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573c146390 con 0x7f573c140410 2021-01-03T13:07:57.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f5741c6d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c05cf20 con 0x7f573c1407f0 2021-01-03T13:07:57.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f573b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f573c140410 0x7f573c146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:57.428 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f573b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f573c140410 0x7f573c146cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40708/0 (socket says 172.21.15.133:40708) 2021-01-03T13:07:57.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f573b7fe700 1 -- 172.21.15.133:0/3833215058 learned_addr learned my addr 172.21.15.133:0/3833215058 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:57.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f573affd700 1 --2- 172.21.15.133:0/3833215058 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573c1407f0 0x7f573c142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:57.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f573bfff700 1 --2- 172.21.15.133:0/3833215058 >> v2:172.21.15.16:3300/0 conn(0x7f573c0b0470 0x7f573c05bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:57.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f573b7fe700 1 -- 172.21.15.133:0/3833215058 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573c1407f0 msgr2=0x7f573c142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:57.429 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f573b7fe700 1 --2- 172.21.15.133:0/3833215058 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573c1407f0 0x7f573c142dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f573b7fe700 1 -- 172.21.15.133:0/3833215058 >> v2:172.21.15.16:3300/0 conn(0x7f573c0b0470 msgr2=0x7f573c05bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:57.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f573b7fe700 1 --2- 172.21.15.133:0/3833215058 >> v2:172.21.15.16:3300/0 conn(0x7f573c0b0470 0x7f573c05bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f573b7fe700 1 -- 172.21.15.133:0/3833215058 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c146580 con 0x7f573c140410 2021-01-03T13:07:57.430 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f573b7fe700 1 --2- 172.21.15.133:0/3833215058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573c140410 0x7f573c146cc0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f572c002f30 tx=0x7f572c006e80).ready entity=mon.1 client_cookie=6d698f9324fd71f7 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:57.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f573a7fc700 1 -- 172.21.15.133:0/3833215058 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f572c009640 con 0x7f573c140410 2021-01-03T13:07:57.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f573a7fc700 1 -- 172.21.15.133:0/3833215058 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c0097a0 con 0x7f573c140410 2021-01-03T13:07:57.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f573a7fc700 1 -- 172.21.15.133:0/3833215058 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f572c009b00 con 0x7f573c140410 2021-01-03T13:07:57.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f5741c6d700 1 -- 172.21.15.133:0/3833215058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573c140410 msgr2=0x7f573c146cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:57.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.423+0000 7f5741c6d700 1 --2- 172.21.15.133:0/3833215058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573c140410 0x7f573c146cc0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f572c002f30 tx=0x7f572c006e80).stop 2021-01-03T13:07:57.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f5741c6d700 1 -- 172.21.15.133:0/3833215058 shutdown_connections 2021-01-03T13:07:57.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f5741c6d700 1 --2- 172.21.15.133:0/3833215058 >> v2:172.21.15.16:3300/0 conn(0x7f573c0b0470 0x7f573c05bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f5741c6d700 1 --2- 172.21.15.133:0/3833215058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573c140410 0x7f573c146cc0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f5741c6d700 1 --2- 172.21.15.133:0/3833215058 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573c1407f0 0x7f573c142dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f5741c6d700 1 -- 172.21.15.133:0/3833215058 >> 172.21.15.133:0/3833215058 conn(0x7f573c0b95d0 msgr2=0x7f573c0b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:57.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f5741c6d700 1 -- 172.21.15.133:0/3833215058 shutdown_connections 2021-01-03T13:07:57.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f5741c6d700 1 -- 172.21.15.133:0/3833215058 wait complete. 2021-01-03T13:07:57.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f5741c6d700 1 Processor -- start 2021-01-03T13:07:57.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f5741c6d700 1 -- start start 2021-01-03T13:07:57.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f5741c6d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573c0b0470 0x7f573c0b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:57.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f5741c6d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573c140410 0x7f573c13f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:57.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f5741c6d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f573c1407f0 0x7f573c13fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:57.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f5741c6d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c156130 con 0x7f573c1407f0 2021-01-03T13:07:57.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f5741c6d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c155e90 con 0x7f573c0b0470 2021-01-03T13:07:57.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f5741c6d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c141540 con 0x7f573c140410 2021-01-03T13:07:57.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f573b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573c0b0470 0x7f573c0b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:57.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f573b7fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573c0b0470 0x7f573c0b14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40714/0 (socket says 172.21.15.133:40714) 2021-01-03T13:07:57.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f573b7fe700 1 -- 172.21.15.133:0/4076139589 learned_addr learned my addr 172.21.15.133:0/4076139589 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:57.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f573affd700 1 --2- 172.21.15.133:0/4076139589 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573c140410 0x7f573c13f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:57.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f573bfff700 1 --2- 172.21.15.133:0/4076139589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f573c1407f0 0x7f573c13fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:57.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f573b7fe700 1 -- 172.21.15.133:0/4076139589 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573c140410 msgr2=0x7f573c13f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:57.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f573b7fe700 1 --2- 172.21.15.133:0/4076139589 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573c140410 0x7f573c13f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f573b7fe700 1 -- 172.21.15.133:0/4076139589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f573c1407f0 msgr2=0x7f573c13fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:57.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f573b7fe700 1 --2- 172.21.15.133:0/4076139589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f573c1407f0 0x7f573c13fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.427+0000 7f573b7fe700 1 -- 172.21.15.133:0/4076139589 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c1417e0 con 0x7f573c0b0470 2021-01-03T13:07:57.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.431+0000 7f573b7fe700 1 --2- 172.21.15.133:0/4076139589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573c0b0470 0x7f573c0b14c0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f572c002f30 tx=0x7f572c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:57.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.431+0000 7f5738ff9700 1 -- 172.21.15.133:0/4076139589 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f572c011ad0 con 0x7f573c0b0470 2021-01-03T13:07:57.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.431+0000 7f5738ff9700 1 -- 172.21.15.133:0/4076139589 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c011c30 con 0x7f573c0b0470 2021-01-03T13:07:57.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.431+0000 7f5738ff9700 1 -- 172.21.15.133:0/4076139589 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f572c01d450 con 0x7f573c0b0470 2021-01-03T13:07:57.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.431+0000 7f5741c6d700 1 -- 172.21.15.133:0/4076139589 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573c155bc0 con 0x7f573c0b0470 2021-01-03T13:07:57.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.431+0000 7f5741c6d700 1 -- 172.21.15.133:0/4076139589 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573c0b19b0 con 0x7f573c0b0470 2021-01-03T13:07:57.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.431+0000 7f5741c6d700 1 -- 172.21.15.133:0/4076139589 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573c141970 con 0x7f573c0b0470 2021-01-03T13:07:57.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.431+0000 7f5738ff9700 1 -- 172.21.15.133:0/4076139589 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f572c00f070 con 0x7f573c0b0470 2021-01-03T13:07:57.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.431+0000 7f5738ff9700 1 --2- 172.21.15.133:0/4076139589 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f571c055330 0x7f571c0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:57.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.431+0000 7f5738ff9700 1 -- 172.21.15.133:0/4076139589 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f572c06f830 con 0x7f573c0b0470 2021-01-03T13:07:57.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.431+0000 7f573affd700 1 --2- 172.21.15.133:0/4076139589 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f571c055330 0x7f571c0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:57.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.435+0000 7f573affd700 1 --2- 172.21.15.133:0/4076139589 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f571c055330 0x7f571c0577f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f573000b000 tx=0x7f5730006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:57.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.443+0000 7f5738ff9700 1 -- 172.21.15.133:0/4076139589 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f572c045c20 con 0x7f573c0b0470 2021-01-03T13:07:57.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.627+0000 7f5741c6d700 1 -- 172.21.15.133:0/4076139589 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f573c057300 con 0x7f573c0b0470 2021-01-03T13:07:57.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.639+0000 7f5738ff9700 1 -- 172.21.15.133:0/4076139589 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 29 and data pool 30 v77) v1 ==== 189+0+0 (secure 0 0 0) 0x7f572c0491c0 con 0x7f573c0b0470 2021-01-03T13:07:57.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.643+0000 7f5741c6d700 1 -- 172.21.15.133:0/4076139589 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f571c055330 msgr2=0x7f571c0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:57.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.643+0000 7f5741c6d700 1 --2- 172.21.15.133:0/4076139589 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f571c055330 0x7f571c0577f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f573000b000 tx=0x7f5730006dc0).stop 2021-01-03T13:07:57.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.643+0000 7f5741c6d700 1 -- 172.21.15.133:0/4076139589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573c0b0470 msgr2=0x7f573c0b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:57.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.643+0000 7f5741c6d700 1 --2- 172.21.15.133:0/4076139589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573c0b0470 0x7f573c0b14c0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f572c002f30 tx=0x7f572c015000).stop 2021-01-03T13:07:57.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.643+0000 7f5741c6d700 1 -- 172.21.15.133:0/4076139589 shutdown_connections 2021-01-03T13:07:57.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.643+0000 7f5741c6d700 1 --2- 172.21.15.133:0/4076139589 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f571c055330 0x7f571c0577f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.643+0000 7f5741c6d700 1 --2- 172.21.15.133:0/4076139589 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f573c1407f0 0x7f573c13fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.643+0000 7f5741c6d700 1 --2- 172.21.15.133:0/4076139589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f573c0b0470 0x7f573c0b14c0 secure :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 rx=0x7f572c002f30 tx=0x7f572c015000).stop 2021-01-03T13:07:57.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.643+0000 7f5741c6d700 1 --2- 172.21.15.133:0/4076139589 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f573c140410 0x7f573c13f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.643+0000 7f5741c6d700 1 -- 172.21.15.133:0/4076139589 >> 172.21.15.133:0/4076139589 conn(0x7f573c0b95d0 msgr2=0x7f573c0b71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:57.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.643+0000 7f5741c6d700 1 -- 172.21.15.133:0/4076139589 shutdown_connections 2021-01-03T13:07:57.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.643+0000 7f5741c6d700 1 -- 172.21.15.133:0/4076139589 wait complete. 2021-01-03T13:07:57.648 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 29 and data pool 30 2021-01-03T13:07:57.660 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:07:57.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.751+0000 7f60cb54a700 1 Processor -- start 2021-01-03T13:07:57.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.751+0000 7f60cb54a700 1 -- start start 2021-01-03T13:07:57.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60cb54a700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f60c40b23a0 0x7f60c4066fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:57.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60cb54a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60c41406b0 0x7f60c40674a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:57.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60cb54a700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c40b2780 con 0x7f60c40af780 2021-01-03T13:07:57.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60cb54a700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c40aef00 con 0x7f60c40b23a0 2021-01-03T13:07:57.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60cb54a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40a9480 con 0x7f60c41406b0 2021-01-03T13:07:57.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60ca548700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f60c40b23a0 0x7f60c4066fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:57.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60c9d47700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60c41406b0 0x7f60c40674a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:57.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60ca548700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f60c40b23a0 0x7f60c4066fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:39268/0 (socket says 172.21.15.133:39268) 2021-01-03T13:07:57.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60ca548700 1 -- 172.21.15.133:0/2530395314 learned_addr learned my addr 172.21.15.133:0/2530395314 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:57.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60ca548700 1 -- 172.21.15.133:0/2530395314 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60c41406b0 msgr2=0x7f60c40674a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:57.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60ca548700 1 --2- 172.21.15.133:0/2530395314 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60c41406b0 0x7f60c40674a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60ca548700 1 -- 172.21.15.133:0/2530395314 >> v1:172.21.15.16:6789/0 conn(0x7f60c40af780 legacy=0x7f60c4142f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:57.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60ca548700 1 -- 172.21.15.133:0/2530395314 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c413fa30 con 0x7f60c40b23a0 2021-01-03T13:07:57.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60ca548700 1 --2- 172.21.15.133:0/2530395314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60c40b23a0 0x7f60c4066fb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f60c0002f30 tx=0x7f60c0006e80).ready entity=mon.0 client_cookie=4b01c9031861f767 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:57.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60c9546700 1 -- 172.21.15.133:0/2530395314 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60c00097f0 con 0x7f60c40b23a0 2021-01-03T13:07:57.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60c9546700 1 -- 172.21.15.133:0/2530395314 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c0009950 con 0x7f60c40b23a0 2021-01-03T13:07:57.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60c9546700 1 -- 172.21.15.133:0/2530395314 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60c0009cb0 con 0x7f60c40b23a0 2021-01-03T13:07:57.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60cb54a700 1 -- 172.21.15.133:0/2530395314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60c40b23a0 msgr2=0x7f60c4066fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.755+0000 7f60cb54a700 1 --2- 172.21.15.133:0/2530395314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60c40b23a0 0x7f60c4066fb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f60c0002f30 tx=0x7f60c0006e80).stop 2021-01-03T13:07:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60cb54a700 1 -- 172.21.15.133:0/2530395314 shutdown_connections 2021-01-03T13:07:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60cb54a700 1 --2- 172.21.15.133:0/2530395314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60c40b23a0 0x7f60c4066fb0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60cb54a700 1 --2- 172.21.15.133:0/2530395314 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60c41406b0 0x7f60c40674a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60cb54a700 1 -- 172.21.15.133:0/2530395314 >> 172.21.15.133:0/2530395314 conn(0x7f60c406b050 msgr2=0x7f60c4060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60cb54a700 1 -- 172.21.15.133:0/2530395314 shutdown_connections 2021-01-03T13:07:57.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60cb54a700 1 -- 172.21.15.133:0/2530395314 wait complete. 2021-01-03T13:07:57.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60cb54a700 1 Processor -- start 2021-01-03T13:07:57.767 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60cb54a700 1 -- start start 2021-01-03T13:07:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60cb54a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60c40af780 0x7f60c405c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60cb54a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60c40b23a0 0x7f60c40b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60cb54a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60c41406b0 0x7f60c4143550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60cb54a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c4140db0 con 0x7f60c40b23a0 2021-01-03T13:07:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60cb54a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40b50c0 con 0x7f60c40af780 2021-01-03T13:07:57.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60cb54a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40b58c0 con 0x7f60c41406b0 2021-01-03T13:07:57.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60ca548700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60c40af780 0x7f60c405c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:57.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60ca548700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60c40af780 0x7f60c405c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40736/0 (socket says 172.21.15.133:40736) 2021-01-03T13:07:57.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60ca548700 1 -- 172.21.15.133:0/2012831622 learned_addr learned my addr 172.21.15.133:0/2012831622 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:57.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60cad49700 1 --2- 172.21.15.133:0/2012831622 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60c41406b0 0x7f60c4143550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:57.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60c9d47700 1 --2- 172.21.15.133:0/2012831622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60c40b23a0 0x7f60c40b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:57.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60ca548700 1 -- 172.21.15.133:0/2012831622 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60c41406b0 msgr2=0x7f60c4143550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:57.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60ca548700 1 --2- 172.21.15.133:0/2012831622 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60c41406b0 0x7f60c4143550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60ca548700 1 -- 172.21.15.133:0/2012831622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60c40b23a0 msgr2=0x7f60c40b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:57.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60ca548700 1 --2- 172.21.15.133:0/2012831622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60c40b23a0 0x7f60c40b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60ca548700 1 -- 172.21.15.133:0/2012831622 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c40b4880 con 0x7f60c40af780 2021-01-03T13:07:57.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60ca548700 1 --2- 172.21.15.133:0/2012831622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60c40af780 0x7f60c405c130 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f60c0002f30 tx=0x7f60c0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:57.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60b37fe700 1 -- 172.21.15.133:0/2012831622 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60c0011bf0 con 0x7f60c40af780 2021-01-03T13:07:57.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60b37fe700 1 -- 172.21.15.133:0/2012831622 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c0011d50 con 0x7f60c40af780 2021-01-03T13:07:57.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60cb54a700 1 -- 172.21.15.133:0/2012831622 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c40a8480 con 0x7f60c40af780 2021-01-03T13:07:57.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60b37fe700 1 -- 172.21.15.133:0/2012831622 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60c001e650 con 0x7f60c40af780 2021-01-03T13:07:57.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.759+0000 7f60cb54a700 1 -- 172.21.15.133:0/2012831622 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c4143a40 con 0x7f60c40af780 2021-01-03T13:07:57.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.763+0000 7f60b37fe700 1 -- 172.21.15.133:0/2012831622 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f60c0025030 con 0x7f60c40af780 2021-01-03T13:07:57.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.763+0000 7f60cb54a700 1 -- 172.21.15.133:0/2012831622 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c4140f00 con 0x7f60c40af780 2021-01-03T13:07:57.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.763+0000 7f60b37fe700 1 --2- 172.21.15.133:0/2012831622 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f60a40554e0 0x7f60a40579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:57.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.763+0000 7f60b37fe700 1 -- 172.21.15.133:0/2012831622 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f60c006f420 con 0x7f60c40af780 2021-01-03T13:07:57.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.763+0000 7f60c9d47700 1 --2- 172.21.15.133:0/2012831622 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f60a40554e0 0x7f60a40579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:57.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.763+0000 7f60c9d47700 1 --2- 172.21.15.133:0/2012831622 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f60a40554e0 0x7f60a40579a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f60b400b000 tx=0x7f60b4006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:57.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.771+0000 7f60b37fe700 1 -- 172.21.15.133:0/2012831622 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f60c4140f00 con 0x7f60c40af780 2021-01-03T13:07:57.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.911+0000 7f60cb54a700 1 -- 172.21.15.133:0/2012831622 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60c4140f00 con 0x7f60c40af780 2021-01-03T13:07:57.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.915+0000 7f60b37fe700 1 -- 172.21.15.133:0/2012831622 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+16113 (secure 0 0 0) 0x7f60c4140f00 con 0x7f60c40af780 2021-01-03T13:07:57.917 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:57.918 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":160,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:57.630074+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:07:56.170759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-01-03T13:07:56.676733+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:07:57.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.915+0000 7f60cb54a700 1 -- 172.21.15.133:0/2012831622 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f60a40554e0 msgr2=0x7f60a40579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:57.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.915+0000 7f60cb54a700 1 --2- 172.21.15.133:0/2012831622 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f60a40554e0 0x7f60a40579a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f60b400b000 tx=0x7f60b4006dc0).stop 2021-01-03T13:07:57.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.915+0000 7f60cb54a700 1 -- 172.21.15.133:0/2012831622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60c40af780 msgr2=0x7f60c405c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:57.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.915+0000 7f60cb54a700 1 --2- 172.21.15.133:0/2012831622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60c40af780 0x7f60c405c130 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f60c0002f30 tx=0x7f60c0015000).stop 2021-01-03T13:07:57.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.915+0000 7f60cb54a700 1 -- 172.21.15.133:0/2012831622 shutdown_connections 2021-01-03T13:07:57.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.915+0000 7f60cb54a700 1 --2- 172.21.15.133:0/2012831622 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f60a40554e0 0x7f60a40579a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.915+0000 7f60cb54a700 1 --2- 172.21.15.133:0/2012831622 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f60c41406b0 0x7f60c4143550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.915+0000 7f60cb54a700 1 --2- 172.21.15.133:0/2012831622 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60c40af780 0x7f60c405c130 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.915+0000 7f60cb54a700 1 --2- 172.21.15.133:0/2012831622 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60c40b23a0 0x7f60c40b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:57.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.915+0000 7f60cb54a700 1 -- 172.21.15.133:0/2012831622 >> 172.21.15.133:0/2012831622 conn(0x7f60c406b050 msgr2=0x7f60c41440a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:57.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.915+0000 7f60cb54a700 1 -- 172.21.15.133:0/2012831622 shutdown_connections 2021-01-03T13:07:57.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:57.915+0000 7f60cb54a700 1 -- 172.21.15.133:0/2012831622 wait complete. 2021-01-03T13:07:57.931 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:07:58.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.039+0000 7f4ba5271700 1 Processor -- start 2021-01-03T13:07:58.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.039+0000 7f4ba5271700 1 -- start start 2021-01-03T13:07:58.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4ba5271700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ba00b0c90 0x7f4ba00b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:58.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4ba5271700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba0060da0 con 0x7f4ba00b52c0 2021-01-03T13:07:58.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4ba5271700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba00b0ad0 con 0x7f4ba00b5c00 2021-01-03T13:07:58.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4ba5271700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba0067a90 con 0x7f4ba00b0c90 2021-01-03T13:07:58.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4ba4a70700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4ba00b5c00 0x7f4ba0143eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33544/0 (socket says 172.21.15.133:33544) 2021-01-03T13:07:58.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4ba4a70700 1 -- 172.21.15.133:0/1984802697 learned_addr learned my addr 172.21.15.133:0/1984802697 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:58.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4b9f7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ba00b0c90 0x7f4ba00b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:58.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4b9f7fe700 1 -- 172.21.15.133:0/1984802697 >> v1:172.21.15.133:6789/0 conn(0x7f4ba00b5c00 legacy=0x7f4ba0143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:58.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4b9f7fe700 1 -- 172.21.15.133:0/1984802697 >> v1:172.21.15.16:6789/0 conn(0x7f4ba00b52c0 legacy=0x7f4ba0098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:58.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4b9f7fe700 1 -- 172.21.15.133:0/1984802697 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba00b56a0 con 0x7f4ba00b0c90 2021-01-03T13:07:58.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4b9effd700 1 -- 172.21.15.133:0/1984802697 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290525378 0 0) 0x7f4b90001450 con 0x7f4ba00b5c00 2021-01-03T13:07:58.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4b9f7fe700 1 --2- 172.21.15.133:0/1984802697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ba00b0c90 0x7f4ba00b05e0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f4b88002f30 tx=0x7f4b88006dc0).ready entity=mon.1 client_cookie=89a13ae9c9c2dcb6 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:58.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4b9effd700 1 -- 172.21.15.133:0/1984802697 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b880097f0 con 0x7f4ba00b0c90 2021-01-03T13:07:58.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4b9effd700 1 -- 172.21.15.133:0/1984802697 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b88009950 con 0x7f4ba00b0c90 2021-01-03T13:07:58.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4b9effd700 1 -- 172.21.15.133:0/1984802697 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b88009cb0 con 0x7f4ba00b0c90 2021-01-03T13:07:58.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4ba5271700 1 -- 172.21.15.133:0/1984802697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ba00b0c90 msgr2=0x7f4ba00b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:58.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4ba5271700 1 --2- 172.21.15.133:0/1984802697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ba00b0c90 0x7f4ba00b05e0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f4b88002f30 tx=0x7f4b88006dc0).stop 2021-01-03T13:07:58.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4ba5271700 1 -- 172.21.15.133:0/1984802697 shutdown_connections 2021-01-03T13:07:58.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4ba5271700 1 --2- 172.21.15.133:0/1984802697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ba00b0c90 0x7f4ba00b05e0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:58.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4ba5271700 1 -- 172.21.15.133:0/1984802697 >> 172.21.15.133:0/1984802697 conn(0x7f4ba005bdf0 msgr2=0x7f4ba005c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:58.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4ba5271700 1 -- 172.21.15.133:0/1984802697 shutdown_connections 2021-01-03T13:07:58.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.043+0000 7f4ba5271700 1 -- 172.21.15.133:0/1984802697 wait complete. 2021-01-03T13:07:58.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba5271700 1 Processor -- start 2021-01-03T13:07:58.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba5271700 1 -- start start 2021-01-03T13:07:58.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba5271700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ba00b0c90 0x7f4ba0066520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:58.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba5271700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ba00b52c0 0x7f4ba00af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:58.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba5271700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ba00b5c00 0x7f4ba01596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:58.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba5271700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba0065e50 con 0x7f4ba00b0c90 2021-01-03T13:07:58.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba5271700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00b4420 con 0x7f4ba00b5c00 2021-01-03T13:07:58.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba5271700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00b46c0 con 0x7f4ba00b52c0 2021-01-03T13:07:58.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba4a70700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ba00b5c00 0x7f4ba01596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:58.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba4a70700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ba00b5c00 0x7f4ba01596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40752/0 (socket says 172.21.15.133:40752) 2021-01-03T13:07:58.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba4a70700 1 -- 172.21.15.133:0/3926616218 learned_addr learned my addr 172.21.15.133:0/3926616218 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:58.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4b9ffff700 1 --2- 172.21.15.133:0/3926616218 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ba00b0c90 0x7f4ba0066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:58.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4b9f7fe700 1 --2- 172.21.15.133:0/3926616218 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ba00b52c0 0x7f4ba00af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:58.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba4a70700 1 -- 172.21.15.133:0/3926616218 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ba00b52c0 msgr2=0x7f4ba00af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:58.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba4a70700 1 --2- 172.21.15.133:0/3926616218 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ba00b52c0 0x7f4ba00af120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:58.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba4a70700 1 -- 172.21.15.133:0/3926616218 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ba00b0c90 msgr2=0x7f4ba0066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:58.056 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba4a70700 1 --2- 172.21.15.133:0/3926616218 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ba00b0c90 0x7f4ba0066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:58.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba4a70700 1 -- 172.21.15.133:0/3926616218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba0066080 con 0x7f4ba00b5c00 2021-01-03T13:07:58.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba4a70700 1 --2- 172.21.15.133:0/3926616218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ba00b5c00 0x7f4ba01596c0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f4b90000f00 tx=0x7f4b90007f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:58.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4b9d7fa700 1 -- 172.21.15.133:0/3926616218 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b90005b70 con 0x7f4ba00b5c00 2021-01-03T13:07:58.057 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4b9d7fa700 1 -- 172.21.15.133:0/3926616218 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b90005cd0 con 0x7f4ba00b5c00 2021-01-03T13:07:58.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba5271700 1 -- 172.21.15.133:0/3926616218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba00ad700 con 0x7f4ba00b5c00 2021-01-03T13:07:58.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4b9d7fa700 1 -- 172.21.15.133:0/3926616218 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b90007300 con 0x7f4ba00b5c00 2021-01-03T13:07:58.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba5271700 1 -- 172.21.15.133:0/3926616218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba0159bb0 con 0x7f4ba00b5c00 2021-01-03T13:07:58.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4ba5271700 1 -- 172.21.15.133:0/3926616218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba00ae990 con 0x7f4ba00b5c00 2021-01-03T13:07:58.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.047+0000 7f4b9d7fa700 1 -- 172.21.15.133:0/3926616218 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4b90010030 con 0x7f4ba00b5c00 2021-01-03T13:07:58.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.051+0000 7f4b9d7fa700 1 --2- 172.21.15.133:0/3926616218 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4b780553b0 0x7f4b78057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:58.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.051+0000 7f4b9d7fa700 1 -- 172.21.15.133:0/3926616218 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4b9006dc10 con 0x7f4ba00b5c00 2021-01-03T13:07:58.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.051+0000 7f4b9ffff700 1 --2- 172.21.15.133:0/3926616218 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4b780553b0 0x7f4b78057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:58.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.051+0000 7f4b9ffff700 1 --2- 172.21.15.133:0/3926616218 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4b780553b0 0x7f4b78057870 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f4b9800d000 tx=0x7f4b98009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:58.060 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.055+0000 7f4b9d7fa700 1 -- 172.21.15.133:0/3926616218 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4ba00ae990 con 0x7f4ba00b5c00 2021-01-03T13:07:58.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.195+0000 7f4ba5271700 1 -- 172.21.15.133:0/3926616218 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ba00ae990 con 0x7f4ba00b5c00 2021-01-03T13:07:58.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.195+0000 7f4b9d7fa700 1 -- 172.21.15.133:0/3926616218 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+16113 (secure 0 0 0) 0x7f4ba00ae990 con 0x7f4ba00b5c00 2021-01-03T13:07:58.199 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:58.199 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":160,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:57.630074+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:07:56.170759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-01-03T13:07:56.676733+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:07:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.199+0000 7f4ba5271700 1 -- 172.21.15.133:0/3926616218 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4b780553b0 msgr2=0x7f4b78057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:58.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.199+0000 7f4ba5271700 1 --2- 172.21.15.133:0/3926616218 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4b780553b0 0x7f4b78057870 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f4b9800d000 tx=0x7f4b98009040).stop 2021-01-03T13:07:58.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.199+0000 7f4ba5271700 1 -- 172.21.15.133:0/3926616218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ba00b5c00 msgr2=0x7f4ba01596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:58.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.199+0000 7f4ba5271700 1 --2- 172.21.15.133:0/3926616218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ba00b5c00 0x7f4ba01596c0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f4b90000f00 tx=0x7f4b90007f70).stop 2021-01-03T13:07:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.199+0000 7f4ba5271700 1 -- 172.21.15.133:0/3926616218 shutdown_connections 2021-01-03T13:07:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.199+0000 7f4ba5271700 1 --2- 172.21.15.133:0/3926616218 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4b780553b0 0x7f4b78057870 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.199+0000 7f4ba5271700 1 --2- 172.21.15.133:0/3926616218 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ba00b0c90 0x7f4ba0066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:58.202 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.199+0000 7f4ba5271700 1 --2- 172.21.15.133:0/3926616218 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ba00b5c00 0x7f4ba01596c0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:58.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.199+0000 7f4ba5271700 1 --2- 172.21.15.133:0/3926616218 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ba00b52c0 0x7f4ba00af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:58.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.199+0000 7f4ba5271700 1 -- 172.21.15.133:0/3926616218 >> 172.21.15.133:0/3926616218 conn(0x7f4ba005bdf0 msgr2=0x7f4ba0144500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:58.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.199+0000 7f4ba5271700 1 -- 172.21.15.133:0/3926616218 shutdown_connections 2021-01-03T13:07:58.203 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.199+0000 7f4ba5271700 1 -- 172.21.15.133:0/3926616218 wait complete. 2021-01-03T13:07:58.214 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2021-01-03T13:07:58.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd518e0700 1 Processor -- start 2021-01-03T13:07:58.325 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd518e0700 1 -- start start 2021-01-03T13:07:58.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd518e0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efd4c0b9b60 0x7efd4c0b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:58.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd518e0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efd4c0b4980 0x7efd4c0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:58.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd518e0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4c0605f0 con 0x7efd4c146430 2021-01-03T13:07:58.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd518e0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd4c0aed30 con 0x7efd4c0b9b60 2021-01-03T13:07:58.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd518e0700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c146fd0 con 0x7efd4c0b4980 2021-01-03T13:07:58.328 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd510df700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efd4c146430 0x7efd4c1468c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33560/0 (socket says 172.21.15.133:33560) 2021-01-03T13:07:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd510df700 1 -- 172.21.15.133:0/3985790111 learned_addr learned my addr 172.21.15.133:0/3985790111 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd508de700 1 --2- 172.21.15.133:0/3985790111 >> v2:172.21.15.133:3300/0 conn(0x7efd4c0b9b60 0x7efd4c0b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd4bfff700 1 --2- 172.21.15.133:0/3985790111 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efd4c0b4980 0x7efd4c0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd4b7fe700 1 -- 172.21.15.133:0/3985790111 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774488451 0 0) 0x7efd4c0605f0 con 0x7efd4c146430 2021-01-03T13:07:58.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd4b7fe700 1 -- 172.21.15.133:0/3985790111 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd38003230 con 0x7efd4c146430 2021-01-03T13:07:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd508de700 1 -- 172.21.15.133:0/3985790111 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efd4c0b4980 msgr2=0x7efd4c0b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd4b7fe700 1 -- 172.21.15.133:0/3985790111 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3621886160 0 0) 0x7efd38003230 con 0x7efd4c146430 2021-01-03T13:07:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd508de700 1 --2- 172.21.15.133:0/3985790111 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efd4c0b4980 0x7efd4c0b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd508de700 1 -- 172.21.15.133:0/3985790111 >> v1:172.21.15.133:6789/0 conn(0x7efd4c146430 legacy=0x7efd4c1468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:58.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd508de700 1 -- 172.21.15.133:0/3985790111 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c0600b0 con 0x7efd4c0b9b60 2021-01-03T13:07:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd508de700 1 --2- 172.21.15.133:0/3985790111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd4c0b9b60 0x7efd4c0b9f40 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7efd44001bf0 tx=0x7efd3c006dc0).ready entity=mon.1 client_cookie=a1ca0cb228e97499 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd4b7fe700 1 -- 172.21.15.133:0/3985790111 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd44001a50 con 0x7efd4c0b9b60 2021-01-03T13:07:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd4b7fe700 1 -- 172.21.15.133:0/3985790111 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3c00d570 con 0x7efd4c0b9b60 2021-01-03T13:07:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd518e0700 1 -- 172.21.15.133:0/3985790111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd4c0b9b60 msgr2=0x7efd4c0b9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:58.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd4b7fe700 1 -- 172.21.15.133:0/3985790111 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd3c00d6e0 con 0x7efd4c0b9b60 2021-01-03T13:07:58.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd518e0700 1 --2- 172.21.15.133:0/3985790111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd4c0b9b60 0x7efd4c0b9f40 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7efd44001bf0 tx=0x7efd3c006dc0).stop 2021-01-03T13:07:58.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd518e0700 1 -- 172.21.15.133:0/3985790111 shutdown_connections 2021-01-03T13:07:58.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd518e0700 1 --2- 172.21.15.133:0/3985790111 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd4c0b9b60 0x7efd4c0b9f40 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:58.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd518e0700 1 --2- 172.21.15.133:0/3985790111 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efd4c0b4980 0x7efd4c0b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.323+0000 7efd518e0700 1 -- 172.21.15.133:0/3985790111 >> 172.21.15.133:0/3985790111 conn(0x7efd4c0b69e0 msgr2=0x7efd4c0b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd518e0700 1 -- 172.21.15.133:0/3985790111 shutdown_connections 2021-01-03T13:07:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd518e0700 1 -- 172.21.15.133:0/3985790111 wait complete. 2021-01-03T13:07:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd518e0700 1 Processor -- start 2021-01-03T13:07:58.335 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd518e0700 1 -- start start 2021-01-03T13:07:58.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd518e0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efd4c0b4980 0x7efd4c0b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:58.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd518e0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd4c0b9b60 0x7efd4c151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:58.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd518e0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efd4c146430 0x7efd4c1523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:58.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd518e0700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c1528d0 con 0x7efd4c0b4980 2021-01-03T13:07:58.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd518e0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c0b1760 con 0x7efd4c0b9b60 2021-01-03T13:07:58.336 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd518e0700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c09e5a0 con 0x7efd4c146430 2021-01-03T13:07:58.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd4bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd4c0b9b60 0x7efd4c151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:58.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd4bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd4c0b9b60 0x7efd4c151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40764/0 (socket says 172.21.15.133:40764) 2021-01-03T13:07:58.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd4bfff700 1 -- 172.21.15.133:0/3725229149 learned_addr learned my addr 172.21.15.133:0/3725229149 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:58.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd510df700 1 --2- 172.21.15.133:0/3725229149 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efd4c146430 0x7efd4c1523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:58.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd508de700 1 --2- 172.21.15.133:0/3725229149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efd4c0b4980 0x7efd4c0b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:58.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd4bfff700 1 -- 172.21.15.133:0/3725229149 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efd4c146430 msgr2=0x7efd4c1523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:58.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd4bfff700 1 --2- 172.21.15.133:0/3725229149 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efd4c146430 0x7efd4c1523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:58.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd4bfff700 1 -- 172.21.15.133:0/3725229149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efd4c0b4980 msgr2=0x7efd4c0b0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:58.338 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd4bfff700 1 --2- 172.21.15.133:0/3725229149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efd4c0b4980 0x7efd4c0b0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:58.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd4bfff700 1 -- 172.21.15.133:0/3725229149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c1519b0 con 0x7efd4c0b9b60 2021-01-03T13:07:58.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd510df700 1 --2- 172.21.15.133:0/3725229149 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efd4c146430 0x7efd4c1523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:07:58.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd4bfff700 1 --2- 172.21.15.133:0/3725229149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd4c0b9b60 0x7efd4c151ef0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7efd4c09f210 tx=0x7efd40006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:58.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd49ffb700 1 -- 172.21.15.133:0/3725229149 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd4000ca80 con 0x7efd4c0b9b60 2021-01-03T13:07:58.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd49ffb700 1 -- 172.21.15.133:0/3725229149 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4000cbe0 con 0x7efd4c0b9b60 2021-01-03T13:07:58.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd518e0700 1 -- 172.21.15.133:0/3725229149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd4c09e840 con 0x7efd4c0b9b60 2021-01-03T13:07:58.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.327+0000 7efd49ffb700 1 -- 172.21.15.133:0/3725229149 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efd400123f0 con 0x7efd4c0b9b60 2021-01-03T13:07:58.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.331+0000 7efd518e0700 1 -- 172.21.15.133:0/3725229149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4c0b0710 con 0x7efd4c0b9b60 2021-01-03T13:07:58.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.331+0000 7efd518e0700 1 -- 172.21.15.133:0/3725229149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd4c151b40 con 0x7efd4c0b9b60 2021-01-03T13:07:58.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.331+0000 7efd49ffb700 1 -- 172.21.15.133:0/3725229149 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7efd40012550 con 0x7efd4c0b9b60 2021-01-03T13:07:58.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.331+0000 7efd49ffb700 1 --2- 172.21.15.133:0/3725229149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efd2c055470 0x7efd2c057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:58.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.331+0000 7efd508de700 1 --2- 172.21.15.133:0/3725229149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efd2c055470 0x7efd2c057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:58.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.331+0000 7efd49ffb700 1 -- 172.21.15.133:0/3725229149 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efd4006e540 con 0x7efd4c0b9b60 2021-01-03T13:07:58.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.331+0000 7efd508de700 1 --2- 172.21.15.133:0/3725229149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efd2c055470 0x7efd2c057930 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7efd3c018000 tx=0x7efd3c015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:58.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.335+0000 7efd49ffb700 1 -- 172.21.15.133:0/3725229149 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7efd400446d0 con 0x7efd4c0b9b60 2021-01-03T13:07:58.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:58.519+0000 7efd518e0700 1 -- 172.21.15.133:0/3725229149 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efd4c057300 con 0x7efd4c0b9b60 2021-01-03T13:07:59.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.335+0000 7efd49ffb700 1 -- 172.21.15.133:0/3725229149 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v79) v1 ==== 118+0+0 (secure 0 0 0) 0x7efd40047cf0 con 0x7efd4c0b9b60 2021-01-03T13:07:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.335+0000 7efd518e0700 1 -- 172.21.15.133:0/3725229149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efd2c055470 msgr2=0x7efd2c057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.335+0000 7efd518e0700 1 --2- 172.21.15.133:0/3725229149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efd2c055470 0x7efd2c057930 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7efd3c018000 tx=0x7efd3c015000).stop 2021-01-03T13:07:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.335+0000 7efd518e0700 1 -- 172.21.15.133:0/3725229149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd4c0b9b60 msgr2=0x7efd4c151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:59.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.335+0000 7efd518e0700 1 --2- 172.21.15.133:0/3725229149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd4c0b9b60 0x7efd4c151ef0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7efd4c09f210 tx=0x7efd40006dc0).stop 2021-01-03T13:07:59.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.335+0000 7efd518e0700 1 -- 172.21.15.133:0/3725229149 shutdown_connections 2021-01-03T13:07:59.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.335+0000 7efd518e0700 1 --2- 172.21.15.133:0/3725229149 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efd2c055470 0x7efd2c057930 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.335+0000 7efd518e0700 1 --2- 172.21.15.133:0/3725229149 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efd4c0b4980 0x7efd4c0b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.335+0000 7efd518e0700 1 --2- 172.21.15.133:0/3725229149 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efd4c146430 0x7efd4c1523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.335+0000 7efd518e0700 1 --2- 172.21.15.133:0/3725229149 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efd4c0b9b60 0x7efd4c151ef0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.335+0000 7efd518e0700 1 -- 172.21.15.133:0/3725229149 >> 172.21.15.133:0/3725229149 conn(0x7efd4c0b69e0 msgr2=0x7efd4c05bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:59.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.335+0000 7efd518e0700 1 -- 172.21.15.133:0/3725229149 shutdown_connections 2021-01-03T13:07:59.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.335+0000 7efd518e0700 1 -- 172.21.15.133:0/3725229149 wait complete. 2021-01-03T13:07:59.356 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:07:59.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.467+0000 7f3332837700 1 Processor -- start 2021-01-03T13:07:59.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.467+0000 7f3332837700 1 -- start start 2021-01-03T13:07:59.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3332837700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f332c0b2050 0x7f332c1428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3332837700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332c0afa40 con 0x7f332c0b1300 2021-01-03T13:07:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3332837700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332c0b25d0 con 0x7f332c0b0c30 2021-01-03T13:07:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3332837700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332c0b2870 con 0x7f332c0b2050 2021-01-03T13:07:59.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3332036700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f332c0b2050 0x7f332c1428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3331034700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f332c0b0c30 0x7f332c0a8850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33572/0 (socket says 172.21.15.133:33572) 2021-01-03T13:07:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3331034700 1 -- 172.21.15.133:0/1882029953 learned_addr learned my addr 172.21.15.133:0/1882029953 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:07:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3332036700 1 -- 172.21.15.133:0/1882029953 >> v1:172.21.15.133:6789/0 conn(0x7f332c0b0c30 legacy=0x7f332c0a8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3332036700 1 -- 172.21.15.133:0/1882029953 >> v1:172.21.15.16:6789/0 conn(0x7f332c0b1300 legacy=0x7f332c0ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:59.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3332036700 1 -- 172.21.15.133:0/1882029953 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c0ad040 con 0x7f332c0b2050 2021-01-03T13:07:59.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3332036700 1 --2- 172.21.15.133:0/1882029953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f332c0b2050 0x7f332c1428c0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f3324002f30 tx=0x7f3324006dc0).ready entity=mon.1 client_cookie=26f719713572d8ee server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:59.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3330833700 1 -- 172.21.15.133:0/1882029953 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33240097f0 con 0x7f332c0b2050 2021-01-03T13:07:59.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3330833700 1 -- 172.21.15.133:0/1882029953 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3324009950 con 0x7f332c0b2050 2021-01-03T13:07:59.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3330833700 1 -- 172.21.15.133:0/1882029953 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3324009cb0 con 0x7f332c0b2050 2021-01-03T13:07:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3332837700 1 -- 172.21.15.133:0/1882029953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f332c0b2050 msgr2=0x7f332c1428c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3332837700 1 --2- 172.21.15.133:0/1882029953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f332c0b2050 0x7f332c1428c0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7f3324002f30 tx=0x7f3324006dc0).stop 2021-01-03T13:07:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3332837700 1 -- 172.21.15.133:0/1882029953 shutdown_connections 2021-01-03T13:07:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3332837700 1 --2- 172.21.15.133:0/1882029953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f332c0b2050 0x7f332c1428c0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3332837700 1 -- 172.21.15.133:0/1882029953 >> 172.21.15.133:0/1882029953 conn(0x7f332c06b050 msgr2=0x7f332c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3332837700 1 -- 172.21.15.133:0/1882029953 shutdown_connections 2021-01-03T13:07:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.471+0000 7f3332837700 1 -- 172.21.15.133:0/1882029953 wait complete. 2021-01-03T13:07:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.475+0000 7f3332837700 1 Processor -- start 2021-01-03T13:07:59.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.475+0000 7f3332837700 1 -- start start 2021-01-03T13:07:59.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.475+0000 7f3332837700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f332c0b0c30 0x7f332c09e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:59.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.475+0000 7f3332837700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f332c0b1300 0x7f332c14e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.475+0000 7f3332837700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f332c0b2050 0x7f332c0640c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.475+0000 7f3332837700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c066900 con 0x7f332c0b0c30 2021-01-03T13:07:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.475+0000 7f3332837700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c13cde0 con 0x7f332c0b2050 2021-01-03T13:07:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.475+0000 7f3332837700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c065890 con 0x7f332c0b1300 2021-01-03T13:07:59.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.475+0000 7f3332036700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f332c0b2050 0x7f332c0640c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:59.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.475+0000 7f3332036700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f332c0b2050 0x7f332c0640c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40778/0 (socket says 172.21.15.133:40778) 2021-01-03T13:07:59.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.475+0000 7f3332036700 1 -- 172.21.15.133:0/2564952440 learned_addr learned my addr 172.21.15.133:0/2564952440 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:59.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.475+0000 7f3331034700 1 --2- 172.21.15.133:0/2564952440 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f332c0b1300 0x7f332c14e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:59.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.475+0000 7f3331835700 1 --2- 172.21.15.133:0/2564952440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f332c0b0c30 0x7f332c09e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:59.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.479+0000 7f3332036700 1 -- 172.21.15.133:0/2564952440 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f332c0b1300 msgr2=0x7f332c14e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:59.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.479+0000 7f3332036700 1 --2- 172.21.15.133:0/2564952440 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f332c0b1300 0x7f332c14e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.479+0000 7f3332036700 1 -- 172.21.15.133:0/2564952440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f332c0b0c30 msgr2=0x7f332c09e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:59.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.479+0000 7f3332036700 1 --2- 172.21.15.133:0/2564952440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f332c0b0c30 0x7f332c09e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.479+0000 7f3332036700 1 -- 172.21.15.133:0/2564952440 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c14eee0 con 0x7f332c0b2050 2021-01-03T13:07:59.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.479+0000 7f3332036700 1 --2- 172.21.15.133:0/2564952440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f332c0b2050 0x7f332c0640c0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f3324002f30 tx=0x7f3324015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:59.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.479+0000 7f332affd700 1 -- 172.21.15.133:0/2564952440 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3324011af0 con 0x7f332c0b2050 2021-01-03T13:07:59.486 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.479+0000 7f332affd700 1 -- 172.21.15.133:0/2564952440 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3324021070 con 0x7f332c0b2050 2021-01-03T13:07:59.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.479+0000 7f3332837700 1 -- 172.21.15.133:0/2564952440 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332c14f180 con 0x7f332c0b2050 2021-01-03T13:07:59.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.479+0000 7f332affd700 1 -- 172.21.15.133:0/2564952440 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3324011e40 con 0x7f332c0b2050 2021-01-03T13:07:59.487 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.479+0000 7f3332837700 1 -- 172.21.15.133:0/2564952440 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332c063490 con 0x7f332c0b2050 2021-01-03T13:07:59.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.479+0000 7f3332837700 1 -- 172.21.15.133:0/2564952440 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332c057300 con 0x7f332c0b2050 2021-01-03T13:07:59.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.479+0000 7f332affd700 1 -- 172.21.15.133:0/2564952440 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f332402d070 con 0x7f332c0b2050 2021-01-03T13:07:59.488 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.479+0000 7f332affd700 1 --2- 172.21.15.133:0/2564952440 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f330c055440 0x7f330c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.483+0000 7f332affd700 1 -- 172.21.15.133:0/2564952440 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3324071780 con 0x7f332c0b2050 2021-01-03T13:07:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.483+0000 7f3331835700 1 --2- 172.21.15.133:0/2564952440 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f330c055440 0x7f330c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:59.489 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.483+0000 7f3331835700 1 --2- 172.21.15.133:0/2564952440 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f330c055440 0x7f330c057900 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f331c00d000 tx=0x7f331c007ee0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:59.491 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.487+0000 7f332affd700 1 -- 172.21.15.133:0/2564952440 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3324047a80 con 0x7f332c0b2050 2021-01-03T13:07:59.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.675+0000 7f3332837700 1 -- 172.21.15.133:0/2564952440 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f332c05f080 con 0x7f332c0b2050 2021-01-03T13:07:59.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.675+0000 7f332affd700 1 -- 172.21.15.133:0/2564952440 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+2501 (secure 0 0 0) 0x7f332404b0a0 con 0x7f332c0b2050 2021-01-03T13:07:59.677 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:59.678 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":79,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/1043050023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1043050023},{"type":"v1","addr":"172.21.15.16:6833","nonce":1043050023}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76},{"gid":8488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1327300036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1327300036},{"type":"v1","addr":"172.21.15.133:6835","nonce":1327300036}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:57.630488+0000","modified":"2021-01-03T13:07:59.321927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8494":{"gid":8494,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/3193569550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3193569550},{"type":"v1","addr":"172.21.15.133:6837","nonce":3193569550}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-01-03T13:07:59.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.675+0000 7f3332837700 1 -- 172.21.15.133:0/2564952440 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f330c055440 msgr2=0x7f330c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:59.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.675+0000 7f3332837700 1 --2- 172.21.15.133:0/2564952440 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f330c055440 0x7f330c057900 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f331c00d000 tx=0x7f331c007ee0).stop 2021-01-03T13:07:59.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.675+0000 7f3332837700 1 -- 172.21.15.133:0/2564952440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f332c0b2050 msgr2=0x7f332c0640c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:59.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.675+0000 7f3332837700 1 --2- 172.21.15.133:0/2564952440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f332c0b2050 0x7f332c0640c0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f3324002f30 tx=0x7f3324015000).stop 2021-01-03T13:07:59.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.675+0000 7f3332837700 1 -- 172.21.15.133:0/2564952440 shutdown_connections 2021-01-03T13:07:59.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.675+0000 7f3332837700 1 --2- 172.21.15.133:0/2564952440 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f330c055440 0x7f330c057900 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.675+0000 7f3332837700 1 --2- 172.21.15.133:0/2564952440 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f332c0b0c30 0x7f332c09e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.675+0000 7f3332837700 1 --2- 172.21.15.133:0/2564952440 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f332c0b2050 0x7f332c0640c0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.675+0000 7f3332837700 1 --2- 172.21.15.133:0/2564952440 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f332c0b1300 0x7f332c14e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.675+0000 7f3332837700 1 -- 172.21.15.133:0/2564952440 >> 172.21.15.133:0/2564952440 conn(0x7f332c06b050 msgr2=0x7f332c0b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:59.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.675+0000 7f3332837700 1 -- 172.21.15.133:0/2564952440 shutdown_connections 2021-01-03T13:07:59.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.675+0000 7f3332837700 1 -- 172.21.15.133:0/2564952440 wait complete. 2021-01-03T13:07:59.683 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 79 2021-01-03T13:07:59.695 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:07:59.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9b07700 1 Processor -- start 2021-01-03T13:07:59.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9b07700 1 -- start start 2021-01-03T13:07:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9b07700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42b405f920 0x7f42b40b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9b07700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f42b4066f30 0x7f42b40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9b07700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f42b40b1590 0x7f42b40613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9b07700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b40ae700 con 0x7f42b4066f30 2021-01-03T13:07:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9b07700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b405fd00 con 0x7f42b40b1590 2021-01-03T13:07:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9b07700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40accd0 con 0x7f42b405f920 2021-01-03T13:07:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9306700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f42b40b1590 0x7f42b40613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9306700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f42b40b1590 0x7f42b40613e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40786/0 (socket says 172.21.15.133:40786) 2021-01-03T13:07:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9306700 1 -- 172.21.15.133:0/767095477 learned_addr learned my addr 172.21.15.133:0/767095477 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:59.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b8b05700 1 --2- 172.21.15.133:0/767095477 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42b405f920 0x7f42b40b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:59.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b3fff700 1 --2- 172.21.15.133:0/767095477 >> v2:172.21.15.16:3300/0 conn(0x7f42b4066f30 0x7f42b40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:59.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9306700 1 -- 172.21.15.133:0/767095477 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42b405f920 msgr2=0x7f42b40b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:59.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9306700 1 --2- 172.21.15.133:0/767095477 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42b405f920 0x7f42b40b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9306700 1 -- 172.21.15.133:0/767095477 >> v2:172.21.15.16:3300/0 conn(0x7f42b4066f30 msgr2=0x7f42b40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:07:59.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9306700 1 --2- 172.21.15.133:0/767095477 >> v2:172.21.15.16:3300/0 conn(0x7f42b4066f30 0x7f42b40b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9306700 1 -- 172.21.15.133:0/767095477 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b40acf70 con 0x7f42b40b1590 2021-01-03T13:07:59.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9306700 1 --2- 172.21.15.133:0/767095477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42b40b1590 0x7f42b40613e0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f42ac0032b0 tx=0x7f42ac009270).ready entity=mon.1 client_cookie=b139d6fb53bd9a2e server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:59.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b37fe700 1 -- 172.21.15.133:0/767095477 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42ac009e60 con 0x7f42b40b1590 2021-01-03T13:07:59.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b37fe700 1 -- 172.21.15.133:0/767095477 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac00bb50 con 0x7f42b40b1590 2021-01-03T13:07:59.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b37fe700 1 -- 172.21.15.133:0/767095477 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42ac00bcc0 con 0x7f42b40b1590 2021-01-03T13:07:59.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9b07700 1 -- 172.21.15.133:0/767095477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42b40b1590 msgr2=0x7f42b40613e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:59.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.803+0000 7f42b9b07700 1 --2- 172.21.15.133:0/767095477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42b40b1590 0x7f42b40613e0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f42ac0032b0 tx=0x7f42ac009270).stop 2021-01-03T13:07:59.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9b07700 1 -- 172.21.15.133:0/767095477 shutdown_connections 2021-01-03T13:07:59.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9b07700 1 --2- 172.21.15.133:0/767095477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42b40b1590 0x7f42b40613e0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9b07700 1 --2- 172.21.15.133:0/767095477 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42b405f920 0x7f42b40b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9b07700 1 --2- 172.21.15.133:0/767095477 >> v2:172.21.15.16:3300/0 conn(0x7f42b4066f30 0x7f42b40b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9b07700 1 -- 172.21.15.133:0/767095477 >> 172.21.15.133:0/767095477 conn(0x7f42b40b6110 msgr2=0x7f42b40b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9b07700 1 -- 172.21.15.133:0/767095477 shutdown_connections 2021-01-03T13:07:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9b07700 1 -- 172.21.15.133:0/767095477 wait complete. 2021-01-03T13:07:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9b07700 1 Processor -- start 2021-01-03T13:07:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9b07700 1 -- start start 2021-01-03T13:07:59.816 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9b07700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42b405f920 0x7f42b4144a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:59.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9b07700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42b4066f30 0x7f42b413e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:59.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9b07700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42b40b1590 0x7f42b413e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:59.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9b07700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b414ec30 con 0x7f42b4066f30 2021-01-03T13:07:59.817 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9b07700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b414eed0 con 0x7f42b40b1590 2021-01-03T13:07:59.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9b07700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b414f170 con 0x7f42b405f920 2021-01-03T13:07:59.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9306700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42b40b1590 0x7f42b413e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:59.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9306700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42b40b1590 0x7f42b413e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40794/0 (socket says 172.21.15.133:40794) 2021-01-03T13:07:59.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.807+0000 7f42b9306700 1 -- 172.21.15.133:0/1814381045 learned_addr learned my addr 172.21.15.133:0/1814381045 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:07:59.818 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b8b05700 1 --2- 172.21.15.133:0/1814381045 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42b405f920 0x7f42b4144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:59.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b3fff700 1 --2- 172.21.15.133:0/1814381045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42b4066f30 0x7f42b413e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:59.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b9306700 1 -- 172.21.15.133:0/1814381045 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42b405f920 msgr2=0x7f42b4144a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:59.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b9306700 1 --2- 172.21.15.133:0/1814381045 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42b405f920 0x7f42b4144a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.819 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b9306700 1 -- 172.21.15.133:0/1814381045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42b4066f30 msgr2=0x7f42b413e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:59.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b9306700 1 --2- 172.21.15.133:0/1814381045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42b4066f30 0x7f42b413e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b9306700 1 -- 172.21.15.133:0/1814381045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b414f410 con 0x7f42b40b1590 2021-01-03T13:07:59.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b9306700 1 --2- 172.21.15.133:0/1814381045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42b40b1590 0x7f42b413e680 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f42ac0032b0 tx=0x7f42ac016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:59.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b1ffb700 1 -- 172.21.15.133:0/1814381045 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42ac01f3f0 con 0x7f42b40b1590 2021-01-03T13:07:59.820 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b1ffb700 1 -- 172.21.15.133:0/1814381045 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac01f550 con 0x7f42b40b1590 2021-01-03T13:07:59.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b9b07700 1 -- 172.21.15.133:0/1814381045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b40a0220 con 0x7f42b40b1590 2021-01-03T13:07:59.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b1ffb700 1 -- 172.21.15.133:0/1814381045 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42ac01f8b0 con 0x7f42b40b1590 2021-01-03T13:07:59.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b9b07700 1 -- 172.21.15.133:0/1814381045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b414e720 con 0x7f42b40b1590 2021-01-03T13:07:59.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b1ffb700 1 -- 172.21.15.133:0/1814381045 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f42ac026030 con 0x7f42b40b1590 2021-01-03T13:07:59.821 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b1ffb700 1 --2- 172.21.15.133:0/1814381045 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f42940553b0 0x7f4294057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:07:59.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b9b07700 1 -- 172.21.15.133:0/1814381045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b414ea00 con 0x7f42b40b1590 2021-01-03T13:07:59.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b1ffb700 1 -- 172.21.15.133:0/1814381045 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f42ac06e810 con 0x7f42b40b1590 2021-01-03T13:07:59.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.811+0000 7f42b8b05700 1 --2- 172.21.15.133:0/1814381045 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f42940553b0 0x7f4294057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:07:59.822 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.815+0000 7f42b8b05700 1 --2- 172.21.15.133:0/1814381045 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f42940553b0 0x7f4294057870 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f42a400b000 tx=0x7f42a4006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:07:59.823 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.819+0000 7f42b1ffb700 1 -- 172.21.15.133:0/1814381045 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f42ac044b10 con 0x7f42b40b1590 2021-01-03T13:07:59.961 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.959+0000 7f42b9b07700 1 -- 172.21.15.133:0/1814381045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42b4145550 con 0x7f42b40b1590 2021-01-03T13:07:59.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.959+0000 7f42b1ffb700 1 -- 172.21.15.133:0/1814381045 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16100 (secure 0 0 0) 0x7f42b4145550 con 0x7f42b40b1590 2021-01-03T13:07:59.962 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:07:59.963 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":162,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:59.636463+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:07:56.170759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-01-03T13:07:56.676733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:07:59.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.963+0000 7f42b9b07700 1 -- 172.21.15.133:0/1814381045 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f42940553b0 msgr2=0x7f4294057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:59.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.963+0000 7f42b9b07700 1 --2- 172.21.15.133:0/1814381045 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f42940553b0 0x7f4294057870 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f42a400b000 tx=0x7f42a4006dc0).stop 2021-01-03T13:07:59.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.963+0000 7f42b9b07700 1 -- 172.21.15.133:0/1814381045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42b40b1590 msgr2=0x7f42b413e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:07:59.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.963+0000 7f42b9b07700 1 --2- 172.21.15.133:0/1814381045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42b40b1590 0x7f42b413e680 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f42ac0032b0 tx=0x7f42ac016000).stop 2021-01-03T13:07:59.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.963+0000 7f42b9b07700 1 -- 172.21.15.133:0/1814381045 shutdown_connections 2021-01-03T13:07:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.963+0000 7f42b9b07700 1 --2- 172.21.15.133:0/1814381045 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f42940553b0 0x7f4294057870 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.963+0000 7f42b9b07700 1 --2- 172.21.15.133:0/1814381045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42b40b1590 0x7f42b413e680 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.963+0000 7f42b9b07700 1 --2- 172.21.15.133:0/1814381045 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f42b405f920 0x7f42b4144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.963+0000 7f42b9b07700 1 --2- 172.21.15.133:0/1814381045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42b4066f30 0x7f42b413e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:07:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.963+0000 7f42b9b07700 1 -- 172.21.15.133:0/1814381045 >> 172.21.15.133:0/1814381045 conn(0x7f42b40b6110 msgr2=0x7f42b41415a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:07:59.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.963+0000 7f42b9b07700 1 -- 172.21.15.133:0/1814381045 shutdown_connections 2021-01-03T13:07:59.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:07:59.963+0000 7f42b9b07700 1 -- 172.21.15.133:0/1814381045 wait complete. 2021-01-03T13:07:59.976 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:08:00.102 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.095+0000 7f7c71d32700 1 Processor -- start 2021-01-03T13:08:00.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.095+0000 7f7c71d32700 1 -- start start 2021-01-03T13:08:00.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.095+0000 7f7c71d32700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7c6c0adc10 0x7f7c6c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:00.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.095+0000 7f7c71d32700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c6c062450 0x7f7c6c0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:00.103 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.095+0000 7f7c71d32700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6c0adff0 con 0x7f7c6c0b3190 2021-01-03T13:08:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.095+0000 7f7c71d32700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6c0b1930 con 0x7f7c6c0adc10 2021-01-03T13:08:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.095+0000 7f7c71d32700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c05fb80 con 0x7f7c6c062450 2021-01-03T13:08:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.095+0000 7f7c72f94700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7c6c0b3190 0x7f7c6c025140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33602/0 (socket says 172.21.15.133:33602) 2021-01-03T13:08:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.095+0000 7f7c72f94700 1 -- 172.21.15.133:0/1898170867 learned_addr learned my addr 172.21.15.133:0/1898170867 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:08:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.095+0000 7f7c70d30700 1 --2- 172.21.15.133:0/1898170867 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c6c062450 0x7f7c6c0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.095+0000 7f7c71531700 1 --2- 172.21.15.133:0/1898170867 >> v2:172.21.15.16:3300/0 conn(0x7f7c6c0adc10 0x7f7c6c067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c63fff700 1 -- 172.21.15.133:0/1898170867 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000489777 0 0) 0x7f7c6c0adff0 con 0x7f7c6c0b3190 2021-01-03T13:08:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c63fff700 1 -- 172.21.15.133:0/1898170867 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c58003230 con 0x7f7c6c0b3190 2021-01-03T13:08:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c71531700 1 -- 172.21.15.133:0/1898170867 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c6c062450 msgr2=0x7f7c6c0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:00.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c71531700 1 --2- 172.21.15.133:0/1898170867 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c6c062450 0x7f7c6c0b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c71531700 1 -- 172.21.15.133:0/1898170867 >> v1:172.21.15.133:6789/0 conn(0x7f7c6c0b3190 legacy=0x7f7c6c025140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c71531700 1 -- 172.21.15.133:0/1898170867 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c05fed0 con 0x7f7c6c0adc10 2021-01-03T13:08:00.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c71531700 1 --2- 172.21.15.133:0/1898170867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c6c0adc10 0x7f7c6c067cb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f7c68002f30 tx=0x7f7c68006dc0).ready entity=mon.0 client_cookie=481a7e9b66737c02 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:00.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c63fff700 1 -- 172.21.15.133:0/1898170867 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c680096a0 con 0x7f7c6c0adc10 2021-01-03T13:08:00.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c63fff700 1 -- 172.21.15.133:0/1898170867 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c68009800 con 0x7f7c6c0adc10 2021-01-03T13:08:00.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c63fff700 1 -- 172.21.15.133:0/1898170867 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c68009b60 con 0x7f7c6c0adc10 2021-01-03T13:08:00.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c71d32700 1 -- 172.21.15.133:0/1898170867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c6c0adc10 msgr2=0x7f7c6c067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c71d32700 1 --2- 172.21.15.133:0/1898170867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c6c0adc10 0x7f7c6c067cb0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f7c68002f30 tx=0x7f7c68006dc0).stop 2021-01-03T13:08:00.107 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c71d32700 1 -- 172.21.15.133:0/1898170867 shutdown_connections 2021-01-03T13:08:00.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c71d32700 1 --2- 172.21.15.133:0/1898170867 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c6c0adc10 0x7f7c6c067cb0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c71d32700 1 --2- 172.21.15.133:0/1898170867 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c6c062450 0x7f7c6c0b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.108 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c71d32700 1 -- 172.21.15.133:0/1898170867 >> 172.21.15.133:0/1898170867 conn(0x7f7c6c060d10 msgr2=0x7f7c6c061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:00.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c71d32700 1 -- 172.21.15.133:0/1898170867 shutdown_connections 2021-01-03T13:08:00.109 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c71d32700 1 -- 172.21.15.133:0/1898170867 wait complete. 2021-01-03T13:08:00.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.099+0000 7f7c71d32700 1 Processor -- start 2021-01-03T13:08:00.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c71d32700 1 -- start start 2021-01-03T13:08:00.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c71d32700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c6c062450 0x7f7c6c130650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:00.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c71d32700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c6c0adc10 0x7f7c6c12fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:00.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c71d32700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c6c0b3190 0x7f7c6c153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:00.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c71d32700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c064d20 con 0x7f7c6c062450 2021-01-03T13:08:00.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c71d32700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c064f50 con 0x7f7c6c0b3190 2021-01-03T13:08:00.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c71d32700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c0651f0 con 0x7f7c6c0adc10 2021-01-03T13:08:00.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c72f94700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c6c0b3190 0x7f7c6c153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:00.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c72f94700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c6c0b3190 0x7f7c6c153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40806/0 (socket says 172.21.15.133:40806) 2021-01-03T13:08:00.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c72f94700 1 -- 172.21.15.133:0/2053732082 learned_addr learned my addr 172.21.15.133:0/2053732082 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:00.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c71531700 1 --2- 172.21.15.133:0/2053732082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c6c062450 0x7f7c6c130650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:00.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c70d30700 1 --2- 172.21.15.133:0/2053732082 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c6c0adc10 0x7f7c6c12fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:00.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c72f94700 1 -- 172.21.15.133:0/2053732082 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c6c0adc10 msgr2=0x7f7c6c12fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.114 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c72f94700 1 --2- 172.21.15.133:0/2053732082 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c6c0adc10 0x7f7c6c12fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c72f94700 1 -- 172.21.15.133:0/2053732082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c6c062450 msgr2=0x7f7c6c130650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c72f94700 1 --2- 172.21.15.133:0/2053732082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c6c062450 0x7f7c6c130650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.115 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c72f94700 1 -- 172.21.15.133:0/2053732082 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c065490 con 0x7f7c6c0b3190 2021-01-03T13:08:00.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c72f94700 1 --2- 172.21.15.133:0/2053732082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c6c0b3190 0x7f7c6c153210 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f7c64001450 tx=0x7f7c64007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:00.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c61ffb700 1 -- 172.21.15.133:0/2053732082 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c64005d60 con 0x7f7c6c0b3190 2021-01-03T13:08:00.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c61ffb700 1 -- 172.21.15.133:0/2053732082 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c64007110 con 0x7f7c6c0b3190 2021-01-03T13:08:00.116 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c71d32700 1 -- 172.21.15.133:0/2053732082 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6c12fef0 con 0x7f7c6c0b3190 2021-01-03T13:08:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c61ffb700 1 -- 172.21.15.133:0/2053732082 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c64007470 con 0x7f7c6c0b3190 2021-01-03T13:08:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c71d32700 1 -- 172.21.15.133:0/2053732082 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6c128730 con 0x7f7c6c0b3190 2021-01-03T13:08:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.103+0000 7f7c61ffb700 1 -- 172.21.15.133:0/2053732082 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7c640075d0 con 0x7f7c6c0b3190 2021-01-03T13:08:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.107+0000 7f7c71d32700 1 -- 172.21.15.133:0/2053732082 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6c065650 con 0x7f7c6c0b3190 2021-01-03T13:08:00.117 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.107+0000 7f7c61ffb700 1 --2- 172.21.15.133:0/2053732082 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7c4c0554d0 0x7f7c4c057990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:00.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.107+0000 7f7c61ffb700 1 -- 172.21.15.133:0/2053732082 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7c64070360 con 0x7f7c6c0b3190 2021-01-03T13:08:00.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.107+0000 7f7c71531700 1 --2- 172.21.15.133:0/2053732082 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7c4c0554d0 0x7f7c4c057990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:00.118 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.107+0000 7f7c71531700 1 --2- 172.21.15.133:0/2053732082 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7c4c0554d0 0x7f7c4c057990 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f7c68019000 tx=0x7f7c68015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:00.119 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.111+0000 7f7c61ffb700 1 -- 172.21.15.133:0/2053732082 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7c640465c0 con 0x7f7c6c0b3190 2021-01-03T13:08:00.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.299+0000 7f7c71d32700 1 -- 172.21.15.133:0/2053732082 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7c6c057300 con 0x7f7c6c0b3190 2021-01-03T13:08:00.311 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.307+0000 7f7c61ffb700 1 -- 172.21.15.133:0/2053732082 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v33) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7c64049be0 con 0x7f7c6c0b3190 2021-01-03T13:08:00.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.311+0000 7f7c71d32700 1 -- 172.21.15.133:0/2053732082 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7c4c0554d0 msgr2=0x7f7c4c057990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.315 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.311+0000 7f7c71d32700 1 --2- 172.21.15.133:0/2053732082 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7c4c0554d0 0x7f7c4c057990 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f7c68019000 tx=0x7f7c68015000).stop 2021-01-03T13:08:00.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.311+0000 7f7c71d32700 1 -- 172.21.15.133:0/2053732082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c6c0b3190 msgr2=0x7f7c6c153210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.311+0000 7f7c71d32700 1 --2- 172.21.15.133:0/2053732082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c6c0b3190 0x7f7c6c153210 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f7c64001450 tx=0x7f7c64007dd0).stop 2021-01-03T13:08:00.316 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.311+0000 7f7c71d32700 1 -- 172.21.15.133:0/2053732082 shutdown_connections 2021-01-03T13:08:00.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.311+0000 7f7c71d32700 1 --2- 172.21.15.133:0/2053732082 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7c4c0554d0 0x7f7c4c057990 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.311+0000 7f7c71d32700 1 --2- 172.21.15.133:0/2053732082 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c6c062450 0x7f7c6c130650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.311+0000 7f7c71d32700 1 --2- 172.21.15.133:0/2053732082 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c6c0b3190 0x7f7c6c153210 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.311+0000 7f7c71d32700 1 --2- 172.21.15.133:0/2053732082 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7c6c0adc10 0x7f7c6c12fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.311+0000 7f7c71d32700 1 -- 172.21.15.133:0/2053732082 >> 172.21.15.133:0/2053732082 conn(0x7f7c6c060d10 msgr2=0x7f7c6c0b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:00.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.311+0000 7f7c71d32700 1 -- 172.21.15.133:0/2053732082 shutdown_connections 2021-01-03T13:08:00.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.311+0000 7f7c71d32700 1 -- 172.21.15.133:0/2053732082 wait complete. 2021-01-03T13:08:00.319 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2021-01-03T13:08:00.332 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2021-01-03T13:08:00.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.447+0000 7fd4c518c700 1 Processor -- start 2021-01-03T13:08:00.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.447+0000 7fd4c518c700 1 -- start start 2021-01-03T13:08:00.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.447+0000 7fd4c518c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd4c00adc10 0x7fd4c0067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:00.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.447+0000 7fd4c518c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd4c0062450 0x7fd4c00b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:00.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.447+0000 7fd4c518c700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c00adff0 con 0x7fd4c00b3190 2021-01-03T13:08:00.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.447+0000 7fd4c518c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c00b1930 con 0x7fd4c0062450 2021-01-03T13:08:00.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.447+0000 7fd4c518c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c005fb80 con 0x7fd4c00adc10 2021-01-03T13:08:00.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4c498b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd4c00adc10 0x7fd4c0067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:00.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4c498b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd4c00adc10 0x7fd4c0067cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40812/0 (socket says 172.21.15.133:40812) 2021-01-03T13:08:00.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4c498b700 1 -- 172.21.15.133:0/1876066767 learned_addr learned my addr 172.21.15.133:0/1876066767 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4bffff700 1 --2- 172.21.15.133:0/1876066767 >> v2:172.21.15.16:3300/0 conn(0x7fd4c0062450 0x7fd4c00b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4c498b700 1 -- 172.21.15.133:0/1876066767 >> v2:172.21.15.16:3300/0 conn(0x7fd4c0062450 msgr2=0x7fd4c00b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4c498b700 1 --2- 172.21.15.133:0/1876066767 >> v2:172.21.15.16:3300/0 conn(0x7fd4c0062450 0x7fd4c00b2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4c498b700 1 -- 172.21.15.133:0/1876066767 >> v1:172.21.15.16:6789/0 conn(0x7fd4c00b3190 legacy=0x7fd4c0025140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4c498b700 1 -- 172.21.15.133:0/1876066767 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c005fed0 con 0x7fd4c00adc10 2021-01-03T13:08:00.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4c498b700 1 --2- 172.21.15.133:0/1876066767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4c00adc10 0x7fd4c0067cb0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7fd4b00032b0 tx=0x7fd4b0009270).ready entity=mon.1 client_cookie=5ca9abfd9c10172 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:00.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4bf7fe700 1 -- 172.21.15.133:0/1876066767 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4b0009e60 con 0x7fd4c00adc10 2021-01-03T13:08:00.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4bf7fe700 1 -- 172.21.15.133:0/1876066767 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b000bc00 con 0x7fd4c00adc10 2021-01-03T13:08:00.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4bf7fe700 1 -- 172.21.15.133:0/1876066767 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4b000bd70 con 0x7fd4c00adc10 2021-01-03T13:08:00.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4c518c700 1 -- 172.21.15.133:0/1876066767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4c00adc10 msgr2=0x7fd4c0067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4c518c700 1 --2- 172.21.15.133:0/1876066767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4c00adc10 0x7fd4c0067cb0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7fd4b00032b0 tx=0x7fd4b0009270).stop 2021-01-03T13:08:00.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4c518c700 1 -- 172.21.15.133:0/1876066767 shutdown_connections 2021-01-03T13:08:00.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4c518c700 1 --2- 172.21.15.133:0/1876066767 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4c00adc10 0x7fd4c0067cb0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4c518c700 1 --2- 172.21.15.133:0/1876066767 >> v2:172.21.15.16:3300/0 conn(0x7fd4c0062450 0x7fd4c00b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4c518c700 1 -- 172.21.15.133:0/1876066767 >> 172.21.15.133:0/1876066767 conn(0x7fd4c0060d10 msgr2=0x7fd4c0061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:00.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4c518c700 1 -- 172.21.15.133:0/1876066767 shutdown_connections 2021-01-03T13:08:00.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.451+0000 7fd4c518c700 1 -- 172.21.15.133:0/1876066767 wait complete. 2021-01-03T13:08:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c518c700 1 Processor -- start 2021-01-03T13:08:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c518c700 1 -- start start 2021-01-03T13:08:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c518c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4c0062450 0x7fd4c01143a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c518c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd4c00adc10 0x7fd4c0151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:00.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c518c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4c00b3190 0x7fd4c01119b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:00.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c518c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0067780 con 0x7fd4c00b3190 2021-01-03T13:08:00.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c518c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0152630 con 0x7fd4c0062450 2021-01-03T13:08:00.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c518c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c0070c90 con 0x7fd4c00adc10 2021-01-03T13:08:00.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c498b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4c0062450 0x7fd4c01143a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:00.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c498b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4c0062450 0x7fd4c01143a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40818/0 (socket says 172.21.15.133:40818) 2021-01-03T13:08:00.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c498b700 1 -- 172.21.15.133:0/869295804 learned_addr learned my addr 172.21.15.133:0/869295804 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:00.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c63ee700 1 --2- 172.21.15.133:0/869295804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4c00b3190 0x7fd4c01119b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:00.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4bffff700 1 --2- 172.21.15.133:0/869295804 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd4c00adc10 0x7fd4c0151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:00.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c498b700 1 -- 172.21.15.133:0/869295804 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd4c00adc10 msgr2=0x7fd4c0151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c498b700 1 --2- 172.21.15.133:0/869295804 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd4c00adc10 0x7fd4c0151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c498b700 1 -- 172.21.15.133:0/869295804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4c00b3190 msgr2=0x7fd4c01119b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c498b700 1 --2- 172.21.15.133:0/869295804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4c00b3190 0x7fd4c01119b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c498b700 1 -- 172.21.15.133:0/869295804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c0151bb0 con 0x7fd4c0062450 2021-01-03T13:08:00.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c63ee700 1 --2- 172.21.15.133:0/869295804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4c00b3190 0x7fd4c01119b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:08:00.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c498b700 1 --2- 172.21.15.133:0/869295804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4c0062450 0x7fd4c01143a0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7fd4c01534f0 tx=0x7fd4b0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:00.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4bd7fa700 1 -- 172.21.15.133:0/869295804 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4b00105b0 con 0x7fd4c0062450 2021-01-03T13:08:00.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4c518c700 1 -- 172.21.15.133:0/869295804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c0151e50 con 0x7fd4c0062450 2021-01-03T13:08:00.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4bd7fa700 1 -- 172.21.15.133:0/869295804 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b0010710 con 0x7fd4c0062450 2021-01-03T13:08:00.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.459+0000 7fd4c518c700 1 -- 172.21.15.133:0/869295804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c0152390 con 0x7fd4c0062450 2021-01-03T13:08:00.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.455+0000 7fd4bd7fa700 1 -- 172.21.15.133:0/869295804 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4b0010a70 con 0x7fd4c0062450 2021-01-03T13:08:00.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.459+0000 7fd4c518c700 1 -- 172.21.15.133:0/869295804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c0057300 con 0x7fd4c0062450 2021-01-03T13:08:00.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.459+0000 7fd4bd7fa700 1 -- 172.21.15.133:0/869295804 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd4b000f070 con 0x7fd4c0062450 2021-01-03T13:08:00.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.459+0000 7fd4bd7fa700 1 --2- 172.21.15.133:0/869295804 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd4a40554d0 0x7fd4a4057990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:00.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.459+0000 7fd4bd7fa700 1 -- 172.21.15.133:0/869295804 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd4b006f770 con 0x7fd4c0062450 2021-01-03T13:08:00.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.459+0000 7fd4bffff700 1 --2- 172.21.15.133:0/869295804 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd4a40554d0 0x7fd4a4057990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:00.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.459+0000 7fd4bffff700 1 --2- 172.21.15.133:0/869295804 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd4a40554d0 0x7fd4a4057990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fd4a800b000 tx=0x7fd4a8006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:00.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.467+0000 7fd4bd7fa700 1 -- 172.21.15.133:0/869295804 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd4b0045970 con 0x7fd4c0062450 2021-01-03T13:08:00.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.659+0000 7fd4c518c700 1 -- 172.21.15.133:0/869295804 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd4c01517f0 con 0x7fd4c0062450 2021-01-03T13:08:00.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.667+0000 7fd4bd7fa700 1 -- 172.21.15.133:0/869295804 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v34) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd4b00150e0 con 0x7fd4c0062450 2021-01-03T13:08:00.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.667+0000 7fd4c518c700 1 -- 172.21.15.133:0/869295804 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd4a40554d0 msgr2=0x7fd4a4057990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.667+0000 7fd4c518c700 1 --2- 172.21.15.133:0/869295804 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd4a40554d0 0x7fd4a4057990 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fd4a800b000 tx=0x7fd4a8006dc0).stop 2021-01-03T13:08:00.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.667+0000 7fd4c518c700 1 -- 172.21.15.133:0/869295804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4c0062450 msgr2=0x7fd4c01143a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.667+0000 7fd4c518c700 1 --2- 172.21.15.133:0/869295804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4c0062450 0x7fd4c01143a0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7fd4c01534f0 tx=0x7fd4b0016000).stop 2021-01-03T13:08:00.671 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.667+0000 7fd4c518c700 1 -- 172.21.15.133:0/869295804 shutdown_connections 2021-01-03T13:08:00.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.667+0000 7fd4c518c700 1 --2- 172.21.15.133:0/869295804 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd4a40554d0 0x7fd4a4057990 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.667+0000 7fd4c518c700 1 --2- 172.21.15.133:0/869295804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd4c00b3190 0x7fd4c01119b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.667+0000 7fd4c518c700 1 --2- 172.21.15.133:0/869295804 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4c0062450 0x7fd4c01143a0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.667+0000 7fd4c518c700 1 --2- 172.21.15.133:0/869295804 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd4c00adc10 0x7fd4c0151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.672 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.667+0000 7fd4c518c700 1 -- 172.21.15.133:0/869295804 >> 172.21.15.133:0/869295804 conn(0x7fd4c0060d10 msgr2=0x7fd4c00b54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:00.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.667+0000 7fd4c518c700 1 -- 172.21.15.133:0/869295804 shutdown_connections 2021-01-03T13:08:00.673 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.667+0000 7fd4c518c700 1 -- 172.21.15.133:0/869295804 wait complete. 2021-01-03T13:08:00.673 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.1 2021-01-03T13:08:00.685 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:08:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.791+0000 7febef5ec700 1 Processor -- start 2021-01-03T13:08:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.791+0000 7febef5ec700 1 -- start start 2021-01-03T13:08:00.795 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.791+0000 7febef5ec700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febe80b3d80 0x7febe80b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.791+0000 7febef5ec700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe809aec0 con 0x7febe80ac5c0 2021-01-03T13:08:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.791+0000 7febef5ec700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe809b160 con 0x7febe80b35a0 2021-01-03T13:08:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.791+0000 7febef5ec700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe81440f0 con 0x7febe80b3d80 2021-01-03T13:08:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.791+0000 7febecb87700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7febe80b35a0 0x7febe8144830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33630/0 (socket says 172.21.15.133:33630) 2021-01-03T13:08:00.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.791+0000 7febecb87700 1 -- 172.21.15.133:0/604859476 learned_addr learned my addr 172.21.15.133:0/604859476 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:08:00.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.791+0000 7febed388700 1 --2- 172.21.15.133:0/604859476 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febe80b3d80 0x7febe80b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:00.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.791+0000 7febdbfff700 1 -- 172.21.15.133:0/604859476 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768148527 0 0) 0x7febe809b160 con 0x7febe80b35a0 2021-01-03T13:08:00.797 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.791+0000 7febdbfff700 1 -- 172.21.15.133:0/604859476 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febcc003230 con 0x7febe80b35a0 2021-01-03T13:08:00.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febed388700 1 -- 172.21.15.133:0/604859476 >> v1:172.21.15.133:6789/0 conn(0x7febe80b35a0 legacy=0x7febe8144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febdbfff700 1 -- 172.21.15.133:0/604859476 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083853458 0 0) 0x7febe809aec0 con 0x7febe80ac5c0 2021-01-03T13:08:00.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febed388700 1 -- 172.21.15.133:0/604859476 >> v1:172.21.15.16:6789/0 conn(0x7febe80ac5c0 legacy=0x7febe80b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.799 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febed388700 1 -- 172.21.15.133:0/604859476 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe8144390 con 0x7febe80b3d80 2021-01-03T13:08:00.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febed388700 1 --2- 172.21.15.133:0/604859476 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febe80b3d80 0x7febe80b4160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7febe8140b50 tx=0x7febe00091a0).ready entity=mon.2 client_cookie=c7027fb7ce18f9c server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:00.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febdbfff700 1 -- 172.21.15.133:0/604859476 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febe000b9b0 con 0x7febe80b3d80 2021-01-03T13:08:00.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febdbfff700 1 -- 172.21.15.133:0/604859476 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe000bb10 con 0x7febe80b3d80 2021-01-03T13:08:00.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febdbfff700 1 -- 172.21.15.133:0/604859476 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febe000bc80 con 0x7febe80b3d80 2021-01-03T13:08:00.800 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febef5ec700 1 -- 172.21.15.133:0/604859476 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febe80b3d80 msgr2=0x7febe80b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febef5ec700 1 --2- 172.21.15.133:0/604859476 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febe80b3d80 0x7febe80b4160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7febe8140b50 tx=0x7febe00091a0).stop 2021-01-03T13:08:00.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febef5ec700 1 -- 172.21.15.133:0/604859476 shutdown_connections 2021-01-03T13:08:00.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febef5ec700 1 --2- 172.21.15.133:0/604859476 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febe80b3d80 0x7febe80b4160 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.801 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febef5ec700 1 -- 172.21.15.133:0/604859476 >> 172.21.15.133:0/604859476 conn(0x7febe805bdf0 msgr2=0x7febe805c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febef5ec700 1 -- 172.21.15.133:0/604859476 shutdown_connections 2021-01-03T13:08:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febef5ec700 1 -- 172.21.15.133:0/604859476 wait complete. 2021-01-03T13:08:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febef5ec700 1 Processor -- start 2021-01-03T13:08:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febef5ec700 1 -- start start 2021-01-03T13:08:00.804 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febef5ec700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febe80ac5c0 0x7febe8147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:00.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febef5ec700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febe80b35a0 0x7febe80b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:00.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febef5ec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febe80b3d80 0x7febe813d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:00.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febef5ec700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe80b74b0 con 0x7febe80b35a0 2021-01-03T13:08:00.805 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febef5ec700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe8066170 con 0x7febe80b3d80 2021-01-03T13:08:00.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.795+0000 7febef5ec700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe8067770 con 0x7febe80ac5c0 2021-01-03T13:08:00.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febedb89700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febe80b3d80 0x7febe813d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:00.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febedb89700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febe80b3d80 0x7febe813d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40836/0 (socket says 172.21.15.133:40836) 2021-01-03T13:08:00.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febedb89700 1 -- 172.21.15.133:0/4105170838 learned_addr learned my addr 172.21.15.133:0/4105170838 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:00.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febed388700 1 --2- 172.21.15.133:0/4105170838 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febe80ac5c0 0x7febe8147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:00.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febecb87700 1 --2- 172.21.15.133:0/4105170838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febe80b35a0 0x7febe80b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:00.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febedb89700 1 -- 172.21.15.133:0/4105170838 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febe80ac5c0 msgr2=0x7febe8147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febedb89700 1 --2- 172.21.15.133:0/4105170838 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febe80ac5c0 0x7febe8147130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febedb89700 1 -- 172.21.15.133:0/4105170838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febe80b35a0 msgr2=0x7febe80b78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febedb89700 1 --2- 172.21.15.133:0/4105170838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febe80b35a0 0x7febe80b78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febedb89700 1 -- 172.21.15.133:0/4105170838 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe80b6780 con 0x7febe80b3d80 2021-01-03T13:08:00.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febecb87700 1 --2- 172.21.15.133:0/4105170838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febe80b35a0 0x7febe80b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:08:00.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febedb89700 1 --2- 172.21.15.133:0/4105170838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febe80b3d80 0x7febe813d800 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7febe8066b90 tx=0x7febdc0079b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:00.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febdaffd700 1 -- 172.21.15.133:0/4105170838 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febdc00e4a0 con 0x7febe80b3d80 2021-01-03T13:08:00.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febdaffd700 1 -- 172.21.15.133:0/4105170838 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc00e600 con 0x7febe80b3d80 2021-01-03T13:08:00.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febef5ec700 1 -- 172.21.15.133:0/4105170838 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe80b6a20 con 0x7febe80b3d80 2021-01-03T13:08:00.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febdaffd700 1 -- 172.21.15.133:0/4105170838 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febdc00e960 con 0x7febe80b3d80 2021-01-03T13:08:00.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febef5ec700 1 -- 172.21.15.133:0/4105170838 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe8147d00 con 0x7febe80b3d80 2021-01-03T13:08:00.809 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febef5ec700 1 -- 172.21.15.133:0/4105170838 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe8057300 con 0x7febe80b3d80 2021-01-03T13:08:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febdaffd700 1 -- 172.21.15.133:0/4105170838 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7febdc010030 con 0x7febe80b3d80 2021-01-03T13:08:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febdaffd700 1 --2- 172.21.15.133:0/4105170838 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febc40554e0 0x7febc40579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febdaffd700 1 -- 172.21.15.133:0/4105170838 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7febdc06ddd0 con 0x7febe80b3d80 2021-01-03T13:08:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.799+0000 7febed388700 1 --2- 172.21.15.133:0/4105170838 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febc40554e0 0x7febc40579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.803+0000 7febed388700 1 --2- 172.21.15.133:0/4105170838 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febc40554e0 0x7febc40579a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7febe001a000 tx=0x7febe0016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:00.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.807+0000 7febdaffd700 1 -- 172.21.15.133:0/4105170838 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7febdc0440d0 con 0x7febe80b3d80 2021-01-03T13:08:00.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.987+0000 7febef5ec700 1 -- 172.21.15.133:0/4105170838 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febe8064d40 con 0x7febe80b3d80 2021-01-03T13:08:00.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.991+0000 7febdaffd700 1 -- 172.21.15.133:0/4105170838 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+2501 (secure 0 0 0) 0x7febdc0476f0 con 0x7febe80b3d80 2021-01-03T13:08:00.992 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:08:00.993 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":79,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/1043050023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1043050023},{"type":"v1","addr":"172.21.15.16:6833","nonce":1043050023}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76},{"gid":8488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1327300036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1327300036},{"type":"v1","addr":"172.21.15.133:6835","nonce":1327300036}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:57.630488+0000","modified":"2021-01-03T13:07:59.321927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8494":{"gid":8494,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/3193569550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3193569550},{"type":"v1","addr":"172.21.15.133:6837","nonce":3193569550}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-01-03T13:08:00.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.991+0000 7febef5ec700 1 -- 172.21.15.133:0/4105170838 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febc40554e0 msgr2=0x7febc40579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.991+0000 7febef5ec700 1 --2- 172.21.15.133:0/4105170838 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febc40554e0 0x7febc40579a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7febe001a000 tx=0x7febe0016000).stop 2021-01-03T13:08:00.994 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.991+0000 7febef5ec700 1 -- 172.21.15.133:0/4105170838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febe80b3d80 msgr2=0x7febe813d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:00.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.991+0000 7febef5ec700 1 --2- 172.21.15.133:0/4105170838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febe80b3d80 0x7febe813d800 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7febe8066b90 tx=0x7febdc0079b0).stop 2021-01-03T13:08:00.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.991+0000 7febef5ec700 1 -- 172.21.15.133:0/4105170838 shutdown_connections 2021-01-03T13:08:00.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.991+0000 7febef5ec700 1 --2- 172.21.15.133:0/4105170838 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7febc40554e0 0x7febc40579a0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.991+0000 7febef5ec700 1 --2- 172.21.15.133:0/4105170838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febe80b3d80 0x7febe813d800 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.991+0000 7febef5ec700 1 --2- 172.21.15.133:0/4105170838 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7febe80ac5c0 0x7febe8147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.991+0000 7febef5ec700 1 --2- 172.21.15.133:0/4105170838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febe80b35a0 0x7febe80b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:00.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.991+0000 7febef5ec700 1 -- 172.21.15.133:0/4105170838 >> 172.21.15.133:0/4105170838 conn(0x7febe805bdf0 msgr2=0x7febe80b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:00.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.991+0000 7febef5ec700 1 -- 172.21.15.133:0/4105170838 shutdown_connections 2021-01-03T13:08:00.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:00.991+0000 7febef5ec700 1 -- 172.21.15.133:0/4105170838 wait complete. 2021-01-03T13:08:00.997 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 79 2021-01-03T13:08:01.308 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:07:57.630488+0000', 'modified': '2021-01-03T13:07:59.321927+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8494}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8494': {'gid': 8494, 'name': 'a', 'rank': 0, 'incarnation': 77, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/3193569550', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 3193569550}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 3193569550}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:08:01.308 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:08:01.309 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-01-03T13:08:01.448 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":8494,"want_state":"up:active","state":"up:active","rank_uptime":3.802306711,"mdsmap_epoch":79,"osdmap_epoch":162,"osdmap_epoch_barrier":161,"uptime":8.1561970349999999} 2021-01-03T13:08:01.449 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 8494, "mdsmap_epoch": 79, "osdmap_epoch": 162, "osdmap_epoch_barrier": 161, "rank_uptime": 3.802306711, "state": "up:active", "uptime": 8.156197035, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:08:01.449 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:08:01.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.559+0000 7fe00c837700 1 Processor -- start 2021-01-03T13:08:01.561 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.559+0000 7fe00c837700 1 -- start start 2021-01-03T13:08:01.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.559+0000 7fe00c837700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe0080afdc0 0x7fe00813c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:01.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.559+0000 7fe00c837700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0080b16d0 0x7fe00813ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:01.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.559+0000 7fe00c837700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0080b7130 con 0x7fe0080b6d50 2021-01-03T13:08:01.564 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.559+0000 7fe00c837700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0080b0690 con 0x7fe0080b16d0 2021-01-03T13:08:01.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.559+0000 7fe00c837700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0080b0dc0 con 0x7fe0080afdc0 2021-01-03T13:08:01.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.559+0000 7fe006d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0080b16d0 0x7fe00813ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:01.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.559+0000 7fe006d9d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0080b16d0 0x7fe00813ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40844/0 (socket says 172.21.15.133:40844) 2021-01-03T13:08:01.565 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.559+0000 7fe006d9d700 1 -- 172.21.15.133:0/1734767738 learned_addr learned my addr 172.21.15.133:0/1734767738 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:01.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.559+0000 7fe005d9b700 1 --2- 172.21.15.133:0/1734767738 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe0080afdc0 0x7fe00813c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:01.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.559+0000 7fe006d9d700 1 -- 172.21.15.133:0/1734767738 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe0080afdc0 msgr2=0x7fe00813c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:01.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.559+0000 7fe006d9d700 1 --2- 172.21.15.133:0/1734767738 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe0080afdc0 0x7fe00813c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:01.566 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.559+0000 7fe006d9d700 1 -- 172.21.15.133:0/1734767738 >> v1:172.21.15.16:6789/0 conn(0x7fe0080b6d50 legacy=0x7fe0080af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:01.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.559+0000 7fe006d9d700 1 -- 172.21.15.133:0/1734767738 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0080b1060 con 0x7fe0080b16d0 2021-01-03T13:08:01.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.559+0000 7fe005d9b700 1 --2- 172.21.15.133:0/1734767738 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe0080afdc0 0x7fe00813c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:08:01.567 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.563+0000 7fe006d9d700 1 --2- 172.21.15.133:0/1734767738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0080b16d0 0x7fe00813ccb0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7fe0000032b0 tx=0x7fe000009270).ready entity=mon.1 client_cookie=ebef1b478e18c74 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:01.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.563+0000 7fe00559a700 1 -- 172.21.15.133:0/1734767738 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe00000bc00 con 0x7fe0080b16d0 2021-01-03T13:08:01.570 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.563+0000 7fe00559a700 1 -- 172.21.15.133:0/1734767738 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00000bd60 con 0x7fe0080b16d0 2021-01-03T13:08:01.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.563+0000 7fe00559a700 1 -- 172.21.15.133:0/1734767738 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe000011400 con 0x7fe0080b16d0 2021-01-03T13:08:01.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.563+0000 7fe00c837700 1 -- 172.21.15.133:0/1734767738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0080b16d0 msgr2=0x7fe00813ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:01.571 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.563+0000 7fe00c837700 1 --2- 172.21.15.133:0/1734767738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0080b16d0 0x7fe00813ccb0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7fe0000032b0 tx=0x7fe000009270).stop 2021-01-03T13:08:01.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.563+0000 7fe00c837700 1 -- 172.21.15.133:0/1734767738 shutdown_connections 2021-01-03T13:08:01.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.563+0000 7fe00c837700 1 --2- 172.21.15.133:0/1734767738 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0080b16d0 0x7fe00813ccb0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:01.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.563+0000 7fe00c837700 1 --2- 172.21.15.133:0/1734767738 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe0080afdc0 0x7fe00813c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:01.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.563+0000 7fe00c837700 1 -- 172.21.15.133:0/1734767738 >> 172.21.15.133:0/1734767738 conn(0x7fe0080622f0 msgr2=0x7fe0080b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:01.572 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.563+0000 7fe00c837700 1 -- 172.21.15.133:0/1734767738 shutdown_connections 2021-01-03T13:08:01.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.563+0000 7fe00c837700 1 -- 172.21.15.133:0/1734767738 wait complete. 2021-01-03T13:08:01.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.563+0000 7fe00c837700 1 Processor -- start 2021-01-03T13:08:01.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.563+0000 7fe00c837700 1 -- start start 2021-01-03T13:08:01.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe00c837700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe0080afdc0 0x7fe008145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:01.573 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe00c837700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0080b16d0 0x7fe008138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe00c837700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0080b6d50 0x7fe0080b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe00c837700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe008143bb0 con 0x7fe0080b16d0 2021-01-03T13:08:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe00c837700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe008139290 con 0x7fe0080b6d50 2021-01-03T13:08:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe00c837700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00805cbb0 con 0x7fe0080afdc0 2021-01-03T13:08:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe006d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0080b6d50 0x7fe0080b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:01.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe00659c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe0080afdc0 0x7fe008145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:01.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe006d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0080b6d50 0x7fe0080b4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40850/0 (socket says 172.21.15.133:40850) 2021-01-03T13:08:01.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe006d9d700 1 -- 172.21.15.133:0/2348978484 learned_addr learned my addr 172.21.15.133:0/2348978484 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:01.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe005d9b700 1 --2- 172.21.15.133:0/2348978484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0080b16d0 0x7fe008138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:01.575 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe006d9d700 1 -- 172.21.15.133:0/2348978484 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe0080afdc0 msgr2=0x7fe008145fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:01.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe006d9d700 1 --2- 172.21.15.133:0/2348978484 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe0080afdc0 0x7fe008145fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:01.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe006d9d700 1 -- 172.21.15.133:0/2348978484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0080b16d0 msgr2=0x7fe008138da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:01.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe006d9d700 1 --2- 172.21.15.133:0/2348978484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0080b16d0 0x7fe008138da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:01.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe006d9d700 1 -- 172.21.15.133:0/2348978484 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0081452a0 con 0x7fe0080b6d50 2021-01-03T13:08:01.576 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe006d9d700 1 --2- 172.21.15.133:0/2348978484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0080b6d50 0x7fe0080b4440 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7fe0000032b0 tx=0x7fe000016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:01.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fdfff7fe700 1 -- 172.21.15.133:0/2348978484 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe00001e610 con 0x7fe0080b6d50 2021-01-03T13:08:01.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fdfff7fe700 1 -- 172.21.15.133:0/2348978484 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00001e770 con 0x7fe0080b6d50 2021-01-03T13:08:01.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe00c837700 1 -- 172.21.15.133:0/2348978484 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe008145540 con 0x7fe0080b6d50 2021-01-03T13:08:01.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fdfff7fe700 1 -- 172.21.15.133:0/2348978484 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe00001ead0 con 0x7fe0080b6d50 2021-01-03T13:08:01.577 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe00c837700 1 -- 172.21.15.133:0/2348978484 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0080b4930 con 0x7fe0080b6d50 2021-01-03T13:08:01.578 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fdfff7fe700 1 -- 172.21.15.133:0/2348978484 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fe00000f070 con 0x7fe0080b6d50 2021-01-03T13:08:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe00c837700 1 -- 172.21.15.133:0/2348978484 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe008057300 con 0x7fe0080b6d50 2021-01-03T13:08:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fdfff7fe700 1 --2- 172.21.15.133:0/2348978484 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdfe4055440 0x7fdfe4057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fdfff7fe700 1 -- 172.21.15.133:0/2348978484 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe00006f610 con 0x7fe0080b6d50 2021-01-03T13:08:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.567+0000 7fe00659c700 1 --2- 172.21.15.133:0/2348978484 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdfe4055440 0x7fdfe4057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:01.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.571+0000 7fe00659c700 1 --2- 172.21.15.133:0/2348978484 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdfe4055440 0x7fdfe4057900 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fdff800d000 tx=0x7fdff8007b60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:01.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.575+0000 7fdfff7fe700 1 -- 172.21.15.133:0/2348978484 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe000045910 con 0x7fe0080b6d50 2021-01-03T13:08:01.718 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.715+0000 7fe00c837700 1 -- 172.21.15.133:0/2348978484 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe00813e180 con 0x7fe0080b6d50 2021-01-03T13:08:01.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.719+0000 7fdfff7fe700 1 -- 172.21.15.133:0/2348978484 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16100 (secure 0 0 0) 0x7fe000015090 con 0x7fe0080b6d50 2021-01-03T13:08:01.721 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:08:01.721 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":162,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:59.636463+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:07:56.170759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-01-03T13:07:56.676733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:08:01.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.719+0000 7fe00c837700 1 -- 172.21.15.133:0/2348978484 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdfe4055440 msgr2=0x7fdfe4057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:01.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.719+0000 7fe00c837700 1 --2- 172.21.15.133:0/2348978484 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdfe4055440 0x7fdfe4057900 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fdff800d000 tx=0x7fdff8007b60).stop 2021-01-03T13:08:01.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.719+0000 7fe00c837700 1 -- 172.21.15.133:0/2348978484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0080b6d50 msgr2=0x7fe0080b4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:01.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.719+0000 7fe00c837700 1 --2- 172.21.15.133:0/2348978484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0080b6d50 0x7fe0080b4440 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7fe0000032b0 tx=0x7fe000016000).stop 2021-01-03T13:08:01.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.719+0000 7fe00c837700 1 -- 172.21.15.133:0/2348978484 shutdown_connections 2021-01-03T13:08:01.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.719+0000 7fe00c837700 1 --2- 172.21.15.133:0/2348978484 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fdfe4055440 0x7fdfe4057900 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:01.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.719+0000 7fe00c837700 1 --2- 172.21.15.133:0/2348978484 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0080b6d50 0x7fe0080b4440 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:01.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.719+0000 7fe00c837700 1 --2- 172.21.15.133:0/2348978484 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fe0080afdc0 0x7fe008145fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:01.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.719+0000 7fe00c837700 1 --2- 172.21.15.133:0/2348978484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe0080b16d0 0x7fe008138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:01.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.719+0000 7fe00c837700 1 -- 172.21.15.133:0/2348978484 >> 172.21.15.133:0/2348978484 conn(0x7fe0080622f0 msgr2=0x7fe0080ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:01.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.719+0000 7fe00c837700 1 -- 172.21.15.133:0/2348978484 shutdown_connections 2021-01-03T13:08:01.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.719+0000 7fe00c837700 1 -- 172.21.15.133:0/2348978484 wait complete. 2021-01-03T13:08:01.735 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:07:56.170759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:07:56.676733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '162', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:08:01.735 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:08:01.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f0571a3d700 1 Processor -- start 2021-01-03T13:08:01.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f0571a3d700 1 -- start start 2021-01-03T13:08:01.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f0571a3d700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f056c0b5c00 0x7f056c1477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:01.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f0571a3d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056c0b0c10 con 0x7f056c0b5260 2021-01-03T13:08:01.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f0571a3d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056c0b5640 con 0x7f056c1442a0 2021-01-03T13:08:01.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f0571a3d700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c144e00 con 0x7f056c0b5c00 2021-01-03T13:08:01.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f057123c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f056c1442a0 0x7f056c1446f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33656/0 (socket says 172.21.15.133:33656) 2021-01-03T13:08:01.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f057123c700 1 -- 172.21.15.133:0/1117730958 learned_addr learned my addr 172.21.15.133:0/1117730958 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:08:01.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056bfff700 1 --2- 172.21.15.133:0/1117730958 >> v2:172.21.15.16:3300/0 conn(0x7f056c0b5c00 0x7f056c1477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:01.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 -- 172.21.15.133:0/1117730958 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711976825 0 0) 0x7f056c0b5640 con 0x7f056c1442a0 2021-01-03T13:08:01.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 -- 172.21.15.133:0/1117730958 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0550003230 con 0x7f056c1442a0 2021-01-03T13:08:01.860 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 -- 172.21.15.133:0/1117730958 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349330006 0 0) 0x7f056c0b0c10 con 0x7f056c0b5260 2021-01-03T13:08:01.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 -- 172.21.15.133:0/1117730958 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f056c0b5640 con 0x7f056c0b5260 2021-01-03T13:08:01.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 -- 172.21.15.133:0/1117730958 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 20624319 0 0) 0x7f0550003230 con 0x7f056c1442a0 2021-01-03T13:08:01.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 -- 172.21.15.133:0/1117730958 >> v2:172.21.15.16:3300/0 conn(0x7f056c0b5c00 msgr2=0x7f056c1477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:01.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 --2- 172.21.15.133:0/1117730958 >> v2:172.21.15.16:3300/0 conn(0x7f056c0b5c00 0x7f056c1477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:01.861 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 -- 172.21.15.133:0/1117730958 >> v1:172.21.15.16:6789/0 conn(0x7f056c0b5260 legacy=0x7f056c1470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:01.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 -- 172.21.15.133:0/1117730958 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c09a4f0 con 0x7f056c1442a0 2021-01-03T13:08:01.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 -- 172.21.15.133:0/1117730958 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f0564001a90 con 0x7f056c1442a0 2021-01-03T13:08:01.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 -- 172.21.15.133:0/1117730958 >> v1:172.21.15.133:6789/0 conn(0x7f056c1442a0 legacy=0x7f056c1446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:01.862 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 --2- 172.21.15.133:0/1117730958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05500038b0 0x7f0550003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:01.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 --2- 172.21.15.133:0/1117730958 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05500044d0 0x7f0550004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:01.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 --2- 172.21.15.133:0/1117730958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0550004e40 0x7f055000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:01.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 -- 172.21.15.133:0/1117730958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0550005370 con 0x7f0550004e40 2021-01-03T13:08:01.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 -- 172.21.15.133:0/1117730958 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055000bc10 con 0x7f05500038b0 2021-01-03T13:08:01.863 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 -- 172.21.15.133:0/1117730958 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055000bdd0 con 0x7f05500044d0 2021-01-03T13:08:01.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f0570a3b700 1 --2- 172.21.15.133:0/1117730958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05500038b0 0x7f0550003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:01.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056bfff700 1 --2- 172.21.15.133:0/1117730958 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05500044d0 0x7f0550004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:01.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f0570a3b700 1 -- 172.21.15.133:0/1117730958 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05500044d0 msgr2=0x7f0550004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:01.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f0570a3b700 1 --2- 172.21.15.133:0/1117730958 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f05500044d0 0x7f0550004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:01.864 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f0570a3b700 1 -- 172.21.15.133:0/1117730958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0550004e40 msgr2=0x7f055000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:01.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f057123c700 1 --2- 172.21.15.133:0/1117730958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0550004e40 0x7f055000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:01.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f0570a3b700 1 --2- 172.21.15.133:0/1117730958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0550004e40 0x7f055000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:01.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f0570a3b700 1 -- 172.21.15.133:0/1117730958 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0550003230 con 0x7f05500038b0 2021-01-03T13:08:01.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f057123c700 1 --2- 172.21.15.133:0/1117730958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0550004e40 0x7f055000b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:08:01.865 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f057123c700 1 -- 172.21.15.133:0/1117730958 reap_dead start 2021-01-03T13:08:01.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f0570a3b700 1 --2- 172.21.15.133:0/1117730958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05500038b0 0x7f0550003cb0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f05600010d0 tx=0x7f0560007b60).ready entity=mon.1 client_cookie=6666c6fe318b30b4 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:01.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 -- 172.21.15.133:0/1117730958 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f056000c870 con 0x7f05500038b0 2021-01-03T13:08:01.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 -- 172.21.15.133:0/1117730958 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056000c9d0 con 0x7f05500038b0 2021-01-03T13:08:01.866 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f056b7fe700 1 -- 172.21.15.133:0/1117730958 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f056000cd30 con 0x7f05500038b0 2021-01-03T13:08:01.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f0571a3d700 1 -- 172.21.15.133:0/1117730958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05500038b0 msgr2=0x7f0550003cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:01.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.851+0000 7f0571a3d700 1 --2- 172.21.15.133:0/1117730958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05500038b0 0x7f0550003cb0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f05600010d0 tx=0x7f0560007b60).stop 2021-01-03T13:08:01.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0571a3d700 1 -- 172.21.15.133:0/1117730958 shutdown_connections 2021-01-03T13:08:01.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0571a3d700 1 --2- 172.21.15.133:0/1117730958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05500038b0 0x7f0550003cb0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:01.867 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0571a3d700 1 -- 172.21.15.133:0/1117730958 >> 172.21.15.133:0/1117730958 conn(0x7f056c05bdf0 msgr2=0x7f056c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:01.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0571a3d700 1 -- 172.21.15.133:0/1117730958 shutdown_connections 2021-01-03T13:08:01.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0571a3d700 1 -- 172.21.15.133:0/1117730958 wait complete. 2021-01-03T13:08:01.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0571a3d700 1 Processor -- start 2021-01-03T13:08:01.868 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0571a3d700 1 -- start start 2021-01-03T13:08:01.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0571a3d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05500038b0 0x7f056c067240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:01.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0571a3d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f056c144f50 0x7f056c0643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:01.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0571a3d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f056c155e10 0x7f056c1562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:01.871 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0571a3d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c143050 con 0x7f056c144f50 2021-01-03T13:08:01.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0571a3d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c063540 con 0x7f05500038b0 2021-01-03T13:08:01.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0570a3b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05500038b0 0x7f056c067240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:01.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0570a3b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05500038b0 0x7f056c067240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40866/0 (socket says 172.21.15.133:40866) 2021-01-03T13:08:01.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0570a3b700 1 -- 172.21.15.133:0/1914154902 learned_addr learned my addr 172.21.15.133:0/1914154902 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:01.872 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0571a3d700 1 -- 172.21.15.133:0/1914154902 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c065f20 con 0x7f056c155e10 2021-01-03T13:08:01.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f056bfff700 1 --2- 172.21.15.133:0/1914154902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f056c144f50 0x7f056c0643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:01.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f057123c700 1 --2- 172.21.15.133:0/1914154902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f056c155e10 0x7f056c1562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:01.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0570a3b700 1 -- 172.21.15.133:0/1914154902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f056c155e10 msgr2=0x7f056c1562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:01.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0570a3b700 1 --2- 172.21.15.133:0/1914154902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f056c155e10 0x7f056c1562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:01.873 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0570a3b700 1 -- 172.21.15.133:0/1914154902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f056c144f50 msgr2=0x7f056c0643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:01.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0570a3b700 1 --2- 172.21.15.133:0/1914154902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f056c144f50 0x7f056c0643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:01.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0570a3b700 1 -- 172.21.15.133:0/1914154902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c064e20 con 0x7f05500038b0 2021-01-03T13:08:01.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f057123c700 1 --2- 172.21.15.133:0/1914154902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f056c155e10 0x7f056c1562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:08:01.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.855+0000 7f0570a3b700 1 --2- 172.21.15.133:0/1914154902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05500038b0 0x7f056c067240 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f056c0af330 tx=0x7f0560016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:01.874 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.859+0000 7f0569ffb700 1 -- 172.21.15.133:0/1914154902 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0560007220 con 0x7f05500038b0 2021-01-03T13:08:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.859+0000 7f0569ffb700 1 -- 172.21.15.133:0/1914154902 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0560007380 con 0x7f05500038b0 2021-01-03T13:08:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.859+0000 7f0571a3d700 1 -- 172.21.15.133:0/1914154902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c0650c0 con 0x7f05500038b0 2021-01-03T13:08:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.859+0000 7f0569ffb700 1 -- 172.21.15.133:0/1914154902 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0560013bf0 con 0x7f05500038b0 2021-01-03T13:08:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.859+0000 7f0571a3d700 1 -- 172.21.15.133:0/1914154902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c063ad0 con 0x7f05500038b0 2021-01-03T13:08:01.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.859+0000 7f0571a3d700 1 -- 172.21.15.133:0/1914154902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056c057300 con 0x7f05500038b0 2021-01-03T13:08:01.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.859+0000 7f0569ffb700 1 -- 172.21.15.133:0/1914154902 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0560024030 con 0x7f05500038b0 2021-01-03T13:08:01.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.859+0000 7f0569ffb700 1 --2- 172.21.15.133:0/1914154902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f05540553b0 0x7f0554057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:01.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.859+0000 7f0569ffb700 1 -- 172.21.15.133:0/1914154902 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f056006ed90 con 0x7f05500038b0 2021-01-03T13:08:01.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.859+0000 7f056bfff700 1 --2- 172.21.15.133:0/1914154902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f05540553b0 0x7f0554057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:01.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.859+0000 7f056bfff700 1 --2- 172.21.15.133:0/1914154902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f05540553b0 0x7f0554057870 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f0558008000 tx=0x7f0558008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:01.877 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:01.867+0000 7f0569ffb700 1 -- 172.21.15.133:0/1914154902 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0560044ff0 con 0x7f05500038b0 2021-01-03T13:08:02.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.007+0000 7f0571a3d700 1 -- 172.21.15.133:0/1914154902 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f056c057300 con 0x7f05500038b0 2021-01-03T13:08:02.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.007+0000 7f0569ffb700 1 -- 172.21.15.133:0/1914154902 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v162) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0560022070 con 0x7f05500038b0 2021-01-03T13:08:02.012 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:08:02.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.011+0000 7f0571a3d700 1 -- 172.21.15.133:0/1914154902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f05540553b0 msgr2=0x7f0554057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.011+0000 7f0571a3d700 1 --2- 172.21.15.133:0/1914154902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f05540553b0 0x7f0554057870 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f0558008000 tx=0x7f0558008040).stop 2021-01-03T13:08:02.014 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.011+0000 7f0571a3d700 1 -- 172.21.15.133:0/1914154902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05500038b0 msgr2=0x7f056c067240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.011+0000 7f0571a3d700 1 --2- 172.21.15.133:0/1914154902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05500038b0 0x7f056c067240 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f056c0af330 tx=0x7f0560016000).stop 2021-01-03T13:08:02.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.011+0000 7f0571a3d700 1 -- 172.21.15.133:0/1914154902 shutdown_connections 2021-01-03T13:08:02.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.011+0000 7f0571a3d700 1 --2- 172.21.15.133:0/1914154902 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f05540553b0 0x7f0554057870 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.011+0000 7f0571a3d700 1 --2- 172.21.15.133:0/1914154902 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f056c155e10 0x7f056c1562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.011+0000 7f0571a3d700 1 --2- 172.21.15.133:0/1914154902 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05500038b0 0x7f056c067240 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.011+0000 7f0571a3d700 1 --2- 172.21.15.133:0/1914154902 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f056c144f50 0x7f056c0643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.011+0000 7f0571a3d700 1 -- 172.21.15.133:0/1914154902 >> 172.21.15.133:0/1914154902 conn(0x7f056c05bdf0 msgr2=0x7f056c05f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:02.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.011+0000 7f0571a3d700 1 -- 172.21.15.133:0/1914154902 shutdown_connections 2021-01-03T13:08:02.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.011+0000 7f0571a3d700 1 -- 172.21.15.133:0/1914154902 wait complete. 2021-01-03T13:08:02.025 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:08:02.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e82f0700 1 Processor -- start 2021-01-03T13:08:02.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e82f0700 1 -- start start 2021-01-03T13:08:02.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e82f0700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f96e0140410 0x7f96e0146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e82f0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f96e00b0470 0x7f96e005bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e82f0700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e005cf20 con 0x7f96e01407f0 2021-01-03T13:08:02.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e82f0700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e00b02d0 con 0x7f96e0140410 2021-01-03T13:08:02.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e82f0700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0146390 con 0x7f96e00b0470 2021-01-03T13:08:02.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e688d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f96e00b0470 0x7f96e005bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e588b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f96e01407f0 0x7f96e0142dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:40636/0 (socket says 172.21.15.133:40636) 2021-01-03T13:08:02.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e588b700 1 -- 172.21.15.133:0/3738917927 learned_addr learned my addr 172.21.15.133:0/3738917927 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:08:02.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e608c700 1 --2- 172.21.15.133:0/3738917927 >> v2:172.21.15.16:3300/0 conn(0x7f96e0140410 0x7f96e0146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e688d700 1 -- 172.21.15.133:0/3738917927 >> v2:172.21.15.16:3300/0 conn(0x7f96e0140410 msgr2=0x7f96e0146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:02.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e688d700 1 --2- 172.21.15.133:0/3738917927 >> v2:172.21.15.16:3300/0 conn(0x7f96e0140410 0x7f96e0146cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e688d700 1 -- 172.21.15.133:0/3738917927 >> v1:172.21.15.16:6789/0 conn(0x7f96e01407f0 legacy=0x7f96e0142dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e688d700 1 -- 172.21.15.133:0/3738917927 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e0146580 con 0x7f96e00b0470 2021-01-03T13:08:02.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e688d700 1 --2- 172.21.15.133:0/3738917927 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f96e00b0470 0x7f96e005bdf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f96d80032b0 tx=0x7f96d80091a0).ready entity=mon.2 client_cookie=9916afdf5c909dae server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:02.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e508a700 1 -- 172.21.15.133:0/3738917927 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d800b9a0 con 0x7f96e00b0470 2021-01-03T13:08:02.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e508a700 1 -- 172.21.15.133:0/3738917927 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d800bb00 con 0x7f96e00b0470 2021-01-03T13:08:02.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e508a700 1 -- 172.21.15.133:0/3738917927 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d800bc70 con 0x7f96e00b0470 2021-01-03T13:08:02.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e82f0700 1 -- 172.21.15.133:0/3738917927 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f96e00b0470 msgr2=0x7f96e005bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.150 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.143+0000 7f96e82f0700 1 --2- 172.21.15.133:0/3738917927 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f96e00b0470 0x7f96e005bdf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f96d80032b0 tx=0x7f96d80091a0).stop 2021-01-03T13:08:02.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e82f0700 1 -- 172.21.15.133:0/3738917927 shutdown_connections 2021-01-03T13:08:02.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e82f0700 1 --2- 172.21.15.133:0/3738917927 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f96e00b0470 0x7f96e005bdf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e82f0700 1 --2- 172.21.15.133:0/3738917927 >> v2:172.21.15.16:3300/0 conn(0x7f96e0140410 0x7f96e0146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e82f0700 1 -- 172.21.15.133:0/3738917927 >> 172.21.15.133:0/3738917927 conn(0x7f96e00b95d0 msgr2=0x7f96e00b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:02.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e82f0700 1 -- 172.21.15.133:0/3738917927 shutdown_connections 2021-01-03T13:08:02.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e82f0700 1 -- 172.21.15.133:0/3738917927 wait complete. 2021-01-03T13:08:02.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e82f0700 1 Processor -- start 2021-01-03T13:08:02.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e82f0700 1 -- start start 2021-01-03T13:08:02.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e82f0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96e00b0470 0x7f96e0149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e82f0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f96e0140410 0x7f96e0151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e82f0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e01407f0 0x7f96e0152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e82f0700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0155220 con 0x7f96e00b0470 2021-01-03T13:08:02.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e82f0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01560d0 con 0x7f96e01407f0 2021-01-03T13:08:02.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e82f0700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0155450 con 0x7f96e0140410 2021-01-03T13:08:02.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e688d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e01407f0 0x7f96e0152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e688d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e01407f0 0x7f96e0152160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40884/0 (socket says 172.21.15.133:40884) 2021-01-03T13:08:02.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e688d700 1 -- 172.21.15.133:0/1197309947 learned_addr learned my addr 172.21.15.133:0/1197309947 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:02.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96e588b700 1 --2- 172.21.15.133:0/1197309947 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f96e0140410 0x7f96e0151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.147+0000 7f96e608c700 1 --2- 172.21.15.133:0/1197309947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96e00b0470 0x7f96e0149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.156 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96e688d700 1 -- 172.21.15.133:0/1197309947 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f96e0140410 msgr2=0x7f96e0151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96e688d700 1 --2- 172.21.15.133:0/1197309947 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f96e0140410 0x7f96e0151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96e688d700 1 -- 172.21.15.133:0/1197309947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96e00b0470 msgr2=0x7f96e0149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96e688d700 1 --2- 172.21.15.133:0/1197309947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96e00b0470 0x7f96e0149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96e688d700 1 -- 172.21.15.133:0/1197309947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e01556f0 con 0x7f96e01407f0 2021-01-03T13:08:02.157 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96e688d700 1 --2- 172.21.15.133:0/1197309947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e01407f0 0x7f96e0152160 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f96d80032b0 tx=0x7f96d8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:02.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96cf7fe700 1 -- 172.21.15.133:0/1197309947 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d800bc70 con 0x7f96e01407f0 2021-01-03T13:08:02.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96cf7fe700 1 -- 172.21.15.133:0/1197309947 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d801f5e0 con 0x7f96e01407f0 2021-01-03T13:08:02.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96cf7fe700 1 -- 172.21.15.133:0/1197309947 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d801f940 con 0x7f96e01407f0 2021-01-03T13:08:02.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96e82f0700 1 -- 172.21.15.133:0/1197309947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e0155990 con 0x7f96e01407f0 2021-01-03T13:08:02.158 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96e82f0700 1 -- 172.21.15.133:0/1197309947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e0142220 con 0x7f96e01407f0 2021-01-03T13:08:02.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96bf7fe700 1 -- 172.21.15.133:0/1197309947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e0057300 con 0x7f96e01407f0 2021-01-03T13:08:02.159 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96cf7fe700 1 -- 172.21.15.133:0/1197309947 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f96d8026030 con 0x7f96e01407f0 2021-01-03T13:08:02.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96cf7fe700 1 --2- 172.21.15.133:0/1197309947 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f96c0055350 0x7f96c0057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96cf7fe700 1 -- 172.21.15.133:0/1197309947 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f96d806ecc0 con 0x7f96e01407f0 2021-01-03T13:08:02.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96e608c700 1 --2- 172.21.15.133:0/1197309947 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f96c0055350 0x7f96c0057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.151+0000 7f96e608c700 1 --2- 172.21.15.133:0/1197309947 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f96c0055350 0x7f96c0057810 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f96dc00b000 tx=0x7f96dc008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:02.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.159+0000 7f96cf7fe700 1 -- 172.21.15.133:0/1197309947 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f96d8044fc0 con 0x7f96e01407f0 2021-01-03T13:08:02.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.299+0000 7f96bf7fe700 1 -- 172.21.15.133:0/1197309947 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f96e0155e00 con 0x7f96e01407f0 2021-01-03T13:08:02.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.299+0000 7f96cf7fe700 1 -- 172.21.15.133:0/1197309947 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v162) v1 ==== 92+0+10 (secure 0 0 0) 0x7f96d80240a0 con 0x7f96e01407f0 2021-01-03T13:08:02.302 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:08:02.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.299+0000 7f96bf7fe700 1 -- 172.21.15.133:0/1197309947 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f96c0055350 msgr2=0x7f96c0057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.299+0000 7f96bf7fe700 1 --2- 172.21.15.133:0/1197309947 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f96c0055350 0x7f96c0057810 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f96dc00b000 tx=0x7f96dc008040).stop 2021-01-03T13:08:02.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.299+0000 7f96bf7fe700 1 -- 172.21.15.133:0/1197309947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e01407f0 msgr2=0x7f96e0152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.299+0000 7f96bf7fe700 1 --2- 172.21.15.133:0/1197309947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e01407f0 0x7f96e0152160 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f96d80032b0 tx=0x7f96d8016000).stop 2021-01-03T13:08:02.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.299+0000 7f96bf7fe700 1 -- 172.21.15.133:0/1197309947 shutdown_connections 2021-01-03T13:08:02.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.299+0000 7f96bf7fe700 1 --2- 172.21.15.133:0/1197309947 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f96c0055350 0x7f96c0057810 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.299+0000 7f96bf7fe700 1 --2- 172.21.15.133:0/1197309947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f96e00b0470 0x7f96e0149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.299+0000 7f96bf7fe700 1 --2- 172.21.15.133:0/1197309947 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f96e01407f0 0x7f96e0152160 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.299+0000 7f96bf7fe700 1 --2- 172.21.15.133:0/1197309947 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f96e0140410 0x7f96e0151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.299+0000 7f96bf7fe700 1 -- 172.21.15.133:0/1197309947 >> 172.21.15.133:0/1197309947 conn(0x7f96e00b95d0 msgr2=0x7f96e00b4430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:02.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.303+0000 7f96bf7fe700 1 -- 172.21.15.133:0/1197309947 shutdown_connections 2021-01-03T13:08:02.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.303+0000 7f96bf7fe700 1 -- 172.21.15.133:0/1197309947 wait complete. 2021-01-03T13:08:02.316 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:08:02.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.427+0000 7f55bf59e700 1 Processor -- start 2021-01-03T13:08:02.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.427+0000 7f55bf59e700 1 -- start start 2021-01-03T13:08:02.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55bf59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f55c00b2460 0x7f55c00a9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55bf59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f55c00b0a60 0x7f55c00ad490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55bf59e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c00b16a0 con 0x7f55c00ad980 2021-01-03T13:08:02.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55bf59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c00b2840 con 0x7f55c00b0a60 2021-01-03T13:08:02.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55bf59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c00aeae0 con 0x7f55c00b2460 2021-01-03T13:08:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55be59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f55c00b2460 0x7f55c00a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55be59c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f55c00b2460 0x7f55c00a9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40892/0 (socket says 172.21.15.133:40892) 2021-01-03T13:08:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55be59c700 1 -- 172.21.15.133:0/2543067645 learned_addr learned my addr 172.21.15.133:0/2543067645 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:02.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55bdd9b700 1 --2- 172.21.15.133:0/2543067645 >> v2:172.21.15.16:3300/0 conn(0x7f55c00b0a60 0x7f55c00ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55be59c700 1 -- 172.21.15.133:0/2543067645 >> v2:172.21.15.16:3300/0 conn(0x7f55c00b0a60 msgr2=0x7f55c00ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55be59c700 1 --2- 172.21.15.133:0/2543067645 >> v2:172.21.15.16:3300/0 conn(0x7f55c00b0a60 0x7f55c00ad490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55be59c700 1 -- 172.21.15.133:0/2543067645 >> v1:172.21.15.16:6789/0 conn(0x7f55c00ad980 legacy=0x7f55c00a8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55be59c700 1 -- 172.21.15.133:0/2543067645 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c00b1160 con 0x7f55c00b2460 2021-01-03T13:08:02.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55be59c700 1 --2- 172.21.15.133:0/2543067645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55c00b2460 0x7f55c00a9750 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f55b4002f30 tx=0x7f55b4006e80).ready entity=mon.1 client_cookie=efec74bada19374b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:02.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55bd59a700 1 -- 172.21.15.133:0/2543067645 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55b40097f0 con 0x7f55c00b2460 2021-01-03T13:08:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55bd59a700 1 -- 172.21.15.133:0/2543067645 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b4009950 con 0x7f55c00b2460 2021-01-03T13:08:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55bd59a700 1 -- 172.21.15.133:0/2543067645 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55b4009cb0 con 0x7f55c00b2460 2021-01-03T13:08:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55bf59e700 1 -- 172.21.15.133:0/2543067645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55c00b2460 msgr2=0x7f55c00a9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55bf59e700 1 --2- 172.21.15.133:0/2543067645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55c00b2460 0x7f55c00a9750 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f55b4002f30 tx=0x7f55b4006e80).stop 2021-01-03T13:08:02.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55bf59e700 1 -- 172.21.15.133:0/2543067645 shutdown_connections 2021-01-03T13:08:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55bf59e700 1 --2- 172.21.15.133:0/2543067645 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55c00b2460 0x7f55c00a9750 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55bf59e700 1 --2- 172.21.15.133:0/2543067645 >> v2:172.21.15.16:3300/0 conn(0x7f55c00b0a60 0x7f55c00ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55bf59e700 1 -- 172.21.15.133:0/2543067645 >> 172.21.15.133:0/2543067645 conn(0x7f55c006b050 msgr2=0x7f55c0060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55bf59e700 1 -- 172.21.15.133:0/2543067645 shutdown_connections 2021-01-03T13:08:02.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.431+0000 7f55bf59e700 1 -- 172.21.15.133:0/2543067645 wait complete. 2021-01-03T13:08:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55bf59e700 1 Processor -- start 2021-01-03T13:08:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55bf59e700 1 -- start start 2021-01-03T13:08:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55bf59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55c00ad980 0x7f55c0143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55bf59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55c00b0a60 0x7f55c013fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55bf59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55c00b2460 0x7f55c0155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55bf59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c0141fa0 con 0x7f55c00b2460 2021-01-03T13:08:02.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55bf59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c0142240 con 0x7f55c00ad980 2021-01-03T13:08:02.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55bf59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c0140790 con 0x7f55c00b0a60 2021-01-03T13:08:02.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55be59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55c00ad980 0x7f55c0143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55be59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55c00ad980 0x7f55c0143ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40894/0 (socket says 172.21.15.133:40894) 2021-01-03T13:08:02.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55be59c700 1 -- 172.21.15.133:0/4288897248 learned_addr learned my addr 172.21.15.133:0/4288897248 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:02.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55bdd9b700 1 --2- 172.21.15.133:0/4288897248 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55c00b0a60 0x7f55c013fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55bed9d700 1 --2- 172.21.15.133:0/4288897248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55c00b2460 0x7f55c0155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55be59c700 1 -- 172.21.15.133:0/4288897248 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55c00b0a60 msgr2=0x7f55c013fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55be59c700 1 --2- 172.21.15.133:0/4288897248 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55c00b0a60 0x7f55c013fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55be59c700 1 -- 172.21.15.133:0/4288897248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55c00b2460 msgr2=0x7f55c0155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55be59c700 1 --2- 172.21.15.133:0/4288897248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55c00b2460 0x7f55c0155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55be59c700 1 -- 172.21.15.133:0/4288897248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c0144490 con 0x7f55c00ad980 2021-01-03T13:08:02.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55be59c700 1 --2- 172.21.15.133:0/4288897248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55c00ad980 0x7f55c0143ce0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f55b4002f30 tx=0x7f55b4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:02.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55af7fe700 1 -- 172.21.15.133:0/4288897248 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55b4006bb0 con 0x7f55c00ad980 2021-01-03T13:08:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55af7fe700 1 -- 172.21.15.133:0/4288897248 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b4009c50 con 0x7f55c00ad980 2021-01-03T13:08:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55bf59e700 1 -- 172.21.15.133:0/4288897248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c01424e0 con 0x7f55c00ad980 2021-01-03T13:08:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55af7fe700 1 -- 172.21.15.133:0/4288897248 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55b401e650 con 0x7f55c00ad980 2021-01-03T13:08:02.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.435+0000 7f55bf59e700 1 -- 172.21.15.133:0/4288897248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c013dea0 con 0x7f55c00ad980 2021-01-03T13:08:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.439+0000 7f55bf59e700 1 -- 172.21.15.133:0/4288897248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c0140950 con 0x7f55c00ad980 2021-01-03T13:08:02.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.439+0000 7f55af7fe700 1 -- 172.21.15.133:0/4288897248 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f55b4025030 con 0x7f55c00ad980 2021-01-03T13:08:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.439+0000 7f55af7fe700 1 --2- 172.21.15.133:0/4288897248 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f559c0553b0 0x7f559c057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.439+0000 7f55af7fe700 1 -- 172.21.15.133:0/4288897248 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f55b406f3e0 con 0x7f55c00ad980 2021-01-03T13:08:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.439+0000 7f55bdd9b700 1 --2- 172.21.15.133:0/4288897248 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f559c0553b0 0x7f559c057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.439+0000 7f55bdd9b700 1 --2- 172.21.15.133:0/4288897248 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f559c0553b0 0x7f559c057870 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f55b000b000 tx=0x7f55b0006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:02.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.447+0000 7f55af7fe700 1 -- 172.21.15.133:0/4288897248 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f55b4045640 con 0x7f55c00ad980 2021-01-03T13:08:02.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.583+0000 7f55bf59e700 1 -- 172.21.15.133:0/4288897248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f55c0057300 con 0x7f55c00ad980 2021-01-03T13:08:02.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.583+0000 7f55af7fe700 1 -- 172.21.15.133:0/4288897248 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v162) v1 ==== 104+0+10 (secure 0 0 0) 0x7f55b4048c60 con 0x7f55c00ad980 2021-01-03T13:08:02.588 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:08:02.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.587+0000 7f55bf59e700 1 -- 172.21.15.133:0/4288897248 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f559c0553b0 msgr2=0x7f559c057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.587+0000 7f55bf59e700 1 --2- 172.21.15.133:0/4288897248 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f559c0553b0 0x7f559c057870 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f55b000b000 tx=0x7f55b0006dc0).stop 2021-01-03T13:08:02.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.587+0000 7f55bf59e700 1 -- 172.21.15.133:0/4288897248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55c00ad980 msgr2=0x7f55c0143ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.587+0000 7f55bf59e700 1 --2- 172.21.15.133:0/4288897248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55c00ad980 0x7f55c0143ce0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f55b4002f30 tx=0x7f55b4015000).stop 2021-01-03T13:08:02.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.587+0000 7f55bf59e700 1 -- 172.21.15.133:0/4288897248 shutdown_connections 2021-01-03T13:08:02.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.587+0000 7f55bf59e700 1 --2- 172.21.15.133:0/4288897248 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f559c0553b0 0x7f559c057870 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.587+0000 7f55bf59e700 1 --2- 172.21.15.133:0/4288897248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55c00b2460 0x7f55c0155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.587+0000 7f55bf59e700 1 --2- 172.21.15.133:0/4288897248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55c00ad980 0x7f55c0143ce0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.587+0000 7f55bf59e700 1 --2- 172.21.15.133:0/4288897248 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f55c00b0a60 0x7f55c013fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.587+0000 7f55bf59e700 1 -- 172.21.15.133:0/4288897248 >> 172.21.15.133:0/4288897248 conn(0x7f55c006b050 msgr2=0x7f55c00b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:02.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.587+0000 7f55bf59e700 1 -- 172.21.15.133:0/4288897248 shutdown_connections 2021-01-03T13:08:02.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.587+0000 7f55bf59e700 1 -- 172.21.15.133:0/4288897248 wait complete. 2021-01-03T13:08:02.601 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:08:02.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.715+0000 7f45a96b0700 1 Processor -- start 2021-01-03T13:08:02.719 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.715+0000 7f45a96b0700 1 -- start start 2021-01-03T13:08:02.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a96b0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f45a40b6a10 0x7f45a40b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a96b0700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f45a40601f0 0x7f45a40ae640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a96b0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45a4060650 0x7f45a40aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a96b0700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a4147210 con 0x7f45a40601f0 2021-01-03T13:08:02.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a96b0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a41462f0 con 0x7f45a4060650 2021-01-03T13:08:02.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a96b0700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a4146590 con 0x7f45a40b6a10 2021-01-03T13:08:02.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45a4060650 0x7f45a40aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45a4060650 0x7f45a40aeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40906/0 (socket says 172.21.15.133:40906) 2021-01-03T13:08:02.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a37fe700 1 -- 172.21.15.133:0/124919379 learned_addr learned my addr 172.21.15.133:0/124919379 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:02.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a27fc700 1 --2- 172.21.15.133:0/124919379 >> v2:172.21.15.16:3300/0 conn(0x7f45a40601f0 0x7f45a40ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.723 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a2ffd700 1 --2- 172.21.15.133:0/124919379 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f45a40b6a10 0x7f45a40b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a37fe700 1 -- 172.21.15.133:0/124919379 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f45a40b6a10 msgr2=0x7f45a40b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:02.724 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a37fe700 1 --2- 172.21.15.133:0/124919379 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f45a40b6a10 0x7f45a40b6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a37fe700 1 -- 172.21.15.133:0/124919379 >> v2:172.21.15.16:3300/0 conn(0x7f45a40601f0 msgr2=0x7f45a40ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:02.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a37fe700 1 --2- 172.21.15.133:0/124919379 >> v2:172.21.15.16:3300/0 conn(0x7f45a40601f0 0x7f45a40ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a37fe700 1 -- 172.21.15.133:0/124919379 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a4146830 con 0x7f45a4060650 2021-01-03T13:08:02.725 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a37fe700 1 --2- 172.21.15.133:0/124919379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a4060650 0x7f45a40aeb30 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f459c0032b0 tx=0x7f459c009270).ready entity=mon.1 client_cookie=34f633624b76fb99 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:02.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a1ffb700 1 -- 172.21.15.133:0/124919379 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f459c009e60 con 0x7f45a4060650 2021-01-03T13:08:02.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a1ffb700 1 -- 172.21.15.133:0/124919379 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c00bb50 con 0x7f45a4060650 2021-01-03T13:08:02.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a1ffb700 1 -- 172.21.15.133:0/124919379 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f459c00bcc0 con 0x7f45a4060650 2021-01-03T13:08:02.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a96b0700 1 -- 172.21.15.133:0/124919379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a4060650 msgr2=0x7f45a40aeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.726 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a96b0700 1 --2- 172.21.15.133:0/124919379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a4060650 0x7f45a40aeb30 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f459c0032b0 tx=0x7f459c009270).stop 2021-01-03T13:08:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a96b0700 1 -- 172.21.15.133:0/124919379 shutdown_connections 2021-01-03T13:08:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a96b0700 1 --2- 172.21.15.133:0/124919379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a4060650 0x7f45a40aeb30 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a96b0700 1 --2- 172.21.15.133:0/124919379 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f45a40b6a10 0x7f45a40b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a96b0700 1 --2- 172.21.15.133:0/124919379 >> v2:172.21.15.16:3300/0 conn(0x7f45a40601f0 0x7f45a40ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.727 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a96b0700 1 -- 172.21.15.133:0/124919379 >> 172.21.15.133:0/124919379 conn(0x7f45a40622f0 msgr2=0x7f45a40b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:02.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a96b0700 1 -- 172.21.15.133:0/124919379 shutdown_connections 2021-01-03T13:08:02.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a96b0700 1 -- 172.21.15.133:0/124919379 wait complete. 2021-01-03T13:08:02.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a96b0700 1 Processor -- start 2021-01-03T13:08:02.728 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.719+0000 7f45a96b0700 1 -- start start 2021-01-03T13:08:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a96b0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a40601f0 0x7f45a413f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a96b0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45a4060650 0x7f45a41526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a96b0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f45a40b6a10 0x7f45a4152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a96b0700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a41400a0 con 0x7f45a4060650 2021-01-03T13:08:02.731 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a96b0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a40aefe0 con 0x7f45a40601f0 2021-01-03T13:08:02.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a96b0700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a40b0430 con 0x7f45a40b6a10 2021-01-03T13:08:02.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a40601f0 0x7f45a413f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a2ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a40601f0 0x7f45a413f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40908/0 (socket says 172.21.15.133:40908) 2021-01-03T13:08:02.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a2ffd700 1 -- 172.21.15.133:0/2408191115 learned_addr learned my addr 172.21.15.133:0/2408191115 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:02.732 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a37fe700 1 --2- 172.21.15.133:0/2408191115 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f45a40b6a10 0x7f45a4152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a27fc700 1 --2- 172.21.15.133:0/2408191115 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45a4060650 0x7f45a41526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a2ffd700 1 -- 172.21.15.133:0/2408191115 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f45a40b6a10 msgr2=0x7f45a4152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a2ffd700 1 --2- 172.21.15.133:0/2408191115 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f45a40b6a10 0x7f45a4152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a2ffd700 1 -- 172.21.15.133:0/2408191115 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45a4060650 msgr2=0x7f45a41526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.733 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a2ffd700 1 --2- 172.21.15.133:0/2408191115 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45a4060650 0x7f45a41526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a2ffd700 1 -- 172.21.15.133:0/2408191115 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a4151fd0 con 0x7f45a40601f0 2021-01-03T13:08:02.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a2ffd700 1 --2- 172.21.15.133:0/2408191115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a40601f0 0x7f45a413f860 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f458c00c000 tx=0x7f458c006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:02.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f459bfff700 1 -- 172.21.15.133:0/2408191115 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f458c00ca10 con 0x7f45a40601f0 2021-01-03T13:08:02.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f459bfff700 1 -- 172.21.15.133:0/2408191115 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c00cb70 con 0x7f45a40601f0 2021-01-03T13:08:02.734 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a96b0700 1 -- 172.21.15.133:0/2408191115 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a413fd50 con 0x7f45a40601f0 2021-01-03T13:08:02.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f459bfff700 1 -- 172.21.15.133:0/2408191115 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f458c0123f0 con 0x7f45a40601f0 2021-01-03T13:08:02.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.723+0000 7f45a96b0700 1 -- 172.21.15.133:0/2408191115 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a4139e90 con 0x7f45a40601f0 2021-01-03T13:08:02.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.727+0000 7f45a96b0700 1 -- 172.21.15.133:0/2408191115 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a413fee0 con 0x7f45a40601f0 2021-01-03T13:08:02.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.727+0000 7f459bfff700 1 -- 172.21.15.133:0/2408191115 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f458c012550 con 0x7f45a40601f0 2021-01-03T13:08:02.735 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.727+0000 7f459bfff700 1 --2- 172.21.15.133:0/2408191115 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4588055440 0x7f4588057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:02.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.727+0000 7f459bfff700 1 -- 172.21.15.133:0/2408191115 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f458c06e2e0 con 0x7f45a40601f0 2021-01-03T13:08:02.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.727+0000 7f45a27fc700 1 --2- 172.21.15.133:0/2408191115 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4588055440 0x7f4588057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:02.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.727+0000 7f45a27fc700 1 --2- 172.21.15.133:0/2408191115 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4588055440 0x7f4588057900 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f459400b000 tx=0x7f4594006dc0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:02.736 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.731+0000 7f459bfff700 1 -- 172.21.15.133:0/2408191115 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f458c0444e0 con 0x7f45a40601f0 2021-01-03T13:08:02.875 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.871+0000 7f45a96b0700 1 -- 172.21.15.133:0/2408191115 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45a4057300 con 0x7f45a40601f0 2021-01-03T13:08:02.876 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.875+0000 7f459bfff700 1 -- 172.21.15.133:0/2408191115 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v162) v1 ==== 100+0+10 (secure 0 0 0) 0x7f458c047b00 con 0x7f45a40601f0 2021-01-03T13:08:02.876 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:08:02.879 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.875+0000 7f45a96b0700 1 -- 172.21.15.133:0/2408191115 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4588055440 msgr2=0x7f4588057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.875+0000 7f45a96b0700 1 --2- 172.21.15.133:0/2408191115 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4588055440 0x7f4588057900 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f459400b000 tx=0x7f4594006dc0).stop 2021-01-03T13:08:02.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.875+0000 7f45a96b0700 1 -- 172.21.15.133:0/2408191115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a40601f0 msgr2=0x7f45a413f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:02.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.875+0000 7f45a96b0700 1 --2- 172.21.15.133:0/2408191115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a40601f0 0x7f45a413f860 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f458c00c000 tx=0x7f458c006dc0).stop 2021-01-03T13:08:02.880 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.875+0000 7f45a96b0700 1 -- 172.21.15.133:0/2408191115 shutdown_connections 2021-01-03T13:08:02.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.875+0000 7f45a96b0700 1 --2- 172.21.15.133:0/2408191115 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4588055440 0x7f4588057900 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.875+0000 7f45a96b0700 1 --2- 172.21.15.133:0/2408191115 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f45a40b6a10 0x7f45a4152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.875+0000 7f45a96b0700 1 --2- 172.21.15.133:0/2408191115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45a40601f0 0x7f45a413f860 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.875+0000 7f45a96b0700 1 --2- 172.21.15.133:0/2408191115 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f45a4060650 0x7f45a41526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:02.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.875+0000 7f45a96b0700 1 -- 172.21.15.133:0/2408191115 >> 172.21.15.133:0/2408191115 conn(0x7f45a40622f0 msgr2=0x7f45a41454c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.875+0000 7f45a96b0700 1 -- 172.21.15.133:0/2408191115 shutdown_connections 2021-01-03T13:08:02.882 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.875+0000 7f45a96b0700 1 -- 172.21.15.133:0/2408191115 wait complete. 2021-01-03T13:08:02.894 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:08:02.894 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:08:03.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.999+0000 7f226cadc700 1 Processor -- start 2021-01-03T13:08:03.003 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.999+0000 7f226cadc700 1 -- start start 2021-01-03T13:08:03.004 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.999+0000 7f226cadc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f22680b5a70 0x7f226813e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:03.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.999+0000 7f226cadc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22680b1010 0x7f22680ad050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:03.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.999+0000 7f226cadc700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22681441d0 con 0x7f22680b1580 2021-01-03T13:08:03.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.999+0000 7f226cadc700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22680b01f0 con 0x7f22680b5a70 2021-01-03T13:08:03.005 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:02.999+0000 7f226cadc700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22680b0490 con 0x7f22680b1010 2021-01-03T13:08:03.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226659c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f22680b5a70 0x7f226813e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:03.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f2266d9d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22680b1010 0x7f22680ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:03.006 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f2265d9b700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f22680b1580 0x7f22680ac940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:40676/0 (socket says 172.21.15.133:40676) 2021-01-03T13:08:03.007 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f2265d9b700 1 -- 172.21.15.133:0/3239626189 learned_addr learned my addr 172.21.15.133:0/3239626189 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:08:03.008 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226559a700 1 -- 172.21.15.133:0/3239626189 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578119766 0 0) 0x7f22681441d0 con 0x7f22680b1580 2021-01-03T13:08:03.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226559a700 1 -- 172.21.15.133:0/3239626189 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f224c003230 con 0x7f22680b1580 2021-01-03T13:08:03.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226659c700 1 -- 172.21.15.133:0/3239626189 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22680b1010 msgr2=0x7f22680ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:03.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226659c700 1 --2- 172.21.15.133:0/3239626189 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22680b1010 0x7f22680ad050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:03.009 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226659c700 1 -- 172.21.15.133:0/3239626189 >> v1:172.21.15.16:6789/0 conn(0x7f22680b1580 legacy=0x7f22680ac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:03.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226659c700 1 -- 172.21.15.133:0/3239626189 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22680b1ae0 con 0x7f22680b5a70 2021-01-03T13:08:03.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f2266d9d700 1 --2- 172.21.15.133:0/3239626189 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22680b1010 0x7f22680ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:08:03.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226659c700 1 --2- 172.21.15.133:0/3239626189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22680b5a70 0x7f226813e020 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f2258002f30 tx=0x7f2258006dc0).ready entity=mon.0 client_cookie=9b3369a0abec5648 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:03.010 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226559a700 1 -- 172.21.15.133:0/3239626189 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22580096a0 con 0x7f22680b5a70 2021-01-03T13:08:03.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226559a700 1 -- 172.21.15.133:0/3239626189 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2258009800 con 0x7f22680b5a70 2021-01-03T13:08:03.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226559a700 1 -- 172.21.15.133:0/3239626189 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2258009b60 con 0x7f22680b5a70 2021-01-03T13:08:03.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226cadc700 1 -- 172.21.15.133:0/3239626189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22680b5a70 msgr2=0x7f226813e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:03.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226cadc700 1 --2- 172.21.15.133:0/3239626189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22680b5a70 0x7f226813e020 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f2258002f30 tx=0x7f2258006dc0).stop 2021-01-03T13:08:03.011 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226cadc700 1 -- 172.21.15.133:0/3239626189 shutdown_connections 2021-01-03T13:08:03.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226cadc700 1 --2- 172.21.15.133:0/3239626189 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22680b1010 0x7f22680ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:03.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226cadc700 1 --2- 172.21.15.133:0/3239626189 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22680b5a70 0x7f226813e020 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:03.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226cadc700 1 -- 172.21.15.133:0/3239626189 >> 172.21.15.133:0/3239626189 conn(0x7f226805c8c0 msgr2=0x7f22680b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:03.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226cadc700 1 -- 172.21.15.133:0/3239626189 shutdown_connections 2021-01-03T13:08:03.012 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.003+0000 7f226cadc700 1 -- 172.21.15.133:0/3239626189 wait complete. 2021-01-03T13:08:03.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f226cadc700 1 Processor -- start 2021-01-03T13:08:03.013 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f226cadc700 1 -- start start 2021-01-03T13:08:03.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f226cadc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22680b1010 0x7f22681404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:03.015 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f226cadc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22680b1580 0x7f226813c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:03.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f226cadc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22680b5a70 0x7f2268140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:03.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f226cadc700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2268062990 con 0x7f22680b1010 2021-01-03T13:08:03.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f226cadc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2268062c30 con 0x7f22680b5a70 2021-01-03T13:08:03.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f226cadc700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2268062ed0 con 0x7f22680b1580 2021-01-03T13:08:03.016 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f2266d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22680b5a70 0x7f2268140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:03.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f2265d9b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22680b1580 0x7f226813c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:03.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f2266d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22680b5a70 0x7f2268140bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40926/0 (socket says 172.21.15.133:40926) 2021-01-03T13:08:03.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f226659c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22680b1010 0x7f22681404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:03.017 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f2266d9d700 1 -- 172.21.15.133:0/41133046 learned_addr learned my addr 172.21.15.133:0/41133046 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:03.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f2266d9d700 1 -- 172.21.15.133:0/41133046 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22680b1580 msgr2=0x7f226813c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:03.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f2266d9d700 1 --2- 172.21.15.133:0/41133046 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22680b1580 0x7f226813c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:03.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f2266d9d700 1 -- 172.21.15.133:0/41133046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22680b1010 msgr2=0x7f22681404c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:03.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f2266d9d700 1 --2- 172.21.15.133:0/41133046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22680b1010 0x7f22681404c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:03.018 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f2266d9d700 1 -- 172.21.15.133:0/41133046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2268063170 con 0x7f22680b5a70 2021-01-03T13:08:03.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f2265d9b700 1 --2- 172.21.15.133:0/41133046 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22680b1580 0x7f226813c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:08:03.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f2266d9d700 1 --2- 172.21.15.133:0/41133046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22680b5a70 0x7f2268140bd0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f226000c000 tx=0x7f22600091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:03.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f22577fe700 1 -- 172.21.15.133:0/41133046 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f226000cbd0 con 0x7f22680b5a70 2021-01-03T13:08:03.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f22577fe700 1 -- 172.21.15.133:0/41133046 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226000cd30 con 0x7f22680b5a70 2021-01-03T13:08:03.019 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f226cadc700 1 -- 172.21.15.133:0/41133046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2268064870 con 0x7f22680b5a70 2021-01-03T13:08:03.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f22577fe700 1 -- 172.21.15.133:0/41133046 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f226000cea0 con 0x7f22680b5a70 2021-01-03T13:08:03.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.007+0000 7f226cadc700 1 -- 172.21.15.133:0/41133046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2268064d70 con 0x7f22680b5a70 2021-01-03T13:08:03.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.011+0000 7f226cadc700 1 -- 172.21.15.133:0/41133046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2268057300 con 0x7f22680b5a70 2021-01-03T13:08:03.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.011+0000 7f22577fe700 1 -- 172.21.15.133:0/41133046 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2260022070 con 0x7f22680b5a70 2021-01-03T13:08:03.020 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.011+0000 7f22577fe700 1 --2- 172.21.15.133:0/41133046 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2244055470 0x7f2244057930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:03.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.011+0000 7f22577fe700 1 -- 172.21.15.133:0/41133046 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f226006e7b0 con 0x7f22680b5a70 2021-01-03T13:08:03.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.011+0000 7f226659c700 1 --2- 172.21.15.133:0/41133046 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2244055470 0x7f2244057930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:03.021 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.011+0000 7f226659c700 1 --2- 172.21.15.133:0/41133046 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2244055470 0x7f2244057930 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f225801b000 tx=0x7f2258015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:03.022 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.015+0000 7f22577fe700 1 -- 172.21.15.133:0/41133046 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2260044ab0 con 0x7f22680b5a70 2021-01-03T13:08:03.206 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.203+0000 7f226cadc700 1 -- 172.21.15.133:0/41133046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f226809b1e0 con 0x7f22680b5a70 2021-01-03T13:08:03.207 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.203+0000 7f22577fe700 1 -- 172.21.15.133:0/41133046 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+2501 (secure 0 0 0) 0x7f2260016070 con 0x7f22680b5a70 2021-01-03T13:08:03.208 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:08:03.208 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":79,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/1043050023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1043050023},{"type":"v1","addr":"172.21.15.16:6833","nonce":1043050023}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76},{"gid":8488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1327300036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1327300036},{"type":"v1","addr":"172.21.15.133:6835","nonce":1327300036}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:57.630488+0000","modified":"2021-01-03T13:07:59.321927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8494":{"gid":8494,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/3193569550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3193569550},{"type":"v1","addr":"172.21.15.133:6837","nonce":3193569550}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-01-03T13:08:03.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.207+0000 7f226cadc700 1 -- 172.21.15.133:0/41133046 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2244055470 msgr2=0x7f2244057930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:03.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.207+0000 7f226cadc700 1 --2- 172.21.15.133:0/41133046 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2244055470 0x7f2244057930 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f225801b000 tx=0x7f2258015000).stop 2021-01-03T13:08:03.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.207+0000 7f226cadc700 1 -- 172.21.15.133:0/41133046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22680b5a70 msgr2=0x7f2268140bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:03.210 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.207+0000 7f226cadc700 1 --2- 172.21.15.133:0/41133046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22680b5a70 0x7f2268140bd0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f226000c000 tx=0x7f22600091a0).stop 2021-01-03T13:08:03.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.207+0000 7f226cadc700 1 -- 172.21.15.133:0/41133046 shutdown_connections 2021-01-03T13:08:03.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.207+0000 7f226cadc700 1 --2- 172.21.15.133:0/41133046 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2244055470 0x7f2244057930 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:03.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.207+0000 7f226cadc700 1 --2- 172.21.15.133:0/41133046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22680b1010 0x7f22681404c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:03.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.207+0000 7f226cadc700 1 --2- 172.21.15.133:0/41133046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22680b5a70 0x7f2268140bd0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:03.211 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.207+0000 7f226cadc700 1 --2- 172.21.15.133:0/41133046 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f22680b1580 0x7f226813c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:03.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.207+0000 7f226cadc700 1 -- 172.21.15.133:0/41133046 >> 172.21.15.133:0/41133046 conn(0x7f226805c8c0 msgr2=0x7f22681391e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:03.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.207+0000 7f226cadc700 1 -- 172.21.15.133:0/41133046 shutdown_connections 2021-01-03T13:08:03.212 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:03.207+0000 7f226cadc700 1 -- 172.21.15.133:0/41133046 wait complete. 2021-01-03T13:08:03.213 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 79 2021-01-03T13:08:03.523 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:07:57.630488+0000', 'modified': '2021-01-03T13:07:59.321927+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8494}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8494': {'gid': 8494, 'name': 'a', 'rank': 0, 'incarnation': 77, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/3193569550', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 3193569550}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 3193569550}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:08:03.524 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:08:03.525 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-01-03T13:08:03.651 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":8494,"want_state":"up:active","state":"up:active","rank_uptime":6.0056088799999996,"mdsmap_epoch":79,"osdmap_epoch":162,"osdmap_epoch_barrier":161,"uptime":10.359489484999999} 2021-01-03T13:08:03.651 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 8494, "mdsmap_epoch": 79, "osdmap_epoch": 162, "osdmap_epoch_barrier": 161, "rank_uptime": 6.00560888, "state": "up:active", "uptime": 10.359489485, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:08:03.652 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:08:03.652 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2021-01-03T13:08:03.652 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi007.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2021-01-03T13:08:03.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:03.653 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:08:03.661 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:08:03.721 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:08:03.722 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:08:03.780 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:08:03.781 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:08:03.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:03.782 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:08:03.831 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:08:03.832 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:08:03.875 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:08:03.891 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:08:03.891 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:08:03.948 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:08:03.949 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:08:03.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:03.951 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:08:03.953 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12955]: starting ceph client2021-01-03T13:08:03.950+0000 7f28446b30c0 -1 init, newargv = 0x55646bef7280 newargc=9 2021-01-03T13:08:03.954 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr: 2021-01-03T13:08:03.964 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[12955]: starting fuse 2021-01-03T13:08:05.059 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2021-01-03T13:08:05.075 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:08:05.075 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:08:05.132 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:08:05.134 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:08:05.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:05.135 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2021-01-03T13:08:05.183 INFO:teuthology.orchestra.run.smithi007.stdout:50 2021-01-03T13:08:05.184 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:08:05.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:05.185 DEBUG:teuthology.orchestra.run.smithi007:> sudo python3 -c ' 2021-01-03T13:08:05.185 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2021-01-03T13:08:05.185 DEBUG:teuthology.orchestra.run.smithi007:> import re 2021-01-03T13:08:05.186 DEBUG:teuthology.orchestra.run.smithi007:> import os 2021-01-03T13:08:05.186 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2021-01-03T13:08:05.187 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:08:05.187 DEBUG:teuthology.orchestra.run.smithi007:> def find_socket(client_name): 2021-01-03T13:08:05.187 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2021-01-03T13:08:05.188 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2021-01-03T13:08:05.188 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:08:05.189 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2021-01-03T13:08:05.189 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2021-01-03T13:08:05.189 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2021-01-03T13:08:05.190 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2021-01-03T13:08:05.190 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:08:05.191 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2021-01-03T13:08:05.191 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:08:05.191 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:08:05.192 DEBUG:teuthology.orchestra.run.smithi007:> return f 2021-01-03T13:08:05.192 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:08:05.192 DEBUG:teuthology.orchestra.run.smithi007:> 2021-01-03T13:08:05.193 DEBUG:teuthology.orchestra.run.smithi007:> print(find_socket("client.0")) 2021-01-03T13:08:05.193 DEBUG:teuthology.orchestra.run.smithi007:> ' 2021-01-03T13:08:05.280 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.12955.asok 2021-01-03T13:08:05.286 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12955.asok 2021-01-03T13:08:05.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:05.287 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12955.asok status 2021-01-03T13:08:05.390 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2021-01-03T13:08:05.391 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2021-01-03T13:08:05.391 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:08:05.391 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:08:05.391 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2021-01-03T13:08:05.392 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2021-01-03T13:08:05.392 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2021-01-03T13:08:05.392 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "12955", 2021-01-03T13:08:05.392 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2021-01-03T13:08:05.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:08:05.393 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2021-01-03T13:08:05.393 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2021-01-03T13:08:05.393 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 7256, 2021-01-03T13:08:05.393 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2021-01-03T13:08:05.393 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2021-01-03T13:08:05.394 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2021-01-03T13:08:05.394 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 7256 2021-01-03T13:08:05.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:08:05.394 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:08:05.394 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:08:05.395 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:08:05.395 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3319700479 2021-01-03T13:08:05.395 INFO:teuthology.orchestra.run.smithi007.stdout: } 2021-01-03T13:08:05.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:08:05.395 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2021-01-03T13:08:05.396 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2021-01-03T13:08:05.396 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2021-01-03T13:08:05.396 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3319700479 2021-01-03T13:08:05.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2021-01-03T13:08:05.396 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.7256 172.21.15.7:0/3319700479", 2021-01-03T13:08:05.396 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "172.21.15.7:0/3319700479", 2021-01-03T13:08:05.397 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2021-01-03T13:08:05.397 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 79, 2021-01-03T13:08:05.397 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 162, 2021-01-03T13:08:05.397 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:08:05.397 INFO:teuthology.orchestra.run.smithi007.stdout: "blacklisted": false, 2021-01-03T13:08:05.398 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2021-01-03T13:08:05.398 INFO:teuthology.orchestra.run.smithi007.stdout:} 2021-01-03T13:08:05.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:05.400 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:08:05.401 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:08:05.407 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2021-01-03T13:08:05.408 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2021-01-03T13:08:05.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:05.409 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:08:05.466 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:08:05.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.583+0000 7fa90e108700 1 Processor -- start 2021-01-03T13:08:05.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.583+0000 7fa90e108700 1 -- start start 2021-01-03T13:08:05.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.583+0000 7fa90e108700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9080b2f00 0x7fa90805f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:05.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.583+0000 7fa90e108700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa908142d30 con 0x7fa9080b20c0 2021-01-03T13:08:05.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.583+0000 7fa90e108700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa908142fd0 con 0x7fa9080b3830 2021-01-03T13:08:05.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.583+0000 7fa90e108700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa908143270 con 0x7fa9080b2f00 2021-01-03T13:08:05.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.583+0000 7fa90d907700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa9080b3830 0x7fa90814d5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33734/0 (socket says 172.21.15.133:33734) 2021-01-03T13:08:05.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.583+0000 7fa90d907700 1 -- 172.21.15.133:0/3083746471 learned_addr learned my addr 172.21.15.133:0/3083746471 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:08:05.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.583+0000 7fa90d106700 1 --2- 172.21.15.133:0/3083746471 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9080b2f00 0x7fa90805f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:05.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.583+0000 7fa8fffff700 1 -- 172.21.15.133:0/3083746471 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791989423 0 0) 0x7fa908142fd0 con 0x7fa9080b3830 2021-01-03T13:08:05.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.583+0000 7fa8fffff700 1 -- 172.21.15.133:0/3083746471 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8ec003230 con 0x7fa9080b3830 2021-01-03T13:08:05.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.583+0000 7fa8fffff700 1 -- 172.21.15.133:0/3083746471 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731582764 0 0) 0x7fa908142d30 con 0x7fa9080b20c0 2021-01-03T13:08:05.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.583+0000 7fa8fffff700 1 -- 172.21.15.133:0/3083746471 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa908142fd0 con 0x7fa9080b20c0 2021-01-03T13:08:05.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.583+0000 7fa90d106700 1 -- 172.21.15.133:0/3083746471 >> v1:172.21.15.133:6789/0 conn(0x7fa9080b3830 legacy=0x7fa90814d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:05.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.583+0000 7fa90d106700 1 -- 172.21.15.133:0/3083746471 >> v1:172.21.15.16:6789/0 conn(0x7fa9080b20c0 legacy=0x7fa908140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:05.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.583+0000 7fa90d106700 1 -- 172.21.15.133:0/3083746471 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa908143510 con 0x7fa9080b2f00 2021-01-03T13:08:05.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.583+0000 7fa90d106700 1 --2- 172.21.15.133:0/3083746471 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9080b2f00 0x7fa90805f5e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fa9040032b0 tx=0x7fa9040091a0).ready entity=mon.2 client_cookie=6fd4a321a2f30723 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:05.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa8fffff700 1 -- 172.21.15.133:0/3083746471 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa90400b940 con 0x7fa9080b2f00 2021-01-03T13:08:05.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa8fffff700 1 -- 172.21.15.133:0/3083746471 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90400baa0 con 0x7fa9080b2f00 2021-01-03T13:08:05.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa8fffff700 1 -- 172.21.15.133:0/3083746471 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa90400bc10 con 0x7fa9080b2f00 2021-01-03T13:08:05.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90e108700 1 -- 172.21.15.133:0/3083746471 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9080b2f00 msgr2=0x7fa90805f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:05.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90e108700 1 --2- 172.21.15.133:0/3083746471 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9080b2f00 0x7fa90805f5e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fa9040032b0 tx=0x7fa9040091a0).stop 2021-01-03T13:08:05.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90e108700 1 -- 172.21.15.133:0/3083746471 shutdown_connections 2021-01-03T13:08:05.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90e108700 1 --2- 172.21.15.133:0/3083746471 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9080b2f00 0x7fa90805f5e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:05.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90e108700 1 -- 172.21.15.133:0/3083746471 >> 172.21.15.133:0/3083746471 conn(0x7fa9080b7200 msgr2=0x7fa9080b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:05.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90e108700 1 -- 172.21.15.133:0/3083746471 shutdown_connections 2021-01-03T13:08:05.593 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90e108700 1 -- 172.21.15.133:0/3083746471 wait complete. 2021-01-03T13:08:05.594 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90e108700 1 Processor -- start 2021-01-03T13:08:05.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90e108700 1 -- start start 2021-01-03T13:08:05.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90e108700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9080b20c0 0x7fa908144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:05.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90e108700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080b2f00 0x7fa908145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:05.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90e108700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9080b3830 0x7fa908155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90e108700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa908147d50 con 0x7fa9080b20c0 2021-01-03T13:08:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90e108700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080b0e90 con 0x7fa9080b2f00 2021-01-03T13:08:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90e108700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa908152990 con 0x7fa9080b3830 2021-01-03T13:08:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90c905700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080b2f00 0x7fa908145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90c905700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080b2f00 0x7fa908145100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40938/0 (socket says 172.21.15.133:40938) 2021-01-03T13:08:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.587+0000 7fa90c905700 1 -- 172.21.15.133:0/3169885899 learned_addr learned my addr 172.21.15.133:0/3169885899 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa90d907700 1 --2- 172.21.15.133:0/3169885899 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9080b3830 0x7fa908155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa90d106700 1 --2- 172.21.15.133:0/3169885899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9080b20c0 0x7fa908144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa90c905700 1 -- 172.21.15.133:0/3169885899 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9080b3830 msgr2=0x7fa908155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa90c905700 1 --2- 172.21.15.133:0/3169885899 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9080b3830 0x7fa908155330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:05.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa90c905700 1 -- 172.21.15.133:0/3169885899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9080b20c0 msgr2=0x7fa908144c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:05.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa90c905700 1 --2- 172.21.15.133:0/3169885899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9080b20c0 0x7fa908144c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:05.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa90c905700 1 -- 172.21.15.133:0/3169885899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa908152c30 con 0x7fa9080b2f00 2021-01-03T13:08:05.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa90d907700 1 --2- 172.21.15.133:0/3169885899 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9080b3830 0x7fa908155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:08:05.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa90d106700 1 --2- 172.21.15.133:0/3169885899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9080b20c0 0x7fa908144c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:08:05.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa90c905700 1 --2- 172.21.15.133:0/3169885899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080b2f00 0x7fa908145100 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fa8f80010d0 tx=0x7fa8f8007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:05.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa8fe7fc700 1 -- 172.21.15.133:0/3169885899 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f800e4a0 con 0x7fa9080b2f00 2021-01-03T13:08:05.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa8fe7fc700 1 -- 172.21.15.133:0/3169885899 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f800e600 con 0x7fa9080b2f00 2021-01-03T13:08:05.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa90e108700 1 -- 172.21.15.133:0/3169885899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9080b0860 con 0x7fa9080b2f00 2021-01-03T13:08:05.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa8fe7fc700 1 -- 172.21.15.133:0/3169885899 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f800e960 con 0x7fa9080b2f00 2021-01-03T13:08:05.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa90e108700 1 -- 172.21.15.133:0/3169885899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9081455f0 con 0x7fa9080b2f00 2021-01-03T13:08:05.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa90e108700 1 -- 172.21.15.133:0/3169885899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa908147ee0 con 0x7fa9080b2f00 2021-01-03T13:08:05.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa8fe7fc700 1 -- 172.21.15.133:0/3169885899 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa8f8019030 con 0x7fa9080b2f00 2021-01-03T13:08:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.591+0000 7fa8fe7fc700 1 --2- 172.21.15.133:0/3169885899 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa8f00554e0 0x7fa8f00579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.595+0000 7fa90d106700 1 --2- 172.21.15.133:0/3169885899 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa8f00554e0 0x7fa8f00579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.595+0000 7fa8fe7fc700 1 -- 172.21.15.133:0/3169885899 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa8f806d4a0 con 0x7fa9080b2f00 2021-01-03T13:08:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.595+0000 7fa90d106700 1 --2- 172.21.15.133:0/3169885899 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa8f00554e0 0x7fa8f00579a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fa904019000 tx=0x7fa904016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:05.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.599+0000 7fa8fe7fc700 1 -- 172.21.15.133:0/3169885899 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa908147ee0 con 0x7fa9080b2f00 2021-01-03T13:08:05.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.743+0000 7fa90e108700 1 -- 172.21.15.133:0/3169885899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9081527d0 con 0x7fa9080b2f00 2021-01-03T13:08:05.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.747+0000 7fa8fe7fc700 1 -- 172.21.15.133:0/3169885899 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16100 (secure 0 0 0) 0x7fa8f8043720 con 0x7fa9080b2f00 2021-01-03T13:08:05.749 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:08:05.749 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":162,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:07:59.636463+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2021-01-03T13:07:56.170759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2021-01-03T13:07:56.676733+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:08:05.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.747+0000 7fa90e108700 1 -- 172.21.15.133:0/3169885899 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa8f00554e0 msgr2=0x7fa8f00579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:05.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.747+0000 7fa90e108700 1 --2- 172.21.15.133:0/3169885899 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa8f00554e0 0x7fa8f00579a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fa904019000 tx=0x7fa904016000).stop 2021-01-03T13:08:05.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.747+0000 7fa90e108700 1 -- 172.21.15.133:0/3169885899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080b2f00 msgr2=0x7fa908145100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:05.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.747+0000 7fa90e108700 1 --2- 172.21.15.133:0/3169885899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080b2f00 0x7fa908145100 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7fa8f80010d0 tx=0x7fa8f8007a60).stop 2021-01-03T13:08:05.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.747+0000 7fa90e108700 1 -- 172.21.15.133:0/3169885899 shutdown_connections 2021-01-03T13:08:05.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.747+0000 7fa90e108700 1 --2- 172.21.15.133:0/3169885899 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa8f00554e0 0x7fa8f00579a0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.747+0000 7fa90e108700 1 --2- 172.21.15.133:0/3169885899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa9080b20c0 0x7fa908144c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.747+0000 7fa90e108700 1 --2- 172.21.15.133:0/3169885899 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa9080b3830 0x7fa908155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.747+0000 7fa90e108700 1 --2- 172.21.15.133:0/3169885899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080b2f00 0x7fa908145100 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.747+0000 7fa90e108700 1 -- 172.21.15.133:0/3169885899 >> 172.21.15.133:0/3169885899 conn(0x7fa9080b7200 msgr2=0x7fa9080b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.751+0000 7fa90e108700 1 -- 172.21.15.133:0/3169885899 shutdown_connections 2021-01-03T13:08:05.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.751+0000 7fa90e108700 1 -- 172.21.15.133:0/3169885899 wait complete. 2021-01-03T13:08:05.767 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-03T12:57:47.102954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-01-03T12:57:55.472799+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2021-01-03T13:07:56.170759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2021-01-03T13:07:56.676733+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '162', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2021-01-03T13:08:05.767 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2021-01-03T13:08:05.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.879+0000 7efe6e372700 1 Processor -- start 2021-01-03T13:08:05.881 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.879+0000 7efe6e372700 1 -- start start 2021-01-03T13:08:05.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.879+0000 7efe6e372700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efe6805c130 0x7efe680b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:05.883 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.879+0000 7efe6e372700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe680622f0 0x7efe680b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.879+0000 7efe6e372700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6805c510 con 0x7efe680b02b0 2021-01-03T13:08:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.879+0000 7efe6e372700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe681473d0 con 0x7efe6805c130 2021-01-03T13:08:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.879+0000 7efe6e372700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe680b0ab0 con 0x7efe680622f0 2021-01-03T13:08:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.879+0000 7efe6db71700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe680622f0 0x7efe680b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:05.884 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.879+0000 7efe6d370700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efe6805c130 0x7efe680b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:05.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.879+0000 7efe6d370700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efe6805c130 0x7efe680b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:39484/0 (socket says 172.21.15.133:39484) 2021-01-03T13:08:05.885 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.879+0000 7efe6d370700 1 -- 172.21.15.133:0/3574044305 learned_addr learned my addr 172.21.15.133:0/3574044305 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:05.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.883+0000 7efe6d370700 1 -- 172.21.15.133:0/3574044305 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe680622f0 msgr2=0x7efe680b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:05.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.883+0000 7efe6d370700 1 --2- 172.21.15.133:0/3574044305 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe680622f0 0x7efe680b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:05.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.883+0000 7efe6d370700 1 -- 172.21.15.133:0/3574044305 >> v1:172.21.15.16:6789/0 conn(0x7efe680b02b0 legacy=0x7efe680668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:05.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.883+0000 7efe6d370700 1 -- 172.21.15.133:0/3574044305 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe680b15a0 con 0x7efe6805c130 2021-01-03T13:08:05.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.883+0000 7efe6db71700 1 --2- 172.21.15.133:0/3574044305 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe680622f0 0x7efe680b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:08:05.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.883+0000 7efe6d370700 1 --2- 172.21.15.133:0/3574044305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe6805c130 0x7efe680b1a00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7efe64002f30 tx=0x7efe64006e80).ready entity=mon.0 client_cookie=9df2eacd76617576 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:05.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.883+0000 7efe5ffff700 1 -- 172.21.15.133:0/3574044305 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe640097f0 con 0x7efe6805c130 2021-01-03T13:08:05.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.883+0000 7efe5ffff700 1 -- 172.21.15.133:0/3574044305 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe64009950 con 0x7efe6805c130 2021-01-03T13:08:05.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.883+0000 7efe5ffff700 1 -- 172.21.15.133:0/3574044305 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe64009cf0 con 0x7efe6805c130 2021-01-03T13:08:05.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.883+0000 7efe6e372700 1 -- 172.21.15.133:0/3574044305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe6805c130 msgr2=0x7efe680b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:05.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.883+0000 7efe6e372700 1 --2- 172.21.15.133:0/3574044305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe6805c130 0x7efe680b1a00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7efe64002f30 tx=0x7efe64006e80).stop 2021-01-03T13:08:05.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.883+0000 7efe6e372700 1 -- 172.21.15.133:0/3574044305 shutdown_connections 2021-01-03T13:08:05.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.883+0000 7efe6e372700 1 --2- 172.21.15.133:0/3574044305 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe680622f0 0x7efe680b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:05.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.883+0000 7efe6e372700 1 --2- 172.21.15.133:0/3574044305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe6805c130 0x7efe680b1a00 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:05.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.883+0000 7efe6e372700 1 -- 172.21.15.133:0/3574044305 >> 172.21.15.133:0/3574044305 conn(0x7efe680b6110 msgr2=0x7efe680b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:05.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.883+0000 7efe6e372700 1 -- 172.21.15.133:0/3574044305 shutdown_connections 2021-01-03T13:08:05.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.883+0000 7efe6e372700 1 -- 172.21.15.133:0/3574044305 wait complete. 2021-01-03T13:08:05.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6e372700 1 Processor -- start 2021-01-03T13:08:05.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6e372700 1 -- start start 2021-01-03T13:08:05.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6e372700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe6805c130 0x7efe680b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:05.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6e372700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe680622f0 0x7efe68064f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:05.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6e372700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe680b02b0 0x7efe68065440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:05.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6e372700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe68063870 con 0x7efe680622f0 2021-01-03T13:08:05.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6e372700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe68064240 con 0x7efe680b02b0 2021-01-03T13:08:05.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6e372700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe68065e80 con 0x7efe6805c130 2021-01-03T13:08:05.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6db71700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe680b02b0 0x7efe68065440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:05.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6db71700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe680b02b0 0x7efe68065440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40954/0 (socket says 172.21.15.133:40954) 2021-01-03T13:08:05.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6db71700 1 -- 172.21.15.133:0/231150774 learned_addr learned my addr 172.21.15.133:0/231150774 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:05.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6d370700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe6805c130 0x7efe680b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:05.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6cb6f700 1 --2- 172.21.15.133:0/231150774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe680622f0 0x7efe68064f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:05.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6db71700 1 -- 172.21.15.133:0/231150774 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe6805c130 msgr2=0x7efe680b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:05.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6db71700 1 --2- 172.21.15.133:0/231150774 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe6805c130 0x7efe680b5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:05.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6db71700 1 -- 172.21.15.133:0/231150774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe680622f0 msgr2=0x7efe68064f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:05.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6db71700 1 --2- 172.21.15.133:0/231150774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe680622f0 0x7efe68064f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:05.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6db71700 1 -- 172.21.15.133:0/231150774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68063aa0 con 0x7efe680b02b0 2021-01-03T13:08:05.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6db71700 1 --2- 172.21.15.133:0/231150774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe680b02b0 0x7efe68065440 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7efe6000c000 tx=0x7efe600091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:05.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe5e7fc700 1 -- 172.21.15.133:0/231150774 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe6000cbd0 con 0x7efe680b02b0 2021-01-03T13:08:05.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6e372700 1 -- 172.21.15.133:0/231150774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe680a41a0 con 0x7efe680b02b0 2021-01-03T13:08:05.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.887+0000 7efe6e372700 1 -- 172.21.15.133:0/231150774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe680646a0 con 0x7efe680b02b0 2021-01-03T13:08:05.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.891+0000 7efe5e7fc700 1 -- 172.21.15.133:0/231150774 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6000cd30 con 0x7efe680b02b0 2021-01-03T13:08:05.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.891+0000 7efe5e7fc700 1 -- 172.21.15.133:0/231150774 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe6000cea0 con 0x7efe680b02b0 2021-01-03T13:08:05.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.891+0000 7efe6e372700 1 -- 172.21.15.133:0/231150774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe68057300 con 0x7efe680b02b0 2021-01-03T13:08:05.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.891+0000 7efe5e7fc700 1 -- 172.21.15.133:0/231150774 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7efe60022070 con 0x7efe680b02b0 2021-01-03T13:08:05.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.891+0000 7efe5e7fc700 1 --2- 172.21.15.133:0/231150774 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efe500553b0 0x7efe50057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:05.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.891+0000 7efe6d370700 1 --2- 172.21.15.133:0/231150774 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efe500553b0 0x7efe50057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:05.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.891+0000 7efe5e7fc700 1 -- 172.21.15.133:0/231150774 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efe6006e8c0 con 0x7efe680b02b0 2021-01-03T13:08:05.898 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.891+0000 7efe6d370700 1 --2- 172.21.15.133:0/231150774 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efe500553b0 0x7efe50057870 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7efe6401c000 tx=0x7efe64015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:05.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:05.899+0000 7efe5e7fc700 1 -- 172.21.15.133:0/231150774 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7efe60044bc0 con 0x7efe680b02b0 2021-01-03T13:08:06.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.039+0000 7efe6e372700 1 -- 172.21.15.133:0/231150774 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efe68064380 con 0x7efe680b02b0 2021-01-03T13:08:06.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.039+0000 7efe5e7fc700 1 -- 172.21.15.133:0/231150774 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v162) v1 ==== 110+0+10 (secure 0 0 0) 0x7efe60016020 con 0x7efe680b02b0 2021-01-03T13:08:06.043 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2021-01-03T13:08:06.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.043+0000 7efe6e372700 1 -- 172.21.15.133:0/231150774 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efe500553b0 msgr2=0x7efe50057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.043+0000 7efe6e372700 1 --2- 172.21.15.133:0/231150774 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efe500553b0 0x7efe50057870 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7efe6401c000 tx=0x7efe64015000).stop 2021-01-03T13:08:06.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.043+0000 7efe6e372700 1 -- 172.21.15.133:0/231150774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe680b02b0 msgr2=0x7efe68065440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.043+0000 7efe6e372700 1 --2- 172.21.15.133:0/231150774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe680b02b0 0x7efe68065440 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7efe6000c000 tx=0x7efe600091a0).stop 2021-01-03T13:08:06.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.043+0000 7efe6e372700 1 -- 172.21.15.133:0/231150774 shutdown_connections 2021-01-03T13:08:06.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.043+0000 7efe6e372700 1 --2- 172.21.15.133:0/231150774 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efe500553b0 0x7efe50057870 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.043+0000 7efe6e372700 1 --2- 172.21.15.133:0/231150774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe680b02b0 0x7efe68065440 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.043+0000 7efe6e372700 1 --2- 172.21.15.133:0/231150774 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe6805c130 0x7efe680b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.043+0000 7efe6e372700 1 --2- 172.21.15.133:0/231150774 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe680622f0 0x7efe68064f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.046 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.043+0000 7efe6e372700 1 -- 172.21.15.133:0/231150774 >> 172.21.15.133:0/231150774 conn(0x7efe680b6110 msgr2=0x7efe680b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:06.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.043+0000 7efe6e372700 1 -- 172.21.15.133:0/231150774 shutdown_connections 2021-01-03T13:08:06.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.043+0000 7efe6e372700 1 -- 172.21.15.133:0/231150774 wait complete. 2021-01-03T13:08:06.056 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2021-01-03T13:08:06.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.167+0000 7f7597557700 1 Processor -- start 2021-01-03T13:08:06.171 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.167+0000 7f7597557700 1 -- start start 2021-01-03T13:08:06.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7597557700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7590066f30 0x7f75900b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.172 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7597557700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759005fd00 con 0x7f75900b1590 2021-01-03T13:08:06.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7597557700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75900accd0 con 0x7f759005f920 2021-01-03T13:08:06.173 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7597557700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75900b2980 con 0x7f7590066f30 2021-01-03T13:08:06.174 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7596555700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f759005f920 0x7f75900b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33758/0 (socket says 172.21.15.133:33758) 2021-01-03T13:08:06.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7596555700 1 -- 172.21.15.133:0/652571939 learned_addr learned my addr 172.21.15.133:0/652571939 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:08:06.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7595d54700 1 --2- 172.21.15.133:0/652571939 >> v2:172.21.15.16:3300/0 conn(0x7f7590066f30 0x7f75900b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7595553700 1 -- 172.21.15.133:0/652571939 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87289135 0 0) 0x7f75900accd0 con 0x7f759005f920 2021-01-03T13:08:06.175 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7595553700 1 -- 172.21.15.133:0/652571939 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7578003230 con 0x7f759005f920 2021-01-03T13:08:06.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7595d54700 1 -- 172.21.15.133:0/652571939 >> v1:172.21.15.133:6789/0 conn(0x7f759005f920 legacy=0x7f75900b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7595553700 1 -- 172.21.15.133:0/652571939 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 738604323 0 0) 0x7f7578003230 con 0x7f759005f920 2021-01-03T13:08:06.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7595d54700 1 -- 172.21.15.133:0/652571939 >> v1:172.21.15.16:6789/0 conn(0x7f75900b1590 legacy=0x7f759013ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7595d54700 1 -- 172.21.15.133:0/652571939 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75900acf70 con 0x7f7590066f30 2021-01-03T13:08:06.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7595d54700 1 --2- 172.21.15.133:0/652571939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7590066f30 0x7f75900b0ab0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f7588001450 tx=0x7f7584006dc0).ready entity=mon.0 client_cookie=db0210aadd23c391 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:06.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7595553700 1 -- 172.21.15.133:0/652571939 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f758c0016d0 con 0x7f7590066f30 2021-01-03T13:08:06.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7595553700 1 -- 172.21.15.133:0/652571939 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7584009620 con 0x7f7590066f30 2021-01-03T13:08:06.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7595553700 1 -- 172.21.15.133:0/652571939 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7584009790 con 0x7f7590066f30 2021-01-03T13:08:06.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7597557700 1 -- 172.21.15.133:0/652571939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7590066f30 msgr2=0x7f75900b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7597557700 1 --2- 172.21.15.133:0/652571939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7590066f30 0x7f75900b0ab0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f7588001450 tx=0x7f7584006dc0).stop 2021-01-03T13:08:06.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7597557700 1 -- 172.21.15.133:0/652571939 shutdown_connections 2021-01-03T13:08:06.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7597557700 1 --2- 172.21.15.133:0/652571939 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7590066f30 0x7f75900b0ab0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7597557700 1 -- 172.21.15.133:0/652571939 >> 172.21.15.133:0/652571939 conn(0x7f75900b6110 msgr2=0x7f75900b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7597557700 1 -- 172.21.15.133:0/652571939 shutdown_connections 2021-01-03T13:08:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.171+0000 7f7597557700 1 -- 172.21.15.133:0/652571939 wait complete. 2021-01-03T13:08:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7597557700 1 Processor -- start 2021-01-03T13:08:06.181 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7597557700 1 -- start start 2021-01-03T13:08:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7597557700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f759005f920 0x7f7590145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7597557700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7590066f30 0x7f7590145040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7597557700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f75900b1590 0x7f759014f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7597557700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7590152c80 con 0x7f759005f920 2021-01-03T13:08:06.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7597557700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759014ecb0 con 0x7f7590066f30 2021-01-03T13:08:06.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7597557700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759014ef50 con 0x7f75900b1590 2021-01-03T13:08:06.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7595d54700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7590066f30 0x7f7590145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7595d54700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7590066f30 0x7f7590145040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40966/0 (socket says 172.21.15.133:40966) 2021-01-03T13:08:06.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7595d54700 1 -- 172.21.15.133:0/3532735283 learned_addr learned my addr 172.21.15.133:0/3532735283 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:06.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7596555700 1 --2- 172.21.15.133:0/3532735283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f759005f920 0x7f7590145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7596d56700 1 --2- 172.21.15.133:0/3532735283 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f75900b1590 0x7f759014f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7595d54700 1 -- 172.21.15.133:0/3532735283 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f75900b1590 msgr2=0x7f759014f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7595d54700 1 --2- 172.21.15.133:0/3532735283 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f75900b1590 0x7f759014f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7595d54700 1 -- 172.21.15.133:0/3532735283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f759005f920 msgr2=0x7f7590145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7595d54700 1 --2- 172.21.15.133:0/3532735283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f759005f920 0x7f7590145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7595d54700 1 -- 172.21.15.133:0/3532735283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759014e9a0 con 0x7f7590066f30 2021-01-03T13:08:06.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7595d54700 1 --2- 172.21.15.133:0/3532735283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7590066f30 0x7f7590145040 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f7588001450 tx=0x7f75900af0e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:06.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f75837fe700 1 -- 172.21.15.133:0/3532735283 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7584013df0 con 0x7f7590066f30 2021-01-03T13:08:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f75837fe700 1 -- 172.21.15.133:0/3532735283 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7584020070 con 0x7f7590066f30 2021-01-03T13:08:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7597557700 1 -- 172.21.15.133:0/3532735283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75901528c0 con 0x7f7590066f30 2021-01-03T13:08:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f75837fe700 1 -- 172.21.15.133:0/3532735283 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f758401c5f0 con 0x7f7590066f30 2021-01-03T13:08:06.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.175+0000 7f7597557700 1 -- 172.21.15.133:0/3532735283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7590144b40 con 0x7f7590066f30 2021-01-03T13:08:06.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.179+0000 7f7597557700 1 -- 172.21.15.133:0/3532735283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7590057300 con 0x7f7590066f30 2021-01-03T13:08:06.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.179+0000 7f75837fe700 1 -- 172.21.15.133:0/3532735283 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f758402c070 con 0x7f7590066f30 2021-01-03T13:08:06.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.179+0000 7f75837fe700 1 --2- 172.21.15.133:0/3532735283 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f75700553b0 0x7f7570057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.179+0000 7f7596555700 1 --2- 172.21.15.133:0/3532735283 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f75700553b0 0x7f7570057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.179+0000 7f75837fe700 1 -- 172.21.15.133:0/3532735283 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7584070d50 con 0x7f7590066f30 2021-01-03T13:08:06.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.179+0000 7f7596555700 1 --2- 172.21.15.133:0/3532735283 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f75700553b0 0x7f7570057870 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f758c00b000 tx=0x7f758c000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:06.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.187+0000 7f75837fe700 1 -- 172.21.15.133:0/3532735283 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7584046f40 con 0x7f7590066f30 2021-01-03T13:08:06.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.327+0000 7f7597557700 1 -- 172.21.15.133:0/3532735283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7590144b40 con 0x7f7590066f30 2021-01-03T13:08:06.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.327+0000 7f75837fe700 1 -- 172.21.15.133:0/3532735283 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v162) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7590144b40 con 0x7f7590066f30 2021-01-03T13:08:06.330 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:08:06.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.327+0000 7f7597557700 1 -- 172.21.15.133:0/3532735283 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f75700553b0 msgr2=0x7f7570057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.327+0000 7f7597557700 1 --2- 172.21.15.133:0/3532735283 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f75700553b0 0x7f7570057870 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f758c00b000 tx=0x7f758c000b80).stop 2021-01-03T13:08:06.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.327+0000 7f7597557700 1 -- 172.21.15.133:0/3532735283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7590066f30 msgr2=0x7f7590145040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.327+0000 7f7597557700 1 --2- 172.21.15.133:0/3532735283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7590066f30 0x7f7590145040 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f7588001450 tx=0x7f75900af0e0).stop 2021-01-03T13:08:06.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.327+0000 7f7597557700 1 -- 172.21.15.133:0/3532735283 shutdown_connections 2021-01-03T13:08:06.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.327+0000 7f7597557700 1 --2- 172.21.15.133:0/3532735283 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f75700553b0 0x7f7570057870 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.327+0000 7f7597557700 1 --2- 172.21.15.133:0/3532735283 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f759005f920 0x7f7590145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.327+0000 7f7597557700 1 --2- 172.21.15.133:0/3532735283 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f75900b1590 0x7f759014f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.333 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.327+0000 7f7597557700 1 --2- 172.21.15.133:0/3532735283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7590066f30 0x7f7590145040 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.327+0000 7f7597557700 1 -- 172.21.15.133:0/3532735283 >> 172.21.15.133:0/3532735283 conn(0x7f75900b6110 msgr2=0x7f75900b4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:06.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.331+0000 7f7597557700 1 -- 172.21.15.133:0/3532735283 shutdown_connections 2021-01-03T13:08:06.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.331+0000 7f7597557700 1 -- 172.21.15.133:0/3532735283 wait complete. 2021-01-03T13:08:06.344 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2021-01-03T13:08:06.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.455+0000 7f245359e700 1 Processor -- start 2021-01-03T13:08:06.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.455+0000 7f245359e700 1 -- start start 2021-01-03T13:08:06.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24540a9750 0x7f24540a8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245359e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24540b16a0 con 0x7f24540b0a60 2021-01-03T13:08:06.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24540a9ba0 con 0x7f24540b2460 2021-01-03T13:08:06.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24540b2840 con 0x7f24540a9750 2021-01-03T13:08:06.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245259c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f24540b2460 0x7f24540ad490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33772/0 (socket says 172.21.15.133:33772) 2021-01-03T13:08:06.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245259c700 1 -- 172.21.15.133:0/2319077479 learned_addr learned my addr 172.21.15.133:0/2319077479 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:08:06.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f2452d9d700 1 --2- 172.21.15.133:0/2319077479 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24540a9750 0x7f24540a8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 -- 172.21.15.133:0/2319077479 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505991653 0 0) 0x7f24540a9ba0 con 0x7f24540b2460 2021-01-03T13:08:06.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 -- 172.21.15.133:0/2319077479 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2438003230 con 0x7f24540b2460 2021-01-03T13:08:06.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 -- 172.21.15.133:0/2319077479 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3875993499 0 0) 0x7f2438003230 con 0x7f24540b2460 2021-01-03T13:08:06.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 -- 172.21.15.133:0/2319077479 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24540a9750 msgr2=0x7f24540a8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:06.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 --2- 172.21.15.133:0/2319077479 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24540a9750 0x7f24540a8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 -- 172.21.15.133:0/2319077479 >> v1:172.21.15.16:6789/0 conn(0x7f24540b0a60 legacy=0x7f24540a8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 -- 172.21.15.133:0/2319077479 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24540aeae0 con 0x7f24540b2460 2021-01-03T13:08:06.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 -- 172.21.15.133:0/2319077479 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f2444001a50 con 0x7f24540b2460 2021-01-03T13:08:06.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 -- 172.21.15.133:0/2319077479 >> v1:172.21.15.133:6789/0 conn(0x7f24540b2460 legacy=0x7f24540ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 --2- 172.21.15.133:0/2319077479 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24540a9750 0x7f2438003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 --2- 172.21.15.133:0/2319077479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2438003c10 0x7f24380044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 --2- 172.21.15.133:0/2319077479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24380049c0 0x7f2438004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 -- 172.21.15.133:0/2319077479 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24540b2840 con 0x7f2438003c10 2021-01-03T13:08:06.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 -- 172.21.15.133:0/2319077479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2438004130 con 0x7f24380049c0 2021-01-03T13:08:06.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 -- 172.21.15.133:0/2319077479 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24380042f0 con 0x7f24540a9750 2021-01-03T13:08:06.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f2452d9d700 1 --2- 172.21.15.133:0/2319077479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24380049c0 0x7f2438004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245259c700 1 --2- 172.21.15.133:0/2319077479 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24540a9750 0x7f2438003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f2451d9b700 1 --2- 172.21.15.133:0/2319077479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2438003c10 0x7f24380044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f2452d9d700 1 -- 172.21.15.133:0/2319077479 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24540a9750 msgr2=0x7f2438003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:06.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f2452d9d700 1 --2- 172.21.15.133:0/2319077479 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f24540a9750 0x7f2438003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f2452d9d700 1 -- 172.21.15.133:0/2319077479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2438003c10 msgr2=0x7f24380044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:06.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f2452d9d700 1 --2- 172.21.15.133:0/2319077479 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2438003c10 0x7f24380044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f2452d9d700 1 -- 172.21.15.133:0/2319077479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2438003230 con 0x7f24380049c0 2021-01-03T13:08:06.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f2452d9d700 1 --2- 172.21.15.133:0/2319077479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24380049c0 0x7f2438004e40 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f244c00c000 tx=0x7f244c006db0).ready entity=mon.1 client_cookie=a4b63303d8c83fa7 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:06.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 -- 172.21.15.133:0/2319077479 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f244c00b8b0 con 0x7f24380049c0 2021-01-03T13:08:06.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 -- 172.21.15.133:0/2319077479 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c015070 con 0x7f24380049c0 2021-01-03T13:08:06.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245159a700 1 -- 172.21.15.133:0/2319077479 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f244c00bc00 con 0x7f24380049c0 2021-01-03T13:08:06.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245359e700 1 -- 172.21.15.133:0/2319077479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24380049c0 msgr2=0x7f2438004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245359e700 1 --2- 172.21.15.133:0/2319077479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24380049c0 0x7f2438004e40 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7f244c00c000 tx=0x7f244c006db0).stop 2021-01-03T13:08:06.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f2452d9d700 1 -- 172.21.15.133:0/2319077479 reap_dead start 2021-01-03T13:08:06.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245359e700 1 -- 172.21.15.133:0/2319077479 shutdown_connections 2021-01-03T13:08:06.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245359e700 1 -- 172.21.15.133:0/2319077479 >> 172.21.15.133:0/2319077479 conn(0x7f245406b050 msgr2=0x7f2454060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:06.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245359e700 1 -- 172.21.15.133:0/2319077479 shutdown_connections 2021-01-03T13:08:06.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.459+0000 7f245359e700 1 -- 172.21.15.133:0/2319077479 wait complete. 2021-01-03T13:08:06.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f245359e700 1 Processor -- start 2021-01-03T13:08:06.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f245359e700 1 -- start start 2021-01-03T13:08:06.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f245359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f245409efb0 0x7f245409f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f245359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2454064110 0x7f2454141700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f245359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2454141bf0 0x7f2454062fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f245359e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245414e4d0 con 0x7f245409efb0 2021-01-03T13:08:06.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f245359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2454064db0 con 0x7f2454141bf0 2021-01-03T13:08:06.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f245359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2454065050 con 0x7f2454064110 2021-01-03T13:08:06.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f2452d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2454141bf0 0x7f2454062fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f2452d9d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2454141bf0 0x7f2454062fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:40988/0 (socket says 172.21.15.133:40988) 2021-01-03T13:08:06.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f2452d9d700 1 -- 172.21.15.133:0/2440756673 learned_addr learned my addr 172.21.15.133:0/2440756673 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:06.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f245259c700 1 --2- 172.21.15.133:0/2440756673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f245409efb0 0x7f245409f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f2451d9b700 1 --2- 172.21.15.133:0/2440756673 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2454064110 0x7f2454141700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f2452d9d700 1 -- 172.21.15.133:0/2440756673 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2454064110 msgr2=0x7f2454141700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f2452d9d700 1 --2- 172.21.15.133:0/2440756673 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2454064110 0x7f2454141700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f2452d9d700 1 -- 172.21.15.133:0/2440756673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f245409efb0 msgr2=0x7f245409f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f2452d9d700 1 --2- 172.21.15.133:0/2440756673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f245409efb0 0x7f245409f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.463+0000 7f2452d9d700 1 -- 172.21.15.133:0/2440756673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245414e1c0 con 0x7f2454141bf0 2021-01-03T13:08:06.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.467+0000 7f2452d9d700 1 --2- 172.21.15.133:0/2440756673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2454141bf0 0x7f2454062fe0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f2444001cb0 tx=0x7f244c018000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:06.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.467+0000 7f24437fe700 1 -- 172.21.15.133:0/2440756673 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f244c020070 con 0x7f2454141bf0 2021-01-03T13:08:06.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.467+0000 7f24437fe700 1 -- 172.21.15.133:0/2440756673 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c011660 con 0x7f2454141bf0 2021-01-03T13:08:06.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.467+0000 7f245359e700 1 -- 172.21.15.133:0/2440756673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245409f880 con 0x7f2454141bf0 2021-01-03T13:08:06.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.467+0000 7f24437fe700 1 -- 172.21.15.133:0/2440756673 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f244c0119c0 con 0x7f2454141bf0 2021-01-03T13:08:06.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.467+0000 7f245359e700 1 -- 172.21.15.133:0/2440756673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2454063670 con 0x7f2454141bf0 2021-01-03T13:08:06.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.467+0000 7f24437fe700 1 -- 172.21.15.133:0/2440756673 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f244c02c070 con 0x7f2454141bf0 2021-01-03T13:08:06.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.467+0000 7f245359e700 1 -- 172.21.15.133:0/2440756673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2454065210 con 0x7f2454141bf0 2021-01-03T13:08:06.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.467+0000 7f24437fe700 1 --2- 172.21.15.133:0/2440756673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2430055330 0x7f24300577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.467+0000 7f24437fe700 1 -- 172.21.15.133:0/2440756673 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f244c070730 con 0x7f2454141bf0 2021-01-03T13:08:06.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.467+0000 7f245259c700 1 --2- 172.21.15.133:0/2440756673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2430055330 0x7f24300577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.467+0000 7f245259c700 1 --2- 172.21.15.133:0/2440756673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2430055330 0x7f24300577f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f244400d000 tx=0x7f2444007040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:06.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.475+0000 7f24437fe700 1 -- 172.21.15.133:0/2440756673 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f244c046930 con 0x7f2454141bf0 2021-01-03T13:08:06.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.615+0000 7f245359e700 1 -- 172.21.15.133:0/2440756673 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2454057300 con 0x7f2454141bf0 2021-01-03T13:08:06.617 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.615+0000 7f24437fe700 1 -- 172.21.15.133:0/2440756673 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v162) v1 ==== 104+0+10 (secure 0 0 0) 0x7f244c049f50 con 0x7f2454141bf0 2021-01-03T13:08:06.618 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:08:06.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.615+0000 7f245359e700 1 -- 172.21.15.133:0/2440756673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2430055330 msgr2=0x7f24300577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.615+0000 7f245359e700 1 --2- 172.21.15.133:0/2440756673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2430055330 0x7f24300577f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f244400d000 tx=0x7f2444007040).stop 2021-01-03T13:08:06.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.615+0000 7f245359e700 1 -- 172.21.15.133:0/2440756673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2454141bf0 msgr2=0x7f2454062fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.615+0000 7f245359e700 1 --2- 172.21.15.133:0/2440756673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2454141bf0 0x7f2454062fe0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7f2444001cb0 tx=0x7f244c018000).stop 2021-01-03T13:08:06.620 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.615+0000 7f245359e700 1 -- 172.21.15.133:0/2440756673 shutdown_connections 2021-01-03T13:08:06.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.615+0000 7f245359e700 1 --2- 172.21.15.133:0/2440756673 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2430055330 0x7f24300577f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.615+0000 7f245359e700 1 --2- 172.21.15.133:0/2440756673 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f245409efb0 0x7f245409f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.615+0000 7f245359e700 1 --2- 172.21.15.133:0/2440756673 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2454141bf0 0x7f2454062fe0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.615+0000 7f245359e700 1 --2- 172.21.15.133:0/2440756673 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2454064110 0x7f2454141700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.615+0000 7f245359e700 1 -- 172.21.15.133:0/2440756673 >> 172.21.15.133:0/2440756673 conn(0x7f245406b050 msgr2=0x7f24540aed80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:06.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.615+0000 7f245359e700 1 -- 172.21.15.133:0/2440756673 shutdown_connections 2021-01-03T13:08:06.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.615+0000 7f245359e700 1 -- 172.21.15.133:0/2440756673 wait complete. 2021-01-03T13:08:06.632 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2021-01-03T13:08:06.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.743+0000 7efe17347700 1 Processor -- start 2021-01-03T13:08:06.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.743+0000 7efe17347700 1 -- start start 2021-01-03T13:08:06.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe17347700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe100b3670 0x7efe100b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.750 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe17347700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efe100b1f30 0x7efe100b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe17347700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe100ac200 con 0x7efe100b7910 2021-01-03T13:08:06.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe17347700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe100ad720 con 0x7efe100b1f30 2021-01-03T13:08:06.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe17347700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe100acc10 con 0x7efe100b3670 2021-01-03T13:08:06.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe16345700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efe100b7910 0x7efe1013e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33792/0 (socket says 172.21.15.133:33792) 2021-01-03T13:08:06.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe16345700 1 -- 172.21.15.133:0/2333517777 learned_addr learned my addr 172.21.15.133:0/2333517777 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:08:06.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe15b44700 1 --2- 172.21.15.133:0/2333517777 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe100b3670 0x7efe100b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe16b46700 1 --2- 172.21.15.133:0/2333517777 >> v2:172.21.15.16:3300/0 conn(0x7efe100b1f30 0x7efe100b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe15343700 1 -- 172.21.15.133:0/2333517777 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718944462 0 0) 0x7efe100ac200 con 0x7efe100b7910 2021-01-03T13:08:06.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe15343700 1 -- 172.21.15.133:0/2333517777 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdf8003230 con 0x7efe100b7910 2021-01-03T13:08:06.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe15b44700 1 -- 172.21.15.133:0/2333517777 >> v2:172.21.15.16:3300/0 conn(0x7efe100b1f30 msgr2=0x7efe100b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:06.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe15b44700 1 --2- 172.21.15.133:0/2333517777 >> v2:172.21.15.16:3300/0 conn(0x7efe100b1f30 0x7efe100b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe15b44700 1 -- 172.21.15.133:0/2333517777 >> v1:172.21.15.133:6789/0 conn(0x7efe100b7910 legacy=0x7efe1013e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe15343700 1 -- 172.21.15.133:0/2333517777 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3197430618 0 0) 0x7efdf8003230 con 0x7efe100b7910 2021-01-03T13:08:06.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe15b44700 1 -- 172.21.15.133:0/2333517777 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe100ac430 con 0x7efe100b3670 2021-01-03T13:08:06.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe16b46700 1 --2- 172.21.15.133:0/2333517777 >> v2:172.21.15.16:3300/0 conn(0x7efe100b1f30 0x7efe100b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:08:06.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe15b44700 1 --2- 172.21.15.133:0/2333517777 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe100b3670 0x7efe100b7cf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7efe0c001870 tx=0x7efe00006d60).ready entity=mon.2 client_cookie=f30c46b289bd928a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:06.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe15343700 1 -- 172.21.15.133:0/2333517777 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe0c0016d0 con 0x7efe100b3670 2021-01-03T13:08:06.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe15343700 1 -- 172.21.15.133:0/2333517777 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0000f510 con 0x7efe100b3670 2021-01-03T13:08:06.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe15343700 1 -- 172.21.15.133:0/2333517777 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe0000f680 con 0x7efe100b3670 2021-01-03T13:08:06.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe17347700 1 -- 172.21.15.133:0/2333517777 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe100b3670 msgr2=0x7efe100b7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe17347700 1 --2- 172.21.15.133:0/2333517777 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe100b3670 0x7efe100b7cf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7efe0c001870 tx=0x7efe00006d60).stop 2021-01-03T13:08:06.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe17347700 1 -- 172.21.15.133:0/2333517777 shutdown_connections 2021-01-03T13:08:06.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe17347700 1 --2- 172.21.15.133:0/2333517777 >> v2:172.21.15.16:3300/0 conn(0x7efe100b1f30 0x7efe100b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe17347700 1 --2- 172.21.15.133:0/2333517777 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe100b3670 0x7efe100b7cf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe17347700 1 -- 172.21.15.133:0/2333517777 >> 172.21.15.133:0/2333517777 conn(0x7efe1005c8c0 msgr2=0x7efe100b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:06.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe17347700 1 -- 172.21.15.133:0/2333517777 shutdown_connections 2021-01-03T13:08:06.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.747+0000 7efe17347700 1 -- 172.21.15.133:0/2333517777 wait complete. 2021-01-03T13:08:06.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe17347700 1 Processor -- start 2021-01-03T13:08:06.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe17347700 1 -- start start 2021-01-03T13:08:06.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe17347700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe100b1f30 0x7efe10147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe17347700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe100b3670 0x7efe10061450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe17347700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe100b7910 0x7efe10061940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe17347700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe10065890 con 0x7efe100b3670 2021-01-03T13:08:06.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe17347700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe10145eb0 con 0x7efe100b7910 2021-01-03T13:08:06.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe17347700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe100633a0 con 0x7efe100b1f30 2021-01-03T13:08:06.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe16b46700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe100b7910 0x7efe10061940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe16b46700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe100b7910 0x7efe10061940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41002/0 (socket says 172.21.15.133:41002) 2021-01-03T13:08:06.761 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe16b46700 1 -- 172.21.15.133:0/486860435 learned_addr learned my addr 172.21.15.133:0/486860435 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:06.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe15b44700 1 --2- 172.21.15.133:0/486860435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe100b3670 0x7efe10061450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe16345700 1 --2- 172.21.15.133:0/486860435 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe100b1f30 0x7efe10147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe16b46700 1 -- 172.21.15.133:0/486860435 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe100b1f30 msgr2=0x7efe10147980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.762 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe16b46700 1 --2- 172.21.15.133:0/486860435 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe100b1f30 0x7efe10147980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe16b46700 1 -- 172.21.15.133:0/486860435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe100b3670 msgr2=0x7efe10061450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe16b46700 1 --2- 172.21.15.133:0/486860435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe100b3670 0x7efe10061450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe16b46700 1 -- 172.21.15.133:0/486860435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe100677f0 con 0x7efe100b7910 2021-01-03T13:08:06.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe16b46700 1 --2- 172.21.15.133:0/486860435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe100b7910 0x7efe10061940 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7efe1009ca30 tx=0x7efe080091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:06.763 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efdff7fe700 1 -- 172.21.15.133:0/486860435 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe0800cb50 con 0x7efe100b7910 2021-01-03T13:08:06.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efdff7fe700 1 -- 172.21.15.133:0/486860435 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0800ccb0 con 0x7efe100b7910 2021-01-03T13:08:06.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe17347700 1 -- 172.21.15.133:0/486860435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe101460e0 con 0x7efe100b7910 2021-01-03T13:08:06.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efdff7fe700 1 -- 172.21.15.133:0/486860435 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe080125e0 con 0x7efe100b7910 2021-01-03T13:08:06.764 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.751+0000 7efe17347700 1 -- 172.21.15.133:0/486860435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe10061fd0 con 0x7efe100b7910 2021-01-03T13:08:06.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.755+0000 7efdff7fe700 1 -- 172.21.15.133:0/486860435 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7efe08022070 con 0x7efe100b7910 2021-01-03T13:08:06.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.755+0000 7efe17347700 1 -- 172.21.15.133:0/486860435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe10147240 con 0x7efe100b7910 2021-01-03T13:08:06.765 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.755+0000 7efdff7fe700 1 --2- 172.21.15.133:0/486860435 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efdf00553b0 0x7efdf0057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:06.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.755+0000 7efe16345700 1 --2- 172.21.15.133:0/486860435 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efdf00553b0 0x7efdf0057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:06.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.755+0000 7efdff7fe700 1 -- 172.21.15.133:0/486860435 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efe0806e8c0 con 0x7efe100b7910 2021-01-03T13:08:06.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.755+0000 7efe16345700 1 --2- 172.21.15.133:0/486860435 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efdf00553b0 0x7efdf0057870 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7efe0c00d000 tx=0x7efe0c001140).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:06.766 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.763+0000 7efdff7fe700 1 -- 172.21.15.133:0/486860435 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7efe10147240 con 0x7efe100b7910 2021-01-03T13:08:06.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.903+0000 7efe17347700 1 -- 172.21.15.133:0/486860435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efe10147240 con 0x7efe100b7910 2021-01-03T13:08:06.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.903+0000 7efdff7fe700 1 -- 172.21.15.133:0/486860435 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v162) v1 ==== 100+0+10 (secure 0 0 0) 0x7efe10147240 con 0x7efe100b7910 2021-01-03T13:08:06.906 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 8 2021-01-03T13:08:06.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.903+0000 7efe17347700 1 -- 172.21.15.133:0/486860435 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efdf00553b0 msgr2=0x7efdf0057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.903+0000 7efe17347700 1 --2- 172.21.15.133:0/486860435 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efdf00553b0 0x7efdf0057870 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7efe0c00d000 tx=0x7efe0c001140).stop 2021-01-03T13:08:06.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.903+0000 7efe17347700 1 -- 172.21.15.133:0/486860435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe100b7910 msgr2=0x7efe10061940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:06.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.903+0000 7efe17347700 1 --2- 172.21.15.133:0/486860435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe100b7910 0x7efe10061940 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7efe1009ca30 tx=0x7efe080091a0).stop 2021-01-03T13:08:06.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.903+0000 7efe17347700 1 -- 172.21.15.133:0/486860435 shutdown_connections 2021-01-03T13:08:06.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.903+0000 7efe17347700 1 --2- 172.21.15.133:0/486860435 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7efdf00553b0 0x7efdf0057870 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.903+0000 7efe17347700 1 --2- 172.21.15.133:0/486860435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe100b7910 0x7efe10061940 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.903+0000 7efe17347700 1 --2- 172.21.15.133:0/486860435 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7efe100b1f30 0x7efe10147980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.903+0000 7efe17347700 1 --2- 172.21.15.133:0/486860435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe100b3670 0x7efe10061450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:06.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.903+0000 7efe17347700 1 -- 172.21.15.133:0/486860435 >> 172.21.15.133:0/486860435 conn(0x7efe1005c8c0 msgr2=0x7efe10142d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.903+0000 7efe17347700 1 -- 172.21.15.133:0/486860435 shutdown_connections 2021-01-03T13:08:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:06.903+0000 7efe17347700 1 -- 172.21.15.133:0/486860435 wait complete. 2021-01-03T13:08:06.918 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2021-01-03T13:08:06.919 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:08:07.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064a98f700 1 Processor -- start 2021-01-03T13:08:07.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064a98f700 1 -- start start 2021-01-03T13:08:07.037 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064a98f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06440606f0 0x7f0644060ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:07.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064a98f700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06440b1210 con 0x7f0644143050 2021-01-03T13:08:07.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064a98f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06440afd30 con 0x7f06440b0ac0 2021-01-03T13:08:07.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064a98f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06440afa90 con 0x7f06440606f0 2021-01-03T13:08:07.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064918c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f06440b0ac0 0x7f06440abc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33806/0 (socket says 172.21.15.133:33806) 2021-01-03T13:08:07.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064918c700 1 -- 172.21.15.133:0/4027573891 learned_addr learned my addr 172.21.15.133:0/4027573891 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:08:07.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064998d700 1 --2- 172.21.15.133:0/4027573891 >> v2:172.21.15.133:3300/0 conn(0x7f06440606f0 0x7f0644060ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:07.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064898b700 1 -- 172.21.15.133:0/4027573891 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603517864 0 0) 0x7f06440afd30 con 0x7f06440b0ac0 2021-01-03T13:08:07.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064898b700 1 -- 172.21.15.133:0/4027573891 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f062c003230 con 0x7f06440b0ac0 2021-01-03T13:08:07.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064898b700 1 -- 172.21.15.133:0/4027573891 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347055454 0 0) 0x7f06440b1210 con 0x7f0644143050 2021-01-03T13:08:07.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064998d700 1 -- 172.21.15.133:0/4027573891 >> v1:172.21.15.133:6789/0 conn(0x7f06440b0ac0 legacy=0x7f06440abc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:07.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064998d700 1 -- 172.21.15.133:0/4027573891 >> v1:172.21.15.16:6789/0 conn(0x7f0644143050 legacy=0x7f06440aa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:07.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064998d700 1 -- 172.21.15.133:0/4027573891 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06440b1470 con 0x7f06440606f0 2021-01-03T13:08:07.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064998d700 1 --2- 172.21.15.133:0/4027573891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06440606f0 0x7f0644060ad0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f0634001870 tx=0x7f0640006dc0).ready entity=mon.1 client_cookie=9e4ae96e171d735b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:07.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064898b700 1 -- 172.21.15.133:0/4027573891 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06340016d0 con 0x7f06440606f0 2021-01-03T13:08:07.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064898b700 1 -- 172.21.15.133:0/4027573891 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0640009670 con 0x7f06440606f0 2021-01-03T13:08:07.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064898b700 1 -- 172.21.15.133:0/4027573891 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06400097e0 con 0x7f06440606f0 2021-01-03T13:08:07.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064a98f700 1 -- 172.21.15.133:0/4027573891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06440606f0 msgr2=0x7f0644060ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:07.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.035+0000 7f064a98f700 1 --2- 172.21.15.133:0/4027573891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06440606f0 0x7f0644060ad0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f0634001870 tx=0x7f0640006dc0).stop 2021-01-03T13:08:07.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.039+0000 7f064a98f700 1 -- 172.21.15.133:0/4027573891 shutdown_connections 2021-01-03T13:08:07.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.039+0000 7f064a98f700 1 --2- 172.21.15.133:0/4027573891 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06440606f0 0x7f0644060ad0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:07.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.039+0000 7f064a98f700 1 -- 172.21.15.133:0/4027573891 >> 172.21.15.133:0/4027573891 conn(0x7f064405bdf0 msgr2=0x7f064405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:07.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.039+0000 7f064a98f700 1 -- 172.21.15.133:0/4027573891 shutdown_connections 2021-01-03T13:08:07.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.039+0000 7f064a98f700 1 -- 172.21.15.133:0/4027573891 wait complete. 2021-01-03T13:08:07.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.039+0000 7f064a98f700 1 Processor -- start 2021-01-03T13:08:07.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.039+0000 7f064a98f700 1 -- start start 2021-01-03T13:08:07.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.039+0000 7f064a98f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06440606f0 0x7f064413f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:07.047 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.039+0000 7f064a98f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f06440b0ac0 0x7f0644152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:07.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.039+0000 7f064a98f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0644143050 0x7f0644153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:07.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.039+0000 7f064a98f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06440674d0 con 0x7f06440606f0 2021-01-03T13:08:07.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.039+0000 7f064a98f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0644066af0 con 0x7f0644143050 2021-01-03T13:08:07.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.039+0000 7f064a98f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0644142d50 con 0x7f06440b0ac0 2021-01-03T13:08:07.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.039+0000 7f064a18e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0644143050 0x7f0644153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:07.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.043+0000 7f064a18e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0644143050 0x7f0644153360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41016/0 (socket says 172.21.15.133:41016) 2021-01-03T13:08:07.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.043+0000 7f064a18e700 1 -- 172.21.15.133:0/1400332213 learned_addr learned my addr 172.21.15.133:0/1400332213 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:07.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.043+0000 7f064918c700 1 --2- 172.21.15.133:0/1400332213 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f06440b0ac0 0x7f0644152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:07.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.043+0000 7f064998d700 1 --2- 172.21.15.133:0/1400332213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06440606f0 0x7f064413f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:07.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.043+0000 7f064a18e700 1 -- 172.21.15.133:0/1400332213 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f06440b0ac0 msgr2=0x7f0644152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:07.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.043+0000 7f064a18e700 1 --2- 172.21.15.133:0/1400332213 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f06440b0ac0 0x7f0644152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:07.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.043+0000 7f064a18e700 1 -- 172.21.15.133:0/1400332213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06440606f0 msgr2=0x7f064413f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:07.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.043+0000 7f064a18e700 1 --2- 172.21.15.133:0/1400332213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06440606f0 0x7f064413f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:07.050 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.043+0000 7f064a18e700 1 -- 172.21.15.133:0/1400332213 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0644150520 con 0x7f0644143050 2021-01-03T13:08:07.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.043+0000 7f064a18e700 1 --2- 172.21.15.133:0/1400332213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0644143050 0x7f0644153360 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f063c001210 tx=0x7f063c007f50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:07.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.043+0000 7f0632ffd700 1 -- 172.21.15.133:0/1400332213 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f063c006860 con 0x7f0644143050 2021-01-03T13:08:07.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.043+0000 7f0632ffd700 1 -- 172.21.15.133:0/1400332213 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c0069c0 con 0x7f0644143050 2021-01-03T13:08:07.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.043+0000 7f064a98f700 1 -- 172.21.15.133:0/1400332213 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0644067150 con 0x7f0644143050 2021-01-03T13:08:07.051 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.043+0000 7f0632ffd700 1 -- 172.21.15.133:0/1400332213 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f063c006d20 con 0x7f0644143050 2021-01-03T13:08:07.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.043+0000 7f064a98f700 1 -- 172.21.15.133:0/1400332213 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064413f5f0 con 0x7f0644143050 2021-01-03T13:08:07.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.043+0000 7f064a98f700 1 -- 172.21.15.133:0/1400332213 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0644057300 con 0x7f0644143050 2021-01-03T13:08:07.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.043+0000 7f0632ffd700 1 -- 172.21.15.133:0/1400332213 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f063c010030 con 0x7f0644143050 2021-01-03T13:08:07.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.047+0000 7f0632ffd700 1 --2- 172.21.15.133:0/1400332213 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f06240554e0 0x7f06240579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:07.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.047+0000 7f0632ffd700 1 -- 172.21.15.133:0/1400332213 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f063c06dd30 con 0x7f0644143050 2021-01-03T13:08:07.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.047+0000 7f064998d700 1 --2- 172.21.15.133:0/1400332213 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f06240554e0 0x7f06240579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:07.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.047+0000 7f064998d700 1 --2- 172.21.15.133:0/1400332213 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f06240554e0 0x7f06240579a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f0640019000 tx=0x7f06440b1600).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:07.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.051+0000 7f0632ffd700 1 -- 172.21.15.133:0/1400332213 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f063c044030 con 0x7f0644143050 2021-01-03T13:08:07.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.235+0000 7f064a98f700 1 -- 172.21.15.133:0/1400332213 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0644066c30 con 0x7f0644143050 2021-01-03T13:08:07.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.239+0000 7f0632ffd700 1 -- 172.21.15.133:0/1400332213 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+2501 (secure 0 0 0) 0x7f063c003070 con 0x7f0644143050 2021-01-03T13:08:07.241 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:08:07.241 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":79,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/1043050023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1043050023},{"type":"v1","addr":"172.21.15.16:6833","nonce":1043050023}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76},{"gid":8488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1327300036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1327300036},{"type":"v1","addr":"172.21.15.133:6835","nonce":1327300036}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:57.630488+0000","modified":"2021-01-03T13:07:59.321927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8494":{"gid":8494,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/3193569550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3193569550},{"type":"v1","addr":"172.21.15.133:6837","nonce":3193569550}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-01-03T13:08:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.243+0000 7f064a98f700 1 -- 172.21.15.133:0/1400332213 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f06240554e0 msgr2=0x7f06240579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.243+0000 7f064a98f700 1 --2- 172.21.15.133:0/1400332213 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f06240554e0 0x7f06240579a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f0640019000 tx=0x7f06440b1600).stop 2021-01-03T13:08:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.243+0000 7f064a98f700 1 -- 172.21.15.133:0/1400332213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0644143050 msgr2=0x7f0644153360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:07.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.243+0000 7f064a98f700 1 --2- 172.21.15.133:0/1400332213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0644143050 0x7f0644153360 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7f063c001210 tx=0x7f063c007f50).stop 2021-01-03T13:08:07.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.243+0000 7f064a98f700 1 -- 172.21.15.133:0/1400332213 shutdown_connections 2021-01-03T13:08:07.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.243+0000 7f064a98f700 1 --2- 172.21.15.133:0/1400332213 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f06240554e0 0x7f06240579a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:07.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.243+0000 7f064a98f700 1 --2- 172.21.15.133:0/1400332213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f06440606f0 0x7f064413f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:07.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.243+0000 7f064a98f700 1 --2- 172.21.15.133:0/1400332213 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0644143050 0x7f0644153360 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:07.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.243+0000 7f064a98f700 1 --2- 172.21.15.133:0/1400332213 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f06440b0ac0 0x7f0644152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:07.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.243+0000 7f064a98f700 1 -- 172.21.15.133:0/1400332213 >> 172.21.15.133:0/1400332213 conn(0x7f064405bdf0 msgr2=0x7f06440ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:07.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.243+0000 7f064a98f700 1 -- 172.21.15.133:0/1400332213 shutdown_connections 2021-01-03T13:08:07.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:07.243+0000 7f064a98f700 1 -- 172.21.15.133:0/1400332213 wait complete. 2021-01-03T13:08:07.248 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 79 2021-01-03T13:08:07.561 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2021-01-03T13:07:57.630488+0000', 'modified': '2021-01-03T13:07:59.321927+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8494}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8494': {'gid': 8494, 'name': 'a', 'rank': 0, 'incarnation': 77, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6837/3193569550', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6836', 'nonce': 3193569550}, {'type': 'v1', 'addr': '172.21.15.133:6837', 'nonce': 3193569550}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2021-01-03T13:08:07.562 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2021-01-03T13:08:07.562 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2021-01-03T13:08:07.692 INFO:teuthology.orchestra.run.smithi133.stdout:{"cluster_fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","whoami":0,"id":8494,"want_state":"up:active","state":"up:active","rank_uptime":10.046277065,"mdsmap_epoch":79,"osdmap_epoch":162,"osdmap_epoch_barrier":161,"uptime":14.400169391} 2021-01-03T13:08:07.693 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", "id": 8494, "mdsmap_epoch": 79, "osdmap_epoch": 162, "osdmap_epoch_barrier": 161, "rank_uptime": 10.046277065, "state": "up:active", "uptime": 14.400169391, "want_state": "up:active", "whoami": 0 } 2021-01-03T13:08:07.693 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2021-01-03T13:08:07.694 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2021-01-03T13:08:07.694 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi036.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2021-01-03T13:08:07.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:07.695 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:08:07.703 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:08:07.761 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:08:07.761 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:08:07.820 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:08:07.821 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:08:07.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:07.822 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:08:07.868 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2021-01-03T13:08:07.869 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:08:07.912 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:08:07.928 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:08:07.929 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:08:07.983 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:08:07.984 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:08:07.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:07.985 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:08:07.991 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:2021-01-03T13:08:07.990+0000 7f9b687020c0 -1 init, newargv = 0x5615c78f6d30 newargc=9ceph-fuse[12507]: starting ceph client 2021-01-03T13:08:07.992 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr: 2021-01-03T13:08:08.003 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[12507]: starting fuse 2021-01-03T13:08:08.515 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:08:08.518 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:08:08.520 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:08:08.523 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:08:09.098 DEBUG:teuthology.orchestra.run.smithi036:> sudo modprobe fuse 2021-01-03T13:08:09.114 INFO:teuthology.orchestra.run:Running command with timeout 30 2021-01-03T13:08:09.115 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2021-01-03T13:08:09.173 INFO:teuthology.orchestra.run.smithi036.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2021-01-03T13:08:09.174 DEBUG:teuthology.orchestra.run:got remote process result: 32 2021-01-03T13:08:09.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:09.176 DEBUG:teuthology.orchestra.run.smithi036:> ls /sys/fs/fuse/connections 2021-01-03T13:08:09.228 INFO:teuthology.orchestra.run.smithi036.stdout:50 2021-01-03T13:08:09.228 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2021-01-03T13:08:09.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:09.229 DEBUG:teuthology.orchestra.run.smithi036:> sudo python3 -c ' 2021-01-03T13:08:09.229 DEBUG:teuthology.orchestra.run.smithi036:> import glob 2021-01-03T13:08:09.230 DEBUG:teuthology.orchestra.run.smithi036:> import re 2021-01-03T13:08:09.230 DEBUG:teuthology.orchestra.run.smithi036:> import os 2021-01-03T13:08:09.231 DEBUG:teuthology.orchestra.run.smithi036:> import subprocess 2021-01-03T13:08:09.231 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:08:09.232 DEBUG:teuthology.orchestra.run.smithi036:> def find_socket(client_name): 2021-01-03T13:08:09.232 DEBUG:teuthology.orchestra.run.smithi036:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2021-01-03T13:08:09.232 DEBUG:teuthology.orchestra.run.smithi036:> files = glob.glob(asok_path) 2021-01-03T13:08:09.233 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:08:09.233 DEBUG:teuthology.orchestra.run.smithi036:> # Given a non-glob path, it better be there 2021-01-03T13:08:09.234 DEBUG:teuthology.orchestra.run.smithi036:> if "*" not in asok_path: 2021-01-03T13:08:09.234 DEBUG:teuthology.orchestra.run.smithi036:> assert(len(files) == 1) 2021-01-03T13:08:09.234 DEBUG:teuthology.orchestra.run.smithi036:> return files[0] 2021-01-03T13:08:09.235 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:08:09.235 DEBUG:teuthology.orchestra.run.smithi036:> for f in files: 2021-01-03T13:08:09.235 DEBUG:teuthology.orchestra.run.smithi036:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2021-01-03T13:08:09.236 DEBUG:teuthology.orchestra.run.smithi036:> if os.path.exists("/proc/{0}".format(pid)): 2021-01-03T13:08:09.236 DEBUG:teuthology.orchestra.run.smithi036:> return f 2021-01-03T13:08:09.236 DEBUG:teuthology.orchestra.run.smithi036:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2021-01-03T13:08:09.237 DEBUG:teuthology.orchestra.run.smithi036:> 2021-01-03T13:08:09.237 DEBUG:teuthology.orchestra.run.smithi036:> print(find_socket("client.1")) 2021-01-03T13:08:09.238 DEBUG:teuthology.orchestra.run.smithi036:> ' 2021-01-03T13:08:09.320 INFO:teuthology.orchestra.run.smithi036.stdout:/var/run/ceph/ceph-client.1.12507.asok 2021-01-03T13:08:09.325 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.12507.asok 2021-01-03T13:08:09.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:09.327 DEBUG:teuthology.orchestra.run.smithi036:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.12507.asok status 2021-01-03T13:08:09.427 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2021-01-03T13:08:09.428 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": { 2021-01-03T13:08:09.428 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_sha1": "2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e", 2021-01-03T13:08:09.428 INFO:teuthology.orchestra.run.smithi036.stdout: "ceph_version": "ceph version 15.2.8-57-g2eacca1e (2eacca1efb80d3af604f7e9be47cd3ad5d9bc63e) octopus (stable)", 2021-01-03T13:08:09.428 INFO:teuthology.orchestra.run.smithi036.stdout: "entity_id": "1", 2021-01-03T13:08:09.429 INFO:teuthology.orchestra.run.smithi036.stdout: "hostname": "smithi036", 2021-01-03T13:08:09.429 INFO:teuthology.orchestra.run.smithi036.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2021-01-03T13:08:09.429 INFO:teuthology.orchestra.run.smithi036.stdout: "pid": "12507", 2021-01-03T13:08:09.429 INFO:teuthology.orchestra.run.smithi036.stdout: "root": "/" 2021-01-03T13:08:09.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:08:09.430 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_count": 0, 2021-01-03T13:08:09.430 INFO:teuthology.orchestra.run.smithi036.stdout: "dentry_pinned_count": 0, 2021-01-03T13:08:09.430 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 8511, 2021-01-03T13:08:09.430 INFO:teuthology.orchestra.run.smithi036.stdout: "inst": { 2021-01-03T13:08:09.431 INFO:teuthology.orchestra.run.smithi036.stdout: "name": { 2021-01-03T13:08:09.431 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "client", 2021-01-03T13:08:09.431 INFO:teuthology.orchestra.run.smithi036.stdout: "num": 8511 2021-01-03T13:08:09.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:08:09.431 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:08:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:08:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:08:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 275883166 2021-01-03T13:08:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: } 2021-01-03T13:08:09.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:08:09.433 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": { 2021-01-03T13:08:09.433 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2021-01-03T13:08:09.433 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:0", 2021-01-03T13:08:09.433 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 275883166 2021-01-03T13:08:09.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2021-01-03T13:08:09.434 INFO:teuthology.orchestra.run.smithi036.stdout: "inst_str": "client.8511 172.21.15.36:0/275883166", 2021-01-03T13:08:09.434 INFO:teuthology.orchestra.run.smithi036.stdout: "addr_str": "172.21.15.36:0/275883166", 2021-01-03T13:08:09.434 INFO:teuthology.orchestra.run.smithi036.stdout: "inode_count": 1, 2021-01-03T13:08:09.434 INFO:teuthology.orchestra.run.smithi036.stdout: "mds_epoch": 79, 2021-01-03T13:08:09.434 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch": 162, 2021-01-03T13:08:09.435 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_epoch_barrier": 0, 2021-01-03T13:08:09.435 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklisted": false, 2021-01-03T13:08:09.435 INFO:teuthology.orchestra.run.smithi036.stdout: "fs_name": "cephfs" 2021-01-03T13:08:09.435 INFO:teuthology.orchestra.run.smithi036.stdout:} 2021-01-03T13:08:09.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:09.437 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:08:09.438 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:08:09.445 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:08:09.446 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:08:09.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:09.447 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:08:09.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:09.508 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:08:09.508 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:08:09.557 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:08:09.558 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:08:09.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:09.559 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:08:09.559 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:08:09.609 INFO:teuthology.orchestra.run.smithi036.stdout:fuseblk 2021-01-03T13:08:09.610 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2021-01-03T13:08:09.610 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi036.front.sepia.ceph.com... 2021-01-03T13:08:09.611 INFO:teuthology.orchestra.run:Running command with timeout 1800 2021-01-03T13:08:09.611 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:08:09.690 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi036.stderr:ceph-fuse[12507]: fuse finished with error 0 and tester_r 0 2021-01-03T13:08:09.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:09.693 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:08:09.693 DEBUG:teuthology.orchestra.run.smithi036:> ' -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:08:09.740 INFO:teuthology.orchestra.run.smithi036.stdout:ext2/ext3 2021-01-03T13:08:09.741 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2021-01-03T13:08:09.741 INFO:teuthology.orchestra.run:waiting for 900 2021-01-03T13:08:09.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2021-01-03T13:08:09.784 DEBUG:teuthology.orchestra.run.smithi036:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2021-01-03T13:08:09.791 INFO:teuthology.orchestra.run:Running command with timeout 10800 2021-01-03T13:08:09.791 DEBUG:teuthology.orchestra.run.smithi007:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-01-03T13:08:09.811 INFO:teuthology.orchestra.run.smithi007.stdout: File: "." 2021-01-03T13:08:09.811 INFO:teuthology.orchestra.run.smithi007.stdout: ID: 0 Namelen: 255 Type: fuseblk 2021-01-03T13:08:09.812 INFO:teuthology.orchestra.run.smithi007.stdout:Block size: 4194304 Fundamental block size: 4194304 2021-01-03T13:08:09.812 INFO:teuthology.orchestra.run.smithi007.stdout:Blocks: Total: 86526 Free: 86526 Available: 86526 2021-01-03T13:08:09.812 INFO:teuthology.orchestra.run.smithi007.stdout:Inodes: Total: 1 Free: 0 2021-01-03T13:08:09.813 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2021-01-03T13:08:09.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f526c7700 1 Processor -- start 2021-01-03T13:08:09.937 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f526c7700 1 -- start start 2021-01-03T13:08:09.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f526c7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f4c0b0c90 0x7f2f4c0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:09.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f526c7700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4c060da0 con 0x7f2f4c0b52c0 2021-01-03T13:08:09.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f526c7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4c0b0ad0 con 0x7f2f4c0b5c00 2021-01-03T13:08:09.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f526c7700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c067a90 con 0x7f2f4c0b0c90 2021-01-03T13:08:09.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f51ec6700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2f4c0b5c00 0x7f2f4c143eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33824/0 (socket says 172.21.15.133:33824) 2021-01-03T13:08:09.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f51ec6700 1 -- 172.21.15.133:0/3978219337 learned_addr learned my addr 172.21.15.133:0/3978219337 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:08:09.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f50ec4700 1 --2- 172.21.15.133:0/3978219337 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f4c0b0c90 0x7f2f4c0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:09.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 -- 172.21.15.133:0/3978219337 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937463413 0 0) 0x7f2f440010d0 con 0x7f2f4c0b5c00 2021-01-03T13:08:09.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 -- 172.21.15.133:0/3978219337 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f38003230 con 0x7f2f4c0b5c00 2021-01-03T13:08:09.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 -- 172.21.15.133:0/3978219337 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355064187 0 0) 0x7f2f4c060da0 con 0x7f2f4c0b52c0 2021-01-03T13:08:09.942 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 -- 172.21.15.133:0/3978219337 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f440010d0 con 0x7f2f4c0b52c0 2021-01-03T13:08:09.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 -- 172.21.15.133:0/3978219337 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 471954259 0 0) 0x7f2f38003230 con 0x7f2f4c0b5c00 2021-01-03T13:08:09.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 -- 172.21.15.133:0/3978219337 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f4c0b0c90 msgr2=0x7f2f4c0b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:09.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 --2- 172.21.15.133:0/3978219337 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f4c0b0c90 0x7f2f4c0b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:09.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 -- 172.21.15.133:0/3978219337 >> v1:172.21.15.16:6789/0 conn(0x7f2f4c0b52c0 legacy=0x7f2f4c098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:09.943 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 -- 172.21.15.133:0/3978219337 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c0b56a0 con 0x7f2f4c0b5c00 2021-01-03T13:08:09.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 -- 172.21.15.133:0/3978219337 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f2f44001860 con 0x7f2f4c0b5c00 2021-01-03T13:08:09.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 -- 172.21.15.133:0/3978219337 >> v1:172.21.15.133:6789/0 conn(0x7f2f4c0b5c00 legacy=0x7f2f4c143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:09.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 --2- 172.21.15.133:0/3978219337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f380038b0 0x7f2f38003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:09.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 --2- 172.21.15.133:0/3978219337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f380044d0 0x7f2f38004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:09.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 --2- 172.21.15.133:0/3978219337 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f4c0b0c90 0x7f2f38004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:09.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 -- 172.21.15.133:0/3978219337 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c067a90 con 0x7f2f380038b0 2021-01-03T13:08:09.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 -- 172.21.15.133:0/3978219337 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f38005330 con 0x7f2f380044d0 2021-01-03T13:08:09.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 -- 172.21.15.133:0/3978219337 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3800b750 con 0x7f2f4c0b0c90 2021-01-03T13:08:09.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f50ec4700 1 --2- 172.21.15.133:0/3978219337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f380044d0 0x7f2f38004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:09.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f51ec6700 1 --2- 172.21.15.133:0/3978219337 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f4c0b0c90 0x7f2f38004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:09.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f516c5700 1 --2- 172.21.15.133:0/3978219337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f380038b0 0x7f2f38003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:09.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f50ec4700 1 -- 172.21.15.133:0/3978219337 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f4c0b0c90 msgr2=0x7f2f38004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:09.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f50ec4700 1 --2- 172.21.15.133:0/3978219337 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f4c0b0c90 0x7f2f38004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:09.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f50ec4700 1 -- 172.21.15.133:0/3978219337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f380038b0 msgr2=0x7f2f38003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:09.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f50ec4700 1 --2- 172.21.15.133:0/3978219337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f380038b0 0x7f2f38003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:09.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f50ec4700 1 -- 172.21.15.133:0/3978219337 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f38003230 con 0x7f2f380044d0 2021-01-03T13:08:09.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f516c5700 1 --2- 172.21.15.133:0/3978219337 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f380038b0 0x7f2f38003cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:08:09.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f51ec6700 1 --2- 172.21.15.133:0/3978219337 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f4c0b0c90 0x7f2f38004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:08:09.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f50ec4700 1 --2- 172.21.15.133:0/3978219337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f380044d0 0x7f2f38004950 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f2f4000c000 tx=0x7f2f40008040).ready entity=mon.1 client_cookie=1c5c5d3cf6698960 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:09.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 -- 172.21.15.133:0/3978219337 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f4000e970 con 0x7f2f380044d0 2021-01-03T13:08:09.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 -- 172.21.15.133:0/3978219337 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4000ead0 con 0x7f2f380044d0 2021-01-03T13:08:09.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f526c7700 1 -- 172.21.15.133:0/3978219337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f380044d0 msgr2=0x7f2f38004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:09.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f4bfff700 1 -- 172.21.15.133:0/3978219337 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f4000ee30 con 0x7f2f380044d0 2021-01-03T13:08:09.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.935+0000 7f2f526c7700 1 --2- 172.21.15.133:0/3978219337 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f380044d0 0x7f2f38004950 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f2f4000c000 tx=0x7f2f40008040).stop 2021-01-03T13:08:09.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f51ec6700 1 -- 172.21.15.133:0/3978219337 reap_dead start 2021-01-03T13:08:09.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f526c7700 1 -- 172.21.15.133:0/3978219337 shutdown_connections 2021-01-03T13:08:09.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f526c7700 1 -- 172.21.15.133:0/3978219337 >> 172.21.15.133:0/3978219337 conn(0x7f2f4c05bdf0 msgr2=0x7f2f4c05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:09.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f526c7700 1 -- 172.21.15.133:0/3978219337 shutdown_connections 2021-01-03T13:08:09.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f526c7700 1 -- 172.21.15.133:0/3978219337 wait complete. 2021-01-03T13:08:09.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f526c7700 1 Processor -- start 2021-01-03T13:08:09.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f526c7700 1 -- start start 2021-01-03T13:08:09.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f526c7700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f4c0658c0 0x7f2f4c064d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:09.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f526c7700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f4c064300 0x7f2f4c1442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:09.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f526c7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f4c067200 0x7f2f4c144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:09.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f526c7700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c0669f0 con 0x7f2f4c0658c0 2021-01-03T13:08:09.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f526c7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c065ca0 con 0x7f2f4c067200 2021-01-03T13:08:09.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f526c7700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c156f60 con 0x7f2f4c064300 2021-01-03T13:08:09.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f51ec6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f4c067200 0x7f2f4c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:09.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f51ec6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f4c067200 0x7f2f4c144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41032/0 (socket says 172.21.15.133:41032) 2021-01-03T13:08:09.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f51ec6700 1 -- 172.21.15.133:0/1255715147 learned_addr learned my addr 172.21.15.133:0/1255715147 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:09.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f516c5700 1 --2- 172.21.15.133:0/1255715147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f4c0658c0 0x7f2f4c064d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:09.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f50ec4700 1 --2- 172.21.15.133:0/1255715147 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f4c064300 0x7f2f4c1442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:09.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f51ec6700 1 -- 172.21.15.133:0/1255715147 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f4c064300 msgr2=0x7f2f4c1442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:09.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f51ec6700 1 --2- 172.21.15.133:0/1255715147 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f4c064300 0x7f2f4c1442a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:09.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f51ec6700 1 -- 172.21.15.133:0/1255715147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f4c0658c0 msgr2=0x7f2f4c064d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:09.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f51ec6700 1 --2- 172.21.15.133:0/1255715147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f4c0658c0 0x7f2f4c064d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:09.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f51ec6700 1 -- 172.21.15.133:0/1255715147 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c0aa190 con 0x7f2f4c067200 2021-01-03T13:08:09.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.939+0000 7f2f51ec6700 1 --2- 172.21.15.133:0/1255715147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f4c067200 0x7f2f4c144790 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f2f4c14b2a0 tx=0x7f2f44009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:09.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.943+0000 7f2f4a7fc700 1 -- 172.21.15.133:0/1255715147 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f44007170 con 0x7f2f4c067200 2021-01-03T13:08:09.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.943+0000 7f2f4a7fc700 1 -- 172.21.15.133:0/1255715147 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f440072d0 con 0x7f2f4c067200 2021-01-03T13:08:09.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.943+0000 7f2f4a7fc700 1 -- 172.21.15.133:0/1255715147 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f440047a0 con 0x7f2f4c067200 2021-01-03T13:08:09.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.943+0000 7f2f526c7700 1 -- 172.21.15.133:0/1255715147 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4c0aa430 con 0x7f2f4c067200 2021-01-03T13:08:09.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.943+0000 7f2f526c7700 1 -- 172.21.15.133:0/1255715147 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4c14a920 con 0x7f2f4c067200 2021-01-03T13:08:09.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.943+0000 7f2f526c7700 1 -- 172.21.15.133:0/1255715147 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4c063ff0 con 0x7f2f4c067200 2021-01-03T13:08:09.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.943+0000 7f2f4a7fc700 1 -- 172.21.15.133:0/1255715147 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2f44004900 con 0x7f2f4c067200 2021-01-03T13:08:09.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.943+0000 7f2f4a7fc700 1 --2- 172.21.15.133:0/1255715147 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f2c055440 0x7f2f2c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:09.958 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.943+0000 7f2f4a7fc700 1 -- 172.21.15.133:0/1255715147 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2f4406cf80 con 0x7f2f4c067200 2021-01-03T13:08:09.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.943+0000 7f2f516c5700 1 --2- 172.21.15.133:0/1255715147 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f2c055440 0x7f2f2c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:09.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.947+0000 7f2f516c5700 1 --2- 172.21.15.133:0/1255715147 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f2c055440 0x7f2f2c057900 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f2f3c00e000 tx=0x7f2f3c009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:09.959 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:09.951+0000 7f2f4a7fc700 1 -- 172.21.15.133:0/1255715147 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2f44043280 con 0x7f2f4c067200 2021-01-03T13:08:10.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.091+0000 7f2f526c7700 1 -- 172.21.15.133:0/1255715147 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2f4c0b0ad0 con 0x7f2f4c067200 2021-01-03T13:08:10.098 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.095+0000 7f2f4a7fc700 1 -- 172.21.15.133:0/1255715147 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v162) v1 ==== 81+0+33707 (secure 0 0 0) 0x7f2f4c0b0ad0 con 0x7f2f4c067200 2021-01-03T13:08:10.099 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:08:10.099 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:08:10.100 INFO:teuthology.orchestra.run.smithi133.stdout: "epoch": 162, 2021-01-03T13:08:10.100 INFO:teuthology.orchestra.run.smithi133.stdout: "fsid": "80bc9ef3-5820-4b9f-9c57-8f734e4c440e", 2021-01-03T13:08:10.100 INFO:teuthology.orchestra.run.smithi133.stdout: "created": "2021-01-03T12:57:43.298835+0000", 2021-01-03T13:08:10.100 INFO:teuthology.orchestra.run.smithi133.stdout: "modified": "2021-01-03T13:07:59.636463+0000", 2021-01-03T13:08:10.100 INFO:teuthology.orchestra.run.smithi133.stdout: "last_up_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:08:10.101 INFO:teuthology.orchestra.run.smithi133.stdout: "last_in_change": "2021-01-03T12:57:51.052544+0000", 2021-01-03T13:08:10.101 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2021-01-03T13:08:10.101 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_num": 5799936, 2021-01-03T13:08:10.101 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_set": [ 2021-01-03T13:08:10.102 INFO:teuthology.orchestra.run.smithi133.stdout: "pglog_hardlimit", 2021-01-03T13:08:10.102 INFO:teuthology.orchestra.run.smithi133.stdout: "purged_snapdirs", 2021-01-03T13:08:10.102 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_deletes", 2021-01-03T13:08:10.102 INFO:teuthology.orchestra.run.smithi133.stdout: "sortbitwise" 2021-01-03T13:08:10.102 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:08:10.103 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_version": 4, 2021-01-03T13:08:10.103 INFO:teuthology.orchestra.run.smithi133.stdout: "full_ratio": 0.94999998807907104, 2021-01-03T13:08:10.103 INFO:teuthology.orchestra.run.smithi133.stdout: "backfillfull_ratio": 0.89999997615814209, 2021-01-03T13:08:10.103 INFO:teuthology.orchestra.run.smithi133.stdout: "nearfull_ratio": 0.85000002384185791, 2021-01-03T13:08:10.104 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_snapshot": "", 2021-01-03T13:08:10.104 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_max": 30, 2021-01-03T13:08:10.104 INFO:teuthology.orchestra.run.smithi133.stdout: "max_osd": 8, 2021-01-03T13:08:10.104 INFO:teuthology.orchestra.run.smithi133.stdout: "require_min_compat_client": "jewel", 2021-01-03T13:08:10.104 INFO:teuthology.orchestra.run.smithi133.stdout: "min_compat_client": "jewel", 2021-01-03T13:08:10.105 INFO:teuthology.orchestra.run.smithi133.stdout: "require_osd_release": "octopus", 2021-01-03T13:08:10.105 INFO:teuthology.orchestra.run.smithi133.stdout: "pools": [ 2021-01-03T13:08:10.105 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.105 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 1, 2021-01-03T13:08:10.105 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "device_health_metrics", 2021-01-03T13:08:10.106 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:47.102954+0000", 2021-01-03T13:08:10.106 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:08:10.106 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:08:10.106 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:08:10.107 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:08:10.107 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:08:10.107 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:08:10.107 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:08:10.107 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:08:10.108 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 1, 2021-01-03T13:08:10.108 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 1, 2021-01-03T13:08:10.108 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 1, 2021-01-03T13:08:10.108 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 1, 2021-01-03T13:08:10.108 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 1, 2021-01-03T13:08:10.109 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:08:10.109 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:08:10.109 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:08:10.109 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:08:10.109 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:08:10.110 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:08:10.110 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:08:10.110 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.110 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "16", 2021-01-03T13:08:10.111 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:08:10.111 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:08:10.111 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:08:10.111 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:08:10.111 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:08:10.112 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:08:10.112 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:08:10.112 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:08:10.112 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:08:10.112 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:08:10.113 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:08:10.113 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:08:10.113 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:08:10.113 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:08:10.113 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:08:10.114 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:08:10.114 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:08:10.114 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:08:10.114 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:08:10.115 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:08:10.115 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:08:10.115 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:08:10.115 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:08:10.115 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:08:10.116 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:08:10.116 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:08:10.116 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.116 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:08:10.116 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:08:10.117 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:08:10.117 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:08:10.117 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:08:10.117 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:08:10.118 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:08:10.118 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:08:10.118 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:08:10.118 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:08:10.118 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:08:10.119 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:08:10.119 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 1 2021-01-03T13:08:10.119 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.119 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:08:10.120 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr_devicehealth": {} 2021-01-03T13:08:10.120 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.120 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.120 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.120 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 2, 2021-01-03T13:08:10.121 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "rbd", 2021-01-03T13:08:10.121 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T12:57:55.472799+0000", 2021-01-03T13:08:10.121 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:08:10.122 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:08:10.122 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:08:10.122 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:08:10.122 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:08:10.122 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:08:10.123 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:08:10.123 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:08:10.123 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:08:10.123 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:08:10.124 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:08:10.124 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:08:10.124 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:08:10.124 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:08:10.124 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:08:10.125 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:08:10.125 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:08:10.125 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:08:10.125 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:08:10.125 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:08:10.126 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.126 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "19", 2021-01-03T13:08:10.126 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:08:10.126 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:08:10.126 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:08:10.127 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:08:10.127 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:08:10.127 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:08:10.127 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:08:10.127 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:08:10.128 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:08:10.128 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:08:10.128 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:08:10.128 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:08:10.128 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:08:10.129 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:08:10.129 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:08:10.129 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:08:10.129 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:08:10.130 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:08:10.130 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:08:10.130 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:08:10.130 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:08:10.131 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:08:10.131 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:08:10.131 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:08:10.131 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:08:10.131 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:08:10.132 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.132 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:08:10.132 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:08:10.132 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:08:10.133 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:08:10.133 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:08:10.133 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:08:10.134 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:08:10.134 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:08:10.134 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:08:10.134 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:08:10.134 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:08:10.135 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:08:10.135 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:08:10.135 INFO:teuthology.orchestra.run.smithi133.stdout: "rbd": {} 2021-01-03T13:08:10.135 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.136 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 29, 2021-01-03T13:08:10.136 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_metadata", 2021-01-03T13:08:10.136 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:07:56.170759+0000", 2021-01-03T13:08:10.137 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:08:10.137 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:08:10.137 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:08:10.137 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:08:10.137 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:08:10.138 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:08:10.138 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:08:10.138 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:08:10.138 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:08:10.139 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:08:10.139 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:08:10.139 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:08:10.140 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:08:10.140 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:08:10.140 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:08:10.140 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:08:10.140 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:08:10.141 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:08:10.141 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:08:10.141 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:08:10.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.141 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "160", 2021-01-03T13:08:10.142 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:08:10.142 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:08:10.142 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:08:10.142 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:08:10.143 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:08:10.143 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:08:10.143 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:08:10.143 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:08:10.143 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:08:10.144 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:08:10.144 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:08:10.144 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:08:10.144 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:08:10.144 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:08:10.145 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:08:10.145 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:08:10.145 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:08:10.145 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:08:10.145 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:08:10.146 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:08:10.146 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:08:10.146 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:08:10.146 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:08:10.146 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:08:10.147 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:08:10.147 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:08:10.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.147 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:08:10.147 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:08:10.148 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:08:10.148 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:08:10.148 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:08:10.148 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:08:10.148 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:08:10.149 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:08:10.149 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:08:10.149 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:08:10.149 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:08:10.149 INFO:teuthology.orchestra.run.smithi133.stdout: "options": { 2021-01-03T13:08:10.150 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_bias": 4, 2021-01-03T13:08:10.150 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_min": 16, 2021-01-03T13:08:10.150 INFO:teuthology.orchestra.run.smithi133.stdout: "recovery_priority": 5 2021-01-03T13:08:10.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.150 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:08:10.151 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:08:10.151 INFO:teuthology.orchestra.run.smithi133.stdout: "metadata": "cephfs" 2021-01-03T13:08:10.151 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.151 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.152 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.152 INFO:teuthology.orchestra.run.smithi133.stdout: "pool": 30, 2021-01-03T13:08:10.152 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_name": "cephfs_data", 2021-01-03T13:08:10.152 INFO:teuthology.orchestra.run.smithi133.stdout: "create_time": "2021-01-03T13:07:56.676733+0000", 2021-01-03T13:08:10.152 INFO:teuthology.orchestra.run.smithi133.stdout: "flags": 1, 2021-01-03T13:08:10.153 INFO:teuthology.orchestra.run.smithi133.stdout: "flags_names": "hashpspool", 2021-01-03T13:08:10.153 INFO:teuthology.orchestra.run.smithi133.stdout: "type": 1, 2021-01-03T13:08:10.153 INFO:teuthology.orchestra.run.smithi133.stdout: "size": 2, 2021-01-03T13:08:10.153 INFO:teuthology.orchestra.run.smithi133.stdout: "min_size": 1, 2021-01-03T13:08:10.154 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_rule": 0, 2021-01-03T13:08:10.154 INFO:teuthology.orchestra.run.smithi133.stdout: "object_hash": 2, 2021-01-03T13:08:10.154 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_autoscale_mode": "off", 2021-01-03T13:08:10.154 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num": 8, 2021-01-03T13:08:10.154 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num": 8, 2021-01-03T13:08:10.155 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_placement_num_target": 8, 2021-01-03T13:08:10.155 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_target": 8, 2021-01-03T13:08:10.155 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_num_pending": 8, 2021-01-03T13:08:10.155 INFO:teuthology.orchestra.run.smithi133.stdout: "last_pg_merge_meta": { 2021-01-03T13:08:10.155 INFO:teuthology.orchestra.run.smithi133.stdout: "source_pgid": "0.0", 2021-01-03T13:08:10.156 INFO:teuthology.orchestra.run.smithi133.stdout: "ready_epoch": 0, 2021-01-03T13:08:10.156 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_started": 0, 2021-01-03T13:08:10.156 INFO:teuthology.orchestra.run.smithi133.stdout: "last_epoch_clean": 0, 2021-01-03T13:08:10.156 INFO:teuthology.orchestra.run.smithi133.stdout: "source_version": "0'0", 2021-01-03T13:08:10.156 INFO:teuthology.orchestra.run.smithi133.stdout: "target_version": "0'0" 2021-01-03T13:08:10.157 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.157 INFO:teuthology.orchestra.run.smithi133.stdout: "last_change": "162", 2021-01-03T13:08:10.157 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend": "0", 2021-01-03T13:08:10.157 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_prenautilus": "0", 2021-01-03T13:08:10.157 INFO:teuthology.orchestra.run.smithi133.stdout: "last_force_op_resend_preluminous": "0", 2021-01-03T13:08:10.158 INFO:teuthology.orchestra.run.smithi133.stdout: "auid": 0, 2021-01-03T13:08:10.158 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_mode": "selfmanaged", 2021-01-03T13:08:10.158 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_seq": 0, 2021-01-03T13:08:10.158 INFO:teuthology.orchestra.run.smithi133.stdout: "snap_epoch": 0, 2021-01-03T13:08:10.158 INFO:teuthology.orchestra.run.smithi133.stdout: "pool_snaps": [], 2021-01-03T13:08:10.159 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps": "[]", 2021-01-03T13:08:10.159 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_bytes": 0, 2021-01-03T13:08:10.159 INFO:teuthology.orchestra.run.smithi133.stdout: "quota_max_objects": 0, 2021-01-03T13:08:10.159 INFO:teuthology.orchestra.run.smithi133.stdout: "tiers": [], 2021-01-03T13:08:10.159 INFO:teuthology.orchestra.run.smithi133.stdout: "tier_of": -1, 2021-01-03T13:08:10.160 INFO:teuthology.orchestra.run.smithi133.stdout: "read_tier": -1, 2021-01-03T13:08:10.160 INFO:teuthology.orchestra.run.smithi133.stdout: "write_tier": -1, 2021-01-03T13:08:10.160 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_mode": "none", 2021-01-03T13:08:10.160 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_bytes": 0, 2021-01-03T13:08:10.160 INFO:teuthology.orchestra.run.smithi133.stdout: "target_max_objects": 0, 2021-01-03T13:08:10.161 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_ratio_micro": 400000, 2021-01-03T13:08:10.161 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2021-01-03T13:08:10.161 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_target_full_ratio_micro": 800000, 2021-01-03T13:08:10.161 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_flush_age": 0, 2021-01-03T13:08:10.161 INFO:teuthology.orchestra.run.smithi133.stdout: "cache_min_evict_age": 0, 2021-01-03T13:08:10.162 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profile": "", 2021-01-03T13:08:10.162 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_params": { 2021-01-03T13:08:10.162 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "none" 2021-01-03T13:08:10.162 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.162 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_period": 0, 2021-01-03T13:08:10.163 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_count": 0, 2021-01-03T13:08:10.163 INFO:teuthology.orchestra.run.smithi133.stdout: "use_gmt_hitset": true, 2021-01-03T13:08:10.163 INFO:teuthology.orchestra.run.smithi133.stdout: "min_read_recency_for_promote": 0, 2021-01-03T13:08:10.163 INFO:teuthology.orchestra.run.smithi133.stdout: "min_write_recency_for_promote": 0, 2021-01-03T13:08:10.163 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_grade_decay_rate": 0, 2021-01-03T13:08:10.164 INFO:teuthology.orchestra.run.smithi133.stdout: "hit_set_search_last_n": 0, 2021-01-03T13:08:10.164 INFO:teuthology.orchestra.run.smithi133.stdout: "grade_table": [], 2021-01-03T13:08:10.164 INFO:teuthology.orchestra.run.smithi133.stdout: "stripe_width": 0, 2021-01-03T13:08:10.164 INFO:teuthology.orchestra.run.smithi133.stdout: "expected_num_objects": 0, 2021-01-03T13:08:10.164 INFO:teuthology.orchestra.run.smithi133.stdout: "fast_read": false, 2021-01-03T13:08:10.165 INFO:teuthology.orchestra.run.smithi133.stdout: "options": {}, 2021-01-03T13:08:10.165 INFO:teuthology.orchestra.run.smithi133.stdout: "application_metadata": { 2021-01-03T13:08:10.165 INFO:teuthology.orchestra.run.smithi133.stdout: "cephfs": { 2021-01-03T13:08:10.165 INFO:teuthology.orchestra.run.smithi133.stdout: "data": "cephfs" 2021-01-03T13:08:10.165 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.166 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.166 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.166 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:08:10.166 INFO:teuthology.orchestra.run.smithi133.stdout: "osds": [ 2021-01-03T13:08:10.166 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.167 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:08:10.167 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a", 2021-01-03T13:08:10.167 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:08:10.167 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:08:10.167 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:08:10.168 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:08:10.168 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:08:10.168 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:08:10.168 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:08:10.168 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 159, 2021-01-03T13:08:10.169 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:08:10.169 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:08:10.169 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:08:10.169 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.169 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.170 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.170 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6810", 2021-01-03T13:08:10.170 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:08:10.170 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.170 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.171 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.171 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6811", 2021-01-03T13:08:10.171 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:08:10.171 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.171 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.172 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.172 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:08:10.172 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.172 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.172 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.173 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6812", 2021-01-03T13:08:10.173 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:08:10.173 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.173 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.173 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.174 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6813", 2021-01-03T13:08:10.174 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:08:10.174 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.174 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.174 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.175 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:08:10.175 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.175 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.175 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.175 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6816", 2021-01-03T13:08:10.176 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:08:10.176 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.176 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.176 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.176 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6817", 2021-01-03T13:08:10.177 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:08:10.177 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.177 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.177 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.178 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:08:10.178 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.178 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.178 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.178 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6814", 2021-01-03T13:08:10.179 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:08:10.179 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.179 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.179 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.179 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6815", 2021-01-03T13:08:10.180 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12124 2021-01-03T13:08:10.180 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.180 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.180 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.180 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6811/12124", 2021-01-03T13:08:10.181 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6813/12124", 2021-01-03T13:08:10.181 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6817/12124", 2021-01-03T13:08:10.181 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6815/12124", 2021-01-03T13:08:10.181 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:08:10.181 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:08:10.182 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:08:10.182 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.182 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.182 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.182 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:08:10.183 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9170d1de-58d4-4dfd-b9de-80dc15ca9e60", 2021-01-03T13:08:10.183 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:08:10.183 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:08:10.183 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:08:10.183 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:08:10.184 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:08:10.184 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:08:10.184 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:08:10.184 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 158, 2021-01-03T13:08:10.185 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:08:10.185 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:08:10.185 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:08:10.185 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.185 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.186 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.186 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6818", 2021-01-03T13:08:10.186 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:08:10.186 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.187 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.187 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.187 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6819", 2021-01-03T13:08:10.187 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:08:10.187 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.188 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.188 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.188 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:08:10.188 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.188 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.189 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.189 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6820", 2021-01-03T13:08:10.189 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:08:10.189 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.189 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.190 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.190 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6821", 2021-01-03T13:08:10.190 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:08:10.190 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.190 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.191 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.191 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:08:10.191 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.191 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.192 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.192 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6824", 2021-01-03T13:08:10.192 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:08:10.192 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.192 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.193 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.193 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6825", 2021-01-03T13:08:10.193 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:08:10.193 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.193 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.194 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.194 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:08:10.194 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.194 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.194 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.195 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6822", 2021-01-03T13:08:10.195 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:08:10.195 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.195 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.195 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.196 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6823", 2021-01-03T13:08:10.196 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12123 2021-01-03T13:08:10.196 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.196 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.196 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.197 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6819/12123", 2021-01-03T13:08:10.197 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6821/12123", 2021-01-03T13:08:10.197 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6825/12123", 2021-01-03T13:08:10.197 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6823/12123", 2021-01-03T13:08:10.197 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:08:10.198 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:08:10.198 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:08:10.198 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.198 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.199 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.199 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:08:10.199 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "9fc5adf9-3537-4953-9c65-0c67ecb53776", 2021-01-03T13:08:10.199 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:08:10.199 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:08:10.200 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:08:10.200 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:08:10.200 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:08:10.200 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:08:10.200 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:08:10.201 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 159, 2021-01-03T13:08:10.201 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:08:10.201 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:08:10.201 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:08:10.201 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.201 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.202 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.202 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6802", 2021-01-03T13:08:10.202 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:08:10.202 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.203 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.203 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.203 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6803", 2021-01-03T13:08:10.203 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:08:10.203 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.204 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.204 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.204 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:08:10.204 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.204 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.205 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.205 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6804", 2021-01-03T13:08:10.205 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:08:10.205 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.205 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.206 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.206 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6805", 2021-01-03T13:08:10.206 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:08:10.206 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.206 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.207 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.207 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:08:10.207 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.207 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.207 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.208 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6808", 2021-01-03T13:08:10.208 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:08:10.208 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.208 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.208 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.209 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6809", 2021-01-03T13:08:10.209 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:08:10.209 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.209 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.209 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.210 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:08:10.210 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.210 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.210 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.210 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6806", 2021-01-03T13:08:10.211 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:08:10.211 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.211 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.211 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.211 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6807", 2021-01-03T13:08:10.212 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12122 2021-01-03T13:08:10.212 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.212 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.212 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.212 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6803/12122", 2021-01-03T13:08:10.213 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6805/12122", 2021-01-03T13:08:10.213 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6809/12122", 2021-01-03T13:08:10.213 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6807/12122", 2021-01-03T13:08:10.213 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:08:10.213 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:08:10.214 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:08:10.214 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.214 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.214 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.215 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:08:10.215 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "0ad45ce5-6635-4089-bbf8-c966d0fe5338", 2021-01-03T13:08:10.215 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:08:10.215 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:08:10.215 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:08:10.216 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:08:10.216 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:08:10.216 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:08:10.216 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:08:10.216 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 160, 2021-01-03T13:08:10.217 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:08:10.217 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:08:10.217 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:08:10.217 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.217 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.218 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.218 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6826", 2021-01-03T13:08:10.218 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:08:10.218 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.218 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.219 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.219 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6827", 2021-01-03T13:08:10.219 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:08:10.219 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.219 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.220 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.220 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:08:10.220 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.220 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.220 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.221 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6828", 2021-01-03T13:08:10.221 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:08:10.221 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.221 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.221 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.222 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6829", 2021-01-03T13:08:10.222 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:08:10.222 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.222 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.223 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.223 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:08:10.223 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.223 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.223 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.224 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6832", 2021-01-03T13:08:10.224 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:08:10.224 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.224 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.224 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.224 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6833", 2021-01-03T13:08:10.225 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:08:10.225 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.225 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.225 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.225 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:08:10.226 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.226 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.226 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.226 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6830", 2021-01-03T13:08:10.227 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:08:10.227 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.227 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.227 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.227 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.133:6831", 2021-01-03T13:08:10.228 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12136 2021-01-03T13:08:10.228 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.228 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.228 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.228 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.133:6827/12136", 2021-01-03T13:08:10.229 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.133:6829/12136", 2021-01-03T13:08:10.229 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.133:6833/12136", 2021-01-03T13:08:10.229 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.133:6831/12136", 2021-01-03T13:08:10.229 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:08:10.229 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:08:10.230 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:08:10.230 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.230 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.230 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.230 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:08:10.231 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "86b8d6d5-271b-4a70-ae7b-a227afb38d7c", 2021-01-03T13:08:10.231 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:08:10.231 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:08:10.231 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:08:10.231 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:08:10.232 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:08:10.232 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:08:10.232 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:08:10.232 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 158, 2021-01-03T13:08:10.232 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:08:10.233 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:08:10.233 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:08:10.233 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.233 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.233 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.234 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6808", 2021-01-03T13:08:10.234 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:08:10.234 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.234 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.234 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.235 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6809", 2021-01-03T13:08:10.235 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:08:10.235 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.235 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.235 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.236 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:08:10.236 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.236 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.236 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.236 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6810", 2021-01-03T13:08:10.237 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:08:10.237 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.237 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.237 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.237 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6811", 2021-01-03T13:08:10.238 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:08:10.238 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.238 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.238 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.239 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:08:10.239 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.239 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.239 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.239 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6814", 2021-01-03T13:08:10.240 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:08:10.240 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.240 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.240 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.240 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6815", 2021-01-03T13:08:10.241 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:08:10.241 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.241 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.241 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.241 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:08:10.242 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.242 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.242 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.242 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6812", 2021-01-03T13:08:10.242 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:08:10.243 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.243 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.243 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.243 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6813", 2021-01-03T13:08:10.243 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12672 2021-01-03T13:08:10.244 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.244 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.244 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.244 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6809/12672", 2021-01-03T13:08:10.244 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6811/12672", 2021-01-03T13:08:10.245 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6815/12672", 2021-01-03T13:08:10.245 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6813/12672", 2021-01-03T13:08:10.245 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:08:10.245 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:08:10.245 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:08:10.246 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.246 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.246 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.246 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:08:10.246 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "173feb9d-f596-4030-85d8-1f4b46a9ffe5", 2021-01-03T13:08:10.247 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:08:10.247 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:08:10.247 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:08:10.247 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:08:10.247 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:08:10.248 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:08:10.248 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:08:10.248 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 159, 2021-01-03T13:08:10.248 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:08:10.248 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:08:10.249 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:08:10.249 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.249 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.249 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.249 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6817", 2021-01-03T13:08:10.250 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:08:10.250 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.250 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.250 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.251 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6819", 2021-01-03T13:08:10.251 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:08:10.251 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.251 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.251 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.251 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:08:10.252 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.252 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.252 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.252 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6820", 2021-01-03T13:08:10.252 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:08:10.253 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.253 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.253 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.253 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6822", 2021-01-03T13:08:10.253 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:08:10.254 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.254 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.254 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.254 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:08:10.254 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.255 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.255 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.255 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6828", 2021-01-03T13:08:10.255 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:08:10.256 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.256 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.256 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.256 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6830", 2021-01-03T13:08:10.256 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:08:10.257 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.257 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.257 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.257 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:08:10.257 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.258 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.258 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.258 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6824", 2021-01-03T13:08:10.258 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:08:10.258 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.259 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.259 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.259 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6826", 2021-01-03T13:08:10.259 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12673 2021-01-03T13:08:10.259 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.260 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.260 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.260 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6819/12673", 2021-01-03T13:08:10.260 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6822/12673", 2021-01-03T13:08:10.260 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6830/12673", 2021-01-03T13:08:10.261 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6826/12673", 2021-01-03T13:08:10.261 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:08:10.261 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:08:10.261 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:08:10.261 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.262 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.262 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.262 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:08:10.262 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "b487980e-ad4d-43c1-91fa-4845f7af3d4d", 2021-01-03T13:08:10.263 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:08:10.263 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:08:10.263 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:08:10.263 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:08:10.263 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:08:10.263 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:08:10.264 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:08:10.264 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 159, 2021-01-03T13:08:10.264 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:08:10.264 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:08:10.264 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:08:10.265 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.265 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.265 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.265 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6800", 2021-01-03T13:08:10.266 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:08:10.266 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.266 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.266 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.266 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6801", 2021-01-03T13:08:10.267 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:08:10.267 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.267 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.267 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.267 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:08:10.268 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.268 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.268 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.268 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6802", 2021-01-03T13:08:10.268 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:08:10.269 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.269 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.269 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.269 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6803", 2021-01-03T13:08:10.269 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:08:10.270 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.270 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.270 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.270 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:08:10.270 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.271 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.271 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.271 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6806", 2021-01-03T13:08:10.271 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:08:10.271 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.272 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.272 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.272 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6807", 2021-01-03T13:08:10.272 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:08:10.272 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.273 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.273 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.273 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:08:10.273 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.273 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.274 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.274 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6804", 2021-01-03T13:08:10.274 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:08:10.274 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.274 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.275 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.275 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6805", 2021-01-03T13:08:10.275 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12662 2021-01-03T13:08:10.275 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.275 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.276 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.276 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6801/12662", 2021-01-03T13:08:10.276 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6803/12662", 2021-01-03T13:08:10.276 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6807/12662", 2021-01-03T13:08:10.276 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6805/12662", 2021-01-03T13:08:10.277 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:08:10.277 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:08:10.277 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:08:10.277 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.277 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.278 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.278 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:08:10.278 INFO:teuthology.orchestra.run.smithi133.stdout: "uuid": "38ea839a-451f-4c09-a545-4514e049b178", 2021-01-03T13:08:10.278 INFO:teuthology.orchestra.run.smithi133.stdout: "up": 1, 2021-01-03T13:08:10.279 INFO:teuthology.orchestra.run.smithi133.stdout: "in": 1, 2021-01-03T13:08:10.279 INFO:teuthology.orchestra.run.smithi133.stdout: "weight": 1, 2021-01-03T13:08:10.279 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_affinity": 1, 2021-01-03T13:08:10.279 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_begin": 0, 2021-01-03T13:08:10.279 INFO:teuthology.orchestra.run.smithi133.stdout: "last_clean_end": 0, 2021-01-03T13:08:10.280 INFO:teuthology.orchestra.run.smithi133.stdout: "up_from": 14, 2021-01-03T13:08:10.280 INFO:teuthology.orchestra.run.smithi133.stdout: "up_thru": 159, 2021-01-03T13:08:10.280 INFO:teuthology.orchestra.run.smithi133.stdout: "down_at": 0, 2021-01-03T13:08:10.280 INFO:teuthology.orchestra.run.smithi133.stdout: "lost_at": 0, 2021-01-03T13:08:10.280 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addrs": { 2021-01-03T13:08:10.280 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.281 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.281 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.281 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6816", 2021-01-03T13:08:10.281 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:08:10.281 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.282 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.282 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.282 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6818", 2021-01-03T13:08:10.282 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:08:10.282 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.283 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.283 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.283 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addrs": { 2021-01-03T13:08:10.283 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.283 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.284 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.284 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6821", 2021-01-03T13:08:10.284 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:08:10.284 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.285 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.285 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.285 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6823", 2021-01-03T13:08:10.285 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:08:10.285 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.286 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.286 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.286 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addrs": { 2021-01-03T13:08:10.286 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.286 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.287 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.287 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6829", 2021-01-03T13:08:10.287 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:08:10.287 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.287 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.288 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.288 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6831", 2021-01-03T13:08:10.288 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:08:10.288 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.288 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.289 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.289 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addrs": { 2021-01-03T13:08:10.289 INFO:teuthology.orchestra.run.smithi133.stdout: "addrvec": [ 2021-01-03T13:08:10.289 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.289 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v2", 2021-01-03T13:08:10.290 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6825", 2021-01-03T13:08:10.290 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:08:10.290 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.290 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.290 INFO:teuthology.orchestra.run.smithi133.stdout: "type": "v1", 2021-01-03T13:08:10.291 INFO:teuthology.orchestra.run.smithi133.stdout: "addr": "172.21.15.16:6827", 2021-01-03T13:08:10.291 INFO:teuthology.orchestra.run.smithi133.stdout: "nonce": 12674 2021-01-03T13:08:10.291 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.291 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.292 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.292 INFO:teuthology.orchestra.run.smithi133.stdout: "public_addr": "172.21.15.16:6818/12674", 2021-01-03T13:08:10.292 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_addr": "172.21.15.16:6823/12674", 2021-01-03T13:08:10.292 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_back_addr": "172.21.15.16:6831/12674", 2021-01-03T13:08:10.293 INFO:teuthology.orchestra.run.smithi133.stdout: "heartbeat_front_addr": "172.21.15.16:6827/12674", 2021-01-03T13:08:10.293 INFO:teuthology.orchestra.run.smithi133.stdout: "state": [ 2021-01-03T13:08:10.293 INFO:teuthology.orchestra.run.smithi133.stdout: "exists", 2021-01-03T13:08:10.293 INFO:teuthology.orchestra.run.smithi133.stdout: "up" 2021-01-03T13:08:10.293 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2021-01-03T13:08:10.294 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.294 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:08:10.294 INFO:teuthology.orchestra.run.smithi133.stdout: "osd_xinfo": [ 2021-01-03T13:08:10.294 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.295 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 0, 2021-01-03T13:08:10.295 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:08:10.295 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:08:10.295 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:08:10.295 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:08:10.296 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:08:10.296 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.659942+0000", 2021-01-03T13:08:10.296 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:08:10.296 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.297 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.297 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 1, 2021-01-03T13:08:10.297 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:08:10.297 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:08:10.297 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:08:10.298 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:08:10.298 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:08:10.298 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.750326+0000", 2021-01-03T13:08:10.298 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:08:10.298 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.299 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.299 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 2, 2021-01-03T13:08:10.299 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:08:10.299 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:08:10.299 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:08:10.300 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:08:10.300 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:08:10.300 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.587742+0000", 2021-01-03T13:08:10.300 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:08:10.300 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.301 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.301 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 3, 2021-01-03T13:08:10.301 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:08:10.301 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:08:10.302 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:08:10.302 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:08:10.302 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:08:10.302 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.855073+0000", 2021-01-03T13:08:10.302 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:08:10.303 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.303 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.303 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 4, 2021-01-03T13:08:10.303 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:08:10.303 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:08:10.304 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:08:10.304 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:08:10.304 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:08:10.304 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.565030+0000", 2021-01-03T13:08:10.304 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:08:10.305 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.305 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.305 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 5, 2021-01-03T13:08:10.305 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:08:10.305 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:08:10.306 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:08:10.306 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:08:10.306 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:08:10.306 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.786206+0000", 2021-01-03T13:08:10.306 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:08:10.307 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.307 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.307 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 6, 2021-01-03T13:08:10.307 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:08:10.307 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:08:10.308 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:08:10.308 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:08:10.308 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:08:10.308 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.576185+0000", 2021-01-03T13:08:10.309 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:08:10.309 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.309 INFO:teuthology.orchestra.run.smithi133.stdout: { 2021-01-03T13:08:10.309 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": 7, 2021-01-03T13:08:10.309 INFO:teuthology.orchestra.run.smithi133.stdout: "down_stamp": "0.000000", 2021-01-03T13:08:10.310 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_probability": 0, 2021-01-03T13:08:10.310 INFO:teuthology.orchestra.run.smithi133.stdout: "laggy_interval": 0, 2021-01-03T13:08:10.310 INFO:teuthology.orchestra.run.smithi133.stdout: "features": 4540138292840890367, 2021-01-03T13:08:10.310 INFO:teuthology.orchestra.run.smithi133.stdout: "old_weight": 0, 2021-01-03T13:08:10.310 INFO:teuthology.orchestra.run.smithi133.stdout: "last_purged_snaps_scrub": "2021-01-03T12:57:49.823786+0000", 2021-01-03T13:08:10.311 INFO:teuthology.orchestra.run.smithi133.stdout: "dead_epoch": 0 2021-01-03T13:08:10.311 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.311 INFO:teuthology.orchestra.run.smithi133.stdout: ], 2021-01-03T13:08:10.311 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap": [], 2021-01-03T13:08:10.311 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_upmap_items": [], 2021-01-03T13:08:10.312 INFO:teuthology.orchestra.run.smithi133.stdout: "pg_temp": [], 2021-01-03T13:08:10.312 INFO:teuthology.orchestra.run.smithi133.stdout: "primary_temp": [], 2021-01-03T13:08:10.312 INFO:teuthology.orchestra.run.smithi133.stdout: "blacklist": {}, 2021-01-03T13:08:10.312 INFO:teuthology.orchestra.run.smithi133.stdout: "erasure_code_profiles": { 2021-01-03T13:08:10.312 INFO:teuthology.orchestra.run.smithi133.stdout: "default": { 2021-01-03T13:08:10.313 INFO:teuthology.orchestra.run.smithi133.stdout: "crush-failure-domain": "osd", 2021-01-03T13:08:10.313 INFO:teuthology.orchestra.run.smithi133.stdout: "k": "2", 2021-01-03T13:08:10.313 INFO:teuthology.orchestra.run.smithi133.stdout: "m": "1", 2021-01-03T13:08:10.313 INFO:teuthology.orchestra.run.smithi133.stdout: "plugin": "jerasure", 2021-01-03T13:08:10.313 INFO:teuthology.orchestra.run.smithi133.stdout: "ruleset-failure-domain": "osd", 2021-01-03T13:08:10.314 INFO:teuthology.orchestra.run.smithi133.stdout: "technique": "reed_sol_van" 2021-01-03T13:08:10.314 INFO:teuthology.orchestra.run.smithi133.stdout: } 2021-01-03T13:08:10.314 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2021-01-03T13:08:10.314 INFO:teuthology.orchestra.run.smithi133.stdout: "removed_snaps_queue": [], 2021-01-03T13:08:10.315 INFO:teuthology.orchestra.run.smithi133.stdout: "new_removed_snaps": [], 2021-01-03T13:08:10.315 INFO:teuthology.orchestra.run.smithi133.stdout: "new_purged_snaps": [], 2021-01-03T13:08:10.315 INFO:teuthology.orchestra.run.smithi133.stdout: "crush_node_flags": {}, 2021-01-03T13:08:10.315 INFO:teuthology.orchestra.run.smithi133.stdout: "device_class_flags": {} 2021-01-03T13:08:10.315 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:08:10.317 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.099+0000 7f2f526c7700 1 -- 172.21.15.133:0/1255715147 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f2c055440 msgr2=0x7f2f2c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:10.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.099+0000 7f2f526c7700 1 --2- 172.21.15.133:0/1255715147 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f2c055440 0x7f2f2c057900 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f2f3c00e000 tx=0x7f2f3c009040).stop 2021-01-03T13:08:10.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.099+0000 7f2f526c7700 1 -- 172.21.15.133:0/1255715147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f4c067200 msgr2=0x7f2f4c144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:10.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.099+0000 7f2f526c7700 1 --2- 172.21.15.133:0/1255715147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f4c067200 0x7f2f4c144790 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f2f4c14b2a0 tx=0x7f2f44009040).stop 2021-01-03T13:08:10.318 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.099+0000 7f2f526c7700 1 -- 172.21.15.133:0/1255715147 shutdown_connections 2021-01-03T13:08:10.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.099+0000 7f2f526c7700 1 --2- 172.21.15.133:0/1255715147 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2f2c055440 0x7f2f2c057900 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:10.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.099+0000 7f2f526c7700 1 --2- 172.21.15.133:0/1255715147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f4c0658c0 0x7f2f4c064d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:10.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.099+0000 7f2f526c7700 1 --2- 172.21.15.133:0/1255715147 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f4c067200 0x7f2f4c144790 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:10.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.099+0000 7f2f526c7700 1 --2- 172.21.15.133:0/1255715147 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2f4c064300 0x7f2f4c1442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:10.319 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.099+0000 7f2f526c7700 1 -- 172.21.15.133:0/1255715147 >> 172.21.15.133:0/1255715147 conn(0x7f2f4c05bdf0 msgr2=0x7f2f4c1472a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:10.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.099+0000 7f2f526c7700 1 -- 172.21.15.133:0/1255715147 shutdown_connections 2021-01-03T13:08:10.320 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.099+0000 7f2f526c7700 1 -- 172.21.15.133:0/1255715147 wait complete. 2021-01-03T13:08:10.321 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:08:10.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.435+0000 7ff407fff700 1 Processor -- start 2021-01-03T13:08:10.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.435+0000 7ff407fff700 1 -- start start 2021-01-03T13:08:10.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.435+0000 7ff407fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4080b1590 0x7ff4080b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:10.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.435+0000 7ff407fff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40805fd00 con 0x7ff408066f30 2021-01-03T13:08:10.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff407fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4080accd0 con 0x7ff40805f920 2021-01-03T13:08:10.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff407fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4080b2980 con 0x7ff4080b1590 2021-01-03T13:08:10.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff406ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff40805f920 0x7ff4080b2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33840/0 (socket says 172.21.15.133:33840) 2021-01-03T13:08:10.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff406ffd700 1 -- 172.21.15.133:0/4034563052 learned_addr learned my addr 172.21.15.133:0/4034563052 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:08:10.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff4077fe700 1 --2- 172.21.15.133:0/4034563052 >> v2:172.21.15.133:3300/0 conn(0x7ff4080b1590 0x7ff4080b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:10.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff405ffb700 1 -- 172.21.15.133:0/4034563052 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201847757 0 0) 0x7ff4080accd0 con 0x7ff40805f920 2021-01-03T13:08:10.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff405ffb700 1 -- 172.21.15.133:0/4034563052 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3e8003230 con 0x7ff40805f920 2021-01-03T13:08:10.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff4077fe700 1 -- 172.21.15.133:0/4034563052 >> v1:172.21.15.133:6789/0 conn(0x7ff40805f920 legacy=0x7ff4080b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:10.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff4077fe700 1 -- 172.21.15.133:0/4034563052 >> v1:172.21.15.16:6789/0 conn(0x7ff408066f30 legacy=0x7ff40813ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:10.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff4077fe700 1 -- 172.21.15.133:0/4034563052 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080acf70 con 0x7ff4080b1590 2021-01-03T13:08:10.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff4077fe700 1 --2- 172.21.15.133:0/4034563052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4080b1590 0x7ff4080b0ab0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7ff400002f30 tx=0x7ff400006dc0).ready entity=mon.1 client_cookie=75fc96d15c328e54 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:10.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff405ffb700 1 -- 172.21.15.133:0/4034563052 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff400009800 con 0x7ff4080b1590 2021-01-03T13:08:10.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff405ffb700 1 -- 172.21.15.133:0/4034563052 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff400009960 con 0x7ff4080b1590 2021-01-03T13:08:10.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff405ffb700 1 -- 172.21.15.133:0/4034563052 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff400009cc0 con 0x7ff4080b1590 2021-01-03T13:08:10.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff407fff700 1 -- 172.21.15.133:0/4034563052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4080b1590 msgr2=0x7ff4080b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:10.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff407fff700 1 --2- 172.21.15.133:0/4034563052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4080b1590 0x7ff4080b0ab0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7ff400002f30 tx=0x7ff400006dc0).stop 2021-01-03T13:08:10.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff407fff700 1 -- 172.21.15.133:0/4034563052 shutdown_connections 2021-01-03T13:08:10.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff407fff700 1 --2- 172.21.15.133:0/4034563052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4080b1590 0x7ff4080b0ab0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:10.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff407fff700 1 -- 172.21.15.133:0/4034563052 >> 172.21.15.133:0/4034563052 conn(0x7ff4080b6110 msgr2=0x7ff4080b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:10.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff407fff700 1 -- 172.21.15.133:0/4034563052 shutdown_connections 2021-01-03T13:08:10.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.439+0000 7ff407fff700 1 -- 172.21.15.133:0/4034563052 wait complete. 2021-01-03T13:08:10.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff407fff700 1 Processor -- start 2021-01-03T13:08:10.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff407fff700 1 -- start start 2021-01-03T13:08:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff407fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff40805f920 0x7ff4080a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff407fff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff408066f30 0x7ff408066160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:10.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff407fff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4080b1590 0x7ff40814ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:10.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff407fff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080a3a60 con 0x7ff4080b1590 2021-01-03T13:08:10.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff407fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40814e890 con 0x7ff40805f920 2021-01-03T13:08:10.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff407fff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff408140d40 con 0x7ff408066f30 2021-01-03T13:08:10.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff406ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff40805f920 0x7ff4080a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:10.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff406ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff40805f920 0x7ff4080a0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41046/0 (socket says 172.21.15.133:41046) 2021-01-03T13:08:10.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff406ffd700 1 -- 172.21.15.133:0/3817783586 learned_addr learned my addr 172.21.15.133:0/3817783586 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:10.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff4077fe700 1 --2- 172.21.15.133:0/3817783586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4080b1590 0x7ff40814ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:10.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff4067fc700 1 --2- 172.21.15.133:0/3817783586 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff408066f30 0x7ff408066160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:10.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff406ffd700 1 -- 172.21.15.133:0/3817783586 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff408066f30 msgr2=0x7ff408066160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:10.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff406ffd700 1 --2- 172.21.15.133:0/3817783586 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff408066f30 0x7ff408066160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:10.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff406ffd700 1 -- 172.21.15.133:0/3817783586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4080b1590 msgr2=0x7ff40814ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:10.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff406ffd700 1 --2- 172.21.15.133:0/3817783586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4080b1590 0x7ff40814ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:10.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff406ffd700 1 -- 172.21.15.133:0/3817783586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40814eac0 con 0x7ff40805f920 2021-01-03T13:08:10.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff406ffd700 1 --2- 172.21.15.133:0/3817783586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff40805f920 0x7ff4080a0aa0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7ff3f8001450 tx=0x7ff3f8007e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:10.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff3fffff700 1 -- 172.21.15.133:0/3817783586 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3f800ce40 con 0x7ff40805f920 2021-01-03T13:08:10.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff3fffff700 1 -- 172.21.15.133:0/3817783586 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f8005b70 con 0x7ff40805f920 2021-01-03T13:08:10.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff3fffff700 1 -- 172.21.15.133:0/3817783586 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3f8007110 con 0x7ff40805f920 2021-01-03T13:08:10.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff407fff700 1 -- 172.21.15.133:0/3817783586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff408140fe0 con 0x7ff40805f920 2021-01-03T13:08:10.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.443+0000 7ff407fff700 1 -- 172.21.15.133:0/3817783586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4080b47d0 con 0x7ff40805f920 2021-01-03T13:08:10.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.447+0000 7ff407fff700 1 -- 172.21.15.133:0/3817783586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40814ec50 con 0x7ff40805f920 2021-01-03T13:08:10.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.447+0000 7ff3fffff700 1 -- 172.21.15.133:0/3817783586 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff3f8010030 con 0x7ff40805f920 2021-01-03T13:08:10.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.447+0000 7ff3fffff700 1 --2- 172.21.15.133:0/3817783586 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff3ec0553f0 0x7ff3ec0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:10.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.447+0000 7ff3fffff700 1 -- 172.21.15.133:0/3817783586 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff3f806de80 con 0x7ff40805f920 2021-01-03T13:08:10.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.447+0000 7ff4067fc700 1 --2- 172.21.15.133:0/3817783586 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff3ec0553f0 0x7ff3ec0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:10.456 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.447+0000 7ff4067fc700 1 --2- 172.21.15.133:0/3817783586 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff3ec0553f0 0x7ff3ec0578b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7ff3f000d000 tx=0x7ff3f0000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.455+0000 7ff3fffff700 1 -- 172.21.15.133:0/3817783586 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff3f8044230 con 0x7ff40805f920 2021-01-03T13:08:10.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.639+0000 7ff407fff700 1 -- 172.21.15.133:0/3817783586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff408057300 con 0x7ff40805f920 2021-01-03T13:08:10.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.639+0000 7ff3fffff700 1 -- 172.21.15.133:0/3817783586 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+2501 (secure 0 0 0) 0x7ff3f8047850 con 0x7ff40805f920 2021-01-03T13:08:10.644 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:08:10.644 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":79,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/1043050023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1043050023},{"type":"v1","addr":"172.21.15.16:6833","nonce":1043050023}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76},{"gid":8488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1327300036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1327300036},{"type":"v1","addr":"172.21.15.133:6835","nonce":1327300036}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:57.630488+0000","modified":"2021-01-03T13:07:59.321927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8494},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8494":{"gid":8494,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6837/3193569550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6836","nonce":3193569550},{"type":"v1","addr":"172.21.15.133:6837","nonce":3193569550}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-01-03T13:08:10.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.643+0000 7ff407fff700 1 -- 172.21.15.133:0/3817783586 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff3ec0553f0 msgr2=0x7ff3ec0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:10.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.643+0000 7ff407fff700 1 --2- 172.21.15.133:0/3817783586 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff3ec0553f0 0x7ff3ec0578b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7ff3f000d000 tx=0x7ff3f0000b80).stop 2021-01-03T13:08:10.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.643+0000 7ff407fff700 1 -- 172.21.15.133:0/3817783586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff40805f920 msgr2=0x7ff4080a0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:10.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.643+0000 7ff407fff700 1 --2- 172.21.15.133:0/3817783586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff40805f920 0x7ff4080a0aa0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7ff3f8001450 tx=0x7ff3f8007e20).stop 2021-01-03T13:08:10.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.643+0000 7ff407fff700 1 -- 172.21.15.133:0/3817783586 shutdown_connections 2021-01-03T13:08:10.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.643+0000 7ff407fff700 1 --2- 172.21.15.133:0/3817783586 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff3ec0553f0 0x7ff3ec0578b0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:10.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.643+0000 7ff407fff700 1 --2- 172.21.15.133:0/3817783586 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4080b1590 0x7ff40814ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:10.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.643+0000 7ff407fff700 1 --2- 172.21.15.133:0/3817783586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff40805f920 0x7ff4080a0aa0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:10.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.643+0000 7ff407fff700 1 --2- 172.21.15.133:0/3817783586 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff408066f30 0x7ff408066160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:10.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.643+0000 7ff407fff700 1 -- 172.21.15.133:0/3817783586 >> 172.21.15.133:0/3817783586 conn(0x7ff4080b6110 msgr2=0x7ff4080ae000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:10.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.643+0000 7ff407fff700 1 -- 172.21.15.133:0/3817783586 shutdown_connections 2021-01-03T13:08:10.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.643+0000 7ff407fff700 1 -- 172.21.15.133:0/3817783586 wait complete. 2021-01-03T13:08:10.648 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 79 2021-01-03T13:08:10.657 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2021-01-03T13:08:10.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.767+0000 7f09ac8e2700 1 Processor -- start 2021-01-03T13:08:10.771 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.767+0000 7f09ac8e2700 1 -- start start 2021-01-03T13:08:10.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.767+0000 7f09ac8e2700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f09a80b4c20 0x7f09a805c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:10.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.767+0000 7f09ac8e2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f09a805fd10 0x7f09a80b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:10.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09ac8e2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a805bf00 con 0x7f09a8060510 2021-01-03T13:08:10.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09ac8e2700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a805c1a0 con 0x7f09a80b4c20 2021-01-03T13:08:10.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09ac8e2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a805c440 con 0x7f09a805fd10 2021-01-03T13:08:10.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09a7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f09a805fd10 0x7f09a80b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:10.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09a6ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f09a8060510 0x7f09a80b5000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33856/0 (socket says 172.21.15.133:33856) 2021-01-03T13:08:10.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09a6ffd700 1 -- 172.21.15.133:0/2032261244 learned_addr learned my addr 172.21.15.133:0/2032261244 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:08:10.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09a77fe700 1 --2- 172.21.15.133:0/2032261244 >> v2:172.21.15.16:3300/0 conn(0x7f09a80b4c20 0x7f09a805c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:10.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09a7fff700 1 -- 172.21.15.133:0/2032261244 >> v2:172.21.15.16:3300/0 conn(0x7f09a80b4c20 msgr2=0x7f09a805c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:10.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09a7fff700 1 --2- 172.21.15.133:0/2032261244 >> v2:172.21.15.16:3300/0 conn(0x7f09a80b4c20 0x7f09a805c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:10.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09a7fff700 1 -- 172.21.15.133:0/2032261244 >> v1:172.21.15.133:6789/0 conn(0x7f09a8060510 legacy=0x7f09a80b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:10.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09a7fff700 1 -- 172.21.15.133:0/2032261244 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a80b6ad0 con 0x7f09a805fd10 2021-01-03T13:08:10.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09a77fe700 1 --2- 172.21.15.133:0/2032261244 >> v2:172.21.15.16:3300/0 conn(0x7f09a80b4c20 0x7f09a805c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:08:10.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09a67fc700 1 -- 172.21.15.133:0/2032261244 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515967835 0 0) 0x7f09a805bf00 con 0x7f09a8060510 2021-01-03T13:08:10.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09a7fff700 1 --2- 172.21.15.133:0/2032261244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a805fd10 0x7f09a80b65e0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7f09a00032b0 tx=0x7f09a00091a0).ready entity=mon.1 client_cookie=579d64955df8f42f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:10.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09a67fc700 1 -- 172.21.15.133:0/2032261244 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09a000ba50 con 0x7f09a805fd10 2021-01-03T13:08:10.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09a67fc700 1 -- 172.21.15.133:0/2032261244 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a000bbb0 con 0x7f09a805fd10 2021-01-03T13:08:10.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09a67fc700 1 -- 172.21.15.133:0/2032261244 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09a000bd20 con 0x7f09a805fd10 2021-01-03T13:08:10.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09ac8e2700 1 -- 172.21.15.133:0/2032261244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a805fd10 msgr2=0x7f09a80b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:10.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09ac8e2700 1 --2- 172.21.15.133:0/2032261244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a805fd10 0x7f09a80b65e0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7f09a00032b0 tx=0x7f09a00091a0).stop 2021-01-03T13:08:10.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09ac8e2700 1 -- 172.21.15.133:0/2032261244 shutdown_connections 2021-01-03T13:08:10.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09ac8e2700 1 --2- 172.21.15.133:0/2032261244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a805fd10 0x7f09a80b65e0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:10.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09ac8e2700 1 --2- 172.21.15.133:0/2032261244 >> v2:172.21.15.16:3300/0 conn(0x7f09a80b4c20 0x7f09a805c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:10.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09ac8e2700 1 -- 172.21.15.133:0/2032261244 >> 172.21.15.133:0/2032261244 conn(0x7f09a80b9f00 msgr2=0x7f09a80b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:10.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09ac8e2700 1 -- 172.21.15.133:0/2032261244 shutdown_connections 2021-01-03T13:08:10.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.771+0000 7f09ac8e2700 1 -- 172.21.15.133:0/2032261244 wait complete. 2021-01-03T13:08:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09ac8e2700 1 Processor -- start 2021-01-03T13:08:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09ac8e2700 1 -- start start 2021-01-03T13:08:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09ac8e2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a805fd10 0x7f09a80b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:10.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09ac8e2700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09a8060510 0x7f09a8151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:10.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09ac8e2700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a80b4c20 0x7f09a8152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:10.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09ac8e2700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a809e910 con 0x7f09a80b4c20 2021-01-03T13:08:10.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09ac8e2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a809e130 con 0x7f09a805fd10 2021-01-03T13:08:10.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09ac8e2700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a809e3d0 con 0x7f09a8060510 2021-01-03T13:08:10.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09a77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a805fd10 0x7f09a80b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:10.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09a77fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a805fd10 0x7f09a80b2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41060/0 (socket says 172.21.15.133:41060) 2021-01-03T13:08:10.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09a77fe700 1 -- 172.21.15.133:0/551154121 learned_addr learned my addr 172.21.15.133:0/551154121 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:10.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09a7fff700 1 --2- 172.21.15.133:0/551154121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a80b4c20 0x7f09a8152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:10.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09a6ffd700 1 --2- 172.21.15.133:0/551154121 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09a8060510 0x7f09a8151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:10.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09a77fe700 1 -- 172.21.15.133:0/551154121 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09a8060510 msgr2=0x7f09a8151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:10.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09a77fe700 1 --2- 172.21.15.133:0/551154121 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09a8060510 0x7f09a8151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:10.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09a77fe700 1 -- 172.21.15.133:0/551154121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a80b4c20 msgr2=0x7f09a8152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:10.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09a77fe700 1 --2- 172.21.15.133:0/551154121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a80b4c20 0x7f09a8152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:10.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09a77fe700 1 -- 172.21.15.133:0/551154121 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a809e670 con 0x7f09a805fd10 2021-01-03T13:08:10.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09a77fe700 1 --2- 172.21.15.133:0/551154121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a805fd10 0x7f09a80b2a00 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f0998006910 tx=0x7f0998008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:10.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09a4ff9700 1 -- 172.21.15.133:0/551154121 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09980127e0 con 0x7f09a805fd10 2021-01-03T13:08:10.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09a4ff9700 1 -- 172.21.15.133:0/551154121 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0998012940 con 0x7f09a805fd10 2021-01-03T13:08:10.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09ac8e2700 1 -- 172.21.15.133:0/551154121 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a8141470 con 0x7f09a805fd10 2021-01-03T13:08:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09a4ff9700 1 -- 172.21.15.133:0/551154121 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0998012ca0 con 0x7f09a805fd10 2021-01-03T13:08:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.775+0000 7f09ac8e2700 1 -- 172.21.15.133:0/551154121 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a80b22e0 con 0x7f09a805fd10 2021-01-03T13:08:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.779+0000 7f09ac8e2700 1 -- 172.21.15.133:0/551154121 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a8057300 con 0x7f09a805fd10 2021-01-03T13:08:10.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.779+0000 7f09a4ff9700 1 -- 172.21.15.133:0/551154121 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0998013480 con 0x7f09a805fd10 2021-01-03T13:08:10.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.779+0000 7f09a4ff9700 1 --2- 172.21.15.133:0/551154121 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f098c055440 0x7f098c057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:10.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.779+0000 7f09a4ff9700 1 -- 172.21.15.133:0/551154121 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f099806e710 con 0x7f09a805fd10 2021-01-03T13:08:10.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.779+0000 7f09a6ffd700 1 --2- 172.21.15.133:0/551154121 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f098c055440 0x7f098c057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:10.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.779+0000 7f09a6ffd700 1 --2- 172.21.15.133:0/551154121 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f098c055440 0x7f098c057900 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f099000d000 tx=0x7f09900079d0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:10.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.783+0000 7f09a4ff9700 1 -- 172.21.15.133:0/551154121 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0998044910 con 0x7f09a805fd10 2021-01-03T13:08:10.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:10.967+0000 7f09ac8e2700 1 -- 172.21.15.133:0/551154121 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f09a8067a00 con 0x7f09a805fd10 2021-01-03T13:08:11.377 INFO:tasks.ceph.mon.b.smithi016.stderr:2021-01-03T13:08:11.375+0000 7fba5c9c4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2021-01-03T13:08:11.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.387+0000 7f09a4ff9700 1 -- 172.21.15.133:0/551154121 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v80) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0998012e00 con 0x7f09a805fd10 2021-01-03T13:08:11.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.391+0000 7f09ac8e2700 1 -- 172.21.15.133:0/551154121 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f098c055440 msgr2=0x7f098c057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:11.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.391+0000 7f09ac8e2700 1 --2- 172.21.15.133:0/551154121 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f098c055440 0x7f098c057900 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f099000d000 tx=0x7f09900079d0).stop 2021-01-03T13:08:11.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.391+0000 7f09ac8e2700 1 -- 172.21.15.133:0/551154121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a805fd10 msgr2=0x7f09a80b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:11.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.391+0000 7f09ac8e2700 1 --2- 172.21.15.133:0/551154121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a805fd10 0x7f09a80b2a00 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f0998006910 tx=0x7f0998008040).stop 2021-01-03T13:08:11.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.391+0000 7f09ac8e2700 1 -- 172.21.15.133:0/551154121 shutdown_connections 2021-01-03T13:08:11.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.391+0000 7f09ac8e2700 1 --2- 172.21.15.133:0/551154121 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f098c055440 0x7f098c057900 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.391+0000 7f09ac8e2700 1 --2- 172.21.15.133:0/551154121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09a80b4c20 0x7f09a8152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.391+0000 7f09ac8e2700 1 --2- 172.21.15.133:0/551154121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09a805fd10 0x7f09a80b2a00 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.391+0000 7f09ac8e2700 1 --2- 172.21.15.133:0/551154121 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f09a8060510 0x7f09a8151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.391+0000 7f09ac8e2700 1 -- 172.21.15.133:0/551154121 >> 172.21.15.133:0/551154121 conn(0x7f09a80b9f00 msgr2=0x7f09a80afc30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:11.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.391+0000 7f09ac8e2700 1 -- 172.21.15.133:0/551154121 shutdown_connections 2021-01-03T13:08:11.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.391+0000 7f09ac8e2700 1 -- 172.21.15.133:0/551154121 wait complete. 2021-01-03T13:08:11.398 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2021-01-03T13:08:11.409 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2021-01-03T13:08:11.415 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2021-01-03T13:08:11.514 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.511+0000 7f0f12646700 1 Processor -- start 2021-01-03T13:08:11.515 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.511+0000 7f0f12646700 1 -- start start 2021-01-03T13:08:11.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.511+0000 7f0f12646700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f0c0b4c20 0x7f0f0c05c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:11.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.511+0000 7f0f12646700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0f0c060510 0x7f0f0c0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:11.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.511+0000 7f0f12646700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0c0b6cf0 con 0x7f0f0c05fd10 2021-01-03T13:08:11.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.511+0000 7f0f12646700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0c05bf00 con 0x7f0f0c060510 2021-01-03T13:08:11.517 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.511+0000 7f0f12646700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0c05c1a0 con 0x7f0f0c0b4c20 2021-01-03T13:08:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.511+0000 7f0f11644700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f0c0b4c20 0x7f0f0c05c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.511+0000 7f0f11644700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f0c0b4c20 0x7f0f0c05c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41080/0 (socket says 172.21.15.133:41080) 2021-01-03T13:08:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.511+0000 7f0f11644700 1 -- 172.21.15.133:0/187796789 learned_addr learned my addr 172.21.15.133:0/187796789 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f10e43700 1 --2- 172.21.15.133:0/187796789 >> v2:172.21.15.16:3300/0 conn(0x7f0f0c060510 0x7f0f0c0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f11644700 1 -- 172.21.15.133:0/187796789 >> v2:172.21.15.16:3300/0 conn(0x7f0f0c060510 msgr2=0x7f0f0c0b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:11.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f11644700 1 --2- 172.21.15.133:0/187796789 >> v2:172.21.15.16:3300/0 conn(0x7f0f0c060510 0x7f0f0c0b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f11644700 1 -- 172.21.15.133:0/187796789 >> v1:172.21.15.16:6789/0 conn(0x7f0f0c05fd10 legacy=0x7f0f0c0b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:11.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f11644700 1 -- 172.21.15.133:0/187796789 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c05c440 con 0x7f0f0c0b4c20 2021-01-03T13:08:11.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f11644700 1 --2- 172.21.15.133:0/187796789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c0b4c20 0x7f0f0c05c8e0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f0f040032b0 tx=0x7f0f04009270).ready entity=mon.1 client_cookie=4ac969b42f50fd57 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:11.519 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0efffff700 1 -- 172.21.15.133:0/187796789 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f0400bc00 con 0x7f0f0c0b4c20 2021-01-03T13:08:11.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0efffff700 1 -- 172.21.15.133:0/187796789 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0400bd60 con 0x7f0f0c0b4c20 2021-01-03T13:08:11.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0efffff700 1 -- 172.21.15.133:0/187796789 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f04011400 con 0x7f0f0c0b4c20 2021-01-03T13:08:11.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f12646700 1 -- 172.21.15.133:0/187796789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c0b4c20 msgr2=0x7f0f0c05c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:11.520 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f12646700 1 --2- 172.21.15.133:0/187796789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c0b4c20 0x7f0f0c05c8e0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f0f040032b0 tx=0x7f0f04009270).stop 2021-01-03T13:08:11.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f12646700 1 -- 172.21.15.133:0/187796789 shutdown_connections 2021-01-03T13:08:11.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f12646700 1 --2- 172.21.15.133:0/187796789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c0b4c20 0x7f0f0c05c8e0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f12646700 1 --2- 172.21.15.133:0/187796789 >> v2:172.21.15.16:3300/0 conn(0x7f0f0c060510 0x7f0f0c0b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f12646700 1 -- 172.21.15.133:0/187796789 >> 172.21.15.133:0/187796789 conn(0x7f0f0c0b9f00 msgr2=0x7f0f0c0b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:11.523 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f12646700 1 -- 172.21.15.133:0/187796789 shutdown_connections 2021-01-03T13:08:11.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f12646700 1 -- 172.21.15.133:0/187796789 wait complete. 2021-01-03T13:08:11.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f12646700 1 Processor -- start 2021-01-03T13:08:11.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f12646700 1 -- start start 2021-01-03T13:08:11.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f12646700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c05fd10 0x7f0f0c0b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:11.524 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f12646700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0f0c060510 0x7f0f0c09e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:11.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f12646700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f0c0b4c20 0x7f0f0c155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:11.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f12646700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c0b3630 con 0x7f0f0c0b4c20 2021-01-03T13:08:11.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f12646700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c1425f0 con 0x7f0f0c05fd10 2021-01-03T13:08:11.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.515+0000 7f0f12646700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c142850 con 0x7f0f0c060510 2021-01-03T13:08:11.525 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0f11644700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c05fd10 0x7f0f0c0b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:11.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0f11644700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c05fd10 0x7f0f0c0b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41086/0 (socket says 172.21.15.133:41086) 2021-01-03T13:08:11.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0f11644700 1 -- 172.21.15.133:0/3229670138 learned_addr learned my addr 172.21.15.133:0/3229670138 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:11.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0f10e43700 1 --2- 172.21.15.133:0/3229670138 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0f0c060510 0x7f0f0c09e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:11.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0f11e45700 1 --2- 172.21.15.133:0/3229670138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f0c0b4c20 0x7f0f0c155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:11.526 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0f11644700 1 -- 172.21.15.133:0/3229670138 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0f0c060510 msgr2=0x7f0f0c09e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:11.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0f11644700 1 --2- 172.21.15.133:0/3229670138 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0f0c060510 0x7f0f0c09e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0f11644700 1 -- 172.21.15.133:0/3229670138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f0c0b4c20 msgr2=0x7f0f0c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:11.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0f11644700 1 --2- 172.21.15.133:0/3229670138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f0c0b4c20 0x7f0f0c155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0f11644700 1 -- 172.21.15.133:0/3229670138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c142af0 con 0x7f0f0c05fd10 2021-01-03T13:08:11.527 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0f11e45700 1 --2- 172.21.15.133:0/3229670138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f0c0b4c20 0x7f0f0c155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:08:11.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0f11644700 1 --2- 172.21.15.133:0/3229670138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c05fd10 0x7f0f0c0b3b40 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f0f0c0b2a50 tx=0x7f0f04016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:11.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0efe7fc700 1 -- 172.21.15.133:0/3229670138 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f0401f5e0 con 0x7f0f0c05fd10 2021-01-03T13:08:11.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0efe7fc700 1 -- 172.21.15.133:0/3229670138 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0401f740 con 0x7f0f0c05fd10 2021-01-03T13:08:11.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0f12646700 1 -- 172.21.15.133:0/3229670138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0c09eb70 con 0x7f0f0c05fd10 2021-01-03T13:08:11.528 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0efe7fc700 1 -- 172.21.15.133:0/3229670138 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f0401faa0 con 0x7f0f0c05fd10 2021-01-03T13:08:11.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0f12646700 1 -- 172.21.15.133:0/3229670138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0c09f3b0 con 0x7f0f0c05fd10 2021-01-03T13:08:11.529 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0f12646700 1 -- 172.21.15.133:0/3229670138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0c142c80 con 0x7f0f0c05fd10 2021-01-03T13:08:11.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0efe7fc700 1 -- 172.21.15.133:0/3229670138 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f0f04026030 con 0x7f0f0c05fd10 2021-01-03T13:08:11.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.519+0000 7f0efe7fc700 1 --2- 172.21.15.133:0/3229670138 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0ef4055440 0x7f0ef4057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:11.530 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.523+0000 7f0f10e43700 1 --2- 172.21.15.133:0/3229670138 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0ef4055440 0x7f0ef4057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:11.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.523+0000 7f0efe7fc700 1 -- 172.21.15.133:0/3229670138 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0f0406f120 con 0x7f0f0c05fd10 2021-01-03T13:08:11.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.523+0000 7f0f10e43700 1 --2- 172.21.15.133:0/3229670138 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0ef4055440 0x7f0ef4057900 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f0f0000c000 tx=0x7f0f00008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:11.531 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.527+0000 7f0efe7fc700 1 -- 172.21.15.133:0/3229670138 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0f04045370 con 0x7f0f0c05fd10 2021-01-03T13:08:11.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.715+0000 7f0f12646700 1 -- 172.21.15.133:0/3229670138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f0c057300 con 0x7f0f0c05fd10 2021-01-03T13:08:11.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.715+0000 7f0efe7fc700 1 -- 172.21.15.133:0/3229670138 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+2138 (secure 0 0 0) 0x7f0f04024870 con 0x7f0f0c05fd10 2021-01-03T13:08:11.718 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:08:11.718 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":80,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7142,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.16:6833/1043050023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":1043050023},{"type":"v1","addr":"172.21.15.16:6833","nonce":1043050023}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76},{"gid":8488,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1327300036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1327300036},{"type":"v1","addr":"172.21.15.133:6835","nonce":1327300036}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":75}],"filesystems":[{"mdsmap":{"epoch":80,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2021-01-03T13:07:57.630488+0000","modified":"2021-01-03T13:08:11.376757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":163,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2021-01-03T13:08:11.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.715+0000 7f0f12646700 1 -- 172.21.15.133:0/3229670138 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0ef4055440 msgr2=0x7f0ef4057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:11.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.715+0000 7f0f12646700 1 --2- 172.21.15.133:0/3229670138 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0ef4055440 0x7f0ef4057900 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f0f0000c000 tx=0x7f0f00008040).stop 2021-01-03T13:08:11.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.715+0000 7f0f12646700 1 -- 172.21.15.133:0/3229670138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c05fd10 msgr2=0x7f0f0c0b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:11.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.715+0000 7f0f12646700 1 --2- 172.21.15.133:0/3229670138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c05fd10 0x7f0f0c0b3b40 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f0f0c0b2a50 tx=0x7f0f04016000).stop 2021-01-03T13:08:11.720 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.715+0000 7f0f12646700 1 -- 172.21.15.133:0/3229670138 shutdown_connections 2021-01-03T13:08:11.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.715+0000 7f0f12646700 1 --2- 172.21.15.133:0/3229670138 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0ef4055440 0x7f0ef4057900 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.715+0000 7f0f12646700 1 --2- 172.21.15.133:0/3229670138 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0f0c0b4c20 0x7f0f0c155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.715+0000 7f0f12646700 1 --2- 172.21.15.133:0/3229670138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0c05fd10 0x7f0f0c0b3b40 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.715+0000 7f0f12646700 1 --2- 172.21.15.133:0/3229670138 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f0f0c060510 0x7f0f0c09e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.721 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.715+0000 7f0f12646700 1 -- 172.21.15.133:0/3229670138 >> 172.21.15.133:0/3229670138 conn(0x7f0f0c0b9f00 msgr2=0x7f0f0c0af900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:11.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.715+0000 7f0f12646700 1 -- 172.21.15.133:0/3229670138 shutdown_connections 2021-01-03T13:08:11.722 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.715+0000 7f0f12646700 1 -- 172.21.15.133:0/3229670138 wait complete. 2021-01-03T13:08:11.722 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 80 2021-01-03T13:08:11.731 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2021-01-03T13:08:11.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.887+0000 7f6801582700 1 Processor -- start 2021-01-03T13:08:11.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.887+0000 7f6801582700 1 -- start start 2021-01-03T13:08:11.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.887+0000 7f6801582700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67fc0b52c0 0x7f67fc0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:11.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.887+0000 7f6801582700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f67fc0b5c00 0x7f67fc143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:11.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.887+0000 7f6801582700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67fc060da0 con 0x7f67fc0b0c90 2021-01-03T13:08:11.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.887+0000 7f6801582700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67fc067a90 con 0x7f67fc0b52c0 2021-01-03T13:08:11.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.887+0000 7f6801582700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc0b0ad0 con 0x7f67fc0b5c00 2021-01-03T13:08:11.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.887+0000 7f67fbfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67fc0b52c0 0x7f67fc0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:11.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.887+0000 7f67f37fe700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f67fc0b0c90 0x7f67fc098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:40854/0 (socket says 172.21.15.133:40854) 2021-01-03T13:08:11.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.887+0000 7f67f37fe700 1 -- 172.21.15.133:0/916946768 learned_addr learned my addr 172.21.15.133:0/916946768 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:08:11.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.887+0000 7f6800d81700 1 --2- 172.21.15.133:0/916946768 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f67fc0b5c00 0x7f67fc143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:11.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f67fbfff700 1 -- 172.21.15.133:0/916946768 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f67fc0b5c00 msgr2=0x7f67fc143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:08:11.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f67fbfff700 1 --2- 172.21.15.133:0/916946768 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f67fc0b5c00 0x7f67fc143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f67fbfff700 1 -- 172.21.15.133:0/916946768 >> v1:172.21.15.16:6789/0 conn(0x7f67fc0b0c90 legacy=0x7f67fc098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:11.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f67fbfff700 1 -- 172.21.15.133:0/916946768 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc0b56a0 con 0x7f67fc0b52c0 2021-01-03T13:08:11.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f67fbfff700 1 --2- 172.21.15.133:0/916946768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc0b52c0 0x7f67fc0b05e0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f67e4002f30 tx=0x7f67e4006dc0).ready entity=mon.1 client_cookie=5352e355804bd348 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:11.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f67fb7fe700 1 -- 172.21.15.133:0/916946768 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67e4009760 con 0x7f67fc0b52c0 2021-01-03T13:08:11.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f67fb7fe700 1 -- 172.21.15.133:0/916946768 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e40098c0 con 0x7f67fc0b52c0 2021-01-03T13:08:11.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f67fb7fe700 1 -- 172.21.15.133:0/916946768 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67e4009c20 con 0x7f67fc0b52c0 2021-01-03T13:08:11.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f6801582700 1 -- 172.21.15.133:0/916946768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc0b52c0 msgr2=0x7f67fc0b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:11.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f6801582700 1 --2- 172.21.15.133:0/916946768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc0b52c0 0x7f67fc0b05e0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f67e4002f30 tx=0x7f67e4006dc0).stop 2021-01-03T13:08:11.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f6801582700 1 -- 172.21.15.133:0/916946768 shutdown_connections 2021-01-03T13:08:11.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f6801582700 1 --2- 172.21.15.133:0/916946768 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f67fc0b5c00 0x7f67fc143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f6801582700 1 --2- 172.21.15.133:0/916946768 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc0b52c0 0x7f67fc0b05e0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f6801582700 1 -- 172.21.15.133:0/916946768 >> 172.21.15.133:0/916946768 conn(0x7f67fc05bdf0 msgr2=0x7f67fc05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:11.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f6801582700 1 -- 172.21.15.133:0/916946768 shutdown_connections 2021-01-03T13:08:11.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f6801582700 1 -- 172.21.15.133:0/916946768 wait complete. 2021-01-03T13:08:11.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f6801582700 1 Processor -- start 2021-01-03T13:08:11.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f6801582700 1 -- start start 2021-01-03T13:08:11.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f6801582700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc0b0c90 0x7f67fc065a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:11.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f6801582700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67fc0b52c0 0x7f67fc155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:11.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f6801582700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f67fc0b5c00 0x7f67fc156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:11.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f6801582700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc156800 con 0x7f67fc0b52c0 2021-01-03T13:08:11.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f6801582700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc064a10 con 0x7f67fc0b0c90 2021-01-03T13:08:11.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.891+0000 7f6801582700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc064cb0 con 0x7f67fc0b5c00 2021-01-03T13:08:11.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67fbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc0b0c90 0x7f67fc065a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:11.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67fbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc0b0c90 0x7f67fc065a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41100/0 (socket says 172.21.15.133:41100) 2021-01-03T13:08:11.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67fbfff700 1 -- 172.21.15.133:0/3873026311 learned_addr learned my addr 172.21.15.133:0/3873026311 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:11.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f6800d81700 1 --2- 172.21.15.133:0/3873026311 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f67fc0b5c00 0x7f67fc156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:11.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67f37fe700 1 --2- 172.21.15.133:0/3873026311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67fc0b52c0 0x7f67fc155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:11.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67fbfff700 1 -- 172.21.15.133:0/3873026311 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f67fc0b5c00 msgr2=0x7f67fc156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:11.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67fbfff700 1 --2- 172.21.15.133:0/3873026311 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f67fc0b5c00 0x7f67fc156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67fbfff700 1 -- 172.21.15.133:0/3873026311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67fc0b52c0 msgr2=0x7f67fc155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:11.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67fbfff700 1 --2- 172.21.15.133:0/3873026311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67fc0b52c0 0x7f67fc155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:11.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67fbfff700 1 -- 172.21.15.133:0/3873026311 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc064f50 con 0x7f67fc0b0c90 2021-01-03T13:08:11.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67fbfff700 1 --2- 172.21.15.133:0/3873026311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc0b0c90 0x7f67fc065a00 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f67e4002f30 tx=0x7f67e4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:11.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67f9ffb700 1 -- 172.21.15.133:0/3873026311 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67e4011b80 con 0x7f67fc0b0c90 2021-01-03T13:08:11.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67f9ffb700 1 -- 172.21.15.133:0/3873026311 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e4011ce0 con 0x7f67fc0b0c90 2021-01-03T13:08:11.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f6801582700 1 -- 172.21.15.133:0/3873026311 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67fc063de0 con 0x7f67fc0b0c90 2021-01-03T13:08:11.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67f9ffb700 1 -- 172.21.15.133:0/3873026311 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67e401d630 con 0x7f67fc0b0c90 2021-01-03T13:08:11.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f6801582700 1 -- 172.21.15.133:0/3873026311 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67fc064280 con 0x7f67fc0b0c90 2021-01-03T13:08:11.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67f9ffb700 1 -- 172.21.15.133:0/3873026311 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f67e4024030 con 0x7f67fc0b0c90 2021-01-03T13:08:11.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67f9ffb700 1 --2- 172.21.15.133:0/3873026311 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f67d4055350 0x7f67d4057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:11.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f6801582700 1 -- 172.21.15.133:0/3873026311 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67fc057300 con 0x7f67fc0b0c90 2021-01-03T13:08:11.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67f9ffb700 1 -- 172.21.15.133:0/3873026311 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f67e406ef60 con 0x7f67fc0b0c90 2021-01-03T13:08:11.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67f37fe700 1 --2- 172.21.15.133:0/3873026311 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f67d4055350 0x7f67d4057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:11.907 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.895+0000 7f67f37fe700 1 --2- 172.21.15.133:0/3873026311 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f67d4055350 0x7f67d4057810 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f67ec00b000 tx=0x7f67ec009040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:11.908 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:11.903+0000 7f67f9ffb700 1 -- 172.21.15.133:0/3873026311 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f67e4045210 con 0x7f67fc0b0c90 2021-01-03T13:08:12.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:12.087+0000 7f6801582700 1 -- 172.21.15.133:0/3873026311 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f67fc05ce00 con 0x7f67fc0b0c90 2021-01-03T13:08:12.985 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:12.983+0000 7f67f9ffb700 1 -- 172.21.15.133:0/3873026311 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v81) v1 ==== 104+0+0 (secure 0 0 0) 0x7f67e4022020 con 0x7f67fc0b0c90 2021-01-03T13:08:12.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:12.987+0000 7f6801582700 1 -- 172.21.15.133:0/3873026311 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f67d4055350 msgr2=0x7f67d4057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:12.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:12.987+0000 7f6801582700 1 --2- 172.21.15.133:0/3873026311 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f67d4055350 0x7f67d4057810 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f67ec00b000 tx=0x7f67ec009040).stop 2021-01-03T13:08:12.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:12.987+0000 7f6801582700 1 -- 172.21.15.133:0/3873026311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc0b0c90 msgr2=0x7f67fc065a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:12.989 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:12.987+0000 7f6801582700 1 --2- 172.21.15.133:0/3873026311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc0b0c90 0x7f67fc065a00 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f67e4002f30 tx=0x7f67e4015000).stop 2021-01-03T13:08:12.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:12.987+0000 7f6801582700 1 -- 172.21.15.133:0/3873026311 shutdown_connections 2021-01-03T13:08:12.990 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:12.987+0000 7f6801582700 1 --2- 172.21.15.133:0/3873026311 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f67d4055350 0x7f67d4057810 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:12.987+0000 7f6801582700 1 --2- 172.21.15.133:0/3873026311 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f67fc0b5c00 0x7f67fc156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:12.987+0000 7f6801582700 1 --2- 172.21.15.133:0/3873026311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67fc0b0c90 0x7f67fc065a00 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:12.987+0000 7f6801582700 1 --2- 172.21.15.133:0/3873026311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f67fc0b52c0 0x7f67fc155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:12.987+0000 7f6801582700 1 -- 172.21.15.133:0/3873026311 >> 172.21.15.133:0/3873026311 conn(0x7f67fc05bdf0 msgr2=0x7f67fc098e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:12.991 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:12.987+0000 7f6801582700 1 -- 172.21.15.133:0/3873026311 shutdown_connections 2021-01-03T13:08:12.992 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:12.987+0000 7f6801582700 1 -- 172.21.15.133:0/3873026311 wait complete. 2021-01-03T13:08:13.008 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2021-01-03T13:08:13.127 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.123+0000 7f9ece6ce700 1 Processor -- start 2021-01-03T13:08:13.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.123+0000 7f9ece6ce700 1 -- start start 2021-01-03T13:08:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9ece6ce700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ec80b5590 0x7f9ec8143a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9ece6ce700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec805f5e0 con 0x7f9ec805c8e0 2021-01-03T13:08:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9ece6ce700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec805c510 con 0x7f9ec805c130 2021-01-03T13:08:13.129 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9ece6ce700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec80b59c0 con 0x7f9ec80b5590 2021-01-03T13:08:13.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9eccc6b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ec80b5590 0x7f9ec8143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:13.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9ec7fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9ec805c130 0x7f9ec8143310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33908/0 (socket says 172.21.15.133:33908) 2021-01-03T13:08:13.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9ec7fff700 1 -- 172.21.15.133:0/4081152713 learned_addr learned my addr 172.21.15.133:0/4081152713 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:08:13.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9eccc6b700 1 -- 172.21.15.133:0/4081152713 >> v1:172.21.15.133:6789/0 conn(0x7f9ec805c130 legacy=0x7f9ec8143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:13.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9eccc6b700 1 -- 172.21.15.133:0/4081152713 >> v1:172.21.15.16:6789/0 conn(0x7f9ec805c8e0 legacy=0x7f9ec813fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:13.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9eccc6b700 1 -- 172.21.15.133:0/4081152713 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec80b0190 con 0x7f9ec80b5590 2021-01-03T13:08:13.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9ec6ffd700 1 -- 172.21.15.133:0/4081152713 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110266161 0 0) 0x7f9ec805c510 con 0x7f9ec805c130 2021-01-03T13:08:13.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9eccc6b700 1 --2- 172.21.15.133:0/4081152713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ec80b5590 0x7f9ec8143a20 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7f9ec81431f0 tx=0x7f9ec00091a0).ready entity=mon.1 client_cookie=15e4c66065a51181 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:13.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9ec6ffd700 1 -- 172.21.15.133:0/4081152713 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ec0009e70 con 0x7f9ec80b5590 2021-01-03T13:08:13.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9ec6ffd700 1 -- 172.21.15.133:0/4081152713 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec000bbc0 con 0x7f9ec80b5590 2021-01-03T13:08:13.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9ec6ffd700 1 -- 172.21.15.133:0/4081152713 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ec000bd30 con 0x7f9ec80b5590 2021-01-03T13:08:13.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9ece6ce700 1 -- 172.21.15.133:0/4081152713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ec80b5590 msgr2=0x7f9ec8143a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:13.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9ece6ce700 1 --2- 172.21.15.133:0/4081152713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ec80b5590 0x7f9ec8143a20 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7f9ec81431f0 tx=0x7f9ec00091a0).stop 2021-01-03T13:08:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9ece6ce700 1 -- 172.21.15.133:0/4081152713 shutdown_connections 2021-01-03T13:08:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9ece6ce700 1 --2- 172.21.15.133:0/4081152713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ec80b5590 0x7f9ec8143a20 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9ece6ce700 1 -- 172.21.15.133:0/4081152713 >> 172.21.15.133:0/4081152713 conn(0x7f9ec80b9620 msgr2=0x7f9ec80b9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9ece6ce700 1 -- 172.21.15.133:0/4081152713 shutdown_connections 2021-01-03T13:08:13.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.127+0000 7f9ece6ce700 1 -- 172.21.15.133:0/4081152713 wait complete. 2021-01-03T13:08:13.136 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ece6ce700 1 Processor -- start 2021-01-03T13:08:13.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ece6ce700 1 -- start start 2021-01-03T13:08:13.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ece6ce700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ec805c130 0x7f9ec8060250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:13.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ece6ce700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ec805c8e0 0x7f9ec8151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:13.137 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ece6ce700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ec80b5590 0x7f9ec8152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:13.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ece6ce700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec81550c0 con 0x7f9ec805c8e0 2021-01-03T13:08:13.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ece6ce700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec81552f0 con 0x7f9ec805c130 2021-01-03T13:08:13.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ece6ce700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec8155590 con 0x7f9ec80b5590 2021-01-03T13:08:13.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ec7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ec805c130 0x7f9ec8060250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:13.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ec7fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ec805c130 0x7f9ec8060250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41114/0 (socket says 172.21.15.133:41114) 2021-01-03T13:08:13.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ec7fff700 1 -- 172.21.15.133:0/2838630705 learned_addr learned my addr 172.21.15.133:0/2838630705 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:13.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ec77fe700 1 --2- 172.21.15.133:0/2838630705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ec805c8e0 0x7f9ec8151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:13.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9eccc6b700 1 --2- 172.21.15.133:0/2838630705 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ec80b5590 0x7f9ec8152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:13.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ec7fff700 1 -- 172.21.15.133:0/2838630705 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ec80b5590 msgr2=0x7f9ec8152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:13.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ec7fff700 1 --2- 172.21.15.133:0/2838630705 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ec80b5590 0x7f9ec8152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:13.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ec7fff700 1 -- 172.21.15.133:0/2838630705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ec805c8e0 msgr2=0x7f9ec8151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:13.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ec7fff700 1 --2- 172.21.15.133:0/2838630705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ec805c8e0 0x7f9ec8151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:13.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ec7fff700 1 -- 172.21.15.133:0/2838630705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec8155830 con 0x7f9ec805c130 2021-01-03T13:08:13.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9eccc6b700 1 --2- 172.21.15.133:0/2838630705 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ec80b5590 0x7f9ec8152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:08:13.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ec7fff700 1 --2- 172.21.15.133:0/2838630705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ec805c130 0x7f9ec8060250 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f9ec81476c0 tx=0x7f9eb8007a30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ec57fa700 1 -- 172.21.15.133:0/2838630705 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9eb80072e0 con 0x7f9ec805c130 2021-01-03T13:08:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ec57fa700 1 -- 172.21.15.133:0/2838630705 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb8007440 con 0x7f9ec805c130 2021-01-03T13:08:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ece6ce700 1 -- 172.21.15.133:0/2838630705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec8060740 con 0x7f9ec805c130 2021-01-03T13:08:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ec57fa700 1 -- 172.21.15.133:0/2838630705 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9eb80057d0 con 0x7f9ec805c130 2021-01-03T13:08:13.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.131+0000 7f9ece6ce700 1 -- 172.21.15.133:0/2838630705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec8148780 con 0x7f9ec805c130 2021-01-03T13:08:13.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.135+0000 7f9ece6ce700 1 -- 172.21.15.133:0/2838630705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec81559c0 con 0x7f9ec805c130 2021-01-03T13:08:13.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.135+0000 7f9ec57fa700 1 -- 172.21.15.133:0/2838630705 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f9eb8010070 con 0x7f9ec805c130 2021-01-03T13:08:13.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.135+0000 7f9ec57fa700 1 --2- 172.21.15.133:0/2838630705 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9eac055440 0x7f9eac057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:13.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.135+0000 7f9ec57fa700 1 -- 172.21.15.133:0/2838630705 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9eb806d770 con 0x7f9ec805c130 2021-01-03T13:08:13.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.135+0000 7f9ec77fe700 1 --2- 172.21.15.133:0/2838630705 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9eac055440 0x7f9eac057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:13.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.135+0000 7f9ec77fe700 1 --2- 172.21.15.133:0/2838630705 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9eac055440 0x7f9eac057900 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f9eb000d000 tx=0x7f9eb0007b60).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:13.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.139+0000 7f9ec57fa700 1 -- 172.21.15.133:0/2838630705 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9eb80439c0 con 0x7f9ec805c130 2021-01-03T13:08:13.287 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:13.283+0000 7f9ece6ce700 1 -- 172.21.15.133:0/2838630705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9ec8057300 con 0x7f9ec805c130 2021-01-03T13:08:14.284 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.279+0000 7f9ec57fa700 1 -- 172.21.15.133:0/2838630705 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v164) v1 ==== 185+0+0 (secure 0 0 0) 0x7f9eb8046fe0 con 0x7f9ec805c130 2021-01-03T13:08:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.283+0000 7f9ece6ce700 1 -- 172.21.15.133:0/2838630705 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9eac055440 msgr2=0x7f9eac057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.283+0000 7f9ece6ce700 1 --2- 172.21.15.133:0/2838630705 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9eac055440 0x7f9eac057900 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f9eb000d000 tx=0x7f9eb0007b60).stop 2021-01-03T13:08:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.283+0000 7f9ece6ce700 1 -- 172.21.15.133:0/2838630705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ec805c130 msgr2=0x7f9ec8060250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:14.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.283+0000 7f9ece6ce700 1 --2- 172.21.15.133:0/2838630705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ec805c130 0x7f9ec8060250 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f9ec81476c0 tx=0x7f9eb8007a30).stop 2021-01-03T13:08:14.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.287+0000 7f9ece6ce700 1 -- 172.21.15.133:0/2838630705 shutdown_connections 2021-01-03T13:08:14.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.287+0000 7f9ece6ce700 1 --2- 172.21.15.133:0/2838630705 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f9eac055440 0x7f9eac057900 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:14.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.287+0000 7f9ece6ce700 1 --2- 172.21.15.133:0/2838630705 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f9ec80b5590 0x7f9ec8152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:14.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.287+0000 7f9ece6ce700 1 --2- 172.21.15.133:0/2838630705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ec805c130 0x7f9ec8060250 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:14.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.287+0000 7f9ece6ce700 1 --2- 172.21.15.133:0/2838630705 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9ec805c8e0 0x7f9ec8151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:14.290 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.287+0000 7f9ece6ce700 1 -- 172.21.15.133:0/2838630705 >> 172.21.15.133:0/2838630705 conn(0x7f9ec80b9620 msgr2=0x7f9ec813fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.287+0000 7f9ece6ce700 1 -- 172.21.15.133:0/2838630705 shutdown_connections 2021-01-03T13:08:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.287+0000 7f9ece6ce700 1 -- 172.21.15.133:0/2838630705 wait complete. 2021-01-03T13:08:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2021-01-03T13:08:14.303 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2021-01-03T13:08:14.421 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd487e93700 1 Processor -- start 2021-01-03T13:08:14.422 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd487e93700 1 -- start start 2021-01-03T13:08:14.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd487e93700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd48013fb40 0x7fd48013fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:14.431 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd487e93700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48005cc20 con 0x7fd48005c840 2021-01-03T13:08:14.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd487e93700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd480143df0 con 0x7fd48013c890 2021-01-03T13:08:14.432 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd487e93700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4800aa1f0 con 0x7fd48013fb40 2021-01-03T13:08:14.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd486430700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd48013c890 0x7fd48013cd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33926/0 (socket says 172.21.15.133:33926) 2021-01-03T13:08:14.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd486430700 1 -- 172.21.15.133:0/188631449 learned_addr learned my addr 172.21.15.133:0/188631449 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:08:14.433 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd48542e700 1 --2- 172.21.15.133:0/188631449 >> v2:172.21.15.16:3300/0 conn(0x7fd48013fb40 0x7fd48013fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:14.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd484c2d700 1 -- 172.21.15.133:0/188631449 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821073153 0 0) 0x7fd480143df0 con 0x7fd48013c890 2021-01-03T13:08:14.434 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd484c2d700 1 -- 172.21.15.133:0/188631449 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd468003230 con 0x7fd48013c890 2021-01-03T13:08:14.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd484c2d700 1 -- 172.21.15.133:0/188631449 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188775992 0 0) 0x7fd48005cc20 con 0x7fd48005c840 2021-01-03T13:08:14.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd484c2d700 1 -- 172.21.15.133:0/188631449 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd480143df0 con 0x7fd48005c840 2021-01-03T13:08:14.435 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd48542e700 1 -- 172.21.15.133:0/188631449 >> v1:172.21.15.133:6789/0 conn(0x7fd48013c890 legacy=0x7fd48013cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:14.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd484c2d700 1 -- 172.21.15.133:0/188631449 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2485262216 0 0) 0x7fd468003230 con 0x7fd48013c890 2021-01-03T13:08:14.436 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd48542e700 1 -- 172.21.15.133:0/188631449 >> v1:172.21.15.16:6789/0 conn(0x7fd48005c840 legacy=0x7fd4800b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:14.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd48542e700 1 -- 172.21.15.133:0/188631449 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4800a9ab0 con 0x7fd48013fb40 2021-01-03T13:08:14.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.419+0000 7fd48542e700 1 --2- 172.21.15.133:0/188631449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd48013fb40 0x7fd48013fff0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fd4800af650 tx=0x7fd470006dc0).ready entity=mon.0 client_cookie=6afc46e78536ab67 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:14.437 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.423+0000 7fd484c2d700 1 -- 172.21.15.133:0/188631449 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4780016d0 con 0x7fd48013fb40 2021-01-03T13:08:14.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.423+0000 7fd484c2d700 1 -- 172.21.15.133:0/188631449 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47000d610 con 0x7fd48013fb40 2021-01-03T13:08:14.438 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.423+0000 7fd484c2d700 1 -- 172.21.15.133:0/188631449 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd47000d780 con 0x7fd48013fb40 2021-01-03T13:08:14.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.423+0000 7fd487e93700 1 -- 172.21.15.133:0/188631449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd48013fb40 msgr2=0x7fd48013fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:14.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.423+0000 7fd487e93700 1 --2- 172.21.15.133:0/188631449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd48013fb40 0x7fd48013fff0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fd4800af650 tx=0x7fd470006dc0).stop 2021-01-03T13:08:14.439 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.423+0000 7fd487e93700 1 -- 172.21.15.133:0/188631449 shutdown_connections 2021-01-03T13:08:14.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.423+0000 7fd487e93700 1 --2- 172.21.15.133:0/188631449 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd48013fb40 0x7fd48013fff0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:14.440 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.423+0000 7fd487e93700 1 -- 172.21.15.133:0/188631449 >> 172.21.15.133:0/188631449 conn(0x7fd48006aeb0 msgr2=0x7fd48005bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:14.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.423+0000 7fd487e93700 1 -- 172.21.15.133:0/188631449 shutdown_connections 2021-01-03T13:08:14.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.423+0000 7fd487e93700 1 -- 172.21.15.133:0/188631449 wait complete. 2021-01-03T13:08:14.441 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.423+0000 7fd487e93700 1 Processor -- start 2021-01-03T13:08:14.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.423+0000 7fd487e93700 1 -- start start 2021-01-03T13:08:14.442 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.423+0000 7fd487e93700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd48005c840 0x7fd480067b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:14.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.423+0000 7fd487e93700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd48013c890 0x7fd4801501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:14.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.423+0000 7fd487e93700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd48013fb40 0x7fd4801506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:14.443 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.423+0000 7fd487e93700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd480150bc0 con 0x7fd48013c890 2021-01-03T13:08:14.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd487e93700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd480063280 con 0x7fd48013fb40 2021-01-03T13:08:14.444 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd487e93700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd480063520 con 0x7fd48005c840 2021-01-03T13:08:14.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd486430700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd48013fb40 0x7fd4801506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:14.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd48542e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd48013c890 0x7fd4801501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:14.445 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd486430700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd48013fb40 0x7fd4801506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41132/0 (socket says 172.21.15.133:41132) 2021-01-03T13:08:14.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd486430700 1 -- 172.21.15.133:0/3092413516 learned_addr learned my addr 172.21.15.133:0/3092413516 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:08:14.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd485c2f700 1 --2- 172.21.15.133:0/3092413516 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd48005c840 0x7fd480067b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:14.446 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd486430700 1 -- 172.21.15.133:0/3092413516 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd48005c840 msgr2=0x7fd480067b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:14.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd486430700 1 --2- 172.21.15.133:0/3092413516 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd48005c840 0x7fd480067b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:14.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd486430700 1 -- 172.21.15.133:0/3092413516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd48013c890 msgr2=0x7fd4801501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:14.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd486430700 1 --2- 172.21.15.133:0/3092413516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd48013c890 0x7fd4801501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:14.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd486430700 1 -- 172.21.15.133:0/3092413516 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48014fcd0 con 0x7fd48013fb40 2021-01-03T13:08:14.447 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd486430700 1 --2- 172.21.15.133:0/3092413516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd48013fb40 0x7fd4801506d0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7fd480066520 tx=0x7fd478001280).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:14.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd46effd700 1 -- 172.21.15.133:0/3092413516 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd478007170 con 0x7fd48013fb40 2021-01-03T13:08:14.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd46effd700 1 -- 172.21.15.133:0/3092413516 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4780072d0 con 0x7fd48013fb40 2021-01-03T13:08:14.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd46effd700 1 -- 172.21.15.133:0/3092413516 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4780048f0 con 0x7fd48013fb40 2021-01-03T13:08:14.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd487e93700 1 -- 172.21.15.133:0/3092413516 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4800641a0 con 0x7fd48013fb40 2021-01-03T13:08:14.448 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd487e93700 1 -- 172.21.15.133:0/3092413516 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd480067490 con 0x7fd48013fb40 2021-01-03T13:08:14.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd487e93700 1 -- 172.21.15.133:0/3092413516 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd480063990 con 0x7fd48013fb40 2021-01-03T13:08:14.449 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd46effd700 1 -- 172.21.15.133:0/3092413516 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fd478004a50 con 0x7fd48013fb40 2021-01-03T13:08:14.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd46effd700 1 --2- 172.21.15.133:0/3092413516 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd460055330 0x7fd4600577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:08:14.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd46effd700 1 -- 172.21.15.133:0/3092413516 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fd47806d760 con 0x7fd48013fb40 2021-01-03T13:08:14.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.427+0000 7fd485c2f700 1 --2- 172.21.15.133:0/3092413516 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd460055330 0x7fd4600577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:08:14.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.431+0000 7fd485c2f700 1 --2- 172.21.15.133:0/3092413516 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd460055330 0x7fd4600577f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fd47c00d000 tx=0x7fd47c007d70).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:08:14.451 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.439+0000 7fd46effd700 1 -- 172.21.15.133:0/3092413516 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd478043bc0 con 0x7fd48013fb40 2021-01-03T13:08:14.580 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:14.579+0000 7fd487e93700 1 -- 172.21.15.133:0/3092413516 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd480057300 con 0x7fd48013fb40 2021-01-03T13:08:15.403 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:15.399+0000 7fd46effd700 1 -- 172.21.15.133:0/3092413516 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v165) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd4780471e0 con 0x7fd48013fb40 2021-01-03T13:08:15.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:15.403+0000 7fd487e93700 1 -- 172.21.15.133:0/3092413516 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd460055330 msgr2=0x7fd4600577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:15.406 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:15.403+0000 7fd487e93700 1 --2- 172.21.15.133:0/3092413516 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd460055330 0x7fd4600577f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fd47c00d000 tx=0x7fd47c007d70).stop 2021-01-03T13:08:15.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:15.403+0000 7fd487e93700 1 -- 172.21.15.133:0/3092413516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd48013fb40 msgr2=0x7fd4801506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:08:15.407 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:15.403+0000 7fd487e93700 1 --2- 172.21.15.133:0/3092413516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd48013fb40 0x7fd4801506d0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7fd480066520 tx=0x7fd478001280).stop 2021-01-03T13:08:15.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:15.403+0000 7fd487e93700 1 -- 172.21.15.133:0/3092413516 shutdown_connections 2021-01-03T13:08:15.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:15.403+0000 7fd487e93700 1 --2- 172.21.15.133:0/3092413516 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fd460055330 0x7fd4600577f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:15.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:15.403+0000 7fd487e93700 1 --2- 172.21.15.133:0/3092413516 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd48013fb40 0x7fd4801506d0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:15.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:15.403+0000 7fd487e93700 1 --2- 172.21.15.133:0/3092413516 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fd48005c840 0x7fd480067b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:15.408 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:15.403+0000 7fd487e93700 1 --2- 172.21.15.133:0/3092413516 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd48013c890 0x7fd4801501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:08:15.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:15.403+0000 7fd487e93700 1 -- 172.21.15.133:0/3092413516 >> 172.21.15.133:0/3092413516 conn(0x7fd48006aeb0 msgr2=0x7fd4800abf10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:08:15.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:15.403+0000 7fd487e93700 1 -- 172.21.15.133:0/3092413516 shutdown_connections 2021-01-03T13:08:15.409 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:08:15.403+0000 7fd487e93700 1 -- 172.21.15.133:0/3092413516 wait complete. 2021-01-03T13:08:15.409 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2021-01-03T13:08:15.422 INFO:teuthology.orchestra.run:Running command with timeout 60 2021-01-03T13:08:15.423 DEBUG:teuthology.orchestra.run.smithi007:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2021-01-03T13:08:38.573 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:08:38.576 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:08:38.578 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:08:38.581 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:08:45.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:08:45.528 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:08:45.529 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:09:08.634 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:09:08.637 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:09:08.639 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:09:08.642 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:09:15.428 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-01-03T13:09:15.431 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-01-03T13:09:38.756 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:09:38.759 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:09:38.762 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:09:38.765 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:10:08.808 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:10:08.811 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:10:08.814 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:10:08.816 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:10:38.909 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:10:38.913 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:10:38.916 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:10:38.919 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:11:09.013 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:11:09.016 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:11:09.018 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:11:09.021 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:11:39.142 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:11:39.146 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:11:39.149 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:11:39.152 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:12:09.214 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:12:09.217 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:12:09.219 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:12:09.222 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:12:39.294 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:12:39.297 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:12:39.299 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:12:39.301 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:13:09.398 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:13:09.401 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:13:09.403 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:13:09.406 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:13:39.453 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:13:39.456 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:13:39.458 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:13:39.461 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:14:09.708 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:14:09.711 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:14:09.713 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:14:09.716 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:14:39.812 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:14:39.816 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:14:39.819 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:14:39.822 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:15:09.951 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:15:09.954 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:15:09.956 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:15:09.959 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:15:39.997 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:15:40.000 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:15:40.002 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:15:40.004 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:16:10.218 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:16:10.221 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:16:10.223 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:16:10.226 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:16:40.273 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:16:40.276 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:16:40.279 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:16:40.281 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:17:10.344 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:17:10.347 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:17:10.350 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:17:10.352 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:17:40.403 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:17:40.406 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:17:40.409 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:17:40.411 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:18:10.542 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:18:10.545 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:18:10.547 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:18:10.550 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:18:40.602 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:18:40.605 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:18:40.607 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:18:40.610 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:19:10.656 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:19:10.658 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:19:10.661 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:19:10.663 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:19:40.723 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:19:40.726 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:19:40.729 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:19:40.731 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:20:10.773 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:20:10.776 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:20:10.778 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:20:10.781 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:20:40.903 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:20:40.906 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:20:40.908 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:20:40.910 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:21:10.957 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:21:10.960 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:21:10.962 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:21:10.965 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:21:41.046 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:21:41.049 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:21:41.052 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:21:41.054 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:22:11.318 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:22:11.321 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:22:11.323 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:22:11.325 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:22:41.463 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:22:41.466 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:22:41.469 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:22:41.471 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:23:11.552 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:23:11.555 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:23:11.558 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:23:11.560 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:23:41.598 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:23:41.601 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:23:41.604 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:23:41.606 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:23:45.532 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-01-03T13:23:45.533 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-01-03T13:23:45.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:23:45.540 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2021-01-03T13:23:45.541 DEBUG:teuthology.orchestra.run.smithi007:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:23:45.559 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:23:45.577 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:23:45.595 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2021-01-03T13:23:45.613 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2021-01-03T13:23:45.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:23:45.614 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:23:45.614 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:24:11.786 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:24:11.789 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:24:11.791 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:24:11.794 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:24:41.849 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:24:41.852 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:24:41.855 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:24:41.857 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:25:11.987 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:25:11.990 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:25:11.993 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:25:11.995 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:25:42.034 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:25:42.038 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:25:42.040 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:25:42.043 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:26:12.122 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:26:12.125 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:26:12.127 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:26:12.129 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:26:42.260 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:26:42.263 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:26:42.266 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:26:42.268 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:27:12.355 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:27:12.358 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:27:12.360 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:27:12.363 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:27:42.406 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:27:42.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:27:42.411 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:27:42.414 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:28:12.574 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:28:12.577 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:28:12.579 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:28:12.581 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:28:42.696 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:28:42.699 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:28:42.701 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:28:42.704 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:29:12.750 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:29:12.753 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:29:12.755 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:29:12.758 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:29:42.797 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:29:42.800 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:29:42.803 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:29:42.806 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:30:12.884 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:30:12.888 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:30:12.890 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:30:12.892 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:30:43.022 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:30:43.025 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:30:43.027 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:30:43.030 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:31:13.118 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:31:13.121 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:31:13.123 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:31:13.126 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:31:43.192 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:31:43.195 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:31:43.198 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:31:43.200 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:32:13.261 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:32:13.264 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:32:13.266 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:32:13.269 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:32:43.421 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:32:43.424 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:32:43.426 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:32:43.428 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:33:13.471 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:33:13.474 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:33:13.476 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:33:13.478 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:33:43.529 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:33:43.537 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:33:43.545 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:33:43.549 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:34:13.598 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:34:13.601 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:34:13.603 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:34:13.605 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:34:43.644 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:34:43.647 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:34:43.649 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:34:43.652 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:35:13.824 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:35:13.829 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:35:13.831 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:35:13.834 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:35:43.887 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:35:43.889 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:35:43.892 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:35:43.894 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:36:14.034 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:36:14.041 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:36:14.052 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:36:14.061 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:36:44.123 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:36:44.126 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:36:44.128 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:36:44.131 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:37:14.201 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:37:14.203 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:37:14.206 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:37:14.209 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:37:44.378 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:37:44.381 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:37:44.383 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:37:44.385 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:38:14.427 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:38:14.430 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:38:14.432 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:38:14.435 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:38:44.474 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:38:44.477 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:38:44.479 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:38:44.481 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:38:45.618 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-01-03T13:38:45.623 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-01-03T13:38:45.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:38:45.629 INFO:tasks.cephfs_test_runner:test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) ... ERROR 2021-01-03T13:38:45.630 INFO:tasks.cephfs_test_runner:ERROR 2021-01-03T13:38:45.630 INFO:tasks.cephfs_test_runner: 2021-01-03T13:38:45.631 INFO:tasks.cephfs_test_runner:====================================================================== 2021-01-03T13:38:45.631 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-01-03T13:38:45.631 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-01-03T13:38:45.632 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-01-03T13:38:45.632 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-01-03T13:38:45.632 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-01-03T13:38:45.632 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-01-03T13:38:45.633 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-01-03T13:38:45.633 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-01-03T13:38:45.633 INFO:tasks.cephfs_test_runner: 2021-01-03T13:38:45.634 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-01-03T13:38:45.634 INFO:tasks.cephfs_test_runner: 2021-01-03T13:38:45.634 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-01-03T13:38:45.634 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-01-03T13:38:45.635 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-01-03T13:38:45.635 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-01-03T13:38:45.635 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-01-03T13:38:45.635 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-01-03T13:38:45.636 INFO:tasks.cephfs_test_runner: proc.wait() 2021-01-03T13:38:45.636 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 148, in wait 2021-01-03T13:38:45.636 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-01-03T13:38:45.636 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 683, in gevent._greenlet.Greenlet.get 2021-01-03T13:38:45.637 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception 2021-01-03T13:38:45.637 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2021-01-03T13:38:45.637 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-01-03T13:38:45.637 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run 2021-01-03T13:38:45.638 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-01-03T13:38:45.638 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-01-03T13:38:45.638 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-01-03T13:38:45.639 INFO:tasks.cephfs_test_runner: for line in f: 2021-01-03T13:38:45.639 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-01-03T13:38:45.639 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-01-03T13:38:45.639 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-01-03T13:38:45.640 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-01-03T13:38:45.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-01-03T13:38:45.640 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-01-03T13:38:45.640 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-01-03T13:38:45.641 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-01-03T13:38:45.641 INFO:tasks.cephfs_test_runner:socket.timeout 2021-01-03T13:38:45.641 INFO:tasks.cephfs_test_runner: 2021-01-03T13:38:45.641 INFO:tasks.cephfs_test_runner:====================================================================== 2021-01-03T13:38:45.642 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-01-03T13:38:45.642 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-01-03T13:38:45.642 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-01-03T13:38:45.642 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-01-03T13:38:45.643 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-01-03T13:38:45.643 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-01-03T13:38:45.643 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-01-03T13:38:45.644 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-01-03T13:38:45.644 INFO:tasks.cephfs_test_runner: 2021-01-03T13:38:45.644 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-01-03T13:38:45.644 INFO:tasks.cephfs_test_runner: 2021-01-03T13:38:45.645 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-01-03T13:38:45.645 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-01-03T13:38:45.645 INFO:tasks.cephfs_test_runner: m.teardown() 2021-01-03T13:38:45.645 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-01-03T13:38:45.646 INFO:tasks.cephfs_test_runner: self.umount() 2021-01-03T13:38:45.646 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-01-03T13:38:45.646 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-01-03T13:38:45.646 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-01-03T13:38:45.647 INFO:tasks.cephfs_test_runner: proc.wait() 2021-01-03T13:38:45.647 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 148, in wait 2021-01-03T13:38:45.647 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-01-03T13:38:45.647 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 683, in gevent._greenlet.Greenlet.get 2021-01-03T13:38:45.648 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception 2021-01-03T13:38:45.648 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2021-01-03T13:38:45.648 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-01-03T13:38:45.648 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run 2021-01-03T13:38:45.649 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-01-03T13:38:45.649 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-01-03T13:38:45.649 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-01-03T13:38:45.649 INFO:tasks.cephfs_test_runner: for line in f: 2021-01-03T13:38:45.650 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-01-03T13:38:45.650 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-01-03T13:38:45.650 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-01-03T13:38:45.651 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-01-03T13:38:45.651 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-01-03T13:38:45.651 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-01-03T13:38:45.651 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-01-03T13:38:45.652 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-01-03T13:38:45.652 INFO:tasks.cephfs_test_runner:socket.timeout 2021-01-03T13:38:45.652 INFO:tasks.cephfs_test_runner: 2021-01-03T13:38:45.652 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-01-03T13:38:45.653 INFO:tasks.cephfs_test_runner:Ran 12 tests in 2418.436s 2021-01-03T13:38:45.653 INFO:tasks.cephfs_test_runner: 2021-01-03T13:38:45.653 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2021-01-03T13:38:45.653 INFO:tasks.cephfs_test_runner: 2021-01-03T13:38:45.654 INFO:tasks.cephfs_test_runner:====================================================================== 2021-01-03T13:38:45.654 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-01-03T13:38:45.654 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-01-03T13:38:45.655 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-01-03T13:38:45.655 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-01-03T13:38:45.655 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-01-03T13:38:45.655 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-01-03T13:38:45.656 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-01-03T13:38:45.656 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-01-03T13:38:45.656 INFO:tasks.cephfs_test_runner: 2021-01-03T13:38:45.656 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-01-03T13:38:45.657 INFO:tasks.cephfs_test_runner: 2021-01-03T13:38:45.657 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-01-03T13:38:45.657 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2021-01-03T13:38:45.657 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2021-01-03T13:38:45.658 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2021-01-03T13:38:45.658 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2021-01-03T13:38:45.658 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-01-03T13:38:45.658 INFO:tasks.cephfs_test_runner: proc.wait() 2021-01-03T13:38:45.659 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 148, in wait 2021-01-03T13:38:45.659 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-01-03T13:38:45.659 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 683, in gevent._greenlet.Greenlet.get 2021-01-03T13:38:45.659 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception 2021-01-03T13:38:45.660 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2021-01-03T13:38:45.660 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-01-03T13:38:45.660 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run 2021-01-03T13:38:45.660 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-01-03T13:38:45.661 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-01-03T13:38:45.661 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-01-03T13:38:45.661 INFO:tasks.cephfs_test_runner: for line in f: 2021-01-03T13:38:45.661 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-01-03T13:38:45.662 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-01-03T13:38:45.662 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-01-03T13:38:45.662 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-01-03T13:38:45.662 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-01-03T13:38:45.663 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-01-03T13:38:45.663 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-01-03T13:38:45.663 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-01-03T13:38:45.663 INFO:tasks.cephfs_test_runner:socket.timeout 2021-01-03T13:38:45.664 INFO:tasks.cephfs_test_runner: 2021-01-03T13:38:45.664 INFO:tasks.cephfs_test_runner:====================================================================== 2021-01-03T13:38:45.664 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-01-03T13:38:45.665 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2021-01-03T13:38:45.665 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-01-03T13:38:45.665 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2021-01-03T13:38:45.665 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2021-01-03T13:38:45.666 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2021-01-03T13:38:45.666 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2021-01-03T13:38:45.666 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2021-01-03T13:38:45.666 INFO:tasks.cephfs_test_runner: 2021-01-03T13:38:45.667 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2021-01-03T13:38:45.667 INFO:tasks.cephfs_test_runner: 2021-01-03T13:38:45.667 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2021-01-03T13:38:45.668 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2021-01-03T13:38:45.668 INFO:tasks.cephfs_test_runner: m.teardown() 2021-01-03T13:38:45.668 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2021-01-03T13:38:45.668 INFO:tasks.cephfs_test_runner: self.umount() 2021-01-03T13:38:45.669 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2021-01-03T13:38:45.669 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2021-01-03T13:38:45.669 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2021-01-03T13:38:45.669 INFO:tasks.cephfs_test_runner: proc.wait() 2021-01-03T13:38:45.670 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 148, in wait 2021-01-03T13:38:45.670 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2021-01-03T13:38:45.670 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 683, in gevent._greenlet.Greenlet.get 2021-01-03T13:38:45.671 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception 2021-01-03T13:38:45.671 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise 2021-01-03T13:38:45.671 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2021-01-03T13:38:45.671 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run 2021-01-03T13:38:45.672 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 323, in copy_file_to 2021-01-03T13:38:45.672 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2021-01-03T13:38:45.672 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 276, in copy_to_log 2021-01-03T13:38:45.672 INFO:tasks.cephfs_test_runner: for line in f: 2021-01-03T13:38:45.673 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2021-01-03T13:38:45.673 INFO:tasks.cephfs_test_runner: line = self.readline() 2021-01-03T13:38:45.673 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2021-01-03T13:38:45.673 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2021-01-03T13:38:45.674 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2021-01-03T13:38:45.674 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2021-01-03T13:38:45.674 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2021-01-03T13:38:45.675 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2021-01-03T13:38:45.675 INFO:tasks.cephfs_test_runner:socket.timeout 2021-01-03T13:38:45.675 INFO:tasks.cephfs_test_runner: 2021-01-03T13:38:45.675 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-01-03T13:38:45.710 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=779339b24c9949d6bf6063565ba6407f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2021-01-03T13:38:45.711 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2021-01-03T13:38:45.719 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2021-01-03T13:38:45.737 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2021-01-03T13:38:45.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2021-01-03T13:38:45.738 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2021-01-03T13:38:45.738 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0) 2021-01-03T13:39:14.595 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:39:14.598 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:39:14.601 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:39:14.604 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:39:44.691 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:39:44.694 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:39:44.696 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:39:44.699 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:40:14.804 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:40:14.807 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:40:14.810 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:40:14.812 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:40:44.863 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:40:44.866 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:40:44.868 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:40:44.871 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:41:14.988 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:41:14.991 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:41:14.993 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:41:14.995 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:41:45.043 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:41:45.046 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:41:45.048 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:41:45.050 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:42:15.115 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:42:15.118 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:42:15.120 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:42:15.123 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:42:45.178 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:42:45.181 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:42:45.183 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:42:45.186 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:43:15.283 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:43:15.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:43:15.289 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:43:15.291 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:43:45.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:43:45.390 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:43:45.392 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:43:45.395 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:44:15.517 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:44:15.519 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:44:15.522 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:44:15.524 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:44:45.563 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:44:45.566 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:44:45.569 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:44:45.571 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:45:15.676 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:45:15.679 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:45:15.681 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:45:15.683 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:45:45.790 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:45:45.792 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:45:45.795 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:45:45.797 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:46:15.893 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:46:15.896 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:46:15.898 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:46:15.901 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:46:45.944 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:46:45.947 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:46:45.949 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:46:45.952 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:47:16.020 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:47:16.022 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:47:16.025 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:47:16.027 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:47:46.133 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:47:46.136 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:47:46.138 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:47:46.141 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:48:16.253 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:48:16.355 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:48:16.369 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:48:16.373 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:48:46.412 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:48:46.415 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:48:46.418 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:48:46.420 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:49:16.480 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:49:16.483 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:49:16.485 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:49:16.487 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:49:46.527 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:49:46.529 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:49:46.532 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:49:46.534 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:50:16.581 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:50:16.584 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:50:16.587 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:50:16.590 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:50:46.836 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:50:46.839 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:50:46.842 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:50:46.845 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:51:16.966 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:51:16.969 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:51:16.971 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:51:16.974 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:51:47.029 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:51:47.032 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:51:47.036 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:51:47.039 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:52:17.110 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:52:17.113 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:52:17.115 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:52:17.118 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:52:47.274 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:52:47.277 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:52:47.280 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:52:47.282 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:53:17.411 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:53:17.414 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:53:17.417 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:53:17.420 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:53:45.744 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-01-03T13:53:45.744 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2021-01-03T13:53:45.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:53:45.752 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 173, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/ceph_fuse.py", line 159, in task if mount.is_mounted(): File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 683, in gevent._greenlet.Greenlet.get File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-01-03T13:53:45.753 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2021-01-03T13:53:45.766 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2021-01-03T13:53:45.766 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:53:45.886 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ced9c4700 1 Processor -- start 2021-01-03T13:53:45.887 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ced9c4700 1 -- start start 2021-01-03T13:53:45.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ced9c4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ce80b5c10 0x7f4ce80aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:45.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ced9c4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ce80b0670 0x7f4ce814a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:45.888 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ced9c4700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4ce814acc0 0x7f4ce8144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:45.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ced9c4700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce8098550 con 0x7f4ce814acc0 2021-01-03T13:53:45.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ced9c4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce80b5ff0 con 0x7f4ce80b5c10 2021-01-03T13:53:45.889 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ced9c4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80b0b10 con 0x7f4ce80b0670 2021-01-03T13:53:45.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ce6ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ce80b5c10 0x7f4ce80aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:45.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ce6ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ce80b5c10 0x7f4ce80aae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41202/0 (socket says 172.21.15.133:41202) 2021-01-03T13:53:45.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ce6ffd700 1 -- 172.21.15.133:0/275187774 learned_addr learned my addr 172.21.15.133:0/275187774 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:45.890 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ce67fc700 1 --2- 172.21.15.133:0/275187774 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ce80b0670 0x7f4ce814a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:45.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ce77fe700 1 --2- 172.21.15.133:0/275187774 >> v2:172.21.15.16:3300/0 conn(0x7f4ce814acc0 0x7f4ce8144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:45.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ce6ffd700 1 -- 172.21.15.133:0/275187774 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ce80b0670 msgr2=0x7f4ce814a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:45.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ce6ffd700 1 --2- 172.21.15.133:0/275187774 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ce80b0670 0x7f4ce814a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:45.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ce6ffd700 1 -- 172.21.15.133:0/275187774 >> v2:172.21.15.16:3300/0 conn(0x7f4ce814acc0 msgr2=0x7f4ce8144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:45.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ce6ffd700 1 --2- 172.21.15.133:0/275187774 >> v2:172.21.15.16:3300/0 conn(0x7f4ce814acc0 0x7f4ce8144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:45.893 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ce6ffd700 1 -- 172.21.15.133:0/275187774 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce8098780 con 0x7f4ce80b5c10 2021-01-03T13:53:45.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.884+0000 7f4ce6ffd700 1 --2- 172.21.15.133:0/275187774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ce80b5c10 0x7f4ce80aae70 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f4cdc002f30 tx=0x7f4cdc006e80).ready entity=mon.1 client_cookie=570244764fb1cd9a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:45.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ce5ffb700 1 -- 172.21.15.133:0/275187774 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cdc009640 con 0x7f4ce80b5c10 2021-01-03T13:53:45.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ce5ffb700 1 -- 172.21.15.133:0/275187774 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cdc0097a0 con 0x7f4ce80b5c10 2021-01-03T13:53:45.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ce5ffb700 1 -- 172.21.15.133:0/275187774 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cdc009b00 con 0x7f4ce80b5c10 2021-01-03T13:53:45.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ced9c4700 1 -- 172.21.15.133:0/275187774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ce80b5c10 msgr2=0x7f4ce80aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:45.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ced9c4700 1 --2- 172.21.15.133:0/275187774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ce80b5c10 0x7f4ce80aae70 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f4cdc002f30 tx=0x7f4cdc006e80).stop 2021-01-03T13:53:45.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ced9c4700 1 -- 172.21.15.133:0/275187774 shutdown_connections 2021-01-03T13:53:45.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ced9c4700 1 --2- 172.21.15.133:0/275187774 >> v2:172.21.15.16:3300/0 conn(0x7f4ce814acc0 0x7f4ce8144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:45.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ced9c4700 1 --2- 172.21.15.133:0/275187774 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ce80b5c10 0x7f4ce80aae70 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:45.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ced9c4700 1 --2- 172.21.15.133:0/275187774 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ce80b0670 0x7f4ce814a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:45.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ced9c4700 1 -- 172.21.15.133:0/275187774 >> 172.21.15.133:0/275187774 conn(0x7f4ce805c8c0 msgr2=0x7f4ce80b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:45.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ced9c4700 1 -- 172.21.15.133:0/275187774 shutdown_connections 2021-01-03T13:53:45.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ced9c4700 1 -- 172.21.15.133:0/275187774 wait complete. 2021-01-03T13:53:45.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ced9c4700 1 Processor -- start 2021-01-03T13:53:45.897 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ced9c4700 1 -- start start 2021-01-03T13:53:45.899 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ced9c4700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce80b0670 0x7f4ce8147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:45.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ced9c4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ce80b5c10 0x7f4ce814dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:45.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ced9c4700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ce814acc0 0x7f4ce80ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:45.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ced9c4700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce814e7a0 con 0x7f4ce80b0670 2021-01-03T13:53:45.900 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.888+0000 7f4ced9c4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce8147680 con 0x7f4ce80b5c10 2021-01-03T13:53:45.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4ced9c4700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce8147920 con 0x7f4ce814acc0 2021-01-03T13:53:45.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4ce67fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ce80b5c10 0x7f4ce814dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:45.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4ce67fc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ce80b5c10 0x7f4ce814dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41208/0 (socket says 172.21.15.133:41208) 2021-01-03T13:53:45.901 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4ce67fc700 1 -- 172.21.15.133:0/2322183089 learned_addr learned my addr 172.21.15.133:0/2322183089 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:45.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4ce77fe700 1 --2- 172.21.15.133:0/2322183089 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ce814acc0 0x7f4ce80ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:45.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4ce6ffd700 1 --2- 172.21.15.133:0/2322183089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce80b0670 0x7f4ce8147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:45.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4ce67fc700 1 -- 172.21.15.133:0/2322183089 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ce814acc0 msgr2=0x7f4ce80ae4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:45.902 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4ce67fc700 1 --2- 172.21.15.133:0/2322183089 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ce814acc0 0x7f4ce80ae4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:45.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4ce67fc700 1 -- 172.21.15.133:0/2322183089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce80b0670 msgr2=0x7f4ce8147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:45.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4ce67fc700 1 --2- 172.21.15.133:0/2322183089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce80b0670 0x7f4ce8147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:45.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4ce67fc700 1 -- 172.21.15.133:0/2322183089 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce81468e0 con 0x7f4ce80b5c10 2021-01-03T13:53:45.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4ce67fc700 1 --2- 172.21.15.133:0/2322183089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ce80b5c10 0x7f4ce814dd80 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f4cd800c000 tx=0x7f4cd8006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:45.903 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4cd7fff700 1 -- 172.21.15.133:0/2322183089 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cd800ca10 con 0x7f4ce80b5c10 2021-01-03T13:53:45.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4cd7fff700 1 -- 172.21.15.133:0/2322183089 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd800cb70 con 0x7f4ce80b5c10 2021-01-03T13:53:45.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4ced9c4700 1 -- 172.21.15.133:0/2322183089 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce8146360 con 0x7f4ce80b5c10 2021-01-03T13:53:45.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4cd7fff700 1 -- 172.21.15.133:0/2322183089 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cd80123f0 con 0x7f4ce80b5c10 2021-01-03T13:53:45.904 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4ced9c4700 1 -- 172.21.15.133:0/2322183089 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce80af1c0 con 0x7f4ce80b5c10 2021-01-03T13:53:45.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4ced9c4700 1 -- 172.21.15.133:0/2322183089 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce8147b20 con 0x7f4ce80b5c10 2021-01-03T13:53:45.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.892+0000 7f4cd7fff700 1 -- 172.21.15.133:0/2322183089 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f4cd8012550 con 0x7f4ce80b5c10 2021-01-03T13:53:45.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.896+0000 7f4cd7fff700 1 --2- 172.21.15.133:0/2322183089 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4cc4055440 0x7f4cc4057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:45.905 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.896+0000 7f4cd7fff700 1 -- 172.21.15.133:0/2322183089 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f4cd806dfa0 con 0x7f4ce80b5c10 2021-01-03T13:53:45.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.896+0000 7f4ce6ffd700 1 --2- 172.21.15.133:0/2322183089 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4cc4055440 0x7f4cc4057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:45.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.896+0000 7f4ce6ffd700 1 --2- 172.21.15.133:0/2322183089 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4cc4055440 0x7f4cc4057900 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f4cdc01b000 tx=0x7f4cdc015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:45.906 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:45.904+0000 7f4cd7fff700 1 -- 172.21.15.133:0/2322183089 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4cd8044520 con 0x7f4ce80b5c10 2021-01-03T13:53:46.048 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.044+0000 7f4ced9c4700 1 -- 172.21.15.133:0/2322183089 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ce8057300 con 0x7f4ce80b5c10 2021-01-03T13:53:46.049 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.048+0000 7f4cd7fff700 1 -- 172.21.15.133:0/2322183089 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+13370 (secure 0 0 0) 0x7f4cd8047b40 con 0x7f4ce80b5c10 2021-01-03T13:53:46.050 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:53:46.050 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":165,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:08:15.387348+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.133:6837/3193569550":"2021-01-04T13:08:10.972796+0000","172.21.15.133:6836/3193569550":"2021-01-04T13:08:10.972796+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:53:46.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.048+0000 7f4ced9c4700 1 -- 172.21.15.133:0/2322183089 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4cc4055440 msgr2=0x7f4cc4057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:46.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.048+0000 7f4ced9c4700 1 --2- 172.21.15.133:0/2322183089 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4cc4055440 0x7f4cc4057900 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f4cdc01b000 tx=0x7f4cdc015000).stop 2021-01-03T13:53:46.052 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.048+0000 7f4ced9c4700 1 -- 172.21.15.133:0/2322183089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ce80b5c10 msgr2=0x7f4ce814dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.048+0000 7f4ced9c4700 1 --2- 172.21.15.133:0/2322183089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ce80b5c10 0x7f4ce814dd80 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f4cd800c000 tx=0x7f4cd8006dc0).stop 2021-01-03T13:53:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.048+0000 7f4ced9c4700 1 -- 172.21.15.133:0/2322183089 shutdown_connections 2021-01-03T13:53:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.048+0000 7f4ced9c4700 1 --2- 172.21.15.133:0/2322183089 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f4cc4055440 0x7f4cc4057900 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.053 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.048+0000 7f4ced9c4700 1 --2- 172.21.15.133:0/2322183089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ce80b0670 0x7f4ce8147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.048+0000 7f4ced9c4700 1 --2- 172.21.15.133:0/2322183089 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f4ce814acc0 0x7f4ce80ae4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.048+0000 7f4ced9c4700 1 --2- 172.21.15.133:0/2322183089 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ce80b5c10 0x7f4ce814dd80 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.048+0000 7f4ced9c4700 1 -- 172.21.15.133:0/2322183089 >> 172.21.15.133:0/2322183089 conn(0x7f4ce805c8c0 msgr2=0x7f4ce814b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:46.054 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.048+0000 7f4ced9c4700 1 -- 172.21.15.133:0/2322183089 shutdown_connections 2021-01-03T13:53:46.055 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.048+0000 7f4ced9c4700 1 -- 172.21.15.133:0/2322183089 wait complete. 2021-01-03T13:53:46.069 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2021-01-03T13:53:46.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.176+0000 7f03dd97f700 1 Processor -- start 2021-01-03T13:53:46.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.176+0000 7f03dd97f700 1 -- start start 2021-01-03T13:53:46.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.176+0000 7f03dd97f700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f03d80b52c0 0x7f03d80b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:46.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.176+0000 7f03dd97f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03d80b0c90 0x7f03d8098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:46.182 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.176+0000 7f03dd97f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d8060da0 con 0x7f03d80b5c00 2021-01-03T13:53:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.176+0000 7f03dd97f700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d8067a90 con 0x7f03d80b52c0 2021-01-03T13:53:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.176+0000 7f03dd97f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d80b0ad0 con 0x7f03d80b0c90 2021-01-03T13:53:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.176+0000 7f03d7fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03d80b0c90 0x7f03d8098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:46.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.176+0000 7f03dd17e700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f03d80b5c00 0x7f03d814a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34018/0 (socket says 172.21.15.133:34018) 2021-01-03T13:53:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.176+0000 7f03dd17e700 1 -- 172.21.15.133:0/2718476525 learned_addr learned my addr 172.21.15.133:0/2718476525 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:53:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.176+0000 7f03dc97d700 1 --2- 172.21.15.133:0/2718476525 >> v2:172.21.15.16:3300/0 conn(0x7f03d80b52c0 0x7f03d80b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.176+0000 7f03d7fff700 1 -- 172.21.15.133:0/2718476525 >> v2:172.21.15.16:3300/0 conn(0x7f03d80b52c0 msgr2=0x7f03d80b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.176+0000 7f03d7fff700 1 --2- 172.21.15.133:0/2718476525 >> v2:172.21.15.16:3300/0 conn(0x7f03d80b52c0 0x7f03d80b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.176+0000 7f03d7fff700 1 -- 172.21.15.133:0/2718476525 >> v1:172.21.15.133:6789/0 conn(0x7f03d80b5c00 legacy=0x7f03d814a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.180+0000 7f03d7fff700 1 -- 172.21.15.133:0/2718476525 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d80b56a0 con 0x7f03d80b0c90 2021-01-03T13:53:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.180+0000 7f03dc97d700 1 --2- 172.21.15.133:0/2718476525 >> v2:172.21.15.16:3300/0 conn(0x7f03d80b52c0 0x7f03d80b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:53:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.180+0000 7f03d7fff700 1 --2- 172.21.15.133:0/2718476525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03d80b0c90 0x7f03d8098ec0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f03c0002f30 tx=0x7f03c0006dc0).ready entity=mon.1 client_cookie=e041afd26ff900de server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:46.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.180+0000 7f03d77fe700 1 -- 172.21.15.133:0/2718476525 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03c00097f0 con 0x7f03d80b0c90 2021-01-03T13:53:46.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.180+0000 7f03d77fe700 1 -- 172.21.15.133:0/2718476525 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c0009950 con 0x7f03d80b0c90 2021-01-03T13:53:46.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.180+0000 7f03d77fe700 1 -- 172.21.15.133:0/2718476525 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03c0009cb0 con 0x7f03d80b0c90 2021-01-03T13:53:46.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.180+0000 7f03dd97f700 1 -- 172.21.15.133:0/2718476525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03d80b0c90 msgr2=0x7f03d8098ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:46.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.180+0000 7f03dd97f700 1 --2- 172.21.15.133:0/2718476525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03d80b0c90 0x7f03d8098ec0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f03c0002f30 tx=0x7f03c0006dc0).stop 2021-01-03T13:53:46.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.180+0000 7f03dd97f700 1 -- 172.21.15.133:0/2718476525 shutdown_connections 2021-01-03T13:53:46.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.180+0000 7f03dd97f700 1 --2- 172.21.15.133:0/2718476525 >> v2:172.21.15.16:3300/0 conn(0x7f03d80b52c0 0x7f03d80b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.180+0000 7f03dd97f700 1 --2- 172.21.15.133:0/2718476525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03d80b0c90 0x7f03d8098ec0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.180+0000 7f03dd97f700 1 -- 172.21.15.133:0/2718476525 >> 172.21.15.133:0/2718476525 conn(0x7f03d805bdf0 msgr2=0x7f03d805c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.180+0000 7f03dd97f700 1 -- 172.21.15.133:0/2718476525 shutdown_connections 2021-01-03T13:53:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.180+0000 7f03dd97f700 1 -- 172.21.15.133:0/2718476525 wait complete. 2021-01-03T13:53:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dd97f700 1 Processor -- start 2021-01-03T13:53:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dd97f700 1 -- start start 2021-01-03T13:53:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dd97f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03d80b0c90 0x7f03d8067060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dd97f700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f03d80b52c0 0x7f03d8155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:46.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dd97f700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03d80b5c00 0x7f03d81563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:46.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dd97f700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d8065a10 con 0x7f03d80b5c00 2021-01-03T13:53:46.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dd97f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80af3e0 con 0x7f03d80b0c90 2021-01-03T13:53:46.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dd97f700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80ae980 con 0x7f03d80b52c0 2021-01-03T13:53:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dc97d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03d80b0c90 0x7f03d8067060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dc97d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03d80b0c90 0x7f03d8067060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41224/0 (socket says 172.21.15.133:41224) 2021-01-03T13:53:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dc97d700 1 -- 172.21.15.133:0/2616020491 learned_addr learned my addr 172.21.15.133:0/2616020491 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dd17e700 1 --2- 172.21.15.133:0/2616020491 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03d80b5c00 0x7f03d81563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:46.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03d7fff700 1 --2- 172.21.15.133:0/2616020491 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f03d80b52c0 0x7f03d8155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:46.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dc97d700 1 -- 172.21.15.133:0/2616020491 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f03d80b52c0 msgr2=0x7f03d8155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:46.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dc97d700 1 --2- 172.21.15.133:0/2616020491 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f03d80b52c0 0x7f03d8155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dc97d700 1 -- 172.21.15.133:0/2616020491 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03d80b5c00 msgr2=0x7f03d81563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dc97d700 1 --2- 172.21.15.133:0/2616020491 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03d80b5c00 0x7f03d81563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dc97d700 1 -- 172.21.15.133:0/2616020491 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d8065770 con 0x7f03d80b0c90 2021-01-03T13:53:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03d7fff700 1 --2- 172.21.15.133:0/2616020491 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f03d80b52c0 0x7f03d8155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:53:46.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dd17e700 1 --2- 172.21.15.133:0/2616020491 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03d80b5c00 0x7f03d81563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:53:46.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dc97d700 1 --2- 172.21.15.133:0/2616020491 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03d80b0c90 0x7f03d8067060 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f03d80666c0 tx=0x7f03c8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:46.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03d5ffb700 1 -- 172.21.15.133:0/2616020491 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03c8007710 con 0x7f03d80b0c90 2021-01-03T13:53:46.197 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03d5ffb700 1 -- 172.21.15.133:0/2616020491 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c8007870 con 0x7f03d80b0c90 2021-01-03T13:53:46.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dd97f700 1 -- 172.21.15.133:0/2616020491 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d80af5d0 con 0x7f03d80b0c90 2021-01-03T13:53:46.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03d5ffb700 1 -- 172.21.15.133:0/2616020491 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03c8007bd0 con 0x7f03d80b0c90 2021-01-03T13:53:46.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.184+0000 7f03dd97f700 1 -- 172.21.15.133:0/2616020491 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d80651e0 con 0x7f03d80b0c90 2021-01-03T13:53:46.198 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.188+0000 7f03dd97f700 1 -- 172.21.15.133:0/2616020491 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d8057300 con 0x7f03d80b0c90 2021-01-03T13:53:46.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.188+0000 7f03d5ffb700 1 -- 172.21.15.133:0/2616020491 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f03c8007d30 con 0x7f03d80b0c90 2021-01-03T13:53:46.199 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.188+0000 7f03d5ffb700 1 --2- 172.21.15.133:0/2616020491 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f03bc055330 0x7f03bc0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:46.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.188+0000 7f03d5ffb700 1 -- 172.21.15.133:0/2616020491 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f03c806de20 con 0x7f03d80b0c90 2021-01-03T13:53:46.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.188+0000 7f03d7fff700 1 --2- 172.21.15.133:0/2616020491 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f03bc055330 0x7f03bc0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:46.200 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.188+0000 7f03d7fff700 1 --2- 172.21.15.133:0/2616020491 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f03bc055330 0x7f03bc0577f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f03c0019000 tx=0x7f03c0015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:46.201 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.196+0000 7f03d5ffb700 1 -- 172.21.15.133:0/2616020491 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f03c80443a0 con 0x7f03d80b0c90 2021-01-03T13:53:46.334 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.332+0000 7f03dd97f700 1 -- 172.21.15.133:0/2616020491 --> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f03d8063520 con 0x7f03bc055330 2021-01-03T13:53:46.337 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.336+0000 7f03d5ffb700 1 -- 172.21.15.133:0/2616020491 <== mgr.4110 v2:172.21.15.133:6800/11943 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66118 (secure 0 0 0) 0x7f03d8063520 con 0x7f03bc055330 2021-01-03T13:53:46.339 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:53:46.339 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.336+0000 7f03dd97f700 1 -- 172.21.15.133:0/2616020491 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f03bc055330 msgr2=0x7f03bc0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:46.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.336+0000 7f03dd97f700 1 --2- 172.21.15.133:0/2616020491 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f03bc055330 0x7f03bc0577f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f03c0019000 tx=0x7f03c0015000).stop 2021-01-03T13:53:46.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.336+0000 7f03dd97f700 1 -- 172.21.15.133:0/2616020491 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03d80b0c90 msgr2=0x7f03d8067060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:46.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.336+0000 7f03dd97f700 1 --2- 172.21.15.133:0/2616020491 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03d80b0c90 0x7f03d8067060 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f03d80666c0 tx=0x7f03c8008040).stop 2021-01-03T13:53:46.340 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.336+0000 7f03dd97f700 1 -- 172.21.15.133:0/2616020491 shutdown_connections 2021-01-03T13:53:46.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.336+0000 7f03dd97f700 1 --2- 172.21.15.133:0/2616020491 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f03bc055330 0x7f03bc0577f0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.336+0000 7f03dd97f700 1 --2- 172.21.15.133:0/2616020491 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03d80b5c00 0x7f03d81563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.336+0000 7f03dd97f700 1 --2- 172.21.15.133:0/2616020491 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03d80b0c90 0x7f03d8067060 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.341 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.336+0000 7f03dd97f700 1 --2- 172.21.15.133:0/2616020491 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f03d80b52c0 0x7f03d8155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.336+0000 7f03dd97f700 1 -- 172.21.15.133:0/2616020491 >> 172.21.15.133:0/2616020491 conn(0x7f03d805bdf0 msgr2=0x7f03d81472a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:46.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.336+0000 7f03dd97f700 1 -- 172.21.15.133:0/2616020491 shutdown_connections 2021-01-03T13:53:46.342 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.336+0000 7f03dd97f700 1 -- 172.21.15.133:0/2616020491 wait complete. 2021-01-03T13:53:46.343 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2021-01-03T13:53:46.350 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":1835,"stamp":"2021-01-03T13:53:45.999074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8405056,"kb_used_data":16384,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569664,"statfs":{"total":773094113280,"available":764487335936,"internally_reserved":8589934592,"allocated":16777216,"data_stored":7805040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003486"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":"139","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.361062+0000","last_change":"2021-01-03T12:57:57.354556+0000","last_active":"2021-01-03T13:08:14.361062+0000","last_peered":"2021-01-03T13:08:14.361062+0000","last_clean":"2021-01-03T13:08:14.361062+0000","last_became_active":"2021-01-03T12:57:57.354020+0000","last_became_peered":"2021-01-03T12:57:57.354020+0000","last_unstale":"2021-01-03T13:08:14.361062+0000","last_undegraded":"2021-01-03T13:08:14.361062+0000","last_fullsized":"2021-01-03T13:08:14.361062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"138","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.363827+0000","last_change":"2021-01-03T12:57:57.348550+0000","last_active":"2021-01-03T13:08:14.363827+0000","last_peered":"2021-01-03T13:08:14.363827+0000","last_clean":"2021-01-03T13:08:14.363827+0000","last_became_active":"2021-01-03T12:57:57.348011+0000","last_became_peered":"2021-01-03T12:57:57.348011+0000","last_unstale":"2021-01-03T13:08:14.363827+0000","last_undegraded":"2021-01-03T13:08:14.363827+0000","last_fullsized":"2021-01-03T13:08:14.363827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"150","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.360452+0000","last_change":"2021-01-03T12:57:57.494403+0000","last_active":"2021-01-03T13:08:14.360452+0000","last_peered":"2021-01-03T13:08:14.360452+0000","last_clean":"2021-01-03T13:08:14.360452+0000","last_became_active":"2021-01-03T12:57:57.493742+0000","last_became_peered":"2021-01-03T12:57:57.493742+0000","last_unstale":"2021-01-03T13:08:14.360452+0000","last_undegraded":"2021-01-03T13:08:14.360452+0000","last_fullsized":"2021-01-03T13:08:14.360452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"138","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.363915+0000","last_change":"2021-01-03T12:57:57.345066+0000","last_active":"2021-01-03T13:08:14.363915+0000","last_peered":"2021-01-03T13:08:14.363915+0000","last_clean":"2021-01-03T13:08:14.363915+0000","last_became_active":"2021-01-03T12:57:57.344536+0000","last_became_peered":"2021-01-03T12:57:57.344536+0000","last_unstale":"2021-01-03T13:08:14.363915+0000","last_undegraded":"2021-01-03T13:08:14.363915+0000","last_fullsized":"2021-01-03T13:08:14.363915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"152","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.282783+0000","last_change":"2021-01-03T12:57:52.089767+0000","last_active":"2021-01-03T13:08:14.282783+0000","last_peered":"2021-01-03T13:08:14.282783+0000","last_clean":"2021-01-03T13:08:14.282783+0000","last_became_active":"2021-01-03T12:57:52.088788+0000","last_became_peered":"2021-01-03T12:57:52.088788+0000","last_unstale":"2021-01-03T13:08:14.282783+0000","last_undegraded":"2021-01-03T13:08:14.282783+0000","last_fullsized":"2021-01-03T13:08:14.282783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:48.019621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:48.019621+0000","last_clean_scrub_stamp":"2021-01-03T12:57:48.019621+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"147","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.283119+0000","last_change":"2021-01-03T12:57:57.344690+0000","last_active":"2021-01-03T13:08:14.283119+0000","last_peered":"2021-01-03T13:08:14.283119+0000","last_clean":"2021-01-03T13:08:14.283119+0000","last_became_active":"2021-01-03T12:57:57.344012+0000","last_became_peered":"2021-01-03T12:57:57.344012+0000","last_unstale":"2021-01-03T13:08:14.283119+0000","last_undegraded":"2021-01-03T13:08:14.283119+0000","last_fullsized":"2021-01-03T13:08:14.283119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"147","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.284215+0000","last_change":"2021-01-03T12:57:57.356385+0000","last_active":"2021-01-03T13:08:14.284215+0000","last_peered":"2021-01-03T13:08:14.284215+0000","last_clean":"2021-01-03T13:08:14.284215+0000","last_became_active":"2021-01-03T12:57:57.355963+0000","last_became_peered":"2021-01-03T12:57:57.355963+0000","last_unstale":"2021-01-03T13:08:14.284215+0000","last_undegraded":"2021-01-03T13:08:14.284215+0000","last_fullsized":"2021-01-03T13:08:14.284215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"139","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.362262+0000","last_change":"2021-01-03T12:57:57.342113+0000","last_active":"2021-01-03T13:08:14.362262+0000","last_peered":"2021-01-03T13:08:14.362262+0000","last_clean":"2021-01-03T13:08:14.362262+0000","last_became_active":"2021-01-03T12:57:57.341496+0000","last_became_peered":"2021-01-03T12:57:57.341496+0000","last_unstale":"2021-01-03T13:08:14.362262+0000","last_undegraded":"2021-01-03T13:08:14.362262+0000","last_fullsized":"2021-01-03T13:08:14.362262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"137","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.362523+0000","last_change":"2021-01-03T12:57:57.346557+0000","last_active":"2021-01-03T13:08:14.362523+0000","last_peered":"2021-01-03T13:08:14.362523+0000","last_clean":"2021-01-03T13:08:14.362523+0000","last_became_active":"2021-01-03T12:57:57.346072+0000","last_became_peered":"2021-01-03T12:57:57.346072+0000","last_unstale":"2021-01-03T13:08:14.362523+0000","last_undegraded":"2021-01-03T13:08:14.362523+0000","last_fullsized":"2021-01-03T13:08:14.362523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542817,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:52:40 2021","interfaces":[{"interface":"back","average":{"1min":1.6899999999999999,"5min":1.7689999999999999,"15min":1.7350000000000001},"min":{"1min":1.379,"5min":1.198,"15min":1.1220000000000001},"max":{"1min":2.8900000000000001,"5min":3.1720000000000002,"15min":3.1720000000000002},"last":1.264},{"interface":"front","average":{"1min":2.0859999999999999,"5min":1.9810000000000001,"15min":1.835},"min":{"1min":1.397,"5min":1.1619999999999999,"15min":1.1619999999999999},"max":{"1min":3.863,"5min":3.863,"15min":3.863},"last":1.571}]},{"osd":1,"last update":"Sun Jan 3 13:52:40 2021","interfaces":[{"interface":"back","average":{"1min":1.905,"5min":2.052,"15min":1.9610000000000001},"min":{"1min":1.498,"5min":1.4930000000000001,"15min":1.306},"max":{"1min":2.282,"5min":3.1829999999999998,"15min":3.371},"last":2.9740000000000002},{"interface":"front","average":{"1min":2.407,"5min":2.2130000000000001,"15min":2.2480000000000002},"min":{"1min":1.883,"5min":1.456,"15min":1.377},"max":{"1min":3.121,"5min":3.3679999999999999,"15min":4.2910000000000004},"last":2.125}]},{"osd":2,"last update":"Sun Jan 3 13:52:40 2021","interfaces":[{"interface":"back","average":{"1min":2.5329999999999999,"5min":2.2530000000000001,"15min":2.339},"min":{"1min":1.5940000000000001,"5min":1.4419999999999999,"15min":1.292},"max":{"1min":3.8650000000000002,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":2.7959999999999998},{"interface":"front","average":{"1min":2.46,"5min":2.2349999999999999,"15min":2.2829999999999999},"min":{"1min":1.526,"5min":1.3069999999999999,"15min":1.2110000000000001},"max":{"1min":3.1859999999999999,"5min":3.601,"15min":3.601},"last":2.7250000000000001}]},{"osd":3,"last update":"Sun Jan 3 13:52:40 2021","interfaces":[{"interface":"back","average":{"1min":2.4649999999999999,"5min":2.4900000000000002,"15min":2.472},"min":{"1min":1.367,"5min":1.367,"15min":1.367},"max":{"1min":3.121,"5min":3.2080000000000002,"15min":3.9950000000000001},"last":3.218},{"interface":"front","average":{"1min":2.6240000000000001,"5min":2.5899999999999999,"15min":2.5619999999999998},"min":{"1min":1.788,"5min":1.784,"15min":1.645},"max":{"1min":3.4049999999999998,"5min":3.4249999999999998,"15min":3.875},"last":2.5019999999999998}]},{"osd":4,"last update":"Sun Jan 3 13:52:40 2021","interfaces":[{"interface":"back","average":{"1min":2.903,"5min":2.7839999999999998,"15min":2.802},"min":{"1min":2.1619999999999999,"5min":1.371,"15min":1.371},"max":{"1min":3.6469999999999998,"5min":3.6739999999999999,"15min":4.1349999999999998},"last":3.1110000000000002},{"interface":"front","average":{"1min":3.0640000000000001,"5min":2.7879999999999998,"15min":2.798},"min":{"1min":2.3919999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"max":{"1min":4.6740000000000004,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":2.1989999999999998}]},{"osd":5,"last update":"Sun Jan 3 13:52:40 2021","interfaces":[{"interface":"back","average":{"1min":2.9239999999999999,"5min":2.778,"15min":2.819},"min":{"1min":1.9330000000000001,"5min":1.476,"15min":1.476},"max":{"1min":3.5089999999999999,"5min":3.6099999999999999,"15min":4.4109999999999996},"last":3.4300000000000002},{"interface":"front","average":{"1min":3.2320000000000002,"5min":3.0419999999999998,"15min":3.109},"min":{"1min":2.4420000000000002,"5min":1.474,"15min":1.3959999999999999},"max":{"1min":4.3330000000000002,"5min":4.3330000000000002,"15min":4.6779999999999999},"last":2.8879999999999999}]},{"osd":6,"last update":"Sun Jan 3 13:52:40 2021","interfaces":[{"interface":"back","average":{"1min":3.3620000000000001,"5min":3.125,"15min":3.1150000000000002},"min":{"1min":2.7200000000000002,"5min":1.2030000000000001,"15min":1.2030000000000001},"max":{"1min":4.3120000000000003,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":2.5830000000000002},{"interface":"front","average":{"1min":3.6509999999999998,"5min":3.3519999999999999,"15min":3.3450000000000002},"min":{"1min":2.9209999999999998,"5min":1.3799999999999999,"15min":1.3799999999999999},"max":{"1min":5.5919999999999996,"5min":5.5919999999999996,"15min":5.5919999999999996},"last":3.0600000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542817,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.0009999999999999,"5min":1.8859999999999999,"15min":1.804},"min":{"1min":1.264,"5min":1.264,"15min":1.171},"max":{"1min":2.8919999999999999,"5min":4.1349999999999998,"15min":4.1349999999999998},"last":2.0640000000000001},{"interface":"front","average":{"1min":1.718,"5min":1.891,"15min":1.7989999999999999},"min":{"1min":1.47,"5min":1.319,"15min":1.2569999999999999},"max":{"1min":2.6200000000000001,"5min":3.0920000000000001,"15min":3.347},"last":1.728}]},{"osd":1,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.1890000000000001,"5min":2.306,"15min":2.2829999999999999},"min":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.2829999999999999},"max":{"1min":3.843,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":1.6279999999999999},{"interface":"front","average":{"1min":2.6970000000000001,"5min":2.7639999999999998,"15min":2.694},"min":{"1min":2.02,"5min":1.4770000000000001,"15min":1.464},"max":{"1min":3.3929999999999998,"5min":4.375,"15min":4.375},"last":2.3809999999999998}]},{"osd":2,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.177,"5min":2.0419999999999998,"15min":2.0150000000000001},"min":{"1min":1.6539999999999999,"5min":1.4330000000000001,"15min":1.2470000000000001},"max":{"1min":3.0870000000000002,"5min":3.8260000000000001,"15min":3.8260000000000001},"last":2.1909999999999998},{"interface":"front","average":{"1min":2.5230000000000001,"5min":2.556,"15min":2.4969999999999999},"min":{"1min":1.6499999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"max":{"1min":3.319,"5min":4.9359999999999999,"15min":4.9359999999999999},"last":3.0449999999999999}]},{"osd":3,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.3900000000000001,"5min":2.359,"15min":2.339},"min":{"1min":1.9710000000000001,"5min":1.6619999999999999,"15min":1.4019999999999999},"max":{"1min":3.1389999999999998,"5min":3.726,"15min":5.1210000000000004},"last":3.1219999999999999},{"interface":"front","average":{"1min":2.4220000000000002,"5min":2.4359999999999999,"15min":2.3959999999999999},"min":{"1min":1.593,"5min":1.593,"15min":1.4219999999999999},"max":{"1min":3.2480000000000002,"5min":4.1559999999999997,"15min":4.4980000000000002},"last":2.5920000000000001}]},{"osd":4,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.8530000000000002,"5min":2.9009999999999998,"15min":2.8340000000000001},"min":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.49},"max":{"1min":3.7370000000000001,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":2.6589999999999998},{"interface":"front","average":{"1min":2.9750000000000001,"5min":2.9159999999999999,"15min":2.8439999999999999},"min":{"1min":1.875,"5min":1.875,"15min":1.6890000000000001},"max":{"1min":4.0529999999999999,"5min":4.3479999999999999,"15min":5.0069999999999997},"last":2.7349999999999999}]},{"osd":5,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.9630000000000001,"5min":2.75,"15min":2.7210000000000001},"min":{"1min":2.0139999999999998,"5min":1.353,"15min":0.93700000000000006},"max":{"1min":3.4489999999999998,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":3.2029999999999998},{"interface":"front","average":{"1min":3.302,"5min":3.2490000000000001,"15min":3.1800000000000002},"min":{"1min":2.4449999999999998,"5min":2.2450000000000001,"15min":1.4510000000000001},"max":{"1min":4.0780000000000003,"5min":5.3410000000000002,"15min":5.3410000000000002},"last":3.4260000000000002}]},{"osd":7,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":3.3090000000000002,"5min":3.3109999999999999,"15min":3.2469999999999999},"min":{"1min":2.456,"5min":1.889,"15min":1.889},"max":{"1min":4.2770000000000001,"5min":4.798,"15min":4.798},"last":3.5209999999999999},{"interface":"front","average":{"1min":3.4319999999999999,"5min":3.27,"15min":3.2290000000000001},"min":{"1min":2.601,"5min":2.077,"15min":1.0760000000000001},"max":{"1min":4.2050000000000001,"5min":4.5670000000000002,"15min":4.5670000000000002},"last":3.5910000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542817,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.7110000000000001,"15min":1.706},"min":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3129999999999999},"max":{"1min":2.0259999999999998,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.7529999999999999,"5min":1.8029999999999999,"15min":1.8149999999999999},"min":{"1min":1.4950000000000001,"5min":1.337,"15min":1.337},"max":{"1min":2.3639999999999999,"5min":2.9910000000000001,"15min":4.5979999999999999},"last":1.6339999999999999}]},{"osd":2,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":1.9810000000000001,"5min":1.8799999999999999,"15min":1.8839999999999999},"min":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"max":{"1min":3.194,"5min":3.194,"15min":3.528},"last":1.5740000000000001},{"interface":"front","average":{"1min":2.6019999999999999,"5min":2.556,"15min":2.569},"min":{"1min":1.9850000000000001,"5min":1.665,"15min":1.5649999999999999},"max":{"1min":3.0960000000000001,"5min":3.9809999999999999,"15min":3.9809999999999999},"last":2.488}]},{"osd":3,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":2.2669999999999999,"5min":2.21,"15min":2.1930000000000001},"min":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.4810000000000001},"max":{"1min":3.5619999999999998,"5min":4.3579999999999997,"15min":4.3579999999999997},"last":2.714},{"interface":"front","average":{"1min":2.3980000000000001,"5min":2.3399999999999999,"15min":2.3479999999999999},"min":{"1min":1.9279999999999999,"5min":1.5069999999999999,"15min":1.357},"max":{"1min":2.9100000000000001,"5min":2.996,"15min":3.262},"last":2.3650000000000002}]},{"osd":4,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":2.1469999999999998,"5min":2.3100000000000001,"15min":2.3239999999999998},"min":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.544},"max":{"1min":2.8900000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":2.1589999999999998},{"interface":"front","average":{"1min":2.7749999999999999,"5min":2.8109999999999999,"15min":2.798},"min":{"1min":2.2149999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"max":{"1min":3.75,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":3.1509999999999998}]},{"osd":5,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":2.8530000000000002,"5min":2.8879999999999999,"15min":2.8679999999999999},"min":{"1min":2.1360000000000001,"5min":2.0289999999999999,"15min":1.9750000000000001},"max":{"1min":3.7010000000000001,"5min":3.9969999999999999,"15min":4.306},"last":3.8319999999999999},{"interface":"front","average":{"1min":2.8010000000000002,"5min":2.8839999999999999,"15min":2.919},"min":{"1min":2.109,"5min":1.855,"15min":1.847},"max":{"1min":3.6970000000000001,"5min":4.6509999999999998,"15min":4.6509999999999998},"last":3.766}]},{"osd":6,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":3.1850000000000001,"5min":3.177,"15min":3.2090000000000001},"min":{"1min":2.3050000000000002,"5min":2.27,"15min":1.903},"max":{"1min":4.2000000000000002,"5min":4.7990000000000004,"15min":4.9720000000000004},"last":3.4430000000000001},{"interface":"front","average":{"1min":2.984,"5min":3.1469999999999998,"15min":3.1579999999999999},"min":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"max":{"1min":3.9300000000000002,"5min":5.5960000000000001,"15min":5.5960000000000001},"last":3.3769999999999998}]},{"osd":7,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":3.2429999999999999,"5min":3.2229999999999999,"15min":3.2010000000000001},"min":{"1min":2.6379999999999999,"5min":2.54,"15min":2.4660000000000002},"max":{"1min":4.1210000000000004,"5min":5.1449999999999996,"15min":5.1840000000000002},"last":2.9670000000000001},{"interface":"front","average":{"1min":3.2349999999999999,"5min":3.302,"15min":3.2810000000000001},"min":{"1min":2.8999999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"max":{"1min":3.8119999999999998,"5min":4.2729999999999997,"15min":5.3730000000000002},"last":3.0329999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542817,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":1.7609999999999999,"15min":1.704},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.1950000000000001},"max":{"1min":2.5920000000000001,"5min":2.9870000000000001,"15min":3.0179999999999998},"last":1.96},{"interface":"front","average":{"1min":1.8540000000000001,"5min":1.869,"15min":1.8180000000000001},"min":{"1min":1.403,"5min":1.377,"15min":1.244},"max":{"1min":2.9100000000000001,"5min":3.1459999999999999,"15min":3.2690000000000001},"last":1.5580000000000001}]},{"osd":2,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":2.101,"5min":2.0960000000000001,"15min":2.101},"min":{"1min":1.4330000000000001,"5min":1.4099999999999999,"15min":1.2589999999999999},"max":{"1min":2.645,"5min":2.9009999999999998,"15min":3.4009999999999998},"last":1.661},{"interface":"front","average":{"1min":2.415,"5min":2.3780000000000001,"15min":2.3730000000000002},"min":{"1min":2.0489999999999999,"5min":1.8009999999999999,"15min":1.4399999999999999},"max":{"1min":3.1339999999999999,"5min":3.242,"15min":3.4870000000000001},"last":2.081}]},{"osd":3,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":2.052,"5min":1.839,"15min":1.8100000000000001},"min":{"1min":1.5409999999999999,"5min":1.403,"15min":1.2749999999999999},"max":{"1min":3.0379999999999998,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.758},{"interface":"front","average":{"1min":2.355,"5min":2.4180000000000001,"15min":2.407},"min":{"1min":1.9490000000000001,"5min":1.8240000000000001,"15min":1.5900000000000001},"max":{"1min":2.9260000000000002,"5min":3.411,"15min":3.411},"last":2.3500000000000001}]},{"osd":4,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":2.2320000000000002,"5min":2.403,"15min":2.415},"min":{"1min":1.5600000000000001,"5min":1.5349999999999999,"15min":1.486},"max":{"1min":3.3540000000000001,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":2.4710000000000001},{"interface":"front","average":{"1min":2.4249999999999998,"5min":2.4529999999999998,"15min":2.4900000000000002},"min":{"1min":2.0419999999999998,"5min":1.746,"15min":1.647},"max":{"1min":3.3410000000000002,"5min":3.6629999999999998,"15min":4.1900000000000004},"last":2.859}]},{"osd":5,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":2.3300000000000001,"5min":2.4929999999999999,"15min":2.5099999999999998},"min":{"1min":1.627,"5min":1.627,"15min":1.627},"max":{"1min":3.1080000000000001,"5min":3.851,"15min":4.4779999999999998},"last":2.1400000000000001},{"interface":"front","average":{"1min":3.0230000000000001,"5min":2.944,"15min":2.9670000000000001},"min":{"1min":2.4870000000000001,"5min":1.9570000000000001,"15min":1.9490000000000001},"max":{"1min":3.5049999999999999,"5min":3.9929999999999999,"15min":4.2119999999999997},"last":3.1099999999999999}]},{"osd":6,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":3.113,"5min":3.1299999999999999,"15min":3.2000000000000002},"min":{"1min":2.6019999999999999,"5min":2.214,"15min":2.214},"max":{"1min":3.548,"5min":3.9300000000000002,"15min":4.1459999999999999},"last":3.331},{"interface":"front","average":{"1min":2.8530000000000002,"5min":3.0139999999999998,"15min":2.9790000000000001},"min":{"1min":2.343,"5min":2.343,"15min":2.1749999999999998},"max":{"1min":3.4089999999999998,"5min":4.0659999999999998,"15min":4.274},"last":2.7480000000000002}]},{"osd":7,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":3.1000000000000001,"5min":3.2480000000000002,"15min":3.2189999999999999},"min":{"1min":2.52,"5min":2.5129999999999999,"15min":1.921},"max":{"1min":3.7120000000000002,"5min":4.1609999999999996,"15min":4.806},"last":3.464},{"interface":"front","average":{"1min":2.9870000000000001,"5min":3.0630000000000002,"15min":3.069},"min":{"1min":2.5030000000000001,"5min":2.363,"15min":1.8140000000000001},"max":{"1min":3.3799999999999999,"5min":3.988,"15min":4.3810000000000002},"last":3.5539999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542817,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.6419999999999999,"15min":1.657},"min":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"max":{"1min":2.0910000000000002,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":2.0950000000000002},{"interface":"front","average":{"1min":1.6379999999999999,"5min":1.7549999999999999,"15min":1.7749999999999999},"min":{"1min":1.3660000000000001,"5min":1.278,"15min":1.278},"max":{"1min":2.2989999999999999,"5min":2.8679999999999999,"15min":3.2429999999999999},"last":1.6499999999999999}]},{"osd":1,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":2.0030000000000001,"5min":2.101,"15min":2.0859999999999999},"min":{"1min":1.373,"5min":1.3720000000000001,"15min":1.3400000000000001},"max":{"1min":3.117,"5min":3.117,"15min":3.117},"last":1.573},{"interface":"front","average":{"1min":2.0760000000000001,"5min":2.085,"15min":2.0870000000000002},"min":{"1min":1.774,"5min":1.46,"15min":1.4279999999999999},"max":{"1min":2.5099999999999998,"5min":2.8380000000000001,"15min":3.2149999999999999},"last":2.0299999999999998}]},{"osd":3,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":1.984,"5min":2.0430000000000001,"15min":1.994},"min":{"1min":1.4610000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"max":{"1min":3.0840000000000001,"5min":3.198,"15min":3.5699999999999998},"last":1.7749999999999999},{"interface":"front","average":{"1min":2.4670000000000001,"5min":2.5790000000000002,"15min":2.5619999999999998},"min":{"1min":2.036,"5min":1.9399999999999999,"15min":1.5900000000000001},"max":{"1min":3.4089999999999998,"5min":3.508,"15min":3.6549999999999998},"last":2.6280000000000001}]},{"osd":4,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":2.609,"5min":2.476,"15min":2.532},"min":{"1min":1.95,"5min":1.502,"15min":1.502},"max":{"1min":3.5609999999999999,"5min":3.6890000000000001,"15min":3.6890000000000001},"last":2.2890000000000001},{"interface":"front","average":{"1min":2.1640000000000001,"5min":2.2829999999999999,"15min":2.3239999999999998},"min":{"1min":1.46,"5min":1.46,"15min":1.46},"max":{"1min":2.9780000000000002,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":2.3479999999999999}]},{"osd":5,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":2.589,"5min":2.875,"15min":2.8210000000000002},"min":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.7669999999999999},"max":{"1min":3.7200000000000002,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":2.4199999999999999},{"interface":"front","average":{"1min":2.968,"5min":2.9929999999999999,"15min":3.0430000000000001},"min":{"1min":2.3090000000000002,"5min":1.925,"15min":1.925},"max":{"1min":3.8279999999999998,"5min":4.0789999999999997,"15min":4.0970000000000004},"last":2.726}]},{"osd":6,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":2.7450000000000001,"5min":2.746,"15min":2.7679999999999998},"min":{"1min":2.2330000000000001,"5min":1.9830000000000001,"15min":1.8500000000000001},"max":{"1min":3.633,"5min":4.4660000000000002,"15min":4.4660000000000002},"last":2.7749999999999999},{"interface":"front","average":{"1min":2.9569999999999999,"5min":3.1160000000000001,"15min":3.1280000000000001},"min":{"1min":2.395,"5min":2.395,"15min":2.3220000000000001},"max":{"1min":3.5859999999999999,"5min":4.1609999999999996,"15min":4.2519999999999998},"last":2.9929999999999999}]},{"osd":7,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":3.2149999999999999,"5min":3.1899999999999999,"15min":3.2429999999999999},"min":{"1min":2.5590000000000002,"5min":2.4129999999999998,"15min":2.302},"max":{"1min":3.9750000000000001,"5min":3.9750000000000001,"15min":4.3109999999999999},"last":2.532},{"interface":"front","average":{"1min":2.9630000000000001,"5min":3.1230000000000002,"15min":3.105},"min":{"1min":2.4569999999999999,"5min":2.1989999999999998,"15min":1.881},"max":{"1min":3.464,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":3.1389999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542817,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.661,"15min":1.6519999999999999},"min":{"1min":1.2669999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"max":{"1min":2.1040000000000001,"5min":2.528,"15min":3.024},"last":1.484},{"interface":"front","average":{"1min":1.657,"5min":1.653,"15min":1.6699999999999999},"min":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"max":{"1min":2.4750000000000001,"5min":2.52,"15min":2.8079999999999998},"last":1.351}]},{"osd":1,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":1.883,"5min":1.9039999999999999,"15min":1.8540000000000001},"min":{"1min":1.355,"5min":1.355,"15min":1.2849999999999999},"max":{"1min":2.8399999999999999,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":1.5740000000000001},{"interface":"front","average":{"1min":2.0390000000000001,"5min":2.0649999999999999,"15min":2.097},"min":{"1min":1.458,"5min":1.331,"15min":1.331},"max":{"1min":2.4780000000000002,"5min":2.698,"15min":3.1099999999999999},"last":1.867}]},{"osd":2,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":2.3239999999999998,"5min":2.202,"15min":2.242},"min":{"1min":1.573,"5min":1.5229999999999999,"15min":1.3879999999999999},"max":{"1min":3.4300000000000002,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":2.0489999999999999},{"interface":"front","average":{"1min":2.5880000000000001,"5min":2.5329999999999999,"15min":2.5379999999999998},"min":{"1min":2.0680000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"max":{"1min":3.0939999999999999,"5min":3.2879999999999998,"15min":3.532},"last":2.105}]},{"osd":4,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":2.3599999999999999,"5min":2.3140000000000001,"15min":2.319},"min":{"1min":1.857,"5min":1.6559999999999999,"15min":1.524},"max":{"1min":3.3380000000000001,"5min":3.754,"15min":4.327},"last":1.9930000000000001},{"interface":"front","average":{"1min":2.4609999999999999,"5min":2.6139999999999999,"15min":2.5859999999999999},"min":{"1min":1.792,"5min":1.619,"15min":1.619},"max":{"1min":3.2709999999999999,"5min":3.6379999999999999,"15min":4.1070000000000002},"last":2.2349999999999999}]},{"osd":5,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":2.714,"5min":2.843,"15min":2.8410000000000002},"min":{"1min":2.2320000000000002,"5min":1.899,"15min":1.6850000000000001},"max":{"1min":3.403,"5min":3.7370000000000001,"15min":4.4850000000000003},"last":2.4319999999999999},{"interface":"front","average":{"1min":2.8029999999999999,"5min":2.851,"15min":2.831},"min":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.9609999999999999},"last":2.3719999999999999}]},{"osd":6,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":2.8999999999999999,"5min":2.8620000000000001,"15min":2.875},"min":{"1min":1.76,"5min":1.76,"15min":1.76},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":5.0110000000000001},"last":2.927},{"interface":"front","average":{"1min":3.105,"5min":3.2669999999999999,"15min":3.2749999999999999},"min":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"max":{"1min":3.7639999999999998,"5min":4.093,"15min":5.1760000000000002},"last":3.2429999999999999}]},{"osd":7,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":3.0910000000000002,"5min":3.1120000000000001,"15min":3.125},"min":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"max":{"1min":3.5419999999999998,"5min":3.8159999999999998,"15min":4.4379999999999997},"last":2.702},{"interface":"front","average":{"1min":3.085,"5min":3.0419999999999998,"15min":3.0419999999999998},"min":{"1min":2.5539999999999998,"5min":2.3519999999999999,"15min":2.3519999999999999},"max":{"1min":3.5339999999999998,"5min":3.9380000000000002,"15min":4.1210000000000004},"last":3.327}]}]},{"osd":4,"up_from":14,"seq":60129542816,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:52:44 2021","interfaces":[{"interface":"back","average":{"1min":1.8919999999999999,"5min":1.919,"15min":2.016},"min":{"1min":1.2689999999999999,"5min":1.044,"15min":1.044},"max":{"1min":2.9649999999999999,"5min":3.1150000000000002,"15min":4.0910000000000002},"last":1.8120000000000001},{"interface":"front","average":{"1min":2.4529999999999998,"5min":2.488,"15min":2.5569999999999999},"min":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.6919999999999999},"max":{"1min":2.9950000000000001,"5min":3.444,"15min":3.7890000000000001},"last":3.0310000000000001}]},{"osd":1,"last update":"Sun Jan 3 13:52:44 2021","interfaces":[{"interface":"back","average":{"1min":1.9259999999999999,"5min":1.984,"15min":1.9259999999999999},"min":{"1min":1.556,"5min":1.369,"15min":1.264},"max":{"1min":2.931,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":2.7080000000000002},{"interface":"front","average":{"1min":2.0760000000000001,"5min":2.0390000000000001,"15min":2.0499999999999998},"min":{"1min":1.6659999999999999,"5min":1.355,"15min":1.1679999999999999},"max":{"1min":2.8690000000000002,"5min":3.2890000000000001,"15min":3.5009999999999999},"last":1.6719999999999999}]},{"osd":2,"last update":"Sun Jan 3 13:52:44 2021","interfaces":[{"interface":"back","average":{"1min":2.254,"5min":2.1859999999999999,"15min":2.1989999999999998},"min":{"1min":1.5609999999999999,"5min":1.5009999999999999,"15min":1.248},"max":{"1min":2.9550000000000001,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":2.1930000000000001},{"interface":"front","average":{"1min":2.419,"5min":2.476,"15min":2.4239999999999999},"min":{"1min":1.6459999999999999,"5min":1.3420000000000001,"15min":1.327},"max":{"1min":3.46,"5min":3.6840000000000002,"15min":3.6840000000000002},"last":1.9359999999999999}]},{"osd":3,"last update":"Sun Jan 3 13:52:44 2021","interfaces":[{"interface":"back","average":{"1min":2.4420000000000002,"5min":2.3940000000000001,"15min":2.3479999999999999},"min":{"1min":1.722,"5min":1.601,"15min":1.54},"max":{"1min":3.089,"5min":3.976,"15min":4.3579999999999997},"last":2.0539999999999998},{"interface":"front","average":{"1min":2.9060000000000001,"5min":2.8399999999999999,"15min":2.8610000000000002},"min":{"1min":2.5350000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"max":{"1min":3.3490000000000002,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":2.6219999999999999}]},{"osd":5,"last update":"Sun Jan 3 13:52:44 2021","interfaces":[{"interface":"back","average":{"1min":2.851,"5min":2.7559999999999998,"15min":2.694},"min":{"1min":2.3109999999999999,"5min":1.843,"15min":1.552},"max":{"1min":3.5350000000000001,"5min":3.6869999999999998,"15min":3.8740000000000001},"last":2.2970000000000002},{"interface":"front","average":{"1min":2.698,"5min":2.7090000000000001,"15min":2.6699999999999999},"min":{"1min":2.173,"5min":1.522,"15min":1.522},"max":{"1min":3.4980000000000002,"5min":4.556,"15min":4.556},"last":2.444}]},{"osd":6,"last update":"Sun Jan 3 13:52:44 2021","interfaces":[{"interface":"back","average":{"1min":3.1240000000000001,"5min":3.0219999999999998,"15min":2.9590000000000001},"min":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.825},"max":{"1min":3.8210000000000002,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":2.399},{"interface":"front","average":{"1min":3.2799999999999998,"5min":3.3069999999999999,"15min":3.2559999999999998},"min":{"1min":2.8050000000000002,"5min":2.649,"15min":1.98},"max":{"1min":4.0149999999999997,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":3.2330000000000001}]},{"osd":7,"last update":"Sun Jan 3 13:52:44 2021","interfaces":[{"interface":"back","average":{"1min":3.1400000000000001,"5min":3.0329999999999999,"15min":3.0129999999999999},"min":{"1min":2.4700000000000002,"5min":1.879,"15min":1.111},"max":{"1min":3.726,"5min":4.2850000000000001,"15min":4.2850000000000001},"last":2.8399999999999999},{"interface":"front","average":{"1min":3.3330000000000002,"5min":3.278,"15min":3.29},"min":{"1min":2.7480000000000002,"5min":2.0920000000000001,"15min":1.5429999999999999},"max":{"1min":4.1609999999999996,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":2.8980000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542817,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:52:43 2021","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":1.698,"15min":1.6879999999999999},"min":{"1min":1.294,"5min":1.107,"15min":1.107},"max":{"1min":2.4329999999999998,"5min":2.9870000000000001,"15min":3.1480000000000001},"last":2.4649999999999999},{"interface":"front","average":{"1min":1.744,"5min":1.819,"15min":1.8839999999999999},"min":{"1min":1.367,"5min":1.1679999999999999,"15min":1.1679999999999999},"max":{"1min":2.6139999999999999,"5min":2.9580000000000002,"15min":3.2669999999999999},"last":1.2350000000000001}]},{"osd":1,"last update":"Sun Jan 3 13:52:43 2021","interfaces":[{"interface":"back","average":{"1min":1.8460000000000001,"5min":1.847,"15min":1.8420000000000001},"min":{"1min":1.5349999999999999,"5min":1.3899999999999999,"15min":1.206},"max":{"1min":2.992,"5min":2.992,"15min":2.992},"last":1.8280000000000001},{"interface":"front","average":{"1min":2.202,"5min":2.2149999999999999,"15min":2.194},"min":{"1min":1.556,"5min":1.278,"15min":1.278},"max":{"1min":3.5230000000000001,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":2.202}]},{"osd":2,"last update":"Sun Jan 3 13:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.306,"5min":2.3740000000000001,"15min":2.3239999999999998},"min":{"1min":1.518,"5min":1.518,"15min":1.4870000000000001},"max":{"1min":3.0569999999999999,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":1.7470000000000001},{"interface":"front","average":{"1min":2.6659999999999999,"5min":2.6120000000000001,"15min":2.6779999999999999},"min":{"1min":2.1789999999999998,"5min":1.6970000000000001,"15min":1.6970000000000001},"max":{"1min":3.194,"5min":3.476,"15min":3.984},"last":2.5640000000000001}]},{"osd":3,"last update":"Sun Jan 3 13:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.673,"5min":2.746,"15min":2.6659999999999999},"min":{"1min":1.9450000000000001,"5min":1.7230000000000001,"15min":1.5780000000000001},"max":{"1min":3.3730000000000002,"5min":3.8010000000000002,"15min":3.8010000000000002},"last":2.3159999999999998},{"interface":"front","average":{"1min":2.851,"5min":2.8380000000000001,"15min":2.8660000000000001},"min":{"1min":2.2839999999999998,"5min":1.472,"15min":1.472},"max":{"1min":3.532,"5min":4.0229999999999997,"15min":4.2759999999999998},"last":2.7709999999999999}]},{"osd":4,"last update":"Sun Jan 3 13:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.698,"5min":2.6989999999999998,"15min":2.6840000000000002},"min":{"1min":2.04,"5min":1.415,"15min":1.3300000000000001},"max":{"1min":3.4399999999999999,"5min":4.0060000000000002,"15min":4.0060000000000002},"last":2.6699999999999999},{"interface":"front","average":{"1min":2.8599999999999999,"5min":3.0680000000000001,"15min":3.0350000000000001},"min":{"1min":2.1059999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":3.516,"5min":4.1310000000000002,"15min":4.1609999999999996},"last":2.0030000000000001}]},{"osd":6,"last update":"Sun Jan 3 13:52:43 2021","interfaces":[{"interface":"back","average":{"1min":2.823,"5min":2.8620000000000001,"15min":2.835},"min":{"1min":1.927,"5min":1.3009999999999999,"15min":1.3009999999999999},"max":{"1min":3.911,"5min":4.3280000000000003,"15min":4.7880000000000003},"last":2.3559999999999999},{"interface":"front","average":{"1min":2.996,"5min":3.0169999999999999,"15min":2.968},"min":{"1min":2.3210000000000002,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.8610000000000002,"5min":3.891,"15min":3.9710000000000001},"last":2.8690000000000002}]},{"osd":7,"last update":"Sun Jan 3 13:52:43 2021","interfaces":[{"interface":"back","average":{"1min":3.0910000000000002,"5min":3.3119999999999998,"15min":3.3199999999999998},"min":{"1min":1.841,"5min":1.841,"15min":1.841},"max":{"1min":3.952,"5min":4.3620000000000001,"15min":4.6619999999999999},"last":2.1520000000000001},{"interface":"front","average":{"1min":3.2599999999999998,"5min":3.2970000000000002,"15min":3.343},"min":{"1min":2.5840000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"max":{"1min":4.2869999999999999,"5min":4.4489999999999998,"15min":5.0129999999999999},"last":2.9670000000000001}]}]}]}} 2021-01-03T13:53:46.353 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2021-01-03T13:53:46.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.460+0000 7fb700c87700 1 Processor -- start 2021-01-03T13:53:46.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.460+0000 7fb700c87700 1 -- start start 2021-01-03T13:53:46.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.460+0000 7fb700c87700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb6fc0b5c10 0x7fb6fc0aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:46.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.460+0000 7fb700c87700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6fc0b0670 0x7fb6fc14a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:46.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb700c87700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6fc098550 con 0x7fb6fc14acc0 2021-01-03T13:53:46.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb700c87700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6fc0b5ff0 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb700c87700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0b0b10 con 0x7fb6fc0b0670 2021-01-03T13:53:46.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb6fa59c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb6fc0b5c10 0x7fb6fc0aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:46.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb6fad9d700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb6fc14acc0 0x7fb6fc144470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:40992/0 (socket says 172.21.15.133:40992) 2021-01-03T13:53:46.467 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb6fad9d700 1 -- 172.21.15.133:0/1938889430 learned_addr learned my addr 172.21.15.133:0/1938889430 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:53:46.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb6f9d9b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6fc0b0670 0x7fb6fc14a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:46.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb6fa59c700 1 -- 172.21.15.133:0/1938889430 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6fc0b0670 msgr2=0x7fb6fc14a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:46.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb6fa59c700 1 --2- 172.21.15.133:0/1938889430 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6fc0b0670 0x7fb6fc14a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb6fa59c700 1 -- 172.21.15.133:0/1938889430 >> v1:172.21.15.16:6789/0 conn(0x7fb6fc14acc0 legacy=0x7fb6fc144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:46.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb6f959a700 1 -- 172.21.15.133:0/1938889430 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246731551 0 0) 0x7fb6fc098550 con 0x7fb6fc14acc0 2021-01-03T13:53:46.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb6fa59c700 1 -- 172.21.15.133:0/1938889430 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc098780 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb6f9d9b700 1 --2- 172.21.15.133:0/1938889430 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6fc0b0670 0x7fb6fc14a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:53:46.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb6fa59c700 1 --2- 172.21.15.133:0/1938889430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6fc0b5c10 0x7fb6fc0aae70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fb6ec002f30 tx=0x7fb6ec006dc0).ready entity=mon.0 client_cookie=6ef7609d29f3fe73 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:46.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb6f959a700 1 -- 172.21.15.133:0/1938889430 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6ec009760 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb6f959a700 1 -- 172.21.15.133:0/1938889430 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec0098c0 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb700c87700 1 -- 172.21.15.133:0/1938889430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6fc0b5c10 msgr2=0x7fb6fc0aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:46.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb6f959a700 1 -- 172.21.15.133:0/1938889430 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6ec009c20 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb700c87700 1 --2- 172.21.15.133:0/1938889430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6fc0b5c10 0x7fb6fc0aae70 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fb6ec002f30 tx=0x7fb6ec006dc0).stop 2021-01-03T13:53:46.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb700c87700 1 -- 172.21.15.133:0/1938889430 shutdown_connections 2021-01-03T13:53:46.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb700c87700 1 --2- 172.21.15.133:0/1938889430 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6fc0b5c10 0x7fb6fc0aae70 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb700c87700 1 --2- 172.21.15.133:0/1938889430 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6fc0b0670 0x7fb6fc14a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb700c87700 1 -- 172.21.15.133:0/1938889430 >> 172.21.15.133:0/1938889430 conn(0x7fb6fc05c8c0 msgr2=0x7fb6fc0b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:46.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb700c87700 1 -- 172.21.15.133:0/1938889430 shutdown_connections 2021-01-03T13:53:46.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.464+0000 7fb700c87700 1 -- 172.21.15.133:0/1938889430 wait complete. 2021-01-03T13:53:46.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.468+0000 7fb700c87700 1 Processor -- start 2021-01-03T13:53:46.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.468+0000 7fb700c87700 1 -- start start 2021-01-03T13:53:46.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.468+0000 7fb700c87700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6fc0b0670 0x7fb6fc063550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:46.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.468+0000 7fb700c87700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6fc0b5c10 0x7fb6fc159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:46.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.468+0000 7fb700c87700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6fc14acc0 0x7fb6fc1432a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:46.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.468+0000 7fb700c87700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc0643e0 con 0x7fb6fc0b0670 2021-01-03T13:53:46.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.468+0000 7fb700c87700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc158e20 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.468+0000 7fb700c87700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6fc158b40 con 0x7fb6fc14acc0 2021-01-03T13:53:46.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.468+0000 7fb6f9d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6fc0b5c10 0x7fb6fc159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:46.478 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.472+0000 7fb6f9d9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6fc0b5c10 0x7fb6fc159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41236/0 (socket says 172.21.15.133:41236) 2021-01-03T13:53:46.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.472+0000 7fb6f9d9b700 1 -- 172.21.15.133:0/4127597561 learned_addr learned my addr 172.21.15.133:0/4127597561 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:46.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.472+0000 7fb6fad9d700 1 --2- 172.21.15.133:0/4127597561 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6fc14acc0 0x7fb6fc1432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:46.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.472+0000 7fb6fa59c700 1 --2- 172.21.15.133:0/4127597561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6fc0b0670 0x7fb6fc063550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:46.479 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.472+0000 7fb6f9d9b700 1 -- 172.21.15.133:0/4127597561 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6fc14acc0 msgr2=0x7fb6fc1432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:46.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.472+0000 7fb6f9d9b700 1 --2- 172.21.15.133:0/4127597561 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6fc14acc0 0x7fb6fc1432a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.472+0000 7fb6f9d9b700 1 -- 172.21.15.133:0/4127597561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6fc0b0670 msgr2=0x7fb6fc063550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:46.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.472+0000 7fb6f9d9b700 1 --2- 172.21.15.133:0/4127597561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6fc0b0670 0x7fb6fc063550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.480 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.472+0000 7fb6f9d9b700 1 -- 172.21.15.133:0/4127597561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc1590c0 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.472+0000 7fb6fa59c700 1 --2- 172.21.15.133:0/4127597561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6fc0b0670 0x7fb6fc063550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:53:46.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.472+0000 7fb6f9d9b700 1 --2- 172.21.15.133:0/4127597561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6fc0b5c10 0x7fb6fc159380 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7fb6e400c000 tx=0x7fb6e40091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:46.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.472+0000 7fb6f37fe700 1 -- 172.21.15.133:0/4127597561 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e400cc60 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.481 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.472+0000 7fb6f37fe700 1 -- 172.21.15.133:0/4127597561 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e400cdc0 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.472+0000 7fb700c87700 1 -- 172.21.15.133:0/4127597561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6fc062eb0 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.472+0000 7fb6f37fe700 1 -- 172.21.15.133:0/4127597561 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e40125e0 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.482 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.472+0000 7fb700c87700 1 -- 172.21.15.133:0/4127597561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6fc159a10 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.472+0000 7fb6f37fe700 1 -- 172.21.15.133:0/4127597561 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb6e4022070 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.483 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.476+0000 7fb700c87700 1 -- 172.21.15.133:0/4127597561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6fc057300 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.476+0000 7fb6f37fe700 1 --2- 172.21.15.133:0/4127597561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6e0055440 0x7fb6e0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:46.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.476+0000 7fb6f37fe700 1 -- 172.21.15.133:0/4127597561 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fb6e406e700 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.476+0000 7fb6fa59c700 1 --2- 172.21.15.133:0/4127597561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6e0055440 0x7fb6e0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:46.484 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.476+0000 7fb6fa59c700 1 --2- 172.21.15.133:0/4127597561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6e0055440 0x7fb6e0057900 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fb6ec018000 tx=0x7fb6ec015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:46.485 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.484+0000 7fb6f37fe700 1 -- 172.21.15.133:0/4127597561 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb6e4044b50 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.624+0000 7fb700c87700 1 -- 172.21.15.133:0/4127597561 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6fc05ce00 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.624+0000 7fb6f37fe700 1 -- 172.21.15.133:0/4127597561 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+13370 (secure 0 0 0) 0x7fb6e4048170 con 0x7fb6fc0b5c10 2021-01-03T13:53:46.628 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:53:46.628 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":165,"fsid":"80bc9ef3-5820-4b9f-9c57-8f734e4c440e","created":"2021-01-03T12:57:43.298835+0000","modified":"2021-01-03T13:08:15.387348+0000","last_up_change":"2021-01-03T12:57:51.052544+0000","last_in_change":"2021-01-03T12:57:51.052544+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-03T12:57:47.102954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-01-03T12:57:55.472799+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"11d9cfa8-1a6c-47d7-9f28-9c7e5568bd8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":12124},{"type":"v1","addr":"172.21.15.133:6811","nonce":12124}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":12124},{"type":"v1","addr":"172.21.15.133:6813","nonce":12124}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":12124},{"type":"v1","addr":"172.21.15.133:6817","nonce":12124}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":12124},{"type":"v1","addr":"172.21.15.133:6815","nonce":12124}]},"public_addr":"172.21.15.133:6811/12124","cluster_addr":"172.21.15.133:6813/12124","heartbeat_back_addr":"172.21.15.133:6817/12124","heartbeat_front_addr":"172.21.15.133:6815/12124","state":["exists","up"]},{"osd":1,"uuid":"9170d1de-58d4-4dfd-b9de-80dc15ca9e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":12123},{"type":"v1","addr":"172.21.15.133:6819","nonce":12123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":12123},{"type":"v1","addr":"172.21.15.133:6821","nonce":12123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":12123},{"type":"v1","addr":"172.21.15.133:6825","nonce":12123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":12123},{"type":"v1","addr":"172.21.15.133:6823","nonce":12123}]},"public_addr":"172.21.15.133:6819/12123","cluster_addr":"172.21.15.133:6821/12123","heartbeat_back_addr":"172.21.15.133:6825/12123","heartbeat_front_addr":"172.21.15.133:6823/12123","state":["exists","up"]},{"osd":2,"uuid":"9fc5adf9-3537-4953-9c65-0c67ecb53776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":12122},{"type":"v1","addr":"172.21.15.133:6803","nonce":12122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":12122},{"type":"v1","addr":"172.21.15.133:6805","nonce":12122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":12122},{"type":"v1","addr":"172.21.15.133:6809","nonce":12122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":12122},{"type":"v1","addr":"172.21.15.133:6807","nonce":12122}]},"public_addr":"172.21.15.133:6803/12122","cluster_addr":"172.21.15.133:6805/12122","heartbeat_back_addr":"172.21.15.133:6809/12122","heartbeat_front_addr":"172.21.15.133:6807/12122","state":["exists","up"]},{"osd":3,"uuid":"0ad45ce5-6635-4089-bbf8-c966d0fe5338","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":12136},{"type":"v1","addr":"172.21.15.133:6827","nonce":12136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":12136},{"type":"v1","addr":"172.21.15.133:6829","nonce":12136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":12136},{"type":"v1","addr":"172.21.15.133:6833","nonce":12136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":12136},{"type":"v1","addr":"172.21.15.133:6831","nonce":12136}]},"public_addr":"172.21.15.133:6827/12136","cluster_addr":"172.21.15.133:6829/12136","heartbeat_back_addr":"172.21.15.133:6833/12136","heartbeat_front_addr":"172.21.15.133:6831/12136","state":["exists","up"]},{"osd":4,"uuid":"86b8d6d5-271b-4a70-ae7b-a227afb38d7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":12672},{"type":"v1","addr":"172.21.15.16:6809","nonce":12672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":12672},{"type":"v1","addr":"172.21.15.16:6811","nonce":12672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":12672},{"type":"v1","addr":"172.21.15.16:6815","nonce":12672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":12672},{"type":"v1","addr":"172.21.15.16:6813","nonce":12672}]},"public_addr":"172.21.15.16:6809/12672","cluster_addr":"172.21.15.16:6811/12672","heartbeat_back_addr":"172.21.15.16:6815/12672","heartbeat_front_addr":"172.21.15.16:6813/12672","state":["exists","up"]},{"osd":5,"uuid":"173feb9d-f596-4030-85d8-1f4b46a9ffe5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":12673},{"type":"v1","addr":"172.21.15.16:6819","nonce":12673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":12673},{"type":"v1","addr":"172.21.15.16:6822","nonce":12673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":12673},{"type":"v1","addr":"172.21.15.16:6830","nonce":12673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":12673},{"type":"v1","addr":"172.21.15.16:6826","nonce":12673}]},"public_addr":"172.21.15.16:6819/12673","cluster_addr":"172.21.15.16:6822/12673","heartbeat_back_addr":"172.21.15.16:6830/12673","heartbeat_front_addr":"172.21.15.16:6826/12673","state":["exists","up"]},{"osd":6,"uuid":"b487980e-ad4d-43c1-91fa-4845f7af3d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":12662},{"type":"v1","addr":"172.21.15.16:6801","nonce":12662}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":12662},{"type":"v1","addr":"172.21.15.16:6803","nonce":12662}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":12662},{"type":"v1","addr":"172.21.15.16:6807","nonce":12662}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":12662},{"type":"v1","addr":"172.21.15.16:6805","nonce":12662}]},"public_addr":"172.21.15.16:6801/12662","cluster_addr":"172.21.15.16:6803/12662","heartbeat_back_addr":"172.21.15.16:6807/12662","heartbeat_front_addr":"172.21.15.16:6805/12662","state":["exists","up"]},{"osd":7,"uuid":"38ea839a-451f-4c09-a545-4514e049b178","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":159,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":12674},{"type":"v1","addr":"172.21.15.16:6818","nonce":12674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":12674},{"type":"v1","addr":"172.21.15.16:6823","nonce":12674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6829","nonce":12674},{"type":"v1","addr":"172.21.15.16:6831","nonce":12674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6825","nonce":12674},{"type":"v1","addr":"172.21.15.16:6827","nonce":12674}]},"public_addr":"172.21.15.16:6818/12674","cluster_addr":"172.21.15.16:6823/12674","heartbeat_back_addr":"172.21.15.16:6831/12674","heartbeat_front_addr":"172.21.15.16:6827/12674","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.659942+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.750326+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.587742+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.855073+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.565030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.786206+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.576185+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-01-03T12:57:49.823786+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.133:6837/3193569550":"2021-01-04T13:08:10.972796+0000","172.21.15.133:6836/3193569550":"2021-01-04T13:08:10.972796+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-01-03T13:53:46.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.628+0000 7fb700c87700 1 -- 172.21.15.133:0/4127597561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6e0055440 msgr2=0x7fb6e0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:46.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.628+0000 7fb700c87700 1 --2- 172.21.15.133:0/4127597561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6e0055440 0x7fb6e0057900 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7fb6ec018000 tx=0x7fb6ec015000).stop 2021-01-03T13:53:46.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.628+0000 7fb700c87700 1 -- 172.21.15.133:0/4127597561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6fc0b5c10 msgr2=0x7fb6fc159380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:46.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.628+0000 7fb700c87700 1 --2- 172.21.15.133:0/4127597561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6fc0b5c10 0x7fb6fc159380 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7fb6e400c000 tx=0x7fb6e40091a0).stop 2021-01-03T13:53:46.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.628+0000 7fb700c87700 1 -- 172.21.15.133:0/4127597561 shutdown_connections 2021-01-03T13:53:46.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.628+0000 7fb700c87700 1 --2- 172.21.15.133:0/4127597561 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb6e0055440 0x7fb6e0057900 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.628+0000 7fb700c87700 1 --2- 172.21.15.133:0/4127597561 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6fc0b0670 0x7fb6fc063550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.628+0000 7fb700c87700 1 --2- 172.21.15.133:0/4127597561 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb6fc14acc0 0x7fb6fc1432a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.628+0000 7fb700c87700 1 --2- 172.21.15.133:0/4127597561 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6fc0b5c10 0x7fb6fc159380 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:46.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.628+0000 7fb700c87700 1 -- 172.21.15.133:0/4127597561 >> 172.21.15.133:0/4127597561 conn(0x7fb6fc05c8c0 msgr2=0x7fb6fc09ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:46.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.628+0000 7fb700c87700 1 -- 172.21.15.133:0/4127597561 shutdown_connections 2021-01-03T13:53:46.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:46.628+0000 7fb700c87700 1 -- 172.21.15.133:0/4127597561 wait complete. 2021-01-03T13:53:47.541 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:53:47.544 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:53:47.546 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:53:47.549 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:53:47.642 INFO:tasks.ceph:Scrubbing osd.0 2021-01-03T13:53:47.643 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 config set osd_debug_deep_scrub_sleep 0 2021-01-03T13:53:47.769 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a30c9700 1 Processor -- start 2021-01-03T13:53:47.770 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a30c9700 1 -- start start 2021-01-03T13:53:47.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a30c9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff39c0af200 0x7ff39c141620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:47.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a30c9700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff39c144c60 0x7ff39c0ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:47.772 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a30c9700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39c0af5e0 con 0x7ff39c05bdf0 2021-01-03T13:53:47.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a30c9700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39c05c2a0 con 0x7ff39c144c60 2021-01-03T13:53:47.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a30c9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39c05c4c0 con 0x7ff39c0af200 2021-01-03T13:53:47.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a20c7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff39c0af200 0x7ff39c141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:47.773 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a20c7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff39c0af200 0x7ff39c141620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41242/0 (socket says 172.21.15.133:41242) 2021-01-03T13:53:47.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a20c7700 1 -- 172.21.15.133:0/3927382755 learned_addr learned my addr 172.21.15.133:0/3927382755 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:47.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a28c8700 1 --2- 172.21.15.133:0/3927382755 >> v2:172.21.15.16:3300/0 conn(0x7ff39c144c60 0x7ff39c0ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:47.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a20c7700 1 -- 172.21.15.133:0/3927382755 >> v2:172.21.15.16:3300/0 conn(0x7ff39c144c60 msgr2=0x7ff39c0ab0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:47.774 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a20c7700 1 --2- 172.21.15.133:0/3927382755 >> v2:172.21.15.16:3300/0 conn(0x7ff39c144c60 0x7ff39c0ab0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:47.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a20c7700 1 -- 172.21.15.133:0/3927382755 >> v1:172.21.15.16:6789/0 conn(0x7ff39c05bdf0 legacy=0x7ff39c144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:47.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a20c7700 1 -- 172.21.15.133:0/3927382755 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39c05c760 con 0x7ff39c0af200 2021-01-03T13:53:47.775 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a20c7700 1 --2- 172.21.15.133:0/3927382755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39c0af200 0x7ff39c141620 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7ff39c061200 tx=0x7ff398006e80).ready entity=mon.1 client_cookie=b55d62eeb6a1ad50 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:47.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a10c5700 1 -- 172.21.15.133:0/3927382755 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3980097b0 con 0x7ff39c0af200 2021-01-03T13:53:47.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a10c5700 1 -- 172.21.15.133:0/3927382755 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff398009910 con 0x7ff39c0af200 2021-01-03T13:53:47.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a10c5700 1 -- 172.21.15.133:0/3927382755 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff398009a80 con 0x7ff39c0af200 2021-01-03T13:53:47.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a30c9700 1 -- 172.21.15.133:0/3927382755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39c0af200 msgr2=0x7ff39c141620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:47.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.768+0000 7ff3a30c9700 1 --2- 172.21.15.133:0/3927382755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39c0af200 0x7ff39c141620 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7ff39c061200 tx=0x7ff398006e80).stop 2021-01-03T13:53:47.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.772+0000 7ff3a30c9700 1 -- 172.21.15.133:0/3927382755 shutdown_connections 2021-01-03T13:53:47.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.772+0000 7ff3a30c9700 1 --2- 172.21.15.133:0/3927382755 >> v2:172.21.15.16:3300/0 conn(0x7ff39c144c60 0x7ff39c0ab0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:47.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.772+0000 7ff3a30c9700 1 --2- 172.21.15.133:0/3927382755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39c0af200 0x7ff39c141620 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:47.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.772+0000 7ff3a30c9700 1 -- 172.21.15.133:0/3927382755 >> 172.21.15.133:0/3927382755 conn(0x7ff39c06b050 msgr2=0x7ff39c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:47.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.772+0000 7ff3a30c9700 1 -- 172.21.15.133:0/3927382755 shutdown_connections 2021-01-03T13:53:47.778 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.772+0000 7ff3a30c9700 1 -- 172.21.15.133:0/3927382755 wait complete. 2021-01-03T13:53:47.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.772+0000 7ff3a30c9700 1 Processor -- start 2021-01-03T13:53:47.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.772+0000 7ff3a30c9700 1 -- start start 2021-01-03T13:53:47.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.772+0000 7ff3a30c9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff39c05bdf0 0x7ff39c1400f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:47.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.772+0000 7ff3a30c9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff39c0af200 0x7ff39c13db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:47.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.772+0000 7ff3a30c9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39c144c60 0x7ff39c13e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:47.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a30c9700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c1431c0 con 0x7ff39c0af200 2021-01-03T13:53:47.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a30c9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c1428b0 con 0x7ff39c144c60 2021-01-03T13:53:47.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a30c9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39c1433f0 con 0x7ff39c05bdf0 2021-01-03T13:53:47.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a28c8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39c144c60 0x7ff39c13e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:47.783 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a28c8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39c144c60 0x7ff39c13e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41252/0 (socket says 172.21.15.133:41252) 2021-01-03T13:53:47.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a28c8700 1 -- 172.21.15.133:0/4144964850 learned_addr learned my addr 172.21.15.133:0/4144964850 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:47.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a20c7700 1 --2- 172.21.15.133:0/4144964850 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff39c05bdf0 0x7ff39c1400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:47.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a18c6700 1 --2- 172.21.15.133:0/4144964850 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff39c0af200 0x7ff39c13db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:47.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a28c8700 1 -- 172.21.15.133:0/4144964850 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff39c05bdf0 msgr2=0x7ff39c1400f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:47.784 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a28c8700 1 --2- 172.21.15.133:0/4144964850 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff39c05bdf0 0x7ff39c1400f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:47.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a28c8700 1 -- 172.21.15.133:0/4144964850 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff39c0af200 msgr2=0x7ff39c13db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:47.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a28c8700 1 --2- 172.21.15.133:0/4144964850 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff39c0af200 0x7ff39c13db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:47.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a28c8700 1 -- 172.21.15.133:0/4144964850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39c142b10 con 0x7ff39c144c60 2021-01-03T13:53:47.785 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a28c8700 1 --2- 172.21.15.133:0/4144964850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39c144c60 0x7ff39c13e050 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7ff39400a000 tx=0x7ff394008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:47.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff38b7fe700 1 -- 172.21.15.133:0/4144964850 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff394009a90 con 0x7ff39c144c60 2021-01-03T13:53:47.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff38b7fe700 1 -- 172.21.15.133:0/4144964850 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff394009bf0 con 0x7ff39c144c60 2021-01-03T13:53:47.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a30c9700 1 -- 172.21.15.133:0/4144964850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39c13e540 con 0x7ff39c144c60 2021-01-03T13:53:47.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff38b7fe700 1 -- 172.21.15.133:0/4144964850 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff394012420 con 0x7ff39c144c60 2021-01-03T13:53:47.786 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a30c9700 1 -- 172.21.15.133:0/4144964850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39c0a8c00 con 0x7ff39c144c60 2021-01-03T13:53:47.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a30c9700 1 -- 172.21.15.133:0/4144964850 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff39c057300 con 0x7ff39c144c60 2021-01-03T13:53:47.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff38b7fe700 1 -- 172.21.15.133:0/4144964850 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff394012580 con 0x7ff39c144c60 2021-01-03T13:53:47.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff38b7fe700 1 --2- 172.21.15.133:0/4144964850 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff37c0553f0 0x7ff37c0578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:47.787 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff38b7fe700 1 -- 172.21.15.133:0/4144964850 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7ff39406e380 con 0x7ff39c144c60 2021-01-03T13:53:47.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a20c7700 1 --2- 172.21.15.133:0/4144964850 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff37c0553f0 0x7ff37c0578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:47.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff38b7fe700 1 --2- 172.21.15.133:0/4144964850 >> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] conn(0x7ff37c05bb00 0x7ff37c05df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:47.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff38b7fe700 1 -- 172.21.15.133:0/4144964850 --> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff37c05e5a0 con 0x7ff37c05bb00 2021-01-03T13:53:47.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff38b7fe700 1 -- 172.21.15.133:0/4144964850 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=165) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff394070a10 con 0x7ff39c144c60 2021-01-03T13:53:47.788 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.776+0000 7ff3a18c6700 1 --2- 172.21.15.133:0/4144964850 >> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] conn(0x7ff37c05bb00 0x7ff37c05df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:47.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.780+0000 7ff3a20c7700 1 --2- 172.21.15.133:0/4144964850 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff37c0553f0 0x7ff37c0578b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7ff398019000 tx=0x7ff398016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:47.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.780+0000 7ff3a18c6700 1 --2- 172.21.15.133:0/4144964850 >> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] conn(0x7ff37c05bb00 0x7ff37c05df20 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:47.789 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.780+0000 7ff38b7fe700 1 -- 172.21.15.133:0/4144964850 <== osd.0 v2:172.21.15.133:6810/12124 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7ff37c05e5a0 con 0x7ff37c05bb00 2021-01-03T13:53:47.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.800+0000 7ff3a30c9700 1 -- 172.21.15.133:0/4144964850 --> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff39c0ac0e0 con 0x7ff37c05bb00 2021-01-03T13:53:47.803 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.800+0000 7ff38b7fe700 1 -- 172.21.15.133:0/4144964850 <== osd.0 v2:172.21.15.133:6810/12124 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff39c0ac0e0 con 0x7ff37c05bb00 2021-01-03T13:53:47.804 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:53:47.804 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-01-03T13:53:47.804 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:53:47.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.800+0000 7ff3a30c9700 1 -- 172.21.15.133:0/4144964850 >> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] conn(0x7ff37c05bb00 msgr2=0x7ff37c05df20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:47.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.800+0000 7ff3a30c9700 1 --2- 172.21.15.133:0/4144964850 >> [v2:172.21.15.133:6810/12124,v1:172.21.15.133:6811/12124] conn(0x7ff37c05bb00 0x7ff37c05df20 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:47.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.800+0000 7ff3a30c9700 1 -- 172.21.15.133:0/4144964850 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff37c0553f0 msgr2=0x7ff37c0578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:47.806 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.800+0000 7ff3a30c9700 1 --2- 172.21.15.133:0/4144964850 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff37c0553f0 0x7ff37c0578b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7ff398019000 tx=0x7ff398016000).stop 2021-01-03T13:53:47.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.800+0000 7ff3a30c9700 1 -- 172.21.15.133:0/4144964850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39c144c60 msgr2=0x7ff39c13e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:47.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.800+0000 7ff3a30c9700 1 --2- 172.21.15.133:0/4144964850 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff39c144c60 0x7ff39c13e050 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7ff39400a000 tx=0x7ff394008040).stop 2021-01-03T13:53:47.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.800+0000 7ff3a28c8700 1 -- 172.21.15.133:0/4144964850 reap_dead start 2021-01-03T13:53:47.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.800+0000 7ff3a30c9700 1 -- 172.21.15.133:0/4144964850 shutdown_connections 2021-01-03T13:53:47.807 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.800+0000 7ff3a30c9700 1 -- 172.21.15.133:0/4144964850 >> 172.21.15.133:0/4144964850 conn(0x7ff39c06b050 msgr2=0x7ff39c0b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:47.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.800+0000 7ff3a30c9700 1 -- 172.21.15.133:0/4144964850 shutdown_connections 2021-01-03T13:53:47.808 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.804+0000 7ff3a30c9700 1 -- 172.21.15.133:0/4144964850 wait complete. 2021-01-03T13:53:47.818 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 0 2021-01-03T13:53:47.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.932+0000 7f889591c700 1 Processor -- start 2021-01-03T13:53:47.936 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.932+0000 7f889591c700 1 -- start start 2021-01-03T13:53:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889591c700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f88900b9b60 0x7f88900b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889591c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88900b4e10 0x7f8890146b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:47.938 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889591c700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8890147030 con 0x7f88900b4980 2021-01-03T13:53:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889591c700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88900aed30 con 0x7f88900b9b60 2021-01-03T13:53:47.939 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889591c700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88900605f0 con 0x7f88900b4e10 2021-01-03T13:53:47.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889511b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88900b4e10 0x7f8890146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:47.940 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889511b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88900b4e10 0x7f8890146b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41258/0 (socket says 172.21.15.133:41258) 2021-01-03T13:53:47.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889511b700 1 -- 172.21.15.133:0/1064387942 learned_addr learned my addr 172.21.15.133:0/1064387942 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:47.941 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889491a700 1 --2- 172.21.15.133:0/1064387942 >> v2:172.21.15.16:3300/0 conn(0x7f88900b9b60 0x7f88900b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:47.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889511b700 1 -- 172.21.15.133:0/1064387942 >> v2:172.21.15.16:3300/0 conn(0x7f88900b9b60 msgr2=0x7f88900b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:47.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889511b700 1 --2- 172.21.15.133:0/1064387942 >> v2:172.21.15.16:3300/0 conn(0x7f88900b9b60 0x7f88900b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:47.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889511b700 1 -- 172.21.15.133:0/1064387942 >> v1:172.21.15.16:6789/0 conn(0x7f88900b4980 legacy=0x7f8890146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:47.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889511b700 1 -- 172.21.15.133:0/1064387942 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88900600b0 con 0x7f88900b4e10 2021-01-03T13:53:47.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889511b700 1 --2- 172.21.15.133:0/1064387942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88900b4e10 0x7f8890146b40 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f8890068a40 tx=0x7f8888006e80).ready entity=mon.1 client_cookie=74743fa3a62ccf75 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:47.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f888f7fe700 1 -- 172.21.15.133:0/1064387942 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88880097b0 con 0x7f88900b4e10 2021-01-03T13:53:47.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f888f7fe700 1 -- 172.21.15.133:0/1064387942 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8888009910 con 0x7f88900b4e10 2021-01-03T13:53:47.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f888f7fe700 1 -- 172.21.15.133:0/1064387942 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8888009a80 con 0x7f88900b4e10 2021-01-03T13:53:47.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889591c700 1 -- 172.21.15.133:0/1064387942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88900b4e10 msgr2=0x7f8890146b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:47.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889591c700 1 --2- 172.21.15.133:0/1064387942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88900b4e10 0x7f8890146b40 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f8890068a40 tx=0x7f8888006e80).stop 2021-01-03T13:53:47.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889591c700 1 -- 172.21.15.133:0/1064387942 shutdown_connections 2021-01-03T13:53:47.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889591c700 1 --2- 172.21.15.133:0/1064387942 >> v2:172.21.15.16:3300/0 conn(0x7f88900b9b60 0x7f88900b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:47.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889591c700 1 --2- 172.21.15.133:0/1064387942 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88900b4e10 0x7f8890146b40 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:47.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889591c700 1 -- 172.21.15.133:0/1064387942 >> 172.21.15.133:0/1064387942 conn(0x7f88900b69e0 msgr2=0x7f88900b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:47.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889591c700 1 -- 172.21.15.133:0/1064387942 shutdown_connections 2021-01-03T13:53:47.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.936+0000 7f889591c700 1 -- 172.21.15.133:0/1064387942 wait complete. 2021-01-03T13:53:47.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889591c700 1 Processor -- start 2021-01-03T13:53:47.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889591c700 1 -- start start 2021-01-03T13:53:47.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889591c700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88900b4980 0x7f889013cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:47.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889591c700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f88900b4e10 0x7f8890151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:47.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889591c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88900b9b60 0x7f88901520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:47.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889591c700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88900b86f0 con 0x7f88900b4980 2021-01-03T13:53:47.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889591c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889009d110 con 0x7f88900b9b60 2021-01-03T13:53:47.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889591c700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889009c730 con 0x7f88900b4e10 2021-01-03T13:53:47.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889511b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88900b9b60 0x7f88901520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:47.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889511b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88900b9b60 0x7f88901520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41268/0 (socket says 172.21.15.133:41268) 2021-01-03T13:53:47.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889511b700 1 -- 172.21.15.133:0/118048121 learned_addr learned my addr 172.21.15.133:0/118048121 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:47.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889491a700 1 --2- 172.21.15.133:0/118048121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88900b4980 0x7f889013cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:47.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f888ffff700 1 --2- 172.21.15.133:0/118048121 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f88900b4e10 0x7f8890151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:47.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889511b700 1 -- 172.21.15.133:0/118048121 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f88900b4e10 msgr2=0x7f8890151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:47.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889511b700 1 --2- 172.21.15.133:0/118048121 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f88900b4e10 0x7f8890151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:47.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889511b700 1 -- 172.21.15.133:0/118048121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88900b4980 msgr2=0x7f889013cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:47.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889511b700 1 --2- 172.21.15.133:0/118048121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88900b4980 0x7f889013cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:47.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889511b700 1 -- 172.21.15.133:0/118048121 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889009c9d0 con 0x7f88900b9b60 2021-01-03T13:53:47.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889511b700 1 --2- 172.21.15.133:0/118048121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88900b9b60 0x7f88901520f0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f8890068a40 tx=0x7f8888016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:47.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f888dffb700 1 -- 172.21.15.133:0/118048121 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8888011e90 con 0x7f88900b9b60 2021-01-03T13:53:47.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f888dffb700 1 -- 172.21.15.133:0/118048121 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8888021440 con 0x7f88900b9b60 2021-01-03T13:53:47.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889591c700 1 -- 172.21.15.133:0/118048121 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889009cc70 con 0x7f88900b9b60 2021-01-03T13:53:47.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f888dffb700 1 -- 172.21.15.133:0/118048121 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88880217a0 con 0x7f88900b9b60 2021-01-03T13:53:47.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.940+0000 7f889591c700 1 -- 172.21.15.133:0/118048121 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8890145d70 con 0x7f88900b9b60 2021-01-03T13:53:47.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.944+0000 7f889591c700 1 -- 172.21.15.133:0/118048121 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8890057300 con 0x7f88900b9b60 2021-01-03T13:53:47.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.944+0000 7f888dffb700 1 -- 172.21.15.133:0/118048121 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f8888027020 con 0x7f88900b9b60 2021-01-03T13:53:47.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.944+0000 7f888dffb700 1 --2- 172.21.15.133:0/118048121 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8870055350 0x7f8870057810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:47.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.944+0000 7f888dffb700 1 -- 172.21.15.133:0/118048121 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f888806edc0 con 0x7f88900b9b60 2021-01-03T13:53:47.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.944+0000 7f889491a700 1 --2- 172.21.15.133:0/118048121 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8870055350 0x7f8870057810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:47.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.944+0000 7f889491a700 1 --2- 172.21.15.133:0/118048121 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8870055350 0x7f8870057810 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f888000c000 tx=0x7f8880008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:47.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:47.952+0000 7f888dffb700 1 -- 172.21.15.133:0/118048121 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f88880453c0 con 0x7f88900b9b60 2021-01-03T13:53:48.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.092+0000 7f889591c700 1 -- 172.21.15.133:0/118048121 --> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f88900ae8a0 con 0x7f8870055350 2021-01-03T13:53:48.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.092+0000 7f888dffb700 1 -- 172.21.15.133:0/118048121 <== mgr.4110 v2:172.21.15.133:6800/11943 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f88900ae8a0 con 0x7f8870055350 2021-01-03T13:53:48.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.096+0000 7f889591c700 1 -- 172.21.15.133:0/118048121 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8870055350 msgr2=0x7f8870057810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.096+0000 7f889591c700 1 --2- 172.21.15.133:0/118048121 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8870055350 0x7f8870057810 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f888000c000 tx=0x7f8880008040).stop 2021-01-03T13:53:48.099 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.096+0000 7f889591c700 1 -- 172.21.15.133:0/118048121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88900b9b60 msgr2=0x7f88901520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.096+0000 7f889591c700 1 --2- 172.21.15.133:0/118048121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88900b9b60 0x7f88901520f0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f8890068a40 tx=0x7f8888016000).stop 2021-01-03T13:53:48.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.096+0000 7f889591c700 1 -- 172.21.15.133:0/118048121 shutdown_connections 2021-01-03T13:53:48.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.096+0000 7f889591c700 1 --2- 172.21.15.133:0/118048121 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f8870055350 0x7f8870057810 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.100 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.096+0000 7f889591c700 1 --2- 172.21.15.133:0/118048121 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88900b4980 0x7f889013cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.096+0000 7f889591c700 1 --2- 172.21.15.133:0/118048121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88900b9b60 0x7f88901520f0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.096+0000 7f889591c700 1 --2- 172.21.15.133:0/118048121 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f88900b4e10 0x7f8890151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.096+0000 7f889591c700 1 -- 172.21.15.133:0/118048121 >> 172.21.15.133:0/118048121 conn(0x7f88900b69e0 msgr2=0x7f889005bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.096+0000 7f889591c700 1 -- 172.21.15.133:0/118048121 shutdown_connections 2021-01-03T13:53:48.101 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.096+0000 7f889591c700 1 -- 172.21.15.133:0/118048121 wait complete. 2021-01-03T13:53:48.102 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 0 to deep-scrub 2021-01-03T13:53:48.110 INFO:tasks.ceph:Scrubbing osd.1 2021-01-03T13:53:48.111 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 config set osd_debug_deep_scrub_sleep 0 2021-01-03T13:53:48.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.220+0000 7f15cb59e700 1 Processor -- start 2021-01-03T13:53:48.223 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.220+0000 7f15cb59e700 1 -- start start 2021-01-03T13:53:48.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.220+0000 7f15cb59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f15cc066f30 0x7f15cc0b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.224 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.220+0000 7f15cb59e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15cc05fd00 con 0x7f15cc05f920 2021-01-03T13:53:48.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.220+0000 7f15cb59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15cc0accd0 con 0x7f15cc0b1590 2021-01-03T13:53:48.225 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.220+0000 7f15cb59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15cc0b2980 con 0x7f15cc066f30 2021-01-03T13:53:48.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.220+0000 7f15cad9d700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f15cc0b1590 0x7f15cc13ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34074/0 (socket says 172.21.15.133:34074) 2021-01-03T13:53:48.227 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.220+0000 7f15cad9d700 1 -- 172.21.15.133:0/4280480092 learned_addr learned my addr 172.21.15.133:0/4280480092 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:53:48.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.220+0000 7f15c9d9b700 1 --2- 172.21.15.133:0/4280480092 >> v2:172.21.15.16:3300/0 conn(0x7f15cc066f30 0x7f15cc0b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 -- 172.21.15.133:0/4280480092 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342122028 0 0) 0x7f15cc0accd0 con 0x7f15cc0b1590 2021-01-03T13:53:48.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 -- 172.21.15.133:0/4280480092 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15b0003230 con 0x7f15cc0b1590 2021-01-03T13:53:48.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 -- 172.21.15.133:0/4280480092 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569852998 0 0) 0x7f15cc05fd00 con 0x7f15cc05f920 2021-01-03T13:53:48.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 -- 172.21.15.133:0/4280480092 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15cc0accd0 con 0x7f15cc05f920 2021-01-03T13:53:48.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 -- 172.21.15.133:0/4280480092 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 574317729 0 0) 0x7f15b0003230 con 0x7f15cc0b1590 2021-01-03T13:53:48.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 -- 172.21.15.133:0/4280480092 >> v2:172.21.15.16:3300/0 conn(0x7f15cc066f30 msgr2=0x7f15cc0b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:48.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 --2- 172.21.15.133:0/4280480092 >> v2:172.21.15.16:3300/0 conn(0x7f15cc066f30 0x7f15cc0b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 -- 172.21.15.133:0/4280480092 >> v1:172.21.15.16:6789/0 conn(0x7f15cc05f920 legacy=0x7f15cc0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 -- 172.21.15.133:0/4280480092 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc0acf70 con 0x7f15cc0b1590 2021-01-03T13:53:48.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 -- 172.21.15.133:0/4280480092 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7f15c40016d0 con 0x7f15cc0b1590 2021-01-03T13:53:48.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 -- 172.21.15.133:0/4280480092 >> v1:172.21.15.133:6789/0 conn(0x7f15cc0b1590 legacy=0x7f15cc13ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 --2- 172.21.15.133:0/4280480092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b00038b0 0x7f15b0003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.230 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 --2- 172.21.15.133:0/4280480092 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15b00044d0 0x7f15b0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 --2- 172.21.15.133:0/4280480092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15b0004e40 0x7f15b000fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 -- 172.21.15.133:0/4280480092 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc0b2980 con 0x7f15b0004e40 2021-01-03T13:53:48.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 -- 172.21.15.133:0/4280480092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b00053a0 con 0x7f15b00038b0 2021-01-03T13:53:48.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 -- 172.21.15.133:0/4280480092 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b00100a0 con 0x7f15b00044d0 2021-01-03T13:53:48.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15ca59c700 1 --2- 172.21.15.133:0/4280480092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b00038b0 0x7f15b0003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15cad9d700 1 --2- 172.21.15.133:0/4280480092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15b0004e40 0x7f15b000fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c9d9b700 1 --2- 172.21.15.133:0/4280480092 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15b00044d0 0x7f15b0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15ca59c700 1 -- 172.21.15.133:0/4280480092 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15b00044d0 msgr2=0x7f15b0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:48.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15ca59c700 1 --2- 172.21.15.133:0/4280480092 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15b00044d0 0x7f15b0004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15ca59c700 1 -- 172.21.15.133:0/4280480092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15b0004e40 msgr2=0x7f15b000fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:48.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15ca59c700 1 --2- 172.21.15.133:0/4280480092 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15b0004e40 0x7f15b000fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15cad9d700 1 -- 172.21.15.133:0/4280480092 reap_dead start 2021-01-03T13:53:48.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15ca59c700 1 -- 172.21.15.133:0/4280480092 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b0003230 con 0x7f15b00038b0 2021-01-03T13:53:48.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c9d9b700 1 --2- 172.21.15.133:0/4280480092 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15b00044d0 0x7f15b0004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:53:48.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15ca59c700 1 --2- 172.21.15.133:0/4280480092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b00038b0 0x7f15b0003cb0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f15b40010d0 tx=0x7f15b4007b60).ready entity=mon.1 client_cookie=44b5424c1d535b0b server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:48.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 -- 172.21.15.133:0/4280480092 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b400c870 con 0x7f15b00038b0 2021-01-03T13:53:48.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 -- 172.21.15.133:0/4280480092 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b400c9d0 con 0x7f15b00038b0 2021-01-03T13:53:48.234 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15c959a700 1 -- 172.21.15.133:0/4280480092 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b400cd30 con 0x7f15b00038b0 2021-01-03T13:53:48.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15cb59e700 1 -- 172.21.15.133:0/4280480092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b00038b0 msgr2=0x7f15b0003cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.235 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15cb59e700 1 --2- 172.21.15.133:0/4280480092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b00038b0 0x7f15b0003cb0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f15b40010d0 tx=0x7f15b4007b60).stop 2021-01-03T13:53:48.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15cb59e700 1 -- 172.21.15.133:0/4280480092 shutdown_connections 2021-01-03T13:53:48.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15cb59e700 1 --2- 172.21.15.133:0/4280480092 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b00038b0 0x7f15b0003cb0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.238 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15cb59e700 1 -- 172.21.15.133:0/4280480092 >> 172.21.15.133:0/4280480092 conn(0x7f15cc0b6110 msgr2=0x7f15cc0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:48.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15cb59e700 1 -- 172.21.15.133:0/4280480092 shutdown_connections 2021-01-03T13:53:48.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.224+0000 7f15cb59e700 1 -- 172.21.15.133:0/4280480092 wait complete. 2021-01-03T13:53:48.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15cb59e700 1 Processor -- start 2021-01-03T13:53:48.239 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15cb59e700 1 -- start start 2021-01-03T13:53:48.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15cb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b00038b0 0x7f15cc14d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15cb59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15cc066a40 0x7f15cc1409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15cb59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15cc13c900 0x7f15cc13d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15cb59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc09e7b0 con 0x7f15cc13c900 2021-01-03T13:53:48.240 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15cb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc13e550 con 0x7f15b00038b0 2021-01-03T13:53:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15cb59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc09e9e0 con 0x7f15cc066a40 2021-01-03T13:53:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15ca59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b00038b0 0x7f15cc14d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15ca59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b00038b0 0x7f15cc14d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41284/0 (socket says 172.21.15.133:41284) 2021-01-03T13:53:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15ca59c700 1 -- 172.21.15.133:0/1185815427 learned_addr learned my addr 172.21.15.133:0/1185815427 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:48.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15c9d9b700 1 --2- 172.21.15.133:0/1185815427 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15cc066a40 0x7f15cc1409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15cad9d700 1 --2- 172.21.15.133:0/1185815427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15cc13c900 0x7f15cc13d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15ca59c700 1 -- 172.21.15.133:0/1185815427 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15cc066a40 msgr2=0x7f15cc1409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15ca59c700 1 --2- 172.21.15.133:0/1185815427 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f15cc066a40 0x7f15cc1409b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.242 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15ca59c700 1 -- 172.21.15.133:0/1185815427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15cc13c900 msgr2=0x7f15cc13d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15ca59c700 1 --2- 172.21.15.133:0/1185815427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15cc13c900 0x7f15cc13d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15ca59c700 1 -- 172.21.15.133:0/1185815427 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc09ec80 con 0x7f15b00038b0 2021-01-03T13:53:48.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15ca59c700 1 --2- 172.21.15.133:0/1185815427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b00038b0 0x7f15cc14d950 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f15b40010d0 tx=0x7f15b4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:48.243 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15c37fe700 1 -- 172.21.15.133:0/1185815427 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b4013c40 con 0x7f15b00038b0 2021-01-03T13:53:48.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15c37fe700 1 -- 172.21.15.133:0/1185815427 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b4013da0 con 0x7f15b00038b0 2021-01-03T13:53:48.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15cb59e700 1 -- 172.21.15.133:0/1185815427 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15cc13d270 con 0x7f15b00038b0 2021-01-03T13:53:48.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15c37fe700 1 -- 172.21.15.133:0/1185815427 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b401e660 con 0x7f15b00038b0 2021-01-03T13:53:48.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15cb59e700 1 -- 172.21.15.133:0/1185815427 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15cc140ea0 con 0x7f15b00038b0 2021-01-03T13:53:48.244 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15cb59e700 1 -- 172.21.15.133:0/1185815427 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15cc13e6c0 con 0x7f15b00038b0 2021-01-03T13:53:48.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.228+0000 7f15c37fe700 1 -- 172.21.15.133:0/1185815427 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f15b4025030 con 0x7f15b00038b0 2021-01-03T13:53:48.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.232+0000 7f15c37fe700 1 --2- 172.21.15.133:0/1185815427 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f15a40554e0 0x7f15a40579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.232+0000 7f15c9d9b700 1 --2- 172.21.15.133:0/1185815427 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f15a40554e0 0x7f15a40579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.245 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.232+0000 7f15c37fe700 1 -- 172.21.15.133:0/1185815427 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f15b406ec80 con 0x7f15b00038b0 2021-01-03T13:53:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.232+0000 7f15c37fe700 1 --2- 172.21.15.133:0/1185815427 >> [v2:172.21.15.133:6818/12123,v1:172.21.15.133:6819/12123] conn(0x7f15a405bbf0 0x7f15a405e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.232+0000 7f15c37fe700 1 -- 172.21.15.133:0/1185815427 --> [v2:172.21.15.133:6818/12123,v1:172.21.15.133:6819/12123] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15a405e5f0 con 0x7f15a405bbf0 2021-01-03T13:53:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.232+0000 7f15c37fe700 1 -- 172.21.15.133:0/1185815427 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=165) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15b4071310 con 0x7f15b00038b0 2021-01-03T13:53:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.232+0000 7f15c9d9b700 1 --2- 172.21.15.133:0/1185815427 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f15a40554e0 0x7f15a40579a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f15bc00b000 tx=0x7f15bc008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.232+0000 7f15cad9d700 1 --2- 172.21.15.133:0/1185815427 >> [v2:172.21.15.133:6818/12123,v1:172.21.15.133:6819/12123] conn(0x7f15a405bbf0 0x7f15a405e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.232+0000 7f15cad9d700 1 --2- 172.21.15.133:0/1185815427 >> [v2:172.21.15.133:6818/12123,v1:172.21.15.133:6819/12123] conn(0x7f15a405bbf0 0x7f15a405e010 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:48.247 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.232+0000 7f15c37fe700 1 -- 172.21.15.133:0/1185815427 <== osd.1 v2:172.21.15.133:6818/12123 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7f15a405e5f0 con 0x7f15a405bbf0 2021-01-03T13:53:48.257 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.256+0000 7f15cb59e700 1 -- 172.21.15.133:0/1185815427 --> [v2:172.21.15.133:6818/12123,v1:172.21.15.133:6819/12123] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f15cc13e070 con 0x7f15a405bbf0 2021-01-03T13:53:48.258 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.256+0000 7f15c37fe700 1 -- 172.21.15.133:0/1185815427 <== osd.1 v2:172.21.15.133:6818/12123 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f15cc13e070 con 0x7f15a405bbf0 2021-01-03T13:53:48.259 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:53:48.259 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-01-03T13:53:48.259 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:53:48.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.256+0000 7f15cb59e700 1 -- 172.21.15.133:0/1185815427 >> [v2:172.21.15.133:6818/12123,v1:172.21.15.133:6819/12123] conn(0x7f15a405bbf0 msgr2=0x7f15a405e010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.260 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.256+0000 7f15cb59e700 1 --2- 172.21.15.133:0/1185815427 >> [v2:172.21.15.133:6818/12123,v1:172.21.15.133:6819/12123] conn(0x7f15a405bbf0 0x7f15a405e010 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.256+0000 7f15cb59e700 1 -- 172.21.15.133:0/1185815427 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f15a40554e0 msgr2=0x7f15a40579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.256+0000 7f15cb59e700 1 --2- 172.21.15.133:0/1185815427 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f15a40554e0 0x7f15a40579a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f15bc00b000 tx=0x7f15bc008040).stop 2021-01-03T13:53:48.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.256+0000 7f15cb59e700 1 -- 172.21.15.133:0/1185815427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b00038b0 msgr2=0x7f15cc14d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.256+0000 7f15cb59e700 1 --2- 172.21.15.133:0/1185815427 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15b00038b0 0x7f15cc14d950 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f15b40010d0 tx=0x7f15b4016000).stop 2021-01-03T13:53:48.261 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.256+0000 7f15cad9d700 1 -- 172.21.15.133:0/1185815427 reap_dead start 2021-01-03T13:53:48.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.256+0000 7f15cb59e700 1 -- 172.21.15.133:0/1185815427 shutdown_connections 2021-01-03T13:53:48.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.256+0000 7f15cb59e700 1 -- 172.21.15.133:0/1185815427 >> 172.21.15.133:0/1185815427 conn(0x7f15cc0b6110 msgr2=0x7f15cc143b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:48.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.256+0000 7f15cb59e700 1 -- 172.21.15.133:0/1185815427 shutdown_connections 2021-01-03T13:53:48.262 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.256+0000 7f15cb59e700 1 -- 172.21.15.133:0/1185815427 wait complete. 2021-01-03T13:53:48.271 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 1 2021-01-03T13:53:48.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.376+0000 7fcad2ecc700 1 Processor -- start 2021-01-03T13:53:48.381 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.376+0000 7fcad2ecc700 1 -- start start 2021-01-03T13:53:48.382 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad2ecc700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcacc0b0c90 0x7fcacc0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad2ecc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcacc0b5c00 0x7fcacc143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad2ecc700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcacc060da0 con 0x7fcacc0b52c0 2021-01-03T13:53:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad2ecc700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcacc067a90 con 0x7fcacc0b0c90 2021-01-03T13:53:48.383 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad2ecc700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc0b0ad0 con 0x7fcacc0b5c00 2021-01-03T13:53:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad26cb700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcacc0b5c00 0x7fcacc143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad16c9700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcacc0b0c90 0x7fcacc0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad16c9700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcacc0b0c90 0x7fcacc0b05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.133:39834/0 (socket says 172.21.15.133:39834) 2021-01-03T13:53:48.384 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad1eca700 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fcacc0b52c0 0x7fcacc098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.133:41054/0 (socket says 172.21.15.133:41054) 2021-01-03T13:53:48.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad16c9700 1 -- 172.21.15.133:0/2118747796 learned_addr learned my addr 172.21.15.133:0/2118747796 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:48.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad16c9700 1 -- 172.21.15.133:0/2118747796 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcacc0b5c00 msgr2=0x7fcacc143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:48.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad16c9700 1 --2- 172.21.15.133:0/2118747796 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcacc0b5c00 0x7fcacc143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.385 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad16c9700 1 -- 172.21.15.133:0/2118747796 >> v1:172.21.15.16:6789/0 conn(0x7fcacc0b52c0 legacy=0x7fcacc098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad16c9700 1 -- 172.21.15.133:0/2118747796 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc0b56a0 con 0x7fcacc0b0c90 2021-01-03T13:53:48.386 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad16c9700 1 --2- 172.21.15.133:0/2118747796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcacc0b0c90 0x7fcacc0b05e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fcac8002f30 tx=0x7fcac8006e80).ready entity=mon.0 client_cookie=3cfdaefe71e192ed server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:48.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad0ec8700 1 -- 172.21.15.133:0/2118747796 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac80097f0 con 0x7fcacc0b0c90 2021-01-03T13:53:48.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad0ec8700 1 -- 172.21.15.133:0/2118747796 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac8009950 con 0x7fcacc0b0c90 2021-01-03T13:53:48.389 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad0ec8700 1 -- 172.21.15.133:0/2118747796 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac8009cb0 con 0x7fcacc0b0c90 2021-01-03T13:53:48.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad2ecc700 1 -- 172.21.15.133:0/2118747796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcacc0b0c90 msgr2=0x7fcacc0b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad2ecc700 1 --2- 172.21.15.133:0/2118747796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcacc0b0c90 0x7fcacc0b05e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fcac8002f30 tx=0x7fcac8006e80).stop 2021-01-03T13:53:48.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad2ecc700 1 -- 172.21.15.133:0/2118747796 shutdown_connections 2021-01-03T13:53:48.390 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad2ecc700 1 --2- 172.21.15.133:0/2118747796 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcacc0b5c00 0x7fcacc143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad2ecc700 1 --2- 172.21.15.133:0/2118747796 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcacc0b0c90 0x7fcacc0b05e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad2ecc700 1 -- 172.21.15.133:0/2118747796 >> 172.21.15.133:0/2118747796 conn(0x7fcacc05bdf0 msgr2=0x7fcacc05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:48.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad2ecc700 1 -- 172.21.15.133:0/2118747796 shutdown_connections 2021-01-03T13:53:48.391 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.380+0000 7fcad2ecc700 1 -- 172.21.15.133:0/2118747796 wait complete. 2021-01-03T13:53:48.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad2ecc700 1 Processor -- start 2021-01-03T13:53:48.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad2ecc700 1 -- start start 2021-01-03T13:53:48.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad2ecc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcacc0b0c90 0x7fcacc063880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.392 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad2ecc700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcacc0b52c0 0x7fcacc1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad2ecc700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcacc0b5c00 0x7fcacc1598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad2ecc700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc155e80 con 0x7fcacc0b5c00 2021-01-03T13:53:48.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad2ecc700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc067570 con 0x7fcacc0b0c90 2021-01-03T13:53:48.393 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad2ecc700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc156070 con 0x7fcacc0b52c0 2021-01-03T13:53:48.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad1eca700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcacc0b0c90 0x7fcacc063880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad1eca700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcacc0b0c90 0x7fcacc063880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41300/0 (socket says 172.21.15.133:41300) 2021-01-03T13:53:48.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad1eca700 1 -- 172.21.15.133:0/121405250 learned_addr learned my addr 172.21.15.133:0/121405250 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:48.394 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad26cb700 1 --2- 172.21.15.133:0/121405250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcacc0b5c00 0x7fcacc1598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad16c9700 1 --2- 172.21.15.133:0/121405250 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcacc0b52c0 0x7fcacc1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad1eca700 1 -- 172.21.15.133:0/121405250 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcacc0b52c0 msgr2=0x7fcacc1593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad1eca700 1 --2- 172.21.15.133:0/121405250 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcacc0b52c0 0x7fcacc1593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.395 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad1eca700 1 -- 172.21.15.133:0/121405250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcacc0b5c00 msgr2=0x7fcacc1598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad1eca700 1 --2- 172.21.15.133:0/121405250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcacc0b5c00 0x7fcacc1598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad1eca700 1 -- 172.21.15.133:0/121405250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc156310 con 0x7fcacc0b0c90 2021-01-03T13:53:48.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad1eca700 1 --2- 172.21.15.133:0/121405250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcacc0b0c90 0x7fcacc063880 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7fcacc061fd0 tx=0x7fcac0007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:48.396 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcabeffd700 1 -- 172.21.15.133:0/121405250 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac00072e0 con 0x7fcacc0b0c90 2021-01-03T13:53:48.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcabeffd700 1 -- 172.21.15.133:0/121405250 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac0005520 con 0x7fcacc0b0c90 2021-01-03T13:53:48.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad2ecc700 1 -- 172.21.15.133:0/121405250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcacc1565b0 con 0x7fcacc0b0c90 2021-01-03T13:53:48.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcabeffd700 1 -- 172.21.15.133:0/121405250 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac0005880 con 0x7fcacc0b0c90 2021-01-03T13:53:48.397 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.384+0000 7fcad2ecc700 1 -- 172.21.15.133:0/121405250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcacc156d70 con 0x7fcacc0b0c90 2021-01-03T13:53:48.398 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.388+0000 7fcad2ecc700 1 -- 172.21.15.133:0/121405250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcacc057300 con 0x7fcacc0b0c90 2021-01-03T13:53:48.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.388+0000 7fcabeffd700 1 -- 172.21.15.133:0/121405250 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fcac0010070 con 0x7fcacc0b0c90 2021-01-03T13:53:48.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.388+0000 7fcabeffd700 1 --2- 172.21.15.133:0/121405250 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaac055330 0x7fcaac0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.388+0000 7fcabeffd700 1 -- 172.21.15.133:0/121405250 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fcac006d2c0 con 0x7fcacc0b0c90 2021-01-03T13:53:48.399 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.388+0000 7fcad16c9700 1 --2- 172.21.15.133:0/121405250 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaac055330 0x7fcaac0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.388+0000 7fcad16c9700 1 --2- 172.21.15.133:0/121405250 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaac055330 0x7fcaac0577f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7fcac801c000 tx=0x7fcac8015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:48.400 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.396+0000 7fcabeffd700 1 -- 172.21.15.133:0/121405250 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcac0043800 con 0x7fcacc0b0c90 2021-01-03T13:53:48.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.536+0000 7fcad2ecc700 1 -- 172.21.15.133:0/121405250 --> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcacc156740 con 0x7fcaac055330 2021-01-03T13:53:48.539 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.536+0000 7fcabeffd700 1 -- 172.21.15.133:0/121405250 <== mgr.4110 v2:172.21.15.133:6800/11943 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcacc156740 con 0x7fcaac055330 2021-01-03T13:53:48.541 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.540+0000 7fcad2ecc700 1 -- 172.21.15.133:0/121405250 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaac055330 msgr2=0x7fcaac0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.540+0000 7fcad2ecc700 1 --2- 172.21.15.133:0/121405250 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaac055330 0x7fcaac0577f0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7fcac801c000 tx=0x7fcac8015000).stop 2021-01-03T13:53:48.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.540+0000 7fcad2ecc700 1 -- 172.21.15.133:0/121405250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcacc0b0c90 msgr2=0x7fcacc063880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.540+0000 7fcad2ecc700 1 --2- 172.21.15.133:0/121405250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcacc0b0c90 0x7fcacc063880 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7fcacc061fd0 tx=0x7fcac0007bd0).stop 2021-01-03T13:53:48.542 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.540+0000 7fcad2ecc700 1 -- 172.21.15.133:0/121405250 shutdown_connections 2021-01-03T13:53:48.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.540+0000 7fcad2ecc700 1 --2- 172.21.15.133:0/121405250 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcaac055330 0x7fcaac0577f0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.540+0000 7fcad2ecc700 1 --2- 172.21.15.133:0/121405250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcacc0b5c00 0x7fcacc1598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.540+0000 7fcad2ecc700 1 --2- 172.21.15.133:0/121405250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcacc0b0c90 0x7fcacc063880 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.543 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.540+0000 7fcad2ecc700 1 --2- 172.21.15.133:0/121405250 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcacc0b52c0 0x7fcacc1593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.540+0000 7fcad2ecc700 1 -- 172.21.15.133:0/121405250 >> 172.21.15.133:0/121405250 conn(0x7fcacc05bdf0 msgr2=0x7fcacc098e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:48.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.540+0000 7fcad2ecc700 1 -- 172.21.15.133:0/121405250 shutdown_connections 2021-01-03T13:53:48.544 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.540+0000 7fcad2ecc700 1 -- 172.21.15.133:0/121405250 wait complete. 2021-01-03T13:53:48.545 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 1 to deep-scrub 2021-01-03T13:53:48.553 INFO:tasks.ceph:Scrubbing osd.2 2021-01-03T13:53:48.553 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 config set osd_debug_deep_scrub_sleep 0 2021-01-03T13:53:48.675 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.672+0000 7f1176388700 1 Processor -- start 2021-01-03T13:53:48.676 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.672+0000 7f1176388700 1 -- start start 2021-01-03T13:53:48.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.672+0000 7f1176388700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f11700b4c20 0x7f117005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.672+0000 7f1176388700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1170060510 0x7f11700b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.677 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.672+0000 7f1176388700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11700b6cf0 con 0x7f117005fd10 2021-01-03T13:53:48.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.672+0000 7f1176388700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117005bf00 con 0x7f1170060510 2021-01-03T13:53:48.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.672+0000 7f1176388700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117005c1a0 con 0x7f11700b4c20 2021-01-03T13:53:48.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1175b87700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f117005fd10 0x7f11700b65e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34112/0 (socket says 172.21.15.133:34112) 2021-01-03T13:53:48.678 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1175b87700 1 -- 172.21.15.133:0/3405767535 learned_addr learned my addr 172.21.15.133:0/3405767535 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:53:48.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1174b85700 1 --2- 172.21.15.133:0/3405767535 >> v2:172.21.15.16:3300/0 conn(0x7f1170060510 0x7f11700b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.679 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1175386700 1 --2- 172.21.15.133:0/3405767535 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f11700b4c20 0x7f117005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.680 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1167fff700 1 -- 172.21.15.133:0/3405767535 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2724806753 0 0) 0x7f11700b6cf0 con 0x7f117005fd10 2021-01-03T13:53:48.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1167fff700 1 -- 172.21.15.133:0/3405767535 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1154003230 con 0x7f117005fd10 2021-01-03T13:53:48.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1174b85700 1 -- 172.21.15.133:0/3405767535 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f11700b4c20 msgr2=0x7f117005c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:48.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1174b85700 1 --2- 172.21.15.133:0/3405767535 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f11700b4c20 0x7f117005c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.681 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1174b85700 1 -- 172.21.15.133:0/3405767535 >> v1:172.21.15.133:6789/0 conn(0x7f117005fd10 legacy=0x7f11700b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1167fff700 1 -- 172.21.15.133:0/3405767535 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1436366165 0 0) 0x7f1154003230 con 0x7f117005fd10 2021-01-03T13:53:48.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1174b85700 1 -- 172.21.15.133:0/3405767535 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117005c440 con 0x7f1170060510 2021-01-03T13:53:48.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1174b85700 1 --2- 172.21.15.133:0/3405767535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1170060510 0x7f11700b5000 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f1168001bf0 tx=0x7f1160006dc0).ready entity=mon.0 client_cookie=81200f2d3b0aba00 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:48.682 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1167fff700 1 -- 172.21.15.133:0/3405767535 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1168001a50 con 0x7f1170060510 2021-01-03T13:53:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1167fff700 1 -- 172.21.15.133:0/3405767535 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116000d570 con 0x7f1170060510 2021-01-03T13:53:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1167fff700 1 -- 172.21.15.133:0/3405767535 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f116000d6e0 con 0x7f1170060510 2021-01-03T13:53:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1176388700 1 -- 172.21.15.133:0/3405767535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1170060510 msgr2=0x7f11700b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.683 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1176388700 1 --2- 172.21.15.133:0/3405767535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1170060510 0x7f11700b5000 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f1168001bf0 tx=0x7f1160006dc0).stop 2021-01-03T13:53:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1176388700 1 -- 172.21.15.133:0/3405767535 shutdown_connections 2021-01-03T13:53:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1176388700 1 --2- 172.21.15.133:0/3405767535 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f11700b4c20 0x7f117005c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1176388700 1 --2- 172.21.15.133:0/3405767535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1170060510 0x7f11700b5000 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1176388700 1 -- 172.21.15.133:0/3405767535 >> 172.21.15.133:0/3405767535 conn(0x7f11700b9f00 msgr2=0x7f11700b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:48.684 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1176388700 1 -- 172.21.15.133:0/3405767535 shutdown_connections 2021-01-03T13:53:48.685 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.676+0000 7f1176388700 1 -- 172.21.15.133:0/3405767535 wait complete. 2021-01-03T13:53:48.687 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1176388700 1 Processor -- start 2021-01-03T13:53:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1176388700 1 -- start start 2021-01-03T13:53:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1176388700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f117005fd10 0x7f11701440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1176388700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1170060510 0x7f1170146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.688 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1176388700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11700b4c20 0x7f1170154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1176388700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117009dea0 con 0x7f11700b4c20 2021-01-03T13:53:48.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1176388700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117009e0d0 con 0x7f117005fd10 2021-01-03T13:53:48.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1176388700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1170152520 con 0x7f1170060510 2021-01-03T13:53:48.689 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1175386700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f117005fd10 0x7f11701440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1175386700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f117005fd10 0x7f11701440e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41314/0 (socket says 172.21.15.133:41314) 2021-01-03T13:53:48.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1175386700 1 -- 172.21.15.133:0/3495814441 learned_addr learned my addr 172.21.15.133:0/3495814441 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:48.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1174b85700 1 --2- 172.21.15.133:0/3495814441 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1170060510 0x7f1170146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1175b87700 1 --2- 172.21.15.133:0/3495814441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11700b4c20 0x7f1170154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.690 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1175386700 1 -- 172.21.15.133:0/3495814441 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1170060510 msgr2=0x7f1170146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1175386700 1 --2- 172.21.15.133:0/3495814441 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f1170060510 0x7f1170146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1175386700 1 -- 172.21.15.133:0/3495814441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11700b4c20 msgr2=0x7f1170154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1175386700 1 --2- 172.21.15.133:0/3495814441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11700b4c20 0x7f1170154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.691 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1175386700 1 -- 172.21.15.133:0/3495814441 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11701527c0 con 0x7f117005fd10 2021-01-03T13:53:48.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1175b87700 1 --2- 172.21.15.133:0/3495814441 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f11700b4c20 0x7f1170154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:53:48.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1175386700 1 --2- 172.21.15.133:0/3495814441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f117005fd10 0x7f11701440e0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f116c00c000 tx=0x7f116c006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:48.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f11667fc700 1 -- 172.21.15.133:0/3495814441 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f116c00ca10 con 0x7f117005fd10 2021-01-03T13:53:48.692 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f11667fc700 1 -- 172.21.15.133:0/3495814441 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c00cb70 con 0x7f117005fd10 2021-01-03T13:53:48.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1176388700 1 -- 172.21.15.133:0/3495814441 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11701445d0 con 0x7f117005fd10 2021-01-03T13:53:48.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f11667fc700 1 -- 172.21.15.133:0/3495814441 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f116c0123f0 con 0x7f117005fd10 2021-01-03T13:53:48.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.680+0000 7f1176388700 1 -- 172.21.15.133:0/3495814441 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1170146a00 con 0x7f117005fd10 2021-01-03T13:53:48.693 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.684+0000 7f1176388700 1 -- 172.21.15.133:0/3495814441 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1170152390 con 0x7f117005fd10 2021-01-03T13:53:48.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.684+0000 7f11667fc700 1 -- 172.21.15.133:0/3495814441 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f116c012550 con 0x7f117005fd10 2021-01-03T13:53:48.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.684+0000 7f11667fc700 1 --2- 172.21.15.133:0/3495814441 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f11580553f0 0x7f11580578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.684+0000 7f11667fc700 1 -- 172.21.15.133:0/3495814441 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f116c06df90 con 0x7f117005fd10 2021-01-03T13:53:48.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.684+0000 7f1174b85700 1 --2- 172.21.15.133:0/3495814441 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f11580553f0 0x7f11580578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.694 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.684+0000 7f11667fc700 1 --2- 172.21.15.133:0/3495814441 >> [v2:172.21.15.133:6802/12122,v1:172.21.15.133:6803/12122] conn(0x7f115805bb00 0x7f115805df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.684+0000 7f11667fc700 1 -- 172.21.15.133:0/3495814441 --> [v2:172.21.15.133:6802/12122,v1:172.21.15.133:6803/12122] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f115805e5a0 con 0x7f115805bb00 2021-01-03T13:53:48.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.684+0000 7f11667fc700 1 -- 172.21.15.133:0/3495814441 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=165) v2 ==== 24+0+0 (secure 0 0 0) 0x7f116c070620 con 0x7f117005fd10 2021-01-03T13:53:48.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.684+0000 7f1175b87700 1 --2- 172.21.15.133:0/3495814441 >> [v2:172.21.15.133:6802/12122,v1:172.21.15.133:6803/12122] conn(0x7f115805bb00 0x7f115805df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.695 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.684+0000 7f1174b85700 1 --2- 172.21.15.133:0/3495814441 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f11580553f0 0x7f11580578b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f116001a000 tx=0x7f1160015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:48.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.684+0000 7f1175b87700 1 --2- 172.21.15.133:0/3495814441 >> [v2:172.21.15.133:6802/12122,v1:172.21.15.133:6803/12122] conn(0x7f115805bb00 0x7f115805df20 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:48.696 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.688+0000 7f11667fc700 1 -- 172.21.15.133:0/3495814441 <== osd.2 v2:172.21.15.133:6802/12122 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7f115805e5a0 con 0x7f115805bb00 2021-01-03T13:53:48.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.708+0000 7f1176388700 1 -- 172.21.15.133:0/3495814441 --> [v2:172.21.15.133:6802/12122,v1:172.21.15.133:6803/12122] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1170144cb0 con 0x7f115805bb00 2021-01-03T13:53:48.712 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.708+0000 7f11667fc700 1 -- 172.21.15.133:0/3495814441 <== osd.2 v2:172.21.15.133:6802/12122 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1170144cb0 con 0x7f115805bb00 2021-01-03T13:53:48.713 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:53:48.713 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-01-03T13:53:48.713 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:53:48.714 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.712+0000 7f1176388700 1 -- 172.21.15.133:0/3495814441 >> [v2:172.21.15.133:6802/12122,v1:172.21.15.133:6803/12122] conn(0x7f115805bb00 msgr2=0x7f115805df20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.712+0000 7f1176388700 1 --2- 172.21.15.133:0/3495814441 >> [v2:172.21.15.133:6802/12122,v1:172.21.15.133:6803/12122] conn(0x7f115805bb00 0x7f115805df20 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.712+0000 7f1176388700 1 -- 172.21.15.133:0/3495814441 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f11580553f0 msgr2=0x7f11580578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.712+0000 7f1176388700 1 --2- 172.21.15.133:0/3495814441 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f11580553f0 0x7f11580578b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f116001a000 tx=0x7f1160015000).stop 2021-01-03T13:53:48.715 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.712+0000 7f1176388700 1 -- 172.21.15.133:0/3495814441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f117005fd10 msgr2=0x7f11701440e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.712+0000 7f1176388700 1 --2- 172.21.15.133:0/3495814441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f117005fd10 0x7f11701440e0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f116c00c000 tx=0x7f116c006dc0).stop 2021-01-03T13:53:48.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.712+0000 7f1175b87700 1 -- 172.21.15.133:0/3495814441 reap_dead start 2021-01-03T13:53:48.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.712+0000 7f1176388700 1 -- 172.21.15.133:0/3495814441 shutdown_connections 2021-01-03T13:53:48.716 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.712+0000 7f1176388700 1 -- 172.21.15.133:0/3495814441 >> 172.21.15.133:0/3495814441 conn(0x7f11700b9f00 msgr2=0x7f11700b80f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:48.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.712+0000 7f1176388700 1 -- 172.21.15.133:0/3495814441 shutdown_connections 2021-01-03T13:53:48.717 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.712+0000 7f1176388700 1 -- 172.21.15.133:0/3495814441 wait complete. 2021-01-03T13:53:48.725 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 2 2021-01-03T13:53:48.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e30d9700 1 Processor -- start 2021-01-03T13:53:48.842 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e30d9700 1 -- start start 2021-01-03T13:53:48.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e30d9700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb7dc05c130 0x7fb7dc0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e30d9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb7dc0b02b0 0x7fb7dc0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.843 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e30d9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc05c510 con 0x7fb7dc0622f0 2021-01-03T13:53:48.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e30d9700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7dc1473d0 con 0x7fb7dc05c130 2021-01-03T13:53:48.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e30d9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7dc0b0ab0 con 0x7fb7dc0b02b0 2021-01-03T13:53:48.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e18d6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb7dc0b02b0 0x7fb7dc0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.844 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e18d6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb7dc0b02b0 0x7fb7dc0b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41326/0 (socket says 172.21.15.133:41326) 2021-01-03T13:53:48.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e28d8700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb7dc0622f0 0x7fb7dc0668a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34128/0 (socket says 172.21.15.133:34128) 2021-01-03T13:53:48.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e18d6700 1 -- 172.21.15.133:0/2742642486 learned_addr learned my addr 172.21.15.133:0/2742642486 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:48.845 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e20d7700 1 --2- 172.21.15.133:0/2742642486 >> v2:172.21.15.16:3300/0 conn(0x7fb7dc05c130 0x7fb7dc0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e18d6700 1 -- 172.21.15.133:0/2742642486 >> v2:172.21.15.16:3300/0 conn(0x7fb7dc05c130 msgr2=0x7fb7dc0b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:48.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e18d6700 1 --2- 172.21.15.133:0/2742642486 >> v2:172.21.15.16:3300/0 conn(0x7fb7dc05c130 0x7fb7dc0b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.848 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e18d6700 1 -- 172.21.15.133:0/2742642486 >> v1:172.21.15.133:6789/0 conn(0x7fb7dc0622f0 legacy=0x7fb7dc0668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e18d6700 1 -- 172.21.15.133:0/2742642486 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc0b15a0 con 0x7fb7dc0b02b0 2021-01-03T13:53:48.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e20d7700 1 --2- 172.21.15.133:0/2742642486 >> v2:172.21.15.16:3300/0 conn(0x7fb7dc05c130 0x7fb7dc0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:53:48.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e18d6700 1 --2- 172.21.15.133:0/2742642486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc0b02b0 0x7fb7dc0b1ef0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7fb7d8002f30 tx=0x7fb7d8006e80).ready entity=mon.1 client_cookie=a30866eb6d1ab559 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:48.849 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e10d5700 1 -- 172.21.15.133:0/2742642486 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7d80097f0 con 0x7fb7dc0b02b0 2021-01-03T13:53:48.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e10d5700 1 -- 172.21.15.133:0/2742642486 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d8009950 con 0x7fb7dc0b02b0 2021-01-03T13:53:48.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e10d5700 1 -- 172.21.15.133:0/2742642486 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7d8009cb0 con 0x7fb7dc0b02b0 2021-01-03T13:53:48.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e30d9700 1 -- 172.21.15.133:0/2742642486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc0b02b0 msgr2=0x7fb7dc0b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.850 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e30d9700 1 --2- 172.21.15.133:0/2742642486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc0b02b0 0x7fb7dc0b1ef0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7fb7d8002f30 tx=0x7fb7d8006e80).stop 2021-01-03T13:53:48.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e30d9700 1 -- 172.21.15.133:0/2742642486 shutdown_connections 2021-01-03T13:53:48.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e30d9700 1 --2- 172.21.15.133:0/2742642486 >> v2:172.21.15.16:3300/0 conn(0x7fb7dc05c130 0x7fb7dc0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e30d9700 1 --2- 172.21.15.133:0/2742642486 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc0b02b0 0x7fb7dc0b1ef0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e30d9700 1 -- 172.21.15.133:0/2742642486 >> 172.21.15.133:0/2742642486 conn(0x7fb7dc0b6110 msgr2=0x7fb7dc0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:48.851 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e30d9700 1 -- 172.21.15.133:0/2742642486 shutdown_connections 2021-01-03T13:53:48.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.840+0000 7fb7e30d9700 1 -- 172.21.15.133:0/2742642486 wait complete. 2021-01-03T13:53:48.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e30d9700 1 Processor -- start 2021-01-03T13:53:48.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e30d9700 1 -- start start 2021-01-03T13:53:48.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e30d9700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7dc05c130 0x7fb7dc1451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.852 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e30d9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc0622f0 0x7fb7dc064f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e30d9700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb7dc0b02b0 0x7fb7dc065df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e30d9700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc152610 con 0x7fb7dc05c130 2021-01-03T13:53:48.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e30d9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc145690 con 0x7fb7dc0622f0 2021-01-03T13:53:48.853 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e30d9700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc152840 con 0x7fb7dc0b02b0 2021-01-03T13:53:48.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e18d6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc0622f0 0x7fb7dc064f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e18d6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc0622f0 0x7fb7dc064f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41332/0 (socket says 172.21.15.133:41332) 2021-01-03T13:53:48.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e18d6700 1 -- 172.21.15.133:0/3139073269 learned_addr learned my addr 172.21.15.133:0/3139073269 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:48.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e28d8700 1 --2- 172.21.15.133:0/3139073269 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb7dc0b02b0 0x7fb7dc065df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.854 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e20d7700 1 --2- 172.21.15.133:0/3139073269 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7dc05c130 0x7fb7dc1451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e18d6700 1 -- 172.21.15.133:0/3139073269 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb7dc0b02b0 msgr2=0x7fb7dc065df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e18d6700 1 --2- 172.21.15.133:0/3139073269 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb7dc0b02b0 0x7fb7dc065df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e18d6700 1 -- 172.21.15.133:0/3139073269 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7dc05c130 msgr2=0x7fb7dc1451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.855 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e18d6700 1 --2- 172.21.15.133:0/3139073269 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7dc05c130 0x7fb7dc1451a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e18d6700 1 -- 172.21.15.133:0/3139073269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc065460 con 0x7fb7dc0622f0 2021-01-03T13:53:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e18d6700 1 --2- 172.21.15.133:0/3139073269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc0622f0 0x7fb7dc064f70 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7fb7d8002f30 tx=0x7fb7d8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7cb7fe700 1 -- 172.21.15.133:0/3139073269 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7d8011e30 con 0x7fb7dc0622f0 2021-01-03T13:53:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e30d9700 1 -- 172.21.15.133:0/3139073269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7dc066630 con 0x7fb7dc0622f0 2021-01-03T13:53:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7cb7fe700 1 -- 172.21.15.133:0/3139073269 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d8009c50 con 0x7fb7dc0622f0 2021-01-03T13:53:48.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7cb7fe700 1 -- 172.21.15.133:0/3139073269 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7d801e650 con 0x7fb7dc0622f0 2021-01-03T13:53:48.857 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.844+0000 7fb7e30d9700 1 -- 172.21.15.133:0/3139073269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7dc0642e0 con 0x7fb7dc0622f0 2021-01-03T13:53:48.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.848+0000 7fb7e30d9700 1 -- 172.21.15.133:0/3139073269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7dc066480 con 0x7fb7dc0622f0 2021-01-03T13:53:48.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.848+0000 7fb7cb7fe700 1 -- 172.21.15.133:0/3139073269 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fb7d801a040 con 0x7fb7dc0622f0 2021-01-03T13:53:48.858 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.848+0000 7fb7cb7fe700 1 --2- 172.21.15.133:0/3139073269 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb7bc055440 0x7fb7bc057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:48.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.848+0000 7fb7cb7fe700 1 -- 172.21.15.133:0/3139073269 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fb7d806ee70 con 0x7fb7dc0622f0 2021-01-03T13:53:48.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.848+0000 7fb7e20d7700 1 --2- 172.21.15.133:0/3139073269 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb7bc055440 0x7fb7bc057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:48.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.848+0000 7fb7e20d7700 1 --2- 172.21.15.133:0/3139073269 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb7bc055440 0x7fb7bc057900 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fb7cc00c000 tx=0x7fb7cc008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:48.859 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.852+0000 7fb7cb7fe700 1 -- 172.21.15.133:0/3139073269 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb7d80452c0 con 0x7fb7dc0622f0 2021-01-03T13:53:48.995 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.992+0000 7fb7e30d9700 1 -- 172.21.15.133:0/3139073269 --> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7dc152a00 con 0x7fb7bc055440 2021-01-03T13:53:48.996 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.992+0000 7fb7cb7fe700 1 -- 172.21.15.133:0/3139073269 <== mgr.4110 v2:172.21.15.133:6800/11943 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb7dc152a00 con 0x7fb7bc055440 2021-01-03T13:53:48.998 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.996+0000 7fb7e30d9700 1 -- 172.21.15.133:0/3139073269 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb7bc055440 msgr2=0x7fb7bc057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.996+0000 7fb7e30d9700 1 --2- 172.21.15.133:0/3139073269 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb7bc055440 0x7fb7bc057900 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fb7cc00c000 tx=0x7fb7cc008040).stop 2021-01-03T13:53:48.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.996+0000 7fb7e30d9700 1 -- 172.21.15.133:0/3139073269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc0622f0 msgr2=0x7fb7dc064f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:48.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.996+0000 7fb7e30d9700 1 --2- 172.21.15.133:0/3139073269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc0622f0 0x7fb7dc064f70 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7fb7d8002f30 tx=0x7fb7d8015000).stop 2021-01-03T13:53:48.999 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.996+0000 7fb7e30d9700 1 -- 172.21.15.133:0/3139073269 shutdown_connections 2021-01-03T13:53:49.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.996+0000 7fb7e30d9700 1 --2- 172.21.15.133:0/3139073269 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fb7bc055440 0x7fb7bc057900 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.996+0000 7fb7e30d9700 1 --2- 172.21.15.133:0/3139073269 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb7dc05c130 0x7fb7dc1451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.996+0000 7fb7e30d9700 1 --2- 172.21.15.133:0/3139073269 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fb7dc0b02b0 0x7fb7dc065df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.000 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.996+0000 7fb7e30d9700 1 --2- 172.21.15.133:0/3139073269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb7dc0622f0 0x7fb7dc064f70 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.996+0000 7fb7e30d9700 1 -- 172.21.15.133:0/3139073269 >> 172.21.15.133:0/3139073269 conn(0x7fb7dc0b6110 msgr2=0x7fb7dc0b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:49.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.996+0000 7fb7e30d9700 1 -- 172.21.15.133:0/3139073269 shutdown_connections 2021-01-03T13:53:49.001 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:48.996+0000 7fb7e30d9700 1 -- 172.21.15.133:0/3139073269 wait complete. 2021-01-03T13:53:49.002 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 2 to deep-scrub 2021-01-03T13:53:49.010 INFO:tasks.ceph:Scrubbing osd.3 2021-01-03T13:53:49.010 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 config set osd_debug_deep_scrub_sleep 0 2021-01-03T13:53:49.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.124+0000 7fc01073b700 1 Processor -- start 2021-01-03T13:53:49.128 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.124+0000 7fc01073b700 1 -- start start 2021-01-03T13:53:49.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc01073b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc0080b6d50 0x7fc0080af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.130 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc01073b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc0080afbe0 0x7fc00805fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc01073b700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0080b0e60 con 0x7fc0080b18e0 2021-01-03T13:53:49.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc01073b700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0080b7130 con 0x7fc0080b6d50 2021-01-03T13:53:49.131 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc01073b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0080b0260 con 0x7fc0080afbe0 2021-01-03T13:53:49.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc00ecd8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc0080afbe0 0x7fc00805fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc00ecd8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc0080afbe0 0x7fc00805fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41342/0 (socket says 172.21.15.133:41342) 2021-01-03T13:53:49.132 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc00ecd8700 1 -- 172.21.15.133:0/1593072503 learned_addr learned my addr 172.21.15.133:0/1593072503 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:49.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc00e4d7700 1 --2- 172.21.15.133:0/1593072503 >> v2:172.21.15.16:3300/0 conn(0x7fc0080b6d50 0x7fc0080af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc00ecd8700 1 -- 172.21.15.133:0/1593072503 >> v2:172.21.15.16:3300/0 conn(0x7fc0080b6d50 msgr2=0x7fc0080af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:49.133 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc00ecd8700 1 --2- 172.21.15.133:0/1593072503 >> v2:172.21.15.16:3300/0 conn(0x7fc0080b6d50 0x7fc0080af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc00ecd8700 1 -- 172.21.15.133:0/1593072503 >> v1:172.21.15.16:6789/0 conn(0x7fc0080b18e0 legacy=0x7fc00805f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc00ecd8700 1 -- 172.21.15.133:0/1593072503 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0080b0050 con 0x7fc0080afbe0 2021-01-03T13:53:49.134 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc00ecd8700 1 --2- 172.21.15.133:0/1593072503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0080afbe0 0x7fc00805fcf0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7fc0000032b0 tx=0x7fc000009270).ready entity=mon.1 client_cookie=51a408a409d7c5bf server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:49.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc00d4d5700 1 -- 172.21.15.133:0/1593072503 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc000009e60 con 0x7fc0080afbe0 2021-01-03T13:53:49.138 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc00d4d5700 1 -- 172.21.15.133:0/1593072503 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00000bc00 con 0x7fc0080afbe0 2021-01-03T13:53:49.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc00d4d5700 1 -- 172.21.15.133:0/1593072503 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc00000bd70 con 0x7fc0080afbe0 2021-01-03T13:53:49.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc01073b700 1 -- 172.21.15.133:0/1593072503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0080afbe0 msgr2=0x7fc00805fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.139 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc01073b700 1 --2- 172.21.15.133:0/1593072503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0080afbe0 0x7fc00805fcf0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7fc0000032b0 tx=0x7fc000009270).stop 2021-01-03T13:53:49.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc01073b700 1 -- 172.21.15.133:0/1593072503 shutdown_connections 2021-01-03T13:53:49.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc01073b700 1 --2- 172.21.15.133:0/1593072503 >> v2:172.21.15.16:3300/0 conn(0x7fc0080b6d50 0x7fc0080af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.140 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc01073b700 1 --2- 172.21.15.133:0/1593072503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0080afbe0 0x7fc00805fcf0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc01073b700 1 -- 172.21.15.133:0/1593072503 >> 172.21.15.133:0/1593072503 conn(0x7fc0080622f0 msgr2=0x7fc0080b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:49.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc01073b700 1 -- 172.21.15.133:0/1593072503 shutdown_connections 2021-01-03T13:53:49.141 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.128+0000 7fc01073b700 1 -- 172.21.15.133:0/1593072503 wait complete. 2021-01-03T13:53:49.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc01073b700 1 Processor -- start 2021-01-03T13:53:49.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc01073b700 1 -- start start 2021-01-03T13:53:49.142 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc01073b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0080afbe0 0x7fc0080b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc01073b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0080b18e0 0x7fc00813f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc01073b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0080b6d50 0x7fc008141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.143 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc01073b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00813dc00 con 0x7fc0080b6d50 2021-01-03T13:53:49.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc01073b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc008141440 con 0x7fc0080afbe0 2021-01-03T13:53:49.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc01073b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0081350e0 con 0x7fc0080b18e0 2021-01-03T13:53:49.144 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc00e4d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0080afbe0 0x7fc0080b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc00e4d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0080afbe0 0x7fc0080b5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41344/0 (socket says 172.21.15.133:41344) 2021-01-03T13:53:49.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc00e4d7700 1 -- 172.21.15.133:0/1379859338 learned_addr learned my addr 172.21.15.133:0/1379859338 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:49.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc00ecd8700 1 --2- 172.21.15.133:0/1379859338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0080b6d50 0x7fc008141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.145 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc00dcd6700 1 --2- 172.21.15.133:0/1379859338 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0080b18e0 0x7fc00813f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc00e4d7700 1 -- 172.21.15.133:0/1379859338 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0080b18e0 msgr2=0x7fc00813f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.146 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc00e4d7700 1 --2- 172.21.15.133:0/1379859338 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc0080b18e0 0x7fc00813f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc00e4d7700 1 -- 172.21.15.133:0/1379859338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0080b6d50 msgr2=0x7fc008141ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc00e4d7700 1 --2- 172.21.15.133:0/1379859338 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0080b6d50 0x7fc008141ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.147 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc00e4d7700 1 -- 172.21.15.133:0/1379859338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc008134460 con 0x7fc0080afbe0 2021-01-03T13:53:49.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc00e4d7700 1 --2- 172.21.15.133:0/1379859338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0080afbe0 0x7fc0080b5b70 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7fc00400c000 tx=0x7fc004006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:49.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fbffb7fe700 1 -- 172.21.15.133:0/1379859338 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc00400ca10 con 0x7fc0080afbe0 2021-01-03T13:53:49.148 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fbffb7fe700 1 -- 172.21.15.133:0/1379859338 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00400cb70 con 0x7fc0080afbe0 2021-01-03T13:53:49.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc01073b700 1 -- 172.21.15.133:0/1379859338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc008134700 con 0x7fc0080afbe0 2021-01-03T13:53:49.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fbffb7fe700 1 -- 172.21.15.133:0/1379859338 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc00400b2d0 con 0x7fc0080afbe0 2021-01-03T13:53:49.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.132+0000 7fc01073b700 1 -- 172.21.15.133:0/1379859338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc008134150 con 0x7fc0080afbe0 2021-01-03T13:53:49.149 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.136+0000 7fc01073b700 1 -- 172.21.15.133:0/1379859338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc008141830 con 0x7fc0080afbe0 2021-01-03T13:53:49.151 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.136+0000 7fbffb7fe700 1 -- 172.21.15.133:0/1379859338 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc00401b400 con 0x7fc0080afbe0 2021-01-03T13:53:49.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.136+0000 7fbffb7fe700 1 --2- 172.21.15.133:0/1379859338 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfe8055440 0x7fbfe8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.136+0000 7fbffb7fe700 1 -- 172.21.15.133:0/1379859338 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fc00406dc90 con 0x7fc0080afbe0 2021-01-03T13:53:49.152 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.136+0000 7fc00dcd6700 1 --2- 172.21.15.133:0/1379859338 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfe8055440 0x7fbfe8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.136+0000 7fbffb7fe700 1 --2- 172.21.15.133:0/1379859338 >> [v2:172.21.15.133:6826/12136,v1:172.21.15.133:6827/12136] conn(0x7fbfe805bb50 0x7fbfe805df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.136+0000 7fbffb7fe700 1 -- 172.21.15.133:0/1379859338 --> [v2:172.21.15.133:6826/12136,v1:172.21.15.133:6827/12136] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbfe805e550 con 0x7fbfe805bb50 2021-01-03T13:53:49.153 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.136+0000 7fbffb7fe700 1 -- 172.21.15.133:0/1379859338 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=165) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0040702c0 con 0x7fc0080afbe0 2021-01-03T13:53:49.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.136+0000 7fc00ecd8700 1 --2- 172.21.15.133:0/1379859338 >> [v2:172.21.15.133:6826/12136,v1:172.21.15.133:6827/12136] conn(0x7fbfe805bb50 0x7fbfe805df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.136+0000 7fc00dcd6700 1 --2- 172.21.15.133:0/1379859338 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfe8055440 0x7fbfe8057900 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7fbffc00d000 tx=0x7fbffc000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:49.154 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.136+0000 7fc00ecd8700 1 --2- 172.21.15.133:0/1379859338 >> [v2:172.21.15.133:6826/12136,v1:172.21.15.133:6827/12136] conn(0x7fbfe805bb50 0x7fbfe805df70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:49.155 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.140+0000 7fbffb7fe700 1 -- 172.21.15.133:0/1379859338 <== osd.3 v2:172.21.15.133:6826/12136 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7fbfe805e550 con 0x7fbfe805bb50 2021-01-03T13:53:49.160 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.156+0000 7fc01073b700 1 -- 172.21.15.133:0/1379859338 --> [v2:172.21.15.133:6826/12136,v1:172.21.15.133:6827/12136] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc00805c110 con 0x7fbfe805bb50 2021-01-03T13:53:49.161 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.160+0000 7fbffb7fe700 1 -- 172.21.15.133:0/1379859338 <== osd.3 v2:172.21.15.133:6826/12136 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc00805c110 con 0x7fbfe805bb50 2021-01-03T13:53:49.161 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:53:49.162 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-01-03T13:53:49.162 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:53:49.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.160+0000 7fc01073b700 1 -- 172.21.15.133:0/1379859338 >> [v2:172.21.15.133:6826/12136,v1:172.21.15.133:6827/12136] conn(0x7fbfe805bb50 msgr2=0x7fbfe805df70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.160+0000 7fc01073b700 1 --2- 172.21.15.133:0/1379859338 >> [v2:172.21.15.133:6826/12136,v1:172.21.15.133:6827/12136] conn(0x7fbfe805bb50 0x7fbfe805df70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.164 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.160+0000 7fc01073b700 1 -- 172.21.15.133:0/1379859338 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfe8055440 msgr2=0x7fbfe8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.160+0000 7fc01073b700 1 --2- 172.21.15.133:0/1379859338 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fbfe8055440 0x7fbfe8057900 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7fbffc00d000 tx=0x7fbffc000b80).stop 2021-01-03T13:53:49.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.160+0000 7fc01073b700 1 -- 172.21.15.133:0/1379859338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0080afbe0 msgr2=0x7fc0080b5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.165 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.160+0000 7fc01073b700 1 --2- 172.21.15.133:0/1379859338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0080afbe0 0x7fc0080b5b70 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7fc00400c000 tx=0x7fc004006dc0).stop 2021-01-03T13:53:49.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.160+0000 7fc00ecd8700 1 -- 172.21.15.133:0/1379859338 reap_dead start 2021-01-03T13:53:49.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.160+0000 7fc01073b700 1 -- 172.21.15.133:0/1379859338 shutdown_connections 2021-01-03T13:53:49.166 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.160+0000 7fc01073b700 1 -- 172.21.15.133:0/1379859338 >> 172.21.15.133:0/1379859338 conn(0x7fc0080622f0 msgr2=0x7fc00813ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:49.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.160+0000 7fc01073b700 1 -- 172.21.15.133:0/1379859338 shutdown_connections 2021-01-03T13:53:49.167 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.160+0000 7fc01073b700 1 -- 172.21.15.133:0/1379859338 wait complete. 2021-01-03T13:53:49.174 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 3 2021-01-03T13:53:49.288 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.284+0000 7f2e1810a700 1 Processor -- start 2021-01-03T13:53:49.289 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.284+0000 7f2e1810a700 1 -- start start 2021-01-03T13:53:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e1810a700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e1005c840 0x7f2e100b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e1810a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e1013c890 0x7f2e1013cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e1810a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e10140700 con 0x7f2e1013fb40 2021-01-03T13:53:49.291 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e1810a700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e100aa1f0 con 0x7f2e1005c840 2021-01-03T13:53:49.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e1810a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1005cc20 con 0x7f2e1013c890 2021-01-03T13:53:49.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e15ea6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e1005c840 0x7f2e100b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e15ea6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e1005c840 0x7f2e100b16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41354/0 (socket says 172.21.15.133:41354) 2021-01-03T13:53:49.292 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e15ea6700 1 -- 172.21.15.133:0/4190699899 learned_addr learned my addr 172.21.15.133:0/4190699899 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:49.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e156a5700 1 --1- 172.21.15.133:0/4190699899 >> v1:172.21.15.133:6789/0 conn(0x7f2e1013fb40 0x7f2e1013fff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34156/0 (socket says 172.21.15.133:34156) 2021-01-03T13:53:49.293 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e166a7700 1 --2- 172.21.15.133:0/4190699899 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e1013c890 0x7f2e1013cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.294 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e15ea6700 1 -- 172.21.15.133:0/4190699899 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e1013c890 msgr2=0x7f2e1013cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:49.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e15ea6700 1 --2- 172.21.15.133:0/4190699899 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e1013c890 0x7f2e1013cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e15ea6700 1 -- 172.21.15.133:0/4190699899 >> v1:172.21.15.133:6789/0 conn(0x7f2e1013fb40 legacy=0x7f2e1013fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e15ea6700 1 -- 172.21.15.133:0/4190699899 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e10143df0 con 0x7f2e1005c840 2021-01-03T13:53:49.295 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e14ea4700 1 -- 172.21.15.133:0/4190699899 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942441900 0 0) 0x7f2e000010d0 con 0x7f2e1013fb40 2021-01-03T13:53:49.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e15ea6700 1 --2- 172.21.15.133:0/4190699899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1005c840 0x7f2e100b16b0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f2e0c0032b0 tx=0x7f2e0c009270).ready entity=mon.1 client_cookie=e51d089015c9e6c6 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:49.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e14ea4700 1 -- 172.21.15.133:0/4190699899 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e0c009e60 con 0x7f2e1005c840 2021-01-03T13:53:49.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e14ea4700 1 -- 172.21.15.133:0/4190699899 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c00bc00 con 0x7f2e1005c840 2021-01-03T13:53:49.296 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e14ea4700 1 -- 172.21.15.133:0/4190699899 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e0c00bd70 con 0x7f2e1005c840 2021-01-03T13:53:49.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e1810a700 1 -- 172.21.15.133:0/4190699899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1005c840 msgr2=0x7f2e100b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e1810a700 1 --2- 172.21.15.133:0/4190699899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1005c840 0x7f2e100b16b0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f2e0c0032b0 tx=0x7f2e0c009270).stop 2021-01-03T13:53:49.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e1810a700 1 -- 172.21.15.133:0/4190699899 shutdown_connections 2021-01-03T13:53:49.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e1810a700 1 --2- 172.21.15.133:0/4190699899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1005c840 0x7f2e100b16b0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.297 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e1810a700 1 --2- 172.21.15.133:0/4190699899 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e1013c890 0x7f2e1013cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e1810a700 1 -- 172.21.15.133:0/4190699899 >> 172.21.15.133:0/4190699899 conn(0x7f2e1006aeb0 msgr2=0x7f2e1005bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:49.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e1810a700 1 -- 172.21.15.133:0/4190699899 shutdown_connections 2021-01-03T13:53:49.298 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.288+0000 7f2e1810a700 1 -- 172.21.15.133:0/4190699899 wait complete. 2021-01-03T13:53:49.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.292+0000 7f2e1810a700 1 Processor -- start 2021-01-03T13:53:49.300 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.292+0000 7f2e1810a700 1 -- start start 2021-01-03T13:53:49.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e1810a700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e1005c840 0x7f2e10140f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e1810a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1013c890 0x7f2e101420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e1810a700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e1013fb40 0x7f2e101380e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.301 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e1810a700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e10141430 con 0x7f2e1005c840 2021-01-03T13:53:49.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e1810a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e101425b0 con 0x7f2e1013c890 2021-01-03T13:53:49.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e1810a700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e10141610 con 0x7f2e1013fb40 2021-01-03T13:53:49.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e156a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1013c890 0x7f2e101420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.302 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e15ea6700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e1005c840 0x7f2e10140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e156a5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1013c890 0x7f2e101420c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41362/0 (socket says 172.21.15.133:41362) 2021-01-03T13:53:49.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e156a5700 1 -- 172.21.15.133:0/2972475826 learned_addr learned my addr 172.21.15.133:0/2972475826 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:49.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e166a7700 1 --2- 172.21.15.133:0/2972475826 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e1013fb40 0x7f2e101380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.303 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e15ea6700 1 -- 172.21.15.133:0/2972475826 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e1013fb40 msgr2=0x7f2e101380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e15ea6700 1 --2- 172.21.15.133:0/2972475826 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e1013fb40 0x7f2e101380e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e15ea6700 1 -- 172.21.15.133:0/2972475826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1013c890 msgr2=0x7f2e101420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e15ea6700 1 --2- 172.21.15.133:0/2972475826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1013c890 0x7f2e101420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.304 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e15ea6700 1 -- 172.21.15.133:0/2972475826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1014d8b0 con 0x7f2e1005c840 2021-01-03T13:53:49.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e166a7700 1 --2- 172.21.15.133:0/2972475826 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e1013fb40 0x7f2e101380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:53:49.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e156a5700 1 --2- 172.21.15.133:0/2972475826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1013c890 0x7f2e101420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:53:49.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e15ea6700 1 --2- 172.21.15.133:0/2972475826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e1005c840 0x7f2e10140f40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f2e0c0032b0 tx=0x7f2e0c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:49.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2dfeffd700 1 -- 172.21.15.133:0/2972475826 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e0c0107a0 con 0x7f2e1005c840 2021-01-03T13:53:49.305 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2dfeffd700 1 -- 172.21.15.133:0/2972475826 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c010900 con 0x7f2e1005c840 2021-01-03T13:53:49.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e1810a700 1 -- 172.21.15.133:0/2972475826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1014db50 con 0x7f2e1005c840 2021-01-03T13:53:49.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2dfeffd700 1 -- 172.21.15.133:0/2972475826 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e0c010c60 con 0x7f2e1005c840 2021-01-03T13:53:49.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e1810a700 1 -- 172.21.15.133:0/2972475826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e101385d0 con 0x7f2e1005c840 2021-01-03T13:53:49.306 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.296+0000 7f2e1810a700 1 -- 172.21.15.133:0/2972475826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e1014dff0 con 0x7f2e1005c840 2021-01-03T13:53:49.307 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.300+0000 7f2dfeffd700 1 -- 172.21.15.133:0/2972475826 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f2e0c00f070 con 0x7f2e1005c840 2021-01-03T13:53:49.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.300+0000 7f2dfeffd700 1 --2- 172.21.15.133:0/2972475826 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2df0055440 0x7f2df0057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.300+0000 7f2dfeffd700 1 -- 172.21.15.133:0/2972475826 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f2e0c06f540 con 0x7f2e1005c840 2021-01-03T13:53:49.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.300+0000 7f2e156a5700 1 --2- 172.21.15.133:0/2972475826 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2df0055440 0x7f2df0057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.308 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.300+0000 7f2e156a5700 1 --2- 172.21.15.133:0/2972475826 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2df0055440 0x7f2df0057900 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f2e0000f000 tx=0x7f2e00009e10).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:49.312 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.308+0000 7f2dfeffd700 1 -- 172.21.15.133:0/2972475826 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2e0c049440 con 0x7f2e1005c840 2021-01-03T13:53:49.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.448+0000 7f2e1810a700 1 -- 172.21.15.133:0/2972475826 --> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e10141ec0 con 0x7f2df0055440 2021-01-03T13:53:49.450 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.448+0000 7f2dfeffd700 1 -- 172.21.15.133:0/2972475826 <== mgr.4110 v2:172.21.15.133:6800/11943 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2e10141ec0 con 0x7f2df0055440 2021-01-03T13:53:49.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.448+0000 7f2e1810a700 1 -- 172.21.15.133:0/2972475826 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2df0055440 msgr2=0x7f2df0057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.452 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.448+0000 7f2e1810a700 1 --2- 172.21.15.133:0/2972475826 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2df0055440 0x7f2df0057900 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f2e0000f000 tx=0x7f2e00009e10).stop 2021-01-03T13:53:49.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.448+0000 7f2e1810a700 1 -- 172.21.15.133:0/2972475826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e1005c840 msgr2=0x7f2e10140f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.448+0000 7f2e1810a700 1 --2- 172.21.15.133:0/2972475826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e1005c840 0x7f2e10140f40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f2e0c0032b0 tx=0x7f2e0c016000).stop 2021-01-03T13:53:49.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.448+0000 7f2e1810a700 1 -- 172.21.15.133:0/2972475826 shutdown_connections 2021-01-03T13:53:49.453 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.448+0000 7f2e1810a700 1 --2- 172.21.15.133:0/2972475826 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f2df0055440 0x7f2df0057900 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.448+0000 7f2e1810a700 1 --2- 172.21.15.133:0/2972475826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2e1005c840 0x7f2e10140f40 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.448+0000 7f2e1810a700 1 --2- 172.21.15.133:0/2972475826 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f2e1013fb40 0x7f2e101380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.448+0000 7f2e1810a700 1 --2- 172.21.15.133:0/2972475826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1013c890 0x7f2e101420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.454 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.448+0000 7f2e1810a700 1 -- 172.21.15.133:0/2972475826 >> 172.21.15.133:0/2972475826 conn(0x7f2e1006aeb0 msgr2=0x7f2e1013db40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:49.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.448+0000 7f2e1810a700 1 -- 172.21.15.133:0/2972475826 shutdown_connections 2021-01-03T13:53:49.455 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.448+0000 7f2e1810a700 1 -- 172.21.15.133:0/2972475826 wait complete. 2021-01-03T13:53:49.455 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 3 to deep-scrub 2021-01-03T13:53:49.464 INFO:tasks.ceph:Scrubbing osd.4 2021-01-03T13:53:49.465 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 config set osd_debug_deep_scrub_sleep 0 2021-01-03T13:53:49.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.580+0000 7f6978f3b700 1 Processor -- start 2021-01-03T13:53:49.584 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.580+0000 7f6978f3b700 1 -- start start 2021-01-03T13:53:49.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f6978f3b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69740b5330 0x7f6974141630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.585 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f6978f3b700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69740b5710 con 0x7f6974144930 2021-01-03T13:53:49.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f6978f3b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6974140c50 con 0x7f69740b5ae0 2021-01-03T13:53:49.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f6978f3b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69740b16b0 con 0x7f69740b5330 2021-01-03T13:53:49.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f69737fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69740b5330 0x7f6974141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.586 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f6972ffd700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f69740b5ae0 0x7f69740aec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34168/0 (socket says 172.21.15.133:34168) 2021-01-03T13:53:49.587 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f6972ffd700 1 -- 172.21.15.133:0/4218495035 learned_addr learned my addr 172.21.15.133:0/4218495035 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:53:49.588 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f69727fc700 1 -- 172.21.15.133:0/4218495035 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916085526 0 0) 0x7f6974140c50 con 0x7f69740b5ae0 2021-01-03T13:53:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f69727fc700 1 -- 172.21.15.133:0/4218495035 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6958003230 con 0x7f69740b5ae0 2021-01-03T13:53:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f69737fe700 1 -- 172.21.15.133:0/4218495035 >> v1:172.21.15.133:6789/0 conn(0x7f69740b5ae0 legacy=0x7f69740aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f69737fe700 1 -- 172.21.15.133:0/4218495035 >> v1:172.21.15.16:6789/0 conn(0x7f6974144930 legacy=0x7f69740af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f69737fe700 1 -- 172.21.15.133:0/4218495035 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6974140ef0 con 0x7f69740b5330 2021-01-03T13:53:49.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f69737fe700 1 --2- 172.21.15.133:0/4218495035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69740b5330 0x7f6974141630 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f6964002f30 tx=0x7f6964006dc0).ready entity=mon.1 client_cookie=1fa3cff178c3126a server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:49.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f69727fc700 1 -- 172.21.15.133:0/4218495035 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6964009800 con 0x7f69740b5330 2021-01-03T13:53:49.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f69727fc700 1 -- 172.21.15.133:0/4218495035 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6964009960 con 0x7f69740b5330 2021-01-03T13:53:49.590 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f69727fc700 1 -- 172.21.15.133:0/4218495035 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6964009cc0 con 0x7f69740b5330 2021-01-03T13:53:49.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f6978f3b700 1 -- 172.21.15.133:0/4218495035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69740b5330 msgr2=0x7f6974141630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f6978f3b700 1 --2- 172.21.15.133:0/4218495035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69740b5330 0x7f6974141630 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f6964002f30 tx=0x7f6964006dc0).stop 2021-01-03T13:53:49.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f6978f3b700 1 -- 172.21.15.133:0/4218495035 shutdown_connections 2021-01-03T13:53:49.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f6978f3b700 1 --2- 172.21.15.133:0/4218495035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69740b5330 0x7f6974141630 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.591 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f6978f3b700 1 -- 172.21.15.133:0/4218495035 >> 172.21.15.133:0/4218495035 conn(0x7f697405bdf0 msgr2=0x7f697405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f6978f3b700 1 -- 172.21.15.133:0/4218495035 shutdown_connections 2021-01-03T13:53:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f6978f3b700 1 -- 172.21.15.133:0/4218495035 wait complete. 2021-01-03T13:53:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f6978f3b700 1 Processor -- start 2021-01-03T13:53:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.584+0000 7f6978f3b700 1 -- start start 2021-01-03T13:53:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6978f3b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69740b5330 0x7f6974064130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6978f3b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69740b5ae0 0x7f69740b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6978f3b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6974144930 0x7f697413a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6978f3b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69740638c0 con 0x7f69740b5330 2021-01-03T13:53:49.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6978f3b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6974155f20 con 0x7f69740b5ae0 2021-01-03T13:53:49.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6978f3b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69741561c0 con 0x7f6974144930 2021-01-03T13:53:49.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6972ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69740b5ae0 0x7f69740b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.596 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6972ffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69740b5ae0 0x7f69740b3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41374/0 (socket says 172.21.15.133:41374) 2021-01-03T13:53:49.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6972ffd700 1 -- 172.21.15.133:0/2168180712 learned_addr learned my addr 172.21.15.133:0/2168180712 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:49.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f69737fe700 1 --2- 172.21.15.133:0/2168180712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69740b5330 0x7f6974064130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6973fff700 1 --2- 172.21.15.133:0/2168180712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6974144930 0x7f697413a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6972ffd700 1 -- 172.21.15.133:0/2168180712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6974144930 msgr2=0x7f697413a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.597 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6972ffd700 1 --2- 172.21.15.133:0/2168180712 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f6974144930 0x7f697413a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6972ffd700 1 -- 172.21.15.133:0/2168180712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69740b5330 msgr2=0x7f6974064130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6972ffd700 1 --2- 172.21.15.133:0/2168180712 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69740b5330 0x7f6974064130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6972ffd700 1 -- 172.21.15.133:0/2168180712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69740ab470 con 0x7f69740b5ae0 2021-01-03T13:53:49.598 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6972ffd700 1 --2- 172.21.15.133:0/2168180712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69740b5ae0 0x7f69740b3d50 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f695c0010d0 tx=0x7f695c007a30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:49.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6970ff9700 1 -- 172.21.15.133:0/2168180712 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f695c0072e0 con 0x7f69740b5ae0 2021-01-03T13:53:49.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6970ff9700 1 -- 172.21.15.133:0/2168180712 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c007440 con 0x7f69740b5ae0 2021-01-03T13:53:49.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6978f3b700 1 -- 172.21.15.133:0/2168180712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6974063540 con 0x7f69740b5ae0 2021-01-03T13:53:49.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6970ff9700 1 -- 172.21.15.133:0/2168180712 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f695c0057d0 con 0x7f69740b5ae0 2021-01-03T13:53:49.599 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6978f3b700 1 -- 172.21.15.133:0/2168180712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69740b43e0 con 0x7f69740b5ae0 2021-01-03T13:53:49.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6978f3b700 1 -- 172.21.15.133:0/2168180712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6974156380 con 0x7f69740b5ae0 2021-01-03T13:53:49.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.588+0000 7f6970ff9700 1 -- 172.21.15.133:0/2168180712 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f695c010070 con 0x7f69740b5ae0 2021-01-03T13:53:49.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.592+0000 7f6970ff9700 1 --2- 172.21.15.133:0/2168180712 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f694c055330 0x7f694c0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.600 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.592+0000 7f6970ff9700 1 -- 172.21.15.133:0/2168180712 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f695c06d140 con 0x7f69740b5ae0 2021-01-03T13:53:49.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.592+0000 7f6970ff9700 1 --2- 172.21.15.133:0/2168180712 >> [v2:172.21.15.16:6808/12672,v1:172.21.15.16:6809/12672] conn(0x7f694c05bae0 0x7f694c05df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.592+0000 7f69737fe700 1 --2- 172.21.15.133:0/2168180712 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f694c055330 0x7f694c0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.592+0000 7f6970ff9700 1 -- 172.21.15.133:0/2168180712 --> [v2:172.21.15.16:6808/12672,v1:172.21.15.16:6809/12672] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f694c05e580 con 0x7f694c05bae0 2021-01-03T13:53:49.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.592+0000 7f6970ff9700 1 -- 172.21.15.133:0/2168180712 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=165) v2 ==== 24+0+0 (secure 0 0 0) 0x7f695c06f7d0 con 0x7f69740b5ae0 2021-01-03T13:53:49.601 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.592+0000 7f69737fe700 1 --2- 172.21.15.133:0/2168180712 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f694c055330 0x7f694c0577f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f696401a000 tx=0x7f6964015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:49.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.592+0000 7f6973fff700 1 --2- 172.21.15.133:0/2168180712 >> [v2:172.21.15.16:6808/12672,v1:172.21.15.16:6809/12672] conn(0x7f694c05bae0 0x7f694c05df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.592+0000 7f6973fff700 1 --2- 172.21.15.133:0/2168180712 >> [v2:172.21.15.16:6808/12672,v1:172.21.15.16:6809/12672] conn(0x7f694c05bae0 0x7f694c05df00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:49.602 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.592+0000 7f6970ff9700 1 -- 172.21.15.133:0/2168180712 <== osd.4 v2:172.21.15.16:6808/12672 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7f694c05e580 con 0x7f694c05bae0 2021-01-03T13:53:49.618 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.616+0000 7f6978f3b700 1 -- 172.21.15.133:0/2168180712 --> [v2:172.21.15.16:6808/12672,v1:172.21.15.16:6809/12672] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6974057300 con 0x7f694c05bae0 2021-01-03T13:53:49.619 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.616+0000 7f6970ff9700 1 -- 172.21.15.133:0/2168180712 <== osd.4 v2:172.21.15.16:6808/12672 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6974057300 con 0x7f694c05bae0 2021-01-03T13:53:49.619 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:53:49.619 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-01-03T13:53:49.619 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:53:49.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.616+0000 7f6978f3b700 1 -- 172.21.15.133:0/2168180712 >> [v2:172.21.15.16:6808/12672,v1:172.21.15.16:6809/12672] conn(0x7f694c05bae0 msgr2=0x7f694c05df00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.616+0000 7f6978f3b700 1 --2- 172.21.15.133:0/2168180712 >> [v2:172.21.15.16:6808/12672,v1:172.21.15.16:6809/12672] conn(0x7f694c05bae0 0x7f694c05df00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.616+0000 7f6978f3b700 1 -- 172.21.15.133:0/2168180712 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f694c055330 msgr2=0x7f694c0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.616+0000 7f6978f3b700 1 --2- 172.21.15.133:0/2168180712 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f694c055330 0x7f694c0577f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f696401a000 tx=0x7f6964015000).stop 2021-01-03T13:53:49.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.616+0000 7f6978f3b700 1 -- 172.21.15.133:0/2168180712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69740b5ae0 msgr2=0x7f69740b3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.616+0000 7f6978f3b700 1 --2- 172.21.15.133:0/2168180712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69740b5ae0 0x7f69740b3d50 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7f695c0010d0 tx=0x7f695c007a30).stop 2021-01-03T13:53:49.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.616+0000 7f6973fff700 1 -- 172.21.15.133:0/2168180712 reap_dead start 2021-01-03T13:53:49.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.616+0000 7f6978f3b700 1 -- 172.21.15.133:0/2168180712 shutdown_connections 2021-01-03T13:53:49.622 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.616+0000 7f6978f3b700 1 -- 172.21.15.133:0/2168180712 >> 172.21.15.133:0/2168180712 conn(0x7f697405bdf0 msgr2=0x7f6974099fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:49.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.616+0000 7f6978f3b700 1 -- 172.21.15.133:0/2168180712 shutdown_connections 2021-01-03T13:53:49.623 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.616+0000 7f6978f3b700 1 -- 172.21.15.133:0/2168180712 wait complete. 2021-01-03T13:53:49.631 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 4 2021-01-03T13:53:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f359e700 1 Processor -- start 2021-01-03T13:53:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f359e700 1 -- start start 2021-01-03T13:53:49.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69f40b0c90 0x7f69f40b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f359e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f69f40b5c00 0x7f69f4143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.744 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f4060da0 con 0x7f69f40b52c0 2021-01-03T13:53:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f359e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f4067a90 con 0x7f69f40b5c00 2021-01-03T13:53:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f40b0ad0 con 0x7f69f40b0c90 2021-01-03T13:53:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f259c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f69f40b52c0 0x7f69f4098ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34184/0 (socket says 172.21.15.133:34184) 2021-01-03T13:53:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f1d9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69f40b0c90 0x7f69f40b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f259c700 1 -- 172.21.15.133:0/3190176987 learned_addr learned my addr 172.21.15.133:0/3190176987 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:53:49.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f2d9d700 1 --2- 172.21.15.133:0/3190176987 >> v2:172.21.15.16:3300/0 conn(0x7f69f40b5c00 0x7f69f4143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f159a700 1 -- 172.21.15.133:0/3190176987 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531767998 0 0) 0x7f69f4060da0 con 0x7f69f40b52c0 2021-01-03T13:53:49.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f159a700 1 -- 172.21.15.133:0/3190176987 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69d4003230 con 0x7f69f40b52c0 2021-01-03T13:53:49.746 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f1d9b700 1 -- 172.21.15.133:0/3190176987 >> v2:172.21.15.16:3300/0 conn(0x7f69f40b5c00 msgr2=0x7f69f4143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:49.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f1d9b700 1 --2- 172.21.15.133:0/3190176987 >> v2:172.21.15.16:3300/0 conn(0x7f69f40b5c00 0x7f69f4143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f1d9b700 1 -- 172.21.15.133:0/3190176987 >> v1:172.21.15.133:6789/0 conn(0x7f69f40b52c0 legacy=0x7f69f4098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f1d9b700 1 -- 172.21.15.133:0/3190176987 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f40b56a0 con 0x7f69f40b0c90 2021-01-03T13:53:49.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f2d9d700 1 --2- 172.21.15.133:0/3190176987 >> v2:172.21.15.16:3300/0 conn(0x7f69f40b5c00 0x7f69f4143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:53:49.747 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f1d9b700 1 --2- 172.21.15.133:0/3190176987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69f40b0c90 0x7f69f40b05e0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f69ec0032b0 tx=0x7f69ec0091a0).ready entity=mon.1 client_cookie=aa2f2aaf547c9f57 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:49.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f159a700 1 -- 172.21.15.133:0/3190176987 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69ec00b9a0 con 0x7f69f40b0c90 2021-01-03T13:53:49.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f159a700 1 -- 172.21.15.133:0/3190176987 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec00bb00 con 0x7f69f40b0c90 2021-01-03T13:53:49.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f359e700 1 -- 172.21.15.133:0/3190176987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69f40b0c90 msgr2=0x7f69f40b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.748 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f359e700 1 --2- 172.21.15.133:0/3190176987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69f40b0c90 0x7f69f40b05e0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f69ec0032b0 tx=0x7f69ec0091a0).stop 2021-01-03T13:53:49.749 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f159a700 1 -- 172.21.15.133:0/3190176987 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69ec00bc70 con 0x7f69f40b0c90 2021-01-03T13:53:49.751 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f359e700 1 -- 172.21.15.133:0/3190176987 shutdown_connections 2021-01-03T13:53:49.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f359e700 1 --2- 172.21.15.133:0/3190176987 >> v2:172.21.15.16:3300/0 conn(0x7f69f40b5c00 0x7f69f4143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f359e700 1 --2- 172.21.15.133:0/3190176987 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69f40b0c90 0x7f69f40b05e0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f359e700 1 -- 172.21.15.133:0/3190176987 >> 172.21.15.133:0/3190176987 conn(0x7f69f405bdf0 msgr2=0x7f69f405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:49.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f359e700 1 -- 172.21.15.133:0/3190176987 shutdown_connections 2021-01-03T13:53:49.752 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.740+0000 7f69f359e700 1 -- 172.21.15.133:0/3190176987 wait complete. 2021-01-03T13:53:49.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f359e700 1 Processor -- start 2021-01-03T13:53:49.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f359e700 1 -- start start 2021-01-03T13:53:49.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69f40b0c90 0x7f69f40ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.753 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f359e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69f40b52c0 0x7f69f4148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f359e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f69f40b5c00 0x7f69f4156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f359e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f40ad7b0 con 0x7f69f40b52c0 2021-01-03T13:53:49.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f40ada10 con 0x7f69f40b0c90 2021-01-03T13:53:49.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f359e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f40aded0 con 0x7f69f40b5c00 2021-01-03T13:53:49.754 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69f40b0c90 0x7f69f40ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f259c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69f40b0c90 0x7f69f40ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41390/0 (socket says 172.21.15.133:41390) 2021-01-03T13:53:49.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f259c700 1 -- 172.21.15.133:0/2263558290 learned_addr learned my addr 172.21.15.133:0/2263558290 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:49.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f1d9b700 1 --2- 172.21.15.133:0/2263558290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69f40b52c0 0x7f69f4148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f2d9d700 1 --2- 172.21.15.133:0/2263558290 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f69f40b5c00 0x7f69f4156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.755 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f259c700 1 -- 172.21.15.133:0/2263558290 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f69f40b5c00 msgr2=0x7f69f4156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f259c700 1 --2- 172.21.15.133:0/2263558290 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f69f40b5c00 0x7f69f4156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f259c700 1 -- 172.21.15.133:0/2263558290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69f40b52c0 msgr2=0x7f69f4148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f259c700 1 --2- 172.21.15.133:0/2263558290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69f40b52c0 0x7f69f4148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.756 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f259c700 1 -- 172.21.15.133:0/2263558290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f40ae170 con 0x7f69f40b0c90 2021-01-03T13:53:49.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f2d9d700 1 --2- 172.21.15.133:0/2263558290 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f69f40b5c00 0x7f69f4156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:53:49.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f259c700 1 --2- 172.21.15.133:0/2263558290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69f40b0c90 0x7f69f40ae8b0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f69e40010d0 tx=0x7f69e4007a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:49.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69eb7fe700 1 -- 172.21.15.133:0/2263558290 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69e40072e0 con 0x7f69f40b0c90 2021-01-03T13:53:49.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f359e700 1 -- 172.21.15.133:0/2263558290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f40ae410 con 0x7f69f40b0c90 2021-01-03T13:53:49.757 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69eb7fe700 1 -- 172.21.15.133:0/2263558290 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e4007440 con 0x7f69f40b0c90 2021-01-03T13:53:49.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69eb7fe700 1 -- 172.21.15.133:0/2263558290 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69e40057d0 con 0x7f69f40b0c90 2021-01-03T13:53:49.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.744+0000 7f69f359e700 1 -- 172.21.15.133:0/2263558290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f4067350 con 0x7f69f40b0c90 2021-01-03T13:53:49.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.748+0000 7f69f359e700 1 -- 172.21.15.133:0/2263558290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f41496d0 con 0x7f69f40b0c90 2021-01-03T13:53:49.758 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.748+0000 7f69eb7fe700 1 -- 172.21.15.133:0/2263558290 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f69e4010070 con 0x7f69f40b0c90 2021-01-03T13:53:49.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.748+0000 7f69eb7fe700 1 --2- 172.21.15.133:0/2263558290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f69d80553f0 0x7f69d80578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:49.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.748+0000 7f69eb7fe700 1 -- 172.21.15.133:0/2263558290 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f69e406d3b0 con 0x7f69f40b0c90 2021-01-03T13:53:49.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.748+0000 7f69f1d9b700 1 --2- 172.21.15.133:0/2263558290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f69d80553f0 0x7f69d80578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:49.759 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.748+0000 7f69f1d9b700 1 --2- 172.21.15.133:0/2263558290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f69d80553f0 0x7f69d80578b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f69ec019000 tx=0x7f69ec016000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:49.760 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.752+0000 7f69eb7fe700 1 -- 172.21.15.133:0/2263558290 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f69e40438f0 con 0x7f69f40b0c90 2021-01-03T13:53:49.891 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.888+0000 7f69f359e700 1 -- 172.21.15.133:0/2263558290 --> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f69f4057300 con 0x7f69d80553f0 2021-01-03T13:53:49.892 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.888+0000 7f69eb7fe700 1 -- 172.21.15.133:0/2263558290 <== mgr.4110 v2:172.21.15.133:6800/11943 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f69f4057300 con 0x7f69d80553f0 2021-01-03T13:53:49.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.892+0000 7f69f359e700 1 -- 172.21.15.133:0/2263558290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f69d80553f0 msgr2=0x7f69d80578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.892+0000 7f69f359e700 1 --2- 172.21.15.133:0/2263558290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f69d80553f0 0x7f69d80578b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f69ec019000 tx=0x7f69ec016000).stop 2021-01-03T13:53:49.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.892+0000 7f69f359e700 1 -- 172.21.15.133:0/2263558290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69f40b0c90 msgr2=0x7f69f40ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:49.894 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.892+0000 7f69f359e700 1 --2- 172.21.15.133:0/2263558290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69f40b0c90 0x7f69f40ae8b0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f69e40010d0 tx=0x7f69e4007a70).stop 2021-01-03T13:53:49.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.892+0000 7f69f359e700 1 -- 172.21.15.133:0/2263558290 shutdown_connections 2021-01-03T13:53:49.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.892+0000 7f69f359e700 1 --2- 172.21.15.133:0/2263558290 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f69d80553f0 0x7f69d80578b0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.892+0000 7f69f359e700 1 --2- 172.21.15.133:0/2263558290 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f69f40b5c00 0x7f69f4156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.895 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.892+0000 7f69f359e700 1 --2- 172.21.15.133:0/2263558290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69f40b0c90 0x7f69f40ae8b0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.892+0000 7f69f359e700 1 --2- 172.21.15.133:0/2263558290 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69f40b52c0 0x7f69f4148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:49.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.892+0000 7f69f359e700 1 -- 172.21.15.133:0/2263558290 >> 172.21.15.133:0/2263558290 conn(0x7f69f405bdf0 msgr2=0x7f69f40601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:49.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.892+0000 7f69f359e700 1 -- 172.21.15.133:0/2263558290 shutdown_connections 2021-01-03T13:53:49.896 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:49.892+0000 7f69f359e700 1 -- 172.21.15.133:0/2263558290 wait complete. 2021-01-03T13:53:49.897 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 4 to deep-scrub 2021-01-03T13:53:49.905 INFO:tasks.ceph:Scrubbing osd.5 2021-01-03T13:53:49.906 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 config set osd_debug_deep_scrub_sleep 0 2021-01-03T13:53:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.024+0000 7fcb4bfff700 1 Processor -- start 2021-01-03T13:53:50.027 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.024+0000 7fcb4bfff700 1 -- start start 2021-01-03T13:53:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.024+0000 7fcb4bfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb4c0677a0 0x7fcb4c0ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.024+0000 7fcb4bfff700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcb4c0b1a50 0x7fcb4c0a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.028 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.024+0000 7fcb4bfff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4c140ae0 con 0x7fcb4c05c670 2021-01-03T13:53:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.024+0000 7fcb4bfff700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb4c0ace10 con 0x7fcb4c0b1a50 2021-01-03T13:53:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.024+0000 7fcb4bfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c067b80 con 0x7fcb4c0677a0 2021-01-03T13:53:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.024+0000 7fcb4a7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcb4c05c670 0x7fcb4c146320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34200/0 (socket says 172.21.15.133:34200) 2021-01-03T13:53:50.029 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.024+0000 7fcb4a7fc700 1 -- 172.21.15.133:0/3258488921 learned_addr learned my addr 172.21.15.133:0/3258488921 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:53:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.024+0000 7fcb4affd700 1 --2- 172.21.15.133:0/3258488921 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb4c0677a0 0x7fcb4c0ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.030 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.024+0000 7fcb4b7fe700 1 --2- 172.21.15.133:0/3258488921 >> v2:172.21.15.16:3300/0 conn(0x7fcb4c0b1a50 0x7fcb4c0a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.031 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.024+0000 7fcb49ffb700 1 -- 172.21.15.133:0/3258488921 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966990349 0 0) 0x7fcb4c140ae0 con 0x7fcb4c05c670 2021-01-03T13:53:50.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.024+0000 7fcb49ffb700 1 -- 172.21.15.133:0/3258488921 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb2c003230 con 0x7fcb4c05c670 2021-01-03T13:53:50.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb4affd700 1 -- 172.21.15.133:0/3258488921 >> v2:172.21.15.16:3300/0 conn(0x7fcb4c0b1a50 msgr2=0x7fcb4c0a8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:50.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb4affd700 1 --2- 172.21.15.133:0/3258488921 >> v2:172.21.15.16:3300/0 conn(0x7fcb4c0b1a50 0x7fcb4c0a8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.032 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb4affd700 1 -- 172.21.15.133:0/3258488921 >> v1:172.21.15.133:6789/0 conn(0x7fcb4c05c670 legacy=0x7fcb4c146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb4affd700 1 -- 172.21.15.133:0/3258488921 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c0b1560 con 0x7fcb4c0677a0 2021-01-03T13:53:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb4affd700 1 --2- 172.21.15.133:0/3258488921 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb4c0677a0 0x7fcb4c0ae3b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fcb3c002f30 tx=0x7fcb3c006dc0).ready entity=mon.2 client_cookie=81bd1ac2c55d9458 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb49ffb700 1 -- 172.21.15.133:0/3258488921 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb3c0096a0 con 0x7fcb4c0677a0 2021-01-03T13:53:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb49ffb700 1 -- 172.21.15.133:0/3258488921 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c009800 con 0x7fcb4c0677a0 2021-01-03T13:53:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb4bfff700 1 -- 172.21.15.133:0/3258488921 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb4c0677a0 msgr2=0x7fcb4c0ae3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb49ffb700 1 -- 172.21.15.133:0/3258488921 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb3c009b60 con 0x7fcb4c0677a0 2021-01-03T13:53:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb4bfff700 1 --2- 172.21.15.133:0/3258488921 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb4c0677a0 0x7fcb4c0ae3b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fcb3c002f30 tx=0x7fcb3c006dc0).stop 2021-01-03T13:53:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb4bfff700 1 -- 172.21.15.133:0/3258488921 shutdown_connections 2021-01-03T13:53:50.034 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb4bfff700 1 --2- 172.21.15.133:0/3258488921 >> v2:172.21.15.16:3300/0 conn(0x7fcb4c0b1a50 0x7fcb4c0a8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb4bfff700 1 --2- 172.21.15.133:0/3258488921 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb4c0677a0 0x7fcb4c0ae3b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb4bfff700 1 -- 172.21.15.133:0/3258488921 >> 172.21.15.133:0/3258488921 conn(0x7fcb4c06b050 msgr2=0x7fcb4c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:50.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb4bfff700 1 -- 172.21.15.133:0/3258488921 shutdown_connections 2021-01-03T13:53:50.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb4bfff700 1 -- 172.21.15.133:0/3258488921 wait complete. 2021-01-03T13:53:50.035 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb4bfff700 1 Processor -- start 2021-01-03T13:53:50.036 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.028+0000 7fcb4bfff700 1 -- start start 2021-01-03T13:53:50.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb4c05c670 0x7fcb4c145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4bfff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb4c0677a0 0x7fcb4c152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.038 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4bfff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb4c0b1a50 0x7fcb4c1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4bfff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c148a70 con 0x7fcb4c0b1a50 2021-01-03T13:53:50.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4bfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c0a9290 con 0x7fcb4c05c670 2021-01-03T13:53:50.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4bfff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c149620 con 0x7fcb4c0677a0 2021-01-03T13:53:50.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb4c05c670 0x7fcb4c145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.039 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb4c05c670 0x7fcb4c145a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41404/0 (socket says 172.21.15.133:41404) 2021-01-03T13:53:50.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4affd700 1 -- 172.21.15.133:0/3767406172 learned_addr learned my addr 172.21.15.133:0/3767406172 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:50.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4affd700 1 -- 172.21.15.133:0/3767406172 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb4c0677a0 msgr2=0x7fcb4c152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4affd700 1 --2- 172.21.15.133:0/3767406172 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fcb4c0677a0 0x7fcb4c152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-03T13:53:50.040 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4affd700 1 -- 172.21.15.133:0/3767406172 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb4c0b1a50 msgr2=0x7fcb4c1551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4b7fe700 1 --2- 172.21.15.133:0/3767406172 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb4c0b1a50 0x7fcb4c1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4affd700 1 --2- 172.21.15.133:0/3767406172 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb4c0b1a50 0x7fcb4c1551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4affd700 1 -- 172.21.15.133:0/3767406172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c151c50 con 0x7fcb4c05c670 2021-01-03T13:53:50.041 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4affd700 1 --2- 172.21.15.133:0/3767406172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb4c05c670 0x7fcb4c145a80 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7fcb3c002f30 tx=0x7fcb3c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb43fff700 1 -- 172.21.15.133:0/3767406172 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb3c011b80 con 0x7fcb4c05c670 2021-01-03T13:53:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb43fff700 1 -- 172.21.15.133:0/3767406172 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c011ce0 con 0x7fcb4c05c670 2021-01-03T13:53:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4bfff700 1 -- 172.21.15.133:0/3767406172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4c148ca0 con 0x7fcb4c05c670 2021-01-03T13:53:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4bfff700 1 -- 172.21.15.133:0/3767406172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4c0a9760 con 0x7fcb4c05c670 2021-01-03T13:53:50.042 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb43fff700 1 -- 172.21.15.133:0/3767406172 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb3c01c5a0 con 0x7fcb4c05c670 2021-01-03T13:53:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb43fff700 1 -- 172.21.15.133:0/3767406172 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fcb3c00f070 con 0x7fcb4c05c670 2021-01-03T13:53:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4bfff700 1 -- 172.21.15.133:0/3767406172 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb4c0a9920 con 0x7fcb4c05c670 2021-01-03T13:53:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb43fff700 1 --2- 172.21.15.133:0/3767406172 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb300553b0 0x7fcb30057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.043 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb43fff700 1 -- 172.21.15.133:0/3767406172 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fcb3c06ec30 con 0x7fcb4c05c670 2021-01-03T13:53:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4a7fc700 1 --2- 172.21.15.133:0/3767406172 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb300553b0 0x7fcb30057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb43fff700 1 --2- 172.21.15.133:0/3767406172 >> [v2:172.21.15.16:6817/12673,v1:172.21.15.16:6819/12673] conn(0x7fcb3005bac0 0x7fcb3005dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb43fff700 1 -- 172.21.15.133:0/3767406172 --> [v2:172.21.15.16:6817/12673,v1:172.21.15.16:6819/12673] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb3005e560 con 0x7fcb3005bac0 2021-01-03T13:53:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb43fff700 1 -- 172.21.15.133:0/3767406172 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=165) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb3c0712a0 con 0x7fcb4c05c670 2021-01-03T13:53:50.044 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4a7fc700 1 --2- 172.21.15.133:0/3767406172 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb300553b0 0x7fcb30057870 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7fcb340010d0 tx=0x7fcb34007690).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.032+0000 7fcb4b7fe700 1 --2- 172.21.15.133:0/3767406172 >> [v2:172.21.15.16:6817/12673,v1:172.21.15.16:6819/12673] conn(0x7fcb3005bac0 0x7fcb3005dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.036+0000 7fcb4b7fe700 1 --2- 172.21.15.133:0/3767406172 >> [v2:172.21.15.16:6817/12673,v1:172.21.15.16:6819/12673] conn(0x7fcb3005bac0 0x7fcb3005dee0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.045 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.036+0000 7fcb43fff700 1 -- 172.21.15.133:0/3767406172 <== osd.5 v2:172.21.15.16:6817/12673 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7fcb3005e560 con 0x7fcb3005bac0 2021-01-03T13:53:50.058 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.056+0000 7fcb4bfff700 1 -- 172.21.15.133:0/3767406172 --> [v2:172.21.15.16:6817/12673,v1:172.21.15.16:6819/12673] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcb4c057300 con 0x7fcb3005bac0 2021-01-03T13:53:50.059 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.056+0000 7fcb43fff700 1 -- 172.21.15.133:0/3767406172 <== osd.5 v2:172.21.15.16:6817/12673 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcb4c057300 con 0x7fcb3005bac0 2021-01-03T13:53:50.059 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:53:50.060 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-01-03T13:53:50.060 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:53:50.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.056+0000 7fcb4bfff700 1 -- 172.21.15.133:0/3767406172 >> [v2:172.21.15.16:6817/12673,v1:172.21.15.16:6819/12673] conn(0x7fcb3005bac0 msgr2=0x7fcb3005dee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.056+0000 7fcb4bfff700 1 --2- 172.21.15.133:0/3767406172 >> [v2:172.21.15.16:6817/12673,v1:172.21.15.16:6819/12673] conn(0x7fcb3005bac0 0x7fcb3005dee0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.061 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.056+0000 7fcb4bfff700 1 -- 172.21.15.133:0/3767406172 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb300553b0 msgr2=0x7fcb30057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.056+0000 7fcb4bfff700 1 --2- 172.21.15.133:0/3767406172 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fcb300553b0 0x7fcb30057870 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7fcb340010d0 tx=0x7fcb34007690).stop 2021-01-03T13:53:50.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.056+0000 7fcb4bfff700 1 -- 172.21.15.133:0/3767406172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb4c05c670 msgr2=0x7fcb4c145a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.056+0000 7fcb4bfff700 1 --2- 172.21.15.133:0/3767406172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb4c05c670 0x7fcb4c145a80 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7fcb3c002f30 tx=0x7fcb3c015000).stop 2021-01-03T13:53:50.062 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.056+0000 7fcb4b7fe700 1 -- 172.21.15.133:0/3767406172 reap_dead start 2021-01-03T13:53:50.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.056+0000 7fcb4bfff700 1 -- 172.21.15.133:0/3767406172 shutdown_connections 2021-01-03T13:53:50.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.056+0000 7fcb4bfff700 1 -- 172.21.15.133:0/3767406172 >> 172.21.15.133:0/3767406172 conn(0x7fcb4c06b050 msgr2=0x7fcb4c0b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:50.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.056+0000 7fcb4bfff700 1 -- 172.21.15.133:0/3767406172 shutdown_connections 2021-01-03T13:53:50.063 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.056+0000 7fcb4bfff700 1 -- 172.21.15.133:0/3767406172 wait complete. 2021-01-03T13:53:50.070 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 5 2021-01-03T13:53:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.172+0000 7f541242b700 1 Processor -- start 2021-01-03T13:53:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.172+0000 7f541242b700 1 -- start start 2021-01-03T13:53:50.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f541242b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f540c05c130 0x7f540c0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f541242b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f540c0b02b0 0x7f540c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f541242b700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f540c0622f0 0x7f540c0668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.178 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f541242b700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c1473d0 con 0x7f540c0622f0 2021-01-03T13:53:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f541242b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c0b0ab0 con 0x7f540c0b02b0 2021-01-03T13:53:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f541242b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c05c510 con 0x7f540c05c130 2021-01-03T13:53:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f5410c28700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f540c0b02b0 0x7f540c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f5410c28700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f540c0b02b0 0x7f540c0b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41416/0 (socket says 172.21.15.133:41416) 2021-01-03T13:53:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f5410c28700 1 -- 172.21.15.133:0/1268716619 learned_addr learned my addr 172.21.15.133:0/1268716619 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f5411429700 1 --2- 172.21.15.133:0/1268716619 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f540c05c130 0x7f540c0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f5411c2a700 1 --2- 172.21.15.133:0/1268716619 >> v2:172.21.15.16:3300/0 conn(0x7f540c0622f0 0x7f540c0668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f5410c28700 1 -- 172.21.15.133:0/1268716619 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f540c05c130 msgr2=0x7f540c0b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f5410c28700 1 --2- 172.21.15.133:0/1268716619 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f540c05c130 0x7f540c0b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.183 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f5410c28700 1 -- 172.21.15.133:0/1268716619 >> v2:172.21.15.16:3300/0 conn(0x7f540c0622f0 msgr2=0x7f540c0668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f5410c28700 1 --2- 172.21.15.133:0/1268716619 >> v2:172.21.15.16:3300/0 conn(0x7f540c0622f0 0x7f540c0668a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f5410c28700 1 -- 172.21.15.133:0/1268716619 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c0b15a0 con 0x7f540c0b02b0 2021-01-03T13:53:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f5411429700 1 --2- 172.21.15.133:0/1268716619 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f540c05c130 0x7f540c0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-03T13:53:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f5410c28700 1 --2- 172.21.15.133:0/1268716619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f540c0b02b0 0x7f540c0b1ef0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f5408002f30 tx=0x7f5408006e80).ready entity=mon.1 client_cookie=15e9f03d8b8f4268 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.184 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f53fffff700 1 -- 172.21.15.133:0/1268716619 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5408009640 con 0x7f540c0b02b0 2021-01-03T13:53:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f53fffff700 1 -- 172.21.15.133:0/1268716619 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54080097a0 con 0x7f540c0b02b0 2021-01-03T13:53:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f541242b700 1 -- 172.21.15.133:0/1268716619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f540c0b02b0 msgr2=0x7f540c0b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f53fffff700 1 -- 172.21.15.133:0/1268716619 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5408009b00 con 0x7f540c0b02b0 2021-01-03T13:53:50.185 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f541242b700 1 --2- 172.21.15.133:0/1268716619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f540c0b02b0 0x7f540c0b1ef0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f5408002f30 tx=0x7f5408006e80).stop 2021-01-03T13:53:50.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f541242b700 1 -- 172.21.15.133:0/1268716619 shutdown_connections 2021-01-03T13:53:50.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f541242b700 1 --2- 172.21.15.133:0/1268716619 >> v2:172.21.15.16:3300/0 conn(0x7f540c0622f0 0x7f540c0668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f541242b700 1 --2- 172.21.15.133:0/1268716619 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f540c05c130 0x7f540c0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.186 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f541242b700 1 --2- 172.21.15.133:0/1268716619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f540c0b02b0 0x7f540c0b1ef0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f541242b700 1 -- 172.21.15.133:0/1268716619 >> 172.21.15.133:0/1268716619 conn(0x7f540c0b6110 msgr2=0x7f540c0b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:50.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f541242b700 1 -- 172.21.15.133:0/1268716619 shutdown_connections 2021-01-03T13:53:50.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f541242b700 1 -- 172.21.15.133:0/1268716619 wait complete. 2021-01-03T13:53:50.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f541242b700 1 Processor -- start 2021-01-03T13:53:50.187 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.176+0000 7f541242b700 1 -- start start 2021-01-03T13:53:50.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f541242b700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f540c05c130 0x7f540c064390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f541242b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f540c0622f0 0x7f540c148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f541242b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f540c0b02b0 0x7f540c148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f541242b700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c155e80 con 0x7f540c0622f0 2021-01-03T13:53:50.188 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f541242b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c154f30 con 0x7f540c0b02b0 2021-01-03T13:53:50.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f541242b700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c148540 con 0x7f540c05c130 2021-01-03T13:53:50.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f5411c2a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f540c0b02b0 0x7f540c148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f5411c2a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f540c0b02b0 0x7f540c148fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41422/0 (socket says 172.21.15.133:41422) 2021-01-03T13:53:50.189 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f5411c2a700 1 -- 172.21.15.133:0/1795006998 learned_addr learned my addr 172.21.15.133:0/1795006998 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:50.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f5411429700 1 --2- 172.21.15.133:0/1795006998 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f540c05c130 0x7f540c064390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f5410c28700 1 --2- 172.21.15.133:0/1795006998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f540c0622f0 0x7f540c148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f5411c2a700 1 -- 172.21.15.133:0/1795006998 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f540c05c130 msgr2=0x7f540c064390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f5411c2a700 1 --2- 172.21.15.133:0/1795006998 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f540c05c130 0x7f540c064390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.190 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f5411c2a700 1 -- 172.21.15.133:0/1795006998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f540c0622f0 msgr2=0x7f540c148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f5411c2a700 1 --2- 172.21.15.133:0/1795006998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f540c0622f0 0x7f540c148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f5411c2a700 1 -- 172.21.15.133:0/1795006998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c147510 con 0x7f540c0b02b0 2021-01-03T13:53:50.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f5411c2a700 1 --2- 172.21.15.133:0/1795006998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f540c0b02b0 0x7f540c148fb0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f540c155190 tx=0x7f5400006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.191 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f53fe7fc700 1 -- 172.21.15.133:0/1795006998 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540000cae0 con 0x7f540c0b02b0 2021-01-03T13:53:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f53fe7fc700 1 -- 172.21.15.133:0/1795006998 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540000cc40 con 0x7f540c0b02b0 2021-01-03T13:53:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f53fe7fc700 1 -- 172.21.15.133:0/1795006998 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54000123f0 con 0x7f540c0b02b0 2021-01-03T13:53:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f541242b700 1 -- 172.21.15.133:0/1795006998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540c1466c0 con 0x7f540c0b02b0 2021-01-03T13:53:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f541242b700 1 -- 172.21.15.133:0/1795006998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c1469a0 con 0x7f540c0b02b0 2021-01-03T13:53:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.180+0000 7f541242b700 1 -- 172.21.15.133:0/1795006998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540c148900 con 0x7f540c0b02b0 2021-01-03T13:53:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.184+0000 7f53fe7fc700 1 -- 172.21.15.133:0/1795006998 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f5400012550 con 0x7f540c0b02b0 2021-01-03T13:53:50.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.184+0000 7f53fe7fc700 1 --2- 172.21.15.133:0/1795006998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53ec055330 0x7f53ec0577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.184+0000 7f53fe7fc700 1 -- 172.21.15.133:0/1795006998 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f540006e130 con 0x7f540c0b02b0 2021-01-03T13:53:50.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.184+0000 7f5411429700 1 --2- 172.21.15.133:0/1795006998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53ec055330 0x7f53ec0577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.194 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.184+0000 7f5411429700 1 --2- 172.21.15.133:0/1795006998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53ec055330 0x7f53ec0577f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f540400b000 tx=0x7f5404008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.195 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.188+0000 7f53fe7fc700 1 -- 172.21.15.133:0/1795006998 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f54000446b0 con 0x7f540c0b02b0 2021-01-03T13:53:50.326 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.324+0000 7f541242b700 1 -- 172.21.15.133:0/1795006998 --> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f540c1483c0 con 0x7f53ec055330 2021-01-03T13:53:50.327 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.324+0000 7f53fe7fc700 1 -- 172.21.15.133:0/1795006998 <== mgr.4110 v2:172.21.15.133:6800/11943 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5404011b90 con 0x7f53ec055330 2021-01-03T13:53:50.329 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.328+0000 7f541242b700 1 -- 172.21.15.133:0/1795006998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53ec055330 msgr2=0x7f53ec0577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.328+0000 7f541242b700 1 --2- 172.21.15.133:0/1795006998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53ec055330 0x7f53ec0577f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f540400b000 tx=0x7f5404008040).stop 2021-01-03T13:53:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.328+0000 7f541242b700 1 -- 172.21.15.133:0/1795006998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f540c0b02b0 msgr2=0x7f540c148fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.328+0000 7f541242b700 1 --2- 172.21.15.133:0/1795006998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f540c0b02b0 0x7f540c148fb0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f540c155190 tx=0x7f5400006dc0).stop 2021-01-03T13:53:50.330 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.328+0000 7f541242b700 1 -- 172.21.15.133:0/1795006998 shutdown_connections 2021-01-03T13:53:50.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.328+0000 7f541242b700 1 --2- 172.21.15.133:0/1795006998 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f53ec055330 0x7f53ec0577f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.328+0000 7f541242b700 1 --2- 172.21.15.133:0/1795006998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f540c0b02b0 0x7f540c148fb0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.328+0000 7f541242b700 1 --2- 172.21.15.133:0/1795006998 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f540c05c130 0x7f540c064390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.331 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.328+0000 7f541242b700 1 --2- 172.21.15.133:0/1795006998 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f540c0622f0 0x7f540c148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.328+0000 7f541242b700 1 -- 172.21.15.133:0/1795006998 >> 172.21.15.133:0/1795006998 conn(0x7f540c0b6110 msgr2=0x7f540c0af430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:50.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.328+0000 7f541242b700 1 -- 172.21.15.133:0/1795006998 shutdown_connections 2021-01-03T13:53:50.332 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.328+0000 7f541242b700 1 -- 172.21.15.133:0/1795006998 wait complete. 2021-01-03T13:53:50.332 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 5 to deep-scrub 2021-01-03T13:53:50.345 INFO:tasks.ceph:Scrubbing osd.6 2021-01-03T13:53:50.346 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 config set osd_debug_deep_scrub_sleep 0 2021-01-03T13:53:50.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.456+0000 7f7dcffff700 1 Processor -- start 2021-01-03T13:53:50.458 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.456+0000 7f7dcffff700 1 -- start start 2021-01-03T13:53:50.459 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.456+0000 7f7dcffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7dd005c130 0x7f7dd00b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.456+0000 7f7dcffff700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd005c510 con 0x7f7dd01479e0 2021-01-03T13:53:50.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.456+0000 7f7dcffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd014a930 con 0x7f7dd0061890 2021-01-03T13:53:50.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.456+0000 7f7dcffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd014abd0 con 0x7f7dd005c130 2021-01-03T13:53:50.460 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.456+0000 7f7dce7fc700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7dd0061890 0x7f7dd01472d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34230/0 (socket says 172.21.15.133:34230) 2021-01-03T13:53:50.461 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.456+0000 7f7dce7fc700 1 -- 172.21.15.133:0/3945307756 learned_addr learned my addr 172.21.15.133:0/3945307756 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:53:50.462 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.456+0000 7f7dceffd700 1 --2- 172.21.15.133:0/3945307756 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7dd005c130 0x7f7dd00b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.456+0000 7f7dcdffb700 1 -- 172.21.15.133:0/3945307756 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488174951 0 0) 0x7f7dd014a930 con 0x7f7dd0061890 2021-01-03T13:53:50.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.456+0000 7f7dcdffb700 1 -- 172.21.15.133:0/3945307756 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7db0003230 con 0x7f7dd0061890 2021-01-03T13:53:50.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.456+0000 7f7dcdffb700 1 -- 172.21.15.133:0/3945307756 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618141825 0 0) 0x7f7dd005c510 con 0x7f7dd01479e0 2021-01-03T13:53:50.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.456+0000 7f7dcdffb700 1 -- 172.21.15.133:0/3945307756 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dd014a930 con 0x7f7dd01479e0 2021-01-03T13:53:50.463 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.456+0000 7f7dcdffb700 1 -- 172.21.15.133:0/3945307756 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3570145748 0 0) 0x7f7db0003230 con 0x7f7dd0061890 2021-01-03T13:53:50.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.456+0000 7f7dceffd700 1 -- 172.21.15.133:0/3945307756 >> v1:172.21.15.133:6789/0 conn(0x7f7dd0061890 legacy=0x7f7dd01472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.456+0000 7f7dceffd700 1 -- 172.21.15.133:0/3945307756 >> v1:172.21.15.16:6789/0 conn(0x7f7dd01479e0 legacy=0x7f7dd01445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.460+0000 7f7dceffd700 1 -- 172.21.15.133:0/3945307756 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd014ae70 con 0x7f7dd005c130 2021-01-03T13:53:50.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.460+0000 7f7dceffd700 1 --2- 172.21.15.133:0/3945307756 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7dd005c130 0x7f7dd00b25d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f7dc0001870 tx=0x7f7db8006dc0).ready entity=mon.2 client_cookie=7a9ebc21ac298dda server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.464 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.460+0000 7f7dcdffb700 1 -- 172.21.15.133:0/3945307756 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7dc00016d0 con 0x7f7dd005c130 2021-01-03T13:53:50.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.460+0000 7f7dcdffb700 1 -- 172.21.15.133:0/3945307756 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db800d5c0 con 0x7f7dd005c130 2021-01-03T13:53:50.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.460+0000 7f7dcdffb700 1 -- 172.21.15.133:0/3945307756 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7db800d730 con 0x7f7dd005c130 2021-01-03T13:53:50.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.460+0000 7f7dcffff700 1 -- 172.21.15.133:0/3945307756 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7dd005c130 msgr2=0x7f7dd00b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.465 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.460+0000 7f7dcffff700 1 --2- 172.21.15.133:0/3945307756 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7dd005c130 0x7f7dd00b25d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f7dc0001870 tx=0x7f7db8006dc0).stop 2021-01-03T13:53:50.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.460+0000 7f7dcffff700 1 -- 172.21.15.133:0/3945307756 shutdown_connections 2021-01-03T13:53:50.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.460+0000 7f7dcffff700 1 --2- 172.21.15.133:0/3945307756 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7dd005c130 0x7f7dd00b25d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.460+0000 7f7dcffff700 1 -- 172.21.15.133:0/3945307756 >> 172.21.15.133:0/3945307756 conn(0x7f7dd00b6110 msgr2=0x7f7dd00b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:50.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.460+0000 7f7dcffff700 1 -- 172.21.15.133:0/3945307756 shutdown_connections 2021-01-03T13:53:50.466 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.460+0000 7f7dcffff700 1 -- 172.21.15.133:0/3945307756 wait complete. 2021-01-03T13:53:50.468 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.460+0000 7f7dcffff700 1 Processor -- start 2021-01-03T13:53:50.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.460+0000 7f7dcffff700 1 -- start start 2021-01-03T13:53:50.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dcffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dd005c130 0x7f7dd0149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dcffff700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dd0061890 0x7f7dd00af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.469 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dcffff700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7dd01479e0 0x7f7dd00af700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dcffff700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd00ae760 con 0x7f7dd0061890 2021-01-03T13:53:50.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dcffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd014a5a0 con 0x7f7dd005c130 2021-01-03T13:53:50.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dcffff700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd0146a20 con 0x7f7dd01479e0 2021-01-03T13:53:50.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dceffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dd005c130 0x7f7dd0149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.470 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dceffd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dd005c130 0x7f7dd0149920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41434/0 (socket says 172.21.15.133:41434) 2021-01-03T13:53:50.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dceffd700 1 -- 172.21.15.133:0/136751058 learned_addr learned my addr 172.21.15.133:0/136751058 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:50.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dce7fc700 1 --2- 172.21.15.133:0/136751058 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dd0061890 0x7f7dd00af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dcf7fe700 1 --2- 172.21.15.133:0/136751058 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7dd01479e0 0x7f7dd00af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.471 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dceffd700 1 -- 172.21.15.133:0/136751058 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7dd01479e0 msgr2=0x7f7dd00af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dceffd700 1 --2- 172.21.15.133:0/136751058 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f7dd01479e0 0x7f7dd00af700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dceffd700 1 -- 172.21.15.133:0/136751058 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dd0061890 msgr2=0x7f7dd00af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dceffd700 1 --2- 172.21.15.133:0/136751058 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7dd0061890 0x7f7dd00af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dceffd700 1 -- 172.21.15.133:0/136751058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd00afbf0 con 0x7f7dd005c130 2021-01-03T13:53:50.472 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dceffd700 1 --2- 172.21.15.133:0/136751058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dd005c130 0x7f7dd0149920 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7f7dd00af160 tx=0x7f7db8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dc7fff700 1 -- 172.21.15.133:0/136751058 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7db8011ac0 con 0x7f7dd005c130 2021-01-03T13:53:50.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dc7fff700 1 -- 172.21.15.133:0/136751058 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db8011c20 con 0x7f7dd005c130 2021-01-03T13:53:50.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dcffff700 1 -- 172.21.15.133:0/136751058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd0146780 con 0x7f7dd005c130 2021-01-03T13:53:50.473 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dc7fff700 1 -- 172.21.15.133:0/136751058 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7db801d450 con 0x7f7dd005c130 2021-01-03T13:53:50.474 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.464+0000 7f7dcffff700 1 -- 172.21.15.133:0/136751058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd00abd60 con 0x7f7dd005c130 2021-01-03T13:53:50.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.468+0000 7f7dcffff700 1 -- 172.21.15.133:0/136751058 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7dd00ade70 con 0x7f7dd005c130 2021-01-03T13:53:50.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.468+0000 7f7dc7fff700 1 -- 172.21.15.133:0/136751058 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f7db8024030 con 0x7f7dd005c130 2021-01-03T13:53:50.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.468+0000 7f7dc7fff700 1 --2- 172.21.15.133:0/136751058 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7db4055440 0x7f7db4057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.475 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.468+0000 7f7dc7fff700 1 -- 172.21.15.133:0/136751058 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f7db806ebc0 con 0x7f7dd005c130 2021-01-03T13:53:50.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.468+0000 7f7dce7fc700 1 --2- 172.21.15.133:0/136751058 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7db4055440 0x7f7db4057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.468+0000 7f7dc7fff700 1 --2- 172.21.15.133:0/136751058 >> [v2:172.21.15.16:6800/12662,v1:172.21.15.16:6801/12662] conn(0x7f7db405bb50 0x7f7db405df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.468+0000 7f7dc7fff700 1 -- 172.21.15.133:0/136751058 --> [v2:172.21.15.16:6800/12662,v1:172.21.15.16:6801/12662] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7db405e550 con 0x7f7db405bb50 2021-01-03T13:53:50.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.468+0000 7f7dc7fff700 1 -- 172.21.15.133:0/136751058 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=165) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7db8074220 con 0x7f7dd005c130 2021-01-03T13:53:50.476 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.468+0000 7f7dce7fc700 1 --2- 172.21.15.133:0/136751058 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7db4055440 0x7f7db4057900 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f7dc000d000 tx=0x7f7dc0000b80).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.468+0000 7f7dcf7fe700 1 --2- 172.21.15.133:0/136751058 >> [v2:172.21.15.16:6800/12662,v1:172.21.15.16:6801/12662] conn(0x7f7db405bb50 0x7f7db405df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.468+0000 7f7dcf7fe700 1 --2- 172.21.15.133:0/136751058 >> [v2:172.21.15.16:6800/12662,v1:172.21.15.16:6801/12662] conn(0x7f7db405bb50 0x7f7db405df70 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.477 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.472+0000 7f7dc7fff700 1 -- 172.21.15.133:0/136751058 <== osd.6 v2:172.21.15.16:6800/12662 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7f7db405e550 con 0x7f7db405bb50 2021-01-03T13:53:50.493 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.492+0000 7f7dcffff700 1 -- 172.21.15.133:0/136751058 --> [v2:172.21.15.16:6800/12662,v1:172.21.15.16:6801/12662] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7dd0057300 con 0x7f7db405bb50 2021-01-03T13:53:50.494 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.492+0000 7f7dc7fff700 1 -- 172.21.15.133:0/136751058 <== osd.6 v2:172.21.15.16:6800/12662 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7dd0057300 con 0x7f7db405bb50 2021-01-03T13:53:50.495 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:53:50.495 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-01-03T13:53:50.495 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:53:50.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.492+0000 7f7dcffff700 1 -- 172.21.15.133:0/136751058 >> [v2:172.21.15.16:6800/12662,v1:172.21.15.16:6801/12662] conn(0x7f7db405bb50 msgr2=0x7f7db405df70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.496 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.492+0000 7f7dcffff700 1 --2- 172.21.15.133:0/136751058 >> [v2:172.21.15.16:6800/12662,v1:172.21.15.16:6801/12662] conn(0x7f7db405bb50 0x7f7db405df70 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.492+0000 7f7dcffff700 1 -- 172.21.15.133:0/136751058 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7db4055440 msgr2=0x7f7db4057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.492+0000 7f7dcffff700 1 --2- 172.21.15.133:0/136751058 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f7db4055440 0x7f7db4057900 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f7dc000d000 tx=0x7f7dc0000b80).stop 2021-01-03T13:53:50.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.492+0000 7f7dcffff700 1 -- 172.21.15.133:0/136751058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dd005c130 msgr2=0x7f7dd0149920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.497 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.492+0000 7f7dcffff700 1 --2- 172.21.15.133:0/136751058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dd005c130 0x7f7dd0149920 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7f7dd00af160 tx=0x7f7db8015000).stop 2021-01-03T13:53:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.492+0000 7f7dcf7fe700 1 -- 172.21.15.133:0/136751058 reap_dead start 2021-01-03T13:53:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.492+0000 7f7dcffff700 1 -- 172.21.15.133:0/136751058 shutdown_connections 2021-01-03T13:53:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.492+0000 7f7dcffff700 1 -- 172.21.15.133:0/136751058 >> 172.21.15.133:0/136751058 conn(0x7f7dd00b6110 msgr2=0x7f7dd00b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.492+0000 7f7dcffff700 1 -- 172.21.15.133:0/136751058 shutdown_connections 2021-01-03T13:53:50.498 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.492+0000 7f7dcffff700 1 -- 172.21.15.133:0/136751058 wait complete. 2021-01-03T13:53:50.507 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 6 2021-01-03T13:53:50.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff898fdb700 1 Processor -- start 2021-01-03T13:53:50.621 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff898fdb700 1 -- start start 2021-01-03T13:53:50.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff898fdb700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8940b3d80 0x7ff8940b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.624 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff898fdb700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8940b35a0 0x7ff8940ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff898fdb700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff89409a740 0x7ff894144830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.625 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff898fdb700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89409aec0 con 0x7ff89409a740 2021-01-03T13:53:50.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff898fdb700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff89409b160 con 0x7ff8940b3d80 2021-01-03T13:53:50.626 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff898fdb700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8941440f0 con 0x7ff8940b35a0 2021-01-03T13:53:50.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff89259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8940b3d80 0x7ff8940b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff89259c700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff8940b3d80 0x7ff8940b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41444/0 (socket says 172.21.15.133:41444) 2021-01-03T13:53:50.627 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff89259c700 1 -- 172.21.15.133:0/413172304 learned_addr learned my addr 172.21.15.133:0/413172304 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:50.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff892d9d700 1 --2- 172.21.15.133:0/413172304 >> v2:172.21.15.16:3300/0 conn(0x7ff89409a740 0x7ff894144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.628 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff88bfff700 1 --2- 172.21.15.133:0/413172304 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8940b35a0 0x7ff8940ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff89259c700 1 -- 172.21.15.133:0/413172304 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8940b35a0 msgr2=0x7ff8940ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:50.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff89259c700 1 --2- 172.21.15.133:0/413172304 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8940b35a0 0x7ff8940ac5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.629 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff89259c700 1 -- 172.21.15.133:0/413172304 >> v2:172.21.15.16:3300/0 conn(0x7ff89409a740 msgr2=0x7ff894144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:50.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff89259c700 1 --2- 172.21.15.133:0/413172304 >> v2:172.21.15.16:3300/0 conn(0x7ff89409a740 0x7ff894144830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.630 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff89259c700 1 -- 172.21.15.133:0/413172304 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff894144390 con 0x7ff8940b3d80 2021-01-03T13:53:50.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff892d9d700 1 --2- 172.21.15.133:0/413172304 >> v2:172.21.15.16:3300/0 conn(0x7ff89409a740 0x7ff894144830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:53:50.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff88bfff700 1 --2- 172.21.15.133:0/413172304 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8940b35a0 0x7ff8940ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-03T13:53:50.631 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff89259c700 1 --2- 172.21.15.133:0/413172304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8940b3d80 0x7ff8940b4160 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7ff884002f30 tx=0x7ff884006e80).ready entity=mon.1 client_cookie=74f249aac9bd8ca2 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff891d9b700 1 -- 172.21.15.133:0/413172304 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8840097f0 con 0x7ff8940b3d80 2021-01-03T13:53:50.632 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff891d9b700 1 -- 172.21.15.133:0/413172304 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff884009950 con 0x7ff8940b3d80 2021-01-03T13:53:50.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff891d9b700 1 -- 172.21.15.133:0/413172304 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff884009cb0 con 0x7ff8940b3d80 2021-01-03T13:53:50.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff898fdb700 1 -- 172.21.15.133:0/413172304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8940b3d80 msgr2=0x7ff8940b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.633 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff898fdb700 1 --2- 172.21.15.133:0/413172304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8940b3d80 0x7ff8940b4160 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7ff884002f30 tx=0x7ff884006e80).stop 2021-01-03T13:53:50.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff898fdb700 1 -- 172.21.15.133:0/413172304 shutdown_connections 2021-01-03T13:53:50.634 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff898fdb700 1 --2- 172.21.15.133:0/413172304 >> v2:172.21.15.16:3300/0 conn(0x7ff89409a740 0x7ff894144830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff898fdb700 1 --2- 172.21.15.133:0/413172304 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8940b3d80 0x7ff8940b4160 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff898fdb700 1 --2- 172.21.15.133:0/413172304 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8940b35a0 0x7ff8940ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.635 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff898fdb700 1 -- 172.21.15.133:0/413172304 >> 172.21.15.133:0/413172304 conn(0x7ff89405bdf0 msgr2=0x7ff89405c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:50.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff898fdb700 1 -- 172.21.15.133:0/413172304 shutdown_connections 2021-01-03T13:53:50.636 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.620+0000 7ff898fdb700 1 -- 172.21.15.133:0/413172304 wait complete. 2021-01-03T13:53:50.641 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff898fdb700 1 Processor -- start 2021-01-03T13:53:50.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff898fdb700 1 -- start start 2021-01-03T13:53:50.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff898fdb700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff89409a740 0x7ff894147600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.642 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff898fdb700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8940b35a0 0x7ff894064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff898fdb700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8940b3d80 0x7ff894065090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.643 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff898fdb700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940b6750 con 0x7ff89409a740 2021-01-03T13:53:50.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff898fdb700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff894062b40 con 0x7ff8940b35a0 2021-01-03T13:53:50.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff898fdb700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940b6a10 con 0x7ff8940b3d80 2021-01-03T13:53:50.644 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff88bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8940b35a0 0x7ff894064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff88bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8940b35a0 0x7ff894064ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41450/0 (socket says 172.21.15.133:41450) 2021-01-03T13:53:50.645 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff88bfff700 1 -- 172.21.15.133:0/1281504353 learned_addr learned my addr 172.21.15.133:0/1281504353 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:50.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff89259c700 1 --2- 172.21.15.133:0/1281504353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff89409a740 0x7ff894147600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.646 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff892d9d700 1 --2- 172.21.15.133:0/1281504353 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8940b3d80 0x7ff894065090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff88bfff700 1 -- 172.21.15.133:0/1281504353 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8940b3d80 msgr2=0x7ff894065090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff88bfff700 1 --2- 172.21.15.133:0/1281504353 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8940b3d80 0x7ff894065090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.647 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff88bfff700 1 -- 172.21.15.133:0/1281504353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff89409a740 msgr2=0x7ff894147600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff88bfff700 1 --2- 172.21.15.133:0/1281504353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff89409a740 0x7ff894147600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.648 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff88bfff700 1 -- 172.21.15.133:0/1281504353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8940b6cb0 con 0x7ff8940b35a0 2021-01-03T13:53:50.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff88bfff700 1 --2- 172.21.15.133:0/1281504353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8940b35a0 0x7ff894064ba0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7ff8940b6890 tx=0x7ff87c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff88b7fe700 1 -- 172.21.15.133:0/1281504353 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff87c007710 con 0x7ff8940b35a0 2021-01-03T13:53:50.649 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff88b7fe700 1 -- 172.21.15.133:0/1281504353 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87c007870 con 0x7ff8940b35a0 2021-01-03T13:53:50.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff898fdb700 1 -- 172.21.15.133:0/1281504353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8940b57f0 con 0x7ff8940b35a0 2021-01-03T13:53:50.650 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff88b7fe700 1 -- 172.21.15.133:0/1281504353 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff87c007bd0 con 0x7ff8940b35a0 2021-01-03T13:53:50.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.624+0000 7ff898fdb700 1 -- 172.21.15.133:0/1281504353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8940b5a90 con 0x7ff8940b35a0 2021-01-03T13:53:50.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.628+0000 7ff898fdb700 1 -- 172.21.15.133:0/1281504353 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff894062c80 con 0x7ff8940b35a0 2021-01-03T13:53:50.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.628+0000 7ff88b7fe700 1 -- 172.21.15.133:0/1281504353 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7ff87c007d30 con 0x7ff8940b35a0 2021-01-03T13:53:50.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.628+0000 7ff88b7fe700 1 --2- 172.21.15.133:0/1281504353 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff878055330 0x7ff8780577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.652 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.628+0000 7ff88b7fe700 1 -- 172.21.15.133:0/1281504353 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7ff87c06de60 con 0x7ff8940b35a0 2021-01-03T13:53:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.628+0000 7ff89259c700 1 --2- 172.21.15.133:0/1281504353 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff878055330 0x7ff8780577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.628+0000 7ff89259c700 1 --2- 172.21.15.133:0/1281504353 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff878055330 0x7ff8780577f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7ff88401a000 tx=0x7ff884015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.632+0000 7ff88b7fe700 1 -- 172.21.15.133:0/1281504353 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff87c044440 con 0x7ff8940b35a0 2021-01-03T13:53:50.776 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.772+0000 7ff898fdb700 1 -- 172.21.15.133:0/1281504353 --> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7ff894147f00 con 0x7ff878055330 2021-01-03T13:53:50.777 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.776+0000 7ff88b7fe700 1 -- 172.21.15.133:0/1281504353 <== mgr.4110 v2:172.21.15.133:6800/11943 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff894147f00 con 0x7ff878055330 2021-01-03T13:53:50.779 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.776+0000 7ff898fdb700 1 -- 172.21.15.133:0/1281504353 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff878055330 msgr2=0x7ff8780577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.776+0000 7ff898fdb700 1 --2- 172.21.15.133:0/1281504353 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff878055330 0x7ff8780577f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7ff88401a000 tx=0x7ff884015000).stop 2021-01-03T13:53:50.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.776+0000 7ff898fdb700 1 -- 172.21.15.133:0/1281504353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8940b35a0 msgr2=0x7ff894064ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.776+0000 7ff898fdb700 1 --2- 172.21.15.133:0/1281504353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8940b35a0 0x7ff894064ba0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 rx=0x7ff8940b6890 tx=0x7ff87c008040).stop 2021-01-03T13:53:50.780 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.776+0000 7ff898fdb700 1 -- 172.21.15.133:0/1281504353 shutdown_connections 2021-01-03T13:53:50.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.776+0000 7ff898fdb700 1 --2- 172.21.15.133:0/1281504353 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7ff878055330 0x7ff8780577f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.776+0000 7ff898fdb700 1 --2- 172.21.15.133:0/1281504353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff89409a740 0x7ff894147600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.776+0000 7ff898fdb700 1 --2- 172.21.15.133:0/1281504353 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7ff8940b3d80 0x7ff894065090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.776+0000 7ff898fdb700 1 --2- 172.21.15.133:0/1281504353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8940b35a0 0x7ff894064ba0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.781 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.776+0000 7ff898fdb700 1 -- 172.21.15.133:0/1281504353 >> 172.21.15.133:0/1281504353 conn(0x7ff89405bdf0 msgr2=0x7ff89413f780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:50.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.776+0000 7ff898fdb700 1 -- 172.21.15.133:0/1281504353 shutdown_connections 2021-01-03T13:53:50.782 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.776+0000 7ff898fdb700 1 -- 172.21.15.133:0/1281504353 wait complete. 2021-01-03T13:53:50.782 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 6 to deep-scrub 2021-01-03T13:53:50.791 INFO:tasks.ceph:Scrubbing osd.7 2021-01-03T13:53:50.791 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 config set osd_debug_deep_scrub_sleep 0 2021-01-03T13:53:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b6228700 1 Processor -- start 2021-01-03T13:53:50.909 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b6228700 1 -- start start 2021-01-03T13:53:50.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b6228700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa1b00b2e90 0x7fa1b0142ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b6228700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1b0061e90 0x7fa1b01401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.911 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b6228700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b01434e0 con 0x7fa1b00613e0 2021-01-03T13:53:50.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b6228700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b01474e0 con 0x7fa1b00b2e90 2021-01-03T13:53:50.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b6228700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b00b3270 con 0x7fa1b0061e90 2021-01-03T13:53:50.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b4a25700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa1b00613e0 0x7fa1b0146dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34260/0 (socket says 172.21.15.133:34260) 2021-01-03T13:53:50.912 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b4a25700 1 -- 172.21.15.133:0/1959230336 learned_addr learned my addr 172.21.15.133:0/1959230336 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:53:50.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b5a27700 1 --2- 172.21.15.133:0/1959230336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1b0061e90 0x7fa1b01401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.913 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b5226700 1 --2- 172.21.15.133:0/1959230336 >> v2:172.21.15.16:3300/0 conn(0x7fa1b00b2e90 0x7fa1b0142ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1a7fff700 1 -- 172.21.15.133:0/1959230336 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234102352 0 0) 0x7fa1a00010d0 con 0x7fa1b00613e0 2021-01-03T13:53:50.915 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1a7fff700 1 -- 172.21.15.133:0/1959230336 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa194003230 con 0x7fa1b00613e0 2021-01-03T13:53:50.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1a7fff700 1 -- 172.21.15.133:0/1959230336 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2601627003 0 0) 0x7fa194003230 con 0x7fa1b00613e0 2021-01-03T13:53:50.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1a7fff700 1 -- 172.21.15.133:0/1959230336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1b0061e90 msgr2=0x7fa1b01401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:50.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1a7fff700 1 --2- 172.21.15.133:0/1959230336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1b0061e90 0x7fa1b01401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.916 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1a7fff700 1 -- 172.21.15.133:0/1959230336 >> v2:172.21.15.16:3300/0 conn(0x7fa1b00b2e90 msgr2=0x7fa1b0142ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:50.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1a7fff700 1 --2- 172.21.15.133:0/1959230336 >> v2:172.21.15.16:3300/0 conn(0x7fa1b00b2e90 0x7fa1b0142ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1a7fff700 1 -- 172.21.15.133:0/1959230336 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b01466d0 con 0x7fa1b00613e0 2021-01-03T13:53:50.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1a7fff700 1 -- 172.21.15.133:0/1959230336 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3555554184 0 0) 0x7fa1a0001860 con 0x7fa1b00613e0 2021-01-03T13:53:50.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1a7fff700 1 -- 172.21.15.133:0/1959230336 >> v1:172.21.15.133:6789/0 conn(0x7fa1b00613e0 legacy=0x7fa1b0146dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.917 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1a7fff700 1 --2- 172.21.15.133:0/1959230336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1b0061e90 0x7fa194003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1a7fff700 1 --2- 172.21.15.133:0/1959230336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa194003c30 0x7fa1940044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1a7fff700 1 --2- 172.21.15.133:0/1959230336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1940049c0 0x7fa194004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.918 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1a7fff700 1 -- 172.21.15.133:0/1959230336 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b01474e0 con 0x7fa1940049c0 2021-01-03T13:53:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1a7fff700 1 -- 172.21.15.133:0/1959230336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b00b3270 con 0x7fa194003c30 2021-01-03T13:53:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1a7fff700 1 -- 172.21.15.133:0/1959230336 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1940041f0 con 0x7fa1b0061e90 2021-01-03T13:53:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b4a25700 1 --2- 172.21.15.133:0/1959230336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa194003c30 0x7fa1940044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.919 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b5a27700 1 --2- 172.21.15.133:0/1959230336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1940049c0 0x7fa194004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b5226700 1 --2- 172.21.15.133:0/1959230336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1b0061e90 0x7fa194003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b4a25700 1 -- 172.21.15.133:0/1959230336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1b0061e90 msgr2=0x7fa194003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b4a25700 1 --2- 172.21.15.133:0/1959230336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1b0061e90 0x7fa194003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.920 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b4a25700 1 -- 172.21.15.133:0/1959230336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1940049c0 msgr2=0x7fa194004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b4a25700 1 --2- 172.21.15.133:0/1959230336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1940049c0 0x7fa194004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b4a25700 1 -- 172.21.15.133:0/1959230336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa194003230 con 0x7fa194003c30 2021-01-03T13:53:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.908+0000 7fa1b5226700 1 --2- 172.21.15.133:0/1959230336 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1b0061e90 0x7fa194003720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-03T13:53:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.912+0000 7fa1b4a25700 1 --2- 172.21.15.133:0/1959230336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa194003c30 0x7fa1940044d0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7fa1a0001570 tx=0x7fa1a0007930).ready entity=mon.1 client_cookie=7a752cba5bc42344 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.921 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.912+0000 7fa1a7fff700 1 -- 172.21.15.133:0/1959230336 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1a00072e0 con 0x7fa194003c30 2021-01-03T13:53:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.912+0000 7fa1a7fff700 1 -- 172.21.15.133:0/1959230336 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a0007440 con 0x7fa194003c30 2021-01-03T13:53:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.912+0000 7fa1a7fff700 1 -- 172.21.15.133:0/1959230336 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1a00057d0 con 0x7fa194003c30 2021-01-03T13:53:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.912+0000 7fa1b6228700 1 -- 172.21.15.133:0/1959230336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa194003c30 msgr2=0x7fa1940044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.922 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.912+0000 7fa1b6228700 1 --2- 172.21.15.133:0/1959230336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa194003c30 0x7fa1940044d0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7fa1a0001570 tx=0x7fa1a0007930).stop 2021-01-03T13:53:50.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.912+0000 7fa1b5a27700 1 -- 172.21.15.133:0/1959230336 reap_dead start 2021-01-03T13:53:50.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.912+0000 7fa1b6228700 1 -- 172.21.15.133:0/1959230336 shutdown_connections 2021-01-03T13:53:50.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.912+0000 7fa1b6228700 1 -- 172.21.15.133:0/1959230336 >> 172.21.15.133:0/1959230336 conn(0x7fa1b006a620 msgr2=0x7fa1b006aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:50.923 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.912+0000 7fa1b6228700 1 -- 172.21.15.133:0/1959230336 shutdown_connections 2021-01-03T13:53:50.924 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.912+0000 7fa1b6228700 1 -- 172.21.15.133:0/1959230336 wait complete. 2021-01-03T13:53:50.926 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.912+0000 7fa1b6228700 1 Processor -- start 2021-01-03T13:53:50.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.912+0000 7fa1b6228700 1 -- start start 2021-01-03T13:53:50.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b6228700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1b0145f40 0x7fa1b0152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b6228700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1b0064d30 0x7fa1b0156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b6228700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1b00ae3e0 0x7fa1b00ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.927 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b6228700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b01556e0 con 0x7fa1b0064d30 2021-01-03T13:53:50.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b6228700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b0146320 con 0x7fa1b00ae3e0 2021-01-03T13:53:50.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b6228700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b00654e0 con 0x7fa1b0145f40 2021-01-03T13:53:50.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b5a27700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1b00ae3e0 0x7fa1b00ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.928 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b5a27700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1b00ae3e0 0x7fa1b00ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41470/0 (socket says 172.21.15.133:41470) 2021-01-03T13:53:50.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b5a27700 1 -- 172.21.15.133:0/4243222960 learned_addr learned my addr 172.21.15.133:0/4243222960 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:50.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b4a25700 1 --2- 172.21.15.133:0/4243222960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1b0064d30 0x7fa1b0156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b5226700 1 --2- 172.21.15.133:0/4243222960 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1b0145f40 0x7fa1b0152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b5a27700 1 -- 172.21.15.133:0/4243222960 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1b0145f40 msgr2=0x7fa1b0152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.929 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b5a27700 1 --2- 172.21.15.133:0/4243222960 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fa1b0145f40 0x7fa1b0152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b5a27700 1 -- 172.21.15.133:0/4243222960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1b0064d30 msgr2=0x7fa1b0156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b5a27700 1 --2- 172.21.15.133:0/4243222960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1b0064d30 0x7fa1b0156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b5a27700 1 -- 172.21.15.133:0/4243222960 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b0065780 con 0x7fa1b00ae3e0 2021-01-03T13:53:50.930 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b5a27700 1 --2- 172.21.15.133:0/4243222960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1b00ae3e0 0x7fa1b00ae890 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7fa1a800b000 tx=0x7fa1a80091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1a67fc700 1 -- 172.21.15.133:0/4243222960 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1a800fab0 con 0x7fa1b00ae3e0 2021-01-03T13:53:50.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1a67fc700 1 -- 172.21.15.133:0/4243222960 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a800fc10 con 0x7fa1b00ae3e0 2021-01-03T13:53:50.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1a67fc700 1 -- 172.21.15.133:0/4243222960 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1a8014440 con 0x7fa1b00ae3e0 2021-01-03T13:53:50.931 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b6228700 1 -- 172.21.15.133:0/4243222960 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b01558d0 con 0x7fa1b00ae3e0 2021-01-03T13:53:50.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b6228700 1 -- 172.21.15.133:0/4243222960 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b0152600 con 0x7fa1b00ae3e0 2021-01-03T13:53:50.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.916+0000 7fa1b6228700 1 -- 172.21.15.133:0/4243222960 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa1b0155d70 con 0x7fa1b00ae3e0 2021-01-03T13:53:50.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.920+0000 7fa1a67fc700 1 -- 172.21.15.133:0/4243222960 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fa1a80145a0 con 0x7fa1b00ae3e0 2021-01-03T13:53:50.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.920+0000 7fa1a67fc700 1 --2- 172.21.15.133:0/4243222960 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa198055440 0x7fa198057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.932 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.920+0000 7fa1a67fc700 1 -- 172.21.15.133:0/4243222960 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fa1a806e470 con 0x7fa1b00ae3e0 2021-01-03T13:53:50.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.920+0000 7fa1b5226700 1 --2- 172.21.15.133:0/4243222960 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa198055440 0x7fa198057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.920+0000 7fa1a67fc700 1 --2- 172.21.15.133:0/4243222960 >> [v2:172.21.15.16:6816/12674,v1:172.21.15.16:6818/12674] conn(0x7fa19805bb50 0x7fa19805df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:50.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.920+0000 7fa1a67fc700 1 -- 172.21.15.133:0/4243222960 --> [v2:172.21.15.16:6816/12674,v1:172.21.15.16:6818/12674] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa19805e550 con 0x7fa19805bb50 2021-01-03T13:53:50.933 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.920+0000 7fa1a67fc700 1 -- 172.21.15.133:0/4243222960 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=165) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1a8070aa0 con 0x7fa1b00ae3e0 2021-01-03T13:53:50.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.920+0000 7fa1b5226700 1 --2- 172.21.15.133:0/4243222960 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa198055440 0x7fa198057900 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7fa1ac008000 tx=0x7fa1ac008040).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.920+0000 7fa1b4a25700 1 --2- 172.21.15.133:0/4243222960 >> [v2:172.21.15.16:6816/12674,v1:172.21.15.16:6818/12674] conn(0x7fa19805bb50 0x7fa19805df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:50.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.920+0000 7fa1b4a25700 1 --2- 172.21.15.133:0/4243222960 >> [v2:172.21.15.16:6816/12674,v1:172.21.15.16:6818/12674] conn(0x7fa19805bb50 0x7fa19805df70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:50.934 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.924+0000 7fa1a67fc700 1 -- 172.21.15.133:0/4243222960 <== osd.7 v2:172.21.15.16:6816/12674 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7fa19805e550 con 0x7fa19805bb50 2021-01-03T13:53:50.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.944+0000 7fa1b6228700 1 -- 172.21.15.133:0/4243222960 --> [v2:172.21.15.16:6816/12674,v1:172.21.15.16:6818/12674] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa1b0065910 con 0x7fa19805bb50 2021-01-03T13:53:50.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.944+0000 7fa1a67fc700 1 -- 172.21.15.133:0/4243222960 <== osd.7 v2:172.21.15.16:6816/12674 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa1b0065910 con 0x7fa19805bb50 2021-01-03T13:53:50.948 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2021-01-03T13:53:50.948 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-01-03T13:53:50.948 INFO:teuthology.orchestra.run.smithi133.stdout:} 2021-01-03T13:53:50.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.944+0000 7fa1b6228700 1 -- 172.21.15.133:0/4243222960 >> [v2:172.21.15.16:6816/12674,v1:172.21.15.16:6818/12674] conn(0x7fa19805bb50 msgr2=0x7fa19805df70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.944+0000 7fa1b6228700 1 --2- 172.21.15.133:0/4243222960 >> [v2:172.21.15.16:6816/12674,v1:172.21.15.16:6818/12674] conn(0x7fa19805bb50 0x7fa19805df70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:50.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.944+0000 7fa1b6228700 1 -- 172.21.15.133:0/4243222960 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa198055440 msgr2=0x7fa198057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.944+0000 7fa1b6228700 1 --2- 172.21.15.133:0/4243222960 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fa198055440 0x7fa198057900 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7fa1ac008000 tx=0x7fa1ac008040).stop 2021-01-03T13:53:50.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.944+0000 7fa1b6228700 1 -- 172.21.15.133:0/4243222960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1b00ae3e0 msgr2=0x7fa1b00ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:50.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.944+0000 7fa1b6228700 1 --2- 172.21.15.133:0/4243222960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1b00ae3e0 0x7fa1b00ae890 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 rx=0x7fa1a800b000 tx=0x7fa1a80091a0).stop 2021-01-03T13:53:50.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.944+0000 7fa1b5a27700 1 -- 172.21.15.133:0/4243222960 reap_dead start 2021-01-03T13:53:50.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.944+0000 7fa1b6228700 1 -- 172.21.15.133:0/4243222960 shutdown_connections 2021-01-03T13:53:50.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.944+0000 7fa1b6228700 1 -- 172.21.15.133:0/4243222960 >> 172.21.15.133:0/4243222960 conn(0x7fa1b006a620 msgr2=0x7fa1b0140250 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:50.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.944+0000 7fa1b6228700 1 -- 172.21.15.133:0/4243222960 shutdown_connections 2021-01-03T13:53:50.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:50.948+0000 7fa1b6228700 1 -- 172.21.15.133:0/4243222960 wait complete. 2021-01-03T13:53:50.961 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd deep-scrub 7 2021-01-03T13:53:51.076 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.072+0000 7fc31f59e700 1 Processor -- start 2021-01-03T13:53:51.077 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.072+0000 7fc31f59e700 1 -- start start 2021-01-03T13:53:51.079 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31f59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc320060510 0x7fc32005c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:51.079 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31f59e700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc32005fd10 0x7fc3200b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:51.079 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31f59e700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32005bf00 con 0x7fc3200b4c20 2021-01-03T13:53:51.079 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31f59e700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32005c1a0 con 0x7fc32005fd10 2021-01-03T13:53:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31f59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32005c440 con 0x7fc320060510 2021-01-03T13:53:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31dd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc320060510 0x7fc32005c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31dd9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc320060510 0x7fc32005c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41482/0 (socket says 172.21.15.133:41482) 2021-01-03T13:53:51.080 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31dd9b700 1 -- 172.21.15.133:0/2828507311 learned_addr learned my addr 172.21.15.133:0/2828507311 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31ed9d700 1 --2- 172.21.15.133:0/2828507311 >> v2:172.21.15.16:3300/0 conn(0x7fc32005fd10 0x7fc3200b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31d59a700 1 -- 172.21.15.133:0/2828507311 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598080399 0 0) 0x7fc32005bf00 con 0x7fc3200b4c20 2021-01-03T13:53:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31d59a700 1 -- 172.21.15.133:0/2828507311 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc304003230 con 0x7fc3200b4c20 2021-01-03T13:53:51.081 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31dd9b700 1 -- 172.21.15.133:0/2828507311 >> v2:172.21.15.16:3300/0 conn(0x7fc32005fd10 msgr2=0x7fc3200b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:53:51.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31dd9b700 1 --2- 172.21.15.133:0/2828507311 >> v2:172.21.15.16:3300/0 conn(0x7fc32005fd10 0x7fc3200b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:51.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31dd9b700 1 -- 172.21.15.133:0/2828507311 >> v1:172.21.15.16:6789/0 conn(0x7fc3200b4c20 legacy=0x7fc3200b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:51.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31dd9b700 1 -- 172.21.15.133:0/2828507311 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3200b6ad0 con 0x7fc320060510 2021-01-03T13:53:51.082 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31dd9b700 1 --2- 172.21.15.133:0/2828507311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc320060510 0x7fc32005c8e0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7fc308002f30 tx=0x7fc308006e80).ready entity=mon.1 client_cookie=a31b8ce8bf146934 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31d59a700 1 -- 172.21.15.133:0/2828507311 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc308009640 con 0x7fc320060510 2021-01-03T13:53:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31d59a700 1 -- 172.21.15.133:0/2828507311 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3080097a0 con 0x7fc320060510 2021-01-03T13:53:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31d59a700 1 -- 172.21.15.133:0/2828507311 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc308009b00 con 0x7fc320060510 2021-01-03T13:53:51.083 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31f59e700 1 -- 172.21.15.133:0/2828507311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc320060510 msgr2=0x7fc32005c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:51.084 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31f59e700 1 --2- 172.21.15.133:0/2828507311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc320060510 0x7fc32005c8e0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 rx=0x7fc308002f30 tx=0x7fc308006e80).stop 2021-01-03T13:53:51.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31f59e700 1 -- 172.21.15.133:0/2828507311 shutdown_connections 2021-01-03T13:53:51.086 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31f59e700 1 --2- 172.21.15.133:0/2828507311 >> v2:172.21.15.16:3300/0 conn(0x7fc32005fd10 0x7fc3200b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:51.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31f59e700 1 --2- 172.21.15.133:0/2828507311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc320060510 0x7fc32005c8e0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:51.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31f59e700 1 -- 172.21.15.133:0/2828507311 >> 172.21.15.133:0/2828507311 conn(0x7fc3200b9f00 msgr2=0x7fc3200b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:51.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31f59e700 1 -- 172.21.15.133:0/2828507311 shutdown_connections 2021-01-03T13:53:51.087 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.076+0000 7fc31f59e700 1 -- 172.21.15.133:0/2828507311 wait complete. 2021-01-03T13:53:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31f59e700 1 Processor -- start 2021-01-03T13:53:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31f59e700 1 -- start start 2021-01-03T13:53:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc32005fd10 0x7fc3200b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:51.088 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31f59e700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc320060510 0x7fc32009e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31f59e700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3200b4c20 0x7fc320149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31f59e700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc320148ce0 con 0x7fc320060510 2021-01-03T13:53:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200b3b00 con 0x7fc32005fd10 2021-01-03T13:53:51.089 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31f59e700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200b3700 con 0x7fc3200b4c20 2021-01-03T13:53:51.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc32005fd10 0x7fc3200b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:51.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31e59c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc32005fd10 0x7fc3200b07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41488/0 (socket says 172.21.15.133:41488) 2021-01-03T13:53:51.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31dd9b700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc320060510 0x7fc32009e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:51.090 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31e59c700 1 -- 172.21.15.133:0/3227901640 learned_addr learned my addr 172.21.15.133:0/3227901640 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31ed9d700 1 --2- 172.21.15.133:0/3227901640 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3200b4c20 0x7fc320149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31e59c700 1 -- 172.21.15.133:0/3227901640 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3200b4c20 msgr2=0x7fc320149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31e59c700 1 --2- 172.21.15.133:0/3227901640 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3200b4c20 0x7fc320149830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:51.091 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31e59c700 1 -- 172.21.15.133:0/3227901640 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc320060510 msgr2=0x7fc32009e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31e59c700 1 --2- 172.21.15.133:0/3227901640 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc320060510 0x7fc32009e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31e59c700 1 -- 172.21.15.133:0/3227901640 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32009f220 con 0x7fc32005fd10 2021-01-03T13:53:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31e59c700 1 --2- 172.21.15.133:0/3227901640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc32005fd10 0x7fc3200b07a0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7fc310001450 tx=0x7fc310007e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:51.092 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc3177fe700 1 -- 172.21.15.133:0/3227901640 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc310002240 con 0x7fc32005fd10 2021-01-03T13:53:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc3177fe700 1 -- 172.21.15.133:0/3227901640 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3100023a0 con 0x7fc32005fd10 2021-01-03T13:53:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31f59e700 1 -- 172.21.15.133:0/3227901640 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc320148800 con 0x7fc32005fd10 2021-01-03T13:53:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc3177fe700 1 -- 172.21.15.133:0/3227901640 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc31000a790 con 0x7fc32005fd10 2021-01-03T13:53:51.093 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.080+0000 7fc31f59e700 1 -- 172.21.15.133:0/3227901640 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3200b33f0 con 0x7fc32005fd10 2021-01-03T13:53:51.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.084+0000 7fc3177fe700 1 -- 172.21.15.133:0/3227901640 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7fc310010070 con 0x7fc32005fd10 2021-01-03T13:53:51.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.084+0000 7fc31f59e700 1 -- 172.21.15.133:0/3227901640 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3201489f0 con 0x7fc32005fd10 2021-01-03T13:53:51.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.084+0000 7fc3177fe700 1 --2- 172.21.15.133:0/3227901640 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc2f8055440 0x7fc2f8057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:51.094 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.084+0000 7fc31dd9b700 1 --2- 172.21.15.133:0/3227901640 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc2f8055440 0x7fc2f8057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:51.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.084+0000 7fc3177fe700 1 -- 172.21.15.133:0/3227901640 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fc310004020 con 0x7fc32005fd10 2021-01-03T13:53:51.095 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.084+0000 7fc31dd9b700 1 --2- 172.21.15.133:0/3227901640 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc2f8055440 0x7fc2f8057900 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7fc30801b000 tx=0x7fc308015000).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:51.096 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.088+0000 7fc3177fe700 1 -- 172.21.15.133:0/3227901640 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc3201489f0 con 0x7fc32005fd10 2021-01-03T13:53:51.228 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.224+0000 7fc31f59e700 1 -- 172.21.15.133:0/3227901640 --> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3200b3980 con 0x7fc2f8055440 2021-01-03T13:53:51.229 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.228+0000 7fc3177fe700 1 -- 172.21.15.133:0/3227901640 <== mgr.4110 v2:172.21.15.133:6800/11943 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc3080069f0 con 0x7fc2f8055440 2021-01-03T13:53:51.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.228+0000 7fc31f59e700 1 -- 172.21.15.133:0/3227901640 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc2f8055440 msgr2=0x7fc2f8057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:51.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.228+0000 7fc31f59e700 1 --2- 172.21.15.133:0/3227901640 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc2f8055440 0x7fc2f8057900 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7fc30801b000 tx=0x7fc308015000).stop 2021-01-03T13:53:51.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.228+0000 7fc31f59e700 1 -- 172.21.15.133:0/3227901640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc32005fd10 msgr2=0x7fc3200b07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:51.231 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.228+0000 7fc31f59e700 1 --2- 172.21.15.133:0/3227901640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc32005fd10 0x7fc3200b07a0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7fc310001450 tx=0x7fc310007e30).stop 2021-01-03T13:53:51.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.228+0000 7fc31f59e700 1 -- 172.21.15.133:0/3227901640 shutdown_connections 2021-01-03T13:53:51.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.228+0000 7fc31f59e700 1 --2- 172.21.15.133:0/3227901640 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7fc2f8055440 0x7fc2f8057900 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:51.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.228+0000 7fc31f59e700 1 --2- 172.21.15.133:0/3227901640 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7fc3200b4c20 0x7fc320149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:51.232 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.228+0000 7fc31f59e700 1 --2- 172.21.15.133:0/3227901640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc32005fd10 0x7fc3200b07a0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:51.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.228+0000 7fc31f59e700 1 --2- 172.21.15.133:0/3227901640 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc320060510 0x7fc32009e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:51.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.228+0000 7fc31f59e700 1 -- 172.21.15.133:0/3227901640 >> 172.21.15.133:0/3227901640 conn(0x7fc3200b9f00 msgr2=0x7fc3200b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:51.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.228+0000 7fc31f59e700 1 -- 172.21.15.133:0/3227901640 shutdown_connections 2021-01-03T13:53:51.233 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.228+0000 7fc31f59e700 1 -- 172.21.15.133:0/3227901640 wait complete. 2021-01-03T13:53:51.234 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 7 to deep-scrub 2021-01-03T13:53:51.242 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2021-01-03T13:53:51.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.348+0000 7f0256ea0700 1 Processor -- start 2021-01-03T13:53:51.351 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.348+0000 7f0256ea0700 1 -- start start 2021-01-03T13:53:51.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.348+0000 7f0256ea0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f02501406b0 0x7f02500676c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:51.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.348+0000 7f0256ea0700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02500b2780 con 0x7f02500b23a0 2021-01-03T13:53:51.352 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.348+0000 7f0256ea0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02500a9480 con 0x7f02500af780 2021-01-03T13:53:51.353 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.348+0000 7f0256ea0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02500aef00 con 0x7f02501406b0 2021-01-03T13:53:51.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.348+0000 7f025569d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f02501406b0 0x7f02500676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:51.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.348+0000 7f025669f700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f02500af780 0x7f02500b0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34298/0 (socket says 172.21.15.133:34298) 2021-01-03T13:53:51.354 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.348+0000 7f025669f700 1 -- 172.21.15.133:0/3225465084 learned_addr learned my addr 172.21.15.133:0/3225465084 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:53:51.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.348+0000 7f025569d700 1 --2- 172.21.15.133:0/3225465084 >> v2:172.21.15.133:3300/0 conn(0x7f02501406b0 0x7f02500676c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41496/0 (socket says 172.21.15.133:41496) 2021-01-03T13:53:51.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.352+0000 7f025569d700 1 -- 172.21.15.133:0/3225465084 >> v1:172.21.15.133:6789/0 conn(0x7f02500af780 legacy=0x7f02500b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:51.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.352+0000 7f025569d700 1 -- 172.21.15.133:0/3225465084 >> v1:172.21.15.16:6789/0 conn(0x7f02500b23a0 legacy=0x7f0250066fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:51.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.352+0000 7f025569d700 1 -- 172.21.15.133:0/3225465084 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025013fa30 con 0x7f02501406b0 2021-01-03T13:53:51.355 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.352+0000 7f0254e9c700 1 -- 172.21.15.133:0/3225465084 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672444299 0 0) 0x7f02500b2780 con 0x7f02500b23a0 2021-01-03T13:53:51.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.352+0000 7f025569d700 1 --2- 172.21.15.133:0/3225465084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02501406b0 0x7f02500676c0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f0240002f30 tx=0x7f0240006e50).ready entity=mon.1 client_cookie=7745632a7bcf2c5f server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:51.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.352+0000 7f0254e9c700 1 -- 172.21.15.133:0/3225465084 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0240010470 con 0x7f02501406b0 2021-01-03T13:53:51.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.352+0000 7f0254e9c700 1 -- 172.21.15.133:0/3225465084 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02400105d0 con 0x7f02501406b0 2021-01-03T13:53:51.356 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.352+0000 7f0254e9c700 1 -- 172.21.15.133:0/3225465084 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0240010930 con 0x7f02501406b0 2021-01-03T13:53:51.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.352+0000 7f0256ea0700 1 -- 172.21.15.133:0/3225465084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02501406b0 msgr2=0x7f02500676c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:51.357 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.352+0000 7f0256ea0700 1 --2- 172.21.15.133:0/3225465084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02501406b0 0x7f02500676c0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f0240002f30 tx=0x7f0240006e50).stop 2021-01-03T13:53:51.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.352+0000 7f0256ea0700 1 -- 172.21.15.133:0/3225465084 shutdown_connections 2021-01-03T13:53:51.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.352+0000 7f0256ea0700 1 --2- 172.21.15.133:0/3225465084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02501406b0 0x7f02500676c0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:51.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.352+0000 7f0256ea0700 1 -- 172.21.15.133:0/3225465084 >> 172.21.15.133:0/3225465084 conn(0x7f025006b050 msgr2=0x7f0250060540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:51.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.352+0000 7f0256ea0700 1 -- 172.21.15.133:0/3225465084 shutdown_connections 2021-01-03T13:53:51.359 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.352+0000 7f0256ea0700 1 -- 172.21.15.133:0/3225465084 wait complete. 2021-01-03T13:53:51.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0256ea0700 1 Processor -- start 2021-01-03T13:53:51.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0256ea0700 1 -- start start 2021-01-03T13:53:51.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0256ea0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02500af780 0x7f0250142160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:51.360 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0256ea0700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02500b23a0 0x7f025013ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:51.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0256ea0700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02501406b0 0x7f02501431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:51.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0256ea0700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02500642a0 con 0x7f02501406b0 2021-01-03T13:53:51.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0256ea0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0250065630 con 0x7f02500af780 2021-01-03T13:53:51.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0256ea0700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0250064c50 con 0x7f02500b23a0 2021-01-03T13:53:51.361 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0255e9e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02500af780 0x7f0250142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:51.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0255e9e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02500af780 0x7f0250142160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41500/0 (socket says 172.21.15.133:41500) 2021-01-03T13:53:51.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0255e9e700 1 -- 172.21.15.133:0/3726770305 learned_addr learned my addr 172.21.15.133:0/3726770305 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:53:51.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f025669f700 1 --2- 172.21.15.133:0/3726770305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02501406b0 0x7f02501431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:51.362 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f025569d700 1 --2- 172.21.15.133:0/3726770305 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02500b23a0 0x7f025013ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:51.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0255e9e700 1 -- 172.21.15.133:0/3726770305 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02500b23a0 msgr2=0x7f025013ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:51.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0255e9e700 1 --2- 172.21.15.133:0/3726770305 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02500b23a0 0x7f025013ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:51.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0255e9e700 1 -- 172.21.15.133:0/3726770305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02501406b0 msgr2=0x7f02501431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:51.363 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0255e9e700 1 --2- 172.21.15.133:0/3726770305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02501406b0 0x7f02501431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:51.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0255e9e700 1 -- 172.21.15.133:0/3726770305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0250064ef0 con 0x7f02500af780 2021-01-03T13:53:51.364 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0255e9e700 1 --2- 172.21.15.133:0/3726770305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02500af780 0x7f0250142160 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7f024c000f00 tx=0x7f024c007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:51.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f023effd700 1 -- 172.21.15.133:0/3726770305 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f024c00a7b0 con 0x7f02500af780 2021-01-03T13:53:51.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f023effd700 1 -- 172.21.15.133:0/3726770305 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c00a910 con 0x7f02500af780 2021-01-03T13:53:51.365 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0256ea0700 1 -- 172.21.15.133:0/3726770305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0250065190 con 0x7f02500af780 2021-01-03T13:53:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f023effd700 1 -- 172.21.15.133:0/3726770305 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f024c00ac70 con 0x7f02500af780 2021-01-03T13:53:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0256ea0700 1 -- 172.21.15.133:0/3726770305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0250142a60 con 0x7f02500af780 2021-01-03T13:53:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.356+0000 7f0256ea0700 1 -- 172.21.15.133:0/3726770305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0250057300 con 0x7f02500af780 2021-01-03T13:53:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.360+0000 7f023effd700 1 -- 172.21.15.133:0/3726770305 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f024c019030 con 0x7f02500af780 2021-01-03T13:53:51.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.360+0000 7f023effd700 1 --2- 172.21.15.133:0/3726770305 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0230055440 0x7f0230057900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:53:51.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.360+0000 7f023effd700 1 -- 172.21.15.133:0/3726770305 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f024c06d430 con 0x7f02500af780 2021-01-03T13:53:51.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.360+0000 7f025569d700 1 --2- 172.21.15.133:0/3726770305 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0230055440 0x7f0230057900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:53:51.367 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.360+0000 7f025569d700 1 --2- 172.21.15.133:0/3726770305 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0230055440 0x7f0230057900 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f024001a000 tx=0x7f02500afd00).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:53:51.368 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.364+0000 7f023effd700 1 -- 172.21.15.133:0/3726770305 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f024c041df0 con 0x7f02500af780 2021-01-03T13:53:51.502 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.500+0000 7f0256ea0700 1 -- 172.21.15.133:0/3726770305 --> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02500abd00 con 0x7f0230055440 2021-01-03T13:53:51.506 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.504+0000 7f023effd700 1 -- 172.21.15.133:0/3726770305 <== mgr.4110 v2:172.21.15.133:6800/11943 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66127 (secure 0 0 0) 0x7f02500abd00 con 0x7f0230055440 2021-01-03T13:53:51.507 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:53:51.508 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.504+0000 7f0256ea0700 1 -- 172.21.15.133:0/3726770305 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0230055440 msgr2=0x7f0230057900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:51.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.504+0000 7f0256ea0700 1 --2- 172.21.15.133:0/3726770305 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0230055440 0x7f0230057900 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f024001a000 tx=0x7f02500afd00).stop 2021-01-03T13:53:51.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.504+0000 7f0256ea0700 1 -- 172.21.15.133:0/3726770305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02500af780 msgr2=0x7f0250142160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:53:51.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.504+0000 7f0256ea0700 1 --2- 172.21.15.133:0/3726770305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02500af780 0x7f0250142160 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7f024c000f00 tx=0x7f024c007dc0).stop 2021-01-03T13:53:51.509 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.504+0000 7f0256ea0700 1 -- 172.21.15.133:0/3726770305 shutdown_connections 2021-01-03T13:53:51.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.504+0000 7f0256ea0700 1 --2- 172.21.15.133:0/3726770305 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f0230055440 0x7f0230057900 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:51.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.504+0000 7f0256ea0700 1 --2- 172.21.15.133:0/3726770305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02501406b0 0x7f02501431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:51.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.504+0000 7f0256ea0700 1 --2- 172.21.15.133:0/3726770305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02500af780 0x7f0250142160 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:51.510 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.504+0000 7f0256ea0700 1 --2- 172.21.15.133:0/3726770305 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f02500b23a0 0x7f025013ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:53:51.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.504+0000 7f0256ea0700 1 -- 172.21.15.133:0/3726770305 >> 172.21.15.133:0/3726770305 conn(0x7f025006b050 msgr2=0x7f02500add20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:53:51.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.504+0000 7f0256ea0700 1 -- 172.21.15.133:0/3726770305 shutdown_connections 2021-01-03T13:53:51.511 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:53:51.504+0000 7f0256ea0700 1 -- 172.21.15.133:0/3726770305 wait complete. 2021-01-03T13:53:51.511 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2021-01-03T13:53:51.521 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":1837,"stamp":"2021-01-03T13:53:50.000091+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8405056,"kb_used_data":16384,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569664,"statfs":{"total":773094113280,"available":764487335936,"internally_reserved":8589934592,"allocated":16777216,"data_stored":7805040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003401"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":"139","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.361062+0000","last_change":"2021-01-03T12:57:57.354556+0000","last_active":"2021-01-03T13:08:14.361062+0000","last_peered":"2021-01-03T13:08:14.361062+0000","last_clean":"2021-01-03T13:08:14.361062+0000","last_became_active":"2021-01-03T12:57:57.354020+0000","last_became_peered":"2021-01-03T12:57:57.354020+0000","last_unstale":"2021-01-03T13:08:14.361062+0000","last_undegraded":"2021-01-03T13:08:14.361062+0000","last_fullsized":"2021-01-03T13:08:14.361062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"138","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.363827+0000","last_change":"2021-01-03T12:57:57.348550+0000","last_active":"2021-01-03T13:08:14.363827+0000","last_peered":"2021-01-03T13:08:14.363827+0000","last_clean":"2021-01-03T13:08:14.363827+0000","last_became_active":"2021-01-03T12:57:57.348011+0000","last_became_peered":"2021-01-03T12:57:57.348011+0000","last_unstale":"2021-01-03T13:08:14.363827+0000","last_undegraded":"2021-01-03T13:08:14.363827+0000","last_fullsized":"2021-01-03T13:08:14.363827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"150","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.360452+0000","last_change":"2021-01-03T12:57:57.494403+0000","last_active":"2021-01-03T13:08:14.360452+0000","last_peered":"2021-01-03T13:08:14.360452+0000","last_clean":"2021-01-03T13:08:14.360452+0000","last_became_active":"2021-01-03T12:57:57.493742+0000","last_became_peered":"2021-01-03T12:57:57.493742+0000","last_unstale":"2021-01-03T13:08:14.360452+0000","last_undegraded":"2021-01-03T13:08:14.360452+0000","last_fullsized":"2021-01-03T13:08:14.360452+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"138","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.363915+0000","last_change":"2021-01-03T12:57:57.345066+0000","last_active":"2021-01-03T13:08:14.363915+0000","last_peered":"2021-01-03T13:08:14.363915+0000","last_clean":"2021-01-03T13:08:14.363915+0000","last_became_active":"2021-01-03T12:57:57.344536+0000","last_became_peered":"2021-01-03T12:57:57.344536+0000","last_unstale":"2021-01-03T13:08:14.363915+0000","last_undegraded":"2021-01-03T13:08:14.363915+0000","last_fullsized":"2021-01-03T13:08:14.363915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"152","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.282783+0000","last_change":"2021-01-03T12:57:52.089767+0000","last_active":"2021-01-03T13:08:14.282783+0000","last_peered":"2021-01-03T13:08:14.282783+0000","last_clean":"2021-01-03T13:08:14.282783+0000","last_became_active":"2021-01-03T12:57:52.088788+0000","last_became_peered":"2021-01-03T12:57:52.088788+0000","last_unstale":"2021-01-03T13:08:14.282783+0000","last_undegraded":"2021-01-03T13:08:14.282783+0000","last_fullsized":"2021-01-03T13:08:14.282783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:48.019621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:48.019621+0000","last_clean_scrub_stamp":"2021-01-03T12:57:48.019621+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"147","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.283119+0000","last_change":"2021-01-03T12:57:57.344690+0000","last_active":"2021-01-03T13:08:14.283119+0000","last_peered":"2021-01-03T13:08:14.283119+0000","last_clean":"2021-01-03T13:08:14.283119+0000","last_became_active":"2021-01-03T12:57:57.344012+0000","last_became_peered":"2021-01-03T12:57:57.344012+0000","last_unstale":"2021-01-03T13:08:14.283119+0000","last_undegraded":"2021-01-03T13:08:14.283119+0000","last_fullsized":"2021-01-03T13:08:14.283119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"147","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.284215+0000","last_change":"2021-01-03T12:57:57.356385+0000","last_active":"2021-01-03T13:08:14.284215+0000","last_peered":"2021-01-03T13:08:14.284215+0000","last_clean":"2021-01-03T13:08:14.284215+0000","last_became_active":"2021-01-03T12:57:57.355963+0000","last_became_peered":"2021-01-03T12:57:57.355963+0000","last_unstale":"2021-01-03T13:08:14.284215+0000","last_undegraded":"2021-01-03T13:08:14.284215+0000","last_fullsized":"2021-01-03T13:08:14.284215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"139","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.362262+0000","last_change":"2021-01-03T12:57:57.342113+0000","last_active":"2021-01-03T13:08:14.362262+0000","last_peered":"2021-01-03T13:08:14.362262+0000","last_clean":"2021-01-03T13:08:14.362262+0000","last_became_active":"2021-01-03T12:57:57.341496+0000","last_became_peered":"2021-01-03T12:57:57.341496+0000","last_unstale":"2021-01-03T13:08:14.362262+0000","last_undegraded":"2021-01-03T13:08:14.362262+0000","last_fullsized":"2021-01-03T13:08:14.362262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"137","reported_epoch":"164","state":"active+clean","last_fresh":"2021-01-03T13:08:14.362523+0000","last_change":"2021-01-03T12:57:57.346557+0000","last_active":"2021-01-03T13:08:14.362523+0000","last_peered":"2021-01-03T13:08:14.362523+0000","last_clean":"2021-01-03T13:08:14.362523+0000","last_became_active":"2021-01-03T12:57:57.346072+0000","last_became_peered":"2021-01-03T12:57:57.346072+0000","last_unstale":"2021-01-03T13:08:14.362523+0000","last_undegraded":"2021-01-03T13:08:14.362523+0000","last_fullsized":"2021-01-03T13:08:14.362523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T12:57:56.318129+0000","last_clean_scrub_stamp":"2021-01-03T12:57:56.318129+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542818,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:43 2021","interfaces":[{"interface":"back","average":{"1min":1.823,"5min":1.8029999999999999,"15min":1.742},"min":{"1min":1.264,"5min":1.264,"15min":1.1220000000000001},"max":{"1min":3.089,"5min":3.1720000000000002,"15min":3.1720000000000002},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.8120000000000001,"5min":1.96,"15min":1.833},"min":{"1min":1.339,"5min":1.1619999999999999,"15min":1.1619999999999999},"max":{"1min":2.577,"5min":3.863,"15min":3.863},"last":1.8839999999999999}]},{"osd":1,"last update":"Sun Jan 3 13:53:43 2021","interfaces":[{"interface":"back","average":{"1min":2.0489999999999999,"5min":2.036,"15min":1.968},"min":{"1min":1.474,"5min":1.474,"15min":1.306},"max":{"1min":3.3250000000000002,"5min":3.3250000000000002,"15min":3.371},"last":1.792},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.1549999999999998,"15min":2.2469999999999999},"min":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.377},"max":{"1min":3.5329999999999999,"5min":3.5329999999999999,"15min":4.2910000000000004},"last":2.5939999999999999}]},{"osd":2,"last update":"Sun Jan 3 13:53:43 2021","interfaces":[{"interface":"back","average":{"1min":2.4329999999999998,"5min":2.2850000000000001,"15min":2.343},"min":{"1min":1.8799999999999999,"5min":1.4419999999999999,"15min":1.292},"max":{"1min":3.4220000000000002,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":2.7120000000000002},{"interface":"front","average":{"1min":2.516,"5min":2.2930000000000001,"15min":2.294},"min":{"1min":1.772,"5min":1.3069999999999999,"15min":1.2110000000000001},"max":{"1min":3.0089999999999999,"5min":3.601,"15min":3.601},"last":2.7949999999999999}]},{"osd":3,"last update":"Sun Jan 3 13:53:43 2021","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":2.427,"15min":2.468},"min":{"1min":1.863,"5min":1.367,"15min":1.367},"max":{"1min":3.218,"5min":3.218,"15min":3.9950000000000001},"last":2.3940000000000001},{"interface":"front","average":{"1min":2.6419999999999999,"5min":2.5960000000000001,"15min":2.5630000000000002},"min":{"1min":1.9239999999999999,"5min":1.788,"15min":1.645},"max":{"1min":3.4470000000000001,"5min":3.4470000000000001,"15min":3.875},"last":3.0070000000000001}]},{"osd":4,"last update":"Sun Jan 3 13:53:43 2021","interfaces":[{"interface":"back","average":{"1min":2.8999999999999999,"5min":2.7610000000000001,"15min":2.8109999999999999},"min":{"1min":1.724,"5min":1.371,"15min":1.371},"max":{"1min":3.7069999999999999,"5min":3.7069999999999999,"15min":4.1349999999999998},"last":3.3490000000000002},{"interface":"front","average":{"1min":2.8159999999999998,"5min":2.7650000000000001,"15min":2.798},"min":{"1min":2.1989999999999998,"5min":1.6459999999999999,"15min":1.6459999999999999},"max":{"1min":3.4510000000000001,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":3.1179999999999999}]},{"osd":5,"last update":"Sun Jan 3 13:53:43 2021","interfaces":[{"interface":"back","average":{"1min":2.8759999999999999,"5min":2.7890000000000001,"15min":2.823},"min":{"1min":2.2000000000000002,"5min":1.476,"15min":1.476},"max":{"1min":3.5529999999999999,"5min":3.6099999999999999,"15min":4.4109999999999996},"last":3.1960000000000002},{"interface":"front","average":{"1min":3.1539999999999999,"5min":3.0350000000000001,"15min":3.109},"min":{"1min":2.2930000000000001,"5min":1.474,"15min":1.3959999999999999},"max":{"1min":3.9750000000000001,"5min":4.3330000000000002,"15min":4.6779999999999999},"last":3.544}]},{"osd":6,"last update":"Sun Jan 3 13:53:43 2021","interfaces":[{"interface":"back","average":{"1min":3.181,"5min":3.1349999999999998,"15min":3.1150000000000002},"min":{"1min":2.5830000000000002,"5min":1.2030000000000001,"15min":1.2030000000000001},"max":{"1min":3.8250000000000002,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":3.6920000000000002},{"interface":"front","average":{"1min":3.4279999999999999,"5min":3.3639999999999999,"15min":3.3410000000000002},"min":{"1min":2.8559999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"max":{"1min":4.1929999999999996,"5min":5.5919999999999996,"15min":5.5919999999999996},"last":3.4809999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542818,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.0009999999999999,"5min":1.8859999999999999,"15min":1.804},"min":{"1min":1.264,"5min":1.264,"15min":1.171},"max":{"1min":2.8919999999999999,"5min":4.1349999999999998,"15min":4.1349999999999998},"last":1.923},{"interface":"front","average":{"1min":1.718,"5min":1.891,"15min":1.7989999999999999},"min":{"1min":1.47,"5min":1.319,"15min":1.2569999999999999},"max":{"1min":2.6200000000000001,"5min":3.0920000000000001,"15min":3.347},"last":1.6160000000000001}]},{"osd":1,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.1890000000000001,"5min":2.306,"15min":2.2829999999999999},"min":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.2829999999999999},"max":{"1min":3.843,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":2.8170000000000002},{"interface":"front","average":{"1min":2.6970000000000001,"5min":2.7639999999999998,"15min":2.694},"min":{"1min":2.02,"5min":1.4770000000000001,"15min":1.464},"max":{"1min":3.3929999999999998,"5min":4.375,"15min":4.375},"last":2.8849999999999998}]},{"osd":2,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.177,"5min":2.0419999999999998,"15min":2.0150000000000001},"min":{"1min":1.6539999999999999,"5min":1.4330000000000001,"15min":1.2470000000000001},"max":{"1min":3.0870000000000002,"5min":3.8260000000000001,"15min":3.8260000000000001},"last":1.7210000000000001},{"interface":"front","average":{"1min":2.5230000000000001,"5min":2.556,"15min":2.4969999999999999},"min":{"1min":1.6499999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"max":{"1min":3.319,"5min":4.9359999999999999,"15min":4.9359999999999999},"last":2.4169999999999998}]},{"osd":3,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.3900000000000001,"5min":2.359,"15min":2.339},"min":{"1min":1.9710000000000001,"5min":1.6619999999999999,"15min":1.4019999999999999},"max":{"1min":3.1389999999999998,"5min":3.726,"15min":5.1210000000000004},"last":2.0510000000000002},{"interface":"front","average":{"1min":2.4220000000000002,"5min":2.4359999999999999,"15min":2.3959999999999999},"min":{"1min":1.593,"5min":1.593,"15min":1.4219999999999999},"max":{"1min":3.2480000000000002,"5min":4.1559999999999997,"15min":4.4980000000000002},"last":2.145}]},{"osd":4,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.8530000000000002,"5min":2.9009999999999998,"15min":2.8340000000000001},"min":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.49},"max":{"1min":3.7370000000000001,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":2.2250000000000001},{"interface":"front","average":{"1min":2.9750000000000001,"5min":2.9159999999999999,"15min":2.8439999999999999},"min":{"1min":1.875,"5min":1.875,"15min":1.6890000000000001},"max":{"1min":4.0529999999999999,"5min":4.3479999999999999,"15min":5.0069999999999997},"last":2.4620000000000002}]},{"osd":5,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.9630000000000001,"5min":2.75,"15min":2.7210000000000001},"min":{"1min":2.0139999999999998,"5min":1.353,"15min":0.93700000000000006},"max":{"1min":3.4489999999999998,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":2.548},{"interface":"front","average":{"1min":3.302,"5min":3.2490000000000001,"15min":3.1800000000000002},"min":{"1min":2.4449999999999998,"5min":2.2450000000000001,"15min":1.4510000000000001},"max":{"1min":4.0780000000000003,"5min":5.3410000000000002,"15min":5.3410000000000002},"last":2.625}]},{"osd":7,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":3.3090000000000002,"5min":3.3109999999999999,"15min":3.2469999999999999},"min":{"1min":2.456,"5min":1.889,"15min":1.889},"max":{"1min":4.2770000000000001,"5min":4.798,"15min":4.798},"last":3.2010000000000001},{"interface":"front","average":{"1min":3.4319999999999999,"5min":3.27,"15min":3.2290000000000001},"min":{"1min":2.601,"5min":2.077,"15min":1.0760000000000001},"max":{"1min":4.2050000000000001,"5min":4.5670000000000002,"15min":4.5670000000000002},"last":2.976}]}]},{"osd":1,"up_from":14,"seq":60129542818,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.7110000000000001,"15min":1.706},"min":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3129999999999999},"max":{"1min":2.0259999999999998,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":1.6339999999999999},{"interface":"front","average":{"1min":1.7529999999999999,"5min":1.8029999999999999,"15min":1.8149999999999999},"min":{"1min":1.4950000000000001,"5min":1.337,"15min":1.337},"max":{"1min":2.3639999999999999,"5min":2.9910000000000001,"15min":4.5979999999999999},"last":1.931}]},{"osd":2,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":1.9810000000000001,"5min":1.8799999999999999,"15min":1.8839999999999999},"min":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"max":{"1min":3.194,"5min":3.194,"15min":3.528},"last":1.492},{"interface":"front","average":{"1min":2.6019999999999999,"5min":2.556,"15min":2.569},"min":{"1min":1.9850000000000001,"5min":1.665,"15min":1.5649999999999999},"max":{"1min":3.0960000000000001,"5min":3.9809999999999999,"15min":3.9809999999999999},"last":2.3109999999999999}]},{"osd":3,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":2.2669999999999999,"5min":2.21,"15min":2.1930000000000001},"min":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.4810000000000001},"max":{"1min":3.5619999999999998,"5min":4.3579999999999997,"15min":4.3579999999999997},"last":1.8899999999999999},{"interface":"front","average":{"1min":2.3980000000000001,"5min":2.3399999999999999,"15min":2.3479999999999999},"min":{"1min":1.9279999999999999,"5min":1.5069999999999999,"15min":1.357},"max":{"1min":2.9100000000000001,"5min":2.996,"15min":3.262},"last":2.218}]},{"osd":4,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":2.1469999999999998,"5min":2.3100000000000001,"15min":2.3239999999999998},"min":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.544},"max":{"1min":2.8900000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":2.1629999999999998},{"interface":"front","average":{"1min":2.7749999999999999,"5min":2.8109999999999999,"15min":2.798},"min":{"1min":2.2149999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"max":{"1min":3.75,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":2.9540000000000002}]},{"osd":5,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":2.8530000000000002,"5min":2.8879999999999999,"15min":2.8679999999999999},"min":{"1min":2.1360000000000001,"5min":2.0289999999999999,"15min":1.9750000000000001},"max":{"1min":3.7010000000000001,"5min":3.9969999999999999,"15min":4.306},"last":3.8250000000000002},{"interface":"front","average":{"1min":2.8010000000000002,"5min":2.8839999999999999,"15min":2.919},"min":{"1min":2.109,"5min":1.855,"15min":1.847},"max":{"1min":3.6970000000000001,"5min":4.6509999999999998,"15min":4.6509999999999998},"last":2.8730000000000002}]},{"osd":6,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":3.1850000000000001,"5min":3.177,"15min":3.2090000000000001},"min":{"1min":2.3050000000000002,"5min":2.27,"15min":1.903},"max":{"1min":4.2000000000000002,"5min":4.7990000000000004,"15min":4.9720000000000004},"last":4.048},{"interface":"front","average":{"1min":2.984,"5min":3.1469999999999998,"15min":3.1579999999999999},"min":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"max":{"1min":3.9300000000000002,"5min":5.5960000000000001,"15min":5.5960000000000001},"last":3.6469999999999998}]},{"osd":7,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":3.2429999999999999,"5min":3.2229999999999999,"15min":3.2010000000000001},"min":{"1min":2.6379999999999999,"5min":2.54,"15min":2.4660000000000002},"max":{"1min":4.1210000000000004,"5min":5.1449999999999996,"15min":5.1840000000000002},"last":3.1899999999999999},{"interface":"front","average":{"1min":3.2349999999999999,"5min":3.302,"15min":3.2810000000000001},"min":{"1min":2.8999999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"max":{"1min":3.8119999999999998,"5min":4.2729999999999997,"15min":5.3730000000000002},"last":3.4430000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542818,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":1.7609999999999999,"15min":1.704},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.1950000000000001},"max":{"1min":2.5920000000000001,"5min":2.9870000000000001,"15min":3.0179999999999998},"last":1.9710000000000001},{"interface":"front","average":{"1min":1.8540000000000001,"5min":1.869,"15min":1.8180000000000001},"min":{"1min":1.403,"5min":1.377,"15min":1.244},"max":{"1min":2.9100000000000001,"5min":3.1459999999999999,"15min":3.2690000000000001},"last":1.2969999999999999}]},{"osd":2,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":2.101,"5min":2.0960000000000001,"15min":2.101},"min":{"1min":1.4330000000000001,"5min":1.4099999999999999,"15min":1.2589999999999999},"max":{"1min":2.645,"5min":2.9009999999999998,"15min":3.4009999999999998},"last":1.214},{"interface":"front","average":{"1min":2.415,"5min":2.3780000000000001,"15min":2.3730000000000002},"min":{"1min":2.0489999999999999,"5min":1.8009999999999999,"15min":1.4399999999999999},"max":{"1min":3.1339999999999999,"5min":3.242,"15min":3.4870000000000001},"last":1.546}]},{"osd":3,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":2.052,"5min":1.839,"15min":1.8100000000000001},"min":{"1min":1.5409999999999999,"5min":1.403,"15min":1.2749999999999999},"max":{"1min":3.0379999999999998,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":1.3280000000000001},{"interface":"front","average":{"1min":2.355,"5min":2.4180000000000001,"15min":2.407},"min":{"1min":1.9490000000000001,"5min":1.8240000000000001,"15min":1.5900000000000001},"max":{"1min":2.9260000000000002,"5min":3.411,"15min":3.411},"last":2.2570000000000001}]},{"osd":4,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":2.2320000000000002,"5min":2.403,"15min":2.415},"min":{"1min":1.5600000000000001,"5min":1.5349999999999999,"15min":1.486},"max":{"1min":3.3540000000000001,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":2.3109999999999999},{"interface":"front","average":{"1min":2.4249999999999998,"5min":2.4529999999999998,"15min":2.4900000000000002},"min":{"1min":2.0419999999999998,"5min":1.746,"15min":1.647},"max":{"1min":3.3410000000000002,"5min":3.6629999999999998,"15min":4.1900000000000004},"last":1.6399999999999999}]},{"osd":5,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":2.3300000000000001,"5min":2.4929999999999999,"15min":2.5099999999999998},"min":{"1min":1.627,"5min":1.627,"15min":1.627},"max":{"1min":3.1080000000000001,"5min":3.851,"15min":4.4779999999999998},"last":1.903},{"interface":"front","average":{"1min":3.0230000000000001,"5min":2.944,"15min":2.9670000000000001},"min":{"1min":2.4870000000000001,"5min":1.9570000000000001,"15min":1.9490000000000001},"max":{"1min":3.5049999999999999,"5min":3.9929999999999999,"15min":4.2119999999999997},"last":2.8700000000000001}]},{"osd":6,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":3.113,"5min":3.1299999999999999,"15min":3.2000000000000002},"min":{"1min":2.6019999999999999,"5min":2.214,"15min":2.214},"max":{"1min":3.548,"5min":3.9300000000000002,"15min":4.1459999999999999},"last":2.6070000000000002},{"interface":"front","average":{"1min":2.8530000000000002,"5min":3.0139999999999998,"15min":2.9790000000000001},"min":{"1min":2.343,"5min":2.343,"15min":2.1749999999999998},"max":{"1min":3.4089999999999998,"5min":4.0659999999999998,"15min":4.274},"last":3.0529999999999999}]},{"osd":7,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":3.1000000000000001,"5min":3.2480000000000002,"15min":3.2189999999999999},"min":{"1min":2.52,"5min":2.5129999999999999,"15min":1.921},"max":{"1min":3.7120000000000002,"5min":4.1609999999999996,"15min":4.806},"last":2.9249999999999998},{"interface":"front","average":{"1min":2.9870000000000001,"5min":3.0630000000000002,"15min":3.069},"min":{"1min":2.5030000000000001,"5min":2.363,"15min":1.8140000000000001},"max":{"1min":3.3799999999999999,"5min":3.988,"15min":4.3810000000000002},"last":2.2109999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542818,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.6419999999999999,"15min":1.657},"min":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"max":{"1min":2.0910000000000002,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":2.02},{"interface":"front","average":{"1min":1.6379999999999999,"5min":1.7549999999999999,"15min":1.7749999999999999},"min":{"1min":1.3660000000000001,"5min":1.278,"15min":1.278},"max":{"1min":2.2989999999999999,"5min":2.8679999999999999,"15min":3.2429999999999999},"last":1.5409999999999999}]},{"osd":1,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":2.0030000000000001,"5min":2.101,"15min":2.0859999999999999},"min":{"1min":1.373,"5min":1.3720000000000001,"15min":1.3400000000000001},"max":{"1min":3.117,"5min":3.117,"15min":3.117},"last":1.4239999999999999},{"interface":"front","average":{"1min":2.0760000000000001,"5min":2.085,"15min":2.0870000000000002},"min":{"1min":1.774,"5min":1.46,"15min":1.4279999999999999},"max":{"1min":2.5099999999999998,"5min":2.8380000000000001,"15min":3.2149999999999999},"last":2.1709999999999998}]},{"osd":3,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":1.984,"5min":2.0430000000000001,"15min":1.994},"min":{"1min":1.4610000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"max":{"1min":3.0840000000000001,"5min":3.198,"15min":3.5699999999999998},"last":2.1240000000000001},{"interface":"front","average":{"1min":2.4670000000000001,"5min":2.5790000000000002,"15min":2.5619999999999998},"min":{"1min":2.036,"5min":1.9399999999999999,"15min":1.5900000000000001},"max":{"1min":3.4089999999999998,"5min":3.508,"15min":3.6549999999999998},"last":2.77}]},{"osd":4,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":2.609,"5min":2.476,"15min":2.532},"min":{"1min":1.95,"5min":1.502,"15min":1.502},"max":{"1min":3.5609999999999999,"5min":3.6890000000000001,"15min":3.6890000000000001},"last":2.4809999999999999},{"interface":"front","average":{"1min":2.1640000000000001,"5min":2.2829999999999999,"15min":2.3239999999999998},"min":{"1min":1.46,"5min":1.46,"15min":1.46},"max":{"1min":2.9780000000000002,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":1.835}]},{"osd":5,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":2.589,"5min":2.875,"15min":2.8210000000000002},"min":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.7669999999999999},"max":{"1min":3.7200000000000002,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":2.3999999999999999},{"interface":"front","average":{"1min":2.968,"5min":2.9929999999999999,"15min":3.0430000000000001},"min":{"1min":2.3090000000000002,"5min":1.925,"15min":1.925},"max":{"1min":3.8279999999999998,"5min":4.0789999999999997,"15min":4.0970000000000004},"last":2.7069999999999999}]},{"osd":6,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":2.7450000000000001,"5min":2.746,"15min":2.7679999999999998},"min":{"1min":2.2330000000000001,"5min":1.9830000000000001,"15min":1.8500000000000001},"max":{"1min":3.633,"5min":4.4660000000000002,"15min":4.4660000000000002},"last":2.3290000000000002},{"interface":"front","average":{"1min":2.9569999999999999,"5min":3.1160000000000001,"15min":3.1280000000000001},"min":{"1min":2.395,"5min":2.395,"15min":2.3220000000000001},"max":{"1min":3.5859999999999999,"5min":4.1609999999999996,"15min":4.2519999999999998},"last":3.117}]},{"osd":7,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":3.2149999999999999,"5min":3.1899999999999999,"15min":3.2429999999999999},"min":{"1min":2.5590000000000002,"5min":2.4129999999999998,"15min":2.302},"max":{"1min":3.9750000000000001,"5min":3.9750000000000001,"15min":4.3109999999999999},"last":3.1899999999999999},{"interface":"front","average":{"1min":2.9630000000000001,"5min":3.1230000000000002,"15min":3.105},"min":{"1min":2.4569999999999999,"5min":2.1989999999999998,"15min":1.881},"max":{"1min":3.464,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":2.5539999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542818,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.661,"15min":1.6519999999999999},"min":{"1min":1.2669999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"max":{"1min":2.1040000000000001,"5min":2.528,"15min":3.024},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.657,"5min":1.653,"15min":1.6699999999999999},"min":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"max":{"1min":2.4750000000000001,"5min":2.52,"15min":2.8079999999999998},"last":1.6719999999999999}]},{"osd":1,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":1.883,"5min":1.9039999999999999,"15min":1.8540000000000001},"min":{"1min":1.355,"5min":1.355,"15min":1.2849999999999999},"max":{"1min":2.8399999999999999,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":2.9020000000000001},{"interface":"front","average":{"1min":2.0390000000000001,"5min":2.0649999999999999,"15min":2.097},"min":{"1min":1.458,"5min":1.331,"15min":1.331},"max":{"1min":2.4780000000000002,"5min":2.698,"15min":3.1099999999999999},"last":2.242}]},{"osd":2,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":2.3239999999999998,"5min":2.202,"15min":2.242},"min":{"1min":1.573,"5min":1.5229999999999999,"15min":1.3879999999999999},"max":{"1min":3.4300000000000002,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":1.778},{"interface":"front","average":{"1min":2.5880000000000001,"5min":2.5329999999999999,"15min":2.5379999999999998},"min":{"1min":2.0680000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"max":{"1min":3.0939999999999999,"5min":3.2879999999999998,"15min":3.532},"last":2.4460000000000002}]},{"osd":4,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":2.3599999999999999,"5min":2.3140000000000001,"15min":2.319},"min":{"1min":1.857,"5min":1.6559999999999999,"15min":1.524},"max":{"1min":3.3380000000000001,"5min":3.754,"15min":4.327},"last":2.2890000000000001},{"interface":"front","average":{"1min":2.4609999999999999,"5min":2.6139999999999999,"15min":2.5859999999999999},"min":{"1min":1.792,"5min":1.619,"15min":1.619},"max":{"1min":3.2709999999999999,"5min":3.6379999999999999,"15min":4.1070000000000002},"last":2.5259999999999998}]},{"osd":5,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":2.714,"5min":2.843,"15min":2.8410000000000002},"min":{"1min":2.2320000000000002,"5min":1.899,"15min":1.6850000000000001},"max":{"1min":3.403,"5min":3.7370000000000001,"15min":4.4850000000000003},"last":2.1640000000000001},{"interface":"front","average":{"1min":2.8029999999999999,"5min":2.851,"15min":2.831},"min":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.9609999999999999},"last":2.665}]},{"osd":6,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":2.8999999999999999,"5min":2.8620000000000001,"15min":2.875},"min":{"1min":1.76,"5min":1.76,"15min":1.76},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":5.0110000000000001},"last":2.9969999999999999},{"interface":"front","average":{"1min":3.105,"5min":3.2669999999999999,"15min":3.2749999999999999},"min":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"max":{"1min":3.7639999999999998,"5min":4.093,"15min":5.1760000000000002},"last":3.29}]},{"osd":7,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":3.0910000000000002,"5min":3.1120000000000001,"15min":3.125},"min":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"max":{"1min":3.5419999999999998,"5min":3.8159999999999998,"15min":4.4379999999999997},"last":3.036},{"interface":"front","average":{"1min":3.085,"5min":3.0419999999999998,"15min":3.0419999999999998},"min":{"1min":2.5539999999999998,"5min":2.3519999999999999,"15min":2.3519999999999999},"max":{"1min":3.5339999999999998,"5min":3.9380000000000002,"15min":4.1210000000000004},"last":3.1899999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542817,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":2.032,"5min":1.913,"15min":2.0099999999999998},"min":{"1min":1.405,"5min":1.044,"15min":1.044},"max":{"1min":2.4889999999999999,"5min":3.1150000000000002,"15min":4.0910000000000002},"last":2.2160000000000002},{"interface":"front","average":{"1min":2.6699999999999999,"5min":2.512,"15min":2.5609999999999999},"min":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"max":{"1min":3.0880000000000001,"5min":3.444,"15min":3.7890000000000001},"last":2.6829999999999998}]},{"osd":1,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":1.929,"5min":1.974,"15min":1.9319999999999999},"min":{"1min":1.524,"5min":1.369,"15min":1.264},"max":{"1min":2.7349999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":1.524},{"interface":"front","average":{"1min":1.8520000000000001,"5min":1.9930000000000001,"15min":2.044},"min":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.1679999999999999},"max":{"1min":2.605,"5min":3.2890000000000001,"15min":3.5009999999999999},"last":1.988}]},{"osd":2,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":1.958,"5min":2.1280000000000001,"15min":2.1819999999999999},"min":{"1min":1.137,"5min":1.137,"15min":1.137},"max":{"1min":2.677,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":1.6539999999999999},{"interface":"front","average":{"1min":2.1850000000000001,"5min":2.395,"15min":2.4009999999999998},"min":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.327},"max":{"1min":3.2349999999999999,"5min":3.46,"15min":3.6840000000000002},"last":2.2799999999999998}]},{"osd":3,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":2.4249999999999998,"5min":2.3559999999999999,"15min":2.3540000000000001},"min":{"1min":1.863,"5min":1.601,"15min":1.54},"max":{"1min":3.5720000000000001,"5min":3.5720000000000001,"15min":4.3579999999999997},"last":2.8300000000000001},{"interface":"front","average":{"1min":2.7959999999999998,"5min":2.8479999999999999,"15min":2.8519999999999999},"min":{"1min":2.5030000000000001,"5min":2.181,"15min":1.2769999999999999},"max":{"1min":3.234,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":2.593}]},{"osd":5,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":2.8180000000000001,"5min":2.75,"15min":2.7050000000000001},"min":{"1min":1.9119999999999999,"5min":1.843,"15min":1.552},"max":{"1min":3.6150000000000002,"5min":3.6869999999999998,"15min":3.8740000000000001},"last":1.9119999999999999},{"interface":"front","average":{"1min":2.681,"5min":2.6800000000000002,"15min":2.6709999999999998},"min":{"1min":2.0750000000000002,"5min":1.522,"15min":1.522},"max":{"1min":3.3359999999999999,"5min":3.6920000000000002,"15min":4.556},"last":2.4129999999999998}]},{"osd":6,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":3.0579999999999998,"5min":3.0249999999999999,"15min":2.9630000000000001},"min":{"1min":2.3860000000000001,"5min":1.9810000000000001,"15min":1.825},"max":{"1min":4.3440000000000003,"5min":4.3440000000000003,"15min":4.3440000000000003},"last":2.9569999999999999},{"interface":"front","average":{"1min":3.4289999999999998,"5min":3.3100000000000001,"15min":3.2639999999999998},"min":{"1min":3.0409999999999999,"5min":2.7509999999999999,"15min":1.98},"max":{"1min":4.6870000000000003,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":3.2559999999999998}]},{"osd":7,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":2.9710000000000001,"5min":2.9929999999999999,"15min":3.0139999999999998},"min":{"1min":2.5539999999999998,"5min":1.879,"15min":1.111},"max":{"1min":3.613,"5min":3.9660000000000002,"15min":4.2850000000000001},"last":3.1960000000000002},{"interface":"front","average":{"1min":3.278,"5min":3.27,"15min":3.2839999999999998},"min":{"1min":2.766,"5min":2.0920000000000001,"15min":1.5429999999999999},"max":{"1min":3.7400000000000002,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":3.161}]}]},{"osd":5,"up_from":14,"seq":60129542818,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":1.6850000000000001,"5min":1.6990000000000001,"15min":1.7},"min":{"1min":1.268,"5min":1.107,"15min":1.107},"max":{"1min":2.4649999999999999,"5min":2.9870000000000001,"15min":3.1480000000000001},"last":1.286},{"interface":"front","average":{"1min":1.891,"5min":1.8500000000000001,"15min":1.8819999999999999},"min":{"1min":1.2350000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"max":{"1min":2.698,"5min":2.9580000000000002,"15min":3.2669999999999999},"last":1.4359999999999999}]},{"osd":1,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":1.9339999999999999,"5min":1.865,"15min":1.847},"min":{"1min":1.609,"5min":1.3899999999999999,"15min":1.206},"max":{"1min":2.5710000000000002,"5min":2.992,"15min":2.992},"last":1.597},{"interface":"front","average":{"1min":2.2229999999999999,"5min":2.2120000000000002,"15min":2.202},"min":{"1min":1.7450000000000001,"5min":1.278,"15min":1.278},"max":{"1min":3.097,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":2.0720000000000001}]},{"osd":2,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":2.3919999999999999,"5min":2.3809999999999998,"15min":2.3220000000000001},"min":{"1min":1.581,"5min":1.518,"15min":1.4870000000000001},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":2.1509999999999998},{"interface":"front","average":{"1min":2.7069999999999999,"5min":2.6299999999999999,"15min":2.677},"min":{"1min":2.0139999999999998,"5min":1.6970000000000001,"15min":1.6970000000000001},"max":{"1min":3.2770000000000001,"5min":3.476,"15min":3.984},"last":2.3730000000000002}]},{"osd":3,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":2.8300000000000001,"5min":2.7519999999999998,"15min":2.6930000000000001},"min":{"1min":1.994,"5min":1.7230000000000001,"15min":1.6000000000000001},"max":{"1min":3.4180000000000001,"5min":3.8010000000000002,"15min":3.8010000000000002},"last":2.5739999999999998},{"interface":"front","average":{"1min":2.8740000000000001,"5min":2.823,"15min":2.8730000000000002},"min":{"1min":2.0059999999999998,"5min":1.472,"15min":1.472},"max":{"1min":3.637,"5min":4.0229999999999997,"15min":4.2759999999999998},"last":1.964}]},{"osd":4,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":2.6669999999999998,"5min":2.6989999999999998,"15min":2.6819999999999999},"min":{"1min":2.1789999999999998,"5min":1.415,"15min":1.3300000000000001},"max":{"1min":3.6309999999999998,"5min":3.6309999999999998,"15min":4.0060000000000002},"last":2.4590000000000001},{"interface":"front","average":{"1min":3.0219999999999998,"5min":3.0230000000000001,"15min":3.036},"min":{"1min":1.929,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":4.016,"5min":4.1310000000000002,"15min":4.1609999999999996},"last":3.0059999999999998}]},{"osd":6,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":2.8730000000000002,"5min":2.8460000000000001,"15min":2.8370000000000002},"min":{"1min":2.0779999999999998,"5min":1.3009999999999999,"15min":1.3009999999999999},"max":{"1min":4.0419999999999998,"5min":4.0419999999999998,"15min":4.7880000000000003},"last":2.9430000000000001},{"interface":"front","average":{"1min":2.9140000000000001,"5min":2.9870000000000001,"15min":2.972},"min":{"1min":2.4289999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.609,"5min":3.8690000000000002,"15min":3.9710000000000001},"last":2.855}]},{"osd":7,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":3.427,"5min":3.3330000000000002,"15min":3.3260000000000001},"min":{"1min":2.1520000000000001,"5min":1.841,"15min":1.841},"max":{"1min":3.9820000000000002,"5min":4.3620000000000001,"15min":4.6619999999999999},"last":3.222},{"interface":"front","average":{"1min":3.3700000000000001,"5min":3.2890000000000001,"15min":3.3399999999999999},"min":{"1min":2.7400000000000002,"5min":1.6339999999999999,"15min":1.6339999999999999},"max":{"1min":4.4180000000000001,"5min":4.4489999999999998,"15min":5.0129999999999999},"last":2.7040000000000002}]}]}]}} 2021-01-03T13:53:51.526 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2021-01-03T12:57:56.318129+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=6, tm_yday=3, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=13, tm_min=53, tm_sec=46, tm_wday=6, tm_yday=3, tm_isdst=0) 2021-01-03T13:53:51.527 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-01-03T12:57:56.318129+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=6, tm_yday=3, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=13, tm_min=53, tm_sec=46, tm_wday=6, tm_yday=3, tm_isdst=0) 2021-01-03T13:53:51.527 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2021-01-03T12:57:56.318129+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=6, tm_yday=3, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=13, tm_min=53, tm_sec=46, tm_wday=6, tm_yday=3, tm_isdst=0) 2021-01-03T13:53:51.528 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2021-01-03T12:57:56.318129+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=6, tm_yday=3, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=13, tm_min=53, tm_sec=46, tm_wday=6, tm_yday=3, tm_isdst=0) 2021-01-03T13:53:51.528 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2021-01-03T12:57:48.019621+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=12, tm_min=57, tm_sec=48, tm_wday=6, tm_yday=3, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=13, tm_min=53, tm_sec=46, tm_wday=6, tm_yday=3, tm_isdst=0) 2021-01-03T13:53:51.529 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2021-01-03T12:57:56.318129+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=6, tm_yday=3, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=13, tm_min=53, tm_sec=46, tm_wday=6, tm_yday=3, tm_isdst=0) 2021-01-03T13:53:51.529 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2021-01-03T12:57:56.318129+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=6, tm_yday=3, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=13, tm_min=53, tm_sec=46, tm_wday=6, tm_yday=3, tm_isdst=0) 2021-01-03T13:53:51.530 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2021-01-03T12:57:56.318129+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=6, tm_yday=3, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=13, tm_min=53, tm_sec=46, tm_wday=6, tm_yday=3, tm_isdst=0) 2021-01-03T13:53:51.531 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2021-01-03T12:57:56.318129+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=12, tm_min=57, tm_sec=56, tm_wday=6, tm_yday=3, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=3, tm_hour=13, tm_min=53, tm_sec=46, tm_wday=6, tm_yday=3, tm_isdst=0) 2021-01-03T13:53:51.531 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2021-01-03T13:54:11.532 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2021-01-03T13:54:11.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.647+0000 7f61e189d700 1 Processor -- start 2021-01-03T13:54:11.651 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.647+0000 7f61e189d700 1 -- start start 2021-01-03T13:54:11.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.647+0000 7f61e189d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f61dc0b0c90 0x7f61dc0b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:54:11.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.647+0000 7f61e189d700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61dc060da0 con 0x7f61dc0b52c0 2021-01-03T13:54:11.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.647+0000 7f61e189d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61dc0b0ad0 con 0x7f61dc0b5c00 2021-01-03T13:54:11.653 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.647+0000 7f61e189d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc067a90 con 0x7f61dc0b0c90 2021-01-03T13:54:11.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.647+0000 7f61e109c700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f61dc0b5c00 0x7f61dc143eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34312/0 (socket says 172.21.15.133:34312) 2021-01-03T13:54:11.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.647+0000 7f61e109c700 1 -- 172.21.15.133:0/3289214198 learned_addr learned my addr 172.21.15.133:0/3289214198 (peer_addr_for_me v1:172.21.15.133:0/0) 2021-01-03T13:54:11.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.647+0000 7f61dbfff700 1 --2- 172.21.15.133:0/3289214198 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f61dc0b0c90 0x7f61dc0b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:54:11.654 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.647+0000 7f61db7fe700 1 -- 172.21.15.133:0/3289214198 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4211034871 0 0) 0x7f61cc001450 con 0x7f61dc0b5c00 2021-01-03T13:54:11.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.647+0000 7f61db7fe700 1 -- 172.21.15.133:0/3289214198 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c0003230 con 0x7f61dc0b5c00 2021-01-03T13:54:11.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.647+0000 7f61db7fe700 1 -- 172.21.15.133:0/3289214198 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617042719 0 0) 0x7f61dc060da0 con 0x7f61dc0b52c0 2021-01-03T13:54:11.655 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.647+0000 7f61dbfff700 1 -- 172.21.15.133:0/3289214198 >> v1:172.21.15.133:6789/0 conn(0x7f61dc0b5c00 legacy=0x7f61dc143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:54:11.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.647+0000 7f61dbfff700 1 -- 172.21.15.133:0/3289214198 >> v1:172.21.15.16:6789/0 conn(0x7f61dc0b52c0 legacy=0x7f61dc098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:54:11.656 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61dbfff700 1 -- 172.21.15.133:0/3289214198 --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc0b56a0 con 0x7f61dc0b0c90 2021-01-03T13:54:11.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61dbfff700 1 --2- 172.21.15.133:0/3289214198 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f61dc0b0c90 0x7f61dc0b05e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f61c4002f30 tx=0x7f61c4006dc0).ready entity=mon.2 client_cookie=da516be0c5c0c278 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:54:11.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61db7fe700 1 -- 172.21.15.133:0/3289214198 <== mon.2 v2:172.21.15.16:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c40097b0 con 0x7f61dc0b0c90 2021-01-03T13:54:11.659 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61db7fe700 1 -- 172.21.15.133:0/3289214198 <== mon.2 v2:172.21.15.16:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c4009910 con 0x7f61dc0b0c90 2021-01-03T13:54:11.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61db7fe700 1 -- 172.21.15.133:0/3289214198 <== mon.2 v2:172.21.15.16:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c4009c70 con 0x7f61dc0b0c90 2021-01-03T13:54:11.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61e189d700 1 -- 172.21.15.133:0/3289214198 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f61dc0b0c90 msgr2=0x7f61dc0b05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:54:11.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61e189d700 1 --2- 172.21.15.133:0/3289214198 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f61dc0b0c90 0x7f61dc0b05e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f61c4002f30 tx=0x7f61c4006dc0).stop 2021-01-03T13:54:11.660 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61e189d700 1 -- 172.21.15.133:0/3289214198 shutdown_connections 2021-01-03T13:54:11.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61e189d700 1 --2- 172.21.15.133:0/3289214198 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f61dc0b0c90 0x7f61dc0b05e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:54:11.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61e189d700 1 -- 172.21.15.133:0/3289214198 >> 172.21.15.133:0/3289214198 conn(0x7f61dc05bdf0 msgr2=0x7f61dc05c200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:54:11.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61e189d700 1 -- 172.21.15.133:0/3289214198 shutdown_connections 2021-01-03T13:54:11.661 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61e189d700 1 -- 172.21.15.133:0/3289214198 wait complete. 2021-01-03T13:54:11.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61e189d700 1 Processor -- start 2021-01-03T13:54:11.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61e189d700 1 -- start start 2021-01-03T13:54:11.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61e189d700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61dc0b0c90 0x7f61dc14e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:54:11.662 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61e189d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61dc0b52c0 0x7f61dc1490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:54:11.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61e189d700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f61dc0b5c00 0x7f61dc149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:54:11.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61e189d700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc149a80 con 0x7f61dc0b0c90 2021-01-03T13:54:11.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61e189d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc0673b0 con 0x7f61dc0b52c0 2021-01-03T13:54:11.663 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61e189d700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc067650 con 0x7f61dc0b5c00 2021-01-03T13:54:11.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61dbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61dc0b52c0 0x7f61dc1490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:54:11.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61dbfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61dc0b52c0 0x7f61dc1490a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41516/0 (socket says 172.21.15.133:41516) 2021-01-03T13:54:11.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61dbfff700 1 -- 172.21.15.133:0/2823159063 learned_addr learned my addr 172.21.15.133:0/2823159063 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:54:11.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61e109c700 1 --2- 172.21.15.133:0/2823159063 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f61dc0b5c00 0x7f61dc149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:54:11.664 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.651+0000 7f61e089b700 1 --2- 172.21.15.133:0/2823159063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61dc0b0c90 0x7f61dc14e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:54:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.655+0000 7f61dbfff700 1 -- 172.21.15.133:0/2823159063 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f61dc0b5c00 msgr2=0x7f61dc149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:54:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.655+0000 7f61dbfff700 1 --2- 172.21.15.133:0/2823159063 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f61dc0b5c00 0x7f61dc149590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:54:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.655+0000 7f61dbfff700 1 -- 172.21.15.133:0/2823159063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61dc0b0c90 msgr2=0x7f61dc14e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:54:11.665 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.655+0000 7f61dbfff700 1 --2- 172.21.15.133:0/2823159063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61dc0b0c90 0x7f61dc14e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:54:11.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.655+0000 7f61dbfff700 1 -- 172.21.15.133:0/2823159063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc065b50 con 0x7f61dc0b52c0 2021-01-03T13:54:11.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.655+0000 7f61dbfff700 1 --2- 172.21.15.133:0/2823159063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61dc0b52c0 0x7f61dc1490a0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f61c4002f30 tx=0x7f61c4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:54:11.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.655+0000 7f61d9ffb700 1 -- 172.21.15.133:0/2823159063 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c4011b40 con 0x7f61dc0b52c0 2021-01-03T13:54:11.666 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.655+0000 7f61d9ffb700 1 -- 172.21.15.133:0/2823159063 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c4011ca0 con 0x7f61dc0b52c0 2021-01-03T13:54:11.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.655+0000 7f61e189d700 1 -- 172.21.15.133:0/2823159063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61dc066a10 con 0x7f61dc0b52c0 2021-01-03T13:54:11.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.655+0000 7f61d9ffb700 1 -- 172.21.15.133:0/2823159063 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61c401d440 con 0x7f61dc0b52c0 2021-01-03T13:54:11.667 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.655+0000 7f61e189d700 1 -- 172.21.15.133:0/2823159063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61dc148a90 con 0x7f61dc0b52c0 2021-01-03T13:54:11.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.655+0000 7f61e189d700 1 -- 172.21.15.133:0/2823159063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61dc057300 con 0x7f61dc0b52c0 2021-01-03T13:54:11.668 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.655+0000 7f61d9ffb700 1 -- 172.21.15.133:0/2823159063 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f61c4024030 con 0x7f61dc0b52c0 2021-01-03T13:54:11.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.659+0000 7f61d9ffb700 1 --2- 172.21.15.133:0/2823159063 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f61b40553b0 0x7f61b4057870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:54:11.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.659+0000 7f61d9ffb700 1 -- 172.21.15.133:0/2823159063 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f61c406ec30 con 0x7f61dc0b52c0 2021-01-03T13:54:11.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.659+0000 7f61e089b700 1 --2- 172.21.15.133:0/2823159063 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f61b40553b0 0x7f61b4057870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:54:11.669 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.659+0000 7f61e089b700 1 --2- 172.21.15.133:0/2823159063 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f61b40553b0 0x7f61b4057870 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f61d400d000 tx=0x7f61d4007980).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:54:11.670 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.663+0000 7f61d9ffb700 1 -- 172.21.15.133:0/2823159063 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f61c4045100 con 0x7f61dc0b52c0 2021-01-03T13:54:11.802 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.799+0000 7f61e189d700 1 -- 172.21.15.133:0/2823159063 --> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61dc067230 con 0x7f61b40553b0 2021-01-03T13:54:11.810 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.807+0000 7f61d9ffb700 1 -- 172.21.15.133:0/2823159063 <== mgr.4110 v2:172.21.15.133:6800/11943 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66081 (secure 0 0 0) 0x7f61d4002510 con 0x7f61b40553b0 2021-01-03T13:54:11.810 INFO:teuthology.orchestra.run.smithi133.stdout: 2021-01-03T13:54:11.811 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.807+0000 7f61e189d700 1 -- 172.21.15.133:0/2823159063 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f61b40553b0 msgr2=0x7f61b4057870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:54:11.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.807+0000 7f61e189d700 1 --2- 172.21.15.133:0/2823159063 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f61b40553b0 0x7f61b4057870 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f61d400d000 tx=0x7f61d4007980).stop 2021-01-03T13:54:11.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.807+0000 7f61e189d700 1 -- 172.21.15.133:0/2823159063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61dc0b52c0 msgr2=0x7f61dc1490a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:54:11.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.807+0000 7f61e189d700 1 --2- 172.21.15.133:0/2823159063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61dc0b52c0 0x7f61dc1490a0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f61c4002f30 tx=0x7f61c4015000).stop 2021-01-03T13:54:11.812 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.807+0000 7f61e189d700 1 -- 172.21.15.133:0/2823159063 shutdown_connections 2021-01-03T13:54:11.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.807+0000 7f61e189d700 1 --2- 172.21.15.133:0/2823159063 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f61b40553b0 0x7f61b4057870 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:54:11.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.807+0000 7f61e189d700 1 --2- 172.21.15.133:0/2823159063 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61dc0b0c90 0x7f61dc14e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:54:11.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.807+0000 7f61e189d700 1 --2- 172.21.15.133:0/2823159063 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f61dc0b5c00 0x7f61dc149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:54:11.813 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.807+0000 7f61e189d700 1 --2- 172.21.15.133:0/2823159063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61dc0b52c0 0x7f61dc1490a0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:54:11.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.807+0000 7f61e189d700 1 -- 172.21.15.133:0/2823159063 >> 172.21.15.133:0/2823159063 conn(0x7f61dc05bdf0 msgr2=0x7f61dc143660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:54:11.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.807+0000 7f61e189d700 1 -- 172.21.15.133:0/2823159063 shutdown_connections 2021-01-03T13:54:11.814 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.807+0000 7f61e189d700 1 -- 172.21.15.133:0/2823159063 wait complete. 2021-01-03T13:54:11.815 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2021-01-03T13:54:11.825 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":1847,"stamp":"2021-01-03T13:54:10.006199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1180,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":8405056,"kb_used_data":16384,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569664,"statfs":{"total":773094113280,"available":764487335936,"internally_reserved":8589934592,"allocated":16777216,"data_stored":7805040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003830"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":"142","reported_epoch":"165","state":"active+clean","last_fresh":"2021-01-03T13:53:51.390559+0000","last_change":"2021-01-03T13:53:51.390683+0000","last_active":"2021-01-03T13:53:51.390559+0000","last_peered":"2021-01-03T13:53:51.390559+0000","last_clean":"2021-01-03T13:53:51.390559+0000","last_became_active":"2021-01-03T12:57:57.354020+0000","last_became_peered":"2021-01-03T12:57:57.354020+0000","last_unstale":"2021-01-03T13:53:51.390559+0000","last_undegraded":"2021-01-03T13:53:51.390559+0000","last_fullsized":"2021-01-03T13:53:51.390559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T13:53:51.390551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T13:53:51.390551+0000","last_clean_scrub_stamp":"2021-01-03T13:53:51.390551+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"141","reported_epoch":"165","state":"active+clean","last_fresh":"2021-01-03T13:53:52.164376+0000","last_change":"2021-01-03T13:53:52.164534+0000","last_active":"2021-01-03T13:53:52.164376+0000","last_peered":"2021-01-03T13:53:52.164376+0000","last_clean":"2021-01-03T13:53:52.164376+0000","last_became_active":"2021-01-03T12:57:57.348011+0000","last_became_peered":"2021-01-03T12:57:57.348011+0000","last_unstale":"2021-01-03T13:53:52.164376+0000","last_undegraded":"2021-01-03T13:53:52.164376+0000","last_fullsized":"2021-01-03T13:53:52.164376+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T13:53:52.164368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T13:53:52.164368+0000","last_clean_scrub_stamp":"2021-01-03T13:53:52.164368+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"153","reported_epoch":"165","state":"active+clean","last_fresh":"2021-01-03T13:53:53.524695+0000","last_change":"2021-01-03T13:53:53.524886+0000","last_active":"2021-01-03T13:53:53.524695+0000","last_peered":"2021-01-03T13:53:53.524695+0000","last_clean":"2021-01-03T13:53:53.524695+0000","last_became_active":"2021-01-03T12:57:57.493742+0000","last_became_peered":"2021-01-03T12:57:57.493742+0000","last_unstale":"2021-01-03T13:53:53.524695+0000","last_undegraded":"2021-01-03T13:53:53.524695+0000","last_fullsized":"2021-01-03T13:53:53.524695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T13:53:53.524681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T13:53:53.524681+0000","last_clean_scrub_stamp":"2021-01-03T13:53:53.524681+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"141","reported_epoch":"165","state":"active+clean","last_fresh":"2021-01-03T13:54:00.331377+0000","last_change":"2021-01-03T13:54:00.331526+0000","last_active":"2021-01-03T13:54:00.331377+0000","last_peered":"2021-01-03T13:54:00.331377+0000","last_clean":"2021-01-03T13:54:00.331377+0000","last_became_active":"2021-01-03T12:57:57.344536+0000","last_became_peered":"2021-01-03T12:57:57.344536+0000","last_unstale":"2021-01-03T13:54:00.331377+0000","last_undegraded":"2021-01-03T13:54:00.331377+0000","last_fullsized":"2021-01-03T13:54:00.331377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T13:54:00.331367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T13:54:00.331367+0000","last_clean_scrub_stamp":"2021-01-03T13:54:00.331367+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"165'4","reported_seq":"157","reported_epoch":"165","state":"active+clean","last_fresh":"2021-01-03T13:53:53.931831+0000","last_change":"2021-01-03T13:53:53.932020+0000","last_active":"2021-01-03T13:53:53.931831+0000","last_peered":"2021-01-03T13:53:53.931831+0000","last_clean":"2021-01-03T13:53:53.931831+0000","last_became_active":"2021-01-03T12:57:52.088788+0000","last_became_peered":"2021-01-03T12:57:52.088788+0000","last_unstale":"2021-01-03T13:53:53.931831+0000","last_undegraded":"2021-01-03T13:53:53.931831+0000","last_fullsized":"2021-01-03T13:53:53.931831+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'4","last_scrub_stamp":"2021-01-03T13:53:53.931815+0000","last_deep_scrub":"165'4","last_deep_scrub_stamp":"2021-01-03T13:53:53.931815+0000","last_clean_scrub_stamp":"2021-01-03T13:53:53.931815+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1180,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"150","reported_epoch":"165","state":"active+clean","last_fresh":"2021-01-03T13:53:55.983958+0000","last_change":"2021-01-03T13:53:55.984176+0000","last_active":"2021-01-03T13:53:55.983958+0000","last_peered":"2021-01-03T13:53:55.983958+0000","last_clean":"2021-01-03T13:53:55.983958+0000","last_became_active":"2021-01-03T12:57:57.344012+0000","last_became_peered":"2021-01-03T12:57:57.344012+0000","last_unstale":"2021-01-03T13:53:55.983958+0000","last_undegraded":"2021-01-03T13:53:55.983958+0000","last_fullsized":"2021-01-03T13:53:55.983958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T13:53:55.983943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T13:53:55.983943+0000","last_clean_scrub_stamp":"2021-01-03T13:53:55.983943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"150","reported_epoch":"165","state":"active+clean","last_fresh":"2021-01-03T13:54:04.086099+0000","last_change":"2021-01-03T13:54:04.086314+0000","last_active":"2021-01-03T13:54:04.086099+0000","last_peered":"2021-01-03T13:54:04.086099+0000","last_clean":"2021-01-03T13:54:04.086099+0000","last_became_active":"2021-01-03T12:57:57.355963+0000","last_became_peered":"2021-01-03T12:57:57.355963+0000","last_unstale":"2021-01-03T13:54:04.086099+0000","last_undegraded":"2021-01-03T13:54:04.086099+0000","last_fullsized":"2021-01-03T13:54:04.086099+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T13:54:04.086089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T13:54:04.086089+0000","last_clean_scrub_stamp":"2021-01-03T13:54:04.086089+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"142","reported_epoch":"165","state":"active+clean","last_fresh":"2021-01-03T13:53:53.390136+0000","last_change":"2021-01-03T13:53:53.390219+0000","last_active":"2021-01-03T13:53:53.390136+0000","last_peered":"2021-01-03T13:53:53.390136+0000","last_clean":"2021-01-03T13:53:53.390136+0000","last_became_active":"2021-01-03T12:57:57.341496+0000","last_became_peered":"2021-01-03T12:57:57.341496+0000","last_unstale":"2021-01-03T13:53:53.390136+0000","last_undegraded":"2021-01-03T13:53:53.390136+0000","last_fullsized":"2021-01-03T13:53:53.390136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T13:53:53.390132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T13:53:53.390132+0000","last_clean_scrub_stamp":"2021-01-03T13:53:53.390132+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"140","reported_epoch":"165","state":"active+clean","last_fresh":"2021-01-03T13:53:54.877454+0000","last_change":"2021-01-03T13:53:54.877538+0000","last_active":"2021-01-03T13:53:54.877454+0000","last_peered":"2021-01-03T13:53:54.877454+0000","last_clean":"2021-01-03T13:53:54.877454+0000","last_became_active":"2021-01-03T12:57:57.346072+0000","last_became_peered":"2021-01-03T12:57:57.346072+0000","last_unstale":"2021-01-03T13:53:54.877454+0000","last_undegraded":"2021-01-03T13:53:54.877454+0000","last_fullsized":"2021-01-03T13:53:54.877454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-03T13:53:54.877450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-03T13:53:54.877450+0000","last_clean_scrub_stamp":"2021-01-03T13:53:54.877450+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1180,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542822,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:43 2021","interfaces":[{"interface":"back","average":{"1min":1.823,"5min":1.8029999999999999,"15min":1.742},"min":{"1min":1.264,"5min":1.264,"15min":1.1220000000000001},"max":{"1min":3.089,"5min":3.1720000000000002,"15min":3.1720000000000002},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.8120000000000001,"5min":1.96,"15min":1.833},"min":{"1min":1.339,"5min":1.1619999999999999,"15min":1.1619999999999999},"max":{"1min":2.577,"5min":3.863,"15min":3.863},"last":2.4630000000000001}]},{"osd":1,"last update":"Sun Jan 3 13:53:43 2021","interfaces":[{"interface":"back","average":{"1min":2.0489999999999999,"5min":2.036,"15min":1.968},"min":{"1min":1.474,"5min":1.474,"15min":1.306},"max":{"1min":3.3250000000000002,"5min":3.3250000000000002,"15min":3.371},"last":2.3679999999999999},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.1549999999999998,"15min":2.2469999999999999},"min":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.377},"max":{"1min":3.5329999999999999,"5min":3.5329999999999999,"15min":4.2910000000000004},"last":2.028}]},{"osd":2,"last update":"Sun Jan 3 13:53:43 2021","interfaces":[{"interface":"back","average":{"1min":2.4329999999999998,"5min":2.2850000000000001,"15min":2.343},"min":{"1min":1.8799999999999999,"5min":1.4419999999999999,"15min":1.292},"max":{"1min":3.4220000000000002,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":1.8},{"interface":"front","average":{"1min":2.516,"5min":2.2930000000000001,"15min":2.294},"min":{"1min":1.772,"5min":1.3069999999999999,"15min":1.2110000000000001},"max":{"1min":3.0089999999999999,"5min":3.601,"15min":3.601},"last":1.9239999999999999}]},{"osd":3,"last update":"Sun Jan 3 13:53:43 2021","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":2.427,"15min":2.468},"min":{"1min":1.863,"5min":1.367,"15min":1.367},"max":{"1min":3.218,"5min":3.218,"15min":3.9950000000000001},"last":2.7389999999999999},{"interface":"front","average":{"1min":2.6419999999999999,"5min":2.5960000000000001,"15min":2.5630000000000002},"min":{"1min":1.9239999999999999,"5min":1.788,"15min":1.645},"max":{"1min":3.4470000000000001,"5min":3.4470000000000001,"15min":3.875},"last":2.3180000000000001}]},{"osd":4,"last update":"Sun Jan 3 13:53:43 2021","interfaces":[{"interface":"back","average":{"1min":2.8999999999999999,"5min":2.7610000000000001,"15min":2.8109999999999999},"min":{"1min":1.724,"5min":1.371,"15min":1.371},"max":{"1min":3.7069999999999999,"5min":3.7069999999999999,"15min":4.1349999999999998},"last":2.6779999999999999},{"interface":"front","average":{"1min":2.8159999999999998,"5min":2.7650000000000001,"15min":2.798},"min":{"1min":2.1989999999999998,"5min":1.6459999999999999,"15min":1.6459999999999999},"max":{"1min":3.4510000000000001,"5min":4.6740000000000004,"15min":4.6740000000000004},"last":2.9079999999999999}]},{"osd":5,"last update":"Sun Jan 3 13:53:43 2021","interfaces":[{"interface":"back","average":{"1min":2.8759999999999999,"5min":2.7890000000000001,"15min":2.823},"min":{"1min":2.2000000000000002,"5min":1.476,"15min":1.476},"max":{"1min":3.5529999999999999,"5min":3.6099999999999999,"15min":4.4109999999999996},"last":3.0499999999999998},{"interface":"front","average":{"1min":3.1539999999999999,"5min":3.0350000000000001,"15min":3.109},"min":{"1min":2.2930000000000001,"5min":1.474,"15min":1.3959999999999999},"max":{"1min":3.9750000000000001,"5min":4.3330000000000002,"15min":4.6779999999999999},"last":3}]},{"osd":6,"last update":"Sun Jan 3 13:53:43 2021","interfaces":[{"interface":"back","average":{"1min":3.181,"5min":3.1349999999999998,"15min":3.1150000000000002},"min":{"1min":2.5830000000000002,"5min":1.2030000000000001,"15min":1.2030000000000001},"max":{"1min":3.8250000000000002,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":3.3239999999999998},{"interface":"front","average":{"1min":3.4279999999999999,"5min":3.3639999999999999,"15min":3.3410000000000002},"min":{"1min":2.8559999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"max":{"1min":4.1929999999999996,"5min":5.5919999999999996,"15min":5.5919999999999996},"last":3.6779999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542822,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.0009999999999999,"5min":1.8859999999999999,"15min":1.804},"min":{"1min":1.264,"5min":1.264,"15min":1.171},"max":{"1min":2.8919999999999999,"5min":4.1349999999999998,"15min":4.1349999999999998},"last":1.9159999999999999},{"interface":"front","average":{"1min":1.718,"5min":1.891,"15min":1.7989999999999999},"min":{"1min":1.47,"5min":1.319,"15min":1.2569999999999999},"max":{"1min":2.6200000000000001,"5min":3.0920000000000001,"15min":3.347},"last":2.0289999999999999}]},{"osd":1,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.1890000000000001,"5min":2.306,"15min":2.2829999999999999},"min":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.2829999999999999},"max":{"1min":3.843,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":1.458},{"interface":"front","average":{"1min":2.6970000000000001,"5min":2.7639999999999998,"15min":2.694},"min":{"1min":2.02,"5min":1.4770000000000001,"15min":1.464},"max":{"1min":3.3929999999999998,"5min":4.375,"15min":4.375},"last":2.5190000000000001}]},{"osd":2,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.177,"5min":2.0419999999999998,"15min":2.0150000000000001},"min":{"1min":1.6539999999999999,"5min":1.4330000000000001,"15min":1.2470000000000001},"max":{"1min":3.0870000000000002,"5min":3.8260000000000001,"15min":3.8260000000000001},"last":1.865},{"interface":"front","average":{"1min":2.5230000000000001,"5min":2.556,"15min":2.4969999999999999},"min":{"1min":1.6499999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"max":{"1min":3.319,"5min":4.9359999999999999,"15min":4.9359999999999999},"last":2.3090000000000002}]},{"osd":3,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.3900000000000001,"5min":2.359,"15min":2.339},"min":{"1min":1.9710000000000001,"5min":1.6619999999999999,"15min":1.4019999999999999},"max":{"1min":3.1389999999999998,"5min":3.726,"15min":5.1210000000000004},"last":1.661},{"interface":"front","average":{"1min":2.4220000000000002,"5min":2.4359999999999999,"15min":2.3959999999999999},"min":{"1min":1.593,"5min":1.593,"15min":1.4219999999999999},"max":{"1min":3.2480000000000002,"5min":4.1559999999999997,"15min":4.4980000000000002},"last":2.625}]},{"osd":4,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.8530000000000002,"5min":2.9009999999999998,"15min":2.8340000000000001},"min":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.49},"max":{"1min":3.7370000000000001,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":2.734},{"interface":"front","average":{"1min":2.9750000000000001,"5min":2.9159999999999999,"15min":2.8439999999999999},"min":{"1min":1.875,"5min":1.875,"15min":1.6890000000000001},"max":{"1min":4.0529999999999999,"5min":4.3479999999999999,"15min":5.0069999999999997},"last":2.819}]},{"osd":5,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":2.9630000000000001,"5min":2.75,"15min":2.7210000000000001},"min":{"1min":2.0139999999999998,"5min":1.353,"15min":0.93700000000000006},"max":{"1min":3.4489999999999998,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":2.2370000000000001},{"interface":"front","average":{"1min":3.302,"5min":3.2490000000000001,"15min":3.1800000000000002},"min":{"1min":2.4449999999999998,"5min":2.2450000000000001,"15min":1.4510000000000001},"max":{"1min":4.0780000000000003,"5min":5.3410000000000002,"15min":5.3410000000000002},"last":3.1629999999999998}]},{"osd":7,"last update":"Sun Jan 3 13:53:40 2021","interfaces":[{"interface":"back","average":{"1min":3.3090000000000002,"5min":3.3109999999999999,"15min":3.2469999999999999},"min":{"1min":2.456,"5min":1.889,"15min":1.889},"max":{"1min":4.2770000000000001,"5min":4.798,"15min":4.798},"last":3.052},{"interface":"front","average":{"1min":3.4319999999999999,"5min":3.27,"15min":3.2290000000000001},"min":{"1min":2.601,"5min":2.077,"15min":1.0760000000000001},"max":{"1min":4.2050000000000001,"5min":4.5670000000000002,"15min":4.5670000000000002},"last":3.093}]}]},{"osd":1,"up_from":14,"seq":60129542822,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.7110000000000001,"15min":1.706},"min":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3129999999999999},"max":{"1min":2.0259999999999998,"5min":3.6000000000000001,"15min":3.6000000000000001},"last":1.546},{"interface":"front","average":{"1min":1.7529999999999999,"5min":1.8029999999999999,"15min":1.8149999999999999},"min":{"1min":1.4950000000000001,"5min":1.337,"15min":1.337},"max":{"1min":2.3639999999999999,"5min":2.9910000000000001,"15min":4.5979999999999999},"last":1.629}]},{"osd":2,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":1.9810000000000001,"5min":1.8799999999999999,"15min":1.8839999999999999},"min":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"max":{"1min":3.194,"5min":3.194,"15min":3.528},"last":1.9339999999999999},{"interface":"front","average":{"1min":2.6019999999999999,"5min":2.556,"15min":2.569},"min":{"1min":1.9850000000000001,"5min":1.665,"15min":1.5649999999999999},"max":{"1min":3.0960000000000001,"5min":3.9809999999999999,"15min":3.9809999999999999},"last":2.7770000000000001}]},{"osd":3,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":2.2669999999999999,"5min":2.21,"15min":2.1930000000000001},"min":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.4810000000000001},"max":{"1min":3.5619999999999998,"5min":4.3579999999999997,"15min":4.3579999999999997},"last":2.3460000000000001},{"interface":"front","average":{"1min":2.3980000000000001,"5min":2.3399999999999999,"15min":2.3479999999999999},"min":{"1min":1.9279999999999999,"5min":1.5069999999999999,"15min":1.357},"max":{"1min":2.9100000000000001,"5min":2.996,"15min":3.262},"last":2.1989999999999998}]},{"osd":4,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":2.1469999999999998,"5min":2.3100000000000001,"15min":2.3239999999999998},"min":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.544},"max":{"1min":2.8900000000000001,"5min":3.5649999999999999,"15min":3.5649999999999999},"last":1.7310000000000001},{"interface":"front","average":{"1min":2.7749999999999999,"5min":2.8109999999999999,"15min":2.798},"min":{"1min":2.2149999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"max":{"1min":3.75,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":3.1869999999999998}]},{"osd":5,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":2.8530000000000002,"5min":2.8879999999999999,"15min":2.8679999999999999},"min":{"1min":2.1360000000000001,"5min":2.0289999999999999,"15min":1.9750000000000001},"max":{"1min":3.7010000000000001,"5min":3.9969999999999999,"15min":4.306},"last":2.4249999999999998},{"interface":"front","average":{"1min":2.8010000000000002,"5min":2.8839999999999999,"15min":2.919},"min":{"1min":2.109,"5min":1.855,"15min":1.847},"max":{"1min":3.6970000000000001,"5min":4.6509999999999998,"15min":4.6509999999999998},"last":2.5030000000000001}]},{"osd":6,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":3.1850000000000001,"5min":3.177,"15min":3.2090000000000001},"min":{"1min":2.3050000000000002,"5min":2.27,"15min":1.903},"max":{"1min":4.2000000000000002,"5min":4.7990000000000004,"15min":4.9720000000000004},"last":2.8570000000000002},{"interface":"front","average":{"1min":2.984,"5min":3.1469999999999998,"15min":3.1579999999999999},"min":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"max":{"1min":3.9300000000000002,"5min":5.5960000000000001,"15min":5.5960000000000001},"last":2.2879999999999998}]},{"osd":7,"last update":"Sun Jan 3 13:53:32 2021","interfaces":[{"interface":"back","average":{"1min":3.2429999999999999,"5min":3.2229999999999999,"15min":3.2010000000000001},"min":{"1min":2.6379999999999999,"5min":2.54,"15min":2.4660000000000002},"max":{"1min":4.1210000000000004,"5min":5.1449999999999996,"15min":5.1840000000000002},"last":3.54},{"interface":"front","average":{"1min":3.2349999999999999,"5min":3.302,"15min":3.2810000000000001},"min":{"1min":2.8999999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"max":{"1min":3.8119999999999998,"5min":4.2729999999999997,"15min":5.3730000000000002},"last":3.133}]}]},{"osd":0,"up_from":14,"seq":60129542822,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":1.7609999999999999,"15min":1.704},"min":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.1950000000000001},"max":{"1min":2.5920000000000001,"5min":2.9870000000000001,"15min":3.0179999999999998},"last":2.1989999999999998},{"interface":"front","average":{"1min":1.8540000000000001,"5min":1.869,"15min":1.8180000000000001},"min":{"1min":1.403,"5min":1.377,"15min":1.244},"max":{"1min":2.9100000000000001,"5min":3.1459999999999999,"15min":3.2690000000000001},"last":2.0910000000000002}]},{"osd":2,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":2.101,"5min":2.0960000000000001,"15min":2.101},"min":{"1min":1.4330000000000001,"5min":1.4099999999999999,"15min":1.2589999999999999},"max":{"1min":2.645,"5min":2.9009999999999998,"15min":3.4009999999999998},"last":2.7450000000000001},{"interface":"front","average":{"1min":2.415,"5min":2.3780000000000001,"15min":2.3730000000000002},"min":{"1min":2.0489999999999999,"5min":1.8009999999999999,"15min":1.4399999999999999},"max":{"1min":3.1339999999999999,"5min":3.242,"15min":3.4870000000000001},"last":2.4969999999999999}]},{"osd":3,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":2.052,"5min":1.839,"15min":1.8100000000000001},"min":{"1min":1.5409999999999999,"5min":1.403,"15min":1.2749999999999999},"max":{"1min":3.0379999999999998,"5min":3.0379999999999998,"15min":3.0379999999999998},"last":2.153},{"interface":"front","average":{"1min":2.355,"5min":2.4180000000000001,"15min":2.407},"min":{"1min":1.9490000000000001,"5min":1.8240000000000001,"15min":1.5900000000000001},"max":{"1min":2.9260000000000002,"5min":3.411,"15min":3.411},"last":2.536}]},{"osd":4,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":2.2320000000000002,"5min":2.403,"15min":2.415},"min":{"1min":1.5600000000000001,"5min":1.5349999999999999,"15min":1.486},"max":{"1min":3.3540000000000001,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":2.6920000000000002},{"interface":"front","average":{"1min":2.4249999999999998,"5min":2.4529999999999998,"15min":2.4900000000000002},"min":{"1min":2.0419999999999998,"5min":1.746,"15min":1.647},"max":{"1min":3.3410000000000002,"5min":3.6629999999999998,"15min":4.1900000000000004},"last":2.802}]},{"osd":5,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":2.3300000000000001,"5min":2.4929999999999999,"15min":2.5099999999999998},"min":{"1min":1.627,"5min":1.627,"15min":1.627},"max":{"1min":3.1080000000000001,"5min":3.851,"15min":4.4779999999999998},"last":2.5819999999999999},{"interface":"front","average":{"1min":3.0230000000000001,"5min":2.944,"15min":2.9670000000000001},"min":{"1min":2.4870000000000001,"5min":1.9570000000000001,"15min":1.9490000000000001},"max":{"1min":3.5049999999999999,"5min":3.9929999999999999,"15min":4.2119999999999997},"last":2.927}]},{"osd":6,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":3.113,"5min":3.1299999999999999,"15min":3.2000000000000002},"min":{"1min":2.6019999999999999,"5min":2.214,"15min":2.214},"max":{"1min":3.548,"5min":3.9300000000000002,"15min":4.1459999999999999},"last":3.7690000000000001},{"interface":"front","average":{"1min":2.8530000000000002,"5min":3.0139999999999998,"15min":2.9790000000000001},"min":{"1min":2.343,"5min":2.343,"15min":2.1749999999999998},"max":{"1min":3.4089999999999998,"5min":4.0659999999999998,"15min":4.274},"last":3.375}]},{"osd":7,"last update":"Sun Jan 3 13:53:21 2021","interfaces":[{"interface":"back","average":{"1min":3.1000000000000001,"5min":3.2480000000000002,"15min":3.2189999999999999},"min":{"1min":2.52,"5min":2.5129999999999999,"15min":1.921},"max":{"1min":3.7120000000000002,"5min":4.1609999999999996,"15min":4.806},"last":3.6469999999999998},{"interface":"front","average":{"1min":2.9870000000000001,"5min":3.0630000000000002,"15min":3.069},"min":{"1min":2.5030000000000001,"5min":2.363,"15min":1.8140000000000001},"max":{"1min":3.3799999999999999,"5min":3.988,"15min":4.3810000000000002},"last":3.2789999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542822,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.6419999999999999,"15min":1.657},"min":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"max":{"1min":2.0910000000000002,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":1.357},{"interface":"front","average":{"1min":1.6379999999999999,"5min":1.7549999999999999,"15min":1.7749999999999999},"min":{"1min":1.3660000000000001,"5min":1.278,"15min":1.278},"max":{"1min":2.2989999999999999,"5min":2.8679999999999999,"15min":3.2429999999999999},"last":2.1960000000000002}]},{"osd":1,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":2.0030000000000001,"5min":2.101,"15min":2.0859999999999999},"min":{"1min":1.373,"5min":1.3720000000000001,"15min":1.3400000000000001},"max":{"1min":3.117,"5min":3.117,"15min":3.117},"last":1.982},{"interface":"front","average":{"1min":2.0760000000000001,"5min":2.085,"15min":2.0870000000000002},"min":{"1min":1.774,"5min":1.46,"15min":1.4279999999999999},"max":{"1min":2.5099999999999998,"5min":2.8380000000000001,"15min":3.2149999999999999},"last":1.72}]},{"osd":3,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":1.984,"5min":2.0430000000000001,"15min":1.994},"min":{"1min":1.4610000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"max":{"1min":3.0840000000000001,"5min":3.198,"15min":3.5699999999999998},"last":1.4330000000000001},{"interface":"front","average":{"1min":2.4670000000000001,"5min":2.5790000000000002,"15min":2.5619999999999998},"min":{"1min":2.036,"5min":1.9399999999999999,"15min":1.5900000000000001},"max":{"1min":3.4089999999999998,"5min":3.508,"15min":3.6549999999999998},"last":2.7999999999999998}]},{"osd":4,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":2.609,"5min":2.476,"15min":2.532},"min":{"1min":1.95,"5min":1.502,"15min":1.502},"max":{"1min":3.5609999999999999,"5min":3.6890000000000001,"15min":3.6890000000000001},"last":1.923},{"interface":"front","average":{"1min":2.1640000000000001,"5min":2.2829999999999999,"15min":2.3239999999999998},"min":{"1min":1.46,"5min":1.46,"15min":1.46},"max":{"1min":2.9780000000000002,"5min":3.4129999999999998,"15min":3.4129999999999998},"last":2.097}]},{"osd":5,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":2.589,"5min":2.875,"15min":2.8210000000000002},"min":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.7669999999999999},"max":{"1min":3.7200000000000002,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":2.4430000000000001},{"interface":"front","average":{"1min":2.968,"5min":2.9929999999999999,"15min":3.0430000000000001},"min":{"1min":2.3090000000000002,"5min":1.925,"15min":1.925},"max":{"1min":3.8279999999999998,"5min":4.0789999999999997,"15min":4.0970000000000004},"last":2.617}]},{"osd":6,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":2.7450000000000001,"5min":2.746,"15min":2.7679999999999998},"min":{"1min":2.2330000000000001,"5min":1.9830000000000001,"15min":1.8500000000000001},"max":{"1min":3.633,"5min":4.4660000000000002,"15min":4.4660000000000002},"last":2.3719999999999999},{"interface":"front","average":{"1min":2.9569999999999999,"5min":3.1160000000000001,"15min":3.1280000000000001},"min":{"1min":2.395,"5min":2.395,"15min":2.3220000000000001},"max":{"1min":3.5859999999999999,"5min":4.1609999999999996,"15min":4.2519999999999998},"last":3.1739999999999999}]},{"osd":7,"last update":"Sun Jan 3 13:53:30 2021","interfaces":[{"interface":"back","average":{"1min":3.2149999999999999,"5min":3.1899999999999999,"15min":3.2429999999999999},"min":{"1min":2.5590000000000002,"5min":2.4129999999999998,"15min":2.302},"max":{"1min":3.9750000000000001,"5min":3.9750000000000001,"15min":4.3109999999999999},"last":3.0009999999999999},{"interface":"front","average":{"1min":2.9630000000000001,"5min":3.1230000000000002,"15min":3.105},"min":{"1min":2.4569999999999999,"5min":2.1989999999999998,"15min":1.881},"max":{"1min":3.464,"5min":4.2279999999999998,"15min":4.2279999999999998},"last":2.5459999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542822,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.661,"15min":1.6519999999999999},"min":{"1min":1.2669999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"max":{"1min":2.1040000000000001,"5min":2.528,"15min":3.024},"last":1.772},{"interface":"front","average":{"1min":1.657,"5min":1.653,"15min":1.6699999999999999},"min":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"max":{"1min":2.4750000000000001,"5min":2.52,"15min":2.8079999999999998},"last":1.6859999999999999}]},{"osd":1,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":1.883,"5min":1.9039999999999999,"15min":1.8540000000000001},"min":{"1min":1.355,"5min":1.355,"15min":1.2849999999999999},"max":{"1min":2.8399999999999999,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":1.5609999999999999},{"interface":"front","average":{"1min":2.0390000000000001,"5min":2.0649999999999999,"15min":2.097},"min":{"1min":1.458,"5min":1.331,"15min":1.331},"max":{"1min":2.4780000000000002,"5min":2.698,"15min":3.1099999999999999},"last":2.2050000000000001}]},{"osd":2,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":2.3239999999999998,"5min":2.202,"15min":2.242},"min":{"1min":1.573,"5min":1.5229999999999999,"15min":1.3879999999999999},"max":{"1min":3.4300000000000002,"5min":3.4300000000000002,"15min":3.4300000000000002},"last":2.4620000000000002},{"interface":"front","average":{"1min":2.5880000000000001,"5min":2.5329999999999999,"15min":2.5379999999999998},"min":{"1min":2.0680000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"max":{"1min":3.0939999999999999,"5min":3.2879999999999998,"15min":3.532},"last":2.4239999999999999}]},{"osd":4,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":2.3599999999999999,"5min":2.3140000000000001,"15min":2.319},"min":{"1min":1.857,"5min":1.6559999999999999,"15min":1.524},"max":{"1min":3.3380000000000001,"5min":3.754,"15min":4.327},"last":2.1240000000000001},{"interface":"front","average":{"1min":2.4609999999999999,"5min":2.6139999999999999,"15min":2.5859999999999999},"min":{"1min":1.792,"5min":1.619,"15min":1.619},"max":{"1min":3.2709999999999999,"5min":3.6379999999999999,"15min":4.1070000000000002},"last":2.9140000000000001}]},{"osd":5,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":2.714,"5min":2.843,"15min":2.8410000000000002},"min":{"1min":2.2320000000000002,"5min":1.899,"15min":1.6850000000000001},"max":{"1min":3.403,"5min":3.7370000000000001,"15min":4.4850000000000003},"last":3.3199999999999998},{"interface":"front","average":{"1min":2.8029999999999999,"5min":2.851,"15min":2.831},"min":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.9609999999999999},"last":2.9910000000000001}]},{"osd":6,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":2.8999999999999999,"5min":2.8620000000000001,"15min":2.875},"min":{"1min":1.76,"5min":1.76,"15min":1.76},"max":{"1min":3.8300000000000001,"5min":3.8300000000000001,"15min":5.0110000000000001},"last":2.3260000000000001},{"interface":"front","average":{"1min":3.105,"5min":3.2669999999999999,"15min":3.2749999999999999},"min":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"max":{"1min":3.7639999999999998,"5min":4.093,"15min":5.1760000000000002},"last":3.6659999999999999}]},{"osd":7,"last update":"Sun Jan 3 13:53:37 2021","interfaces":[{"interface":"back","average":{"1min":3.0910000000000002,"5min":3.1120000000000001,"15min":3.125},"min":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"max":{"1min":3.5419999999999998,"5min":3.8159999999999998,"15min":4.4379999999999997},"last":3.1859999999999999},{"interface":"front","average":{"1min":3.085,"5min":3.0419999999999998,"15min":3.0419999999999998},"min":{"1min":2.5539999999999998,"5min":2.3519999999999999,"15min":2.3519999999999999},"max":{"1min":3.5339999999999998,"5min":3.9380000000000002,"15min":4.1210000000000004},"last":3.0219999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542821,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":2.032,"5min":1.913,"15min":2.0099999999999998},"min":{"1min":1.405,"5min":1.044,"15min":1.044},"max":{"1min":2.4889999999999999,"5min":3.1150000000000002,"15min":4.0910000000000002},"last":1.544},{"interface":"front","average":{"1min":2.6699999999999999,"5min":2.512,"15min":2.5609999999999999},"min":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"max":{"1min":3.0880000000000001,"5min":3.444,"15min":3.7890000000000001},"last":2.948}]},{"osd":1,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":1.929,"5min":1.974,"15min":1.9319999999999999},"min":{"1min":1.524,"5min":1.369,"15min":1.264},"max":{"1min":2.7349999999999999,"5min":3.2080000000000002,"15min":3.2080000000000002},"last":2.4489999999999998},{"interface":"front","average":{"1min":1.8520000000000001,"5min":1.9930000000000001,"15min":2.044},"min":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.1679999999999999},"max":{"1min":2.605,"5min":3.2890000000000001,"15min":3.5009999999999999},"last":1.8480000000000001}]},{"osd":2,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":1.958,"5min":2.1280000000000001,"15min":2.1819999999999999},"min":{"1min":1.137,"5min":1.137,"15min":1.137},"max":{"1min":2.677,"5min":3.7120000000000002,"15min":3.7120000000000002},"last":2.5350000000000001},{"interface":"front","average":{"1min":2.1850000000000001,"5min":2.395,"15min":2.4009999999999998},"min":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.327},"max":{"1min":3.2349999999999999,"5min":3.46,"15min":3.6840000000000002},"last":2.746}]},{"osd":3,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":2.4249999999999998,"5min":2.3559999999999999,"15min":2.3540000000000001},"min":{"1min":1.863,"5min":1.601,"15min":1.54},"max":{"1min":3.5720000000000001,"5min":3.5720000000000001,"15min":4.3579999999999997},"last":2.6859999999999999},{"interface":"front","average":{"1min":2.7959999999999998,"5min":2.8479999999999999,"15min":2.8519999999999999},"min":{"1min":2.5030000000000001,"5min":2.181,"15min":1.2769999999999999},"max":{"1min":3.234,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":2.8929999999999998}]},{"osd":5,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":2.8180000000000001,"5min":2.75,"15min":2.7050000000000001},"min":{"1min":1.9119999999999999,"5min":1.843,"15min":1.552},"max":{"1min":3.6150000000000002,"5min":3.6869999999999998,"15min":3.8740000000000001},"last":3.1579999999999999},{"interface":"front","average":{"1min":2.681,"5min":2.6800000000000002,"15min":2.6709999999999998},"min":{"1min":2.0750000000000002,"5min":1.522,"15min":1.522},"max":{"1min":3.3359999999999999,"5min":3.6920000000000002,"15min":4.556},"last":2.863}]},{"osd":6,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":3.0579999999999998,"5min":3.0249999999999999,"15min":2.9630000000000001},"min":{"1min":2.3860000000000001,"5min":1.9810000000000001,"15min":1.825},"max":{"1min":4.3440000000000003,"5min":4.3440000000000003,"15min":4.3440000000000003},"last":3.3090000000000002},{"interface":"front","average":{"1min":3.4289999999999998,"5min":3.3100000000000001,"15min":3.2639999999999998},"min":{"1min":3.0409999999999999,"5min":2.7509999999999999,"15min":1.98},"max":{"1min":4.6870000000000003,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":3.3540000000000001}]},{"osd":7,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":2.9710000000000001,"5min":2.9929999999999999,"15min":3.0139999999999998},"min":{"1min":2.5539999999999998,"5min":1.879,"15min":1.111},"max":{"1min":3.613,"5min":3.9660000000000002,"15min":4.2850000000000001},"last":2.9950000000000001},{"interface":"front","average":{"1min":3.278,"5min":3.27,"15min":3.2839999999999998},"min":{"1min":2.766,"5min":2.0920000000000001,"15min":1.5429999999999999},"max":{"1min":3.7400000000000002,"5min":4.3090000000000002,"15min":4.3090000000000002},"last":3.1160000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542822,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050632,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321208,"statfs":{"total":96636764160,"available":95560916992,"internally_reserved":1073741824,"allocated":2097152,"data_stored":975630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":1.6850000000000001,"5min":1.6990000000000001,"15min":1.7},"min":{"1min":1.268,"5min":1.107,"15min":1.107},"max":{"1min":2.4649999999999999,"5min":2.9870000000000001,"15min":3.1480000000000001},"last":1.879},{"interface":"front","average":{"1min":1.891,"5min":1.8500000000000001,"15min":1.8819999999999999},"min":{"1min":1.2350000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"max":{"1min":2.698,"5min":2.9580000000000002,"15min":3.2669999999999999},"last":1.9570000000000001}]},{"osd":1,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":1.9339999999999999,"5min":1.865,"15min":1.847},"min":{"1min":1.609,"5min":1.3899999999999999,"15min":1.206},"max":{"1min":2.5710000000000002,"5min":2.992,"15min":2.992},"last":2.024},{"interface":"front","average":{"1min":2.2229999999999999,"5min":2.2120000000000002,"15min":2.202},"min":{"1min":1.7450000000000001,"5min":1.278,"15min":1.278},"max":{"1min":3.097,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":2.54}]},{"osd":2,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":2.3919999999999999,"5min":2.3809999999999998,"15min":2.3220000000000001},"min":{"1min":1.581,"5min":1.518,"15min":1.4870000000000001},"max":{"1min":3.597,"5min":3.597,"15min":3.597},"last":2.706},{"interface":"front","average":{"1min":2.7069999999999999,"5min":2.6299999999999999,"15min":2.677},"min":{"1min":2.0139999999999998,"5min":1.6970000000000001,"15min":1.6970000000000001},"max":{"1min":3.2770000000000001,"5min":3.476,"15min":3.984},"last":2.9009999999999998}]},{"osd":3,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":2.8300000000000001,"5min":2.7519999999999998,"15min":2.6930000000000001},"min":{"1min":1.994,"5min":1.7230000000000001,"15min":1.6000000000000001},"max":{"1min":3.4180000000000001,"5min":3.8010000000000002,"15min":3.8010000000000002},"last":3.0830000000000002},{"interface":"front","average":{"1min":2.8740000000000001,"5min":2.823,"15min":2.8730000000000002},"min":{"1min":2.0059999999999998,"5min":1.472,"15min":1.472},"max":{"1min":3.637,"5min":4.0229999999999997,"15min":4.2759999999999998},"last":3.327}]},{"osd":4,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":2.6669999999999998,"5min":2.6989999999999998,"15min":2.6819999999999999},"min":{"1min":2.1789999999999998,"5min":1.415,"15min":1.3300000000000001},"max":{"1min":3.6309999999999998,"5min":3.6309999999999998,"15min":4.0060000000000002},"last":3.169},{"interface":"front","average":{"1min":3.0219999999999998,"5min":3.0230000000000001,"15min":3.036},"min":{"1min":1.929,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":4.016,"5min":4.1310000000000002,"15min":4.1609999999999996},"last":3.4860000000000002}]},{"osd":6,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":2.8730000000000002,"5min":2.8460000000000001,"15min":2.8370000000000002},"min":{"1min":2.0779999999999998,"5min":1.3009999999999999,"15min":1.3009999999999999},"max":{"1min":4.0419999999999998,"5min":4.0419999999999998,"15min":4.7880000000000003},"last":3.7320000000000002},{"interface":"front","average":{"1min":2.9140000000000001,"5min":2.9870000000000001,"15min":2.972},"min":{"1min":2.4289999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.609,"5min":3.8690000000000002,"15min":3.9710000000000001},"last":3.5910000000000002}]},{"osd":7,"last update":"Sun Jan 3 13:53:44 2021","interfaces":[{"interface":"back","average":{"1min":3.427,"5min":3.3330000000000002,"15min":3.3260000000000001},"min":{"1min":2.1520000000000001,"5min":1.841,"15min":1.841},"max":{"1min":3.9820000000000002,"5min":4.3620000000000001,"15min":4.6619999999999999},"last":3.8069999999999999},{"interface":"front","average":{"1min":3.3700000000000001,"5min":3.2890000000000001,"15min":3.3399999999999999},"min":{"1min":2.7400000000000002,"5min":1.6339999999999999,"15min":1.6339999999999999},"max":{"1min":4.4180000000000001,"5min":4.4489999999999998,"15min":5.0129999999999999},"last":3.948}]}]}]}} 2021-01-03T13:54:11.828 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2021-01-03T13:54:11.944 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.935+0000 7f3931742700 1 Processor -- start 2021-01-03T13:54:11.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.935+0000 7f3931742700 1 -- start start 2021-01-03T13:54:11.945 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.935+0000 7f3931742700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f392c062450 0x7f392c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:54:11.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.935+0000 7f3931742700 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f392c0b33b0 0x7f392c14f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-03T13:54:11.946 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.935+0000 7f3931742700 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392c0adff0 con 0x7f392c0adc10 2021-01-03T13:54:11.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.935+0000 7f3931742700 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392c0b1930 con 0x7f392c0b33b0 2021-01-03T13:54:11.947 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.935+0000 7f3931742700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392c05fb80 con 0x7f392c062450 2021-01-03T13:54:11.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f392bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f392c062450 0x7f392c067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:54:11.948 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f392bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f392c062450 0x7f392c067cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41524/0 (socket says 172.21.15.133:41524) 2021-01-03T13:54:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f392bfff700 1 -- 172.21.15.133:0/3221644432 learned_addr learned my addr 172.21.15.133:0/3221644432 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:54:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f39329a4700 1 --2- 172.21.15.133:0/3221644432 >> v2:172.21.15.16:3300/0 conn(0x7f392c0b33b0 0x7f392c14f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:54:11.949 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f392b7fe700 1 -- 172.21.15.133:0/3221644432 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216344984 0 0) 0x7f392c0adff0 con 0x7f392c0adc10 2021-01-03T13:54:11.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f392b7fe700 1 -- 172.21.15.133:0/3221644432 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3918003230 con 0x7f392c0adc10 2021-01-03T13:54:11.950 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f392bfff700 1 -- 172.21.15.133:0/3221644432 >> v2:172.21.15.16:3300/0 conn(0x7f392c0b33b0 msgr2=0x7f392c14f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-03T13:54:11.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f392bfff700 1 --2- 172.21.15.133:0/3221644432 >> v2:172.21.15.16:3300/0 conn(0x7f392c0b33b0 0x7f392c14f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:54:11.951 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f392bfff700 1 -- 172.21.15.133:0/3221644432 >> v1:172.21.15.16:6789/0 conn(0x7f392c0adc10 legacy=0x7f392c0b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:54:11.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f392bfff700 1 -- 172.21.15.133:0/3221644432 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c0b3860 con 0x7f392c062450 2021-01-03T13:54:11.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f392bfff700 1 --2- 172.21.15.133:0/3221644432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c062450 0x7f392c067cb0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7f3914002f30 tx=0x7f3914006e80).ready entity=mon.1 client_cookie=56ecbe14c5b510d5 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:54:11.952 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f392b7fe700 1 -- 172.21.15.133:0/3221644432 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3914009640 con 0x7f392c062450 2021-01-03T13:54:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f392b7fe700 1 -- 172.21.15.133:0/3221644432 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39140097a0 con 0x7f392c062450 2021-01-03T13:54:11.953 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f392b7fe700 1 -- 172.21.15.133:0/3221644432 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3914009b00 con 0x7f392c062450 2021-01-03T13:54:11.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f3931742700 1 -- 172.21.15.133:0/3221644432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c062450 msgr2=0x7f392c067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:54:11.954 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f3931742700 1 --2- 172.21.15.133:0/3221644432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c062450 0x7f392c067cb0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7f3914002f30 tx=0x7f3914006e80).stop 2021-01-03T13:54:11.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f3931742700 1 -- 172.21.15.133:0/3221644432 shutdown_connections 2021-01-03T13:54:11.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f3931742700 1 --2- 172.21.15.133:0/3221644432 >> v2:172.21.15.16:3300/0 conn(0x7f392c0b33b0 0x7f392c14f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-03T13:54:11.955 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f3931742700 1 --2- 172.21.15.133:0/3221644432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c062450 0x7f392c067cb0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:54:11.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f3931742700 1 -- 172.21.15.133:0/3221644432 >> 172.21.15.133:0/3221644432 conn(0x7f392c060d10 msgr2=0x7f392c061b30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:54:11.956 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f3931742700 1 -- 172.21.15.133:0/3221644432 shutdown_connections 2021-01-03T13:54:11.957 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.939+0000 7f3931742700 1 -- 172.21.15.133:0/3221644432 wait complete. 2021-01-03T13:54:11.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.943+0000 7f3931742700 1 Processor -- start 2021-01-03T13:54:11.962 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.943+0000 7f3931742700 1 -- start start 2021-01-03T13:54:11.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.943+0000 7f3931742700 1 --2- >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f392c062450 0x7f392c0b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:54:11.963 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.943+0000 7f3931742700 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f392c0adc10 0x7f392c12c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:54:11.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.943+0000 7f3931742700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0b33b0 0x7f392c12cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:54:11.964 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.943+0000 7f3931742700 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c124140 con 0x7f392c0adc10 2021-01-03T13:54:11.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.943+0000 7f3931742700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c1243e0 con 0x7f392c0b33b0 2021-01-03T13:54:11.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.943+0000 7f3931742700 1 -- --> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392c124680 con 0x7f392c062450 2021-01-03T13:54:11.965 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.943+0000 7f39329a4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0b33b0 0x7f392c12cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:54:11.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.943+0000 7f39329a4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0b33b0 0x7f392c12cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:41532/0 (socket says 172.21.15.133:41532) 2021-01-03T13:54:11.966 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.943+0000 7f39329a4700 1 -- 172.21.15.133:0/3758005248 learned_addr learned my addr 172.21.15.133:0/3758005248 (peer_addr_for_me v2:172.21.15.133:0/0) 2021-01-03T13:54:11.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.943+0000 7f392bfff700 1 --2- 172.21.15.133:0/3758005248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f392c0adc10 0x7f392c12c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:54:11.967 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.943+0000 7f3930f41700 1 --2- 172.21.15.133:0/3758005248 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f392c062450 0x7f392c0b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:54:11.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.947+0000 7f39329a4700 1 -- 172.21.15.133:0/3758005248 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f392c062450 msgr2=0x7f392c0b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:54:11.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.947+0000 7f39329a4700 1 --2- 172.21.15.133:0/3758005248 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f392c062450 0x7f392c0b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:54:11.968 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.947+0000 7f39329a4700 1 -- 172.21.15.133:0/3758005248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f392c0adc10 msgr2=0x7f392c12c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:54:11.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.947+0000 7f39329a4700 1 --2- 172.21.15.133:0/3758005248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f392c0adc10 0x7f392c12c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:54:11.969 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.947+0000 7f39329a4700 1 -- 172.21.15.133:0/3758005248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c124fd0 con 0x7f392c0b33b0 2021-01-03T13:54:11.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.947+0000 7f39329a4700 1 --2- 172.21.15.133:0/3758005248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0b33b0 0x7f392c12cda0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f3924006dd0 tx=0x7f39240091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:54:11.970 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.947+0000 7f39297fa700 1 -- 172.21.15.133:0/3758005248 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f392400c8f0 con 0x7f392c0b33b0 2021-01-03T13:54:11.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.947+0000 7f39297fa700 1 -- 172.21.15.133:0/3758005248 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392400ca50 con 0x7f392c0b33b0 2021-01-03T13:54:11.971 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.947+0000 7f39297fa700 1 -- 172.21.15.133:0/3758005248 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f392400cdb0 con 0x7f392c0b33b0 2021-01-03T13:54:11.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.947+0000 7f3931742700 1 -- 172.21.15.133:0/3758005248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392c126dd0 con 0x7f392c0b33b0 2021-01-03T13:54:11.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.947+0000 7f3931742700 1 -- 172.21.15.133:0/3758005248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392c066d90 con 0x7f392c0b33b0 2021-01-03T13:54:11.972 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.947+0000 7f3931742700 1 -- 172.21.15.133:0/3758005248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392c124840 con 0x7f392c0b33b0 2021-01-03T13:54:11.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.947+0000 7f39297fa700 1 -- 172.21.15.133:0/3758005248 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 66880+0+0 (secure 0 0 0) 0x7f3924022070 con 0x7f392c0b33b0 2021-01-03T13:54:11.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.947+0000 7f39297fa700 1 --2- 172.21.15.133:0/3758005248 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f39100554d0 0x7f3910057990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-03T13:54:11.973 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.947+0000 7f39297fa700 1 -- 172.21.15.133:0/3758005248 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f392406e2e0 con 0x7f392c0b33b0 2021-01-03T13:54:11.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.951+0000 7f3930f41700 1 --2- 172.21.15.133:0/3758005248 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f39100554d0 0x7f3910057990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-03T13:54:11.974 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.951+0000 7f3930f41700 1 --2- 172.21.15.133:0/3758005248 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f39100554d0 0x7f3910057990 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f391c00d000 tx=0x7f391c0079f0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-03T13:54:11.975 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:11.955+0000 7f39297fa700 1 -- 172.21.15.133:0/3758005248 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3924044820 con 0x7f392c0b33b0 2021-01-03T13:54:12.097 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:12.095+0000 7f3931742700 1 -- 172.21.15.133:0/3758005248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"} v 0) v1 -- 0x7f392c057300 con 0x7f392c0b33b0 2021-01-03T13:54:12.105 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:12.103+0000 7f39297fa700 1 -- 172.21.15.133:0/3758005248 <== mon.1 v2:172.21.15.133:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3924044820 con 0x7f392c0b33b0 2021-01-03T13:54:12.106 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:12.103+0000 7f39297fa700 1 -- 172.21.15.133:0/3758005248 <== mon.1 v2:172.21.15.133:3300/0 8 ==== mon_command_ack([{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}]=0 v25) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3924016070 con 0x7f392c0b33b0 2021-01-03T13:54:12.110 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:12.107+0000 7f3931742700 1 -- 172.21.15.133:0/3758005248 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f39100554d0 msgr2=0x7f3910057990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:54:12.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:12.107+0000 7f3931742700 1 --2- 172.21.15.133:0/3758005248 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f39100554d0 0x7f3910057990 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f391c00d000 tx=0x7f391c0079f0).stop 2021-01-03T13:54:12.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:12.107+0000 7f3931742700 1 -- 172.21.15.133:0/3758005248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0b33b0 msgr2=0x7f392c12cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-03T13:54:12.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:12.107+0000 7f3931742700 1 --2- 172.21.15.133:0/3758005248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0b33b0 0x7f392c12cda0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 rx=0x7f3924006dd0 tx=0x7f39240091a0).stop 2021-01-03T13:54:12.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:12.107+0000 7f3931742700 1 -- 172.21.15.133:0/3758005248 shutdown_connections 2021-01-03T13:54:12.111 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:12.107+0000 7f3931742700 1 --2- 172.21.15.133:0/3758005248 >> [v2:172.21.15.133:6800/11943,v1:172.21.15.133:6801/11943] conn(0x7f39100554d0 0x7f3910057990 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:54:12.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:12.107+0000 7f3931742700 1 --2- 172.21.15.133:0/3758005248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0b33b0 0x7f392c12cda0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:54:12.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:12.107+0000 7f3931742700 1 --2- 172.21.15.133:0/3758005248 >> [v2:172.21.15.16:3301/0,v1:172.21.15.16:6790/0] conn(0x7f392c062450 0x7f392c0b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:54:12.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:12.107+0000 7f3931742700 1 --2- 172.21.15.133:0/3758005248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f392c0adc10 0x7f392c12c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-03T13:54:12.112 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:12.107+0000 7f3931742700 1 -- 172.21.15.133:0/3758005248 >> 172.21.15.133:0/3758005248 conn(0x7f392c060d10 msgr2=0x7f392c0ae570 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-03T13:54:12.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:12.107+0000 7f3931742700 1 -- 172.21.15.133:0/3758005248 shutdown_connections 2021-01-03T13:54:12.113 INFO:teuthology.orchestra.run.smithi133.stderr:2021-01-03T13:54:12.107+0000 7f3931742700 1 -- 172.21.15.133:0/3758005248 wait complete. 2021-01-03T13:54:12.125 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/ceph.py", line 1839, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 173, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/ceph_fuse.py", line 159, in task if mount.is_mounted(): File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 683, in gevent._greenlet.Greenlet.get File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-01-03T13:54:12.126 INFO:teuthology.misc:Shutting down mds daemons... 2021-01-03T13:54:12.127 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2021-01-03T13:54:12.127 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:54:12.138 INFO:tasks.ceph.mds.a:Stopped 2021-01-03T13:54:12.139 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2021-01-03T13:54:12.140 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:54:12.196 INFO:tasks.ceph.mds.c:Stopped 2021-01-03T13:54:12.197 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2021-01-03T13:54:12.197 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:54:12.213 INFO:tasks.ceph.mds.b:Stopped 2021-01-03T13:54:12.214 INFO:teuthology.misc:Shutting down osd daemons... 2021-01-03T13:54:12.214 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2021-01-03T13:54:12.215 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:54:12.315 INFO:tasks.ceph.osd.0:Stopped 2021-01-03T13:54:12.315 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2021-01-03T13:54:12.316 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:54:12.391 INFO:tasks.ceph.osd.1:Stopped 2021-01-03T13:54:12.392 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2021-01-03T13:54:12.392 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:54:12.466 INFO:tasks.ceph.osd.2:Stopped 2021-01-03T13:54:12.466 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2021-01-03T13:54:12.467 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:54:12.546 INFO:tasks.ceph.osd.3:Stopped 2021-01-03T13:54:12.547 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2021-01-03T13:54:12.548 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:54:12.613 INFO:tasks.ceph.osd.4:Stopped 2021-01-03T13:54:12.614 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2021-01-03T13:54:12.615 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:54:12.669 INFO:tasks.ceph.osd.5:Stopped 2021-01-03T13:54:12.670 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2021-01-03T13:54:12.671 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:54:12.744 INFO:tasks.ceph.osd.6:Stopped 2021-01-03T13:54:12.745 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2021-01-03T13:54:12.745 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:54:12.807 INFO:tasks.ceph.osd.7:Stopped 2021-01-03T13:54:12.807 INFO:teuthology.misc:Shutting down mgr daemons... 2021-01-03T13:54:12.808 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2021-01-03T13:54:12.808 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:54:12.841 INFO:tasks.ceph.mgr.y:Stopped 2021-01-03T13:54:12.841 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2021-01-03T13:54:12.842 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:54:12.873 INFO:tasks.ceph.mgr.x:Stopped 2021-01-03T13:54:12.874 INFO:teuthology.misc:Shutting down mon daemons... 2021-01-03T13:54:12.875 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2021-01-03T13:54:12.875 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:54:12.907 INFO:tasks.ceph.mon.a:Stopped 2021-01-03T13:54:12.908 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2021-01-03T13:54:12.909 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:54:12.938 INFO:tasks.ceph.mon.b:Stopped 2021-01-03T13:54:12.939 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2021-01-03T13:54:12.939 INFO:teuthology.orchestra.run:waiting for 300 2021-01-03T13:54:12.999 INFO:tasks.ceph.mon.c:Stopped 2021-01-03T13:54:13.000 INFO:tasks.ceph:Checking cluster log for badness... 2021-01-03T13:54:13.001 DEBUG:teuthology.orchestra.run.smithi133:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'has not responded to cap revoke by MDS for over' | egrep -v MDS_CLIENT_LATE_RELEASE | egrep -v 'responding to mclientcaps' | head -n 1 2021-01-03T13:54:13.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2021-01-03T13:54:13.023 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi133.front.sepia.ceph.com 2021-01-03T13:54:13.024 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2021-01-03T13:54:13.308 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi133.front.sepia.ceph.com 2021-01-03T13:54:13.308 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-01-03T13:54:13.415 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi133.front.sepia.ceph.com 2021-01-03T13:54:13.415 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2021-01-03T13:54:13.535 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi133.front.sepia.ceph.com 2021-01-03T13:54:13.536 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2021-01-03T13:54:13.651 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi016.front.sepia.ceph.com 2021-01-03T13:54:13.652 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2021-01-03T13:54:13.901 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi016.front.sepia.ceph.com 2021-01-03T13:54:13.902 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2021-01-03T13:54:14.045 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi016.front.sepia.ceph.com 2021-01-03T13:54:14.046 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2021-01-03T13:54:14.185 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi016.front.sepia.ceph.com 2021-01-03T13:54:14.186 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2021-01-03T13:54:14.313 INFO:tasks.ceph:Archiving mon data... 2021-01-03T13:54:14.315 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047/data/mon.a.tgz 2021-01-03T13:54:14.316 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2021-01-03T13:54:14.322 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.6UcqjznRvL 2021-01-03T13:54:14.323 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.6UcqjznRvL 2021-01-03T13:54:14.576 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.6UcqjznRvL 2021-01-03T13:54:14.640 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.6UcqjznRvL is 585KB 2021-01-03T13:54:14.707 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.6UcqjznRvL 2021-01-03T13:54:14.713 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047/data/mon.b.tgz 2021-01-03T13:54:14.714 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2021-01-03T13:54:14.720 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.borGTu09QA 2021-01-03T13:54:14.721 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.borGTu09QA 2021-01-03T13:54:14.975 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.borGTu09QA 2021-01-03T13:54:15.038 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.borGTu09QA is 531KB 2021-01-03T13:54:15.101 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.borGTu09QA 2021-01-03T13:54:15.108 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047/data/mon.c.tgz 2021-01-03T13:54:15.108 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2021-01-03T13:54:15.156 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.VOjfx0maLx 2021-01-03T13:54:15.157 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.VOjfx0maLx 2021-01-03T13:54:15.424 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.VOjfx0maLx 2021-01-03T13:54:15.490 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.VOjfx0maLx is 585KB 2021-01-03T13:54:15.553 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.VOjfx0maLx 2021-01-03T13:54:15.560 INFO:tasks.ceph:Cleaning ceph cluster... 2021-01-03T13:54:15.561 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-01-03T13:54:15.563 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-01-03T13:54:15.604 DEBUG:teuthology.orchestra.run.smithi036:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-01-03T13:54:15.607 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-01-03T13:54:15.622 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2021-01-03T13:54:15.623 DEBUG:teuthology.orchestra.run.smithi133:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-01-03T13:54:15.666 DEBUG:teuthology.orchestra.run.smithi016:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-01-03T13:54:15.669 DEBUG:teuthology.orchestra.run.smithi007:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-01-03T13:54:15.671 DEBUG:teuthology.orchestra.run.smithi036:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-01-03T13:54:15.703 INFO:teuthology.orchestra.run.smithi016.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-01-03T13:54:15.707 INFO:teuthology.orchestra.run.smithi036.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-01-03T13:54:15.711 INFO:teuthology.orchestra.run.smithi007.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-01-03T13:54:15.964 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-01-03T13:54:15.971 INFO:tasks.ceph:Archiving crash dumps... 2021-01-03T13:54:15.974 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047/remote/smithi133/crash 2021-01-03T13:54:15.975 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-01-03T13:54:15.994 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047/remote/smithi016/crash 2021-01-03T13:54:15.996 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-01-03T13:54:16.015 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047/remote/smithi007/crash 2021-01-03T13:54:16.017 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-01-03T13:54:16.037 DEBUG:teuthology.misc:Transferring archived files from smithi036:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047/remote/smithi036/crash 2021-01-03T13:54:16.038 DEBUG:teuthology.orchestra.run.smithi036:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-01-03T13:54:16.057 INFO:tasks.ceph:Shutting down logrotate 2021-01-03T13:54:16.058 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:54:16.078 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:54:16.080 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:54:16.102 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2021-01-03T13:54:16.151 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-01-03T13:54:16.166 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-01-03T13:54:16.181 DEBUG:teuthology.orchestra.run.smithi036:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-01-03T13:54:16.196 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm /etc/logrotate.d/ceph-test.conf 2021-01-03T13:54:16.211 INFO:tasks.ceph:Compressing logs... 2021-01-03T13:54:16.212 DEBUG:teuthology.orchestra.run.smithi007:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-01-03T13:54:16.215 DEBUG:teuthology.orchestra.run.smithi016:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-01-03T13:54:16.224 DEBUG:teuthology.orchestra.run.smithi036:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-01-03T13:54:16.242 DEBUG:teuthology.orchestra.run.smithi133:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-01-03T13:54:18.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2021-01-03T13:54:41.001 INFO:tasks.ceph:Archiving logs... 2021-01-03T13:54:41.002 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047/remote/smithi133/log 2021-01-03T13:54:41.003 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/log/ceph -- . 2021-01-03T13:54:45.755 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047/remote/smithi016/log 2021-01-03T13:54:45.756 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/log/ceph -- . 2021-01-03T13:54:49.889 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047/remote/smithi007/log 2021-01-03T13:54:49.890 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /var/log/ceph -- . 2021-01-03T13:54:50.259 DEBUG:teuthology.misc:Transferring archived files from smithi036:/var/log/ceph to /home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047/remote/smithi036/log 2021-01-03T13:54:50.261 DEBUG:teuthology.orchestra.run.smithi036:> sudo tar cz -f - -C /var/log/ceph -- . 2021-01-03T13:54:50.289 DEBUG:teuthology.run_tasks:Unwinding manager install 2021-01-03T13:54:50.303 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/install/__init__.py", line 619, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 173, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/ceph_fuse.py", line 159, in task if mount.is_mounted(): File "/home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 683, in gevent._greenlet.Greenlet.get File "src/gevent/greenlet.py", line 317, in gevent._greenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 47, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2021-01-03T13:54:50.303 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2021-01-03T13:54:50.304 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-01-03T13:54:50.307 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-01-03T13:54:50.309 DEBUG:teuthology.orchestra.run.smithi036:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-01-03T13:54:50.330 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-01-03T13:54:50.416 DEBUG:teuthology.run_tasks:Unwinding manager clock 2021-01-03T13:54:50.428 INFO:teuthology.task.clock:Checking final clock skew... 2021-01-03T13:54:50.428 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-03T13:54:50.454 INFO:teuthology.orchestra.run.smithi133.stdout: remote refid st t when poll reach delay offset jitter 2021-01-03T13:54:50.454 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================== 2021-01-03T13:54:50.454 INFO:teuthology.orchestra.run.smithi133.stdout:-hv01.front.sepi 216.240.36.24 3 u 14 128 377 0.153 -2.940 0.155 2021-01-03T13:54:50.454 INFO:teuthology.orchestra.run.smithi133.stdout:*hv02.front.sepi 163.237.218.18 2 u 21 128 377 0.155 -1.518 0.548 2021-01-03T13:54:50.455 INFO:teuthology.orchestra.run.smithi133.stdout:+hv03.front.sepi 74.6.168.72 3 u 81 128 377 0.143 -1.562 0.292 2021-01-03T13:54:50.455 INFO:teuthology.orchestra.run.smithi133.stdout:+hv04.front.sepi 144.172.126.201 3 u 7 128 377 0.109 -1.828 0.494 2021-01-03T13:54:50.456 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-03T13:54:50.480 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2021-01-03T13:54:50.480 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2021-01-03T13:54:50.480 INFO:teuthology.orchestra.run.smithi016.stdout:-hv01.front.sepi 216.240.36.24 3 u 5 128 377 0.169 -1.643 0.164 2021-01-03T13:54:50.480 INFO:teuthology.orchestra.run.smithi016.stdout:*hv02.front.sepi 163.237.218.18 2 u 2 256 377 0.188 -0.541 0.150 2021-01-03T13:54:50.481 INFO:teuthology.orchestra.run.smithi016.stdout:+hv03.front.sepi 74.6.168.72 3 u 59 128 377 0.170 -0.435 0.057 2021-01-03T13:54:50.481 INFO:teuthology.orchestra.run.smithi016.stdout:+hv04.front.sepi 144.172.126.201 3 u 118 128 377 0.116 -0.683 0.199 2021-01-03T13:54:50.482 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-03T13:54:50.505 INFO:teuthology.orchestra.run.smithi007.stdout: remote refid st t when poll reach delay offset jitter 2021-01-03T13:54:50.505 INFO:teuthology.orchestra.run.smithi007.stdout:============================================================================== 2021-01-03T13:54:50.506 INFO:teuthology.orchestra.run.smithi007.stdout:-hv01.front.sepi 216.240.36.24 3 u 129 128 377 0.141 -2.252 0.125 2021-01-03T13:54:50.506 INFO:teuthology.orchestra.run.smithi007.stdout:*hv02.front.sepi 163.237.218.18 2 u 6 128 377 0.169 -1.100 0.218 2021-01-03T13:54:50.506 INFO:teuthology.orchestra.run.smithi007.stdout:+hv03.front.sepi 74.6.168.72 3 u 119 128 377 0.206 -1.062 0.161 2021-01-03T13:54:50.506 INFO:teuthology.orchestra.run.smithi007.stdout:+hv04.front.sepi 144.172.126.201 3 u 58 128 377 0.148 -1.119 0.393 2021-01-03T13:54:50.507 DEBUG:teuthology.orchestra.run.smithi036:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-03T13:54:50.531 INFO:teuthology.orchestra.run.smithi036.stdout: remote refid st t when poll reach delay offset jitter 2021-01-03T13:54:50.531 INFO:teuthology.orchestra.run.smithi036.stdout:============================================================================== 2021-01-03T13:54:50.532 INFO:teuthology.orchestra.run.smithi036.stdout:-hv01.front.sepi 216.240.36.24 3 u 1 128 377 0.179 -2.821 0.079 2021-01-03T13:54:50.532 INFO:teuthology.orchestra.run.smithi036.stdout:*hv02.front.sepi 163.237.218.18 2 u 55 128 377 0.174 -1.499 0.394 2021-01-03T13:54:50.532 INFO:teuthology.orchestra.run.smithi036.stdout:+hv03.front.sepi 74.6.168.72 3 u 39 128 377 0.178 -1.858 0.309 2021-01-03T13:54:50.532 INFO:teuthology.orchestra.run.smithi036.stdout:+hv04.front.sepi 144.172.126.201 3 u 125 128 377 0.155 -1.876 0.292 2021-01-03T13:54:50.533 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2021-01-03T13:54:50.543 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2021-01-03T13:54:50.544 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2021-01-03T13:54:50.555 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-01-03T13:54:50.568 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2021-01-03T13:54:50.583 INFO:teuthology.task.internal:Duration was 3744.758021 seconds 2021-01-03T13:54:50.584 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2021-01-03T13:54:50.595 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-01-03T13:54:50.596 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-01-03T13:54:50.598 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-01-03T13:54:50.601 DEBUG:teuthology.orchestra.run.smithi036:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-01-03T13:54:50.604 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-01-03T13:54:50.655 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-01-03T13:54:50.656 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2021-01-03T13:54:50.656 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-01-03T13:54:50.669 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2021-01-03T13:54:50.669 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-01-03T13:54:50.684 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2021-01-03T13:54:50.684 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-01-03T13:54:50.699 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi036.front.sepia.ceph.com 2021-01-03T13:54:50.699 DEBUG:teuthology.orchestra.run.smithi036:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-01-03T13:54:50.717 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2021-01-03T13:54:50.717 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-01-03T13:54:50.746 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-01-03T13:54:50.749 DEBUG:teuthology.orchestra.run.smithi036:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-01-03T13:54:50.762 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-01-03T13:54:50.796 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2021-01-03T13:54:50.808 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2021-01-03T13:54:50.808 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-01-03T13:54:50.827 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-01-03T13:54:50.843 DEBUG:teuthology.orchestra.run.smithi036:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-01-03T13:54:50.859 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-01-03T13:54:50.874 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2021-01-03T13:54:50.894 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-01-03T13:54:50.897 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-01-03T13:54:50.899 DEBUG:teuthology.orchestra.run.smithi036:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-01-03T13:54:50.902 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-01-03T13:54:50.908 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2021-01-03T13:54:50.911 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2021-01-03T13:54:50.914 INFO:teuthology.orchestra.run.smithi036.stdout:kernel.core_pattern = core 2021-01-03T13:54:50.929 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2021-01-03T13:54:50.975 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2021-01-03T13:54:51.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:54:51.022 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2021-01-03T13:54:51.027 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:54:51.028 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2021-01-03T13:54:51.034 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:54:51.034 DEBUG:teuthology.orchestra.run.smithi036:> test -e /home/ubuntu/cephtest/archive/coredump 2021-01-03T13:54:51.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-03T13:54:51.041 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2021-01-03T13:54:51.051 INFO:teuthology.task.internal:Transferring archived files... 2021-01-03T13:54:51.052 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047/remote/smithi133 2021-01-03T13:54:51.052 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-01-03T13:54:51.087 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047/remote/smithi016 2021-01-03T13:54:51.088 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-01-03T13:54:51.111 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047/remote/smithi007 2021-01-03T13:54:51.111 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-01-03T13:54:51.135 DEBUG:teuthology.misc:Transferring archived files from smithi036:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2021-01-03_04:10:03-fs-octopus-distro-basic-smithi/5752047/remote/smithi036 2021-01-03T13:54:51.135 DEBUG:teuthology.orchestra.run.smithi036:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-01-03T13:54:51.158 INFO:teuthology.task.internal:Removing archive directory... 2021-01-03T13:54:51.158 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2021-01-03T13:54:51.178 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf -- /home/ubuntu/cephtest/archive 2021-01-03T13:54:51.181 DEBUG:teuthology.orchestra.run.smithi036:> rm -rf -- /home/ubuntu/cephtest/archive 2021-01-03T13:54:51.206 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2021-01-03T13:54:51.213 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2021-01-03T13:54:51.224 INFO:teuthology.task.internal:Not uploading archives. 2021-01-03T13:54:51.225 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2021-01-03T13:54:51.237 INFO:teuthology.task.internal:Tidying up after the test... 2021-01-03T13:54:51.237 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-01-03T13:54:51.240 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-01-03T13:54:51.243 DEBUG:teuthology.orchestra.run.smithi036:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-01-03T13:54:51.248 INFO:teuthology.orchestra.run.smithi016.stdout: 524332 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 3 13:54 /home/ubuntu/cephtest 2021-01-03T13:54:51.254 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-01-03T13:54:51.259 INFO:teuthology.orchestra.run.smithi036.stdout: 524332 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 3 13:54 /home/ubuntu/cephtest 2021-01-03T13:54:51.263 INFO:teuthology.orchestra.run.smithi133.stdout: 524332 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 3 13:54 /home/ubuntu/cephtest 2021-01-04T00:38:57.268 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2021-01-04T00:38:57.313 DEBUG:teuthology.task.console_log:Killing console logger for smithi133 2021-01-04T00:38:57.314 DEBUG:teuthology.task.console_log:Killing console logger for smithi016 2021-01-04T00:38:57.314 DEBUG:teuthology.task.console_log:Killing console logger for smithi007 2021-01-04T00:38:57.315 DEBUG:teuthology.task.console_log:Killing console logger for smithi036 2021-01-04T00:38:57.315 DEBUG:teuthology.task.console_log:Killing console logger for smithi133 2021-01-04T00:38:57.316 DEBUG:teuthology.task.console_log:Killing console logger for smithi016 2021-01-04T00:38:57.316 DEBUG:teuthology.task.console_log:Killing console logger for smithi007 2021-01-04T00:38:57.316 DEBUG:teuthology.task.console_log:Killing console logger for smithi036 2021-01-04T00:38:57.317 DEBUG:teuthology.exit:Finished running handlers